2024-09-18T12:29:14.972 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-18T12:29:14.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T12:29:15.095 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911383 branch: wip-guits-main-2024-09-17-1213 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: gabrioux@redhat.com first_in_suite: false job_id: '7911383' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/squid ' name: gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-guits-main-2024-09-17-1213 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-guits-main-2024-09-17-1213 sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e owner: scheduled_gabrioux@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 8982 sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-main-2024-09-17-1213 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e targets: smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP66wcVZVHrXl4ljuh7XDZctdjqjkTeGYLlTInw3WP3XjxJm5+I1GsskqQIzQP8oYYCGT8skwiqsAo7ZDJwImX8= smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAsfdAKkB4HMeWB/5GzbQ+8M4oeX8dnSv7YV7s7UeWdIphZt/b79O3F8SW/yWzXDnX/7aMU0QTW5+moIfgQWcyk= tasks: - install: branch: squid exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: squid conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:squid roleless: true - print: '**** done end installing squid cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_12:14:13 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: gabrioux verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-18T12:29:15.095 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa; will attempt to use it 2024-09-18T12:29:15.096 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks 2024-09-18T12:29:15.096 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-18T12:29:15.098 INFO:teuthology.task.internal:Checking packages... 2024-09-18T12:29:15.118 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e' 2024-09-18T12:29:15.118 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:29:15.118 INFO:teuthology.packaging:ref: None 2024-09-18T12:29:15.119 INFO:teuthology.packaging:tag: None 2024-09-18T12:29:15.119 INFO:teuthology.packaging:branch: wip-guits-main-2024-09-17-1213 2024-09-18T12:29:15.119 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:29:15.119 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-guits-main-2024-09-17-1213 2024-09-18T12:29:15.267 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4983.ge7fb7b56 2024-09-18T12:29:15.269 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-18T12:29:15.277 INFO:teuthology.task.internal:no buildpackages task found 2024-09-18T12:29:15.277 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-18T12:29:15.292 INFO:teuthology.task.internal:Saving configuration 2024-09-18T12:29:15.312 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-18T12:29:15.318 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-18T12:29:15.344 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911383', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 12:24:15.574658', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP66wcVZVHrXl4ljuh7XDZctdjqjkTeGYLlTInw3WP3XjxJm5+I1GsskqQIzQP8oYYCGT8skwiqsAo7ZDJwImX8='} 2024-09-18T12:29:15.367 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911383', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 12:24:15.576569', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAsfdAKkB4HMeWB/5GzbQ+8M4oeX8dnSv7YV7s7UeWdIphZt/b79O3F8SW/yWzXDnX/7aMU0QTW5+moIfgQWcyk='} 2024-09-18T12:29:15.367 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-18T12:29:15.373 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-18T12:29:15.374 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-18T12:29:15.374 INFO:teuthology.run_tasks:Running task console_log... 2024-09-18T12:29:15.451 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff11955feb0>, signals=[15]) 2024-09-18T12:29:15.451 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-18T12:29:15.458 INFO:teuthology.task.internal:Opening connections... 2024-09-18T12:29:15.458 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2024-09-18T12:29:15.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:29:15.538 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2024-09-18T12:29:15.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:29:15.614 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-18T12:29:15.622 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-09-18T12:29:15.641 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-09-18T12:29:15.641 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-09-18T12:29:15.698 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2024-09-18T12:29:15.698 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9" 2024-09-18T12:29:15.698 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2024-09-18T12:29:15.698 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2024-09-18T12:29:15.698 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9" 2024-09-18T12:29:15.698 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9" 2024-09-18T12:29:15.698 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T12:29:15.699 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2024-09-18T12:29:15.699 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon" 2024-09-18T12:29:15.699 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T12:29:15.699 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2024-09-18T12:29:15.699 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T12:29:15.699 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T12:29:15.699 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T12:29:15.700 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-09-18T12:29:15.714 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-09-18T12:29:15.731 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-09-18T12:29:15.731 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-09-18T12:29:15.788 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-09-18T12:29:15.788 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-09-18T12:29:15.788 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-09-18T12:29:15.789 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-09-18T12:29:15.789 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-09-18T12:29:15.789 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-09-18T12:29:15.789 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T12:29:15.789 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-09-18T12:29:15.789 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-09-18T12:29:15.789 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T12:29:15.789 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-09-18T12:29:15.789 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T12:29:15.789 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T12:29:15.790 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T12:29:15.790 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-09-18T12:29:15.805 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-18T12:29:15.815 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-18T12:29:15.824 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-18T12:29:15.824 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2024-09-18T12:29:15.827 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2024-09-18T12:29:15.844 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-18T12:29:15.850 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-18T12:29:15.850 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2024-09-18T12:29:15.883 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2024-09-18T12:29:15.991 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-18T12:29:16.047 INFO:teuthology.run_tasks:Running task kernel... 2024-09-18T12:29:16.061 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-18T12:29:16.061 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-18T12:29:16.062 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T12:29:16.062 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T12:29:16.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:29:16.080 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-18T12:29:16.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:29:16.081 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-18T12:29:16.137 INFO:teuthology.orchestra.run.smithi078.stdout:5.14.0-503.el9.x86_64 2024-09-18T12:29:16.137 INFO:teuthology.task.kernel:Running kernel on smithi078: 5.14.0-503.el9.x86_64 2024-09-18T12:29:16.138 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum install -y kernel 2024-09-18T12:29:16.139 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-503.el9.x86_64 2024-09-18T12:29:16.139 INFO:teuthology.task.kernel:Running kernel on smithi148: 5.14.0-503.el9.x86_64 2024-09-18T12:29:16.140 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum install -y kernel 2024-09-18T12:29:18.605 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-18T12:29:18.753 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.3 MB 00:00 2024-09-18T12:29:20.540 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-18T12:29:23.096 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 20 MB 00:03 2024-09-18T12:29:25.990 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-18T12:29:27.907 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 19 kB 00:00 2024-09-18T12:29:28.472 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-18T12:29:29.128 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-18T12:29:29.964 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-18T12:29:31.060 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-18T12:29:34.517 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-18T12:29:36.407 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T12:29:36.407 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T12:29:36.482 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-18T12:29:36.503 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:29:36.512 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:29:36.513 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-18T12:29:36.513 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:29:36.513 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:29:36.513 INFO:teuthology.orchestra.run.smithi148.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T12:29:36.513 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-18T12:29:36.513 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T12:29:36.513 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T12:29:36.513 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T12:29:36.513 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:29:36.513 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:29:36.513 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:29:36.513 INFO:teuthology.orchestra.run.smithi148.stdout:Install 4 Packages 2024-09-18T12:29:36.513 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:29:36.517 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 79 M 2024-09-18T12:29:36.517 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 126 M 2024-09-18T12:29:36.517 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:29:36.935 INFO:teuthology.orchestra.run.smithi148.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 171 kB/s | 36 kB 00:00 2024-09-18T12:29:38.372 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T12:29:38.373 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T12:29:38.466 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:29:38.477 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:29:38.477 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2024-09-18T12:29:38.477 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:29:38.477 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:29:38.477 INFO:teuthology.orchestra.run.smithi078.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T12:29:38.477 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-18T12:29:38.477 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T12:29:38.477 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T12:29:38.477 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T12:29:38.478 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:29:38.478 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:29:38.478 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:29:38.478 INFO:teuthology.orchestra.run.smithi078.stdout:Install 4 Packages 2024-09-18T12:29:38.478 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:29:38.478 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 79 M 2024-09-18T12:29:38.478 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 126 M 2024-09-18T12:29:38.478 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:29:38.717 INFO:teuthology.orchestra.run.smithi078.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 309 kB/s | 36 kB 00:00 2024-09-18T12:29:39.843 INFO:teuthology.orchestra.run.smithi148.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 5.0 MB/s | 16 MB 00:03 2024-09-18T12:29:41.510 INFO:teuthology.orchestra.run.smithi148.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 6.2 MB/s | 29 MB 00:04 2024-09-18T12:29:42.793 INFO:teuthology.orchestra.run.smithi148.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 5.7 MB/s | 35 MB 00:06 2024-09-18T12:29:42.794 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:29:42.794 INFO:teuthology.orchestra.run.smithi148.stdout:Total 13 MB/s | 79 MB 00:06 2024-09-18T12:29:43.481 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:29:43.818 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:29:43.818 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:29:44.292 INFO:teuthology.orchestra.run.smithi078.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.8 MB/s | 16 MB 00:05 2024-09-18T12:29:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:29:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:29:44.976 INFO:teuthology.orchestra.run.smithi078.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 5.4 MB/s | 35 MB 00:06 2024-09-18T12:29:47.220 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:29:47.896 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:29:47.985 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:29:49.942 INFO:teuthology.orchestra.run.smithi078.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.5 MB/s | 29 MB 00:11 2024-09-18T12:29:49.942 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:29:49.943 INFO:teuthology.orchestra.run.smithi078.stdout:Total 6.9 MB/s | 79 MB 00:11 2024-09-18T12:29:50.620 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:29:50.767 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:29:50.911 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:29:50.971 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:29:50.971 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:29:51.935 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:29:51.936 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:29:54.423 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:29:55.105 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:29:55.193 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:29:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:29:55.853 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:29:58.040 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:29:58.164 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:30:00.726 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:30:02.974 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:30:03.014 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:30:07.915 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:30:38.835 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:30:38.875 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:30:39.211 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:30:39.211 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:30:39.211 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:30:39.211 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:30:40.050 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:30:40.051 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:30:40.051 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:30:40.051 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T12:30:40.051 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T12:30:40.051 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T12:30:40.051 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T12:30:40.051 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:30:40.051 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:30:40.403 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:30:40.478 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:30:40.479 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:30:40.479 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T12:30:40.479 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T12:30:40.479 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T12:30:40.479 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-18T12:30:40.479 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T12:30:40.479 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:30:40.537 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:30:40.538 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:30:40.539 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -qi grub2-tools 2024-09-18T12:30:40.578 INFO:teuthology.orchestra.run.smithi148.stdout:Name : grub2-tools 2024-09-18T12:30:40.578 INFO:teuthology.orchestra.run.smithi148.stdout:Epoch : 1 2024-09-18T12:30:40.578 INFO:teuthology.orchestra.run.smithi148.stdout:Version : 2.06 2024-09-18T12:30:40.578 INFO:teuthology.orchestra.run.smithi148.stdout:Release : 82.el9 2024-09-18T12:30:40.579 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: x86_64 2024-09-18T12:30:40.579 INFO:teuthology.orchestra.run.smithi148.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T12:30:40.579 INFO:teuthology.orchestra.run.smithi148.stdout:Group : Unspecified 2024-09-18T12:30:40.579 INFO:teuthology.orchestra.run.smithi148.stdout:Size : 8274670 2024-09-18T12:30:40.579 INFO:teuthology.orchestra.run.smithi148.stdout:License : GPLv3+ 2024-09-18T12:30:40.579 INFO:teuthology.orchestra.run.smithi148.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T12:30:40.579 INFO:teuthology.orchestra.run.smithi148.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T12:30:40.579 INFO:teuthology.orchestra.run.smithi148.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T12:30:40.579 INFO:teuthology.orchestra.run.smithi148.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T12:30:40.579 INFO:teuthology.orchestra.run.smithi148.stdout:Packager : builder@centos.org 2024-09-18T12:30:40.579 INFO:teuthology.orchestra.run.smithi148.stdout:Vendor : CentOS 2024-09-18T12:30:40.579 INFO:teuthology.orchestra.run.smithi148.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T12:30:40.580 INFO:teuthology.orchestra.run.smithi148.stdout:Summary : Support tools for GRUB. 2024-09-18T12:30:40.580 INFO:teuthology.orchestra.run.smithi148.stdout:Description : 2024-09-18T12:30:40.580 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:30:40.580 INFO:teuthology.orchestra.run.smithi148.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T12:30:40.580 INFO:teuthology.orchestra.run.smithi148.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T12:30:40.580 INFO:teuthology.orchestra.run.smithi148.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T12:30:40.580 INFO:teuthology.orchestra.run.smithi148.stdout:hardware devices. 2024-09-18T12:30:40.580 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:30:40.580 INFO:teuthology.orchestra.run.smithi148.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T12:30:40.581 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T12:30:40.581 INFO:teuthology.task.kernel:Updating grub on smithi148 to boot 5.14.0-508.el9.x86_64 2024-09-18T12:30:40.581 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T12:30:41.285 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2024-09-18T12:30:42.612 INFO:teuthology.orchestra.run.smithi148.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T12:30:42.644 INFO:teuthology.orchestra.run.smithi148.stderr:done 2024-09-18T12:30:42.646 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-09-18T12:30:42.662 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.lojOZjZHBG 2024-09-18T12:30:42.662 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lojOZjZHBG 2024-09-18T12:30:42.728 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.lojOZjZHBG 2024-09-18T12:30:42.865 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.lojOZjZHBG is 6KB 2024-09-18T12:30:42.914 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.lojOZjZHBG 2024-09-18T12:30:42.929 DEBUG:teuthology.orchestra.run.smithi148:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T12:30:42.993 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T12:30:42.993 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T12:30:42.993 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T12:30:42.993 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T12:30:42.994 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T12:30:43.147 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2024-09-18T12:30:46.067 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:30:46.107 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:30:46.423 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:30:46.423 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:30:46.423 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:30:46.423 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:30:47.292 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:30:47.293 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:30:47.293 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:30:47.293 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T12:30:47.293 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T12:30:47.293 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T12:30:47.293 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T12:30:47.293 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:30:47.293 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:30:47.674 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:30:47.755 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:30:47.755 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:30:47.755 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T12:30:47.756 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T12:30:47.756 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T12:30:47.756 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-18T12:30:47.756 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T12:30:47.756 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:30:47.815 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:30:47.815 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:30:47.815 DEBUG:teuthology.orchestra.run.smithi078:> sudo rpm -qi grub2-tools 2024-09-18T12:30:47.857 INFO:teuthology.orchestra.run.smithi078.stdout:Name : grub2-tools 2024-09-18T12:30:47.858 INFO:teuthology.orchestra.run.smithi078.stdout:Epoch : 1 2024-09-18T12:30:47.858 INFO:teuthology.orchestra.run.smithi078.stdout:Version : 2.06 2024-09-18T12:30:47.858 INFO:teuthology.orchestra.run.smithi078.stdout:Release : 82.el9 2024-09-18T12:30:47.858 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: x86_64 2024-09-18T12:30:47.858 INFO:teuthology.orchestra.run.smithi078.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T12:30:47.858 INFO:teuthology.orchestra.run.smithi078.stdout:Group : Unspecified 2024-09-18T12:30:47.858 INFO:teuthology.orchestra.run.smithi078.stdout:Size : 8274670 2024-09-18T12:30:47.858 INFO:teuthology.orchestra.run.smithi078.stdout:License : GPLv3+ 2024-09-18T12:30:47.858 INFO:teuthology.orchestra.run.smithi078.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T12:30:47.858 INFO:teuthology.orchestra.run.smithi078.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T12:30:47.858 INFO:teuthology.orchestra.run.smithi078.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T12:30:47.858 INFO:teuthology.orchestra.run.smithi078.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T12:30:47.858 INFO:teuthology.orchestra.run.smithi078.stdout:Packager : builder@centos.org 2024-09-18T12:30:47.859 INFO:teuthology.orchestra.run.smithi078.stdout:Vendor : CentOS 2024-09-18T12:30:47.859 INFO:teuthology.orchestra.run.smithi078.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T12:30:47.859 INFO:teuthology.orchestra.run.smithi078.stdout:Summary : Support tools for GRUB. 2024-09-18T12:30:47.859 INFO:teuthology.orchestra.run.smithi078.stdout:Description : 2024-09-18T12:30:47.859 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:30:47.859 INFO:teuthology.orchestra.run.smithi078.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T12:30:47.859 INFO:teuthology.orchestra.run.smithi078.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T12:30:47.859 INFO:teuthology.orchestra.run.smithi078.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T12:30:47.859 INFO:teuthology.orchestra.run.smithi078.stdout:hardware devices. 2024-09-18T12:30:47.859 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:30:47.859 INFO:teuthology.orchestra.run.smithi078.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T12:30:47.860 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T12:30:47.860 INFO:teuthology.task.kernel:Updating grub on smithi078 to boot 5.14.0-508.el9.x86_64 2024-09-18T12:30:47.860 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T12:30:48.563 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2024-09-18T12:30:49.882 INFO:teuthology.orchestra.run.smithi078.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T12:30:49.914 INFO:teuthology.orchestra.run.smithi078.stderr:done 2024-09-18T12:30:49.916 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-18T12:30:49.959 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.bkz4KPvvU0 2024-09-18T12:30:49.960 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bkz4KPvvU0 2024-09-18T12:30:50.032 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.bkz4KPvvU0 2024-09-18T12:30:50.187 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.bkz4KPvvU0 is 6KB 2024-09-18T12:30:50.236 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.bkz4KPvvU0 2024-09-18T12:30:50.251 DEBUG:teuthology.orchestra.run.smithi078:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T12:30:50.313 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T12:30:50.314 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T12:30:50.314 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T12:30:50.314 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T12:30:50.315 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T12:30:50.456 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2024-09-18T12:31:13.172 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-18T12:31:13.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-18T12:31:13.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:31:20.465 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-18T12:31:20.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-18T12:31:20.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:32:13.230 DEBUG:teuthology.orchestra.remote:timed out 2024-09-18T12:32:20.473 DEBUG:teuthology.orchestra.remote:timed out 2024-09-18T12:32:22.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-18T12:32:22.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:32:29.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-18T12:32:29.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:32:29.923 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-18T12:32:29.978 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-18T12:32:30.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-18T12:32:30.269 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-18T12:32:30.269 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-18T12:32:30.283 INFO:teuthology.orchestra.run.smithi078.stdout:5.14.0-508.el9.x86_64 2024-09-18T12:32:30.284 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T12:32:30.284 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T12:32:30.284 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T12:32:30.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-18T12:32:30.350 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-18T12:32:30.350 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-18T12:32:30.365 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-508.el9.x86_64 2024-09-18T12:32:30.365 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T12:32:30.365 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T12:32:30.365 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T12:32:31.284 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-18T12:32:31.285 DEBUG:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T12:32:31.366 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-18T12:32:31.367 DEBUG:teuthology.orchestra.run.smithi148:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T12:32:31.393 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2024-09-18T12:32:31.412 DEBUG:teuthology.parallel:result is None 2024-09-18T12:32:31.469 INFO:teuthology.orchestra.run.smithi148.stdout:ttyS1 2024-09-18T12:32:31.499 DEBUG:teuthology.parallel:result is None 2024-09-18T12:32:31.499 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-18T12:32:31.506 INFO:teuthology.task.internal:Creating test directory... 2024-09-18T12:32:31.506 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T12:32:31.508 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T12:32:31.524 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-18T12:32:31.530 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-18T12:32:31.539 INFO:teuthology.task.internal:Creating archive directory... 2024-09-18T12:32:31.539 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T12:32:31.563 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T12:32:31.589 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-18T12:32:31.595 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-18T12:32:31.595 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T12:32:31.626 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T12:32:31.658 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:32:31.660 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:32:31.668 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:32:31.671 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:32:31.673 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-18T12:32:31.680 INFO:teuthology.task.internal:Configuring sudo... 2024-09-18T12:32:31.680 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T12:32:31.711 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T12:32:31.736 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-18T12:32:31.746 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-18T12:32:31.746 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T12:32:31.775 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T12:32:31.790 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:32:31.877 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:32:31.910 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:32:31.994 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:32:32.033 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:32:32.034 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T12:32:32.098 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:32:32.142 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:32:32.204 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:32:32.244 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:32:32.283 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-18T12:32:32.283 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T12:32:32.344 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2024-09-18T12:32:32.346 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2024-09-18T12:32:32.388 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T12:32:32.427 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T12:32:32.663 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-18T12:32:32.671 INFO:teuthology.task.internal:Starting timer... 2024-09-18T12:32:32.671 INFO:teuthology.run_tasks:Running task pcp... 2024-09-18T12:32:32.681 INFO:teuthology.run_tasks:Running task selinux... 2024-09-18T12:32:32.689 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-18T12:32:32.689 DEBUG:teuthology.orchestra.run.smithi078:> sudo service auditd rotate 2024-09-18T12:32:32.729 INFO:teuthology.orchestra.run.smithi078.stdout:Rotating logs: 2024-09-18T12:32:32.731 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2024-09-18T12:32:32.804 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: 2024-09-18T12:32:32.805 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-18T12:32:32.806 DEBUG:teuthology.orchestra.run.smithi078:> /usr/sbin/getenforce 2024-09-18T12:32:32.857 INFO:teuthology.orchestra.run.smithi078.stdout:Permissive 2024-09-18T12:32:32.857 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2024-09-18T12:32:32.878 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2024-09-18T12:32:32.878 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi078.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi148.front.sepia.ceph.com': 'permissive'} 2024-09-18T12:32:32.878 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-18T12:32:32.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:32:32.903 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-18T12:32:32.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:32:32.954 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-18T12:32:32.955 DEBUG:teuthology.orchestra.run.smithi078:> sudo /usr/sbin/setenforce permissive 2024-09-18T12:32:32.988 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2024-09-18T12:32:33.025 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-18T12:32:33.034 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-18T12:32:33.046 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-18T12:32:33.047 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi148.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-18T12:36:17.765 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com')] 2024-09-18T12:36:17.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-18T12:36:17.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:36:17.845 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-18T12:36:17.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-18T12:36:17.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-18T12:36:17.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:36:17.959 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-18T12:36:18.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-18T12:36:18.040 INFO:teuthology.run_tasks:Running task clock... 2024-09-18T12:36:18.057 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-18T12:36:18.058 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T12:36:18.059 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T12:36:18.062 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T12:36:18.062 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T12:36:18.088 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T12:36:18.103 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T12:36:18.111 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T12:36:18.125 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T12:36:18.127 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: ntpd: command not found 2024-09-18T12:36:18.138 INFO:teuthology.orchestra.run.smithi078.stdout:506 Cannot talk to daemon 2024-09-18T12:36:18.150 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2024-09-18T12:36:18.152 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T12:36:18.162 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2024-09-18T12:36:18.166 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T12:36:18.177 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T12:36:18.191 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T12:36:18.226 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2024-09-18T12:36:18.230 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T12:36:18.230 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-09-18T12:36:18.230 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:36:18.230 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:36:18.230 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:36:18.230 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:36:18.256 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-18T12:36:18.259 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T12:36:18.259 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-18T12:36:18.259 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:36:18.259 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:36:18.259 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:36:18.259 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:36:18.260 INFO:teuthology.run_tasks:Running task install... 2024-09-18T12:36:18.271 DEBUG:teuthology.task.install:project ceph 2024-09-18T12:36:18.271 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e'}} 2024-09-18T12:36:18.271 DEBUG:teuthology.task.install:config {'branch': 'squid', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e'} 2024-09-18T12:36:18.271 INFO:teuthology.task.install:Using flavor: default 2024-09-18T12:36:18.278 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-18T12:36:18.278 INFO:teuthology.task.install:extra packages: [] 2024-09-18T12:36:18.278 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e', 'tag': None, 'wait_for_package': False} 2024-09-18T12:36:18.279 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:36:18.279 INFO:teuthology.packaging:ref: None 2024-09-18T12:36:18.279 INFO:teuthology.packaging:tag: None 2024-09-18T12:36:18.279 INFO:teuthology.packaging:branch: squid 2024-09-18T12:36:18.279 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:36:18.280 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-18T12:36:18.283 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e', 'tag': None, 'wait_for_package': False} 2024-09-18T12:36:18.284 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:36:18.284 INFO:teuthology.packaging:ref: None 2024-09-18T12:36:18.284 INFO:teuthology.packaging:tag: None 2024-09-18T12:36:18.284 INFO:teuthology.packaging:branch: squid 2024-09-18T12:36:18.284 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:36:18.284 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-18T12:36:18.500 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/ 2024-09-18T12:36:18.501 INFO:teuthology.task.install.rpm:Package version is 19.2.0-0 2024-09-18T12:36:18.515 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/ 2024-09-18T12:36:18.515 INFO:teuthology.task.install.rpm:Package version is 19.2.0-0 2024-09-18T12:36:18.543 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T12:36:18.543 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:36:18.543 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T12:36:18.548 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T12:36:18.548 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-18T12:36:18.548 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T12:36:18.571 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T12:36:18.571 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:36:18.571 INFO:teuthology.packaging:ref: None 2024-09-18T12:36:18.571 INFO:teuthology.packaging:tag: None 2024-09-18T12:36:18.571 INFO:teuthology.packaging:branch: squid 2024-09-18T12:36:18.571 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:36:18.571 DEBUG:teuthology.orchestra.run.smithi078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T12:36:18.574 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T12:36:18.575 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:36:18.575 INFO:teuthology.packaging:ref: None 2024-09-18T12:36:18.575 INFO:teuthology.packaging:tag: None 2024-09-18T12:36:18.575 INFO:teuthology.packaging:branch: squid 2024-09-18T12:36:18.575 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:36:18.575 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T12:36:18.638 DEBUG:teuthology.orchestra.run.smithi078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T12:36:18.641 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T12:36:18.714 DEBUG:teuthology.orchestra.run.smithi078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T12:36:18.716 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T12:36:18.780 INFO:teuthology.orchestra.run.smithi078.stdout:check_obsoletes = 1 2024-09-18T12:36:18.781 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2024-09-18T12:36:18.782 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum clean all 2024-09-18T12:36:18.783 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2024-09-18T12:36:19.012 INFO:teuthology.orchestra.run.smithi148.stdout:45 files removed 2024-09-18T12:36:19.015 INFO:teuthology.orchestra.run.smithi078.stdout:45 files removed 2024-09-18T12:36:19.039 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw 2024-09-18T12:36:19.042 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-radosgw 2024-09-18T12:36:19.405 INFO:teuthology.orchestra.run.smithi078.stdout:ceph packages for x86_64 1.0 MB/s | 83 kB 00:00 2024-09-18T12:36:19.407 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 988 kB/s | 83 kB 00:00 2024-09-18T12:36:19.514 INFO:teuthology.orchestra.run.smithi078.stdout:ceph noarch packages 185 kB/s | 11 kB 00:00 2024-09-18T12:36:19.532 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 144 kB/s | 11 kB 00:00 2024-09-18T12:36:19.614 INFO:teuthology.orchestra.run.smithi078.stdout:ceph source packages 34 kB/s | 2.2 kB 00:00 2024-09-18T12:36:19.658 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 24 kB/s | 2.2 kB 00:00 2024-09-18T12:36:20.056 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.3 MB 00:00 2024-09-18T12:36:20.125 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.3 MB 00:00 2024-09-18T12:36:23.233 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 20 MB 00:02 2024-09-18T12:36:29.483 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-18T12:36:31.942 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-18T12:36:33.329 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-18T12:36:38.713 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-18T12:36:40.937 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:36:40.955 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:36:40.955 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-09-18T12:36:40.955 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:36:40.955 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:36:40.955 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw x86_64 2:19.2.0-0.el9 ceph 11 M 2024-09-18T12:36:40.955 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrading: 2024-09-18T12:36:40.955 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 x86_64 2:19.2.0-0.el9 ceph 3.4 M 2024-09-18T12:36:40.956 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1 x86_64 2:19.2.0-0.el9 ceph 3.2 M 2024-09-18T12:36:40.956 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-18T12:36:40.956 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-18T12:36:40.956 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-18T12:36:40.956 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common x86_64 2:19.2.0-0.el9 ceph 21 M 2024-09-18T12:36:40.956 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux x86_64 2:19.2.0-0.el9 ceph 25 k 2024-09-18T12:36:40.956 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T12:36:40.956 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-18T12:36:40.956 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-18T12:36:40.956 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2 x86_64 2:19.2.0-0.el9 ceph 751 k 2024-09-18T12:36:40.956 INFO:teuthology.orchestra.run.smithi078.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T12:36:40.957 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T12:36:40.957 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T12:36:40.957 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 x86_64 2:19.2.0-0.el9 ceph 506 k 2024-09-18T12:36:40.957 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T12:36:40.957 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-18T12:36:40.957 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T12:36:40.957 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T12:36:40.957 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-18T12:36:40.957 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse x86_64 2:19.2.0-0.el9 ceph 45 k 2024-09-18T12:36:40.957 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common x86_64 2:19.2.0-0.el9 ceph 135 k 2024-09-18T12:36:40.957 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs x86_64 2:19.2.0-0.el9 ceph 161 k 2024-09-18T12:36:40.957 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T12:36:40.958 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados x86_64 2:19.2.0-0.el9 ceph 320 k 2024-09-18T12:36:40.958 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd x86_64 2:19.2.0-0.el9 ceph 301 k 2024-09-18T12:36:40.958 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw x86_64 2:19.2.0-0.el9 ceph 99 k 2024-09-18T12:36:40.958 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-18T12:36:40.958 INFO:teuthology.orchestra.run.smithi078.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-18T12:36:40.958 INFO:teuthology.orchestra.run.smithi078.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-18T12:36:40.958 INFO:teuthology.orchestra.run.smithi078.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T12:36:40.958 INFO:teuthology.orchestra.run.smithi078.stdout:Installing weak dependencies: 2024-09-18T12:36:40.958 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-18T12:36:40.958 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:36:40.958 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:36:40.958 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:36:40.958 INFO:teuthology.orchestra.run.smithi078.stdout:Install 30 Packages 2024-09-18T12:36:40.959 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrade 2 Packages 2024-09-18T12:36:40.959 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:36:40.959 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 60 M 2024-09-18T12:36:40.959 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:36:41.371 INFO:teuthology.orchestra.run.smithi078.stdout:(1/32): ceph-base-19.2.0-0.el9.x86_64.rpm 47 MB/s | 5.4 MB 00:00 2024-09-18T12:36:41.396 INFO:teuthology.orchestra.run.smithi078.stdout:(2/32): ceph-selinux-19.2.0-0.el9.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-09-18T12:36:41.446 INFO:teuthology.orchestra.run.smithi078.stdout:(3/32): libcephfs2-19.2.0-0.el9.x86_64.rpm 15 MB/s | 751 kB 00:00 2024-09-18T12:36:41.480 INFO:teuthology.orchestra.run.smithi078.stdout:(4/32): libradosstriper1-19.2.0-0.el9.x86_64.rp 15 MB/s | 506 kB 00:00 2024-09-18T12:36:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:(5/32): librgw2-19.2.0-0.el9.x86_64.rpm 50 MB/s | 5.4 MB 00:00 2024-09-18T12:36:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:(6/32): python3-ceph-argparse-19.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-09-18T12:36:41.639 INFO:teuthology.orchestra.run.smithi078.stdout:(7/32): python3-ceph-common-19.2.0-0.el9.x86_64 5.3 MB/s | 135 kB 00:00 2024-09-18T12:36:41.640 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 20 MB 00:20 2024-09-18T12:36:41.664 INFO:teuthology.orchestra.run.smithi078.stdout:(8/32): python3-cephfs-19.2.0-0.el9.x86_64.rpm 6.3 MB/s | 161 kB 00:00 2024-09-18T12:36:41.690 INFO:teuthology.orchestra.run.smithi078.stdout:(9/32): python3-rados-19.2.0-0.el9.x86_64.rpm 12 MB/s | 320 kB 00:00 2024-09-18T12:36:41.715 INFO:teuthology.orchestra.run.smithi078.stdout:(10/32): python3-rbd-19.2.0-0.el9.x86_64.rpm 12 MB/s | 301 kB 00:00 2024-09-18T12:36:41.740 INFO:teuthology.orchestra.run.smithi078.stdout:(11/32): python3-rgw-19.2.0-0.el9.x86_64.rpm 3.9 MB/s | 99 kB 00:00 2024-09-18T12:36:41.857 INFO:teuthology.orchestra.run.smithi078.stdout:(12/32): ceph-radosgw-19.2.0-0.el9.x86_64.rpm 18 MB/s | 11 MB 00:00 2024-09-18T12:36:42.099 INFO:teuthology.orchestra.run.smithi078.stdout:(13/32): ceph-common-19.2.0-0.el9.x86_64.rpm 25 MB/s | 21 MB 00:00 2024-09-18T12:36:42.633 INFO:teuthology.orchestra.run.smithi078.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 120 kB/s | 107 kB 00:00 2024-09-18T12:36:42.675 INFO:teuthology.orchestra.run.smithi078.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-09-18T12:36:42.742 INFO:teuthology.orchestra.run.smithi078.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 181 kB/s | 160 kB 00:00 2024-09-18T12:36:43.308 INFO:teuthology.orchestra.run.smithi078.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 75 kB/s | 42 kB 00:00 2024-09-18T12:36:43.459 INFO:teuthology.orchestra.run.smithi078.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 373 kB/s | 292 kB 00:00 2024-09-18T12:36:43.501 INFO:teuthology.orchestra.run.smithi078.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 764 kB/s | 662 kB 00:00 2024-09-18T12:36:44.017 INFO:teuthology.orchestra.run.smithi078.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 64 kB/s | 36 kB 00:00 2024-09-18T12:36:44.059 INFO:teuthology.orchestra.run.smithi078.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 294 kB/s | 221 kB 00:00 2024-09-18T12:36:44.085 INFO:teuthology.orchestra.run.smithi078.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 81 kB/s | 47 kB 00:00 2024-09-18T12:36:44.135 INFO:teuthology.orchestra.run.smithi078.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-18T12:36:44.160 INFO:teuthology.orchestra.run.smithi078.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 384 kB/s | 26 kB 00:00 2024-09-18T12:36:44.185 INFO:teuthology.orchestra.run.smithi078.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 973 kB/s | 49 kB 00:00 2024-09-18T12:36:44.211 INFO:teuthology.orchestra.run.smithi078.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-18T12:36:44.278 INFO:teuthology.orchestra.run.smithi078.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-18T12:36:44.420 INFO:teuthology.orchestra.run.smithi078.stdout:(28/32): re2-20211101-20.el9.x86_64.rpm 918 kB/s | 191 kB 00:00 2024-09-18T12:36:44.470 INFO:teuthology.orchestra.run.smithi078.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 8.2 MB/s | 1.6 MB 00:00 2024-09-18T12:36:44.554 INFO:teuthology.orchestra.run.smithi078.stdout:(30/32): librados2-19.2.0-0.el9.x86_64.rpm 26 MB/s | 3.4 MB 00:00 2024-09-18T12:36:44.604 INFO:teuthology.orchestra.run.smithi078.stdout:(31/32): librbd1-19.2.0-0.el9.x86_64.rpm 24 MB/s | 3.2 MB 00:00 2024-09-18T12:36:44.671 INFO:teuthology.orchestra.run.smithi078.stdout:(32/32): libarrow-9.0.0-11.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-09-18T12:36:44.677 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:36:44.677 INFO:teuthology.orchestra.run.smithi078.stdout:Total 16 MB/s | 60 MB 00:03 2024-09-18T12:36:44.782 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:36:44.818 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:36:44.818 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:36:45.510 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:36:45.511 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:36:46.973 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:36:47.055 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-18T12:36:47.093 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-18T12:36:47.100 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-18T12:36:47.126 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-18T12:36:47.149 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T12:36:47.171 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T12:36:47.367 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T12:36:47.429 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T12:36:47.767 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-18T12:36:47.886 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-18T12:36:47.971 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-18T12:36:48.060 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-2:19.2.0-0.el9.x86_64 8/34 2024-09-18T12:36:48.088 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-18T12:36:48.151 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-18T12:36:48.187 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-18T12:36:48.231 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 11/34 2024-09-18T12:36:48.313 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-2:19.2.0-0.el9.x86_64 12/34 2024-09-18T12:36:48.356 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-18T12:36:48.421 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-18T12:36:48.455 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-18T12:36:48.564 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-18T12:36:48.598 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-18T12:36:48.647 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-18T12:36:48.687 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-18T12:36:48.716 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-18T12:36:48.759 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-18T12:36:48.808 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 19 kB 00:00 2024-09-18T12:36:49.084 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-18T12:36:49.121 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-18T12:36:49.195 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-18T12:36:49.226 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-2:19.2.0-0.el9.x86_64 23/34 2024-09-18T12:36:49.270 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-18T12:36:49.746 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-18T12:36:49.773 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-18T12:36:49.845 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-18T12:36:49.931 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-2:19.2.0-0.el9.x86_64 27/34 2024-09-18T12:36:49.967 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-common-2:19.2.0-0.el9.x86_64 28/34 2024-09-18T12:36:50.262 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-18T12:36:52.265 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-18T12:36:52.313 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-18T12:36:52.894 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-18T12:36:52.933 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-18T12:36:53.026 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-18T12:36:53.026 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T12:36:53.027 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T12:36:53.027 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:36:53.068 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-18T12:36:55.677 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-18T12:36:57.872 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:36:57.894 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:36:57.895 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-18T12:36:57.895 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:36:57.895 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:36:57.895 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:19.2.0-0.el9 ceph 11 M 2024-09-18T12:36:57.895 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2024-09-18T12:36:57.895 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:19.2.0-0.el9 ceph 3.4 M 2024-09-18T12:36:57.896 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:19.2.0-0.el9 ceph 3.2 M 2024-09-18T12:36:57.896 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-18T12:36:57.896 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-18T12:36:57.896 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-18T12:36:57.896 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:19.2.0-0.el9 ceph 21 M 2024-09-18T12:36:57.896 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:19.2.0-0.el9 ceph 25 k 2024-09-18T12:36:57.896 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T12:36:57.896 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-18T12:36:57.896 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-18T12:36:57.896 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:19.2.0-0.el9 ceph 751 k 2024-09-18T12:36:57.896 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T12:36:57.897 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T12:36:57.897 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T12:36:57.897 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:19.2.0-0.el9 ceph 506 k 2024-09-18T12:36:57.897 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T12:36:57.897 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-18T12:36:57.897 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T12:36:57.897 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T12:36:57.897 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-18T12:36:57.897 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:19.2.0-0.el9 ceph 45 k 2024-09-18T12:36:57.897 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:19.2.0-0.el9 ceph 135 k 2024-09-18T12:36:57.897 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:19.2.0-0.el9 ceph 161 k 2024-09-18T12:36:57.898 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T12:36:57.898 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:19.2.0-0.el9 ceph 320 k 2024-09-18T12:36:57.898 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:19.2.0-0.el9 ceph 301 k 2024-09-18T12:36:57.898 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:19.2.0-0.el9 ceph 99 k 2024-09-18T12:36:57.898 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-18T12:36:57.898 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-18T12:36:57.898 INFO:teuthology.orchestra.run.smithi148.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-18T12:36:57.898 INFO:teuthology.orchestra.run.smithi148.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T12:36:57.899 INFO:teuthology.orchestra.run.smithi148.stdout:Installing weak dependencies: 2024-09-18T12:36:57.899 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-18T12:36:57.899 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:36:57.899 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:36:57.899 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:36:57.899 INFO:teuthology.orchestra.run.smithi148.stdout:Install 30 Packages 2024-09-18T12:36:57.899 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 2 Packages 2024-09-18T12:36:57.899 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:36:57.900 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 60 M 2024-09-18T12:36:57.900 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:36:58.137 INFO:teuthology.orchestra.run.smithi148.stdout:(1/32): ceph-base-19.2.0-0.el9.x86_64.rpm 41 MB/s | 5.4 MB 00:00 2024-09-18T12:36:58.153 INFO:teuthology.orchestra.run.smithi148.stdout:(2/32): ceph-selinux-19.2.0-0.el9.x86_64.rpm 1.5 MB/s | 25 kB 00:00 2024-09-18T12:36:58.195 INFO:teuthology.orchestra.run.smithi148.stdout:(3/32): libcephfs2-19.2.0-0.el9.x86_64.rpm 18 MB/s | 751 kB 00:00 2024-09-18T12:36:58.229 INFO:teuthology.orchestra.run.smithi148.stdout:(4/32): libradosstriper1-19.2.0-0.el9.x86_64.rp 15 MB/s | 506 kB 00:00 2024-09-18T12:36:58.338 INFO:teuthology.orchestra.run.smithi148.stdout:(5/32): librgw2-19.2.0-0.el9.x86_64.rpm 49 MB/s | 5.4 MB 00:00 2024-09-18T12:36:58.354 INFO:teuthology.orchestra.run.smithi148.stdout:(6/32): python3-ceph-argparse-19.2.0-0.el9.x86_ 2.7 MB/s | 45 kB 00:00 2024-09-18T12:36:58.380 INFO:teuthology.orchestra.run.smithi148.stdout:(7/32): python3-ceph-common-19.2.0-0.el9.x86_64 5.3 MB/s | 135 kB 00:00 2024-09-18T12:36:58.413 INFO:teuthology.orchestra.run.smithi148.stdout:(8/32): python3-cephfs-19.2.0-0.el9.x86_64.rpm 4.7 MB/s | 161 kB 00:00 2024-09-18T12:36:58.439 INFO:teuthology.orchestra.run.smithi148.stdout:(9/32): python3-rados-19.2.0-0.el9.x86_64.rpm 13 MB/s | 320 kB 00:00 2024-09-18T12:36:58.464 INFO:teuthology.orchestra.run.smithi148.stdout:(10/32): python3-rbd-19.2.0-0.el9.x86_64.rpm 12 MB/s | 301 kB 00:00 2024-09-18T12:36:58.489 INFO:teuthology.orchestra.run.smithi148.stdout:(11/32): python3-rgw-19.2.0-0.el9.x86_64.rpm 3.9 MB/s | 99 kB 00:00 2024-09-18T12:36:58.615 INFO:teuthology.orchestra.run.smithi148.stdout:(12/32): ceph-radosgw-19.2.0-0.el9.x86_64.rpm 17 MB/s | 11 MB 00:00 2024-09-18T12:36:58.865 INFO:teuthology.orchestra.run.smithi148.stdout:(13/32): ceph-common-19.2.0-0.el9.x86_64.rpm 25 MB/s | 21 MB 00:00 2024-09-18T12:36:58.890 INFO:teuthology.orchestra.run.smithi148.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 267 kB/s | 107 kB 00:00 2024-09-18T12:36:58.924 INFO:teuthology.orchestra.run.smithi148.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 519 kB/s | 160 kB 00:00 2024-09-18T12:36:58.957 INFO:teuthology.orchestra.run.smithi148.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 491 kB/s | 45 kB 00:00 2024-09-18T12:36:58.991 INFO:teuthology.orchestra.run.smithi148.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-18T12:36:59.016 INFO:teuthology.orchestra.run.smithi148.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 723 kB/s | 42 kB 00:00 2024-09-18T12:36:59.041 INFO:teuthology.orchestra.run.smithi148.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-18T12:36:59.067 INFO:teuthology.orchestra.run.smithi148.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-18T12:36:59.092 INFO:teuthology.orchestra.run.smithi148.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 475 kB/s | 36 kB 00:00 2024-09-18T12:36:59.117 INFO:teuthology.orchestra.run.smithi148.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-18T12:36:59.184 INFO:teuthology.orchestra.run.smithi148.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 490 kB/s | 26 kB 00:00 2024-09-18T12:36:59.209 INFO:teuthology.orchestra.run.smithi148.stdout:(24/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.1 MB/s | 308 kB 00:00 2024-09-18T12:36:59.235 INFO:teuthology.orchestra.run.smithi148.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-09-18T12:36:59.262 INFO:teuthology.orchestra.run.smithi148.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-18T12:36:59.304 INFO:teuthology.orchestra.run.smithi148.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-18T12:36:59.380 INFO:teuthology.orchestra.run.smithi148.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.7 MB/s | 839 kB 00:00 2024-09-18T12:36:59.446 INFO:teuthology.orchestra.run.smithi148.stdout:(29/32): librados2-19.2.0-0.el9.x86_64.rpm 51 MB/s | 3.4 MB 00:00 2024-09-18T12:36:59.522 INFO:teuthology.orchestra.run.smithi148.stdout:(30/32): librbd1-19.2.0-0.el9.x86_64.rpm 42 MB/s | 3.2 MB 00:00 2024-09-18T12:36:59.572 INFO:teuthology.orchestra.run.smithi148.stdout:(31/32): thrift-0.15.0-2.el9.x86_64.rpm 5.9 MB/s | 1.6 MB 00:00 2024-09-18T12:36:59.722 INFO:teuthology.orchestra.run.smithi148.stdout:(32/32): libarrow-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 4.4 MB 00:00 2024-09-18T12:36:59.726 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:36:59.726 INFO:teuthology.orchestra.run.smithi148.stdout:Total 33 MB/s | 60 MB 00:01 2024-09-18T12:36:59.823 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:36:59.860 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:36:59.860 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:37:00.507 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:37:00.507 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:37:02.002 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:37:02.082 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-18T12:37:02.110 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-18T12:37:02.136 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-18T12:37:02.158 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T12:37:02.178 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T12:37:02.345 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T12:37:02.397 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T12:37:02.721 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-18T12:37:02.841 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-18T12:37:02.930 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-18T12:37:03.019 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:19.2.0-0.el9.x86_64 8/34 2024-09-18T12:37:03.063 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-18T12:37:03.112 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-18T12:37:03.148 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-18T12:37:03.148 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /sys 2024-09-18T12:37:03.148 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /proc 2024-09-18T12:37:03.148 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /mnt 2024-09-18T12:37:03.148 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /var/tmp 2024-09-18T12:37:03.149 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /home 2024-09-18T12:37:03.149 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /root 2024-09-18T12:37:03.149 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /tmp 2024-09-18T12:37:03.149 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:03.155 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-18T12:37:03.199 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 11/34 2024-09-18T12:37:03.269 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:19.2.0-0.el9.x86_64 12/34 2024-09-18T12:37:03.291 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-18T12:37:03.355 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-18T12:37:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-18T12:37:03.526 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-18T12:37:03.557 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-18T12:37:03.598 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-18T12:37:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-18T12:37:03.684 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-18T12:37:03.717 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-18T12:37:04.030 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-18T12:37:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-18T12:37:04.136 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-18T12:37:04.162 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-18T12:37:04.162 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:37:04.162 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T12:37:04.162 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:37:04.162 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:37:04.162 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:04.163 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-18T12:37:04.164 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T12:37:04.202 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:19.2.0-0.el9.x86_64 23/34 2024-09-18T12:37:04.238 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-18T12:37:04.271 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T12:37:04.271 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T12:37:04.711 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-18T12:37:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-18T12:37:04.821 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-18T12:37:04.897 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:19.2.0-0.el9.x86_64 27/34 2024-09-18T12:37:04.926 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:19.2.0-0.el9.x86_64 28/34 2024-09-18T12:37:05.544 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T12:37:05.544 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-2:19.2.0-0.el9.x86_64 1/34 2024-09-18T12:37:05.544 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-2:19.2.0-0.el9.x86_64 2/34 2024-09-18T12:37:05.544 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-2:19.2.0-0.el9.x86_64 3/34 2024-09-18T12:37:05.544 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-selinux-2:19.2.0-0.el9.x86_64 4/34 2024-09-18T12:37:05.544 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-2:19.2.0-0.el9.x86_64 5/34 2024-09-18T12:37:05.544 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libradosstriper1-2:19.2.0-0.el9.x86_64 6/34 2024-09-18T12:37:05.544 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librgw2-2:19.2.0-0.el9.x86_64 7/34 2024-09-18T12:37:05.544 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 8/34 2024-09-18T12:37:05.545 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-common-2:19.2.0-0.el9.x86_64 9/34 2024-09-18T12:37:05.545 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-2:19.2.0-0.el9.x86_64 10/34 2024-09-18T12:37:05.545 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-2:19.2.0-0.el9.x86_64 11/34 2024-09-18T12:37:05.545 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-2:19.2.0-0.el9.x86_64 12/34 2024-09-18T12:37:05.545 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-2:19.2.0-0.el9.x86_64 13/34 2024-09-18T12:37:05.545 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-18T12:37:05.545 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-18T12:37:05.545 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-18T12:37:05.545 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-18T12:37:05.545 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-18T12:37:05.545 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-18T12:37:05.545 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-18T12:37:05.545 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-18T12:37:05.546 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-18T12:37:05.546 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-18T12:37:05.546 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-18T12:37:05.546 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-18T12:37:05.546 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-18T12:37:05.546 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-18T12:37:05.546 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-18T12:37:05.546 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-18T12:37:05.546 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-18T12:37:05.546 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:19.2.0-0.el9.x86_64 31/34 2024-09-18T12:37:05.546 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-18T12:37:05.546 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:19.2.0-0.el9.x86_64 33/34 2024-09-18T12:37:06.654 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T12:37:06.655 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:06.655 INFO:teuthology.orchestra.run.smithi078.stdout:Upgraded: 2024-09-18T12:37:06.655 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-2:19.2.0-0.el9.x86_64 librbd1-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:06.655 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:37:06.655 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-18T12:37:06.655 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:06.655 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:06.655 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:06.655 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:06.655 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T12:37:06.655 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-18T12:37:06.656 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-18T12:37:06.656 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:06.656 INFO:teuthology.orchestra.run.smithi078.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T12:37:06.656 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T12:37:06.656 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T12:37:06.656 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:06.656 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T12:37:06.656 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:06.656 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T12:37:06.656 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T12:37:06.656 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-18T12:37:06.656 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:06.657 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:06.657 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:06.657 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T12:37:06.657 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:06.657 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:06.657 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:06.657 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-18T12:37:06.657 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-18T12:37:06.657 INFO:teuthology.orchestra.run.smithi078.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-18T12:37:06.657 INFO:teuthology.orchestra.run.smithi078.stdout: re2-1:20211101-20.el9.x86_64 2024-09-18T12:37:06.657 INFO:teuthology.orchestra.run.smithi078.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T12:37:06.657 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:06.657 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:37:07.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-test 2024-09-18T12:37:07.193 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-18T12:37:07.239 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-18T12:37:07.598 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:00:29 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:37:07.732 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:37:07.732 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:07.732 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2024-09-18T12:37:07.732 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:07.732 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:37:07.733 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test x86_64 2:19.2.0-0.el9 ceph 49 M 2024-09-18T12:37:07.733 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-18T12:37:07.733 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite x86_64 2:19.2.0-0.el9 ceph 163 k 2024-09-18T12:37:07.733 INFO:teuthology.orchestra.run.smithi078.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T12:37:07.733 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T12:37:07.733 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:07.733 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:37:07.733 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:07.733 INFO:teuthology.orchestra.run.smithi078.stdout:Install 4 Packages 2024-09-18T12:37:07.733 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:07.734 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 49 M 2024-09-18T12:37:07.734 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 208 M 2024-09-18T12:37:07.734 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:37:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-18T12:37:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-18T12:37:07.961 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-18T12:37:07.962 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T12:37:07.962 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T12:37:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:07.994 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-18T12:37:08.076 INFO:teuthology.orchestra.run.smithi078.stdout:(1/4): libcephsqlite-19.2.0-0.el9.x86_64.rpm 2.6 MB/s | 163 kB 00:00 2024-09-18T12:37:08.643 INFO:teuthology.orchestra.run.smithi078.stdout:(2/4): ceph-test-19.2.0-0.el9.x86_64.rpm 77 MB/s | 49 MB 00:00 2024-09-18T12:37:08.668 INFO:teuthology.orchestra.run.smithi078.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 108 kB/s | 64 kB 00:00 2024-09-18T12:37:09.018 INFO:teuthology.orchestra.run.smithi078.stdout:(4/4): socat-1.7.4.1-6.el9.x86_64.rpm 303 kB/s | 304 kB 00:01 2024-09-18T12:37:09.020 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:37:09.021 INFO:teuthology.orchestra.run.smithi078.stdout:Total 38 MB/s | 49 MB 00:01 2024-09-18T12:37:09.047 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:37:09.067 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:37:09.067 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:37:09.437 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:37:09.437 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:37:09.965 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:37:10.036 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T12:37:10.075 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T12:37:10.104 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-18T12:37:14.697 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-18T12:37:14.777 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-18T12:37:17.277 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-18T12:37:17.277 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-2:19.2.0-0.el9.x86_64 1/4 2024-09-18T12:37:17.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephsqlite-2:19.2.0-0.el9.x86_64 2/4 2024-09-18T12:37:17.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T12:37:17.605 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T12:37:17.606 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:17.606 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:37:17.606 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-2:19.2.0-0.el9.x86_64 libcephsqlite-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:17.606 INFO:teuthology.orchestra.run.smithi078.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T12:37:17.606 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:17.606 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:37:17.922 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph 2024-09-18T12:37:18.477 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-18T12:37:18.477 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2024-09-18T12:37:18.477 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2024-09-18T12:37:18.477 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2024-09-18T12:37:18.477 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2024-09-18T12:37:18.477 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2024-09-18T12:37:18.477 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /root 2024-09-18T12:37:18.477 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2024-09-18T12:37:18.477 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:18.542 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:37:18.692 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:37:18.695 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:18.695 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-09-18T12:37:18.695 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:18.695 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:37:18.696 INFO:teuthology.orchestra.run.smithi078.stdout: ceph x86_64 2:19.2.0-0.el9 ceph 6.5 k 2024-09-18T12:37:18.696 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-18T12:37:18.696 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds x86_64 2:19.2.0-0.el9 ceph 2.4 M 2024-09-18T12:37:18.696 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr x86_64 2:19.2.0-0.el9 ceph 1.5 M 2024-09-18T12:37:18.696 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core noarch 2:19.2.0-0.el9 ceph-noarch 249 k 2024-09-18T12:37:18.696 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon x86_64 2:19.2.0-0.el9 ceph 4.7 M 2024-09-18T12:37:18.697 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd x86_64 2:19.2.0-0.el9 ceph 17 M 2024-09-18T12:37:18.697 INFO:teuthology.orchestra.run.smithi078.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-18T12:37:18.697 INFO:teuthology.orchestra.run.smithi078.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-18T12:37:18.697 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-18T12:37:18.697 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T12:37:18.697 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T12:37:18.697 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T12:37:18.697 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T12:37:18.697 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T12:37:18.697 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T12:37:18.697 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T12:37:18.698 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-18T12:37:18.698 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T12:37:18.698 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T12:37:18.698 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T12:37:18.698 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T12:37:18.699 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T12:37:18.699 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T12:37:18.699 INFO:teuthology.orchestra.run.smithi078.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T12:37:18.699 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T12:37:18.699 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T12:37:18.699 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T12:37:18.699 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T12:37:18.699 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T12:37:18.699 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T12:37:18.699 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T12:37:18.699 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T12:37:18.699 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T12:37:18.700 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T12:37:18.700 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T12:37:18.700 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T12:37:18.700 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T12:37:18.700 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:18.700 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:37:18.700 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:18.700 INFO:teuthology.orchestra.run.smithi078.stdout:Install 37 Packages 2024-09-18T12:37:18.700 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:18.701 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 30 M 2024-09-18T12:37:18.701 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 108 M 2024-09-18T12:37:18.701 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:37:19.237 INFO:teuthology.orchestra.run.smithi078.stdout:(1/37): ceph-19.2.0-0.el9.x86_64.rpm 113 kB/s | 6.5 kB 00:00 2024-09-18T12:37:19.287 INFO:teuthology.orchestra.run.smithi078.stdout:(2/37): ceph-mgr-19.2.0-0.el9.x86_64.rpm 14 MB/s | 1.5 MB 00:00 2024-09-18T12:37:19.337 INFO:teuthology.orchestra.run.smithi078.stdout:(3/37): ceph-mds-19.2.0-0.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-09-18T12:37:19.363 INFO:teuthology.orchestra.run.smithi078.stdout:(4/37): ceph-mgr-modules-core-19.2.0-0.el9.noar 9.7 MB/s | 249 kB 00:00 2024-09-18T12:37:19.452 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-18T12:37:19.471 INFO:teuthology.orchestra.run.smithi078.stdout:(5/37): ceph-mon-19.2.0-0.el9.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2024-09-18T12:37:19.477 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-18T12:37:19.477 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:37:19.477 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T12:37:19.477 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:37:19.477 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:37:19.477 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:19.479 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T12:37:19.562 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T12:37:19.563 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T12:37:19.680 INFO:teuthology.orchestra.run.smithi078.stdout:(6/37): ceph-osd-19.2.0-0.el9.x86_64.rpm 43 MB/s | 17 MB 00:00 2024-09-18T12:37:20.297 INFO:teuthology.orchestra.run.smithi078.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 271 kB/s | 253 kB 00:00 2024-09-18T12:37:20.347 INFO:teuthology.orchestra.run.smithi078.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 160 kB/s | 106 kB 00:00 2024-09-18T12:37:20.539 INFO:teuthology.orchestra.run.smithi078.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 1.1 MB/s | 1.2 MB 00:01 2024-09-18T12:37:20.840 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T12:37:20.840 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:19.2.0-0.el9.x86_64 1/34 2024-09-18T12:37:20.840 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:19.2.0-0.el9.x86_64 2/34 2024-09-18T12:37:20.840 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:19.2.0-0.el9.x86_64 3/34 2024-09-18T12:37:20.840 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:19.2.0-0.el9.x86_64 4/34 2024-09-18T12:37:20.840 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:19.2.0-0.el9.x86_64 5/34 2024-09-18T12:37:20.840 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:19.2.0-0.el9.x86_64 6/34 2024-09-18T12:37:20.840 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:19.2.0-0.el9.x86_64 7/34 2024-09-18T12:37:20.840 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 8/34 2024-09-18T12:37:20.840 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:19.2.0-0.el9.x86_64 9/34 2024-09-18T12:37:20.840 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:19.2.0-0.el9.x86_64 10/34 2024-09-18T12:37:20.840 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:19.2.0-0.el9.x86_64 11/34 2024-09-18T12:37:20.841 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:19.2.0-0.el9.x86_64 12/34 2024-09-18T12:37:20.841 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:19.2.0-0.el9.x86_64 13/34 2024-09-18T12:37:20.841 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-18T12:37:20.841 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-18T12:37:20.841 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-18T12:37:20.841 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-18T12:37:20.841 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-18T12:37:20.841 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-18T12:37:20.841 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-18T12:37:20.841 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-18T12:37:20.841 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-18T12:37:20.841 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-18T12:37:20.842 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-18T12:37:20.842 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-18T12:37:20.842 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-18T12:37:20.842 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-18T12:37:20.842 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-18T12:37:20.842 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-18T12:37:20.843 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-18T12:37:20.843 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:19.2.0-0.el9.x86_64 31/34 2024-09-18T12:37:20.843 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-18T12:37:20.843 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:19.2.0-0.el9.x86_64 33/34 2024-09-18T12:37:21.024 INFO:teuthology.orchestra.run.smithi078.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 186 kB/s | 135 kB 00:00 2024-09-18T12:37:21.048 INFO:teuthology.orchestra.run.smithi078.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 178 kB/s | 125 kB 00:00 2024-09-18T12:37:21.165 INFO:teuthology.orchestra.run.smithi078.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-09-18T12:37:21.190 INFO:teuthology.orchestra.run.smithi078.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-18T12:37:21.215 INFO:teuthology.orchestra.run.smithi078.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 693 kB/s | 35 kB 00:00 2024-09-18T12:37:21.240 INFO:teuthology.orchestra.run.smithi078.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-18T12:37:21.266 INFO:teuthology.orchestra.run.smithi078.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-18T12:37:21.291 INFO:teuthology.orchestra.run.smithi078.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-09-18T12:37:21.324 INFO:teuthology.orchestra.run.smithi078.stdout:(18/37): python3-urllib3-1.26.5-6.el9.noarch.rp 276 kB/s | 215 kB 00:00 2024-09-18T12:37:21.375 INFO:teuthology.orchestra.run.smithi078.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-18T12:37:21.400 INFO:teuthology.orchestra.run.smithi078.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-18T12:37:21.425 INFO:teuthology.orchestra.run.smithi078.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 441 kB/s | 43 kB 00:00 2024-09-18T12:37:21.459 INFO:teuthology.orchestra.run.smithi078.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-18T12:37:21.484 INFO:teuthology.orchestra.run.smithi078.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 208 kB/s | 11 kB 00:00 2024-09-18T12:37:21.510 INFO:teuthology.orchestra.run.smithi078.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 365 kB/s | 18 kB 00:00 2024-09-18T12:37:21.530 INFO:teuthology.orchestra.run.smithi078.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 513 kB/s | 23 kB 00:00 2024-09-18T12:37:21.555 INFO:teuthology.orchestra.run.smithi078.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 429 kB/s | 19 kB 00:00 2024-09-18T12:37:21.581 INFO:teuthology.orchestra.run.smithi078.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-18T12:37:21.606 INFO:teuthology.orchestra.run.smithi078.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 926 kB/s | 46 kB 00:00 2024-09-18T12:37:21.631 INFO:teuthology.orchestra.run.smithi078.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-18T12:37:21.657 INFO:teuthology.orchestra.run.smithi078.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-18T12:37:21.682 INFO:teuthology.orchestra.run.smithi078.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-18T12:37:21.707 INFO:teuthology.orchestra.run.smithi078.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-18T12:37:21.732 INFO:teuthology.orchestra.run.smithi078.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-18T12:37:21.758 INFO:teuthology.orchestra.run.smithi078.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-18T12:37:21.783 INFO:teuthology.orchestra.run.smithi078.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 803 kB/s | 20 kB 00:00 2024-09-18T12:37:21.809 INFO:teuthology.orchestra.run.smithi078.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-18T12:37:21.833 INFO:teuthology.orchestra.run.smithi078.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-18T12:37:21.838 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:37:21.838 INFO:teuthology.orchestra.run.smithi078.stdout:Total 9.6 MB/s | 30 MB 00:03 2024-09-18T12:37:21.903 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T12:37:21.903 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:21.904 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2024-09-18T12:37:21.904 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:19.2.0-0.el9.x86_64 librbd1-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:21.904 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:37:21.904 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-18T12:37:21.904 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:21.904 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:21.904 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:21.904 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:21.904 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T12:37:21.904 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-18T12:37:21.905 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-18T12:37:21.905 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:21.905 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T12:37:21.905 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T12:37:21.905 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T12:37:21.905 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:21.905 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T12:37:21.905 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:21.905 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T12:37:21.905 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T12:37:21.905 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-18T12:37:21.905 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:21.905 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:21.905 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:21.906 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T12:37:21.906 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:21.906 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:21.906 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:21.906 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-18T12:37:21.906 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-18T12:37:21.906 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-18T12:37:21.906 INFO:teuthology.orchestra.run.smithi148.stdout: re2-1:20211101-20.el9.x86_64 2024-09-18T12:37:21.906 INFO:teuthology.orchestra.run.smithi148.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T12:37:21.906 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:21.906 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:37:21.992 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:37:22.032 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:37:22.032 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:37:22.239 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-test 2024-09-18T12:37:22.525 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:37:22.525 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:37:22.823 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:27 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:37:22.956 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:37:22.956 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:22.957 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-18T12:37:22.957 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:22.957 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:37:22.957 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:19.2.0-0.el9 ceph 49 M 2024-09-18T12:37:22.957 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-18T12:37:22.957 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:19.2.0-0.el9 ceph 163 k 2024-09-18T12:37:22.957 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T12:37:22.957 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T12:37:22.957 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:22.957 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:37:22.957 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:22.957 INFO:teuthology.orchestra.run.smithi148.stdout:Install 4 Packages 2024-09-18T12:37:22.957 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:22.958 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 49 M 2024-09-18T12:37:22.958 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 208 M 2024-09-18T12:37:22.958 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:37:23.068 INFO:teuthology.orchestra.run.smithi148.stdout:(1/4): libcephsqlite-19.2.0-0.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2024-09-18T12:37:23.201 INFO:teuthology.orchestra.run.smithi148.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 478 kB/s | 64 kB 00:00 2024-09-18T12:37:23.235 INFO:teuthology.orchestra.run.smithi148.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-18T12:37:23.685 INFO:teuthology.orchestra.run.smithi148.stdout:(4/4): ceph-test-19.2.0-0.el9.x86_64.rpm 72 MB/s | 49 MB 00:00 2024-09-18T12:37:23.687 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:37:23.688 INFO:teuthology.orchestra.run.smithi148.stdout:Total 67 MB/s | 49 MB 00:00 2024-09-18T12:37:23.715 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:37:23.736 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:37:23.736 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:37:23.895 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:37:23.953 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-18T12:37:23.999 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-18T12:37:24.039 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-18T12:37:24.105 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:37:24.106 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:37:24.110 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-18T12:37:24.180 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-18T12:37:24.212 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-18T12:37:24.304 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-18T12:37:24.374 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-18T12:37:24.415 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-18T12:37:24.458 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-18T12:37:24.488 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-18T12:37:24.522 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-18T12:37:24.556 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-18T12:37:24.596 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-18T12:37:24.631 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:37:24.639 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-18T12:37:24.674 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-18T12:37:24.711 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T12:37:24.722 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-18T12:37:24.751 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T12:37:24.763 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-18T12:37:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-18T12:37:24.836 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-18T12:37:24.975 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-18T12:37:25.055 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-18T12:37:25.108 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-18T12:37:25.155 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-18T12:37:25.204 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-18T12:37:25.259 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-18T12:37:25.445 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-18T12:37:25.500 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-18T12:37:25.587 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-18T12:37:25.675 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-18T12:37:25.716 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-18T12:37:25.833 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-18T12:37:25.997 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 32/37 2024-09-18T12:37:26.035 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-18T12:37:26.060 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-18T12:37:26.061 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:37:26.061 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T12:37:26.061 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:37:26.061 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:37:26.061 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:27.527 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-18T12:37:27.554 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-18T12:37:27.554 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:37:27.554 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T12:37:27.555 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:37:27.555 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:37:27.555 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:27.994 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-18T12:37:28.019 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-18T12:37:28.019 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:37:28.019 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T12:37:28.019 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:37:28.019 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:37:28.019 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:28.254 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-18T12:37:28.277 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-18T12:37:28.277 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:37:28.277 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T12:37:28.277 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:37:28.277 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:37:28.277 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:28.341 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-18T12:37:29.379 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-18T12:37:29.460 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-18T12:37:30.064 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-18T12:37:30.064 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-2:19.2.0-0.el9.x86_64 1/37 2024-09-18T12:37:30.064 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-2:19.2.0-0.el9.x86_64 2/37 2024-09-18T12:37:30.064 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-2:19.2.0-0.el9.x86_64 3/37 2024-09-18T12:37:30.064 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-2:19.2.0-0.el9.x86_64 4/37 2024-09-18T12:37:30.064 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-2:19.2.0-0.el9.x86_64 5/37 2024-09-18T12:37:30.064 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 6/37 2024-09-18T12:37:30.064 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-18T12:37:30.064 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-18T12:37:30.064 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-18T12:37:30.065 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-18T12:37:30.065 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-18T12:37:30.065 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-18T12:37:30.065 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-18T12:37:30.065 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-18T12:37:30.065 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-18T12:37:30.065 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-18T12:37:30.065 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-18T12:37:30.065 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-18T12:37:30.065 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-18T12:37:30.065 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-18T12:37:30.065 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-18T12:37:30.065 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-18T12:37:30.066 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-18T12:37:30.066 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-18T12:37:30.066 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-18T12:37:30.066 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-18T12:37:30.066 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-18T12:37:30.066 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-18T12:37:30.066 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-18T12:37:30.066 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-18T12:37:30.066 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-18T12:37:30.066 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-18T12:37:30.066 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-18T12:37:30.066 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-18T12:37:30.066 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-18T12:37:30.067 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-18T12:37:31.021 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-18T12:37:31.022 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:31.022 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:37:31.022 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:31.022 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:31.022 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:31.022 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 2024-09-18T12:37:31.022 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:31.022 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:31.022 INFO:teuthology.orchestra.run.smithi078.stdout: lua-5.4.4-4.el9.x86_64 2024-09-18T12:37:31.022 INFO:teuthology.orchestra.run.smithi078.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-18T12:37:31.022 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-18T12:37:31.022 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T12:37:31.023 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T12:37:31.023 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T12:37:31.023 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T12:37:31.023 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T12:37:31.023 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T12:37:31.023 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T12:37:31.023 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T12:37:31.023 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T12:37:31.023 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T12:37:31.023 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T12:37:31.023 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T12:37:31.023 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T12:37:31.024 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T12:37:31.024 INFO:teuthology.orchestra.run.smithi078.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T12:37:31.024 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T12:37:31.024 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T12:37:31.024 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T12:37:31.024 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T12:37:31.024 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T12:37:31.024 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T12:37:31.024 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T12:37:31.024 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T12:37:31.024 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T12:37:31.024 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T12:37:31.024 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T12:37:31.024 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T12:37:31.025 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T12:37:31.025 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:31.025 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:37:31.429 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-base 2024-09-18T12:37:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-18T12:37:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:19.2.0-0.el9.x86_64 1/4 2024-09-18T12:37:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:19.2.0-0.el9.x86_64 2/4 2024-09-18T12:37:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T12:37:32.001 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T12:37:32.001 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:32.001 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:37:32.001 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:19.2.0-0.el9.x86_64 libcephsqlite-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:32.001 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T12:37:32.001 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:32.001 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:37:32.013 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:00:54 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:37:32.103 INFO:teuthology.orchestra.run.smithi078.stdout:Package ceph-base-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:37:32.145 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:37:32.146 INFO:teuthology.orchestra.run.smithi078.stdout:Nothing to do. 2024-09-18T12:37:32.146 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:37:32.221 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install cephadm 2024-09-18T12:37:32.311 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph 2024-09-18T12:37:32.797 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:00:54 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:37:32.906 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:37:32.926 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:37:32.927 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2024-09-18T12:37:32.927 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:32.927 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:37:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm noarch 2:19.2.0-0.el9 ceph-noarch 765 k 2024-09-18T12:37:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:32.927 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:37:32.927 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:32.927 INFO:teuthology.orchestra.run.smithi078.stdout:Install 1 Package 2024-09-18T12:37:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:32.928 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 765 k 2024-09-18T12:37:32.928 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 771 k 2024-09-18T12:37:32.928 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:37:32.986 INFO:teuthology.orchestra.run.smithi078.stdout:cephadm-19.2.0-0.el9.noarch.rpm 13 MB/s | 765 kB 00:00 2024-09-18T12:37:32.987 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:37:32.987 INFO:teuthology.orchestra.run.smithi078.stdout:Total 13 MB/s | 765 kB 00:00 2024-09-18T12:37:32.987 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:37:32.992 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:37:32.992 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:37:32.998 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:37:32.999 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:37:33.045 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:37:33.048 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:33.048 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-18T12:37:33.048 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:33.048 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:37:33.048 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:19.2.0-0.el9 ceph 6.5 k 2024-09-18T12:37:33.049 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-18T12:37:33.049 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:19.2.0-0.el9 ceph 2.4 M 2024-09-18T12:37:33.049 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:19.2.0-0.el9 ceph 1.5 M 2024-09-18T12:37:33.049 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:19.2.0-0.el9 ceph-noarch 249 k 2024-09-18T12:37:33.049 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:19.2.0-0.el9 ceph 4.7 M 2024-09-18T12:37:33.049 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:19.2.0-0.el9 ceph 17 M 2024-09-18T12:37:33.049 INFO:teuthology.orchestra.run.smithi148.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-18T12:37:33.049 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-18T12:37:33.049 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-18T12:37:33.049 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T12:37:33.049 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T12:37:33.049 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T12:37:33.049 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T12:37:33.050 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T12:37:33.050 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T12:37:33.050 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T12:37:33.050 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-18T12:37:33.050 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T12:37:33.050 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T12:37:33.050 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T12:37:33.050 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T12:37:33.050 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T12:37:33.050 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T12:37:33.050 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T12:37:33.050 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T12:37:33.050 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T12:37:33.051 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T12:37:33.051 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T12:37:33.051 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T12:37:33.051 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T12:37:33.051 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T12:37:33.051 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T12:37:33.051 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T12:37:33.051 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T12:37:33.051 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T12:37:33.051 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T12:37:33.051 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T12:37:33.051 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:33.051 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:37:33.052 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:33.052 INFO:teuthology.orchestra.run.smithi148.stdout:Install 37 Packages 2024-09-18T12:37:33.052 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:33.052 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 30 M 2024-09-18T12:37:33.052 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 108 M 2024-09-18T12:37:33.052 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:37:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:37:33.563 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:37:33.648 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:37:33.653 INFO:teuthology.orchestra.run.smithi148.stdout:(1/37): ceph-19.2.0-0.el9.x86_64.rpm 122 kB/s | 6.5 kB 00:00 2024-09-18T12:37:33.697 INFO:teuthology.orchestra.run.smithi148.stdout:(2/37): ceph-mgr-19.2.0-0.el9.x86_64.rpm 16 MB/s | 1.5 MB 00:00 2024-09-18T12:37:33.745 INFO:teuthology.orchestra.run.smithi148.stdout:(3/37): ceph-mds-19.2.0-0.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-09-18T12:37:33.779 INFO:teuthology.orchestra.run.smithi148.stdout:(4/37): ceph-mgr-modules-core-19.2.0-0.el9.noar 7.3 MB/s | 249 kB 00:00 2024-09-18T12:37:33.854 INFO:teuthology.orchestra.run.smithi148.stdout:(5/37): ceph-mon-19.2.0-0.el9.x86_64.rpm 23 MB/s | 4.7 MB 00:00 2024-09-18T12:37:34.030 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:37:34.080 INFO:teuthology.orchestra.run.smithi148.stdout:(6/37): ceph-osd-19.2.0-0.el9.x86_64.rpm 44 MB/s | 17 MB 00:00 2024-09-18T12:37:34.188 INFO:teuthology.orchestra.run.smithi148.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 619 kB/s | 253 kB 00:00 2024-09-18T12:37:34.238 INFO:teuthology.orchestra.run.smithi148.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-18T12:37:34.263 INFO:teuthology.orchestra.run.smithi148.stdout:(9/37): python3-ply-3.11-14.el9.noarch.rpm 580 kB/s | 106 kB 00:00 2024-09-18T12:37:34.271 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:37:34.271 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:34.271 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:37:34.271 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm-2:19.2.0-0.el9.noarch 2024-09-18T12:37:34.272 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:34.272 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:37:34.297 INFO:teuthology.orchestra.run.smithi148.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.1 MB/s | 125 kB 00:00 2024-09-18T12:37:34.339 INFO:teuthology.orchestra.run.smithi148.stdout:(11/37): python3-cryptography-36.0.1-4.el9.x86_ 2.5 MB/s | 1.2 MB 00:00 2024-09-18T12:37:34.364 INFO:teuthology.orchestra.run.smithi148.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.1 MB/s | 215 kB 00:00 2024-09-18T12:37:34.464 INFO:teuthology.orchestra.run.smithi148.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 348 kB/s | 35 kB 00:00 2024-09-18T12:37:34.498 INFO:teuthology.orchestra.run.smithi148.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-18T12:37:34.523 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T12:37:34.524 INFO:teuthology.orchestra.run.smithi148.stdout:(15/37): lua-5.4.4-4.el9.x86_64.rpm 833 kB/s | 188 kB 00:00 2024-09-18T12:37:34.549 INFO:teuthology.orchestra.run.smithi148.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-18T12:37:34.574 INFO:teuthology.orchestra.run.smithi148.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 706 kB/s | 77 kB 00:00 2024-09-18T12:37:34.599 INFO:teuthology.orchestra.run.smithi148.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-09-18T12:37:34.658 INFO:teuthology.orchestra.run.smithi148.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-18T12:37:34.683 INFO:teuthology.orchestra.run.smithi148.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 520 kB/s | 43 kB 00:00 2024-09-18T12:37:34.708 INFO:teuthology.orchestra.run.smithi148.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 140 kB/s | 22 kB 00:00 2024-09-18T12:37:34.742 INFO:teuthology.orchestra.run.smithi148.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-18T12:37:34.767 INFO:teuthology.orchestra.run.smithi148.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 760 kB/s | 18 kB 00:00 2024-09-18T12:37:34.792 INFO:teuthology.orchestra.run.smithi148.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 127 kB/s | 11 kB 00:00 2024-09-18T12:37:34.818 INFO:teuthology.orchestra.run.smithi148.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-18T12:37:34.843 INFO:teuthology.orchestra.run.smithi148.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-18T12:37:34.868 INFO:teuthology.orchestra.run.smithi148.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-18T12:37:34.893 INFO:teuthology.orchestra.run.smithi148.stdout:(28/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.7 MB/s | 358 kB 00:00 2024-09-18T12:37:34.920 INFO:teuthology.orchestra.run.smithi148.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 613 kB/s | 46 kB 00:00 2024-09-18T12:37:34.948 INFO:teuthology.orchestra.run.smithi148.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-18T12:37:34.973 INFO:teuthology.orchestra.run.smithi148.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 305 kB/s | 16 kB 00:00 2024-09-18T12:37:34.998 INFO:teuthology.orchestra.run.smithi148.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-18T12:37:35.023 INFO:teuthology.orchestra.run.smithi148.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 713 kB/s | 36 kB 00:00 2024-09-18T12:37:35.049 INFO:teuthology.orchestra.run.smithi148.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-18T12:37:35.074 INFO:teuthology.orchestra.run.smithi148.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 811 kB/s | 20 kB 00:00 2024-09-18T12:37:35.099 INFO:teuthology.orchestra.run.smithi148.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-18T12:37:35.120 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:00:57 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:37:35.124 INFO:teuthology.orchestra.run.smithi148.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-18T12:37:35.127 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:37:35.127 INFO:teuthology.orchestra.run.smithi148.stdout:Total 15 MB/s | 30 MB 00:02 2024-09-18T12:37:35.257 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:37:35.257 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:35.257 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repo Size 2024-09-18T12:37:35.258 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:35.258 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:37:35.258 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache x86_64 2:19.2.0-0.el9 ceph 145 k 2024-09-18T12:37:35.258 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:35.258 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:37:35.258 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:35.258 INFO:teuthology.orchestra.run.smithi078.stdout:Install 1 Package 2024-09-18T12:37:35.258 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:35.259 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 145 k 2024-09-18T12:37:35.259 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 435 k 2024-09-18T12:37:35.259 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:37:35.281 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:37:35.302 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-immutable-object-cache-19.2.0-0.el9.x86_64 3.3 MB/s | 145 kB 00:00 2024-09-18T12:37:35.303 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:37:35.303 INFO:teuthology.orchestra.run.smithi078.stdout:Total 3.1 MB/s | 145 kB 00:00 2024-09-18T12:37:35.304 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:37:35.311 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:37:35.311 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:37:35.322 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:37:35.323 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:37:35.369 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:37:35.369 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:37:35.533 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:37:35.603 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:37:35.629 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:37:35.630 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:37:35.630 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T12:37:35.630 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:35.812 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:37:35.812 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:37:36.553 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:37:36.556 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:36.556 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:37:36.556 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:36.556 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:36.556 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:37:36.813 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-mgr 2024-09-18T12:37:37.184 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:37:37.252 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-18T12:37:37.288 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-18T12:37:37.321 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-18T12:37:37.392 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-18T12:37:37.403 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:00:59 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:37:37.470 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-18T12:37:37.494 INFO:teuthology.orchestra.run.smithi078.stdout:Package ceph-mgr-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:37:37.503 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-18T12:37:37.536 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:37:37.537 INFO:teuthology.orchestra.run.smithi078.stdout:Nothing to do. 2024-09-18T12:37:37.537 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:37:37.595 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-18T12:37:37.609 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T12:37:37.673 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-18T12:37:37.714 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-18T12:37:37.757 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-18T12:37:37.796 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-18T12:37:37.830 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-18T12:37:37.863 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-18T12:37:37.904 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-18T12:37:37.947 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-18T12:37:37.981 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-18T12:37:38.029 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-18T12:37:38.062 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-18T12:37:38.143 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-18T12:37:38.184 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:00 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:37:38.290 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-18T12:37:38.314 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:37:38.316 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:38.316 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-09-18T12:37:38.316 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:38.316 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:37:38.316 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard noarch 2:19.2.0-0.el9 ceph-noarch 3.6 M 2024-09-18T12:37:38.316 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-18T12:37:38.316 INFO:teuthology.orchestra.run.smithi078.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-18T12:37:38.316 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards noarch 2:19.2.0-0.el9 ceph-noarch 32 k 2024-09-18T12:37:38.316 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts noarch 2:19.2.0-0.el9 ceph-noarch 16 k 2024-09-18T12:37:38.316 INFO:teuthology.orchestra.run.smithi078.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-18T12:37:38.316 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-18T12:37:38.317 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-18T12:37:38.317 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-18T12:37:38.317 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-18T12:37:38.317 INFO:teuthology.orchestra.run.smithi078.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-18T12:37:38.317 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T12:37:38.317 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T12:37:38.317 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:38.317 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:37:38.317 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:38.317 INFO:teuthology.orchestra.run.smithi078.stdout:Install 12 Packages 2024-09-18T12:37:38.317 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:38.318 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 8.7 M 2024-09-18T12:37:38.318 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 104 M 2024-09-18T12:37:38.318 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:37:38.370 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-18T12:37:38.423 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-18T12:37:38.470 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-18T12:37:38.519 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-18T12:37:38.583 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-18T12:37:38.778 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-18T12:37:38.827 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-18T12:37:38.903 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-18T12:37:39.000 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-18T12:37:39.048 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-18T12:37:39.089 INFO:teuthology.orchestra.run.smithi078.stdout:(1/12): ceph-grafana-dashboards-19.2.0-0.el9.no 510 kB/s | 32 kB 00:00 2024-09-18T12:37:39.114 INFO:teuthology.orchestra.run.smithi078.stdout:(2/12): ceph-prometheus-alerts-19.2.0-0.el9.noa 187 kB/s | 16 kB 00:00 2024-09-18T12:37:39.166 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-18T12:37:39.181 INFO:teuthology.orchestra.run.smithi078.stdout:(3/12): ceph-mgr-dashboard-19.2.0-0.el9.noarch. 23 MB/s | 3.6 MB 00:00 2024-09-18T12:37:39.282 INFO:teuthology.orchestra.run.smithi078.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.6 MB/s | 269 kB 00:00 2024-09-18T12:37:39.320 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 32/37 2024-09-18T12:37:39.324 INFO:teuthology.orchestra.run.smithi078.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-09-18T12:37:39.350 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-18T12:37:39.374 INFO:teuthology.orchestra.run.smithi078.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 403 kB/s | 19 kB 00:00 2024-09-18T12:37:39.375 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-18T12:37:39.375 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:37:39.375 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T12:37:39.375 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:37:39.375 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:37:39.376 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:39.399 INFO:teuthology.orchestra.run.smithi078.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.6 MB/s | 548 kB 00:00 2024-09-18T12:37:39.441 INFO:teuthology.orchestra.run.smithi078.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.3 MB/s | 863 kB 00:00 2024-09-18T12:37:39.466 INFO:teuthology.orchestra.run.smithi078.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.1 MB/s | 144 kB 00:00 2024-09-18T12:37:39.508 INFO:teuthology.orchestra.run.smithi078.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.3 MB/s | 188 kB 00:00 2024-09-18T12:37:39.533 INFO:teuthology.orchestra.run.smithi078.stdout:(11/12): python3-repoze-lru-0.7-16.el9.noarch.r 334 kB/s | 31 kB 00:00 2024-09-18T12:37:39.617 INFO:teuthology.orchestra.run.smithi078.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 8.4 MB/s | 2.0 MB 00:00 2024-09-18T12:37:39.621 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:37:39.621 INFO:teuthology.orchestra.run.smithi078.stdout:Total 6.6 MB/s | 8.7 MB 00:01 2024-09-18T12:37:39.669 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:37:39.687 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:37:39.687 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:37:39.894 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:37:39.895 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:37:40.432 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:37:40.535 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-18T12:37:40.570 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-18T12:37:40.616 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-18T12:37:40.647 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-18T12:37:40.743 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-18T12:37:40.851 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-18T12:37:40.873 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-18T12:37:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-18T12:37:40.879 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:37:40.879 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T12:37:40.879 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:37:40.879 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:37:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:40.967 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-18T12:37:41.010 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-18T12:37:41.038 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-18T12:37:41.070 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 10/12 2024-09-18T12:37:41.310 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-18T12:37:41.334 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-18T12:37:41.334 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:37:41.334 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T12:37:41.334 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:37:41.334 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:37:41.335 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:41.569 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-18T12:37:41.593 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-18T12:37:41.593 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:37:41.593 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T12:37:41.593 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:37:41.593 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:37:41.593 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:41.657 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-18T12:37:42.126 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 11/12 2024-09-18T12:37:42.162 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-18T12:37:43.316 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-18T12:37:43.316 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:19.2.0-0.el9.x86_64 1/37 2024-09-18T12:37:43.316 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:19.2.0-0.el9.x86_64 2/37 2024-09-18T12:37:43.316 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:19.2.0-0.el9.x86_64 3/37 2024-09-18T12:37:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:19.2.0-0.el9.x86_64 4/37 2024-09-18T12:37:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:19.2.0-0.el9.x86_64 5/37 2024-09-18T12:37:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 6/37 2024-09-18T12:37:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-18T12:37:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-18T12:37:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-18T12:37:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-18T12:37:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-18T12:37:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-18T12:37:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-18T12:37:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-18T12:37:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-18T12:37:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-18T12:37:43.317 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-18T12:37:43.318 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-18T12:37:43.318 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-18T12:37:43.318 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-18T12:37:43.318 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-18T12:37:43.318 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-18T12:37:43.318 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-18T12:37:43.318 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-18T12:37:43.318 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-18T12:37:43.318 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-18T12:37:43.318 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-18T12:37:43.318 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-18T12:37:43.318 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-18T12:37:43.319 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-18T12:37:43.319 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-18T12:37:43.319 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-18T12:37:43.319 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-18T12:37:43.319 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-18T12:37:43.319 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-18T12:37:43.319 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-18T12:37:43.552 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-18T12:37:43.552 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 1/12 2024-09-18T12:37:43.552 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2/12 2024-09-18T12:37:43.552 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 3/12 2024-09-18T12:37:43.552 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-18T12:37:43.552 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-18T12:37:43.552 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-18T12:37:43.553 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-18T12:37:43.553 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-18T12:37:43.553 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-18T12:37:43.553 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-18T12:37:43.553 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-18T12:37:43.860 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-18T12:37:43.860 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:43.860 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:37:43.860 INFO:teuthology.orchestra.run.smithi078.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-18T12:37:43.860 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 2024-09-18T12:37:43.860 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2024-09-18T12:37:43.860 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 2024-09-18T12:37:43.860 INFO:teuthology.orchestra.run.smithi078.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-18T12:37:43.860 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-18T12:37:43.861 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-18T12:37:43.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-18T12:37:43.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-18T12:37:43.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-18T12:37:43.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T12:37:43.861 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T12:37:43.861 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:43.861 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:37:44.105 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T12:37:44.297 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-18T12:37:44.297 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:44.297 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:37:44.297 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:44.297 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:44.297 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:44.297 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 2024-09-18T12:37:44.297 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:44.297 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:44.297 INFO:teuthology.orchestra.run.smithi148.stdout: lua-5.4.4-4.el9.x86_64 2024-09-18T12:37:44.298 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-18T12:37:44.298 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-18T12:37:44.298 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T12:37:44.298 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T12:37:44.298 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T12:37:44.298 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T12:37:44.298 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T12:37:44.298 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T12:37:44.298 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T12:37:44.298 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T12:37:44.298 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T12:37:44.298 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T12:37:44.298 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T12:37:44.299 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T12:37:44.299 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T12:37:44.299 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T12:37:44.299 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T12:37:44.299 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T12:37:44.299 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T12:37:44.299 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T12:37:44.299 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T12:37:44.299 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T12:37:44.299 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T12:37:44.299 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T12:37:44.299 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T12:37:44.299 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T12:37:44.299 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T12:37:44.300 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T12:37:44.300 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T12:37:44.300 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T12:37:44.300 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:44.300 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:37:44.667 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-base 2024-09-18T12:37:44.682 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:06 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:37:44.815 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:37:44.816 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:44.816 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-09-18T12:37:44.816 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:44.816 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:37:44.817 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.0-0.el9 ceph-noarch 7.4 M 2024-09-18T12:37:44.817 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-18T12:37:44.817 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T12:37:44.817 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T12:37:44.817 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T12:37:44.817 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T12:37:44.817 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T12:37:44.817 INFO:teuthology.orchestra.run.smithi078.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T12:37:44.817 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T12:37:44.817 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T12:37:44.817 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T12:37:44.817 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T12:37:44.817 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T12:37:44.818 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:44.818 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:37:44.818 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:44.818 INFO:teuthology.orchestra.run.smithi078.stdout:Install 12 Packages 2024-09-18T12:37:44.818 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:44.818 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 38 M 2024-09-18T12:37:44.818 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 212 M 2024-09-18T12:37:44.819 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:37:45.251 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:37:45.317 INFO:teuthology.orchestra.run.smithi078.stdout:(1/12): ceph-mgr-diskprediction-local-19.2.0-0. 51 MB/s | 7.4 MB 00:00 2024-09-18T12:37:45.339 INFO:teuthology.orchestra.run.smithi148.stdout:Package ceph-base-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:37:45.381 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:37:45.382 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-18T12:37:45.382 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:37:45.417 INFO:teuthology.orchestra.run.smithi078.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 328 kB/s | 33 kB 00:00 2024-09-18T12:37:45.449 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install cephadm 2024-09-18T12:37:45.467 INFO:teuthology.orchestra.run.smithi078.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 649 kB/s | 191 kB 00:00 2024-09-18T12:37:45.492 INFO:teuthology.orchestra.run.smithi078.stdout:(4/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-18T12:37:45.559 INFO:teuthology.orchestra.run.smithi078.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 198 kB/s | 18 kB 00:00 2024-09-18T12:37:45.593 INFO:teuthology.orchestra.run.smithi078.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 383 kB/s | 38 kB 00:00 2024-09-18T12:37:45.710 INFO:teuthology.orchestra.run.smithi078.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 10 MB/s | 3.0 MB 00:00 2024-09-18T12:37:45.735 INFO:teuthology.orchestra.run.smithi078.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-18T12:37:45.844 INFO:teuthology.orchestra.run.smithi078.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 5.1 MB 00:00 2024-09-18T12:37:45.894 INFO:teuthology.orchestra.run.smithi078.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.5 MB/s | 250 kB 00:00 2024-09-18T12:37:45.977 INFO:teuthology.orchestra.run.smithi078.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 12 MB/s | 4.9 MB 00:00 2024-09-18T12:37:46.020 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:37:46.151 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:37:46.151 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-18T12:37:46.151 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:46.152 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:37:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:19.2.0-0.el9 ceph-noarch 765 k 2024-09-18T12:37:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:46.152 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:37:46.152 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:46.152 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-18T12:37:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:46.153 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 765 k 2024-09-18T12:37:46.153 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 771 k 2024-09-18T12:37:46.153 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:37:46.218 INFO:teuthology.orchestra.run.smithi148.stdout:cephadm-19.2.0-0.el9.noarch.rpm 11 MB/s | 765 kB 00:00 2024-09-18T12:37:46.219 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:37:46.219 INFO:teuthology.orchestra.run.smithi148.stdout:Total 11 MB/s | 765 kB 00:00 2024-09-18T12:37:46.219 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:37:46.224 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:37:46.224 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:37:46.230 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:37:46.230 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:37:46.253 INFO:teuthology.orchestra.run.smithi078.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-09-18T12:37:46.253 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:37:46.253 INFO:teuthology.orchestra.run.smithi078.stdout:Total 27 MB/s | 38 MB 00:01 2024-09-18T12:37:46.300 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:37:46.610 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:37:46.637 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:37:46.637 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:37:46.720 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:37:46.813 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:37:47.066 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:37:47.067 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:37:47.165 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:37:47.423 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:37:47.423 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:47.423 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:37:47.423 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:19.2.0-0.el9.noarch 2024-09-18T12:37:47.423 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:47.423 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:37:47.655 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T12:37:47.847 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:37:47.917 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T12:37:47.967 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:37:48.067 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:37:48.102 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T12:37:48.251 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:37:48.287 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T12:37:48.318 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T12:37:48.388 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:37:48.389 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:48.389 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repo Size 2024-09-18T12:37:48.389 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:48.389 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:37:48.389 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:19.2.0-0.el9 ceph 145 k 2024-09-18T12:37:48.390 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:48.390 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:37:48.390 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:48.390 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-18T12:37:48.390 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:48.390 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 145 k 2024-09-18T12:37:48.390 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 435 k 2024-09-18T12:37:48.390 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:37:48.401 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T12:37:48.449 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-immutable-object-cache-19.2.0-0.el9.x86_64 2.4 MB/s | 145 kB 00:00 2024-09-18T12:37:48.450 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:37:48.450 INFO:teuthology.orchestra.run.smithi148.stdout:Total 2.4 MB/s | 145 kB 00:00 2024-09-18T12:37:48.450 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:37:48.457 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:37:48.457 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:37:48.513 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:37:48.514 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:37:48.668 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:37:48.716 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:37:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:37:48.742 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:37:48.742 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T12:37:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:49.045 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T12:37:49.173 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T12:37:49.686 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:37:49.686 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:49.686 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:37:49.686 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 2024-09-18T12:37:49.686 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:49.686 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:37:49.938 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr 2024-09-18T12:37:50.422 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:37:50.527 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:55 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:37:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:Package ceph-mgr-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:37:50.661 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:37:50.662 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-18T12:37:50.662 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:37:50.733 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T12:37:51.311 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:56 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:37:51.443 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:37:51.444 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-18T12:37:51.444 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:51.444 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:37:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:19.2.0-0.el9 ceph-noarch 3.6 M 2024-09-18T12:37:51.444 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-18T12:37:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-18T12:37:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:19.2.0-0.el9 ceph-noarch 32 k 2024-09-18T12:37:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:19.2.0-0.el9 ceph-noarch 16 k 2024-09-18T12:37:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-18T12:37:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-18T12:37:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-18T12:37:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-18T12:37:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-18T12:37:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-18T12:37:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T12:37:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T12:37:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:51.446 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:37:51.446 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:51.446 INFO:teuthology.orchestra.run.smithi148.stdout:Install 12 Packages 2024-09-18T12:37:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:51.446 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 8.7 M 2024-09-18T12:37:51.446 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 104 M 2024-09-18T12:37:51.447 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:37:51.465 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T12:37:51.492 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-18T12:37:51.704 INFO:teuthology.orchestra.run.smithi148.stdout:(1/12): ceph-prometheus-alerts-19.2.0-0.el9.noa 225 kB/s | 16 kB 00:00 2024-09-18T12:37:51.729 INFO:teuthology.orchestra.run.smithi148.stdout:(2/12): ceph-grafana-dashboards-19.2.0-0.el9.no 324 kB/s | 32 kB 00:00 2024-09-18T12:37:51.796 INFO:teuthology.orchestra.run.smithi148.stdout:(3/12): ceph-mgr-dashboard-19.2.0-0.el9.noarch. 22 MB/s | 3.6 MB 00:00 2024-09-18T12:37:51.905 INFO:teuthology.orchestra.run.smithi148.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.5 MB/s | 269 kB 00:00 2024-09-18T12:37:51.938 INFO:teuthology.orchestra.run.smithi148.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-09-18T12:37:52.006 INFO:teuthology.orchestra.run.smithi148.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 323 kB/s | 19 kB 00:00 2024-09-18T12:37:52.073 INFO:teuthology.orchestra.run.smithi148.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 3.2 MB/s | 548 kB 00:00 2024-09-18T12:37:52.106 INFO:teuthology.orchestra.run.smithi148.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.7 MB/s | 863 kB 00:00 2024-09-18T12:37:52.148 INFO:teuthology.orchestra.run.smithi148.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.9 MB/s | 144 kB 00:00 2024-09-18T12:37:52.182 INFO:teuthology.orchestra.run.smithi148.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 409 kB/s | 31 kB 00:00 2024-09-18T12:37:52.207 INFO:teuthology.orchestra.run.smithi148.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.3 MB/s | 188 kB 00:00 2024-09-18T12:37:52.390 INFO:teuthology.orchestra.run.smithi148.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.3 MB/s | 2.0 MB 00:00 2024-09-18T12:37:52.394 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:37:52.394 INFO:teuthology.orchestra.run.smithi148.stdout:Total 9.1 MB/s | 8.7 MB 00:00 2024-09-18T12:37:52.442 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:37:52.459 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:37:52.460 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:37:52.689 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:37:52.690 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:37:53.215 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:37:53.291 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-18T12:37:53.334 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-18T12:37:53.389 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-18T12:37:53.428 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-18T12:37:53.532 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-18T12:37:53.663 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-18T12:37:53.748 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-18T12:37:53.800 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-18T12:37:53.837 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-18T12:37:53.868 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 10/12 2024-09-18T12:37:54.118 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-18T12:37:54.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 1/12 2024-09-18T12:37:54.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:37:54.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:37:54.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T12:37:54.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T12:37:54.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T12:37:54.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T12:37:54.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T12:37:54.118 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T12:37:54.119 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:37:54.119 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T12:37:54.554 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T12:37:54.554 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:54.554 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:37:54.554 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarch 2024-09-18T12:37:54.554 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T12:37:54.554 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T12:37:54.554 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T12:37:54.554 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T12:37:54.554 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T12:37:54.555 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T12:37:54.555 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T12:37:54.555 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T12:37:54.555 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T12:37:54.555 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T12:37:54.555 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T12:37:54.555 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:54.555 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:37:54.919 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 11/12 2024-09-18T12:37:54.946 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-mgr-rook 2024-09-18T12:37:54.952 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-18T12:37:55.532 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:17 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:37:55.664 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:37:55.665 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:55.665 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-09-18T12:37:55.665 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:55.665 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:37:55.665 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook noarch 2:19.2.0-0.el9 ceph-noarch 49 k 2024-09-18T12:37:55.665 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-18T12:37:55.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T12:37:55.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T12:37:55.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T12:37:55.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T12:37:55.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T12:37:55.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T12:37:55.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T12:37:55.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T12:37:55.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T12:37:55.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T12:37:55.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T12:37:55.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T12:37:55.666 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:55.666 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:37:55.666 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:37:55.667 INFO:teuthology.orchestra.run.smithi078.stdout:Install 13 Packages 2024-09-18T12:37:55.667 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:55.667 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 2.2 M 2024-09-18T12:37:55.667 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 26 M 2024-09-18T12:37:55.667 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:37:55.893 INFO:teuthology.orchestra.run.smithi078.stdout:(1/13): ceph-mgr-rook-19.2.0-0.el9.noarch.rpm 919 kB/s | 49 kB 00:00 2024-09-18T12:37:55.943 INFO:teuthology.orchestra.run.smithi078.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 247 kB/s | 26 kB 00:00 2024-09-18T12:37:55.969 INFO:teuthology.orchestra.run.smithi078.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 149 kB/s | 19 kB 00:00 2024-09-18T12:37:56.052 INFO:teuthology.orchestra.run.smithi078.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-18T12:37:56.102 INFO:teuthology.orchestra.run.smithi078.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-18T12:37:56.127 INFO:teuthology.orchestra.run.smithi078.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 713 kB/s | 54 kB 00:00 2024-09-18T12:37:56.152 INFO:teuthology.orchestra.run.smithi078.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-18T12:37:56.194 INFO:teuthology.orchestra.run.smithi078.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 349 kB/s | 32 kB 00:00 2024-09-18T12:37:56.220 INFO:teuthology.orchestra.run.smithi078.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 153 kB/s | 14 kB 00:00 2024-09-18T12:37:56.245 INFO:teuthology.orchestra.run.smithi078.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-18T12:37:56.270 INFO:teuthology.orchestra.run.smithi078.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.1 MB/s | 220 kB 00:00 2024-09-18T12:37:56.295 INFO:teuthology.orchestra.run.smithi078.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-18T12:37:56.337 INFO:teuthology.orchestra.run.smithi078.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-18T12:37:56.340 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:37:56.340 INFO:teuthology.orchestra.run.smithi078.stdout:Total 3.3 MB/s | 2.2 MB 00:00 2024-09-18T12:37:56.387 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-18T12:37:56.387 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 1/12 2024-09-18T12:37:56.387 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2/12 2024-09-18T12:37:56.387 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 3/12 2024-09-18T12:37:56.387 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-18T12:37:56.387 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-18T12:37:56.387 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-18T12:37:56.387 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-18T12:37:56.388 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-18T12:37:56.388 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-18T12:37:56.388 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-18T12:37:56.388 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-18T12:37:56.402 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:37:56.417 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:37:56.417 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:37:56.507 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:37:56.507 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:37:56.700 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-18T12:37:56.700 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:56.700 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:37:56.700 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-18T12:37:56.700 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 2024-09-18T12:37:56.700 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2024-09-18T12:37:56.700 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 2024-09-18T12:37:56.700 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-18T12:37:56.700 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-18T12:37:56.701 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-18T12:37:56.701 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-18T12:37:56.701 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-18T12:37:56.701 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-18T12:37:56.701 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T12:37:56.701 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T12:37:56.701 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:56.701 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:37:56.953 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T12:37:57.029 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:37:57.200 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T12:37:57.256 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T12:37:57.319 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T12:37:57.364 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T12:37:57.406 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T12:37:57.517 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T12:37:57.537 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:02 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:37:57.627 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T12:37:57.669 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:37:57.671 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:57.671 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-18T12:37:57.671 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:57.671 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:37:57.671 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.0-0.el9 ceph-noarch 7.4 M 2024-09-18T12:37:57.671 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-18T12:37:57.671 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T12:37:57.671 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T12:37:57.671 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T12:37:57.671 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T12:37:57.671 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T12:37:57.671 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T12:37:57.671 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T12:37:57.672 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T12:37:57.672 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T12:37:57.672 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T12:37:57.672 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T12:37:57.672 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:57.672 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:37:57.672 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:37:57.672 INFO:teuthology.orchestra.run.smithi148.stdout:Install 12 Packages 2024-09-18T12:37:57.672 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:37:57.673 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 38 M 2024-09-18T12:37:57.673 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 212 M 2024-09-18T12:37:57.673 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:37:57.691 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T12:37:57.949 INFO:teuthology.orchestra.run.smithi148.stdout:(1/12): ceph-mgr-diskprediction-local-19.2.0-0. 57 MB/s | 7.4 MB 00:00 2024-09-18T12:37:57.990 INFO:teuthology.orchestra.run.smithi148.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-18T12:37:58.032 INFO:teuthology.orchestra.run.smithi148.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-18T12:37:58.058 INFO:teuthology.orchestra.run.smithi148.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-18T12:37:58.116 INFO:teuthology.orchestra.run.smithi148.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 661 kB/s | 38 kB 00:00 2024-09-18T12:37:58.141 INFO:teuthology.orchestra.run.smithi148.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 167 kB/s | 18 kB 00:00 2024-09-18T12:37:58.250 INFO:teuthology.orchestra.run.smithi148.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-18T12:37:58.300 INFO:teuthology.orchestra.run.smithi148.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.7 MB/s | 3.0 MB 00:00 2024-09-18T12:37:58.343 INFO:teuthology.orchestra.run.smithi148.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 5.9 MB/s | 250 kB 00:00 2024-09-18T12:37:58.409 INFO:teuthology.orchestra.run.smithi148.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 17 MB/s | 4.9 MB 00:00 2024-09-18T12:37:58.420 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T12:37:58.472 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T12:37:58.501 INFO:teuthology.orchestra.run.smithi148.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-09-18T12:37:58.505 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T12:37:58.554 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T12:37:58.584 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-18T12:37:58.710 INFO:teuthology.orchestra.run.smithi148.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2024-09-18T12:37:58.710 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:37:58.711 INFO:teuthology.orchestra.run.smithi148.stdout:Total 37 MB/s | 38 MB 00:01 2024-09-18T12:37:59.066 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:37:59.092 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:37:59.092 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:37:59.427 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-18T12:37:59.427 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-rook-2:19.2.0-0.el9.noarch 1/13 2024-09-18T12:37:59.427 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T12:37:59.427 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T12:37:59.427 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T12:37:59.427 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T12:37:59.427 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T12:37:59.427 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T12:37:59.427 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T12:37:59.427 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T12:37:59.427 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T12:37:59.428 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T12:37:59.428 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T12:37:59.526 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:37:59.526 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:37:59.767 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T12:37:59.767 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:59.768 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:37:59.768 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook-2:19.2.0-0.el9.noarch 2024-09-18T12:37:59.768 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T12:37:59.768 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T12:37:59.768 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T12:37:59.768 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T12:37:59.768 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T12:37:59.768 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T12:37:59.768 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T12:37:59.768 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T12:37:59.768 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T12:37:59.768 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T12:37:59.769 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T12:37:59.769 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T12:37:59.769 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:37:59.769 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:38:00.027 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T12:38:00.308 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:38:00.370 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T12:38:00.407 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:38:00.507 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:38:00.551 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T12:38:00.598 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:22 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:38:00.729 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:38:00.730 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:00.730 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-09-18T12:38:00.730 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:00.730 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:38:00.730 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm noarch 2:19.2.0-0.el9 ceph-noarch 146 k 2024-09-18T12:38:00.730 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-18T12:38:00.731 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T12:38:00.731 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T12:38:00.731 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T12:38:00.731 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T12:38:00.731 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T12:38:00.731 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:00.731 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:38:00.731 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:00.731 INFO:teuthology.orchestra.run.smithi078.stdout:Install 6 Packages 2024-09-18T12:38:00.731 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:00.732 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 7.0 M 2024-09-18T12:38:00.732 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 33 M 2024-09-18T12:38:00.732 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:38:00.734 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T12:38:00.766 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T12:38:00.843 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T12:38:01.298 INFO:teuthology.orchestra.run.smithi078.stdout:(1/6): ceph-mgr-cephadm-19.2.0-0.el9.noarch.rpm 2.6 MB/s | 146 kB 00:00 2024-09-18T12:38:01.399 INFO:teuthology.orchestra.run.smithi078.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.4 MB/s | 548 kB 00:00 2024-09-18T12:38:01.432 INFO:teuthology.orchestra.run.smithi078.stdout:(3/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-09-18T12:38:01.458 INFO:teuthology.orchestra.run.smithi078.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 983 kB/s | 58 kB 00:00 2024-09-18T12:38:01.484 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T12:38:01.508 INFO:teuthology.orchestra.run.smithi078.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 994 kB/s | 74 kB 00:00 2024-09-18T12:38:01.604 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T12:38:01.616 INFO:teuthology.orchestra.run.smithi078.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-18T12:38:01.618 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:01.618 INFO:teuthology.orchestra.run.smithi078.stdout:Total 7.9 MB/s | 7.0 MB 00:00 2024-09-18T12:38:01.688 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:38:01.699 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:38:01.700 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:38:01.797 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:38:01.798 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:38:02.104 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:38:02.283 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T12:38:02.343 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T12:38:02.844 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:38:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T12:38:02.939 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T12:38:03.010 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T12:38:03.038 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-18T12:38:03.832 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-18T12:38:03.832 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 1/6 2024-09-18T12:38:03.832 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T12:38:03.832 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T12:38:03.832 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T12:38:03.832 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T12:38:03.874 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T12:38:03.898 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-18T12:38:04.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T12:38:04.101 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:04.101 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:38:04.101 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 2024-09-18T12:38:04.101 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T12:38:04.101 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T12:38:04.101 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T12:38:04.101 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T12:38:04.101 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T12:38:04.102 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:04.102 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:38:04.391 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-fuse 2024-09-18T12:38:04.969 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:26 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:38:05.100 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:38:05.101 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:05.101 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2024-09-18T12:38:05.101 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:05.101 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:38:05.101 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse x86_64 2:19.2.0-0.el9 ceph 896 k 2024-09-18T12:38:05.101 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-18T12:38:05.101 INFO:teuthology.orchestra.run.smithi078.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T12:38:05.101 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:05.101 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:38:05.102 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:05.102 INFO:teuthology.orchestra.run.smithi078.stdout:Install 2 Packages 2024-09-18T12:38:05.102 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:05.102 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 976 k 2024-09-18T12:38:05.102 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 2.9 M 2024-09-18T12:38:05.103 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:38:05.443 INFO:teuthology.orchestra.run.smithi078.stdout:(1/2): ceph-fuse-19.2.0-0.el9.x86_64.rpm 16 MB/s | 896 kB 00:00 2024-09-18T12:38:05.751 INFO:teuthology.orchestra.run.smithi078.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 219 kB/s | 80 kB 00:00 2024-09-18T12:38:05.752 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:05.752 INFO:teuthology.orchestra.run.smithi078.stdout:Total 1.5 MB/s | 976 kB 00:00 2024-09-18T12:38:05.765 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:38:05.789 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:38:05.790 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:38:05.874 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:38:05.874 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:38:06.064 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:38:06.212 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T12:38:06.275 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-18T12:38:06.621 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-18T12:38:06.621 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 1/12 2024-09-18T12:38:06.621 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:38:06.622 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:38:06.622 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T12:38:06.622 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T12:38:06.622 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T12:38:06.622 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T12:38:06.622 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T12:38:06.622 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T12:38:06.622 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:38:06.622 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T12:38:06.936 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-18T12:38:06.937 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-2:19.2.0-0.el9.x86_64 1/2 2024-09-18T12:38:07.040 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T12:38:07.040 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:07.040 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:38:07.040 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarch 2024-09-18T12:38:07.041 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T12:38:07.041 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T12:38:07.041 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T12:38:07.041 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T12:38:07.041 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T12:38:07.041 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T12:38:07.041 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T12:38:07.041 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T12:38:07.041 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T12:38:07.042 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T12:38:07.042 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T12:38:07.042 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:07.042 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:07.183 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T12:38:07.184 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:07.184 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:38:07.184 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-2:19.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T12:38:07.184 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:07.184 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:38:07.385 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-rook 2024-09-18T12:38:07.505 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install librados-devel 2024-09-18T12:38:07.973 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:12 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:38:08.100 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:30 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:38:08.105 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:38:08.106 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:08.106 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-18T12:38:08.106 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:08.107 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:38:08.107 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:19.2.0-0.el9 ceph-noarch 49 k 2024-09-18T12:38:08.107 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-18T12:38:08.107 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T12:38:08.107 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T12:38:08.107 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T12:38:08.107 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T12:38:08.107 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T12:38:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T12:38:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T12:38:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T12:38:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T12:38:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T12:38:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T12:38:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T12:38:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:08.109 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:38:08.109 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:08.109 INFO:teuthology.orchestra.run.smithi148.stdout:Install 13 Packages 2024-09-18T12:38:08.109 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:08.110 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 2.2 M 2024-09-18T12:38:08.110 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 26 M 2024-09-18T12:38:08.110 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:38:08.238 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:38:08.239 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:08.239 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2024-09-18T12:38:08.239 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:08.239 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:38:08.239 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel x86_64 2:19.2.0-0.el9 ceph 126 k 2024-09-18T12:38:08.239 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:08.239 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:38:08.239 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:08.239 INFO:teuthology.orchestra.run.smithi078.stdout:Install 1 Package 2024-09-18T12:38:08.239 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:08.240 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 126 k 2024-09-18T12:38:08.240 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 456 k 2024-09-18T12:38:08.240 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:38:08.249 INFO:teuthology.orchestra.run.smithi148.stdout:(1/13): ceph-mgr-rook-19.2.0-0.el9.noarch.rpm 812 kB/s | 49 kB 00:00 2024-09-18T12:38:08.282 INFO:teuthology.orchestra.run.smithi078.stdout:librados-devel-19.2.0-0.el9.x86_64.rpm 3.0 MB/s | 126 kB 00:00 2024-09-18T12:38:08.283 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:08.283 INFO:teuthology.orchestra.run.smithi078.stdout:Total 2.9 MB/s | 126 kB 00:00 2024-09-18T12:38:08.283 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:38:08.288 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:38:08.289 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:38:08.308 INFO:teuthology.orchestra.run.smithi148.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 161 kB/s | 19 kB 00:00 2024-09-18T12:38:08.333 INFO:teuthology.orchestra.run.smithi148.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 177 kB/s | 26 kB 00:00 2024-09-18T12:38:08.353 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:38:08.353 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:38:08.375 INFO:teuthology.orchestra.run.smithi148.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 222 kB 00:00 2024-09-18T12:38:08.417 INFO:teuthology.orchestra.run.smithi148.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 1.3 MB/s | 54 kB 00:00 2024-09-18T12:38:08.442 INFO:teuthology.orchestra.run.smithi148.stdout:(6/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-18T12:38:08.468 INFO:teuthology.orchestra.run.smithi148.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.0 MB/s | 279 kB 00:00 2024-09-18T12:38:08.507 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:38:08.518 INFO:teuthology.orchestra.run.smithi148.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-18T12:38:08.543 INFO:teuthology.orchestra.run.smithi148.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-18T12:38:08.568 INFO:teuthology.orchestra.run.smithi148.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-18T12:38:08.594 INFO:teuthology.orchestra.run.smithi148.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-18T12:38:08.614 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:08.619 INFO:teuthology.orchestra.run.smithi148.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-18T12:38:08.677 INFO:teuthology.orchestra.run.smithi148.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.5 MB/s | 1.0 MB 00:00 2024-09-18T12:38:08.680 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:08.680 INFO:teuthology.orchestra.run.smithi148.stdout:Total 3.9 MB/s | 2.2 MB 00:00 2024-09-18T12:38:08.744 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:38:08.759 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:38:08.759 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:38:08.856 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:38:08.857 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:38:09.074 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:09.358 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:09.358 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:09.358 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:38:09.358 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-2:19.2.0-0.el9.x86_64 2024-09-18T12:38:09.358 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:09.358 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:38:09.360 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:38:09.540 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T12:38:09.595 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T12:38:09.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install libcephfs2 2024-09-18T12:38:09.650 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T12:38:09.696 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T12:38:09.746 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T12:38:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T12:38:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T12:38:10.006 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T12:38:10.206 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:38:10.296 INFO:teuthology.orchestra.run.smithi078.stdout:Package libcephfs2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:38:10.340 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:38:10.341 INFO:teuthology.orchestra.run.smithi078.stdout:Nothing to do. 2024-09-18T12:38:10.341 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:38:10.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install libcephfs-devel 2024-09-18T12:38:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T12:38:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T12:38:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T12:38:10.851 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T12:38:10.873 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-18T12:38:11.014 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:33 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:38:11.144 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:38:11.145 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:11.145 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2024-09-18T12:38:11.145 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:11.145 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:38:11.145 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel x86_64 2:19.2.0-0.el9 ceph 32 k 2024-09-18T12:38:11.145 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:11.145 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:38:11.145 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:11.145 INFO:teuthology.orchestra.run.smithi078.stdout:Install 1 Package 2024-09-18T12:38:11.145 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:11.146 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 32 k 2024-09-18T12:38:11.146 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 142 k 2024-09-18T12:38:11.146 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:38:11.194 INFO:teuthology.orchestra.run.smithi078.stdout:libcephfs-devel-19.2.0-0.el9.x86_64.rpm 658 kB/s | 32 kB 00:00 2024-09-18T12:38:11.194 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:11.195 INFO:teuthology.orchestra.run.smithi078.stdout:Total 641 kB/s | 32 kB 00:00 2024-09-18T12:38:11.195 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:38:11.198 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:38:11.198 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:38:11.227 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:38:11.227 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:38:11.319 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:38:11.425 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:11.737 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-18T12:38:11.737 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:19.2.0-0.el9.noarch 1/13 2024-09-18T12:38:11.737 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T12:38:11.737 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T12:38:11.737 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T12:38:11.737 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T12:38:11.737 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T12:38:11.737 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T12:38:11.738 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T12:38:11.738 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T12:38:11.738 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T12:38:11.738 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T12:38:11.738 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T12:38:11.800 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:12.040 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:12.040 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:12.040 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:38:12.040 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel-2:19.2.0-0.el9.x86_64 2024-09-18T12:38:12.040 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:12.040 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:38:12.072 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T12:38:12.072 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:12.072 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:38:12.072 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:19.2.0-0.el9.noarch 2024-09-18T12:38:12.072 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T12:38:12.072 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T12:38:12.072 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T12:38:12.072 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T12:38:12.073 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T12:38:12.073 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T12:38:12.073 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T12:38:12.073 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T12:38:12.073 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T12:38:12.073 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T12:38:12.073 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T12:38:12.073 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T12:38:12.073 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:12.073 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:12.235 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install librados2 2024-09-18T12:38:12.324 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T12:38:12.811 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:38:12.900 INFO:teuthology.orchestra.run.smithi078.stdout:Package librados2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:38:12.902 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:17 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:38:12.943 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:38:12.944 INFO:teuthology.orchestra.run.smithi078.stdout:Nothing to do. 2024-09-18T12:38:12.944 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:38:13.015 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install librbd1 2024-09-18T12:38:13.035 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:38:13.035 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:13.035 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-18T12:38:13.036 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:13.036 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:38:13.036 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:19.2.0-0.el9 ceph-noarch 146 k 2024-09-18T12:38:13.036 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-18T12:38:13.036 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T12:38:13.036 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T12:38:13.036 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T12:38:13.036 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T12:38:13.036 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T12:38:13.036 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:13.036 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:38:13.037 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:13.037 INFO:teuthology.orchestra.run.smithi148.stdout:Install 6 Packages 2024-09-18T12:38:13.037 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:13.037 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 7.0 M 2024-09-18T12:38:13.037 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 33 M 2024-09-18T12:38:13.037 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:38:13.446 INFO:teuthology.orchestra.run.smithi148.stdout:(1/6): ceph-mgr-cephadm-19.2.0-0.el9.noarch.rpm 3.3 MB/s | 146 kB 00:00 2024-09-18T12:38:13.546 INFO:teuthology.orchestra.run.smithi148.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.3 MB/s | 548 kB 00:00 2024-09-18T12:38:13.571 INFO:teuthology.orchestra.run.smithi148.stdout:(3/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-18T12:38:13.588 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:35 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:38:13.597 INFO:teuthology.orchestra.run.smithi148.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-18T12:38:13.656 INFO:teuthology.orchestra.run.smithi148.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 890 kB/s | 74 kB 00:00 2024-09-18T12:38:13.676 INFO:teuthology.orchestra.run.smithi078.stdout:Package librbd1-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:38:13.720 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:38:13.720 INFO:teuthology.orchestra.run.smithi078.stdout:Nothing to do. 2024-09-18T12:38:13.721 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:38:13.756 INFO:teuthology.orchestra.run.smithi148.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-18T12:38:13.757 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:13.758 INFO:teuthology.orchestra.run.smithi148.stdout:Total 9.7 MB/s | 7.0 MB 00:00 2024-09-18T12:38:13.791 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install python3-rados 2024-09-18T12:38:13.827 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:38:13.838 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:38:13.838 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:38:13.938 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:38:13.938 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:38:14.241 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:38:14.369 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:38:14.407 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T12:38:14.457 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T12:38:14.458 INFO:teuthology.orchestra.run.smithi078.stdout:Package python3-rados-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:38:14.501 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:38:14.502 INFO:teuthology.orchestra.run.smithi078.stdout:Nothing to do. 2024-09-18T12:38:14.502 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:38:14.575 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install python3-rgw 2024-09-18T12:38:14.991 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T12:38:15.085 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T12:38:15.149 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T12:38:15.151 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:38:15.178 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-18T12:38:15.241 INFO:teuthology.orchestra.run.smithi078.stdout:Package python3-rgw-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:38:15.285 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:38:15.286 INFO:teuthology.orchestra.run.smithi078.stdout:Nothing to do. 2024-09-18T12:38:15.286 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:38:15.369 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install python3-cephfs 2024-09-18T12:38:15.946 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:38:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-18T12:38:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 1/6 2024-09-18T12:38:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T12:38:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T12:38:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T12:38:15.953 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T12:38:16.035 INFO:teuthology.orchestra.run.smithi078.stdout:Package python3-cephfs-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:38:16.078 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:38:16.078 INFO:teuthology.orchestra.run.smithi078.stdout:Nothing to do. 2024-09-18T12:38:16.079 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:38:16.148 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install python3-rbd 2024-09-18T12:38:16.225 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T12:38:16.226 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:16.226 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:38:16.226 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 2024-09-18T12:38:16.226 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T12:38:16.226 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T12:38:16.226 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T12:38:16.226 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T12:38:16.226 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T12:38:16.226 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:16.226 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:16.477 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-fuse 2024-09-18T12:38:16.724 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:38:16.811 INFO:teuthology.orchestra.run.smithi078.stdout:Package python3-rbd-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:38:16.855 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:38:16.856 INFO:teuthology.orchestra.run.smithi078.stdout:Nothing to do. 2024-09-18T12:38:16.856 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:38:16.932 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install rbd-fuse 2024-09-18T12:38:17.060 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:22 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:38:17.193 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:38:17.193 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:17.193 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-18T12:38:17.193 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:17.194 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:38:17.194 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:19.2.0-0.el9 ceph 896 k 2024-09-18T12:38:17.194 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-18T12:38:17.194 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T12:38:17.194 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:17.194 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:38:17.194 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:17.194 INFO:teuthology.orchestra.run.smithi148.stdout:Install 2 Packages 2024-09-18T12:38:17.194 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:17.195 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 976 k 2024-09-18T12:38:17.195 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 2.9 M 2024-09-18T12:38:17.195 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:38:17.283 INFO:teuthology.orchestra.run.smithi148.stdout:(1/2): ceph-fuse-19.2.0-0.el9.x86_64.rpm 14 MB/s | 896 kB 00:00 2024-09-18T12:38:17.374 INFO:teuthology.orchestra.run.smithi148.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 513 kB/s | 80 kB 00:00 2024-09-18T12:38:17.374 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:17.375 INFO:teuthology.orchestra.run.smithi148.stdout:Total 5.3 MB/s | 976 kB 00:00 2024-09-18T12:38:17.386 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:38:17.407 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:38:17.408 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:38:17.488 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:38:17.489 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:38:17.511 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:39 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:38:17.643 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:38:17.644 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:17.644 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2024-09-18T12:38:17.644 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:17.644 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:38:17.644 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse x86_64 2:19.2.0-0.el9 ceph 85 k 2024-09-18T12:38:17.644 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:17.644 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:38:17.645 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:17.645 INFO:teuthology.orchestra.run.smithi078.stdout:Install 1 Package 2024-09-18T12:38:17.645 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:17.645 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 85 k 2024-09-18T12:38:17.645 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 231 k 2024-09-18T12:38:17.645 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:38:17.678 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:38:17.697 INFO:teuthology.orchestra.run.smithi078.stdout:rbd-fuse-19.2.0-0.el9.x86_64.rpm 1.6 MB/s | 85 kB 00:00 2024-09-18T12:38:17.698 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:17.698 INFO:teuthology.orchestra.run.smithi078.stdout:Total 1.5 MB/s | 85 kB 00:00 2024-09-18T12:38:17.698 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:38:17.705 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:38:17.705 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:38:17.767 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:38:17.768 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:38:17.809 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T12:38:17.883 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-18T12:38:17.927 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:38:18.035 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:18.423 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:18.547 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-18T12:38:18.548 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:19.2.0-0.el9.x86_64 1/2 2024-09-18T12:38:18.683 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:18.683 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:18.683 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:38:18.683 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-2:19.2.0-0.el9.x86_64 2024-09-18T12:38:18.683 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:18.683 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:38:18.835 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T12:38:18.835 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:18.835 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:38:18.835 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:19.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T12:38:18.835 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:18.835 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:18.915 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install rbd-mirror 2024-09-18T12:38:19.137 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install librados-devel 2024-09-18T12:38:19.496 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:41 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:38:19.633 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:38:19.634 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:19.634 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2024-09-18T12:38:19.634 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:19.634 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:38:19.634 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror x86_64 2:19.2.0-0.el9 ceph 3.1 M 2024-09-18T12:38:19.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:19.634 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:38:19.634 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:19.635 INFO:teuthology.orchestra.run.smithi078.stdout:Install 1 Package 2024-09-18T12:38:19.635 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:19.635 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 3.1 M 2024-09-18T12:38:19.635 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 13 M 2024-09-18T12:38:19.635 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:38:19.726 INFO:teuthology.orchestra.run.smithi078.stdout:rbd-mirror-19.2.0-0.el9.x86_64.rpm 34 MB/s | 3.1 MB 00:00 2024-09-18T12:38:19.726 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:19.727 INFO:teuthology.orchestra.run.smithi078.stdout:Total 33 MB/s | 3.1 MB 00:00 2024-09-18T12:38:19.727 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:38:19.732 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:24 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:38:19.736 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:38:19.736 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:38:19.816 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:38:19.816 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:38:19.867 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:38:19.868 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:19.868 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-18T12:38:19.868 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:19.868 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:38:19.868 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:19.2.0-0.el9 ceph 126 k 2024-09-18T12:38:19.868 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:19.868 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:38:19.869 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:19.869 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-18T12:38:19.869 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:19.869 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 126 k 2024-09-18T12:38:19.869 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 456 k 2024-09-18T12:38:19.869 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:38:19.912 INFO:teuthology.orchestra.run.smithi148.stdout:librados-devel-19.2.0-0.el9.x86_64.rpm 2.9 MB/s | 126 kB 00:00 2024-09-18T12:38:19.912 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:19.913 INFO:teuthology.orchestra.run.smithi148.stdout:Total 2.8 MB/s | 126 kB 00:00 2024-09-18T12:38:19.913 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:38:19.920 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:38:19.920 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:38:19.982 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:38:19.983 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:38:20.134 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:38:20.237 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:38:20.243 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:20.302 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:20.327 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:20.327 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:38:20.327 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T12:38:20.327 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:38:20.327 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:38:20.327 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:20.708 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:20.961 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:20.961 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:20.961 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:38:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:19.2.0-0.el9.x86_64 2024-09-18T12:38:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:20.962 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:21.204 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install libcephfs2 2024-09-18T12:38:21.422 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:21.422 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:21.422 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:38:21.422 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-2:19.2.0-0.el9.x86_64 2024-09-18T12:38:21.422 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:21.422 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:38:21.712 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install rbd-nbd 2024-09-18T12:38:21.792 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:26 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:38:21.881 INFO:teuthology.orchestra.run.smithi148.stdout:Package libcephfs2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:38:21.927 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:38:21.928 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-18T12:38:21.928 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:21.996 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install libcephfs-devel 2024-09-18T12:38:22.294 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:44 ago on Wed 18 Sep 2024 12:36:38 PM UTC. 2024-09-18T12:38:22.430 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-18T12:38:22.431 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:22.431 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2024-09-18T12:38:22.431 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:22.432 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-18T12:38:22.432 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd x86_64 2:19.2.0-0.el9 ceph 170 k 2024-09-18T12:38:22.432 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:22.432 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-18T12:38:22.432 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-18T12:38:22.432 INFO:teuthology.orchestra.run.smithi078.stdout:Install 1 Package 2024-09-18T12:38:22.432 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:22.432 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 170 k 2024-09-18T12:38:22.432 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 494 k 2024-09-18T12:38:22.432 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-18T12:38:22.489 INFO:teuthology.orchestra.run.smithi078.stdout:rbd-nbd-19.2.0-0.el9.x86_64.rpm 3.0 MB/s | 170 kB 00:00 2024-09-18T12:38:22.490 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:22.490 INFO:teuthology.orchestra.run.smithi078.stdout:Total 2.8 MB/s | 170 kB 00:00 2024-09-18T12:38:22.490 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-18T12:38:22.498 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-18T12:38:22.499 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-18T12:38:22.563 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-18T12:38:22.564 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-18T12:38:22.577 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:27 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:38:22.708 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:38:22.709 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:22.709 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-18T12:38:22.710 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:22.710 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:38:22.710 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:19.2.0-0.el9 ceph 32 k 2024-09-18T12:38:22.710 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:22.710 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:38:22.710 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:22.710 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-18T12:38:22.710 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:22.710 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 32 k 2024-09-18T12:38:22.710 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 142 k 2024-09-18T12:38:22.710 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:38:22.726 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-18T12:38:22.766 INFO:teuthology.orchestra.run.smithi148.stdout:libcephfs-devel-19.2.0-0.el9.x86_64.rpm 568 kB/s | 32 kB 00:00 2024-09-18T12:38:22.767 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:22.767 INFO:teuthology.orchestra.run.smithi148.stdout:Total 555 kB/s | 32 kB 00:00 2024-09-18T12:38:22.767 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:38:22.770 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:38:22.770 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:38:22.782 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:38:22.782 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:38:22.830 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:22.862 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:38:22.978 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:23.282 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:23.549 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:23.549 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:23.549 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-18T12:38:23.549 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-2:19.2.0-0.el9.x86_64 2024-09-18T12:38:23.549 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:38:23.549 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-18T12:38:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:23.567 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:38:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:19.2.0-0.el9.x86_64 2024-09-18T12:38:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:23.567 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:23.755 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install librados2 2024-09-18T12:38:23.812 DEBUG:teuthology.parallel:result is None 2024-09-18T12:38:24.335 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:29 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:38:24.426 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:38:24.469 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:38:24.470 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-18T12:38:24.470 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:24.535 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install librbd1 2024-09-18T12:38:25.114 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:30 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:38:25.204 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:38:25.247 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:38:25.248 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-18T12:38:25.248 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:25.362 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-rados 2024-09-18T12:38:25.937 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:30 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:38:26.025 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-rados-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:38:26.069 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:38:26.069 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-18T12:38:26.070 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:26.138 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-rgw 2024-09-18T12:38:26.712 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:31 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:38:26.800 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-rgw-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:38:26.843 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:38:26.844 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-18T12:38:26.844 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:26.920 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-cephfs 2024-09-18T12:38:27.505 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:38:27.594 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-cephfs-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:38:27.638 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:38:27.639 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-18T12:38:27.639 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:27.710 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-rbd 2024-09-18T12:38:28.289 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:33 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:38:28.376 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-rbd-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:38:28.421 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:38:28.422 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-18T12:38:28.422 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:28.496 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install rbd-fuse 2024-09-18T12:38:29.073 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:38:29.206 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:38:29.207 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:29.207 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-18T12:38:29.207 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:29.207 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:38:29.207 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:19.2.0-0.el9 ceph 85 k 2024-09-18T12:38:29.207 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:29.207 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:38:29.207 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:29.207 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-18T12:38:29.207 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:29.208 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 85 k 2024-09-18T12:38:29.208 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 231 k 2024-09-18T12:38:29.208 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:38:29.261 INFO:teuthology.orchestra.run.smithi148.stdout:rbd-fuse-19.2.0-0.el9.x86_64.rpm 1.6 MB/s | 85 kB 00:00 2024-09-18T12:38:29.261 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:29.261 INFO:teuthology.orchestra.run.smithi148.stdout:Total 1.5 MB/s | 85 kB 00:00 2024-09-18T12:38:29.262 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:38:29.268 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:38:29.268 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:38:29.331 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:38:29.332 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:38:29.482 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:38:29.599 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:30.005 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:30.269 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:30.269 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:30.269 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:38:30.270 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:19.2.0-0.el9.x86_64 2024-09-18T12:38:30.270 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:30.270 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:30.529 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install rbd-mirror 2024-09-18T12:38:31.120 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:38:31.254 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:38:31.255 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:31.255 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-18T12:38:31.255 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:31.255 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:38:31.255 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:19.2.0-0.el9 ceph 3.1 M 2024-09-18T12:38:31.256 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:31.256 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:38:31.256 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:31.256 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-18T12:38:31.256 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:31.256 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 3.1 M 2024-09-18T12:38:31.256 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 13 M 2024-09-18T12:38:31.256 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:38:31.331 INFO:teuthology.orchestra.run.smithi148.stdout:rbd-mirror-19.2.0-0.el9.x86_64.rpm 41 MB/s | 3.1 MB 00:00 2024-09-18T12:38:31.332 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:31.332 INFO:teuthology.orchestra.run.smithi148.stdout:Total 41 MB/s | 3.1 MB 00:00 2024-09-18T12:38:31.332 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:38:31.341 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:38:31.341 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:38:31.422 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:38:31.422 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:38:31.852 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:38:31.932 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:31.956 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:38:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T12:38:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:38:31.956 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:38:31.956 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:33.068 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:38:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:19.2.0-0.el9.x86_64 2024-09-18T12:38:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:33.068 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:33.360 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install rbd-nbd 2024-09-18T12:38:33.954 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Sep 2024 12:36:55 PM UTC. 2024-09-18T12:38:34.089 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-18T12:38:34.090 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:34.090 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-18T12:38:34.090 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:34.090 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-18T12:38:34.090 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:19.2.0-0.el9 ceph 170 k 2024-09-18T12:38:34.090 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:34.090 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-18T12:38:34.090 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-18T12:38:34.090 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-18T12:38:34.090 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:34.091 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 170 k 2024-09-18T12:38:34.091 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 494 k 2024-09-18T12:38:34.091 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-18T12:38:34.135 INFO:teuthology.orchestra.run.smithi148.stdout:rbd-nbd-19.2.0-0.el9.x86_64.rpm 3.8 MB/s | 170 kB 00:00 2024-09-18T12:38:34.135 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:38:34.136 INFO:teuthology.orchestra.run.smithi148.stdout:Total 3.7 MB/s | 170 kB 00:00 2024-09-18T12:38:34.136 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-18T12:38:34.143 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-18T12:38:34.144 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-18T12:38:34.207 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-18T12:38:34.208 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-18T12:38:34.379 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-18T12:38:34.474 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:35.033 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:35.293 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:38:35.293 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:35.293 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-18T12:38:35.293 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:19.2.0-0.el9.x86_64 2024-09-18T12:38:35.293 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:38:35.294 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-18T12:38:35.557 DEBUG:teuthology.parallel:result is None 2024-09-18T12:38:35.557 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:38:35.558 INFO:teuthology.packaging:ref: None 2024-09-18T12:38:35.558 INFO:teuthology.packaging:tag: None 2024-09-18T12:38:35.558 INFO:teuthology.packaging:branch: squid 2024-09-18T12:38:35.558 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:38:35.558 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-18T12:38:35.796 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T12:38:35.823 INFO:teuthology.orchestra.run.smithi078.stdout:19.2.0-0.el9 2024-09-18T12:38:35.823 INFO:teuthology.packaging:The installed version of ceph is 19.2.0-0.el9 2024-09-18T12:38:35.823 INFO:teuthology.task.install:The correct ceph version 19.2.0-0 is installed. 2024-09-18T12:38:35.825 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:38:35.826 INFO:teuthology.packaging:ref: None 2024-09-18T12:38:35.826 INFO:teuthology.packaging:tag: None 2024-09-18T12:38:35.826 INFO:teuthology.packaging:branch: squid 2024-09-18T12:38:35.826 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:38:35.826 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-18T12:38:36.058 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T12:38:36.080 INFO:teuthology.orchestra.run.smithi148.stdout:19.2.0-0.el9 2024-09-18T12:38:36.080 INFO:teuthology.packaging:The installed version of ceph is 19.2.0-0.el9 2024-09-18T12:38:36.080 INFO:teuthology.task.install:The correct ceph version 19.2.0-0 is installed. 2024-09-18T12:38:36.082 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-18T12:38:36.082 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:38:36.082 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T12:38:36.113 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-18T12:38:36.113 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T12:38:36.146 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-18T12:38:36.146 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:38:36.146 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T12:38:36.181 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T12:38:36.248 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-18T12:38:36.248 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T12:38:36.273 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T12:38:36.337 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-18T12:38:36.338 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:38:36.338 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T12:38:36.364 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T12:38:36.430 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-18T12:38:36.430 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T12:38:36.455 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T12:38:36.519 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-18T12:38:36.520 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:38:36.520 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T12:38:36.546 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T12:38:36.611 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-18T12:38:36.612 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T12:38:36.636 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T12:38:36.702 INFO:teuthology.run_tasks:Running task print... 2024-09-18T12:38:36.715 INFO:teuthology.task.print:**** done install task... 2024-09-18T12:38:36.715 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-18T12:38:36.817 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'squid', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.ceph.io/ceph-ci/ceph:squid', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e'} 2024-09-18T12:38:36.817 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:squid 2024-09-18T12:38:36.818 INFO:tasks.cephadm:Cluster fsid is ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:38:36.818 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-18T12:38:36.818 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-18T12:38:36.818 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi078': '172.21.15.78', 'mon.smithi148': '172.21.15.148'} 2024-09-18T12:38:36.818 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-18T12:38:36.819 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname $(hostname -s) 2024-09-18T12:38:36.845 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname $(hostname -s) 2024-09-18T12:38:36.870 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for squid 2024-09-18T12:38:36.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:38:37.017 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83115/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4983-ge7fb7b56', 'node_name': '172.21.2.6+braggi06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4983.ge7fb7b56'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-17-1213/e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-17 17:21:57.325397', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-guits-main-2024-09-17-1213', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-guits-main-2024-09-17-1213/e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-18T12:38:37.250 INFO:tasks.util.chacra:got chacra host chacra.ceph.com, ref squid, sha1 8e98666cb045318799c9328f1ae906cc2d724fd2 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=squid 2024-09-18T12:38:37.251 INFO:tasks.cephadm:Discovered cachra url: https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm 2024-09-18T12:38:37.251 INFO:tasks.cephadm:Downloading cephadm from url: https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm 2024-09-18T12:38:37.252 DEBUG:teuthology.orchestra.run.smithi078:> curl --silent -L https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-18T12:38:37.566 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r--. 1 ubuntu ubuntu 784488 Sep 18 12:38 /home/ubuntu/cephtest/cephadm 2024-09-18T12:38:37.567 DEBUG:teuthology.orchestra.run.smithi148:> curl --silent -L https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-18T12:38:37.857 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r--. 1 ubuntu ubuntu 784488 Sep 18 12:38 /home/ubuntu/cephtest/cephadm 2024-09-18T12:38:37.858 DEBUG:teuthology.orchestra.run.smithi078:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-18T12:38:37.888 DEBUG:teuthology.orchestra.run.smithi148:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-18T12:38:38.316 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:squid on all hosts... 2024-09-18T12:38:38.316 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-18T12:38:38.319 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-18T12:38:39.990 INFO:teuthology.orchestra.run.smithi148.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-18T12:38:40.002 INFO:teuthology.orchestra.run.smithi078.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-18T12:39:16.603 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:39:16.603 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_version": "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)", 2024-09-18T12:39:16.603 INFO:teuthology.orchestra.run.smithi078.stdout: "image_id": "ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b", 2024-09-18T12:39:16.604 INFO:teuthology.orchestra.run.smithi078.stdout: "repo_digests": [ 2024-09-18T12:39:16.604 INFO:teuthology.orchestra.run.smithi078.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3" 2024-09-18T12:39:16.604 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-18T12:39:16.604 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:39:30.974 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-18T12:39:30.974 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_version": "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)", 2024-09-18T12:39:30.974 INFO:teuthology.orchestra.run.smithi148.stdout: "image_id": "ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b", 2024-09-18T12:39:30.974 INFO:teuthology.orchestra.run.smithi148.stdout: "repo_digests": [ 2024-09-18T12:39:30.974 INFO:teuthology.orchestra.run.smithi148.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3" 2024-09-18T12:39:30.974 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-18T12:39:30.974 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-18T12:39:30.998 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph 2024-09-18T12:39:31.033 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph 2024-09-18T12:39:31.061 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /etc/ceph 2024-09-18T12:39:31.104 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /etc/ceph 2024-09-18T12:39:31.129 INFO:tasks.cephadm:Writing seed config... 2024-09-18T12:39:31.130 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-18T12:39:31.130 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-18T12:39:31.130 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-18T12:39:31.130 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-18T12:39:31.130 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-18T12:39:31.130 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-18T12:39:31.131 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-18T12:39:31.131 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-18T12:39:31.131 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-18T12:39:31.131 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-18T12:39:31.131 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-18T12:39:31.131 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-18T12:39:31.131 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-18T12:39:31.131 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-18T12:39:31.131 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-18T12:39:31.131 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-18T12:39:31.131 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-18T12:39:31.131 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-18T12:39:31.131 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-18T12:39:31.131 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-18T12:39:31.132 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-18T12:39:31.132 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-18T12:39:31.132 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-18T12:39:31.132 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-18T12:39:31.132 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-18T12:39:31.132 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-18T12:39:31.133 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:39:31.133 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-18T12:39:31.164 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ecc0857e-75ba-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-18T12:39:31.165 DEBUG:teuthology.orchestra.run.smithi078:mon.smithi078> sudo journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mon.smithi078.service 2024-09-18T12:39:31.207 INFO:tasks.cephadm:Bootstrapping... 2024-09-18T12:39:31.208 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid -v bootstrap --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.78 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-18T12:39:31.429 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:squid', '-v', 'bootstrap', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.78', '--skip-admin-label'] 2024-09-18T12:39:31.430 INFO:teuthology.orchestra.run.smithi078.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-18T12:39:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying podman|docker is present... 2024-09-18T12:39:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stdout 5.2.2 2024-09-18T12:39:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying lvm2 is present... 2024-09-18T12:39:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying time synchronization is in place... 2024-09-18T12:39:31.462 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-18T12:39:31.462 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-18T12:39:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-18T12:39:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-18T12:39:31.476 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout enabled 2024-09-18T12:39:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout active 2024-09-18T12:39:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:Unit chronyd.service is enabled and running 2024-09-18T12:39:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:Repeating the final host check... 2024-09-18T12:39:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stdout 5.2.2 2024-09-18T12:39:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-18T12:39:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl is present 2024-09-18T12:39:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:lvcreate is present 2024-09-18T12:39:31.512 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-18T12:39:31.513 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-18T12:39:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-18T12:39:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-18T12:39:31.526 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout enabled 2024-09-18T12:39:31.533 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout active 2024-09-18T12:39:31.533 INFO:teuthology.orchestra.run.smithi078.stdout:Unit chronyd.service is enabled and running 2024-09-18T12:39:31.533 INFO:teuthology.orchestra.run.smithi078.stdout:Host looks OK 2024-09-18T12:39:31.534 INFO:teuthology.orchestra.run.smithi078.stdout:Cluster fsid: ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:39:31.534 INFO:teuthology.orchestra.run.smithi078.stdout:Acquiring lock 140330830554976 on /run/cephadm/ecc0857e-75ba-11ef-bceb-c7b262605968.lock 2024-09-18T12:39:31.534 INFO:teuthology.orchestra.run.smithi078.stdout:Lock 140330830554976 acquired on /run/cephadm/ecc0857e-75ba-11ef-bceb-c7b262605968.lock 2024-09-18T12:39:31.534 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying IP 172.21.15.78 port 3300 ... 2024-09-18T12:39:31.534 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying IP 172.21.15.78 port 6789 ... 2024-09-18T12:39:31.534 INFO:teuthology.orchestra.run.smithi078.stdout:Base mon IP(s) is [172.21.15.78:3300, 172.21.15.78:6789], mon addrv is [v2:172.21.15.78:3300,v1:172.21.15.78:6789] 2024-09-18T12:39:31.537 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.78 metric 100 2024-09-18T12:39:31.537 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.78 metric 100 2024-09-18T12:39:31.540 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-18T12:39:31.540 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-18T12:39:31.540 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-18T12:39:31.542 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-18T12:39:31.542 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-18T12:39:31.542 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-18T12:39:31.543 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-18T12:39:31.543 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link noprefixroute 2024-09-18T12:39:31.543 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-18T12:39:31.544 INFO:teuthology.orchestra.run.smithi078.stdout:Mon IP `172.21.15.78` is in CIDR network `172.21.0.0/20` 2024-09-18T12:39:31.544 INFO:teuthology.orchestra.run.smithi078.stdout:Mon IP `172.21.15.78` is in CIDR network `172.21.0.0/20` 2024-09-18T12:39:31.544 INFO:teuthology.orchestra.run.smithi078.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-18T12:39:31.544 INFO:teuthology.orchestra.run.smithi078.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-18T12:39:31.544 INFO:teuthology.orchestra.run.smithi078.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-18T12:39:32.062 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stdout ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b 2024-09-18T12:39:32.062 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:squid... 2024-09-18T12:39:32.062 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stderr Getting image source signatures 2024-09-18T12:39:32.062 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stderr Copying blob sha256:83d928f919f2c1e0c1bd6bccd6df0f26dec4d40362b4c5deccad70d7b002219d 2024-09-18T12:39:32.062 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-18T12:39:32.062 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stderr Copying config sha256:ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b 2024-09-18T12:39:32.062 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-18T12:39:32.992 INFO:teuthology.orchestra.run.smithi078.stdout:ceph: stdout ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable) 2024-09-18T12:39:32.992 INFO:teuthology.orchestra.run.smithi078.stdout:Ceph version: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable) 2024-09-18T12:39:32.992 INFO:teuthology.orchestra.run.smithi078.stdout:Extracting ceph user uid/gid from container image... 2024-09-18T12:39:33.988 INFO:teuthology.orchestra.run.smithi078.stdout:stat: stdout 167 167 2024-09-18T12:39:33.988 INFO:teuthology.orchestra.run.smithi078.stdout:Creating initial keys... 2024-09-18T12:39:34.919 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-authtool: stdout AQAGyupmutEOERAAOJ2IQGei90JT9Em12VP15w== 2024-09-18T12:39:35.840 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-authtool: stdout AQAHyupmWRFSDBAAb4O9Wo8Ary8+0EMwDief5Q== 2024-09-18T12:39:36.855 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-authtool: stdout AQAIyupmjApbCBAA15TKjYuwsT3xDlKnJtdl/A== 2024-09-18T12:39:36.856 INFO:teuthology.orchestra.run.smithi078.stdout:Creating initial monmap... 2024-09-18T12:39:37.836 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-18T12:39:37.837 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-18T12:39:37.837 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:39:37.837 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-18T12:39:37.837 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool for smithi078 [v2:172.21.15.78:3300,v1:172.21.15.78:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-18T12:39:37.837 INFO:teuthology.orchestra.run.smithi078.stdout:setting min_mon_release = quincy 2024-09-18T12:39:37.837 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: set fsid to ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:39:37.837 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-18T12:39:37.837 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:39:37.837 INFO:teuthology.orchestra.run.smithi078.stdout:Creating mon... 2024-09-18T12:39:38.801 INFO:teuthology.orchestra.run.smithi078.stdout:create mon.smithi078 on 2024-09-18T12:39:39.025 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-18T12:39:39.162 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-18T12:39:39.325 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ecc0857e-75ba-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-ecc0857e-75ba-11ef-bceb-c7b262605968.target. 2024-09-18T12:39:39.325 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ecc0857e-75ba-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-ecc0857e-75ba-11ef-bceb-c7b262605968.target. 2024-09-18T12:39:39.546 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mon.smithi078 2024-09-18T12:39:39.546 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mon.smithi078.service: Unit ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mon.smithi078.service not loaded. 2024-09-18T12:39:39.704 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ecc0857e-75ba-11ef-bceb-c7b262605968.target.wants/ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mon.smithi078.service → /etc/systemd/system/ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@.service. 2024-09-18T12:39:40.187 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:40 smithi078 podman[27707]: 2024-09-18 12:39:40.1460532 +0000 UTC m=+0.313258796 container start 028378892b4e1546ec52ac523fec17cc3474b8004930f794ca45e46e21f8710e (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-18T12:39:40.232 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T12:39:40.232 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout disabled 2024-09-18T12:39:40.239 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T12:39:40.239 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-18T12:39:40.239 INFO:teuthology.orchestra.run.smithi078.stdout:firewalld.service is not enabled 2024-09-18T12:39:40.239 INFO:teuthology.orchestra.run.smithi078.stdout:Not possible to enable service . firewalld.service is not available 2024-09-18T12:39:40.240 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mon to start... 2024-09-18T12:39:40.240 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mon... 2024-09-18T12:39:40.464 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:40 smithi078 ceph-mon[27727]: mkfs ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:39:40.465 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:40 smithi078 ceph-mon[27727]: mon.smithi078 is new leader, mons smithi078 in quorum (ranks 0) 2024-09-18T12:39:40.465 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:40 smithi078 bash[27707]: 028378892b4e1546ec52ac523fec17cc3474b8004930f794ca45e46e21f8710e 2024-09-18T12:39:40.465 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:40 smithi078 systemd[1]: Started Ceph mon.smithi078 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:39:41.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:41 smithi078 ceph-mon[27727]: mon.smithi078 is new leader, mons smithi078 in quorum (ranks 0) 2024-09-18T12:39:41.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:41 smithi078 ceph-mon[27727]: monmap epoch 1 2024-09-18T12:39:41.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:41 smithi078 ceph-mon[27727]: fsid ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:39:41.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:41 smithi078 ceph-mon[27727]: last_changed 2024-09-18T12:39:37.203660+0000 2024-09-18T12:39:41.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:41 smithi078 ceph-mon[27727]: created 2024-09-18T12:39:37.203660+0000 2024-09-18T12:39:41.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:41 smithi078 ceph-mon[27727]: min_mon_release 19 (squid) 2024-09-18T12:39:41.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:41 smithi078 ceph-mon[27727]: election_strategy: 1 2024-09-18T12:39:41.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:41 smithi078 ceph-mon[27727]: 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.smithi078 2024-09-18T12:39:41.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:41 smithi078 ceph-mon[27727]: fsmap 2024-09-18T12:39:41.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:41 smithi078 ceph-mon[27727]: osdmap e1: 0 total, 0 up, 0 in 2024-09-18T12:39:41.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:41 smithi078 ceph-mon[27727]: mgrmap e1: no daemons active 2024-09-18T12:39:41.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:41 smithi078 ceph-mon[27727]: from='client.? 172.21.15.78:0/277063931' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-18T12:39:43.384 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout cluster: 2024-09-18T12:39:43.384 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout id: ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:39:43.384 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-18T12:39:43.384 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-18T12:39:43.385 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout services: 2024-09-18T12:39:43.385 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi078 (age 0.533837s) 2024-09-18T12:39:43.385 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-18T12:39:43.385 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-18T12:39:43.385 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-18T12:39:43.385 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout data: 2024-09-18T12:39:43.385 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-18T12:39:43.385 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-18T12:39:43.385 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-18T12:39:43.385 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout pgs: 2024-09-18T12:39:43.385 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-18T12:39:43.385 INFO:teuthology.orchestra.run.smithi078.stdout:mon is available 2024-09-18T12:39:43.385 INFO:teuthology.orchestra.run.smithi078.stdout:Assimilating anything we can from ceph.conf... 2024-09-18T12:39:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:46 smithi078 ceph-mon[27727]: from='client.? 172.21.15.78:0/782901681' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-18T12:39:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:46 smithi078 ceph-mon[27727]: from='client.? 172.21.15.78:0/782901681' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-18T12:39:52.968 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-18T12:39:52.970 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [global] 2024-09-18T12:39:52.970 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout fsid = ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:39:52.970 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.78:3300,v1:172.21.15.78:6789] 2024-09-18T12:39:52.970 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-18T12:39:52.970 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-18T12:39:52.970 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-18T12:39:52.970 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-18T12:39:52.970 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-18T12:39:52.971 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-18T12:39:52.971 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-18T12:39:52.971 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-18T12:39:52.971 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [osd] 2024-09-18T12:39:52.971 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-18T12:39:52.971 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-18T12:39:52.971 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-18T12:39:52.971 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-18T12:39:52.971 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-18T12:39:52.971 INFO:teuthology.orchestra.run.smithi078.stdout:Generating new minimal ceph.conf... 2024-09-18T12:39:53.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:53 smithi078 ceph-mon[27727]: from='client.? 172.21.15.78:0/1553089778' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:39:53.998 INFO:teuthology.orchestra.run.smithi078.stdout:Restarting the monitor... 2024-09-18T12:39:54.291 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:54 smithi078 systemd[1]: Stopping Ceph mon.smithi078 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:39:54.723 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:54 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[27723]: 2024-09-18T12:39:54.289+0000 7f6f20c4f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi078 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:39:54.723 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:54 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[27723]: 2024-09-18T12:39:54.289+0000 7f6f20c4f640 -1 mon.smithi078@0(leader) e1 *** Got Signal Terminated *** 2024-09-18T12:39:54.724 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:54 smithi078 podman[27968]: 2024-09-18 12:39:54.464087104 +0000 UTC m=+0.292248374 container died 028378892b4e1546ec52ac523fec17cc3474b8004930f794ca45e46e21f8710e (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=) 2024-09-18T12:39:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:54 smithi078 podman[27968]: 2024-09-18 12:39:54.822608377 +0000 UTC m=+0.650769643 container cleanup 028378892b4e1546ec52ac523fec17cc3474b8004930f794ca45e46e21f8710e (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-18T12:39:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:54 smithi078 bash[27968]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078 2024-09-18T12:39:55.456 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 podman[27980]: 2024-09-18 12:39:55.081917176 +0000 UTC m=+0.615263973 container remove 028378892b4e1546ec52ac523fec17cc3474b8004930f794ca45e46e21f8710e (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-18T12:39:55.456 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mon.smithi078.service: Deactivated successfully. 2024-09-18T12:39:55.456 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 systemd[1]: Stopped Ceph mon.smithi078 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:39:55.456 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 systemd[1]: Starting Ceph mon.smithi078 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:39:55.719 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 podman[28072]: 2024-09-18 12:39:55.358512479 +0000 UTC m=+0.016445385 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:squid 2024-09-18T12:39:55.719 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 podman[28072]: 2024-09-18 12:39:55.457632493 +0000 UTC m=+0.115565434 container create 1cb11a5bcd725f0f0767432d3bfc584b2d656bbe53fa4fb8ff901b4107d96839 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS) 2024-09-18T12:39:55.719 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 podman[28072]: 2024-09-18 12:39:55.659896296 +0000 UTC m=+0.317829193 container init 1cb11a5bcd725f0f0767432d3bfc584b2d656bbe53fa4fb8ff901b4107d96839 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:39:55.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 podman[28072]: 2024-09-18 12:39:55.662945715 +0000 UTC m=+0.320878620 container start 1cb11a5bcd725f0f0767432d3bfc584b2d656bbe53fa4fb8ff901b4107d96839 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-18T12:39:55.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: set uid:gid to 167:167 (ceph:ceph) 2024-09-18T12:39:55.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-18T12:39:55.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: pidfile_write: ignore empty --pid-file 2024-09-18T12:39:55.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: load: jerasure load: lrc 2024-09-18T12:39:55.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: RocksDB version: 7.9.2 2024-09-18T12:39:55.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Git sha 0 2024-09-18T12:39:55.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-18T12:39:55.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: DB SUMMARY 2024-09-18T12:39:55.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: DB Session ID: 0IB8YL1D1B9HGBF14OKV 2024-09-18T12:39:55.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: CURRENT file: CURRENT 2024-09-18T12:39:55.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: IDENTITY file: IDENTITY 2024-09-18T12:39:55.721 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-18T12:39:55.721 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi078/store.db dir, Total Num: 1, files: 000008.sst 2024-09-18T12:39:55.721 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi078/store.db: 000009.log size: 95825 ; 2024-09-18T12:39:55.721 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.error_if_exists: 0 2024-09-18T12:39:55.721 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.create_if_missing: 0 2024-09-18T12:39:55.721 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.paranoid_checks: 1 2024-09-18T12:39:55.722 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-18T12:39:55.722 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-18T12:39:55.723 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-18T12:39:55.723 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.env: 0x562a634ae940 2024-09-18T12:39:55.723 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.fs: PosixFileSystem 2024-09-18T12:39:55.723 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.info_log: 0x562a6556d8c0 2024-09-18T12:39:55.723 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_file_opening_threads: 16 2024-09-18T12:39:55.723 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.statistics: (nil) 2024-09-18T12:39:55.723 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.use_fsync: 0 2024-09-18T12:39:55.723 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_log_file_size: 0 2024-09-18T12:39:55.723 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-18T12:39:55.723 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-18T12:39:55.723 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.keep_log_file_num: 1000 2024-09-18T12:39:55.723 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.recycle_log_file_num: 0 2024-09-18T12:39:55.724 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.allow_fallocate: 1 2024-09-18T12:39:55.724 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.allow_mmap_reads: 0 2024-09-18T12:39:55.724 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.allow_mmap_writes: 0 2024-09-18T12:39:55.724 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.use_direct_reads: 0 2024-09-18T12:39:55.724 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-18T12:39:55.724 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.create_missing_column_families: 0 2024-09-18T12:39:55.724 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.db_log_dir: 2024-09-18T12:39:55.724 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.wal_dir: 2024-09-18T12:39:55.724 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-18T12:39:55.724 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-18T12:39:55.724 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-18T12:39:55.725 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-18T12:39:55.725 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-18T12:39:55.725 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-18T12:39:55.725 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.advise_random_on_open: 1 2024-09-18T12:39:55.725 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.db_write_buffer_size: 0 2024-09-18T12:39:55.725 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.write_buffer_manager: 0x562a6557cdc0 2024-09-18T12:39:55.725 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-18T12:39:55.725 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-18T12:39:55.725 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-18T12:39:55.725 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.rate_limiter: (nil) 2024-09-18T12:39:55.725 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-18T12:39:55.725 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.wal_recovery_mode: 2 2024-09-18T12:39:55.725 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.enable_thread_tracking: 0 2024-09-18T12:39:55.725 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.enable_pipelined_write: 0 2024-09-18T12:39:55.726 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.unordered_write: 0 2024-09-18T12:39:55.726 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-18T12:39:55.726 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-18T12:39:55.726 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-18T12:39:55.726 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-18T12:39:55.726 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.row_cache: None 2024-09-18T12:39:55.726 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.wal_filter: None 2024-09-18T12:39:55.726 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-18T12:39:55.726 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.allow_ingest_behind: 0 2024-09-18T12:39:55.726 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.two_write_queues: 0 2024-09-18T12:39:55.726 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.manual_wal_flush: 0 2024-09-18T12:39:55.726 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.wal_compression: 0 2024-09-18T12:39:55.727 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.atomic_flush: 0 2024-09-18T12:39:55.727 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-18T12:39:55.727 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-18T12:39:55.727 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-18T12:39:55.727 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.log_readahead_size: 0 2024-09-18T12:39:55.727 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-18T12:39:55.727 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.best_efforts_recovery: 0 2024-09-18T12:39:55.727 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-18T12:39:55.727 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-18T12:39:55.727 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.allow_data_in_errors: 0 2024-09-18T12:39:55.727 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.db_host_id: __hostname__ 2024-09-18T12:39:55.727 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-18T12:39:55.728 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_background_jobs: 2 2024-09-18T12:39:55.728 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_background_compactions: -1 2024-09-18T12:39:55.728 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_subcompactions: 1 2024-09-18T12:39:55.728 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-18T12:39:55.728 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-18T12:39:55.728 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-18T12:39:55.728 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_total_wal_size: 0 2024-09-18T12:39:55.728 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-18T12:39:55.728 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-18T12:39:55.728 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-18T12:39:55.728 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-18T12:39:55.728 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_open_files: -1 2024-09-18T12:39:55.729 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.bytes_per_sync: 0 2024-09-18T12:39:55.729 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-18T12:39:55.729 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-18T12:39:55.729 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compaction_readahead_size: 0 2024-09-18T12:39:55.729 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_background_flushes: -1 2024-09-18T12:39:55.729 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Compression algorithms supported: 2024-09-18T12:39:55.729 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: kZSTD supported: 0 2024-09-18T12:39:55.729 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: kXpressCompression supported: 0 2024-09-18T12:39:55.729 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: kBZip2Compression supported: 0 2024-09-18T12:39:55.729 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-18T12:39:55.729 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: kLZ4Compression supported: 1 2024-09-18T12:39:55.729 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: kZlibCompression supported: 1 2024-09-18T12:39:55.730 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: kLZ4HCCompression supported: 1 2024-09-18T12:39:55.730 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: kSnappyCompression supported: 1 2024-09-18T12:39:55.730 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-18T12:39:55.730 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-18T12:39:55.730 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi078/store.db/MANIFEST-000010 2024-09-18T12:39:55.730 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-18T12:39:55.730 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-18T12:39:55.730 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.merge_operator: 2024-09-18T12:39:55.730 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compaction_filter: None 2024-09-18T12:39:55.730 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compaction_filter_factory: None 2024-09-18T12:39:55.730 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.sst_partitioner_factory: None 2024-09-18T12:39:55.730 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-18T12:39:55.730 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-18T12:39:55.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562a6556d520) 2024-09-18T12:39:55.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: cache_index_and_filter_blocks: 1 2024-09-18T12:39:55.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-18T12:39:55.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-18T12:39:55.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: pin_top_level_index_and_filter: 1 2024-09-18T12:39:55.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: index_type: 0 2024-09-18T12:39:55.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: data_block_index_type: 0 2024-09-18T12:39:55.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: index_shortening: 1 2024-09-18T12:39:55.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-18T12:39:55.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: checksum: 4 2024-09-18T12:39:55.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: no_block_cache: 0 2024-09-18T12:39:55.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_cache: 0x562a655611f0 2024-09-18T12:39:55.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_cache_name: BinnedLRUCache 2024-09-18T12:39:55.732 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_cache_options: 2024-09-18T12:39:55.732 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: capacity : 536870912 2024-09-18T12:39:55.732 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: num_shard_bits : 4 2024-09-18T12:39:55.732 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: strict_capacity_limit : 0 2024-09-18T12:39:55.732 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: high_pri_pool_ratio: 0.000 2024-09-18T12:39:55.732 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_cache_compressed: (nil) 2024-09-18T12:39:55.732 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: persistent_cache: (nil) 2024-09-18T12:39:55.732 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_size: 4096 2024-09-18T12:39:55.732 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_size_deviation: 10 2024-09-18T12:39:55.732 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_restart_interval: 16 2024-09-18T12:39:55.732 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: index_block_restart_interval: 1 2024-09-18T12:39:55.732 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: metadata_block_size: 4096 2024-09-18T12:39:55.732 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: partition_filters: 0 2024-09-18T12:39:55.733 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: use_delta_encoding: 1 2024-09-18T12:39:55.733 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: filter_policy: bloomfilter 2024-09-18T12:39:55.733 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: whole_key_filtering: 1 2024-09-18T12:39:55.733 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: verify_compression: 0 2024-09-18T12:39:55.733 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: read_amp_bytes_per_bit: 0 2024-09-18T12:39:55.733 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: format_version: 5 2024-09-18T12:39:55.733 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: enable_index_compression: 1 2024-09-18T12:39:55.733 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_align: 0 2024-09-18T12:39:55.733 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: max_auto_readahead_size: 262144 2024-09-18T12:39:55.733 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: prepopulate_block_cache: 0 2024-09-18T12:39:55.733 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: initial_auto_readahead_size: 8192 2024-09-18T12:39:55.734 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: num_file_reads_for_auto_readahead: 2 2024-09-18T12:39:55.734 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.write_buffer_size: 33554432 2024-09-18T12:39:55.734 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_write_buffer_number: 2 2024-09-18T12:39:55.734 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compression: NoCompression 2024-09-18T12:39:55.734 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.bottommost_compression: Disabled 2024-09-18T12:39:55.734 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.prefix_extractor: nullptr 2024-09-18T12:39:55.734 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-18T12:39:55.734 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.num_levels: 7 2024-09-18T12:39:55.734 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-18T12:39:55.734 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-18T12:39:55.734 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-18T12:39:55.734 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-18T12:39:55.735 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-18T12:39:55.735 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-18T12:39:55.735 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-18T12:39:55.735 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:39:55.735 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-18T12:39:55.735 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-18T12:39:55.735 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:39:55.735 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:39:55.735 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-18T12:39:55.735 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compression_opts.level: 32767 2024-09-18T12:39:55.735 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compression_opts.strategy: 0 2024-09-18T12:39:55.735 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-18T12:39:55.735 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:39:55.736 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:39:55.736 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-18T12:39:55.736 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compression_opts.enabled: false 2024-09-18T12:39:55.736 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:39:55.736 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-18T12:39:55.736 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-18T12:39:55.736 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-18T12:39:55.736 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.target_file_size_base: 67108864 2024-09-18T12:39:55.736 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-18T12:39:55.736 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-18T12:39:55.736 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-18T12:39:55.736 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-18T12:39:55.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-18T12:39:55.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-18T12:39:55.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-18T12:39:55.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-18T12:39:55.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-18T12:39:55.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-18T12:39:55.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-18T12:39:55.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-18T12:39:55.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-18T12:39:55.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-18T12:39:55.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.arena_block_size: 1048576 2024-09-18T12:39:55.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-18T12:39:55.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-18T12:39:55.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.disable_auto_compactions: 0 2024-09-18T12:39:55.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-18T12:39:55.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-18T12:39:55.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-18T12:39:55.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-18T12:39:55.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-18T12:39:55.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-18T12:39:55.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-18T12:39:55.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-18T12:39:55.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-18T12:39:55.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-18T12:39:55.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-18T12:39:55.739 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.inplace_update_support: 0 2024-09-18T12:39:55.739 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-18T12:39:55.739 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-18T12:39:55.739 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-18T12:39:55.739 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-18T12:39:55.739 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.bloom_locality: 0 2024-09-18T12:39:55.739 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.max_successive_merges: 0 2024-09-18T12:39:55.739 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-18T12:39:55.739 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.paranoid_file_checks: 0 2024-09-18T12:39:55.739 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.force_consistency_checks: 1 2024-09-18T12:39:55.739 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.report_bg_io_stats: 0 2024-09-18T12:39:55.739 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.ttl: 2592000 2024-09-18T12:39:55.740 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-18T12:39:55.740 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-18T12:39:55.740 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-18T12:39:55.740 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.enable_blob_files: false 2024-09-18T12:39:55.740 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.min_blob_size: 0 2024-09-18T12:39:55.740 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.blob_file_size: 268435456 2024-09-18T12:39:55.740 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-18T12:39:55.740 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-18T12:39:55.740 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-18T12:39:55.740 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-18T12:39:55.740 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-18T12:39:55.740 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.blob_file_starting_level: 0 2024-09-18T12:39:55.740 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-18T12:39:55.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi078/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-18T12:39:55.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-18T12:39:55.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b8a53094-9598-4ef2-9e01-70291381e1d7 2024-09-18T12:39:55.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726663195690448, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-18T12:39:55.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-18T12:39:55.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726663195691401, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91826, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 288, "table_properties": {"data_size": 89867, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11912, "raw_average_key_size": 48, "raw_value_size": 83235, "raw_average_value_size": 336, "num_data_blocks": 12, "num_entries": 247, "num_filter_entries": 247, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726663195, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b8a53094-9598-4ef2-9e01-70291381e1d7", "db_session_id": "0IB8YL1D1B9HGBF14OKV", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-18T12:39:55.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726663195691493, "job": 1, "event": "recovery_finished"} 2024-09-18T12:39:55.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-18T12:39:55.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi078/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-18T12:39:55.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562a6558ee00 2024-09-18T12:39:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: DB pointer 0x562a6568a000 2024-09-18T12:39:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-18T12:39:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-18T12:39:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: ** DB Stats ** 2024-09-18T12:39:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:39:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-18T12:39:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:39:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:39:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-18T12:39:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:39:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:39:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: 2024-09-18T12:39:55.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: ** Compaction Stats [default] ** 2024-09-18T12:39:55.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:39:55.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-18T12:39:55.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: L0 2/0 91.57 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-18T12:39:55.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Sum 2/0 91.57 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-18T12:39:55.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-18T12:39:55.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: 2024-09-18T12:39:55.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: ** Compaction Stats [default] ** 2024-09-18T12:39:55.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:39:55.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T12:39:55.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 136.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-18T12:39:55.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: 2024-09-18T12:39:55.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-18T12:39:55.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: 2024-09-18T12:39:55.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:39:55.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-18T12:39:55.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-18T12:39:55.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-18T12:39:55.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-18T12:39:55.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-18T12:39:55.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Cumulative compaction: 0.00 GB write, 28.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:39:55.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Interval compaction: 0.00 GB write, 28.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:39:55.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-18T12:39:55.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Block cache BinnedLRUCache@0x562a655611f0#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-18T12:39:55.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-18T12:39:55.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: 2024-09-18T12:39:55.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-18T12:39:55.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: starting mon.smithi078 rank 0 at public addrs [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] at bind addrs [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi078 fsid ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:39:55.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: mon.smithi078@-1(???) e1 preinit fsid ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:39:55.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: mon.smithi078@-1(???).mds e1 new map 2024-09-18T12:39:55.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: mon.smithi078@-1(???).mds e1 print_map 2024-09-18T12:39:55.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: e1 2024-09-18T12:39:55.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: btime 2024-09-18T12:39:40:184320+0000 2024-09-18T12:39:55.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:39:55.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:39:55.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: legacy client fscid: -1 2024-09-18T12:39:55.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: 2024-09-18T12:39:55.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: No filesystems configured 2024-09-18T12:39:55.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: mon.smithi078@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-18T12:39:55.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: mon.smithi078@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T12:39:55.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: mon.smithi078@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T12:39:55.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: mon.smithi078@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T12:39:55.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: mon.smithi078@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-18T12:39:55.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 bash[28072]: 1cb11a5bcd725f0f0767432d3bfc584b2d656bbe53fa4fb8ff901b4107d96839 2024-09-18T12:39:55.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 systemd[1]: Started Ceph mon.smithi078 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:39:55.746 INFO:teuthology.orchestra.run.smithi078.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-18T12:39:55.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: mon.smithi078 is new leader, mons smithi078 in quorum (ranks 0) 2024-09-18T12:39:55.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: monmap epoch 1 2024-09-18T12:39:55.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: fsid ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:39:55.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: last_changed 2024-09-18T12:39:37.203660+0000 2024-09-18T12:39:55.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: created 2024-09-18T12:39:37.203660+0000 2024-09-18T12:39:55.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: min_mon_release 19 (squid) 2024-09-18T12:39:55.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: election_strategy: 1 2024-09-18T12:39:55.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.smithi078 2024-09-18T12:39:55.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: fsmap 2024-09-18T12:39:55.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: osdmap e1: 0 total, 0 up, 0 in 2024-09-18T12:39:55.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:55 smithi078 ceph-mon[28091]: mgrmap e1: no daemons active 2024-09-18T12:39:56.802 INFO:teuthology.orchestra.run.smithi078.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-18T12:39:56.825 INFO:teuthology.orchestra.run.smithi078.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-18T12:39:56.825 INFO:teuthology.orchestra.run.smithi078.stdout:Creating mgr... 2024-09-18T12:39:56.825 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-18T12:39:56.826 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-18T12:39:56.826 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-18T12:39:57.069 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mgr.smithi078.ohifux 2024-09-18T12:39:57.069 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mgr.smithi078.ohifux.service: Unit ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mgr.smithi078.ohifux.service not loaded. 2024-09-18T12:39:57.213 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ecc0857e-75ba-11ef-bceb-c7b262605968.target.wants/ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mgr.smithi078.ohifux.service → /etc/systemd/system/ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@.service. 2024-09-18T12:39:57.442 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:57 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/973835855' entity='client.admin' 2024-09-18T12:39:57.752 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T12:39:57.752 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout disabled 2024-09-18T12:39:57.759 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T12:39:57.759 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-18T12:39:57.759 INFO:teuthology.orchestra.run.smithi078.stdout:firewalld.service is not enabled 2024-09-18T12:39:57.759 INFO:teuthology.orchestra.run.smithi078.stdout:Not possible to enable service . firewalld.service is not available 2024-09-18T12:39:57.768 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T12:39:57.768 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout disabled 2024-09-18T12:39:57.776 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T12:39:57.776 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-18T12:39:57.776 INFO:teuthology.orchestra.run.smithi078.stdout:firewalld.service is not enabled 2024-09-18T12:39:57.776 INFO:teuthology.orchestra.run.smithi078.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-18T12:39:57.776 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mgr to start... 2024-09-18T12:39:57.776 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mgr... 2024-09-18T12:39:58.908 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:39:58 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/900440283' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-18T12:39:59.172 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-18T12:39:59.177 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:39:59.177 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsid": "ecc0857e-75ba-11ef-bceb-c7b262605968", 2024-09-18T12:39:59.177 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "health": { 2024-09-18T12:39:59.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-18T12:39:59.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-18T12:39:59.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-18T12:39:59.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:39:59.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-18T12:39:59.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-18T12:39:59.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 0 2024-09-18T12:39:59.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:39:59.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-18T12:39:59.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "smithi078" 2024-09-18T12:39:59.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:39:59.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-18T12:39:59.178 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-18T12:39:59.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:39:59.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-18T12:39:59.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-18T12:39:59.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:39:59.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-18T12:39:59.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:39:59.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-18T12:39:59.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-18T12:39:59.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-18T12:39:59.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-18T12:39:59.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-18T12:39:59.179 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-18T12:39:59.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:39:59.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-18T12:39:59.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-18T12:39:59.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-18T12:39:59.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-18T12:39:59.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-18T12:39:59.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-18T12:39:59.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-18T12:39:59.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-18T12:39:59.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-18T12:39:59.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:39:59.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-18T12:39:59.180 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:39:59.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "btime": "2024-09-18T12:39:40:184320+0000", 2024-09-18T12:39:59.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-18T12:39:59.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-18T12:39:59.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:39:59.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-18T12:39:59.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-18T12:39:59.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-18T12:39:59.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-18T12:39:59.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-18T12:39:59.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-18T12:39:59.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "restful" 2024-09-18T12:39:59.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:39:59.181 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:39:59.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:39:59.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-18T12:39:59.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:39:59.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modified": "2024-09-18T12:39:40.184968+0000", 2024-09-18T12:39:59.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:39:59.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:39:59.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-18T12:39:59.182 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:39:59.182 INFO:teuthology.orchestra.run.smithi078.stdout:mgr not available, waiting (1/15)... 2024-09-18T12:40:01.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:01 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3208789990' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-18T12:40:02.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-18T12:40:02.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:40:02.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsid": "ecc0857e-75ba-11ef-bceb-c7b262605968", 2024-09-18T12:40:02.332 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "health": { 2024-09-18T12:40:02.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-18T12:40:02.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-18T12:40:02.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-18T12:40:02.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:40:02.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-18T12:40:02.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-18T12:40:02.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 0 2024-09-18T12:40:02.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:40:02.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-18T12:40:02.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "smithi078" 2024-09-18T12:40:02.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:40:02.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-18T12:40:02.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-18T12:40:02.333 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:40:02.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-18T12:40:02.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-18T12:40:02.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:40:02.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-18T12:40:02.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:40:02.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-18T12:40:02.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-18T12:40:02.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-18T12:40:02.334 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-18T12:40:02.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-18T12:40:02.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-18T12:40:02.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:40:02.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-18T12:40:02.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-18T12:40:02.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-18T12:40:02.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-18T12:40:02.341 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-18T12:40:02.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-18T12:40:02.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-18T12:40:02.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-18T12:40:02.342 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-18T12:40:02.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:40:02.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-18T12:40:02.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:40:02.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "btime": "2024-09-18T12:39:40:184320+0000", 2024-09-18T12:40:02.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-18T12:40:02.343 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-18T12:40:02.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:40:02.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-18T12:40:02.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-18T12:40:02.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-18T12:40:02.344 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-18T12:40:02.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-18T12:40:02.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-18T12:40:02.346 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "restful" 2024-09-18T12:40:02.347 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:40:02.347 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:40:02.347 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:40:02.347 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-18T12:40:02.347 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:40:02.347 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modified": "2024-09-18T12:39:40.184968+0000", 2024-09-18T12:40:02.347 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:40:02.347 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:40:02.347 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-18T12:40:02.347 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:40:02.347 INFO:teuthology.orchestra.run.smithi078.stdout:mgr not available, waiting (2/15)... 2024-09-18T12:40:03.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:02 smithi078 ceph-mon[28091]: Activating manager daemon smithi078.ohifux 2024-09-18T12:40:03.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:02 smithi078 ceph-mon[28091]: mgrmap e2: smithi078.ohifux(active, starting, since 0.00297776s) 2024-09-18T12:40:03.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:02 smithi078 ceph-mon[28091]: from='mgr.14100 172.21.15.78:0/3961549109' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:40:03.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:02 smithi078 ceph-mon[28091]: from='mgr.14100 172.21.15.78:0/3961549109' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:40:03.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:02 smithi078 ceph-mon[28091]: from='mgr.14100 172.21.15.78:0/3961549109' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:40:03.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:02 smithi078 ceph-mon[28091]: from='mgr.14100 172.21.15.78:0/3961549109' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:40:03.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:02 smithi078 ceph-mon[28091]: from='mgr.14100 172.21.15.78:0/3961549109' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr metadata", "who": "smithi078.ohifux", "id": "smithi078.ohifux"}]: dispatch 2024-09-18T12:40:03.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:02 smithi078 ceph-mon[28091]: Manager daemon smithi078.ohifux is now available 2024-09-18T12:40:03.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:02 smithi078 ceph-mon[28091]: from='mgr.14100 172.21.15.78:0/3961549109' entity='mgr.smithi078.ohifux' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi078.ohifux/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:40:03.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:02 smithi078 ceph-mon[28091]: from='mgr.14100 172.21.15.78:0/3961549109' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:03.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:02 smithi078 ceph-mon[28091]: from='mgr.14100 172.21.15.78:0/3961549109' entity='mgr.smithi078.ohifux' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi078.ohifux/trash_purge_schedule"}]: dispatch 2024-09-18T12:40:03.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:02 smithi078 ceph-mon[28091]: from='mgr.14100 172.21.15.78:0/3961549109' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:03.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:02 smithi078 ceph-mon[28091]: from='mgr.14100 172.21.15.78:0/3961549109' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:04.712 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:04 smithi078 ceph-mon[28091]: mgrmap e3: smithi078.ohifux(active, since 1.00739s) 2024-09-18T12:40:05.512 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-18T12:40:05.512 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:40:05.512 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsid": "ecc0857e-75ba-11ef-bceb-c7b262605968", 2024-09-18T12:40:05.512 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "health": { 2024-09-18T12:40:05.512 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-18T12:40:05.513 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-18T12:40:05.513 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-18T12:40:05.513 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:40:05.513 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-18T12:40:05.513 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-18T12:40:05.513 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 0 2024-09-18T12:40:05.513 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:40:05.513 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-18T12:40:05.513 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "smithi078" 2024-09-18T12:40:05.513 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:40:05.513 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-18T12:40:05.514 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-18T12:40:05.514 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:40:05.514 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-18T12:40:05.514 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-18T12:40:05.514 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:40:05.514 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-18T12:40:05.514 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:40:05.514 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-18T12:40:05.514 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-18T12:40:05.514 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-18T12:40:05.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-18T12:40:05.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-18T12:40:05.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-18T12:40:05.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:40:05.520 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-18T12:40:05.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-18T12:40:05.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-18T12:40:05.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-18T12:40:05.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-18T12:40:05.521 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-18T12:40:05.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-18T12:40:05.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-18T12:40:05.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-18T12:40:05.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:40:05.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-18T12:40:05.522 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:40:05.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "btime": "2024-09-18T12:39:40:184320+0000", 2024-09-18T12:40:05.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-18T12:40:05.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-18T12:40:05.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:40:05.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-18T12:40:05.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-18T12:40:05.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-18T12:40:05.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-18T12:40:05.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-18T12:40:05.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-18T12:40:05.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "restful" 2024-09-18T12:40:05.523 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:40:05.524 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:40:05.524 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:40:05.524 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-18T12:40:05.524 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:40:05.524 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modified": "2024-09-18T12:39:40.184968+0000", 2024-09-18T12:40:05.524 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:40:05.524 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:40:05.524 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-18T12:40:05.524 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:40:05.524 INFO:teuthology.orchestra.run.smithi078.stdout:mgr is available 2024-09-18T12:40:05.733 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:05 smithi078 ceph-mon[28091]: mgrmap e4: smithi078.ohifux(active, since 2s) 2024-09-18T12:40:05.733 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:05 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/872700114' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-18T12:40:06.676 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-18T12:40:06.677 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [global] 2024-09-18T12:40:06.677 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout fsid = ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:40:06.677 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.78:3300,v1:172.21.15.78:6789] 2024-09-18T12:40:06.677 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-18T12:40:06.677 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-18T12:40:06.677 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-18T12:40:06.677 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-18T12:40:06.677 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-18T12:40:06.677 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-18T12:40:06.677 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-18T12:40:06.677 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-18T12:40:06.677 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [osd] 2024-09-18T12:40:06.677 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-18T12:40:06.678 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-18T12:40:06.678 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-18T12:40:06.678 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-18T12:40:06.678 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-18T12:40:06.678 INFO:teuthology.orchestra.run.smithi078.stdout:Enabling cephadm module... 2024-09-18T12:40:06.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:06 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2703576616' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-18T12:40:07.818 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:07 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2759698532' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-18T12:40:08.699 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:08 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2759698532' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-18T12:40:08.699 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:08 smithi078 ceph-mon[28091]: mgrmap e5: smithi078.ohifux(active, since 5s) 2024-09-18T12:40:09.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:40:09.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-18T12:40:09.286 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-18T12:40:09.287 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "active_name": "smithi078.ohifux", 2024-09-18T12:40:09.287 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-18T12:40:09.287 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:40:09.287 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for the mgr to restart... 2024-09-18T12:40:09.287 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mgr epoch 5... 2024-09-18T12:40:09.603 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:09 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/580054735' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-18T12:40:12.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: Active manager daemon smithi078.ohifux restarted 2024-09-18T12:40:12.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: Activating manager daemon smithi078.ohifux 2024-09-18T12:40:12.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: osdmap e2: 0 total, 0 up, 0 in 2024-09-18T12:40:12.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: mgrmap e6: smithi078.ohifux(active, starting, since 0.00340958s) 2024-09-18T12:40:12.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:40:12.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr metadata", "who": "smithi078.ohifux", "id": "smithi078.ohifux"}]: dispatch 2024-09-18T12:40:12.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:40:12.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:40:12.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:40:12.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: Manager daemon smithi078.ohifux is now available 2024-09-18T12:40:12.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:12.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:12.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:40:12.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:40:12.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi078.ohifux/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:40:12.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:12 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi078.ohifux/trash_purge_schedule"}]: dispatch 2024-09-18T12:40:13.677 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:13 smithi078 ceph-mon[28091]: Found migration_current of "None". Setting to last migration. 2024-09-18T12:40:13.677 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:13 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:13.677 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:13 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:13.678 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:13 smithi078 ceph-mon[28091]: mgrmap e7: smithi078.ohifux(active, since 1.00572s) 2024-09-18T12:40:13.959 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:40:13.959 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-18T12:40:13.959 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-18T12:40:13.960 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:40:13.960 INFO:teuthology.orchestra.run.smithi078.stdout:mgr epoch 5 is available 2024-09-18T12:40:13.960 INFO:teuthology.orchestra.run.smithi078.stdout:Setting orchestrator backend to cephadm... 2024-09-18T12:40:14.554 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:14 smithi078 ceph-mon[28091]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-18T12:40:14.554 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:14 smithi078 ceph-mon[28091]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-18T12:40:15.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:15 smithi078 ceph-mon[28091]: mgrmap e8: smithi078.ohifux(active, since 2s) 2024-09-18T12:40:15.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:15 smithi078 ceph-mon[28091]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:15.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:15 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:15.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:15 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:40:15.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:15 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:40:16.412 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:16 smithi078 ceph-mon[28091]: [18/Sep/2024:12:40:14] ENGINE Bus STARTING 2024-09-18T12:40:16.412 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:16 smithi078 ceph-mon[28091]: [18/Sep/2024:12:40:14] ENGINE Serving on http://172.21.15.78:8765 2024-09-18T12:40:16.412 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:16 smithi078 ceph-mon[28091]: [18/Sep/2024:12:40:14] ENGINE Serving on https://172.21.15.78:7150 2024-09-18T12:40:16.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:16 smithi078 ceph-mon[28091]: [18/Sep/2024:12:40:14] ENGINE Bus STARTED 2024-09-18T12:40:16.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:16 smithi078 ceph-mon[28091]: [18/Sep/2024:12:40:14] ENGINE Error in HTTPServer.serve 2024-09-18T12:40:16.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Traceback (most recent call last): 2024-09-18T12:40:16.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:40:16.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:40:16.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:40:16.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self._run(expiration_interval) 2024-09-18T12:40:16.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:40:16.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:40:16.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:40:16.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:40:16.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:40:16.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: s = self.context.wrap_socket( 2024-09-18T12:40:16.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:40:16.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: return self.sslsocket_class._create( 2024-09-18T12:40:16.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:40:16.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self.do_handshake() 2024-09-18T12:40:16.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:40:16.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self._sslobj.do_handshake() 2024-09-18T12:40:16.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:40:16.415 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-18T12:40:16.415 INFO:teuthology.orchestra.run.smithi078.stdout:Generating ssh key... 2024-09-18T12:40:17.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:17 smithi078 ceph-mon[28091]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:17.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:17 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:17.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:17 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:18.569 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:18 smithi078 ceph-mon[28091]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:18.569 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:18 smithi078 ceph-mon[28091]: Generating ssh key... 2024-09-18T12:40:18.811 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD17S6cIjmlPaZEst5FwsajdJypFu7VWzeyvw2sSg2N6l450KRYjfU7bMtkqbXm4ZHha5S6R1+uSS/K45sqjF2MP33JQM8Pj4JZC6733MfEWG3W+yIVZMpbOdYcKFKQ5YAUgmYq4SpGXxt9kgq4W7Qe0XFmqU4ccIzpSv1UBCzX/NqOPcwlt42LWGsgd2xTjJH2V+fkOf4yAtRWjNlSdTefWOf0ugjlHg07cZFvAXWGHYClK00GkgsNTG6Ev7SSEMPz/C/pvW6wd7qFigW/0aWerxFltassuO/QKTcgUohDYQTAKY/NvlW0vqV49mioaeyG4sLrV040uBIxnWSO+1+h3fdhq5Gm2hk4t5z0FTXcfb/aLZ1Lw+HeE8ZihdnaiuP64lTezOaHT5Fl3pR4oE1+dhZgzMoLjVoBhmw08CqB+D5vjfzmEtd8MYnpsYYYaO0YUEZLuBI65s6sGtAZI7iugHa9RMy5GZ2lxCjVi3Gf7CorQ8umoj4/UEev7z+iRgc= ceph-ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:40:18.812 INFO:teuthology.orchestra.run.smithi078.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-18T12:40:18.812 INFO:teuthology.orchestra.run.smithi078.stdout:Adding key to root@localhost authorized_keys... 2024-09-18T12:40:18.821 INFO:teuthology.orchestra.run.smithi078.stdout:Adding host smithi078... 2024-09-18T12:40:19.483 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:19 smithi078 ceph-mon[28091]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:20.395 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:20 smithi078 ceph-mon[28091]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi078", "addr": "172.21.15.78", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:21.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:21 smithi078 ceph-mon[28091]: Deploying cephadm binary to smithi078 2024-09-18T12:40:23.086 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Added host 'smithi078' with addr '172.21.15.78' 2024-09-18T12:40:23.086 INFO:teuthology.orchestra.run.smithi078.stdout:Deploying mon service with default placement... 2024-09-18T12:40:23.774 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:23 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:23.774 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:23 smithi078 ceph-mon[28091]: Added host smithi078 2024-09-18T12:40:23.774 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:23 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:40:24.320 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-18T12:40:24.321 INFO:teuthology.orchestra.run.smithi078.stdout:Deploying mgr service with default placement... 2024-09-18T12:40:24.969 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:24 smithi078 ceph-mon[28091]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:24.969 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:24 smithi078 ceph-mon[28091]: Saving service mon spec with placement count:5 2024-09-18T12:40:24.969 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:24 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:26.089 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:25 smithi078 ceph-mon[28091]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:26.089 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:25 smithi078 ceph-mon[28091]: Saving service mgr spec with placement count:2 2024-09-18T12:40:26.089 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:25 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:26.384 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-18T12:40:26.384 INFO:teuthology.orchestra.run.smithi078.stdout:Deploying crash service with default placement... 2024-09-18T12:40:27.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:26 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:27.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:26 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:28.119 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-18T12:40:28.119 INFO:teuthology.orchestra.run.smithi078.stdout:Deploying ceph-exporter service with default placement... 2024-09-18T12:40:28.148 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:28 smithi078 ceph-mon[28091]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:28.148 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:28 smithi078 ceph-mon[28091]: Saving service crash spec with placement * 2024-09-18T12:40:28.148 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:28 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:28.148 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:28 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:29.367 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-18T12:40:29.368 INFO:teuthology.orchestra.run.smithi078.stdout:Deploying prometheus service with default placement... 2024-09-18T12:40:29.693 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:29 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:29.693 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:29 smithi078 ceph-mon[28091]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:29.693 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:29 smithi078 ceph-mon[28091]: Saving service ceph-exporter spec with placement * 2024-09-18T12:40:29.693 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:29 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:30.526 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-18T12:40:30.526 INFO:teuthology.orchestra.run.smithi078.stdout:Deploying grafana service with default placement... 2024-09-18T12:40:31.211 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:30 smithi078 ceph-mon[28091]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:31.211 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:30 smithi078 ceph-mon[28091]: Saving service prometheus spec with placement count:1 2024-09-18T12:40:31.212 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:30 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:32.413 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-18T12:40:32.413 INFO:teuthology.orchestra.run.smithi078.stdout:Deploying node-exporter service with default placement... 2024-09-18T12:40:32.931 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:32 smithi078 ceph-mon[28091]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:32.931 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:32 smithi078 ceph-mon[28091]: Saving service grafana spec with placement count:1 2024-09-18T12:40:32.931 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:32 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:32.932 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:32 smithi078 ceph-mon[28091]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:40:33.644 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-18T12:40:33.644 INFO:teuthology.orchestra.run.smithi078.stdout:Deploying alertmanager service with default placement... 2024-09-18T12:40:34.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:34 smithi078 ceph-mon[28091]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:34.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:34 smithi078 ceph-mon[28091]: Saving service node-exporter spec with placement * 2024-09-18T12:40:34.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:34 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:34.850 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-18T12:40:35.412 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:35 smithi078 ceph-mon[28091]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:35.412 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:35 smithi078 ceph-mon[28091]: Saving service alertmanager spec with placement count:1 2024-09-18T12:40:35.412 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:35 smithi078 ceph-mon[28091]: from='mgr.14118 172.21.15.78:0/2373525165' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:35.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:35 smithi078 ceph-mon[28091]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:40:36.546 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:36 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/182302412' entity='client.admin' 2024-09-18T12:40:37.070 INFO:teuthology.orchestra.run.smithi078.stdout:Enabling the dashboard module... 2024-09-18T12:40:37.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:37 smithi078 ceph-mon[28091]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:40:37.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:37 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/529380565' entity='client.admin' 2024-09-18T12:40:38.895 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:38 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3788331742' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-18T12:40:39.835 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:39 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3788331742' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-18T12:40:39.835 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:39 smithi078 ceph-mon[28091]: mgrmap e9: smithi078.ohifux(active, since 26s) 2024-09-18T12:40:40.427 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:40:40.427 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-18T12:40:40.427 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-18T12:40:40.427 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "active_name": "smithi078.ohifux", 2024-09-18T12:40:40.427 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-18T12:40:40.428 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:40:40.428 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for the mgr to restart... 2024-09-18T12:40:40.428 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mgr epoch 9... 2024-09-18T12:40:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:40 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/381882756' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-18T12:40:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:43 smithi078 ceph-mon[28091]: Active manager daemon smithi078.ohifux restarted 2024-09-18T12:40:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:43 smithi078 ceph-mon[28091]: Activating manager daemon smithi078.ohifux 2024-09-18T12:40:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:43 smithi078 ceph-mon[28091]: osdmap e3: 0 total, 0 up, 0 in 2024-09-18T12:40:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:43 smithi078 ceph-mon[28091]: mgrmap e10: smithi078.ohifux(active, starting, since 0.00338126s) 2024-09-18T12:40:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:43 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:40:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:43 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr metadata", "who": "smithi078.ohifux", "id": "smithi078.ohifux"}]: dispatch 2024-09-18T12:40:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:43 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:40:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:43 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:40:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:43 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:40:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:43 smithi078 ceph-mon[28091]: Manager daemon smithi078.ohifux is now available 2024-09-18T12:40:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:43 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:40:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:43 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi078.ohifux/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:40:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:43 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi078.ohifux/trash_purge_schedule"}]: dispatch 2024-09-18T12:40:45.203 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:40:45.204 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-18T12:40:45.204 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-18T12:40:45.204 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:40:45.204 INFO:teuthology.orchestra.run.smithi078.stdout:mgr epoch 9 is available 2024-09-18T12:40:45.204 INFO:teuthology.orchestra.run.smithi078.stdout:Generating a dashboard self-signed certificate... 2024-09-18T12:40:45.458 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:45 smithi078 ceph-mon[28091]: mgrmap e11: smithi078.ohifux(active, since 1.00606s) 2024-09-18T12:40:45.458 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:45 smithi078 ceph-mon[28091]: [18/Sep/2024:12:40:44] ENGINE Bus STARTING 2024-09-18T12:40:45.458 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:45 smithi078 ceph-mon[28091]: [18/Sep/2024:12:40:44] ENGINE Serving on https://172.21.15.78:7150 2024-09-18T12:40:45.458 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:45 smithi078 ceph-mon[28091]: [18/Sep/2024:12:40:44] ENGINE Error in HTTPServer.serve 2024-09-18T12:40:45.458 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Traceback (most recent call last): 2024-09-18T12:40:45.458 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:40:45.458 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:40:45.458 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:40:45.458 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self._run(expiration_interval) 2024-09-18T12:40:45.458 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:40:45.459 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:40:45.459 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:40:45.459 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:40:45.459 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:40:45.459 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: s = self.context.wrap_socket( 2024-09-18T12:40:45.459 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:40:45.459 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: return self.sslsocket_class._create( 2024-09-18T12:40:45.459 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:40:45.459 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self.do_handshake() 2024-09-18T12:40:45.459 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:40:45.459 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self._sslobj.do_handshake() 2024-09-18T12:40:45.459 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:40:45.459 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:45 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:46.474 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:46 smithi078 ceph-mon[28091]: [18/Sep/2024:12:40:44] ENGINE Serving on http://172.21.15.78:8765 2024-09-18T12:40:46.475 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:46 smithi078 ceph-mon[28091]: [18/Sep/2024:12:40:44] ENGINE Bus STARTED 2024-09-18T12:40:46.475 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:46 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:46.475 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:46 smithi078 ceph-mon[28091]: mgrmap e12: smithi078.ohifux(active, since 2s) 2024-09-18T12:40:46.475 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:46 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:46.475 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:46 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:46.476 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-18T12:40:46.477 INFO:teuthology.orchestra.run.smithi078.stdout:Creating initial admin user... 2024-09-18T12:40:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:47 smithi078 ceph-mon[28091]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:47 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:48.645 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:48 smithi078 ceph-mon[28091]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:48.647 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$VNbbZB7FZ4qK9Wxg4MCx/ehRHFPoYSEl2wEwgGNnCi4gBXA.kfOAe", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726663247, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-18T12:40:48.648 INFO:teuthology.orchestra.run.smithi078.stdout:Fetching dashboard port number... 2024-09-18T12:40:49.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:49 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2009642976' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-18T12:40:49.921 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 8443 2024-09-18T12:40:49.930 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T12:40:49.931 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout disabled 2024-09-18T12:40:49.938 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T12:40:49.938 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-18T12:40:49.938 INFO:teuthology.orchestra.run.smithi078.stdout:firewalld.service is not enabled 2024-09-18T12:40:49.938 INFO:teuthology.orchestra.run.smithi078.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-18T12:40:49.940 INFO:teuthology.orchestra.run.smithi078.stdout:Ceph Dashboard is now available at: 2024-09-18T12:40:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:40:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: URL: https://smithi078.front.sepia.ceph.com:8443/ 2024-09-18T12:40:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: User: admin 2024-09-18T12:40:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: Password: nems0e8u5w 2024-09-18T12:40:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:40:49.941 INFO:teuthology.orchestra.run.smithi078.stdout:Saving cluster configuration to /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config directory 2024-09-18T12:40:50.589 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:50 smithi078 ceph-mon[28091]: mgrmap e13: smithi078.ohifux(active, since 6s) 2024-09-18T12:40:51.195 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-18T12:40:51.196 INFO:teuthology.orchestra.run.smithi078.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-18T12:40:51.196 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:40:51.196 INFO:teuthology.orchestra.run.smithi078.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-18T12:40:51.196 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:40:51.196 INFO:teuthology.orchestra.run.smithi078.stdout:Or, if you are only running a single cluster on this host: 2024-09-18T12:40:51.196 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:40:51.196 INFO:teuthology.orchestra.run.smithi078.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-18T12:40:51.196 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:40:51.196 INFO:teuthology.orchestra.run.smithi078.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-18T12:40:51.196 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:40:51.196 INFO:teuthology.orchestra.run.smithi078.stdout: ceph telemetry on 2024-09-18T12:40:51.196 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:40:51.196 INFO:teuthology.orchestra.run.smithi078.stdout:For more information see: 2024-09-18T12:40:51.197 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:40:51.197 INFO:teuthology.orchestra.run.smithi078.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-18T12:40:51.197 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:40:51.197 INFO:teuthology.orchestra.run.smithi078.stdout:Bootstrap complete. 2024-09-18T12:40:51.243 INFO:tasks.cephadm:Fetching config... 2024-09-18T12:40:51.243 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:40:51.243 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-18T12:40:51.260 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-18T12:40:51.260 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:40:51.260 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-18T12:40:51.316 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-18T12:40:51.317 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:40:51.317 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/keyring of=/dev/stdout 2024-09-18T12:40:51.382 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-18T12:40:51.385 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:40:51.385 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-18T12:40:51.438 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-18T12:40:51.439 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD17S6cIjmlPaZEst5FwsajdJypFu7VWzeyvw2sSg2N6l450KRYjfU7bMtkqbXm4ZHha5S6R1+uSS/K45sqjF2MP33JQM8Pj4JZC6733MfEWG3W+yIVZMpbOdYcKFKQ5YAUgmYq4SpGXxt9kgq4W7Qe0XFmqU4ccIzpSv1UBCzX/NqOPcwlt42LWGsgd2xTjJH2V+fkOf4yAtRWjNlSdTefWOf0ugjlHg07cZFvAXWGHYClK00GkgsNTG6Ev7SSEMPz/C/pvW6wd7qFigW/0aWerxFltassuO/QKTcgUohDYQTAKY/NvlW0vqV49mioaeyG4sLrV040uBIxnWSO+1+h3fdhq5Gm2hk4t5z0FTXcfb/aLZ1Lw+HeE8ZihdnaiuP64lTezOaHT5Fl3pR4oE1+dhZgzMoLjVoBhmw08CqB+D5vjfzmEtd8MYnpsYYYaO0YUEZLuBI65s6sGtAZI7iugHa9RMy5GZ2lxCjVi3Gf7CorQ8umoj4/UEev7z+iRgc= ceph-ecc0857e-75ba-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-18T12:40:51.515 INFO:teuthology.orchestra.run.smithi078.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD17S6cIjmlPaZEst5FwsajdJypFu7VWzeyvw2sSg2N6l450KRYjfU7bMtkqbXm4ZHha5S6R1+uSS/K45sqjF2MP33JQM8Pj4JZC6733MfEWG3W+yIVZMpbOdYcKFKQ5YAUgmYq4SpGXxt9kgq4W7Qe0XFmqU4ccIzpSv1UBCzX/NqOPcwlt42LWGsgd2xTjJH2V+fkOf4yAtRWjNlSdTefWOf0ugjlHg07cZFvAXWGHYClK00GkgsNTG6Ev7SSEMPz/C/pvW6wd7qFigW/0aWerxFltassuO/QKTcgUohDYQTAKY/NvlW0vqV49mioaeyG4sLrV040uBIxnWSO+1+h3fdhq5Gm2hk4t5z0FTXcfb/aLZ1Lw+HeE8ZihdnaiuP64lTezOaHT5Fl3pR4oE1+dhZgzMoLjVoBhmw08CqB+D5vjfzmEtd8MYnpsYYYaO0YUEZLuBI65s6sGtAZI7iugHa9RMy5GZ2lxCjVi3Gf7CorQ8umoj4/UEev7z+iRgc= ceph-ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:40:51.527 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD17S6cIjmlPaZEst5FwsajdJypFu7VWzeyvw2sSg2N6l450KRYjfU7bMtkqbXm4ZHha5S6R1+uSS/K45sqjF2MP33JQM8Pj4JZC6733MfEWG3W+yIVZMpbOdYcKFKQ5YAUgmYq4SpGXxt9kgq4W7Qe0XFmqU4ccIzpSv1UBCzX/NqOPcwlt42LWGsgd2xTjJH2V+fkOf4yAtRWjNlSdTefWOf0ugjlHg07cZFvAXWGHYClK00GkgsNTG6Ev7SSEMPz/C/pvW6wd7qFigW/0aWerxFltassuO/QKTcgUohDYQTAKY/NvlW0vqV49mioaeyG4sLrV040uBIxnWSO+1+h3fdhq5Gm2hk4t5z0FTXcfb/aLZ1Lw+HeE8ZihdnaiuP64lTezOaHT5Fl3pR4oE1+dhZgzMoLjVoBhmw08CqB+D5vjfzmEtd8MYnpsYYYaO0YUEZLuBI65s6sGtAZI7iugHa9RMy5GZ2lxCjVi3Gf7CorQ8umoj4/UEev7z+iRgc= ceph-ecc0857e-75ba-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-18T12:40:51.680 INFO:teuthology.orchestra.run.smithi148.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD17S6cIjmlPaZEst5FwsajdJypFu7VWzeyvw2sSg2N6l450KRYjfU7bMtkqbXm4ZHha5S6R1+uSS/K45sqjF2MP33JQM8Pj4JZC6733MfEWG3W+yIVZMpbOdYcKFKQ5YAUgmYq4SpGXxt9kgq4W7Qe0XFmqU4ccIzpSv1UBCzX/NqOPcwlt42LWGsgd2xTjJH2V+fkOf4yAtRWjNlSdTefWOf0ugjlHg07cZFvAXWGHYClK00GkgsNTG6Ev7SSEMPz/C/pvW6wd7qFigW/0aWerxFltassuO/QKTcgUohDYQTAKY/NvlW0vqV49mioaeyG4sLrV040uBIxnWSO+1+h3fdhq5Gm2hk4t5z0FTXcfb/aLZ1Lw+HeE8ZihdnaiuP64lTezOaHT5Fl3pR4oE1+dhZgzMoLjVoBhmw08CqB+D5vjfzmEtd8MYnpsYYYaO0YUEZLuBI65s6sGtAZI7iugHa9RMy5GZ2lxCjVi3Gf7CorQ8umoj4/UEev7z+iRgc= ceph-ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:40:51.693 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-18T12:40:51.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:51 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3039691743' entity='client.admin' 2024-09-18T12:40:51.945 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:40:53.224 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-18T12:40:53.225 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-18T12:40:53.706 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:40:53.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:53 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/606694464' entity='client.admin' 2024-09-18T12:40:55.512 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi148 2024-09-18T12:40:55.512 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-18T12:40:55.512 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/etc/ceph/ceph.conf 2024-09-18T12:40:55.531 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-18T12:40:55.531 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:40:55.589 INFO:tasks.cephadm:Adding host smithi148 to orchestrator... 2024-09-18T12:40:55.590 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph orch host add smithi148 2024-09-18T12:40:56.013 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:40:56.137 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:55 smithi078 ceph-mon[28091]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:56.137 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:55 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:57.227 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:56 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:57.228 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:56 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:57.228 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:56 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd/host:smithi078", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:40:57.228 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:56 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:40:57.228 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:56 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:40:57.228 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:56 smithi078 ceph-mon[28091]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-18T12:40:57.228 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:56 smithi078 ceph-mon[28091]: Updating smithi078:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:40:57.228 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:56 smithi078 ceph-mon[28091]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:40:57.228 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:56 smithi078 ceph-mon[28091]: Updating smithi078:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:40:57.228 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:56 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:57.228 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:56 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:57.228 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:56 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:40:57.228 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:56 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi078", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:40:57.229 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:56 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi078", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-18T12:40:57.229 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:56 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:40:58.141 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:57 smithi078 ceph-mon[28091]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi148", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:40:58.141 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:57 smithi078 ceph-mon[28091]: Deploying daemon ceph-exporter.smithi078 on smithi078 2024-09-18T12:40:59.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:40:58 smithi078 ceph-mon[28091]: Deploying cephadm binary to smithi148 2024-09-18T12:40:59.988 INFO:teuthology.orchestra.run.smithi078.stdout:Added host 'smithi148' with addr '172.21.15.148' 2024-09-18T12:41:00.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:00 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:00.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:00 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:00.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:00 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:00.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:00 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:00.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:00 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi078", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:41:00.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:00 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi078", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-18T12:41:00.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:00 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:41:00.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:00 smithi078 ceph-mon[28091]: Deploying daemon crash.smithi078 on smithi078 2024-09-18T12:41:00.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:00 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:01.400 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:01 smithi078 ceph-mon[28091]: Added host smithi148 2024-09-18T12:41:01.433 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-18T12:41:01.929 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:41:02.574 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:41:02.575 INFO:teuthology.orchestra.run.smithi078.stdout:[{"addr": "172.21.15.78", "hostname": "smithi078", "labels": [], "status": ""}, {"addr": "172.21.15.148", "hostname": "smithi148", "labels": [], "status": ""}] 2024-09-18T12:41:03.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:02 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:03.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:02 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:03.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:02 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:03.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:02 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:03.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:02 smithi078 ceph-mon[28091]: Deploying daemon node-exporter.smithi078 on smithi078 2024-09-18T12:41:03.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:02 smithi078 ceph-mon[28091]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:41:03.321 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-18T12:41:03.321 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-18T12:41:03.584 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:41:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:04 smithi078 ceph-mon[28091]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:04 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:04 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/4220389622' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-18T12:41:04.941 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2024-09-18T12:41:06.187 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:05 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/4220389622' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-18T12:41:06.187 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:05 smithi078 ceph-mon[28091]: osdmap e4: 0 total, 0 up, 0 in 2024-09-18T12:41:06.187 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:05 smithi078 ceph-mon[28091]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:06.270 INFO:tasks.cephadm:Adding mon.smithi078 on smithi078 2024-09-18T12:41:06.270 INFO:tasks.cephadm:Adding mon.smithi148 on smithi148 2024-09-18T12:41:06.271 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi078:172.21.15.78=smithi078;smithi148:172.21.15.148=smithi148' 2024-09-18T12:41:06.533 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:06.576 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:07.195 INFO:teuthology.orchestra.run.smithi148.stdout:Scheduled mon update... 2024-09-18T12:41:07.783 DEBUG:teuthology.orchestra.run.smithi148:mon.smithi148> sudo journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mon.smithi148.service 2024-09-18T12:41:07.785 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:07.785 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:07.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:07 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:07.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:07 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:07.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:07 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:07.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:07 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:07.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:07 smithi078 ceph-mon[28091]: Deploying daemon alertmanager.smithi078 on smithi078 2024-09-18T12:41:07.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:07 smithi078 ceph-mon[28091]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi078:172.21.15.78=smithi078;smithi148:172.21.15.148=smithi148", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:41:07.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:07 smithi078 ceph-mon[28091]: Saving service mon spec with placement smithi078:172.21.15.78=smithi078;smithi148:172.21.15.148=smithi148;count:2 2024-09-18T12:41:07.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:07 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:07.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:07 smithi078 ceph-mon[28091]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:08.072 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:08.128 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:08.776 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:08.776 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:08.776 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:09.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:09 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:09.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:09 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/2196557060' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:10.411 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:10.412 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:10.648 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:10.689 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:10.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:10 smithi078 ceph-mon[28091]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:11.311 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:11.311 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:11.312 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:11 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/2010793471' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:12.633 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:12 smithi078 ceph-mon[28091]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:12.844 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:12.845 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:13.090 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:13.134 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:14.022 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:14.022 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:14.022 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:14.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:14 smithi078 ceph-mon[28091]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:14.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:14 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/3343687231' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:15.617 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:15.618 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:15.863 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:15.908 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:15.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:15 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:15.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:15 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:15.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:15 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:15.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:15 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:15.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:15 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:15.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:15 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:15.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:15 smithi078 ceph-mon[28091]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-18T12:41:15.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:15 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:15.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:15 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:15.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:15 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-18T12:41:15.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:15 smithi078 ceph-mon[28091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-18T12:41:15.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:15 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:15.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:15 smithi078 ceph-mon[28091]: Deploying daemon grafana.smithi078 on smithi078 2024-09-18T12:41:15.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:15 smithi078 ceph-mon[28091]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:16.531 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:16.531 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:16.531 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:17.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:16 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/4102686679' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:18.150 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:18.151 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:18.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:17 smithi078 ceph-mon[28091]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:18.395 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:18.439 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:19.099 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:19.099 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:19.099 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:19.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:19 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:19.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:19 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/4035403741' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:20.685 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:20.685 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:20.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:20 smithi078 ceph-mon[28091]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:20.929 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:20.973 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:21.606 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:21.606 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:21.606 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:22.693 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:22 smithi078 ceph-mon[28091]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:22.693 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:22 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/3150778416' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:23.203 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:23.203 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:23.493 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:24.461 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:24.461 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:24.461 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:24.571 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:24 smithi078 ceph-mon[28091]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:25 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/1368609906' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:25 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:25 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:25 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:25 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:25 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:25.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:25 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:25.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:25 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:25.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:25 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:26.015 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:26.016 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:26.261 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:26.307 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:26.595 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:26 smithi078 ceph-mon[28091]: Deploying daemon prometheus.smithi078 on smithi078 2024-09-18T12:41:26.595 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:26 smithi078 ceph-mon[28091]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:27.090 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:27.090 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:27.090 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:27.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:27 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/4212056432' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:28.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:28 smithi078 ceph-mon[28091]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:28.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:28 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:28.745 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:28.745 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:28.988 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:29.089 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:29.780 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:29.780 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:29.781 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:30.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:30 smithi078 ceph-mon[28091]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:30.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:30 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/1706995472' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:31.353 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:31.353 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:31.597 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:31.641 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:32.487 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:32 smithi078 ceph-mon[28091]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:32.584 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:32.584 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:32.584 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:33.565 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:33 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/3937069067' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:34.141 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:34.141 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:34.386 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:34.441 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:34.622 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:34 smithi078 ceph-mon[28091]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:35.073 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:35.073 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:35.073 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:35.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:35 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/146342340' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:36.604 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:36.605 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:36.843 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:36.888 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:36.912 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:36 smithi078 ceph-mon[28091]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:41:36.912 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:36 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:36.912 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:36 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:36.912 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:36 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:36.912 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:36 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-18T12:41:37.545 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:37.545 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:37.545 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:37.819 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:37 smithi078 ceph-mon[28091]: from='mgr.14162 172.21.15.78:0/3513512692' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-18T12:41:37.820 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:37 smithi078 ceph-mon[28091]: mgrmap e14: smithi078.ohifux(active, since 53s) 2024-09-18T12:41:37.820 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:37 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/630899079' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:39.087 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:39.087 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:39.330 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:39.374 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:40.100 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:40.100 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:40.100 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:40.289 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:40 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/2932887489' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:41.608 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:41 smithi078 ceph-mon[28091]: Active manager daemon smithi078.ohifux restarted 2024-09-18T12:41:41.609 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:41 smithi078 ceph-mon[28091]: Activating manager daemon smithi078.ohifux 2024-09-18T12:41:41.609 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:41 smithi078 ceph-mon[28091]: osdmap e5: 0 total, 0 up, 0 in 2024-09-18T12:41:41.609 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:41 smithi078 ceph-mon[28091]: mgrmap e15: smithi078.ohifux(active, starting, since 0.00288319s) 2024-09-18T12:41:41.609 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:41:41.609 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr metadata", "who": "smithi078.ohifux", "id": "smithi078.ohifux"}]: dispatch 2024-09-18T12:41:41.609 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:41:41.609 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:41:41.610 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:41:41.610 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:41 smithi078 ceph-mon[28091]: Manager daemon smithi078.ohifux is now available 2024-09-18T12:41:41.610 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:41:41.610 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:41.610 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:41:41.610 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi078.ohifux/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:41:41.774 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:41.774 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:42.018 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:42.070 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:42.643 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:42 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi078.ohifux/trash_purge_schedule"}]: dispatch 2024-09-18T12:41:42.644 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:42 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:42.644 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:42 smithi078 ceph-mon[28091]: mgrmap e16: smithi078.ohifux(active, since 1.0054s) 2024-09-18T12:41:42.744 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:42.744 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:42.744 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:43.941 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:43 smithi078 ceph-mon[28091]: [18/Sep/2024:12:41:42] ENGINE Bus STARTING 2024-09-18T12:41:43.942 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:43 smithi078 ceph-mon[28091]: [18/Sep/2024:12:41:42] ENGINE Serving on http://172.21.15.78:8765 2024-09-18T12:41:43.942 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:43 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:43.942 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:43 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/1052272708' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:44.352 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:44.353 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:44.697 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:44.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:44 smithi078 ceph-mon[28091]: [18/Sep/2024:12:41:42] ENGINE Serving on https://172.21.15.78:7150 2024-09-18T12:41:44.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:44 smithi078 ceph-mon[28091]: [18/Sep/2024:12:41:42] ENGINE Bus STARTED 2024-09-18T12:41:44.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:44 smithi078 ceph-mon[28091]: [18/Sep/2024:12:41:42] ENGINE Error in HTTPServer.serve 2024-09-18T12:41:44.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Traceback (most recent call last): 2024-09-18T12:41:44.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:41:44.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:41:44.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:41:44.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self._run(expiration_interval) 2024-09-18T12:41:44.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:41:44.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:41:44.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:41:44.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:41:44.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:41:44.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: s = self.context.wrap_socket( 2024-09-18T12:41:44.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:41:44.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: return self.sslsocket_class._create( 2024-09-18T12:41:44.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:41:44.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self.do_handshake() 2024-09-18T12:41:44.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:41:44.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self._sslobj.do_handshake() 2024-09-18T12:41:44.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:41:44.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:44 smithi078 ceph-mon[28091]: mgrmap e17: smithi078.ohifux(active, since 2s) 2024-09-18T12:41:44.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:44 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:45.076 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:41:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:46.165 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:46.165 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:46.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:46 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:46.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:46 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:46.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:46 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/2747289489' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:46.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:46 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:46.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:46 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:46.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:46 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd/host:smithi078", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:41:48.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:48.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:48.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:48.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:48.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd/host:smithi148", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:41:48.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:41:48.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:41:48.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-18T12:41:48.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-18T12:41:48.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: Updating smithi078:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:41:48.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: Updating smithi148:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:41:48.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:41:48.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:41:48.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:48.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:48.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:48.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:48.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:48.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi148", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:41:48.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi148", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-18T12:41:48.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:41:48.522 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:48.522 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:49.225 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:41:49.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:48 smithi078 ceph-mon[28091]: Updating smithi078:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:41:49.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:48 smithi078 ceph-mon[28091]: Updating smithi148:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:41:49.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:48 smithi078 ceph-mon[28091]: Deploying daemon ceph-exporter.smithi148 on smithi148 2024-09-18T12:41:49.983 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:49.983 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:49.983 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:50.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:50 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/4110001723' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:51.606 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:51.606 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:52 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:52 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:52 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:52 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:52.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:52 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi148", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:41:52.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:52 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi148", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-18T12:41:52.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:52 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:41:52.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:52 smithi078 ceph-mon[28091]: Deploying daemon crash.smithi148 on smithi148 2024-09-18T12:41:52.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:52 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:52.611 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:41:53.483 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:53.483 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:53.483 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:53.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:53 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/2394934082' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:55.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:54 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:55.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:54 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:55.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:54 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:55.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:54 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:55.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:54 smithi078 ceph-mon[28091]: Deploying daemon node-exporter.smithi148 on smithi148 2024-09-18T12:41:55.371 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:55.372 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:55.615 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:41:56.491 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:41:56.492 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:41:56.492 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:41:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:56 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:41:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:56 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:57.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:57 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/948708190' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:41:58.848 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:41:58.848 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:41:59.198 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:41:59.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:59 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:59.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:59 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:59.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:59 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:59.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:59 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:41:59.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:59 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.bfgshs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:41:59.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:59 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.bfgshs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-18T12:41:59.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:59 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:41:59.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:59 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:41:59.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:41:59 smithi078 ceph-mon[28091]: Deploying daemon mgr.smithi148.bfgshs on smithi148 2024-09-18T12:42:00.334 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:42:00.334 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:42:00.334 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:42:00.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:00 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/2545462950' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:42:02.006 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:42:02.006 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:42:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:02 smithi078 ceph-mon[28091]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:02 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:02 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:02 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:02.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:02 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:02.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:02 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:02.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:02 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:42:02.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:02 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:02.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:02 smithi078 ceph-mon[28091]: Deploying daemon mon.smithi148 on smithi148 2024-09-18T12:42:03.556 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:42:04.703 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:42:04.703 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:39:37.203660Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:42:04.704 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-18T12:42:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:04 smithi078 ceph-mon[28091]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:05.571 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:05 smithi148 ceph-mon[35352]: mon.smithi148@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-18T12:42:05.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:05 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/2969722313' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:42:05.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:05 smithi148 bash[35317]: 02dfe15512266bed1dab054016e2f63c8fa51b110a194a210ed78c344de1f675 2024-09-18T12:42:05.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:05 smithi148 systemd[1]: Started Ceph mon.smithi148 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:42:06.375 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:42:06.376 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:42:06.623 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi148/config 2024-09-18T12:42:10.948 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:42:10.948 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":2,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:05.559042Z","created":"2024-09-18T12:39:37.203660Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi078","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-18T12:42:10.948 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 2 2024-09-18T12:42:10.949 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:10.949 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:42:10.949 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: mon.smithi078 calling monitor election 2024-09-18T12:42:10.949 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:10.949 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:10.949 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/1408161429' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/crt"}]: dispatch 2024-09-18T12:42:10.949 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:10.950 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:10.950 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:10.950 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: mon.smithi148 calling monitor election 2024-09-18T12:42:10.950 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:10.950 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:10.950 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:10.950 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:10.950 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: mon.smithi078 is new leader, mons smithi078,smithi148 in quorum (ranks 0,1) 2024-09-18T12:42:10.950 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: monmap epoch 2 2024-09-18T12:42:10.950 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: fsid ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:42:10.950 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: last_changed 2024-09-18T12:42:05.559042+0000 2024-09-18T12:42:10.950 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: created 2024-09-18T12:39:37.203660+0000 2024-09-18T12:42:10.950 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: min_mon_release 19 (squid) 2024-09-18T12:42:10.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: election_strategy: 1 2024-09-18T12:42:10.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.smithi078 2024-09-18T12:42:10.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.smithi148 2024-09-18T12:42:10.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: fsmap 2024-09-18T12:42:10.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: osdmap e5: 0 total, 0 up, 0 in 2024-09-18T12:42:10.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: mgrmap e17: smithi078.ohifux(active, since 29s) 2024-09-18T12:42:10.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: overall HEALTH_OK 2024-09-18T12:42:10.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: Standby manager daemon smithi148.bfgshs started 2024-09-18T12:42:10.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:10.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/1408161429' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:42:10.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:10.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/1408161429' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/key"}]: dispatch 2024-09-18T12:42:10.952 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/1408161429' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:42:10.952 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:10.952 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:10.952 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:10.952 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:10.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:10.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:42:10.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: mon.smithi078 calling monitor election 2024-09-18T12:42:10.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:10.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:10.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/1408161429' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/crt"}]: dispatch 2024-09-18T12:42:10.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:10.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:10.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:10.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: mon.smithi148 calling monitor election 2024-09-18T12:42:10.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:10.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:10.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:10.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:10.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: mon.smithi078 is new leader, mons smithi078,smithi148 in quorum (ranks 0,1) 2024-09-18T12:42:10.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: monmap epoch 2 2024-09-18T12:42:10.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: fsid ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:42:10.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: last_changed 2024-09-18T12:42:05.559042+0000 2024-09-18T12:42:10.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: created 2024-09-18T12:39:37.203660+0000 2024-09-18T12:42:10.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: min_mon_release 19 (squid) 2024-09-18T12:42:10.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: election_strategy: 1 2024-09-18T12:42:10.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.smithi078 2024-09-18T12:42:10.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.smithi148 2024-09-18T12:42:10.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: fsmap 2024-09-18T12:42:10.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: osdmap e5: 0 total, 0 up, 0 in 2024-09-18T12:42:10.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: mgrmap e17: smithi078.ohifux(active, since 29s) 2024-09-18T12:42:10.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: overall HEALTH_OK 2024-09-18T12:42:10.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: Standby manager daemon smithi148.bfgshs started 2024-09-18T12:42:10.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:10.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/1408161429' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:42:10.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:10.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/1408161429' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/key"}]: dispatch 2024-09-18T12:42:10.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/1408161429' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:42:10.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:10.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:10.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:10.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:11.530 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-18T12:42:11.531 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-18T12:42:11.798 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:11.866 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:11 smithi148 ceph-mon[35352]: mgrmap e18: smithi078.ohifux(active, since 29s), standbys: smithi148.bfgshs 2024-09-18T12:42:11.866 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:11 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr metadata", "who": "smithi148.bfgshs", "id": "smithi148.bfgshs"}]: dispatch 2024-09-18T12:42:11.866 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:11 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:42:11.866 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:11 smithi148 ceph-mon[35352]: from='client.? 172.21.15.148:0/295687963' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:42:11.866 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:11 smithi148 ceph-mon[35352]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:11.866 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:11 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:42:11.867 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:11 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:11.918 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:11 smithi078 ceph-mon[28091]: mgrmap e18: smithi078.ohifux(active, since 29s), standbys: smithi148.bfgshs 2024-09-18T12:42:11.919 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:11 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr metadata", "who": "smithi148.bfgshs", "id": "smithi148.bfgshs"}]: dispatch 2024-09-18T12:42:11.919 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:11 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:42:11.919 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:11 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/295687963' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:42:11.919 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:11 smithi078 ceph-mon[28091]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:11.919 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:11 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:42:11.919 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:11 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:42:12.414 INFO:teuthology.orchestra.run.smithi078.stdout:# minimal ceph.conf for ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:42:12.415 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2024-09-18T12:42:12.415 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:42:12.415 INFO:teuthology.orchestra.run.smithi078.stdout: mon_host = [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-18T12:42:12.947 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:12 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2808102344' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:12.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:12 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2808102344' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:13.020 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-18T12:42:13.021 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:42:13.021 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.conf 2024-09-18T12:42:13.048 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:42:13.048 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:42:13.114 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-18T12:42:13.114 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.conf 2024-09-18T12:42:13.140 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-18T12:42:13.140 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:42:13.208 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-18T12:42:13.208 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-18T12:42:13.210 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-18T12:42:13.211 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set client debug_client 20 2024-09-18T12:42:13.255 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-18T12:42:13.255 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set client debug_ms 1 2024-09-18T12:42:13.299 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-18T12:42:13.299 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-18T12:42:13.342 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-18T12:42:13.342 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-18T12:42:13.386 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-18T12:42:13.386 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-18T12:42:13.429 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-18T12:42:13.429 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-18T12:42:13.474 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-18T12:42:13.474 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-18T12:42:13.517 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-18T12:42:13.517 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-18T12:42:13.533 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:13.571 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-18T12:42:13.571 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-18T12:42:13.616 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-18T12:42:13.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-18T12:42:13.660 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-18T12:42:13.660 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-18T12:42:13.705 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-18T12:42:13.706 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-18T12:42:13.753 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-18T12:42:13.754 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-18T12:42:13.801 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-18T12:42:13.801 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-18T12:42:13.847 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-18T12:42:13.847 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-18T12:42:13.949 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-18T12:42:13.949 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-18T12:42:13.993 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-18T12:42:13.994 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-18T12:42:14.053 DEBUG:tasks.cephadm:set 18 configs 2024-09-18T12:42:14.053 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi078') 2024-09-18T12:42:14.073 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:14.074 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:14.074 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:14.074 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:42:14.074 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-18T12:42:14.074 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-18T12:42:14.074 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: Updating smithi078:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:42:14.074 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: Updating smithi148:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:42:14.074 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:14.074 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:14.074 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:14.074 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:14.075 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:14.075 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:14.075 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:42:14.075 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:42:14.075 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:14.269 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:14.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:14.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:14.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:14.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:42:14.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-18T12:42:14.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-18T12:42:14.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: Updating smithi078:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:42:14.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: Updating smithi148:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:42:14.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:14.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:14.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:14.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:14.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:14.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:14.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:42:14.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:42:14.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:15.153 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:15.169 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:15.171 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:15.182 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:15.582 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:15 smithi078 ceph-mon[28091]: Reconfiguring mon.smithi078 (unknown last config time)... 2024-09-18T12:42:15.582 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:15 smithi078 ceph-mon[28091]: Reconfiguring daemon mon.smithi078 on smithi078 2024-09-18T12:42:15.582 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:15 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1063904952' entity='client.admin' 2024-09-18T12:42:15.582 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:15 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/963203220' entity='client.admin' 2024-09-18T12:42:15.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:15 smithi148 ceph-mon[35352]: Reconfiguring mon.smithi078 (unknown last config time)... 2024-09-18T12:42:15.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:15 smithi148 ceph-mon[35352]: Reconfiguring daemon mon.smithi078 on smithi078 2024-09-18T12:42:15.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:15 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1063904952' entity='client.admin' 2024-09-18T12:42:15.977 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:15 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/963203220' entity='client.admin' 2024-09-18T12:42:16.553 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi078') 2024-09-18T12:42:16.749 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:16.750 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:16.751 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:16.754 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:16.833 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:16 smithi078 ceph-mon[28091]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:16.833 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:16 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:16 smithi148 ceph-mon[35352]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:16 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:17.155 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi078') 2024-09-18T12:42:18.617 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:18 smithi078 ceph-mon[28091]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:18.618 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:18 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3919544994' entity='client.admin' 2024-09-18T12:42:18.618 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:18 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3338097488' entity='client.admin' 2024-09-18T12:42:18.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:18 smithi148 ceph-mon[35352]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:18.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:18 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/3919544994' entity='client.admin' 2024-09-18T12:42:18.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:18 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/3338097488' entity='client.admin' 2024-09-18T12:42:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.887+0000 7f2604aab640 1 -- 172.21.15.78:0/1380680667 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f25ec06e380 msgr2=0x7f25ec070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.887+0000 7f2604aab640 1 --2- 172.21.15.78:0/1380680667 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f25ec06e380 0x7f25ec070840 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f25f00096c0 tx=0x7f25f0000bc0 comp rx=0 tx=0).stop 2024-09-18T12:42:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.887+0000 7f2604aab640 1 -- 172.21.15.78:0/1380680667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2600196f60 msgr2=0x7f260019bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.887+0000 7f2604aab640 1 --2- 172.21.15.78:0/1380680667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2600196f60 0x7f260019bf60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f25e800b490 tx=0x7f25e800b950 comp rx=0 tx=0).stop 2024-09-18T12:42:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.887+0000 7f2604aab640 1 -- 172.21.15.78:0/1380680667 shutdown_connections 2024-09-18T12:42:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.887+0000 7f2604aab640 1 --2- 172.21.15.78:0/1380680667 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f25ec06e380 0x7f25ec070840 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.887+0000 7f2604aab640 1 --2- 172.21.15.78:0/1380680667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2600196f60 0x7f260019bf60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:19.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.887+0000 7f2604aab640 1 --2- 172.21.15.78:0/1380680667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26001020a0 0x7f2600196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:19.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.887+0000 7f2604aab640 1 -- 172.21.15.78:0/1380680667 >> 172.21.15.78:0/1380680667 conn(0x7f26000fbc80 msgr2=0x7f26000fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:19.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.887+0000 7f2604aab640 1 -- 172.21.15.78:0/1380680667 shutdown_connections 2024-09-18T12:42:19.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.887+0000 7f2604aab640 1 -- 172.21.15.78:0/1380680667 wait complete. 2024-09-18T12:42:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.951+0000 7efc061c6640 1 -- 172.21.15.78:0/62429945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc001015e0 msgr2=0x7efc001019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.951+0000 7efc061c6640 1 --2- 172.21.15.78:0/62429945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc001015e0 0x7efc001019e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009880 tx=0x7efbe802a5d0 comp rx=0 tx=0).stop 2024-09-18T12:42:19.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.951+0000 7efc061c6640 1 -- 172.21.15.78:0/62429945 shutdown_connections 2024-09-18T12:42:19.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.951+0000 7efc061c6640 1 --2- 172.21.15.78:0/62429945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc001015e0 0x7efc001019e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:19.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.951+0000 7efc061c6640 1 -- 172.21.15.78:0/62429945 >> 172.21.15.78:0/62429945 conn(0x7efc000fcd70 msgr2=0x7efc000ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:19.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.951+0000 7efc061c6640 1 -- 172.21.15.78:0/62429945 shutdown_connections 2024-09-18T12:42:19.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.951+0000 7efc061c6640 1 -- 172.21.15.78:0/62429945 wait complete. 2024-09-18T12:42:19.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.951+0000 7efc061c6640 1 Processor -- start 2024-09-18T12:42:19.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.952+0000 7efc061c6640 1 -- start start 2024-09-18T12:42:19.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.952+0000 7efc061c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc001015e0 0x7efc00075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:19.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.952+0000 7efc061c6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc000745e0 0x7efc00074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:19.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.952+0000 7efc061c6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efc00107570 con 0x7efc001015e0 2024-09-18T12:42:19.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.952+0000 7efc061c6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efc001073f0 con 0x7efc000745e0 2024-09-18T12:42:19.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.952+0000 7efbff7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc001015e0 0x7efc00075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:19.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.952+0000 7efbff7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc001015e0 0x7efc00075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59784/0 (socket says 172.21.15.78:59784) 2024-09-18T12:42:19.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.952+0000 7efbff7fe640 1 -- 172.21.15.78:0/2041694067 learned_addr learned my addr 172.21.15.78:0/2041694067 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:42:19.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.952+0000 7efbfeffd640 1 --2- 172.21.15.78:0/2041694067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc000745e0 0x7efc00074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:19.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.952+0000 7efbff7fe640 1 -- 172.21.15.78:0/2041694067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc000745e0 msgr2=0x7efc00074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:19.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.952+0000 7efbff7fe640 1 --2- 172.21.15.78:0/2041694067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc000745e0 0x7efc00074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:19.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.952+0000 7efbff7fe640 1 -- 172.21.15.78:0/2041694067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc00074fa0 con 0x7efc001015e0 2024-09-18T12:42:19.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.953+0000 7efbff7fe640 1 --2- 172.21.15.78:0/2041694067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc001015e0 0x7efc00075f20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efbe8005940 tx=0x7efbe80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:19.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.953+0000 7efbfcff9640 1 -- 172.21.15.78:0/2041694067 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efbe803f070 con 0x7efc001015e0 2024-09-18T12:42:19.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.953+0000 7efc061c6640 1 -- 172.21.15.78:0/2041694067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc00075230 con 0x7efc001015e0 2024-09-18T12:42:19.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.953+0000 7efbfcff9640 1 -- 172.21.15.78:0/2041694067 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7efbe8003a90 con 0x7efc001015e0 2024-09-18T12:42:19.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.953+0000 7efbfcff9640 1 -- 172.21.15.78:0/2041694067 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efbe8035030 con 0x7efc001015e0 2024-09-18T12:42:19.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.953+0000 7efc061c6640 1 -- 172.21.15.78:0/2041694067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc0019eda0 con 0x7efc001015e0 2024-09-18T12:42:19.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.954+0000 7efc061c6640 1 -- 172.21.15.78:0/2041694067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc00107d10 con 0x7efc001015e0 2024-09-18T12:42:19.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.954+0000 7efbfcff9640 1 -- 172.21.15.78:0/2041694067 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7efbe8042070 con 0x7efc001015e0 2024-09-18T12:42:19.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.955+0000 7efbfcff9640 1 --2- 172.21.15.78:0/2041694067 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7efbec06e380 0x7efbec070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:19.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.955+0000 7efbfcff9640 1 -- 172.21.15.78:0/2041694067 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7efbe80adbb0 con 0x7efc001015e0 2024-09-18T12:42:19.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.955+0000 7efbfeffd640 1 --2- 172.21.15.78:0/2041694067 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7efbec06e380 0x7efbec070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:19.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.956+0000 7efbfeffd640 1 --2- 172.21.15.78:0/2041694067 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7efbec06e380 0x7efbec070840 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efc00075ca0 tx=0x7efbf0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:19.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:19.959+0000 7efbfcff9640 1 -- 172.21.15.78:0/2041694067 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efbe807c5e0 con 0x7efc001015e0 2024-09-18T12:42:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.131+0000 7efc061c6640 1 -- 172.21.15.78:0/2041694067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7efc0002d980 con 0x7efc001015e0 2024-09-18T12:42:20.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.135+0000 7efbfcff9640 1 -- 172.21.15.78:0/2041694067 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v16)=0 v16) ==== 106+0+0 (secure 0 0 0) 0x7efbe8080290 con 0x7efc001015e0 2024-09-18T12:42:20.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.137+0000 7efc061c6640 1 -- 172.21.15.78:0/2041694067 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7efbec06e380 msgr2=0x7efbec070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:20.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.137+0000 7efc061c6640 1 --2- 172.21.15.78:0/2041694067 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7efbec06e380 0x7efbec070840 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efc00075ca0 tx=0x7efbf0008040 comp rx=0 tx=0).stop 2024-09-18T12:42:20.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.137+0000 7efc061c6640 1 -- 172.21.15.78:0/2041694067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc001015e0 msgr2=0x7efc00075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:20.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.137+0000 7efc061c6640 1 --2- 172.21.15.78:0/2041694067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc001015e0 0x7efc00075f20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efbe8005940 tx=0x7efbe80048f0 comp rx=0 tx=0).stop 2024-09-18T12:42:20.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.137+0000 7efc061c6640 1 -- 172.21.15.78:0/2041694067 shutdown_connections 2024-09-18T12:42:20.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.137+0000 7efc061c6640 1 --2- 172.21.15.78:0/2041694067 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7efbec06e380 0x7efbec070840 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:20.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.137+0000 7efc061c6640 1 --2- 172.21.15.78:0/2041694067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc000745e0 0x7efc00074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:20.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.137+0000 7efc061c6640 1 --2- 172.21.15.78:0/2041694067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc001015e0 0x7efc00075f20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:20.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.137+0000 7efc061c6640 1 -- 172.21.15.78:0/2041694067 >> 172.21.15.78:0/2041694067 conn(0x7efc000fcd70 msgr2=0x7efc000fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:20.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.137+0000 7efc061c6640 1 -- 172.21.15.78:0/2041694067 shutdown_connections 2024-09-18T12:42:20.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.137+0000 7efc061c6640 1 -- 172.21.15.78:0/2041694067 wait complete. 2024-09-18T12:42:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.167+0000 7fed578fb640 1 -- 172.21.15.78:0/321007656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed50102c40 msgr2=0x7fed50103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.167+0000 7fed578fb640 1 --2- 172.21.15.78:0/321007656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed50102c40 0x7fed50103040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fed48009880 tx=0x7fed4802a5d0 comp rx=0 tx=0).stop 2024-09-18T12:42:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.167+0000 7fed578fb640 1 -- 172.21.15.78:0/321007656 shutdown_connections 2024-09-18T12:42:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.167+0000 7fed578fb640 1 --2- 172.21.15.78:0/321007656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed50102c40 0x7fed50103040 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.167+0000 7fed578fb640 1 -- 172.21.15.78:0/321007656 >> 172.21.15.78:0/321007656 conn(0x7fed500fb450 msgr2=0x7fed500fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.167+0000 7fed578fb640 1 -- 172.21.15.78:0/321007656 shutdown_connections 2024-09-18T12:42:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.167+0000 7fed578fb640 1 -- 172.21.15.78:0/321007656 wait complete. 2024-09-18T12:42:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.167+0000 7fed578fb640 1 Processor -- start 2024-09-18T12:42:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.167+0000 7fed578fb640 1 -- start start 2024-09-18T12:42:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed578fb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed50102c40 0x7fed50196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed578fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed501970b0 0x7fed5019c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed578fb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fed50107550 con 0x7fed501970b0 2024-09-18T12:42:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed578fb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fed501073d0 con 0x7fed50102c40 2024-09-18T12:42:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed54e96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed501970b0 0x7fed5019c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed54e96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed501970b0 0x7fed5019c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59794/0 (socket says 172.21.15.78:59794) 2024-09-18T12:42:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed54e96640 1 -- 172.21.15.78:0/602091744 learned_addr learned my addr 172.21.15.78:0/602091744 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:42:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed54e96640 1 -- 172.21.15.78:0/602091744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed50102c40 msgr2=0x7fed50196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed54e96640 1 --2- 172.21.15.78:0/602091744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed50102c40 0x7fed50196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed54e96640 1 -- 172.21.15.78:0/602091744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed501975e0 con 0x7fed501970b0 2024-09-18T12:42:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed54e96640 1 --2- 172.21.15.78:0/602091744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed501970b0 0x7fed5019c0b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed4400b4a0 tx=0x7fed4400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed4e7fc640 1 -- 172.21.15.78:0/602091744 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed44014070 con 0x7fed501970b0 2024-09-18T12:42:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed4e7fc640 1 -- 172.21.15.78:0/602091744 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fed44010ab0 con 0x7fed501970b0 2024-09-18T12:42:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed4e7fc640 1 -- 172.21.15.78:0/602091744 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed44017c80 con 0x7fed501970b0 2024-09-18T12:42:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed578fb640 1 -- 172.21.15.78:0/602091744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5019c5f0 con 0x7fed501970b0 2024-09-18T12:42:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.168+0000 7fed578fb640 1 -- 172.21.15.78:0/602091744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed5019cb70 con 0x7fed501970b0 2024-09-18T12:42:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.169+0000 7fed578fb640 1 -- 172.21.15.78:0/602091744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed50107cf0 con 0x7fed501970b0 2024-09-18T12:42:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.170+0000 7fed4e7fc640 1 -- 172.21.15.78:0/602091744 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fed44017070 con 0x7fed501970b0 2024-09-18T12:42:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.170+0000 7fed4e7fc640 1 --2- 172.21.15.78:0/602091744 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fed3806e330 0x7fed380707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.170+0000 7fed4e7fc640 1 -- 172.21.15.78:0/602091744 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fed4400d040 con 0x7fed501970b0 2024-09-18T12:42:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.170+0000 7fed55697640 1 --2- 172.21.15.78:0/602091744 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fed3806e330 0x7fed380707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.171+0000 7fed55697640 1 --2- 172.21.15.78:0/602091744 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fed3806e330 0x7fed380707f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fed480096c0 tx=0x7fed48005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.174+0000 7fed4e7fc640 1 -- 172.21.15.78:0/602091744 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed4401e030 con 0x7fed501970b0 2024-09-18T12:42:20.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.351+0000 7fed578fb640 1 -- 172.21.15.78:0/602091744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fed501030c0 con 0x7fed501970b0 2024-09-18T12:42:20.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.355+0000 7fed4e7fc640 1 -- 172.21.15.78:0/602091744 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v17)=0 v17) ==== 117+0+0 (secure 0 0 0) 0x7fed4405b290 con 0x7fed501970b0 2024-09-18T12:42:20.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.357+0000 7fed578fb640 1 -- 172.21.15.78:0/602091744 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fed3806e330 msgr2=0x7fed380707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:20.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.357+0000 7fed578fb640 1 --2- 172.21.15.78:0/602091744 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fed3806e330 0x7fed380707f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fed480096c0 tx=0x7fed48005d50 comp rx=0 tx=0).stop 2024-09-18T12:42:20.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.357+0000 7fed578fb640 1 -- 172.21.15.78:0/602091744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed501970b0 msgr2=0x7fed5019c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:20.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.357+0000 7fed578fb640 1 --2- 172.21.15.78:0/602091744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed501970b0 0x7fed5019c0b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed4400b4a0 tx=0x7fed4400b960 comp rx=0 tx=0).stop 2024-09-18T12:42:20.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.357+0000 7fed578fb640 1 -- 172.21.15.78:0/602091744 shutdown_connections 2024-09-18T12:42:20.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.357+0000 7fed578fb640 1 --2- 172.21.15.78:0/602091744 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fed3806e330 0x7fed380707f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:20.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.357+0000 7fed578fb640 1 --2- 172.21.15.78:0/602091744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed501970b0 0x7fed5019c0b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:20.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.357+0000 7fed578fb640 1 --2- 172.21.15.78:0/602091744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed50102c40 0x7fed50196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:20.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.357+0000 7fed578fb640 1 -- 172.21.15.78:0/602091744 >> 172.21.15.78:0/602091744 conn(0x7fed500fb450 msgr2=0x7fed500fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:20.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.357+0000 7fed578fb640 1 -- 172.21.15.78:0/602091744 shutdown_connections 2024-09-18T12:42:20.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:20.357+0000 7fed578fb640 1 -- 172.21.15.78:0/602091744 wait complete. 2024-09-18T12:42:20.696 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:20 smithi078 ceph-mon[28091]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:20.696 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:20 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1380680667' entity='client.admin' 2024-09-18T12:42:20.696 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:20 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2041694067' entity='client.admin' 2024-09-18T12:42:20.696 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:20 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/602091744' entity='client.admin' 2024-09-18T12:42:20.816 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:20.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:20 smithi148 ceph-mon[35352]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:20.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:20 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1380680667' entity='client.admin' 2024-09-18T12:42:20.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:20 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2041694067' entity='client.admin' 2024-09-18T12:42:20.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:20 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/602091744' entity='client.admin' 2024-09-18T12:42:21.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.777+0000 7fe904f97640 1 -- 172.21.15.78:0/1144260023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe900101600 msgr2=0x7fe900101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:21.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.777+0000 7fe904f97640 1 --2- 172.21.15.78:0/1144260023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe900101600 0x7fe900101a00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009880 tx=0x7fe8f002a5d0 comp rx=0 tx=0).stop 2024-09-18T12:42:21.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.777+0000 7fe904f97640 1 -- 172.21.15.78:0/1144260023 shutdown_connections 2024-09-18T12:42:21.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.777+0000 7fe904f97640 1 --2- 172.21.15.78:0/1144260023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe900101600 0x7fe900101a00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:21.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.777+0000 7fe904f97640 1 -- 172.21.15.78:0/1144260023 >> 172.21.15.78:0/1144260023 conn(0x7fe9000fcdb0 msgr2=0x7fe9000ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:21.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.777+0000 7fe904f97640 1 -- 172.21.15.78:0/1144260023 shutdown_connections 2024-09-18T12:42:21.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.777+0000 7fe904f97640 1 -- 172.21.15.78:0/1144260023 wait complete. 2024-09-18T12:42:21.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.778+0000 7fe904f97640 1 Processor -- start 2024-09-18T12:42:21.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.778+0000 7fe904f97640 1 -- start start 2024-09-18T12:42:21.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.778+0000 7fe904f97640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe900101600 0x7fe900196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:21.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.778+0000 7fe904f97640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9001970b0 0x7fe90019c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:21.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.778+0000 7fe904f97640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe900107590 con 0x7fe9001970b0 2024-09-18T12:42:21.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.778+0000 7fe904f97640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe900107410 con 0x7fe900101600 2024-09-18T12:42:21.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.778+0000 7fe8f7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9001970b0 0x7fe90019c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:21.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.779+0000 7fe8f7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9001970b0 0x7fe90019c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39994/0 (socket says 172.21.15.78:39994) 2024-09-18T12:42:21.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.779+0000 7fe8f7fff640 1 -- 172.21.15.78:0/1159619860 learned_addr learned my addr 172.21.15.78:0/1159619860 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:42:21.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.779+0000 7fe8f7fff640 1 -- 172.21.15.78:0/1159619860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe900101600 msgr2=0x7fe900196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:21.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.779+0000 7fe8f7fff640 1 --2- 172.21.15.78:0/1159619860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe900101600 0x7fe900196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:21.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.779+0000 7fe8f7fff640 1 -- 172.21.15.78:0/1159619860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9001975e0 con 0x7fe9001970b0 2024-09-18T12:42:21.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.779+0000 7fe8f7fff640 1 --2- 172.21.15.78:0/1159619860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9001970b0 0x7fe90019c0b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800b4a0 tx=0x7fe8e800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:21.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.779+0000 7fe8f77fe640 1 -- 172.21.15.78:0/1159619860 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe8e8014070 con 0x7fe9001970b0 2024-09-18T12:42:21.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.779+0000 7fe904f97640 1 -- 172.21.15.78:0/1159619860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90019c5f0 con 0x7fe9001970b0 2024-09-18T12:42:21.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.779+0000 7fe8f77fe640 1 -- 172.21.15.78:0/1159619860 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fe8e8010ab0 con 0x7fe9001970b0 2024-09-18T12:42:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.779+0000 7fe8f77fe640 1 -- 172.21.15.78:0/1159619860 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe8e8017c80 con 0x7fe9001970b0 2024-09-18T12:42:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.779+0000 7fe904f97640 1 -- 172.21.15.78:0/1159619860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe90019cb70 con 0x7fe9001970b0 2024-09-18T12:42:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.780+0000 7fe904f97640 1 -- 172.21.15.78:0/1159619860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe900107d30 con 0x7fe9001970b0 2024-09-18T12:42:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.781+0000 7fe8f77fe640 1 -- 172.21.15.78:0/1159619860 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fe8e8017070 con 0x7fe9001970b0 2024-09-18T12:42:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.782+0000 7fe8f77fe640 1 --2- 172.21.15.78:0/1159619860 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fe8ec06e330 0x7fe8ec0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.782+0000 7fe8f77fe640 1 -- 172.21.15.78:0/1159619860 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe8e800d040 con 0x7fe9001970b0 2024-09-18T12:42:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.782+0000 7fe8fe59c640 1 --2- 172.21.15.78:0/1159619860 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fe8ec06e330 0x7fe8ec0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.782+0000 7fe8fe59c640 1 --2- 172.21.15.78:0/1159619860 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fe8ec06e330 0x7fe8ec0707f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00096c0 tx=0x7fe8f0005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.786+0000 7fe8f77fe640 1 -- 172.21.15.78:0/1159619860 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe8e801e030 con 0x7fe9001970b0 2024-09-18T12:42:21.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.962+0000 7fe904f97640 1 -- 172.21.15.78:0/1159619860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fe900101a80 con 0x7fe9001970b0 2024-09-18T12:42:21.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.965+0000 7fe8f77fe640 1 -- 172.21.15.78:0/1159619860 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v19)=0 v19) ==== 115+0+0 (secure 0 0 0) 0x7fe8e805b290 con 0x7fe9001970b0 2024-09-18T12:42:21.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.967+0000 7fe904f97640 1 -- 172.21.15.78:0/1159619860 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fe8ec06e330 msgr2=0x7fe8ec0707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:21.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.967+0000 7fe904f97640 1 --2- 172.21.15.78:0/1159619860 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fe8ec06e330 0x7fe8ec0707f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00096c0 tx=0x7fe8f0005d50 comp rx=0 tx=0).stop 2024-09-18T12:42:21.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.967+0000 7fe904f97640 1 -- 172.21.15.78:0/1159619860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9001970b0 msgr2=0x7fe90019c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:21.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.967+0000 7fe904f97640 1 --2- 172.21.15.78:0/1159619860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9001970b0 0x7fe90019c0b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800b4a0 tx=0x7fe8e800b960 comp rx=0 tx=0).stop 2024-09-18T12:42:21.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.967+0000 7fe904f97640 1 -- 172.21.15.78:0/1159619860 shutdown_connections 2024-09-18T12:42:21.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.967+0000 7fe904f97640 1 --2- 172.21.15.78:0/1159619860 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fe8ec06e330 0x7fe8ec0707f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:21.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.967+0000 7fe904f97640 1 --2- 172.21.15.78:0/1159619860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9001970b0 0x7fe90019c0b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:21.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.967+0000 7fe904f97640 1 --2- 172.21.15.78:0/1159619860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe900101600 0x7fe900196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:21.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.967+0000 7fe904f97640 1 -- 172.21.15.78:0/1159619860 >> 172.21.15.78:0/1159619860 conn(0x7fe9000fcdb0 msgr2=0x7fe9000fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:21.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.967+0000 7fe904f97640 1 -- 172.21.15.78:0/1159619860 shutdown_connections 2024-09-18T12:42:21.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.967+0000 7fe904f97640 1 -- 172.21.15.78:0/1159619860 wait complete. 2024-09-18T12:42:22.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.658+0000 7f8858730640 1 -- 172.21.15.78:0/3030263866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8850100510 msgr2=0x7f8850100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:22.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.658+0000 7f8858730640 1 --2- 172.21.15.78:0/3030263866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8850100510 0x7f8850100910 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f884c009880 tx=0x7f884c02a5d0 comp rx=0 tx=0).stop 2024-09-18T12:42:22.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.658+0000 7f8858730640 1 -- 172.21.15.78:0/3030263866 shutdown_connections 2024-09-18T12:42:22.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.658+0000 7f8858730640 1 --2- 172.21.15.78:0/3030263866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8850100510 0x7f8850100910 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:22.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.658+0000 7f8858730640 1 -- 172.21.15.78:0/3030263866 >> 172.21.15.78:0/3030263866 conn(0x7f88500fbc80 msgr2=0x7f88500fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.658+0000 7f8858730640 1 -- 172.21.15.78:0/3030263866 shutdown_connections 2024-09-18T12:42:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.658+0000 7f8858730640 1 -- 172.21.15.78:0/3030263866 wait complete. 2024-09-18T12:42:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.659+0000 7f8858730640 1 Processor -- start 2024-09-18T12:42:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.659+0000 7f8858730640 1 -- start start 2024-09-18T12:42:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.659+0000 7f8858730640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8850100510 0x7f88500fdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.659+0000 7f8858730640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88500fc290 0x7f88500fc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.659+0000 7f8858730640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f88501064a0 con 0x7f88500fc290 2024-09-18T12:42:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.659+0000 7f8858730640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8850106320 con 0x7f8850100510 2024-09-18T12:42:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.659+0000 7f8855ccb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88500fc290 0x7f88500fc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.659+0000 7f8855ccb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88500fc290 0x7f88500fc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39970/0 (socket says 172.21.15.78:39970) 2024-09-18T12:42:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.659+0000 7f8855ccb640 1 -- 172.21.15.78:0/2681871583 learned_addr learned my addr 172.21.15.78:0/2681871583 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:42:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.660+0000 7f88564cc640 1 --2- 172.21.15.78:0/2681871583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8850100510 0x7f88500fdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.660+0000 7f8855ccb640 1 -- 172.21.15.78:0/2681871583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8850100510 msgr2=0x7f88500fdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:22.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.660+0000 7f8855ccb640 1 --2- 172.21.15.78:0/2681871583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8850100510 0x7f88500fdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:22.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.660+0000 7f8855ccb640 1 -- 172.21.15.78:0/2681871583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88500fcc50 con 0x7f88500fc290 2024-09-18T12:42:22.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.660+0000 7f8855ccb640 1 --2- 172.21.15.78:0/2681871583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88500fc290 0x7f88500fc710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f884000b4a0 tx=0x7f884000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:22.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.660+0000 7f88477fe640 1 -- 172.21.15.78:0/2681871583 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8840014070 con 0x7f88500fc290 2024-09-18T12:42:22.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.660+0000 7f88477fe640 1 -- 172.21.15.78:0/2681871583 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f8840010ab0 con 0x7f88500fc290 2024-09-18T12:42:22.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.660+0000 7f8858730640 1 -- 172.21.15.78:0/2681871583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88500fcf40 con 0x7f88500fc290 2024-09-18T12:42:22.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.660+0000 7f88477fe640 1 -- 172.21.15.78:0/2681871583 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8840017c80 con 0x7f88500fc290 2024-09-18T12:42:22.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.660+0000 7f8858730640 1 -- 172.21.15.78:0/2681871583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885019edd0 con 0x7f88500fc290 2024-09-18T12:42:22.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.661+0000 7f8858730640 1 -- 172.21.15.78:0/2681871583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8850106c40 con 0x7f88500fc290 2024-09-18T12:42:22.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.662+0000 7f88477fe640 1 -- 172.21.15.78:0/2681871583 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f8840017070 con 0x7f88500fc290 2024-09-18T12:42:22.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.662+0000 7f88477fe640 1 --2- 172.21.15.78:0/2681871583 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f883c06e330 0x7f883c0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:22.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.662+0000 7f88477fe640 1 -- 172.21.15.78:0/2681871583 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f884000d040 con 0x7f88500fc290 2024-09-18T12:42:22.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.662+0000 7f88564cc640 1 --2- 172.21.15.78:0/2681871583 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f883c06e330 0x7f883c0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:22.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.662+0000 7f88564cc640 1 --2- 172.21.15.78:0/2681871583 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f883c06e330 0x7f883c0707f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f884c0096c0 tx=0x7f884c005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:22.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.666+0000 7f88477fe640 1 -- 172.21.15.78:0/2681871583 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f884001e030 con 0x7f88500fc290 2024-09-18T12:42:22.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.842+0000 7f8858730640 1 -- 172.21.15.78:0/2681871583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f88501903e0 con 0x7f88500fc290 2024-09-18T12:42:22.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.846+0000 7f88477fe640 1 -- 172.21.15.78:0/2681871583 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v18)=0 v18) ==== 119+0+0 (secure 0 0 0) 0x7f884005b290 con 0x7f88500fc290 2024-09-18T12:42:22.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.848+0000 7f8858730640 1 -- 172.21.15.78:0/2681871583 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f883c06e330 msgr2=0x7f883c0707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:22.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.848+0000 7f8858730640 1 --2- 172.21.15.78:0/2681871583 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f883c06e330 0x7f883c0707f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f884c0096c0 tx=0x7f884c005d50 comp rx=0 tx=0).stop 2024-09-18T12:42:22.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.848+0000 7f8858730640 1 -- 172.21.15.78:0/2681871583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88500fc290 msgr2=0x7f88500fc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:22.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.848+0000 7f8858730640 1 --2- 172.21.15.78:0/2681871583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88500fc290 0x7f88500fc710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f884000b4a0 tx=0x7f884000b960 comp rx=0 tx=0).stop 2024-09-18T12:42:22.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.848+0000 7f8858730640 1 -- 172.21.15.78:0/2681871583 shutdown_connections 2024-09-18T12:42:22.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.848+0000 7f8858730640 1 --2- 172.21.15.78:0/2681871583 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f883c06e330 0x7f883c0707f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:22.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.848+0000 7f8858730640 1 --2- 172.21.15.78:0/2681871583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88500fc290 0x7f88500fc710 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:22.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.848+0000 7f8858730640 1 --2- 172.21.15.78:0/2681871583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8850100510 0x7f88500fdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:22.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.848+0000 7f8858730640 1 -- 172.21.15.78:0/2681871583 >> 172.21.15.78:0/2681871583 conn(0x7f88500fbc80 msgr2=0x7f885006a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:22.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.849+0000 7f8858730640 1 -- 172.21.15.78:0/2681871583 shutdown_connections 2024-09-18T12:42:22.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:21.849+0000 7f8858730640 1 -- 172.21.15.78:0/2681871583 wait complete. 2024-09-18T12:42:22.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:22 smithi148 ceph-mon[35352]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:22.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:22 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2681871583' entity='client.admin' 2024-09-18T12:42:22.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:22 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1159619860' entity='client.admin' 2024-09-18T12:42:22.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:22 smithi078 ceph-mon[28091]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:22.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:22 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2681871583' entity='client.admin' 2024-09-18T12:42:22.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:22 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1159619860' entity='client.admin' 2024-09-18T12:42:23.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.701+0000 7f558a0b8640 1 -- 172.21.15.78:0/1517132586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5584100540 msgr2=0x7f5584100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:23.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.701+0000 7f558a0b8640 1 --2- 172.21.15.78:0/1517132586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5584100540 0x7f5584100940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5574009880 tx=0x7f557402a5d0 comp rx=0 tx=0).stop 2024-09-18T12:42:23.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.701+0000 7f558a0b8640 1 -- 172.21.15.78:0/1517132586 shutdown_connections 2024-09-18T12:42:23.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.701+0000 7f558a0b8640 1 --2- 172.21.15.78:0/1517132586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5584100540 0x7f5584100940 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:23.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.701+0000 7f558a0b8640 1 -- 172.21.15.78:0/1517132586 >> 172.21.15.78:0/1517132586 conn(0x7f55840fbcd0 msgr2=0x7f55840fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:23.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.701+0000 7f558a0b8640 1 -- 172.21.15.78:0/1517132586 shutdown_connections 2024-09-18T12:42:23.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.701+0000 7f558a0b8640 1 -- 172.21.15.78:0/1517132586 wait complete. 2024-09-18T12:42:23.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.702+0000 7f558a0b8640 1 Processor -- start 2024-09-18T12:42:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.702+0000 7f558a0b8640 1 -- start start 2024-09-18T12:42:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.702+0000 7f558a0b8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5584100540 0x7f5584196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.702+0000 7f558a0b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55841970b0 0x7f558419c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.702+0000 7f558a0b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5584106460 con 0x7f55841970b0 2024-09-18T12:42:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.702+0000 7f558a0b8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f55841062e0 con 0x7f5584100540 2024-09-18T12:42:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.702+0000 7f5582ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55841970b0 0x7f558419c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.702+0000 7f5582ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55841970b0 0x7f558419c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40016/0 (socket says 172.21.15.78:40016) 2024-09-18T12:42:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.702+0000 7f5582ffd640 1 -- 172.21.15.78:0/2459846768 learned_addr learned my addr 172.21.15.78:0/2459846768 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:42:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.702+0000 7f5582ffd640 1 -- 172.21.15.78:0/2459846768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5584100540 msgr2=0x7f5584196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.702+0000 7f5582ffd640 1 --2- 172.21.15.78:0/2459846768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5584100540 0x7f5584196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.703+0000 7f5582ffd640 1 -- 172.21.15.78:0/2459846768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55841975e0 con 0x7f55841970b0 2024-09-18T12:42:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.703+0000 7f5582ffd640 1 --2- 172.21.15.78:0/2459846768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55841970b0 0x7f558419c0b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f557800b4a0 tx=0x7f557800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.703+0000 7f5580ff9640 1 -- 172.21.15.78:0/2459846768 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5578014070 con 0x7f55841970b0 2024-09-18T12:42:23.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.703+0000 7f5580ff9640 1 -- 172.21.15.78:0/2459846768 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f5578010ab0 con 0x7f55841970b0 2024-09-18T12:42:23.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.703+0000 7f5580ff9640 1 -- 172.21.15.78:0/2459846768 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5578017c80 con 0x7f55841970b0 2024-09-18T12:42:23.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.703+0000 7f558a0b8640 1 -- 172.21.15.78:0/2459846768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558419c5f0 con 0x7f55841970b0 2024-09-18T12:42:23.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.703+0000 7f558a0b8640 1 -- 172.21.15.78:0/2459846768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f558419cb70 con 0x7f55841970b0 2024-09-18T12:42:23.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.704+0000 7f558a0b8640 1 -- 172.21.15.78:0/2459846768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5584106c00 con 0x7f55841970b0 2024-09-18T12:42:23.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.704+0000 7f5580ff9640 1 -- 172.21.15.78:0/2459846768 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f5578017070 con 0x7f55841970b0 2024-09-18T12:42:23.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.705+0000 7f5580ff9640 1 --2- 172.21.15.78:0/2459846768 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f556c06e380 0x7f556c070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:23.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.705+0000 7f5580ff9640 1 -- 172.21.15.78:0/2459846768 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f557800d040 con 0x7f55841970b0 2024-09-18T12:42:23.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.705+0000 7f55837fe640 1 --2- 172.21.15.78:0/2459846768 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f556c06e380 0x7f556c070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:23.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.705+0000 7f55837fe640 1 --2- 172.21.15.78:0/2459846768 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f556c06e380 0x7f556c070840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55740096c0 tx=0x7f5574005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:23.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.709+0000 7f5580ff9640 1 -- 172.21.15.78:0/2459846768 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f557801e030 con 0x7f55841970b0 2024-09-18T12:42:23.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.880+0000 7f558a0b8640 1 -- 172.21.15.78:0/2459846768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f55841009c0 con 0x7f55841970b0 2024-09-18T12:42:23.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.886+0000 7f5580ff9640 1 -- 172.21.15.78:0/2459846768 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v20)=0 v20) ==== 108+0+0 (secure 0 0 0) 0x7f557805b1d0 con 0x7f55841970b0 2024-09-18T12:42:23.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.888+0000 7f558a0b8640 1 -- 172.21.15.78:0/2459846768 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f556c06e380 msgr2=0x7f556c070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.888+0000 7f558a0b8640 1 --2- 172.21.15.78:0/2459846768 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f556c06e380 0x7f556c070840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55740096c0 tx=0x7f5574005d50 comp rx=0 tx=0).stop 2024-09-18T12:42:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.888+0000 7f558a0b8640 1 -- 172.21.15.78:0/2459846768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55841970b0 msgr2=0x7f558419c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.888+0000 7f558a0b8640 1 --2- 172.21.15.78:0/2459846768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55841970b0 0x7f558419c0b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f557800b4a0 tx=0x7f557800b960 comp rx=0 tx=0).stop 2024-09-18T12:42:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.888+0000 7f558a0b8640 1 -- 172.21.15.78:0/2459846768 shutdown_connections 2024-09-18T12:42:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.888+0000 7f558a0b8640 1 --2- 172.21.15.78:0/2459846768 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f556c06e380 0x7f556c070840 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.888+0000 7f558a0b8640 1 --2- 172.21.15.78:0/2459846768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55841970b0 0x7f558419c0b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.888+0000 7f558a0b8640 1 --2- 172.21.15.78:0/2459846768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5584100540 0x7f5584196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.888+0000 7f558a0b8640 1 -- 172.21.15.78:0/2459846768 >> 172.21.15.78:0/2459846768 conn(0x7f55840fbcd0 msgr2=0x7f55840fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.888+0000 7f558a0b8640 1 -- 172.21.15.78:0/2459846768 shutdown_connections 2024-09-18T12:42:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:23.888+0000 7f558a0b8640 1 -- 172.21.15.78:0/2459846768 wait complete. 2024-09-18T12:42:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:24 smithi148 ceph-mon[35352]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:24 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:24 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:24 smithi148 ceph-mon[35352]: Reconfiguring mgr.smithi078.ohifux (unknown last config time)... 2024-09-18T12:42:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:24 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi078.ohifux", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:42:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:24 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:42:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:24 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:24 smithi148 ceph-mon[35352]: Reconfiguring daemon mgr.smithi078.ohifux on smithi078 2024-09-18T12:42:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:24 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2459846768' entity='client.admin' 2024-09-18T12:42:24.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:24 smithi078 ceph-mon[28091]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:24.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:24 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:24.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:24 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:24.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:24 smithi078 ceph-mon[28091]: Reconfiguring mgr.smithi078.ohifux (unknown last config time)... 2024-09-18T12:42:24.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:24 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi078.ohifux", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:42:24.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:24 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:42:24.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:24 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:24.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:24 smithi078 ceph-mon[28091]: Reconfiguring daemon mgr.smithi078.ohifux on smithi078 2024-09-18T12:42:24.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:24 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2459846768' entity='client.admin' 2024-09-18T12:42:24.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.920+0000 7fdfeec50640 1 -- 172.21.15.78:0/412792619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe8101a60 msgr2=0x7fdfe8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:24.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.920+0000 7fdfeec50640 1 --2- 172.21.15.78:0/412792619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe8101a60 0x7fdfe8101ee0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009c20 tx=0x7fdfdc02a970 comp rx=0 tx=0).stop 2024-09-18T12:42:24.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.920+0000 7fdfeec50640 1 -- 172.21.15.78:0/412792619 shutdown_connections 2024-09-18T12:42:24.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.920+0000 7fdfeec50640 1 --2- 172.21.15.78:0/412792619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe8101a60 0x7fdfe8101ee0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:24.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.920+0000 7fdfeec50640 1 --2- 172.21.15.78:0/412792619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfe8100860 0x7fdfe8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:24.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.920+0000 7fdfeec50640 1 -- 172.21.15.78:0/412792619 >> 172.21.15.78:0/412792619 conn(0x7fdfe80fc010 msgr2=0x7fdfe80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:24.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.921+0000 7fdfeec50640 1 -- 172.21.15.78:0/412792619 shutdown_connections 2024-09-18T12:42:24.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.921+0000 7fdfeec50640 1 -- 172.21.15.78:0/412792619 wait complete. 2024-09-18T12:42:24.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.921+0000 7fdfeec50640 1 Processor -- start 2024-09-18T12:42:24.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.921+0000 7fdfeec50640 1 -- start start 2024-09-18T12:42:24.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.921+0000 7fdfeec50640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfe8100860 0x7fdfe8104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:24.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.921+0000 7fdfeec50640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe8101a60 0x7fdfe8102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:24.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.921+0000 7fdfeec50640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe81095e0 con 0x7fdfe8101a60 2024-09-18T12:42:24.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.921+0000 7fdfeec50640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe8109460 con 0x7fdfe8100860 2024-09-18T12:42:24.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.921+0000 7fdfe7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe8101a60 0x7fdfe8102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:24.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.921+0000 7fdfe7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe8101a60 0x7fdfe8102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40032/0 (socket says 172.21.15.78:40032) 2024-09-18T12:42:24.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.921+0000 7fdfe7fff640 1 -- 172.21.15.78:0/169175973 learned_addr learned my addr 172.21.15.78:0/169175973 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:42:24.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.922+0000 7fdfe7fff640 1 -- 172.21.15.78:0/169175973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfe8100860 msgr2=0x7fdfe8104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:24.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.922+0000 7fdfe7fff640 1 --2- 172.21.15.78:0/169175973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfe8100860 0x7fdfe8104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:24.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.922+0000 7fdfe7fff640 1 -- 172.21.15.78:0/169175973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe8103380 con 0x7fdfe8101a60 2024-09-18T12:42:24.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.922+0000 7fdfe7fff640 1 --2- 172.21.15.78:0/169175973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe8101a60 0x7fdfe8102e40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc006010 tx=0x7fdfdc02fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:24.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.922+0000 7fdfe5ffb640 1 -- 172.21.15.78:0/169175973 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdfdc047070 con 0x7fdfe8101a60 2024-09-18T12:42:24.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.922+0000 7fdfe5ffb640 1 -- 172.21.15.78:0/169175973 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fdfdc003e10 con 0x7fdfe8101a60 2024-09-18T12:42:24.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.922+0000 7fdfeec50640 1 -- 172.21.15.78:0/169175973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe8103610 con 0x7fdfe8101a60 2024-09-18T12:42:24.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.922+0000 7fdfe5ffb640 1 -- 172.21.15.78:0/169175973 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdfdc034070 con 0x7fdfe8101a60 2024-09-18T12:42:24.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.922+0000 7fdfeec50640 1 -- 172.21.15.78:0/169175973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe8103bc0 con 0x7fdfe8101a60 2024-09-18T12:42:24.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.923+0000 7fdfeec50640 1 -- 172.21.15.78:0/169175973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfe8109dc0 con 0x7fdfe8101a60 2024-09-18T12:42:24.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.924+0000 7fdfe5ffb640 1 -- 172.21.15.78:0/169175973 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fdfdc04a070 con 0x7fdfe8101a60 2024-09-18T12:42:24.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.924+0000 7fdfe5ffb640 1 --2- 172.21.15.78:0/169175973 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fdfd006e280 0x7fdfd0070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:24.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.924+0000 7fdfe5ffb640 1 -- 172.21.15.78:0/169175973 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdfdc0adef0 con 0x7fdfe8101a60 2024-09-18T12:42:24.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.924+0000 7fdfec9ec640 1 --2- 172.21.15.78:0/169175973 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fdfd006e280 0x7fdfd0070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:24.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.925+0000 7fdfec9ec640 1 --2- 172.21.15.78:0/169175973 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fdfd006e280 0x7fdfd0070740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdfe81018c0 tx=0x7fdfd8006c90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:24.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:24.928+0000 7fdfe5ffb640 1 -- 172.21.15.78:0/169175973 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdfdc03f070 con 0x7fdfe8101a60 2024-09-18T12:42:25.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.095+0000 7fdfeec50640 1 -- 172.21.15.78:0/169175973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fdfe819f660 con 0x7fdfe8101a60 2024-09-18T12:42:25.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.098+0000 7fdfe5ffb640 1 -- 172.21.15.78:0/169175973 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fdfdc076e20 con 0x7fdfe8101a60 2024-09-18T12:42:25.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.101+0000 7fdfeec50640 1 -- 172.21.15.78:0/169175973 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fdfd006e280 msgr2=0x7fdfd0070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:25.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.101+0000 7fdfeec50640 1 --2- 172.21.15.78:0/169175973 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fdfd006e280 0x7fdfd0070740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdfe81018c0 tx=0x7fdfd8006c90 comp rx=0 tx=0).stop 2024-09-18T12:42:25.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.101+0000 7fdfeec50640 1 -- 172.21.15.78:0/169175973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe8101a60 msgr2=0x7fdfe8102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:25.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.101+0000 7fdfeec50640 1 --2- 172.21.15.78:0/169175973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe8101a60 0x7fdfe8102e40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc006010 tx=0x7fdfdc02fcb0 comp rx=0 tx=0).stop 2024-09-18T12:42:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.101+0000 7fdfeec50640 1 -- 172.21.15.78:0/169175973 shutdown_connections 2024-09-18T12:42:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.101+0000 7fdfeec50640 1 --2- 172.21.15.78:0/169175973 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fdfd006e280 0x7fdfd0070740 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.101+0000 7fdfeec50640 1 --2- 172.21.15.78:0/169175973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe8101a60 0x7fdfe8102e40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.101+0000 7fdfeec50640 1 --2- 172.21.15.78:0/169175973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfe8100860 0x7fdfe8104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.101+0000 7fdfeec50640 1 -- 172.21.15.78:0/169175973 >> 172.21.15.78:0/169175973 conn(0x7fdfe80fc010 msgr2=0x7fdfe806a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.101+0000 7fdfeec50640 1 -- 172.21.15.78:0/169175973 shutdown_connections 2024-09-18T12:42:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.101+0000 7fdfeec50640 1 -- 172.21.15.78:0/169175973 wait complete. 2024-09-18T12:42:25.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.475+0000 7fc393fd3640 1 -- 172.21.15.78:0/1716436210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc38c0761a0 msgr2=0x7fc38c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:25.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.475+0000 7fc393fd3640 1 --2- 172.21.15.78:0/1716436210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc38c0761a0 0x7fc38c074600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc388009880 tx=0x7fc38802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:42:25.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.475+0000 7fc393fd3640 1 -- 172.21.15.78:0/1716436210 shutdown_connections 2024-09-18T12:42:25.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.475+0000 7fc393fd3640 1 --2- 172.21.15.78:0/1716436210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc38c074b40 0x7fc38c074fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:25.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.475+0000 7fc393fd3640 1 --2- 172.21.15.78:0/1716436210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc38c0761a0 0x7fc38c074600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:25.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.475+0000 7fc393fd3640 1 -- 172.21.15.78:0/1716436210 >> 172.21.15.78:0/1716436210 conn(0x7fc38c0fd0f0 msgr2=0x7fc38c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:25.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.475+0000 7fc393fd3640 1 -- 172.21.15.78:0/1716436210 shutdown_connections 2024-09-18T12:42:25.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.475+0000 7fc393fd3640 1 -- 172.21.15.78:0/1716436210 wait complete. 2024-09-18T12:42:25.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.476+0000 7fc393fd3640 1 Processor -- start 2024-09-18T12:42:25.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.476+0000 7fc393fd3640 1 -- start start 2024-09-18T12:42:25.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.476+0000 7fc393fd3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc38c074b40 0x7fc38c199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:25.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.476+0000 7fc393fd3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc38c0761a0 0x7fc38c199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:25.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.476+0000 7fc393fd3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c10c850 con 0x7fc38c0761a0 2024-09-18T12:42:25.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.476+0000 7fc393fd3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c10c6d0 con 0x7fc38c074b40 2024-09-18T12:42:25.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.476+0000 7fc39156e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc38c0761a0 0x7fc38c199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:25.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.476+0000 7fc39156e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc38c0761a0 0x7fc38c199b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40042/0 (socket says 172.21.15.78:40042) 2024-09-18T12:42:25.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.476+0000 7fc39156e640 1 -- 172.21.15.78:0/209320581 learned_addr learned my addr 172.21.15.78:0/209320581 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:42:25.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.476+0000 7fc39156e640 1 -- 172.21.15.78:0/209320581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc38c074b40 msgr2=0x7fc38c199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:25.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.476+0000 7fc391d6f640 1 --2- 172.21.15.78:0/209320581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc38c074b40 0x7fc38c199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:25.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.476+0000 7fc39156e640 1 --2- 172.21.15.78:0/209320581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc38c074b40 0x7fc38c199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:25.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.476+0000 7fc39156e640 1 -- 172.21.15.78:0/209320581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38c19a1e0 con 0x7fc38c0761a0 2024-09-18T12:42:25.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.476+0000 7fc39156e640 1 --2- 172.21.15.78:0/209320581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc38c0761a0 0x7fc38c199b60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c8f0 tx=0x7fc37c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:25.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.477+0000 7fc382ffd640 1 -- 172.21.15.78:0/209320581 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc37c0079b0 con 0x7fc38c0761a0 2024-09-18T12:42:25.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.477+0000 7fc382ffd640 1 -- 172.21.15.78:0/209320581 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fc37c005020 con 0x7fc38c0761a0 2024-09-18T12:42:25.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.477+0000 7fc382ffd640 1 -- 172.21.15.78:0/209320581 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc37c004d90 con 0x7fc38c0761a0 2024-09-18T12:42:25.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.477+0000 7fc393fd3640 1 -- 172.21.15.78:0/209320581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc38c19ebb0 con 0x7fc38c0761a0 2024-09-18T12:42:25.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.477+0000 7fc393fd3640 1 -- 172.21.15.78:0/209320581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc38c19f1c0 con 0x7fc38c0761a0 2024-09-18T12:42:25.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.478+0000 7fc393fd3640 1 -- 172.21.15.78:0/209320581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc38c10d030 con 0x7fc38c0761a0 2024-09-18T12:42:25.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.478+0000 7fc382ffd640 1 -- 172.21.15.78:0/209320581 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fc37c0051d0 con 0x7fc38c0761a0 2024-09-18T12:42:25.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.478+0000 7fc382ffd640 1 --2- 172.21.15.78:0/209320581 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc37806e230 0x7fc3780706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:25.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.479+0000 7fc382ffd640 1 -- 172.21.15.78:0/209320581 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc37c08cee0 con 0x7fc38c0761a0 2024-09-18T12:42:25.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.479+0000 7fc391d6f640 1 --2- 172.21.15.78:0/209320581 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc37806e230 0x7fc3780706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:25.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.479+0000 7fc391d6f640 1 --2- 172.21.15.78:0/209320581 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc37806e230 0x7fc3780706f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3880096c0 tx=0x7fc388000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:25.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.483+0000 7fc382ffd640 1 -- 172.21.15.78:0/209320581 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc37c014030 con 0x7fc38c0761a0 2024-09-18T12:42:25.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.652+0000 7fc393fd3640 1 -- 172.21.15.78:0/209320581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fc38c02d8e0 con 0x7fc38c0761a0 2024-09-18T12:42:25.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.656+0000 7fc382ffd640 1 -- 172.21.15.78:0/209320581 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v22)=0 v22) ==== 120+0+0 (secure 0 0 0) 0x7fc37c05b9a0 con 0x7fc38c0761a0 2024-09-18T12:42:25.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.658+0000 7fc393fd3640 1 -- 172.21.15.78:0/209320581 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc37806e230 msgr2=0x7fc3780706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:25.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.658+0000 7fc393fd3640 1 --2- 172.21.15.78:0/209320581 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc37806e230 0x7fc3780706f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3880096c0 tx=0x7fc388000bc0 comp rx=0 tx=0).stop 2024-09-18T12:42:25.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.658+0000 7fc393fd3640 1 -- 172.21.15.78:0/209320581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc38c0761a0 msgr2=0x7fc38c199b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:25.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.658+0000 7fc393fd3640 1 --2- 172.21.15.78:0/209320581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc38c0761a0 0x7fc38c199b60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c8f0 tx=0x7fc37c00cdb0 comp rx=0 tx=0).stop 2024-09-18T12:42:25.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.658+0000 7fc393fd3640 1 -- 172.21.15.78:0/209320581 shutdown_connections 2024-09-18T12:42:25.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.658+0000 7fc393fd3640 1 --2- 172.21.15.78:0/209320581 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc37806e230 0x7fc3780706f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:25.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.658+0000 7fc393fd3640 1 --2- 172.21.15.78:0/209320581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc38c0761a0 0x7fc38c199b60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:25.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.658+0000 7fc393fd3640 1 --2- 172.21.15.78:0/209320581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc38c074b40 0x7fc38c199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:25.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.658+0000 7fc393fd3640 1 -- 172.21.15.78:0/209320581 >> 172.21.15.78:0/209320581 conn(0x7fc38c0fd0f0 msgr2=0x7fc38c107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:25.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.658+0000 7fc393fd3640 1 -- 172.21.15.78:0/209320581 shutdown_connections 2024-09-18T12:42:25.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:25.658+0000 7fc393fd3640 1 -- 172.21.15.78:0/209320581 wait complete. 2024-09-18T12:42:26.255 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-18T12:42:26.364 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:26 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/169175973' entity='client.admin' 2024-09-18T12:42:26.364 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:26 smithi078 ceph-mon[28091]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:26.364 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:26 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/209320581' entity='client.admin' 2024-09-18T12:42:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:26 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/169175973' entity='client.admin' 2024-09-18T12:42:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:26 smithi148 ceph-mon[35352]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:26 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/209320581' entity='client.admin' 2024-09-18T12:42:27.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.048+0000 7fc1aec83640 1 -- 172.21.15.78:0/1594731394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a8101a60 msgr2=0x7fc1a8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:27.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.048+0000 7fc1aec83640 1 --2- 172.21.15.78:0/1594731394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a8101a60 0x7fc1a8101ee0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc194009880 tx=0x7fc19402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:42:27.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.048+0000 7fc1aec83640 1 -- 172.21.15.78:0/1594731394 shutdown_connections 2024-09-18T12:42:27.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.048+0000 7fc1aec83640 1 --2- 172.21.15.78:0/1594731394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a8101a60 0x7fc1a8101ee0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:27.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.048+0000 7fc1aec83640 1 --2- 172.21.15.78:0/1594731394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1a8100860 0x7fc1a8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:27.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.048+0000 7fc1aec83640 1 -- 172.21.15.78:0/1594731394 >> 172.21.15.78:0/1594731394 conn(0x7fc1a80fc010 msgr2=0x7fc1a80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:27.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.048+0000 7fc1aec83640 1 -- 172.21.15.78:0/1594731394 shutdown_connections 2024-09-18T12:42:27.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.048+0000 7fc1aec83640 1 -- 172.21.15.78:0/1594731394 wait complete. 2024-09-18T12:42:27.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.048+0000 7fc1aec83640 1 Processor -- start 2024-09-18T12:42:27.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1aec83640 1 -- start start 2024-09-18T12:42:27.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1aec83640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1a8100860 0x7fc1a806aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:27.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1aec83640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a8101a60 0x7fc1a819c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:27.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1aec83640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a81095e0 con 0x7fc1a8101a60 2024-09-18T12:42:27.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1aec83640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a8109460 con 0x7fc1a8100860 2024-09-18T12:42:27.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1a7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a8101a60 0x7fc1a819c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:27.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1a7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a8101a60 0x7fc1a819c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40058/0 (socket says 172.21.15.78:40058) 2024-09-18T12:42:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1a7fff640 1 -- 172.21.15.78:0/720261640 learned_addr learned my addr 172.21.15.78:0/720261640 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:42:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1aca1f640 1 --2- 172.21.15.78:0/720261640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1a8100860 0x7fc1a806aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1a7fff640 1 -- 172.21.15.78:0/720261640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1a8100860 msgr2=0x7fc1a806aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1a7fff640 1 --2- 172.21.15.78:0/720261640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1a8100860 0x7fc1a806aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1a7fff640 1 -- 172.21.15.78:0/720261640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a819c800 con 0x7fc1a8101a60 2024-09-18T12:42:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1aca1f640 1 --2- 172.21.15.78:0/720261640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1a8100860 0x7fc1a806aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:42:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1a7fff640 1 --2- 172.21.15.78:0/720261640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a8101a60 0x7fc1a819c240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc194009230 tx=0x7fc1940048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1a5ffb640 1 -- 172.21.15.78:0/720261640 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc19403f070 con 0x7fc1a8101a60 2024-09-18T12:42:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1a5ffb640 1 -- 172.21.15.78:0/720261640 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fc194003a90 con 0x7fc1a8101a60 2024-09-18T12:42:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1a5ffb640 1 -- 172.21.15.78:0/720261640 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc194035030 con 0x7fc1a8101a60 2024-09-18T12:42:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.049+0000 7fc1aec83640 1 -- 172.21.15.78:0/720261640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a819ca90 con 0x7fc1a8101a60 2024-09-18T12:42:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.050+0000 7fc1aec83640 1 -- 172.21.15.78:0/720261640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a819d040 con 0x7fc1a8101a60 2024-09-18T12:42:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.051+0000 7fc1aec83640 1 -- 172.21.15.78:0/720261640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a8109dc0 con 0x7fc1a8101a60 2024-09-18T12:42:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.051+0000 7fc1a5ffb640 1 -- 172.21.15.78:0/720261640 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fc194042070 con 0x7fc1a8101a60 2024-09-18T12:42:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.051+0000 7fc1a5ffb640 1 --2- 172.21.15.78:0/720261640 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc19806e280 0x7fc198070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:27.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.051+0000 7fc1a5ffb640 1 -- 172.21.15.78:0/720261640 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc1940adbf0 con 0x7fc1a8101a60 2024-09-18T12:42:27.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.051+0000 7fc1aca1f640 1 --2- 172.21.15.78:0/720261640 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc19806e280 0x7fc198070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:27.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.052+0000 7fc1aca1f640 1 --2- 172.21.15.78:0/720261640 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc19806e280 0x7fc198070740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc19c006fd0 tx=0x7fc19c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:27.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.056+0000 7fc1a5ffb640 1 -- 172.21.15.78:0/720261640 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc194005490 con 0x7fc1a8101a60 2024-09-18T12:42:27.218 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:27.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.238+0000 7fc1aec83640 1 -- 172.21.15.78:0/720261640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fc1a8100ce0 con 0x7fc1a8101a60 2024-09-18T12:42:27.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.243+0000 7fc1a5ffb640 1 -- 172.21.15.78:0/720261640 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7fc19407c620 con 0x7fc1a8101a60 2024-09-18T12:42:27.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.245+0000 7fc1aec83640 1 -- 172.21.15.78:0/720261640 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc19806e280 msgr2=0x7fc198070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:27.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.245+0000 7fc1aec83640 1 --2- 172.21.15.78:0/720261640 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc19806e280 0x7fc198070740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc19c006fd0 tx=0x7fc19c008040 comp rx=0 tx=0).stop 2024-09-18T12:42:27.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.246+0000 7fc1aec83640 1 -- 172.21.15.78:0/720261640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a8101a60 msgr2=0x7fc1a819c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:27.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.246+0000 7fc1aec83640 1 --2- 172.21.15.78:0/720261640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a8101a60 0x7fc1a819c240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc194009230 tx=0x7fc1940048f0 comp rx=0 tx=0).stop 2024-09-18T12:42:27.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.246+0000 7fc1aec83640 1 -- 172.21.15.78:0/720261640 shutdown_connections 2024-09-18T12:42:27.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.246+0000 7fc1aec83640 1 --2- 172.21.15.78:0/720261640 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc19806e280 0x7fc198070740 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:27.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.246+0000 7fc1aec83640 1 --2- 172.21.15.78:0/720261640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a8101a60 0x7fc1a819c240 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:27.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.246+0000 7fc1aec83640 1 --2- 172.21.15.78:0/720261640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1a8100860 0x7fc1a806aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:27.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.246+0000 7fc1aec83640 1 -- 172.21.15.78:0/720261640 >> 172.21.15.78:0/720261640 conn(0x7fc1a80fc010 msgr2=0x7fc1a8105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:27.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.246+0000 7fc1aec83640 1 -- 172.21.15.78:0/720261640 shutdown_connections 2024-09-18T12:42:27.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:27.246+0000 7fc1aec83640 1 -- 172.21.15.78:0/720261640 wait complete. 2024-09-18T12:42:27.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:42:27.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:42:27.602 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:28.571 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:28 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/720261640' entity='client.admin' 2024-09-18T12:42:28.571 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:28 smithi078 ceph-mon[28091]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:28.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.573+0000 7f16eb0bf640 1 -- 172.21.15.78:0/2813193487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4100880 msgr2=0x7f16e4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.573+0000 7f16eb0bf640 1 --2- 172.21.15.78:0/2813193487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4100880 0x7f16e4100c80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009880 tx=0x7f16d802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:42:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.573+0000 7f16eb0bf640 1 -- 172.21.15.78:0/2813193487 shutdown_connections 2024-09-18T12:42:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.573+0000 7f16eb0bf640 1 --2- 172.21.15.78:0/2813193487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e4101a80 0x7f16e4101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.573+0000 7f16eb0bf640 1 --2- 172.21.15.78:0/2813193487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4100880 0x7f16e4100c80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.573+0000 7f16eb0bf640 1 -- 172.21.15.78:0/2813193487 >> 172.21.15.78:0/2813193487 conn(0x7f16e40fc010 msgr2=0x7f16e40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.573+0000 7f16eb0bf640 1 -- 172.21.15.78:0/2813193487 shutdown_connections 2024-09-18T12:42:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.573+0000 7f16eb0bf640 1 -- 172.21.15.78:0/2813193487 wait complete. 2024-09-18T12:42:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.574+0000 7f16eb0bf640 1 Processor -- start 2024-09-18T12:42:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.574+0000 7f16eb0bf640 1 -- start start 2024-09-18T12:42:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.574+0000 7f16eb0bf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4100880 0x7f16e4197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.574+0000 7f16eb0bf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e4101a80 0x7f16e4197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:28.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.574+0000 7f16eb0bf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f16e4109560 con 0x7f16e4100880 2024-09-18T12:42:28.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.574+0000 7f16eb0bf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f16e41093e0 con 0x7f16e4101a80 2024-09-18T12:42:28.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.574+0000 7f16e8e5b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4100880 0x7f16e4197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:28.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.574+0000 7f16e8e5b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4100880 0x7f16e4197450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40072/0 (socket says 172.21.15.78:40072) 2024-09-18T12:42:28.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.574+0000 7f16e8e5b640 1 -- 172.21.15.78:0/1967429735 learned_addr learned my addr 172.21.15.78:0/1967429735 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:42:28.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.574+0000 7f16e3fff640 1 --2- 172.21.15.78:0/1967429735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e4101a80 0x7f16e4197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:28.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.574+0000 7f16e8e5b640 1 -- 172.21.15.78:0/1967429735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e4101a80 msgr2=0x7f16e4197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:28.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.574+0000 7f16e8e5b640 1 --2- 172.21.15.78:0/1967429735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e4101a80 0x7f16e4197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:28.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.574+0000 7f16e8e5b640 1 -- 172.21.15.78:0/1967429735 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e4198010 con 0x7f16e4100880 2024-09-18T12:42:28.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.574+0000 7f16e8e5b640 1 --2- 172.21.15.78:0/1967429735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4100880 0x7f16e4197450 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009230 tx=0x7f16d80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:28.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.574+0000 7f16e1ffb640 1 -- 172.21.15.78:0/1967429735 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16d803f070 con 0x7f16e4100880 2024-09-18T12:42:28.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.575+0000 7f16e1ffb640 1 -- 172.21.15.78:0/1967429735 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f16d8003a90 con 0x7f16e4100880 2024-09-18T12:42:28.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.575+0000 7f16e1ffb640 1 -- 172.21.15.78:0/1967429735 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16d8035030 con 0x7f16e4100880 2024-09-18T12:42:28.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.575+0000 7f16eb0bf640 1 -- 172.21.15.78:0/1967429735 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e419c9f0 con 0x7f16e4100880 2024-09-18T12:42:28.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.575+0000 7f16eb0bf640 1 -- 172.21.15.78:0/1967429735 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e419d000 con 0x7f16e4100880 2024-09-18T12:42:28.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.576+0000 7f16eb0bf640 1 -- 172.21.15.78:0/1967429735 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e4109d40 con 0x7f16e4100880 2024-09-18T12:42:28.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.576+0000 7f16e1ffb640 1 -- 172.21.15.78:0/1967429735 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f16d8042070 con 0x7f16e4100880 2024-09-18T12:42:28.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.577+0000 7f16e1ffb640 1 --2- 172.21.15.78:0/1967429735 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f16d406e280 0x7f16d4070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:28.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.577+0000 7f16e1ffb640 1 -- 172.21.15.78:0/1967429735 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f16d80adaf0 con 0x7f16e4100880 2024-09-18T12:42:28.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.577+0000 7f16e3fff640 1 --2- 172.21.15.78:0/1967429735 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f16d406e280 0x7f16d4070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:28.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.577+0000 7f16e3fff640 1 --2- 172.21.15.78:0/1967429735 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f16d406e280 0x7f16d4070740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f16e4198900 tx=0x7f16d000a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:28.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.581+0000 7f16e1ffb640 1 -- 172.21.15.78:0/1967429735 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16d8080260 con 0x7f16e4100880 2024-09-18T12:42:28.591 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:28 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/720261640' entity='client.admin' 2024-09-18T12:42:28.591 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:28 smithi148 ceph-mon[35352]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.750+0000 7f16eb0bf640 1 -- 172.21.15.78:0/1967429735 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f16e419d320 con 0x7f16e4100880 2024-09-18T12:42:28.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.753+0000 7f16e1ffb640 1 -- 172.21.15.78:0/1967429735 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v24)=0 v24) ==== 125+0+0 (secure 0 0 0) 0x7f16d8084a90 con 0x7f16e4100880 2024-09-18T12:42:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.755+0000 7f16eb0bf640 1 -- 172.21.15.78:0/1967429735 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f16d406e280 msgr2=0x7f16d4070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.755+0000 7f16eb0bf640 1 --2- 172.21.15.78:0/1967429735 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f16d406e280 0x7f16d4070740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f16e4198900 tx=0x7f16d000a2d0 comp rx=0 tx=0).stop 2024-09-18T12:42:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.755+0000 7f16eb0bf640 1 -- 172.21.15.78:0/1967429735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4100880 msgr2=0x7f16e4197450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.755+0000 7f16eb0bf640 1 --2- 172.21.15.78:0/1967429735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4100880 0x7f16e4197450 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009230 tx=0x7f16d80048f0 comp rx=0 tx=0).stop 2024-09-18T12:42:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.755+0000 7f16eb0bf640 1 -- 172.21.15.78:0/1967429735 shutdown_connections 2024-09-18T12:42:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.755+0000 7f16eb0bf640 1 --2- 172.21.15.78:0/1967429735 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f16d406e280 0x7f16d4070740 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.755+0000 7f16eb0bf640 1 --2- 172.21.15.78:0/1967429735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16e4101a80 0x7f16e4197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.755+0000 7f16eb0bf640 1 --2- 172.21.15.78:0/1967429735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4100880 0x7f16e4197450 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.755+0000 7f16eb0bf640 1 -- 172.21.15.78:0/1967429735 >> 172.21.15.78:0/1967429735 conn(0x7f16e40fc010 msgr2=0x7f16e406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.756+0000 7f16eb0bf640 1 -- 172.21.15.78:0/1967429735 shutdown_connections 2024-09-18T12:42:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:28.756+0000 7f16eb0bf640 1 -- 172.21.15.78:0/1967429735 wait complete. 2024-09-18T12:42:29.626 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:29.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:29 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1967429735' entity='client.admin' 2024-09-18T12:42:29.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:29 smithi078 ceph-mon[28091]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:30.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:29 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1967429735' entity='client.admin' 2024-09-18T12:42:30.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:29 smithi148 ceph-mon[35352]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:30.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.288+0000 7eff491d7640 1 -- 172.21.15.78:0/406695664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff44101a60 msgr2=0x7eff44101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.288+0000 7eff491d7640 1 --2- 172.21.15.78:0/406695664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff44101a60 0x7eff44101ee0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7eff38009880 tx=0x7eff3802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:42:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.288+0000 7eff491d7640 1 -- 172.21.15.78:0/406695664 shutdown_connections 2024-09-18T12:42:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.288+0000 7eff491d7640 1 --2- 172.21.15.78:0/406695664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff44101a60 0x7eff44101ee0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.288+0000 7eff491d7640 1 --2- 172.21.15.78:0/406695664 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff44100860 0x7eff44100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.288+0000 7eff491d7640 1 -- 172.21.15.78:0/406695664 >> 172.21.15.78:0/406695664 conn(0x7eff440fc010 msgr2=0x7eff440fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.288+0000 7eff491d7640 1 -- 172.21.15.78:0/406695664 shutdown_connections 2024-09-18T12:42:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.288+0000 7eff491d7640 1 -- 172.21.15.78:0/406695664 wait complete. 2024-09-18T12:42:30.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.289+0000 7eff491d7640 1 Processor -- start 2024-09-18T12:42:30.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.289+0000 7eff491d7640 1 -- start start 2024-09-18T12:42:30.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.289+0000 7eff491d7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff44100860 0x7eff4406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:30.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.289+0000 7eff491d7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff44101a60 0x7eff4419c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:30.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.289+0000 7eff491d7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7eff441095e0 con 0x7eff44101a60 2024-09-18T12:42:30.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.289+0000 7eff491d7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7eff44109460 con 0x7eff44100860 2024-09-18T12:42:30.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.289+0000 7eff4259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff44101a60 0x7eff4419c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:30.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.289+0000 7eff4259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff44101a60 0x7eff4419c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40088/0 (socket says 172.21.15.78:40088) 2024-09-18T12:42:30.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.289+0000 7eff4259c640 1 -- 172.21.15.78:0/3647309956 learned_addr learned my addr 172.21.15.78:0/3647309956 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:42:30.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.290+0000 7eff42d9d640 1 --2- 172.21.15.78:0/3647309956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff44100860 0x7eff4406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:30.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.290+0000 7eff4259c640 1 -- 172.21.15.78:0/3647309956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff44100860 msgr2=0x7eff4406a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:30.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.290+0000 7eff4259c640 1 --2- 172.21.15.78:0/3647309956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff44100860 0x7eff4406a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:30.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.290+0000 7eff4259c640 1 -- 172.21.15.78:0/3647309956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4419c7f0 con 0x7eff44101a60 2024-09-18T12:42:30.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.290+0000 7eff4259c640 1 --2- 172.21.15.78:0/3647309956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff44101a60 0x7eff4419c200 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7eff38009230 tx=0x7eff380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:30.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.290+0000 7eff2bfff640 1 -- 172.21.15.78:0/3647309956 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff3803f070 con 0x7eff44101a60 2024-09-18T12:42:30.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.290+0000 7eff491d7640 1 -- 172.21.15.78:0/3647309956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4419ca80 con 0x7eff44101a60 2024-09-18T12:42:30.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.290+0000 7eff2bfff640 1 -- 172.21.15.78:0/3647309956 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7eff38003a90 con 0x7eff44101a60 2024-09-18T12:42:30.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.290+0000 7eff2bfff640 1 -- 172.21.15.78:0/3647309956 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff38035030 con 0x7eff44101a60 2024-09-18T12:42:30.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.290+0000 7eff491d7640 1 -- 172.21.15.78:0/3647309956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff4419d030 con 0x7eff44101a60 2024-09-18T12:42:30.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.291+0000 7eff491d7640 1 -- 172.21.15.78:0/3647309956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff44109dc0 con 0x7eff44101a60 2024-09-18T12:42:30.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.292+0000 7eff2bfff640 1 -- 172.21.15.78:0/3647309956 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7eff38042070 con 0x7eff44101a60 2024-09-18T12:42:30.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.292+0000 7eff2bfff640 1 --2- 172.21.15.78:0/3647309956 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7eff2c06e280 0x7eff2c070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:30.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.292+0000 7eff2bfff640 1 -- 172.21.15.78:0/3647309956 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7eff380adc50 con 0x7eff44101a60 2024-09-18T12:42:30.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.292+0000 7eff42d9d640 1 --2- 172.21.15.78:0/3647309956 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7eff2c06e280 0x7eff2c070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:30.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.293+0000 7eff42d9d640 1 --2- 172.21.15.78:0/3647309956 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7eff2c06e280 0x7eff2c070740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7eff441018c0 tx=0x7eff34008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:30.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.296+0000 7eff2bfff640 1 -- 172.21.15.78:0/3647309956 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff380b3020 con 0x7eff44101a60 2024-09-18T12:42:30.364 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:30.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.477+0000 7eff491d7640 1 -- 172.21.15.78:0/3647309956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7eff4402d8d0 con 0x7eff44101a60 2024-09-18T12:42:30.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.480+0000 7eff2bfff640 1 -- 172.21.15.78:0/3647309956 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7eff38005490 con 0x7eff44101a60 2024-09-18T12:42:30.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.483+0000 7eff491d7640 1 -- 172.21.15.78:0/3647309956 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7eff2c06e280 msgr2=0x7eff2c070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:30.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.483+0000 7eff491d7640 1 --2- 172.21.15.78:0/3647309956 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7eff2c06e280 0x7eff2c070740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7eff441018c0 tx=0x7eff34008040 comp rx=0 tx=0).stop 2024-09-18T12:42:30.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.483+0000 7eff491d7640 1 -- 172.21.15.78:0/3647309956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff44101a60 msgr2=0x7eff4419c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:30.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.483+0000 7eff491d7640 1 --2- 172.21.15.78:0/3647309956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff44101a60 0x7eff4419c200 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7eff38009230 tx=0x7eff380048f0 comp rx=0 tx=0).stop 2024-09-18T12:42:30.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.483+0000 7eff491d7640 1 -- 172.21.15.78:0/3647309956 shutdown_connections 2024-09-18T12:42:30.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.483+0000 7eff491d7640 1 --2- 172.21.15.78:0/3647309956 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7eff2c06e280 0x7eff2c070740 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:30.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.483+0000 7eff491d7640 1 --2- 172.21.15.78:0/3647309956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff44101a60 0x7eff4419c200 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:30.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.483+0000 7eff491d7640 1 --2- 172.21.15.78:0/3647309956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff44100860 0x7eff4406a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:30.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.483+0000 7eff491d7640 1 -- 172.21.15.78:0/3647309956 >> 172.21.15.78:0/3647309956 conn(0x7eff440fc010 msgr2=0x7eff44105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:30.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.483+0000 7eff491d7640 1 -- 172.21.15.78:0/3647309956 shutdown_connections 2024-09-18T12:42:30.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:30.484+0000 7eff491d7640 1 -- 172.21.15.78:0/3647309956 wait complete. 2024-09-18T12:42:31.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:31 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3647309956' entity='client.admin' 2024-09-18T12:42:31.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:31 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/3647309956' entity='client.admin' 2024-09-18T12:42:32.793 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:32 smithi078 ceph-mon[28091]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:32.793 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:32 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:32.793 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:32 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:32.793 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:32 smithi078 ceph-mon[28091]: Reconfiguring ceph-exporter.smithi078 (monmap changed)... 2024-09-18T12:42:32.793 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:32 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi078", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:42:32.793 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:32 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:32.793 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:32 smithi078 ceph-mon[28091]: Reconfiguring daemon ceph-exporter.smithi078 on smithi078 2024-09-18T12:42:32.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:32 smithi148 ceph-mon[35352]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:32.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:32 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:32.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:32 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:32.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:32 smithi148 ceph-mon[35352]: Reconfiguring ceph-exporter.smithi078 (monmap changed)... 2024-09-18T12:42:32.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:32 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi078", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:42:32.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:32 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:32.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:32 smithi148 ceph-mon[35352]: Reconfiguring daemon ceph-exporter.smithi078 on smithi078 2024-09-18T12:42:33.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.586+0000 7f0cf7110640 1 -- 172.21.15.78:0/3661201728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cf0101a60 msgr2=0x7f0cf0101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:33.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.586+0000 7f0cf7110640 1 --2- 172.21.15.78:0/3661201728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cf0101a60 0x7f0cf0101ee0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009880 tx=0x7f0cdc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:42:33.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.586+0000 7f0cf7110640 1 -- 172.21.15.78:0/3661201728 shutdown_connections 2024-09-18T12:42:33.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.586+0000 7f0cf7110640 1 --2- 172.21.15.78:0/3661201728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cf0101a60 0x7f0cf0101ee0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:33.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.586+0000 7f0cf7110640 1 --2- 172.21.15.78:0/3661201728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cf0100860 0x7f0cf0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:33.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.586+0000 7f0cf7110640 1 -- 172.21.15.78:0/3661201728 >> 172.21.15.78:0/3661201728 conn(0x7f0cf00fc010 msgr2=0x7f0cf00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:33.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.586+0000 7f0cf7110640 1 -- 172.21.15.78:0/3661201728 shutdown_connections 2024-09-18T12:42:33.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.586+0000 7f0cf7110640 1 -- 172.21.15.78:0/3661201728 wait complete. 2024-09-18T12:42:33.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.587+0000 7f0cf7110640 1 Processor -- start 2024-09-18T12:42:33.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.587+0000 7f0cf7110640 1 -- start start 2024-09-18T12:42:33.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.587+0000 7f0cf7110640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cf0100860 0x7f0cf0197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:33.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.587+0000 7f0cf7110640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cf0101a60 0x7f0cf0197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:33.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.587+0000 7f0cf7110640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf01095e0 con 0x7f0cf0100860 2024-09-18T12:42:33.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.587+0000 7f0cf7110640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf0109460 con 0x7f0cf0101a60 2024-09-18T12:42:33.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.587+0000 7f0cf4eac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cf0100860 0x7f0cf0197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:33.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.587+0000 7f0cf4eac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cf0100860 0x7f0cf0197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39622/0 (socket says 172.21.15.78:39622) 2024-09-18T12:42:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.587+0000 7f0cf4eac640 1 -- 172.21.15.78:0/2612987780 learned_addr learned my addr 172.21.15.78:0/2612987780 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:42:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.587+0000 7f0ceffff640 1 --2- 172.21.15.78:0/2612987780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cf0101a60 0x7f0cf0197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.588+0000 7f0cf4eac640 1 -- 172.21.15.78:0/2612987780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cf0101a60 msgr2=0x7f0cf0197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.588+0000 7f0cf4eac640 1 --2- 172.21.15.78:0/2612987780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cf0101a60 0x7f0cf0197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.588+0000 7f0cf4eac640 1 -- 172.21.15.78:0/2612987780 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf0198100 con 0x7f0cf0100860 2024-09-18T12:42:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.588+0000 7f0cf4eac640 1 --2- 172.21.15.78:0/2612987780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cf0100860 0x7f0cf0197540 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400b3d0 tx=0x7f0ce400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.588+0000 7f0cedffb640 1 -- 172.21.15.78:0/2612987780 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ce4015020 con 0x7f0cf0100860 2024-09-18T12:42:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.588+0000 7f0cf7110640 1 -- 172.21.15.78:0/2612987780 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf019cb40 con 0x7f0cf0100860 2024-09-18T12:42:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.588+0000 7f0cedffb640 1 -- 172.21.15.78:0/2612987780 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f0ce4011ad0 con 0x7f0cf0100860 2024-09-18T12:42:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.588+0000 7f0cedffb640 1 -- 172.21.15.78:0/2612987780 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ce4010ca0 con 0x7f0cf0100860 2024-09-18T12:42:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.588+0000 7f0cf7110640 1 -- 172.21.15.78:0/2612987780 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf019d0d0 con 0x7f0cf0100860 2024-09-18T12:42:33.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.589+0000 7f0cf7110640 1 -- 172.21.15.78:0/2612987780 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cf0109dc0 con 0x7f0cf0100860 2024-09-18T12:42:33.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.590+0000 7f0cedffb640 1 -- 172.21.15.78:0/2612987780 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f0ce4018020 con 0x7f0cf0100860 2024-09-18T12:42:33.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.590+0000 7f0cedffb640 1 --2- 172.21.15.78:0/2612987780 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f0ce006e240 0x7f0ce0070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:33.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.590+0000 7f0cedffb640 1 -- 172.21.15.78:0/2612987780 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0ce408caf0 con 0x7f0cf0100860 2024-09-18T12:42:33.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.590+0000 7f0ceffff640 1 --2- 172.21.15.78:0/2612987780 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f0ce006e240 0x7f0ce0070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:33.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.591+0000 7f0ceffff640 1 --2- 172.21.15.78:0/2612987780 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f0ce006e240 0x7f0ce0070700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0cf01989f0 tx=0x7f0cdc004ea0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:33.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.598+0000 7f0cedffb640 1 -- 172.21.15.78:0/2612987780 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0ce401f020 con 0x7f0cf0100860 2024-09-18T12:42:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.774+0000 7f0cf7110640 1 -- 172.21.15.78:0/2612987780 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f0cf019d360 con 0x7f0cf0100860 2024-09-18T12:42:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.777+0000 7f0cedffb640 1 -- 172.21.15.78:0/2612987780 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v26)=0 v26) ==== 120+0+0 (secure 0 0 0) 0x7f0cf019d360 con 0x7f0cf0100860 2024-09-18T12:42:33.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.779+0000 7f0cf7110640 1 -- 172.21.15.78:0/2612987780 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f0ce006e240 msgr2=0x7f0ce0070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:33.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.779+0000 7f0cf7110640 1 --2- 172.21.15.78:0/2612987780 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f0ce006e240 0x7f0ce0070700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0cf01989f0 tx=0x7f0cdc004ea0 comp rx=0 tx=0).stop 2024-09-18T12:42:33.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.780+0000 7f0cf7110640 1 -- 172.21.15.78:0/2612987780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cf0100860 msgr2=0x7f0cf0197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:33.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.780+0000 7f0cf7110640 1 --2- 172.21.15.78:0/2612987780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cf0100860 0x7f0cf0197540 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400b3d0 tx=0x7f0ce400b890 comp rx=0 tx=0).stop 2024-09-18T12:42:33.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.780+0000 7f0cf7110640 1 -- 172.21.15.78:0/2612987780 shutdown_connections 2024-09-18T12:42:33.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.780+0000 7f0cf7110640 1 --2- 172.21.15.78:0/2612987780 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f0ce006e240 0x7f0ce0070700 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:33.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.780+0000 7f0cf7110640 1 --2- 172.21.15.78:0/2612987780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0cf0101a60 0x7f0cf0197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:33.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.780+0000 7f0cf7110640 1 --2- 172.21.15.78:0/2612987780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cf0100860 0x7f0cf0197540 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:33.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.780+0000 7f0cf7110640 1 -- 172.21.15.78:0/2612987780 >> 172.21.15.78:0/2612987780 conn(0x7f0cf00fc010 msgr2=0x7f0cf0069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:33.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.780+0000 7f0cf7110640 1 -- 172.21.15.78:0/2612987780 shutdown_connections 2024-09-18T12:42:33.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.780+0000 7f0cf7110640 1 -- 172.21.15.78:0/2612987780 wait complete. 2024-09-18T12:42:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:34 smithi078 ceph-mon[28091]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:34 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2612987780' entity='client.admin' 2024-09-18T12:42:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:34 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1037154237' entity='client.admin' 2024-09-18T12:42:34.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:34 smithi148 ceph-mon[35352]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:34.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:34 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2612987780' entity='client.admin' 2024-09-18T12:42:34.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:34 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1037154237' entity='client.admin' 2024-09-18T12:42:35.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.177+0000 7f6eef4b9640 1 -- 172.21.15.78:0/992312029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ee8104d20 msgr2=0x7f6ee8107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:35.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.177+0000 7f6eef4b9640 1 --2- 172.21.15.78:0/992312029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ee8104d20 0x7f6ee8107110 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80098b0 tx=0x7f6ed802a4d0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.177+0000 7f6eef4b9640 1 -- 172.21.15.78:0/992312029 shutdown_connections 2024-09-18T12:42:35.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.177+0000 7f6eef4b9640 1 --2- 172.21.15.78:0/992312029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ee8104d20 0x7f6ee8107110 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.177+0000 7f6eef4b9640 1 --2- 172.21.15.78:0/992312029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ee81023f0 0x7f6ee81047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.177+0000 7f6eef4b9640 1 -- 172.21.15.78:0/992312029 >> 172.21.15.78:0/992312029 conn(0x7f6ee80fc010 msgr2=0x7f6ee80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:35.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.177+0000 7f6eef4b9640 1 -- 172.21.15.78:0/992312029 shutdown_connections 2024-09-18T12:42:35.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.177+0000 7f6eef4b9640 1 -- 172.21.15.78:0/992312029 wait complete. 2024-09-18T12:42:35.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.178+0000 7f6eef4b9640 1 Processor -- start 2024-09-18T12:42:35.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.178+0000 7f6eef4b9640 1 -- start start 2024-09-18T12:42:35.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.178+0000 7f6eef4b9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ee81023f0 0x7f6ee8101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:35.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.178+0000 7f6eef4b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ee8104d20 0x7f6ee81003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:35.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.178+0000 7f6eef4b9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810a810 con 0x7f6ee8104d20 2024-09-18T12:42:35.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.178+0000 7f6eef4b9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810a690 con 0x7f6ee81023f0 2024-09-18T12:42:35.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.178+0000 7f6eeca54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ee8104d20 0x7f6ee81003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:35.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.178+0000 7f6eeca54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ee8104d20 0x7f6ee81003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39658/0 (socket says 172.21.15.78:39658) 2024-09-18T12:42:35.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.178+0000 7f6eeca54640 1 -- 172.21.15.78:0/1888371517 learned_addr learned my addr 172.21.15.78:0/1888371517 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:42:35.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.178+0000 7f6eed255640 1 --2- 172.21.15.78:0/1888371517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ee81023f0 0x7f6ee8101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:35.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.178+0000 7f6eeca54640 1 -- 172.21.15.78:0/1888371517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ee81023f0 msgr2=0x7f6ee8101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:35.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.178+0000 7f6eeca54640 1 --2- 172.21.15.78:0/1888371517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ee81023f0 0x7f6ee8101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.178+0000 7f6eeca54640 1 -- 172.21.15.78:0/1888371517 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee81008e0 con 0x7f6ee8104d20 2024-09-18T12:42:35.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.179+0000 7f6eeca54640 1 --2- 172.21.15.78:0/1888371517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ee8104d20 0x7f6ee81003a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009230 tx=0x7f6ed80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:35.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.179+0000 7f6ede7fc640 1 -- 172.21.15.78:0/1888371517 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ed803f070 con 0x7f6ee8104d20 2024-09-18T12:42:35.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.179+0000 7f6ede7fc640 1 -- 172.21.15.78:0/1888371517 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ed80044d0 con 0x7f6ee8104d20 2024-09-18T12:42:35.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.179+0000 7f6eef4b9640 1 -- 172.21.15.78:0/1888371517 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee8100b70 con 0x7f6ee8104d20 2024-09-18T12:42:35.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.179+0000 7f6ede7fc640 1 -- 172.21.15.78:0/1888371517 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ed8035030 con 0x7f6ee8104d20 2024-09-18T12:42:35.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.179+0000 7f6eef4b9640 1 -- 172.21.15.78:0/1888371517 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee8101120 con 0x7f6ee8104d20 2024-09-18T12:42:35.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.180+0000 7f6eef4b9640 1 -- 172.21.15.78:0/1888371517 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee81027d0 con 0x7f6ee8104d20 2024-09-18T12:42:35.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.180+0000 7f6ede7fc640 1 -- 172.21.15.78:0/1888371517 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f6ed8042070 con 0x7f6ee8104d20 2024-09-18T12:42:35.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.181+0000 7f6ede7fc640 1 --2- 172.21.15.78:0/1888371517 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f6ed406e280 0x7f6ed4070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:35.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.181+0000 7f6eed255640 1 --2- 172.21.15.78:0/1888371517 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f6ed406e280 0x7f6ed4070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:35.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.181+0000 7f6ede7fc640 1 -- 172.21.15.78:0/1888371517 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6ed80adaf0 con 0x7f6ee8104d20 2024-09-18T12:42:35.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.181+0000 7f6eed255640 1 --2- 172.21.15.78:0/1888371517 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f6ed406e280 0x7f6ed4070740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009990 tx=0x7f6ee4009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:35.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.185+0000 7f6ede7fc640 1 -- 172.21.15.78:0/1888371517 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6ed807c5b0 con 0x7f6ee8104d20 2024-09-18T12:42:35.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.960+0000 7fc2339fc640 1 -- 172.21.15.78:0/1959072621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c100860 msgr2=0x7fc22c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.960+0000 7fc2339fc640 1 --2- 172.21.15.78:0/1959072621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c100860 0x7fc22c100c60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc228009880 tx=0x7fc22802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.960+0000 7fc2339fc640 1 -- 172.21.15.78:0/1959072621 shutdown_connections 2024-09-18T12:42:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.960+0000 7fc2339fc640 1 --2- 172.21.15.78:0/1959072621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc22c101a60 0x7fc22c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.960+0000 7fc2339fc640 1 --2- 172.21.15.78:0/1959072621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c100860 0x7fc22c100c60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.960+0000 7fc2339fc640 1 -- 172.21.15.78:0/1959072621 >> 172.21.15.78:0/1959072621 conn(0x7fc22c0fc010 msgr2=0x7fc22c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.961+0000 7fc2339fc640 1 -- 172.21.15.78:0/1959072621 shutdown_connections 2024-09-18T12:42:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.961+0000 7fc2339fc640 1 -- 172.21.15.78:0/1959072621 wait complete. 2024-09-18T12:42:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.961+0000 7fc2339fc640 1 Processor -- start 2024-09-18T12:42:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.961+0000 7fc2339fc640 1 -- start start 2024-09-18T12:42:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.961+0000 7fc2339fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc22c100860 0x7fc22c1952d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.961+0000 7fc2339fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c101a60 0x7fc22c195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.961+0000 7fc2339fc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c1084b0 con 0x7fc22c101a60 2024-09-18T12:42:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.961+0000 7fc2339fc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c108330 con 0x7fc22c100860 2024-09-18T12:42:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.961+0000 7fc230f97640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c101a60 0x7fc22c195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.961+0000 7fc230f97640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c101a60 0x7fc22c195810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39636/0 (socket says 172.21.15.78:39636) 2024-09-18T12:42:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.961+0000 7fc230f97640 1 -- 172.21.15.78:0/1037154237 learned_addr learned my addr 172.21.15.78:0/1037154237 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:42:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.962+0000 7fc231798640 1 --2- 172.21.15.78:0/1037154237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc22c100860 0x7fc22c1952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.962+0000 7fc230f97640 1 -- 172.21.15.78:0/1037154237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc22c100860 msgr2=0x7fc22c1952d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.962+0000 7fc230f97640 1 --2- 172.21.15.78:0/1037154237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc22c100860 0x7fc22c1952d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.962+0000 7fc230f97640 1 -- 172.21.15.78:0/1037154237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c195e90 con 0x7fc22c101a60 2024-09-18T12:42:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.962+0000 7fc231798640 1 --2- 172.21.15.78:0/1037154237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc22c100860 0x7fc22c1952d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:42:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.962+0000 7fc230f97640 1 --2- 172.21.15.78:0/1037154237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c101a60 0x7fc22c195810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00b420 tx=0x7fc21c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.962+0000 7fc2227fc640 1 -- 172.21.15.78:0/1037154237 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc21c011630 con 0x7fc22c101a60 2024-09-18T12:42:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.962+0000 7fc2227fc640 1 -- 172.21.15.78:0/1037154237 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fc21c016070 con 0x7fc22c101a60 2024-09-18T12:42:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.962+0000 7fc2227fc640 1 -- 172.21.15.78:0/1037154237 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc21c010c90 con 0x7fc22c101a60 2024-09-18T12:42:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.962+0000 7fc2339fc640 1 -- 172.21.15.78:0/1037154237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22c19a8d0 con 0x7fc22c101a60 2024-09-18T12:42:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.962+0000 7fc2339fc640 1 -- 172.21.15.78:0/1037154237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc22c19aee0 con 0x7fc22c101a60 2024-09-18T12:42:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.963+0000 7fc2339fc640 1 -- 172.21.15.78:0/1037154237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc22c108c90 con 0x7fc22c101a60 2024-09-18T12:42:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.964+0000 7fc2227fc640 1 -- 172.21.15.78:0/1037154237 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fc21c0117d0 con 0x7fc22c101a60 2024-09-18T12:42:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.964+0000 7fc2227fc640 1 --2- 172.21.15.78:0/1037154237 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc218070430 0x7fc2180728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.964+0000 7fc2227fc640 1 -- 172.21.15.78:0/1037154237 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc21c08c9c0 con 0x7fc22c101a60 2024-09-18T12:42:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.964+0000 7fc231798640 1 --2- 172.21.15.78:0/1037154237 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc218070430 0x7fc2180728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.964+0000 7fc231798640 1 --2- 172.21.15.78:0/1037154237 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc218070430 0x7fc2180728f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc2280096c0 tx=0x7fc228000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:33.968+0000 7fc2227fc640 1 -- 172.21.15.78:0/1037154237 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc21c00e260 con 0x7fc22c101a60 2024-09-18T12:42:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:34.135+0000 7fc2339fc640 1 -- 172.21.15.78:0/1037154237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fc22c02d970 con 0x7fc22c101a60 2024-09-18T12:42:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:34.139+0000 7fc2227fc640 1 -- 172.21.15.78:0/1037154237 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v27)=0 v27) ==== 123+0+0 (secure 0 0 0) 0x7fc21c05b360 con 0x7fc22c101a60 2024-09-18T12:42:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:34.140+0000 7fc2227fc640 1 -- 172.21.15.78:0/1037154237 <== mon.0 v2:172.21.15.78:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc21c092080 con 0x7fc22c101a60 2024-09-18T12:42:35.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:34.141+0000 7fc2339fc640 1 -- 172.21.15.78:0/1037154237 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc218070430 msgr2=0x7fc2180728f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:35.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:34.141+0000 7fc2339fc640 1 --2- 172.21.15.78:0/1037154237 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc218070430 0x7fc2180728f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc2280096c0 tx=0x7fc228000bc0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:34.141+0000 7fc2339fc640 1 -- 172.21.15.78:0/1037154237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c101a60 msgr2=0x7fc22c195810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:35.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:34.141+0000 7fc2339fc640 1 --2- 172.21.15.78:0/1037154237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c101a60 0x7fc22c195810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00b420 tx=0x7fc21c00b8e0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:34.141+0000 7fc2339fc640 1 -- 172.21.15.78:0/1037154237 shutdown_connections 2024-09-18T12:42:35.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:34.141+0000 7fc2339fc640 1 --2- 172.21.15.78:0/1037154237 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc218070430 0x7fc2180728f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:34.141+0000 7fc2339fc640 1 --2- 172.21.15.78:0/1037154237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c101a60 0x7fc22c195810 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:34.141+0000 7fc2339fc640 1 --2- 172.21.15.78:0/1037154237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc22c100860 0x7fc22c1952d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:34.141+0000 7fc2339fc640 1 -- 172.21.15.78:0/1037154237 >> 172.21.15.78:0/1037154237 conn(0x7fc22c0fc010 msgr2=0x7fc22c105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:35.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:34.141+0000 7fc2339fc640 1 -- 172.21.15.78:0/1037154237 shutdown_connections 2024-09-18T12:42:35.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:34.141+0000 7fc2339fc640 1 -- 172.21.15.78:0/1037154237 wait complete. 2024-09-18T12:42:35.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.358+0000 7f6eef4b9640 1 -- 172.21.15.78:0/1888371517 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f6ee819f840 con 0x7f6ee8104d20 2024-09-18T12:42:35.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.361+0000 7f6ede7fc640 1 -- 172.21.15.78:0/1888371517 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f6ed8080260 con 0x7f6ee8104d20 2024-09-18T12:42:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.364+0000 7f6eef4b9640 1 -- 172.21.15.78:0/1888371517 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f6ed406e280 msgr2=0x7f6ed4070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.364+0000 7f6eef4b9640 1 --2- 172.21.15.78:0/1888371517 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f6ed406e280 0x7f6ed4070740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009990 tx=0x7f6ee4009110 comp rx=0 tx=0).stop 2024-09-18T12:42:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.364+0000 7f6eef4b9640 1 -- 172.21.15.78:0/1888371517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ee8104d20 msgr2=0x7f6ee81003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.364+0000 7f6eef4b9640 1 --2- 172.21.15.78:0/1888371517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ee8104d20 0x7f6ee81003a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009230 tx=0x7f6ed80048f0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.364+0000 7f6eef4b9640 1 -- 172.21.15.78:0/1888371517 shutdown_connections 2024-09-18T12:42:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.364+0000 7f6eef4b9640 1 --2- 172.21.15.78:0/1888371517 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f6ed406e280 0x7f6ed4070740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.364+0000 7f6eef4b9640 1 --2- 172.21.15.78:0/1888371517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ee8104d20 0x7f6ee81003a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.364+0000 7f6eef4b9640 1 --2- 172.21.15.78:0/1888371517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ee81023f0 0x7f6ee8101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:35.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.364+0000 7f6eef4b9640 1 -- 172.21.15.78:0/1888371517 >> 172.21.15.78:0/1888371517 conn(0x7f6ee80fc010 msgr2=0x7f6ee80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:35.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.364+0000 7f6eef4b9640 1 -- 172.21.15.78:0/1888371517 shutdown_connections 2024-09-18T12:42:35.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:35.364+0000 7f6eef4b9640 1 -- 172.21.15.78:0/1888371517 wait complete. 2024-09-18T12:42:35.924 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-18T12:42:35.924 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi078') 2024-09-18T12:42:35.925 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi078') 2024-09-18T12:42:35.925 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi078') 2024-09-18T12:42:35.925 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi078') 2024-09-18T12:42:35.925 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi078') 2024-09-18T12:42:35.925 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi078') 2024-09-18T12:42:35.925 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi078') 2024-09-18T12:42:35.925 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi078') 2024-09-18T12:42:35.926 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-18T12:42:35.926 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-18T12:42:35.926 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi078') 2024-09-18T12:42:35.926 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi078') 2024-09-18T12:42:35.926 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ecc0857e-75ba-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi078') 2024-09-18T12:42:36.472 INFO:tasks.cephadm:Deploying OSDs... 2024-09-18T12:42:36.472 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:42:36.473 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T12:42:36.490 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T12:42:36.491 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2024-09-18T12:42:36.548 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T12:42:36.548 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:42:36.548 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-18T12:42:36.548 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:42:36.548 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:42:36.548 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-18 12:41:34.933006641 +0000 2024-09-18T12:42:36.548 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-18 12:35:59.594596511 +0000 2024-09-18T12:42:36.548 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-18 12:35:59.594596511 +0000 2024-09-18T12:42:36.549 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-18 12:35:59.594596511 +0000 2024-09-18T12:42:36.549 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T12:42:36.611 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:36 smithi078 ceph-mon[28091]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:36.611 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:36 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1888371517' entity='client.admin' 2024-09-18T12:42:36.614 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-18T12:42:36.614 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-18T12:42:36.615 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.00026916 s, 1.9 MB/s 2024-09-18T12:42:36.616 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T12:42:36.674 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2024-09-18T12:42:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:36 smithi148 ceph-mon[35352]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:36 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1888371517' entity='client.admin' 2024-09-18T12:42:36.730 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T12:42:36.730 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:42:36.730 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-18T12:42:36.730 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:42:36.730 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:42:36.730 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-18 12:41:34.933006641 +0000 2024-09-18T12:42:36.730 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-18 12:35:59.920591650 +0000 2024-09-18T12:42:36.730 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-18 12:35:59.920591650 +0000 2024-09-18T12:42:36.730 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-18 12:35:59.920591650 +0000 2024-09-18T12:42:36.731 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T12:42:36.794 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-18T12:42:36.794 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-18T12:42:36.794 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.00019798 s, 2.6 MB/s 2024-09-18T12:42:36.795 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T12:42:36.853 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2024-09-18T12:42:36.911 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T12:42:36.911 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:42:36.911 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-18T12:42:36.911 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:42:36.911 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:42:36.911 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-18 12:41:34.934006625 +0000 2024-09-18T12:42:36.911 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-18 12:36:00.251586715 +0000 2024-09-18T12:42:36.912 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-18 12:36:00.251586715 +0000 2024-09-18T12:42:36.912 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-18 12:36:00.251586715 +0000 2024-09-18T12:42:36.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T12:42:36.976 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-18T12:42:36.976 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-18T12:42:36.976 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000205569 s, 2.5 MB/s 2024-09-18T12:42:36.977 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T12:42:37.034 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2024-09-18T12:42:37.089 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T12:42:37.089 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:42:37.089 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-18T12:42:37.090 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:42:37.090 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:42:37.090 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-18 12:41:34.934006625 +0000 2024-09-18T12:42:37.090 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-18 12:36:00.589581676 +0000 2024-09-18T12:42:37.090 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-18 12:36:00.589581676 +0000 2024-09-18T12:42:37.090 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-18 12:36:00.589581676 +0000 2024-09-18T12:42:37.090 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T12:42:37.153 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-18T12:42:37.153 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-18T12:42:37.154 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000193875 s, 2.6 MB/s 2024-09-18T12:42:37.154 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T12:42:37.211 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-18T12:42:37.211 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T12:42:37.231 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T12:42:37.231 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2024-09-18T12:42:37.291 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T12:42:37.291 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:42:37.291 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-18T12:42:37.291 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:42:37.291 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:42:37.291 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-18 12:42:04.342538818 +0000 2024-09-18T12:42:37.292 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-18 12:35:56.970443979 +0000 2024-09-18T12:42:37.292 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-18 12:35:56.970443979 +0000 2024-09-18T12:42:37.292 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-18 12:35:56.970443979 +0000 2024-09-18T12:42:37.292 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T12:42:37.361 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-18T12:42:37.361 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-18T12:42:37.361 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000236206 s, 2.2 MB/s 2024-09-18T12:42:37.362 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T12:42:37.421 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2024-09-18T12:42:37.481 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T12:42:37.481 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:42:37.481 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-18T12:42:37.481 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:42:37.481 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:42:37.481 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-18 12:42:04.343538794 +0000 2024-09-18T12:42:37.481 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-18 12:35:57.287436423 +0000 2024-09-18T12:42:37.481 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-18 12:35:57.287436423 +0000 2024-09-18T12:42:37.481 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-18 12:35:57.287436423 +0000 2024-09-18T12:42:37.482 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T12:42:37.548 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-18T12:42:37.548 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-18T12:42:37.548 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000238715 s, 2.1 MB/s 2024-09-18T12:42:37.550 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T12:42:37.609 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2024-09-18T12:42:37.668 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T12:42:37.668 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:42:37.668 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-18T12:42:37.668 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:42:37.668 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:42:37.668 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-18 12:42:04.343538794 +0000 2024-09-18T12:42:37.668 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-18 12:35:57.626428343 +0000 2024-09-18T12:42:37.668 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-18 12:35:57.626428343 +0000 2024-09-18T12:42:37.669 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-18 12:35:57.626428343 +0000 2024-09-18T12:42:37.669 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T12:42:37.734 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-18T12:42:37.734 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-18T12:42:37.734 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000197343 s, 2.6 MB/s 2024-09-18T12:42:37.735 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T12:42:37.794 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2024-09-18T12:42:37.852 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T12:42:37.852 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:42:37.852 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-18T12:42:37.852 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:42:37.852 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:42:37.853 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-18 12:42:04.344538771 +0000 2024-09-18T12:42:37.853 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-18 12:35:57.942420812 +0000 2024-09-18T12:42:37.853 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-18 12:35:57.942420812 +0000 2024-09-18T12:42:37.853 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-18 12:35:57.942420812 +0000 2024-09-18T12:42:37.853 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T12:42:37.917 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-18T12:42:37.918 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-18T12:42:37.918 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000234851 s, 2.2 MB/s 2024-09-18T12:42:37.919 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T12:42:37.976 INFO:tasks.cephadm:Deploying osd.0 on smithi078 with /dev/vg_nvme/lv_4... 2024-09-18T12:42:37.977 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-18T12:42:38.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:37 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:38.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:37 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:38.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:37 smithi078 ceph-mon[28091]: Reconfiguring crash.smithi078 (monmap changed)... 2024-09-18T12:42:38.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:37 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi078", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:42:38.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:37 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:38.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:37 smithi078 ceph-mon[28091]: Reconfiguring daemon crash.smithi078 on smithi078 2024-09-18T12:42:38.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:37 smithi078 ceph-mon[28091]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:38.360 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:38.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:37 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:38.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:37 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:38.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:37 smithi148 ceph-mon[35352]: Reconfiguring crash.smithi078 (monmap changed)... 2024-09-18T12:42:38.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:37 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi078", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:42:38.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:37 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:38.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:37 smithi148 ceph-mon[35352]: Reconfiguring daemon crash.smithi078 on smithi078 2024-09-18T12:42:38.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:37 smithi148 ceph-mon[35352]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:39.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:39.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:39.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:39 smithi078 ceph-mon[28091]: Reconfiguring alertmanager.smithi078 (dependencies changed)... 2024-09-18T12:42:39.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:39 smithi078 ceph-mon[28091]: Reconfiguring daemon alertmanager.smithi078 on smithi078 2024-09-18T12:42:39.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:39.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:39.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:39 smithi148 ceph-mon[35352]: Reconfiguring alertmanager.smithi078 (dependencies changed)... 2024-09-18T12:42:39.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:39 smithi148 ceph-mon[35352]: Reconfiguring daemon alertmanager.smithi078 on smithi078 2024-09-18T12:42:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:40 smithi148 ceph-mon[35352]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:40 smithi078 ceph-mon[28091]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:41 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:42:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:42:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:42 smithi148 ceph-mon[35352]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:42.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:42 smithi078 ceph-mon[28091]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:44.482 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:44 smithi078 ceph-mon[28091]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:44.482 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:44 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:44.482 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:44 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:44 smithi148 ceph-mon[35352]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:44 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:44 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:45 smithi148 ceph-mon[35352]: Reconfiguring grafana.smithi078 (dependencies changed)... 2024-09-18T12:42:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:45 smithi148 ceph-mon[35352]: Reconfiguring daemon grafana.smithi078 on smithi078 2024-09-18T12:42:45.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:45 smithi078 ceph-mon[28091]: Reconfiguring grafana.smithi078 (dependencies changed)... 2024-09-18T12:42:45.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:45 smithi078 ceph-mon[28091]: Reconfiguring daemon grafana.smithi078 on smithi078 2024-09-18T12:42:45.833 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:42:45.858 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi078:vg_nvme/lv_4 2024-09-18T12:42:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:46 smithi148 ceph-mon[35352]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:46 smithi078 ceph-mon[28091]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:46.958 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:42:47.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.917+0000 7fa621eb6640 1 -- 172.21.15.78:0/1695754672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c102470 msgr2=0x7fa61c104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:47.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.917+0000 7fa621eb6640 1 --2- 172.21.15.78:0/1695754672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c102470 0x7fa61c104860 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009880 tx=0x7fa60c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:42:47.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.917+0000 7fa621eb6640 1 -- 172.21.15.78:0/1695754672 shutdown_connections 2024-09-18T12:42:47.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.917+0000 7fa621eb6640 1 --2- 172.21.15.78:0/1695754672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c104da0 0x7fa61c107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:47.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.917+0000 7fa621eb6640 1 --2- 172.21.15.78:0/1695754672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c102470 0x7fa61c104860 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:47.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.917+0000 7fa621eb6640 1 -- 172.21.15.78:0/1695754672 >> 172.21.15.78:0/1695754672 conn(0x7fa61c0fc010 msgr2=0x7fa61c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:42:47.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.917+0000 7fa621eb6640 1 -- 172.21.15.78:0/1695754672 shutdown_connections 2024-09-18T12:42:47.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.917+0000 7fa621eb6640 1 -- 172.21.15.78:0/1695754672 wait complete. 2024-09-18T12:42:47.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.918+0000 7fa621eb6640 1 Processor -- start 2024-09-18T12:42:47.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.918+0000 7fa621eb6640 1 -- start start 2024-09-18T12:42:47.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.918+0000 7fa621eb6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c102470 0x7fa61c1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.918+0000 7fa621eb6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c104da0 0x7fa61c197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.918+0000 7fa621eb6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa61c10a7b0 con 0x7fa61c102470 2024-09-18T12:42:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.918+0000 7fa621eb6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa61c10a630 con 0x7fa61c104da0 2024-09-18T12:42:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.918+0000 7fa61b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c102470 0x7fa61c1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.918+0000 7fa61b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c102470 0x7fa61c1974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56128/0 (socket says 172.21.15.78:56128) 2024-09-18T12:42:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.918+0000 7fa61b7fe640 1 -- 172.21.15.78:0/1293959348 learned_addr learned my addr 172.21.15.78:0/1293959348 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:42:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.919+0000 7fa61affd640 1 --2- 172.21.15.78:0/1293959348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c104da0 0x7fa61c197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.919+0000 7fa61b7fe640 1 -- 172.21.15.78:0/1293959348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c104da0 msgr2=0x7fa61c197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:42:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.919+0000 7fa61b7fe640 1 --2- 172.21.15.78:0/1293959348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c104da0 0x7fa61c197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:42:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.919+0000 7fa61b7fe640 1 -- 172.21.15.78:0/1293959348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa61c198090 con 0x7fa61c102470 2024-09-18T12:42:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.919+0000 7fa61affd640 1 --2- 172.21.15.78:0/1293959348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c104da0 0x7fa61c197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:42:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.919+0000 7fa61b7fe640 1 --2- 172.21.15.78:0/1293959348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c102470 0x7fa61c1974d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa60c006010 tx=0x7fa60c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:47.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.919+0000 7fa618ff9640 1 -- 172.21.15.78:0/1293959348 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa60c03f070 con 0x7fa61c102470 2024-09-18T12:42:47.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.919+0000 7fa618ff9640 1 -- 172.21.15.78:0/1293959348 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa60c004ac0 con 0x7fa61c102470 2024-09-18T12:42:47.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.919+0000 7fa618ff9640 1 -- 172.21.15.78:0/1293959348 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa60c035030 con 0x7fa61c102470 2024-09-18T12:42:47.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.919+0000 7fa621eb6640 1 -- 172.21.15.78:0/1293959348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa61c19ca70 con 0x7fa61c102470 2024-09-18T12:42:47.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.919+0000 7fa621eb6640 1 -- 172.21.15.78:0/1293959348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa61c19d000 con 0x7fa61c102470 2024-09-18T12:42:47.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.920+0000 7fa621eb6640 1 -- 172.21.15.78:0/1293959348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa61c102850 con 0x7fa61c102470 2024-09-18T12:42:47.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.921+0000 7fa618ff9640 1 -- 172.21.15.78:0/1293959348 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fa60c042070 con 0x7fa61c102470 2024-09-18T12:42:47.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.921+0000 7fa618ff9640 1 --2- 172.21.15.78:0/1293959348 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa60406e280 0x7fa604070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:42:47.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.921+0000 7fa618ff9640 1 -- 172.21.15.78:0/1293959348 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa60c0adbf0 con 0x7fa61c102470 2024-09-18T12:42:47.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.921+0000 7fa61affd640 1 --2- 172.21.15.78:0/1293959348 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa60406e280 0x7fa604070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:42:47.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.921+0000 7fa61affd640 1 --2- 172.21.15.78:0/1293959348 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa60406e280 0x7fa604070740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa6100058c0 tx=0x7fa610005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:42:47.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:47.925+0000 7fa618ff9640 1 -- 172.21.15.78:0/1293959348 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa60c07c6b0 con 0x7fa61c102470 2024-09-18T12:42:48.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:42:48.106+0000 7fa621eb6640 1 -- 172.21.15.78:0/1293959348 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa61c105700 con 0x7fa60406e280 2024-09-18T12:42:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:48 smithi148 ceph-mon[35352]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:48 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:42:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:48 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:42:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:48 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:48.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:48 smithi078 ceph-mon[28091]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:48.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:48 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:42:48.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:48 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:42:48.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:48 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:49 smithi148 ceph-mon[35352]: from='client.14328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:42:49.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:49 smithi078 ceph-mon[28091]: from='client.14328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:42:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:50 smithi148 ceph-mon[35352]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:50.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:50 smithi078 ceph-mon[28091]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:52 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:52 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:52 smithi148 ceph-mon[35352]: Reconfiguring prometheus.smithi078 (dependencies changed)... 2024-09-18T12:42:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:52 smithi148 ceph-mon[35352]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:52.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:52 smithi148 ceph-mon[35352]: Reconfiguring daemon prometheus.smithi078 on smithi078 2024-09-18T12:42:52.481 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:52 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:52.481 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:52 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:42:52.481 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:52 smithi078 ceph-mon[28091]: Reconfiguring prometheus.smithi078 (dependencies changed)... 2024-09-18T12:42:52.481 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:52 smithi078 ceph-mon[28091]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:52.481 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:52 smithi078 ceph-mon[28091]: Reconfiguring daemon prometheus.smithi078 on smithi078 2024-09-18T12:42:53.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:53 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3656213568' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91b9c8b7-2466-4085-8bec-b4f0d4d88e3a"}]: dispatch 2024-09-18T12:42:53.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:53 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3656213568' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91b9c8b7-2466-4085-8bec-b4f0d4d88e3a"}]': finished 2024-09-18T12:42:53.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:53 smithi078 ceph-mon[28091]: osdmap e6: 1 total, 0 up, 1 in 2024-09-18T12:42:53.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:53 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:42:53.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:53 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1307680816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:42:53.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:53 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/3656213568' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91b9c8b7-2466-4085-8bec-b4f0d4d88e3a"}]: dispatch 2024-09-18T12:42:53.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:53 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/3656213568' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91b9c8b7-2466-4085-8bec-b4f0d4d88e3a"}]': finished 2024-09-18T12:42:53.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:53 smithi148 ceph-mon[35352]: osdmap e6: 1 total, 0 up, 1 in 2024-09-18T12:42:53.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:53 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:42:53.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:53 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1307680816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:42:54.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:54 smithi078 ceph-mon[28091]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:54.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:54 smithi148 ceph-mon[35352]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:56 smithi148 ceph-mon[35352]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:56 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:42:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:56 smithi078 ceph-mon[28091]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:56 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:42:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:42:58 smithi148 ceph-mon[35352]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:42:58.733 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:42:58 smithi078 ceph-mon[28091]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:00.668 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:00 smithi078 ceph-mon[28091]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:00 smithi148 ceph-mon[35352]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:02.642 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:02 smithi078 ceph-mon[28091]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:02.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:02 smithi148 ceph-mon[35352]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:04.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:04 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:04.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:04 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:04.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:04 smithi078 ceph-mon[28091]: Reconfiguring ceph-exporter.smithi148 (monmap changed)... 2024-09-18T12:43:04.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:04 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi148", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:43:04.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:04 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:04.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:04 smithi078 ceph-mon[28091]: Reconfiguring daemon ceph-exporter.smithi148 on smithi148 2024-09-18T12:43:04.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:04 smithi078 ceph-mon[28091]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:04.371 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:04 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:04.371 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:04 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:04.371 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:04 smithi148 ceph-mon[35352]: Reconfiguring ceph-exporter.smithi148 (monmap changed)... 2024-09-18T12:43:04.371 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:04 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi148", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:43:04.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:04 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:04.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:04 smithi148 ceph-mon[35352]: Reconfiguring daemon ceph-exporter.smithi148 on smithi148 2024-09-18T12:43:04.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:04 smithi148 ceph-mon[35352]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:05.107 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:05 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-18T12:43:05.107 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:05 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:05.107 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:05 smithi148 ceph-mon[35352]: Deploying daemon osd.0 on smithi078 2024-09-18T12:43:05.107 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:05 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:05.108 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:05 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:05.108 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:05 smithi148 ceph-mon[35352]: Reconfiguring crash.smithi148 (monmap changed)... 2024-09-18T12:43:05.108 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:05 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi148", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:43:05.108 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:05 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:05.108 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:05 smithi148 ceph-mon[35352]: Reconfiguring daemon crash.smithi148 on smithi148 2024-09-18T12:43:05.120 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:05 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-18T12:43:05.120 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:05 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:05.120 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:05 smithi078 ceph-mon[28091]: Deploying daemon osd.0 on smithi078 2024-09-18T12:43:05.120 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:05 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:05.120 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:05 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:05.120 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:05 smithi078 ceph-mon[28091]: Reconfiguring crash.smithi148 (monmap changed)... 2024-09-18T12:43:05.120 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:05 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi148", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:43:05.120 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:05 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:05.120 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:05 smithi078 ceph-mon[28091]: Reconfiguring daemon crash.smithi148 on smithi148 2024-09-18T12:43:06.230 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:06 smithi078 ceph-mon[28091]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:06.230 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:06 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:06.230 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:06 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:06.230 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:06 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.bfgshs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:43:06.230 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:06 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:43:06.231 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:06 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:06.321 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:06 smithi148 ceph-mon[35352]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:06.321 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:06 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:06.321 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:06 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:06.322 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:06 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.bfgshs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:43:06.322 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:06 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:43:06.322 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:06 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:07.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:07 smithi148 ceph-mon[35352]: Reconfiguring mgr.smithi148.bfgshs (monmap changed)... 2024-09-18T12:43:07.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:07 smithi148 ceph-mon[35352]: Reconfiguring daemon mgr.smithi148.bfgshs on smithi148 2024-09-18T12:43:07.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:07 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:07.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:07 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:07.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:07 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:43:07.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:07 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:43:07.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:07 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:07.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:07 smithi078 ceph-mon[28091]: Reconfiguring mgr.smithi148.bfgshs (monmap changed)... 2024-09-18T12:43:07.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:07 smithi078 ceph-mon[28091]: Reconfiguring daemon mgr.smithi148.bfgshs on smithi148 2024-09-18T12:43:07.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:07 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:07.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:07 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:07.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:07 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:43:07.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:07 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:43:07.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:07 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:08.269 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:08 smithi078 ceph-mon[28091]: Reconfiguring mon.smithi148 (monmap changed)... 2024-09-18T12:43:08.269 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:08 smithi078 ceph-mon[28091]: Reconfiguring daemon mon.smithi148 on smithi148 2024-09-18T12:43:08.269 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:08 smithi078 ceph-mon[28091]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:08.272 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:08 smithi148 ceph-mon[35352]: Reconfiguring mon.smithi148 (monmap changed)... 2024-09-18T12:43:08.273 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:08 smithi148 ceph-mon[35352]: Reconfiguring daemon mon.smithi148 on smithi148 2024-09-18T12:43:08.273 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:08 smithi148 ceph-mon[35352]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:09.549 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:09.550 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:09.550 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:43:09.550 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:43:09.550 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi078.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T12:43:09.550 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi078.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T12:43:09.550 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:09.550 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:43:09.550 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:43:09.550 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi078.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T12:43:09.550 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi078.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T12:43:09.550 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:09.550 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:43:09.551 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:43:09.551 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi078.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T12:43:09.551 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi078.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T12:43:09.551 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:09.551 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:09 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:09.669 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:09.669 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:09.669 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:43:09.669 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:43:09.669 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi078.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T12:43:09.669 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi078.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T12:43:09.669 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:09.670 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:43:09.670 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:43:09.670 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi078.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T12:43:09.670 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi078.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T12:43:09.670 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:09.670 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:43:09.670 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:43:09.670 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi078.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T12:43:09.670 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi078.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T12:43:09.670 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:09.670 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:09 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:10.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:10 smithi078 ceph-mon[28091]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:10.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:10.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:10 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:10 smithi148 ceph-mon[35352]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:10 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:11.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:11 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:11 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:12.700 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:12 smithi078 ceph-mon[28091]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:12.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:12 smithi148 ceph-mon[35352]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:14 smithi148 ceph-mon[35352]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:43:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:14.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:14 smithi078 ceph-mon[28091]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:43:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:15.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:15 smithi148 ceph-mon[35352]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:15.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:15 smithi148 ceph-mon[35352]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-18T12:43:15.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:15 smithi078 ceph-mon[28091]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:15.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:15 smithi078 ceph-mon[28091]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-18T12:43:16.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:16 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:16.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:16 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:16.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:16 smithi078 ceph-mon[28091]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:17.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:16 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:17.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:16 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:17.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:16 smithi148 ceph-mon[35352]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:18.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:18.163+0000 7fa618ff9640 1 -- 172.21.15.78:0/1293959348 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa61c105700 con 0x7fa60406e280 2024-09-18T12:43:18.164 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 0 on host 'smithi078' 2024-09-18T12:43:18.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:18.165+0000 7fa621eb6640 1 -- 172.21.15.78:0/1293959348 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa60406e280 msgr2=0x7fa604070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:43:18.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:18.165+0000 7fa621eb6640 1 --2- 172.21.15.78:0/1293959348 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa60406e280 0x7fa604070740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa6100058c0 tx=0x7fa610005850 comp rx=0 tx=0).stop 2024-09-18T12:43:18.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:18.166+0000 7fa621eb6640 1 -- 172.21.15.78:0/1293959348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c102470 msgr2=0x7fa61c1974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:43:18.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:18.166+0000 7fa621eb6640 1 --2- 172.21.15.78:0/1293959348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c102470 0x7fa61c1974d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa60c006010 tx=0x7fa60c0046c0 comp rx=0 tx=0).stop 2024-09-18T12:43:18.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:18.166+0000 7fa621eb6640 1 -- 172.21.15.78:0/1293959348 shutdown_connections 2024-09-18T12:43:18.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:18.166+0000 7fa621eb6640 1 --2- 172.21.15.78:0/1293959348 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa60406e280 0x7fa604070740 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:43:18.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:18.166+0000 7fa621eb6640 1 --2- 172.21.15.78:0/1293959348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c104da0 0x7fa61c197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:43:18.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:18.166+0000 7fa621eb6640 1 --2- 172.21.15.78:0/1293959348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c102470 0x7fa61c1974d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:43:18.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:18.166+0000 7fa621eb6640 1 -- 172.21.15.78:0/1293959348 >> 172.21.15.78:0/1293959348 conn(0x7fa61c0fc010 msgr2=0x7fa61c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:43:18.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:18.166+0000 7fa621eb6640 1 -- 172.21.15.78:0/1293959348 shutdown_connections 2024-09-18T12:43:18.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:18.166+0000 7fa621eb6640 1 -- 172.21.15.78:0/1293959348 wait complete. 2024-09-18T12:43:19.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:19 smithi078 ceph-mon[28091]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:19.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:19 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:19.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:19 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:19.462 DEBUG:teuthology.orchestra.run.smithi078:osd.0> sudo journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.0.service 2024-09-18T12:43:19.465 INFO:tasks.cephadm:Deploying osd.1 on smithi078 with /dev/vg_nvme/lv_3... 2024-09-18T12:43:19.465 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-18T12:43:19.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:19 smithi148 ceph-mon[35352]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:19.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:19 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:19.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:19 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:19.834 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:43:19.957 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:43:19 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0[49795]: 2024-09-18T12:43:19.758+0000 7f19d7d28640 -1 osd.0 0 log_to_monitors true 2024-09-18T12:43:20.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:20 smithi078 ceph-mon[28091]: from='osd.0 [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-18T12:43:20.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:20 smithi148 ceph-mon[35352]: from='osd.0 [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-18T12:43:21.332 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:21 smithi078 ceph-mon[28091]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:21.333 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:21 smithi078 ceph-mon[28091]: from='osd.0 [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T12:43:21.333 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:21 smithi078 ceph-mon[28091]: osdmap e7: 1 total, 0 up, 1 in 2024-09-18T12:43:21.333 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:21 smithi078 ceph-mon[28091]: from='osd.0 [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-18T12:43:21.333 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:21 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:43:21.333 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:43:21 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0[49795]: 2024-09-18T12:43:21.170+0000 7f19d3488640 -1 osd.0 0 waiting for initial osdmap 2024-09-18T12:43:21.333 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:43:21 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0[49795]: 2024-09-18T12:43:21.176+0000 7f19cfac2640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:43:21.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:21 smithi148 ceph-mon[35352]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:21.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:21 smithi148 ceph-mon[35352]: from='osd.0 [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T12:43:21.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:21 smithi148 ceph-mon[35352]: osdmap e7: 1 total, 0 up, 1 in 2024-09-18T12:43:21.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:21 smithi148 ceph-mon[35352]: from='osd.0 [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-18T12:43:21.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:21 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:43:22.290 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:22 smithi078 ceph-mon[28091]: from='osd.0 [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-18T12:43:22.290 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:22 smithi078 ceph-mon[28091]: osdmap e8: 1 total, 0 up, 1 in 2024-09-18T12:43:22.291 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:22 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:43:22.291 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:22 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:43:22.291 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:22 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:22.291 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:22 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:22.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:22 smithi148 ceph-mon[35352]: from='osd.0 [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-18T12:43:22.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:22 smithi148 ceph-mon[35352]: osdmap e8: 1 total, 0 up, 1 in 2024-09-18T12:43:22.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:22 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:43:22.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:22 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:43:22.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:22 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:22.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:22 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:22.926 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:43:22.952 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi078:vg_nvme/lv_3 2024-09-18T12:43:23.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:23 smithi148 ceph-mon[35352]: purged_snaps scrub starts 2024-09-18T12:43:23.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:23 smithi148 ceph-mon[35352]: purged_snaps scrub ok 2024-09-18T12:43:23.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:23 smithi148 ceph-mon[35352]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:23.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:23 smithi148 ceph-mon[35352]: osd.0 [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518] boot 2024-09-18T12:43:23.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:23 smithi148 ceph-mon[35352]: osdmap e9: 1 total, 1 up, 1 in 2024-09-18T12:43:23.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:23 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:43:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:23 smithi078 ceph-mon[28091]: purged_snaps scrub starts 2024-09-18T12:43:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:23 smithi078 ceph-mon[28091]: purged_snaps scrub ok 2024-09-18T12:43:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:23 smithi078 ceph-mon[28091]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:23 smithi078 ceph-mon[28091]: osd.0 [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518] boot 2024-09-18T12:43:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:23 smithi078 ceph-mon[28091]: osdmap e9: 1 total, 1 up, 1 in 2024-09-18T12:43:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:23 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:43:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:43:24.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.339+0000 7fb44f8da640 1 -- 172.21.15.78:0/3266163169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb448102b60 msgr2=0x7fb448102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:43:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.339+0000 7fb44f8da640 1 --2- 172.21.15.78:0/3266163169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb448102b60 0x7fb448102fe0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009c20 tx=0x7fb43c02a970 comp rx=0 tx=0).stop 2024-09-18T12:43:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.339+0000 7fb44f8da640 1 -- 172.21.15.78:0/3266163169 shutdown_connections 2024-09-18T12:43:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.339+0000 7fb44f8da640 1 --2- 172.21.15.78:0/3266163169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb448102b60 0x7fb448102fe0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:43:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.339+0000 7fb44f8da640 1 --2- 172.21.15.78:0/3266163169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb448101960 0x7fb448101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:43:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.339+0000 7fb44f8da640 1 -- 172.21.15.78:0/3266163169 >> 172.21.15.78:0/3266163169 conn(0x7fb4480fd0f0 msgr2=0x7fb4480ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:43:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.339+0000 7fb44f8da640 1 -- 172.21.15.78:0/3266163169 shutdown_connections 2024-09-18T12:43:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.339+0000 7fb44f8da640 1 -- 172.21.15.78:0/3266163169 wait complete. 2024-09-18T12:43:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.340+0000 7fb44f8da640 1 Processor -- start 2024-09-18T12:43:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.340+0000 7fb44f8da640 1 -- start start 2024-09-18T12:43:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.340+0000 7fb44f8da640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb448101960 0x7fb448197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:43:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.340+0000 7fb44f8da640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb448102b60 0x7fb448197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:43:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.340+0000 7fb44f8da640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb44810a820 con 0x7fb448101960 2024-09-18T12:43:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.340+0000 7fb44f8da640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb44810a6a0 con 0x7fb448102b60 2024-09-18T12:43:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.340+0000 7fb44d676640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb448101960 0x7fb448197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:43:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.340+0000 7fb44d676640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb448101960 0x7fb448197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56276/0 (socket says 172.21.15.78:56276) 2024-09-18T12:43:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.340+0000 7fb44d676640 1 -- 172.21.15.78:0/2309234803 learned_addr learned my addr 172.21.15.78:0/2309234803 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:43:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.340+0000 7fb44ce75640 1 --2- 172.21.15.78:0/2309234803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb448102b60 0x7fb448197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:43:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.340+0000 7fb44d676640 1 -- 172.21.15.78:0/2309234803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb448102b60 msgr2=0x7fb448197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:43:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.340+0000 7fb44d676640 1 --2- 172.21.15.78:0/2309234803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb448102b60 0x7fb448197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:43:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.340+0000 7fb44d676640 1 -- 172.21.15.78:0/2309234803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb448198150 con 0x7fb448101960 2024-09-18T12:43:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.340+0000 7fb44ce75640 1 --2- 172.21.15.78:0/2309234803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb448102b60 0x7fb448197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:43:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.341+0000 7fb44d676640 1 --2- 172.21.15.78:0/2309234803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb448101960 0x7fb448197590 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb43800b3d0 tx=0x7fb43800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:43:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.341+0000 7fb4467fc640 1 -- 172.21.15.78:0/2309234803 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb438015020 con 0x7fb448101960 2024-09-18T12:43:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.341+0000 7fb44f8da640 1 -- 172.21.15.78:0/2309234803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44819cb90 con 0x7fb448101960 2024-09-18T12:43:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.341+0000 7fb4467fc640 1 -- 172.21.15.78:0/2309234803 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb438011af0 con 0x7fb448101960 2024-09-18T12:43:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.341+0000 7fb4467fc640 1 -- 172.21.15.78:0/2309234803 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb438010da0 con 0x7fb448101960 2024-09-18T12:43:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.341+0000 7fb44f8da640 1 -- 172.21.15.78:0/2309234803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44819d120 con 0x7fb448101960 2024-09-18T12:43:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.342+0000 7fb44f8da640 1 -- 172.21.15.78:0/2309234803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb448101de0 con 0x7fb448101960 2024-09-18T12:43:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.342+0000 7fb4467fc640 1 -- 172.21.15.78:0/2309234803 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fb438018020 con 0x7fb448101960 2024-09-18T12:43:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.343+0000 7fb4467fc640 1 --2- 172.21.15.78:0/2309234803 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb43006e230 0x7fb4300706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:43:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.343+0000 7fb4467fc640 1 -- 172.21.15.78:0/2309234803 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1982+0+0 (secure 0 0 0) 0x7fb43808ce60 con 0x7fb448101960 2024-09-18T12:43:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.343+0000 7fb44ce75640 1 --2- 172.21.15.78:0/2309234803 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb43006e230 0x7fb4300706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:43:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.343+0000 7fb44ce75640 1 --2- 172.21.15.78:0/2309234803 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb43006e230 0x7fb4300706f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb43c006010 tx=0x7fb43c0093f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:43:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.347+0000 7fb4467fc640 1 -- 172.21.15.78:0/2309234803 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb43801f020 con 0x7fb448101960 2024-09-18T12:43:24.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:24.526+0000 7fb44f8da640 1 -- 172.21.15.78:0/2309234803 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb4480626f0 con 0x7fb43006e230 2024-09-18T12:43:24.945 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:24 smithi078 ceph-mon[28091]: osdmap e10: 1 total, 1 up, 1 in 2024-09-18T12:43:24.945 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:24 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:43:24.945 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:24 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:43:24.945 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:24 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:24.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:24 smithi148 ceph-mon[35352]: osdmap e10: 1 total, 1 up, 1 in 2024-09-18T12:43:24.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:24 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:43:24.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:24 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:43:24.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:24 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:25.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:25 smithi148 ceph-mon[35352]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:25.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:25 smithi148 ceph-mon[35352]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:25.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:25 smithi078 ceph-mon[28091]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:25.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:25 smithi078 ceph-mon[28091]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:27.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:27.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:27.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:27.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: Detected new or changed devices on smithi078 2024-09-18T12:43:27.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:27.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:27.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:43:27.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: Adjusting osd_memory_target on smithi078 to 11840M 2024-09-18T12:43:27.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:27.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:27.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:43:27.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:27.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:27.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-18T12:43:27.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: Cluster is now healthy 2024-09-18T12:43:27.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:27.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:27.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:27.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:27.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: Detected new or changed devices on smithi078 2024-09-18T12:43:27.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:27.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:27.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:43:27.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: Adjusting osd_memory_target on smithi078 to 11840M 2024-09-18T12:43:27.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:27.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:27.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:43:27.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:27.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:27.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-18T12:43:27.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: Cluster is now healthy 2024-09-18T12:43:27.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:28.523 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:28 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/4253540539' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9b36d44-66f3-4270-8a49-7bb6f6b7af34"}]: dispatch 2024-09-18T12:43:28.523 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:28 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/4253540539' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9b36d44-66f3-4270-8a49-7bb6f6b7af34"}]': finished 2024-09-18T12:43:28.523 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:28 smithi148 ceph-mon[35352]: osdmap e11: 2 total, 1 up, 2 in 2024-09-18T12:43:28.523 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:28 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:43:28.524 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:28 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1930873978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:43:28.637 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:28 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/4253540539' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9b36d44-66f3-4270-8a49-7bb6f6b7af34"}]: dispatch 2024-09-18T12:43:28.637 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:28 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/4253540539' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9b36d44-66f3-4270-8a49-7bb6f6b7af34"}]': finished 2024-09-18T12:43:28.637 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:28 smithi078 ceph-mon[28091]: osdmap e11: 2 total, 1 up, 2 in 2024-09-18T12:43:28.637 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:28 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:43:28.637 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:28 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1930873978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:43:29.904 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:29 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:29.905 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:29 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:29.905 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:29 smithi078 ceph-mon[28091]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:29.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:29 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:29.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:29 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:29.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:29 smithi148 ceph-mon[35352]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:30.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:30 smithi148 ceph-mon[35352]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:30.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:30 smithi078 ceph-mon[28091]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:32 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:32 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:32 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:32 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:43:32.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:32 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:32 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:32 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:32 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:32 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:43:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:32 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:33.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:33 smithi148 ceph-mon[35352]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:33.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:33 smithi078 ceph-mon[28091]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:34.935 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:34 smithi078 ceph-mon[28091]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:34.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:34 smithi148 ceph-mon[35352]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:36.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:36 smithi148 ceph-mon[35352]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:36.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:36 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-18T12:43:36.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:36 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:36.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:36 smithi148 ceph-mon[35352]: Deploying daemon osd.1 on smithi078 2024-09-18T12:43:36.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:36 smithi078 ceph-mon[28091]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:36.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:36 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-18T12:43:36.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:36 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:36.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:36 smithi078 ceph-mon[28091]: Deploying daemon osd.1 on smithi078 2024-09-18T12:43:38.931 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:38 smithi078 ceph-mon[28091]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:38.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:38 smithi148 ceph-mon[35352]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:40.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:40 smithi148 ceph-mon[35352]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:40.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:40 smithi078 ceph-mon[28091]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:42.481 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:42 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:42.481 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:42 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:42 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:42 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:43.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:43 smithi078 ceph-mon[28091]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:43.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:43 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:43.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:43 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:43.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:43 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:43.682 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:43 smithi148 ceph-mon[35352]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:43.682 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:43 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:43.683 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:43 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:43.683 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:43 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:44.894 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:44 smithi078 ceph-mon[28091]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:44.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:44 smithi148 ceph-mon[35352]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:45.776 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:45.776 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:45.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:45.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:46.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:46 smithi148 ceph-mon[35352]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:46.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:46 smithi078 ceph-mon[28091]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:47.651 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 1 on host 'smithi078' 2024-09-18T12:43:47.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:47.649+0000 7fb4467fc640 1 -- 172.21.15.78:0/2309234803 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb4480626f0 con 0x7fb43006e230 2024-09-18T12:43:47.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:47.651+0000 7fb44f8da640 1 -- 172.21.15.78:0/2309234803 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb43006e230 msgr2=0x7fb4300706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:43:47.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:47.651+0000 7fb44f8da640 1 --2- 172.21.15.78:0/2309234803 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb43006e230 0x7fb4300706f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb43c006010 tx=0x7fb43c0093f0 comp rx=0 tx=0).stop 2024-09-18T12:43:47.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:47.651+0000 7fb44f8da640 1 -- 172.21.15.78:0/2309234803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb448101960 msgr2=0x7fb448197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:43:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:47.651+0000 7fb44f8da640 1 --2- 172.21.15.78:0/2309234803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb448101960 0x7fb448197590 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb43800b3d0 tx=0x7fb43800b890 comp rx=0 tx=0).stop 2024-09-18T12:43:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:47.651+0000 7fb44f8da640 1 -- 172.21.15.78:0/2309234803 shutdown_connections 2024-09-18T12:43:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:47.651+0000 7fb44f8da640 1 --2- 172.21.15.78:0/2309234803 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb43006e230 0x7fb4300706f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:43:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:47.651+0000 7fb44f8da640 1 --2- 172.21.15.78:0/2309234803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb448102b60 0x7fb448197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:43:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:47.651+0000 7fb44f8da640 1 --2- 172.21.15.78:0/2309234803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb448101960 0x7fb448197590 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:43:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:47.651+0000 7fb44f8da640 1 -- 172.21.15.78:0/2309234803 >> 172.21.15.78:0/2309234803 conn(0x7fb4480fd0f0 msgr2=0x7fb4481060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:43:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:47.651+0000 7fb44f8da640 1 -- 172.21.15.78:0/2309234803 shutdown_connections 2024-09-18T12:43:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:47.651+0000 7fb44f8da640 1 -- 172.21.15.78:0/2309234803 wait complete. 2024-09-18T12:43:48.840 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:48 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:48.840 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:48 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:48.840 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:48 smithi078 ceph-mon[28091]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:48.871 DEBUG:teuthology.orchestra.run.smithi078:osd.1> sudo journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.1.service 2024-09-18T12:43:48.873 INFO:tasks.cephadm:Deploying osd.2 on smithi078 with /dev/vg_nvme/lv_2... 2024-09-18T12:43:48.873 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-18T12:43:48.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:48 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:48.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:48 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:48.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:48 smithi148 ceph-mon[35352]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:49.446 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:43:49 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1[57239]: 2024-09-18T12:43:49.228+0000 7fb89a40e640 -1 osd.1 0 log_to_monitors true 2024-09-18T12:43:49.690 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:43:49.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:49 smithi078 ceph-mon[28091]: from='osd.1 [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-18T12:43:49.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:49 smithi148 ceph-mon[35352]: from='osd.1 [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-18T12:43:50.819 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:50 smithi078 ceph-mon[28091]: from='osd.1 [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T12:43:50.819 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:50 smithi078 ceph-mon[28091]: osdmap e12: 2 total, 1 up, 2 in 2024-09-18T12:43:50.819 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:50 smithi078 ceph-mon[28091]: from='osd.1 [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-18T12:43:50.819 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:50 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:43:50.819 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:50 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:50.819 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:50 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:50.819 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:50 smithi078 ceph-mon[28091]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:50.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:50 smithi148 ceph-mon[35352]: from='osd.1 [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T12:43:50.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:50 smithi148 ceph-mon[35352]: osdmap e12: 2 total, 1 up, 2 in 2024-09-18T12:43:50.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:50 smithi148 ceph-mon[35352]: from='osd.1 [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-18T12:43:50.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:50 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:43:50.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:50 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:50.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:50 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:50.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:50 smithi148 ceph-mon[35352]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:51.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:51 smithi078 ceph-mon[28091]: from='osd.1 [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-18T12:43:51.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:51 smithi078 ceph-mon[28091]: osdmap e13: 2 total, 1 up, 2 in 2024-09-18T12:43:51.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:51 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:43:51.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:51 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:43:51.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:51 smithi078 ceph-mon[28091]: from='osd.1 [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947]' entity='osd.1' 2024-09-18T12:43:51.742 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:43:51 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1[57239]: 2024-09-18T12:43:51.456+0000 7fb895b6e640 -1 osd.1 0 waiting for initial osdmap 2024-09-18T12:43:51.743 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:43:51 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1[57239]: 2024-09-18T12:43:51.464+0000 7fb88e1a0640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:43:51.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:51 smithi148 ceph-mon[35352]: from='osd.1 [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-18T12:43:51.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:51 smithi148 ceph-mon[35352]: osdmap e13: 2 total, 1 up, 2 in 2024-09-18T12:43:51.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:51 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:43:51.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:51 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:43:51.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:51 smithi148 ceph-mon[35352]: from='osd.1 [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947]' entity='osd.1' 2024-09-18T12:43:52.575 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:43:52.602 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi078:vg_nvme/lv_2 2024-09-18T12:43:52.717 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:52 smithi078 ceph-mon[28091]: purged_snaps scrub starts 2024-09-18T12:43:52.717 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:52 smithi078 ceph-mon[28091]: purged_snaps scrub ok 2024-09-18T12:43:52.717 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:52 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:43:52.717 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:52 smithi078 ceph-mon[28091]: osd.1 [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947] boot 2024-09-18T12:43:52.717 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:52 smithi078 ceph-mon[28091]: osdmap e14: 2 total, 2 up, 2 in 2024-09-18T12:43:52.717 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:52 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:43:52.717 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:52 smithi078 ceph-mon[28091]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:52 smithi148 ceph-mon[35352]: purged_snaps scrub starts 2024-09-18T12:43:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:52 smithi148 ceph-mon[35352]: purged_snaps scrub ok 2024-09-18T12:43:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:52 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:43:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:52 smithi148 ceph-mon[35352]: osd.1 [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947] boot 2024-09-18T12:43:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:52 smithi148 ceph-mon[35352]: osdmap e14: 2 total, 2 up, 2 in 2024-09-18T12:43:52.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:52 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:43:52.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:52 smithi148 ceph-mon[35352]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:43:53.620 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:43:54.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.090+0000 7f6385d8a640 1 -- 172.21.15.78:0/1756652302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6380100860 msgr2=0x7f6380100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:43:54.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.090+0000 7f6385d8a640 1 --2- 172.21.15.78:0/1756652302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6380100860 0x7f6380100c60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6370009880 tx=0x7f637002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:43:54.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.090+0000 7f6385d8a640 1 -- 172.21.15.78:0/1756652302 shutdown_connections 2024-09-18T12:43:54.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.090+0000 7f6385d8a640 1 --2- 172.21.15.78:0/1756652302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6380101a60 0x7f6380101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:43:54.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.090+0000 7f6385d8a640 1 --2- 172.21.15.78:0/1756652302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6380100860 0x7f6380100c60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:43:54.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.090+0000 7f6385d8a640 1 -- 172.21.15.78:0/1756652302 >> 172.21.15.78:0/1756652302 conn(0x7f63800fbff0 msgr2=0x7f63800fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:43:54.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.090+0000 7f6385d8a640 1 -- 172.21.15.78:0/1756652302 shutdown_connections 2024-09-18T12:43:54.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.090+0000 7f6385d8a640 1 -- 172.21.15.78:0/1756652302 wait complete. 2024-09-18T12:43:54.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.091+0000 7f6385d8a640 1 Processor -- start 2024-09-18T12:43:54.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.091+0000 7f6385d8a640 1 -- start start 2024-09-18T12:43:54.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.091+0000 7f6385d8a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6380100860 0x7f6380196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:43:54.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.091+0000 7f6385d8a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6380101a60 0x7f6380196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:43:54.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.091+0000 7f6385d8a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6380109700 con 0x7f6380101a60 2024-09-18T12:43:54.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.091+0000 7f6385d8a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6380109580 con 0x7f6380100860 2024-09-18T12:43:54.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.091+0000 7f637effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6380101a60 0x7f6380196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:43:54.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.091+0000 7f637effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6380101a60 0x7f6380196970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44182/0 (socket says 172.21.15.78:44182) 2024-09-18T12:43:54.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.091+0000 7f637effd640 1 -- 172.21.15.78:0/3656295377 learned_addr learned my addr 172.21.15.78:0/3656295377 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:43:54.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.092+0000 7f637effd640 1 -- 172.21.15.78:0/3656295377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6380100860 msgr2=0x7f6380196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:43:54.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.092+0000 7f637effd640 1 --2- 172.21.15.78:0/3656295377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6380100860 0x7f6380196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:43:54.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.092+0000 7f637effd640 1 -- 172.21.15.78:0/3656295377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6380196ff0 con 0x7f6380101a60 2024-09-18T12:43:54.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.092+0000 7f637effd640 1 --2- 172.21.15.78:0/3656295377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6380101a60 0x7f6380196970 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f637400b420 tx=0x7f637400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:43:54.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.092+0000 7f637cff9640 1 -- 172.21.15.78:0/3656295377 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6374011630 con 0x7f6380101a60 2024-09-18T12:43:54.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.092+0000 7f6385d8a640 1 -- 172.21.15.78:0/3656295377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f638019ba30 con 0x7f6380101a60 2024-09-18T12:43:54.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.092+0000 7f637cff9640 1 -- 172.21.15.78:0/3656295377 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6374016070 con 0x7f6380101a60 2024-09-18T12:43:54.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.092+0000 7f637cff9640 1 -- 172.21.15.78:0/3656295377 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6374010d40 con 0x7f6380101a60 2024-09-18T12:43:54.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.092+0000 7f6385d8a640 1 -- 172.21.15.78:0/3656295377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f638019c040 con 0x7f6380101a60 2024-09-18T12:43:54.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.093+0000 7f6385d8a640 1 -- 172.21.15.78:0/3656295377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6380100c60 con 0x7f6380101a60 2024-09-18T12:43:54.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.094+0000 7f637cff9640 1 -- 172.21.15.78:0/3656295377 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f63740117d0 con 0x7f6380101a60 2024-09-18T12:43:54.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.094+0000 7f637cff9640 1 --2- 172.21.15.78:0/3656295377 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f636806e230 0x7f63680706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:43:54.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.094+0000 7f637cff9640 1 -- 172.21.15.78:0/3656295377 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2414+0+0 (secure 0 0 0) 0x7f637408cd00 con 0x7f6380101a60 2024-09-18T12:43:54.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.094+0000 7f637f7fe640 1 --2- 172.21.15.78:0/3656295377 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f636806e230 0x7f63680706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:43:54.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.095+0000 7f637f7fe640 1 --2- 172.21.15.78:0/3656295377 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f636806e230 0x7f63680706f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63700096c0 tx=0x7f6370000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:43:54.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.099+0000 7f637cff9640 1 -- 172.21.15.78:0/3656295377 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f637405b330 con 0x7f6380101a60 2024-09-18T12:43:54.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:43:54.278+0000 7f6385d8a640 1 -- 172.21.15.78:0/3656295377 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6380062630 con 0x7f636806e230 2024-09-18T12:43:54.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:54 smithi148 ceph-mon[35352]: osdmap e15: 2 total, 2 up, 2 in 2024-09-18T12:43:54.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:54 smithi148 ceph-mon[35352]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:54.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:54 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:43:54.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:54 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:43:54.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:54 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:54.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:54 smithi148 ceph-mon[35352]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:43:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:54 smithi078 ceph-mon[28091]: osdmap e15: 2 total, 2 up, 2 in 2024-09-18T12:43:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:54 smithi078 ceph-mon[28091]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:54 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:43:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:54 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:43:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:54 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:54 smithi078 ceph-mon[28091]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:43:55.863 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:55 smithi078 ceph-mon[28091]: Detected new or changed devices on smithi078 2024-09-18T12:43:55.863 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:55 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:55.863 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:55 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:55.863 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:55 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:43:55.863 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:55 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:43:55.863 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:55 smithi078 ceph-mon[28091]: Adjusting osd_memory_target on smithi078 to 5920M 2024-09-18T12:43:55.864 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:55 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:55.864 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:55 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:55.864 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:55 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:43:55.864 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:55 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:55.864 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:55 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:55.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:55 smithi148 ceph-mon[35352]: Detected new or changed devices on smithi078 2024-09-18T12:43:55.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:55 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:55.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:55 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:55.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:55 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:43:55.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:55 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:43:55.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:55 smithi148 ceph-mon[35352]: Adjusting osd_memory_target on smithi078 to 5920M 2024-09-18T12:43:55.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:55 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:55.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:55 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:55.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:55 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:43:55.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:55 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:43:55.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:55 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:56.852 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:56 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:56.852 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:56 smithi078 ceph-mon[28091]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:43:56.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:56 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:43:56.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:56 smithi148 ceph-mon[35352]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:43:57.855 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:57 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2018193307' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c337d9bd-8a41-4b3f-8b9f-04560dafa83e"}]: dispatch 2024-09-18T12:43:57.855 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:57 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2018193307' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c337d9bd-8a41-4b3f-8b9f-04560dafa83e"}]': finished 2024-09-18T12:43:57.855 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:57 smithi078 ceph-mon[28091]: osdmap e16: 3 total, 2 up, 3 in 2024-09-18T12:43:57.856 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:57 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:43:57.856 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:57 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2464171249' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:43:57.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:57 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2018193307' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c337d9bd-8a41-4b3f-8b9f-04560dafa83e"}]: dispatch 2024-09-18T12:43:57.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:57 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2018193307' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c337d9bd-8a41-4b3f-8b9f-04560dafa83e"}]': finished 2024-09-18T12:43:57.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:57 smithi148 ceph-mon[35352]: osdmap e16: 3 total, 2 up, 3 in 2024-09-18T12:43:57.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:57 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:43:57.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:57 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2464171249' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:43:58.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:43:58 smithi078 ceph-mon[28091]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:43:59.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:43:58 smithi148 ceph-mon[35352]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:01.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:01 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:01.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:01 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:01.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:01 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:01.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:01 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:44:01.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:01 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:01.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:01 smithi148 ceph-mon[35352]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:01.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:01 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:01.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:01 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:01.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:01 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:01.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:01 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:44:01.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:01 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:01.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:01 smithi078 ceph-mon[28091]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:02.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:02 smithi148 ceph-mon[35352]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:02.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:02 smithi078 ceph-mon[28091]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:04 smithi078 ceph-mon[28091]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:04.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:04 smithi148 ceph-mon[35352]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:05.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:05 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-18T12:44:05.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:05 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:06.080 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:05 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-18T12:44:06.080 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:05 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:07.155 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:06 smithi078 ceph-mon[28091]: Deploying daemon osd.2 on smithi078 2024-09-18T12:44:07.156 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:06 smithi078 ceph-mon[28091]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:07.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:06 smithi148 ceph-mon[35352]: Deploying daemon osd.2 on smithi078 2024-09-18T12:44:07.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:06 smithi148 ceph-mon[35352]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:08.915 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:08 smithi078 ceph-mon[28091]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:08.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:08 smithi148 ceph-mon[35352]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:10.897 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:10 smithi078 ceph-mon[28091]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:10.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:10 smithi148 ceph-mon[35352]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:11.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:11 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:11.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:11 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:12.885 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:12 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:44:12.885 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:12 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:12.885 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:12 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:12.885 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:12 smithi078 ceph-mon[28091]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:12.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:12 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:44:12.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:12 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:12.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:12 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:12.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:12 smithi148 ceph-mon[35352]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:14.944 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:14 smithi078 ceph-mon[28091]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:14 smithi148 ceph-mon[35352]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:15.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:44:15.699+0000 7f637cff9640 1 -- 172.21.15.78:0/3656295377 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6380062630 con 0x7f636806e230 2024-09-18T12:44:15.700 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 2 on host 'smithi078' 2024-09-18T12:44:15.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:44:15.701+0000 7f6385d8a640 1 -- 172.21.15.78:0/3656295377 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f636806e230 msgr2=0x7f63680706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:15.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:44:15.701+0000 7f6385d8a640 1 --2- 172.21.15.78:0/3656295377 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f636806e230 0x7f63680706f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63700096c0 tx=0x7f6370000bc0 comp rx=0 tx=0).stop 2024-09-18T12:44:15.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:44:15.701+0000 7f6385d8a640 1 -- 172.21.15.78:0/3656295377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6380101a60 msgr2=0x7f6380196970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:15.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:44:15.701+0000 7f6385d8a640 1 --2- 172.21.15.78:0/3656295377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6380101a60 0x7f6380196970 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f637400b420 tx=0x7f637400b8e0 comp rx=0 tx=0).stop 2024-09-18T12:44:15.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:44:15.701+0000 7f6385d8a640 1 -- 172.21.15.78:0/3656295377 shutdown_connections 2024-09-18T12:44:15.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:44:15.701+0000 7f6385d8a640 1 --2- 172.21.15.78:0/3656295377 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f636806e230 0x7f63680706f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:15.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:44:15.701+0000 7f6385d8a640 1 --2- 172.21.15.78:0/3656295377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6380101a60 0x7f6380196970 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:15.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:44:15.701+0000 7f6385d8a640 1 --2- 172.21.15.78:0/3656295377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6380100860 0x7f6380196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:15.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:44:15.701+0000 7f6385d8a640 1 -- 172.21.15.78:0/3656295377 >> 172.21.15.78:0/3656295377 conn(0x7f63800fbff0 msgr2=0x7f6380104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:15.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:44:15.701+0000 7f6385d8a640 1 -- 172.21.15.78:0/3656295377 shutdown_connections 2024-09-18T12:44:15.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:44:15.701+0000 7f6385d8a640 1 -- 172.21.15.78:0/3656295377 wait complete. 2024-09-18T12:44:16.840 DEBUG:teuthology.orchestra.run.smithi078:osd.2> sudo journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.2.service 2024-09-18T12:44:16.842 INFO:tasks.cephadm:Deploying osd.3 on smithi148 with /dev/vg_nvme/lv_4... 2024-09-18T12:44:16.842 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-18T12:44:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:16 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:16 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:16 smithi148 ceph-mon[35352]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:16.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:16 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:16.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:16 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:16.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:16 smithi078 ceph-mon[28091]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:17.096 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi148/config 2024-09-18T12:44:18.206 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:17 smithi148 ceph-mon[35352]: from='osd.2 [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-18T12:44:18.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:17 smithi078 ceph-mon[28091]: from='osd.2 [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-18T12:44:18.242 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:44:17 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2[64612]: 2024-09-18T12:44:17.787+0000 7f4ca167a640 -1 osd.2 0 log_to_monitors true 2024-09-18T12:44:19.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:18 smithi148 ceph-mon[35352]: from='osd.2 [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T12:44:19.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:18 smithi148 ceph-mon[35352]: osdmap e17: 3 total, 2 up, 3 in 2024-09-18T12:44:19.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:18 smithi148 ceph-mon[35352]: from='osd.2 [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-18T12:44:19.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:18 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:44:19.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:18 smithi148 ceph-mon[35352]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:19.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:18 smithi148 ceph-mon[35352]: from='osd.2 [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-18T12:44:19.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:18 smithi078 ceph-mon[28091]: from='osd.2 [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T12:44:19.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:18 smithi078 ceph-mon[28091]: osdmap e17: 3 total, 2 up, 3 in 2024-09-18T12:44:19.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:18 smithi078 ceph-mon[28091]: from='osd.2 [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-18T12:44:19.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:18 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:44:19.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:18 smithi078 ceph-mon[28091]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:19.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:18 smithi078 ceph-mon[28091]: from='osd.2 [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-18T12:44:19.341 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:44:19.367 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi148:vg_nvme/lv_4 2024-09-18T12:44:19.623 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi148/config 2024-09-18T12:44:19.966 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:19 smithi148 ceph-mon[35352]: osdmap e18: 3 total, 2 up, 3 in 2024-09-18T12:44:19.966 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:19 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:44:19.966 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:19 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:44:19.966 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:19 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:19.966 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:19 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:19.966 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:19 smithi148 ceph-mon[35352]: from='osd.2 [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229]' entity='osd.2' 2024-09-18T12:44:19.966 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:19 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:44:19.992 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:44:19 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2[64612]: 2024-09-18T12:44:19.680+0000 7f4c9de11640 -1 osd.2 0 waiting for initial osdmap 2024-09-18T12:44:19.992 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:44:19 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2[64612]: 2024-09-18T12:44:19.692+0000 7f4c9540c640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:44:19.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:19 smithi078 ceph-mon[28091]: osdmap e18: 3 total, 2 up, 3 in 2024-09-18T12:44:19.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:19 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:44:19.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:19 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:44:19.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:19 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:19.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:19 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:19.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:19 smithi078 ceph-mon[28091]: from='osd.2 [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229]' entity='osd.2' 2024-09-18T12:44:19.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:19 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:44:20.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.050+0000 7f25b482f640 1 -- 172.21.15.148:0/2985156023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25b0104da0 msgr2=0x7f25b0107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:20.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.050+0000 7f25b482f640 1 --2- 172.21.15.148:0/2985156023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25b0104da0 0x7f25b0107190 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009880 tx=0x7f25a402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.051+0000 7f25b482f640 1 -- 172.21.15.148:0/2985156023 shutdown_connections 2024-09-18T12:44:20.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.051+0000 7f25b482f640 1 --2- 172.21.15.148:0/2985156023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25b0104da0 0x7f25b0107190 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.051+0000 7f25b482f640 1 --2- 172.21.15.148:0/2985156023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25b0102470 0x7f25b0104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.051+0000 7f25b482f640 1 -- 172.21.15.148:0/2985156023 >> 172.21.15.148:0/2985156023 conn(0x7f25b00fc010 msgr2=0x7f25b00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:20.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.051+0000 7f25b482f640 1 -- 172.21.15.148:0/2985156023 shutdown_connections 2024-09-18T12:44:20.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.051+0000 7f25b482f640 1 -- 172.21.15.148:0/2985156023 wait complete. 2024-09-18T12:44:20.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.051+0000 7f25b482f640 1 Processor -- start 2024-09-18T12:44:20.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.051+0000 7f25b482f640 1 -- start start 2024-09-18T12:44:20.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f25b482f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25b0102470 0x7f25b0101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:20.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f25b482f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25b0104da0 0x7f25b0100420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:20.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f25b482f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f25b010a780 con 0x7f25b0104da0 2024-09-18T12:44:20.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f25b482f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f25b010a600 con 0x7f25b0102470 2024-09-18T12:44:20.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f25ae59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25b0102470 0x7f25b0101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:20.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f25ae59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25b0102470 0x7f25b0101d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54630/0 (socket says 172.21.15.148:54630) 2024-09-18T12:44:20.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f25ae59c640 1 -- 172.21.15.148:0/3492880701 learned_addr learned my addr 172.21.15.148:0/3492880701 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-18T12:44:20.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f25add9b640 1 --2- 172.21.15.148:0/3492880701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25b0104da0 0x7f25b0100420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:20.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f25ae59c640 1 -- 172.21.15.148:0/3492880701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25b0104da0 msgr2=0x7f25b0100420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:20.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f25ae59c640 1 --2- 172.21.15.148:0/3492880701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25b0104da0 0x7f25b0100420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:20.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f25ae59c640 1 -- 172.21.15.148:0/3492880701 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b0100960 con 0x7f25b0102470 2024-09-18T12:44:20.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f25ae59c640 1 --2- 172.21.15.148:0/3492880701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25b0102470 0x7f25b0101d60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f25a000d8d0 tx=0x7f25a000dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:20.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f259f7fe640 1 -- 172.21.15.148:0/3492880701 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25a0017030 con 0x7f25b0102470 2024-09-18T12:44:20.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f259f7fe640 1 -- 172.21.15.148:0/3492880701 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f25a0004020 con 0x7f25b0102470 2024-09-18T12:44:20.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f25b482f640 1 -- 172.21.15.148:0/3492880701 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b0100c50 con 0x7f25b0102470 2024-09-18T12:44:20.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.052+0000 7f259f7fe640 1 -- 172.21.15.148:0/3492880701 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25a00047a0 con 0x7f25b0102470 2024-09-18T12:44:20.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.053+0000 7f25b482f640 1 -- 172.21.15.148:0/3492880701 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b01011b0 con 0x7f25b0102470 2024-09-18T12:44:20.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.053+0000 7f25b482f640 1 -- 172.21.15.148:0/3492880701 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25b0102850 con 0x7f25b0102470 2024-09-18T12:44:20.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.054+0000 7f259f7fe640 1 -- 172.21.15.148:0/3492880701 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f25a00041d0 con 0x7f25b0102470 2024-09-18T12:44:20.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.054+0000 7f259f7fe640 1 --2- 172.21.15.148:0/3492880701 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f259806e230 0x7f25980706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:20.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.055+0000 7f259f7fe640 1 -- 172.21.15.148:0/3492880701 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2566+0+0 (secure 0 0 0) 0x7f25a0018070 con 0x7f25b0102470 2024-09-18T12:44:20.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.055+0000 7f25add9b640 1 --2- 172.21.15.148:0/3492880701 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f259806e230 0x7f25980706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:20.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.055+0000 7f25add9b640 1 --2- 172.21.15.148:0/3492880701 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f259806e230 0x7f25980706f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009230 tx=0x7f25a40058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:20.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.059+0000 7f259f7fe640 1 -- 172.21.15.148:0/3492880701 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f25a005b870 con 0x7f25b0102470 2024-09-18T12:44:20.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:20.243+0000 7f25b482f640 1 -- 172.21.15.148:0/3492880701 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f25b019f5c0 con 0x7f259806e230 2024-09-18T12:44:20.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:20 smithi148 ceph-mon[35352]: purged_snaps scrub starts 2024-09-18T12:44:20.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:20 smithi148 ceph-mon[35352]: purged_snaps scrub ok 2024-09-18T12:44:20.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:20 smithi148 ceph-mon[35352]: from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:44:20.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:20 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:44:20.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:20 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:44:20.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:20 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:20.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:20 smithi148 ceph-mon[35352]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:20.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:20 smithi148 ceph-mon[35352]: osd.2 [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229] boot 2024-09-18T12:44:20.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:20 smithi148 ceph-mon[35352]: osdmap e19: 3 total, 3 up, 3 in 2024-09-18T12:44:20.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:20 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:44:21.064 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:20 smithi078 ceph-mon[28091]: purged_snaps scrub starts 2024-09-18T12:44:21.064 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:20 smithi078 ceph-mon[28091]: purged_snaps scrub ok 2024-09-18T12:44:21.064 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:20 smithi078 ceph-mon[28091]: from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:44:21.064 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:20 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:44:21.064 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:20 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:44:21.064 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:20 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:21.064 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:20 smithi078 ceph-mon[28091]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:44:21.064 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:20 smithi078 ceph-mon[28091]: osd.2 [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229] boot 2024-09-18T12:44:21.065 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:20 smithi078 ceph-mon[28091]: osdmap e19: 3 total, 3 up, 3 in 2024-09-18T12:44:21.065 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:20 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:44:21.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:21 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-18T12:44:21.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:21 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-18T12:44:21.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:21 smithi148 ceph-mon[35352]: osdmap e20: 3 total, 3 up, 3 in 2024-09-18T12:44:21.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:21 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-18T12:44:22.104 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:21 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-18T12:44:22.104 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:21 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-18T12:44:22.104 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:21 smithi078 ceph-mon[28091]: osdmap e20: 3 total, 3 up, 3 in 2024-09-18T12:44:22.104 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:21 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-18T12:44:22.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/823596382' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5ed45d0-75b8-4f2d-8861-779790af7b1d"}]: dispatch 2024-09-18T12:44:22.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5ed45d0-75b8-4f2d-8861-779790af7b1d"}]: dispatch 2024-09-18T12:44:22.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-18T12:44:22.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5ed45d0-75b8-4f2d-8861-779790af7b1d"}]': finished 2024-09-18T12:44:22.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: osdmap e21: 4 total, 3 up, 4 in 2024-09-18T12:44:22.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:44:22.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:22.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:22.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:22.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:44:22.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:44:22.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:44:22.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:22.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:22.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:44:22.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:22 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:23.074 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: from='client.? 172.21.15.148:0/823596382' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5ed45d0-75b8-4f2d-8861-779790af7b1d"}]: dispatch 2024-09-18T12:44:23.074 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5ed45d0-75b8-4f2d-8861-779790af7b1d"}]: dispatch 2024-09-18T12:44:23.074 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-18T12:44:23.074 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5ed45d0-75b8-4f2d-8861-779790af7b1d"}]': finished 2024-09-18T12:44:23.075 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: osdmap e21: 4 total, 3 up, 4 in 2024-09-18T12:44:23.075 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:44:23.075 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:23.075 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:23.075 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:23.075 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:44:23.075 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:44:23.075 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:44:23.075 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:23.075 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:23.075 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:44:23.075 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:22 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:23.419 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69351]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T12:44:23.419 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69351]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:44:23.419 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:44:23.419 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69351]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:44:23.703 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69355]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T12:44:23.704 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69355]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:44:23.704 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:44:23.704 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69355]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:44:23.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:23.927+0000 7f259f7fe640 1 -- 172.21.15.148:0/3492880701 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f25a00577e0 con 0x7f25b0102470 2024-09-18T12:44:23.963 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69358]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T12:44:23.963 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69358]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:44:23.964 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:44:23.964 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69358]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:44:23.964 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:23 smithi078 ceph-mon[28091]: Detected new or changed devices on smithi078 2024-09-18T12:44:23.964 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:23 smithi078 ceph-mon[28091]: Adjusting osd_memory_target on smithi078 to 3946M 2024-09-18T12:44:23.964 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:23 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:44:23.964 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:23 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:23.964 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:23 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:44:23.964 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:23 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:23.964 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:23 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/1411569586' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:44:23.964 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:23 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:23.964 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:23 smithi078 ceph-mon[28091]: osdmap e22: 4 total, 3 up, 4 in 2024-09-18T12:44:23.965 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:23 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:44:24.214 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69364]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T12:44:24.214 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69361]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T12:44:24.215 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69361]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:44:24.215 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:44:24.215 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:44:23 smithi078 sudo[69361]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:44:24.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:23 smithi148 ceph-mon[35352]: Detected new or changed devices on smithi078 2024-09-18T12:44:24.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:23 smithi148 ceph-mon[35352]: Adjusting osd_memory_target on smithi078 to 3946M 2024-09-18T12:44:24.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:23 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:44:24.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:23 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:24.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:23 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:44:24.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:23 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:24.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:23 smithi148 ceph-mon[35352]: from='client.? 172.21.15.148:0/1411569586' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:44:24.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:23 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:24.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:23 smithi148 ceph-mon[35352]: osdmap e22: 4 total, 3 up, 4 in 2024-09-18T12:44:24.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:23 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:44:24.470 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69364]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:44:24.470 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:44:24.470 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69364]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:44:24.730 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69367]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T12:44:24.731 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69367]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:44:24.731 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:44:24.731 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69367]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:44:24.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69370]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T12:44:24.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69370]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:44:24.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:44:24.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69370]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:44:24.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69373]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T12:44:24.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69373]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:44:24.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:44:24.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:24 smithi078 sudo[69373]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:44:24.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:24 smithi078 ceph-mon[28091]: mgrmap e19: smithi078.ohifux(active, since 2m), standbys: smithi148.bfgshs 2024-09-18T12:44:24.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:24 smithi078 ceph-mon[28091]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T12:44:25.237 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:24 smithi148 ceph-mon[35352]: mgrmap e19: smithi078.ohifux(active, since 2m), standbys: smithi148.bfgshs 2024-09-18T12:44:25.237 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:24 smithi148 ceph-mon[35352]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T12:44:25.237 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 sudo[39691]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T12:44:25.237 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 sudo[39691]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:44:25.237 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 sudo[39691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:44:25.237 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 sudo[39691]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:44:25.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 sudo[39697]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T12:44:25.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 sudo[39697]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:44:25.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 sudo[39697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:44:25.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 sudo[39697]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:44:26.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:25 smithi078 ceph-mon[28091]: pgmap v93: 1 pgs: 1 creating+activating; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:26.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:25 smithi078 ceph-mon[28091]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T12:44:26.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:25 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:44:26.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:25 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:44:26.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:25 smithi078 ceph-mon[28091]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T12:44:26.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:25 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:44:26.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:25 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:44:26.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:25 smithi078 ceph-mon[28091]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T12:44:26.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:25 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 ceph-mon[35352]: pgmap v93: 1 pgs: 1 creating+activating; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 ceph-mon[35352]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T12:44:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:44:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:44:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 ceph-mon[35352]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T12:44:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:44:26.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:44:26.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 ceph-mon[35352]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T12:44:26.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:25 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:27.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:26 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:27.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:26 smithi078 ceph-mon[28091]: pgmap v94: 1 pgs: 1 creating+activating; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:27.315 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:26 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:27.315 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:26 smithi148 ceph-mon[35352]: pgmap v94: 1 pgs: 1 creating+activating; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:28.788 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:28 smithi148 ceph-mon[35352]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:28.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:28 smithi078 ceph-mon[28091]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:30.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:30 smithi148 ceph-mon[35352]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:30.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:30 smithi078 ceph-mon[28091]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:31.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:31 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-18T12:44:31.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:31 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:31.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:31 smithi148 ceph-mon[35352]: Deploying daemon osd.3 on smithi148 2024-09-18T12:44:31.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:31 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-18T12:44:31.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:31 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:31.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:31 smithi078 ceph-mon[28091]: Deploying daemon osd.3 on smithi148 2024-09-18T12:44:32.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:32 smithi148 ceph-mon[35352]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:32.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:32 smithi078 ceph-mon[28091]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:34.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:34 smithi148 ceph-mon[35352]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:34.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:34 smithi078 ceph-mon[28091]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:36.948 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:36 smithi148 ceph-mon[35352]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:36.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:36 smithi078 ceph-mon[28091]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:37 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:44:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:37 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:37 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:37.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:37 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:44:37.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:37 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:37.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:37 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:38.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:38 smithi148 ceph-mon[35352]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:38.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:38 smithi078 ceph-mon[28091]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:41.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:41.136+0000 7f259f7fe640 1 -- 172.21.15.148:0/3492880701 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f25b019f5c0 con 0x7f259806e230 2024-09-18T12:44:41.138 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 3 on host 'smithi148' 2024-09-18T12:44:41.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:41.138+0000 7f25b482f640 1 -- 172.21.15.148:0/3492880701 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f259806e230 msgr2=0x7f25980706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:41.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:41.138+0000 7f25b482f640 1 --2- 172.21.15.148:0/3492880701 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f259806e230 0x7f25980706f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009230 tx=0x7f25a40058d0 comp rx=0 tx=0).stop 2024-09-18T12:44:41.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:41.138+0000 7f25b482f640 1 -- 172.21.15.148:0/3492880701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25b0102470 msgr2=0x7f25b0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:41.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:41.138+0000 7f25b482f640 1 --2- 172.21.15.148:0/3492880701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25b0102470 0x7f25b0101d60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f25a000d8d0 tx=0x7f25a000dd90 comp rx=0 tx=0).stop 2024-09-18T12:44:41.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:41.139+0000 7f25b482f640 1 -- 172.21.15.148:0/3492880701 shutdown_connections 2024-09-18T12:44:41.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:41.139+0000 7f25b482f640 1 --2- 172.21.15.148:0/3492880701 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f259806e230 0x7f25980706f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:41.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:41.139+0000 7f25b482f640 1 --2- 172.21.15.148:0/3492880701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25b0104da0 0x7f25b0100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:41.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:41.139+0000 7f25b482f640 1 --2- 172.21.15.148:0/3492880701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25b0102470 0x7f25b0101d60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:41.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:41.139+0000 7f25b482f640 1 -- 172.21.15.148:0/3492880701 >> 172.21.15.148:0/3492880701 conn(0x7f25b00fc010 msgr2=0x7f25b00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:41.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:41.139+0000 7f25b482f640 1 -- 172.21.15.148:0/3492880701 shutdown_connections 2024-09-18T12:44:41.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:41.139+0000 7f25b482f640 1 -- 172.21.15.148:0/3492880701 wait complete. 2024-09-18T12:44:41.334 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:41 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:41.334 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:41 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:41.334 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:41 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:41.334 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:41 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:44:41.335 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:41 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:41.335 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:41 smithi148 ceph-mon[35352]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:41.335 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:41 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:44:41.335 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:41 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:41.335 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:41 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:44:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:41.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:41 smithi078 ceph-mon[28091]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:41.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:44:41.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:41.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:41.774 DEBUG:teuthology.orchestra.run.smithi148:osd.3> sudo journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.3.service 2024-09-18T12:44:41.776 INFO:tasks.cephadm:Deploying osd.4 on smithi148 with /dev/vg_nvme/lv_3... 2024-09-18T12:44:41.777 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-18T12:44:42.688 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:42 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:42.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:42 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:43.260 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi148/config 2024-09-18T12:44:43.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:43 smithi078 ceph-mon[28091]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:43.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:43 smithi078 ceph-mon[28091]: from='osd.3 [v2:172.21.15.148:6800/2230690563,v1:172.21.15.148:6801/2230690563]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T12:44:43.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:43 smithi078 ceph-mon[28091]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T12:44:43.556 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:43 smithi148 ceph-mon[35352]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:43.556 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:43 smithi148 ceph-mon[35352]: from='osd.3 [v2:172.21.15.148:6800/2230690563,v1:172.21.15.148:6801/2230690563]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T12:44:43.556 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:43 smithi148 ceph-mon[35352]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T12:44:43.557 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:44:43 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3[41294]: 2024-09-18T12:44:43.325+0000 7fad902ae640 -1 osd.3 0 log_to_monitors true 2024-09-18T12:44:44.688 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:44 smithi148 ceph-mon[35352]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T12:44:44.688 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:44 smithi148 ceph-mon[35352]: from='osd.3 [v2:172.21.15.148:6800/2230690563,v1:172.21.15.148:6801/2230690563]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-18T12:44:44.688 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:44 smithi148 ceph-mon[35352]: osdmap e23: 4 total, 3 up, 4 in 2024-09-18T12:44:44.689 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:44 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:44:44.689 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:44 smithi148 ceph-mon[35352]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-18T12:44:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:44 smithi078 ceph-mon[28091]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T12:44:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:44 smithi078 ceph-mon[28091]: from='osd.3 [v2:172.21.15.148:6800/2230690563,v1:172.21.15.148:6801/2230690563]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-18T12:44:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:44 smithi078 ceph-mon[28091]: osdmap e23: 4 total, 3 up, 4 in 2024-09-18T12:44:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:44 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:44:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:44 smithi078 ceph-mon[28091]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-18T12:44:45.444 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:44:45 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3[41294]: 2024-09-18T12:44:45.161+0000 7fad8ba0e640 -1 osd.3 0 waiting for initial osdmap 2024-09-18T12:44:45.444 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:44:45 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3[41294]: 2024-09-18T12:44:45.171+0000 7fad84040640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:44:45.444 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:45 smithi148 ceph-mon[35352]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-18T12:44:45.445 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:45 smithi148 ceph-mon[35352]: osdmap e24: 4 total, 3 up, 4 in 2024-09-18T12:44:45.445 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:44:45.445 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:44:45.445 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:45 smithi148 ceph-mon[35352]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:45.445 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:45.445 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:45.445 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:44:45.445 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:45.445 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:45.445 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:44:45.445 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:45.445 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:45 smithi148 ceph-mon[35352]: from='osd.3 ' entity='osd.3' 2024-09-18T12:44:45.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:45 smithi078 ceph-mon[28091]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-18T12:44:45.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:45 smithi078 ceph-mon[28091]: osdmap e24: 4 total, 3 up, 4 in 2024-09-18T12:44:45.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:44:45.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:44:45.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:45 smithi078 ceph-mon[28091]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:44:45.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:45.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:45.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:44:45.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:45.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:45.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:44:45.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:44:45.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:45 smithi078 ceph-mon[28091]: from='osd.3 ' entity='osd.3' 2024-09-18T12:44:46.451 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:44:46.475 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi148:vg_nvme/lv_3 2024-09-18T12:44:46.720 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi148/config 2024-09-18T12:44:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:46 smithi148 ceph-mon[35352]: purged_snaps scrub starts 2024-09-18T12:44:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:46 smithi148 ceph-mon[35352]: purged_snaps scrub ok 2024-09-18T12:44:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:46 smithi148 ceph-mon[35352]: Detected new or changed devices on smithi148 2024-09-18T12:44:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:46 smithi148 ceph-mon[35352]: Adjusting osd_memory_target on smithi148 to 14912M 2024-09-18T12:44:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:46 smithi148 ceph-mon[35352]: osd.3 [v2:172.21.15.148:6800/2230690563,v1:172.21.15.148:6801/2230690563] boot 2024-09-18T12:44:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:46 smithi148 ceph-mon[35352]: osdmap e25: 4 total, 4 up, 4 in 2024-09-18T12:44:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:46 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:44:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:46 smithi148 ceph-mon[35352]: osdmap e26: 4 total, 4 up, 4 in 2024-09-18T12:44:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:46 smithi078 ceph-mon[28091]: purged_snaps scrub starts 2024-09-18T12:44:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:46 smithi078 ceph-mon[28091]: purged_snaps scrub ok 2024-09-18T12:44:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:46 smithi078 ceph-mon[28091]: Detected new or changed devices on smithi148 2024-09-18T12:44:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:46 smithi078 ceph-mon[28091]: Adjusting osd_memory_target on smithi148 to 14912M 2024-09-18T12:44:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:46 smithi078 ceph-mon[28091]: osd.3 [v2:172.21.15.148:6800/2230690563,v1:172.21.15.148:6801/2230690563] boot 2024-09-18T12:44:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:46 smithi078 ceph-mon[28091]: osdmap e25: 4 total, 4 up, 4 in 2024-09-18T12:44:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:46 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:44:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:46 smithi078 ceph-mon[28091]: osdmap e26: 4 total, 4 up, 4 in 2024-09-18T12:44:47.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.176+0000 7f51e57d5640 1 -- 172.21.15.148:0/279658186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0101a60 msgr2=0x7f51e0101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:47.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.176+0000 7f51e57d5640 1 --2- 172.21.15.148:0/279658186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0101a60 0x7f51e0101ee0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009880 tx=0x7f51d002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:44:47.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.176+0000 7f51e57d5640 1 -- 172.21.15.148:0/279658186 shutdown_connections 2024-09-18T12:44:47.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.176+0000 7f51e57d5640 1 --2- 172.21.15.148:0/279658186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0101a60 0x7f51e0101ee0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:47.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.176+0000 7f51e57d5640 1 --2- 172.21.15.148:0/279658186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e0100860 0x7f51e0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:47.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.176+0000 7f51e57d5640 1 -- 172.21.15.148:0/279658186 >> 172.21.15.148:0/279658186 conn(0x7f51e00fc010 msgr2=0x7f51e00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:44:47.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.176+0000 7f51e57d5640 1 -- 172.21.15.148:0/279658186 shutdown_connections 2024-09-18T12:44:47.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.176+0000 7f51e57d5640 1 -- 172.21.15.148:0/279658186 wait complete. 2024-09-18T12:44:47.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.176+0000 7f51e57d5640 1 Processor -- start 2024-09-18T12:44:47.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.176+0000 7f51e57d5640 1 -- start start 2024-09-18T12:44:47.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51e57d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e0100860 0x7f51e0197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:47.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51e57d5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0101a60 0x7f51e0197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:47.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51e57d5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f51e0109720 con 0x7f51e0100860 2024-09-18T12:44:47.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51e57d5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01095a0 con 0x7f51e0101a60 2024-09-18T12:44:47.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51de7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0101a60 0x7f51e0197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:47.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51de7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0101a60 0x7f51e0197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51684/0 (socket says 172.21.15.148:51684) 2024-09-18T12:44:47.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51de7fc640 1 -- 172.21.15.148:0/4110582939 learned_addr learned my addr 172.21.15.148:0/4110582939 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-18T12:44:47.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51deffd640 1 --2- 172.21.15.148:0/4110582939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e0100860 0x7f51e0197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:47.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51de7fc640 1 -- 172.21.15.148:0/4110582939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e0100860 msgr2=0x7f51e0197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:44:47.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51de7fc640 1 --2- 172.21.15.148:0/4110582939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e0100860 0x7f51e0197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:44:47.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51de7fc640 1 -- 172.21.15.148:0/4110582939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e0198120 con 0x7f51e0101a60 2024-09-18T12:44:47.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51de7fc640 1 --2- 172.21.15.148:0/4110582939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0101a60 0x7f51e0197aa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f51d0006010 tx=0x7f51d00048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:47.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51d7fff640 1 -- 172.21.15.148:0/4110582939 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f51d003f070 con 0x7f51e0101a60 2024-09-18T12:44:47.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51e57d5640 1 -- 172.21.15.148:0/4110582939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e019cb00 con 0x7f51e0101a60 2024-09-18T12:44:47.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51d7fff640 1 -- 172.21.15.148:0/4110582939 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51d00044d0 con 0x7f51e0101a60 2024-09-18T12:44:47.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51d7fff640 1 -- 172.21.15.148:0/4110582939 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f51d0035030 con 0x7f51e0101a60 2024-09-18T12:44:47.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.177+0000 7f51e57d5640 1 -- 172.21.15.148:0/4110582939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e019d110 con 0x7f51e0101a60 2024-09-18T12:44:47.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.178+0000 7f51e57d5640 1 -- 172.21.15.148:0/4110582939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e0100c40 con 0x7f51e0101a60 2024-09-18T12:44:47.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.179+0000 7f51d7fff640 1 -- 172.21.15.148:0/4110582939 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f51d0042070 con 0x7f51e0101a60 2024-09-18T12:44:47.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.179+0000 7f51d7fff640 1 --2- 172.21.15.148:0/4110582939 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f51cc06e2b0 0x7f51cc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:44:47.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.179+0000 7f51d7fff640 1 -- 172.21.15.148:0/4110582939 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3803+0+0 (secure 0 0 0) 0x7f51d00ae860 con 0x7f51e0101a60 2024-09-18T12:44:47.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.180+0000 7f51deffd640 1 --2- 172.21.15.148:0/4110582939 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f51cc06e2b0 0x7f51cc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:44:47.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.180+0000 7f51deffd640 1 --2- 172.21.15.148:0/4110582939 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f51cc06e2b0 0x7f51cc070770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f51e01018c0 tx=0x7f51c8008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:44:47.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.184+0000 7f51d7fff640 1 -- 172.21.15.148:0/4110582939 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51d007c840 con 0x7f51e0101a60 2024-09-18T12:44:47.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:44:47.356+0000 7f51e57d5640 1 -- 172.21.15.148:0/4110582939 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f51e006a3e0 con 0x7f51cc06e2b0 2024-09-18T12:44:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:47 smithi148 ceph-mon[35352]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 521 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:44:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:47 smithi148 ceph-mon[35352]: osdmap e27: 4 total, 4 up, 4 in 2024-09-18T12:44:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:47 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:44:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:47 smithi078 ceph-mon[28091]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 521 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:44:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:47 smithi078 ceph-mon[28091]: osdmap e27: 4 total, 4 up, 4 in 2024-09-18T12:44:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:47 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:44:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:48 smithi148 ceph-mon[35352]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:44:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:48 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:44:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:48 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:48 smithi148 ceph-mon[35352]: osdmap e28: 4 total, 4 up, 4 in 2024-09-18T12:44:48.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:48 smithi078 ceph-mon[28091]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:44:48.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:48 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:44:48.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:48 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:48.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:48 smithi078 ceph-mon[28091]: osdmap e28: 4 total, 4 up, 4 in 2024-09-18T12:44:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:49 smithi148 ceph-mon[35352]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-18T12:44:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:49 smithi148 ceph-mon[35352]: osdmap e29: 4 total, 4 up, 4 in 2024-09-18T12:44:49.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:49 smithi078 ceph-mon[28091]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-18T12:44:49.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:49 smithi078 ceph-mon[28091]: osdmap e29: 4 total, 4 up, 4 in 2024-09-18T12:44:50.630 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:50 smithi148 ceph-mon[35352]: from='client.? 172.21.15.148:0/3088184220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cd45fe-7682-4eb6-9b29-ab7ff324f7be"}]: dispatch 2024-09-18T12:44:50.631 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:50 smithi148 ceph-mon[35352]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cd45fe-7682-4eb6-9b29-ab7ff324f7be"}]: dispatch 2024-09-18T12:44:50.631 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:50 smithi148 ceph-mon[35352]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97cd45fe-7682-4eb6-9b29-ab7ff324f7be"}]': finished 2024-09-18T12:44:50.631 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:50 smithi148 ceph-mon[35352]: osdmap e30: 5 total, 4 up, 5 in 2024-09-18T12:44:50.631 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:50 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:44:50.631 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:50 smithi148 ceph-mon[35352]: from='client.? 172.21.15.148:0/4055609993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:44:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:50 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/3088184220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cd45fe-7682-4eb6-9b29-ab7ff324f7be"}]: dispatch 2024-09-18T12:44:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:50 smithi078 ceph-mon[28091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cd45fe-7682-4eb6-9b29-ab7ff324f7be"}]: dispatch 2024-09-18T12:44:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:50 smithi078 ceph-mon[28091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97cd45fe-7682-4eb6-9b29-ab7ff324f7be"}]': finished 2024-09-18T12:44:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:50 smithi078 ceph-mon[28091]: osdmap e30: 5 total, 4 up, 5 in 2024-09-18T12:44:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:50 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:44:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:50 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/4055609993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:44:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:51 smithi148 ceph-mon[35352]: pgmap v114: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-18T12:44:51.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:51 smithi078 ceph-mon[28091]: pgmap v114: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-18T12:44:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:52 smithi148 ceph-mon[35352]: pgmap v115: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-18T12:44:52.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:52 smithi078 ceph-mon[28091]: pgmap v115: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-18T12:44:54.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:54 smithi148 ceph-mon[35352]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:44:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:54 smithi078 ceph-mon[28091]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:44:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:56 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:56 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:57.558 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:57 smithi148 ceph-mon[35352]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:44:57.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:57 smithi078 ceph-mon[28091]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:44:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:58 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-18T12:44:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:58 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:58.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:58 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-18T12:44:58.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:58 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:59 smithi148 ceph-mon[35352]: Deploying daemon osd.4 on smithi148 2024-09-18T12:44:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:44:59 smithi148 ceph-mon[35352]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:44:59.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:59 smithi078 ceph-mon[28091]: Deploying daemon osd.4 on smithi148 2024-09-18T12:44:59.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:44:59 smithi078 ceph-mon[28091]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:45:00.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:00 smithi078 ceph-mon[28091]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:45:00.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:00 smithi148 ceph-mon[35352]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:45:02.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:02 smithi148 ceph-mon[35352]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:45:02.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:02 smithi078 ceph-mon[28091]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:45:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:04 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:04 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:04 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:04 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:04 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:04 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:05.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:05 smithi078 ceph-mon[28091]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:45:05.784 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:05 smithi148 ceph-mon[35352]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:45:06.832 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:06 smithi148 ceph-mon[35352]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:45:06.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:06 smithi078 ceph-mon[28091]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:45:08.286 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 4 on host 'smithi148' 2024-09-18T12:45:08.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:08.285+0000 7f51d7fff640 1 -- 172.21.15.148:0/4110582939 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f51e006a3e0 con 0x7f51cc06e2b0 2024-09-18T12:45:08.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:08.287+0000 7f51e57d5640 1 -- 172.21.15.148:0/4110582939 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f51cc06e2b0 msgr2=0x7f51cc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:08.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:08.287+0000 7f51e57d5640 1 --2- 172.21.15.148:0/4110582939 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f51cc06e2b0 0x7f51cc070770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f51e01018c0 tx=0x7f51c8008040 comp rx=0 tx=0).stop 2024-09-18T12:45:08.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:08.287+0000 7f51e57d5640 1 -- 172.21.15.148:0/4110582939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0101a60 msgr2=0x7f51e0197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:08.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:08.287+0000 7f51e57d5640 1 --2- 172.21.15.148:0/4110582939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0101a60 0x7f51e0197aa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f51d0006010 tx=0x7f51d00048f0 comp rx=0 tx=0).stop 2024-09-18T12:45:08.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:08.287+0000 7f51e57d5640 1 -- 172.21.15.148:0/4110582939 shutdown_connections 2024-09-18T12:45:08.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:08.287+0000 7f51e57d5640 1 --2- 172.21.15.148:0/4110582939 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f51cc06e2b0 0x7f51cc070770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:08.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:08.287+0000 7f51e57d5640 1 --2- 172.21.15.148:0/4110582939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0101a60 0x7f51e0197aa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:08.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:08.287+0000 7f51e57d5640 1 --2- 172.21.15.148:0/4110582939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e0100860 0x7f51e0197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:08.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:08.287+0000 7f51e57d5640 1 -- 172.21.15.148:0/4110582939 >> 172.21.15.148:0/4110582939 conn(0x7f51e00fc010 msgr2=0x7f51e0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:08.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:08.287+0000 7f51e57d5640 1 -- 172.21.15.148:0/4110582939 shutdown_connections 2024-09-18T12:45:08.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:08.287+0000 7f51e57d5640 1 -- 172.21.15.148:0/4110582939 wait complete. 2024-09-18T12:45:08.867 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:08 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:08.867 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:08 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:08.867 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:08 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:08.867 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:08 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:08.867 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:08 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:08.867 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:08 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:08.867 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:08 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:08.867 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:08 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:08.868 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:08 smithi148 ceph-mon[35352]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:45:08.893 DEBUG:teuthology.orchestra.run.smithi148:osd.4> sudo journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.4.service 2024-09-18T12:45:08.895 INFO:tasks.cephadm:Deploying osd.5 on smithi148 with /dev/vg_nvme/lv_2... 2024-09-18T12:45:08.895 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-18T12:45:08.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:08 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:08.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:08 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:08.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:08 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:08.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:08 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:08.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:08 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:08.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:08 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:08.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:08 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:08.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:08 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:08.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:08 smithi078 ceph-mon[28091]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:45:10.556 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi148/config 2024-09-18T12:45:10.788 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:10 smithi148 ceph-mon[35352]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:45:10.789 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:45:10 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[48135]: 2024-09-18T12:45:10.689+0000 7fd9a3381640 -1 osd.4 0 log_to_monitors true 2024-09-18T12:45:10.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:10 smithi078 ceph-mon[28091]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:45:11.894 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:11 smithi148 ceph-mon[35352]: from='osd.4 [v2:172.21.15.148:6808/2544176191,v1:172.21.15.148:6809/2544176191]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T12:45:11.894 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:11 smithi148 ceph-mon[35352]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T12:45:11.894 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:11 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:11.895 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:11 smithi148 ceph-mon[35352]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T12:45:11.895 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:11 smithi148 ceph-mon[35352]: osdmap e31: 5 total, 4 up, 5 in 2024-09-18T12:45:11.895 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:11 smithi148 ceph-mon[35352]: from='osd.4 [v2:172.21.15.148:6808/2544176191,v1:172.21.15.148:6809/2544176191]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-18T12:45:11.895 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:11 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:45:11.895 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:11 smithi148 ceph-mon[35352]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-18T12:45:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:11 smithi078 ceph-mon[28091]: from='osd.4 [v2:172.21.15.148:6808/2544176191,v1:172.21.15.148:6809/2544176191]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T12:45:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:11 smithi078 ceph-mon[28091]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T12:45:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:11 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:11 smithi078 ceph-mon[28091]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T12:45:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:11 smithi078 ceph-mon[28091]: osdmap e31: 5 total, 4 up, 5 in 2024-09-18T12:45:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:11 smithi078 ceph-mon[28091]: from='osd.4 [v2:172.21.15.148:6808/2544176191,v1:172.21.15.148:6809/2544176191]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-18T12:45:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:11 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:45:11.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:11 smithi078 ceph-mon[28091]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-18T12:45:12.778 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[48135]: 2024-09-18T12:45:12.666+0000 7fd99eae1640 -1 osd.4 0 waiting for initial osdmap 2024-09-18T12:45:12.779 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[48135]: 2024-09-18T12:45:12.672+0000 7fd99b11b640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:45:13.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-mon[35352]: Detected new or changed devices on smithi148 2024-09-18T12:45:13.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:13.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:13.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:13.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:13.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-mon[35352]: Adjusting osd_memory_target on smithi148 to 7456M 2024-09-18T12:45:13.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:13.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:13.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:13.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:13.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-mon[35352]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:45:13.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-mon[35352]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-18T12:45:13.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-mon[35352]: osdmap e32: 5 total, 4 up, 5 in 2024-09-18T12:45:13.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:45:13.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:12 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:45:13.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:12 smithi078 ceph-mon[28091]: Detected new or changed devices on smithi148 2024-09-18T12:45:13.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:12 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:13.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:12 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:13.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:12 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:13.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:12 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:13.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:12 smithi078 ceph-mon[28091]: Adjusting osd_memory_target on smithi148 to 7456M 2024-09-18T12:45:13.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:12 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:13.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:12 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:13.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:12 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:13.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:12 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:13.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:12 smithi078 ceph-mon[28091]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:45:13.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:12 smithi078 ceph-mon[28091]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-18T12:45:13.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:12 smithi078 ceph-mon[28091]: osdmap e32: 5 total, 4 up, 5 in 2024-09-18T12:45:13.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:12 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:45:13.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:12 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:45:13.521 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-18T12:45:13.546 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi148:vg_nvme/lv_2 2024-09-18T12:45:13.795 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi148/config 2024-09-18T12:45:14.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.230+0000 7f526131c640 1 -- 172.21.15.148:0/76345873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f525c101a60 msgr2=0x7f525c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:14.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.230+0000 7f526131c640 1 --2- 172.21.15.148:0/76345873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f525c101a60 0x7f525c101ee0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5244009880 tx=0x7f524402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:45:14.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.230+0000 7f526131c640 1 -- 172.21.15.148:0/76345873 shutdown_connections 2024-09-18T12:45:14.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.230+0000 7f526131c640 1 --2- 172.21.15.148:0/76345873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f525c101a60 0x7f525c101ee0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:14.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.230+0000 7f526131c640 1 --2- 172.21.15.148:0/76345873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f525c100860 0x7f525c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:14.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.230+0000 7f526131c640 1 -- 172.21.15.148:0/76345873 >> 172.21.15.148:0/76345873 conn(0x7f525c0fc010 msgr2=0x7f525c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:14.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.230+0000 7f526131c640 1 -- 172.21.15.148:0/76345873 shutdown_connections 2024-09-18T12:45:14.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.230+0000 7f526131c640 1 -- 172.21.15.148:0/76345873 wait complete. 2024-09-18T12:45:14.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.231+0000 7f526131c640 1 Processor -- start 2024-09-18T12:45:14.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.231+0000 7f526131c640 1 -- start start 2024-09-18T12:45:14.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.231+0000 7f526131c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f525c100860 0x7f525c1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:14.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.231+0000 7f526131c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f525c101a60 0x7f525c1968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:14.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.231+0000 7f526131c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1096a0 con 0x7f525c100860 2024-09-18T12:45:14.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.231+0000 7f526131c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f525c109520 con 0x7f525c101a60 2024-09-18T12:45:14.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.232+0000 7f5253fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f525c101a60 0x7f525c1968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:14.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.232+0000 7f5253fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f525c101a60 0x7f525c1968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54210/0 (socket says 172.21.15.148:54210) 2024-09-18T12:45:14.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.232+0000 7f5253fff640 1 -- 172.21.15.148:0/356435451 learned_addr learned my addr 172.21.15.148:0/356435451 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-18T12:45:14.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.232+0000 7f525affd640 1 --2- 172.21.15.148:0/356435451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f525c100860 0x7f525c1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:14.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.232+0000 7f5253fff640 1 -- 172.21.15.148:0/356435451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f525c100860 msgr2=0x7f525c1963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:14.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.232+0000 7f5253fff640 1 --2- 172.21.15.148:0/356435451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f525c100860 0x7f525c1963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:14.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.232+0000 7f5253fff640 1 -- 172.21.15.148:0/356435451 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c196f60 con 0x7f525c101a60 2024-09-18T12:45:14.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.232+0000 7f5253fff640 1 --2- 172.21.15.148:0/356435451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f525c101a60 0x7f525c1968e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5244006010 tx=0x7f52440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:14.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.232+0000 7f5258ff9640 1 -- 172.21.15.148:0/356435451 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f524403f070 con 0x7f525c101a60 2024-09-18T12:45:14.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.232+0000 7f526131c640 1 -- 172.21.15.148:0/356435451 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c19b940 con 0x7f525c101a60 2024-09-18T12:45:14.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.232+0000 7f5258ff9640 1 -- 172.21.15.148:0/356435451 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5244004ac0 con 0x7f525c101a60 2024-09-18T12:45:14.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.232+0000 7f5258ff9640 1 -- 172.21.15.148:0/356435451 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5244035030 con 0x7f525c101a60 2024-09-18T12:45:14.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.232+0000 7f526131c640 1 -- 172.21.15.148:0/356435451 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c19bed0 con 0x7f525c101a60 2024-09-18T12:45:14.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.233+0000 7f526131c640 1 -- 172.21.15.148:0/356435451 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525c100c60 con 0x7f525c101a60 2024-09-18T12:45:14.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.234+0000 7f5258ff9640 1 -- 172.21.15.148:0/356435451 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5244042070 con 0x7f525c101a60 2024-09-18T12:45:14.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.234+0000 7f5258ff9640 1 --2- 172.21.15.148:0/356435451 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f524806e2b0 0x7f5248070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:14.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.234+0000 7f5258ff9640 1 -- 172.21.15.148:0/356435451 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4206+0+0 (secure 0 0 0) 0x7f52440ae830 con 0x7f525c101a60 2024-09-18T12:45:14.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.234+0000 7f525affd640 1 --2- 172.21.15.148:0/356435451 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f524806e2b0 0x7f5248070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:14.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.235+0000 7f525affd640 1 --2- 172.21.15.148:0/356435451 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f524806e2b0 0x7f5248070770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f524c005fd0 tx=0x7f524c00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:14.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.238+0000 7f5258ff9640 1 -- 172.21.15.148:0/356435451 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5244080330 con 0x7f525c101a60 2024-09-18T12:45:14.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:14.413+0000 7f526131c640 1 -- 172.21.15.148:0/356435451 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f525c062630 con 0x7f524806e2b0 2024-09-18T12:45:14.936 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:14 smithi148 ceph-mon[35352]: purged_snaps scrub starts 2024-09-18T12:45:14.936 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:14 smithi148 ceph-mon[35352]: purged_snaps scrub ok 2024-09-18T12:45:14.936 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:14 smithi148 ceph-mon[35352]: osd.4 [v2:172.21.15.148:6808/2544176191,v1:172.21.15.148:6809/2544176191] boot 2024-09-18T12:45:14.937 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:14 smithi148 ceph-mon[35352]: osdmap e33: 5 total, 5 up, 5 in 2024-09-18T12:45:14.937 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:45:14.937 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:14 smithi148 ceph-mon[35352]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:45:14.937 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:45:14.937 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:45:14.937 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:14 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:14.937 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:14 smithi148 ceph-mon[35352]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:14 smithi078 ceph-mon[28091]: purged_snaps scrub starts 2024-09-18T12:45:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:14 smithi078 ceph-mon[28091]: purged_snaps scrub ok 2024-09-18T12:45:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:14 smithi078 ceph-mon[28091]: osd.4 [v2:172.21.15.148:6808/2544176191,v1:172.21.15.148:6809/2544176191] boot 2024-09-18T12:45:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:14 smithi078 ceph-mon[28091]: osdmap e33: 5 total, 5 up, 5 in 2024-09-18T12:45:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:45:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:14 smithi078 ceph-mon[28091]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:45:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:45:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:45:14.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:14 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:14.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:14 smithi078 ceph-mon[28091]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:15.789 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:15 smithi148 ceph-mon[35352]: osdmap e34: 5 total, 5 up, 5 in 2024-09-18T12:45:15.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:15 smithi078 ceph-mon[28091]: osdmap e34: 5 total, 5 up, 5 in 2024-09-18T12:45:16.970 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:16 smithi148 ceph-mon[35352]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:16.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:16 smithi078 ceph-mon[28091]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:17.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:17 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/3999012093' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65e5086e-6f88-4760-bf6f-6f9bace7c3f4"}]: dispatch 2024-09-18T12:45:17.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:17 smithi078 ceph-mon[28091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65e5086e-6f88-4760-bf6f-6f9bace7c3f4"}]: dispatch 2024-09-18T12:45:17.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:17 smithi078 ceph-mon[28091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65e5086e-6f88-4760-bf6f-6f9bace7c3f4"}]': finished 2024-09-18T12:45:17.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:17 smithi078 ceph-mon[28091]: osdmap e35: 6 total, 5 up, 6 in 2024-09-18T12:45:17.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:17 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:45:17.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:17 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/4124900828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:45:18.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:17 smithi148 ceph-mon[35352]: from='client.? 172.21.15.148:0/3999012093' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65e5086e-6f88-4760-bf6f-6f9bace7c3f4"}]: dispatch 2024-09-18T12:45:18.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:17 smithi148 ceph-mon[35352]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65e5086e-6f88-4760-bf6f-6f9bace7c3f4"}]: dispatch 2024-09-18T12:45:18.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:17 smithi148 ceph-mon[35352]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65e5086e-6f88-4760-bf6f-6f9bace7c3f4"}]': finished 2024-09-18T12:45:18.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:17 smithi148 ceph-mon[35352]: osdmap e35: 6 total, 5 up, 6 in 2024-09-18T12:45:18.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:17 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:45:18.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:17 smithi148 ceph-mon[35352]: from='client.? 172.21.15.148:0/4124900828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:45:18.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:18 smithi148 ceph-mon[35352]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:18.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:18 smithi078 ceph-mon[28091]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:20.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:20 smithi148 ceph-mon[35352]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:20.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:20 smithi078 ceph-mon[28091]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:22.753 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:22 smithi148 ceph-mon[35352]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:22.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:22 smithi078 ceph-mon[28091]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:24.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:24 smithi148 ceph-mon[35352]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:24.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:24 smithi078 ceph-mon[28091]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:25.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:25 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-18T12:45:25.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:25 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:25.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:25 smithi148 ceph-mon[35352]: Deploying daemon osd.5 on smithi148 2024-09-18T12:45:25.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:25 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-18T12:45:25.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:25 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:25.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:25 smithi078 ceph-mon[28091]: Deploying daemon osd.5 on smithi148 2024-09-18T12:45:26.913 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:26 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:26.913 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:26 smithi148 ceph-mon[35352]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:26.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:26 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:26.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:26 smithi078 ceph-mon[28091]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:28.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:28 smithi148 ceph-mon[35352]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:28.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:28 smithi078 ceph-mon[28091]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:30.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:30 smithi148 ceph-mon[35352]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:30.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:30 smithi078 ceph-mon[28091]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:31.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:31 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:31.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:31 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:31.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:31 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:31.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:31 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:31.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:31 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:31.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:31 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:32.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:32 smithi148 ceph-mon[35352]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:32.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:32 smithi078 ceph-mon[28091]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:34.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:34.800+0000 7f5258ff9640 1 -- 172.21.15.148:0/356435451 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f525c062630 con 0x7f524806e2b0 2024-09-18T12:45:34.803 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 5 on host 'smithi148' 2024-09-18T12:45:34.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:34.803+0000 7f526131c640 1 -- 172.21.15.148:0/356435451 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f524806e2b0 msgr2=0x7f5248070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:34.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:34.803+0000 7f526131c640 1 --2- 172.21.15.148:0/356435451 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f524806e2b0 0x7f5248070770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f524c005fd0 tx=0x7f524c00b390 comp rx=0 tx=0).stop 2024-09-18T12:45:34.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:34.803+0000 7f526131c640 1 -- 172.21.15.148:0/356435451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f525c101a60 msgr2=0x7f525c1968e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:34.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:34.803+0000 7f526131c640 1 --2- 172.21.15.148:0/356435451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f525c101a60 0x7f525c1968e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5244006010 tx=0x7f52440046c0 comp rx=0 tx=0).stop 2024-09-18T12:45:34.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:34.803+0000 7f526131c640 1 -- 172.21.15.148:0/356435451 shutdown_connections 2024-09-18T12:45:34.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:34.803+0000 7f526131c640 1 --2- 172.21.15.148:0/356435451 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f524806e2b0 0x7f5248070770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:34.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:34.803+0000 7f526131c640 1 --2- 172.21.15.148:0/356435451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f525c101a60 0x7f525c1968e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:34.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:34.803+0000 7f526131c640 1 --2- 172.21.15.148:0/356435451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f525c100860 0x7f525c1963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:34.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:34.803+0000 7f526131c640 1 -- 172.21.15.148:0/356435451 >> 172.21.15.148:0/356435451 conn(0x7f525c0fc010 msgr2=0x7f525c104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:34.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:34.803+0000 7f526131c640 1 -- 172.21.15.148:0/356435451 shutdown_connections 2024-09-18T12:45:34.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:34.803+0000 7f526131c640 1 -- 172.21.15.148:0/356435451 wait complete. 2024-09-18T12:45:34.813 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:34 smithi148 ceph-mon[35352]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:34.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:34 smithi078 ceph-mon[28091]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:35.388 DEBUG:teuthology.orchestra.run.smithi148:osd.5> sudo journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.5.service 2024-09-18T12:45:35.391 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-18T12:45:35.391 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-18T12:45:35.654 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:45:36.058 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:35 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:36.058 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:35 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:36.059 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:35 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:36.059 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:35 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:36.083 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:35 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:36.083 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:35 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:36.083 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:35 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:36.083 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:35 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:36.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.137+0000 7f0d25b70640 1 -- 172.21.15.78:0/699884637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d200fffe0 msgr2=0x7f0d201003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:36.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.137+0000 7f0d25b70640 1 --2- 172.21.15.78:0/699884637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d200fffe0 0x7f0d201003e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009880 tx=0x7f0d1002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:45:36.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.137+0000 7f0d25b70640 1 -- 172.21.15.78:0/699884637 shutdown_connections 2024-09-18T12:45:36.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.137+0000 7f0d25b70640 1 --2- 172.21.15.78:0/699884637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d201011e0 0x7f0d20101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:36.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.137+0000 7f0d25b70640 1 --2- 172.21.15.78:0/699884637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d200fffe0 0x7f0d201003e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:36.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.137+0000 7f0d25b70640 1 -- 172.21.15.78:0/699884637 >> 172.21.15.78:0/699884637 conn(0x7f0d200fb770 msgr2=0x7f0d200fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:36.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.137+0000 7f0d25b70640 1 -- 172.21.15.78:0/699884637 shutdown_connections 2024-09-18T12:45:36.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.137+0000 7f0d25b70640 1 -- 172.21.15.78:0/699884637 wait complete. 2024-09-18T12:45:36.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.138+0000 7f0d25b70640 1 Processor -- start 2024-09-18T12:45:36.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.138+0000 7f0d25b70640 1 -- start start 2024-09-18T12:45:36.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.138+0000 7f0d25b70640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d200fffe0 0x7f0d20108670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:36.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.138+0000 7f0d25b70640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d201011e0 0x7f0d2019c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:36.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.138+0000 7f0d25b70640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0d201096a0 con 0x7f0d201011e0 2024-09-18T12:45:36.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.138+0000 7f0d25b70640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0d20109520 con 0x7f0d200fffe0 2024-09-18T12:45:36.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.138+0000 7f0d1effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d201011e0 0x7f0d2019c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:36.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.138+0000 7f0d1effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d201011e0 0x7f0d2019c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36836/0 (socket says 172.21.15.78:36836) 2024-09-18T12:45:36.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.138+0000 7f0d1effd640 1 -- 172.21.15.78:0/131564226 learned_addr learned my addr 172.21.15.78:0/131564226 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:45:36.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.138+0000 7f0d1f7fe640 1 --2- 172.21.15.78:0/131564226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d200fffe0 0x7f0d20108670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:36.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.138+0000 7f0d1effd640 1 -- 172.21.15.78:0/131564226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d200fffe0 msgr2=0x7f0d20108670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:36.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.138+0000 7f0d1effd640 1 --2- 172.21.15.78:0/131564226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d200fffe0 0x7f0d20108670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:36.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.138+0000 7f0d1effd640 1 -- 172.21.15.78:0/131564226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2019c820 con 0x7f0d201011e0 2024-09-18T12:45:36.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.139+0000 7f0d1effd640 1 --2- 172.21.15.78:0/131564226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d201011e0 0x7f0d2019c260 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400d6f0 tx=0x7f0d1400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:36.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.139+0000 7f0d1cff9640 1 -- 172.21.15.78:0/131564226 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d14017070 con 0x7f0d201011e0 2024-09-18T12:45:36.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.139+0000 7f0d25b70640 1 -- 172.21.15.78:0/131564226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2019cb10 con 0x7f0d201011e0 2024-09-18T12:45:36.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.139+0000 7f0d1cff9640 1 -- 172.21.15.78:0/131564226 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d1400de00 con 0x7f0d201011e0 2024-09-18T12:45:36.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.139+0000 7f0d1cff9640 1 -- 172.21.15.78:0/131564226 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d14004bb0 con 0x7f0d201011e0 2024-09-18T12:45:36.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.139+0000 7f0d25b70640 1 -- 172.21.15.78:0/131564226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d2019d0a0 con 0x7f0d201011e0 2024-09-18T12:45:36.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.140+0000 7f0d25b70640 1 -- 172.21.15.78:0/131564226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d201003e0 con 0x7f0d201011e0 2024-09-18T12:45:36.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.140+0000 7f0d1cff9640 1 -- 172.21.15.78:0/131564226 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0d14009a30 con 0x7f0d201011e0 2024-09-18T12:45:36.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.141+0000 7f0d1cff9640 1 --2- 172.21.15.78:0/131564226 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f0d0806e310 0x7f0d080707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:36.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.141+0000 7f0d1cff9640 1 -- 172.21.15.78:0/131564226 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4321+0+0 (secure 0 0 0) 0x7f0d1408d870 con 0x7f0d201011e0 2024-09-18T12:45:36.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.141+0000 7f0d1f7fe640 1 --2- 172.21.15.78:0/131564226 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f0d0806e310 0x7f0d080707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:36.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.141+0000 7f0d1f7fe640 1 --2- 172.21.15.78:0/131564226 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f0d0806e310 0x7f0d080707d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009230 tx=0x7f0d100058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:36.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.145+0000 7f0d1cff9640 1 -- 172.21.15.78:0/131564226 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d1405f2e0 con 0x7f0d201011e0 2024-09-18T12:45:36.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.310+0000 7f0d25b70640 1 -- 172.21.15.78:0/131564226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f0d20062fb0 con 0x7f0d201011e0 2024-09-18T12:45:36.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.311+0000 7f0d1cff9640 1 -- 172.21.15.78:0/131564226 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v35) ==== 74+0+130 (secure 0 0 0) 0x7f0d14063b10 con 0x7f0d201011e0 2024-09-18T12:45:36.313 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:45:36.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.313+0000 7f0d25b70640 1 -- 172.21.15.78:0/131564226 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f0d0806e310 msgr2=0x7f0d080707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:36.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.313+0000 7f0d25b70640 1 --2- 172.21.15.78:0/131564226 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f0d0806e310 0x7f0d080707d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009230 tx=0x7f0d100058d0 comp rx=0 tx=0).stop 2024-09-18T12:45:36.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.313+0000 7f0d25b70640 1 -- 172.21.15.78:0/131564226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d201011e0 msgr2=0x7f0d2019c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:36.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.313+0000 7f0d25b70640 1 --2- 172.21.15.78:0/131564226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d201011e0 0x7f0d2019c260 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400d6f0 tx=0x7f0d1400dbb0 comp rx=0 tx=0).stop 2024-09-18T12:45:36.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.313+0000 7f0d25b70640 1 -- 172.21.15.78:0/131564226 shutdown_connections 2024-09-18T12:45:36.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.313+0000 7f0d25b70640 1 --2- 172.21.15.78:0/131564226 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f0d0806e310 0x7f0d080707d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:36.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.313+0000 7f0d25b70640 1 --2- 172.21.15.78:0/131564226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d201011e0 0x7f0d2019c260 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:36.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.313+0000 7f0d25b70640 1 --2- 172.21.15.78:0/131564226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d200fffe0 0x7f0d20108670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:36.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.313+0000 7f0d25b70640 1 -- 172.21.15.78:0/131564226 >> 172.21.15.78:0/131564226 conn(0x7f0d200fb770 msgr2=0x7f0d20104740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:36.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.313+0000 7f0d25b70640 1 -- 172.21.15.78:0/131564226 shutdown_connections 2024-09-18T12:45:36.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:36.313+0000 7f0d25b70640 1 -- 172.21.15.78:0/131564226 wait complete. 2024-09-18T12:45:36.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:36 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/131564226' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:45:36.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:36 smithi148 ceph-mon[35352]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:37.029 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":35,"num_osds":6,"num_up_osds":5,"osd_up_since":1726663513,"num_in_osds":6,"osd_in_since":1726663516,"num_remapped_pgs":0} 2024-09-18T12:45:37.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:36 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/131564226' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:45:37.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:36 smithi078 ceph-mon[28091]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:37.663 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:45:37 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[54886]: 2024-09-18T12:45:37.341+0000 7f44159f7640 -1 osd.5 0 log_to_monitors true 2024-09-18T12:45:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:37 smithi148 ceph-mon[35352]: from='osd.5 [v2:172.21.15.148:6816/3949254394,v1:172.21.15.148:6817/3949254394]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T12:45:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:37 smithi148 ceph-mon[35352]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T12:45:38.029 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-18T12:45:38.057 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:37 smithi078 ceph-mon[28091]: from='osd.5 [v2:172.21.15.148:6816/3949254394,v1:172.21.15.148:6817/3949254394]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T12:45:38.057 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:37 smithi078 ceph-mon[28091]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T12:45:38.288 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:45:38.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.814+0000 7fb7352ed640 1 -- 172.21.15.78:0/2180825412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb730102b70 msgr2=0x7fb730102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:38.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.814+0000 7fb7352ed640 1 --2- 172.21.15.78:0/2180825412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb730102b70 0x7fb730102ff0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb724009880 tx=0x7fb72402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:45:38.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.814+0000 7fb7352ed640 1 -- 172.21.15.78:0/2180825412 shutdown_connections 2024-09-18T12:45:38.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.814+0000 7fb7352ed640 1 --2- 172.21.15.78:0/2180825412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb730102b70 0x7fb730102ff0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:38.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.814+0000 7fb7352ed640 1 --2- 172.21.15.78:0/2180825412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730101970 0x7fb730101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:38.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.814+0000 7fb7352ed640 1 -- 172.21.15.78:0/2180825412 >> 172.21.15.78:0/2180825412 conn(0x7fb7300fd140 msgr2=0x7fb7300ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:38.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.814+0000 7fb7352ed640 1 -- 172.21.15.78:0/2180825412 shutdown_connections 2024-09-18T12:45:38.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.814+0000 7fb7352ed640 1 -- 172.21.15.78:0/2180825412 wait complete. 2024-09-18T12:45:38.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.814+0000 7fb7352ed640 1 Processor -- start 2024-09-18T12:45:38.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.815+0000 7fb7352ed640 1 -- start start 2024-09-18T12:45:38.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.816+0000 7fb7352ed640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb730101970 0x7fb730075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:38.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.816+0000 7fb7352ed640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730102b70 0x7fb7300745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:38.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.816+0000 7fb7352ed640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb73010a790 con 0x7fb730101970 2024-09-18T12:45:38.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.816+0000 7fb7352ed640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb73010a610 con 0x7fb730102b70 2024-09-18T12:45:38.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.816+0000 7fb72effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb730101970 0x7fb730075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:38.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.816+0000 7fb72effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb730101970 0x7fb730075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36846/0 (socket says 172.21.15.78:36846) 2024-09-18T12:45:38.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.816+0000 7fb72effd640 1 -- 172.21.15.78:0/1184861552 learned_addr learned my addr 172.21.15.78:0/1184861552 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.816+0000 7fb72e7fc640 1 --2- 172.21.15.78:0/1184861552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730102b70 0x7fb7300745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.816+0000 7fb72effd640 1 -- 172.21.15.78:0/1184861552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730102b70 msgr2=0x7fb7300745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.816+0000 7fb72effd640 1 --2- 172.21.15.78:0/1184861552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730102b70 0x7fb7300745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.816+0000 7fb72effd640 1 -- 172.21.15.78:0/1184861552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb730074b20 con 0x7fb730101970 2024-09-18T12:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.816+0000 7fb72effd640 1 --2- 172.21.15.78:0/1184861552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb730101970 0x7fb730075f20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb72000e940 tx=0x7fb72000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.816+0000 7fb717fff640 1 -- 172.21.15.78:0/1184861552 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb72000cac0 con 0x7fb730101970 2024-09-18T12:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.816+0000 7fb7352ed640 1 -- 172.21.15.78:0/1184861552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb730074e10 con 0x7fb730101970 2024-09-18T12:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.816+0000 7fb717fff640 1 -- 172.21.15.78:0/1184861552 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb72000cc60 con 0x7fb730101970 2024-09-18T12:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.817+0000 7fb717fff640 1 -- 172.21.15.78:0/1184861552 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb720003de0 con 0x7fb730101970 2024-09-18T12:45:38.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.817+0000 7fb7352ed640 1 -- 172.21.15.78:0/1184861552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb730075370 con 0x7fb730101970 2024-09-18T12:45:38.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.818+0000 7fb7352ed640 1 -- 172.21.15.78:0/1184861552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb730101d70 con 0x7fb730101970 2024-09-18T12:45:38.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.818+0000 7fb717fff640 1 -- 172.21.15.78:0/1184861552 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fb720003f80 con 0x7fb730101970 2024-09-18T12:45:38.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.819+0000 7fb717fff640 1 --2- 172.21.15.78:0/1184861552 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb71806e2b0 0x7fb718070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:38.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.819+0000 7fb72e7fc640 1 --2- 172.21.15.78:0/1184861552 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb71806e2b0 0x7fb718070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:38.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.819+0000 7fb717fff640 1 -- 172.21.15.78:0/1184861552 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4358+0+0 (secure 0 0 0) 0x7fb72008e380 con 0x7fb730101970 2024-09-18T12:45:38.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.819+0000 7fb72e7fc640 1 --2- 172.21.15.78:0/1184861552 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb71806e2b0 0x7fb718070770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb724000c00 tx=0x7fb7240058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:38.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.823+0000 7fb717fff640 1 -- 172.21.15.78:0/1184861552 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb72005c130 con 0x7fb730101970 2024-09-18T12:45:38.926 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:38 smithi148 ceph-mon[35352]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T12:45:38.926 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:38 smithi148 ceph-mon[35352]: osdmap e36: 6 total, 5 up, 6 in 2024-09-18T12:45:38.926 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:38 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:45:38.926 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:38 smithi148 ceph-mon[35352]: from='osd.5 [v2:172.21.15.148:6816/3949254394,v1:172.21.15.148:6817/3949254394]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-18T12:45:38.926 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:38 smithi148 ceph-mon[35352]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-18T12:45:38.926 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:38 smithi148 ceph-mon[35352]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:38.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.989+0000 7fb7352ed640 1 -- 172.21.15.78:0/1184861552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb73002db60 con 0x7fb730101970 2024-09-18T12:45:38.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:38 smithi078 ceph-mon[28091]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T12:45:38.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:38 smithi078 ceph-mon[28091]: osdmap e36: 6 total, 5 up, 6 in 2024-09-18T12:45:38.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:38 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:45:38.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:38 smithi078 ceph-mon[28091]: from='osd.5 [v2:172.21.15.148:6816/3949254394,v1:172.21.15.148:6817/3949254394]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-18T12:45:38.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:38 smithi078 ceph-mon[28091]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-18T12:45:38.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:38 smithi078 ceph-mon[28091]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:38.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.989+0000 7fb717fff640 1 -- 172.21.15.78:0/1184861552 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) ==== 74+0+130 (secure 0 0 0) 0x7fb72005fde0 con 0x7fb730101970 2024-09-18T12:45:38.992 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:45:38.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.991+0000 7fb7352ed640 1 -- 172.21.15.78:0/1184861552 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb71806e2b0 msgr2=0x7fb718070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:38.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.991+0000 7fb7352ed640 1 --2- 172.21.15.78:0/1184861552 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb71806e2b0 0x7fb718070770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb724000c00 tx=0x7fb7240058d0 comp rx=0 tx=0).stop 2024-09-18T12:45:38.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.991+0000 7fb7352ed640 1 -- 172.21.15.78:0/1184861552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb730101970 msgr2=0x7fb730075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:38.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.991+0000 7fb7352ed640 1 --2- 172.21.15.78:0/1184861552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb730101970 0x7fb730075f20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb72000e940 tx=0x7fb72000ee00 comp rx=0 tx=0).stop 2024-09-18T12:45:38.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.992+0000 7fb7352ed640 1 -- 172.21.15.78:0/1184861552 shutdown_connections 2024-09-18T12:45:38.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.992+0000 7fb7352ed640 1 --2- 172.21.15.78:0/1184861552 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb71806e2b0 0x7fb718070770 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:38.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.992+0000 7fb7352ed640 1 --2- 172.21.15.78:0/1184861552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730102b70 0x7fb7300745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:38.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.992+0000 7fb7352ed640 1 --2- 172.21.15.78:0/1184861552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb730101970 0x7fb730075f20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:38.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.992+0000 7fb7352ed640 1 -- 172.21.15.78:0/1184861552 >> 172.21.15.78:0/1184861552 conn(0x7fb7300fd140 msgr2=0x7fb730106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:38.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.992+0000 7fb7352ed640 1 -- 172.21.15.78:0/1184861552 shutdown_connections 2024-09-18T12:45:38.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:38.992+0000 7fb7352ed640 1 -- 172.21.15.78:0/1184861552 wait complete. 2024-09-18T12:45:39.731 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":37,"num_osds":6,"num_up_osds":5,"osd_up_since":1726663513,"num_in_osds":6,"osd_in_since":1726663516,"num_remapped_pgs":0} 2024-09-18T12:45:39.973 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[54886]: 2024-09-18T12:45:39.579+0000 7f4411157640 -1 osd.5 0 waiting for initial osdmap 2024-09-18T12:45:39.973 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[54886]: 2024-09-18T12:45:39.587+0000 7f4409789640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:45:39.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-18T12:45:39.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: osdmap e37: 6 total, 5 up, 6 in 2024-09-18T12:45:39.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:45:39.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:45:39.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: Detected new or changed devices on smithi148 2024-09-18T12:45:39.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:39.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1184861552' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:45:39.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:39.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:39.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:39.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:39.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: Adjusting osd_memory_target on smithi148 to 4970M 2024-09-18T12:45:39.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:39.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:39.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:39.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:39.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:39.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:39.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:39.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:39.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:39 smithi148 ceph-mon[35352]: from='osd.5 ' entity='osd.5' 2024-09-18T12:45:39.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-18T12:45:39.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: osdmap e37: 6 total, 5 up, 6 in 2024-09-18T12:45:39.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:45:39.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:45:39.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: Detected new or changed devices on smithi148 2024-09-18T12:45:39.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:39.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1184861552' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:45:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:45:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: Adjusting osd_memory_target on smithi148 to 4970M 2024-09-18T12:45:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:39.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:45:39.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:39 smithi078 ceph-mon[28091]: from='osd.5 ' entity='osd.5' 2024-09-18T12:45:40.732 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-18T12:45:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:45:41.032 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:40 smithi078 ceph-mon[28091]: purged_snaps scrub starts 2024-09-18T12:45:41.032 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:40 smithi078 ceph-mon[28091]: purged_snaps scrub ok 2024-09-18T12:45:41.032 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:40 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:45:41.033 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:40 smithi078 ceph-mon[28091]: osd.5 [v2:172.21.15.148:6816/3949254394,v1:172.21.15.148:6817/3949254394] boot 2024-09-18T12:45:41.033 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:40 smithi078 ceph-mon[28091]: osdmap e38: 6 total, 6 up, 6 in 2024-09-18T12:45:41.033 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:40 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:45:41.033 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:40 smithi078 ceph-mon[28091]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:41.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:40 smithi148 ceph-mon[35352]: purged_snaps scrub starts 2024-09-18T12:45:41.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:40 smithi148 ceph-mon[35352]: purged_snaps scrub ok 2024-09-18T12:45:41.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:40 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:45:41.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:40 smithi148 ceph-mon[35352]: osd.5 [v2:172.21.15.148:6816/3949254394,v1:172.21.15.148:6817/3949254394] boot 2024-09-18T12:45:41.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:40 smithi148 ceph-mon[35352]: osdmap e38: 6 total, 6 up, 6 in 2024-09-18T12:45:41.091 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:40 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:45:41.091 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:40 smithi148 ceph-mon[35352]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:45:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.478+0000 7f6c3310d640 1 -- 172.21.15.78:0/3841401298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c2c100860 msgr2=0x7f6c2c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.478+0000 7f6c3310d640 1 --2- 172.21.15.78:0/3841401298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c2c100860 0x7f6c2c100c60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009880 tx=0x7f6c2002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:45:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.478+0000 7f6c3310d640 1 -- 172.21.15.78:0/3841401298 shutdown_connections 2024-09-18T12:45:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.478+0000 7f6c3310d640 1 --2- 172.21.15.78:0/3841401298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c2c101a60 0x7f6c2c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.478+0000 7f6c3310d640 1 --2- 172.21.15.78:0/3841401298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c2c100860 0x7f6c2c100c60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.478+0000 7f6c3310d640 1 -- 172.21.15.78:0/3841401298 >> 172.21.15.78:0/3841401298 conn(0x7f6c2c0fc010 msgr2=0x7f6c2c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.478+0000 7f6c3310d640 1 -- 172.21.15.78:0/3841401298 shutdown_connections 2024-09-18T12:45:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.478+0000 7f6c3310d640 1 -- 172.21.15.78:0/3841401298 wait complete. 2024-09-18T12:45:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.478+0000 7f6c3310d640 1 Processor -- start 2024-09-18T12:45:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.478+0000 7f6c3310d640 1 -- start start 2024-09-18T12:45:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.478+0000 7f6c3310d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c2c100860 0x7f6c2c1963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.478+0000 7f6c3310d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c2c101a60 0x7f6c2c196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.478+0000 7f6c3310d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c1096a0 con 0x7f6c2c101a60 2024-09-18T12:45:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.478+0000 7f6c3310d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c109520 con 0x7f6c2c100860 2024-09-18T12:45:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.478+0000 7f6c2bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c2c101a60 0x7f6c2c196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.479+0000 7f6c2bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c2c101a60 0x7f6c2c196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36274/0 (socket says 172.21.15.78:36274) 2024-09-18T12:45:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.479+0000 7f6c2bfff640 1 -- 172.21.15.78:0/2708935805 learned_addr learned my addr 172.21.15.78:0/2708935805 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:45:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.479+0000 7f6c30ea9640 1 --2- 172.21.15.78:0/2708935805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c2c100860 0x7f6c2c1963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.479+0000 7f6c2bfff640 1 -- 172.21.15.78:0/2708935805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c2c100860 msgr2=0x7f6c2c1963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.479+0000 7f6c2bfff640 1 --2- 172.21.15.78:0/2708935805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c2c100860 0x7f6c2c1963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.479+0000 7f6c2bfff640 1 -- 172.21.15.78:0/2708935805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c196fa0 con 0x7f6c2c101a60 2024-09-18T12:45:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.479+0000 7f6c30ea9640 1 --2- 172.21.15.78:0/2708935805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c2c100860 0x7f6c2c1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:45:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.479+0000 7f6c2bfff640 1 --2- 172.21.15.78:0/2708935805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c2c101a60 0x7f6c2c196920 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800d6f0 tx=0x7f6c1800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.479+0000 7f6c29ffb640 1 -- 172.21.15.78:0/2708935805 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c18017070 con 0x7f6c2c101a60 2024-09-18T12:45:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.479+0000 7f6c3310d640 1 -- 172.21.15.78:0/2708935805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2c19b9e0 con 0x7f6c2c101a60 2024-09-18T12:45:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.479+0000 7f6c29ffb640 1 -- 172.21.15.78:0/2708935805 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6c1800de00 con 0x7f6c2c101a60 2024-09-18T12:45:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.479+0000 7f6c29ffb640 1 -- 172.21.15.78:0/2708935805 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c18004bb0 con 0x7f6c2c101a60 2024-09-18T12:45:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.479+0000 7f6c3310d640 1 -- 172.21.15.78:0/2708935805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2c19bf70 con 0x7f6c2c101a60 2024-09-18T12:45:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.480+0000 7f6c3310d640 1 -- 172.21.15.78:0/2708935805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c2c100c60 con 0x7f6c2c101a60 2024-09-18T12:45:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.481+0000 7f6c29ffb640 1 -- 172.21.15.78:0/2708935805 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6c18004e60 con 0x7f6c2c101a60 2024-09-18T12:45:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.481+0000 7f6c29ffb640 1 --2- 172.21.15.78:0/2708935805 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f6c1c06e2b0 0x7f6c1c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.481+0000 7f6c29ffb640 1 -- 172.21.15.78:0/2708935805 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f6c1808da90 con 0x7f6c2c101a60 2024-09-18T12:45:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.481+0000 7f6c30ea9640 1 --2- 172.21.15.78:0/2708935805 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f6c1c06e2b0 0x7f6c1c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.482+0000 7f6c30ea9640 1 --2- 172.21.15.78:0/2708935805 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f6c1c06e2b0 0x7f6c1c070770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6c200096c0 tx=0x7f6c20009650 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.486+0000 7f6c29ffb640 1 -- 172.21.15.78:0/2708935805 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6c1805b730 con 0x7f6c2c101a60 2024-09-18T12:45:41.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.657+0000 7f6c3310d640 1 -- 172.21.15.78:0/2708935805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6c2c1904b0 con 0x7f6c2c101a60 2024-09-18T12:45:41.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.657+0000 7f6c29ffb640 1 -- 172.21.15.78:0/2708935805 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) ==== 74+0+130 (secure 0 0 0) 0x7f6c1805f3e0 con 0x7f6c2c101a60 2024-09-18T12:45:41.659 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:45:41.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.660+0000 7f6c3310d640 1 -- 172.21.15.78:0/2708935805 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f6c1c06e2b0 msgr2=0x7f6c1c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:41.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.660+0000 7f6c3310d640 1 --2- 172.21.15.78:0/2708935805 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f6c1c06e2b0 0x7f6c1c070770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6c200096c0 tx=0x7f6c20009650 comp rx=0 tx=0).stop 2024-09-18T12:45:41.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.660+0000 7f6c3310d640 1 -- 172.21.15.78:0/2708935805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c2c101a60 msgr2=0x7f6c2c196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:41.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.660+0000 7f6c3310d640 1 --2- 172.21.15.78:0/2708935805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c2c101a60 0x7f6c2c196920 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800d6f0 tx=0x7f6c1800dbb0 comp rx=0 tx=0).stop 2024-09-18T12:45:41.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.660+0000 7f6c3310d640 1 -- 172.21.15.78:0/2708935805 shutdown_connections 2024-09-18T12:45:41.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.660+0000 7f6c3310d640 1 --2- 172.21.15.78:0/2708935805 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f6c1c06e2b0 0x7f6c1c070770 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:41.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.660+0000 7f6c3310d640 1 --2- 172.21.15.78:0/2708935805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c2c101a60 0x7f6c2c196920 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:41.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.660+0000 7f6c3310d640 1 --2- 172.21.15.78:0/2708935805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c2c100860 0x7f6c2c1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:41.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.660+0000 7f6c3310d640 1 -- 172.21.15.78:0/2708935805 >> 172.21.15.78:0/2708935805 conn(0x7f6c2c0fc010 msgr2=0x7f6c2c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:41.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.660+0000 7f6c3310d640 1 -- 172.21.15.78:0/2708935805 shutdown_connections 2024-09-18T12:45:41.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:41.660+0000 7f6c3310d640 1 -- 172.21.15.78:0/2708935805 wait complete. 2024-09-18T12:45:41.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:41.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:41 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2708935805' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:45:42.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:41 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:42.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:41 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2708935805' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:45:42.270 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1726663540,"num_in_osds":6,"osd_in_since":1726663516,"num_remapped_pgs":0} 2024-09-18T12:45:42.271 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-18T12:45:42.516 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:45:42.922 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:42 smithi078 ceph-mon[28091]: osdmap e39: 6 total, 6 up, 6 in 2024-09-18T12:45:42.922 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:42 smithi078 ceph-mon[28091]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:43.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:42.999+0000 7fd877ac3640 1 -- 172.21.15.78:0/3186520541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd870101900 msgr2=0x7fd870101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:43.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:42.999+0000 7fd877ac3640 1 --2- 172.21.15.78:0/3186520541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd870101900 0x7fd870101d60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd864009880 tx=0x7fd86402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:45:43.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:42.999+0000 7fd877ac3640 1 -- 172.21.15.78:0/3186520541 shutdown_connections 2024-09-18T12:45:43.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:42.999+0000 7fd877ac3640 1 --2- 172.21.15.78:0/3186520541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd870101900 0x7fd870101d60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:43.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:42.999+0000 7fd877ac3640 1 --2- 172.21.15.78:0/3186520541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd870107900 0x7fd870107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:43.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:42.999+0000 7fd877ac3640 1 -- 172.21.15.78:0/3186520541 >> 172.21.15.78:0/3186520541 conn(0x7fd8700fd600 msgr2=0x7fd8700ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:43.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:42.999+0000 7fd877ac3640 1 -- 172.21.15.78:0/3186520541 shutdown_connections 2024-09-18T12:45:43.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:42.999+0000 7fd877ac3640 1 -- 172.21.15.78:0/3186520541 wait complete. 2024-09-18T12:45:43.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:42.999+0000 7fd877ac3640 1 Processor -- start 2024-09-18T12:45:43.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:42.999+0000 7fd877ac3640 1 -- start start 2024-09-18T12:45:43.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd877ac3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd870101900 0x7fd87019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:43.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd877ac3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd870107900 0x7fd87019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:43.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd877ac3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd87010ee30 con 0x7fd870107900 2024-09-18T12:45:43.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd877ac3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd87010ecb0 con 0x7fd870101900 2024-09-18T12:45:43.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd87505e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd870107900 0x7fd87019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:43.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd87505e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd870107900 0x7fd87019dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36292/0 (socket says 172.21.15.78:36292) 2024-09-18T12:45:43.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd87505e640 1 -- 172.21.15.78:0/2120423633 learned_addr learned my addr 172.21.15.78:0/2120423633 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:45:43.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd87585f640 1 --2- 172.21.15.78:0/2120423633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd870101900 0x7fd87019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:43.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd87505e640 1 -- 172.21.15.78:0/2120423633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd870101900 msgr2=0x7fd87019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:43.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd87505e640 1 --2- 172.21.15.78:0/2120423633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd870101900 0x7fd87019d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:43.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd87505e640 1 -- 172.21.15.78:0/2120423633 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd870197840 con 0x7fd870107900 2024-09-18T12:45:43.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd87585f640 1 --2- 172.21.15.78:0/2120423633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd870101900 0x7fd87019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:45:43.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd87505e640 1 --2- 172.21.15.78:0/2120423633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd870107900 0x7fd87019dc00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd864031460 tx=0x7fd8640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:43.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd86effd640 1 -- 172.21.15.78:0/2120423633 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd86403f070 con 0x7fd870107900 2024-09-18T12:45:43.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd877ac3640 1 -- 172.21.15.78:0/2120423633 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd870197ad0 con 0x7fd870107900 2024-09-18T12:45:43.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd86effd640 1 -- 172.21.15.78:0/2120423633 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd864004cf0 con 0x7fd870107900 2024-09-18T12:45:43.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd86effd640 1 -- 172.21.15.78:0/2120423633 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd864035030 con 0x7fd870107900 2024-09-18T12:45:43.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.000+0000 7fd877ac3640 1 -- 172.21.15.78:0/2120423633 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd870198000 con 0x7fd870107900 2024-09-18T12:45:43.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.001+0000 7fd877ac3640 1 -- 172.21.15.78:0/2120423633 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd870103040 con 0x7fd870107900 2024-09-18T12:45:43.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.002+0000 7fd86effd640 1 -- 172.21.15.78:0/2120423633 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd864042070 con 0x7fd870107900 2024-09-18T12:45:43.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.002+0000 7fd86effd640 1 --2- 172.21.15.78:0/2120423633 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd85806e2b0 0x7fd858070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:43.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.002+0000 7fd86effd640 1 -- 172.21.15.78:0/2120423633 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fd8640ae970 con 0x7fd870107900 2024-09-18T12:45:43.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.002+0000 7fd87585f640 1 --2- 172.21.15.78:0/2120423633 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd85806e2b0 0x7fd858070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:43.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.003+0000 7fd87585f640 1 --2- 172.21.15.78:0/2120423633 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd85806e2b0 0x7fd858070770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd860009fa0 tx=0x7fd860009570 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:43.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.007+0000 7fd86effd640 1 -- 172.21.15.78:0/2120423633 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd86407c5b0 con 0x7fd870107900 2024-09-18T12:45:43.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.174+0000 7fd877ac3640 1 -- 172.21.15.78:0/2120423633 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd870109e90 con 0x7fd870107900 2024-09-18T12:45:43.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.174+0000 7fd86effd640 1 -- 172.21.15.78:0/2120423633 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11408 (secure 0 0 0) 0x7fd864080260 con 0x7fd870107900 2024-09-18T12:45:43.176 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:45:43.176 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":39,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","created":"2024-09-18T12:39:40.184514+0000","modified":"2024-09-18T12:45:41.817177+0000","last_up_change":"2024-09-18T12:45:40.584891+0000","last_in_change":"2024-09-18T12:45:16.726224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:44:21.669427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"91b9c8b7-2466-4085-8bec-b4f0d4d88e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2583422518},{"type":"v1","addr":"172.21.15.78:6803","nonce":2583422518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2583422518},{"type":"v1","addr":"172.21.15.78:6805","nonce":2583422518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2583422518},{"type":"v1","addr":"172.21.15.78:6809","nonce":2583422518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2583422518},{"type":"v1","addr":"172.21.15.78:6807","nonce":2583422518}]},"public_addr":"172.21.15.78:6803/2583422518","cluster_addr":"172.21.15.78:6805/2583422518","heartbeat_back_addr":"172.21.15.78:6809/2583422518","heartbeat_front_addr":"172.21.15.78:6807/2583422518","state":["exists","up"]},{"osd":1,"uuid":"f9b36d44-66f3-4270-8a49-7bb6f6b7af34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3802001947},{"type":"v1","addr":"172.21.15.78:6811","nonce":3802001947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3802001947},{"type":"v1","addr":"172.21.15.78:6813","nonce":3802001947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3802001947},{"type":"v1","addr":"172.21.15.78:6817","nonce":3802001947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3802001947},{"type":"v1","addr":"172.21.15.78:6815","nonce":3802001947}]},"public_addr":"172.21.15.78:6811/3802001947","cluster_addr":"172.21.15.78:6813/3802001947","heartbeat_back_addr":"172.21.15.78:6817/3802001947","heartbeat_front_addr":"172.21.15.78:6815/3802001947","state":["exists","up"]},{"osd":2,"uuid":"c337d9bd-8a41-4b3f-8b9f-04560dafa83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3697746229},{"type":"v1","addr":"172.21.15.78:6819","nonce":3697746229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3697746229},{"type":"v1","addr":"172.21.15.78:6821","nonce":3697746229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3697746229},{"type":"v1","addr":"172.21.15.78:6825","nonce":3697746229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3697746229},{"type":"v1","addr":"172.21.15.78:6823","nonce":3697746229}]},"public_addr":"172.21.15.78:6819/3697746229","cluster_addr":"172.21.15.78:6821/3697746229","heartbeat_back_addr":"172.21.15.78:6825/3697746229","heartbeat_front_addr":"172.21.15.78:6823/3697746229","state":["exists","up"]},{"osd":3,"uuid":"c5ed45d0-75b8-4f2d-8861-779790af7b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2230690563},{"type":"v1","addr":"172.21.15.148:6801","nonce":2230690563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2230690563},{"type":"v1","addr":"172.21.15.148:6803","nonce":2230690563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2230690563},{"type":"v1","addr":"172.21.15.148:6807","nonce":2230690563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2230690563},{"type":"v1","addr":"172.21.15.148:6805","nonce":2230690563}]},"public_addr":"172.21.15.148:6801/2230690563","cluster_addr":"172.21.15.148:6803/2230690563","heartbeat_back_addr":"172.21.15.148:6807/2230690563","heartbeat_front_addr":"172.21.15.148:6805/2230690563","state":["exists","up"]},{"osd":4,"uuid":"97cd45fe-7682-4eb6-9b29-ab7ff324f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2544176191},{"type":"v1","addr":"172.21.15.148:6809","nonce":2544176191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2544176191},{"type":"v1","addr":"172.21.15.148:6811","nonce":2544176191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2544176191},{"type":"v1","addr":"172.21.15.148:6815","nonce":2544176191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2544176191},{"type":"v1","addr":"172.21.15.148:6813","nonce":2544176191}]},"public_addr":"172.21.15.148:6809/2544176191","cluster_addr":"172.21.15.148:6811/2544176191","heartbeat_back_addr":"172.21.15.148:6815/2544176191","heartbeat_front_addr":"172.21.15.148:6813/2544176191","state":["exists","up"]},{"osd":5,"uuid":"65e5086e-6f88-4760-bf6f-6f9bace7c3f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3949254394},{"type":"v1","addr":"172.21.15.148:6817","nonce":3949254394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3949254394},{"type":"v1","addr":"172.21.15.148:6819","nonce":3949254394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3949254394},{"type":"v1","addr":"172.21.15.148:6823","nonce":3949254394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3949254394},{"type":"v1","addr":"172.21.15.148:6821","nonce":3949254394}]},"public_addr":"172.21.15.148:6817/3949254394","cluster_addr":"172.21.15.148:6819/3949254394","heartbeat_back_addr":"172.21.15.148:6823/3949254394","heartbeat_front_addr":"172.21.15.148:6821/3949254394","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:43:20.762681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:43:50.235173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:44:18.789613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:44:44.298829+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:45:11.720301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:45:38.366806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6800/2933657307":"2024-09-19T12:41:41.346021+0000","172.21.15.78:0/538305077":"2024-09-19T12:40:12.294094+0000","172.21.15.78:0/3952955113":"2024-09-19T12:40:43.381299+0000","172.21.15.78:0/1909696487":"2024-09-19T12:40:12.294094+0000","172.21.15.78:6801/2933657307":"2024-09-19T12:41:41.346021+0000","172.21.15.78:6801/2989194374":"2024-09-19T12:40:12.294094+0000","172.21.15.78:0/2192057687":"2024-09-19T12:41:41.346021+0000","172.21.15.78:0/1268671960":"2024-09-19T12:40:12.294094+0000","172.21.15.78:0/2388875547":"2024-09-19T12:40:43.381299+0000","172.21.15.78:0/1473581153":"2024-09-19T12:40:43.381299+0000","172.21.15.78:6800/2511056793":"2024-09-19T12:40:43.381299+0000","172.21.15.78:6800/2989194374":"2024-09-19T12:40:12.294094+0000","172.21.15.78:6801/2511056793":"2024-09-19T12:40:43.381299+0000","172.21.15.78:0/1238593923":"2024-09-19T12:41:41.346021+0000","172.21.15.78:0/3952976544":"2024-09-19T12:41:41.346021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:45:43.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.177+0000 7fd877ac3640 1 -- 172.21.15.78:0/2120423633 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd85806e2b0 msgr2=0x7fd858070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:43.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.177+0000 7fd877ac3640 1 --2- 172.21.15.78:0/2120423633 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd85806e2b0 0x7fd858070770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd860009fa0 tx=0x7fd860009570 comp rx=0 tx=0).stop 2024-09-18T12:45:43.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.177+0000 7fd877ac3640 1 -- 172.21.15.78:0/2120423633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd870107900 msgr2=0x7fd87019dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:43.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.177+0000 7fd877ac3640 1 --2- 172.21.15.78:0/2120423633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd870107900 0x7fd87019dc00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd864031460 tx=0x7fd8640048f0 comp rx=0 tx=0).stop 2024-09-18T12:45:43.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.177+0000 7fd877ac3640 1 -- 172.21.15.78:0/2120423633 shutdown_connections 2024-09-18T12:45:43.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.177+0000 7fd877ac3640 1 --2- 172.21.15.78:0/2120423633 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd85806e2b0 0x7fd858070770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:43.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.177+0000 7fd877ac3640 1 --2- 172.21.15.78:0/2120423633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd870107900 0x7fd87019dc00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:43.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.177+0000 7fd877ac3640 1 --2- 172.21.15.78:0/2120423633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd870101900 0x7fd87019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:43.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.177+0000 7fd877ac3640 1 -- 172.21.15.78:0/2120423633 >> 172.21.15.78:0/2120423633 conn(0x7fd8700fd600 msgr2=0x7fd8700fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:43.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.177+0000 7fd877ac3640 1 -- 172.21.15.78:0/2120423633 shutdown_connections 2024-09-18T12:45:43.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:43.177+0000 7fd877ac3640 1 -- 172.21.15.78:0/2120423633 wait complete. 2024-09-18T12:45:43.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:42 smithi148 ceph-mon[35352]: osdmap e39: 6 total, 6 up, 6 in 2024-09-18T12:45:43.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:42 smithi148 ceph-mon[35352]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:43.828 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T12:44:21.669427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-18T12:45:43.828 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-18T12:45:44.071 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:45:44.192 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:43 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2120423633' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:45:44.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:43 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2120423633' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:45:44.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.510+0000 7fd68479d640 1 -- 172.21.15.78:0/3931194483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67c100800 msgr2=0x7fd67c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:44.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.510+0000 7fd68479d640 1 --2- 172.21.15.78:0/3931194483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67c100800 0x7fd67c100c60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd670009880 tx=0x7fd67002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:45:44.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.510+0000 7fd68479d640 1 -- 172.21.15.78:0/3931194483 shutdown_connections 2024-09-18T12:45:44.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.510+0000 7fd68479d640 1 --2- 172.21.15.78:0/3931194483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67c100800 0x7fd67c100c60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:44.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.510+0000 7fd68479d640 1 --2- 172.21.15.78:0/3931194483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd67c106800 0x7fd67c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:44.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.510+0000 7fd68479d640 1 -- 172.21.15.78:0/3931194483 >> 172.21.15.78:0/3931194483 conn(0x7fd67c0fc520 msgr2=0x7fd67c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:44.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.510+0000 7fd68479d640 1 -- 172.21.15.78:0/3931194483 shutdown_connections 2024-09-18T12:45:44.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.510+0000 7fd68479d640 1 -- 172.21.15.78:0/3931194483 wait complete. 2024-09-18T12:45:44.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.511+0000 7fd68479d640 1 Processor -- start 2024-09-18T12:45:44.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.511+0000 7fd68479d640 1 -- start start 2024-09-18T12:45:44.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.511+0000 7fd68479d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67c100800 0x7fd67c196610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:44.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.511+0000 7fd68479d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd67c106800 0x7fd67c196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:44.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.511+0000 7fd68479d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c10dcd0 con 0x7fd67c100800 2024-09-18T12:45:44.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.511+0000 7fd68479d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c10db50 con 0x7fd67c106800 2024-09-18T12:45:44.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.511+0000 7fd682539640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67c100800 0x7fd67c196610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:44.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.511+0000 7fd682539640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67c100800 0x7fd67c196610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36304/0 (socket says 172.21.15.78:36304) 2024-09-18T12:45:44.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.511+0000 7fd682539640 1 -- 172.21.15.78:0/1394392954 learned_addr learned my addr 172.21.15.78:0/1394392954 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:45:44.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.511+0000 7fd682539640 1 -- 172.21.15.78:0/1394392954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd67c106800 msgr2=0x7fd67c196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:44.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.511+0000 7fd682539640 1 --2- 172.21.15.78:0/1394392954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd67c106800 0x7fd67c196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:44.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.511+0000 7fd682539640 1 -- 172.21.15.78:0/1394392954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c197090 con 0x7fd67c100800 2024-09-18T12:45:44.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.511+0000 7fd682539640 1 --2- 172.21.15.78:0/1394392954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67c100800 0x7fd67c196610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd67400c8f0 tx=0x7fd67400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:44.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.512+0000 7fd67b7fe640 1 -- 172.21.15.78:0/1394392954 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd6740079b0 con 0x7fd67c100800 2024-09-18T12:45:44.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.512+0000 7fd67b7fe640 1 -- 172.21.15.78:0/1394392954 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd6740054e0 con 0x7fd67c100800 2024-09-18T12:45:44.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.512+0000 7fd68479d640 1 -- 172.21.15.78:0/1394392954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67c197380 con 0x7fd67c100800 2024-09-18T12:45:44.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.512+0000 7fd67b7fe640 1 -- 172.21.15.78:0/1394392954 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd674004dd0 con 0x7fd67c100800 2024-09-18T12:45:44.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.512+0000 7fd68479d640 1 -- 172.21.15.78:0/1394392954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67c1a3e50 con 0x7fd67c100800 2024-09-18T12:45:44.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.513+0000 7fd68479d640 1 -- 172.21.15.78:0/1394392954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd67c101f40 con 0x7fd67c100800 2024-09-18T12:45:44.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.513+0000 7fd67b7fe640 1 -- 172.21.15.78:0/1394392954 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd674005020 con 0x7fd67c100800 2024-09-18T12:45:44.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.514+0000 7fd67b7fe640 1 --2- 172.21.15.78:0/1394392954 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd66406e2b0 0x7fd664070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:44.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.514+0000 7fd67b7fe640 1 -- 172.21.15.78:0/1394392954 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fd67408dd00 con 0x7fd67c100800 2024-09-18T12:45:44.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.514+0000 7fd681d38640 1 --2- 172.21.15.78:0/1394392954 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd66406e2b0 0x7fd664070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:44.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.514+0000 7fd681d38640 1 --2- 172.21.15.78:0/1394392954 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd66406e2b0 0x7fd664070770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd6700096c0 tx=0x7fd670000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:44.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.518+0000 7fd67b7fe640 1 -- 172.21.15.78:0/1394392954 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd674091030 con 0x7fd67c100800 2024-09-18T12:45:44.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.684+0000 7fd68479d640 1 -- 172.21.15.78:0/1394392954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd67c06a7a0 con 0x7fd67c100800 2024-09-18T12:45:44.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.684+0000 7fd67b7fe640 1 -- 172.21.15.78:0/1394392954 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7fd674014030 con 0x7fd67c100800 2024-09-18T12:45:44.686 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-09-18T12:45:44.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.686+0000 7fd68479d640 1 -- 172.21.15.78:0/1394392954 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd66406e2b0 msgr2=0x7fd664070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:44.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.686+0000 7fd68479d640 1 --2- 172.21.15.78:0/1394392954 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd66406e2b0 0x7fd664070770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd6700096c0 tx=0x7fd670000bc0 comp rx=0 tx=0).stop 2024-09-18T12:45:44.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.686+0000 7fd68479d640 1 -- 172.21.15.78:0/1394392954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67c100800 msgr2=0x7fd67c196610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:44.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.686+0000 7fd68479d640 1 --2- 172.21.15.78:0/1394392954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67c100800 0x7fd67c196610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd67400c8f0 tx=0x7fd67400cdb0 comp rx=0 tx=0).stop 2024-09-18T12:45:44.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.686+0000 7fd68479d640 1 -- 172.21.15.78:0/1394392954 shutdown_connections 2024-09-18T12:45:44.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.686+0000 7fd68479d640 1 --2- 172.21.15.78:0/1394392954 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd66406e2b0 0x7fd664070770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.686+0000 7fd68479d640 1 --2- 172.21.15.78:0/1394392954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd67c106800 0x7fd67c196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.686+0000 7fd68479d640 1 --2- 172.21.15.78:0/1394392954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67c100800 0x7fd67c196610 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.686+0000 7fd68479d640 1 -- 172.21.15.78:0/1394392954 >> 172.21.15.78:0/1394392954 conn(0x7fd67c0fc520 msgr2=0x7fd67c0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.686+0000 7fd68479d640 1 -- 172.21.15.78:0/1394392954 shutdown_connections 2024-09-18T12:45:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:44.686+0000 7fd68479d640 1 -- 172.21.15.78:0/1394392954 wait complete. 2024-09-18T12:45:45.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:44 smithi148 ceph-mon[35352]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:45.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:44 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1394392954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-18T12:45:45.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:44 smithi078 ceph-mon[28091]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:45.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:44 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1394392954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-18T12:45:45.361 INFO:tasks.cephadm:Setting up client nodes... 2024-09-18T12:45:45.361 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-18T12:45:45.608 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:45:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.069+0000 7fc3f1d03640 1 -- 172.21.15.78:0/2692753729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ec104d20 msgr2=0x7fc3ec107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.069+0000 7fc3f1d03640 1 --2- 172.21.15.78:0/2692753729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ec104d20 0x7fc3ec107110 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40098b0 tx=0x7fc3d402a4d0 comp rx=0 tx=0).stop 2024-09-18T12:45:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.069+0000 7fc3f1d03640 1 -- 172.21.15.78:0/2692753729 shutdown_connections 2024-09-18T12:45:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.069+0000 7fc3f1d03640 1 --2- 172.21.15.78:0/2692753729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ec104d20 0x7fc3ec107110 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.069+0000 7fc3f1d03640 1 --2- 172.21.15.78:0/2692753729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3ec1023f0 0x7fc3ec1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.069+0000 7fc3f1d03640 1 -- 172.21.15.78:0/2692753729 >> 172.21.15.78:0/2692753729 conn(0x7fc3ec0fc010 msgr2=0x7fc3ec0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.069+0000 7fc3f1d03640 1 -- 172.21.15.78:0/2692753729 shutdown_connections 2024-09-18T12:45:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.069+0000 7fc3f1d03640 1 -- 172.21.15.78:0/2692753729 wait complete. 2024-09-18T12:45:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.070+0000 7fc3f1d03640 1 Processor -- start 2024-09-18T12:45:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.070+0000 7fc3f1d03640 1 -- start start 2024-09-18T12:45:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.070+0000 7fc3f1d03640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ec1023f0 0x7fc3ec101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.070+0000 7fc3f1d03640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3ec104d20 0x7fc3ec1003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.070+0000 7fc3f1d03640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec10a810 con 0x7fc3ec1023f0 2024-09-18T12:45:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.070+0000 7fc3f1d03640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec10a690 con 0x7fc3ec104d20 2024-09-18T12:45:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.070+0000 7fc3eb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ec1023f0 0x7fc3ec101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.070+0000 7fc3eb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ec1023f0 0x7fc3ec101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36318/0 (socket says 172.21.15.78:36318) 2024-09-18T12:45:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.070+0000 7fc3eb7fe640 1 -- 172.21.15.78:0/795014269 learned_addr learned my addr 172.21.15.78:0/795014269 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:45:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.070+0000 7fc3eb7fe640 1 -- 172.21.15.78:0/795014269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3ec104d20 msgr2=0x7fc3ec1003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.070+0000 7fc3eb7fe640 1 --2- 172.21.15.78:0/795014269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3ec104d20 0x7fc3ec1003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.070+0000 7fc3eb7fe640 1 -- 172.21.15.78:0/795014269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec1008e0 con 0x7fc3ec1023f0 2024-09-18T12:45:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.070+0000 7fc3eb7fe640 1 --2- 172.21.15.78:0/795014269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ec1023f0 0x7fc3ec101ce0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00ba50 tx=0x7fc3dc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.071+0000 7fc3e8ff9640 1 -- 172.21.15.78:0/795014269 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc3dc019070 con 0x7fc3ec1023f0 2024-09-18T12:45:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.071+0000 7fc3e8ff9640 1 -- 172.21.15.78:0/795014269 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc3dc00ce20 con 0x7fc3ec1023f0 2024-09-18T12:45:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.071+0000 7fc3f1d03640 1 -- 172.21.15.78:0/795014269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ec100bd0 con 0x7fc3ec1023f0 2024-09-18T12:45:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.071+0000 7fc3e8ff9640 1 -- 172.21.15.78:0/795014269 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc3dc0075a0 con 0x7fc3ec1023f0 2024-09-18T12:45:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.071+0000 7fc3f1d03640 1 -- 172.21.15.78:0/795014269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3ec1011e0 con 0x7fc3ec1023f0 2024-09-18T12:45:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.072+0000 7fc3f1d03640 1 -- 172.21.15.78:0/795014269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3ec1027d0 con 0x7fc3ec1023f0 2024-09-18T12:45:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.072+0000 7fc3e8ff9640 1 -- 172.21.15.78:0/795014269 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc3dc01c070 con 0x7fc3ec1023f0 2024-09-18T12:45:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.073+0000 7fc3e8ff9640 1 --2- 172.21.15.78:0/795014269 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc3d806e2b0 0x7fc3d8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.073+0000 7fc3e8ff9640 1 -- 172.21.15.78:0/795014269 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fc3dc08d800 con 0x7fc3ec1023f0 2024-09-18T12:45:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.073+0000 7fc3eaffd640 1 --2- 172.21.15.78:0/795014269 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc3d806e2b0 0x7fc3d8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.073+0000 7fc3eaffd640 1 --2- 172.21.15.78:0/795014269 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc3d806e2b0 0x7fc3d8070770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40096c0 tx=0x7fc3d4000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.077+0000 7fc3e8ff9640 1 -- 172.21.15.78:0/795014269 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc3dc05b4a0 con 0x7fc3ec1023f0 2024-09-18T12:45:46.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.312+0000 7fc3f1d03640 1 -- 172.21.15.78:0/795014269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fc3ec19f800 con 0x7fc3ec1023f0 2024-09-18T12:45:46.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.313+0000 7fc3e8ff9640 1 -- 172.21.15.78:0/795014269 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7fc3dc05f150 con 0x7fc3ec1023f0 2024-09-18T12:45:46.315 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-09-18T12:45:46.315 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB6y+pmKkKsEhAA4X0s0kqIb5TDI5d2pt0oAw== 2024-09-18T12:45:46.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.316+0000 7fc3f1d03640 1 -- 172.21.15.78:0/795014269 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc3d806e2b0 msgr2=0x7fc3d8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:46.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.316+0000 7fc3f1d03640 1 --2- 172.21.15.78:0/795014269 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc3d806e2b0 0x7fc3d8070770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40096c0 tx=0x7fc3d4000bc0 comp rx=0 tx=0).stop 2024-09-18T12:45:46.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.316+0000 7fc3f1d03640 1 -- 172.21.15.78:0/795014269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ec1023f0 msgr2=0x7fc3ec101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:46.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.316+0000 7fc3f1d03640 1 --2- 172.21.15.78:0/795014269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ec1023f0 0x7fc3ec101ce0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00ba50 tx=0x7fc3dc00bf10 comp rx=0 tx=0).stop 2024-09-18T12:45:46.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.316+0000 7fc3f1d03640 1 -- 172.21.15.78:0/795014269 shutdown_connections 2024-09-18T12:45:46.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.316+0000 7fc3f1d03640 1 --2- 172.21.15.78:0/795014269 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc3d806e2b0 0x7fc3d8070770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:46.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.316+0000 7fc3f1d03640 1 --2- 172.21.15.78:0/795014269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3ec104d20 0x7fc3ec1003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:46.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.316+0000 7fc3f1d03640 1 --2- 172.21.15.78:0/795014269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ec1023f0 0x7fc3ec101ce0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:46.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.316+0000 7fc3f1d03640 1 -- 172.21.15.78:0/795014269 >> 172.21.15.78:0/795014269 conn(0x7fc3ec0fc010 msgr2=0x7fc3ec0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:46.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.316+0000 7fc3f1d03640 1 -- 172.21.15.78:0/795014269 shutdown_connections 2024-09-18T12:45:46.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:46.316+0000 7fc3f1d03640 1 -- 172.21.15.78:0/795014269 wait complete. 2024-09-18T12:45:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:46 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/795014269' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:45:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:46 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/795014269' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T12:45:46.735 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:46 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/795014269' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:45:46.735 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:46 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/795014269' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T12:45:46.975 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:45:46.975 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-18T12:45:46.975 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-18T12:45:47.011 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-18T12:45:47.281 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi148/config 2024-09-18T12:45:47.646 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:47 smithi148 ceph-mon[35352]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:47.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.733+0000 7f7629414640 1 -- 172.21.15.148:0/4281253678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7624101a30 msgr2=0x7f7624101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:47.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.733+0000 7f7629414640 1 --2- 172.21.15.148:0/4281253678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7624101a30 0x7f7624101eb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7618009880 tx=0x7f761802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:45:47.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.733+0000 7f7629414640 1 -- 172.21.15.148:0/4281253678 shutdown_connections 2024-09-18T12:45:47.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.733+0000 7f7629414640 1 --2- 172.21.15.148:0/4281253678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7624101a30 0x7f7624101eb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:47.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.733+0000 7f7629414640 1 --2- 172.21.15.148:0/4281253678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7624100830 0x7f7624100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:47.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.733+0000 7f7629414640 1 -- 172.21.15.148:0/4281253678 >> 172.21.15.148:0/4281253678 conn(0x7f76240fbfa0 msgr2=0x7f76240fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:47.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.733+0000 7f7629414640 1 -- 172.21.15.148:0/4281253678 shutdown_connections 2024-09-18T12:45:47.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.733+0000 7f7629414640 1 -- 172.21.15.148:0/4281253678 wait complete. 2024-09-18T12:45:47.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.734+0000 7f7629414640 1 Processor -- start 2024-09-18T12:45:47.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.734+0000 7f7629414640 1 -- start start 2024-09-18T12:45:47.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.734+0000 7f7629414640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7624100830 0x7f762406a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:47.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.734+0000 7f7629414640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7624101a30 0x7f762419c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:47.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.734+0000 7f7629414640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7624109650 con 0x7f7624100830 2024-09-18T12:45:47.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.734+0000 7f7629414640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f76241094d0 con 0x7f7624101a30 2024-09-18T12:45:47.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.734+0000 7f76227fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7624101a30 0x7f762419c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:47.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.734+0000 7f76227fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7624101a30 0x7f762419c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40156/0 (socket says 172.21.15.148:40156) 2024-09-18T12:45:47.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.734+0000 7f76227fc640 1 -- 172.21.15.148:0/3739713389 learned_addr learned my addr 172.21.15.148:0/3739713389 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-18T12:45:47.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.734+0000 7f7622ffd640 1 --2- 172.21.15.148:0/3739713389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7624100830 0x7f762406a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:47.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.735+0000 7f76227fc640 1 -- 172.21.15.148:0/3739713389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7624100830 msgr2=0x7f762406a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:47.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.735+0000 7f76227fc640 1 --2- 172.21.15.148:0/3739713389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7624100830 0x7f762406a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:47.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.735+0000 7f76227fc640 1 -- 172.21.15.148:0/3739713389 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762419c7f0 con 0x7f7624101a30 2024-09-18T12:45:47.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.735+0000 7f76227fc640 1 --2- 172.21.15.148:0/3739713389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7624101a30 0x7f762419c230 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7618000c00 tx=0x7f76180046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:47.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.735+0000 7f760bfff640 1 -- 172.21.15.148:0/3739713389 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f761803f070 con 0x7f7624101a30 2024-09-18T12:45:47.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.735+0000 7f760bfff640 1 -- 172.21.15.148:0/3739713389 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7618004ac0 con 0x7f7624101a30 2024-09-18T12:45:47.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.735+0000 7f7629414640 1 -- 172.21.15.148:0/3739713389 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762419ca80 con 0x7f7624101a30 2024-09-18T12:45:47.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.735+0000 7f760bfff640 1 -- 172.21.15.148:0/3739713389 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7618035030 con 0x7f7624101a30 2024-09-18T12:45:47.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.735+0000 7f7629414640 1 -- 172.21.15.148:0/3739713389 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f762419cfb0 con 0x7f7624101a30 2024-09-18T12:45:47.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.736+0000 7f7629414640 1 -- 172.21.15.148:0/3739713389 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7624100c30 con 0x7f7624101a30 2024-09-18T12:45:47.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.737+0000 7f760bfff640 1 -- 172.21.15.148:0/3739713389 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f7618042070 con 0x7f7624101a30 2024-09-18T12:45:47.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.737+0000 7f760bfff640 1 --2- 172.21.15.148:0/3739713389 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f760c06e2b0 0x7f760c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:47.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.737+0000 7f760bfff640 1 -- 172.21.15.148:0/3739713389 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f76180aea70 con 0x7f7624101a30 2024-09-18T12:45:47.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.737+0000 7f7622ffd640 1 --2- 172.21.15.148:0/3739713389 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f760c06e2b0 0x7f760c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:47.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.738+0000 7f7622ffd640 1 --2- 172.21.15.148:0/3739713389 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f760c06e2b0 0x7f760c070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7624101890 tx=0x7f761400b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:47.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:47 smithi078 ceph-mon[28091]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:47.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.742+0000 7f760bfff640 1 -- 172.21.15.148:0/3739713389 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7618080330 con 0x7f7624101a30 2024-09-18T12:45:47.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.967+0000 7f7629414640 1 -- 172.21.15.148:0/3739713389 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f7624062df0 con 0x7f7624101a30 2024-09-18T12:45:47.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.971+0000 7f760bfff640 1 -- 172.21.15.148:0/3739713389 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7f7618084b60 con 0x7f7624101a30 2024-09-18T12:45:47.972 INFO:teuthology.orchestra.run.smithi148.stdout:[client.1] 2024-09-18T12:45:47.972 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQB7y+pmc4q/ORAAFk9HnhWzdTrPvq3iIO5UFA== 2024-09-18T12:45:47.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.973+0000 7f7629414640 1 -- 172.21.15.148:0/3739713389 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f760c06e2b0 msgr2=0x7f760c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:47.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.973+0000 7f7629414640 1 --2- 172.21.15.148:0/3739713389 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f760c06e2b0 0x7f760c070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7624101890 tx=0x7f761400b390 comp rx=0 tx=0).stop 2024-09-18T12:45:47.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.973+0000 7f7629414640 1 -- 172.21.15.148:0/3739713389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7624101a30 msgr2=0x7f762419c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:47.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.973+0000 7f7629414640 1 --2- 172.21.15.148:0/3739713389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7624101a30 0x7f762419c230 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7618000c00 tx=0x7f76180046c0 comp rx=0 tx=0).stop 2024-09-18T12:45:47.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.973+0000 7f7629414640 1 -- 172.21.15.148:0/3739713389 shutdown_connections 2024-09-18T12:45:47.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.973+0000 7f7629414640 1 --2- 172.21.15.148:0/3739713389 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f760c06e2b0 0x7f760c070770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:47.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.973+0000 7f7629414640 1 --2- 172.21.15.148:0/3739713389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7624101a30 0x7f762419c230 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:47.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.973+0000 7f7629414640 1 --2- 172.21.15.148:0/3739713389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7624100830 0x7f762406a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:47.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.973+0000 7f7629414640 1 -- 172.21.15.148:0/3739713389 >> 172.21.15.148:0/3739713389 conn(0x7f76240fbfa0 msgr2=0x7f7624104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:47.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.974+0000 7f7629414640 1 -- 172.21.15.148:0/3739713389 shutdown_connections 2024-09-18T12:45:47.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:45:47.974+0000 7f7629414640 1 -- 172.21.15.148:0/3739713389 wait complete. 2024-09-18T12:45:48.587 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-18T12:45:48.587 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-18T12:45:48.587 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-18T12:45:48.625 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph config log 1 --format=json 2024-09-18T12:45:48.652 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:48 smithi078 ceph-mon[28091]: from='client.? 172.21.15.148:0/3739713389' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:45:48.652 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:48 smithi078 ceph-mon[28091]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:45:48.652 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:48 smithi078 ceph-mon[28091]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T12:45:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:48 smithi148 ceph-mon[35352]: from='client.? 172.21.15.148:0/3739713389' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:45:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:48 smithi148 ceph-mon[35352]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:45:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:48 smithi148 ceph-mon[35352]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T12:45:48.893 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:45:49.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.321+0000 7f4b37ded640 1 -- 172.21.15.78:0/1664905801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b30102ac0 msgr2=0x7f4b30102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:49.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.321+0000 7f4b37ded640 1 --2- 172.21.15.78:0/1664905801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b30102ac0 0x7f4b30102ea0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009880 tx=0x7f4b2002a530 comp rx=0 tx=0).stop 2024-09-18T12:45:49.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.321+0000 7f4b37ded640 1 -- 172.21.15.78:0/1664905801 shutdown_connections 2024-09-18T12:45:49.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.321+0000 7f4b37ded640 1 --2- 172.21.15.78:0/1664905801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b301033e0 0x7f4b3010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:49.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.321+0000 7f4b37ded640 1 --2- 172.21.15.78:0/1664905801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b30102ac0 0x7f4b30102ea0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:49.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.321+0000 7f4b37ded640 1 -- 172.21.15.78:0/1664905801 >> 172.21.15.78:0/1664905801 conn(0x7f4b300fc520 msgr2=0x7f4b300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:49.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.321+0000 7f4b37ded640 1 -- 172.21.15.78:0/1664905801 shutdown_connections 2024-09-18T12:45:49.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.321+0000 7f4b37ded640 1 -- 172.21.15.78:0/1664905801 wait complete. 2024-09-18T12:45:49.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.322+0000 7f4b37ded640 1 Processor -- start 2024-09-18T12:45:49.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.322+0000 7f4b37ded640 1 -- start start 2024-09-18T12:45:49.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.322+0000 7f4b37ded640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b30102ac0 0x7f4b30100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:49.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.322+0000 7f4b37ded640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b301033e0 0x7f4b30100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:49.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.322+0000 7f4b37ded640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3010ee50 con 0x7f4b301033e0 2024-09-18T12:45:49.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.322+0000 7f4b37ded640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3010ecd0 con 0x7f4b30102ac0 2024-09-18T12:45:49.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.322+0000 7f4b35388640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b301033e0 0x7f4b30100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:49.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.322+0000 7f4b35388640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b301033e0 0x7f4b30100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36336/0 (socket says 172.21.15.78:36336) 2024-09-18T12:45:49.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.322+0000 7f4b35388640 1 -- 172.21.15.78:0/1932193299 learned_addr learned my addr 172.21.15.78:0/1932193299 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:45:49.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.322+0000 7f4b35b89640 1 --2- 172.21.15.78:0/1932193299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b30102ac0 0x7f4b30100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:49.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.322+0000 7f4b35388640 1 -- 172.21.15.78:0/1932193299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b30102ac0 msgr2=0x7f4b30100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:49.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.322+0000 7f4b35388640 1 --2- 172.21.15.78:0/1932193299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b30102ac0 0x7f4b30100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:49.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.323+0000 7f4b35388640 1 -- 172.21.15.78:0/1932193299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b301011a0 con 0x7f4b301033e0 2024-09-18T12:45:49.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.323+0000 7f4b35388640 1 --2- 172.21.15.78:0/1932193299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b301033e0 0x7f4b30100c60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800b9e0 tx=0x7f4b1800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:49.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.323+0000 7f4b2effd640 1 -- 172.21.15.78:0/1932193299 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b18019070 con 0x7f4b301033e0 2024-09-18T12:45:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.323+0000 7f4b2effd640 1 -- 172.21.15.78:0/1932193299 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b1800cd60 con 0x7f4b301033e0 2024-09-18T12:45:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.323+0000 7f4b37ded640 1 -- 172.21.15.78:0/1932193299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b30101490 con 0x7f4b301033e0 2024-09-18T12:45:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.323+0000 7f4b2effd640 1 -- 172.21.15.78:0/1932193299 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b180075a0 con 0x7f4b301033e0 2024-09-18T12:45:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.323+0000 7f4b37ded640 1 -- 172.21.15.78:0/1932193299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b301a3f80 con 0x7f4b301033e0 2024-09-18T12:45:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.324+0000 7f4b37ded640 1 -- 172.21.15.78:0/1932193299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b3006aa90 con 0x7f4b301033e0 2024-09-18T12:45:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.324+0000 7f4b2effd640 1 -- 172.21.15.78:0/1932193299 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f4b1801c070 con 0x7f4b301033e0 2024-09-18T12:45:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.325+0000 7f4b2effd640 1 --2- 172.21.15.78:0/1932193299 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f4b1c06e2b0 0x7f4b1c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.325+0000 7f4b2effd640 1 -- 172.21.15.78:0/1932193299 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f4b1808d7a0 con 0x7f4b301033e0 2024-09-18T12:45:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.325+0000 7f4b35b89640 1 --2- 172.21.15.78:0/1932193299 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f4b1c06e2b0 0x7f4b1c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.326+0000 7f4b35b89640 1 --2- 172.21.15.78:0/1932193299 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f4b1c06e2b0 0x7f4b1c070770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4b200096c0 tx=0x7f4b20031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:49.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.330+0000 7f4b2effd640 1 -- 172.21.15.78:0/1932193299 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b1805f0f0 con 0x7f4b301033e0 2024-09-18T12:45:49.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.500+0000 7f4b37ded640 1 -- 172.21.15.78:0/1932193299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f4b30101c50 con 0x7f4b301033e0 2024-09-18T12:45:49.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.500+0000 7f4b2effd640 1 -- 172.21.15.78:0/1932193299 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v41) ==== 86+0+160 (secure 0 0 0) 0x7f4b18063920 con 0x7f4b301033e0 2024-09-18T12:45:49.502 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:45:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.502+0000 7f4b37ded640 1 -- 172.21.15.78:0/1932193299 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f4b1c06e2b0 msgr2=0x7f4b1c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.502+0000 7f4b37ded640 1 --2- 172.21.15.78:0/1932193299 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f4b1c06e2b0 0x7f4b1c070770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4b200096c0 tx=0x7f4b20031400 comp rx=0 tx=0).stop 2024-09-18T12:45:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.502+0000 7f4b37ded640 1 -- 172.21.15.78:0/1932193299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b301033e0 msgr2=0x7f4b30100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.502+0000 7f4b37ded640 1 --2- 172.21.15.78:0/1932193299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b301033e0 0x7f4b30100c60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800b9e0 tx=0x7f4b1800bea0 comp rx=0 tx=0).stop 2024-09-18T12:45:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.503+0000 7f4b37ded640 1 -- 172.21.15.78:0/1932193299 shutdown_connections 2024-09-18T12:45:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.503+0000 7f4b37ded640 1 --2- 172.21.15.78:0/1932193299 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f4b1c06e2b0 0x7f4b1c070770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.503+0000 7f4b37ded640 1 --2- 172.21.15.78:0/1932193299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b301033e0 0x7f4b30100c60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.503+0000 7f4b37ded640 1 --2- 172.21.15.78:0/1932193299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b30102ac0 0x7f4b30100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.503+0000 7f4b37ded640 1 -- 172.21.15.78:0/1932193299 >> 172.21.15.78:0/1932193299 conn(0x7f4b300fc520 msgr2=0x7f4b30108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.503+0000 7f4b37ded640 1 -- 172.21.15.78:0/1932193299 shutdown_connections 2024-09-18T12:45:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:49.503+0000 7f4b37ded640 1 -- 172.21.15.78:0/1932193299 wait complete. 2024-09-18T12:45:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:49 smithi148 ceph-mon[35352]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:49.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:49 smithi078 ceph-mon[28091]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:50.262 INFO:teuthology.orchestra.run.smithi078.stdout:[{"version":41,"timestamp":"2024-09-18T12:45:39.581461+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"8898.270936"}]}] 2024-09-18T12:45:50.262 INFO:tasks.ceph_manager:config epoch is 41 2024-09-18T12:45:50.262 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-18T12:45:50.262 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-18T12:45:50.263 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-18T12:45:50.553 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:45:50.673 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:50 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1932193299' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-18T12:45:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:50 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1932193299' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-18T12:45:51.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.020+0000 7f1ae32a8640 1 -- 172.21.15.78:0/1677448061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1adc102ab0 msgr2=0x7f1adc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.020+0000 7f1ae32a8640 1 --2- 172.21.15.78:0/1677448061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1adc102ab0 0x7f1adc102e90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009880 tx=0x7f1ad802a530 comp rx=0 tx=0).stop 2024-09-18T12:45:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.020+0000 7f1ae32a8640 1 -- 172.21.15.78:0/1677448061 shutdown_connections 2024-09-18T12:45:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.020+0000 7f1ae32a8640 1 --2- 172.21.15.78:0/1677448061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1adc1033d0 0x7f1adc10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.020+0000 7f1ae32a8640 1 --2- 172.21.15.78:0/1677448061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1adc102ab0 0x7f1adc102e90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.020+0000 7f1ae32a8640 1 -- 172.21.15.78:0/1677448061 >> 172.21.15.78:0/1677448061 conn(0x7f1adc0fc550 msgr2=0x7f1adc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.020+0000 7f1ae32a8640 1 -- 172.21.15.78:0/1677448061 shutdown_connections 2024-09-18T12:45:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.020+0000 7f1ae32a8640 1 -- 172.21.15.78:0/1677448061 wait complete. 2024-09-18T12:45:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.021+0000 7f1ae32a8640 1 Processor -- start 2024-09-18T12:45:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.021+0000 7f1ae32a8640 1 -- start start 2024-09-18T12:45:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.021+0000 7f1ae32a8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1adc102ab0 0x7f1adc19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.021+0000 7f1ae32a8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1adc1033d0 0x7f1adc19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.021+0000 7f1ae32a8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc10edc0 con 0x7f1adc1033d0 2024-09-18T12:45:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.021+0000 7f1ae32a8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc10ec40 con 0x7f1adc102ab0 2024-09-18T12:45:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.021+0000 7f1ae0843640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1adc1033d0 0x7f1adc19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.021+0000 7f1ae0843640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1adc1033d0 0x7f1adc19db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36360/0 (socket says 172.21.15.78:36360) 2024-09-18T12:45:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.021+0000 7f1ae0843640 1 -- 172.21.15.78:0/3858793722 learned_addr learned my addr 172.21.15.78:0/3858793722 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:45:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.021+0000 7f1ae1044640 1 --2- 172.21.15.78:0/3858793722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1adc102ab0 0x7f1adc19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.022+0000 7f1ae0843640 1 -- 172.21.15.78:0/3858793722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1adc102ab0 msgr2=0x7f1adc19d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.022+0000 7f1ae0843640 1 --2- 172.21.15.78:0/3858793722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1adc102ab0 0x7f1adc19d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.022+0000 7f1ae0843640 1 -- 172.21.15.78:0/3858793722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc1977b0 con 0x7f1adc1033d0 2024-09-18T12:45:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.022+0000 7f1ae0843640 1 --2- 172.21.15.78:0/3858793722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1adc1033d0 0x7f1adc19db70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00d6c0 tx=0x7f1acc00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.022+0000 7f1ad27fc640 1 -- 172.21.15.78:0/3858793722 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1acc017070 con 0x7f1adc1033d0 2024-09-18T12:45:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.022+0000 7f1ad27fc640 1 -- 172.21.15.78:0/3858793722 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1acc009ce0 con 0x7f1adc1033d0 2024-09-18T12:45:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.022+0000 7f1ae32a8640 1 -- 172.21.15.78:0/3858793722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1adc197aa0 con 0x7f1adc1033d0 2024-09-18T12:45:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.022+0000 7f1ad27fc640 1 -- 172.21.15.78:0/3858793722 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1acc00f3c0 con 0x7f1adc1033d0 2024-09-18T12:45:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.022+0000 7f1ae32a8640 1 -- 172.21.15.78:0/3858793722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1adc198030 con 0x7f1adc1033d0 2024-09-18T12:45:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.023+0000 7f1ae32a8640 1 -- 172.21.15.78:0/3858793722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1adc06a580 con 0x7f1adc1033d0 2024-09-18T12:45:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.023+0000 7f1ad27fc640 1 -- 172.21.15.78:0/3858793722 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f1acc010460 con 0x7f1adc1033d0 2024-09-18T12:45:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.024+0000 7f1ad27fc640 1 --2- 172.21.15.78:0/3858793722 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f1ac806e2b0 0x7f1ac8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.024+0000 7f1ad27fc640 1 -- 172.21.15.78:0/3858793722 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f1acc08db40 con 0x7f1adc1033d0 2024-09-18T12:45:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.024+0000 7f1ae1044640 1 --2- 172.21.15.78:0/3858793722 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f1ac806e2b0 0x7f1ac8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.024+0000 7f1ae1044640 1 --2- 172.21.15.78:0/3858793722 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f1ac806e2b0 0x7f1ac8070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80096c0 tx=0x7f1ad8031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.028+0000 7f1ad27fc640 1 -- 172.21.15.78:0/3858793722 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1acc05f490 con 0x7f1adc1033d0 2024-09-18T12:45:51.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.241+0000 7f1ae32a8640 1 -- 172.21.15.78:0/3858793722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f1adc105f80 con 0x7f1adc1033d0 2024-09-18T12:45:51.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.244+0000 7f1ad27fc640 1 -- 172.21.15.78:0/3858793722 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+176562 (secure 0 0 0) 0x7f1acc063cc0 con 0x7f1adc1033d0 2024-09-18T12:45:51.248 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:45:51.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.247+0000 7f1ae32a8640 1 -- 172.21.15.78:0/3858793722 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f1ac806e2b0 msgr2=0x7f1ac8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:51.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.247+0000 7f1ae32a8640 1 --2- 172.21.15.78:0/3858793722 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f1ac806e2b0 0x7f1ac8070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80096c0 tx=0x7f1ad8031400 comp rx=0 tx=0).stop 2024-09-18T12:45:51.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.247+0000 7f1ae32a8640 1 -- 172.21.15.78:0/3858793722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1adc1033d0 msgr2=0x7f1adc19db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:51.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.247+0000 7f1ae32a8640 1 --2- 172.21.15.78:0/3858793722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1adc1033d0 0x7f1adc19db70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00d6c0 tx=0x7f1acc00db80 comp rx=0 tx=0).stop 2024-09-18T12:45:51.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.247+0000 7f1ae32a8640 1 -- 172.21.15.78:0/3858793722 shutdown_connections 2024-09-18T12:45:51.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.247+0000 7f1ae32a8640 1 --2- 172.21.15.78:0/3858793722 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f1ac806e2b0 0x7f1ac8070770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:51.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.247+0000 7f1ae32a8640 1 --2- 172.21.15.78:0/3858793722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1adc1033d0 0x7f1adc19db70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:51.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.247+0000 7f1ae32a8640 1 --2- 172.21.15.78:0/3858793722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1adc102ab0 0x7f1adc19d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:51.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.247+0000 7f1ae32a8640 1 -- 172.21.15.78:0/3858793722 >> 172.21.15.78:0/3858793722 conn(0x7f1adc0fc550 msgr2=0x7f1adc108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:51.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.247+0000 7f1ae32a8640 1 -- 172.21.15.78:0/3858793722 shutdown_connections 2024-09-18T12:45:51.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:51.247+0000 7f1ae32a8640 1 -- 172.21.15.78:0/3858793722 wait complete. 2024-09-18T12:45:51.547 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:51 smithi078 ceph-mon[28091]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:51.547 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:51 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3858793722' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-18T12:45:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:51 smithi148 ceph-mon[35352]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:51 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/3858793722' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-18T12:45:51.977 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"flags":0,"active_gid":14217,"active_name":"smithi078.ohifux","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":934367305},{"type":"v1","addr":"172.21.15.78:6801","nonce":934367305}]},"active_addr":"172.21.15.78:6801/934367305","active_change":"2024-09-18T12:41:41.346140+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14242,"name":"smithi148.bfgshs","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.78:8443/","prometheus":"http://172.21.15.78:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2912158439}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3469069650}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":478020441}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1064721970}]}]} 2024-09-18T12:45:51.981 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-18T12:45:51.981 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-18T12:45:51.982 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-18T12:45:52.230 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:45:52.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.680+0000 7facca6b8640 1 -- 172.21.15.78:0/49057166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc4106800 msgr2=0x7facc4106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:52.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.680+0000 7facca6b8640 1 --2- 172.21.15.78:0/49057166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc4106800 0x7facc4106be0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7facb4009880 tx=0x7facb402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:45:52.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.680+0000 7facca6b8640 1 -- 172.21.15.78:0/49057166 shutdown_connections 2024-09-18T12:45:52.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.680+0000 7facca6b8640 1 --2- 172.21.15.78:0/49057166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc4100800 0x7facc4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:52.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.680+0000 7facca6b8640 1 --2- 172.21.15.78:0/49057166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc4106800 0x7facc4106be0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:52.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.680+0000 7facca6b8640 1 -- 172.21.15.78:0/49057166 >> 172.21.15.78:0/49057166 conn(0x7facc40fc520 msgr2=0x7facc40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:52.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.680+0000 7facca6b8640 1 -- 172.21.15.78:0/49057166 shutdown_connections 2024-09-18T12:45:52.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.680+0000 7facca6b8640 1 -- 172.21.15.78:0/49057166 wait complete. 2024-09-18T12:45:52.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.681+0000 7facca6b8640 1 Processor -- start 2024-09-18T12:45:52.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.681+0000 7facca6b8640 1 -- start start 2024-09-18T12:45:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.681+0000 7facca6b8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc4100800 0x7facc419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.681+0000 7facca6b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc4106800 0x7facc419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.681+0000 7facca6b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7facc410ee50 con 0x7facc4106800 2024-09-18T12:45:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.681+0000 7facca6b8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7facc410ecd0 con 0x7facc4100800 2024-09-18T12:45:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.681+0000 7facc37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc4106800 0x7facc419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.681+0000 7facc37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc4106800 0x7facc419dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34944/0 (socket says 172.21.15.78:34944) 2024-09-18T12:45:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.681+0000 7facc37fe640 1 -- 172.21.15.78:0/2550723741 learned_addr learned my addr 172.21.15.78:0/2550723741 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:45:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.681+0000 7facc37fe640 1 -- 172.21.15.78:0/2550723741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc4100800 msgr2=0x7facc419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.681+0000 7facc3fff640 1 --2- 172.21.15.78:0/2550723741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc4100800 0x7facc419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.681+0000 7facc37fe640 1 --2- 172.21.15.78:0/2550723741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc4100800 0x7facc419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:52.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.681+0000 7facc37fe640 1 -- 172.21.15.78:0/2550723741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc4197820 con 0x7facc4106800 2024-09-18T12:45:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.682+0000 7facc37fe640 1 --2- 172.21.15.78:0/2550723741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc4106800 0x7facc419dbe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7facb800b420 tx=0x7facb800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.682+0000 7facc17fa640 1 -- 172.21.15.78:0/2550723741 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facb8011630 con 0x7facc4106800 2024-09-18T12:45:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.682+0000 7facc17fa640 1 -- 172.21.15.78:0/2550723741 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7facb8016070 con 0x7facc4106800 2024-09-18T12:45:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.682+0000 7facca6b8640 1 -- 172.21.15.78:0/2550723741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc4197b10 con 0x7facc4106800 2024-09-18T12:45:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.682+0000 7facc17fa640 1 -- 172.21.15.78:0/2550723741 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facb8010d40 con 0x7facc4106800 2024-09-18T12:45:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.682+0000 7facca6b8640 1 -- 172.21.15.78:0/2550723741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc41980a0 con 0x7facc4106800 2024-09-18T12:45:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.683+0000 7facca6b8640 1 -- 172.21.15.78:0/2550723741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc4101f40 con 0x7facc4106800 2024-09-18T12:45:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.683+0000 7facc17fa640 1 -- 172.21.15.78:0/2550723741 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7facb801b460 con 0x7facc4106800 2024-09-18T12:45:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.684+0000 7facc17fa640 1 --2- 172.21.15.78:0/2550723741 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7facac06e2b0 0x7facac070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.684+0000 7facc3fff640 1 --2- 172.21.15.78:0/2550723741 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7facac06e2b0 0x7facac070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.684+0000 7facc17fa640 1 -- 172.21.15.78:0/2550723741 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7facb808d690 con 0x7facc4106800 2024-09-18T12:45:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.684+0000 7facc3fff640 1 --2- 172.21.15.78:0/2550723741 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7facac06e2b0 0x7facac070770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7facb4031460 tx=0x7facb4009560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.688+0000 7facc17fa640 1 -- 172.21.15.78:0/2550723741 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7facb805b330 con 0x7facc4106800 2024-09-18T12:45:52.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.855+0000 7facca6b8640 1 -- 172.21.15.78:0/2550723741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7facc4108d70 con 0x7facc4106800 2024-09-18T12:45:52.856 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:52 smithi078 ceph-mon[28091]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:52.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.856+0000 7facc17fa640 1 -- 172.21.15.78:0/2550723741 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11408 (secure 0 0 0) 0x7facb805efe0 con 0x7facc4106800 2024-09-18T12:45:52.857 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:45:52.857 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":39,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","created":"2024-09-18T12:39:40.184514+0000","modified":"2024-09-18T12:45:41.817177+0000","last_up_change":"2024-09-18T12:45:40.584891+0000","last_in_change":"2024-09-18T12:45:16.726224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:44:21.669427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"91b9c8b7-2466-4085-8bec-b4f0d4d88e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2583422518},{"type":"v1","addr":"172.21.15.78:6803","nonce":2583422518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2583422518},{"type":"v1","addr":"172.21.15.78:6805","nonce":2583422518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2583422518},{"type":"v1","addr":"172.21.15.78:6809","nonce":2583422518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2583422518},{"type":"v1","addr":"172.21.15.78:6807","nonce":2583422518}]},"public_addr":"172.21.15.78:6803/2583422518","cluster_addr":"172.21.15.78:6805/2583422518","heartbeat_back_addr":"172.21.15.78:6809/2583422518","heartbeat_front_addr":"172.21.15.78:6807/2583422518","state":["exists","up"]},{"osd":1,"uuid":"f9b36d44-66f3-4270-8a49-7bb6f6b7af34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3802001947},{"type":"v1","addr":"172.21.15.78:6811","nonce":3802001947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3802001947},{"type":"v1","addr":"172.21.15.78:6813","nonce":3802001947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3802001947},{"type":"v1","addr":"172.21.15.78:6817","nonce":3802001947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3802001947},{"type":"v1","addr":"172.21.15.78:6815","nonce":3802001947}]},"public_addr":"172.21.15.78:6811/3802001947","cluster_addr":"172.21.15.78:6813/3802001947","heartbeat_back_addr":"172.21.15.78:6817/3802001947","heartbeat_front_addr":"172.21.15.78:6815/3802001947","state":["exists","up"]},{"osd":2,"uuid":"c337d9bd-8a41-4b3f-8b9f-04560dafa83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3697746229},{"type":"v1","addr":"172.21.15.78:6819","nonce":3697746229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3697746229},{"type":"v1","addr":"172.21.15.78:6821","nonce":3697746229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3697746229},{"type":"v1","addr":"172.21.15.78:6825","nonce":3697746229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3697746229},{"type":"v1","addr":"172.21.15.78:6823","nonce":3697746229}]},"public_addr":"172.21.15.78:6819/3697746229","cluster_addr":"172.21.15.78:6821/3697746229","heartbeat_back_addr":"172.21.15.78:6825/3697746229","heartbeat_front_addr":"172.21.15.78:6823/3697746229","state":["exists","up"]},{"osd":3,"uuid":"c5ed45d0-75b8-4f2d-8861-779790af7b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2230690563},{"type":"v1","addr":"172.21.15.148:6801","nonce":2230690563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2230690563},{"type":"v1","addr":"172.21.15.148:6803","nonce":2230690563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2230690563},{"type":"v1","addr":"172.21.15.148:6807","nonce":2230690563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2230690563},{"type":"v1","addr":"172.21.15.148:6805","nonce":2230690563}]},"public_addr":"172.21.15.148:6801/2230690563","cluster_addr":"172.21.15.148:6803/2230690563","heartbeat_back_addr":"172.21.15.148:6807/2230690563","heartbeat_front_addr":"172.21.15.148:6805/2230690563","state":["exists","up"]},{"osd":4,"uuid":"97cd45fe-7682-4eb6-9b29-ab7ff324f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2544176191},{"type":"v1","addr":"172.21.15.148:6809","nonce":2544176191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2544176191},{"type":"v1","addr":"172.21.15.148:6811","nonce":2544176191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2544176191},{"type":"v1","addr":"172.21.15.148:6815","nonce":2544176191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2544176191},{"type":"v1","addr":"172.21.15.148:6813","nonce":2544176191}]},"public_addr":"172.21.15.148:6809/2544176191","cluster_addr":"172.21.15.148:6811/2544176191","heartbeat_back_addr":"172.21.15.148:6815/2544176191","heartbeat_front_addr":"172.21.15.148:6813/2544176191","state":["exists","up"]},{"osd":5,"uuid":"65e5086e-6f88-4760-bf6f-6f9bace7c3f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3949254394},{"type":"v1","addr":"172.21.15.148:6817","nonce":3949254394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3949254394},{"type":"v1","addr":"172.21.15.148:6819","nonce":3949254394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3949254394},{"type":"v1","addr":"172.21.15.148:6823","nonce":3949254394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3949254394},{"type":"v1","addr":"172.21.15.148:6821","nonce":3949254394}]},"public_addr":"172.21.15.148:6817/3949254394","cluster_addr":"172.21.15.148:6819/3949254394","heartbeat_back_addr":"172.21.15.148:6823/3949254394","heartbeat_front_addr":"172.21.15.148:6821/3949254394","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:43:20.762681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:43:50.235173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:44:18.789613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:44:44.298829+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:45:11.720301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:45:38.366806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6800/2933657307":"2024-09-19T12:41:41.346021+0000","172.21.15.78:0/538305077":"2024-09-19T12:40:12.294094+0000","172.21.15.78:0/3952955113":"2024-09-19T12:40:43.381299+0000","172.21.15.78:0/1909696487":"2024-09-19T12:40:12.294094+0000","172.21.15.78:6801/2933657307":"2024-09-19T12:41:41.346021+0000","172.21.15.78:6801/2989194374":"2024-09-19T12:40:12.294094+0000","172.21.15.78:0/2192057687":"2024-09-19T12:41:41.346021+0000","172.21.15.78:0/1268671960":"2024-09-19T12:40:12.294094+0000","172.21.15.78:0/2388875547":"2024-09-19T12:40:43.381299+0000","172.21.15.78:0/1473581153":"2024-09-19T12:40:43.381299+0000","172.21.15.78:6800/2511056793":"2024-09-19T12:40:43.381299+0000","172.21.15.78:6800/2989194374":"2024-09-19T12:40:12.294094+0000","172.21.15.78:6801/2511056793":"2024-09-19T12:40:43.381299+0000","172.21.15.78:0/1238593923":"2024-09-19T12:41:41.346021+0000","172.21.15.78:0/3952976544":"2024-09-19T12:41:41.346021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:45:52.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.858+0000 7facca6b8640 1 -- 172.21.15.78:0/2550723741 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7facac06e2b0 msgr2=0x7facac070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:52.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.858+0000 7facca6b8640 1 --2- 172.21.15.78:0/2550723741 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7facac06e2b0 0x7facac070770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7facb4031460 tx=0x7facb4009560 comp rx=0 tx=0).stop 2024-09-18T12:45:52.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.858+0000 7facca6b8640 1 -- 172.21.15.78:0/2550723741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc4106800 msgr2=0x7facc419dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:52.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.858+0000 7facca6b8640 1 --2- 172.21.15.78:0/2550723741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc4106800 0x7facc419dbe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7facb800b420 tx=0x7facb800b8e0 comp rx=0 tx=0).stop 2024-09-18T12:45:52.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.858+0000 7facca6b8640 1 -- 172.21.15.78:0/2550723741 shutdown_connections 2024-09-18T12:45:52.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.858+0000 7facca6b8640 1 --2- 172.21.15.78:0/2550723741 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7facac06e2b0 0x7facac070770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:52.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.858+0000 7facca6b8640 1 --2- 172.21.15.78:0/2550723741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facc4106800 0x7facc419dbe0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:52.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.858+0000 7facca6b8640 1 --2- 172.21.15.78:0/2550723741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc4100800 0x7facc419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:52.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.858+0000 7facca6b8640 1 -- 172.21.15.78:0/2550723741 >> 172.21.15.78:0/2550723741 conn(0x7facc40fc520 msgr2=0x7facc40fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:52.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.858+0000 7facca6b8640 1 -- 172.21.15.78:0/2550723741 shutdown_connections 2024-09-18T12:45:52.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:52.858+0000 7facca6b8640 1 -- 172.21.15.78:0/2550723741 wait complete. 2024-09-18T12:45:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:52 smithi148 ceph-mon[35352]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:53.582 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-18T12:45:53.582 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-18T12:45:53.830 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:45:53.951 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:53 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2550723741' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:45:53.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:53 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2550723741' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:45:54.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.268+0000 7f85d60fa640 1 -- 172.21.15.78:0/2307235303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d01034a0 msgr2=0x7f85d010b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:54.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.268+0000 7f85d60fa640 1 --2- 172.21.15.78:0/2307235303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d01034a0 0x7f85d010b990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009880 tx=0x7f85b802a530 comp rx=0 tx=0).stop 2024-09-18T12:45:54.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.268+0000 7f85d60fa640 1 -- 172.21.15.78:0/2307235303 shutdown_connections 2024-09-18T12:45:54.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.268+0000 7f85d60fa640 1 --2- 172.21.15.78:0/2307235303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d01034a0 0x7f85d010b990 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:54.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.268+0000 7f85d60fa640 1 --2- 172.21.15.78:0/2307235303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85d0102b80 0x7f85d0102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:54.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.268+0000 7f85d60fa640 1 -- 172.21.15.78:0/2307235303 >> 172.21.15.78:0/2307235303 conn(0x7f85d00fc520 msgr2=0x7f85d00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:54.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.268+0000 7f85d60fa640 1 -- 172.21.15.78:0/2307235303 shutdown_connections 2024-09-18T12:45:54.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.269+0000 7f85d60fa640 1 -- 172.21.15.78:0/2307235303 wait complete. 2024-09-18T12:45:54.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.269+0000 7f85d60fa640 1 Processor -- start 2024-09-18T12:45:54.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.269+0000 7f85d60fa640 1 -- start start 2024-09-18T12:45:54.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.269+0000 7f85d60fa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85d0102b80 0x7f85d01007e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:54.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.269+0000 7f85d60fa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d01034a0 0x7f85d0100d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:54.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.269+0000 7f85d60fa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f85d010edf0 con 0x7f85d01034a0 2024-09-18T12:45:54.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.269+0000 7f85d60fa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f85d010ec70 con 0x7f85d0102b80 2024-09-18T12:45:54.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.269+0000 7f85c7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d01034a0 0x7f85d0100d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:54.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.269+0000 7f85c7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d01034a0 0x7f85d0100d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34960/0 (socket says 172.21.15.78:34960) 2024-09-18T12:45:54.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.269+0000 7f85c7fff640 1 -- 172.21.15.78:0/3390231533 learned_addr learned my addr 172.21.15.78:0/3390231533 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:45:54.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.269+0000 7f85cf7fe640 1 --2- 172.21.15.78:0/3390231533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85d0102b80 0x7f85d01007e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:54.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.270+0000 7f85c7fff640 1 -- 172.21.15.78:0/3390231533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85d0102b80 msgr2=0x7f85d01007e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:54.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.270+0000 7f85c7fff640 1 --2- 172.21.15.78:0/3390231533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85d0102b80 0x7f85d01007e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:54.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.270+0000 7f85c7fff640 1 -- 172.21.15.78:0/3390231533 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d0101260 con 0x7f85d01034a0 2024-09-18T12:45:54.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.270+0000 7f85c7fff640 1 --2- 172.21.15.78:0/3390231533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d01034a0 0x7f85d0100d20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f85b8004f90 tx=0x7f85b80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:54.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.270+0000 7f85cd7fa640 1 -- 172.21.15.78:0/3390231533 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85b803f070 con 0x7f85d01034a0 2024-09-18T12:45:54.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.270+0000 7f85cd7fa640 1 -- 172.21.15.78:0/3390231533 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f85b8004c70 con 0x7f85d01034a0 2024-09-18T12:45:54.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.270+0000 7f85cd7fa640 1 -- 172.21.15.78:0/3390231533 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85b8035030 con 0x7f85d01034a0 2024-09-18T12:45:54.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.270+0000 7f85d60fa640 1 -- 172.21.15.78:0/3390231533 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d01014f0 con 0x7f85d01034a0 2024-09-18T12:45:54.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.270+0000 7f85d60fa640 1 -- 172.21.15.78:0/3390231533 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d01a3da0 con 0x7f85d01034a0 2024-09-18T12:45:54.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.271+0000 7f85d60fa640 1 -- 172.21.15.78:0/3390231533 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d006a9d0 con 0x7f85d01034a0 2024-09-18T12:45:54.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.272+0000 7f85cd7fa640 1 -- 172.21.15.78:0/3390231533 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f85b8042070 con 0x7f85d01034a0 2024-09-18T12:45:54.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.272+0000 7f85cd7fa640 1 --2- 172.21.15.78:0/3390231533 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f85bc06e2b0 0x7f85bc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:54.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.272+0000 7f85cf7fe640 1 --2- 172.21.15.78:0/3390231533 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f85bc06e2b0 0x7f85bc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:54.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.272+0000 7f85cd7fa640 1 -- 172.21.15.78:0/3390231533 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f85b80ae720 con 0x7f85d01034a0 2024-09-18T12:45:54.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.273+0000 7f85cf7fe640 1 --2- 172.21.15.78:0/3390231533 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f85bc06e2b0 0x7f85bc070770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f85c0005fd0 tx=0x7f85c000b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:54.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.277+0000 7f85cd7fa640 1 -- 172.21.15.78:0/3390231533 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f85b8080070 con 0x7f85d01034a0 2024-09-18T12:45:54.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.443+0000 7f85d60fa640 1 -- 172.21.15.78:0/3390231533 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85d0104f90 con 0x7f85d01034a0 2024-09-18T12:45:54.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.444+0000 7f85cd7fa640 1 -- 172.21.15.78:0/3390231533 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11408 (secure 0 0 0) 0x7f85b80848a0 con 0x7f85d01034a0 2024-09-18T12:45:54.446 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:45:54.446 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":39,"fsid":"ecc0857e-75ba-11ef-bceb-c7b262605968","created":"2024-09-18T12:39:40.184514+0000","modified":"2024-09-18T12:45:41.817177+0000","last_up_change":"2024-09-18T12:45:40.584891+0000","last_in_change":"2024-09-18T12:45:16.726224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:44:21.669427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"91b9c8b7-2466-4085-8bec-b4f0d4d88e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2583422518},{"type":"v1","addr":"172.21.15.78:6803","nonce":2583422518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2583422518},{"type":"v1","addr":"172.21.15.78:6805","nonce":2583422518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2583422518},{"type":"v1","addr":"172.21.15.78:6809","nonce":2583422518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2583422518},{"type":"v1","addr":"172.21.15.78:6807","nonce":2583422518}]},"public_addr":"172.21.15.78:6803/2583422518","cluster_addr":"172.21.15.78:6805/2583422518","heartbeat_back_addr":"172.21.15.78:6809/2583422518","heartbeat_front_addr":"172.21.15.78:6807/2583422518","state":["exists","up"]},{"osd":1,"uuid":"f9b36d44-66f3-4270-8a49-7bb6f6b7af34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3802001947},{"type":"v1","addr":"172.21.15.78:6811","nonce":3802001947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3802001947},{"type":"v1","addr":"172.21.15.78:6813","nonce":3802001947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3802001947},{"type":"v1","addr":"172.21.15.78:6817","nonce":3802001947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3802001947},{"type":"v1","addr":"172.21.15.78:6815","nonce":3802001947}]},"public_addr":"172.21.15.78:6811/3802001947","cluster_addr":"172.21.15.78:6813/3802001947","heartbeat_back_addr":"172.21.15.78:6817/3802001947","heartbeat_front_addr":"172.21.15.78:6815/3802001947","state":["exists","up"]},{"osd":2,"uuid":"c337d9bd-8a41-4b3f-8b9f-04560dafa83e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3697746229},{"type":"v1","addr":"172.21.15.78:6819","nonce":3697746229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3697746229},{"type":"v1","addr":"172.21.15.78:6821","nonce":3697746229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3697746229},{"type":"v1","addr":"172.21.15.78:6825","nonce":3697746229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3697746229},{"type":"v1","addr":"172.21.15.78:6823","nonce":3697746229}]},"public_addr":"172.21.15.78:6819/3697746229","cluster_addr":"172.21.15.78:6821/3697746229","heartbeat_back_addr":"172.21.15.78:6825/3697746229","heartbeat_front_addr":"172.21.15.78:6823/3697746229","state":["exists","up"]},{"osd":3,"uuid":"c5ed45d0-75b8-4f2d-8861-779790af7b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2230690563},{"type":"v1","addr":"172.21.15.148:6801","nonce":2230690563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2230690563},{"type":"v1","addr":"172.21.15.148:6803","nonce":2230690563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2230690563},{"type":"v1","addr":"172.21.15.148:6807","nonce":2230690563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2230690563},{"type":"v1","addr":"172.21.15.148:6805","nonce":2230690563}]},"public_addr":"172.21.15.148:6801/2230690563","cluster_addr":"172.21.15.148:6803/2230690563","heartbeat_back_addr":"172.21.15.148:6807/2230690563","heartbeat_front_addr":"172.21.15.148:6805/2230690563","state":["exists","up"]},{"osd":4,"uuid":"97cd45fe-7682-4eb6-9b29-ab7ff324f7be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2544176191},{"type":"v1","addr":"172.21.15.148:6809","nonce":2544176191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2544176191},{"type":"v1","addr":"172.21.15.148:6811","nonce":2544176191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2544176191},{"type":"v1","addr":"172.21.15.148:6815","nonce":2544176191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2544176191},{"type":"v1","addr":"172.21.15.148:6813","nonce":2544176191}]},"public_addr":"172.21.15.148:6809/2544176191","cluster_addr":"172.21.15.148:6811/2544176191","heartbeat_back_addr":"172.21.15.148:6815/2544176191","heartbeat_front_addr":"172.21.15.148:6813/2544176191","state":["exists","up"]},{"osd":5,"uuid":"65e5086e-6f88-4760-bf6f-6f9bace7c3f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3949254394},{"type":"v1","addr":"172.21.15.148:6817","nonce":3949254394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3949254394},{"type":"v1","addr":"172.21.15.148:6819","nonce":3949254394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3949254394},{"type":"v1","addr":"172.21.15.148:6823","nonce":3949254394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3949254394},{"type":"v1","addr":"172.21.15.148:6821","nonce":3949254394}]},"public_addr":"172.21.15.148:6817/3949254394","cluster_addr":"172.21.15.148:6819/3949254394","heartbeat_back_addr":"172.21.15.148:6823/3949254394","heartbeat_front_addr":"172.21.15.148:6821/3949254394","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:43:20.762681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:43:50.235173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:44:18.789613+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:44:44.298829+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:45:11.720301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:45:38.366806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6800/2933657307":"2024-09-19T12:41:41.346021+0000","172.21.15.78:0/538305077":"2024-09-19T12:40:12.294094+0000","172.21.15.78:0/3952955113":"2024-09-19T12:40:43.381299+0000","172.21.15.78:0/1909696487":"2024-09-19T12:40:12.294094+0000","172.21.15.78:6801/2933657307":"2024-09-19T12:41:41.346021+0000","172.21.15.78:6801/2989194374":"2024-09-19T12:40:12.294094+0000","172.21.15.78:0/2192057687":"2024-09-19T12:41:41.346021+0000","172.21.15.78:0/1268671960":"2024-09-19T12:40:12.294094+0000","172.21.15.78:0/2388875547":"2024-09-19T12:40:43.381299+0000","172.21.15.78:0/1473581153":"2024-09-19T12:40:43.381299+0000","172.21.15.78:6800/2511056793":"2024-09-19T12:40:43.381299+0000","172.21.15.78:6800/2989194374":"2024-09-19T12:40:12.294094+0000","172.21.15.78:6801/2511056793":"2024-09-19T12:40:43.381299+0000","172.21.15.78:0/1238593923":"2024-09-19T12:41:41.346021+0000","172.21.15.78:0/3952976544":"2024-09-19T12:41:41.346021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:45:54.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.446+0000 7f85d60fa640 1 -- 172.21.15.78:0/3390231533 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f85bc06e2b0 msgr2=0x7f85bc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.446+0000 7f85d60fa640 1 --2- 172.21.15.78:0/3390231533 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f85bc06e2b0 0x7f85bc070770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f85c0005fd0 tx=0x7f85c000b390 comp rx=0 tx=0).stop 2024-09-18T12:45:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.446+0000 7f85d60fa640 1 -- 172.21.15.78:0/3390231533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d01034a0 msgr2=0x7f85d0100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.446+0000 7f85d60fa640 1 --2- 172.21.15.78:0/3390231533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d01034a0 0x7f85d0100d20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f85b8004f90 tx=0x7f85b80048f0 comp rx=0 tx=0).stop 2024-09-18T12:45:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.446+0000 7f85d60fa640 1 -- 172.21.15.78:0/3390231533 shutdown_connections 2024-09-18T12:45:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.446+0000 7f85d60fa640 1 --2- 172.21.15.78:0/3390231533 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f85bc06e2b0 0x7f85bc070770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.446+0000 7f85d60fa640 1 --2- 172.21.15.78:0/3390231533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d01034a0 0x7f85d0100d20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.446+0000 7f85d60fa640 1 --2- 172.21.15.78:0/3390231533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85d0102b80 0x7f85d01007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.446+0000 7f85d60fa640 1 -- 172.21.15.78:0/3390231533 >> 172.21.15.78:0/3390231533 conn(0x7f85d00fc520 msgr2=0x7f85d0107e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.446+0000 7f85d60fa640 1 -- 172.21.15.78:0/3390231533 shutdown_connections 2024-09-18T12:45:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:54.446+0000 7f85d60fa640 1 -- 172.21.15.78:0/3390231533 wait complete. 2024-09-18T12:45:54.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:54 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/3390231533' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:45:54.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:54 smithi148 ceph-mon[35352]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:54 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3390231533' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:45:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:54 smithi078 ceph-mon[28091]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:55.140 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-18T12:45:55.141 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-18T12:45:55.141 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-18T12:45:55.142 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-18T12:45:55.142 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-18T12:45:55.143 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-18T12:45:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:45:55.440 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:45:56.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.026+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/1595807548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b0101900 msgr2=0x7fc6b0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:56.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.026+0000 7fc6b6b4a640 1 --2- 172.21.15.78:0/1595807548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b0101900 0x7fc6b0101d60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009880 tx=0x7fc6a002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:45:56.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.026+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/1595807548 shutdown_connections 2024-09-18T12:45:56.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.026+0000 7fc6b6b4a640 1 --2- 172.21.15.78:0/1595807548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b0101900 0x7fc6b0101d60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:56.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.026+0000 7fc6b6b4a640 1 --2- 172.21.15.78:0/1595807548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6b0107900 0x7fc6b0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:56.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.026+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/1595807548 >> 172.21.15.78:0/1595807548 conn(0x7fc6b00fd600 msgr2=0x7fc6b00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:56.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.026+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/1595807548 shutdown_connections 2024-09-18T12:45:56.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.026+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/1595807548 wait complete. 2024-09-18T12:45:56.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.027+0000 7fc6b6b4a640 1 Processor -- start 2024-09-18T12:45:56.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.027+0000 7fc6b6b4a640 1 -- start start 2024-09-18T12:45:56.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.027+0000 7fc6b6b4a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b0101900 0x7fc6b019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:56.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.027+0000 7fc6b6b4a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6b0107900 0x7fc6b019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:56.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.027+0000 7fc6b6b4a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b010ee30 con 0x7fc6b0101900 2024-09-18T12:45:56.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.027+0000 7fc6b6b4a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b010ecb0 con 0x7fc6b0107900 2024-09-18T12:45:56.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.027+0000 7fc6b48e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b0101900 0x7fc6b019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:56.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.027+0000 7fc6b48e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b0101900 0x7fc6b019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34980/0 (socket says 172.21.15.78:34980) 2024-09-18T12:45:56.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.027+0000 7fc6b48e6640 1 -- 172.21.15.78:0/4201756434 learned_addr learned my addr 172.21.15.78:0/4201756434 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:45:56.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.027+0000 7fc6a7fff640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6b0107900 0x7fc6b019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:56.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.028+0000 7fc6b48e6640 1 -- 172.21.15.78:0/4201756434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6b0107900 msgr2=0x7fc6b019dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:56.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.028+0000 7fc6b48e6640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6b0107900 0x7fc6b019dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:56.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.028+0000 7fc6b48e6640 1 -- 172.21.15.78:0/4201756434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b0197840 con 0x7fc6b0101900 2024-09-18T12:45:56.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.028+0000 7fc6b48e6640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b0101900 0x7fc6b019d6c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00b420 tx=0x7fc6ac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:56.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.028+0000 7fc6a5ffb640 1 -- 172.21.15.78:0/4201756434 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6ac011630 con 0x7fc6b0101900 2024-09-18T12:45:56.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.028+0000 7fc6a5ffb640 1 -- 172.21.15.78:0/4201756434 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc6ac016070 con 0x7fc6b0101900 2024-09-18T12:45:56.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.028+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/4201756434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b0197b30 con 0x7fc6b0101900 2024-09-18T12:45:56.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.028+0000 7fc6a5ffb640 1 -- 172.21.15.78:0/4201756434 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6ac010d40 con 0x7fc6b0101900 2024-09-18T12:45:56.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.028+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/4201756434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b0198090 con 0x7fc6b0101900 2024-09-18T12:45:56.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.029+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/4201756434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc6b01986b0 con 0x7fc6b0101900 2024-09-18T12:45:56.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.030+0000 7fc6a5ffb640 1 -- 172.21.15.78:0/4201756434 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc6ac01b460 con 0x7fc6b0101900 2024-09-18T12:45:56.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.030+0000 7fc6a5ffb640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc69806e2b0 0x7fc698070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:56.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.030+0000 7fc6a5ffb640 1 -- 172.21.15.78:0/4201756434 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fc6ac08d680 con 0x7fc6b0101900 2024-09-18T12:45:56.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.030+0000 7fc6a7fff640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc69806e2b0 0x7fc698070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:56.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.030+0000 7fc6a5ffb640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229] conn(0x7fc6980740a0 0x7fc6980764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:56.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.030+0000 7fc6a5ffb640 1 -- 172.21.15.78:0/4201756434 --> [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc698076b70 con 0x7fc6980740a0 2024-09-18T12:45:56.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.030+0000 7fc6a5ffb640 1 -- 172.21.15.78:0/4201756434 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc6ac094050 con 0x7fc6b0101900 2024-09-18T12:45:56.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.030+0000 7fc6b50e7640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229] conn(0x7fc6980740a0 0x7fc6980764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:56.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.031+0000 7fc6a7fff640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc69806e2b0 0x7fc698070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0198b90 tx=0x7fc6a0031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:56.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.031+0000 7fc6b50e7640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229] conn(0x7fc6980740a0 0x7fc6980764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:56.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.031+0000 7fc6a5ffb640 1 -- 172.21.15.78:0/4201756434 <== osd.2 v2:172.21.15.78:6818/3697746229 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc698076b70 con 0x7fc6980740a0 2024-09-18T12:45:56.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.045+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/4201756434 --> [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc6b0062880 con 0x7fc6980740a0 2024-09-18T12:45:56.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.045+0000 7fc6a5ffb640 1 -- 172.21.15.78:0/4201756434 <== osd.2 v2:172.21.15.78:6818/3697746229 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc6b0062880 con 0x7fc6980740a0 2024-09-18T12:45:56.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.045+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229] conn(0x7fc6980740a0 msgr2=0x7fc6980764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:56.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.045+0000 7fc6b6b4a640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229] conn(0x7fc6980740a0 0x7fc6980764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:56.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.045+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc69806e2b0 msgr2=0x7fc698070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:56.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.045+0000 7fc6b6b4a640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc69806e2b0 0x7fc698070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0198b90 tx=0x7fc6a0031400 comp rx=0 tx=0).stop 2024-09-18T12:45:56.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.046+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b0101900 msgr2=0x7fc6b019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:56.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.046+0000 7fc6b6b4a640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b0101900 0x7fc6b019d6c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00b420 tx=0x7fc6ac00b8e0 comp rx=0 tx=0).stop 2024-09-18T12:45:56.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.046+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/4201756434 shutdown_connections 2024-09-18T12:45:56.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.046+0000 7fc6b6b4a640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:6818/3697746229,v1:172.21.15.78:6819/3697746229] conn(0x7fc6980740a0 0x7fc6980764c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:56.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.046+0000 7fc6b6b4a640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc69806e2b0 0x7fc698070770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:56.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.046+0000 7fc6b6b4a640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6b0107900 0x7fc6b019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:56.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.046+0000 7fc6b6b4a640 1 --2- 172.21.15.78:0/4201756434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b0101900 0x7fc6b019d6c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:56.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.046+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/4201756434 >> 172.21.15.78:0/4201756434 conn(0x7fc6b00fd600 msgr2=0x7fc6b00fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:56.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.046+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/4201756434 shutdown_connections 2024-09-18T12:45:56.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.046+0000 7fc6b6b4a640 1 -- 172.21.15.78:0/4201756434 wait complete. 2024-09-18T12:45:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:56 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:56 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:56.797 INFO:teuthology.orchestra.run.smithi078.stdout:81604378647 2024-09-18T12:45:56.798 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-18T12:45:57.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.985+0000 7fb63bc3b640 1 -- 172.21.15.78:0/4098239054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb634106860 msgr2=0x7fb634106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:57.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.985+0000 7fb63bc3b640 1 --2- 172.21.15.78:0/4098239054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb634106860 0x7fb634106c40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb630009880 tx=0x7fb63002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:45:57.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.985+0000 7fb63bc3b640 1 -- 172.21.15.78:0/4098239054 shutdown_connections 2024-09-18T12:45:57.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.985+0000 7fb63bc3b640 1 --2- 172.21.15.78:0/4098239054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb634100860 0x7fb634100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:57.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.985+0000 7fb63bc3b640 1 --2- 172.21.15.78:0/4098239054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb634106860 0x7fb634106c40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:57.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.985+0000 7fb63bc3b640 1 -- 172.21.15.78:0/4098239054 >> 172.21.15.78:0/4098239054 conn(0x7fb6340fc580 msgr2=0x7fb6340fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.985+0000 7fb63bc3b640 1 -- 172.21.15.78:0/4098239054 shutdown_connections 2024-09-18T12:45:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.985+0000 7fb63bc3b640 1 -- 172.21.15.78:0/4098239054 wait complete. 2024-09-18T12:45:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.986+0000 7fb63bc3b640 1 Processor -- start 2024-09-18T12:45:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.986+0000 7fb63bc3b640 1 -- start start 2024-09-18T12:45:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.986+0000 7fb63bc3b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb634100860 0x7fb63419c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.986+0000 7fb63bc3b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb634106860 0x7fb63419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.986+0000 7fb63bc3b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb63410dd30 con 0x7fb634100860 2024-09-18T12:45:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.986+0000 7fb63bc3b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb63410dbb0 con 0x7fb634106860 2024-09-18T12:45:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.986+0000 7fb6399d7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb634100860 0x7fb63419c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.987+0000 7fb6399d7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb634100860 0x7fb63419c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34998/0 (socket says 172.21.15.78:34998) 2024-09-18T12:45:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.987+0000 7fb6399d7640 1 -- 172.21.15.78:0/3737164916 learned_addr learned my addr 172.21.15.78:0/3737164916 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:45:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.987+0000 7fb6391d6640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb634106860 0x7fb63419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.987+0000 7fb6399d7640 1 -- 172.21.15.78:0/3737164916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb634106860 msgr2=0x7fb63419cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.987+0000 7fb6399d7640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb634106860 0x7fb63419cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.987+0000 7fb6399d7640 1 -- 172.21.15.78:0/3737164916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb634196700 con 0x7fb634100860 2024-09-18T12:45:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.987+0000 7fb6391d6640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb634106860 0x7fb63419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:45:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.987+0000 7fb6399d7640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb634100860 0x7fb63419c630 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb630031460 tx=0x7fb6300045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.987+0000 7fb62affd640 1 -- 172.21.15.78:0/3737164916 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb630035070 con 0x7fb634100860 2024-09-18T12:45:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.987+0000 7fb62affd640 1 -- 172.21.15.78:0/3737164916 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb6300035f0 con 0x7fb634100860 2024-09-18T12:45:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.987+0000 7fb63bc3b640 1 -- 172.21.15.78:0/3737164916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb634196990 con 0x7fb634100860 2024-09-18T12:45:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.987+0000 7fb62affd640 1 -- 172.21.15.78:0/3737164916 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb630031890 con 0x7fb634100860 2024-09-18T12:45:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.987+0000 7fb63bc3b640 1 -- 172.21.15.78:0/3737164916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb634196e90 con 0x7fb634100860 2024-09-18T12:45:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.988+0000 7fb63bc3b640 1 -- 172.21.15.78:0/3737164916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb6341973d0 con 0x7fb634100860 2024-09-18T12:45:57.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.989+0000 7fb62affd640 1 -- 172.21.15.78:0/3737164916 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fb630031b90 con 0x7fb634100860 2024-09-18T12:45:57.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.989+0000 7fb62affd640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb62006e2b0 0x7fb620070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:57.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.989+0000 7fb62affd640 1 -- 172.21.15.78:0/3737164916 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fb63003e070 con 0x7fb634100860 2024-09-18T12:45:57.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.989+0000 7fb6391d6640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb62006e2b0 0x7fb620070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:57.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.989+0000 7fb62affd640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.148:6816/3949254394,v1:172.21.15.148:6817/3949254394] conn(0x7fb6200740a0 0x7fb6200764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:57.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.989+0000 7fb62affd640 1 -- 172.21.15.78:0/3737164916 --> [v2:172.21.15.148:6816/3949254394,v1:172.21.15.148:6817/3949254394] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb620076b70 con 0x7fb6200740a0 2024-09-18T12:45:57.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.989+0000 7fb62affd640 1 -- 172.21.15.78:0/3737164916 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fb6300b09e0 con 0x7fb634100860 2024-09-18T12:45:57.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.990+0000 7fb6391d6640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb62006e2b0 0x7fb620070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb6240058c0 tx=0x7fb624005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:57.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.990+0000 7fb63a1d8640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.148:6816/3949254394,v1:172.21.15.148:6817/3949254394] conn(0x7fb6200740a0 0x7fb6200764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:57.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.990+0000 7fb63a1d8640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.148:6816/3949254394,v1:172.21.15.148:6817/3949254394] conn(0x7fb6200740a0 0x7fb6200764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:57.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:56.991+0000 7fb62affd640 1 -- 172.21.15.78:0/3737164916 <== osd.5 v2:172.21.15.148:6816/3949254394 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb620076b70 con 0x7fb6200740a0 2024-09-18T12:45:57.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.004+0000 7fb63bc3b640 1 -- 172.21.15.78:0/3737164916 --> [v2:172.21.15.148:6816/3949254394,v1:172.21.15.148:6817/3949254394] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb634062880 con 0x7fb6200740a0 2024-09-18T12:45:57.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.005+0000 7fb62affd640 1 -- 172.21.15.78:0/3737164916 <== osd.5 v2:172.21.15.148:6816/3949254394 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb634062880 con 0x7fb6200740a0 2024-09-18T12:45:57.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.005+0000 7fb63bc3b640 1 -- 172.21.15.78:0/3737164916 >> [v2:172.21.15.148:6816/3949254394,v1:172.21.15.148:6817/3949254394] conn(0x7fb6200740a0 msgr2=0x7fb6200764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:57.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.005+0000 7fb63bc3b640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.148:6816/3949254394,v1:172.21.15.148:6817/3949254394] conn(0x7fb6200740a0 0x7fb6200764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:57.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.005+0000 7fb63bc3b640 1 -- 172.21.15.78:0/3737164916 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb62006e2b0 msgr2=0x7fb620070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:57.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.005+0000 7fb63bc3b640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb62006e2b0 0x7fb620070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb6240058c0 tx=0x7fb624005850 comp rx=0 tx=0).stop 2024-09-18T12:45:57.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.005+0000 7fb63bc3b640 1 -- 172.21.15.78:0/3737164916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb634100860 msgr2=0x7fb63419c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:57.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.005+0000 7fb63bc3b640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb634100860 0x7fb63419c630 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb630031460 tx=0x7fb6300045e0 comp rx=0 tx=0).stop 2024-09-18T12:45:57.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.005+0000 7fb63bc3b640 1 -- 172.21.15.78:0/3737164916 shutdown_connections 2024-09-18T12:45:57.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.005+0000 7fb63bc3b640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.148:6816/3949254394,v1:172.21.15.148:6817/3949254394] conn(0x7fb6200740a0 0x7fb6200764c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:57.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.005+0000 7fb63bc3b640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb62006e2b0 0x7fb620070770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:57.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.005+0000 7fb63bc3b640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb634106860 0x7fb63419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:57.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.005+0000 7fb63bc3b640 1 --2- 172.21.15.78:0/3737164916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb634100860 0x7fb63419c630 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:57.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.005+0000 7fb63bc3b640 1 -- 172.21.15.78:0/3737164916 >> 172.21.15.78:0/3737164916 conn(0x7fb6340fc580 msgr2=0x7fb6340fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:57.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.005+0000 7fb63bc3b640 1 -- 172.21.15.78:0/3737164916 shutdown_connections 2024-09-18T12:45:57.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:57.005+0000 7fb63bc3b640 1 -- 172.21.15.78:0/3737164916 wait complete. 2024-09-18T12:45:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:57 smithi148 ceph-mon[35352]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:57.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:57 smithi078 ceph-mon[28091]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:57.804 INFO:teuthology.orchestra.run.smithi078.stdout:163208757255 2024-09-18T12:45:57.805 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-18T12:45:57.808 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:45:57.837 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:45:57.838 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:45:58.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.357+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/976146515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc106800 msgr2=0x7fa2bc106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:58.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.357+0000 7fa2c3fa6640 1 --2- 172.21.15.78:0/976146515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc106800 0x7fa2bc106be0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009880 tx=0x7fa2b802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:45:58.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.357+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/976146515 shutdown_connections 2024-09-18T12:45:58.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.357+0000 7fa2c3fa6640 1 --2- 172.21.15.78:0/976146515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2bc100800 0x7fa2bc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:58.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.357+0000 7fa2c3fa6640 1 --2- 172.21.15.78:0/976146515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc106800 0x7fa2bc106be0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:58.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.357+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/976146515 >> 172.21.15.78:0/976146515 conn(0x7fa2bc0fc520 msgr2=0x7fa2bc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:58.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.357+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/976146515 shutdown_connections 2024-09-18T12:45:58.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.357+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/976146515 wait complete. 2024-09-18T12:45:58.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.357+0000 7fa2c3fa6640 1 Processor -- start 2024-09-18T12:45:58.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.357+0000 7fa2c3fa6640 1 -- start start 2024-09-18T12:45:58.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2c3fa6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2bc100800 0x7fa2bc19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:58.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2c3fa6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc106800 0x7fa2bc19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:58.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2c3fa6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc10dd30 con 0x7fa2bc106800 2024-09-18T12:45:58.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2c3fa6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc10dbb0 con 0x7fa2bc100800 2024-09-18T12:45:58.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2c1541640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc106800 0x7fa2bc19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:58.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2c1541640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc106800 0x7fa2bc19dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35010/0 (socket says 172.21.15.78:35010) 2024-09-18T12:45:58.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2c1541640 1 -- 172.21.15.78:0/329133328 learned_addr learned my addr 172.21.15.78:0/329133328 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:45:58.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2c1d42640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2bc100800 0x7fa2bc19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:58.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2c1541640 1 -- 172.21.15.78:0/329133328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2bc100800 msgr2=0x7fa2bc19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:58.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2c1541640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2bc100800 0x7fa2bc19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:58.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2c1541640 1 -- 172.21.15.78:0/329133328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2bc197820 con 0x7fa2bc106800 2024-09-18T12:45:58.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2c1541640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc106800 0x7fa2bc19dbe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00b420 tx=0x7fa2ac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:58.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2b2ffd640 1 -- 172.21.15.78:0/329133328 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2ac011630 con 0x7fa2bc106800 2024-09-18T12:45:58.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2b2ffd640 1 -- 172.21.15.78:0/329133328 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa2ac016070 con 0x7fa2bc106800 2024-09-18T12:45:58.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/329133328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2bc197b10 con 0x7fa2bc106800 2024-09-18T12:45:58.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2b2ffd640 1 -- 172.21.15.78:0/329133328 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2ac010d40 con 0x7fa2bc106800 2024-09-18T12:45:58.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.358+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/329133328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2bc1980a0 con 0x7fa2bc106800 2024-09-18T12:45:58.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.359+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/329133328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2bc101f40 con 0x7fa2bc106800 2024-09-18T12:45:58.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.360+0000 7fa2b2ffd640 1 -- 172.21.15.78:0/329133328 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa2ac01b460 con 0x7fa2bc106800 2024-09-18T12:45:58.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.360+0000 7fa2b2ffd640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa2a806e310 0x7fa2a80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:58.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.360+0000 7fa2b2ffd640 1 -- 172.21.15.78:0/329133328 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fa2ac08d550 con 0x7fa2bc106800 2024-09-18T12:45:58.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.360+0000 7fa2c1d42640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa2a806e310 0x7fa2a80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:58.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.360+0000 7fa2b2ffd640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.148:6808/2544176191,v1:172.21.15.148:6809/2544176191] conn(0x7fa2a8074100 0x7fa2a8076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:58.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.361+0000 7fa2b2ffd640 1 -- 172.21.15.78:0/329133328 --> [v2:172.21.15.148:6808/2544176191,v1:172.21.15.148:6809/2544176191] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2a8076bd0 con 0x7fa2a8074100 2024-09-18T12:45:58.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.361+0000 7fa2b2ffd640 1 -- 172.21.15.78:0/329133328 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa2ac094050 con 0x7fa2bc106800 2024-09-18T12:45:58.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.361+0000 7fa2c1d42640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa2a806e310 0x7fa2a80707d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80096c0 tx=0x7fa2b8031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:58.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.361+0000 7fa2c2543640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.148:6808/2544176191,v1:172.21.15.148:6809/2544176191] conn(0x7fa2a8074100 0x7fa2a8076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:58.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.361+0000 7fa2c2543640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.148:6808/2544176191,v1:172.21.15.148:6809/2544176191] conn(0x7fa2a8074100 0x7fa2a8076520 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:58.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.362+0000 7fa2b2ffd640 1 -- 172.21.15.78:0/329133328 <== osd.4 v2:172.21.15.148:6808/2544176191 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2a8076bd0 con 0x7fa2a8074100 2024-09-18T12:45:58.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.375+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/329133328 --> [v2:172.21.15.148:6808/2544176191,v1:172.21.15.148:6809/2544176191] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa2bc062900 con 0x7fa2a8074100 2024-09-18T12:45:58.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.376+0000 7fa2b2ffd640 1 -- 172.21.15.78:0/329133328 <== osd.4 v2:172.21.15.148:6808/2544176191 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa2bc062900 con 0x7fa2a8074100 2024-09-18T12:45:58.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.376+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/329133328 >> [v2:172.21.15.148:6808/2544176191,v1:172.21.15.148:6809/2544176191] conn(0x7fa2a8074100 msgr2=0x7fa2a8076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:58.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.376+0000 7fa2c3fa6640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.148:6808/2544176191,v1:172.21.15.148:6809/2544176191] conn(0x7fa2a8074100 0x7fa2a8076520 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:58.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.376+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/329133328 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa2a806e310 msgr2=0x7fa2a80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:58.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.376+0000 7fa2c3fa6640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa2a806e310 0x7fa2a80707d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80096c0 tx=0x7fa2b8031400 comp rx=0 tx=0).stop 2024-09-18T12:45:58.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.376+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/329133328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc106800 msgr2=0x7fa2bc19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:58.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.376+0000 7fa2c3fa6640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc106800 0x7fa2bc19dbe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00b420 tx=0x7fa2ac00b8e0 comp rx=0 tx=0).stop 2024-09-18T12:45:58.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.376+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/329133328 shutdown_connections 2024-09-18T12:45:58.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.376+0000 7fa2c3fa6640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa2a806e310 0x7fa2a80707d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:58.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.376+0000 7fa2c3fa6640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.148:6808/2544176191,v1:172.21.15.148:6809/2544176191] conn(0x7fa2a8074100 0x7fa2a8076520 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:58.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.376+0000 7fa2c3fa6640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc106800 0x7fa2bc19dbe0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:58.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.376+0000 7fa2c3fa6640 1 --2- 172.21.15.78:0/329133328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2bc100800 0x7fa2bc19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:58.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.376+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/329133328 >> 172.21.15.78:0/329133328 conn(0x7fa2bc0fc520 msgr2=0x7fa2bc06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:58.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.376+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/329133328 shutdown_connections 2024-09-18T12:45:58.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:58.376+0000 7fa2c3fa6640 1 -- 172.21.15.78:0/329133328 wait complete. 2024-09-18T12:45:58.953 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:45:58 smithi078 ceph-mon[28091]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:58.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:45:58 smithi148 ceph-mon[35352]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:45:59.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.136+0000 7f419b76d640 1 -- 172.21.15.78:0/2558315124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41941007f0 msgr2=0x7f4194100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:59.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.136+0000 7f419b76d640 1 --2- 172.21.15.78:0/2558315124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41941007f0 0x7f4194100c50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4188009880 tx=0x7f418802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.136+0000 7f419b76d640 1 -- 172.21.15.78:0/2558315124 shutdown_connections 2024-09-18T12:45:59.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.136+0000 7f419b76d640 1 --2- 172.21.15.78:0/2558315124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41941007f0 0x7f4194100c50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.136+0000 7f419b76d640 1 --2- 172.21.15.78:0/2558315124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41941067f0 0x7f4194106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.136+0000 7f419b76d640 1 -- 172.21.15.78:0/2558315124 >> 172.21.15.78:0/2558315124 conn(0x7f41940fc550 msgr2=0x7f41940fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.137+0000 7f419b76d640 1 -- 172.21.15.78:0/2558315124 shutdown_connections 2024-09-18T12:45:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.137+0000 7f419b76d640 1 -- 172.21.15.78:0/2558315124 wait complete. 2024-09-18T12:45:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.137+0000 7f419b76d640 1 Processor -- start 2024-09-18T12:45:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.137+0000 7f419b76d640 1 -- start start 2024-09-18T12:45:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.137+0000 7f419b76d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41941007f0 0x7f419419b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.137+0000 7f419b76d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41941067f0 0x7f419419b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.137+0000 7f419b76d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f419410cbd0 con 0x7f41941007f0 2024-09-18T12:45:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.137+0000 7f419b76d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f419410ca50 con 0x7f41941067f0 2024-09-18T12:45:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.137+0000 7f4199509640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41941007f0 0x7f419419b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.137+0000 7f4199509640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41941007f0 0x7f419419b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35022/0 (socket says 172.21.15.78:35022) 2024-09-18T12:45:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.137+0000 7f4199509640 1 -- 172.21.15.78:0/3233403546 learned_addr learned my addr 172.21.15.78:0/3233403546 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:45:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.138+0000 7f4198d08640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41941067f0 0x7f419419b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.138+0000 7f4199509640 1 -- 172.21.15.78:0/3233403546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41941067f0 msgr2=0x7f419419b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:59.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.138+0000 7f4199509640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41941067f0 0x7f419419b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.138+0000 7f4199509640 1 -- 172.21.15.78:0/3233403546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41941955c0 con 0x7f41941007f0 2024-09-18T12:45:59.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.138+0000 7f4199509640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41941007f0 0x7f419419b400 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f418400ea00 tx=0x7f418400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:59.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.138+0000 7f41927fc640 1 -- 172.21.15.78:0/3233403546 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f418400cb80 con 0x7f41941007f0 2024-09-18T12:45:59.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.138+0000 7f41927fc640 1 -- 172.21.15.78:0/3233403546 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f418400cd20 con 0x7f41941007f0 2024-09-18T12:45:59.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.138+0000 7f41927fc640 1 -- 172.21.15.78:0/3233403546 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4184011470 con 0x7f41941007f0 2024-09-18T12:45:59.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.138+0000 7f419b76d640 1 -- 172.21.15.78:0/3233403546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41941958b0 con 0x7f41941007f0 2024-09-18T12:45:59.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.138+0000 7f419b76d640 1 -- 172.21.15.78:0/3233403546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4194195e10 con 0x7f41941007f0 2024-09-18T12:45:59.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.139+0000 7f419b76d640 1 -- 172.21.15.78:0/3233403546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f41941963f0 con 0x7f41941007f0 2024-09-18T12:45:59.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.140+0000 7f41927fc640 1 -- 172.21.15.78:0/3233403546 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f41840116e0 con 0x7f41941007f0 2024-09-18T12:45:59.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.140+0000 7f41927fc640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f417c070510 0x7f417c0729d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:59.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.140+0000 7f41927fc640 1 -- 172.21.15.78:0/3233403546 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f418408e170 con 0x7f41941007f0 2024-09-18T12:45:59.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.140+0000 7f4198d08640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f417c070510 0x7f417c0729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:59.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.140+0000 7f41927fc640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947] conn(0x7f417c076300 0x7f417c078720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:59.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.140+0000 7f41927fc640 1 -- 172.21.15.78:0/3233403546 --> [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f417c078dd0 con 0x7f417c076300 2024-09-18T12:45:59.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.140+0000 7f41927fc640 1 -- 172.21.15.78:0/3233403546 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4184095050 con 0x7f41941007f0 2024-09-18T12:45:59.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.140+0000 7f4199d0a640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947] conn(0x7f417c076300 0x7f417c078720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:59.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.141+0000 7f4198d08640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f417c070510 0x7f417c0729d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4194196700 tx=0x7f4188031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:59.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.141+0000 7f4199d0a640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947] conn(0x7f417c076300 0x7f417c078720 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:59.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.141+0000 7f41927fc640 1 -- 172.21.15.78:0/3233403546 <== osd.1 v2:172.21.15.78:6810/3802001947 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f417c078dd0 con 0x7f417c076300 2024-09-18T12:45:59.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.159+0000 7f419b76d640 1 -- 172.21.15.78:0/3233403546 --> [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f41940628b0 con 0x7f417c076300 2024-09-18T12:45:59.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.160+0000 7f41927fc640 1 -- 172.21.15.78:0/3233403546 <== osd.1 v2:172.21.15.78:6810/3802001947 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f41940628b0 con 0x7f417c076300 2024-09-18T12:45:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.160+0000 7f419b76d640 1 -- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947] conn(0x7f417c076300 msgr2=0x7f417c078720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.160+0000 7f419b76d640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947] conn(0x7f417c076300 0x7f417c078720 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.160+0000 7f419b76d640 1 -- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f417c070510 msgr2=0x7f417c0729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.160+0000 7f419b76d640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f417c070510 0x7f417c0729d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4194196700 tx=0x7f4188031400 comp rx=0 tx=0).stop 2024-09-18T12:45:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.160+0000 7f419b76d640 1 -- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41941007f0 msgr2=0x7f419419b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.160+0000 7f419b76d640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41941007f0 0x7f419419b400 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f418400ea00 tx=0x7f418400eec0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.160+0000 7f419b76d640 1 -- 172.21.15.78:0/3233403546 shutdown_connections 2024-09-18T12:45:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.160+0000 7f419b76d640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:6810/3802001947,v1:172.21.15.78:6811/3802001947] conn(0x7f417c076300 0x7f417c078720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.160+0000 7f419b76d640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f417c070510 0x7f417c0729d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.160+0000 7f419b76d640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41941067f0 0x7f419419b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.160+0000 7f419b76d640 1 --2- 172.21.15.78:0/3233403546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41941007f0 0x7f419419b400 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.160+0000 7f419b76d640 1 -- 172.21.15.78:0/3233403546 >> 172.21.15.78:0/3233403546 conn(0x7f41940fc550 msgr2=0x7f41940fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.160+0000 7f419b76d640 1 -- 172.21.15.78:0/3233403546 shutdown_connections 2024-09-18T12:45:59.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.160+0000 7f419b76d640 1 -- 172.21.15.78:0/3233403546 wait complete. 2024-09-18T12:45:59.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.400+0000 7feb3c4eb640 1 -- 172.21.15.78:0/2211944760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb341007f0 msgr2=0x7feb34100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:59.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.400+0000 7feb3c4eb640 1 --2- 172.21.15.78:0/2211944760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb341007f0 0x7feb34100c50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feb30009880 tx=0x7feb3002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.400+0000 7feb3c4eb640 1 -- 172.21.15.78:0/2211944760 shutdown_connections 2024-09-18T12:45:59.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.400+0000 7feb3c4eb640 1 --2- 172.21.15.78:0/2211944760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb341007f0 0x7feb34100c50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.400+0000 7feb3c4eb640 1 --2- 172.21.15.78:0/2211944760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb341067f0 0x7feb34106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.400+0000 7feb3c4eb640 1 -- 172.21.15.78:0/2211944760 >> 172.21.15.78:0/2211944760 conn(0x7feb340fc550 msgr2=0x7feb340fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:59.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.400+0000 7feb3c4eb640 1 -- 172.21.15.78:0/2211944760 shutdown_connections 2024-09-18T12:45:59.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.400+0000 7feb3c4eb640 1 -- 172.21.15.78:0/2211944760 wait complete. 2024-09-18T12:45:59.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.401+0000 7feb3c4eb640 1 Processor -- start 2024-09-18T12:45:59.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.401+0000 7feb3c4eb640 1 -- start start 2024-09-18T12:45:59.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.401+0000 7feb3c4eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb341007f0 0x7feb3419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:59.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.401+0000 7feb3c4eb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb341067f0 0x7feb3419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:59.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.401+0000 7feb3c4eb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feb3410dd20 con 0x7feb341007f0 2024-09-18T12:45:59.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.401+0000 7feb3c4eb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feb3410dba0 con 0x7feb341067f0 2024-09-18T12:45:59.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.401+0000 7feb3a287640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb341007f0 0x7feb3419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:59.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.401+0000 7feb3a287640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb341007f0 0x7feb3419c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35026/0 (socket says 172.21.15.78:35026) 2024-09-18T12:45:59.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.401+0000 7feb3a287640 1 -- 172.21.15.78:0/3797133763 learned_addr learned my addr 172.21.15.78:0/3797133763 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:45:59.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.401+0000 7feb39a86640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb341067f0 0x7feb3419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:59.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.401+0000 7feb3a287640 1 -- 172.21.15.78:0/3797133763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb341067f0 msgr2=0x7feb3419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:59.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.401+0000 7feb3a287640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb341067f0 0x7feb3419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.401+0000 7feb3a287640 1 -- 172.21.15.78:0/3797133763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb34196830 con 0x7feb341007f0 2024-09-18T12:45:59.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.401+0000 7feb3a287640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb341007f0 0x7feb3419c6b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feb2400b420 tx=0x7feb2400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.401+0000 7feb2b7fe640 1 -- 172.21.15.78:0/3797133763 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb24011630 con 0x7feb341007f0 2024-09-18T12:45:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.402+0000 7feb2b7fe640 1 -- 172.21.15.78:0/3797133763 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feb24016070 con 0x7feb341007f0 2024-09-18T12:45:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.402+0000 7feb3c4eb640 1 -- 172.21.15.78:0/3797133763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb34196b20 con 0x7feb341007f0 2024-09-18T12:45:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.402+0000 7feb2b7fe640 1 -- 172.21.15.78:0/3797133763 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb24010d40 con 0x7feb341007f0 2024-09-18T12:45:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.402+0000 7feb3c4eb640 1 -- 172.21.15.78:0/3797133763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb34197080 con 0x7feb341007f0 2024-09-18T12:45:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.402+0000 7feb3c4eb640 1 -- 172.21.15.78:0/3797133763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb34197620 con 0x7feb341007f0 2024-09-18T12:45:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.403+0000 7feb2b7fe640 1 -- 172.21.15.78:0/3797133763 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7feb2401b460 con 0x7feb341007f0 2024-09-18T12:45:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.403+0000 7feb2b7fe640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7feb2006e2b0 0x7feb20070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.403+0000 7feb2b7fe640 1 -- 172.21.15.78:0/3797133763 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7feb2408d5f0 con 0x7feb341007f0 2024-09-18T12:45:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.403+0000 7feb39a86640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7feb2006e2b0 0x7feb20070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.403+0000 7feb2b7fe640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518] conn(0x7feb200740a0 0x7feb200764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:59.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.404+0000 7feb2b7fe640 1 -- 172.21.15.78:0/3797133763 --> [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb20076b70 con 0x7feb200740a0 2024-09-18T12:45:59.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.404+0000 7feb2b7fe640 1 -- 172.21.15.78:0/3797133763 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7feb24094050 con 0x7feb341007f0 2024-09-18T12:45:59.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.404+0000 7feb3aa88640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518] conn(0x7feb200740a0 0x7feb200764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:59.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.404+0000 7feb39a86640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7feb2006e2b0 0x7feb20070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feb34197b80 tx=0x7feb30031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:59.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.404+0000 7feb3aa88640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518] conn(0x7feb200740a0 0x7feb200764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:59.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.405+0000 7feb2b7fe640 1 -- 172.21.15.78:0/3797133763 <== osd.0 v2:172.21.15.78:6802/2583422518 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb20076b70 con 0x7feb200740a0 2024-09-18T12:45:59.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.420+0000 7feb3c4eb640 1 -- 172.21.15.78:0/3797133763 --> [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feb34062880 con 0x7feb200740a0 2024-09-18T12:45:59.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.420+0000 7feb2b7fe640 1 -- 172.21.15.78:0/3797133763 <== osd.0 v2:172.21.15.78:6802/2583422518 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feb34062880 con 0x7feb200740a0 2024-09-18T12:45:59.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.420+0000 7feb3c4eb640 1 -- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518] conn(0x7feb200740a0 msgr2=0x7feb200764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:59.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.420+0000 7feb3c4eb640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518] conn(0x7feb200740a0 0x7feb200764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.420+0000 7feb3c4eb640 1 -- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7feb2006e2b0 msgr2=0x7feb20070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:59.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.420+0000 7feb3c4eb640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7feb2006e2b0 0x7feb20070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feb34197b80 tx=0x7feb30031400 comp rx=0 tx=0).stop 2024-09-18T12:45:59.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.420+0000 7feb3c4eb640 1 -- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb341007f0 msgr2=0x7feb3419c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:59.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.420+0000 7feb3c4eb640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb341007f0 0x7feb3419c6b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feb2400b420 tx=0x7feb2400b8e0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.420+0000 7feb3c4eb640 1 -- 172.21.15.78:0/3797133763 shutdown_connections 2024-09-18T12:45:59.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.420+0000 7feb3c4eb640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:6802/2583422518,v1:172.21.15.78:6803/2583422518] conn(0x7feb200740a0 0x7feb200764c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.420+0000 7feb3c4eb640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7feb2006e2b0 0x7feb20070770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.420+0000 7feb3c4eb640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb341067f0 0x7feb3419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.420+0000 7feb3c4eb640 1 --2- 172.21.15.78:0/3797133763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb341007f0 0x7feb3419c6b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:59.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.420+0000 7feb3c4eb640 1 -- 172.21.15.78:0/3797133763 >> 172.21.15.78:0/3797133763 conn(0x7feb340fc550 msgr2=0x7feb340fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:59.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.421+0000 7feb3c4eb640 1 -- 172.21.15.78:0/3797133763 shutdown_connections 2024-09-18T12:45:59.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:45:59.421+0000 7feb3c4eb640 1 -- 172.21.15.78:0/3797133763 wait complete. 2024-09-18T12:46:00.084 INFO:teuthology.orchestra.run.smithi078.stdout:38654705699 2024-09-18T12:46:00.085 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-18T12:46:00.603 INFO:teuthology.orchestra.run.smithi078.stdout:141733920779 2024-09-18T12:46:00.603 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-18T12:46:00.812 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:00.913 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:00 smithi078 ceph-mon[28091]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:00.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:00 smithi148 ceph-mon[35352]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:01.293 INFO:teuthology.orchestra.run.smithi078.stdout:60129542173 2024-09-18T12:46:01.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-18T12:46:01.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.736+0000 7fa010be9640 1 -- 172.21.15.78:0/3057332427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c107900 msgr2=0x7fa00c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:01.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.736+0000 7fa010be9640 1 --2- 172.21.15.78:0/3057332427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c107900 0x7fa00c107ce0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009880 tx=0x7f9ffc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:01.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.736+0000 7fa010be9640 1 -- 172.21.15.78:0/3057332427 shutdown_connections 2024-09-18T12:46:01.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.736+0000 7fa010be9640 1 --2- 172.21.15.78:0/3057332427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c101900 0x7fa00c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:01.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.736+0000 7fa010be9640 1 --2- 172.21.15.78:0/3057332427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c107900 0x7fa00c107ce0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:01.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.736+0000 7fa010be9640 1 -- 172.21.15.78:0/3057332427 >> 172.21.15.78:0/3057332427 conn(0x7fa00c0fd600 msgr2=0x7fa00c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:01.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.736+0000 7fa010be9640 1 -- 172.21.15.78:0/3057332427 shutdown_connections 2024-09-18T12:46:01.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.736+0000 7fa010be9640 1 -- 172.21.15.78:0/3057332427 wait complete. 2024-09-18T12:46:01.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.737+0000 7fa010be9640 1 Processor -- start 2024-09-18T12:46:01.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.737+0000 7fa010be9640 1 -- start start 2024-09-18T12:46:01.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.737+0000 7fa010be9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c101900 0x7fa00c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:01.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.737+0000 7fa010be9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c107900 0x7fa00c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:01.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.737+0000 7fa010be9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c10edd0 con 0x7fa00c107900 2024-09-18T12:46:01.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.737+0000 7fa010be9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c10ec50 con 0x7fa00c101900 2024-09-18T12:46:01.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.737+0000 7fa009d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c107900 0x7fa00c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:01.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.737+0000 7fa009d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c107900 0x7fa00c19db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48204/0 (socket says 172.21.15.78:48204) 2024-09-18T12:46:01.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.737+0000 7fa009d9b640 1 -- 172.21.15.78:0/486572716 learned_addr learned my addr 172.21.15.78:0/486572716 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:01.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.737+0000 7fa00a59c640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c101900 0x7fa00c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:01.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.737+0000 7fa009d9b640 1 -- 172.21.15.78:0/486572716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c101900 msgr2=0x7fa00c19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:01.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.737+0000 7fa009d9b640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c101900 0x7fa00c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:01.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.737+0000 7fa009d9b640 1 -- 172.21.15.78:0/486572716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00c1977c0 con 0x7fa00c107900 2024-09-18T12:46:01.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.738+0000 7fa009d9b640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c107900 0x7fa00c19db80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa00000c8f0 tx=0x7fa00000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.738+0000 7f9ffb7fe640 1 -- 172.21.15.78:0/486572716 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0000079b0 con 0x7fa00c107900 2024-09-18T12:46:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.738+0000 7f9ffb7fe640 1 -- 172.21.15.78:0/486572716 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa0000054e0 con 0x7fa00c107900 2024-09-18T12:46:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.738+0000 7f9ffb7fe640 1 -- 172.21.15.78:0/486572716 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa000004dd0 con 0x7fa00c107900 2024-09-18T12:46:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.738+0000 7fa010be9640 1 -- 172.21.15.78:0/486572716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00c197ab0 con 0x7fa00c107900 2024-09-18T12:46:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.738+0000 7fa010be9640 1 -- 172.21.15.78:0/486572716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa00c198040 con 0x7fa00c107900 2024-09-18T12:46:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.739+0000 7fa010be9640 1 -- 172.21.15.78:0/486572716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa00c198660 con 0x7fa00c107900 2024-09-18T12:46:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.739+0000 7f9ffb7fe640 1 -- 172.21.15.78:0/486572716 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa000005020 con 0x7fa00c107900 2024-09-18T12:46:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.740+0000 7f9ffb7fe640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f9ff406e260 0x7f9ff4070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.740+0000 7f9ffb7fe640 1 -- 172.21.15.78:0/486572716 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fa00008dde0 con 0x7fa00c107900 2024-09-18T12:46:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.740+0000 7fa00a59c640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f9ff406e260 0x7f9ff4070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.740+0000 7f9ffb7fe640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.148:6800/2230690563,v1:172.21.15.148:6801/2230690563] conn(0x7f9ff4074050 0x7f9ff4076470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.740+0000 7f9ffb7fe640 1 -- 172.21.15.78:0/486572716 --> [v2:172.21.15.148:6800/2230690563,v1:172.21.15.148:6801/2230690563] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa000004490 con 0x7f9ff4074050 2024-09-18T12:46:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.740+0000 7f9ffb7fe640 1 -- 172.21.15.78:0/486572716 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa000093500 con 0x7fa00c107900 2024-09-18T12:46:01.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.740+0000 7fa00a59c640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f9ff406e260 0x7f9ff4070720 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc031460 tx=0x7f9ffc009560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:01.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.740+0000 7fa00ad9d640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.148:6800/2230690563,v1:172.21.15.148:6801/2230690563] conn(0x7f9ff4074050 0x7f9ff4076470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:01.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.741+0000 7fa00ad9d640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.148:6800/2230690563,v1:172.21.15.148:6801/2230690563] conn(0x7f9ff4074050 0x7f9ff4076470 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:01.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.742+0000 7f9ffb7fe640 1 -- 172.21.15.78:0/486572716 <== osd.3 v2:172.21.15.148:6800/2230690563 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa000004490 con 0x7f9ff4074050 2024-09-18T12:46:01.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.755+0000 7fa010be9640 1 -- 172.21.15.78:0/486572716 --> [v2:172.21.15.148:6800/2230690563,v1:172.21.15.148:6801/2230690563] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa00c062900 con 0x7f9ff4074050 2024-09-18T12:46:01.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.756+0000 7f9ffb7fe640 1 -- 172.21.15.78:0/486572716 <== osd.3 v2:172.21.15.148:6800/2230690563 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa00c062900 con 0x7f9ff4074050 2024-09-18T12:46:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.756+0000 7fa010be9640 1 -- 172.21.15.78:0/486572716 >> [v2:172.21.15.148:6800/2230690563,v1:172.21.15.148:6801/2230690563] conn(0x7f9ff4074050 msgr2=0x7f9ff4076470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.756+0000 7fa010be9640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.148:6800/2230690563,v1:172.21.15.148:6801/2230690563] conn(0x7f9ff4074050 0x7f9ff4076470 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.756+0000 7fa010be9640 1 -- 172.21.15.78:0/486572716 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f9ff406e260 msgr2=0x7f9ff4070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.756+0000 7fa010be9640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f9ff406e260 0x7f9ff4070720 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc031460 tx=0x7f9ffc009560 comp rx=0 tx=0).stop 2024-09-18T12:46:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.756+0000 7fa010be9640 1 -- 172.21.15.78:0/486572716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c107900 msgr2=0x7fa00c19db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.756+0000 7fa010be9640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c107900 0x7fa00c19db80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa00000c8f0 tx=0x7fa00000cdb0 comp rx=0 tx=0).stop 2024-09-18T12:46:01.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.756+0000 7fa010be9640 1 -- 172.21.15.78:0/486572716 shutdown_connections 2024-09-18T12:46:01.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.756+0000 7fa010be9640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.148:6800/2230690563,v1:172.21.15.148:6801/2230690563] conn(0x7f9ff4074050 0x7f9ff4076470 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:01.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.757+0000 7fa010be9640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f9ff406e260 0x7f9ff4070720 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:01.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.757+0000 7fa010be9640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c107900 0x7fa00c19db80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:01.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.757+0000 7fa010be9640 1 --2- 172.21.15.78:0/486572716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c101900 0x7fa00c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:01.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.757+0000 7fa010be9640 1 -- 172.21.15.78:0/486572716 >> 172.21.15.78:0/486572716 conn(0x7fa00c0fd600 msgr2=0x7fa00c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:01.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.757+0000 7fa010be9640 1 -- 172.21.15.78:0/486572716 shutdown_connections 2024-09-18T12:46:01.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:01.757+0000 7fa010be9640 1 -- 172.21.15.78:0/486572716 wait complete. 2024-09-18T12:46:01.768 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:02.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.533+0000 7f2e48ef2640 1 -- 172.21.15.78:0/3622379867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e441003c0 msgr2=0x7f2e441007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:02.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.533+0000 7f2e48ef2640 1 --2- 172.21.15.78:0/3622379867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e441003c0 0x7f2e441007a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009880 tx=0x7f2e3402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.533+0000 7f2e48ef2640 1 -- 172.21.15.78:0/3622379867 shutdown_connections 2024-09-18T12:46:02.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.533+0000 7f2e48ef2640 1 --2- 172.21.15.78:0/3622379867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e44100d70 0x7f2e44104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.533+0000 7f2e48ef2640 1 --2- 172.21.15.78:0/3622379867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e441003c0 0x7f2e441007a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.533+0000 7f2e48ef2640 1 -- 172.21.15.78:0/3622379867 >> 172.21.15.78:0/3622379867 conn(0x7f2e44077150 msgr2=0x7f2e44077560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:02.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.534+0000 7f2e48ef2640 1 -- 172.21.15.78:0/3622379867 shutdown_connections 2024-09-18T12:46:02.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.534+0000 7f2e48ef2640 1 -- 172.21.15.78:0/3622379867 wait complete. 2024-09-18T12:46:02.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.534+0000 7f2e48ef2640 1 Processor -- start 2024-09-18T12:46:02.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.534+0000 7f2e48ef2640 1 -- start start 2024-09-18T12:46:02.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e48ef2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e441003c0 0x7f2e44196660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:02.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e48ef2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e44100d70 0x7f2e44196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:02.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e48ef2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4410d4e0 con 0x7f2e44100d70 2024-09-18T12:46:02.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e48ef2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4410d360 con 0x7f2e441003c0 2024-09-18T12:46:02.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e41d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e44100d70 0x7f2e44196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e41d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e44100d70 0x7f2e44196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48234/0 (socket says 172.21.15.78:48234) 2024-09-18T12:46:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e41d9b640 1 -- 172.21.15.78:0/4259973365 learned_addr learned my addr 172.21.15.78:0/4259973365 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e4259c640 1 --2- 172.21.15.78:0/4259973365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e441003c0 0x7f2e44196660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e41d9b640 1 -- 172.21.15.78:0/4259973365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e441003c0 msgr2=0x7f2e44196660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e41d9b640 1 --2- 172.21.15.78:0/4259973365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e441003c0 0x7f2e44196660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e41d9b640 1 -- 172.21.15.78:0/4259973365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e441970e0 con 0x7f2e44100d70 2024-09-18T12:46:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e41d9b640 1 --2- 172.21.15.78:0/4259973365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e44100d70 0x7f2e44196ba0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00b3d0 tx=0x7f2e2c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e3b7fe640 1 -- 172.21.15.78:0/4259973365 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e2c015020 con 0x7f2e44100d70 2024-09-18T12:46:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e48ef2640 1 -- 172.21.15.78:0/4259973365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e441973d0 con 0x7f2e44100d70 2024-09-18T12:46:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e3b7fe640 1 -- 172.21.15.78:0/4259973365 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e2c011af0 con 0x7f2e44100d70 2024-09-18T12:46:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e48ef2640 1 -- 172.21.15.78:0/4259973365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e441a3ea0 con 0x7f2e44100d70 2024-09-18T12:46:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.535+0000 7f2e3b7fe640 1 -- 172.21.15.78:0/4259973365 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e2c010d30 con 0x7f2e44100d70 2024-09-18T12:46:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.537+0000 7f2e48ef2640 1 -- 172.21.15.78:0/4259973365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e441016c0 con 0x7f2e44100d70 2024-09-18T12:46:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.537+0000 7f2e3b7fe640 1 -- 172.21.15.78:0/4259973365 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2e2c018020 con 0x7f2e44100d70 2024-09-18T12:46:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.538+0000 7f2e3b7fe640 1 --2- 172.21.15.78:0/4259973365 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f2e3006e2b0 0x7f2e30070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.538+0000 7f2e3b7fe640 1 -- 172.21.15.78:0/4259973365 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f2e2c08d930 con 0x7f2e44100d70 2024-09-18T12:46:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.538+0000 7f2e4259c640 1 --2- 172.21.15.78:0/4259973365 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f2e3006e2b0 0x7f2e30070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.538+0000 7f2e4259c640 1 --2- 172.21.15.78:0/4259973365 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f2e3006e2b0 0x7f2e30070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e340096c0 tx=0x7f2e34031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:02.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.547+0000 7f2e3b7fe640 1 -- 172.21.15.78:0/4259973365 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e2c01f020 con 0x7f2e44100d70 2024-09-18T12:46:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.433+0000 7efd88732640 1 -- 172.21.15.78:0/4031486638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd801067f0 msgr2=0x7efd80106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.433+0000 7efd88732640 1 --2- 172.21.15.78:0/4031486638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd801067f0 0x7efd80106bd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009880 tx=0x7efd7c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.433+0000 7efd88732640 1 -- 172.21.15.78:0/4031486638 shutdown_connections 2024-09-18T12:46:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.433+0000 7efd88732640 1 --2- 172.21.15.78:0/4031486638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd801007f0 0x7efd80100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.433+0000 7efd88732640 1 --2- 172.21.15.78:0/4031486638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd801067f0 0x7efd80106bd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.433+0000 7efd88732640 1 -- 172.21.15.78:0/4031486638 >> 172.21.15.78:0/4031486638 conn(0x7efd800fc550 msgr2=0x7efd800fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.433+0000 7efd88732640 1 -- 172.21.15.78:0/4031486638 shutdown_connections 2024-09-18T12:46:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.433+0000 7efd88732640 1 -- 172.21.15.78:0/4031486638 wait complete. 2024-09-18T12:46:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.434+0000 7efd88732640 1 Processor -- start 2024-09-18T12:46:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.434+0000 7efd88732640 1 -- start start 2024-09-18T12:46:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.434+0000 7efd88732640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd801007f0 0x7efd8019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.434+0000 7efd88732640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd801067f0 0x7efd8019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.434+0000 7efd88732640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efd8010dca0 con 0x7efd801067f0 2024-09-18T12:46:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.434+0000 7efd88732640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efd8010db20 con 0x7efd801007f0 2024-09-18T12:46:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.434+0000 7efd85ccd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd801067f0 0x7efd8019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.434+0000 7efd85ccd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd801067f0 0x7efd8019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48218/0 (socket says 172.21.15.78:48218) 2024-09-18T12:46:02.691 INFO:teuthology.orchestra.run.smithi078.stdout:81604378647 2024-09-18T12:46:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.434+0000 7efd85ccd640 1 -- 172.21.15.78:0/3692174528 learned_addr learned my addr 172.21.15.78:0/3692174528 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.434+0000 7efd864ce640 1 --2- 172.21.15.78:0/3692174528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd801007f0 0x7efd8019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.434+0000 7efd85ccd640 1 -- 172.21.15.78:0/3692174528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd801007f0 msgr2=0x7efd8019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.434+0000 7efd85ccd640 1 --2- 172.21.15.78:0/3692174528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd801007f0 0x7efd8019d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.434+0000 7efd85ccd640 1 -- 172.21.15.78:0/3692174528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd80197870 con 0x7efd801067f0 2024-09-18T12:46:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.435+0000 7efd85ccd640 1 --2- 172.21.15.78:0/3692174528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd801067f0 0x7efd8019dbf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efd7000d8d0 tx=0x7efd7000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.435+0000 7efd777fe640 1 -- 172.21.15.78:0/3692174528 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd70017070 con 0x7efd801067f0 2024-09-18T12:46:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.435+0000 7efd777fe640 1 -- 172.21.15.78:0/3692174528 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efd70010460 con 0x7efd801067f0 2024-09-18T12:46:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.435+0000 7efd777fe640 1 -- 172.21.15.78:0/3692174528 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd7000f5f0 con 0x7efd801067f0 2024-09-18T12:46:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.435+0000 7efd88732640 1 -- 172.21.15.78:0/3692174528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd80197b00 con 0x7efd801067f0 2024-09-18T12:46:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.435+0000 7efd88732640 1 -- 172.21.15.78:0/3692174528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd80198090 con 0x7efd801067f0 2024-09-18T12:46:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.436+0000 7efd88732640 1 -- 172.21.15.78:0/3692174528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd80101f30 con 0x7efd801067f0 2024-09-18T12:46:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.436+0000 7efd777fe640 1 -- 172.21.15.78:0/3692174528 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7efd70009a30 con 0x7efd801067f0 2024-09-18T12:46:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.437+0000 7efd777fe640 1 --2- 172.21.15.78:0/3692174528 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7efd6c06e310 0x7efd6c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.437+0000 7efd777fe640 1 -- 172.21.15.78:0/3692174528 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7efd7008dc20 con 0x7efd801067f0 2024-09-18T12:46:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.437+0000 7efd864ce640 1 --2- 172.21.15.78:0/3692174528 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7efd6c06e310 0x7efd6c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.437+0000 7efd864ce640 1 --2- 172.21.15.78:0/3692174528 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7efd6c06e310 0x7efd6c0707d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd7c000c00 tx=0x7efd7c031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.441+0000 7efd777fe640 1 -- 172.21.15.78:0/3692174528 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efd7005b940 con 0x7efd801067f0 2024-09-18T12:46:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.622+0000 7efd88732640 1 -- 172.21.15.78:0/3692174528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efd80198dd0 con 0x7efd801067f0 2024-09-18T12:46:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.623+0000 7efd777fe640 1 -- 172.21.15.78:0/3692174528 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efd7005f5f0 con 0x7efd801067f0 2024-09-18T12:46:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.626+0000 7efd88732640 1 -- 172.21.15.78:0/3692174528 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7efd6c06e310 msgr2=0x7efd6c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.626+0000 7efd88732640 1 --2- 172.21.15.78:0/3692174528 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7efd6c06e310 0x7efd6c0707d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd7c000c00 tx=0x7efd7c031400 comp rx=0 tx=0).stop 2024-09-18T12:46:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.626+0000 7efd88732640 1 -- 172.21.15.78:0/3692174528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd801067f0 msgr2=0x7efd8019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.626+0000 7efd88732640 1 --2- 172.21.15.78:0/3692174528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd801067f0 0x7efd8019dbf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efd7000d8d0 tx=0x7efd7000dd90 comp rx=0 tx=0).stop 2024-09-18T12:46:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.626+0000 7efd88732640 1 -- 172.21.15.78:0/3692174528 shutdown_connections 2024-09-18T12:46:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.626+0000 7efd88732640 1 --2- 172.21.15.78:0/3692174528 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7efd6c06e310 0x7efd6c0707d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.626+0000 7efd88732640 1 --2- 172.21.15.78:0/3692174528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd801067f0 0x7efd8019dbf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.626+0000 7efd88732640 1 --2- 172.21.15.78:0/3692174528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd801007f0 0x7efd8019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.626+0000 7efd88732640 1 -- 172.21.15.78:0/3692174528 >> 172.21.15.78:0/3692174528 conn(0x7efd800fc550 msgr2=0x7efd80109f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.626+0000 7efd88732640 1 -- 172.21.15.78:0/3692174528 shutdown_connections 2024-09-18T12:46:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.626+0000 7efd88732640 1 -- 172.21.15.78:0/3692174528 wait complete. 2024-09-18T12:46:02.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.725+0000 7f2e48ef2640 1 -- 172.21.15.78:0/4259973365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2e441a41e0 con 0x7f2e44100d70 2024-09-18T12:46:02.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.726+0000 7f2e3b7fe640 1 -- 172.21.15.78:0/4259973365 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2e2c05b5d0 con 0x7f2e44100d70 2024-09-18T12:46:02.727 INFO:teuthology.orchestra.run.smithi078.stdout:163208757256 2024-09-18T12:46:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.728+0000 7f2e48ef2640 1 -- 172.21.15.78:0/4259973365 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f2e3006e2b0 msgr2=0x7f2e30070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.728+0000 7f2e48ef2640 1 --2- 172.21.15.78:0/4259973365 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f2e3006e2b0 0x7f2e30070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e340096c0 tx=0x7f2e34031400 comp rx=0 tx=0).stop 2024-09-18T12:46:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.728+0000 7f2e48ef2640 1 -- 172.21.15.78:0/4259973365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e44100d70 msgr2=0x7f2e44196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.728+0000 7f2e48ef2640 1 --2- 172.21.15.78:0/4259973365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e44100d70 0x7f2e44196ba0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00b3d0 tx=0x7f2e2c00b890 comp rx=0 tx=0).stop 2024-09-18T12:46:02.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.728+0000 7f2e48ef2640 1 -- 172.21.15.78:0/4259973365 shutdown_connections 2024-09-18T12:46:02.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.728+0000 7f2e48ef2640 1 --2- 172.21.15.78:0/4259973365 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f2e3006e2b0 0x7f2e30070770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.728+0000 7f2e48ef2640 1 --2- 172.21.15.78:0/4259973365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e44100d70 0x7f2e44196ba0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.728+0000 7f2e48ef2640 1 --2- 172.21.15.78:0/4259973365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e441003c0 0x7f2e44196660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.728+0000 7f2e48ef2640 1 -- 172.21.15.78:0/4259973365 >> 172.21.15.78:0/4259973365 conn(0x7f2e44077150 msgr2=0x7f2e440ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:02.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.728+0000 7f2e48ef2640 1 -- 172.21.15.78:0/4259973365 shutdown_connections 2024-09-18T12:46:02.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:02.728+0000 7f2e48ef2640 1 -- 172.21.15.78:0/4259973365 wait complete. 2024-09-18T12:46:02.867 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:02 smithi078 ceph-mon[28091]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:02.867 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:02 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3692174528' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-18T12:46:02.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:02 smithi148 ceph-mon[35352]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:02.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:02 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/3692174528' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-18T12:46:03.563 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757255 got 163208757256 for osd.5 2024-09-18T12:46:03.563 DEBUG:teuthology.parallel:result is None 2024-09-18T12:46:03.819 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:03 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/4259973365' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-18T12:46:03.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:03 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/4259973365' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-18T12:46:03.998 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378647 got 81604378647 for osd.2 2024-09-18T12:46:03.998 DEBUG:teuthology.parallel:result is None 2024-09-18T12:46:04.198 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:04.198 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:04.680 INFO:teuthology.orchestra.run.smithi078.stdout:107374182418 2024-09-18T12:46:04.681 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-18T12:46:04.904 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:04 smithi078 ceph-mon[28091]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:04.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:04 smithi148 ceph-mon[35352]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:05.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.099+0000 7fc6e4b84640 1 -- 172.21.15.78:0/1557892655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6e0100800 msgr2=0x7fc6e0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:05.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.099+0000 7fc6e4b84640 1 --2- 172.21.15.78:0/1557892655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6e0100800 0x7fc6e0100c60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009880 tx=0x7fc6d402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:05.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.100+0000 7fc6e4b84640 1 -- 172.21.15.78:0/1557892655 shutdown_connections 2024-09-18T12:46:05.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.100+0000 7fc6e4b84640 1 --2- 172.21.15.78:0/1557892655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6e0100800 0x7fc6e0100c60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:05.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.100+0000 7fc6e4b84640 1 --2- 172.21.15.78:0/1557892655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6e0106800 0x7fc6e0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:05.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.100+0000 7fc6e4b84640 1 -- 172.21.15.78:0/1557892655 >> 172.21.15.78:0/1557892655 conn(0x7fc6e00fc520 msgr2=0x7fc6e00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:05.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.100+0000 7fc6e4b84640 1 -- 172.21.15.78:0/1557892655 shutdown_connections 2024-09-18T12:46:05.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.100+0000 7fc6e4b84640 1 -- 172.21.15.78:0/1557892655 wait complete. 2024-09-18T12:46:05.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.100+0000 7fc6e4b84640 1 Processor -- start 2024-09-18T12:46:05.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.100+0000 7fc6e4b84640 1 -- start start 2024-09-18T12:46:05.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6e4b84640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6e0100800 0x7fc6e0107770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:05.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6e4b84640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6e0106800 0x7fc6e0107cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:05.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6e4b84640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e010dd30 con 0x7fc6e0106800 2024-09-18T12:46:05.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6e4b84640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e010dbb0 con 0x7fc6e0100800 2024-09-18T12:46:05.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6ddd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6e0106800 0x7fc6e0107cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:05.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6ddd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6e0106800 0x7fc6e0107cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48262/0 (socket says 172.21.15.78:48262) 2024-09-18T12:46:05.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6ddd9b640 1 -- 172.21.15.78:0/2180426267 learned_addr learned my addr 172.21.15.78:0/2180426267 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:05.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6de59c640 1 --2- 172.21.15.78:0/2180426267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6e0100800 0x7fc6e0107770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:05.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6ddd9b640 1 -- 172.21.15.78:0/2180426267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6e0100800 msgr2=0x7fc6e0107770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:05.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6ddd9b640 1 --2- 172.21.15.78:0/2180426267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6e0100800 0x7fc6e0107770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:05.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6ddd9b640 1 -- 172.21.15.78:0/2180426267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e01081f0 con 0x7fc6e0106800 2024-09-18T12:46:05.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6de59c640 1 --2- 172.21.15.78:0/2180426267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6e0100800 0x7fc6e0107770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:46:05.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6ddd9b640 1 --2- 172.21.15.78:0/2180426267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6e0106800 0x7fc6e0107cb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4031460 tx=0x7fc6d40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:05.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6cf7fe640 1 -- 172.21.15.78:0/2180426267 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6d403f070 con 0x7fc6e0106800 2024-09-18T12:46:05.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6e4b84640 1 -- 172.21.15.78:0/2180426267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e0108480 con 0x7fc6e0106800 2024-09-18T12:46:05.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6cf7fe640 1 -- 172.21.15.78:0/2180426267 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc6d4004cf0 con 0x7fc6e0106800 2024-09-18T12:46:05.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6cf7fe640 1 -- 172.21.15.78:0/2180426267 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6d4035030 con 0x7fc6e0106800 2024-09-18T12:46:05.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.101+0000 7fc6e4b84640 1 -- 172.21.15.78:0/2180426267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e01a3dd0 con 0x7fc6e0106800 2024-09-18T12:46:05.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.102+0000 7fc6e4b84640 1 -- 172.21.15.78:0/2180426267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e0101f40 con 0x7fc6e0106800 2024-09-18T12:46:05.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.103+0000 7fc6cf7fe640 1 -- 172.21.15.78:0/2180426267 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc6d4042070 con 0x7fc6e0106800 2024-09-18T12:46:05.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.103+0000 7fc6cf7fe640 1 --2- 172.21.15.78:0/2180426267 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc6c806e2b0 0x7fc6c8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:05.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.103+0000 7fc6cf7fe640 1 -- 172.21.15.78:0/2180426267 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fc6d40ae910 con 0x7fc6e0106800 2024-09-18T12:46:05.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.103+0000 7fc6de59c640 1 --2- 172.21.15.78:0/2180426267 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc6c806e2b0 0x7fc6c8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:05.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.104+0000 7fc6de59c640 1 --2- 172.21.15.78:0/2180426267 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc6c806e2b0 0x7fc6c8070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009930 tx=0x7fc6d0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:05.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.108+0000 7fc6cf7fe640 1 -- 172.21.15.78:0/2180426267 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc6d407c5b0 con 0x7fc6e0106800 2024-09-18T12:46:05.152 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.289+0000 7fc6e4b84640 1 -- 172.21.15.78:0/2180426267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc6e0108ca0 con 0x7fc6e0106800 2024-09-18T12:46:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.290+0000 7fc6cf7fe640 1 -- 172.21.15.78:0/2180426267 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc6d4080260 con 0x7fc6e0106800 2024-09-18T12:46:05.291 INFO:teuthology.orchestra.run.smithi078.stdout:141733920781 2024-09-18T12:46:05.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.292+0000 7fc6e4b84640 1 -- 172.21.15.78:0/2180426267 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc6c806e2b0 msgr2=0x7fc6c8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:05.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.292+0000 7fc6e4b84640 1 --2- 172.21.15.78:0/2180426267 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc6c806e2b0 0x7fc6c8070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009930 tx=0x7fc6d0008040 comp rx=0 tx=0).stop 2024-09-18T12:46:05.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.292+0000 7fc6e4b84640 1 -- 172.21.15.78:0/2180426267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6e0106800 msgr2=0x7fc6e0107cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:05.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.292+0000 7fc6e4b84640 1 --2- 172.21.15.78:0/2180426267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6e0106800 0x7fc6e0107cb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4031460 tx=0x7fc6d40048f0 comp rx=0 tx=0).stop 2024-09-18T12:46:05.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.292+0000 7fc6e4b84640 1 -- 172.21.15.78:0/2180426267 shutdown_connections 2024-09-18T12:46:05.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.292+0000 7fc6e4b84640 1 --2- 172.21.15.78:0/2180426267 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc6c806e2b0 0x7fc6c8070770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:05.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.292+0000 7fc6e4b84640 1 --2- 172.21.15.78:0/2180426267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6e0106800 0x7fc6e0107cb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.292+0000 7fc6e4b84640 1 --2- 172.21.15.78:0/2180426267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6e0100800 0x7fc6e0107770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.292+0000 7fc6e4b84640 1 -- 172.21.15.78:0/2180426267 >> 172.21.15.78:0/2180426267 conn(0x7fc6e00fc520 msgr2=0x7fc6e010a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.292+0000 7fc6e4b84640 1 -- 172.21.15.78:0/2180426267 shutdown_connections 2024-09-18T12:46:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.292+0000 7fc6e4b84640 1 -- 172.21.15.78:0/2180426267 wait complete. 2024-09-18T12:46:05.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.838+0000 7fd80d01e640 1 -- 172.21.15.78:0/822299761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd808102b60 msgr2=0x7fd808102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:05.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.838+0000 7fd80d01e640 1 --2- 172.21.15.78:0/822299761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd808102b60 0x7fd808102f40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009880 tx=0x7fd7f802a540 comp rx=0 tx=0).stop 2024-09-18T12:46:05.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.838+0000 7fd80d01e640 1 -- 172.21.15.78:0/822299761 shutdown_connections 2024-09-18T12:46:05.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.838+0000 7fd80d01e640 1 --2- 172.21.15.78:0/822299761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd808103480 0x7fd80810b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:05.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.838+0000 7fd80d01e640 1 --2- 172.21.15.78:0/822299761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd808102b60 0x7fd808102f40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:05.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.838+0000 7fd80d01e640 1 -- 172.21.15.78:0/822299761 >> 172.21.15.78:0/822299761 conn(0x7fd8080fc520 msgr2=0x7fd8080fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:05.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.838+0000 7fd80d01e640 1 -- 172.21.15.78:0/822299761 shutdown_connections 2024-09-18T12:46:05.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.838+0000 7fd80d01e640 1 -- 172.21.15.78:0/822299761 wait complete. 2024-09-18T12:46:05.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.839+0000 7fd80d01e640 1 Processor -- start 2024-09-18T12:46:05.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.839+0000 7fd80d01e640 1 -- start start 2024-09-18T12:46:05.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.839+0000 7fd80d01e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd808102b60 0x7fd80819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:05.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.839+0000 7fd80d01e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd808103480 0x7fd80819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:05.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.839+0000 7fd80d01e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd80810ee50 con 0x7fd808103480 2024-09-18T12:46:05.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.839+0000 7fd80d01e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd80810ecd0 con 0x7fd808102b60 2024-09-18T12:46:05.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.839+0000 7fd80659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd808103480 0x7fd80819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:05.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.839+0000 7fd80659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd808103480 0x7fd80819dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48272/0 (socket says 172.21.15.78:48272) 2024-09-18T12:46:05.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.839+0000 7fd80659c640 1 -- 172.21.15.78:0/634045837 learned_addr learned my addr 172.21.15.78:0/634045837 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:05.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.839+0000 7fd806d9d640 1 --2- 172.21.15.78:0/634045837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd808102b60 0x7fd80819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:05.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.839+0000 7fd80659c640 1 -- 172.21.15.78:0/634045837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd808102b60 msgr2=0x7fd80819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:05.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.839+0000 7fd80659c640 1 --2- 172.21.15.78:0/634045837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd808102b60 0x7fd80819d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:05.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.839+0000 7fd80659c640 1 -- 172.21.15.78:0/634045837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd808197880 con 0x7fd808103480 2024-09-18T12:46:05.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.840+0000 7fd80659c640 1 --2- 172.21.15.78:0/634045837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd808103480 0x7fd80819dc00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000b420 tx=0x7fd7f000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:05.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.840+0000 7fd7fffff640 1 -- 172.21.15.78:0/634045837 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7f0011630 con 0x7fd808103480 2024-09-18T12:46:05.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.840+0000 7fd80d01e640 1 -- 172.21.15.78:0/634045837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd808197b70 con 0x7fd808103480 2024-09-18T12:46:05.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.840+0000 7fd7fffff640 1 -- 172.21.15.78:0/634045837 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd7f0016070 con 0x7fd808103480 2024-09-18T12:46:05.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.840+0000 7fd7fffff640 1 -- 172.21.15.78:0/634045837 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7f0010d40 con 0x7fd808103480 2024-09-18T12:46:05.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.840+0000 7fd80d01e640 1 -- 172.21.15.78:0/634045837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd808198100 con 0x7fd808103480 2024-09-18T12:46:05.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.841+0000 7fd80d01e640 1 -- 172.21.15.78:0/634045837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd80806a9f0 con 0x7fd808103480 2024-09-18T12:46:05.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.841+0000 7fd7fffff640 1 -- 172.21.15.78:0/634045837 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd7f001b460 con 0x7fd808103480 2024-09-18T12:46:05.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.842+0000 7fd7fffff640 1 --2- 172.21.15.78:0/634045837 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd7f406e2b0 0x7fd7f4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:05.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.842+0000 7fd806d9d640 1 --2- 172.21.15.78:0/634045837 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd7f406e2b0 0x7fd7f4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:05.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.842+0000 7fd7fffff640 1 -- 172.21.15.78:0/634045837 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fd7f008d6e0 con 0x7fd808103480 2024-09-18T12:46:05.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.843+0000 7fd806d9d640 1 --2- 172.21.15.78:0/634045837 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd7f406e2b0 0x7fd7f4070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8000c00 tx=0x7fd7f8004f30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:05.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:05.846+0000 7fd7fffff640 1 -- 172.21.15.78:0/634045837 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd7f005b380 con 0x7fd808103480 2024-09-18T12:46:05.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:05 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2180426267' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-18T12:46:05.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:05 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2180426267' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-18T12:46:06.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:06.016+0000 7fd80d01e640 1 -- 172.21.15.78:0/634045837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd808105010 con 0x7fd808103480 2024-09-18T12:46:06.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:06.016+0000 7fd7fffff640 1 -- 172.21.15.78:0/634045837 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd7f005f030 con 0x7fd808103480 2024-09-18T12:46:06.018 INFO:teuthology.orchestra.run.smithi078.stdout:60129542174 2024-09-18T12:46:06.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:06.018+0000 7fd80d01e640 1 -- 172.21.15.78:0/634045837 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd7f406e2b0 msgr2=0x7fd7f4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:06.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:06.018+0000 7fd80d01e640 1 --2- 172.21.15.78:0/634045837 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd7f406e2b0 0x7fd7f4070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8000c00 tx=0x7fd7f8004f30 comp rx=0 tx=0).stop 2024-09-18T12:46:06.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:06.018+0000 7fd80d01e640 1 -- 172.21.15.78:0/634045837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd808103480 msgr2=0x7fd80819dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:06.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:06.018+0000 7fd80d01e640 1 --2- 172.21.15.78:0/634045837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd808103480 0x7fd80819dc00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000b420 tx=0x7fd7f000b8e0 comp rx=0 tx=0).stop 2024-09-18T12:46:06.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:06.018+0000 7fd80d01e640 1 -- 172.21.15.78:0/634045837 shutdown_connections 2024-09-18T12:46:06.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:06.018+0000 7fd80d01e640 1 --2- 172.21.15.78:0/634045837 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd7f406e2b0 0x7fd7f4070770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:06.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:06.018+0000 7fd80d01e640 1 --2- 172.21.15.78:0/634045837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd808103480 0x7fd80819dc00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:06.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:06.018+0000 7fd80d01e640 1 --2- 172.21.15.78:0/634045837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd808102b60 0x7fd80819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:06.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:06.018+0000 7fd80d01e640 1 -- 172.21.15.78:0/634045837 >> 172.21.15.78:0/634045837 conn(0x7fd8080fc520 msgr2=0x7fd808107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:06.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:06.019+0000 7fd80d01e640 1 -- 172.21.15.78:0/634045837 shutdown_connections 2024-09-18T12:46:06.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:06.019+0000 7fd80d01e640 1 -- 172.21.15.78:0/634045837 wait complete. 2024-09-18T12:46:06.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:06 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/634045837' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-18T12:46:06.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:06 smithi148 ceph-mon[35352]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:06.974 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:06 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/634045837' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-18T12:46:06.975 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:06 smithi078 ceph-mon[28091]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:07.003 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542174 for osd.1 2024-09-18T12:46:07.003 DEBUG:teuthology.parallel:result is None 2024-09-18T12:46:07.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.214+0000 7f7c95106640 1 -- 172.21.15.78:0/4236311357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c90103440 msgr2=0x7f7c9010b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:07.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.214+0000 7f7c95106640 1 --2- 172.21.15.78:0/4236311357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c90103440 0x7f7c9010b930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7c840098b0 tx=0x7f7c8402a560 comp rx=0 tx=0).stop 2024-09-18T12:46:07.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.214+0000 7f7c95106640 1 -- 172.21.15.78:0/4236311357 shutdown_connections 2024-09-18T12:46:07.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.214+0000 7f7c95106640 1 --2- 172.21.15.78:0/4236311357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c90103440 0x7f7c9010b930 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:07.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.214+0000 7f7c95106640 1 --2- 172.21.15.78:0/4236311357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c90102b20 0x7f7c90102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:07.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.214+0000 7f7c95106640 1 -- 172.21.15.78:0/4236311357 >> 172.21.15.78:0/4236311357 conn(0x7f7c900fc520 msgr2=0x7f7c900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:07.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.214+0000 7f7c95106640 1 -- 172.21.15.78:0/4236311357 shutdown_connections 2024-09-18T12:46:07.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.214+0000 7f7c95106640 1 -- 172.21.15.78:0/4236311357 wait complete. 2024-09-18T12:46:07.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.215+0000 7f7c95106640 1 Processor -- start 2024-09-18T12:46:07.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.215+0000 7f7c95106640 1 -- start start 2024-09-18T12:46:07.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.215+0000 7f7c95106640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c90102b20 0x7f7c90100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:07.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.215+0000 7f7c95106640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c90103440 0x7f7c90100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:07.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.215+0000 7f7c95106640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9010edd0 con 0x7f7c90103440 2024-09-18T12:46:07.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.215+0000 7f7c95106640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9010ec50 con 0x7f7c90102b20 2024-09-18T12:46:07.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.215+0000 7f7c8e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c90103440 0x7f7c90100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:07.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.215+0000 7f7c8e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c90103440 0x7f7c90100cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48280/0 (socket says 172.21.15.78:48280) 2024-09-18T12:46:07.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.215+0000 7f7c8e59c640 1 -- 172.21.15.78:0/1197538814 learned_addr learned my addr 172.21.15.78:0/1197538814 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:07.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.216+0000 7f7c8ed9d640 1 --2- 172.21.15.78:0/1197538814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c90102b20 0x7f7c90100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:07.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.216+0000 7f7c8e59c640 1 -- 172.21.15.78:0/1197538814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c90102b20 msgr2=0x7f7c90100780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:07.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.216+0000 7f7c8e59c640 1 --2- 172.21.15.78:0/1197538814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c90102b20 0x7f7c90100780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:07.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.216+0000 7f7c8e59c640 1 -- 172.21.15.78:0/1197538814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c90101200 con 0x7f7c90103440 2024-09-18T12:46:07.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.216+0000 7f7c8ed9d640 1 --2- 172.21.15.78:0/1197538814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c90102b20 0x7f7c90100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:46:07.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.216+0000 7f7c8e59c640 1 --2- 172.21.15.78:0/1197538814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c90103440 0x7f7c90100cc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7c84031460 tx=0x7f7c840048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:07.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.216+0000 7f7c77fff640 1 -- 172.21.15.78:0/1197538814 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c8403f070 con 0x7f7c90103440 2024-09-18T12:46:07.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.216+0000 7f7c95106640 1 -- 172.21.15.78:0/1197538814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c90101490 con 0x7f7c90103440 2024-09-18T12:46:07.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.216+0000 7f7c77fff640 1 -- 172.21.15.78:0/1197538814 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c840044d0 con 0x7f7c90103440 2024-09-18T12:46:07.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.216+0000 7f7c77fff640 1 -- 172.21.15.78:0/1197538814 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c84035030 con 0x7f7c90103440 2024-09-18T12:46:07.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.216+0000 7f7c95106640 1 -- 172.21.15.78:0/1197538814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c901a3d90 con 0x7f7c90103440 2024-09-18T12:46:07.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.217+0000 7f7c95106640 1 -- 172.21.15.78:0/1197538814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c9006aa30 con 0x7f7c90103440 2024-09-18T12:46:07.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.218+0000 7f7c77fff640 1 -- 172.21.15.78:0/1197538814 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f7c84042070 con 0x7f7c90103440 2024-09-18T12:46:07.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.218+0000 7f7c77fff640 1 --2- 172.21.15.78:0/1197538814 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f7c7806e2b0 0x7f7c78070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:07.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.218+0000 7f7c77fff640 1 -- 172.21.15.78:0/1197538814 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f7c840ae840 con 0x7f7c90103440 2024-09-18T12:46:07.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.218+0000 7f7c8ed9d640 1 --2- 172.21.15.78:0/1197538814 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f7c7806e2b0 0x7f7c78070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:07.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.219+0000 7f7c8ed9d640 1 --2- 172.21.15.78:0/1197538814 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f7c7806e2b0 0x7f7c78070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000abe0 tx=0x7f7c8000a5c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:07.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.223+0000 7f7c77fff640 1 -- 172.21.15.78:0/1197538814 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c8407c4e0 con 0x7f7c90103440 2024-09-18T12:46:07.248 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:07.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.399+0000 7f7c95106640 1 -- 172.21.15.78:0/1197538814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7c90106020 con 0x7f7c90103440 2024-09-18T12:46:07.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.400+0000 7f7c77fff640 1 -- 172.21.15.78:0/1197538814 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7c84080190 con 0x7f7c90103440 2024-09-18T12:46:07.401 INFO:teuthology.orchestra.run.smithi078.stdout:38654705700 2024-09-18T12:46:07.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.402+0000 7f7c95106640 1 -- 172.21.15.78:0/1197538814 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f7c7806e2b0 msgr2=0x7f7c78070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:07.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.402+0000 7f7c95106640 1 --2- 172.21.15.78:0/1197538814 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f7c7806e2b0 0x7f7c78070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000abe0 tx=0x7f7c8000a5c0 comp rx=0 tx=0).stop 2024-09-18T12:46:07.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.402+0000 7f7c95106640 1 -- 172.21.15.78:0/1197538814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c90103440 msgr2=0x7f7c90100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:07.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.402+0000 7f7c95106640 1 --2- 172.21.15.78:0/1197538814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c90103440 0x7f7c90100cc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7c84031460 tx=0x7f7c840048f0 comp rx=0 tx=0).stop 2024-09-18T12:46:07.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.402+0000 7f7c95106640 1 -- 172.21.15.78:0/1197538814 shutdown_connections 2024-09-18T12:46:07.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.402+0000 7f7c95106640 1 --2- 172.21.15.78:0/1197538814 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f7c7806e2b0 0x7f7c78070770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:07.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.402+0000 7f7c95106640 1 --2- 172.21.15.78:0/1197538814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c90103440 0x7f7c90100cc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:07.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.402+0000 7f7c95106640 1 --2- 172.21.15.78:0/1197538814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c90102b20 0x7f7c90100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:07.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.402+0000 7f7c95106640 1 -- 172.21.15.78:0/1197538814 >> 172.21.15.78:0/1197538814 conn(0x7f7c900fc520 msgr2=0x7f7c90103d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:07.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.402+0000 7f7c95106640 1 -- 172.21.15.78:0/1197538814 shutdown_connections 2024-09-18T12:46:07.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:07.402+0000 7f7c95106640 1 -- 172.21.15.78:0/1197538814 wait complete. 2024-09-18T12:46:07.688 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920779 got 141733920781 for osd.4 2024-09-18T12:46:07.688 DEBUG:teuthology.parallel:result is None 2024-09-18T12:46:07.916 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:07 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1197538814' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-18T12:46:07.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:07 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1197538814' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-18T12:46:08.527 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705700 for osd.0 2024-09-18T12:46:08.527 DEBUG:teuthology.parallel:result is None 2024-09-18T12:46:08.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.722+0000 7fbfb4fd0640 1 -- 172.21.15.78:0/2579460292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfb01033e0 msgr2=0x7fbfb010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:08.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.722+0000 7fbfb4fd0640 1 --2- 172.21.15.78:0/2579460292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfb01033e0 0x7fbfb010b8d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009880 tx=0x7fbf9802a530 comp rx=0 tx=0).stop 2024-09-18T12:46:08.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.722+0000 7fbfb4fd0640 1 -- 172.21.15.78:0/2579460292 shutdown_connections 2024-09-18T12:46:08.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.722+0000 7fbfb4fd0640 1 --2- 172.21.15.78:0/2579460292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfb01033e0 0x7fbfb010b8d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:08.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.722+0000 7fbfb4fd0640 1 --2- 172.21.15.78:0/2579460292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb0102ac0 0x7fbfb0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:08.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.722+0000 7fbfb4fd0640 1 -- 172.21.15.78:0/2579460292 >> 172.21.15.78:0/2579460292 conn(0x7fbfb00fc520 msgr2=0x7fbfb00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:08.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.722+0000 7fbfb4fd0640 1 -- 172.21.15.78:0/2579460292 shutdown_connections 2024-09-18T12:46:08.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.722+0000 7fbfb4fd0640 1 -- 172.21.15.78:0/2579460292 wait complete. 2024-09-18T12:46:08.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.723+0000 7fbfb4fd0640 1 Processor -- start 2024-09-18T12:46:08.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.723+0000 7fbfb4fd0640 1 -- start start 2024-09-18T12:46:08.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.723+0000 7fbfb4fd0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb0102ac0 0x7fbfb019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:08.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.723+0000 7fbfb4fd0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfb01033e0 0x7fbfb019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:08.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.724+0000 7fbfb4fd0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb010edf0 con 0x7fbfb01033e0 2024-09-18T12:46:08.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.724+0000 7fbfb4fd0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb010ec70 con 0x7fbfb0102ac0 2024-09-18T12:46:08.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.724+0000 7fbfa5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfb01033e0 0x7fbfb019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:08.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.724+0000 7fbfa5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfb01033e0 0x7fbfb019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48306/0 (socket says 172.21.15.78:48306) 2024-09-18T12:46:08.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.724+0000 7fbfa5d9b640 1 -- 172.21.15.78:0/3633273165 learned_addr learned my addr 172.21.15.78:0/3633273165 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:08.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.724+0000 7fbfae59c640 1 --2- 172.21.15.78:0/3633273165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb0102ac0 0x7fbfb019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:08.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.724+0000 7fbfa5d9b640 1 -- 172.21.15.78:0/3633273165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb0102ac0 msgr2=0x7fbfb019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:08.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.724+0000 7fbfa5d9b640 1 --2- 172.21.15.78:0/3633273165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb0102ac0 0x7fbfb019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:08.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.724+0000 7fbfa5d9b640 1 -- 172.21.15.78:0/3633273165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb0197800 con 0x7fbfb01033e0 2024-09-18T12:46:08.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.724+0000 7fbfa5d9b640 1 --2- 172.21.15.78:0/3633273165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfb01033e0 0x7fbfb019dbc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbf98031460 tx=0x7fbf98004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:08.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.724+0000 7fbfa7fff640 1 -- 172.21.15.78:0/3633273165 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf9803f070 con 0x7fbfb01033e0 2024-09-18T12:46:08.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.724+0000 7fbfa7fff640 1 -- 172.21.15.78:0/3633273165 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbf980035f0 con 0x7fbfb01033e0 2024-09-18T12:46:08.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.724+0000 7fbfb4fd0640 1 -- 172.21.15.78:0/3633273165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb0197a90 con 0x7fbfb01033e0 2024-09-18T12:46:08.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.724+0000 7fbfa7fff640 1 -- 172.21.15.78:0/3633273165 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf98035030 con 0x7fbfb01033e0 2024-09-18T12:46:08.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.724+0000 7fbfb4fd0640 1 -- 172.21.15.78:0/3633273165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb0197fc0 con 0x7fbfb01033e0 2024-09-18T12:46:08.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.725+0000 7fbfb4fd0640 1 -- 172.21.15.78:0/3633273165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb006aa90 con 0x7fbfb01033e0 2024-09-18T12:46:08.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.726+0000 7fbfa7fff640 1 -- 172.21.15.78:0/3633273165 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fbf98042070 con 0x7fbfb01033e0 2024-09-18T12:46:08.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.726+0000 7fbfa7fff640 1 --2- 172.21.15.78:0/3633273165 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fbf9c06e2b0 0x7fbf9c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:08.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.726+0000 7fbfa7fff640 1 -- 172.21.15.78:0/3633273165 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fbf980ae720 con 0x7fbfb01033e0 2024-09-18T12:46:08.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.726+0000 7fbfae59c640 1 --2- 172.21.15.78:0/3633273165 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fbf9c06e2b0 0x7fbf9c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:08.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.727+0000 7fbfae59c640 1 --2- 172.21.15.78:0/3633273165 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fbf9c06e2b0 0x7fbf9c070770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0005fd0 tx=0x7fbfa000b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:08.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.730+0000 7fbfa7fff640 1 -- 172.21.15.78:0/3633273165 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf98080070 con 0x7fbfb01033e0 2024-09-18T12:46:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.897+0000 7fbfb4fd0640 1 -- 172.21.15.78:0/3633273165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbfb0105f60 con 0x7fbfb01033e0 2024-09-18T12:46:08.898 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:08 smithi078 ceph-mon[28091]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:08.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.897+0000 7fbfa7fff640 1 -- 172.21.15.78:0/3633273165 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbf980848a0 con 0x7fbfb01033e0 2024-09-18T12:46:08.899 INFO:teuthology.orchestra.run.smithi078.stdout:107374182419 2024-09-18T12:46:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.899+0000 7fbfb4fd0640 1 -- 172.21.15.78:0/3633273165 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fbf9c06e2b0 msgr2=0x7fbf9c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.899+0000 7fbfb4fd0640 1 --2- 172.21.15.78:0/3633273165 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fbf9c06e2b0 0x7fbf9c070770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0005fd0 tx=0x7fbfa000b390 comp rx=0 tx=0).stop 2024-09-18T12:46:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.899+0000 7fbfb4fd0640 1 -- 172.21.15.78:0/3633273165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfb01033e0 msgr2=0x7fbfb019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.899+0000 7fbfb4fd0640 1 --2- 172.21.15.78:0/3633273165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfb01033e0 0x7fbfb019dbc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbf98031460 tx=0x7fbf98004530 comp rx=0 tx=0).stop 2024-09-18T12:46:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.899+0000 7fbfb4fd0640 1 -- 172.21.15.78:0/3633273165 shutdown_connections 2024-09-18T12:46:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.899+0000 7fbfb4fd0640 1 --2- 172.21.15.78:0/3633273165 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fbf9c06e2b0 0x7fbf9c070770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.899+0000 7fbfb4fd0640 1 --2- 172.21.15.78:0/3633273165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfb01033e0 0x7fbfb019dbc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.899+0000 7fbfb4fd0640 1 --2- 172.21.15.78:0/3633273165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfb0102ac0 0x7fbfb019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.899+0000 7fbfb4fd0640 1 -- 172.21.15.78:0/3633273165 >> 172.21.15.78:0/3633273165 conn(0x7fbfb00fc520 msgr2=0x7fbfb0108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.900+0000 7fbfb4fd0640 1 -- 172.21.15.78:0/3633273165 shutdown_connections 2024-09-18T12:46:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:08.900+0000 7fbfb4fd0640 1 -- 172.21.15.78:0/3633273165 wait complete. 2024-09-18T12:46:08.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:08 smithi148 ceph-mon[35352]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:09.583 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182418 got 107374182419 for osd.3 2024-09-18T12:46:09.583 DEBUG:teuthology.parallel:result is None 2024-09-18T12:46:09.584 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-18T12:46:09.584 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-18T12:46:09.834 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:09.954 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:09 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3633273165' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-18T12:46:09.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:09 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/3633273165' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-18T12:46:10.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.294+0000 7f03d04b5640 1 -- 172.21.15.78:0/1818977018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c81007f0 msgr2=0x7f03c8100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:10.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.294+0000 7f03d04b5640 1 --2- 172.21.15.78:0/1818977018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c81007f0 0x7f03c8100c50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009880 tx=0x7f03bc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:10.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.294+0000 7f03d04b5640 1 -- 172.21.15.78:0/1818977018 shutdown_connections 2024-09-18T12:46:10.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.294+0000 7f03d04b5640 1 --2- 172.21.15.78:0/1818977018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c81007f0 0x7f03c8100c50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:10.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.294+0000 7f03d04b5640 1 --2- 172.21.15.78:0/1818977018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03c81067f0 0x7f03c8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:10.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.294+0000 7f03d04b5640 1 -- 172.21.15.78:0/1818977018 >> 172.21.15.78:0/1818977018 conn(0x7f03c80fc550 msgr2=0x7f03c80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:10.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.294+0000 7f03d04b5640 1 -- 172.21.15.78:0/1818977018 shutdown_connections 2024-09-18T12:46:10.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.294+0000 7f03d04b5640 1 -- 172.21.15.78:0/1818977018 wait complete. 2024-09-18T12:46:10.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.294+0000 7f03d04b5640 1 Processor -- start 2024-09-18T12:46:10.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.295+0000 7f03d04b5640 1 -- start start 2024-09-18T12:46:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.295+0000 7f03d04b5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03c81007f0 0x7f03c819c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.295+0000 7f03d04b5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c81067f0 0x7f03c819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.295+0000 7f03d04b5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f03c810dd20 con 0x7f03c81067f0 2024-09-18T12:46:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.295+0000 7f03d04b5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f03c810dba0 con 0x7f03c81007f0 2024-09-18T12:46:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.295+0000 7f03cda50640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c81067f0 0x7f03c819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.295+0000 7f03cda50640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c81067f0 0x7f03c819cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48326/0 (socket says 172.21.15.78:48326) 2024-09-18T12:46:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.295+0000 7f03cda50640 1 -- 172.21.15.78:0/944017083 learned_addr learned my addr 172.21.15.78:0/944017083 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.295+0000 7f03ce251640 1 --2- 172.21.15.78:0/944017083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03c81007f0 0x7f03c819c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.295+0000 7f03cda50640 1 -- 172.21.15.78:0/944017083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03c81007f0 msgr2=0x7f03c819c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.295+0000 7f03cda50640 1 --2- 172.21.15.78:0/944017083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03c81007f0 0x7f03c819c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.295+0000 7f03cda50640 1 -- 172.21.15.78:0/944017083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c8196830 con 0x7f03c81067f0 2024-09-18T12:46:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.295+0000 7f03ce251640 1 --2- 172.21.15.78:0/944017083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03c81007f0 0x7f03c819c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:46:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.295+0000 7f03cda50640 1 --2- 172.21.15.78:0/944017083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c81067f0 0x7f03c819cbf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f03bc031460 tx=0x7f03bc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.296+0000 7f03c77fe640 1 -- 172.21.15.78:0/944017083 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03bc03f070 con 0x7f03c81067f0 2024-09-18T12:46:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.296+0000 7f03c77fe640 1 -- 172.21.15.78:0/944017083 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03bc004cf0 con 0x7f03c81067f0 2024-09-18T12:46:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.296+0000 7f03c77fe640 1 -- 172.21.15.78:0/944017083 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03bc035030 con 0x7f03c81067f0 2024-09-18T12:46:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.296+0000 7f03d04b5640 1 -- 172.21.15.78:0/944017083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c8196ac0 con 0x7f03c81067f0 2024-09-18T12:46:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.296+0000 7f03d04b5640 1 -- 172.21.15.78:0/944017083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c8196ff0 con 0x7f03c81067f0 2024-09-18T12:46:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.297+0000 7f03d04b5640 1 -- 172.21.15.78:0/944017083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c8101f30 con 0x7f03c81067f0 2024-09-18T12:46:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.297+0000 7f03c77fe640 1 -- 172.21.15.78:0/944017083 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f03bc042070 con 0x7f03c81067f0 2024-09-18T12:46:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.297+0000 7f03c77fe640 1 --2- 172.21.15.78:0/944017083 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f03b006e2b0 0x7f03b0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.298+0000 7f03ce251640 1 --2- 172.21.15.78:0/944017083 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f03b006e2b0 0x7f03b0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.298+0000 7f03c77fe640 1 -- 172.21.15.78:0/944017083 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f03bc0ae910 con 0x7f03c81067f0 2024-09-18T12:46:10.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.298+0000 7f03ce251640 1 --2- 172.21.15.78:0/944017083 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f03b006e2b0 0x7f03b0070770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009fa0 tx=0x7f03b8009570 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:10.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.302+0000 7f03c77fe640 1 -- 172.21.15.78:0/944017083 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03bc07c5b0 con 0x7f03c81067f0 2024-09-18T12:46:10.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.467+0000 7f03d04b5640 1 -- 172.21.15.78:0/944017083 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f03c8197d60 con 0x7f03b006e2b0 2024-09-18T12:46:10.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.467+0000 7f03c77fe640 1 -- 172.21.15.78:0/944017083 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f03c8197d60 con 0x7f03b006e2b0 2024-09-18T12:46:10.469 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:46:10.469 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-18T12:46:10.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.470+0000 7f03d04b5640 1 -- 172.21.15.78:0/944017083 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f03b006e2b0 msgr2=0x7f03b0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:10.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.470+0000 7f03d04b5640 1 --2- 172.21.15.78:0/944017083 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f03b006e2b0 0x7f03b0070770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009fa0 tx=0x7f03b8009570 comp rx=0 tx=0).stop 2024-09-18T12:46:10.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.470+0000 7f03d04b5640 1 -- 172.21.15.78:0/944017083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c81067f0 msgr2=0x7f03c819cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:10.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.470+0000 7f03d04b5640 1 --2- 172.21.15.78:0/944017083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c81067f0 0x7f03c819cbf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f03bc031460 tx=0x7f03bc0048f0 comp rx=0 tx=0).stop 2024-09-18T12:46:10.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.470+0000 7f03d04b5640 1 -- 172.21.15.78:0/944017083 shutdown_connections 2024-09-18T12:46:10.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.470+0000 7f03d04b5640 1 --2- 172.21.15.78:0/944017083 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f03b006e2b0 0x7f03b0070770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:10.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.470+0000 7f03d04b5640 1 --2- 172.21.15.78:0/944017083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c81067f0 0x7f03c819cbf0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:10.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.470+0000 7f03d04b5640 1 --2- 172.21.15.78:0/944017083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03c81007f0 0x7f03c819c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:10.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.470+0000 7f03d04b5640 1 -- 172.21.15.78:0/944017083 >> 172.21.15.78:0/944017083 conn(0x7f03c80fc550 msgr2=0x7f03c80fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:10.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.470+0000 7f03d04b5640 1 -- 172.21.15.78:0/944017083 shutdown_connections 2024-09-18T12:46:10.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:10.470+0000 7f03d04b5640 1 -- 172.21.15.78:0/944017083 wait complete. 2024-09-18T12:46:10.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:10 smithi078 ceph-mon[28091]: from='client.14516 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:46:10.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:10 smithi078 ceph-mon[28091]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:10.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:10 smithi148 ceph-mon[35352]: from='client.14516 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:46:10.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:10 smithi148 ceph-mon[35352]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:11.112 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-18T12:46:08.617245+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":182648,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":178678,"kb_avail":562288264,"statfs":{"total":575970213888,"available":575783182336,"internally_reserved":0,"allocated":3919872,"data_stored":2589960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":182966944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002012"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":191,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-18T12:45:41.832826+0000","last_change":"2024-09-18T12:45:13.668242+0000","last_active":"2024-09-18T12:45:41.832826+0000","last_peered":"2024-09-18T12:45:41.832826+0000","last_clean":"2024-09-18T12:45:41.832826+0000","last_became_active":"2024-09-18T12:45:13.667930+0000","last_became_peered":"2024-09-18T12:45:13.667930+0000","last_unstale":"2024-09-18T12:45:41.832826+0000","last_undegraded":"2024-09-18T12:45:41.832826+0000","last_fullsized":"2024-09-18T12:45:41.832826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:44:21.689477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:44:21.689477+0000","last_clean_scrub_stamp":"2024-09-18T12:44:21.689477+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T20:52:44.076580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31540,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713612,"statfs":{"total":95995035648,"available":95962738688,"internally_reserved":0,"allocated":356352,"data_stored":136476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920781,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717772,"statfs":{"total":95995035648,"available":95966998528,"internally_reserved":0,"allocated":356352,"data_stored":136476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182419,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":950272,"data_stored":726844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":136476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":950272,"data_stored":726844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":950272,"data_stored":726844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:46:11.113 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-18T12:46:11.358 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.850+0000 7fa73d481640 1 -- 172.21.15.78:0/563878832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa738102ab0 msgr2=0x7fa738102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.850+0000 7fa73d481640 1 --2- 172.21.15.78:0/563878832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa738102ab0 0x7fa738102e90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa728009c20 tx=0x7fa72802aa00 comp rx=0 tx=0).stop 2024-09-18T12:46:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.850+0000 7fa73d481640 1 -- 172.21.15.78:0/563878832 shutdown_connections 2024-09-18T12:46:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.850+0000 7fa73d481640 1 --2- 172.21.15.78:0/563878832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7381033d0 0x7fa73810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:11.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.850+0000 7fa73d481640 1 --2- 172.21.15.78:0/563878832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa738102ab0 0x7fa738102e90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.850+0000 7fa73d481640 1 -- 172.21.15.78:0/563878832 >> 172.21.15.78:0/563878832 conn(0x7fa7380fc550 msgr2=0x7fa7380fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.850+0000 7fa73d481640 1 -- 172.21.15.78:0/563878832 shutdown_connections 2024-09-18T12:46:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.850+0000 7fa73d481640 1 -- 172.21.15.78:0/563878832 wait complete. 2024-09-18T12:46:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.851+0000 7fa73d481640 1 Processor -- start 2024-09-18T12:46:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.851+0000 7fa73d481640 1 -- start start 2024-09-18T12:46:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.851+0000 7fa73d481640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa738102ab0 0x7fa73819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.851+0000 7fa73d481640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7381033d0 0x7fa73819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.851+0000 7fa73d481640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa73810ee40 con 0x7fa738102ab0 2024-09-18T12:46:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.851+0000 7fa73d481640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa73810ecc0 con 0x7fa7381033d0 2024-09-18T12:46:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.851+0000 7fa736ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa738102ab0 0x7fa73819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.851+0000 7fa736ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa738102ab0 0x7fa73819d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53434/0 (socket says 172.21.15.78:53434) 2024-09-18T12:46:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.851+0000 7fa736ffd640 1 -- 172.21.15.78:0/2048365471 learned_addr learned my addr 172.21.15.78:0/2048365471 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.852+0000 7fa7367fc640 1 --2- 172.21.15.78:0/2048365471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7381033d0 0x7fa73819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.852+0000 7fa736ffd640 1 -- 172.21.15.78:0/2048365471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7381033d0 msgr2=0x7fa73819dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.852+0000 7fa736ffd640 1 --2- 172.21.15.78:0/2048365471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7381033d0 0x7fa73819dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.852+0000 7fa736ffd640 1 -- 172.21.15.78:0/2048365471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa738197870 con 0x7fa738102ab0 2024-09-18T12:46:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.852+0000 7fa7367fc640 1 --2- 172.21.15.78:0/2048365471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7381033d0 0x7fa73819dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:46:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.852+0000 7fa736ffd640 1 --2- 172.21.15.78:0/2048365471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa738102ab0 0x7fa73819d6b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa728005cc0 tx=0x7fa72802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.852+0000 7fa71ffff640 1 -- 172.21.15.78:0/2048365471 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa728047070 con 0x7fa738102ab0 2024-09-18T12:46:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.852+0000 7fa71ffff640 1 -- 172.21.15.78:0/2048365471 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa728003e30 con 0x7fa738102ab0 2024-09-18T12:46:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.852+0000 7fa73d481640 1 -- 172.21.15.78:0/2048365471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa738197b00 con 0x7fa738102ab0 2024-09-18T12:46:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.852+0000 7fa71ffff640 1 -- 172.21.15.78:0/2048365471 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa728033050 con 0x7fa738102ab0 2024-09-18T12:46:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.852+0000 7fa73d481640 1 -- 172.21.15.78:0/2048365471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa738198030 con 0x7fa738102ab0 2024-09-18T12:46:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.853+0000 7fa73d481640 1 -- 172.21.15.78:0/2048365471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa73806a580 con 0x7fa738102ab0 2024-09-18T12:46:11.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.853+0000 7fa71ffff640 1 -- 172.21.15.78:0/2048365471 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa72804a070 con 0x7fa738102ab0 2024-09-18T12:46:11.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.854+0000 7fa71ffff640 1 --2- 172.21.15.78:0/2048365471 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa72006e2b0 0x7fa720070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:11.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.854+0000 7fa71ffff640 1 -- 172.21.15.78:0/2048365471 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fa72803e030 con 0x7fa738102ab0 2024-09-18T12:46:11.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.854+0000 7fa7367fc640 1 --2- 172.21.15.78:0/2048365471 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa72006e2b0 0x7fa720070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:11.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.854+0000 7fa7367fc640 1 --2- 172.21.15.78:0/2048365471 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa72006e2b0 0x7fa720070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa72c006fd0 tx=0x7fa72c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:11.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:11.859+0000 7fa71ffff640 1 -- 172.21.15.78:0/2048365471 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa72807cce0 con 0x7fa738102ab0 2024-09-18T12:46:11.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:11 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:11 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:12.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:12.021+0000 7fa73d481640 1 -- 172.21.15.78:0/2048365471 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa738198da0 con 0x7fa72006e2b0 2024-09-18T12:46:12.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:12.022+0000 7fa71ffff640 1 -- 172.21.15.78:0/2048365471 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7fa738198da0 con 0x7fa72006e2b0 2024-09-18T12:46:12.023 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:46:12.024 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-18T12:46:12.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:12.024+0000 7fa73d481640 1 -- 172.21.15.78:0/2048365471 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa72006e2b0 msgr2=0x7fa720070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:12.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:12.024+0000 7fa73d481640 1 --2- 172.21.15.78:0/2048365471 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa72006e2b0 0x7fa720070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa72c006fd0 tx=0x7fa72c008040 comp rx=0 tx=0).stop 2024-09-18T12:46:12.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:12.024+0000 7fa73d481640 1 -- 172.21.15.78:0/2048365471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa738102ab0 msgr2=0x7fa73819d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:12.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:12.024+0000 7fa73d481640 1 --2- 172.21.15.78:0/2048365471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa738102ab0 0x7fa73819d6b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa728005cc0 tx=0x7fa72802ee60 comp rx=0 tx=0).stop 2024-09-18T12:46:12.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:12.024+0000 7fa73d481640 1 -- 172.21.15.78:0/2048365471 shutdown_connections 2024-09-18T12:46:12.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:12.024+0000 7fa73d481640 1 --2- 172.21.15.78:0/2048365471 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa72006e2b0 0x7fa720070770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:12.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:12.024+0000 7fa73d481640 1 --2- 172.21.15.78:0/2048365471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7381033d0 0x7fa73819dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:12.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:12.024+0000 7fa73d481640 1 --2- 172.21.15.78:0/2048365471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa738102ab0 0x7fa73819d6b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:12.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:12.024+0000 7fa73d481640 1 -- 172.21.15.78:0/2048365471 >> 172.21.15.78:0/2048365471 conn(0x7fa7380fc550 msgr2=0x7fa738108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:12.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:12.024+0000 7fa73d481640 1 -- 172.21.15.78:0/2048365471 shutdown_connections 2024-09-18T12:46:12.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:12.025+0000 7fa73d481640 1 -- 172.21.15.78:0/2048365471 wait complete. 2024-09-18T12:46:12.832 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-09-18T12:46:10.617581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":182648,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":178678,"kb_avail":562288264,"statfs":{"total":575970213888,"available":575783182336,"internally_reserved":0,"allocated":3919872,"data_stored":2589960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":182966944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001890"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":191,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-18T12:45:41.832826+0000","last_change":"2024-09-18T12:45:13.668242+0000","last_active":"2024-09-18T12:45:41.832826+0000","last_peered":"2024-09-18T12:45:41.832826+0000","last_clean":"2024-09-18T12:45:41.832826+0000","last_became_active":"2024-09-18T12:45:13.667930+0000","last_became_peered":"2024-09-18T12:45:13.667930+0000","last_unstale":"2024-09-18T12:45:41.832826+0000","last_undegraded":"2024-09-18T12:45:41.832826+0000","last_fullsized":"2024-09-18T12:45:41.832826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:44:21.689477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:44:21.689477+0000","last_clean_scrub_stamp":"2024-09-18T12:44:21.689477+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T20:52:44.076580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31540,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713612,"statfs":{"total":95995035648,"available":95962738688,"internally_reserved":0,"allocated":356352,"data_stored":136476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920782,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717772,"statfs":{"total":95995035648,"available":95966998528,"internally_reserved":0,"allocated":356352,"data_stored":136476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182420,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":950272,"data_stored":726844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":136476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":950272,"data_stored":726844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":950272,"data_stored":726844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:46:12.833 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-18T12:46:12.833 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-18T12:46:12.833 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-18T12:46:12.834 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-18T12:46:12.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:12 smithi148 ceph-mon[35352]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:46:12.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:12 smithi148 ceph-mon[35352]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:12.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:12 smithi078 ceph-mon[28091]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:46:12.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:12 smithi078 ceph-mon[28091]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:13.080 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:13.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.561+0000 7f9237468640 1 -- 172.21.15.78:0/1856177474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9230103430 msgr2=0x7f923010b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:13.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.561+0000 7f9237468640 1 --2- 172.21.15.78:0/1856177474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9230103430 0x7f923010b920 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9224009c50 tx=0x7f922402aa30 comp rx=0 tx=0).stop 2024-09-18T12:46:13.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.561+0000 7f9237468640 1 -- 172.21.15.78:0/1856177474 shutdown_connections 2024-09-18T12:46:13.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.561+0000 7f9237468640 1 --2- 172.21.15.78:0/1856177474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9230103430 0x7f923010b920 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:13.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.561+0000 7f9237468640 1 --2- 172.21.15.78:0/1856177474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9230102b10 0x7f9230102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:13.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.561+0000 7f9237468640 1 -- 172.21.15.78:0/1856177474 >> 172.21.15.78:0/1856177474 conn(0x7f92300fc550 msgr2=0x7f92300fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:13.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.561+0000 7f9237468640 1 -- 172.21.15.78:0/1856177474 shutdown_connections 2024-09-18T12:46:13.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.561+0000 7f9237468640 1 -- 172.21.15.78:0/1856177474 wait complete. 2024-09-18T12:46:13.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.562+0000 7f9237468640 1 Processor -- start 2024-09-18T12:46:13.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.562+0000 7f9237468640 1 -- start start 2024-09-18T12:46:13.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.562+0000 7f9237468640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9230102b10 0x7f923019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:13.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.562+0000 7f9237468640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9230103430 0x7f923019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:13.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.562+0000 7f9237468640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f923010ede0 con 0x7f9230102b10 2024-09-18T12:46:13.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.562+0000 7f9237468640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f923010ec60 con 0x7f9230103430 2024-09-18T12:46:13.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.562+0000 7f9235204640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9230102b10 0x7f923019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:13.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.562+0000 7f9235204640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9230102b10 0x7f923019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53460/0 (socket says 172.21.15.78:53460) 2024-09-18T12:46:13.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.562+0000 7f9235204640 1 -- 172.21.15.78:0/3681771394 learned_addr learned my addr 172.21.15.78:0/3681771394 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:13.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.562+0000 7f9234a03640 1 --2- 172.21.15.78:0/3681771394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9230103430 0x7f923019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:13.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.562+0000 7f9235204640 1 -- 172.21.15.78:0/3681771394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9230103430 msgr2=0x7f923019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:13.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.562+0000 7f9235204640 1 --2- 172.21.15.78:0/3681771394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9230103430 0x7f923019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:13.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.562+0000 7f9235204640 1 -- 172.21.15.78:0/3681771394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92301977f0 con 0x7f9230102b10 2024-09-18T12:46:13.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.562+0000 7f9234a03640 1 --2- 172.21.15.78:0/3681771394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9230103430 0x7f923019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:46:13.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.563+0000 7f9235204640 1 --2- 172.21.15.78:0/3681771394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9230102b10 0x7f923019d670 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f922000d6f0 tx=0x7f922000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:13.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.563+0000 7f922e7fc640 1 -- 172.21.15.78:0/3681771394 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9220017070 con 0x7f9230102b10 2024-09-18T12:46:13.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.563+0000 7f922e7fc640 1 -- 172.21.15.78:0/3681771394 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f922000de00 con 0x7f9230102b10 2024-09-18T12:46:13.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.563+0000 7f9237468640 1 -- 172.21.15.78:0/3681771394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9230197ae0 con 0x7f9230102b10 2024-09-18T12:46:13.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.563+0000 7f922e7fc640 1 -- 172.21.15.78:0/3681771394 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9220004bb0 con 0x7f9230102b10 2024-09-18T12:46:13.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.563+0000 7f9237468640 1 -- 172.21.15.78:0/3681771394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9230198070 con 0x7f9230102b10 2024-09-18T12:46:13.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.564+0000 7f9237468640 1 -- 172.21.15.78:0/3681771394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f923006a520 con 0x7f9230102b10 2024-09-18T12:46:13.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.564+0000 7f922e7fc640 1 -- 172.21.15.78:0/3681771394 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f9220009a30 con 0x7f9230102b10 2024-09-18T12:46:13.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.565+0000 7f922e7fc640 1 --2- 172.21.15.78:0/3681771394 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f921806e2b0 0x7f9218070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:13.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.565+0000 7f922e7fc640 1 -- 172.21.15.78:0/3681771394 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f922008da70 con 0x7f9230102b10 2024-09-18T12:46:13.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.565+0000 7f9234a03640 1 --2- 172.21.15.78:0/3681771394 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f921806e2b0 0x7f9218070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:13.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.565+0000 7f9234a03640 1 --2- 172.21.15.78:0/3681771394 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f921806e2b0 0x7f9218070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9224006010 tx=0x7f922402e990 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:13.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.569+0000 7f922e7fc640 1 -- 172.21.15.78:0/3681771394 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f922005b710 con 0x7f9230102b10 2024-09-18T12:46:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.773+0000 7f9237468640 1 -- 172.21.15.78:0/3681771394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9230106010 con 0x7f9230102b10 2024-09-18T12:46:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.773+0000 7f922e7fc640 1 -- 172.21.15.78:0/3681771394 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f922005f3c0 con 0x7f9230102b10 2024-09-18T12:46:13.774 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:46:13.775 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-18T12:46:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.775+0000 7f9237468640 1 -- 172.21.15.78:0/3681771394 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f921806e2b0 msgr2=0x7f9218070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.775+0000 7f9237468640 1 --2- 172.21.15.78:0/3681771394 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f921806e2b0 0x7f9218070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9224006010 tx=0x7f922402e990 comp rx=0 tx=0).stop 2024-09-18T12:46:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.775+0000 7f9237468640 1 -- 172.21.15.78:0/3681771394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9230102b10 msgr2=0x7f923019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.775+0000 7f9237468640 1 --2- 172.21.15.78:0/3681771394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9230102b10 0x7f923019d670 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f922000d6f0 tx=0x7f922000dbb0 comp rx=0 tx=0).stop 2024-09-18T12:46:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.775+0000 7f9237468640 1 -- 172.21.15.78:0/3681771394 shutdown_connections 2024-09-18T12:46:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.775+0000 7f9237468640 1 --2- 172.21.15.78:0/3681771394 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f921806e2b0 0x7f9218070770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.775+0000 7f9237468640 1 --2- 172.21.15.78:0/3681771394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9230103430 0x7f923019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.775+0000 7f9237468640 1 --2- 172.21.15.78:0/3681771394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9230102b10 0x7f923019d670 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.775+0000 7f9237468640 1 -- 172.21.15.78:0/3681771394 >> 172.21.15.78:0/3681771394 conn(0x7f92300fc550 msgr2=0x7f9230103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.775+0000 7f9237468640 1 -- 172.21.15.78:0/3681771394 shutdown_connections 2024-09-18T12:46:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:13.775+0000 7f9237468640 1 -- 172.21.15.78:0/3681771394 wait complete. 2024-09-18T12:46:14.097 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:13 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3681771394' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-18T12:46:14.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:13 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/3681771394' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-18T12:46:14.395 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-18T12:46:14.395 INFO:tasks.cephadm:Setup complete, yielding 2024-09-18T12:46:14.395 INFO:teuthology.run_tasks:Running task print... 2024-09-18T12:46:14.405 INFO:teuthology.task.print:**** done end installing squid cephadm ... 2024-09-18T12:46:14.405 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:46:14.427 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-18T12:46:14.427 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-18T12:46:14.673 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:15.120 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:14 smithi078 ceph-mon[28091]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:15.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.119+0000 7f79a362f640 1 -- 172.21.15.78:0/1970606175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c101960 msgr2=0x7f799c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:15.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.119+0000 7f79a362f640 1 --2- 172.21.15.78:0/1970606175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c101960 0x7f799c101d60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7994009880 tx=0x7f799402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:15.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.119+0000 7f79a362f640 1 -- 172.21.15.78:0/1970606175 shutdown_connections 2024-09-18T12:46:15.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.119+0000 7f79a362f640 1 --2- 172.21.15.78:0/1970606175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f799c102b60 0x7f799c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:15.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.119+0000 7f79a362f640 1 --2- 172.21.15.78:0/1970606175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c101960 0x7f799c101d60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:15.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.119+0000 7f79a362f640 1 -- 172.21.15.78:0/1970606175 >> 172.21.15.78:0/1970606175 conn(0x7f799c0fd110 msgr2=0x7f799c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:15.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.119+0000 7f79a362f640 1 -- 172.21.15.78:0/1970606175 shutdown_connections 2024-09-18T12:46:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.119+0000 7f79a362f640 1 -- 172.21.15.78:0/1970606175 wait complete. 2024-09-18T12:46:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.119+0000 7f79a362f640 1 Processor -- start 2024-09-18T12:46:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.119+0000 7f79a362f640 1 -- start start 2024-09-18T12:46:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f79a362f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c101960 0x7f799c1974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f79a362f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f799c102b60 0x7f799c1979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f79a362f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f799c10a780 con 0x7f799c101960 2024-09-18T12:46:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f79a362f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f799c10a600 con 0x7f799c102b60 2024-09-18T12:46:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f79a13cb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c101960 0x7f799c1974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f79a13cb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c101960 0x7f799c1974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53472/0 (socket says 172.21.15.78:53472) 2024-09-18T12:46:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f79a13cb640 1 -- 172.21.15.78:0/2629258313 learned_addr learned my addr 172.21.15.78:0/2629258313 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f79a0bca640 1 --2- 172.21.15.78:0/2629258313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f799c102b60 0x7f799c1979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f79a13cb640 1 -- 172.21.15.78:0/2629258313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f799c102b60 msgr2=0x7f799c1979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f79a13cb640 1 --2- 172.21.15.78:0/2629258313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f799c102b60 0x7f799c1979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f79a13cb640 1 -- 172.21.15.78:0/2629258313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799c197fe0 con 0x7f799c101960 2024-09-18T12:46:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f79a13cb640 1 --2- 172.21.15.78:0/2629258313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c101960 0x7f799c1974b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7994006010 tx=0x7f79940048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f799a7fc640 1 -- 172.21.15.78:0/2629258313 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f799403f070 con 0x7f799c101960 2024-09-18T12:46:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f799a7fc640 1 -- 172.21.15.78:0/2629258313 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79940044d0 con 0x7f799c101960 2024-09-18T12:46:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f799a7fc640 1 -- 172.21.15.78:0/2629258313 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7994035030 con 0x7f799c101960 2024-09-18T12:46:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.120+0000 7f79a362f640 1 -- 172.21.15.78:0/2629258313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f799c19c9f0 con 0x7f799c101960 2024-09-18T12:46:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.121+0000 7f79a362f640 1 -- 172.21.15.78:0/2629258313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f799c19cef0 con 0x7f799c101960 2024-09-18T12:46:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.121+0000 7f79a362f640 1 -- 172.21.15.78:0/2629258313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f799c101d60 con 0x7f799c101960 2024-09-18T12:46:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.122+0000 7f799a7fc640 1 -- 172.21.15.78:0/2629258313 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f7994042070 con 0x7f799c101960 2024-09-18T12:46:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.122+0000 7f799a7fc640 1 --2- 172.21.15.78:0/2629258313 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f798406e310 0x7f79840707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.122+0000 7f799a7fc640 1 -- 172.21.15.78:0/2629258313 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f79940ae9f0 con 0x7f799c101960 2024-09-18T12:46:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.122+0000 7f79a0bca640 1 --2- 172.21.15.78:0/2629258313 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f798406e310 0x7f79840707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.123+0000 7f79a0bca640 1 --2- 172.21.15.78:0/2629258313 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f798406e310 0x7f79840707d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7990005e10 tx=0x7f7990005da0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:15.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.127+0000 7f799a7fc640 1 -- 172.21.15.78:0/2629258313 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f799407c710 con 0x7f799c101960 2024-09-18T12:46:15.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:14 smithi148 ceph-mon[35352]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:15.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.293+0000 7f79a362f640 1 -- 172.21.15.78:0/2629258313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) -- 0x7f799c19d1a0 con 0x7f799c101960 2024-09-18T12:46:15.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.297+0000 7f799a7fc640 1 -- 172.21.15.78:0/2629258313 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v42)=0 v42) ==== 143+0+0 (secure 0 0 0) 0x7f79940803c0 con 0x7f799c101960 2024-09-18T12:46:15.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.299+0000 7f79a362f640 1 -- 172.21.15.78:0/2629258313 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f798406e310 msgr2=0x7f79840707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:15.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.299+0000 7f79a362f640 1 --2- 172.21.15.78:0/2629258313 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f798406e310 0x7f79840707d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7990005e10 tx=0x7f7990005da0 comp rx=0 tx=0).stop 2024-09-18T12:46:15.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.299+0000 7f79a362f640 1 -- 172.21.15.78:0/2629258313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c101960 msgr2=0x7f799c1974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:15.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.299+0000 7f79a362f640 1 --2- 172.21.15.78:0/2629258313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c101960 0x7f799c1974b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7994006010 tx=0x7f79940048f0 comp rx=0 tx=0).stop 2024-09-18T12:46:15.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.299+0000 7f79a362f640 1 -- 172.21.15.78:0/2629258313 shutdown_connections 2024-09-18T12:46:15.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.299+0000 7f79a362f640 1 --2- 172.21.15.78:0/2629258313 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f798406e310 0x7f79840707d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:15.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.299+0000 7f79a362f640 1 --2- 172.21.15.78:0/2629258313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f799c102b60 0x7f799c1979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:15.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.299+0000 7f79a362f640 1 --2- 172.21.15.78:0/2629258313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c101960 0x7f799c1974b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:15.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.299+0000 7f79a362f640 1 -- 172.21.15.78:0/2629258313 >> 172.21.15.78:0/2629258313 conn(0x7f799c0fd110 msgr2=0x7f799c0ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:15.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.299+0000 7f79a362f640 1 -- 172.21.15.78:0/2629258313 shutdown_connections 2024-09-18T12:46:15.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:15.299+0000 7f79a362f640 1 -- 172.21.15.78:0/2629258313 wait complete. 2024-09-18T12:46:15.935 INFO:teuthology.run_tasks:Running task print... 2024-09-18T12:46:15.944 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-18T12:46:15.944 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:46:15.953 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-18T12:46:15.953 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-18T12:46:16.200 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:16.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:16 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2629258313' entity='client.admin' 2024-09-18T12:46:16.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:16 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:16.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:16 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:16.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:16 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:16.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:16 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:16.635 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:16 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2629258313' entity='client.admin' 2024-09-18T12:46:16.636 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:16 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:16.636 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:16 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:16.636 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:16 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:16.636 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:16 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.714+0000 7f8f8ce14640 1 -- 172.21.15.78:0/3298659695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f88102b60 msgr2=0x7f8f88102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.714+0000 7f8f8ce14640 1 --2- 172.21.15.78:0/3298659695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f88102b60 0x7f8f88102fe0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009880 tx=0x7f8f7c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.714+0000 7f8f8ce14640 1 -- 172.21.15.78:0/3298659695 shutdown_connections 2024-09-18T12:46:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.714+0000 7f8f8ce14640 1 --2- 172.21.15.78:0/3298659695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f88102b60 0x7f8f88102fe0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.714+0000 7f8f8ce14640 1 --2- 172.21.15.78:0/3298659695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f88101960 0x7f8f88101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.714+0000 7f8f8ce14640 1 -- 172.21.15.78:0/3298659695 >> 172.21.15.78:0/3298659695 conn(0x7f8f880fd110 msgr2=0x7f8f880ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.714+0000 7f8f8ce14640 1 -- 172.21.15.78:0/3298659695 shutdown_connections 2024-09-18T12:46:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.714+0000 7f8f8ce14640 1 -- 172.21.15.78:0/3298659695 wait complete. 2024-09-18T12:46:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f8ce14640 1 Processor -- start 2024-09-18T12:46:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f8ce14640 1 -- start start 2024-09-18T12:46:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f8ce14640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f88101960 0x7f8f88199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f8ce14640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f88102b60 0x7f8f88199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f8ce14640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8810a820 con 0x7f8f88102b60 2024-09-18T12:46:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f8ce14640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8810a6a0 con 0x7f8f88101960 2024-09-18T12:46:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f85d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f88102b60 0x7f8f88199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f85d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f88102b60 0x7f8f88199c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53502/0 (socket says 172.21.15.78:53502) 2024-09-18T12:46:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f85d9b640 1 -- 172.21.15.78:0/779553286 learned_addr learned my addr 172.21.15.78:0/779553286 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f8659c640 1 --2- 172.21.15.78:0/779553286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f88101960 0x7f8f88199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f85d9b640 1 -- 172.21.15.78:0/779553286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f88101960 msgr2=0x7f8f88199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f85d9b640 1 --2- 172.21.15.78:0/779553286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f88101960 0x7f8f88199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f85d9b640 1 -- 172.21.15.78:0/779553286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8819a2f0 con 0x7f8f88102b60 2024-09-18T12:46:16.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f85d9b640 1 --2- 172.21.15.78:0/779553286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f88102b60 0x7f8f88199c70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c006010 tx=0x7f8f7c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:16.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f777fe640 1 -- 172.21.15.78:0/779553286 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f7c03f070 con 0x7f8f88102b60 2024-09-18T12:46:16.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f777fe640 1 -- 172.21.15.78:0/779553286 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f7c0044d0 con 0x7f8f88102b60 2024-09-18T12:46:16.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.715+0000 7f8f8ce14640 1 -- 172.21.15.78:0/779553286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8819ecd0 con 0x7f8f88102b60 2024-09-18T12:46:16.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.716+0000 7f8f777fe640 1 -- 172.21.15.78:0/779553286 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f7c035030 con 0x7f8f88102b60 2024-09-18T12:46:16.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.716+0000 7f8f8ce14640 1 -- 172.21.15.78:0/779553286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f8819f280 con 0x7f8f88102b60 2024-09-18T12:46:16.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.716+0000 7f8f8ce14640 1 -- 172.21.15.78:0/779553286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f88101d40 con 0x7f8f88102b60 2024-09-18T12:46:16.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.717+0000 7f8f777fe640 1 -- 172.21.15.78:0/779553286 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8f7c042070 con 0x7f8f88102b60 2024-09-18T12:46:16.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.717+0000 7f8f777fe640 1 --2- 172.21.15.78:0/779553286 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8f7006e2b0 0x7f8f70070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:16.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.717+0000 7f8f777fe640 1 -- 172.21.15.78:0/779553286 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f8f7c0aeba0 con 0x7f8f88102b60 2024-09-18T12:46:16.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.717+0000 7f8f8659c640 1 --2- 172.21.15.78:0/779553286 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8f7006e2b0 0x7f8f70070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:16.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.718+0000 7f8f8659c640 1 --2- 172.21.15.78:0/779553286 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8f7006e2b0 0x7f8f70070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8f881029c0 tx=0x7f8f80008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:16.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.722+0000 7f8f777fe640 1 -- 172.21.15.78:0/779553286 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8f7c07c840 con 0x7f8f88102b60 2024-09-18T12:46:16.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.903+0000 7f8f8ce14640 1 -- 172.21.15.78:0/779553286 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f8f88075dd0 con 0x7f8f7006e2b0 2024-09-18T12:46:16.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.904+0000 7f8f777fe640 1 -- 172.21.15.78:0/779553286 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f8f88075dd0 con 0x7f8f7006e2b0 2024-09-18T12:46:16.905 INFO:teuthology.orchestra.run.smithi078.stdout:Backend: cephadm 2024-09-18T12:46:16.905 INFO:teuthology.orchestra.run.smithi078.stdout:Available: Yes 2024-09-18T12:46:16.905 INFO:teuthology.orchestra.run.smithi078.stdout:Paused: No 2024-09-18T12:46:16.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.906+0000 7f8f8ce14640 1 -- 172.21.15.78:0/779553286 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8f7006e2b0 msgr2=0x7f8f70070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:16.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.906+0000 7f8f8ce14640 1 --2- 172.21.15.78:0/779553286 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8f7006e2b0 0x7f8f70070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8f881029c0 tx=0x7f8f80008040 comp rx=0 tx=0).stop 2024-09-18T12:46:16.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.906+0000 7f8f8ce14640 1 -- 172.21.15.78:0/779553286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f88102b60 msgr2=0x7f8f88199c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:16.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.906+0000 7f8f8ce14640 1 --2- 172.21.15.78:0/779553286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f88102b60 0x7f8f88199c70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c006010 tx=0x7f8f7c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:46:16.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.906+0000 7f8f8ce14640 1 -- 172.21.15.78:0/779553286 shutdown_connections 2024-09-18T12:46:16.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.906+0000 7f8f8ce14640 1 --2- 172.21.15.78:0/779553286 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8f7006e2b0 0x7f8f70070770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:16.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.906+0000 7f8f8ce14640 1 --2- 172.21.15.78:0/779553286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f88102b60 0x7f8f88199c70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:16.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.906+0000 7f8f8ce14640 1 --2- 172.21.15.78:0/779553286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f88101960 0x7f8f88199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:16.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.906+0000 7f8f8ce14640 1 -- 172.21.15.78:0/779553286 >> 172.21.15.78:0/779553286 conn(0x7f8f880fd110 msgr2=0x7f8f880746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:16.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.906+0000 7f8f8ce14640 1 -- 172.21.15.78:0/779553286 shutdown_connections 2024-09-18T12:46:16.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:16.906+0000 7f8f8ce14640 1 -- 172.21.15.78:0/779553286 wait complete. 2024-09-18T12:46:17.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:17 smithi078 ceph-mon[28091]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:17.552 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-18T12:46:17.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:17 smithi148 ceph-mon[35352]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:17.796 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:18.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.223+0000 7faa64065640 1 -- 172.21.15.78:0/3431943428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa5c100860 msgr2=0x7faa5c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:18.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.223+0000 7faa64065640 1 --2- 172.21.15.78:0/3431943428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa5c100860 0x7faa5c100c60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faa58009880 tx=0x7faa5802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:18.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.223+0000 7faa64065640 1 -- 172.21.15.78:0/3431943428 shutdown_connections 2024-09-18T12:46:18.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.223+0000 7faa64065640 1 --2- 172.21.15.78:0/3431943428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c101a60 0x7faa5c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:18.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.223+0000 7faa64065640 1 --2- 172.21.15.78:0/3431943428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa5c100860 0x7faa5c100c60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:18.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.223+0000 7faa64065640 1 -- 172.21.15.78:0/3431943428 >> 172.21.15.78:0/3431943428 conn(0x7faa5c0fc010 msgr2=0x7faa5c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:18.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.223+0000 7faa64065640 1 -- 172.21.15.78:0/3431943428 shutdown_connections 2024-09-18T12:46:18.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.223+0000 7faa64065640 1 -- 172.21.15.78:0/3431943428 wait complete. 2024-09-18T12:46:18.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.224+0000 7faa64065640 1 Processor -- start 2024-09-18T12:46:18.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.224+0000 7faa64065640 1 -- start start 2024-09-18T12:46:18.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.224+0000 7faa64065640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c100860 0x7faa5c1963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:18.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.224+0000 7faa64065640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa5c101a60 0x7faa5c196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:18.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.224+0000 7faa64065640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c1096a0 con 0x7faa5c101a60 2024-09-18T12:46:18.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.224+0000 7faa64065640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c109520 con 0x7faa5c100860 2024-09-18T12:46:18.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.224+0000 7faa61600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa5c101a60 0x7faa5c196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:18.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.224+0000 7faa61600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa5c101a60 0x7faa5c196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53508/0 (socket says 172.21.15.78:53508) 2024-09-18T12:46:18.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.224+0000 7faa61600640 1 -- 172.21.15.78:0/3536144350 learned_addr learned my addr 172.21.15.78:0/3536144350 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:18.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.224+0000 7faa61e01640 1 --2- 172.21.15.78:0/3536144350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c100860 0x7faa5c1963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:18.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.224+0000 7faa61600640 1 -- 172.21.15.78:0/3536144350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c100860 msgr2=0x7faa5c1963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:18.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.224+0000 7faa61600640 1 --2- 172.21.15.78:0/3536144350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c100860 0x7faa5c1963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:18.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.224+0000 7faa61600640 1 -- 172.21.15.78:0/3536144350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5c196f90 con 0x7faa5c101a60 2024-09-18T12:46:18.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.225+0000 7faa61600640 1 --2- 172.21.15.78:0/3536144350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa5c101a60 0x7faa5c196910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00d6f0 tx=0x7faa4c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:18.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.225+0000 7faa52ffd640 1 -- 172.21.15.78:0/3536144350 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa4c017070 con 0x7faa5c101a60 2024-09-18T12:46:18.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.225+0000 7faa64065640 1 -- 172.21.15.78:0/3536144350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa5c19b9d0 con 0x7faa5c101a60 2024-09-18T12:46:18.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.225+0000 7faa52ffd640 1 -- 172.21.15.78:0/3536144350 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa4c00de00 con 0x7faa5c101a60 2024-09-18T12:46:18.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.225+0000 7faa52ffd640 1 -- 172.21.15.78:0/3536144350 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa4c004bb0 con 0x7faa5c101a60 2024-09-18T12:46:18.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.225+0000 7faa64065640 1 -- 172.21.15.78:0/3536144350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa5c19bf60 con 0x7faa5c101a60 2024-09-18T12:46:18.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.226+0000 7faa64065640 1 -- 172.21.15.78:0/3536144350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa5c100c60 con 0x7faa5c101a60 2024-09-18T12:46:18.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.226+0000 7faa52ffd640 1 -- 172.21.15.78:0/3536144350 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7faa4c004e60 con 0x7faa5c101a60 2024-09-18T12:46:18.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.227+0000 7faa52ffd640 1 --2- 172.21.15.78:0/3536144350 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7faa4806e2b0 0x7faa48070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:18.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.227+0000 7faa52ffd640 1 -- 172.21.15.78:0/3536144350 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7faa4c08da90 con 0x7faa5c101a60 2024-09-18T12:46:18.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.227+0000 7faa61e01640 1 --2- 172.21.15.78:0/3536144350 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7faa4806e2b0 0x7faa48070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:18.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.227+0000 7faa61e01640 1 --2- 172.21.15.78:0/3536144350 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7faa4806e2b0 0x7faa48070770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faa58000c00 tx=0x7faa58005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:18.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.231+0000 7faa52ffd640 1 -- 172.21.15.78:0/3536144350 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa4c05b730 con 0x7faa5c101a60 2024-09-18T12:46:18.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.405+0000 7faa64065640 1 -- 172.21.15.78:0/3536144350 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7faa5c062630 con 0x7faa4806e2b0 2024-09-18T12:46:18.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.413+0000 7faa52ffd640 1 -- 172.21.15.78:0/3536144350 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3120 (secure 0 0 0) 0x7faa5c062630 con 0x7faa4806e2b0 2024-09-18T12:46:18.414 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:46:18.414 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (3m) 119s ago 5m 27.7M - 0.25.0 c8568f914cd2 47a8b8bee5f5 2024-09-18T12:46:18.414 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (5m) 119s ago 5m 7738k - 19.1.1-330-gc2ddf972 ebb0615149de b314296d0168 2024-09-18T12:46:18.415 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (4m) 42s ago 4m 5272k - 19.1.1-330-gc2ddf972 ebb0615149de dad72664a205 2024-09-18T12:46:18.415 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (5m) 119s ago 5m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de bb77146b81c7 2024-09-18T12:46:18.415 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (4m) 42s ago 4m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de f82fdd264dc6 2024-09-18T12:46:18.415 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (3m) 119s ago 4m 76.0M - 9.4.12 2bacad6d85d8 0367cad8b635 2024-09-18T12:46:18.415 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:9283,8765,8443 running (6m) 119s ago 6m 490M - 19.1.1-330-gc2ddf972 ebb0615149de 284f2d8afd38 2024-09-18T12:46:18.415 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (4m) 42s ago 4m 440M - 19.1.1-330-gc2ddf972 ebb0615149de 2db5ffc08c95 2024-09-18T12:46:18.415 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (6m) 119s ago 6m 45.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1cb11a5bcd72 2024-09-18T12:46:18.415 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (4m) 42s ago 4m 40.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 02dfe1551226 2024-09-18T12:46:18.415 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (5m) 119s ago 5m 16.3M - 1.5.0 0da6a335fe13 3c6ba926bb86 2024-09-18T12:46:18.415 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (4m) 42s ago 4m 17.1M - 1.5.0 0da6a335fe13 4b7db3027dc5 2024-09-18T12:46:18.415 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (3m) 119s ago 3m 39.8M 3946M 19.1.1-330-gc2ddf972 ebb0615149de f634ad9ddb36 2024-09-18T12:46:18.416 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (2m) 119s ago 2m 46.0M 3946M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:46:18.416 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (2m) 119s ago 2m 12.1M 3946M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:46:18.416 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (101s) 42s ago 101s 47.6M 4970M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:46:18.416 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (74s) 42s ago 74s 36.2M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:46:18.416 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (47s) 42s ago 47s 11.6M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:46:18.416 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (3m) 119s ago 4m 40.6M - 2.43.0 a07b618ecd1d d012486d55b1 2024-09-18T12:46:18.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.415+0000 7faa64065640 1 -- 172.21.15.78:0/3536144350 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7faa4806e2b0 msgr2=0x7faa48070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:18.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.415+0000 7faa64065640 1 --2- 172.21.15.78:0/3536144350 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7faa4806e2b0 0x7faa48070770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faa58000c00 tx=0x7faa58005a20 comp rx=0 tx=0).stop 2024-09-18T12:46:18.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.415+0000 7faa64065640 1 -- 172.21.15.78:0/3536144350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa5c101a60 msgr2=0x7faa5c196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:18.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.415+0000 7faa64065640 1 --2- 172.21.15.78:0/3536144350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa5c101a60 0x7faa5c196910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00d6f0 tx=0x7faa4c00dbb0 comp rx=0 tx=0).stop 2024-09-18T12:46:18.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.416+0000 7faa64065640 1 -- 172.21.15.78:0/3536144350 shutdown_connections 2024-09-18T12:46:18.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.416+0000 7faa64065640 1 --2- 172.21.15.78:0/3536144350 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7faa4806e2b0 0x7faa48070770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:18.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.416+0000 7faa64065640 1 --2- 172.21.15.78:0/3536144350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa5c101a60 0x7faa5c196910 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:18.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.416+0000 7faa64065640 1 --2- 172.21.15.78:0/3536144350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c100860 0x7faa5c1963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:18.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.416+0000 7faa64065640 1 -- 172.21.15.78:0/3536144350 >> 172.21.15.78:0/3536144350 conn(0x7faa5c0fc010 msgr2=0x7faa5c104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:18.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.416+0000 7faa64065640 1 -- 172.21.15.78:0/3536144350 shutdown_connections 2024-09-18T12:46:18.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:18.416+0000 7faa64065640 1 -- 172.21.15.78:0/3536144350 wait complete. 2024-09-18T12:46:18.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:18 smithi078 ceph-mon[28091]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:18 smithi148 ceph-mon[35352]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:19.039 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-18T12:46:19.282 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:19.652 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:19 smithi078 ceph-mon[28091]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:19.652 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:19 smithi078 ceph-mon[28091]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:19.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:19 smithi148 ceph-mon[35352]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:19.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:19 smithi148 ceph-mon[35352]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:19.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.730+0000 7fa3aa02a640 1 -- 172.21.15.78:0/3073193680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3a4101a60 msgr2=0x7fa3a4101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:19.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.730+0000 7fa3aa02a640 1 --2- 172.21.15.78:0/3073193680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3a4101a60 0x7fa3a4101ee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009880 tx=0x7fa38c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:19.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.730+0000 7fa3aa02a640 1 -- 172.21.15.78:0/3073193680 shutdown_connections 2024-09-18T12:46:19.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.730+0000 7fa3aa02a640 1 --2- 172.21.15.78:0/3073193680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3a4101a60 0x7fa3a4101ee0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:19.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.730+0000 7fa3aa02a640 1 --2- 172.21.15.78:0/3073193680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a4100860 0x7fa3a4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:19.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.730+0000 7fa3aa02a640 1 -- 172.21.15.78:0/3073193680 >> 172.21.15.78:0/3073193680 conn(0x7fa3a40fc010 msgr2=0x7fa3a40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:19.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.730+0000 7fa3aa02a640 1 -- 172.21.15.78:0/3073193680 shutdown_connections 2024-09-18T12:46:19.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.730+0000 7fa3aa02a640 1 -- 172.21.15.78:0/3073193680 wait complete. 2024-09-18T12:46:19.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.731+0000 7fa3aa02a640 1 Processor -- start 2024-09-18T12:46:19.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.731+0000 7fa3aa02a640 1 -- start start 2024-09-18T12:46:19.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.731+0000 7fa3aa02a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a4100860 0x7fa3a4104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:19.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.731+0000 7fa3aa02a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3a4101a60 0x7fa3a4102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:19.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.731+0000 7fa3aa02a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a41096a0 con 0x7fa3a4101a60 2024-09-18T12:46:19.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.731+0000 7fa3aa02a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a4109520 con 0x7fa3a4100860 2024-09-18T12:46:19.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.731+0000 7fa39bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3a4101a60 0x7fa3a4102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:19.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.731+0000 7fa39bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3a4101a60 0x7fa3a4102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53534/0 (socket says 172.21.15.78:53534) 2024-09-18T12:46:19.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.731+0000 7fa39bfff640 1 -- 172.21.15.78:0/1405430743 learned_addr learned my addr 172.21.15.78:0/1405430743 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:19.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.731+0000 7fa3a37fe640 1 --2- 172.21.15.78:0/1405430743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a4100860 0x7fa3a4104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:19.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.732+0000 7fa39bfff640 1 -- 172.21.15.78:0/1405430743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a4100860 msgr2=0x7fa3a4104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:19.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.732+0000 7fa39bfff640 1 --2- 172.21.15.78:0/1405430743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a4100860 0x7fa3a4104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:19.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.732+0000 7fa39bfff640 1 -- 172.21.15.78:0/1405430743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a4103380 con 0x7fa3a4101a60 2024-09-18T12:46:19.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.732+0000 7fa39bfff640 1 --2- 172.21.15.78:0/1405430743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3a4101a60 0x7fa3a4102e40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa38c006010 tx=0x7fa38c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:19.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.732+0000 7fa3a17fa640 1 -- 172.21.15.78:0/1405430743 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa38c03f070 con 0x7fa3a4101a60 2024-09-18T12:46:19.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.732+0000 7fa3a17fa640 1 -- 172.21.15.78:0/1405430743 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa38c0044d0 con 0x7fa3a4101a60 2024-09-18T12:46:19.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.732+0000 7fa3aa02a640 1 -- 172.21.15.78:0/1405430743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a4103610 con 0x7fa3a4101a60 2024-09-18T12:46:19.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.732+0000 7fa3a17fa640 1 -- 172.21.15.78:0/1405430743 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa38c035030 con 0x7fa3a4101a60 2024-09-18T12:46:19.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.732+0000 7fa3aa02a640 1 -- 172.21.15.78:0/1405430743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a4103b40 con 0x7fa3a4101a60 2024-09-18T12:46:19.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.733+0000 7fa3aa02a640 1 -- 172.21.15.78:0/1405430743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a4100c60 con 0x7fa3a4101a60 2024-09-18T12:46:19.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.733+0000 7fa3a17fa640 1 -- 172.21.15.78:0/1405430743 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa38c042070 con 0x7fa3a4101a60 2024-09-18T12:46:19.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.734+0000 7fa3a17fa640 1 --2- 172.21.15.78:0/1405430743 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa39006e2b0 0x7fa390070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:19.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.734+0000 7fa3a37fe640 1 --2- 172.21.15.78:0/1405430743 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa39006e2b0 0x7fa390070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:19.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.734+0000 7fa3a17fa640 1 -- 172.21.15.78:0/1405430743 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fa38c0aeb80 con 0x7fa3a4101a60 2024-09-18T12:46:19.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.734+0000 7fa3a37fe640 1 --2- 172.21.15.78:0/1405430743 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa39006e2b0 0x7fa390070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa3940058c0 tx=0x7fa394005c80 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:19.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.738+0000 7fa3a17fa640 1 -- 172.21.15.78:0/1405430743 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa38c07c820 con 0x7fa3a4101a60 2024-09-18T12:46:19.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.913+0000 7fa3aa02a640 1 -- 172.21.15.78:0/1405430743 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fa3a406a8f0 con 0x7fa39006e2b0 2024-09-18T12:46:19.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.917+0000 7fa3a17fa640 1 -- 172.21.15.78:0/1405430743 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1300 (secure 0 0 0) 0x7fa3a406a8f0 con 0x7fa39006e2b0 2024-09-18T12:46:19.918 INFO:teuthology.orchestra.run.smithi078.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-18T12:46:19.919 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-18T12:46:19.919 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter 2/2 2m ago 5m * 2024-09-18T12:46:19.919 INFO:teuthology.orchestra.run.smithi078.stdout:crash 2/2 2m ago 5m * 2024-09-18T12:46:19.919 INFO:teuthology.orchestra.run.smithi078.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-18T12:46:19.919 INFO:teuthology.orchestra.run.smithi078.stdout:mgr 2/2 2m ago 5m count:2 2024-09-18T12:46:19.919 INFO:teuthology.orchestra.run.smithi078.stdout:mon 2/2 2m ago 5m smithi078:172.21.15.78=smithi078;smithi148:172.21.15.148=smithi148;count:2 2024-09-18T12:46:19.919 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-18T12:46:19.919 INFO:teuthology.orchestra.run.smithi078.stdout:osd 6 2m ago - 2024-09-18T12:46:19.919 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-18T12:46:19.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.919+0000 7fa3aa02a640 1 -- 172.21.15.78:0/1405430743 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa39006e2b0 msgr2=0x7fa390070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:19.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.919+0000 7fa3aa02a640 1 --2- 172.21.15.78:0/1405430743 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa39006e2b0 0x7fa390070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa3940058c0 tx=0x7fa394005c80 comp rx=0 tx=0).stop 2024-09-18T12:46:19.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.919+0000 7fa3aa02a640 1 -- 172.21.15.78:0/1405430743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3a4101a60 msgr2=0x7fa3a4102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:19.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.919+0000 7fa3aa02a640 1 --2- 172.21.15.78:0/1405430743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3a4101a60 0x7fa3a4102e40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa38c006010 tx=0x7fa38c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:46:19.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.919+0000 7fa3aa02a640 1 -- 172.21.15.78:0/1405430743 shutdown_connections 2024-09-18T12:46:19.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.919+0000 7fa3aa02a640 1 --2- 172.21.15.78:0/1405430743 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa39006e2b0 0x7fa390070770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:19.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.919+0000 7fa3aa02a640 1 --2- 172.21.15.78:0/1405430743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3a4101a60 0x7fa3a4102e40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:19.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.919+0000 7fa3aa02a640 1 --2- 172.21.15.78:0/1405430743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a4100860 0x7fa3a4104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:19.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.919+0000 7fa3aa02a640 1 -- 172.21.15.78:0/1405430743 >> 172.21.15.78:0/1405430743 conn(0x7fa3a40fc010 msgr2=0x7fa3a406a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:19.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.920+0000 7fa3aa02a640 1 -- 172.21.15.78:0/1405430743 shutdown_connections 2024-09-18T12:46:19.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:19.920+0000 7fa3aa02a640 1 -- 172.21.15.78:0/1405430743 wait complete. 2024-09-18T12:46:20.618 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-18T12:46:20.869 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:20.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:20 smithi148 ceph-mon[35352]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:20.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:20 smithi148 ceph-mon[35352]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:20.990 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:20 smithi078 ceph-mon[28091]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:20.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:20 smithi078 ceph-mon[28091]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.321+0000 7f8b612a2640 1 -- 172.21.15.78:0/737516124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5c104d20 msgr2=0x7f8b5c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.321+0000 7f8b612a2640 1 --2- 172.21.15.78:0/737516124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5c104d20 0x7f8b5c107110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8b500098b0 tx=0x7f8b5002a4d0 comp rx=0 tx=0).stop 2024-09-18T12:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.321+0000 7f8b612a2640 1 -- 172.21.15.78:0/737516124 shutdown_connections 2024-09-18T12:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.321+0000 7f8b612a2640 1 --2- 172.21.15.78:0/737516124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5c104d20 0x7f8b5c107110 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.321+0000 7f8b612a2640 1 --2- 172.21.15.78:0/737516124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b5c1023f0 0x7f8b5c1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.321+0000 7f8b612a2640 1 -- 172.21.15.78:0/737516124 >> 172.21.15.78:0/737516124 conn(0x7f8b5c0fc010 msgr2=0x7f8b5c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.321+0000 7f8b612a2640 1 -- 172.21.15.78:0/737516124 shutdown_connections 2024-09-18T12:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.321+0000 7f8b612a2640 1 -- 172.21.15.78:0/737516124 wait complete. 2024-09-18T12:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.322+0000 7f8b612a2640 1 Processor -- start 2024-09-18T12:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.322+0000 7f8b612a2640 1 -- start start 2024-09-18T12:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.322+0000 7f8b612a2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b5c1023f0 0x7f8b5c101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.322+0000 7f8b612a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5c104d20 0x7f8b5c1003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.322+0000 7f8b612a2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c10a810 con 0x7f8b5c104d20 2024-09-18T12:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.322+0000 7f8b612a2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c10a690 con 0x7f8b5c1023f0 2024-09-18T12:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.322+0000 7f8b5a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5c104d20 0x7f8b5c1003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.322+0000 7f8b5a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5c104d20 0x7f8b5c1003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41770/0 (socket says 172.21.15.78:41770) 2024-09-18T12:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.322+0000 7f8b5a7fc640 1 -- 172.21.15.78:0/290996283 learned_addr learned my addr 172.21.15.78:0/290996283 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.322+0000 7f8b5affd640 1 --2- 172.21.15.78:0/290996283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b5c1023f0 0x7f8b5c101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.323+0000 7f8b5a7fc640 1 -- 172.21.15.78:0/290996283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b5c1023f0 msgr2=0x7f8b5c101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.323+0000 7f8b5a7fc640 1 --2- 172.21.15.78:0/290996283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b5c1023f0 0x7f8b5c101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.323+0000 7f8b5a7fc640 1 -- 172.21.15.78:0/290996283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c1008e0 con 0x7f8b5c104d20 2024-09-18T12:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.323+0000 7f8b5a7fc640 1 --2- 172.21.15.78:0/290996283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5c104d20 0x7f8b5c1003a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009230 tx=0x7f8b500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.323+0000 7f8b43fff640 1 -- 172.21.15.78:0/290996283 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8b5003f070 con 0x7f8b5c104d20 2024-09-18T12:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.323+0000 7f8b43fff640 1 -- 172.21.15.78:0/290996283 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8b500044d0 con 0x7f8b5c104d20 2024-09-18T12:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.323+0000 7f8b612a2640 1 -- 172.21.15.78:0/290996283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5c100b70 con 0x7f8b5c104d20 2024-09-18T12:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.323+0000 7f8b43fff640 1 -- 172.21.15.78:0/290996283 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8b50035030 con 0x7f8b5c104d20 2024-09-18T12:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.323+0000 7f8b612a2640 1 -- 172.21.15.78:0/290996283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5c101120 con 0x7f8b5c104d20 2024-09-18T12:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.324+0000 7f8b612a2640 1 -- 172.21.15.78:0/290996283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b5c1027d0 con 0x7f8b5c104d20 2024-09-18T12:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.324+0000 7f8b43fff640 1 -- 172.21.15.78:0/290996283 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8b50042070 con 0x7f8b5c104d20 2024-09-18T12:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.325+0000 7f8b43fff640 1 --2- 172.21.15.78:0/290996283 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8b4406e2b0 0x7f8b44070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.325+0000 7f8b43fff640 1 -- 172.21.15.78:0/290996283 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f8b500ae9d0 con 0x7f8b5c104d20 2024-09-18T12:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.325+0000 7f8b5affd640 1 --2- 172.21.15.78:0/290996283 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8b4406e2b0 0x7f8b44070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.325+0000 7f8b5affd640 1 --2- 172.21.15.78:0/290996283 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8b4406e2b0 0x7f8b44070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c009990 tx=0x7f8b4c009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.329+0000 7f8b43fff640 1 -- 172.21.15.78:0/290996283 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b5007c670 con 0x7f8b5c104d20 2024-09-18T12:46:21.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.501+0000 7f8b612a2640 1 -- 172.21.15.78:0/290996283 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f8b5c105760 con 0x7f8b4406e2b0 2024-09-18T12:46:21.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.503+0000 7f8b43fff640 1 -- 172.21.15.78:0/290996283 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+148 (secure 0 0 0) 0x7f8b5c105760 con 0x7f8b4406e2b0 2024-09-18T12:46:21.504 INFO:teuthology.orchestra.run.smithi078.stdout:HOST ADDR LABELS STATUS 2024-09-18T12:46:21.504 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078 172.21.15.78 2024-09-18T12:46:21.504 INFO:teuthology.orchestra.run.smithi078.stdout:smithi148 172.21.15.148 2024-09-18T12:46:21.504 INFO:teuthology.orchestra.run.smithi078.stdout:2 hosts in cluster 2024-09-18T12:46:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.505+0000 7f8b612a2640 1 -- 172.21.15.78:0/290996283 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8b4406e2b0 msgr2=0x7f8b44070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.505+0000 7f8b612a2640 1 --2- 172.21.15.78:0/290996283 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8b4406e2b0 0x7f8b44070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c009990 tx=0x7f8b4c009110 comp rx=0 tx=0).stop 2024-09-18T12:46:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.505+0000 7f8b612a2640 1 -- 172.21.15.78:0/290996283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5c104d20 msgr2=0x7f8b5c1003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.505+0000 7f8b612a2640 1 --2- 172.21.15.78:0/290996283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5c104d20 0x7f8b5c1003a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009230 tx=0x7f8b500048f0 comp rx=0 tx=0).stop 2024-09-18T12:46:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.505+0000 7f8b612a2640 1 -- 172.21.15.78:0/290996283 shutdown_connections 2024-09-18T12:46:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.505+0000 7f8b612a2640 1 --2- 172.21.15.78:0/290996283 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8b4406e2b0 0x7f8b44070770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.505+0000 7f8b612a2640 1 --2- 172.21.15.78:0/290996283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5c104d20 0x7f8b5c1003a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.505+0000 7f8b612a2640 1 --2- 172.21.15.78:0/290996283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b5c1023f0 0x7f8b5c101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.505+0000 7f8b612a2640 1 -- 172.21.15.78:0/290996283 >> 172.21.15.78:0/290996283 conn(0x7f8b5c0fc010 msgr2=0x7f8b5c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.505+0000 7f8b612a2640 1 -- 172.21.15.78:0/290996283 shutdown_connections 2024-09-18T12:46:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:21.505+0000 7f8b612a2640 1 -- 172.21.15.78:0/290996283 wait complete. 2024-09-18T12:46:21.805 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:21 smithi078 ceph-mon[28091]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:21.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:21 smithi148 ceph-mon[35352]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:22.235 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-18T12:46:22.480 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:22.926 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:22 smithi078 ceph-mon[28091]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.925+0000 7f5df77ab640 1 -- 172.21.15.78:0/194531168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5df01023f0 msgr2=0x7f5df01047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.925+0000 7f5df77ab640 1 --2- 172.21.15.78:0/194531168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5df01023f0 0x7f5df01047e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0098b0 tx=0x7f5dec02a4d0 comp rx=0 tx=0).stop 2024-09-18T12:46:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.925+0000 7f5df77ab640 1 -- 172.21.15.78:0/194531168 shutdown_connections 2024-09-18T12:46:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.925+0000 7f5df77ab640 1 --2- 172.21.15.78:0/194531168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5df0104d20 0x7f5df0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.925+0000 7f5df77ab640 1 --2- 172.21.15.78:0/194531168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5df01023f0 0x7f5df01047e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.925+0000 7f5df77ab640 1 -- 172.21.15.78:0/194531168 >> 172.21.15.78:0/194531168 conn(0x7f5df00fc010 msgr2=0x7f5df00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.925+0000 7f5df77ab640 1 -- 172.21.15.78:0/194531168 shutdown_connections 2024-09-18T12:46:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.925+0000 7f5df77ab640 1 -- 172.21.15.78:0/194531168 wait complete. 2024-09-18T12:46:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.925+0000 7f5df77ab640 1 Processor -- start 2024-09-18T12:46:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.925+0000 7f5df77ab640 1 -- start start 2024-09-18T12:46:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5df77ab640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5df01023f0 0x7f5df0197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5df77ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5df0104d20 0x7f5df0197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5df77ab640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5df010a830 con 0x7f5df0104d20 2024-09-18T12:46:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5df77ab640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5df010a6b0 con 0x7f5df01023f0 2024-09-18T12:46:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5df4d46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5df0104d20 0x7f5df0197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5df4d46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5df0104d20 0x7f5df0197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41784/0 (socket says 172.21.15.78:41784) 2024-09-18T12:46:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5df4d46640 1 -- 172.21.15.78:0/2877594180 learned_addr learned my addr 172.21.15.78:0/2877594180 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5df5547640 1 --2- 172.21.15.78:0/2877594180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5df01023f0 0x7f5df0197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5df4d46640 1 -- 172.21.15.78:0/2877594180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5df01023f0 msgr2=0x7f5df0197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5df4d46640 1 --2- 172.21.15.78:0/2877594180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5df01023f0 0x7f5df0197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5df4d46640 1 -- 172.21.15.78:0/2877594180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df0198110 con 0x7f5df0104d20 2024-09-18T12:46:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5df5547640 1 --2- 172.21.15.78:0/2877594180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5df01023f0 0x7f5df0197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:46:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5df4d46640 1 --2- 172.21.15.78:0/2877594180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5df0104d20 0x7f5df0197a90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5de000b3d0 tx=0x7f5de000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5de67fc640 1 -- 172.21.15.78:0/2877594180 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5de0015020 con 0x7f5df0104d20 2024-09-18T12:46:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5de67fc640 1 -- 172.21.15.78:0/2877594180 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5de0011af0 con 0x7f5df0104d20 2024-09-18T12:46:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5de67fc640 1 -- 172.21.15.78:0/2877594180 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5de0010d30 con 0x7f5df0104d20 2024-09-18T12:46:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5df77ab640 1 -- 172.21.15.78:0/2877594180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df019cb50 con 0x7f5df0104d20 2024-09-18T12:46:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.926+0000 7f5df77ab640 1 -- 172.21.15.78:0/2877594180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df019d160 con 0x7f5df0104d20 2024-09-18T12:46:22.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.927+0000 7f5df77ab640 1 -- 172.21.15.78:0/2877594180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5df01027d0 con 0x7f5df0104d20 2024-09-18T12:46:22.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.928+0000 7f5de67fc640 1 -- 172.21.15.78:0/2877594180 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5de0018020 con 0x7f5df0104d20 2024-09-18T12:46:22.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.928+0000 7f5de67fc640 1 --2- 172.21.15.78:0/2877594180 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f5ddc06e310 0x7f5ddc0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:22.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.928+0000 7f5de67fc640 1 -- 172.21.15.78:0/2877594180 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f5de008d840 con 0x7f5df0104d20 2024-09-18T12:46:22.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.928+0000 7f5df5547640 1 --2- 172.21.15.78:0/2877594180 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f5ddc06e310 0x7f5ddc0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:22.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.929+0000 7f5df5547640 1 --2- 172.21.15.78:0/2877594180 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f5ddc06e310 0x7f5ddc0707d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0096c0 tx=0x7f5dec009650 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:22.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:22.933+0000 7f5de67fc640 1 -- 172.21.15.78:0/2877594180 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5de001f020 con 0x7f5df0104d20 2024-09-18T12:46:22.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:22 smithi148 ceph-mon[35352]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:23.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:23.104+0000 7f5df77ab640 1 -- 172.21.15.78:0/2877594180 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f5df0105680 con 0x7f5ddc06e310 2024-09-18T12:46:23.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:23.105+0000 7f5de67fc640 1 -- 172.21.15.78:0/2877594180 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+399 (secure 0 0 0) 0x7f5df0105680 con 0x7f5ddc06e310 2024-09-18T12:46:23.107 INFO:teuthology.orchestra.run.smithi078.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-18T12:46:23.107 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400QR400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-18T12:46:23.107 INFO:teuthology.orchestra.run.smithi078.stdout:smithi148 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005G400BGN 372G No 44s ago Has a FileSystem, LVM detected 2024-09-18T12:46:23.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:23.108+0000 7f5df77ab640 1 -- 172.21.15.78:0/2877594180 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f5ddc06e310 msgr2=0x7f5ddc0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:23.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:23.108+0000 7f5df77ab640 1 --2- 172.21.15.78:0/2877594180 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f5ddc06e310 0x7f5ddc0707d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0096c0 tx=0x7f5dec009650 comp rx=0 tx=0).stop 2024-09-18T12:46:23.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:23.108+0000 7f5df77ab640 1 -- 172.21.15.78:0/2877594180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5df0104d20 msgr2=0x7f5df0197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:23.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:23.108+0000 7f5df77ab640 1 --2- 172.21.15.78:0/2877594180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5df0104d20 0x7f5df0197a90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5de000b3d0 tx=0x7f5de000b890 comp rx=0 tx=0).stop 2024-09-18T12:46:23.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:23.108+0000 7f5df77ab640 1 -- 172.21.15.78:0/2877594180 shutdown_connections 2024-09-18T12:46:23.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:23.108+0000 7f5df77ab640 1 --2- 172.21.15.78:0/2877594180 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f5ddc06e310 0x7f5ddc0707d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:23.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:23.108+0000 7f5df77ab640 1 --2- 172.21.15.78:0/2877594180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5df0104d20 0x7f5df0197a90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:23.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:23.108+0000 7f5df77ab640 1 --2- 172.21.15.78:0/2877594180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5df01023f0 0x7f5df0197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:23.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:23.108+0000 7f5df77ab640 1 -- 172.21.15.78:0/2877594180 >> 172.21.15.78:0/2877594180 conn(0x7f5df00fc010 msgr2=0x7f5df00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:23.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:23.108+0000 7f5df77ab640 1 -- 172.21.15.78:0/2877594180 shutdown_connections 2024-09-18T12:46:23.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:23.108+0000 7f5df77ab640 1 -- 172.21.15.78:0/2877594180 wait complete. 2024-09-18T12:46:23.851 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:46:23.861 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-18T12:46:23.861 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-18T12:46:23.883 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:23 smithi078 ceph-mon[28091]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:23.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:23 smithi148 ceph-mon[35352]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:24.107 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:24.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.526+0000 7faddc9af640 1 -- 172.21.15.78:0/1132284569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd8101960 msgr2=0x7fadd8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:24.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.526+0000 7faddc9af640 1 --2- 172.21.15.78:0/1132284569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd8101960 0x7fadd8101d60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009880 tx=0x7fadc802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:24.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.526+0000 7faddc9af640 1 -- 172.21.15.78:0/1132284569 shutdown_connections 2024-09-18T12:46:24.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.526+0000 7faddc9af640 1 --2- 172.21.15.78:0/1132284569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd8102b60 0x7fadd8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:24.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.526+0000 7faddc9af640 1 --2- 172.21.15.78:0/1132284569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd8101960 0x7fadd8101d60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:24.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.526+0000 7faddc9af640 1 -- 172.21.15.78:0/1132284569 >> 172.21.15.78:0/1132284569 conn(0x7fadd80fd0f0 msgr2=0x7fadd80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:24.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.526+0000 7faddc9af640 1 -- 172.21.15.78:0/1132284569 shutdown_connections 2024-09-18T12:46:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.526+0000 7faddc9af640 1 -- 172.21.15.78:0/1132284569 wait complete. 2024-09-18T12:46:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.527+0000 7faddc9af640 1 Processor -- start 2024-09-18T12:46:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.527+0000 7faddc9af640 1 -- start start 2024-09-18T12:46:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.527+0000 7faddc9af640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd8101960 0x7fadd8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.527+0000 7faddc9af640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd8102b60 0x7fadd80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.527+0000 7faddc9af640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fadd810a800 con 0x7fadd8101960 2024-09-18T12:46:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.527+0000 7faddc9af640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fadd810a680 con 0x7fadd8102b60 2024-09-18T12:46:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.527+0000 7fadd659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd8101960 0x7fadd8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.527+0000 7fadd659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd8101960 0x7fadd8075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41814/0 (socket says 172.21.15.78:41814) 2024-09-18T12:46:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.527+0000 7fadd659c640 1 -- 172.21.15.78:0/2810827107 learned_addr learned my addr 172.21.15.78:0/2810827107 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.527+0000 7fadd5d9b640 1 --2- 172.21.15.78:0/2810827107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd8102b60 0x7fadd80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.527+0000 7fadd659c640 1 -- 172.21.15.78:0/2810827107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd8102b60 msgr2=0x7fadd80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.527+0000 7fadd659c640 1 --2- 172.21.15.78:0/2810827107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd8102b60 0x7fadd80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.527+0000 7fadd659c640 1 -- 172.21.15.78:0/2810827107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd8074b20 con 0x7fadd8101960 2024-09-18T12:46:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.527+0000 7fadd5d9b640 1 --2- 172.21.15.78:0/2810827107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd8102b60 0x7fadd80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:46:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.528+0000 7fadd659c640 1 --2- 172.21.15.78:0/2810827107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd8101960 0x7fadd8075f20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fadc8006010 tx=0x7fadc80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.528+0000 7fadc77fe640 1 -- 172.21.15.78:0/2810827107 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fadc803f070 con 0x7fadd8101960 2024-09-18T12:46:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.528+0000 7fadc77fe640 1 -- 172.21.15.78:0/2810827107 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fadc80044d0 con 0x7fadd8101960 2024-09-18T12:46:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.528+0000 7faddc9af640 1 -- 172.21.15.78:0/2810827107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd8074db0 con 0x7fadd8101960 2024-09-18T12:46:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.528+0000 7fadc77fe640 1 -- 172.21.15.78:0/2810827107 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fadc8035030 con 0x7fadd8101960 2024-09-18T12:46:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.528+0000 7faddc9af640 1 -- 172.21.15.78:0/2810827107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd8075360 con 0x7fadd8101960 2024-09-18T12:46:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.529+0000 7faddc9af640 1 -- 172.21.15.78:0/2810827107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd8101d60 con 0x7fadd8101960 2024-09-18T12:46:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.529+0000 7fadc77fe640 1 -- 172.21.15.78:0/2810827107 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fadc8042070 con 0x7fadd8101960 2024-09-18T12:46:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.530+0000 7fadc77fe640 1 --2- 172.21.15.78:0/2810827107 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fadc006e2b0 0x7fadc0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.530+0000 7fadc77fe640 1 -- 172.21.15.78:0/2810827107 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fadc80aeae0 con 0x7fadd8101960 2024-09-18T12:46:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.530+0000 7fadd5d9b640 1 --2- 172.21.15.78:0/2810827107 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fadc006e2b0 0x7fadc0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:24.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.530+0000 7fadd5d9b640 1 --2- 172.21.15.78:0/2810827107 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fadc006e2b0 0x7fadc0070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fadcc006fd0 tx=0x7fadcc008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:24.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.534+0000 7fadc77fe640 1 -- 172.21.15.78:0/2810827107 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fadc807c780 con 0x7fadd8101960 2024-09-18T12:46:24.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:24.727+0000 7faddc9af640 1 -- 172.21.15.78:0/2810827107 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) -- 0x7fadd802c640 con 0x7fadc006e2b0 2024-09-18T12:46:24.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:24 smithi148 ceph-mon[35352]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:24.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:24 smithi078 ceph-mon[28091]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:25.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:25 smithi078 ceph-mon[28091]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:25.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:25 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-18T12:46:26.093 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:25 smithi148 ceph-mon[35352]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:26.093 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:25 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-18T12:46:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:26.762+0000 7fadc77fe640 1 -- 172.21.15.78:0/2810827107 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fadd802c640 con 0x7fadc006e2b0 2024-09-18T12:46:26.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:26.765+0000 7faddc9af640 1 -- 172.21.15.78:0/2810827107 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fadc006e2b0 msgr2=0x7fadc0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:26.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:26.765+0000 7faddc9af640 1 --2- 172.21.15.78:0/2810827107 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fadc006e2b0 0x7fadc0070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fadcc006fd0 tx=0x7fadcc008040 comp rx=0 tx=0).stop 2024-09-18T12:46:26.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:26.765+0000 7faddc9af640 1 -- 172.21.15.78:0/2810827107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd8101960 msgr2=0x7fadd8075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:26.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:26.765+0000 7faddc9af640 1 --2- 172.21.15.78:0/2810827107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd8101960 0x7fadd8075f20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fadc8006010 tx=0x7fadc80048f0 comp rx=0 tx=0).stop 2024-09-18T12:46:26.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:26.765+0000 7faddc9af640 1 -- 172.21.15.78:0/2810827107 shutdown_connections 2024-09-18T12:46:26.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:26.765+0000 7faddc9af640 1 --2- 172.21.15.78:0/2810827107 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fadc006e2b0 0x7fadc0070770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:26.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:26.765+0000 7faddc9af640 1 --2- 172.21.15.78:0/2810827107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd8102b60 0x7fadd80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:26.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:26.765+0000 7faddc9af640 1 --2- 172.21.15.78:0/2810827107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd8101960 0x7fadd8075f20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:26.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:26.765+0000 7faddc9af640 1 -- 172.21.15.78:0/2810827107 >> 172.21.15.78:0/2810827107 conn(0x7fadd80fd0f0 msgr2=0x7fadd8105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:26.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:26.765+0000 7faddc9af640 1 -- 172.21.15.78:0/2810827107 shutdown_connections 2024-09-18T12:46:26.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:26.765+0000 7faddc9af640 1 -- 172.21.15.78:0/2810827107 wait complete. 2024-09-18T12:46:26.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:26 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-18T12:46:26.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:26 smithi078 ceph-mon[28091]: osdmap e40: 6 total, 6 up, 6 in 2024-09-18T12:46:26.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:26 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-18T12:46:26.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:26 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:26.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:26 smithi078 ceph-mon[28091]: pgmap v172: 33 pgs: 10 creating+peering, 22 unknown, 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:26.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:26 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[28087]: 2024-09-18T12:46:26.746+0000 7f604861b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:46:27.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:26 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-18T12:46:27.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:26 smithi148 ceph-mon[35352]: osdmap e40: 6 total, 6 up, 6 in 2024-09-18T12:46:27.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:26 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-18T12:46:27.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:26 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:27.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:26 smithi148 ceph-mon[35352]: pgmap v172: 33 pgs: 10 creating+peering, 22 unknown, 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:27.418 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-18T12:46:27.736 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-18T12:46:27.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-18T12:46:27.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: osdmap e41: 6 total, 6 up, 6 in 2024-09-18T12:46:27.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-18T12:46:27.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:46:27.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-18T12:46:27.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-18T12:46:27.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: osdmap e42: 6 total, 6 up, 6 in 2024-09-18T12:46:27.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: fsmap cephfs:0 2024-09-18T12:46:27.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: Saving service mds.cephfs spec with placement count:4 2024-09-18T12:46:27.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:27.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:27.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:27.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:27.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:27.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi078.eakgoe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:46:27.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi078.eakgoe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:46:27.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:27.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:27 smithi078 ceph-mon[28091]: Deploying daemon mds.cephfs.smithi078.eakgoe on smithi078 2024-09-18T12:46:28.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-18T12:46:28.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-18T12:46:28.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: osdmap e41: 6 total, 6 up, 6 in 2024-09-18T12:46:28.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-18T12:46:28.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:46:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-18T12:46:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-18T12:46:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: osdmap e42: 6 total, 6 up, 6 in 2024-09-18T12:46:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: fsmap cephfs:0 2024-09-18T12:46:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: Saving service mds.cephfs spec with placement count:4 2024-09-18T12:46:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi078.eakgoe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:46:28.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi078.eakgoe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:46:28.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:28.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:27 smithi148 ceph-mon[35352]: Deploying daemon mds.cephfs.smithi078.eakgoe on smithi078 2024-09-18T12:46:28.574 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:29.010 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:28 smithi078 ceph-mon[28091]: osdmap e43: 6 total, 6 up, 6 in 2024-09-18T12:46:29.010 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:28 smithi078 ceph-mon[28091]: pgmap v176: 65 pgs: 15 creating+peering, 33 unknown, 17 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:29.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.172+0000 7f25133dd640 1 -- 172.21.15.78:0/2199827602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f250c074c50 msgr2=0x7f250c0750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:29.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.172+0000 7f25133dd640 1 --2- 172.21.15.78:0/2199827602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f250c074c50 0x7f250c0750b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2500009880 tx=0x7f250002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:29.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.172+0000 7f25133dd640 1 -- 172.21.15.78:0/2199827602 shutdown_connections 2024-09-18T12:46:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.172+0000 7f25133dd640 1 --2- 172.21.15.78:0/2199827602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f250c074c50 0x7f250c0750b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.172+0000 7f25133dd640 1 --2- 172.21.15.78:0/2199827602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f250c076220 0x7f250c074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.172+0000 7f25133dd640 1 -- 172.21.15.78:0/2199827602 >> 172.21.15.78:0/2199827602 conn(0x7f250c0fd110 msgr2=0x7f250c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.172+0000 7f25133dd640 1 -- 172.21.15.78:0/2199827602 shutdown_connections 2024-09-18T12:46:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.172+0000 7f25133dd640 1 -- 172.21.15.78:0/2199827602 wait complete. 2024-09-18T12:46:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.172+0000 7f25133dd640 1 Processor -- start 2024-09-18T12:46:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.172+0000 7f25133dd640 1 -- start start 2024-09-18T12:46:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f25133dd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f250c074c50 0x7f250c199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f25133dd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f250c076220 0x7f250c199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f25133dd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f250c10c9c0 con 0x7f250c074c50 2024-09-18T12:46:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f25133dd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f250c10c840 con 0x7f250c076220 2024-09-18T12:46:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f2511179640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f250c074c50 0x7f250c199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:29.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f2511179640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f250c074c50 0x7f250c199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41828/0 (socket says 172.21.15.78:41828) 2024-09-18T12:46:29.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f2511179640 1 -- 172.21.15.78:0/868147783 learned_addr learned my addr 172.21.15.78:0/868147783 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:29.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f2510978640 1 --2- 172.21.15.78:0/868147783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f250c076220 0x7f250c199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:29.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f2511179640 1 -- 172.21.15.78:0/868147783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f250c076220 msgr2=0x7f250c199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:29.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f2511179640 1 --2- 172.21.15.78:0/868147783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f250c076220 0x7f250c199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:29.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f2511179640 1 -- 172.21.15.78:0/868147783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250c19a2c0 con 0x7f250c074c50 2024-09-18T12:46:29.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f2511179640 1 --2- 172.21.15.78:0/868147783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f250c074c50 0x7f250c199700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00d6c0 tx=0x7f24fc00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:29.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f250a7fc640 1 -- 172.21.15.78:0/868147783 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24fc017070 con 0x7f250c074c50 2024-09-18T12:46:29.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f250a7fc640 1 -- 172.21.15.78:0/868147783 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24fc0054e0 con 0x7f250c074c50 2024-09-18T12:46:29.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f25133dd640 1 -- 172.21.15.78:0/868147783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250c19ed00 con 0x7f250c074c50 2024-09-18T12:46:29.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f250a7fc640 1 -- 172.21.15.78:0/868147783 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24fc004b70 con 0x7f250c074c50 2024-09-18T12:46:29.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.173+0000 7f25133dd640 1 -- 172.21.15.78:0/868147783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f250c19f1d0 con 0x7f250c074c50 2024-09-18T12:46:29.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.174+0000 7f25133dd640 1 -- 172.21.15.78:0/868147783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f250c0750b0 con 0x7f250c074c50 2024-09-18T12:46:29.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.175+0000 7f250a7fc640 1 -- 172.21.15.78:0/868147783 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f24fc009820 con 0x7f250c074c50 2024-09-18T12:46:29.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.175+0000 7f250a7fc640 1 --2- 172.21.15.78:0/868147783 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f24f406e2b0 0x7f24f4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:29.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.175+0000 7f250a7fc640 1 -- 172.21.15.78:0/868147783 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f24fc08dd80 con 0x7f250c074c50 2024-09-18T12:46:29.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.175+0000 7f2510978640 1 --2- 172.21.15.78:0/868147783 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f24f406e2b0 0x7f24f4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:29.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.176+0000 7f2510978640 1 --2- 172.21.15.78:0/868147783 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f24f406e2b0 0x7f24f4070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f250c19abb0 tx=0x7f2500005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:29.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.180+0000 7f250a7fc640 1 -- 172.21.15.78:0/868147783 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24fc05b6e0 con 0x7f250c074c50 2024-09-18T12:46:29.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:28 smithi148 ceph-mon[35352]: osdmap e43: 6 total, 6 up, 6 in 2024-09-18T12:46:29.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:28 smithi148 ceph-mon[35352]: pgmap v176: 65 pgs: 15 creating+peering, 33 unknown, 17 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:29.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.395+0000 7f25133dd640 1 -- 172.21.15.78:0/868147783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f250c062df0 con 0x7f250c074c50 2024-09-18T12:46:29.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.395+0000 7f250a7fc640 1 -- 172.21.15.78:0/868147783 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) ==== 75+0+1272 (secure 0 0 0) 0x7f24fc05f390 con 0x7f250c074c50 2024-09-18T12:46:29.397 INFO:teuthology.orchestra.run.smithi078.stdout:e2 2024-09-18T12:46:29.397 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:46:26:747264+0000 2024-09-18T12:46:29.397 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:46:29.397 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:46:29.397 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T12:46:29.397 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:46:29.398 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:46:29.398 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T12:46:29.398 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 2 2024-09-18T12:46:29.398 INFO:teuthology.orchestra.run.smithi078.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:46:29.398 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:46:29.398 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:46:26.747207+0000 2024-09-18T12:46:29.398 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T12:46:29.398 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T12:46:29.398 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T12:46:29.399 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T12:46:29.399 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T12:46:29.399 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T12:46:29.399 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T12:46:29.399 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T12:46:29.399 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 0 2024-09-18T12:46:29.399 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:46:29.399 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 1 2024-09-18T12:46:29.399 INFO:teuthology.orchestra.run.smithi078.stdout:in 2024-09-18T12:46:29.399 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T12:46:29.399 INFO:teuthology.orchestra.run.smithi078.stdout:failed 2024-09-18T12:46:29.399 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T12:46:29.400 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T12:46:29.400 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T12:46:29.400 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T12:46:29.400 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data disabled 2024-09-18T12:46:29.400 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T12:46:29.400 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T12:46:29.400 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 0 2024-09-18T12:46:29.400 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T12:46:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:46:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:46:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 2 2024-09-18T12:46:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.398+0000 7f25133dd640 1 -- 172.21.15.78:0/868147783 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f24f406e2b0 msgr2=0x7f24f4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.398+0000 7f25133dd640 1 --2- 172.21.15.78:0/868147783 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f24f406e2b0 0x7f24f4070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f250c19abb0 tx=0x7f2500005a20 comp rx=0 tx=0).stop 2024-09-18T12:46:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.398+0000 7f25133dd640 1 -- 172.21.15.78:0/868147783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f250c074c50 msgr2=0x7f250c199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.398+0000 7f25133dd640 1 --2- 172.21.15.78:0/868147783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f250c074c50 0x7f250c199700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00d6c0 tx=0x7f24fc00db80 comp rx=0 tx=0).stop 2024-09-18T12:46:29.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.398+0000 7f25133dd640 1 -- 172.21.15.78:0/868147783 shutdown_connections 2024-09-18T12:46:29.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.398+0000 7f25133dd640 1 --2- 172.21.15.78:0/868147783 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f24f406e2b0 0x7f24f4070770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:29.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.398+0000 7f25133dd640 1 --2- 172.21.15.78:0/868147783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f250c076220 0x7f250c199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:29.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.398+0000 7f25133dd640 1 --2- 172.21.15.78:0/868147783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f250c074c50 0x7f250c199700 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:29.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.398+0000 7f25133dd640 1 -- 172.21.15.78:0/868147783 >> 172.21.15.78:0/868147783 conn(0x7f250c0fd110 msgr2=0x7f250c107a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:29.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.398+0000 7f25133dd640 1 -- 172.21.15.78:0/868147783 shutdown_connections 2024-09-18T12:46:29.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:29.398+0000 7f25133dd640 1 -- 172.21.15.78:0/868147783 wait complete. 2024-09-18T12:46:30.095 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:29 smithi078 ceph-mon[28091]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-18T12:46:30.095 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:29 smithi078 ceph-mon[28091]: osdmap e44: 6 total, 6 up, 6 in 2024-09-18T12:46:30.096 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:29 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/868147783' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:46:30.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:29 smithi148 ceph-mon[35352]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-18T12:46:30.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:29 smithi148 ceph-mon[35352]: osdmap e44: 6 total, 6 up, 6 in 2024-09-18T12:46:30.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:29 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/868147783' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:46:30.378 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:46:30.389 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-18T12:46:30.390 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-18T12:46:30.641 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:31.079 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:31.079 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:31.079 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:31.079 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.fqecmm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:46:31.080 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.fqecmm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:46:31.080 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:31.080 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: Deploying daemon mds.cephfs.smithi148.fqecmm on smithi148 2024-09-18T12:46:31.080 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: pgmap v178: 65 pgs: 15 creating+peering, 12 unknown, 38 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:31.080 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: mds.? [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] up:boot 2024-09-18T12:46:31.080 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: daemon mds.cephfs.smithi078.eakgoe assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-18T12:46:31.080 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T12:46:31.080 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-18T12:46:31.080 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: Cluster is now healthy 2024-09-18T12:46:31.080 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: fsmap cephfs:0 1 up:standby 2024-09-18T12:46:31.081 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi078.eakgoe"}]: dispatch 2024-09-18T12:46:31.081 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: fsmap cephfs:1 {0=cephfs.smithi078.eakgoe=up:creating} 2024-09-18T12:46:31.081 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:30 smithi078 ceph-mon[28091]: daemon mds.cephfs.smithi078.eakgoe is now active in filesystem cephfs as rank 0 2024-09-18T12:46:31.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.084+0000 7f6959f97640 1 -- 172.21.15.78:0/550966598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6954101a80 msgr2=0x7f6954101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:31.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.084+0000 7f6959f97640 1 --2- 172.21.15.78:0/550966598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6954101a80 0x7f6954101f00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6948009880 tx=0x7f694802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:31.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.084+0000 7f6959f97640 1 -- 172.21.15.78:0/550966598 shutdown_connections 2024-09-18T12:46:31.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.084+0000 7f6959f97640 1 --2- 172.21.15.78:0/550966598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6954101a80 0x7f6954101f00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:31.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.084+0000 7f6959f97640 1 --2- 172.21.15.78:0/550966598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6954100880 0x7f6954100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:31.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.084+0000 7f6959f97640 1 -- 172.21.15.78:0/550966598 >> 172.21.15.78:0/550966598 conn(0x7f69540fc010 msgr2=0x7f69540fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.084+0000 7f6959f97640 1 -- 172.21.15.78:0/550966598 shutdown_connections 2024-09-18T12:46:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.084+0000 7f6959f97640 1 -- 172.21.15.78:0/550966598 wait complete. 2024-09-18T12:46:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.084+0000 7f6959f97640 1 Processor -- start 2024-09-18T12:46:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.085+0000 7f6959f97640 1 -- start start 2024-09-18T12:46:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.085+0000 7f6959f97640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6954100880 0x7f69541964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.085+0000 7f6959f97640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6954101a80 0x7f69541969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.085+0000 7f6959f97640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6954109740 con 0x7f6954101a80 2024-09-18T12:46:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.085+0000 7f6959f97640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f69541095c0 con 0x7f6954100880 2024-09-18T12:46:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.085+0000 7f6952ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6954101a80 0x7f69541969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.085+0000 7f6952ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6954101a80 0x7f69541969e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41874/0 (socket says 172.21.15.78:41874) 2024-09-18T12:46:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.085+0000 7f6952ffd640 1 -- 172.21.15.78:0/573076238 learned_addr learned my addr 172.21.15.78:0/573076238 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.085+0000 7f69537fe640 1 --2- 172.21.15.78:0/573076238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6954100880 0x7f69541964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.085+0000 7f6952ffd640 1 -- 172.21.15.78:0/573076238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6954100880 msgr2=0x7f69541964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.085+0000 7f6952ffd640 1 --2- 172.21.15.78:0/573076238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6954100880 0x7f69541964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.085+0000 7f6952ffd640 1 -- 172.21.15.78:0/573076238 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6954197060 con 0x7f6954101a80 2024-09-18T12:46:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.085+0000 7f6952ffd640 1 --2- 172.21.15.78:0/573076238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6954101a80 0x7f69541969e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6948006010 tx=0x7f69480048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.086+0000 7f6950ff9640 1 -- 172.21.15.78:0/573076238 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f694803f070 con 0x7f6954101a80 2024-09-18T12:46:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.086+0000 7f6950ff9640 1 -- 172.21.15.78:0/573076238 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69480044d0 con 0x7f6954101a80 2024-09-18T12:46:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.086+0000 7f6959f97640 1 -- 172.21.15.78:0/573076238 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f695419ba40 con 0x7f6954101a80 2024-09-18T12:46:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.086+0000 7f6950ff9640 1 -- 172.21.15.78:0/573076238 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6948035030 con 0x7f6954101a80 2024-09-18T12:46:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.086+0000 7f6959f97640 1 -- 172.21.15.78:0/573076238 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f695419c050 con 0x7f6954101a80 2024-09-18T12:46:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.087+0000 7f6959f97640 1 -- 172.21.15.78:0/573076238 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6954100c60 con 0x7f6954101a80 2024-09-18T12:46:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.087+0000 7f6950ff9640 1 -- 172.21.15.78:0/573076238 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6948042070 con 0x7f6954101a80 2024-09-18T12:46:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.088+0000 7f6950ff9640 1 --2- 172.21.15.78:0/573076238 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f693c06e310 0x7f693c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.088+0000 7f6950ff9640 1 -- 172.21.15.78:0/573076238 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f69480aef30 con 0x7f6954101a80 2024-09-18T12:46:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.088+0000 7f69537fe640 1 --2- 172.21.15.78:0/573076238 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f693c06e310 0x7f693c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.088+0000 7f69537fe640 1 --2- 172.21.15.78:0/573076238 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f693c06e310 0x7f693c0707d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f69541018e0 tx=0x7f6944008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:31.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.092+0000 7f6950ff9640 1 -- 172.21.15.78:0/573076238 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f694807c910 con 0x7f6954101a80 2024-09-18T12:46:31.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:31.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:31.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:31.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.fqecmm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:46:31.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.fqecmm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:46:31.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:31.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: Deploying daemon mds.cephfs.smithi148.fqecmm on smithi148 2024-09-18T12:46:31.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: pgmap v178: 65 pgs: 15 creating+peering, 12 unknown, 38 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:46:31.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: mds.? [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] up:boot 2024-09-18T12:46:31.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: daemon mds.cephfs.smithi078.eakgoe assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-18T12:46:31.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T12:46:31.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-18T12:46:31.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: Cluster is now healthy 2024-09-18T12:46:31.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: fsmap cephfs:0 1 up:standby 2024-09-18T12:46:31.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi078.eakgoe"}]: dispatch 2024-09-18T12:46:31.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: fsmap cephfs:1 {0=cephfs.smithi078.eakgoe=up:creating} 2024-09-18T12:46:31.225 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:30 smithi148 ceph-mon[35352]: daemon mds.cephfs.smithi078.eakgoe is now active in filesystem cephfs as rank 0 2024-09-18T12:46:31.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.293+0000 7f6959f97640 1 -- 172.21.15.78:0/573076238 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) -- 0x7f6954062df0 con 0x7f6954101a80 2024-09-18T12:46:31.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.761+0000 7f6950ff9640 1 -- 172.21.15.78:0/573076238 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v5) ==== 105+0+0 (secure 0 0 0) 0x7f69480805c0 con 0x7f6954101a80 2024-09-18T12:46:31.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.765+0000 7f6959f97640 1 -- 172.21.15.78:0/573076238 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f693c06e310 msgr2=0x7f693c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:31.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.765+0000 7f6959f97640 1 --2- 172.21.15.78:0/573076238 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f693c06e310 0x7f693c0707d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f69541018e0 tx=0x7f6944008040 comp rx=0 tx=0).stop 2024-09-18T12:46:31.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.765+0000 7f6959f97640 1 -- 172.21.15.78:0/573076238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6954101a80 msgr2=0x7f69541969e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:31.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.765+0000 7f6959f97640 1 --2- 172.21.15.78:0/573076238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6954101a80 0x7f69541969e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6948006010 tx=0x7f69480048f0 comp rx=0 tx=0).stop 2024-09-18T12:46:31.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.765+0000 7f6959f97640 1 -- 172.21.15.78:0/573076238 shutdown_connections 2024-09-18T12:46:31.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.765+0000 7f6959f97640 1 --2- 172.21.15.78:0/573076238 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f693c06e310 0x7f693c0707d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:31.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.765+0000 7f6959f97640 1 --2- 172.21.15.78:0/573076238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6954101a80 0x7f69541969e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:31.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.765+0000 7f6959f97640 1 --2- 172.21.15.78:0/573076238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6954100880 0x7f69541964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:31.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.765+0000 7f6959f97640 1 -- 172.21.15.78:0/573076238 >> 172.21.15.78:0/573076238 conn(0x7f69540fc010 msgr2=0x7f6954104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:31.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.765+0000 7f6959f97640 1 -- 172.21.15.78:0/573076238 shutdown_connections 2024-09-18T12:46:31.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:31.765+0000 7f6959f97640 1 -- 172.21.15.78:0/573076238 wait complete. 2024-09-18T12:46:31.976 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:31 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/573076238' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-18T12:46:31.976 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:31 smithi078 ceph-mon[28091]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-18T12:46:31.976 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:31 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/573076238' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-18T12:46:31.976 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:31 smithi078 ceph-mon[28091]: mds.? [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] up:active 2024-09-18T12:46:31.976 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:31 smithi078 ceph-mon[28091]: fsmap cephfs:1 {0=cephfs.smithi078.eakgoe=up:active} 2024-09-18T12:46:32.317 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:31 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/573076238' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-18T12:46:32.317 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:31 smithi148 ceph-mon[35352]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-18T12:46:32.317 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:31 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/573076238' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-18T12:46:32.317 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:31 smithi148 ceph-mon[35352]: mds.? [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] up:active 2024-09-18T12:46:32.317 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:31 smithi148 ceph-mon[35352]: fsmap cephfs:1 {0=cephfs.smithi078.eakgoe=up:active} 2024-09-18T12:46:32.497 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:46:32.506 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-18T12:46:32.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-18T12:46:32.777 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:33.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:33.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:33.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:33.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi078.furyab", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:46:33.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi078.furyab", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:46:33.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:33.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: Deploying daemon mds.cephfs.smithi078.furyab on smithi078 2024-09-18T12:46:33.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: pgmap v179: 65 pgs: 5 creating+peering, 60 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 2 op/s 2024-09-18T12:46:33.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: mds.? [v2:172.21.15.148:6824/1193522785,v1:172.21.15.148:6825/1193522785] up:boot 2024-09-18T12:46:33.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: daemon mds.cephfs.smithi148.fqecmm assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-18T12:46:33.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-18T12:46:33.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-18T12:46:33.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: fsmap cephfs:1 {0=cephfs.smithi078.eakgoe=up:active} 1 up:standby 2024-09-18T12:46:33.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.fqecmm"}]: dispatch 2024-09-18T12:46:33.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi148.fqecmm=up:creating} 2024-09-18T12:46:33.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:33 smithi148 ceph-mon[35352]: daemon mds.cephfs.smithi148.fqecmm is now active in filesystem cephfs as rank 1 2024-09-18T12:46:33.808 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:33.808 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:33.808 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:33.808 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi078.furyab", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:46:33.808 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi078.furyab", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:46:33.808 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:33.808 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: Deploying daemon mds.cephfs.smithi078.furyab on smithi078 2024-09-18T12:46:33.808 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: pgmap v179: 65 pgs: 5 creating+peering, 60 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 2 op/s 2024-09-18T12:46:33.808 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: mds.? [v2:172.21.15.148:6824/1193522785,v1:172.21.15.148:6825/1193522785] up:boot 2024-09-18T12:46:33.808 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: daemon mds.cephfs.smithi148.fqecmm assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-18T12:46:33.809 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-18T12:46:33.809 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-18T12:46:33.809 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: fsmap cephfs:1 {0=cephfs.smithi078.eakgoe=up:active} 1 up:standby 2024-09-18T12:46:33.809 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.fqecmm"}]: dispatch 2024-09-18T12:46:33.809 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi148.fqecmm=up:creating} 2024-09-18T12:46:33.809 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:33 smithi078 ceph-mon[28091]: daemon mds.cephfs.smithi148.fqecmm is now active in filesystem cephfs as rank 1 2024-09-18T12:46:33.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.890+0000 7ff4d2d52640 1 -- 172.21.15.78:0/450012265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4cc101a60 msgr2=0x7ff4cc101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.890+0000 7ff4d2d52640 1 --2- 172.21.15.78:0/450012265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4cc101a60 0x7ff4cc101ee0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009880 tx=0x7ff4b802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.890+0000 7ff4d2d52640 1 -- 172.21.15.78:0/450012265 shutdown_connections 2024-09-18T12:46:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.890+0000 7ff4d2d52640 1 --2- 172.21.15.78:0/450012265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4cc101a60 0x7ff4cc101ee0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.890+0000 7ff4d2d52640 1 --2- 172.21.15.78:0/450012265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4cc100860 0x7ff4cc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.890+0000 7ff4d2d52640 1 -- 172.21.15.78:0/450012265 >> 172.21.15.78:0/450012265 conn(0x7ff4cc0fc010 msgr2=0x7ff4cc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.890+0000 7ff4d2d52640 1 -- 172.21.15.78:0/450012265 shutdown_connections 2024-09-18T12:46:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.890+0000 7ff4d2d52640 1 -- 172.21.15.78:0/450012265 wait complete. 2024-09-18T12:46:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.891+0000 7ff4d2d52640 1 Processor -- start 2024-09-18T12:46:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.891+0000 7ff4d2d52640 1 -- start start 2024-09-18T12:46:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.891+0000 7ff4d2d52640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4cc100860 0x7ff4cc197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.891+0000 7ff4d2d52640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4cc101a60 0x7ff4cc197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.891+0000 7ff4d2d52640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc1096a0 con 0x7ff4cc100860 2024-09-18T12:46:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.891+0000 7ff4d2d52640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc109520 con 0x7ff4cc101a60 2024-09-18T12:46:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.891+0000 7ff4d0aee640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4cc100860 0x7ff4cc197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.891+0000 7ff4d0aee640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4cc100860 0x7ff4cc197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59874/0 (socket says 172.21.15.78:59874) 2024-09-18T12:46:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.891+0000 7ff4d0aee640 1 -- 172.21.15.78:0/4243064840 learned_addr learned my addr 172.21.15.78:0/4243064840 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.891+0000 7ff4cbfff640 1 --2- 172.21.15.78:0/4243064840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4cc101a60 0x7ff4cc197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:33.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.892+0000 7ff4d0aee640 1 -- 172.21.15.78:0/4243064840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4cc101a60 msgr2=0x7ff4cc197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.892+0000 7ff4d0aee640 1 --2- 172.21.15.78:0/4243064840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4cc101a60 0x7ff4cc197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.892+0000 7ff4d0aee640 1 -- 172.21.15.78:0/4243064840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4cc198100 con 0x7ff4cc100860 2024-09-18T12:46:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.892+0000 7ff4d0aee640 1 --2- 172.21.15.78:0/4243064840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4cc100860 0x7ff4cc197540 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000d8d0 tx=0x7ff4c000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.892+0000 7ff4c9ffb640 1 -- 172.21.15.78:0/4243064840 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4c0017070 con 0x7ff4cc100860 2024-09-18T12:46:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.892+0000 7ff4c9ffb640 1 -- 172.21.15.78:0/4243064840 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4c000be10 con 0x7ff4cc100860 2024-09-18T12:46:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.892+0000 7ff4d2d52640 1 -- 172.21.15.78:0/4243064840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4cc19cb40 con 0x7ff4cc100860 2024-09-18T12:46:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.892+0000 7ff4c9ffb640 1 -- 172.21.15.78:0/4243064840 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4c000f3c0 con 0x7ff4cc100860 2024-09-18T12:46:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.892+0000 7ff4d2d52640 1 -- 172.21.15.78:0/4243064840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4cc19d0a0 con 0x7ff4cc100860 2024-09-18T12:46:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.893+0000 7ff4d2d52640 1 -- 172.21.15.78:0/4243064840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4cc100c60 con 0x7ff4cc100860 2024-09-18T12:46:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.894+0000 7ff4c9ffb640 1 -- 172.21.15.78:0/4243064840 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff4c001a070 con 0x7ff4cc100860 2024-09-18T12:46:33.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.894+0000 7ff4c9ffb640 1 --2- 172.21.15.78:0/4243064840 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7ff4bc06e310 0x7ff4bc0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.894+0000 7ff4c9ffb640 1 -- 172.21.15.78:0/4243064840 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7ff4c008dc60 con 0x7ff4cc100860 2024-09-18T12:46:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.894+0000 7ff4cbfff640 1 --2- 172.21.15.78:0/4243064840 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7ff4bc06e310 0x7ff4bc0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.895+0000 7ff4cbfff640 1 --2- 172.21.15.78:0/4243064840 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7ff4bc06e310 0x7ff4bc0707d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8000c00 tx=0x7ff4b80058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:33.899+0000 7ff4c9ffb640 1 -- 172.21.15.78:0/4243064840 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff4c005f2f0 con 0x7ff4cc100860 2024-09-18T12:46:34.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:34.110+0000 7ff4d2d52640 1 -- 172.21.15.78:0/4243064840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff4cc19d2d0 con 0x7ff4cc100860 2024-09-18T12:46:34.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:34.986+0000 7ff4c9ffb640 1 -- 172.21.15.78:0/4243064840 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7ff4c0063b20 con 0x7ff4cc100860 2024-09-18T12:46:34.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:34.989+0000 7ff4d2d52640 1 -- 172.21.15.78:0/4243064840 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7ff4bc06e310 msgr2=0x7ff4bc0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:34.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:34.989+0000 7ff4d2d52640 1 --2- 172.21.15.78:0/4243064840 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7ff4bc06e310 0x7ff4bc0707d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8000c00 tx=0x7ff4b80058d0 comp rx=0 tx=0).stop 2024-09-18T12:46:34.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:34.990+0000 7ff4d2d52640 1 -- 172.21.15.78:0/4243064840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4cc100860 msgr2=0x7ff4cc197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:34.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:34.990+0000 7ff4d2d52640 1 --2- 172.21.15.78:0/4243064840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4cc100860 0x7ff4cc197540 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000d8d0 tx=0x7ff4c000dd90 comp rx=0 tx=0).stop 2024-09-18T12:46:34.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:34.990+0000 7ff4d2d52640 1 -- 172.21.15.78:0/4243064840 shutdown_connections 2024-09-18T12:46:34.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:34.990+0000 7ff4d2d52640 1 --2- 172.21.15.78:0/4243064840 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7ff4bc06e310 0x7ff4bc0707d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:34.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:34.990+0000 7ff4d2d52640 1 --2- 172.21.15.78:0/4243064840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4cc101a60 0x7ff4cc197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:34.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:34.990+0000 7ff4d2d52640 1 --2- 172.21.15.78:0/4243064840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4cc100860 0x7ff4cc197540 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:34.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:34.990+0000 7ff4d2d52640 1 -- 172.21.15.78:0/4243064840 >> 172.21.15.78:0/4243064840 conn(0x7ff4cc0fc010 msgr2=0x7ff4cc069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:34.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:34.990+0000 7ff4d2d52640 1 -- 172.21.15.78:0/4243064840 shutdown_connections 2024-09-18T12:46:34.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:34.990+0000 7ff4d2d52640 1 -- 172.21.15.78:0/4243064840 wait complete. 2024-09-18T12:46:35.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:34 smithi078 ceph-mon[28091]: mds.? [v2:172.21.15.148:6824/1193522785,v1:172.21.15.148:6825/1193522785] up:active 2024-09-18T12:46:35.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:34 smithi078 ceph-mon[28091]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi148.fqecmm=up:active} 2024-09-18T12:46:35.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:34 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/4243064840' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-18T12:46:35.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:34 smithi078 ceph-mon[28091]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-18T12:46:35.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:34 smithi148 ceph-mon[35352]: mds.? [v2:172.21.15.148:6824/1193522785,v1:172.21.15.148:6825/1193522785] up:active 2024-09-18T12:46:35.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:34 smithi148 ceph-mon[35352]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi148.fqecmm=up:active} 2024-09-18T12:46:35.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:34 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/4243064840' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-18T12:46:35.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:34 smithi148 ceph-mon[35352]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-18T12:46:36.069 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:35 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/4243064840' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-18T12:46:36.069 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:35 smithi078 ceph-mon[28091]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi148.fqecmm=up:active} 2024-09-18T12:46:36.069 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:35 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:36.069 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:35 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:36.070 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:35 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:36.070 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:35 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.tvvouo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:46:36.070 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:35 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.tvvouo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:46:36.070 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:35 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:36.098 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:46:36.108 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-18T12:46:36.108 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-18T12:46:36.345 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:35 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/4243064840' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-18T12:46:36.345 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:35 smithi148 ceph-mon[35352]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi148.fqecmm=up:active} 2024-09-18T12:46:36.345 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:35 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:36.345 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:35 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:36.346 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:35 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:36.346 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:35 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.tvvouo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:46:36.346 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:35 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.tvvouo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:46:36.346 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:35 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:36.357 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:36.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.835+0000 7f25f221c640 1 -- 172.21.15.78:0/1032913133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25ec101a60 msgr2=0x7f25ec101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:36.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.835+0000 7f25f221c640 1 --2- 172.21.15.78:0/1032913133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25ec101a60 0x7f25ec101ee0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009880 tx=0x7f25d402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:36.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.835+0000 7f25f221c640 1 -- 172.21.15.78:0/1032913133 shutdown_connections 2024-09-18T12:46:36.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.835+0000 7f25f221c640 1 --2- 172.21.15.78:0/1032913133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25ec101a60 0x7f25ec101ee0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:36.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.835+0000 7f25f221c640 1 --2- 172.21.15.78:0/1032913133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25ec100860 0x7f25ec100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:36.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.835+0000 7f25f221c640 1 -- 172.21.15.78:0/1032913133 >> 172.21.15.78:0/1032913133 conn(0x7f25ec0fc010 msgr2=0x7f25ec0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:36.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.835+0000 7f25f221c640 1 -- 172.21.15.78:0/1032913133 shutdown_connections 2024-09-18T12:46:36.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.835+0000 7f25f221c640 1 -- 172.21.15.78:0/1032913133 wait complete. 2024-09-18T12:46:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.835+0000 7f25f221c640 1 Processor -- start 2024-09-18T12:46:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.835+0000 7f25f221c640 1 -- start start 2024-09-18T12:46:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25f221c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25ec100860 0x7f25ec197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25f221c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25ec101a60 0x7f25ec197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25f221c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec109720 con 0x7f25ec101a60 2024-09-18T12:46:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25f221c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec1095a0 con 0x7f25ec100860 2024-09-18T12:46:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25e3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25ec101a60 0x7f25ec197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25e3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25ec101a60 0x7f25ec197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59904/0 (socket says 172.21.15.78:59904) 2024-09-18T12:46:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25e3fff640 1 -- 172.21.15.78:0/2991724419 learned_addr learned my addr 172.21.15.78:0/2991724419 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25eb7fe640 1 --2- 172.21.15.78:0/2991724419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25ec100860 0x7f25ec197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25e3fff640 1 -- 172.21.15.78:0/2991724419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25ec100860 msgr2=0x7f25ec197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25e3fff640 1 --2- 172.21.15.78:0/2991724419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25ec100860 0x7f25ec197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25e3fff640 1 -- 172.21.15.78:0/2991724419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ec198120 con 0x7f25ec101a60 2024-09-18T12:46:36.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25e3fff640 1 --2- 172.21.15.78:0/2991724419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25ec101a60 0x7f25ec197aa0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f25d4006010 tx=0x7f25d40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:36.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25e97fa640 1 -- 172.21.15.78:0/2991724419 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25d403f070 con 0x7f25ec101a60 2024-09-18T12:46:36.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25e97fa640 1 -- 172.21.15.78:0/2991724419 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f25d40044d0 con 0x7f25ec101a60 2024-09-18T12:46:36.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25e97fa640 1 -- 172.21.15.78:0/2991724419 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25d4035030 con 0x7f25ec101a60 2024-09-18T12:46:36.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25f221c640 1 -- 172.21.15.78:0/2991724419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25ec19cb00 con 0x7f25ec101a60 2024-09-18T12:46:36.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.836+0000 7f25f221c640 1 -- 172.21.15.78:0/2991724419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25ec19d110 con 0x7f25ec101a60 2024-09-18T12:46:36.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.837+0000 7f25f221c640 1 -- 172.21.15.78:0/2991724419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25ec100c40 con 0x7f25ec101a60 2024-09-18T12:46:36.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.838+0000 7f25e97fa640 1 -- 172.21.15.78:0/2991724419 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f25d4042070 con 0x7f25ec101a60 2024-09-18T12:46:36.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.839+0000 7f25e97fa640 1 --2- 172.21.15.78:0/2991724419 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f25d806e2b0 0x7f25d8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:36.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.839+0000 7f25eb7fe640 1 --2- 172.21.15.78:0/2991724419 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f25d806e2b0 0x7f25d8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:36.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.839+0000 7f25e97fa640 1 -- 172.21.15.78:0/2991724419 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f25d40aeed0 con 0x7f25ec101a60 2024-09-18T12:46:36.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.839+0000 7f25eb7fe640 1 --2- 172.21.15.78:0/2991724419 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f25d806e2b0 0x7f25d8070770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f25ec1018c0 tx=0x7f25dc008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:36.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:36.843+0000 7f25e97fa640 1 -- 172.21.15.78:0/2991724419 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f25d407c7d0 con 0x7f25ec101a60 2024-09-18T12:46:37.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:37.050+0000 7f25f221c640 1 -- 172.21.15.78:0/2991724419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) -- 0x7f25ec19d4a0 con 0x7f25ec101a60 2024-09-18T12:46:37.440 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:36 smithi148 ceph-mon[35352]: Deploying daemon mds.cephfs.smithi148.tvvouo on smithi148 2024-09-18T12:46:37.441 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:36 smithi148 ceph-mon[35352]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-18T12:46:37.441 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:36 smithi148 ceph-mon[35352]: Cluster is now healthy 2024-09-18T12:46:37.441 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:36 smithi148 ceph-mon[35352]: mds.? [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] up:boot 2024-09-18T12:46:37.441 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:36 smithi148 ceph-mon[35352]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi148.fqecmm=up:active} 1 up:standby 2024-09-18T12:46:37.441 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:36 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi078.furyab"}]: dispatch 2024-09-18T12:46:37.441 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:36 smithi148 ceph-mon[35352]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-18T12:46:37.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:36 smithi078 ceph-mon[28091]: Deploying daemon mds.cephfs.smithi148.tvvouo on smithi148 2024-09-18T12:46:37.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:36 smithi078 ceph-mon[28091]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-18T12:46:37.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:36 smithi078 ceph-mon[28091]: Cluster is now healthy 2024-09-18T12:46:37.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:36 smithi078 ceph-mon[28091]: mds.? [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] up:boot 2024-09-18T12:46:37.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:36 smithi078 ceph-mon[28091]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi148.fqecmm=up:active} 1 up:standby 2024-09-18T12:46:37.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:36 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi078.furyab"}]: dispatch 2024-09-18T12:46:37.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:36 smithi078 ceph-mon[28091]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-18T12:46:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:38.001+0000 7f25e97fa640 1 -- 172.21.15.78:0/2991724419 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v11) ==== 168+0+0 (secure 0 0 0) 0x7f25d4080480 con 0x7f25ec101a60 2024-09-18T12:46:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:inline data enabled 2024-09-18T12:46:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:38.003+0000 7f25f221c640 1 -- 172.21.15.78:0/2991724419 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f25d806e2b0 msgr2=0x7f25d8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:38.003+0000 7f25f221c640 1 --2- 172.21.15.78:0/2991724419 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f25d806e2b0 0x7f25d8070770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f25ec1018c0 tx=0x7f25dc008040 comp rx=0 tx=0).stop 2024-09-18T12:46:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:38.003+0000 7f25f221c640 1 -- 172.21.15.78:0/2991724419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25ec101a60 msgr2=0x7f25ec197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:38.003+0000 7f25f221c640 1 --2- 172.21.15.78:0/2991724419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25ec101a60 0x7f25ec197aa0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f25d4006010 tx=0x7f25d40048f0 comp rx=0 tx=0).stop 2024-09-18T12:46:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:38.003+0000 7f25f221c640 1 -- 172.21.15.78:0/2991724419 shutdown_connections 2024-09-18T12:46:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:38.003+0000 7f25f221c640 1 --2- 172.21.15.78:0/2991724419 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f25d806e2b0 0x7f25d8070770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:38.006 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:37 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2991724419' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-18T12:46:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:38.003+0000 7f25f221c640 1 --2- 172.21.15.78:0/2991724419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25ec101a60 0x7f25ec197aa0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:38.003+0000 7f25f221c640 1 --2- 172.21.15.78:0/2991724419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25ec100860 0x7f25ec197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:38.003+0000 7f25f221c640 1 -- 172.21.15.78:0/2991724419 >> 172.21.15.78:0/2991724419 conn(0x7f25ec0fc010 msgr2=0x7f25ec069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:38.004+0000 7f25f221c640 1 -- 172.21.15.78:0/2991724419 shutdown_connections 2024-09-18T12:46:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:38.004+0000 7f25f221c640 1 -- 172.21.15.78:0/2991724419 wait complete. 2024-09-18T12:46:38.113 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:37 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2991724419' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-18T12:46:38.634 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:46:38.644 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-18T12:46:38.644 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-18T12:46:39.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:38 smithi148 ceph-mon[35352]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-18T12:46:39.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:38 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2991724419' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-18T12:46:39.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:38 smithi148 ceph-mon[35352]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi148.fqecmm=up:active} 1 up:standby 2024-09-18T12:46:39.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:38 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:39.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:38 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:39.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:38 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:39.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:38 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:39.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:38 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:39.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:38 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:39.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:38 smithi148 ceph-mon[35352]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-18T12:46:39.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:38 smithi078 ceph-mon[28091]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-18T12:46:39.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:38 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2991724419' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-18T12:46:39.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:38 smithi078 ceph-mon[28091]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi148.fqecmm=up:active} 1 up:standby 2024-09-18T12:46:39.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:38 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:39.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:38 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:39.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:38 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:39.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:38 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:39.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:38 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:39.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:38 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:39.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:38 smithi078 ceph-mon[28091]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-18T12:46:39.537 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.975+0000 7feab1332640 1 -- 172.21.15.78:0/3305168916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaac102c00 msgr2=0x7feaac103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.975+0000 7feab1332640 1 --2- 172.21.15.78:0/3305168916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaac102c00 0x7feaac103080 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fea94009880 tx=0x7fea9402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.975+0000 7feab1332640 1 -- 172.21.15.78:0/3305168916 shutdown_connections 2024-09-18T12:46:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.975+0000 7feab1332640 1 --2- 172.21.15.78:0/3305168916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaac102c00 0x7feaac103080 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.975+0000 7feab1332640 1 --2- 172.21.15.78:0/3305168916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaac0ffc20 0x7feaac100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.975+0000 7feab1332640 1 -- 172.21.15.78:0/3305168916 >> 172.21.15.78:0/3305168916 conn(0x7feaac0fb770 msgr2=0x7feaac0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.975+0000 7feab1332640 1 -- 172.21.15.78:0/3305168916 shutdown_connections 2024-09-18T12:46:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.975+0000 7feab1332640 1 -- 172.21.15.78:0/3305168916 wait complete. 2024-09-18T12:46:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.975+0000 7feab1332640 1 Processor -- start 2024-09-18T12:46:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.976+0000 7feab1332640 1 -- start start 2024-09-18T12:46:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.976+0000 7feab1332640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaac0ffc20 0x7feaac1024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.976+0000 7feab1332640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaac102c00 0x7feaac100bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.976+0000 7feab1332640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feaac10a820 con 0x7feaac102c00 2024-09-18T12:46:39.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.976+0000 7feab1332640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feaac10a6a0 con 0x7feaac0ffc20 2024-09-18T12:46:39.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.976+0000 7feaaa7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaac102c00 0x7feaac100bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:39.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.976+0000 7feaaa7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaac102c00 0x7feaac100bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59920/0 (socket says 172.21.15.78:59920) 2024-09-18T12:46:39.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.976+0000 7feaaa7fc640 1 -- 172.21.15.78:0/224872046 learned_addr learned my addr 172.21.15.78:0/224872046 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:39.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.976+0000 7feaaaffd640 1 --2- 172.21.15.78:0/224872046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaac0ffc20 0x7feaac1024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:39.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.976+0000 7feaaa7fc640 1 -- 172.21.15.78:0/224872046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaac0ffc20 msgr2=0x7feaac1024f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:39.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.976+0000 7feaaa7fc640 1 --2- 172.21.15.78:0/224872046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaac0ffc20 0x7feaac1024f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:39.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.976+0000 7feaaa7fc640 1 -- 172.21.15.78:0/224872046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaac1010f0 con 0x7feaac102c00 2024-09-18T12:46:39.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.976+0000 7feaaaffd640 1 --2- 172.21.15.78:0/224872046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaac0ffc20 0x7feaac1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:46:39.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.977+0000 7feaaa7fc640 1 --2- 172.21.15.78:0/224872046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaac102c00 0x7feaac100bb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fea94006010 tx=0x7fea940048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:39.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.977+0000 7feaa3fff640 1 -- 172.21.15.78:0/224872046 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea9403f070 con 0x7feaac102c00 2024-09-18T12:46:39.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.977+0000 7feaa3fff640 1 -- 172.21.15.78:0/224872046 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea940044d0 con 0x7feaac102c00 2024-09-18T12:46:39.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.977+0000 7feab1332640 1 -- 172.21.15.78:0/224872046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaac101380 con 0x7feaac102c00 2024-09-18T12:46:39.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.977+0000 7feaa3fff640 1 -- 172.21.15.78:0/224872046 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea94035030 con 0x7feaac102c00 2024-09-18T12:46:39.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.977+0000 7feab1332640 1 -- 172.21.15.78:0/224872046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaac101930 con 0x7feaac102c00 2024-09-18T12:46:39.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.978+0000 7feab1332640 1 -- 172.21.15.78:0/224872046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaac100000 con 0x7feaac102c00 2024-09-18T12:46:39.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.978+0000 7feaa3fff640 1 -- 172.21.15.78:0/224872046 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fea94042070 con 0x7feaac102c00 2024-09-18T12:46:39.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.979+0000 7feaa3fff640 1 --2- 172.21.15.78:0/224872046 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fea9806e310 0x7fea980707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:39.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.979+0000 7feaa3fff640 1 -- 172.21.15.78:0/224872046 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fea940aedf0 con 0x7feaac102c00 2024-09-18T12:46:39.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.979+0000 7feaaaffd640 1 --2- 172.21.15.78:0/224872046 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fea9806e310 0x7fea980707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:39.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.979+0000 7feaaaffd640 1 --2- 172.21.15.78:0/224872046 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fea9806e310 0x7fea980707d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feaac069fb0 tx=0x7feaa4009570 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:39.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:39.983+0000 7feaa3fff640 1 -- 172.21.15.78:0/224872046 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea9407c7d0 con 0x7feaac102c00 2024-09-18T12:46:40.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:40.197+0000 7feab1332640 1 -- 172.21.15.78:0/224872046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7feaac062df0 con 0x7feaac102c00 2024-09-18T12:46:40.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:40.197+0000 7feaa3fff640 1 -- 172.21.15.78:0/224872046 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) ==== 76+0+1994 (secure 0 0 0) 0x7fea94080480 con 0x7feaac102c00 2024-09-18T12:46:40.199 INFO:teuthology.orchestra.run.smithi078.stdout:e12 2024-09-18T12:46:40.199 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:46:39:001901+0000 2024-09-18T12:46:40.199 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:46:40.199 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:46:40.199 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T12:46:40.199 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:46:40.199 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:46:40.199 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T12:46:40.199 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 12 2024-09-18T12:46:40.199 INFO:teuthology.orchestra.run.smithi078.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:46:40.199 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:46:40.199 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:46:38.778039+0000 2024-09-18T12:46:40.199 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T12:46:40.200 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T12:46:40.200 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T12:46:40.200 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T12:46:40.200 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T12:46:40.200 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T12:46:40.200 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T12:46:40.200 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T12:46:40.200 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 0 2024-09-18T12:46:40.200 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:46:40.200 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T12:46:40.200 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T12:46:40.201 INFO:teuthology.orchestra.run.smithi078.stdout:up {0=14560,1=24269} 2024-09-18T12:46:40.201 INFO:teuthology.orchestra.run.smithi078.stdout:failed 2024-09-18T12:46:40.201 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T12:46:40.201 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T12:46:40.201 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T12:46:40.201 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T12:46:40.201 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T12:46:40.201 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T12:46:40.201 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T12:46:40.201 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T12:46:40.201 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 14560 members: 14560,24269 2024-09-18T12:46:40.201 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{0:14560} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:46:40.201 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{1:24269} state up:active seq 2 addr [v2:172.21.15.148:6824/1193522785,v1:172.21.15.148:6825/1193522785] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:46:40.202 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:46:40.202 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:46:40.202 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T12:46:40.202 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:46:40.202 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:14574} state up:standby seq 1 addr [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:46:40.202 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:24281} state up:standby seq 1 addr [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:46:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 12 2024-09-18T12:46:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:40.199+0000 7feab1332640 1 -- 172.21.15.78:0/224872046 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fea9806e310 msgr2=0x7fea980707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:40.199+0000 7feab1332640 1 --2- 172.21.15.78:0/224872046 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fea9806e310 0x7fea980707d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feaac069fb0 tx=0x7feaa4009570 comp rx=0 tx=0).stop 2024-09-18T12:46:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:40.199+0000 7feab1332640 1 -- 172.21.15.78:0/224872046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaac102c00 msgr2=0x7feaac100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:40.199+0000 7feab1332640 1 --2- 172.21.15.78:0/224872046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaac102c00 0x7feaac100bb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fea94006010 tx=0x7fea940048f0 comp rx=0 tx=0).stop 2024-09-18T12:46:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:40.199+0000 7feab1332640 1 -- 172.21.15.78:0/224872046 shutdown_connections 2024-09-18T12:46:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:40.199+0000 7feab1332640 1 --2- 172.21.15.78:0/224872046 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fea9806e310 0x7fea980707d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:40.199+0000 7feab1332640 1 --2- 172.21.15.78:0/224872046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaac102c00 0x7feaac100bb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:40.199+0000 7feab1332640 1 --2- 172.21.15.78:0/224872046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaac0ffc20 0x7feaac1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:40.199+0000 7feab1332640 1 -- 172.21.15.78:0/224872046 >> 172.21.15.78:0/224872046 conn(0x7feaac0fb770 msgr2=0x7feaac1060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:40.199+0000 7feab1332640 1 -- 172.21.15.78:0/224872046 shutdown_connections 2024-09-18T12:46:40.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:40.199+0000 7feab1332640 1 -- 172.21.15.78:0/224872046 wait complete. 2024-09-18T12:46:40.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:40 smithi078 ceph-mon[28091]: mds.? [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] up:boot 2024-09-18T12:46:40.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:40 smithi078 ceph-mon[28091]: mds.? [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] up:active 2024-09-18T12:46:40.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:40 smithi078 ceph-mon[28091]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi148.fqecmm=up:active} 2 up:standby 2024-09-18T12:46:40.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:40 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.tvvouo"}]: dispatch 2024-09-18T12:46:40.274 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:40 smithi148 ceph-mon[35352]: mds.? [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] up:boot 2024-09-18T12:46:40.274 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:40 smithi148 ceph-mon[35352]: mds.? [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] up:active 2024-09-18T12:46:40.274 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:40 smithi148 ceph-mon[35352]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi148.fqecmm=up:active} 2 up:standby 2024-09-18T12:46:40.274 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:40 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.tvvouo"}]: dispatch 2024-09-18T12:46:41.304 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:41 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/224872046' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:46:41.304 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:41 smithi078 ceph-mon[28091]: mds.? [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] up:standby 2024-09-18T12:46:41.304 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:41 smithi078 ceph-mon[28091]: Dropping low affinity active daemon mds.cephfs.smithi148.fqecmm in favor of higher affinity standby. 2024-09-18T12:46:41.304 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:41 smithi078 ceph-mon[28091]: Replacing daemon mds.cephfs.smithi148.fqecmm as rank 1 with standby daemon mds.cephfs.smithi078.furyab 2024-09-18T12:46:41.304 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:41 smithi078 ceph-mon[28091]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T12:46:41.304 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:41 smithi078 ceph-mon[28091]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi148.fqecmm=up:active} 2 up:standby 2024-09-18T12:46:41.304 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:41 smithi078 ceph-mon[28091]: osdmap e45: 6 total, 6 up, 6 in 2024-09-18T12:46:41.304 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:41 smithi078 ceph-mon[28091]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:replay} 1 up:standby 2024-09-18T12:46:41.304 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:41.304 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:41.304 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:41.305 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:41 smithi078 ceph-mon[28091]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-18T12:46:41.331 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-18T12:46:41.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:41 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/224872046' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:46:41.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:41 smithi148 ceph-mon[35352]: mds.? [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] up:standby 2024-09-18T12:46:41.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:41 smithi148 ceph-mon[35352]: Dropping low affinity active daemon mds.cephfs.smithi148.fqecmm in favor of higher affinity standby. 2024-09-18T12:46:41.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:41 smithi148 ceph-mon[35352]: Replacing daemon mds.cephfs.smithi148.fqecmm as rank 1 with standby daemon mds.cephfs.smithi078.furyab 2024-09-18T12:46:41.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:41 smithi148 ceph-mon[35352]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T12:46:41.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:41 smithi148 ceph-mon[35352]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi148.fqecmm=up:active} 2 up:standby 2024-09-18T12:46:41.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:41 smithi148 ceph-mon[35352]: osdmap e45: 6 total, 6 up, 6 in 2024-09-18T12:46:41.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:41 smithi148 ceph-mon[35352]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:replay} 1 up:standby 2024-09-18T12:46:41.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:41 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:41.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:41 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:41.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:41 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:41.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:41 smithi148 ceph-mon[35352]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-18T12:46:42.121 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:42.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:42 smithi078 ceph-mon[28091]: mds.? [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] up:resolve 2024-09-18T12:46:42.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:42 smithi078 ceph-mon[28091]: mds.? [v2:172.21.15.148:6824/258027429,v1:172.21.15.148:6825/258027429] up:boot 2024-09-18T12:46:42.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:42 smithi078 ceph-mon[28091]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:resolve} 2 up:standby 2024-09-18T12:46:42.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:42 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.fqecmm"}]: dispatch 2024-09-18T12:46:42.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:42 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:42.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:42 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:42 smithi148 ceph-mon[35352]: mds.? [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] up:resolve 2024-09-18T12:46:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:42 smithi148 ceph-mon[35352]: mds.? [v2:172.21.15.148:6824/258027429,v1:172.21.15.148:6825/258027429] up:boot 2024-09-18T12:46:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:42 smithi148 ceph-mon[35352]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:resolve} 2 up:standby 2024-09-18T12:46:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:42 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.fqecmm"}]: dispatch 2024-09-18T12:46:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:42 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:42 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:43.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.159+0000 7fb6767fa640 1 -- 172.21.15.78:0/758054842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6701023f0 msgr2=0x7fb6701047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:43.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.159+0000 7fb6767fa640 1 --2- 172.21.15.78:0/758054842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6701023f0 0x7fb6701047e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb6600098b0 tx=0x7fb66002a4d0 comp rx=0 tx=0).stop 2024-09-18T12:46:43.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.159+0000 7fb6767fa640 1 -- 172.21.15.78:0/758054842 shutdown_connections 2024-09-18T12:46:43.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.159+0000 7fb6767fa640 1 --2- 172.21.15.78:0/758054842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb670104d20 0x7fb670107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:43.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.159+0000 7fb6767fa640 1 --2- 172.21.15.78:0/758054842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6701023f0 0x7fb6701047e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:43.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.159+0000 7fb6767fa640 1 -- 172.21.15.78:0/758054842 >> 172.21.15.78:0/758054842 conn(0x7fb6700fc010 msgr2=0x7fb6700fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:43.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.159+0000 7fb6767fa640 1 -- 172.21.15.78:0/758054842 shutdown_connections 2024-09-18T12:46:43.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.159+0000 7fb6767fa640 1 -- 172.21.15.78:0/758054842 wait complete. 2024-09-18T12:46:43.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.160+0000 7fb6767fa640 1 Processor -- start 2024-09-18T12:46:43.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.160+0000 7fb6767fa640 1 -- start start 2024-09-18T12:46:43.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.160+0000 7fb6767fa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6701023f0 0x7fb670197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:43.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.160+0000 7fb6767fa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb670104d20 0x7fb670197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:43.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.160+0000 7fb6767fa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb67010a830 con 0x7fb6701023f0 2024-09-18T12:46:43.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.160+0000 7fb6767fa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb67010a6b0 con 0x7fb670104d20 2024-09-18T12:46:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.160+0000 7fb66ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6701023f0 0x7fb670197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.160+0000 7fb66ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6701023f0 0x7fb670197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40392/0 (socket says 172.21.15.78:40392) 2024-09-18T12:46:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.160+0000 7fb66ffff640 1 -- 172.21.15.78:0/4109690904 learned_addr learned my addr 172.21.15.78:0/4109690904 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.161+0000 7fb66ffff640 1 -- 172.21.15.78:0/4109690904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb670104d20 msgr2=0x7fb670197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.161+0000 7fb66ffff640 1 --2- 172.21.15.78:0/4109690904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb670104d20 0x7fb670197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.161+0000 7fb66ffff640 1 -- 172.21.15.78:0/4109690904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb670198110 con 0x7fb6701023f0 2024-09-18T12:46:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.161+0000 7fb66ffff640 1 --2- 172.21.15.78:0/4109690904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6701023f0 0x7fb670197550 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb6600099d0 tx=0x7fb6600048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.161+0000 7fb66d7fa640 1 -- 172.21.15.78:0/4109690904 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb66003f070 con 0x7fb6701023f0 2024-09-18T12:46:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.161+0000 7fb66d7fa640 1 -- 172.21.15.78:0/4109690904 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb660004c70 con 0x7fb6701023f0 2024-09-18T12:46:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.161+0000 7fb6767fa640 1 -- 172.21.15.78:0/4109690904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67019caf0 con 0x7fb6701023f0 2024-09-18T12:46:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.161+0000 7fb66d7fa640 1 -- 172.21.15.78:0/4109690904 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb660035030 con 0x7fb6701023f0 2024-09-18T12:46:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.161+0000 7fb6767fa640 1 -- 172.21.15.78:0/4109690904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb67019d100 con 0x7fb6701023f0 2024-09-18T12:46:43.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.162+0000 7fb6767fa640 1 -- 172.21.15.78:0/4109690904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6701027d0 con 0x7fb6701023f0 2024-09-18T12:46:43.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.163+0000 7fb66d7fa640 1 -- 172.21.15.78:0/4109690904 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fb660042070 con 0x7fb6701023f0 2024-09-18T12:46:43.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.163+0000 7fb66d7fa640 1 --2- 172.21.15.78:0/4109690904 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb65806e2b0 0x7fb658070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:43.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.163+0000 7fb66d7fa640 1 -- 172.21.15.78:0/4109690904 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fb6600aee60 con 0x7fb6701023f0 2024-09-18T12:46:43.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.163+0000 7fb66f7fe640 1 --2- 172.21.15.78:0/4109690904 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb65806e2b0 0x7fb658070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:43.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.163+0000 7fb66f7fe640 1 --2- 172.21.15.78:0/4109690904 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb65806e2b0 0x7fb658070770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb670198a00 tx=0x7fb664006c90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:43.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.167+0000 7fb66d7fa640 1 -- 172.21.15.78:0/4109690904 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb66007c760 con 0x7fb6701023f0 2024-09-18T12:46:43.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.388+0000 7fb6767fa640 1 -- 172.21.15.78:0/4109690904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb67019d3d0 con 0x7fb6701023f0 2024-09-18T12:46:43.390 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:43 smithi078 ceph-mon[28091]: mds.? [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] up:reconnect 2024-09-18T12:46:43.390 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:43 smithi078 ceph-mon[28091]: mds.? [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] up:standby 2024-09-18T12:46:43.390 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:43 smithi078 ceph-mon[28091]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:reconnect} 2 up:standby 2024-09-18T12:46:43.390 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:43 smithi078 ceph-mon[28091]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 409 B/s rd, 2.6 KiB/s wr, 7 op/s 2024-09-18T12:46:43.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.388+0000 7fb66d7fa640 1 -- 172.21.15.78:0/4109690904 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5334 (secure 0 0 0) 0x7fb660080410 con 0x7fb6701023f0 2024-09-18T12:46:43.390 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2024-09-18T12:46:43.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.391+0000 7fb6767fa640 1 -- 172.21.15.78:0/4109690904 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb65806e2b0 msgr2=0x7fb658070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:43.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.391+0000 7fb6767fa640 1 --2- 172.21.15.78:0/4109690904 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb65806e2b0 0x7fb658070770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb670198a00 tx=0x7fb664006c90 comp rx=0 tx=0).stop 2024-09-18T12:46:43.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.391+0000 7fb6767fa640 1 -- 172.21.15.78:0/4109690904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6701023f0 msgr2=0x7fb670197550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:43.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.391+0000 7fb6767fa640 1 --2- 172.21.15.78:0/4109690904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6701023f0 0x7fb670197550 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb6600099d0 tx=0x7fb6600048f0 comp rx=0 tx=0).stop 2024-09-18T12:46:43.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.391+0000 7fb6767fa640 1 -- 172.21.15.78:0/4109690904 shutdown_connections 2024-09-18T12:46:43.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.391+0000 7fb6767fa640 1 --2- 172.21.15.78:0/4109690904 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fb65806e2b0 0x7fb658070770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:43.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.391+0000 7fb6767fa640 1 --2- 172.21.15.78:0/4109690904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb670104d20 0x7fb670197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:43.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.391+0000 7fb6767fa640 1 --2- 172.21.15.78:0/4109690904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6701023f0 0x7fb670197550 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:43.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.391+0000 7fb6767fa640 1 -- 172.21.15.78:0/4109690904 >> 172.21.15.78:0/4109690904 conn(0x7fb6700fc010 msgr2=0x7fb6700fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:43.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.391+0000 7fb6767fa640 1 -- 172.21.15.78:0/4109690904 shutdown_connections 2024-09-18T12:46:43.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:43.392+0000 7fb6767fa640 1 -- 172.21.15.78:0/4109690904 wait complete. 2024-09-18T12:46:43.401 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:46:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:43 smithi148 ceph-mon[35352]: mds.? [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] up:reconnect 2024-09-18T12:46:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:43 smithi148 ceph-mon[35352]: mds.? [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] up:standby 2024-09-18T12:46:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:43 smithi148 ceph-mon[35352]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:reconnect} 2 up:standby 2024-09-18T12:46:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:43 smithi148 ceph-mon[35352]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 409 B/s rd, 2.6 KiB/s wr, 7 op/s 2024-09-18T12:46:44.524 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:44 smithi078 ceph-mon[28091]: mds.? [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] up:rejoin 2024-09-18T12:46:44.524 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:44 smithi078 ceph-mon[28091]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:rejoin} 2 up:standby 2024-09-18T12:46:44.525 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:44 smithi078 ceph-mon[28091]: daemon mds.cephfs.smithi078.furyab is now active in filesystem cephfs as rank 1 2024-09-18T12:46:44.525 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:44 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/4109690904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T12:46:44.525 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:44 smithi078 ceph-mon[28091]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T12:46:44.525 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:44 smithi078 ceph-mon[28091]: mds.? [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] up:active 2024-09-18T12:46:44.525 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:44 smithi078 ceph-mon[28091]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:active} 2 up:standby 2024-09-18T12:46:44.526 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-18T12:46:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:44 smithi148 ceph-mon[35352]: mds.? [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] up:rejoin 2024-09-18T12:46:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:44 smithi148 ceph-mon[35352]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:rejoin} 2 up:standby 2024-09-18T12:46:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:44 smithi148 ceph-mon[35352]: daemon mds.cephfs.smithi078.furyab is now active in filesystem cephfs as rank 1 2024-09-18T12:46:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:44 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/4109690904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T12:46:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:44 smithi148 ceph-mon[35352]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T12:46:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:44 smithi148 ceph-mon[35352]: mds.? [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] up:active 2024-09-18T12:46:44.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:44 smithi148 ceph-mon[35352]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:active} 2 up:standby 2024-09-18T12:46:44.798 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:45.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.260+0000 7f8f357c4640 1 -- 172.21.15.78:0/1461461882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f30102450 msgr2=0x7f8f30104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.260+0000 7f8f357c4640 1 --2- 172.21.15.78:0/1461461882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f30102450 0x7f8f30104840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009880 tx=0x7f8f2002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.260+0000 7f8f357c4640 1 -- 172.21.15.78:0/1461461882 shutdown_connections 2024-09-18T12:46:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.260+0000 7f8f357c4640 1 --2- 172.21.15.78:0/1461461882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f30104d80 0x7f8f30107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.260+0000 7f8f357c4640 1 --2- 172.21.15.78:0/1461461882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f30102450 0x7f8f30104840 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.260+0000 7f8f357c4640 1 -- 172.21.15.78:0/1461461882 >> 172.21.15.78:0/1461461882 conn(0x7f8f300fc010 msgr2=0x7f8f300fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.260+0000 7f8f357c4640 1 -- 172.21.15.78:0/1461461882 shutdown_connections 2024-09-18T12:46:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.260+0000 7f8f357c4640 1 -- 172.21.15.78:0/1461461882 wait complete. 2024-09-18T12:46:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.260+0000 7f8f357c4640 1 Processor -- start 2024-09-18T12:46:45.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.261+0000 7f8f357c4640 1 -- start start 2024-09-18T12:46:45.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.261+0000 7f8f357c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f30102450 0x7f8f30101d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.261+0000 7f8f357c4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f30104d80 0x7f8f30100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.261+0000 7f8f357c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3010a7c0 con 0x7f8f30102450 2024-09-18T12:46:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.261+0000 7f8f357c4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3010a640 con 0x7f8f30104d80 2024-09-18T12:46:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.261+0000 7f8f2effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f30102450 0x7f8f30101d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.261+0000 7f8f2effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f30102450 0x7f8f30101d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40396/0 (socket says 172.21.15.78:40396) 2024-09-18T12:46:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.261+0000 7f8f2effd640 1 -- 172.21.15.78:0/4203814491 learned_addr learned my addr 172.21.15.78:0/4203814491 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.261+0000 7f8f2e7fc640 1 --2- 172.21.15.78:0/4203814491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f30104d80 0x7f8f30100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.261+0000 7f8f2effd640 1 -- 172.21.15.78:0/4203814491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f30104d80 msgr2=0x7f8f30100400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.261+0000 7f8f2effd640 1 --2- 172.21.15.78:0/4203814491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f30104d80 0x7f8f30100400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.261+0000 7f8f2effd640 1 -- 172.21.15.78:0/4203814491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f30100940 con 0x7f8f30102450 2024-09-18T12:46:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.262+0000 7f8f2effd640 1 --2- 172.21.15.78:0/4203814491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f30102450 0x7f8f30101d40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8f20006010 tx=0x7f8f200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.262+0000 7f8f17fff640 1 -- 172.21.15.78:0/4203814491 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f2003f070 con 0x7f8f30102450 2024-09-18T12:46:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.262+0000 7f8f357c4640 1 -- 172.21.15.78:0/4203814491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f30100c30 con 0x7f8f30102450 2024-09-18T12:46:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.262+0000 7f8f17fff640 1 -- 172.21.15.78:0/4203814491 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f200044d0 con 0x7f8f30102450 2024-09-18T12:46:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.262+0000 7f8f17fff640 1 -- 172.21.15.78:0/4203814491 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f20035030 con 0x7f8f30102450 2024-09-18T12:46:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.262+0000 7f8f357c4640 1 -- 172.21.15.78:0/4203814491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f30101240 con 0x7f8f30102450 2024-09-18T12:46:45.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.263+0000 7f8f357c4640 1 -- 172.21.15.78:0/4203814491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f30102830 con 0x7f8f30102450 2024-09-18T12:46:45.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.264+0000 7f8f17fff640 1 -- 172.21.15.78:0/4203814491 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8f20042070 con 0x7f8f30102450 2024-09-18T12:46:45.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.264+0000 7f8f17fff640 1 --2- 172.21.15.78:0/4203814491 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8f1806e2b0 0x7f8f18070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:45.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.264+0000 7f8f17fff640 1 -- 172.21.15.78:0/4203814491 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f8f200aee10 con 0x7f8f30102450 2024-09-18T12:46:45.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.265+0000 7f8f2e7fc640 1 --2- 172.21.15.78:0/4203814491 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8f1806e2b0 0x7f8f18070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:45.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.265+0000 7f8f2e7fc640 1 --2- 172.21.15.78:0/4203814491 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8f1806e2b0 0x7f8f18070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8f30101ac0 tx=0x7f8f24009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.269+0000 7f8f17fff640 1 -- 172.21.15.78:0/4203814491 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8f2007c710 con 0x7f8f30102450 2024-09-18T12:46:45.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:45 smithi078 ceph-mon[28091]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-18T12:46:45.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:45.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:45.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:45.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:45.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:45 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:45.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.518+0000 7f8f357c4640 1 -- 172.21.15.78:0/4203814491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) -- 0x7f8f3019fc40 con 0x7f8f30102450 2024-09-18T12:46:45.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.519+0000 7f8f17fff640 1 -- 172.21.15.78:0/4203814491 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v18) ==== 78+0+98 (secure 0 0 0) 0x7f8f200803c0 con 0x7f8f30102450 2024-09-18T12:46:45.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.521+0000 7f8f357c4640 1 -- 172.21.15.78:0/4203814491 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8f1806e2b0 msgr2=0x7f8f18070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:45.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.521+0000 7f8f357c4640 1 --2- 172.21.15.78:0/4203814491 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8f1806e2b0 0x7f8f18070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8f30101ac0 tx=0x7f8f24009110 comp rx=0 tx=0).stop 2024-09-18T12:46:45.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.521+0000 7f8f357c4640 1 -- 172.21.15.78:0/4203814491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f30102450 msgr2=0x7f8f30101d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:45.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.521+0000 7f8f357c4640 1 --2- 172.21.15.78:0/4203814491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f30102450 0x7f8f30101d40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8f20006010 tx=0x7f8f200048f0 comp rx=0 tx=0).stop 2024-09-18T12:46:45.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.521+0000 7f8f357c4640 1 -- 172.21.15.78:0/4203814491 shutdown_connections 2024-09-18T12:46:45.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.521+0000 7f8f357c4640 1 --2- 172.21.15.78:0/4203814491 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f8f1806e2b0 0x7f8f18070770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:45.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.521+0000 7f8f357c4640 1 --2- 172.21.15.78:0/4203814491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f30104d80 0x7f8f30100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:45.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.521+0000 7f8f357c4640 1 --2- 172.21.15.78:0/4203814491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f30102450 0x7f8f30101d40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:45.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.521+0000 7f8f357c4640 1 -- 172.21.15.78:0/4203814491 >> 172.21.15.78:0/4203814491 conn(0x7f8f300fc010 msgr2=0x7f8f300fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:45.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.521+0000 7f8f357c4640 1 -- 172.21.15.78:0/4203814491 shutdown_connections 2024-09-18T12:46:45.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:45.521+0000 7f8f357c4640 1 -- 172.21.15.78:0/4203814491 wait complete. 2024-09-18T12:46:45.531 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:46:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:45 smithi148 ceph-mon[35352]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-18T12:46:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:45 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:46.191 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-18T12:46:46.206 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-18T12:46:46.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:46 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:46.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:46 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/4203814491' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-18T12:46:46.715 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:46 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:46.715 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:46 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/4203814491' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-18T12:46:47.028 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:47.542 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:47 smithi078 ceph-mon[28091]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 6.5 KiB/s rd, 409 B/s wr, 6 op/s 2024-09-18T12:46:47.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.541+0000 7fda64d7a640 1 -- 172.21.15.78:0/2308381905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda60101960 msgr2=0x7fda60101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:47.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.541+0000 7fda64d7a640 1 --2- 172.21.15.78:0/2308381905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda60101960 0x7fda60101dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fda48009880 tx=0x7fda4802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:47.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.541+0000 7fda64d7a640 1 -- 172.21.15.78:0/2308381905 shutdown_connections 2024-09-18T12:46:47.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.541+0000 7fda64d7a640 1 --2- 172.21.15.78:0/2308381905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda60101960 0x7fda60101dc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:47.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.541+0000 7fda64d7a640 1 --2- 172.21.15.78:0/2308381905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda60107960 0x7fda60107d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:47.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.541+0000 7fda64d7a640 1 -- 172.21.15.78:0/2308381905 >> 172.21.15.78:0/2308381905 conn(0x7fda600fd680 msgr2=0x7fda600ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:47.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.541+0000 7fda64d7a640 1 -- 172.21.15.78:0/2308381905 shutdown_connections 2024-09-18T12:46:47.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.541+0000 7fda64d7a640 1 -- 172.21.15.78:0/2308381905 wait complete. 2024-09-18T12:46:47.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda64d7a640 1 Processor -- start 2024-09-18T12:46:47.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda64d7a640 1 -- start start 2024-09-18T12:46:47.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda64d7a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda60101960 0x7fda6019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:47.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda64d7a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda60107960 0x7fda6019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:47.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda64d7a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fda6010ee30 con 0x7fda60101960 2024-09-18T12:46:47.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda64d7a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fda6010ecb0 con 0x7fda60107960 2024-09-18T12:46:47.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda5e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda60101960 0x7fda6019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:47.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda5e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda60101960 0x7fda6019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40420/0 (socket says 172.21.15.78:40420) 2024-09-18T12:46:47.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda5e59c640 1 -- 172.21.15.78:0/4209817707 learned_addr learned my addr 172.21.15.78:0/4209817707 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:47.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda5dd9b640 1 --2- 172.21.15.78:0/4209817707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda60107960 0x7fda6019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:47.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda5e59c640 1 -- 172.21.15.78:0/4209817707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda60107960 msgr2=0x7fda6019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:47.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda5e59c640 1 --2- 172.21.15.78:0/4209817707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda60107960 0x7fda6019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:47.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda5e59c640 1 -- 172.21.15.78:0/4209817707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda60197800 con 0x7fda60101960 2024-09-18T12:46:47.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda5e59c640 1 --2- 172.21.15.78:0/4209817707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda60101960 0x7fda6019d680 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fda5000ea00 tx=0x7fda5000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:47.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda577fe640 1 -- 172.21.15.78:0/4209817707 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda5000cb80 con 0x7fda60101960 2024-09-18T12:46:47.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda64d7a640 1 -- 172.21.15.78:0/4209817707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda60197af0 con 0x7fda60101960 2024-09-18T12:46:47.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda577fe640 1 -- 172.21.15.78:0/4209817707 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda5000cd20 con 0x7fda60101960 2024-09-18T12:46:47.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.542+0000 7fda577fe640 1 -- 172.21.15.78:0/4209817707 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda50011470 con 0x7fda60101960 2024-09-18T12:46:47.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.543+0000 7fda64d7a640 1 -- 172.21.15.78:0/4209817707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda60198050 con 0x7fda60101960 2024-09-18T12:46:47.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.543+0000 7fda64d7a640 1 -- 172.21.15.78:0/4209817707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda601030a0 con 0x7fda60101960 2024-09-18T12:46:47.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.544+0000 7fda577fe640 1 -- 172.21.15.78:0/4209817707 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fda50011750 con 0x7fda60101960 2024-09-18T12:46:47.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.545+0000 7fda577fe640 1 --2- 172.21.15.78:0/4209817707 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fda4c06e2b0 0x7fda4c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:47.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.545+0000 7fda5dd9b640 1 --2- 172.21.15.78:0/4209817707 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fda4c06e2b0 0x7fda4c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:47.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.545+0000 7fda577fe640 1 -- 172.21.15.78:0/4209817707 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fda5008e5b0 con 0x7fda60101960 2024-09-18T12:46:47.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.545+0000 7fda5dd9b640 1 --2- 172.21.15.78:0/4209817707 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fda4c06e2b0 0x7fda4c070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda60198b50 tx=0x7fda48031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:47.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.550+0000 7fda577fe640 1 -- 172.21.15.78:0/4209817707 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda50016030 con 0x7fda60101960 2024-09-18T12:46:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:47 smithi148 ceph-mon[35352]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 6.5 KiB/s rd, 409 B/s wr, 6 op/s 2024-09-18T12:46:47.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.777+0000 7fda64d7a640 1 -- 172.21.15.78:0/4209817707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda60109ed0 con 0x7fda60101960 2024-09-18T12:46:47.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.778+0000 7fda577fe640 1 -- 172.21.15.78:0/4209817707 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5340 (secure 0 0 0) 0x7fda5005fb60 con 0x7fda60101960 2024-09-18T12:46:47.779 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:46:47.779 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":18,"btime":"2024-09-18T12:46:44:251409+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.148:6827/1048760842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1048760842},{"type":"v1","addr":"172.21.15.148:6827","nonce":1048760842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":24287,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/258027429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":258027429},{"type":"v1","addr":"172.21.15.148:6825","nonce":258027429}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T12:46:44.251398+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14560,"mds_1":14574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14560":{"gid":14560,"name":"cephfs.smithi078.eakgoe","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.78:6827/2954199576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2954199576},{"type":"v1","addr":"172.21.15.78:6827","nonce":2954199576}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14574":{"gid":14574,"name":"cephfs.smithi078.furyab","rank":1,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6829/2120994206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2120994206},{"type":"v1","addr":"172.21.15.78:6829","nonce":2120994206}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14560,"qdb_cluster":[14560,14574]},"id":1}]} 2024-09-18T12:46:47.779 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 18 2024-09-18T12:46:47.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.780+0000 7fda64d7a640 1 -- 172.21.15.78:0/4209817707 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fda4c06e2b0 msgr2=0x7fda4c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:47.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.780+0000 7fda64d7a640 1 --2- 172.21.15.78:0/4209817707 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fda4c06e2b0 0x7fda4c070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda60198b50 tx=0x7fda48031400 comp rx=0 tx=0).stop 2024-09-18T12:46:47.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.780+0000 7fda64d7a640 1 -- 172.21.15.78:0/4209817707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda60101960 msgr2=0x7fda6019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:47.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.780+0000 7fda64d7a640 1 --2- 172.21.15.78:0/4209817707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda60101960 0x7fda6019d680 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fda5000ea00 tx=0x7fda5000eec0 comp rx=0 tx=0).stop 2024-09-18T12:46:47.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.780+0000 7fda64d7a640 1 -- 172.21.15.78:0/4209817707 shutdown_connections 2024-09-18T12:46:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.780+0000 7fda64d7a640 1 --2- 172.21.15.78:0/4209817707 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fda4c06e2b0 0x7fda4c070770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.780+0000 7fda64d7a640 1 --2- 172.21.15.78:0/4209817707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda60107960 0x7fda6019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.780+0000 7fda64d7a640 1 --2- 172.21.15.78:0/4209817707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda60101960 0x7fda6019d680 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.780+0000 7fda64d7a640 1 -- 172.21.15.78:0/4209817707 >> 172.21.15.78:0/4209817707 conn(0x7fda600fd680 msgr2=0x7fda600fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.780+0000 7fda64d7a640 1 -- 172.21.15.78:0/4209817707 shutdown_connections 2024-09-18T12:46:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:47.780+0000 7fda64d7a640 1 -- 172.21.15.78:0/4209817707 wait complete. 2024-09-18T12:46:48.595 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:48 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:48.595 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:48 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:48.595 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:48 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/4209817707' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T12:46:48.624 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 18} 2024-09-18T12:46:48.624 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-18T12:46:48.653 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-18T12:46:48.653 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-18T12:46:48.653 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-18T12:46:48.653 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-18T12:46:48.653 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-18T12:46:48.653 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-18T12:46:48.653 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-18T12:46:48.654 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-18T12:46:48.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:48.654 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-18T12:46:48.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:48.674 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2024-09-18T12:46:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:48 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:48 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:48 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/4209817707' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T12:46:48.742 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2024-09-18T12:46:48.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:46:48.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:48.743 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-09-18T12:46:48.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:48.764 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2024-09-18T12:46:48.838 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2024-09-18T12:46:48.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:46:48.840 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-18T12:46:48.840 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-18T12:46:48.840 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-18T12:46:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:49 smithi148 ceph-mon[35352]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-18T12:46:49.729 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:49.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:49 smithi078 ceph-mon[28091]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-18T12:46:50.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.201+0000 7f3a24a6e640 1 -- 172.21.15.78:0/441661074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a20102ac0 msgr2=0x7f3a20102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.201+0000 7f3a24a6e640 1 --2- 172.21.15.78:0/441661074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a20102ac0 0x7f3a20102ea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009880 tx=0x7f3a1002a530 comp rx=0 tx=0).stop 2024-09-18T12:46:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.201+0000 7f3a24a6e640 1 -- 172.21.15.78:0/441661074 shutdown_connections 2024-09-18T12:46:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.201+0000 7f3a24a6e640 1 --2- 172.21.15.78:0/441661074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a201033e0 0x7f3a2010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.201+0000 7f3a24a6e640 1 --2- 172.21.15.78:0/441661074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a20102ac0 0x7f3a20102ea0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.201+0000 7f3a24a6e640 1 -- 172.21.15.78:0/441661074 >> 172.21.15.78:0/441661074 conn(0x7f3a200fc520 msgr2=0x7f3a200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.201+0000 7f3a24a6e640 1 -- 172.21.15.78:0/441661074 shutdown_connections 2024-09-18T12:46:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.201+0000 7f3a24a6e640 1 -- 172.21.15.78:0/441661074 wait complete. 2024-09-18T12:46:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.202+0000 7f3a24a6e640 1 Processor -- start 2024-09-18T12:46:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.202+0000 7f3a24a6e640 1 -- start start 2024-09-18T12:46:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.202+0000 7f3a24a6e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a20102ac0 0x7f3a20100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.202+0000 7f3a24a6e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a201033e0 0x7f3a20100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.202+0000 7f3a24a6e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2010ee50 con 0x7f3a201033e0 2024-09-18T12:46:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.202+0000 7f3a24a6e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2010ecd0 con 0x7f3a20102ac0 2024-09-18T12:46:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.202+0000 7f3a15d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a201033e0 0x7f3a20100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.202+0000 7f3a15d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a201033e0 0x7f3a20100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40426/0 (socket says 172.21.15.78:40426) 2024-09-18T12:46:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.202+0000 7f3a15d9b640 1 -- 172.21.15.78:0/2835379606 learned_addr learned my addr 172.21.15.78:0/2835379606 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.202+0000 7f3a1e59c640 1 --2- 172.21.15.78:0/2835379606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a20102ac0 0x7f3a20100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.202+0000 7f3a15d9b640 1 -- 172.21.15.78:0/2835379606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a20102ac0 msgr2=0x7f3a20100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.202+0000 7f3a15d9b640 1 --2- 172.21.15.78:0/2835379606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a20102ac0 0x7f3a20100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.202+0000 7f3a15d9b640 1 -- 172.21.15.78:0/2835379606 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a201011a0 con 0x7f3a201033e0 2024-09-18T12:46:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.202+0000 7f3a1e59c640 1 --2- 172.21.15.78:0/2835379606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a20102ac0 0x7f3a20100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:46:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.203+0000 7f3a15d9b640 1 --2- 172.21.15.78:0/2835379606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a201033e0 0x7f3a20100c60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800b370 tx=0x7f3a0800b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.203+0000 7f3a17fff640 1 -- 172.21.15.78:0/2835379606 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a08015020 con 0x7f3a201033e0 2024-09-18T12:46:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.203+0000 7f3a17fff640 1 -- 172.21.15.78:0/2835379606 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a08011af0 con 0x7f3a201033e0 2024-09-18T12:46:50.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.203+0000 7f3a24a6e640 1 -- 172.21.15.78:0/2835379606 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a20101490 con 0x7f3a201033e0 2024-09-18T12:46:50.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.203+0000 7f3a17fff640 1 -- 172.21.15.78:0/2835379606 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a08010d60 con 0x7f3a201033e0 2024-09-18T12:46:50.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.203+0000 7f3a24a6e640 1 -- 172.21.15.78:0/2835379606 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a201a3ee0 con 0x7f3a201033e0 2024-09-18T12:46:50.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.204+0000 7f3a24a6e640 1 -- 172.21.15.78:0/2835379606 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2006aa90 con 0x7f3a201033e0 2024-09-18T12:46:50.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.204+0000 7f3a17fff640 1 -- 172.21.15.78:0/2835379606 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3a08018020 con 0x7f3a201033e0 2024-09-18T12:46:50.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.205+0000 7f3a17fff640 1 --2- 172.21.15.78:0/2835379606 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f3a0c06e2b0 0x7f3a0c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:50.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.205+0000 7f3a17fff640 1 -- 172.21.15.78:0/2835379606 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f3a0808dc30 con 0x7f3a201033e0 2024-09-18T12:46:50.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.205+0000 7f3a1e59c640 1 --2- 172.21.15.78:0/2835379606 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f3a0c06e2b0 0x7f3a0c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:50.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.205+0000 7f3a1e59c640 1 --2- 172.21.15.78:0/2835379606 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f3a0c06e2b0 0x7f3a0c070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3a10000c00 tx=0x7f3a10031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:50.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.209+0000 7f3a17fff640 1 -- 172.21.15.78:0/2835379606 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3a0801f020 con 0x7f3a201033e0 2024-09-18T12:46:50.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.414+0000 7f3a24a6e640 1 -- 172.21.15.78:0/2835379606 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3a201a4200 con 0x7f3a201033e0 2024-09-18T12:46:50.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.414+0000 7f3a17fff640 1 -- 172.21.15.78:0/2835379606 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+83 (secure 0 0 0) 0x7f3a0805b530 con 0x7f3a201033e0 2024-09-18T12:46:50.416 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-18T12:46:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.416+0000 7f3a24a6e640 1 -- 172.21.15.78:0/2835379606 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f3a0c06e2b0 msgr2=0x7f3a0c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.416+0000 7f3a24a6e640 1 --2- 172.21.15.78:0/2835379606 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f3a0c06e2b0 0x7f3a0c070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3a10000c00 tx=0x7f3a10031400 comp rx=0 tx=0).stop 2024-09-18T12:46:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.416+0000 7f3a24a6e640 1 -- 172.21.15.78:0/2835379606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a201033e0 msgr2=0x7f3a20100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.416+0000 7f3a24a6e640 1 --2- 172.21.15.78:0/2835379606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a201033e0 0x7f3a20100c60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800b370 tx=0x7f3a0800b830 comp rx=0 tx=0).stop 2024-09-18T12:46:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.416+0000 7f3a24a6e640 1 -- 172.21.15.78:0/2835379606 shutdown_connections 2024-09-18T12:46:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.416+0000 7f3a24a6e640 1 --2- 172.21.15.78:0/2835379606 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f3a0c06e2b0 0x7f3a0c070770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.416+0000 7f3a24a6e640 1 --2- 172.21.15.78:0/2835379606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a201033e0 0x7f3a20100c60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.416+0000 7f3a24a6e640 1 --2- 172.21.15.78:0/2835379606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a20102ac0 0x7f3a20100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.416+0000 7f3a24a6e640 1 -- 172.21.15.78:0/2835379606 >> 172.21.15.78:0/2835379606 conn(0x7f3a200fc520 msgr2=0x7f3a2010af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.416+0000 7f3a24a6e640 1 -- 172.21.15.78:0/2835379606 shutdown_connections 2024-09-18T12:46:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:50.416+0000 7f3a24a6e640 1 -- 172.21.15.78:0/2835379606 wait complete. 2024-09-18T12:46:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:50 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2835379606' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T12:46:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:50 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2835379606' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T12:46:51.087 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-18T12:46:51.087 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-18T12:46:51.087 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-09-18T12:46:51.088 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-18T12:46:51.088 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-18T12:46:51.088 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-18T12:46:51.088 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-18T12:46:51.088 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-18T12:46:51.088 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-18T12:46:51.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:51.088 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-09-18T12:46:51.105 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-18T12:46:51.105 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-18T12:46:51.105 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-09-18T12:46:51.105 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:46:51.105 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-09-18T12:46:51.105 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:46:51.105 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:46:51.105 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:46:51.105 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-09-18T12:46:51.105 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:46:51.106 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:46:51.106 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-09-18T12:46:51.106 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:46:51.106 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-09-18T12:46:51.106 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-18T12:46:51.106 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-09-18T12:46:51.106 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-18T12:46:51.106 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42330sec preferred_lft 42330sec 2024-09-18T12:46:51.106 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link noprefixroute 2024-09-18T12:46:51.106 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:46:51.107 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-18T12:46:51.107 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:46:51.107 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-18T12:46:51.107 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2024-09-18T12:46:51.107 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2024-09-18T12:46:51.107 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2024-09-18T12:46:51.107 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-18T12:46:51.107 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-18T12:46:51.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:46:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:46:51.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:51.380 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-18T12:46:51.404 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-09-18T12:46:51.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:51.406 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-09-18T12:46:51.500 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-09-18T12:46:51.501 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-18T12:46:51.501 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-18T12:46:51.501 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-18T12:46:51.501 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-18T12:46:51.501 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:46:51.501 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-18T12:46:51.501 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-18T12:46:51.501 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-18T12:46:51.502 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-18T12:46:51.502 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-18T12:46:51.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:46:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:51 smithi148 ceph-mon[35352]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 7.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-18T12:46:51.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:51 smithi078 ceph-mon[28091]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 7.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-18T12:46:52.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:46:52.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:52.017 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-18T12:46:52.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:52.036 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2024-09-18T12:46:52.094 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:46:52.094 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-18T12:46:52.095 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T12:46:52.095 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-18T12:46:52.095 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-18T12:46:52.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:46:52.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:46:52.220 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-18T12:46:52.221 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:46:52.221 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-18T12:46:52.221 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-18T12:46:52.221 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-18T12:46:52.221 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-18T12:46:52.221 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-18T12:46:52.221 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-18T12:46:52.221 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-18T12:46:52.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:46:52.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:46:52.365 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:46:52.365 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-18T12:46:52.366 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2024-09-18T12:46:52.366 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2024-09-18T12:46:52.366 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-18T12:46:52.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:46:52.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:46:52.443 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-18T12:46:52.443 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T12:46:52.443 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-18T12:46:52.458 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-18T12:46:52.458 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T12:46:52.458 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-18T12:46:52.513 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2024-09-18T12:46:52.579 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2024-09-18T12:46:52.637 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2024-09-18T12:46:52.637 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2024-09-18T12:46:52.637 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2024-09-18T12:46:52.637 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2024-09-18T12:46:52.637 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2024-09-18T12:46:52.637 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2024-09-18T12:46:52.638 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2024-09-18T12:46:52.638 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2024-09-18T12:46:52.638 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2024-09-18T12:46:52.638 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2024-09-18T12:46:52.638 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2024-09-18T12:46:52.638 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/selinux 2024-09-18T12:46:52.638 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:46:52.638 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2024-09-18T12:46:52.638 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2024-09-18T12:46:52.638 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2024-09-18T12:46:52.638 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2024-09-18T12:46:52.638 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2024-09-18T12:46:52.638 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysctl.service 2024-09-18T12:46:52.639 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2024-09-18T12:46:52.639 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-18T12:46:52.639 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-18T12:46:52.639 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/nfs/rpc_pipefs 2024-09-18T12:46:52.639 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2024-09-18T12:46:52.639 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2024-09-18T12:46:52.639 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay 2024-09-18T12:46:52.639 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/39ff3b10b99d81d16f3208474a7013d5e1cb27b6e624d5998e995afeb6b79dad/merged 2024-09-18T12:46:52.639 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/8bf57fdf2a966d413c5eb28cb1e3f0b96ce579d04c0e8f122fa2a736200e4a9f/merged 2024-09-18T12:46:52.639 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/0 2024-09-18T12:46:52.639 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:46:52.639 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/0a685aa285d6a811c184686d6c6f5d9cbdb4c708306c31cc9b68109a326b5f6c/merged 2024-09-18T12:46:52.639 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/7edc69e941d3bc4194ea6063463cf4fed5105cd58e728adeb1dbb41bcb13a1a1/merged 2024-09-18T12:46:52.640 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/69235695f85b5c5f33ad6d692341e216d7232460d20cd20d568cd4ffa4ae88f6/merged 2024-09-18T12:46:52.640 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/63d45d55d29ab063c59a018e2ba4ec6f905c859a5b90197df34612940b0d3cc5/merged 2024-09-18T12:46:52.640 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/621c83c02e6949187ec4fe7ca5b3955512d0462c655fd809b35c110620f11604/merged 2024-09-18T12:46:52.640 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/6dc4d7975f7484249f4a5f6896f80bed17a8bf9f37b0318a1a7bb3e3d92cdc79/merged 2024-09-18T12:46:52.640 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/632bf5ce6a70bb459385e07a60fc723806a163b513ca5188ad071f24f87299a6/merged 2024-09-18T12:46:52.640 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/9565efc095ca4903383f99a285d39ffe0af016f8729af35a8d715c58087713b3/merged 2024-09-18T12:46:52.640 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/742f25d662707333b46bfa9751288b39bc7e59234198d555ba503d492d5f81a8/merged 2024-09-18T12:46:52.640 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/1596b9311cf7f7ebb0a8fa4a085f94b86c4b2c9825dbb901e45739f8e0b3e0da/merged 2024-09-18T12:46:52.640 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/63e0bf56f801e1ab906c03e871a58b1bb87a7fbca421a19ff8d63796c156c7e1/merged 2024-09-18T12:46:52.640 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2024-09-18T12:46:52.640 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T12:46:52.640 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T12:46:52.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:52.641 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2024-09-18T12:46:52.697 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-18T12:46:52.697 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-18T12:46:52.740 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2024-09-18T12:46:52.766 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2024-09-18T12:46:52.822 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2024-09-18T12:46:52.823 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2024-09-18T12:46:52.823 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2024-09-18T12:46:52.823 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2024-09-18T12:46:52.823 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2024-09-18T12:46:52.823 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2024-09-18T12:46:52.823 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2024-09-18T12:46:52.823 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2024-09-18T12:46:52.823 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2024-09-18T12:46:52.823 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2024-09-18T12:46:52.823 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2024-09-18T12:46:52.823 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/selinux 2024-09-18T12:46:52.823 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:46:52.823 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2024-09-18T12:46:52.824 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2024-09-18T12:46:52.824 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2024-09-18T12:46:52.824 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2024-09-18T12:46:52.824 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2024-09-18T12:46:52.824 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysctl.service 2024-09-18T12:46:52.824 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2024-09-18T12:46:52.824 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-18T12:46:52.824 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-18T12:46:52.824 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/nfs/rpc_pipefs 2024-09-18T12:46:52.824 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2024-09-18T12:46:52.824 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2024-09-18T12:46:52.824 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay 2024-09-18T12:46:52.824 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/39ff3b10b99d81d16f3208474a7013d5e1cb27b6e624d5998e995afeb6b79dad/merged 2024-09-18T12:46:52.825 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/8bf57fdf2a966d413c5eb28cb1e3f0b96ce579d04c0e8f122fa2a736200e4a9f/merged 2024-09-18T12:46:52.825 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/0 2024-09-18T12:46:52.825 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:46:52.825 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/0a685aa285d6a811c184686d6c6f5d9cbdb4c708306c31cc9b68109a326b5f6c/merged 2024-09-18T12:46:52.825 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/7edc69e941d3bc4194ea6063463cf4fed5105cd58e728adeb1dbb41bcb13a1a1/merged 2024-09-18T12:46:52.825 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/69235695f85b5c5f33ad6d692341e216d7232460d20cd20d568cd4ffa4ae88f6/merged 2024-09-18T12:46:52.825 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/63d45d55d29ab063c59a018e2ba4ec6f905c859a5b90197df34612940b0d3cc5/merged 2024-09-18T12:46:52.825 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/621c83c02e6949187ec4fe7ca5b3955512d0462c655fd809b35c110620f11604/merged 2024-09-18T12:46:52.825 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/6dc4d7975f7484249f4a5f6896f80bed17a8bf9f37b0318a1a7bb3e3d92cdc79/merged 2024-09-18T12:46:52.825 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/632bf5ce6a70bb459385e07a60fc723806a163b513ca5188ad071f24f87299a6/merged 2024-09-18T12:46:52.825 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/9565efc095ca4903383f99a285d39ffe0af016f8729af35a8d715c58087713b3/merged 2024-09-18T12:46:52.825 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/742f25d662707333b46bfa9751288b39bc7e59234198d555ba503d492d5f81a8/merged 2024-09-18T12:46:52.825 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/1596b9311cf7f7ebb0a8fa4a085f94b86c4b2c9825dbb901e45739f8e0b3e0da/merged 2024-09-18T12:46:52.825 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/containers/storage/overlay/63e0bf56f801e1ab906c03e871a58b1bb87a7fbca421a19ff8d63796c156c7e1/merged 2024-09-18T12:46:52.826 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2024-09-18T12:46:52.826 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T12:46:52.826 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T12:46:52.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:52.826 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2024-09-18T12:46:52.856 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:2024-09-18T12:46:52.855+0000 7f6fc8120480 -1 init, newargv = 0x5639e32e8f80 newargc=15 2024-09-18T12:46:52.856 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[76875]: starting ceph client 2024-09-18T12:46:52.864 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[76875]: starting fuse 2024-09-18T12:46:52.873 INFO:teuthology.orchestra.run.smithi078.stdout:138 2024-09-18T12:46:52.873 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [138] 2024-09-18T12:46:52.873 DEBUG:teuthology.orchestra.run.smithi078:> sudo stdin-killer -- python3 -c ' 2024-09-18T12:46:52.874 DEBUG:teuthology.orchestra.run.smithi078:> import glob 2024-09-18T12:46:52.874 DEBUG:teuthology.orchestra.run.smithi078:> import re 2024-09-18T12:46:52.874 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-18T12:46:52.874 DEBUG:teuthology.orchestra.run.smithi078:> import subprocess 2024-09-18T12:46:52.874 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-18T12:46:52.874 DEBUG:teuthology.orchestra.run.smithi078:> def _find_admin_socket(client_name): 2024-09-18T12:46:52.874 DEBUG:teuthology.orchestra.run.smithi078:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-18T12:46:52.874 DEBUG:teuthology.orchestra.run.smithi078:> files = glob.glob(asok_path) 2024-09-18T12:46:52.874 DEBUG:teuthology.orchestra.run.smithi078:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-18T12:46:52.874 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-18T12:46:52.874 DEBUG:teuthology.orchestra.run.smithi078:> # Given a non-glob path, it better be there 2024-09-18T12:46:52.875 DEBUG:teuthology.orchestra.run.smithi078:> if "*" not in asok_path: 2024-09-18T12:46:52.875 DEBUG:teuthology.orchestra.run.smithi078:> assert(len(files) == 1) 2024-09-18T12:46:52.875 DEBUG:teuthology.orchestra.run.smithi078:> return files[0] 2024-09-18T12:46:52.875 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-18T12:46:52.875 DEBUG:teuthology.orchestra.run.smithi078:> for f in files: 2024-09-18T12:46:52.875 DEBUG:teuthology.orchestra.run.smithi078:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-18T12:46:52.875 DEBUG:teuthology.orchestra.run.smithi078:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-18T12:46:52.875 DEBUG:teuthology.orchestra.run.smithi078:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-18T12:46:52.875 DEBUG:teuthology.orchestra.run.smithi078:> contents = proc_f.read() 2024-09-18T12:46:52.875 DEBUG:teuthology.orchestra.run.smithi078:> if mountpoint in contents: 2024-09-18T12:46:52.875 DEBUG:teuthology.orchestra.run.smithi078:> return f 2024-09-18T12:46:52.875 DEBUG:teuthology.orchestra.run.smithi078:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-18T12:46:52.875 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-18T12:46:52.876 DEBUG:teuthology.orchestra.run.smithi078:> print(_find_admin_socket("client.0")) 2024-09-18T12:46:52.876 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-18T12:46:52.934 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:52 smithi078 ceph-mon[28091]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-18T12:46:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:52 smithi148 ceph-mon[35352]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-18T12:46:52.992 INFO:teuthology.orchestra.run.smithi078.stdout:/var/run/ceph/ceph-client.0.76875.asok 2024-09-18T12:46:52.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:46:53.002 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76875.asok 2024-09-18T12:46:53.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:53.003 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76875.asok status 2024-09-18T12:46:53.137 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:46:53.137 INFO:teuthology.orchestra.run.smithi078.stdout: "metadata": { 2024-09-18T12:46:53.137 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_sha1": "8e98666cb045318799c9328f1ae906cc2d724fd2", 2024-09-18T12:46:53.137 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_version": "ceph version 19.2.0 (8e98666cb045318799c9328f1ae906cc2d724fd2) squid (stable)", 2024-09-18T12:46:53.137 INFO:teuthology.orchestra.run.smithi078.stdout: "entity_id": "0", 2024-09-18T12:46:53.137 INFO:teuthology.orchestra.run.smithi078.stdout: "hostname": "smithi078", 2024-09-18T12:46:53.137 INFO:teuthology.orchestra.run.smithi078.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-18T12:46:53.137 INFO:teuthology.orchestra.run.smithi078.stdout: "pid": "76875", 2024-09-18T12:46:53.137 INFO:teuthology.orchestra.run.smithi078.stdout: "root": "/" 2024-09-18T12:46:53.138 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:46:53.138 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_count": 0, 2024-09-18T12:46:53.138 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_pinned_count": 0, 2024-09-18T12:46:53.138 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 14610, 2024-09-18T12:46:53.138 INFO:teuthology.orchestra.run.smithi078.stdout: "inst": { 2024-09-18T12:46:53.138 INFO:teuthology.orchestra.run.smithi078.stdout: "name": { 2024-09-18T12:46:53.138 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "client", 2024-09-18T12:46:53.138 INFO:teuthology.orchestra.run.smithi078.stdout: "num": 14610 2024-09-18T12:46:53.138 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:46:53.138 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2024-09-18T12:46:53.138 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-09-18T12:46:53.138 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.1:0", 2024-09-18T12:46:53.138 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 870258011 2024-09-18T12:46:53.138 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:46:53.139 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:46:53.139 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2024-09-18T12:46:53.139 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-09-18T12:46:53.139 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.1:0", 2024-09-18T12:46:53.139 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 870258011 2024-09-18T12:46:53.139 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:46:53.139 INFO:teuthology.orchestra.run.smithi078.stdout: "inst_str": "client.14610 192.168.0.1:0/870258011", 2024-09-18T12:46:53.139 INFO:teuthology.orchestra.run.smithi078.stdout: "addr_str": "192.168.0.1:0/870258011", 2024-09-18T12:46:53.139 INFO:teuthology.orchestra.run.smithi078.stdout: "inode_count": 1, 2024-09-18T12:46:53.139 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_epoch": 18, 2024-09-18T12:46:53.139 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch": 45, 2024-09-18T12:46:53.139 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch_barrier": 0, 2024-09-18T12:46:53.139 INFO:teuthology.orchestra.run.smithi078.stdout: "blocklisted": false, 2024-09-18T12:46:53.139 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs" 2024-09-18T12:46:53.139 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:46:53.145 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-18T12:46:53.145 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-18T12:46:53.402 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:46:53.776 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:53 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:53.776 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:53 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:53.776 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:53 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:53.777 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:53 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:53.777 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:53 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:53.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.851+0000 7f7778157640 1 -- 172.21.15.78:0/141890948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7770100800 msgr2=0x7f7770100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:53.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.851+0000 7f7778157640 1 --2- 172.21.15.78:0/141890948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7770100800 0x7f7770100c60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7760009880 tx=0x7f776002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:53.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.851+0000 7f7778157640 1 -- 172.21.15.78:0/141890948 shutdown_connections 2024-09-18T12:46:53.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.851+0000 7f7778157640 1 --2- 172.21.15.78:0/141890948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7770100800 0x7f7770100c60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:53.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.851+0000 7f7778157640 1 --2- 172.21.15.78:0/141890948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7770106800 0x7f7770106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:53.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.851+0000 7f7778157640 1 -- 172.21.15.78:0/141890948 >> 172.21.15.78:0/141890948 conn(0x7f77700fc520 msgr2=0x7f77700fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:53.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.851+0000 7f7778157640 1 -- 172.21.15.78:0/141890948 shutdown_connections 2024-09-18T12:46:53.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.851+0000 7f7778157640 1 -- 172.21.15.78:0/141890948 wait complete. 2024-09-18T12:46:53.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.852+0000 7f7778157640 1 Processor -- start 2024-09-18T12:46:53.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.852+0000 7f7778157640 1 -- start start 2024-09-18T12:46:53.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.852+0000 7f7778157640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7770100800 0x7f777019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:53.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.852+0000 7f7778157640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7770106800 0x7f777019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:53.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.852+0000 7f7778157640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f777010dcd0 con 0x7f7770100800 2024-09-18T12:46:53.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.852+0000 7f7778157640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f777010db50 con 0x7f7770106800 2024-09-18T12:46:53.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.852+0000 7f7775ef3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7770100800 0x7f777019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:53.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.852+0000 7f7775ef3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7770100800 0x7f777019c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50346/0 (socket says 172.21.15.78:50346) 2024-09-18T12:46:53.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.852+0000 7f7775ef3640 1 -- 172.21.15.78:0/1555837708 learned_addr learned my addr 172.21.15.78:0/1555837708 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:46:53.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.853+0000 7f77756f2640 1 --2- 172.21.15.78:0/1555837708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7770106800 0x7f777019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:53.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.853+0000 7f7775ef3640 1 -- 172.21.15.78:0/1555837708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7770106800 msgr2=0x7f777019cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:53.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.853+0000 7f7775ef3640 1 --2- 172.21.15.78:0/1555837708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7770106800 0x7f777019cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:53.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.853+0000 7f7775ef3640 1 -- 172.21.15.78:0/1555837708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77701966e0 con 0x7f7770100800 2024-09-18T12:46:53.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.853+0000 7f7775ef3640 1 --2- 172.21.15.78:0/1555837708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7770100800 0x7f777019c610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f776c00d6f0 tx=0x7f776c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:53.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.853+0000 7f7766ffd640 1 -- 172.21.15.78:0/1555837708 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f776c017070 con 0x7f7770100800 2024-09-18T12:46:53.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.853+0000 7f7766ffd640 1 -- 172.21.15.78:0/1555837708 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f776c00de00 con 0x7f7770100800 2024-09-18T12:46:53.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.853+0000 7f7778157640 1 -- 172.21.15.78:0/1555837708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77701969d0 con 0x7f7770100800 2024-09-18T12:46:53.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.853+0000 7f7766ffd640 1 -- 172.21.15.78:0/1555837708 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f776c004bb0 con 0x7f7770100800 2024-09-18T12:46:53.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.853+0000 7f7778157640 1 -- 172.21.15.78:0/1555837708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7770196f30 con 0x7f7770100800 2024-09-18T12:46:53.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.854+0000 7f7778157640 1 -- 172.21.15.78:0/1555837708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7770101f40 con 0x7f7770100800 2024-09-18T12:46:53.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.855+0000 7f7766ffd640 1 -- 172.21.15.78:0/1555837708 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f776c009a30 con 0x7f7770100800 2024-09-18T12:46:53.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.855+0000 7f7766ffd640 1 --2- 172.21.15.78:0/1555837708 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f775c06e310 0x7f775c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:53.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.855+0000 7f77756f2640 1 --2- 172.21.15.78:0/1555837708 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f775c06e310 0x7f775c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:53.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.855+0000 7f7766ffd640 1 -- 172.21.15.78:0/1555837708 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f776c08dce0 con 0x7f7770100800 2024-09-18T12:46:53.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.856+0000 7f77756f2640 1 --2- 172.21.15.78:0/1555837708 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f775c06e310 0x7f775c0707d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7770197f30 tx=0x7f7760031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:53.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:53.860+0000 7f7766ffd640 1 -- 172.21.15.78:0/1555837708 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f776c05b660 con 0x7f7770100800 2024-09-18T12:46:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:54.060+0000 7f7778157640 1 -- 172.21.15.78:0/1555837708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7770108d70 con 0x7f7770100800 2024-09-18T12:46:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:54.060+0000 7f7766ffd640 1 -- 172.21.15.78:0/1555837708 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+83 (secure 0 0 0) 0x7f776c05f310 con 0x7f7770100800 2024-09-18T12:46:54.062 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-18T12:46:54.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:54.062+0000 7f7778157640 1 -- 172.21.15.78:0/1555837708 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f775c06e310 msgr2=0x7f775c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:54.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:54.062+0000 7f7778157640 1 --2- 172.21.15.78:0/1555837708 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f775c06e310 0x7f775c0707d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7770197f30 tx=0x7f7760031400 comp rx=0 tx=0).stop 2024-09-18T12:46:54.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:54.062+0000 7f7778157640 1 -- 172.21.15.78:0/1555837708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7770100800 msgr2=0x7f777019c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:54.062+0000 7f7778157640 1 --2- 172.21.15.78:0/1555837708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7770100800 0x7f777019c610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f776c00d6f0 tx=0x7f776c00dbb0 comp rx=0 tx=0).stop 2024-09-18T12:46:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:54.062+0000 7f7778157640 1 -- 172.21.15.78:0/1555837708 shutdown_connections 2024-09-18T12:46:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:54.062+0000 7f7778157640 1 --2- 172.21.15.78:0/1555837708 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f775c06e310 0x7f775c0707d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:54.062+0000 7f7778157640 1 --2- 172.21.15.78:0/1555837708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7770106800 0x7f777019cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:54.062+0000 7f7778157640 1 --2- 172.21.15.78:0/1555837708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7770100800 0x7f777019c610 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:54.062+0000 7f7778157640 1 -- 172.21.15.78:0/1555837708 >> 172.21.15.78:0/1555837708 conn(0x7f77700fc520 msgr2=0x7f77700fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:54.062+0000 7f7778157640 1 -- 172.21.15.78:0/1555837708 shutdown_connections 2024-09-18T12:46:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:46:54.062+0000 7f7778157640 1 -- 172.21.15.78:0/1555837708 wait complete. 2024-09-18T12:46:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:53 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:53 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:53 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:53 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:53 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:54.612 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-18T12:46:54.612 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-18T12:46:54.612 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2024-09-18T12:46:54.612 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-18T12:46:54.612 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-18T12:46:54.612 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-18T12:46:54.612 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-18T12:46:54.612 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-18T12:46:54.613 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-18T12:46:54.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:54.613 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2024-09-18T12:46:54.632 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-18T12:46:54.632 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-18T12:46:54.632 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2024-09-18T12:46:54.632 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:46:54.632 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2024-09-18T12:46:54.632 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:46:54.632 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:46:54.632 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:46:54.633 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2024-09-18T12:46:54.633 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:46:54.633 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:46:54.633 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2024-09-18T12:46:54.633 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:46:54.633 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:46:54.633 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-18T12:46:54.633 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:46:54.633 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-18T12:46:54.633 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42331sec preferred_lft 42331sec 2024-09-18T12:46:54.633 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link noprefixroute 2024-09-18T12:46:54.633 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:46:54.634 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-18T12:46:54.634 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:46:54.634 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-09-18T12:46:54.634 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add name ceph-brx type bridge 2024-09-18T12:46:54.634 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr flush dev ceph-brx 2024-09-18T12:46:54.634 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set ceph-brx up 2024-09-18T12:46:54.634 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-18T12:46:54.634 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-09-18T12:46:54.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:46:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:46:54.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:46:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:46:54.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:54.853 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-18T12:46:54.878 INFO:teuthology.orchestra.run.smithi148.stdout:1 2024-09-18T12:46:54.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:54.879 DEBUG:teuthology.orchestra.run.smithi148:> route 2024-09-18T12:46:54.947 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2024-09-18T12:46:54.947 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-18T12:46:54.948 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-18T12:46:54.948 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-18T12:46:54.948 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-18T12:46:54.948 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:46:54.948 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-09-18T12:46:54.948 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-18T12:46:54.948 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-18T12:46:54.948 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-18T12:46:54.948 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-09-18T12:46:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:54 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1555837708' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T12:46:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:54 smithi078 ceph-mon[28091]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-18T12:46:55.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:46:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:46:55.043 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:54 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1555837708' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T12:46:55.043 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:54 smithi148 ceph-mon[35352]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-18T12:46:55.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:46:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:46:55.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:55.234 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-09-18T12:46:55.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:55.250 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list-id 2024-09-18T12:46:55.305 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:46:55.305 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-09-18T12:46:55.306 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T12:46:55.306 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-18T12:46:55.306 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-09-18T12:46:55.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:46:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:46:55.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:46:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:46:55.424 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-18T12:46:55.424 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:46:55.424 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-09-18T12:46:55.424 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-18T12:46:55.424 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-18T12:46:55.424 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-18T12:46:55.424 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-18T12:46:55.425 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-18T12:46:55.425 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-09-18T12:46:55.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:46:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:46:55.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:46:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:46:55.552 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:46:55.552 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-09-18T12:46:55.552 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2024-09-18T12:46:55.553 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set dev brx.0 master ceph-brx 2024-09-18T12:46:55.553 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-09-18T12:46:55.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:46:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:46:55.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:46:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:46:55.629 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-18T12:46:55.629 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T12:46:55.629 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-18T12:46:55.644 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-18T12:46:55.644 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T12:46:55.644 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-18T12:46:55.700 DEBUG:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2024-09-18T12:46:55.766 DEBUG:teuthology.orchestra.run.smithi148:> cat /proc/self/mounts | awk '{print $2}' 2024-09-18T12:46:55.823 INFO:teuthology.orchestra.run.smithi148.stdout:/proc 2024-09-18T12:46:55.824 INFO:teuthology.orchestra.run.smithi148.stdout:/sys 2024-09-18T12:46:55.824 INFO:teuthology.orchestra.run.smithi148.stdout:/dev 2024-09-18T12:46:55.824 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/security 2024-09-18T12:46:55.824 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/shm 2024-09-18T12:46:55.824 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/pts 2024-09-18T12:46:55.824 INFO:teuthology.orchestra.run.smithi148.stdout:/run 2024-09-18T12:46:55.824 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/cgroup 2024-09-18T12:46:55.824 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/pstore 2024-09-18T12:46:55.824 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/bpf 2024-09-18T12:46:55.824 INFO:teuthology.orchestra.run.smithi148.stdout:/ 2024-09-18T12:46:55.824 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/selinux 2024-09-18T12:46:55.824 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:46:55.825 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/mqueue 2024-09-18T12:46:55.825 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/hugepages 2024-09-18T12:46:55.825 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/debug 2024-09-18T12:46:55.825 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/tracing 2024-09-18T12:46:55.825 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/fuse/connections 2024-09-18T12:46:55.825 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/config 2024-09-18T12:46:55.825 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-sysctl.service 2024-09-18T12:46:55.825 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-18T12:46:55.825 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-18T12:46:55.825 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/nfs/rpc_pipefs 2024-09-18T12:46:55.825 INFO:teuthology.orchestra.run.smithi148.stdout:/run/user/1000 2024-09-18T12:46:55.825 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph 2024-09-18T12:46:55.825 INFO:teuthology.orchestra.run.smithi148.stdout:/run/user/0 2024-09-18T12:46:55.826 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:46:55.826 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay 2024-09-18T12:46:55.826 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/2ccce7d257f12d2c423b05b48e0897bfeede94a131c34b89d414d7bb25c7b847/merged 2024-09-18T12:46:55.826 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/aeeea1041c0ad05cb4ea7a2cdf9ec134544786e5f214bcfe8435c77b77924c0e/merged 2024-09-18T12:46:55.826 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/b99ca7beaccfba193ed1232fb69892e55cd0d931c18cf8882a3db45ad9febfbc/merged 2024-09-18T12:46:55.826 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/5a28a64277d57f7b72e7851fab7863f0e56c755a622bd9e4534e9cfcc4355a41/merged 2024-09-18T12:46:55.826 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/b6853ca4a6d935793256b159effda0d1b8d380aa30b265dcecb90c8cf8b42e38/merged 2024-09-18T12:46:55.826 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/53ad7d5ddc719b85acd605fd8f57ca9123456b967d5c436cc0969a70ed2b9a68/merged 2024-09-18T12:46:55.826 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/dc5b9ad2d3dbb1c9d816b5de16c9f060020806ef92ac1e0dc999f4ba1ea51365/merged 2024-09-18T12:46:55.826 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/3ea0bde9cd21ebe87eb3b1291dabb10d76a90561eb13968a0533639cccda3bab/merged 2024-09-18T12:46:55.826 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/c95b9ed65f1e6347296e9efc0951665575b6249526fb748c0409b5b5916ae76e/merged 2024-09-18T12:46:55.826 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/52f6335bc482ea592a79e4537a96bff41f08912c65e544d80b67252ea2b34dfb/merged 2024-09-18T12:46:55.826 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns 2024-09-18T12:46:55.826 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T12:46:55.827 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T12:46:55.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:55.827 DEBUG:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2024-09-18T12:46:55.879 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-18T12:46:55.879 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-18T12:46:55.922 DEBUG:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2024-09-18T12:46:55.946 DEBUG:teuthology.orchestra.run.smithi148:> cat /proc/self/mounts | awk '{print $2}' 2024-09-18T12:46:56.003 INFO:teuthology.orchestra.run.smithi148.stdout:/proc 2024-09-18T12:46:56.003 INFO:teuthology.orchestra.run.smithi148.stdout:/sys 2024-09-18T12:46:56.003 INFO:teuthology.orchestra.run.smithi148.stdout:/dev 2024-09-18T12:46:56.003 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/security 2024-09-18T12:46:56.003 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/shm 2024-09-18T12:46:56.003 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/pts 2024-09-18T12:46:56.003 INFO:teuthology.orchestra.run.smithi148.stdout:/run 2024-09-18T12:46:56.003 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/cgroup 2024-09-18T12:46:56.003 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/pstore 2024-09-18T12:46:56.003 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/bpf 2024-09-18T12:46:56.003 INFO:teuthology.orchestra.run.smithi148.stdout:/ 2024-09-18T12:46:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/selinux 2024-09-18T12:46:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:46:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/mqueue 2024-09-18T12:46:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/hugepages 2024-09-18T12:46:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/debug 2024-09-18T12:46:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/tracing 2024-09-18T12:46:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/fuse/connections 2024-09-18T12:46:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/config 2024-09-18T12:46:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-sysctl.service 2024-09-18T12:46:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-18T12:46:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-18T12:46:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/nfs/rpc_pipefs 2024-09-18T12:46:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:/run/user/1000 2024-09-18T12:46:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph 2024-09-18T12:46:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:/run/user/0 2024-09-18T12:46:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:46:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay 2024-09-18T12:46:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/2ccce7d257f12d2c423b05b48e0897bfeede94a131c34b89d414d7bb25c7b847/merged 2024-09-18T12:46:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/aeeea1041c0ad05cb4ea7a2cdf9ec134544786e5f214bcfe8435c77b77924c0e/merged 2024-09-18T12:46:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/b99ca7beaccfba193ed1232fb69892e55cd0d931c18cf8882a3db45ad9febfbc/merged 2024-09-18T12:46:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/5a28a64277d57f7b72e7851fab7863f0e56c755a622bd9e4534e9cfcc4355a41/merged 2024-09-18T12:46:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/b6853ca4a6d935793256b159effda0d1b8d380aa30b265dcecb90c8cf8b42e38/merged 2024-09-18T12:46:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/53ad7d5ddc719b85acd605fd8f57ca9123456b967d5c436cc0969a70ed2b9a68/merged 2024-09-18T12:46:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/dc5b9ad2d3dbb1c9d816b5de16c9f060020806ef92ac1e0dc999f4ba1ea51365/merged 2024-09-18T12:46:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/3ea0bde9cd21ebe87eb3b1291dabb10d76a90561eb13968a0533639cccda3bab/merged 2024-09-18T12:46:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/c95b9ed65f1e6347296e9efc0951665575b6249526fb748c0409b5b5916ae76e/merged 2024-09-18T12:46:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/52f6335bc482ea592a79e4537a96bff41f08912c65e544d80b67252ea2b34dfb/merged 2024-09-18T12:46:56.006 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns 2024-09-18T12:46:56.006 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T12:46:56.006 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T12:46:56.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:56.006 DEBUG:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2024-09-18T12:46:56.047 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi148.stderr:2024-09-18T12:46:56.046+0000 7f3962f04480 -1 init, newargv = 0x5639a33bbff0 newargc=15 2024-09-18T12:46:56.047 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi148.stderr:ceph-fuse[61569]: starting ceph client 2024-09-18T12:46:56.055 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi148.stderr:ceph-fuse[61569]: starting fuse 2024-09-18T12:46:56.059 INFO:teuthology.orchestra.run.smithi148.stdout:129 2024-09-18T12:46:56.059 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-18T12:46:56.059 DEBUG:teuthology.orchestra.run.smithi148:> sudo stdin-killer -- python3 -c ' 2024-09-18T12:46:56.059 DEBUG:teuthology.orchestra.run.smithi148:> import glob 2024-09-18T12:46:56.060 DEBUG:teuthology.orchestra.run.smithi148:> import re 2024-09-18T12:46:56.060 DEBUG:teuthology.orchestra.run.smithi148:> import os 2024-09-18T12:46:56.060 DEBUG:teuthology.orchestra.run.smithi148:> import subprocess 2024-09-18T12:46:56.060 DEBUG:teuthology.orchestra.run.smithi148:> 2024-09-18T12:46:56.060 DEBUG:teuthology.orchestra.run.smithi148:> def _find_admin_socket(client_name): 2024-09-18T12:46:56.060 DEBUG:teuthology.orchestra.run.smithi148:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-18T12:46:56.060 DEBUG:teuthology.orchestra.run.smithi148:> files = glob.glob(asok_path) 2024-09-18T12:46:56.060 DEBUG:teuthology.orchestra.run.smithi148:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-18T12:46:56.060 DEBUG:teuthology.orchestra.run.smithi148:> 2024-09-18T12:46:56.060 DEBUG:teuthology.orchestra.run.smithi148:> # Given a non-glob path, it better be there 2024-09-18T12:46:56.060 DEBUG:teuthology.orchestra.run.smithi148:> if "*" not in asok_path: 2024-09-18T12:46:56.060 DEBUG:teuthology.orchestra.run.smithi148:> assert(len(files) == 1) 2024-09-18T12:46:56.060 DEBUG:teuthology.orchestra.run.smithi148:> return files[0] 2024-09-18T12:46:56.060 DEBUG:teuthology.orchestra.run.smithi148:> 2024-09-18T12:46:56.060 DEBUG:teuthology.orchestra.run.smithi148:> for f in files: 2024-09-18T12:46:56.061 DEBUG:teuthology.orchestra.run.smithi148:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-18T12:46:56.061 DEBUG:teuthology.orchestra.run.smithi148:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-18T12:46:56.061 DEBUG:teuthology.orchestra.run.smithi148:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-18T12:46:56.061 DEBUG:teuthology.orchestra.run.smithi148:> contents = proc_f.read() 2024-09-18T12:46:56.061 DEBUG:teuthology.orchestra.run.smithi148:> if mountpoint in contents: 2024-09-18T12:46:56.061 DEBUG:teuthology.orchestra.run.smithi148:> return f 2024-09-18T12:46:56.061 DEBUG:teuthology.orchestra.run.smithi148:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-18T12:46:56.061 DEBUG:teuthology.orchestra.run.smithi148:> 2024-09-18T12:46:56.061 DEBUG:teuthology.orchestra.run.smithi148:> print(_find_admin_socket("client.1")) 2024-09-18T12:46:56.061 DEBUG:teuthology.orchestra.run.smithi148:> ' 2024-09-18T12:46:56.177 INFO:teuthology.orchestra.run.smithi148.stdout:/var/run/ceph/ceph-client.1.61569.asok 2024-09-18T12:46:56.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-18T12:46:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:46:56.188 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61569.asok 2024-09-18T12:46:56.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:56.189 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61569.asok status 2024-09-18T12:46:56.322 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-18T12:46:56.323 INFO:teuthology.orchestra.run.smithi148.stdout: "metadata": { 2024-09-18T12:46:56.323 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_sha1": "8e98666cb045318799c9328f1ae906cc2d724fd2", 2024-09-18T12:46:56.323 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_version": "ceph version 19.2.0 (8e98666cb045318799c9328f1ae906cc2d724fd2) squid (stable)", 2024-09-18T12:46:56.323 INFO:teuthology.orchestra.run.smithi148.stdout: "entity_id": "1", 2024-09-18T12:46:56.323 INFO:teuthology.orchestra.run.smithi148.stdout: "hostname": "smithi148", 2024-09-18T12:46:56.323 INFO:teuthology.orchestra.run.smithi148.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-18T12:46:56.323 INFO:teuthology.orchestra.run.smithi148.stdout: "pid": "61569", 2024-09-18T12:46:56.323 INFO:teuthology.orchestra.run.smithi148.stdout: "root": "/" 2024-09-18T12:46:56.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-18T12:46:56.323 INFO:teuthology.orchestra.run.smithi148.stdout: "dentry_count": 0, 2024-09-18T12:46:56.323 INFO:teuthology.orchestra.run.smithi148.stdout: "dentry_pinned_count": 0, 2024-09-18T12:46:56.323 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24303, 2024-09-18T12:46:56.324 INFO:teuthology.orchestra.run.smithi148.stdout: "inst": { 2024-09-18T12:46:56.324 INFO:teuthology.orchestra.run.smithi148.stdout: "name": { 2024-09-18T12:46:56.324 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "client", 2024-09-18T12:46:56.324 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 24303 2024-09-18T12:46:56.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-18T12:46:56.324 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": { 2024-09-18T12:46:56.324 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-09-18T12:46:56.324 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "192.168.0.1:0", 2024-09-18T12:46:56.324 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 2979256136 2024-09-18T12:46:56.324 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-18T12:46:56.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-18T12:46:56.324 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": { 2024-09-18T12:46:56.324 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-09-18T12:46:56.325 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "192.168.0.1:0", 2024-09-18T12:46:56.325 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 2979256136 2024-09-18T12:46:56.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-18T12:46:56.325 INFO:teuthology.orchestra.run.smithi148.stdout: "inst_str": "client.24303 192.168.0.1:0/2979256136", 2024-09-18T12:46:56.325 INFO:teuthology.orchestra.run.smithi148.stdout: "addr_str": "192.168.0.1:0/2979256136", 2024-09-18T12:46:56.325 INFO:teuthology.orchestra.run.smithi148.stdout: "inode_count": 1, 2024-09-18T12:46:56.325 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_epoch": 18, 2024-09-18T12:46:56.325 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_epoch": 45, 2024-09-18T12:46:56.325 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_epoch_barrier": 0, 2024-09-18T12:46:56.325 INFO:teuthology.orchestra.run.smithi148.stdout: "blocklisted": false, 2024-09-18T12:46:56.325 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs" 2024-09-18T12:46:56.325 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-18T12:46:56.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:56.331 DEBUG:teuthology.orchestra.run.smithi078:> stat --file-system '--printf=%T 2024-09-18T12:46:56.331 DEBUG:teuthology.orchestra.run.smithi078:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-18T12:46:56.353 INFO:teuthology.orchestra.run.smithi078.stdout:fuseblk 2024-09-18T12:46:56.353 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-18T12:46:56.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:56.353 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-18T12:46:56.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:56.428 DEBUG:teuthology.orchestra.run.smithi148:> stat --file-system '--printf=%T 2024-09-18T12:46:56.428 DEBUG:teuthology.orchestra.run.smithi148:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-18T12:46:56.445 INFO:teuthology.orchestra.run.smithi148.stdout:fuseblk 2024-09-18T12:46:56.445 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-18T12:46:56.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:46:56.445 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-18T12:46:57.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:57 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:57.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:57 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:57.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:57 smithi078 ceph-mon[28091]: pgmap v192: 65 pgs: 65 active+clean; 581 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-18T12:46:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:57 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:46:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:57 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:57 smithi148 ceph-mon[35352]: pgmap v192: 65 pgs: 65 active+clean; 581 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-18T12:46:58.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:46:58 smithi148 ceph-mon[35352]: pgmap v193: 65 pgs: 65 active+clean; 582 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 597 B/s wr, 1 op/s 2024-09-18T12:46:58.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:46:58 smithi078 ceph-mon[28091]: pgmap v193: 65 pgs: 65 active+clean; 582 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 597 B/s wr, 1 op/s 2024-09-18T12:46:59.857 INFO:teuthology.run_tasks:Running task print... 2024-09-18T12:46:59.868 INFO:teuthology.task.print:**** done client 2024-09-18T12:46:59.868 INFO:teuthology.run_tasks:Running task parallel... 2024-09-18T12:46:59.878 INFO:teuthology.task.parallel:starting parallel... 2024-09-18T12:46:59.878 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-18T12:46:59.879 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-18T12:46:59.879 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-18T12:46:59.879 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-18T12:46:59.880 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-18T12:46:59.880 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-18T12:46:59.884 INFO:tasks.workunit:Pulling workunits from ref e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:46:59.885 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-18T12:46:59.885 INFO:tasks.workunit:timeout=3h 2024-09-18T12:46:59.885 INFO:tasks.workunit:cleanup=True 2024-09-18T12:46:59.885 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-18T12:46:59.906 INFO:teuthology.orchestra.run.smithi078.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-18T12:46:59.906 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-18T12:46:59.906 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 8ah/138d Inode: 1 Links: 2 2024-09-18T12:46:59.907 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:46:59.907 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-18T12:46:59.907 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-18T12:46:59.907 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-18 12:46:30.764419173 +0000 2024-09-18T12:46:59.907 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-18 12:46:56.424037166 +0000 2024-09-18T12:46:59.907 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-09-18T12:46:59.907 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-18T12:46:59.907 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-18T12:46:59.980 DEBUG:teuthology.orchestra.run.smithi148:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-18T12:46:59.998 INFO:teuthology.orchestra.run.smithi148.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-18T12:46:59.999 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-18T12:46:59.999 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-18T12:46:59.999 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:46:59.999 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-18T12:46:59.999 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-18T12:46:59.999 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-18 12:46:59.973172611 +0000 2024-09-18T12:46:59.999 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-18 12:46:59.973172611 +0000 2024-09-18T12:46:59.999 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2024-09-18T12:46:59.999 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-18T12:46:59.999 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-18T12:47:00.071 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:47:00.072 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:47:00.088 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-18T12:47:00.128 INFO:tasks.workunit.client.1.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-18T12:47:00.158 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:47:00.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.612+0000 7fa884a08640 1 -- 172.21.15.78:0/3052588895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa880102b60 msgr2=0x7fa880102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.612+0000 7fa884a08640 1 --2- 172.21.15.78:0/3052588895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa880102b60 0x7fa880102fe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa868009880 tx=0x7fa86802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:47:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.612+0000 7fa884a08640 1 -- 172.21.15.78:0/3052588895 shutdown_connections 2024-09-18T12:47:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.612+0000 7fa884a08640 1 --2- 172.21.15.78:0/3052588895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa880102b60 0x7fa880102fe0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.612+0000 7fa884a08640 1 --2- 172.21.15.78:0/3052588895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa880101960 0x7fa880101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.612+0000 7fa884a08640 1 -- 172.21.15.78:0/3052588895 >> 172.21.15.78:0/3052588895 conn(0x7fa8800fd0f0 msgr2=0x7fa8800ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.612+0000 7fa884a08640 1 -- 172.21.15.78:0/3052588895 shutdown_connections 2024-09-18T12:47:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.612+0000 7fa884a08640 1 -- 172.21.15.78:0/3052588895 wait complete. 2024-09-18T12:47:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.612+0000 7fa884a08640 1 Processor -- start 2024-09-18T12:47:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.613+0000 7fa884a08640 1 -- start start 2024-09-18T12:47:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.613+0000 7fa884a08640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa880101960 0x7fa8801996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.613+0000 7fa884a08640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa880102b60 0x7fa880199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.613+0000 7fa884a08640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa88010a7a0 con 0x7fa880102b60 2024-09-18T12:47:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.613+0000 7fa884a08640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa88010a620 con 0x7fa880101960 2024-09-18T12:47:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.613+0000 7fa87dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa880102b60 0x7fa880199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.613+0000 7fa87dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa880102b60 0x7fa880199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50366/0 (socket says 172.21.15.78:50366) 2024-09-18T12:47:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.613+0000 7fa87dd9b640 1 -- 172.21.15.78:0/4178819768 learned_addr learned my addr 172.21.15.78:0/4178819768 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:47:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.613+0000 7fa87e59c640 1 --2- 172.21.15.78:0/4178819768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa880101960 0x7fa8801996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.613+0000 7fa87dd9b640 1 -- 172.21.15.78:0/4178819768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa880101960 msgr2=0x7fa8801996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.613+0000 7fa87dd9b640 1 --2- 172.21.15.78:0/4178819768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa880101960 0x7fa8801996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.613+0000 7fa87dd9b640 1 -- 172.21.15.78:0/4178819768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa88019a2a0 con 0x7fa880102b60 2024-09-18T12:47:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.613+0000 7fa87e59c640 1 --2- 172.21.15.78:0/4178819768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa880101960 0x7fa8801996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:47:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.613+0000 7fa87dd9b640 1 --2- 172.21.15.78:0/4178819768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa880102b60 0x7fa880199c20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa868006010 tx=0x7fa8680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.614+0000 7fa8777fe640 1 -- 172.21.15.78:0/4178819768 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa86803f070 con 0x7fa880102b60 2024-09-18T12:47:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.614+0000 7fa884a08640 1 -- 172.21.15.78:0/4178819768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa88019ec80 con 0x7fa880102b60 2024-09-18T12:47:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.614+0000 7fa8777fe640 1 -- 172.21.15.78:0/4178819768 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa868004ac0 con 0x7fa880102b60 2024-09-18T12:47:00.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.614+0000 7fa8777fe640 1 -- 172.21.15.78:0/4178819768 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa868035030 con 0x7fa880102b60 2024-09-18T12:47:00.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.614+0000 7fa884a08640 1 -- 172.21.15.78:0/4178819768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa88019f1c0 con 0x7fa880102b60 2024-09-18T12:47:00.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.615+0000 7fa884a08640 1 -- 172.21.15.78:0/4178819768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa880101d60 con 0x7fa880102b60 2024-09-18T12:47:00.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.615+0000 7fa8777fe640 1 -- 172.21.15.78:0/4178819768 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa868042070 con 0x7fa880102b60 2024-09-18T12:47:00.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.616+0000 7fa8777fe640 1 --2- 172.21.15.78:0/4178819768 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa86c06e2b0 0x7fa86c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:00.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.616+0000 7fa8777fe640 1 -- 172.21.15.78:0/4178819768 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fa8680aee10 con 0x7fa880102b60 2024-09-18T12:47:00.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.616+0000 7fa87e59c640 1 --2- 172.21.15.78:0/4178819768 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa86c06e2b0 0x7fa86c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:00.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.616+0000 7fa87e59c640 1 --2- 172.21.15.78:0/4178819768 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa86c06e2b0 0x7fa86c070770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa8801029c0 tx=0x7fa878009520 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:00.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.620+0000 7fa8777fe640 1 -- 172.21.15.78:0/4178819768 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa86807c710 con 0x7fa880102b60 2024-09-18T12:47:00.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.790+0000 7fa884a08640 1 -- 172.21.15.78:0/4178819768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7fa880106e30 con 0x7fa880102b60 2024-09-18T12:47:00.793 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:00 smithi078 ceph-mon[28091]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-09-18T12:47:00.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.791+0000 7fa8777fe640 1 -- 172.21.15.78:0/4178819768 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v43)=0 v43) ==== 155+0+0 (secure 0 0 0) 0x7fa8680803c0 con 0x7fa880102b60 2024-09-18T12:47:00.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.793+0000 7fa884a08640 1 -- 172.21.15.78:0/4178819768 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa86c06e2b0 msgr2=0x7fa86c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.793+0000 7fa884a08640 1 --2- 172.21.15.78:0/4178819768 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa86c06e2b0 0x7fa86c070770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa8801029c0 tx=0x7fa878009520 comp rx=0 tx=0).stop 2024-09-18T12:47:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.793+0000 7fa884a08640 1 -- 172.21.15.78:0/4178819768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa880102b60 msgr2=0x7fa880199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.793+0000 7fa884a08640 1 --2- 172.21.15.78:0/4178819768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa880102b60 0x7fa880199c20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa868006010 tx=0x7fa8680046c0 comp rx=0 tx=0).stop 2024-09-18T12:47:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.793+0000 7fa884a08640 1 -- 172.21.15.78:0/4178819768 shutdown_connections 2024-09-18T12:47:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.793+0000 7fa884a08640 1 --2- 172.21.15.78:0/4178819768 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa86c06e2b0 0x7fa86c070770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.793+0000 7fa884a08640 1 --2- 172.21.15.78:0/4178819768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa880102b60 0x7fa880199c20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.793+0000 7fa884a08640 1 --2- 172.21.15.78:0/4178819768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa880101960 0x7fa8801996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.793+0000 7fa884a08640 1 -- 172.21.15.78:0/4178819768 >> 172.21.15.78:0/4178819768 conn(0x7fa8800fd0f0 msgr2=0x7fa880104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.793+0000 7fa884a08640 1 -- 172.21.15.78:0/4178819768 shutdown_connections 2024-09-18T12:47:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:00.793+0000 7fa884a08640 1 -- 172.21.15.78:0/4178819768 wait complete. 2024-09-18T12:47:00.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:00 smithi148 ceph-mon[35352]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-09-18T12:47:01.454 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-18T12:47:01.743 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:47:02.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.212+0000 7fad6f582640 1 -- 172.21.15.78:0/2344330956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad68100860 msgr2=0x7fad68100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.212+0000 7fad6f582640 1 --2- 172.21.15.78:0/2344330956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad68100860 0x7fad68100c60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fad58009880 tx=0x7fad5802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:47:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.212+0000 7fad6f582640 1 -- 172.21.15.78:0/2344330956 shutdown_connections 2024-09-18T12:47:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.212+0000 7fad6f582640 1 --2- 172.21.15.78:0/2344330956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad68101a60 0x7fad68101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.212+0000 7fad6f582640 1 --2- 172.21.15.78:0/2344330956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad68100860 0x7fad68100c60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.212+0000 7fad6f582640 1 -- 172.21.15.78:0/2344330956 >> 172.21.15.78:0/2344330956 conn(0x7fad680fc010 msgr2=0x7fad680fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.212+0000 7fad6f582640 1 -- 172.21.15.78:0/2344330956 shutdown_connections 2024-09-18T12:47:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.212+0000 7fad6f582640 1 -- 172.21.15.78:0/2344330956 wait complete. 2024-09-18T12:47:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.212+0000 7fad6f582640 1 Processor -- start 2024-09-18T12:47:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad6f582640 1 -- start start 2024-09-18T12:47:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad6f582640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad68100860 0x7fad68104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad6f582640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad68101a60 0x7fad68102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:02.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad6f582640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fad68109700 con 0x7fad68101a60 2024-09-18T12:47:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad6f582640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fad68109580 con 0x7fad68100860 2024-09-18T12:47:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad6cb1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad68101a60 0x7fad68102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad6cb1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad68101a60 0x7fad68102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45148/0 (socket says 172.21.15.78:45148) 2024-09-18T12:47:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad6cb1d640 1 -- 172.21.15.78:0/2305010811 learned_addr learned my addr 172.21.15.78:0/2305010811 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:47:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad6d31e640 1 --2- 172.21.15.78:0/2305010811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad68100860 0x7fad68104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad6cb1d640 1 -- 172.21.15.78:0/2305010811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad68100860 msgr2=0x7fad68104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad6cb1d640 1 --2- 172.21.15.78:0/2305010811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad68100860 0x7fad68104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad6cb1d640 1 -- 172.21.15.78:0/2305010811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad68103380 con 0x7fad68101a60 2024-09-18T12:47:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad6cb1d640 1 --2- 172.21.15.78:0/2305010811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad68101a60 0x7fad68102e40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fad6400b420 tx=0x7fad6400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad5e7fc640 1 -- 172.21.15.78:0/2305010811 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad64011630 con 0x7fad68101a60 2024-09-18T12:47:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad5e7fc640 1 -- 172.21.15.78:0/2305010811 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad64016070 con 0x7fad68101a60 2024-09-18T12:47:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad6f582640 1 -- 172.21.15.78:0/2305010811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad68103670 con 0x7fad68101a60 2024-09-18T12:47:02.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.213+0000 7fad5e7fc640 1 -- 172.21.15.78:0/2305010811 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad64010d40 con 0x7fad68101a60 2024-09-18T12:47:02.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.214+0000 7fad6f582640 1 -- 172.21.15.78:0/2305010811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad68103c80 con 0x7fad68101a60 2024-09-18T12:47:02.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.215+0000 7fad6f582640 1 -- 172.21.15.78:0/2305010811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad68100c60 con 0x7fad68101a60 2024-09-18T12:47:02.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.215+0000 7fad5e7fc640 1 -- 172.21.15.78:0/2305010811 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fad6401b460 con 0x7fad68101a60 2024-09-18T12:47:02.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.216+0000 7fad5e7fc640 1 --2- 172.21.15.78:0/2305010811 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fad5406e2b0 0x7fad54070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:02.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.216+0000 7fad6d31e640 1 --2- 172.21.15.78:0/2305010811 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fad5406e2b0 0x7fad54070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:02.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.216+0000 7fad5e7fc640 1 -- 172.21.15.78:0/2305010811 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fad6408da40 con 0x7fad68101a60 2024-09-18T12:47:02.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.216+0000 7fad6d31e640 1 --2- 172.21.15.78:0/2305010811 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fad5406e2b0 0x7fad54070770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad58000c00 tx=0x7fad58009620 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:02.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.220+0000 7fad5e7fc640 1 -- 172.21.15.78:0/2305010811 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fad6405b340 con 0x7fad68101a60 2024-09-18T12:47:02.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.404+0000 7fad6f582640 1 -- 172.21.15.78:0/2305010811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7fad6819f6a0 con 0x7fad68101a60 2024-09-18T12:47:02.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.404+0000 7fad5e7fc640 1 -- 172.21.15.78:0/2305010811 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v43)=0 v43) ==== 163+0+0 (secure 0 0 0) 0x7fad6405eff0 con 0x7fad68101a60 2024-09-18T12:47:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.407+0000 7fad6f582640 1 -- 172.21.15.78:0/2305010811 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fad5406e2b0 msgr2=0x7fad54070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.407+0000 7fad6f582640 1 --2- 172.21.15.78:0/2305010811 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fad5406e2b0 0x7fad54070770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad58000c00 tx=0x7fad58009620 comp rx=0 tx=0).stop 2024-09-18T12:47:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.407+0000 7fad6f582640 1 -- 172.21.15.78:0/2305010811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad68101a60 msgr2=0x7fad68102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.407+0000 7fad6f582640 1 --2- 172.21.15.78:0/2305010811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad68101a60 0x7fad68102e40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fad6400b420 tx=0x7fad6400b8e0 comp rx=0 tx=0).stop 2024-09-18T12:47:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.407+0000 7fad6f582640 1 -- 172.21.15.78:0/2305010811 shutdown_connections 2024-09-18T12:47:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.407+0000 7fad6f582640 1 --2- 172.21.15.78:0/2305010811 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fad5406e2b0 0x7fad54070770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.407+0000 7fad6f582640 1 --2- 172.21.15.78:0/2305010811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad68101a60 0x7fad68102e40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.407+0000 7fad6f582640 1 --2- 172.21.15.78:0/2305010811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad68100860 0x7fad68104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.407+0000 7fad6f582640 1 -- 172.21.15.78:0/2305010811 >> 172.21.15.78:0/2305010811 conn(0x7fad680fc010 msgr2=0x7fad68069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.407+0000 7fad6f582640 1 -- 172.21.15.78:0/2305010811 shutdown_connections 2024-09-18T12:47:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:02.407+0000 7fad6f582640 1 -- 172.21.15.78:0/2305010811 wait complete. 2024-09-18T12:47:02.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:02 smithi148 ceph-mon[35352]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-09-18T12:47:02.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:02 smithi078 ceph-mon[28091]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-09-18T12:47:03.271 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-18T12:47:03.525 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:47:03.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.995+0000 7fbcaa36e640 1 -- 172.21.15.78:0/1513982762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbca41023f0 msgr2=0x7fbca41047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:03.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.995+0000 7fbcaa36e640 1 --2- 172.21.15.78:0/1513982762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbca41023f0 0x7fbca41047e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbc940098b0 tx=0x7fbc9402a4d0 comp rx=0 tx=0).stop 2024-09-18T12:47:03.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.995+0000 7fbcaa36e640 1 -- 172.21.15.78:0/1513982762 shutdown_connections 2024-09-18T12:47:03.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.995+0000 7fbcaa36e640 1 --2- 172.21.15.78:0/1513982762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbca4104d20 0x7fbca4107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:03.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.995+0000 7fbcaa36e640 1 --2- 172.21.15.78:0/1513982762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbca41023f0 0x7fbca41047e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:03.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.995+0000 7fbcaa36e640 1 -- 172.21.15.78:0/1513982762 >> 172.21.15.78:0/1513982762 conn(0x7fbca40fc010 msgr2=0x7fbca40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:04.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.995+0000 7fbcaa36e640 1 -- 172.21.15.78:0/1513982762 shutdown_connections 2024-09-18T12:47:04.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.995+0000 7fbcaa36e640 1 -- 172.21.15.78:0/1513982762 wait complete. 2024-09-18T12:47:04.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.996+0000 7fbcaa36e640 1 Processor -- start 2024-09-18T12:47:04.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.996+0000 7fbcaa36e640 1 -- start start 2024-09-18T12:47:04.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.996+0000 7fbcaa36e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbca41023f0 0x7fbca41975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:04.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.996+0000 7fbcaa36e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbca4104d20 0x7fbca4197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:04.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.996+0000 7fbcaa36e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbca410a830 con 0x7fbca41023f0 2024-09-18T12:47:04.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.996+0000 7fbcaa36e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbca410a6b0 con 0x7fbca4104d20 2024-09-18T12:47:04.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.996+0000 7fbca3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbca41023f0 0x7fbca41975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:04.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.996+0000 7fbca3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbca41023f0 0x7fbca41975b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45176/0 (socket says 172.21.15.78:45176) 2024-09-18T12:47:04.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.996+0000 7fbca3fff640 1 -- 172.21.15.78:0/2362794219 learned_addr learned my addr 172.21.15.78:0/2362794219 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:47:04.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.997+0000 7fbca3fff640 1 -- 172.21.15.78:0/2362794219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbca4104d20 msgr2=0x7fbca4197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.997+0000 7fbca3fff640 1 --2- 172.21.15.78:0/2362794219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbca4104d20 0x7fbca4197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.997+0000 7fbca3fff640 1 -- 172.21.15.78:0/2362794219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca4198170 con 0x7fbca41023f0 2024-09-18T12:47:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.997+0000 7fbca3fff640 1 --2- 172.21.15.78:0/2362794219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbca41023f0 0x7fbca41975b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbc940099d0 tx=0x7fbc940048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.997+0000 7fbca17fa640 1 -- 172.21.15.78:0/2362794219 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc9403f070 con 0x7fbca41023f0 2024-09-18T12:47:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.997+0000 7fbca17fa640 1 -- 172.21.15.78:0/2362794219 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc94004c70 con 0x7fbca41023f0 2024-09-18T12:47:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.997+0000 7fbcaa36e640 1 -- 172.21.15.78:0/2362794219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca419cb50 con 0x7fbca41023f0 2024-09-18T12:47:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.997+0000 7fbca17fa640 1 -- 172.21.15.78:0/2362794219 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc94035030 con 0x7fbca41023f0 2024-09-18T12:47:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.997+0000 7fbcaa36e640 1 -- 172.21.15.78:0/2362794219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca419d160 con 0x7fbca41023f0 2024-09-18T12:47:04.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.998+0000 7fbcaa36e640 1 -- 172.21.15.78:0/2362794219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca41027d0 con 0x7fbca41023f0 2024-09-18T12:47:04.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.999+0000 7fbca17fa640 1 -- 172.21.15.78:0/2362794219 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fbc94042070 con 0x7fbca41023f0 2024-09-18T12:47:04.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.999+0000 7fbca17fa640 1 --2- 172.21.15.78:0/2362794219 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fbc8c06e310 0x7fbc8c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:04.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.999+0000 7fbca17fa640 1 -- 172.21.15.78:0/2362794219 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fbc940aedb0 con 0x7fbca41023f0 2024-09-18T12:47:04.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:03.999+0000 7fbca37fe640 1 --2- 172.21.15.78:0/2362794219 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fbc8c06e310 0x7fbc8c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:04.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:04.000+0000 7fbca37fe640 1 --2- 172.21.15.78:0/2362794219 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fbc8c06e310 0x7fbc8c0707d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbca4198a60 tx=0x7fbc98006c90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:04.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:04.003+0000 7fbca17fa640 1 -- 172.21.15.78:0/2362794219 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbc9407c730 con 0x7fbca41023f0 2024-09-18T12:47:04.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:04.174+0000 7fbcaa36e640 1 -- 172.21.15.78:0/2362794219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7fbca419d450 con 0x7fbca41023f0 2024-09-18T12:47:04.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:04.174+0000 7fbca17fa640 1 -- 172.21.15.78:0/2362794219 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v43)=0 v43) ==== 135+0+0 (secure 0 0 0) 0x7fbc940803e0 con 0x7fbca41023f0 2024-09-18T12:47:04.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:04.177+0000 7fbcaa36e640 1 -- 172.21.15.78:0/2362794219 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fbc8c06e310 msgr2=0x7fbc8c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:04.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:04.177+0000 7fbcaa36e640 1 --2- 172.21.15.78:0/2362794219 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fbc8c06e310 0x7fbc8c0707d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbca4198a60 tx=0x7fbc98006c90 comp rx=0 tx=0).stop 2024-09-18T12:47:04.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:04.177+0000 7fbcaa36e640 1 -- 172.21.15.78:0/2362794219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbca41023f0 msgr2=0x7fbca41975b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:04.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:04.177+0000 7fbcaa36e640 1 --2- 172.21.15.78:0/2362794219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbca41023f0 0x7fbca41975b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbc940099d0 tx=0x7fbc940048f0 comp rx=0 tx=0).stop 2024-09-18T12:47:04.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:04.177+0000 7fbcaa36e640 1 -- 172.21.15.78:0/2362794219 shutdown_connections 2024-09-18T12:47:04.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:04.177+0000 7fbcaa36e640 1 --2- 172.21.15.78:0/2362794219 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fbc8c06e310 0x7fbc8c0707d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:04.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:04.177+0000 7fbcaa36e640 1 --2- 172.21.15.78:0/2362794219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbca4104d20 0x7fbca4197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:04.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:04.177+0000 7fbcaa36e640 1 --2- 172.21.15.78:0/2362794219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbca41023f0 0x7fbca41975b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:04.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:04.177+0000 7fbcaa36e640 1 -- 172.21.15.78:0/2362794219 >> 172.21.15.78:0/2362794219 conn(0x7fbca40fc010 msgr2=0x7fbca40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:04.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:04.177+0000 7fbcaa36e640 1 -- 172.21.15.78:0/2362794219 shutdown_connections 2024-09-18T12:47:04.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:04.177+0000 7fbcaa36e640 1 -- 172.21.15.78:0/2362794219 wait complete. 2024-09-18T12:47:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:04 smithi078 ceph-mon[28091]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-18T12:47:04.786 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-18T12:47:04.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:04 smithi148 ceph-mon[35352]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-18T12:47:05.033 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:47:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.453+0000 7fc4ffd42640 1 -- 172.21.15.78:0/1494609689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f8101a60 msgr2=0x7fc4f8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.453+0000 7fc4ffd42640 1 --2- 172.21.15.78:0/1494609689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f8101a60 0x7fc4f8101ee0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009880 tx=0x7fc4e802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:47:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.453+0000 7fc4ffd42640 1 -- 172.21.15.78:0/1494609689 shutdown_connections 2024-09-18T12:47:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.453+0000 7fc4ffd42640 1 --2- 172.21.15.78:0/1494609689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f8101a60 0x7fc4f8101ee0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.453+0000 7fc4ffd42640 1 --2- 172.21.15.78:0/1494609689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4f8100860 0x7fc4f8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.453+0000 7fc4ffd42640 1 -- 172.21.15.78:0/1494609689 >> 172.21.15.78:0/1494609689 conn(0x7fc4f80fc010 msgr2=0x7fc4f80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.453+0000 7fc4ffd42640 1 -- 172.21.15.78:0/1494609689 shutdown_connections 2024-09-18T12:47:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.453+0000 7fc4ffd42640 1 -- 172.21.15.78:0/1494609689 wait complete. 2024-09-18T12:47:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.453+0000 7fc4ffd42640 1 Processor -- start 2024-09-18T12:47:05.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.454+0000 7fc4ffd42640 1 -- start start 2024-09-18T12:47:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.454+0000 7fc4ffd42640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f8100860 0x7fc4f8104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.454+0000 7fc4ffd42640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4f8101a60 0x7fc4f8102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.454+0000 7fc4ffd42640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f8109720 con 0x7fc4f8100860 2024-09-18T12:47:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.454+0000 7fc4ffd42640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81095a0 con 0x7fc4f8101a60 2024-09-18T12:47:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.454+0000 7fc4fdade640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f8100860 0x7fc4f8104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.454+0000 7fc4fdade640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f8100860 0x7fc4f8104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45190/0 (socket says 172.21.15.78:45190) 2024-09-18T12:47:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.454+0000 7fc4fdade640 1 -- 172.21.15.78:0/2317202460 learned_addr learned my addr 172.21.15.78:0/2317202460 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:47:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.454+0000 7fc4fd2dd640 1 --2- 172.21.15.78:0/2317202460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4f8101a60 0x7fc4f8102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.454+0000 7fc4fdade640 1 -- 172.21.15.78:0/2317202460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4f8101a60 msgr2=0x7fc4f8102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.454+0000 7fc4fdade640 1 --2- 172.21.15.78:0/2317202460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4f8101a60 0x7fc4f8102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.454+0000 7fc4fdade640 1 -- 172.21.15.78:0/2317202460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f8103380 con 0x7fc4f8100860 2024-09-18T12:47:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.454+0000 7fc4fd2dd640 1 --2- 172.21.15.78:0/2317202460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4f8101a60 0x7fc4f8102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:47:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.454+0000 7fc4fdade640 1 --2- 172.21.15.78:0/2317202460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f8100860 0x7fc4f8104780 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400b3d0 tx=0x7fc4f400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.454+0000 7fc4eeffd640 1 -- 172.21.15.78:0/2317202460 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc4f4015020 con 0x7fc4f8100860 2024-09-18T12:47:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.455+0000 7fc4eeffd640 1 -- 172.21.15.78:0/2317202460 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc4f4011af0 con 0x7fc4f8100860 2024-09-18T12:47:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.455+0000 7fc4ffd42640 1 -- 172.21.15.78:0/2317202460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f8103670 con 0x7fc4f8100860 2024-09-18T12:47:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.455+0000 7fc4eeffd640 1 -- 172.21.15.78:0/2317202460 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc4f4010da0 con 0x7fc4f8100860 2024-09-18T12:47:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.455+0000 7fc4ffd42640 1 -- 172.21.15.78:0/2317202460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f8103c80 con 0x7fc4f8100860 2024-09-18T12:47:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.456+0000 7fc4ffd42640 1 -- 172.21.15.78:0/2317202460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f8100c60 con 0x7fc4f8100860 2024-09-18T12:47:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.456+0000 7fc4eeffd640 1 -- 172.21.15.78:0/2317202460 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc4f4018020 con 0x7fc4f8100860 2024-09-18T12:47:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.457+0000 7fc4eeffd640 1 --2- 172.21.15.78:0/2317202460 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc4e406e2b0 0x7fc4e4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.457+0000 7fc4eeffd640 1 -- 172.21.15.78:0/2317202460 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fc4f408dd10 con 0x7fc4f8100860 2024-09-18T12:47:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.457+0000 7fc4fd2dd640 1 --2- 172.21.15.78:0/2317202460 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc4e406e2b0 0x7fc4e4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.457+0000 7fc4fd2dd640 1 --2- 172.21.15.78:0/2317202460 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc4e406e2b0 0x7fc4e4070770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8104500 tx=0x7fc4e8005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.461+0000 7fc4eeffd640 1 -- 172.21.15.78:0/2317202460 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc4f401f020 con 0x7fc4f8100860 2024-09-18T12:47:05.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:05.642+0000 7fc4ffd42640 1 -- 172.21.15.78:0/2317202460 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) -- 0x7fc4f806a9b0 con 0x7fc4e406e2b0 2024-09-18T12:47:05.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:05 smithi148 ceph-mon[35352]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:47:05.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:05 smithi078 ceph-mon[28091]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:47:06.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:06 smithi148 ceph-mon[35352]: pgmap v197: 65 pgs: 65 active+clean; 587 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-18T12:47:06.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:06 smithi078 ceph-mon[28091]: pgmap v197: 65 pgs: 65 active+clean; 587 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-09-18T12:47:08.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:08 smithi148 ceph-mon[35352]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 1 op/s 2024-09-18T12:47:08.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:08 smithi078 ceph-mon[28091]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 1 op/s 2024-09-18T12:47:10.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:10 smithi148 ceph-mon[35352]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-09-18T12:47:10.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:10 smithi078 ceph-mon[28091]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-09-18T12:47:11.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:11 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:11.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:11 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:12.879 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:12 smithi078 ceph-mon[28091]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-18T12:47:12.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:12 smithi148 ceph-mon[35352]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-18T12:47:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:14 smithi148 ceph-mon[35352]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-18T12:47:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:14 smithi078 ceph-mon[28091]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-18T12:47:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:16 smithi148 ceph-mon[35352]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:47:16.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:16 smithi078 ceph-mon[28091]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:47:18.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:18 smithi148 ceph-mon[35352]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:47:18.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:18 smithi078 ceph-mon[28091]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:47:20.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:20 smithi148 ceph-mon[35352]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-18T12:47:20.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:20 smithi078 ceph-mon[28091]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-18T12:47:22.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:22 smithi148 ceph-mon[35352]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:22.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:22 smithi078 ceph-mon[28091]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:24.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:24 smithi148 ceph-mon[35352]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:24.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:24 smithi078 ceph-mon[28091]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:26 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:26.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:26 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:27.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:27 smithi148 ceph-mon[35352]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:27.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:27 smithi078 ceph-mon[28091]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:28.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:28 smithi148 ceph-mon[35352]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:28.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:28 smithi078 ceph-mon[28091]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:30.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:30 smithi148 ceph-mon[35352]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:30.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:30 smithi078 ceph-mon[28091]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:32.964 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:32 smithi078 ceph-mon[28091]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:32.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:32 smithi148 ceph-mon[35352]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:34 smithi078 ceph-mon[28091]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:34.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:34 smithi148 ceph-mon[35352]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:36.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:36 smithi148 ceph-mon[35352]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:36.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:36 smithi078 ceph-mon[28091]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:38.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:38 smithi148 ceph-mon[35352]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:38.979 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:38 smithi078 ceph-mon[28091]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:39.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:39.378+0000 7fc4eeffd640 1 -- 172.21.15.78:0/2317202460 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7fc4f806a9b0 con 0x7fc4e406e2b0 2024-09-18T12:47:39.381 INFO:teuthology.orchestra.run.smithi078.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:47:39.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:39.381+0000 7fc4ffd42640 1 -- 172.21.15.78:0/2317202460 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc4e406e2b0 msgr2=0x7fc4e4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:39.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:39.381+0000 7fc4ffd42640 1 --2- 172.21.15.78:0/2317202460 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc4e406e2b0 0x7fc4e4070770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8104500 tx=0x7fc4e8005a20 comp rx=0 tx=0).stop 2024-09-18T12:47:39.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:39.382+0000 7fc4ffd42640 1 -- 172.21.15.78:0/2317202460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f8100860 msgr2=0x7fc4f8104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:39.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:39.382+0000 7fc4ffd42640 1 --2- 172.21.15.78:0/2317202460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f8100860 0x7fc4f8104780 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400b3d0 tx=0x7fc4f400b890 comp rx=0 tx=0).stop 2024-09-18T12:47:39.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:39.382+0000 7fc4ffd42640 1 -- 172.21.15.78:0/2317202460 shutdown_connections 2024-09-18T12:47:39.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:39.382+0000 7fc4ffd42640 1 --2- 172.21.15.78:0/2317202460 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fc4e406e2b0 0x7fc4e4070770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:39.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:39.382+0000 7fc4ffd42640 1 --2- 172.21.15.78:0/2317202460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4f8101a60 0x7fc4f8102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:39.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:39.382+0000 7fc4ffd42640 1 --2- 172.21.15.78:0/2317202460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4f8100860 0x7fc4f8104780 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:39.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:39.382+0000 7fc4ffd42640 1 -- 172.21.15.78:0/2317202460 >> 172.21.15.78:0/2317202460 conn(0x7fc4f80fc010 msgr2=0x7fc4f806a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:39.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:39.382+0000 7fc4ffd42640 1 -- 172.21.15.78:0/2317202460 shutdown_connections 2024-09-18T12:47:39.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:39.382+0000 7fc4ffd42640 1 -- 172.21.15.78:0/2317202460 wait complete. 2024-09-18T12:47:40.057 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-18T12:47:40.401 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:47:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:40 smithi148 ceph-mon[35352]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:47:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:40 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:47:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:40 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:40 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:40 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:40 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:47:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:40 smithi148 ceph-mon[35352]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:47:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:40 smithi078 ceph-mon[28091]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:47:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:40 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:47:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:40 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:40 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:40 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:40 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:47:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:40 smithi078 ceph-mon[28091]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:47:41.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.044+0000 7f087040d640 1 -- 172.21.15.78:0/931758539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0868100860 msgr2=0x7f0868100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.044+0000 7f087040d640 1 --2- 172.21.15.78:0/931758539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0868100860 0x7f0868100c60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0864009880 tx=0x7f086402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.045+0000 7f087040d640 1 -- 172.21.15.78:0/931758539 shutdown_connections 2024-09-18T12:47:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.045+0000 7f087040d640 1 --2- 172.21.15.78:0/931758539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0868101a60 0x7f0868101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.045+0000 7f087040d640 1 --2- 172.21.15.78:0/931758539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0868100860 0x7f0868100c60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.045+0000 7f087040d640 1 -- 172.21.15.78:0/931758539 >> 172.21.15.78:0/931758539 conn(0x7f08680fbff0 msgr2=0x7f08680fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.045+0000 7f087040d640 1 -- 172.21.15.78:0/931758539 shutdown_connections 2024-09-18T12:47:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.045+0000 7f087040d640 1 -- 172.21.15.78:0/931758539 wait complete. 2024-09-18T12:47:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.046+0000 7f087040d640 1 Processor -- start 2024-09-18T12:47:41.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.046+0000 7f087040d640 1 -- start start 2024-09-18T12:47:41.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.047+0000 7f087040d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0868100860 0x7f08681974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:41.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.047+0000 7f087040d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0868101a60 0x7f0868197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:41.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.047+0000 7f087040d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f08681096a0 con 0x7f0868101a60 2024-09-18T12:47:41.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.047+0000 7f087040d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0868109520 con 0x7f0868100860 2024-09-18T12:47:41.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.047+0000 7f086e1a9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0868100860 0x7f08681974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:41.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.047+0000 7f086e1a9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0868100860 0x7f08681974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.78:57542/0 (socket says 172.21.15.78:57542) 2024-09-18T12:47:41.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.047+0000 7f086e1a9640 1 -- 172.21.15.78:0/1149841137 learned_addr learned my addr 172.21.15.78:0/1149841137 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:47:41.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.047+0000 7f086d9a8640 1 --2- 172.21.15.78:0/1149841137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0868101a60 0x7f0868197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:41.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.048+0000 7f086d9a8640 1 -- 172.21.15.78:0/1149841137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0868100860 msgr2=0x7f08681974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.048+0000 7f086d9a8640 1 --2- 172.21.15.78:0/1149841137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0868100860 0x7f08681974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.048+0000 7f086d9a8640 1 -- 172.21.15.78:0/1149841137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0868198080 con 0x7f0868101a60 2024-09-18T12:47:41.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.048+0000 7f086d9a8640 1 --2- 172.21.15.78:0/1149841137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0868101a60 0x7f0868197a00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0858009e70 tx=0x7f085800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:41.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.049+0000 7f085f7fe640 1 -- 172.21.15.78:0/1149841137 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f085800cac0 con 0x7f0868101a60 2024-09-18T12:47:41.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.049+0000 7f085f7fe640 1 -- 172.21.15.78:0/1149841137 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f085800cc60 con 0x7f0868101a60 2024-09-18T12:47:41.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.049+0000 7f087040d640 1 -- 172.21.15.78:0/1149841137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0868102ce0 con 0x7f0868101a60 2024-09-18T12:47:41.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.049+0000 7f087040d640 1 -- 172.21.15.78:0/1149841137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0868103270 con 0x7f0868101a60 2024-09-18T12:47:41.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.049+0000 7f085f7fe640 1 -- 172.21.15.78:0/1149841137 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0858013830 con 0x7f0868101a60 2024-09-18T12:47:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.052+0000 7f087040d640 1 -- 172.21.15.78:0/1149841137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f084c0052c0 con 0x7f0868101a60 2024-09-18T12:47:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.052+0000 7f085f7fe640 1 -- 172.21.15.78:0/1149841137 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0858013b00 con 0x7f0868101a60 2024-09-18T12:47:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.054+0000 7f085f7fe640 1 --2- 172.21.15.78:0/1149841137 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f085406e310 0x7f08540707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.054+0000 7f086e1a9640 1 --2- 172.21.15.78:0/1149841137 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f085406e310 0x7f08540707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:41.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.055+0000 7f086e1a9640 1 --2- 172.21.15.78:0/1149841137 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f085406e310 0x7f08540707d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0864005ab0 tx=0x7f0864005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:41.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.055+0000 7f085f7fe640 1 -- 172.21.15.78:0/1149841137 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f08580926d0 con 0x7f0868101a60 2024-09-18T12:47:41.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.059+0000 7f085f7fe640 1 -- 172.21.15.78:0/1149841137 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f08580610c0 con 0x7f0868101a60 2024-09-18T12:47:41.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.264+0000 7f087040d640 1 -- 172.21.15.78:0/1149841137 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f084c000bf0 con 0x7f085406e310 2024-09-18T12:47:41.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.266+0000 7f085f7fe640 1 -- 172.21.15.78:0/1149841137 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f084c000bf0 con 0x7f085406e310 2024-09-18T12:47:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.268+0000 7f087040d640 1 -- 172.21.15.78:0/1149841137 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f085406e310 msgr2=0x7f08540707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.268+0000 7f087040d640 1 --2- 172.21.15.78:0/1149841137 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f085406e310 0x7f08540707d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0864005ab0 tx=0x7f0864005a20 comp rx=0 tx=0).stop 2024-09-18T12:47:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.268+0000 7f087040d640 1 -- 172.21.15.78:0/1149841137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0868101a60 msgr2=0x7f0868197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.268+0000 7f087040d640 1 --2- 172.21.15.78:0/1149841137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0868101a60 0x7f0868197a00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0858009e70 tx=0x7f085800ed10 comp rx=0 tx=0).stop 2024-09-18T12:47:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.268+0000 7f087040d640 1 -- 172.21.15.78:0/1149841137 shutdown_connections 2024-09-18T12:47:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.268+0000 7f087040d640 1 --2- 172.21.15.78:0/1149841137 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f085406e310 0x7f08540707d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.268+0000 7f087040d640 1 --2- 172.21.15.78:0/1149841137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0868101a60 0x7f0868197a00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.268+0000 7f087040d640 1 --2- 172.21.15.78:0/1149841137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0868100860 0x7f08681974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.268+0000 7f087040d640 1 -- 172.21.15.78:0/1149841137 >> 172.21.15.78:0/1149841137 conn(0x7f08680fbff0 msgr2=0x7f08680fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.269+0000 7f087040d640 1 -- 172.21.15.78:0/1149841137 shutdown_connections 2024-09-18T12:47:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.269+0000 7f087040d640 1 -- 172.21.15.78:0/1149841137 wait complete. 2024-09-18T12:47:41.281 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:47:41.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.372+0000 7fdbba665640 1 -- 172.21.15.78:0/991871501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbb4100860 msgr2=0x7fdbb4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.372+0000 7fdbba665640 1 --2- 172.21.15.78:0/991871501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbb4100860 0x7fdbb4100c60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009880 tx=0x7fdba402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.372+0000 7fdbba665640 1 -- 172.21.15.78:0/991871501 shutdown_connections 2024-09-18T12:47:41.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.372+0000 7fdbba665640 1 --2- 172.21.15.78:0/991871501 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbb4101a60 0x7fdbb4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.372+0000 7fdbba665640 1 --2- 172.21.15.78:0/991871501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbb4100860 0x7fdbb4100c60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.372+0000 7fdbba665640 1 -- 172.21.15.78:0/991871501 >> 172.21.15.78:0/991871501 conn(0x7fdbb40fc010 msgr2=0x7fdbb40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:41.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.372+0000 7fdbba665640 1 -- 172.21.15.78:0/991871501 shutdown_connections 2024-09-18T12:47:41.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.372+0000 7fdbba665640 1 -- 172.21.15.78:0/991871501 wait complete. 2024-09-18T12:47:41.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.373+0000 7fdbba665640 1 Processor -- start 2024-09-18T12:47:41.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.373+0000 7fdbba665640 1 -- start start 2024-09-18T12:47:41.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.374+0000 7fdbba665640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbb4100860 0x7fdbb41963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:41.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.374+0000 7fdbba665640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbb4101a60 0x7fdbb41968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:41.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.374+0000 7fdbba665640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb4109680 con 0x7fdbb4100860 2024-09-18T12:47:41.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.374+0000 7fdbba665640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb4109500 con 0x7fdbb4101a60 2024-09-18T12:47:41.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.374+0000 7fdbb3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbb4100860 0x7fdbb41963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:41.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.374+0000 7fdbb37fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbb4101a60 0x7fdbb41968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:41.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.374+0000 7fdbb3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbb4100860 0x7fdbb41963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43748/0 (socket says 172.21.15.78:43748) 2024-09-18T12:47:41.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.374+0000 7fdbb37fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbb4101a60 0x7fdbb41968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.78:39028/0 (socket says 172.21.15.78:39028) 2024-09-18T12:47:41.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.374+0000 7fdbb37fe640 1 -- 172.21.15.78:0/1241171632 learned_addr learned my addr 172.21.15.78:0/1241171632 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:47:41.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.374+0000 7fdbb3fff640 1 -- 172.21.15.78:0/1241171632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbb4101a60 msgr2=0x7fdbb41968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.374+0000 7fdbb3fff640 1 --2- 172.21.15.78:0/1241171632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbb4101a60 0x7fdbb41968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.374+0000 7fdbb3fff640 1 -- 172.21.15.78:0/1241171632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb4196f60 con 0x7fdbb4100860 2024-09-18T12:47:41.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.374+0000 7fdbb37fe640 1 --2- 172.21.15.78:0/1241171632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbb4101a60 0x7fdbb41968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:47:41.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.375+0000 7fdbb3fff640 1 --2- 172.21.15.78:0/1241171632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbb4100860 0x7fdbb41963a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdba4006010 tx=0x7fdba40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:41.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.375+0000 7fdbb17fa640 1 -- 172.21.15.78:0/1241171632 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdba403f070 con 0x7fdbb4100860 2024-09-18T12:47:41.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.375+0000 7fdbba665640 1 -- 172.21.15.78:0/1241171632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb4069ca0 con 0x7fdbb4100860 2024-09-18T12:47:41.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.375+0000 7fdbb17fa640 1 -- 172.21.15.78:0/1241171632 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdba4004a50 con 0x7fdbb4100860 2024-09-18T12:47:41.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.375+0000 7fdbba665640 1 -- 172.21.15.78:0/1241171632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb406a230 con 0x7fdbb4100860 2024-09-18T12:47:41.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.375+0000 7fdbb17fa640 1 -- 172.21.15.78:0/1241171632 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdba403f070 con 0x7fdbb4100860 2024-09-18T12:47:41.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.376+0000 7fdbba665640 1 -- 172.21.15.78:0/1241171632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb4100c60 con 0x7fdbb4100860 2024-09-18T12:47:41.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.377+0000 7fdbb17fa640 1 -- 172.21.15.78:0/1241171632 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fdba4042070 con 0x7fdbb4100860 2024-09-18T12:47:41.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.378+0000 7fdbb17fa640 1 --2- 172.21.15.78:0/1241171632 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fdb9c06e6b0 0x7fdb9c070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:41.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.378+0000 7fdbb17fa640 1 -- 172.21.15.78:0/1241171632 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fdba40aebf0 con 0x7fdbb4100860 2024-09-18T12:47:41.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.378+0000 7fdbb37fe640 1 --2- 172.21.15.78:0/1241171632 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fdb9c06e6b0 0x7fdb9c070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:41.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.379+0000 7fdbb37fe640 1 --2- 172.21.15.78:0/1241171632 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fdb9c06e6b0 0x7fdb9c070b70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4197850 tx=0x7fdba800d6b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:41.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.382+0000 7fdbb17fa640 1 -- 172.21.15.78:0/1241171632 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdba4080220 con 0x7fdbb4100860 2024-09-18T12:47:41.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.586+0000 7fdbba665640 1 -- 172.21.15.78:0/1241171632 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fdbb4106010 con 0x7fdb9c06e6b0 2024-09-18T12:47:41.587 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:41 smithi078 ceph-mon[28091]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:41.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.587+0000 7fdbb17fa640 1 -- 172.21.15.78:0/1241171632 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7fdbb4106010 con 0x7fdb9c06e6b0 2024-09-18T12:47:41.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.590+0000 7fdbba665640 1 -- 172.21.15.78:0/1241171632 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fdb9c06e6b0 msgr2=0x7fdb9c070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.590+0000 7fdbba665640 1 --2- 172.21.15.78:0/1241171632 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fdb9c06e6b0 0x7fdb9c070b70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4197850 tx=0x7fdba800d6b0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.590+0000 7fdbba665640 1 -- 172.21.15.78:0/1241171632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbb4100860 msgr2=0x7fdbb41963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.590+0000 7fdbba665640 1 --2- 172.21.15.78:0/1241171632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbb4100860 0x7fdbb41963a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdba4006010 tx=0x7fdba40045e0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.590+0000 7fdbba665640 1 -- 172.21.15.78:0/1241171632 shutdown_connections 2024-09-18T12:47:41.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.590+0000 7fdbba665640 1 --2- 172.21.15.78:0/1241171632 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fdb9c06e6b0 0x7fdb9c070b70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.590+0000 7fdbba665640 1 --2- 172.21.15.78:0/1241171632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbb4101a60 0x7fdbb41968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.590+0000 7fdbba665640 1 --2- 172.21.15.78:0/1241171632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbb4100860 0x7fdbb41963a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.590+0000 7fdbba665640 1 -- 172.21.15.78:0/1241171632 >> 172.21.15.78:0/1241171632 conn(0x7fdbb40fc010 msgr2=0x7fdbb40fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:41.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.590+0000 7fdbba665640 1 -- 172.21.15.78:0/1241171632 shutdown_connections 2024-09-18T12:47:41.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.590+0000 7fdbba665640 1 -- 172.21.15.78:0/1241171632 wait complete. 2024-09-18T12:47:41.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.675+0000 7f643f024640 1 -- 172.21.15.78:0/3995126785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6438102b60 msgr2=0x7f6438102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.675+0000 7f643f024640 1 --2- 172.21.15.78:0/3995126785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6438102b60 0x7f6438102fe0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6424009880 tx=0x7f642402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.675+0000 7f643f024640 1 -- 172.21.15.78:0/3995126785 shutdown_connections 2024-09-18T12:47:41.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.675+0000 7f643f024640 1 --2- 172.21.15.78:0/3995126785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6438102b60 0x7f6438102fe0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.675+0000 7f643f024640 1 --2- 172.21.15.78:0/3995126785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6438101960 0x7f6438101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.675+0000 7f643f024640 1 -- 172.21.15.78:0/3995126785 >> 172.21.15.78:0/3995126785 conn(0x7f64380fd110 msgr2=0x7f64380ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:41.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.675+0000 7f643f024640 1 -- 172.21.15.78:0/3995126785 shutdown_connections 2024-09-18T12:47:41.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.675+0000 7f643f024640 1 -- 172.21.15.78:0/3995126785 wait complete. 2024-09-18T12:47:41.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.676+0000 7f643f024640 1 Processor -- start 2024-09-18T12:47:41.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.676+0000 7f643f024640 1 -- start start 2024-09-18T12:47:41.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.676+0000 7f643f024640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6438101960 0x7f64381996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:41.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.676+0000 7f643f024640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6438102b60 0x7f6438199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:41.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.676+0000 7f643f024640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f643810a7a0 con 0x7f6438102b60 2024-09-18T12:47:41.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.676+0000 7f643f024640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f643810a620 con 0x7f6438101960 2024-09-18T12:47:41.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.676+0000 7f6437fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6438102b60 0x7f6438199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:41.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.676+0000 7f6437fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6438102b60 0x7f6438199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43752/0 (socket says 172.21.15.78:43752) 2024-09-18T12:47:41.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.676+0000 7f6437fff640 1 -- 172.21.15.78:0/2841370571 learned_addr learned my addr 172.21.15.78:0/2841370571 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:47:41.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.677+0000 7f643cdc0640 1 --2- 172.21.15.78:0/2841370571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6438101960 0x7f64381996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:41.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.677+0000 7f6437fff640 1 -- 172.21.15.78:0/2841370571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6438101960 msgr2=0x7f64381996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.677+0000 7f6437fff640 1 --2- 172.21.15.78:0/2841370571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6438101960 0x7f64381996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.677+0000 7f6437fff640 1 -- 172.21.15.78:0/2841370571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643819a2a0 con 0x7f6438102b60 2024-09-18T12:47:41.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.677+0000 7f6437fff640 1 --2- 172.21.15.78:0/2841370571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6438102b60 0x7f6438199c20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6424006010 tx=0x7f64240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:41.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.677+0000 7f6435ffb640 1 -- 172.21.15.78:0/2841370571 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f642403f070 con 0x7f6438102b60 2024-09-18T12:47:41.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.677+0000 7f6435ffb640 1 -- 172.21.15.78:0/2841370571 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6424004ac0 con 0x7f6438102b60 2024-09-18T12:47:41.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.677+0000 7f6435ffb640 1 -- 172.21.15.78:0/2841370571 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6424035030 con 0x7f6438102b60 2024-09-18T12:47:41.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.677+0000 7f643f024640 1 -- 172.21.15.78:0/2841370571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643819ec80 con 0x7f6438102b60 2024-09-18T12:47:41.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.679+0000 7f643f024640 1 -- 172.21.15.78:0/2841370571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f643819f1c0 con 0x7f6438102b60 2024-09-18T12:47:41.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.680+0000 7f643f024640 1 -- 172.21.15.78:0/2841370571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6438101d60 con 0x7f6438102b60 2024-09-18T12:47:41.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.681+0000 7f6435ffb640 1 -- 172.21.15.78:0/2841370571 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6424042070 con 0x7f6438102b60 2024-09-18T12:47:41.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.681+0000 7f6435ffb640 1 --2- 172.21.15.78:0/2841370571 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f642806e310 0x7f64280707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:41.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.681+0000 7f6435ffb640 1 -- 172.21.15.78:0/2841370571 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f64240ae810 con 0x7f6438102b60 2024-09-18T12:47:41.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.682+0000 7f643cdc0640 1 --2- 172.21.15.78:0/2841370571 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f642806e310 0x7f64280707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:41.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.682+0000 7f643cdc0640 1 --2- 172.21.15.78:0/2841370571 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f642806e310 0x7f64280707d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f642c005fd0 tx=0x7f642c00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:41.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.690+0000 7f6435ffb640 1 -- 172.21.15.78:0/2841370571 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f642407fe40 con 0x7f6438102b60 2024-09-18T12:47:41.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:41 smithi148 ceph-mon[35352]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:41.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.886+0000 7f643f024640 1 -- 172.21.15.78:0/2841370571 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6438075d80 con 0x7f642806e310 2024-09-18T12:47:41.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.896+0000 7f6435ffb640 1 -- 172.21.15.78:0/2841370571 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7f6438075d80 con 0x7f642806e310 2024-09-18T12:47:41.897 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:47:41.898 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (4m) 49s ago 6m 26.6M - 0.25.0 c8568f914cd2 47a8b8bee5f5 2024-09-18T12:47:41.898 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (6m) 49s ago 6m 8308k - 19.1.1-330-gc2ddf972 ebb0615149de b314296d0168 2024-09-18T12:47:41.898 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (5m) 54s ago 5m 5272k - 19.1.1-330-gc2ddf972 ebb0615149de dad72664a205 2024-09-18T12:47:41.898 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (6m) 49s ago 6m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de bb77146b81c7 2024-09-18T12:47:41.898 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (5m) 54s ago 5m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de f82fdd264dc6 2024-09-18T12:47:41.898 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (4m) 49s ago 6m 80.5M - 9.4.12 2bacad6d85d8 0367cad8b635 2024-09-18T12:47:41.898 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (72s) 49s ago 71s 19.7M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:47:41.898 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (66s) 49s ago 66s 16.5M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:47:41.898 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (69s) 54s ago 69s 11.2M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:47:41.898 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (64s) 54s ago 63s 12.0M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:47:41.898 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:9283,8765,8443 running (7m) 49s ago 7m 500M - 19.1.1-330-gc2ddf972 ebb0615149de 284f2d8afd38 2024-09-18T12:47:41.898 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (5m) 54s ago 5m 440M - 19.1.1-330-gc2ddf972 ebb0615149de 2db5ffc08c95 2024-09-18T12:47:41.898 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (7m) 49s ago 8m 48.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1cb11a5bcd72 2024-09-18T12:47:41.899 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (5m) 54s ago 5m 35.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 02dfe1551226 2024-09-18T12:47:41.899 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (6m) 49s ago 6m 15.6M - 1.5.0 0da6a335fe13 3c6ba926bb86 2024-09-18T12:47:41.899 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (5m) 54s ago 5m 16.6M - 1.5.0 0da6a335fe13 4b7db3027dc5 2024-09-18T12:47:41.899 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (4m) 49s ago 4m 49.2M 3946M 19.1.1-330-gc2ddf972 ebb0615149de f634ad9ddb36 2024-09-18T12:47:41.899 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (3m) 49s ago 3m 55.6M 3946M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:47:41.899 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (3m) 49s ago 3m 54.3M 3946M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:47:41.899 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (3m) 54s ago 3m 53.6M 4970M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:47:41.899 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (2m) 54s ago 2m 42.0M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:47:41.899 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (2m) 54s ago 2m 49.0M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:47:41.899 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (4m) 49s ago 6m 52.7M - 2.43.0 a07b618ecd1d d012486d55b1 2024-09-18T12:47:41.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.899+0000 7f643f024640 1 -- 172.21.15.78:0/2841370571 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f642806e310 msgr2=0x7f64280707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.899+0000 7f643f024640 1 --2- 172.21.15.78:0/2841370571 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f642806e310 0x7f64280707d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f642c005fd0 tx=0x7f642c00b390 comp rx=0 tx=0).stop 2024-09-18T12:47:41.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.899+0000 7f643f024640 1 -- 172.21.15.78:0/2841370571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6438102b60 msgr2=0x7f6438199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.899+0000 7f643f024640 1 --2- 172.21.15.78:0/2841370571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6438102b60 0x7f6438199c20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6424006010 tx=0x7f64240046c0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.899+0000 7f643f024640 1 -- 172.21.15.78:0/2841370571 shutdown_connections 2024-09-18T12:47:41.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.899+0000 7f643f024640 1 --2- 172.21.15.78:0/2841370571 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f642806e310 0x7f64280707d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.899+0000 7f643f024640 1 --2- 172.21.15.78:0/2841370571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6438102b60 0x7f6438199c20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.899+0000 7f643f024640 1 --2- 172.21.15.78:0/2841370571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6438101960 0x7f64381996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.899+0000 7f643f024640 1 -- 172.21.15.78:0/2841370571 >> 172.21.15.78:0/2841370571 conn(0x7f64380fd110 msgr2=0x7f6438074660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:41.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.899+0000 7f643f024640 1 -- 172.21.15.78:0/2841370571 shutdown_connections 2024-09-18T12:47:41.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.899+0000 7f643f024640 1 -- 172.21.15.78:0/2841370571 wait complete. 2024-09-18T12:47:41.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.984+0000 7fd81eee4640 1 -- 172.21.15.78:0/2671587533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8181023f0 msgr2=0x7fd8181047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.984+0000 7fd81eee4640 1 --2- 172.21.15.78:0/2671587533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8181023f0 0x7fd8181047e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0098b0 tx=0x7fd80c02a4d0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.984+0000 7fd81eee4640 1 -- 172.21.15.78:0/2671587533 shutdown_connections 2024-09-18T12:47:41.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.984+0000 7fd81eee4640 1 --2- 172.21.15.78:0/2671587533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd818104d20 0x7fd818107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.984+0000 7fd81eee4640 1 --2- 172.21.15.78:0/2671587533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8181023f0 0x7fd8181047e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.984+0000 7fd81eee4640 1 -- 172.21.15.78:0/2671587533 >> 172.21.15.78:0/2671587533 conn(0x7fd8180fc010 msgr2=0x7fd8180fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:41.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.984+0000 7fd81eee4640 1 -- 172.21.15.78:0/2671587533 shutdown_connections 2024-09-18T12:47:41.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.984+0000 7fd81eee4640 1 -- 172.21.15.78:0/2671587533 wait complete. 2024-09-18T12:47:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.985+0000 7fd81eee4640 1 Processor -- start 2024-09-18T12:47:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.985+0000 7fd81eee4640 1 -- start start 2024-09-18T12:47:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.985+0000 7fd81eee4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8181023f0 0x7fd818197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.985+0000 7fd81eee4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd818104d20 0x7fd818197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.985+0000 7fd81eee4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd81810a7e0 con 0x7fd818104d20 2024-09-18T12:47:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.986+0000 7fd81eee4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd81810a660 con 0x7fd8181023f0 2024-09-18T12:47:41.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.985+0000 7fd817fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd818104d20 0x7fd818197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:41.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.986+0000 7fd81cc80640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8181023f0 0x7fd818197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:41.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.986+0000 7fd817fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd818104d20 0x7fd818197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43768/0 (socket says 172.21.15.78:43768) 2024-09-18T12:47:41.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.986+0000 7fd817fff640 1 -- 172.21.15.78:0/763348213 learned_addr learned my addr 172.21.15.78:0/763348213 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:47:41.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.986+0000 7fd817fff640 1 -- 172.21.15.78:0/763348213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8181023f0 msgr2=0x7fd818197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:41.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.986+0000 7fd817fff640 1 --2- 172.21.15.78:0/763348213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8181023f0 0x7fd818197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:41.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.986+0000 7fd817fff640 1 -- 172.21.15.78:0/763348213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8181980c0 con 0x7fd818104d20 2024-09-18T12:47:41.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.986+0000 7fd817fff640 1 --2- 172.21.15.78:0/763348213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd818104d20 0x7fd818197a40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd80400e970 tx=0x7fd80400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:41.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.986+0000 7fd815ffb640 1 -- 172.21.15.78:0/763348213 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd80400cac0 con 0x7fd818104d20 2024-09-18T12:47:41.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.987+0000 7fd81eee4640 1 -- 172.21.15.78:0/763348213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd81819cb00 con 0x7fd818104d20 2024-09-18T12:47:41.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.987+0000 7fd815ffb640 1 -- 172.21.15.78:0/763348213 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd8040054e0 con 0x7fd818104d20 2024-09-18T12:47:41.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.987+0000 7fd815ffb640 1 -- 172.21.15.78:0/763348213 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd804010430 con 0x7fd818104d20 2024-09-18T12:47:41.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.987+0000 7fd81eee4640 1 -- 172.21.15.78:0/763348213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd81819d090 con 0x7fd818104d20 2024-09-18T12:47:41.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.989+0000 7fd81eee4640 1 -- 172.21.15.78:0/763348213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8181027d0 con 0x7fd818104d20 2024-09-18T12:47:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.989+0000 7fd815ffb640 1 -- 172.21.15.78:0/763348213 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd804004ec0 con 0x7fd818104d20 2024-09-18T12:47:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.989+0000 7fd815ffb640 1 --2- 172.21.15.78:0/763348213 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd80806e310 0x7fd8080707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.989+0000 7fd815ffb640 1 -- 172.21.15.78:0/763348213 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fd80408e7d0 con 0x7fd818104d20 2024-09-18T12:47:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.990+0000 7fd81cc80640 1 --2- 172.21.15.78:0/763348213 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd80806e310 0x7fd8080707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.990+0000 7fd81cc80640 1 --2- 172.21.15.78:0/763348213 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd80806e310 0x7fd8080707d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd80c006010 tx=0x7fd80c0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:41.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:41.994+0000 7fd815ffb640 1 -- 172.21.15.78:0/763348213 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd80405c0b0 con 0x7fd818104d20 2024-09-18T12:47:42.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.482+0000 7fd81eee4640 1 -- 172.21.15.78:0/763348213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd81819d8f0 con 0x7fd818104d20 2024-09-18T12:47:42.483 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:42 smithi078 ceph-mon[28091]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:47:42.483 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:42 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:42.484 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:42 smithi078 ceph-mon[28091]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:47:42.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.483+0000 7fd815ffb640 1 -- 172.21.15.78:0/763348213 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7fd80405fd60 con 0x7fd818104d20 2024-09-18T12:47:42.484 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:47:42.484 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:47:42.484 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:47:42.484 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:47:42.485 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:47:42.485 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:47:42.485 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:47:42.485 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:47:42.485 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:47:42.485 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:47:42.485 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:47:42.485 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:47:42.485 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:47:42.485 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:47:42.485 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-18T12:47:42.485 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:47:42.485 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:47:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.486+0000 7fd81eee4640 1 -- 172.21.15.78:0/763348213 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd80806e310 msgr2=0x7fd8080707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.486+0000 7fd81eee4640 1 --2- 172.21.15.78:0/763348213 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd80806e310 0x7fd8080707d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd80c006010 tx=0x7fd80c0058d0 comp rx=0 tx=0).stop 2024-09-18T12:47:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.486+0000 7fd81eee4640 1 -- 172.21.15.78:0/763348213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd818104d20 msgr2=0x7fd818197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.486+0000 7fd81eee4640 1 --2- 172.21.15.78:0/763348213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd818104d20 0x7fd818197a40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd80400e970 tx=0x7fd80400ee30 comp rx=0 tx=0).stop 2024-09-18T12:47:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.486+0000 7fd81eee4640 1 -- 172.21.15.78:0/763348213 shutdown_connections 2024-09-18T12:47:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.486+0000 7fd81eee4640 1 --2- 172.21.15.78:0/763348213 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fd80806e310 0x7fd8080707d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.486+0000 7fd81eee4640 1 --2- 172.21.15.78:0/763348213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd818104d20 0x7fd818197a40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.486+0000 7fd81eee4640 1 --2- 172.21.15.78:0/763348213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8181023f0 0x7fd818197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:42.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.486+0000 7fd81eee4640 1 -- 172.21.15.78:0/763348213 >> 172.21.15.78:0/763348213 conn(0x7fd8180fc010 msgr2=0x7fd8180fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:42.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.486+0000 7fd81eee4640 1 -- 172.21.15.78:0/763348213 shutdown_connections 2024-09-18T12:47:42.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.486+0000 7fd81eee4640 1 -- 172.21.15.78:0/763348213 wait complete. 2024-09-18T12:47:42.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.614+0000 7f57c49f0640 1 -- 172.21.15.78:0/1396430911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c0101a60 msgr2=0x7f57c0101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:42.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.614+0000 7f57c49f0640 1 --2- 172.21.15.78:0/1396430911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c0101a60 0x7f57c0101ee0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009880 tx=0x7f57b402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:47:42.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.614+0000 7f57c49f0640 1 -- 172.21.15.78:0/1396430911 shutdown_connections 2024-09-18T12:47:42.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.614+0000 7f57c49f0640 1 --2- 172.21.15.78:0/1396430911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c0101a60 0x7f57c0101ee0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:42.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.614+0000 7f57c49f0640 1 --2- 172.21.15.78:0/1396430911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c0100860 0x7f57c0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:42.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.614+0000 7f57c49f0640 1 -- 172.21.15.78:0/1396430911 >> 172.21.15.78:0/1396430911 conn(0x7f57c00fc010 msgr2=0x7f57c00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:42.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.614+0000 7f57c49f0640 1 -- 172.21.15.78:0/1396430911 shutdown_connections 2024-09-18T12:47:42.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.614+0000 7f57c49f0640 1 -- 172.21.15.78:0/1396430911 wait complete. 2024-09-18T12:47:42.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.615+0000 7f57c49f0640 1 Processor -- start 2024-09-18T12:47:42.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.615+0000 7f57c49f0640 1 -- start start 2024-09-18T12:47:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.615+0000 7f57c49f0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c0100860 0x7f57c006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.615+0000 7f57c49f0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c0101a60 0x7f57c019c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.616+0000 7f57c49f0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f57c0109680 con 0x7f57c0100860 2024-09-18T12:47:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.616+0000 7f57c49f0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f57c0109500 con 0x7f57c0101a60 2024-09-18T12:47:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.616+0000 7f57bdd9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c0101a60 0x7f57c019c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.616+0000 7f57bdd9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c0101a60 0x7f57c019c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.78:39100/0 (socket says 172.21.15.78:39100) 2024-09-18T12:47:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.616+0000 7f57bdd9b640 1 -- 172.21.15.78:0/1398510425 learned_addr learned my addr 172.21.15.78:0/1398510425 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:47:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.616+0000 7f57be59c640 1 --2- 172.21.15.78:0/1398510425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c0100860 0x7f57c006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.616+0000 7f57bdd9b640 1 -- 172.21.15.78:0/1398510425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c0100860 msgr2=0x7f57c006a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.616+0000 7f57bdd9b640 1 --2- 172.21.15.78:0/1398510425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c0100860 0x7f57c006a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.616+0000 7f57bdd9b640 1 -- 172.21.15.78:0/1398510425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c019c7d0 con 0x7f57c0101a60 2024-09-18T12:47:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.616+0000 7f57be59c640 1 --2- 172.21.15.78:0/1398510425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c0100860 0x7f57c006a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:47:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.617+0000 7f57bdd9b640 1 --2- 172.21.15.78:0/1398510425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c0101a60 0x7f57c019c1e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f57b4006010 tx=0x7f57b40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.617+0000 7f57af7fe640 1 -- 172.21.15.78:0/1398510425 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57b403f070 con 0x7f57c0101a60 2024-09-18T12:47:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.617+0000 7f57af7fe640 1 -- 172.21.15.78:0/1398510425 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f57b4004ac0 con 0x7f57c0101a60 2024-09-18T12:47:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.617+0000 7f57af7fe640 1 -- 172.21.15.78:0/1398510425 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57b4035030 con 0x7f57c0101a60 2024-09-18T12:47:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.617+0000 7f57c49f0640 1 -- 172.21.15.78:0/1398510425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57c019ca60 con 0x7f57c0101a60 2024-09-18T12:47:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.618+0000 7f57c49f0640 1 -- 172.21.15.78:0/1398510425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57c019ced0 con 0x7f57c0101a60 2024-09-18T12:47:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.619+0000 7f57c49f0640 1 -- 172.21.15.78:0/1398510425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57c0100c60 con 0x7f57c0101a60 2024-09-18T12:47:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.621+0000 7f57af7fe640 1 -- 172.21.15.78:0/1398510425 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f57b4042070 con 0x7f57c0101a60 2024-09-18T12:47:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.621+0000 7f57af7fe640 1 --2- 172.21.15.78:0/1398510425 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f57a806e310 0x7f57a80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.621+0000 7f57af7fe640 1 -- 172.21.15.78:0/1398510425 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f57b40af100 con 0x7f57c0101a60 2024-09-18T12:47:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.622+0000 7f57be59c640 1 --2- 172.21.15.78:0/1398510425 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f57a806e310 0x7f57a80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.622+0000 7f57be59c640 1 --2- 172.21.15.78:0/1398510425 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f57a806e310 0x7f57a80707d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f57b0005fd0 tx=0x7f57b000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:42.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.630+0000 7f57af7fe640 1 -- 172.21.15.78:0/1398510425 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f57b407c8d0 con 0x7f57c0101a60 2024-09-18T12:47:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:42 smithi148 ceph-mon[35352]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:47:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:42 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:42 smithi148 ceph-mon[35352]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:47:42.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.876+0000 7f57c49f0640 1 -- 172.21.15.78:0/1398510425 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f57c0062740 con 0x7f57a806e310 2024-09-18T12:47:42.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.878+0000 7f57af7fe640 1 -- 172.21.15.78:0/1398510425 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f57c0062740 con 0x7f57a806e310 2024-09-18T12:47:42.879 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:47:42.879 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:47:42.879 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:47:42.879 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:47:42.879 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [], 2024-09-18T12:47:42.879 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "0/2 daemons upgraded", 2024-09-18T12:47:42.879 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mgr daemons", 2024-09-18T12:47:42.879 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:47:42.879 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:47:42.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.880+0000 7f57c49f0640 1 -- 172.21.15.78:0/1398510425 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f57a806e310 msgr2=0x7f57a80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:42.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.880+0000 7f57c49f0640 1 --2- 172.21.15.78:0/1398510425 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f57a806e310 0x7f57a80707d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f57b0005fd0 tx=0x7f57b000b410 comp rx=0 tx=0).stop 2024-09-18T12:47:42.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.880+0000 7f57c49f0640 1 -- 172.21.15.78:0/1398510425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c0101a60 msgr2=0x7f57c019c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:42.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.880+0000 7f57c49f0640 1 --2- 172.21.15.78:0/1398510425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c0101a60 0x7f57c019c1e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f57b4006010 tx=0x7f57b40046c0 comp rx=0 tx=0).stop 2024-09-18T12:47:42.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.880+0000 7f57c49f0640 1 -- 172.21.15.78:0/1398510425 shutdown_connections 2024-09-18T12:47:42.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.880+0000 7f57c49f0640 1 --2- 172.21.15.78:0/1398510425 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f57a806e310 0x7f57a80707d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:42.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.880+0000 7f57c49f0640 1 --2- 172.21.15.78:0/1398510425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c0101a60 0x7f57c019c1e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:42.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.880+0000 7f57c49f0640 1 --2- 172.21.15.78:0/1398510425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57c0100860 0x7f57c006a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:42.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.880+0000 7f57c49f0640 1 -- 172.21.15.78:0/1398510425 >> 172.21.15.78:0/1398510425 conn(0x7f57c00fc010 msgr2=0x7f57c0104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:42.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.880+0000 7f57c49f0640 1 -- 172.21.15.78:0/1398510425 shutdown_connections 2024-09-18T12:47:42.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:47:42.880+0000 7f57c49f0640 1 -- 172.21.15.78:0/1398510425 wait complete. 2024-09-18T12:47:43.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:43 smithi148 ceph-mon[35352]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:47:43.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:43 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/763348213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:47:43.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:43 smithi148 ceph-mon[35352]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:43.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:43 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:47:43.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:43 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:43 smithi078 ceph-mon[28091]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:47:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:43 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/763348213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:47:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:43 smithi078 ceph-mon[28091]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:43 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:47:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:43 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:44 smithi148 ceph-mon[35352]: Upgrade: Target is version 19.3.0-4983-ge7fb7b56 (squid) 2024-09-18T12:47:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:44 smithi148 ceph-mon[35352]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9'] 2024-09-18T12:47:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:44 smithi148 ceph-mon[35352]: Upgrade: Need to upgrade myself (mgr.smithi078.ohifux) 2024-09-18T12:47:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:44 smithi148 ceph-mon[35352]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:47:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:44 smithi148 ceph-mon[35352]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 on smithi148 2024-09-18T12:47:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:44 smithi078 ceph-mon[28091]: Upgrade: Target is version 19.3.0-4983-ge7fb7b56 (squid) 2024-09-18T12:47:44.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:44 smithi078 ceph-mon[28091]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9'] 2024-09-18T12:47:44.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:44 smithi078 ceph-mon[28091]: Upgrade: Need to upgrade myself (mgr.smithi078.ohifux) 2024-09-18T12:47:44.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:44 smithi078 ceph-mon[28091]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:47:44.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:44 smithi078 ceph-mon[28091]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 on smithi148 2024-09-18T12:47:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:45 smithi148 ceph-mon[35352]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:45.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:45 smithi078 ceph-mon[28091]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:46.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:46 smithi148 ceph-mon[35352]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:46.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:46 smithi078 ceph-mon[28091]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:48.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:48 smithi148 ceph-mon[35352]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:48.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:48 smithi078 ceph-mon[28091]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:50.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:50 smithi148 ceph-mon[35352]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:50.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:50 smithi078 ceph-mon[28091]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:52 smithi148 ceph-mon[35352]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:52.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:52 smithi078 ceph-mon[28091]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:54.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:54 smithi148 ceph-mon[35352]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:54 smithi078 ceph-mon[28091]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:56 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:56 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:57 smithi148 ceph-mon[35352]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:57.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:57 smithi078 ceph-mon[28091]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:58.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:47:58 smithi148 ceph-mon[35352]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:47:58.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:47:58 smithi078 ceph-mon[28091]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:00.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:00 smithi148 ceph-mon[35352]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:00.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:00 smithi078 ceph-mon[28091]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:02.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:02 smithi148 ceph-mon[35352]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:02.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:02 smithi078 ceph-mon[28091]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:04.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:04 smithi148 ceph-mon[35352]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:04.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:04 smithi078 ceph-mon[28091]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:06.283 INFO:tasks.workunit.client.1.smithi148.stderr:Updating files: 88% (11243/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-18T12:48:06.376 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e'. 2024-09-18T12:48:06.377 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-18T12:48:06.377 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-18T12:48:06.377 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-18T12:48:06.377 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-09-18T12:48:06.377 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-18T12:48:06.377 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-18T12:48:06.377 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-18T12:48:06.377 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-18T12:48:06.377 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-09-18T12:48:06.377 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-18T12:48:06.378 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-09-18T12:48:06.378 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-18T12:48:06.378 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-09-18T12:48:06.378 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-18T12:48:06.378 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-18T12:48:06.378 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-18T12:48:06.378 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at e7fb7b56dba Merge branch 'drive-group-spec-bool-args-followup' of https://github.com/guits/ceph into wip-guits-main-2024-09-17-1213 2024-09-18T12:48:06.382 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-18T12:48:06.405 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-18T12:48:06.407 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-18T12:48:06.407 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-18T12:48:06.879 INFO:tasks.workunit.client.1.smithi148.stderr:Note: switching to 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e'. 2024-09-18T12:48:06.879 INFO:tasks.workunit.client.1.smithi148.stderr: 2024-09-18T12:48:06.879 INFO:tasks.workunit.client.1.smithi148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-18T12:48:06.879 INFO:tasks.workunit.client.1.smithi148.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-18T12:48:06.879 INFO:tasks.workunit.client.1.smithi148.stderr:state without impacting any branches by switching back to a branch. 2024-09-18T12:48:06.879 INFO:tasks.workunit.client.1.smithi148.stderr: 2024-09-18T12:48:06.880 INFO:tasks.workunit.client.1.smithi148.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-18T12:48:06.880 INFO:tasks.workunit.client.1.smithi148.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-18T12:48:06.880 INFO:tasks.workunit.client.1.smithi148.stderr: 2024-09-18T12:48:06.880 INFO:tasks.workunit.client.1.smithi148.stderr: git switch -c 2024-09-18T12:48:06.880 INFO:tasks.workunit.client.1.smithi148.stderr: 2024-09-18T12:48:06.880 INFO:tasks.workunit.client.1.smithi148.stderr:Or undo this operation with: 2024-09-18T12:48:06.880 INFO:tasks.workunit.client.1.smithi148.stderr: 2024-09-18T12:48:06.880 INFO:tasks.workunit.client.1.smithi148.stderr: git switch - 2024-09-18T12:48:06.881 INFO:tasks.workunit.client.1.smithi148.stderr: 2024-09-18T12:48:06.881 INFO:tasks.workunit.client.1.smithi148.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-18T12:48:06.881 INFO:tasks.workunit.client.1.smithi148.stderr: 2024-09-18T12:48:06.881 INFO:tasks.workunit.client.1.smithi148.stderr:HEAD is now at e7fb7b56dba Merge branch 'drive-group-spec-bool-args-followup' of https://github.com/guits/ceph into wip-guits-main-2024-09-17-1213 2024-09-18T12:48:06.885 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-18T12:48:06.952 INFO:tasks.workunit.client.1.smithi148.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-18T12:48:06.955 INFO:tasks.workunit.client.1.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-18T12:48:06.955 INFO:tasks.workunit.client.1.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-18T12:48:06.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:06 smithi148 ceph-mon[35352]: pgmap v227: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:06.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:06 smithi078 ceph-mon[28091]: pgmap v227: 65 pgs: 65 active+clean; 590 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:07.143 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-18T12:48:07.209 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-18T12:48:07.248 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-18T12:48:07.249 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-18T12:48:07.249 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-18T12:48:07.288 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-18T12:48:07.292 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T12:48:07.292 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-18T12:48:07.348 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-18T12:48:07.351 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-18T12:48:07.351 DEBUG:teuthology.orchestra.run.smithi078:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-18T12:48:07.415 INFO:tasks.workunit.client.0.smithi078.stderr:+ mkdir -p fsstress 2024-09-18T12:48:07.417 INFO:tasks.workunit.client.0.smithi078.stderr:+ pushd fsstress 2024-09-18T12:48:07.418 INFO:tasks.workunit.client.0.smithi078.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-18T12:48:07.418 INFO:tasks.workunit.client.0.smithi078.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-18T12:48:07.626 INFO:tasks.workunit.client.1.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-18T12:48:07.690 INFO:tasks.workunit.client.1.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-18T12:48:07.735 INFO:tasks.workunit.client.1.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-18T12:48:07.736 INFO:tasks.workunit.client.1.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-18T12:48:07.736 INFO:tasks.workunit.client.1.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-18T12:48:07.775 INFO:tasks.workunit.client.1.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-18T12:48:07.779 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-18T12:48:07.779 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-18T12:48:07.836 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-18T12:48:07.837 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-18T12:48:07.837 DEBUG:teuthology.orchestra.run.smithi148:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-18T12:48:07.903 INFO:tasks.workunit.client.1.smithi148.stderr:+ mkdir -p fsstress 2024-09-18T12:48:07.905 INFO:tasks.workunit.client.1.smithi148.stderr:+ pushd fsstress 2024-09-18T12:48:07.907 INFO:tasks.workunit.client.1.smithi148.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-18T12:48:07.907 INFO:tasks.workunit.client.1.smithi148.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-18T12:48:07.971 INFO:tasks.workunit.client.0.smithi078.stderr:+ tar xzf ltp-full.tgz 2024-09-18T12:48:08.535 INFO:tasks.workunit.client.1.smithi148.stderr:+ tar xzf ltp-full.tgz 2024-09-18T12:48:08.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:08 smithi148 ceph-mon[35352]: pgmap v228: 65 pgs: 65 active+clean; 4.6 MiB data, 179 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 344 KiB/s wr, 0 op/s 2024-09-18T12:48:08.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:08 smithi078 ceph-mon[28091]: pgmap v228: 65 pgs: 65 active+clean; 4.6 MiB data, 179 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 344 KiB/s wr, 0 op/s 2024-09-18T12:48:10.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:10 smithi148 ceph-mon[35352]: pgmap v229: 65 pgs: 65 active+clean; 10 MiB data, 193 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 815 KiB/s wr, 11 op/s 2024-09-18T12:48:10.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:10 smithi078 ceph-mon[28091]: pgmap v229: 65 pgs: 65 active+clean; 10 MiB data, 193 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 815 KiB/s wr, 11 op/s 2024-09-18T12:48:11.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:11 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:11.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:11 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:12.981 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:12 smithi078 ceph-mon[28091]: pgmap v230: 65 pgs: 65 active+clean; 19 MiB data, 222 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 33 op/s 2024-09-18T12:48:12.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.979+0000 7f07c424d640 1 -- 172.21.15.78:0/1135546580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07bc101960 msgr2=0x7f07bc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:12.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.979+0000 7f07c424d640 1 --2- 172.21.15.78:0/1135546580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07bc101960 0x7f07bc101d60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009880 tx=0x7f07b802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:12.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.979+0000 7f07c424d640 1 -- 172.21.15.78:0/1135546580 shutdown_connections 2024-09-18T12:48:12.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.979+0000 7f07c424d640 1 --2- 172.21.15.78:0/1135546580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07bc102b60 0x7f07bc102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:12.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.979+0000 7f07c424d640 1 --2- 172.21.15.78:0/1135546580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07bc101960 0x7f07bc101d60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:12.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.979+0000 7f07c424d640 1 -- 172.21.15.78:0/1135546580 >> 172.21.15.78:0/1135546580 conn(0x7f07bc0fd110 msgr2=0x7f07bc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:12.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.979+0000 7f07c424d640 1 -- 172.21.15.78:0/1135546580 shutdown_connections 2024-09-18T12:48:12.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.979+0000 7f07c424d640 1 -- 172.21.15.78:0/1135546580 wait complete. 2024-09-18T12:48:12.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.980+0000 7f07c424d640 1 Processor -- start 2024-09-18T12:48:12.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.980+0000 7f07c424d640 1 -- start start 2024-09-18T12:48:12.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.980+0000 7f07c424d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07bc101960 0x7f07bc1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:12.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.980+0000 7f07c424d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07bc102b60 0x7f07bc197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:12.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.980+0000 7f07c424d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc10a780 con 0x7f07bc102b60 2024-09-18T12:48:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.980+0000 7f07c424d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc10a600 con 0x7f07bc101960 2024-09-18T12:48:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.980+0000 7f07c17e8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07bc102b60 0x7f07bc197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.980+0000 7f07c17e8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07bc102b60 0x7f07bc197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52714/0 (socket says 172.21.15.78:52714) 2024-09-18T12:48:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.981+0000 7f07c17e8640 1 -- 172.21.15.78:0/245432131 learned_addr learned my addr 172.21.15.78:0/245432131 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:48:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.981+0000 7f07c1fe9640 1 --2- 172.21.15.78:0/245432131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07bc101960 0x7f07bc1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.981+0000 7f07c17e8640 1 -- 172.21.15.78:0/245432131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07bc101960 msgr2=0x7f07bc1974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.981+0000 7f07c17e8640 1 --2- 172.21.15.78:0/245432131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07bc101960 0x7f07bc1974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.981+0000 7f07c17e8640 1 -- 172.21.15.78:0/245432131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07bc198080 con 0x7f07bc102b60 2024-09-18T12:48:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.981+0000 7f07c17e8640 1 --2- 172.21.15.78:0/245432131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07bc102b60 0x7f07bc197a00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00d8d0 tx=0x7f07ac00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.981+0000 7f07b2ffd640 1 -- 172.21.15.78:0/245432131 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07ac017030 con 0x7f07bc102b60 2024-09-18T12:48:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.981+0000 7f07b2ffd640 1 -- 172.21.15.78:0/245432131 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07ac004020 con 0x7f07bc102b60 2024-09-18T12:48:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.981+0000 7f07c424d640 1 -- 172.21.15.78:0/245432131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07bc19cac0 con 0x7f07bc102b60 2024-09-18T12:48:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.981+0000 7f07c424d640 1 -- 172.21.15.78:0/245432131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07bc19d050 con 0x7f07bc102b60 2024-09-18T12:48:12.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.981+0000 7f07b2ffd640 1 -- 172.21.15.78:0/245432131 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07ac0047a0 con 0x7f07bc102b60 2024-09-18T12:48:12.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.983+0000 7f07c424d640 1 -- 172.21.15.78:0/245432131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07bc101d60 con 0x7f07bc102b60 2024-09-18T12:48:12.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.983+0000 7f07b2ffd640 1 -- 172.21.15.78:0/245432131 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f07ac0041d0 con 0x7f07bc102b60 2024-09-18T12:48:12.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.984+0000 7f07b2ffd640 1 --2- 172.21.15.78:0/245432131 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f07a8072720 0x7f07a8074be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:12.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.984+0000 7f07b2ffd640 1 -- 172.21.15.78:0/245432131 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f07ac018070 con 0x7f07bc102b60 2024-09-18T12:48:12.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.984+0000 7f07c1fe9640 1 --2- 172.21.15.78:0/245432131 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f07a8072720 0x7f07a8074be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:12.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.985+0000 7f07c1fe9640 1 --2- 172.21.15.78:0/245432131 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f07a8072720 0x7f07a8074be0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009230 tx=0x7f07b80058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:12.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:12.989+0000 7f07b2ffd640 1 -- 172.21.15.78:0/245432131 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f07ac05b8b0 con 0x7f07bc102b60 2024-09-18T12:48:13.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.199+0000 7f07c424d640 1 -- 172.21.15.78:0/245432131 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f07bc062630 con 0x7f07a8072720 2024-09-18T12:48:13.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.201+0000 7f07b2ffd640 1 -- 172.21.15.78:0/245432131 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f07bc062630 con 0x7f07a8072720 2024-09-18T12:48:13.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.203+0000 7f07c424d640 1 -- 172.21.15.78:0/245432131 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f07a8072720 msgr2=0x7f07a8074be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:13.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.203+0000 7f07c424d640 1 --2- 172.21.15.78:0/245432131 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f07a8072720 0x7f07a8074be0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009230 tx=0x7f07b80058d0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.203+0000 7f07c424d640 1 -- 172.21.15.78:0/245432131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07bc102b60 msgr2=0x7f07bc197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:13.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.203+0000 7f07c424d640 1 --2- 172.21.15.78:0/245432131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07bc102b60 0x7f07bc197a00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00d8d0 tx=0x7f07ac00dd90 comp rx=0 tx=0).stop 2024-09-18T12:48:13.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.203+0000 7f07c424d640 1 -- 172.21.15.78:0/245432131 shutdown_connections 2024-09-18T12:48:13.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.203+0000 7f07c424d640 1 --2- 172.21.15.78:0/245432131 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f07a8072720 0x7f07a8074be0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.203+0000 7f07c424d640 1 --2- 172.21.15.78:0/245432131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07bc102b60 0x7f07bc197a00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.203+0000 7f07c424d640 1 --2- 172.21.15.78:0/245432131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07bc101960 0x7f07bc1974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.203+0000 7f07c424d640 1 -- 172.21.15.78:0/245432131 >> 172.21.15.78:0/245432131 conn(0x7f07bc0fd110 msgr2=0x7f07bc106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:13.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.203+0000 7f07c424d640 1 -- 172.21.15.78:0/245432131 shutdown_connections 2024-09-18T12:48:13.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.203+0000 7f07c424d640 1 -- 172.21.15.78:0/245432131 wait complete. 2024-09-18T12:48:13.213 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:48:13.222 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:12 smithi148 ceph-mon[35352]: pgmap v230: 65 pgs: 65 active+clean; 19 MiB data, 222 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 33 op/s 2024-09-18T12:48:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.295+0000 7ffb27086640 1 -- 172.21.15.78:0/1888266331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb20100860 msgr2=0x7ffb20100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.295+0000 7ffb27086640 1 --2- 172.21.15.78:0/1888266331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb20100860 0x7ffb20100c60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009880 tx=0x7ffb1402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.295+0000 7ffb27086640 1 -- 172.21.15.78:0/1888266331 shutdown_connections 2024-09-18T12:48:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.295+0000 7ffb27086640 1 --2- 172.21.15.78:0/1888266331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb20101a60 0x7ffb20101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.295+0000 7ffb27086640 1 --2- 172.21.15.78:0/1888266331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb20100860 0x7ffb20100c60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.295+0000 7ffb27086640 1 -- 172.21.15.78:0/1888266331 >> 172.21.15.78:0/1888266331 conn(0x7ffb200fc010 msgr2=0x7ffb200fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.295+0000 7ffb27086640 1 -- 172.21.15.78:0/1888266331 shutdown_connections 2024-09-18T12:48:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.295+0000 7ffb27086640 1 -- 172.21.15.78:0/1888266331 wait complete. 2024-09-18T12:48:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.296+0000 7ffb27086640 1 Processor -- start 2024-09-18T12:48:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.296+0000 7ffb27086640 1 -- start start 2024-09-18T12:48:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.296+0000 7ffb27086640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb20100860 0x7ffb2006a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.296+0000 7ffb27086640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb20101a60 0x7ffb2019c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.296+0000 7ffb27086640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffb20109680 con 0x7ffb20101a60 2024-09-18T12:48:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.296+0000 7ffb27086640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffb20109500 con 0x7ffb20100860 2024-09-18T12:48:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.296+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb20101a60 0x7ffb2019c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.296+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb20101a60 0x7ffb2019c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52724/0 (socket says 172.21.15.78:52724) 2024-09-18T12:48:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.296+0000 7ffb1ffff640 1 -- 172.21.15.78:0/244017967 learned_addr learned my addr 172.21.15.78:0/244017967 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:48:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.296+0000 7ffb24e22640 1 --2- 172.21.15.78:0/244017967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb20100860 0x7ffb2006a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.297+0000 7ffb1ffff640 1 -- 172.21.15.78:0/244017967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb20100860 msgr2=0x7ffb2006a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:13.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.297+0000 7ffb1ffff640 1 --2- 172.21.15.78:0/244017967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb20100860 0x7ffb2006a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.297+0000 7ffb1ffff640 1 -- 172.21.15.78:0/244017967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2019c7c0 con 0x7ffb20101a60 2024-09-18T12:48:13.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.297+0000 7ffb1ffff640 1 --2- 172.21.15.78:0/244017967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb20101a60 0x7ffb2019c200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00e970 tx=0x7ffb0c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.297+0000 7ffb1dffb640 1 -- 172.21.15.78:0/244017967 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb0c00cac0 con 0x7ffb20101a60 2024-09-18T12:48:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.297+0000 7ffb1dffb640 1 -- 172.21.15.78:0/244017967 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffb0c00cc60 con 0x7ffb20101a60 2024-09-18T12:48:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.297+0000 7ffb27086640 1 -- 172.21.15.78:0/244017967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2019cab0 con 0x7ffb20101a60 2024-09-18T12:48:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.297+0000 7ffb1dffb640 1 -- 172.21.15.78:0/244017967 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb0c0186c0 con 0x7ffb20101a60 2024-09-18T12:48:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.297+0000 7ffb27086640 1 -- 172.21.15.78:0/244017967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb2019d040 con 0x7ffb20101a60 2024-09-18T12:48:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.298+0000 7ffb27086640 1 -- 172.21.15.78:0/244017967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb20100c60 con 0x7ffb20101a60 2024-09-18T12:48:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.299+0000 7ffb1dffb640 1 -- 172.21.15.78:0/244017967 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ffb0c010430 con 0x7ffb20101a60 2024-09-18T12:48:13.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.300+0000 7ffb1dffb640 1 --2- 172.21.15.78:0/244017967 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7ffb1006e310 0x7ffb100707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:13.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.300+0000 7ffb1dffb640 1 -- 172.21.15.78:0/244017967 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7ffb0c08e750 con 0x7ffb20101a60 2024-09-18T12:48:13.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.300+0000 7ffb24e22640 1 --2- 172.21.15.78:0/244017967 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7ffb1006e310 0x7ffb100707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:13.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.300+0000 7ffb24e22640 1 --2- 172.21.15.78:0/244017967 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7ffb1006e310 0x7ffb100707d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009230 tx=0x7ffb140058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:13.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.304+0000 7ffb1dffb640 1 -- 172.21.15.78:0/244017967 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb0c05fc90 con 0x7ffb20101a60 2024-09-18T12:48:13.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.502+0000 7ffb27086640 1 -- 172.21.15.78:0/244017967 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ffb20106010 con 0x7ffb1006e310 2024-09-18T12:48:13.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.503+0000 7ffb1dffb640 1 -- 172.21.15.78:0/244017967 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7ffb20106010 con 0x7ffb1006e310 2024-09-18T12:48:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.506+0000 7ffb27086640 1 -- 172.21.15.78:0/244017967 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7ffb1006e310 msgr2=0x7ffb100707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.506+0000 7ffb27086640 1 --2- 172.21.15.78:0/244017967 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7ffb1006e310 0x7ffb100707d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009230 tx=0x7ffb140058d0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.506+0000 7ffb27086640 1 -- 172.21.15.78:0/244017967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb20101a60 msgr2=0x7ffb2019c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.506+0000 7ffb27086640 1 --2- 172.21.15.78:0/244017967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb20101a60 0x7ffb2019c200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00e970 tx=0x7ffb0c00ee30 comp rx=0 tx=0).stop 2024-09-18T12:48:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.507+0000 7ffb27086640 1 -- 172.21.15.78:0/244017967 shutdown_connections 2024-09-18T12:48:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.507+0000 7ffb27086640 1 --2- 172.21.15.78:0/244017967 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7ffb1006e310 0x7ffb100707d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.507+0000 7ffb27086640 1 --2- 172.21.15.78:0/244017967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb20101a60 0x7ffb2019c200 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.507+0000 7ffb27086640 1 --2- 172.21.15.78:0/244017967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb20100860 0x7ffb2006a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.507+0000 7ffb27086640 1 -- 172.21.15.78:0/244017967 >> 172.21.15.78:0/244017967 conn(0x7ffb200fc010 msgr2=0x7ffb200fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:13.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.507+0000 7ffb27086640 1 -- 172.21.15.78:0/244017967 shutdown_connections 2024-09-18T12:48:13.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.507+0000 7ffb27086640 1 -- 172.21.15.78:0/244017967 wait complete. 2024-09-18T12:48:13.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.599+0000 7fe2931e7640 1 -- 172.21.15.78:0/4249618615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe28c1023f0 msgr2=0x7fe28c1047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:13.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.599+0000 7fe2931e7640 1 --2- 172.21.15.78:0/4249618615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe28c1023f0 0x7fe28c1047e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe2800098b0 tx=0x7fe28002a4d0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.599+0000 7fe2931e7640 1 -- 172.21.15.78:0/4249618615 shutdown_connections 2024-09-18T12:48:13.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.599+0000 7fe2931e7640 1 --2- 172.21.15.78:0/4249618615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe28c104d20 0x7fe28c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.599+0000 7fe2931e7640 1 --2- 172.21.15.78:0/4249618615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe28c1023f0 0x7fe28c1047e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.599+0000 7fe2931e7640 1 -- 172.21.15.78:0/4249618615 >> 172.21.15.78:0/4249618615 conn(0x7fe28c0fc010 msgr2=0x7fe28c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:13.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.599+0000 7fe2931e7640 1 -- 172.21.15.78:0/4249618615 shutdown_connections 2024-09-18T12:48:13.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.599+0000 7fe2931e7640 1 -- 172.21.15.78:0/4249618615 wait complete. 2024-09-18T12:48:13.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.600+0000 7fe2931e7640 1 Processor -- start 2024-09-18T12:48:13.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.600+0000 7fe2931e7640 1 -- start start 2024-09-18T12:48:13.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.600+0000 7fe2931e7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe28c1023f0 0x7fe28c197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:13.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.600+0000 7fe2931e7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe28c104d20 0x7fe28c197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:13.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.600+0000 7fe2931e7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c10a7e0 con 0x7fe28c1023f0 2024-09-18T12:48:13.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.600+0000 7fe2931e7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c10a660 con 0x7fe28c104d20 2024-09-18T12:48:13.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.600+0000 7fe290f83640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe28c1023f0 0x7fe28c197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:13.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.600+0000 7fe28bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe28c104d20 0x7fe28c197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:13.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.600+0000 7fe290f83640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe28c1023f0 0x7fe28c197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52754/0 (socket says 172.21.15.78:52754) 2024-09-18T12:48:13.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.600+0000 7fe290f83640 1 -- 172.21.15.78:0/95784104 learned_addr learned my addr 172.21.15.78:0/95784104 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:48:13.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.601+0000 7fe290f83640 1 -- 172.21.15.78:0/95784104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe28c104d20 msgr2=0x7fe28c197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:13.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.601+0000 7fe290f83640 1 --2- 172.21.15.78:0/95784104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe28c104d20 0x7fe28c197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.601+0000 7fe290f83640 1 -- 172.21.15.78:0/95784104 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28c1980c0 con 0x7fe28c1023f0 2024-09-18T12:48:13.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.601+0000 7fe28bfff640 1 --2- 172.21.15.78:0/95784104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe28c104d20 0x7fe28c197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:48:13.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.601+0000 7fe290f83640 1 --2- 172.21.15.78:0/95784104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe28c1023f0 0x7fe28c197500 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe2800099d0 tx=0x7fe2800045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:13.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.601+0000 7fe289ffb640 1 -- 172.21.15.78:0/95784104 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe28003f070 con 0x7fe28c1023f0 2024-09-18T12:48:13.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.601+0000 7fe2931e7640 1 -- 172.21.15.78:0/95784104 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28c19caa0 con 0x7fe28c1023f0 2024-09-18T12:48:13.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.601+0000 7fe289ffb640 1 -- 172.21.15.78:0/95784104 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe280004a90 con 0x7fe28c1023f0 2024-09-18T12:48:13.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.601+0000 7fe2931e7640 1 -- 172.21.15.78:0/95784104 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28c19d030 con 0x7fe28c1023f0 2024-09-18T12:48:13.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.601+0000 7fe289ffb640 1 -- 172.21.15.78:0/95784104 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe280049060 con 0x7fe28c1023f0 2024-09-18T12:48:13.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.603+0000 7fe2931e7640 1 -- 172.21.15.78:0/95784104 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe28c1027d0 con 0x7fe28c1023f0 2024-09-18T12:48:13.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.604+0000 7fe289ffb640 1 -- 172.21.15.78:0/95784104 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe280042070 con 0x7fe28c1023f0 2024-09-18T12:48:13.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.604+0000 7fe289ffb640 1 --2- 172.21.15.78:0/95784104 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fe27c06e2b0 0x7fe27c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:13.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.604+0000 7fe289ffb640 1 -- 172.21.15.78:0/95784104 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fe2800aea00 con 0x7fe28c1023f0 2024-09-18T12:48:13.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.604+0000 7fe28bfff640 1 --2- 172.21.15.78:0/95784104 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fe27c06e2b0 0x7fe27c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:13.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.605+0000 7fe28bfff640 1 --2- 172.21.15.78:0/95784104 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fe27c06e2b0 0x7fe27c070770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe28c1989b0 tx=0x7fe278005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:13.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.610+0000 7fe289ffb640 1 -- 172.21.15.78:0/95784104 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe28007ffb0 con 0x7fe28c1023f0 2024-09-18T12:48:13.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.833+0000 7fe2931e7640 1 -- 172.21.15.78:0/95784104 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe28c105680 con 0x7fe27c06e2b0 2024-09-18T12:48:13.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.845+0000 7fe289ffb640 1 -- 172.21.15.78:0/95784104 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fe28c105680 con 0x7fe27c06e2b0 2024-09-18T12:48:13.847 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:48:13.847 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (5m) 81s ago 6m 26.6M - 0.25.0 c8568f914cd2 47a8b8bee5f5 2024-09-18T12:48:13.847 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (7m) 81s ago 7m 8308k - 19.1.1-330-gc2ddf972 ebb0615149de b314296d0168 2024-09-18T12:48:13.847 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (6m) 86s ago 6m 5272k - 19.1.1-330-gc2ddf972 ebb0615149de dad72664a205 2024-09-18T12:48:13.847 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (7m) 81s ago 7m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de bb77146b81c7 2024-09-18T12:48:13.847 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (6m) 86s ago 6m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de f82fdd264dc6 2024-09-18T12:48:13.847 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (5m) 81s ago 6m 80.5M - 9.4.12 2bacad6d85d8 0367cad8b635 2024-09-18T12:48:13.847 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (104s) 81s ago 103s 19.7M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:48:13.847 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (98s) 81s ago 98s 16.5M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:48:13.847 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (101s) 86s ago 101s 11.2M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:48:13.848 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (96s) 86s ago 95s 12.0M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:48:13.848 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:9283,8765,8443 running (8m) 81s ago 8m 500M - 19.1.1-330-gc2ddf972 ebb0615149de 284f2d8afd38 2024-09-18T12:48:13.848 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (6m) 86s ago 6m 440M - 19.1.1-330-gc2ddf972 ebb0615149de 2db5ffc08c95 2024-09-18T12:48:13.848 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (8m) 81s ago 8m 48.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1cb11a5bcd72 2024-09-18T12:48:13.848 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (6m) 86s ago 6m 35.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 02dfe1551226 2024-09-18T12:48:13.848 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (7m) 81s ago 7m 15.6M - 1.5.0 0da6a335fe13 3c6ba926bb86 2024-09-18T12:48:13.848 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (6m) 86s ago 6m 16.6M - 1.5.0 0da6a335fe13 4b7db3027dc5 2024-09-18T12:48:13.848 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (5m) 81s ago 5m 49.2M 3946M 19.1.1-330-gc2ddf972 ebb0615149de f634ad9ddb36 2024-09-18T12:48:13.848 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (4m) 81s ago 4m 55.6M 3946M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:48:13.848 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (4m) 81s ago 4m 54.3M 3946M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:48:13.848 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (3m) 86s ago 3m 53.6M 4970M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:48:13.848 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (3m) 86s ago 3m 42.0M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:48:13.848 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (2m) 86s ago 2m 49.0M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:48:13.849 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (5m) 81s ago 6m 52.7M - 2.43.0 a07b618ecd1d d012486d55b1 2024-09-18T12:48:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.848+0000 7fe2931e7640 1 -- 172.21.15.78:0/95784104 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fe27c06e2b0 msgr2=0x7fe27c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.848+0000 7fe2931e7640 1 --2- 172.21.15.78:0/95784104 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fe27c06e2b0 0x7fe27c070770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe28c1989b0 tx=0x7fe278005f90 comp rx=0 tx=0).stop 2024-09-18T12:48:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.848+0000 7fe2931e7640 1 -- 172.21.15.78:0/95784104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe28c1023f0 msgr2=0x7fe28c197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.848+0000 7fe2931e7640 1 --2- 172.21.15.78:0/95784104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe28c1023f0 0x7fe28c197500 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe2800099d0 tx=0x7fe2800045e0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.848+0000 7fe2931e7640 1 -- 172.21.15.78:0/95784104 shutdown_connections 2024-09-18T12:48:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.848+0000 7fe2931e7640 1 --2- 172.21.15.78:0/95784104 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fe27c06e2b0 0x7fe27c070770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.848+0000 7fe2931e7640 1 --2- 172.21.15.78:0/95784104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe28c104d20 0x7fe28c197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.848+0000 7fe2931e7640 1 --2- 172.21.15.78:0/95784104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe28c1023f0 0x7fe28c197500 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.848+0000 7fe2931e7640 1 -- 172.21.15.78:0/95784104 >> 172.21.15.78:0/95784104 conn(0x7fe28c0fc010 msgr2=0x7fe28c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.848+0000 7fe2931e7640 1 -- 172.21.15.78:0/95784104 shutdown_connections 2024-09-18T12:48:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.848+0000 7fe2931e7640 1 -- 172.21.15.78:0/95784104 wait complete. 2024-09-18T12:48:13.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.947+0000 7f86e98d0640 1 -- 172.21.15.78:0/3807299192 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86e4101a60 msgr2=0x7f86e4101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:13.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.947+0000 7f86e98d0640 1 --2- 172.21.15.78:0/3807299192 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86e4101a60 0x7f86e4101ee0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009880 tx=0x7f86d802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.947+0000 7f86e98d0640 1 -- 172.21.15.78:0/3807299192 shutdown_connections 2024-09-18T12:48:13.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.947+0000 7f86e98d0640 1 --2- 172.21.15.78:0/3807299192 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86e4101a60 0x7f86e4101ee0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.949 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:13 smithi078 ceph-mon[28091]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:13.949 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:13 smithi078 ceph-mon[28091]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:13.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.947+0000 7f86e98d0640 1 --2- 172.21.15.78:0/3807299192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e4100860 0x7f86e4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.947+0000 7f86e98d0640 1 -- 172.21.15.78:0/3807299192 >> 172.21.15.78:0/3807299192 conn(0x7f86e40fc010 msgr2=0x7f86e40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:13.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.947+0000 7f86e98d0640 1 -- 172.21.15.78:0/3807299192 shutdown_connections 2024-09-18T12:48:13.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.947+0000 7f86e98d0640 1 -- 172.21.15.78:0/3807299192 wait complete. 2024-09-18T12:48:13.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.948+0000 7f86e98d0640 1 Processor -- start 2024-09-18T12:48:13.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.948+0000 7f86e98d0640 1 -- start start 2024-09-18T12:48:13.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.949+0000 7f86e98d0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86e4100860 0x7f86e41963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:13.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.949+0000 7f86e98d0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e4101a60 0x7f86e4196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:13.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.949+0000 7f86e98d0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f86e41096a0 con 0x7f86e4100860 2024-09-18T12:48:13.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.949+0000 7f86e98d0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4109520 con 0x7f86e4101a60 2024-09-18T12:48:13.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.949+0000 7f86e27fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e4101a60 0x7f86e4196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:13.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.949+0000 7f86e27fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e4101a60 0x7f86e4196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.78:53688/0 (socket says 172.21.15.78:53688) 2024-09-18T12:48:13.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.949+0000 7f86e27fc640 1 -- 172.21.15.78:0/1329737120 learned_addr learned my addr 172.21.15.78:0/1329737120 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:48:13.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.949+0000 7f86e2ffd640 1 --2- 172.21.15.78:0/1329737120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86e4100860 0x7f86e41963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:13.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.949+0000 7f86e27fc640 1 -- 172.21.15.78:0/1329737120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86e4100860 msgr2=0x7f86e41963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:13.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.949+0000 7f86e27fc640 1 --2- 172.21.15.78:0/1329737120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86e4100860 0x7f86e41963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:13.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.949+0000 7f86e27fc640 1 -- 172.21.15.78:0/1329737120 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e4196fa0 con 0x7f86e4101a60 2024-09-18T12:48:13.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.950+0000 7f86e27fc640 1 --2- 172.21.15.78:0/1329737120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e4101a60 0x7f86e4196920 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86d8006010 tx=0x7f86d8004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:13.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.950+0000 7f86e88ce640 1 -- 172.21.15.78:0/1329737120 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86d8035070 con 0x7f86e4101a60 2024-09-18T12:48:13.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.950+0000 7f86e98d0640 1 -- 172.21.15.78:0/1329737120 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e4069ca0 con 0x7f86e4101a60 2024-09-18T12:48:13.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.950+0000 7f86e88ce640 1 -- 172.21.15.78:0/1329737120 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f86d80035f0 con 0x7f86e4101a60 2024-09-18T12:48:13.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.950+0000 7f86e88ce640 1 -- 172.21.15.78:0/1329737120 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86d8031810 con 0x7f86e4101a60 2024-09-18T12:48:13.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.950+0000 7f86e98d0640 1 -- 172.21.15.78:0/1329737120 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e406a230 con 0x7f86e4101a60 2024-09-18T12:48:13.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.951+0000 7f86e98d0640 1 -- 172.21.15.78:0/1329737120 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e4100c60 con 0x7f86e4101a60 2024-09-18T12:48:13.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.952+0000 7f86e88ce640 1 -- 172.21.15.78:0/1329737120 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f86d80037a0 con 0x7f86e4101a60 2024-09-18T12:48:13.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.953+0000 7f86e88ce640 1 --2- 172.21.15.78:0/1329737120 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f86cc06e310 0x7f86cc0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:13.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.953+0000 7f86e88ce640 1 -- 172.21.15.78:0/1329737120 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f86d803e070 con 0x7f86e4101a60 2024-09-18T12:48:13.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.953+0000 7f86e2ffd640 1 --2- 172.21.15.78:0/1329737120 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f86cc06e310 0x7f86cc0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:13.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.953+0000 7f86e2ffd640 1 --2- 172.21.15.78:0/1329737120 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f86cc06e310 0x7f86cc0707d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f86e41018c0 tx=0x7f86d4005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:13.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:13.959+0000 7f86e88ce640 1 -- 172.21.15.78:0/1329737120 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f86d807e0c0 con 0x7f86e4101a60 2024-09-18T12:48:14.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:13 smithi148 ceph-mon[35352]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:14.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:13 smithi148 ceph-mon[35352]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:14.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.264+0000 7f86e98d0640 1 -- 172.21.15.78:0/1329737120 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f86e419b920 con 0x7f86e4101a60 2024-09-18T12:48:14.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.265+0000 7f86e88ce640 1 -- 172.21.15.78:0/1329737120 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f86d8081d70 con 0x7f86e4101a60 2024-09-18T12:48:14.267 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:48:14.267 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:48:14.267 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:48:14.267 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:48:14.267 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:48:14.268 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:48:14.268 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:48:14.268 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:48:14.268 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:48:14.268 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:48:14.268 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:48:14.269 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:48:14.269 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:48:14.269 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:48:14.269 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-18T12:48:14.269 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:48:14.270 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:48:14.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.267+0000 7f86e98d0640 1 -- 172.21.15.78:0/1329737120 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f86cc06e310 msgr2=0x7f86cc0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:14.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.267+0000 7f86e98d0640 1 --2- 172.21.15.78:0/1329737120 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f86cc06e310 0x7f86cc0707d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f86e41018c0 tx=0x7f86d4005f90 comp rx=0 tx=0).stop 2024-09-18T12:48:14.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.267+0000 7f86e98d0640 1 -- 172.21.15.78:0/1329737120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e4101a60 msgr2=0x7f86e4196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:14.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.267+0000 7f86e98d0640 1 --2- 172.21.15.78:0/1329737120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e4101a60 0x7f86e4196920 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86d8006010 tx=0x7f86d8004570 comp rx=0 tx=0).stop 2024-09-18T12:48:14.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.267+0000 7f86e98d0640 1 -- 172.21.15.78:0/1329737120 shutdown_connections 2024-09-18T12:48:14.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.267+0000 7f86e98d0640 1 --2- 172.21.15.78:0/1329737120 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f86cc06e310 0x7f86cc0707d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.267+0000 7f86e98d0640 1 --2- 172.21.15.78:0/1329737120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e4101a60 0x7f86e4196920 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.267+0000 7f86e98d0640 1 --2- 172.21.15.78:0/1329737120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86e4100860 0x7f86e41963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.267+0000 7f86e98d0640 1 -- 172.21.15.78:0/1329737120 >> 172.21.15.78:0/1329737120 conn(0x7f86e40fc010 msgr2=0x7f86e4104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:14.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.268+0000 7f86e98d0640 1 -- 172.21.15.78:0/1329737120 shutdown_connections 2024-09-18T12:48:14.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.268+0000 7f86e98d0640 1 -- 172.21.15.78:0/1329737120 wait complete. 2024-09-18T12:48:14.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.385+0000 7f3a6f6ee640 1 -- 172.21.15.78:0/1306210404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a68101a80 msgr2=0x7f3a68101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:14.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.385+0000 7f3a6f6ee640 1 --2- 172.21.15.78:0/1306210404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a68101a80 0x7f3a68101f00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009880 tx=0x7f3a5802a4b0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.386+0000 7f3a6f6ee640 1 -- 172.21.15.78:0/1306210404 shutdown_connections 2024-09-18T12:48:14.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.386+0000 7f3a6f6ee640 1 --2- 172.21.15.78:0/1306210404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a68101a80 0x7f3a68101f00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.386+0000 7f3a6f6ee640 1 --2- 172.21.15.78:0/1306210404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a68100880 0x7f3a68100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.386+0000 7f3a6f6ee640 1 -- 172.21.15.78:0/1306210404 >> 172.21.15.78:0/1306210404 conn(0x7f3a680fc010 msgr2=0x7f3a680fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:14.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.386+0000 7f3a6f6ee640 1 -- 172.21.15.78:0/1306210404 shutdown_connections 2024-09-18T12:48:14.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.386+0000 7f3a6f6ee640 1 -- 172.21.15.78:0/1306210404 wait complete. 2024-09-18T12:48:14.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.386+0000 7f3a6f6ee640 1 Processor -- start 2024-09-18T12:48:14.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.386+0000 7f3a6f6ee640 1 -- start start 2024-09-18T12:48:14.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.387+0000 7f3a6f6ee640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a68100880 0x7f3a6806aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:14.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.387+0000 7f3a6f6ee640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a68101a80 0x7f3a6819c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.387+0000 7f3a6f6ee640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681096a0 con 0x7f3a68101a80 2024-09-18T12:48:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.387+0000 7f3a6f6ee640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68109520 con 0x7f3a68100880 2024-09-18T12:48:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.387+0000 7f3a6cc89640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a68101a80 0x7f3a6819c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.387+0000 7f3a6cc89640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a68101a80 0x7f3a6819c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52778/0 (socket says 172.21.15.78:52778) 2024-09-18T12:48:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.387+0000 7f3a6cc89640 1 -- 172.21.15.78:0/1412429803 learned_addr learned my addr 172.21.15.78:0/1412429803 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:48:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.387+0000 7f3a6d48a640 1 --2- 172.21.15.78:0/1412429803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a68100880 0x7f3a6806aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.387+0000 7f3a6d48a640 1 -- 172.21.15.78:0/1412429803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a68101a80 msgr2=0x7f3a6819c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.387+0000 7f3a6d48a640 1 --2- 172.21.15.78:0/1412429803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a68101a80 0x7f3a6819c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.387+0000 7f3a6d48a640 1 -- 172.21.15.78:0/1412429803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6819c7a0 con 0x7f3a68100880 2024-09-18T12:48:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.388+0000 7f3a6d48a640 1 --2- 172.21.15.78:0/1412429803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a68100880 0x7f3a6806aff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400e940 tx=0x7f3a6400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.388+0000 7f3a5e7fc640 1 -- 172.21.15.78:0/1412429803 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a6400cac0 con 0x7f3a68100880 2024-09-18T12:48:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.388+0000 7f3a5e7fc640 1 -- 172.21.15.78:0/1412429803 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a6400cc60 con 0x7f3a68100880 2024-09-18T12:48:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.388+0000 7f3a6f6ee640 1 -- 172.21.15.78:0/1412429803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a6819ca90 con 0x7f3a68100880 2024-09-18T12:48:14.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.388+0000 7f3a5e7fc640 1 -- 172.21.15.78:0/1412429803 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a64003e10 con 0x7f3a68100880 2024-09-18T12:48:14.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.389+0000 7f3a6f6ee640 1 -- 172.21.15.78:0/1412429803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a6819d020 con 0x7f3a68100880 2024-09-18T12:48:14.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.390+0000 7f3a6f6ee640 1 -- 172.21.15.78:0/1412429803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a68100c80 con 0x7f3a68100880 2024-09-18T12:48:14.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.390+0000 7f3a5e7fc640 1 -- 172.21.15.78:0/1412429803 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3a64004020 con 0x7f3a68100880 2024-09-18T12:48:14.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.391+0000 7f3a5e7fc640 1 --2- 172.21.15.78:0/1412429803 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f3a5406e2b0 0x7f3a54070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:14.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.391+0000 7f3a5e7fc640 1 -- 172.21.15.78:0/1412429803 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f3a6408e790 con 0x7f3a68100880 2024-09-18T12:48:14.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.391+0000 7f3a6cc89640 1 --2- 172.21.15.78:0/1412429803 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f3a5406e2b0 0x7f3a54070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:14.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.392+0000 7f3a6cc89640 1 --2- 172.21.15.78:0/1412429803 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f3a5406e2b0 0x7f3a54070770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3a580096c0 tx=0x7f3a58005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.396+0000 7f3a5e7fc640 1 -- 172.21.15.78:0/1412429803 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3a6405c000 con 0x7f3a68100880 2024-09-18T12:48:14.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.667+0000 7f3a6f6ee640 1 -- 172.21.15.78:0/1412429803 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3a68062630 con 0x7f3a5406e2b0 2024-09-18T12:48:14.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.669+0000 7f3a5e7fc640 1 -- 172.21.15.78:0/1412429803 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f3a68062630 con 0x7f3a5406e2b0 2024-09-18T12:48:14.670 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:48:14.671 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:48:14.671 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:48:14.671 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:48:14.671 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [], 2024-09-18T12:48:14.671 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "0/2 daemons upgraded", 2024-09-18T12:48:14.671 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 image on host smithi148", 2024-09-18T12:48:14.671 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:48:14.671 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:48:14.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.672+0000 7f3a6f6ee640 1 -- 172.21.15.78:0/1412429803 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f3a5406e2b0 msgr2=0x7f3a54070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:14.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.672+0000 7f3a6f6ee640 1 --2- 172.21.15.78:0/1412429803 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f3a5406e2b0 0x7f3a54070770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3a580096c0 tx=0x7f3a58005a20 comp rx=0 tx=0).stop 2024-09-18T12:48:14.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.672+0000 7f3a6f6ee640 1 -- 172.21.15.78:0/1412429803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a68100880 msgr2=0x7f3a6806aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:14.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.672+0000 7f3a6f6ee640 1 --2- 172.21.15.78:0/1412429803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a68100880 0x7f3a6806aff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400e940 tx=0x7f3a6400ee00 comp rx=0 tx=0).stop 2024-09-18T12:48:14.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.672+0000 7f3a6f6ee640 1 -- 172.21.15.78:0/1412429803 shutdown_connections 2024-09-18T12:48:14.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.672+0000 7f3a6f6ee640 1 --2- 172.21.15.78:0/1412429803 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f3a5406e2b0 0x7f3a54070770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.672+0000 7f3a6f6ee640 1 --2- 172.21.15.78:0/1412429803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a68101a80 0x7f3a6819c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.672+0000 7f3a6f6ee640 1 --2- 172.21.15.78:0/1412429803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a68100880 0x7f3a6806aff0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:14.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.672+0000 7f3a6f6ee640 1 -- 172.21.15.78:0/1412429803 >> 172.21.15.78:0/1412429803 conn(0x7f3a680fc010 msgr2=0x7f3a68104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:14.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.673+0000 7f3a6f6ee640 1 -- 172.21.15.78:0/1412429803 shutdown_connections 2024-09-18T12:48:14.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:14.673+0000 7f3a6f6ee640 1 -- 172.21.15.78:0/1412429803 wait complete. 2024-09-18T12:48:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:14 smithi078 ceph-mon[28091]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:14 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1329737120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:48:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:14 smithi078 ceph-mon[28091]: pgmap v231: 65 pgs: 65 active+clean; 28 MiB data, 274 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 75 op/s 2024-09-18T12:48:15.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:14 smithi148 ceph-mon[35352]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:15.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:14 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1329737120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:48:15.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:14 smithi148 ceph-mon[35352]: pgmap v231: 65 pgs: 65 active+clean; 28 MiB data, 274 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 75 op/s 2024-09-18T12:48:15.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:15 smithi078 ceph-mon[28091]: from='client.24351 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:16.099 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:15 smithi148 ceph-mon[35352]: from='client.24351 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:16.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:16 smithi078 ceph-mon[28091]: pgmap v232: 65 pgs: 65 active+clean; 35 MiB data, 299 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.9 MiB/s wr, 115 op/s 2024-09-18T12:48:17.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:16 smithi148 ceph-mon[35352]: pgmap v232: 65 pgs: 65 active+clean; 35 MiB data, 299 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.9 MiB/s wr, 115 op/s 2024-09-18T12:48:18.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:18 smithi148 ceph-mon[35352]: pgmap v233: 65 pgs: 65 active+clean; 45 MiB data, 320 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.8 MiB/s wr, 137 op/s 2024-09-18T12:48:18.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:18 smithi078 ceph-mon[28091]: pgmap v233: 65 pgs: 65 active+clean; 45 MiB data, 320 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.8 MiB/s wr, 137 op/s 2024-09-18T12:48:20.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:20 smithi148 ceph-mon[35352]: pgmap v234: 65 pgs: 65 active+clean; 53 MiB data, 350 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 MiB/s wr, 157 op/s 2024-09-18T12:48:20.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:20 smithi078 ceph-mon[28091]: pgmap v234: 65 pgs: 65 active+clean; 53 MiB data, 350 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 MiB/s wr, 157 op/s 2024-09-18T12:48:22.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:22 smithi148 ceph-mon[35352]: pgmap v235: 65 pgs: 65 active+clean; 61 MiB data, 374 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.3 MiB/s wr, 166 op/s 2024-09-18T12:48:22.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:22 smithi078 ceph-mon[28091]: pgmap v235: 65 pgs: 65 active+clean; 61 MiB data, 374 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.3 MiB/s wr, 166 op/s 2024-09-18T12:48:24.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:24 smithi148 ceph-mon[35352]: pgmap v236: 65 pgs: 65 active+clean; 67 MiB data, 410 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 MiB/s wr, 176 op/s 2024-09-18T12:48:24.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:24 smithi078 ceph-mon[28091]: pgmap v236: 65 pgs: 65 active+clean; 67 MiB data, 410 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 MiB/s wr, 176 op/s 2024-09-18T12:48:26.703 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:26 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:26 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:27.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:27 smithi148 ceph-mon[35352]: pgmap v237: 65 pgs: 65 active+clean; 86 MiB data, 459 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.9 MiB/s wr, 194 op/s 2024-09-18T12:48:27.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:27 smithi078 ceph-mon[28091]: pgmap v237: 65 pgs: 65 active+clean; 86 MiB data, 459 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.9 MiB/s wr, 194 op/s 2024-09-18T12:48:28.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:28 smithi148 ceph-mon[35352]: Upgrade: Updating mgr.smithi148.bfgshs 2024-09-18T12:48:28.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:28 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:28.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:28 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.bfgshs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:48:28.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:28 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:48:28.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:28 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:28.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:28 smithi148 ceph-mon[35352]: Deploying daemon mgr.smithi148.bfgshs on smithi148 2024-09-18T12:48:28.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:28 smithi078 ceph-mon[28091]: Upgrade: Updating mgr.smithi148.bfgshs 2024-09-18T12:48:28.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:28 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:28.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:28 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.bfgshs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:48:28.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:28 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:48:28.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:28 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:28.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:28 smithi078 ceph-mon[28091]: Deploying daemon mgr.smithi148.bfgshs on smithi148 2024-09-18T12:48:29.959 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:29 smithi148 ceph-mon[35352]: pgmap v238: 65 pgs: 65 active+clean; 94 MiB data, 495 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.0 MiB/s wr, 187 op/s 2024-09-18T12:48:29.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:29 smithi078 ceph-mon[28091]: pgmap v238: 65 pgs: 65 active+clean; 94 MiB data, 495 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.0 MiB/s wr, 187 op/s 2024-09-18T12:48:31.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:31 smithi148 ceph-mon[35352]: pgmap v239: 65 pgs: 65 active+clean; 98 MiB data, 513 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.5 MiB/s wr, 179 op/s 2024-09-18T12:48:31.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:31 smithi078 ceph-mon[28091]: pgmap v239: 65 pgs: 65 active+clean; 98 MiB data, 513 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.5 MiB/s wr, 179 op/s 2024-09-18T12:48:33.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:32 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:33.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:32 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:33.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:32 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:33.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:32 smithi148 ceph-mon[35352]: pgmap v240: 65 pgs: 65 active+clean; 103 MiB data, 527 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.2 MiB/s wr, 178 op/s 2024-09-18T12:48:33.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:32 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:33.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:32 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:33.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:32 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:33.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:32 smithi078 ceph-mon[28091]: pgmap v240: 65 pgs: 65 active+clean; 103 MiB data, 527 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.2 MiB/s wr, 178 op/s 2024-09-18T12:48:34.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:34 smithi148 ceph-mon[35352]: pgmap v241: 65 pgs: 65 active+clean; 108 MiB data, 560 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.0 MiB/s wr, 187 op/s 2024-09-18T12:48:34.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:34 smithi078 ceph-mon[28091]: pgmap v241: 65 pgs: 65 active+clean; 108 MiB data, 560 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.0 MiB/s wr, 187 op/s 2024-09-18T12:48:36.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:36 smithi148 ceph-mon[35352]: pgmap v242: 65 pgs: 65 active+clean; 117 MiB data, 589 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.2 MiB/s wr, 188 op/s 2024-09-18T12:48:36.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:36 smithi078 ceph-mon[28091]: pgmap v242: 65 pgs: 65 active+clean; 117 MiB data, 589 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.2 MiB/s wr, 188 op/s 2024-09-18T12:48:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:37 smithi148 ceph-mon[35352]: Standby manager daemon smithi148.bfgshs restarted 2024-09-18T12:48:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:37 smithi148 ceph-mon[35352]: Standby manager daemon smithi148.bfgshs started 2024-09-18T12:48:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:37 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/crt"}]: dispatch 2024-09-18T12:48:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:37 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:48:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:37 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/key"}]: dispatch 2024-09-18T12:48:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:37 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:48:37.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:37 smithi078 ceph-mon[28091]: Standby manager daemon smithi148.bfgshs restarted 2024-09-18T12:48:37.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:37 smithi078 ceph-mon[28091]: Standby manager daemon smithi148.bfgshs started 2024-09-18T12:48:37.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:37 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/crt"}]: dispatch 2024-09-18T12:48:37.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:37 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:48:37.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:37 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/key"}]: dispatch 2024-09-18T12:48:37.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:37 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:48:38.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:38 smithi148 ceph-mon[35352]: mgrmap e20: smithi078.ohifux(active, since 6m), standbys: smithi148.bfgshs 2024-09-18T12:48:38.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:38 smithi148 ceph-mon[35352]: pgmap v243: 65 pgs: 65 active+clean; 123 MiB data, 611 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.1 MiB/s wr, 159 op/s 2024-09-18T12:48:38.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:38 smithi078 ceph-mon[28091]: mgrmap e20: smithi078.ohifux(active, since 6m), standbys: smithi148.bfgshs 2024-09-18T12:48:38.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:38 smithi078 ceph-mon[28091]: pgmap v243: 65 pgs: 65 active+clean; 123 MiB data, 611 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.1 MiB/s wr, 159 op/s 2024-09-18T12:48:40.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:40 smithi148 ceph-mon[35352]: pgmap v244: 65 pgs: 65 active+clean; 126 MiB data, 617 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.8 MiB/s wr, 155 op/s 2024-09-18T12:48:40.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:40 smithi078 ceph-mon[28091]: pgmap v244: 65 pgs: 65 active+clean; 126 MiB data, 617 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.8 MiB/s wr, 155 op/s 2024-09-18T12:48:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:41 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:41.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:41 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:43 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:43 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:43 smithi148 ceph-mon[35352]: pgmap v245: 65 pgs: 65 active+clean; 140 MiB data, 641 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.6 MiB/s wr, 190 op/s 2024-09-18T12:48:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:43 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:43 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:43 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:43 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:43 smithi078 ceph-mon[28091]: pgmap v245: 65 pgs: 65 active+clean; 140 MiB data, 641 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.6 MiB/s wr, 190 op/s 2024-09-18T12:48:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:43 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:43 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:44.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.791+0000 7f1b98632640 1 -- 172.21.15.78:0/2851421381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b90100860 msgr2=0x7f1b90100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:44.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.791+0000 7f1b98632640 1 --2- 172.21.15.78:0/2851421381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b90100860 0x7f1b90100c60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000fa90 tx=0x7f1b8002e640 comp rx=0 tx=0).stop 2024-09-18T12:48:44.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.791+0000 7f1b98632640 1 -- 172.21.15.78:0/2851421381 shutdown_connections 2024-09-18T12:48:44.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.791+0000 7f1b98632640 1 --2- 172.21.15.78:0/2851421381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b90101a60 0x7f1b90101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:44.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.791+0000 7f1b98632640 1 --2- 172.21.15.78:0/2851421381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b90100860 0x7f1b90100c60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:44.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.791+0000 7f1b98632640 1 -- 172.21.15.78:0/2851421381 >> 172.21.15.78:0/2851421381 conn(0x7f1b900fc010 msgr2=0x7f1b900fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:44.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.791+0000 7f1b98632640 1 -- 172.21.15.78:0/2851421381 shutdown_connections 2024-09-18T12:48:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.791+0000 7f1b98632640 1 -- 172.21.15.78:0/2851421381 wait complete. 2024-09-18T12:48:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.791+0000 7f1b98632640 1 Processor -- start 2024-09-18T12:48:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.792+0000 7f1b98632640 1 -- start start 2024-09-18T12:48:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.792+0000 7f1b98632640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b90100860 0x7f1b9019da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.792+0000 7f1b98632640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b90101a60 0x7f1b9019dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.792+0000 7f1b98632640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1b90108570 con 0x7f1b90101a60 2024-09-18T12:48:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.792+0000 7f1b98632640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1b901083f0 con 0x7f1b90100860 2024-09-18T12:48:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.792+0000 7f1b963ce640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b90100860 0x7f1b9019da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.792+0000 7f1b963ce640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b90100860 0x7f1b9019da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.78:53454/0 (socket says 172.21.15.78:53454) 2024-09-18T12:48:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.792+0000 7f1b963ce640 1 -- 172.21.15.78:0/3706206925 learned_addr learned my addr 172.21.15.78:0/3706206925 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:48:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.792+0000 7f1b95bcd640 1 --2- 172.21.15.78:0/3706206925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b90101a60 0x7f1b9019dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.792+0000 7f1b963ce640 1 -- 172.21.15.78:0/3706206925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b90101a60 msgr2=0x7f1b9019dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.792+0000 7f1b963ce640 1 --2- 172.21.15.78:0/3706206925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b90101a60 0x7f1b9019dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.792+0000 7f1b963ce640 1 -- 172.21.15.78:0/3706206925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b9019e650 con 0x7f1b90100860 2024-09-18T12:48:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.793+0000 7f1b963ce640 1 --2- 172.21.15.78:0/3706206925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b90100860 0x7f1b9019da90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1b80037040 tx=0x7f1b8002ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.793+0000 7f1b877fe640 1 -- 172.21.15.78:0/3706206925 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b80004d30 con 0x7f1b90100860 2024-09-18T12:48:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.793+0000 7f1b98632640 1 -- 172.21.15.78:0/3706206925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b901a3090 con 0x7f1b90100860 2024-09-18T12:48:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.793+0000 7f1b877fe640 1 -- 172.21.15.78:0/3706206925 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b80004030 con 0x7f1b90100860 2024-09-18T12:48:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.793+0000 7f1b877fe640 1 -- 172.21.15.78:0/3706206925 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b8000e700 con 0x7f1b90100860 2024-09-18T12:48:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.793+0000 7f1b98632640 1 -- 172.21.15.78:0/3706206925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b901a36a0 con 0x7f1b90100860 2024-09-18T12:48:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.795+0000 7f1b98632640 1 -- 172.21.15.78:0/3706206925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b90100c60 con 0x7f1b90100860 2024-09-18T12:48:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.795+0000 7f1b877fe640 1 -- 172.21.15.78:0/3706206925 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 20) ==== 97939+0+0 (secure 0 0 0) 0x7f1b8000c050 con 0x7f1b90100860 2024-09-18T12:48:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.795+0000 7f1b877fe640 1 --2- 172.21.15.78:0/3706206925 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f1b7c074940 0x7f1b7c076e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.796+0000 7f1b95bcd640 1 --2- 172.21.15.78:0/3706206925 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f1b7c074940 0x7f1b7c076e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.796+0000 7f1b877fe640 1 -- 172.21.15.78:0/3706206925 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f1b800b67d0 con 0x7f1b90100860 2024-09-18T12:48:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.796+0000 7f1b95bcd640 1 --2- 172.21.15.78:0/3706206925 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f1b7c074940 0x7f1b7c076e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1b9019ef40 tx=0x7f1b8c005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:44.801+0000 7f1b877fe640 1 -- 172.21.15.78:0/3706206925 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b80084150 con 0x7f1b90100860 2024-09-18T12:48:44.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:44 smithi148 ceph-mon[35352]: pgmap v246: 65 pgs: 65 active+clean; 148 MiB data, 668 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.9 MiB/s wr, 223 op/s 2024-09-18T12:48:44.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:44 smithi078 ceph-mon[28091]: pgmap v246: 65 pgs: 65 active+clean; 148 MiB data, 668 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.9 MiB/s wr, 223 op/s 2024-09-18T12:48:45.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.103+0000 7f1b98632640 1 -- 172.21.15.78:0/3706206925 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1b90062630 con 0x7f1b7c074940 2024-09-18T12:48:45.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.104+0000 7f1b877fe640 1 -- 172.21.15.78:0/3706206925 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f1b90062630 con 0x7f1b7c074940 2024-09-18T12:48:45.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.107+0000 7f1b98632640 1 -- 172.21.15.78:0/3706206925 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f1b7c074940 msgr2=0x7f1b7c076e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.107+0000 7f1b98632640 1 --2- 172.21.15.78:0/3706206925 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f1b7c074940 0x7f1b7c076e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1b9019ef40 tx=0x7f1b8c005f90 comp rx=0 tx=0).stop 2024-09-18T12:48:45.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.107+0000 7f1b98632640 1 -- 172.21.15.78:0/3706206925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b90100860 msgr2=0x7f1b9019da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.107+0000 7f1b98632640 1 --2- 172.21.15.78:0/3706206925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b90100860 0x7f1b9019da90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1b80037040 tx=0x7f1b8002ee60 comp rx=0 tx=0).stop 2024-09-18T12:48:45.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.107+0000 7f1b98632640 1 -- 172.21.15.78:0/3706206925 shutdown_connections 2024-09-18T12:48:45.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.107+0000 7f1b98632640 1 --2- 172.21.15.78:0/3706206925 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f1b7c074940 0x7f1b7c076e00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.107+0000 7f1b98632640 1 --2- 172.21.15.78:0/3706206925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b90101a60 0x7f1b9019dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.107+0000 7f1b98632640 1 --2- 172.21.15.78:0/3706206925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b90100860 0x7f1b9019da90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.107+0000 7f1b98632640 1 -- 172.21.15.78:0/3706206925 >> 172.21.15.78:0/3706206925 conn(0x7f1b900fc010 msgr2=0x7f1b90104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:45.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.107+0000 7f1b98632640 1 -- 172.21.15.78:0/3706206925 shutdown_connections 2024-09-18T12:48:45.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.108+0000 7f1b98632640 1 -- 172.21.15.78:0/3706206925 wait complete. 2024-09-18T12:48:45.121 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:48:45.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.224+0000 7f73e5d9b640 1 -- 172.21.15.78:0/539878118 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73d8031740 con 0x7f73e8100860 2024-09-18T12:48:45.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.225+0000 7f73ed0c6640 1 -- 172.21.15.78:0/539878118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e8100860 msgr2=0x7f73e8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.225+0000 7f73ed0c6640 1 --2- 172.21.15.78:0/539878118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e8100860 0x7f73e8100c60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009880 tx=0x7f73d802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.225+0000 7f73ed0c6640 1 -- 172.21.15.78:0/539878118 shutdown_connections 2024-09-18T12:48:45.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.225+0000 7f73ed0c6640 1 --2- 172.21.15.78:0/539878118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73e8101a60 0x7f73e8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.225+0000 7f73ed0c6640 1 --2- 172.21.15.78:0/539878118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e8100860 0x7f73e8100c60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.225+0000 7f73ed0c6640 1 -- 172.21.15.78:0/539878118 >> 172.21.15.78:0/539878118 conn(0x7f73e80fc010 msgr2=0x7f73e80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:45.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.225+0000 7f73ed0c6640 1 -- 172.21.15.78:0/539878118 shutdown_connections 2024-09-18T12:48:45.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.225+0000 7f73ed0c6640 1 -- 172.21.15.78:0/539878118 wait complete. 2024-09-18T12:48:45.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.226+0000 7f73ed0c6640 1 Processor -- start 2024-09-18T12:48:45.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.226+0000 7f73ed0c6640 1 -- start start 2024-09-18T12:48:45.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.226+0000 7f73ed0c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e8100860 0x7f73e819db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:45.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.227+0000 7f73ed0c6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73e8101a60 0x7f73e819e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:45.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.227+0000 7f73ed0c6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f73e8107d00 con 0x7f73e8100860 2024-09-18T12:48:45.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.227+0000 7f73ed0c6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f73e8107b80 con 0x7f73e8101a60 2024-09-18T12:48:45.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.227+0000 7f73e659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73e8101a60 0x7f73e819e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:45.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.227+0000 7f73e6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e8100860 0x7f73e819db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:45.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.227+0000 7f73e6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e8100860 0x7f73e819db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35938/0 (socket says 172.21.15.78:35938) 2024-09-18T12:48:45.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.227+0000 7f73e6d9d640 1 -- 172.21.15.78:0/1115427830 learned_addr learned my addr 172.21.15.78:0/1115427830 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:48:45.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.227+0000 7f73e6d9d640 1 -- 172.21.15.78:0/1115427830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73e8101a60 msgr2=0x7f73e819e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.227+0000 7f73e6d9d640 1 --2- 172.21.15.78:0/1115427830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73e8101a60 0x7f73e819e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.227+0000 7f73e6d9d640 1 -- 172.21.15.78:0/1115427830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e819e6e0 con 0x7f73e8100860 2024-09-18T12:48:45.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.227+0000 7f73e6d9d640 1 --2- 172.21.15.78:0/1115427830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e8100860 0x7f73e819db20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f73d8006010 tx=0x7f73d80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:45.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.228+0000 7f73cffff640 1 -- 172.21.15.78:0/1115427830 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73d803f070 con 0x7f73e8100860 2024-09-18T12:48:45.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.228+0000 7f73cffff640 1 -- 172.21.15.78:0/1115427830 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f73d80049d0 con 0x7f73e8100860 2024-09-18T12:48:45.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.228+0000 7f73ed0c6640 1 -- 172.21.15.78:0/1115427830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73e81a30c0 con 0x7f73e8100860 2024-09-18T12:48:45.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.228+0000 7f73cffff640 1 -- 172.21.15.78:0/1115427830 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73d8035030 con 0x7f73e8100860 2024-09-18T12:48:45.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.228+0000 7f73ed0c6640 1 -- 172.21.15.78:0/1115427830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73e81a3650 con 0x7f73e8100860 2024-09-18T12:48:45.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.229+0000 7f73ed0c6640 1 -- 172.21.15.78:0/1115427830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73e8100c60 con 0x7f73e8100860 2024-09-18T12:48:45.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.229+0000 7f73cffff640 1 -- 172.21.15.78:0/1115427830 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 97939+0+0 (secure 0 0 0) 0x7f73d8042070 con 0x7f73e8100860 2024-09-18T12:48:45.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.230+0000 7f73cffff640 1 --2- 172.21.15.78:0/1115427830 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f73d0074940 0x7f73d0076e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:45.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.230+0000 7f73cffff640 1 -- 172.21.15.78:0/1115427830 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f73d80b6a40 con 0x7f73e8100860 2024-09-18T12:48:45.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.230+0000 7f73e659c640 1 --2- 172.21.15.78:0/1115427830 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f73d0074940 0x7f73d0076e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:45.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.231+0000 7f73e659c640 1 --2- 172.21.15.78:0/1115427830 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f73d0074940 0x7f73d0076e00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f73e819efd0 tx=0x7f73dc005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:45.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.237+0000 7f73cffff640 1 -- 172.21.15.78:0/1115427830 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73d8088070 con 0x7f73e8100860 2024-09-18T12:48:45.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.491+0000 7f73ed0c6640 1 -- 172.21.15.78:0/1115427830 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f73e8105d00 con 0x7f73d0074940 2024-09-18T12:48:45.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.492+0000 7f73cffff640 1 -- 172.21.15.78:0/1115427830 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f73e8105d00 con 0x7f73d0074940 2024-09-18T12:48:45.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.495+0000 7f73ed0c6640 1 -- 172.21.15.78:0/1115427830 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f73d0074940 msgr2=0x7f73d0076e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.495+0000 7f73ed0c6640 1 --2- 172.21.15.78:0/1115427830 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f73d0074940 0x7f73d0076e00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f73e819efd0 tx=0x7f73dc005f90 comp rx=0 tx=0).stop 2024-09-18T12:48:45.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.495+0000 7f73ed0c6640 1 -- 172.21.15.78:0/1115427830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e8100860 msgr2=0x7f73e819db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.495+0000 7f73ed0c6640 1 --2- 172.21.15.78:0/1115427830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e8100860 0x7f73e819db20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f73d8006010 tx=0x7f73d80045e0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.495+0000 7f73ed0c6640 1 -- 172.21.15.78:0/1115427830 shutdown_connections 2024-09-18T12:48:45.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.495+0000 7f73ed0c6640 1 --2- 172.21.15.78:0/1115427830 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f73d0074940 0x7f73d0076e00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.495+0000 7f73ed0c6640 1 --2- 172.21.15.78:0/1115427830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73e8101a60 0x7f73e819e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.495+0000 7f73ed0c6640 1 --2- 172.21.15.78:0/1115427830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e8100860 0x7f73e819db20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.495+0000 7f73ed0c6640 1 -- 172.21.15.78:0/1115427830 >> 172.21.15.78:0/1115427830 conn(0x7f73e80fc010 msgr2=0x7f73e80fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:45.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.496+0000 7f73ed0c6640 1 -- 172.21.15.78:0/1115427830 shutdown_connections 2024-09-18T12:48:45.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.496+0000 7f73ed0c6640 1 -- 172.21.15.78:0/1115427830 wait complete. 2024-09-18T12:48:45.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.589+0000 7f4669ce7640 1 -- 172.21.15.78:0/2133606559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4664100860 msgr2=0x7f4664100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.589+0000 7f4669ce7640 1 --2- 172.21.15.78:0/2133606559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4664100860 0x7f4664100c60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4654009880 tx=0x7f465402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.589+0000 7f4669ce7640 1 -- 172.21.15.78:0/2133606559 shutdown_connections 2024-09-18T12:48:45.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.589+0000 7f4669ce7640 1 --2- 172.21.15.78:0/2133606559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4664101a60 0x7f4664101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.589+0000 7f4669ce7640 1 --2- 172.21.15.78:0/2133606559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4664100860 0x7f4664100c60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.589+0000 7f4669ce7640 1 -- 172.21.15.78:0/2133606559 >> 172.21.15.78:0/2133606559 conn(0x7f46640fc010 msgr2=0x7f46640fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:45.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.589+0000 7f4669ce7640 1 -- 172.21.15.78:0/2133606559 shutdown_connections 2024-09-18T12:48:45.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.589+0000 7f4669ce7640 1 -- 172.21.15.78:0/2133606559 wait complete. 2024-09-18T12:48:45.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.590+0000 7f4669ce7640 1 Processor -- start 2024-09-18T12:48:45.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.590+0000 7f4669ce7640 1 -- start start 2024-09-18T12:48:45.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.590+0000 7f4669ce7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4664100860 0x7f46641963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:45.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.590+0000 7f4669ce7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4664101a60 0x7f46641968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:45.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.590+0000 7f4669ce7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4664109680 con 0x7f4664100860 2024-09-18T12:48:45.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.590+0000 7f4669ce7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4664109500 con 0x7f4664101a60 2024-09-18T12:48:45.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.590+0000 7f46637fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4664100860 0x7f46641963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:45.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.590+0000 7f46637fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4664100860 0x7f46641963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35960/0 (socket says 172.21.15.78:35960) 2024-09-18T12:48:45.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.590+0000 7f46637fe640 1 -- 172.21.15.78:0/2542223802 learned_addr learned my addr 172.21.15.78:0/2542223802 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:48:45.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.590+0000 7f465bfff640 1 --2- 172.21.15.78:0/2542223802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4664101a60 0x7f46641968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:45.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.591+0000 7f46637fe640 1 -- 172.21.15.78:0/2542223802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4664101a60 msgr2=0x7f46641968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.591+0000 7f46637fe640 1 --2- 172.21.15.78:0/2542223802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4664101a60 0x7f46641968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.591+0000 7f46637fe640 1 -- 172.21.15.78:0/2542223802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4664196f60 con 0x7f4664100860 2024-09-18T12:48:45.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.591+0000 7f465bfff640 1 --2- 172.21.15.78:0/2542223802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4664101a60 0x7f46641968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:48:45.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.591+0000 7f46637fe640 1 --2- 172.21.15.78:0/2542223802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4664100860 0x7f46641963a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4654006010 tx=0x7f46540048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:45.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.591+0000 7f46617fa640 1 -- 172.21.15.78:0/2542223802 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f465403f070 con 0x7f4664100860 2024-09-18T12:48:45.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.591+0000 7f46617fa640 1 -- 172.21.15.78:0/2542223802 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f46540044d0 con 0x7f4664100860 2024-09-18T12:48:45.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.591+0000 7f4669ce7640 1 -- 172.21.15.78:0/2542223802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466419b940 con 0x7f4664100860 2024-09-18T12:48:45.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.591+0000 7f46617fa640 1 -- 172.21.15.78:0/2542223802 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4654035030 con 0x7f4664100860 2024-09-18T12:48:45.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.591+0000 7f4669ce7640 1 -- 172.21.15.78:0/2542223802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466419bed0 con 0x7f4664100860 2024-09-18T12:48:45.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.592+0000 7f4669ce7640 1 -- 172.21.15.78:0/2542223802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4664100c60 con 0x7f4664100860 2024-09-18T12:48:45.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.593+0000 7f46617fa640 1 -- 172.21.15.78:0/2542223802 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 97939+0+0 (secure 0 0 0) 0x7f4654042070 con 0x7f4664100860 2024-09-18T12:48:45.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.594+0000 7f46617fa640 1 --2- 172.21.15.78:0/2542223802 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f4650074940 0x7f4650076e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:45.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.594+0000 7f46617fa640 1 -- 172.21.15.78:0/2542223802 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f46540b6b10 con 0x7f4664100860 2024-09-18T12:48:45.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.594+0000 7f465bfff640 1 --2- 172.21.15.78:0/2542223802 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f4650074940 0x7f4650076e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:45.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.594+0000 7f465bfff640 1 --2- 172.21.15.78:0/2542223802 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f4650074940 0x7f4650076e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4664197850 tx=0x7f464c00a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:45.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.599+0000 7f46617fa640 1 -- 172.21.15.78:0/2542223802 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4654088140 con 0x7f4664100860 2024-09-18T12:48:45.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.851+0000 7f4669ce7640 1 -- 172.21.15.78:0/2542223802 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4664106010 con 0x7f4650074940 2024-09-18T12:48:45.852 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:45 smithi078 ceph-mon[28091]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:45.852 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:45 smithi078 ceph-mon[28091]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:45.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.867+0000 7f46617fa640 1 -- 172.21.15.78:0/2542223802 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f4664106010 con 0x7f4650074940 2024-09-18T12:48:45.869 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:48:45.869 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (6m) 113s ago 7m 26.6M - 0.25.0 c8568f914cd2 47a8b8bee5f5 2024-09-18T12:48:45.869 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (7m) 113s ago 7m 8308k - 19.1.1-330-gc2ddf972 ebb0615149de b314296d0168 2024-09-18T12:48:45.869 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (6m) 3s ago 6m 5272k - 19.1.1-330-gc2ddf972 ebb0615149de dad72664a205 2024-09-18T12:48:45.869 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (7m) 113s ago 7m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de bb77146b81c7 2024-09-18T12:48:45.869 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (6m) 3s ago 6m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de f82fdd264dc6 2024-09-18T12:48:45.869 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (5m) 113s ago 7m 80.5M - 9.4.12 2bacad6d85d8 0367cad8b635 2024-09-18T12:48:45.869 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (2m) 113s ago 2m 19.7M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:48:45.869 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (2m) 113s ago 2m 16.5M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:48:45.869 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (2m) 3s ago 2m 11.9M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:48:45.870 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (2m) 3s ago 2m 12.7M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:48:45.870 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:9283,8765,8443 running (8m) 113s ago 8m 500M - 19.1.1-330-gc2ddf972 ebb0615149de 284f2d8afd38 2024-09-18T12:48:45.870 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (14s) 3s ago 6m 66.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1c064b119458 2024-09-18T12:48:45.870 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (8m) 113s ago 9m 48.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1cb11a5bcd72 2024-09-18T12:48:45.870 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (6m) 3s ago 6m 37.4M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 02dfe1551226 2024-09-18T12:48:45.870 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (7m) 113s ago 7m 15.6M - 1.5.0 0da6a335fe13 3c6ba926bb86 2024-09-18T12:48:45.870 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (6m) 3s ago 6m 16.5M - 1.5.0 0da6a335fe13 4b7db3027dc5 2024-09-18T12:48:45.870 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (5m) 113s ago 5m 49.2M 3946M 19.1.1-330-gc2ddf972 ebb0615149de f634ad9ddb36 2024-09-18T12:48:45.870 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (5m) 113s ago 5m 55.6M 3946M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:48:45.870 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (4m) 113s ago 4m 54.3M 3946M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:48:45.870 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (4m) 3s ago 4m 80.8M 4970M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:48:45.871 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (3m) 3s ago 3m 72.8M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:48:45.871 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (3m) 3s ago 3m 72.3M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:48:45.871 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (5m) 113s ago 7m 52.7M - 2.43.0 a07b618ecd1d d012486d55b1 2024-09-18T12:48:45.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.871+0000 7f4669ce7640 1 -- 172.21.15.78:0/2542223802 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f4650074940 msgr2=0x7f4650076e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.871+0000 7f4669ce7640 1 --2- 172.21.15.78:0/2542223802 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f4650074940 0x7f4650076e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4664197850 tx=0x7f464c00a2d0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.871+0000 7f4669ce7640 1 -- 172.21.15.78:0/2542223802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4664100860 msgr2=0x7f46641963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.871+0000 7f4669ce7640 1 --2- 172.21.15.78:0/2542223802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4664100860 0x7f46641963a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4654006010 tx=0x7f46540048f0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.871+0000 7f4669ce7640 1 -- 172.21.15.78:0/2542223802 shutdown_connections 2024-09-18T12:48:45.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.871+0000 7f4669ce7640 1 --2- 172.21.15.78:0/2542223802 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f4650074940 0x7f4650076e00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.871+0000 7f4669ce7640 1 --2- 172.21.15.78:0/2542223802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4664101a60 0x7f46641968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.871+0000 7f4669ce7640 1 --2- 172.21.15.78:0/2542223802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4664100860 0x7f46641963a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.871+0000 7f4669ce7640 1 -- 172.21.15.78:0/2542223802 >> 172.21.15.78:0/2542223802 conn(0x7f46640fc010 msgr2=0x7f46640fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:45.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.871+0000 7f4669ce7640 1 -- 172.21.15.78:0/2542223802 shutdown_connections 2024-09-18T12:48:45.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.871+0000 7f4669ce7640 1 -- 172.21.15.78:0/2542223802 wait complete. 2024-09-18T12:48:45.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.978+0000 7fa51890d640 1 -- 172.21.15.78:0/2173313728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa514104d20 msgr2=0x7fa514107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.978+0000 7fa51890d640 1 --2- 172.21.15.78:0/2173313728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa514104d20 0x7fa514107110 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa5080098b0 tx=0x7fa50802a4d0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.978+0000 7fa51890d640 1 -- 172.21.15.78:0/2173313728 shutdown_connections 2024-09-18T12:48:45.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.978+0000 7fa51890d640 1 --2- 172.21.15.78:0/2173313728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa514104d20 0x7fa514107110 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.978+0000 7fa51890d640 1 --2- 172.21.15.78:0/2173313728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5141023f0 0x7fa5141047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.978+0000 7fa51890d640 1 -- 172.21.15.78:0/2173313728 >> 172.21.15.78:0/2173313728 conn(0x7fa5140fc010 msgr2=0x7fa5140fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:45.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.978+0000 7fa51890d640 1 -- 172.21.15.78:0/2173313728 shutdown_connections 2024-09-18T12:48:45.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.978+0000 7fa51890d640 1 -- 172.21.15.78:0/2173313728 wait complete. 2024-09-18T12:48:45.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.979+0000 7fa51890d640 1 Processor -- start 2024-09-18T12:48:45.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.979+0000 7fa51890d640 1 -- start start 2024-09-18T12:48:45.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.979+0000 7fa51890d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5141023f0 0x7fa514197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:45.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.979+0000 7fa51890d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa514104d20 0x7fa514197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:45.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.979+0000 7fa51890d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa51410a790 con 0x7fa514104d20 2024-09-18T12:48:45.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.979+0000 7fa51890d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa51410a610 con 0x7fa5141023f0 2024-09-18T12:48:45.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.979+0000 7fa51259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5141023f0 0x7fa514197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:45.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.979+0000 7fa511d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa514104d20 0x7fa514197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.979+0000 7fa51259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5141023f0 0x7fa514197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.78:53518/0 (socket says 172.21.15.78:53518) 2024-09-18T12:48:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.979+0000 7fa51259c640 1 -- 172.21.15.78:0/879422136 learned_addr learned my addr 172.21.15.78:0/879422136 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:48:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.980+0000 7fa511d9b640 1 -- 172.21.15.78:0/879422136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5141023f0 msgr2=0x7fa514197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.980+0000 7fa511d9b640 1 --2- 172.21.15.78:0/879422136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5141023f0 0x7fa514197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.980+0000 7fa511d9b640 1 -- 172.21.15.78:0/879422136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5141980d0 con 0x7fa514104d20 2024-09-18T12:48:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.980+0000 7fa511d9b640 1 --2- 172.21.15.78:0/879422136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa514104d20 0x7fa514197a50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa508009230 tx=0x7fa5080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.980+0000 7fa5037fe640 1 -- 172.21.15.78:0/879422136 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa508035070 con 0x7fa514104d20 2024-09-18T12:48:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.980+0000 7fa51890d640 1 -- 172.21.15.78:0/879422136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5141001e0 con 0x7fa514104d20 2024-09-18T12:48:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.980+0000 7fa5037fe640 1 -- 172.21.15.78:0/879422136 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa50803a670 con 0x7fa514104d20 2024-09-18T12:48:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.980+0000 7fa5037fe640 1 -- 172.21.15.78:0/879422136 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa5080039b0 con 0x7fa514104d20 2024-09-18T12:48:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.980+0000 7fa51890d640 1 -- 172.21.15.78:0/879422136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa514100770 con 0x7fa514104d20 2024-09-18T12:48:45.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.982+0000 7fa51890d640 1 -- 172.21.15.78:0/879422136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5141027d0 con 0x7fa514104d20 2024-09-18T12:48:45.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.982+0000 7fa5037fe640 1 -- 172.21.15.78:0/879422136 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 97939+0+0 (secure 0 0 0) 0x7fa508003c70 con 0x7fa514104d20 2024-09-18T12:48:45.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.983+0000 7fa5037fe640 1 --2- 172.21.15.78:0/879422136 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa4fc074940 0x7fa4fc076e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:45.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.983+0000 7fa5037fe640 1 -- 172.21.15.78:0/879422136 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fa508040070 con 0x7fa514104d20 2024-09-18T12:48:45.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.983+0000 7fa51259c640 1 --2- 172.21.15.78:0/879422136 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa4fc074940 0x7fa4fc076e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:45.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.984+0000 7fa51259c640 1 --2- 172.21.15.78:0/879422136 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa4fc074940 0x7fa4fc076e00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa504009c90 tx=0x7fa504005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:45.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:45.989+0000 7fa5037fe640 1 -- 172.21.15.78:0/879422136 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa5080879c0 con 0x7fa514104d20 2024-09-18T12:48:46.068 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:45 smithi148 ceph-mon[35352]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:46.068 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:45 smithi148 ceph-mon[35352]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:46.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.364+0000 7fa51890d640 1 -- 172.21.15.78:0/879422136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa514101090 con 0x7fa514104d20 2024-09-18T12:48:46.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.365+0000 7fa5037fe640 1 -- 172.21.15.78:0/879422136 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7fa50808b670 con 0x7fa514104d20 2024-09-18T12:48:46.366 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:48:46.366 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:48:46.366 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:48:46.366 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:48:46.366 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:48:46.366 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-18T12:48:46.366 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:48:46.367 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:48:46.367 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:48:46.367 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:48:46.367 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:48:46.367 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:48:46.367 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:48:46.367 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:48:46.367 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:48:46.367 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 13, 2024-09-18T12:48:46.367 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:48:46.367 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:48:46.367 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:48:46.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.368+0000 7fa51890d640 1 -- 172.21.15.78:0/879422136 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa4fc074940 msgr2=0x7fa4fc076e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:46.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.368+0000 7fa51890d640 1 --2- 172.21.15.78:0/879422136 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa4fc074940 0x7fa4fc076e00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa504009c90 tx=0x7fa504005f90 comp rx=0 tx=0).stop 2024-09-18T12:48:46.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.368+0000 7fa51890d640 1 -- 172.21.15.78:0/879422136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa514104d20 msgr2=0x7fa514197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:46.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.368+0000 7fa51890d640 1 --2- 172.21.15.78:0/879422136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa514104d20 0x7fa514197a50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa508009230 tx=0x7fa5080045e0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.368+0000 7fa51890d640 1 -- 172.21.15.78:0/879422136 shutdown_connections 2024-09-18T12:48:46.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.368+0000 7fa51890d640 1 --2- 172.21.15.78:0/879422136 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7fa4fc074940 0x7fa4fc076e00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.368+0000 7fa51890d640 1 --2- 172.21.15.78:0/879422136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa514104d20 0x7fa514197a50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.368+0000 7fa51890d640 1 --2- 172.21.15.78:0/879422136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5141023f0 0x7fa514197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.368+0000 7fa51890d640 1 -- 172.21.15.78:0/879422136 >> 172.21.15.78:0/879422136 conn(0x7fa5140fc010 msgr2=0x7fa5140fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:46.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.369+0000 7fa51890d640 1 -- 172.21.15.78:0/879422136 shutdown_connections 2024-09-18T12:48:46.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.369+0000 7fa51890d640 1 -- 172.21.15.78:0/879422136 wait complete. 2024-09-18T12:48:46.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.475+0000 7f47df2ac640 1 -- 172.21.15.78:0/2890456449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47d8100860 msgr2=0x7f47d8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:46.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.475+0000 7f47df2ac640 1 --2- 172.21.15.78:0/2890456449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47d8100860 0x7f47d8100c60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009880 tx=0x7f47d402a4b0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.475+0000 7f47df2ac640 1 -- 172.21.15.78:0/2890456449 shutdown_connections 2024-09-18T12:48:46.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.475+0000 7f47df2ac640 1 --2- 172.21.15.78:0/2890456449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47d8101a60 0x7f47d8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.475+0000 7f47df2ac640 1 --2- 172.21.15.78:0/2890456449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47d8100860 0x7f47d8100c60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.475+0000 7f47df2ac640 1 -- 172.21.15.78:0/2890456449 >> 172.21.15.78:0/2890456449 conn(0x7f47d80fc010 msgr2=0x7f47d80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:46.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.475+0000 7f47df2ac640 1 -- 172.21.15.78:0/2890456449 shutdown_connections 2024-09-18T12:48:46.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.475+0000 7f47df2ac640 1 -- 172.21.15.78:0/2890456449 wait complete. 2024-09-18T12:48:46.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.475+0000 7f47df2ac640 1 Processor -- start 2024-09-18T12:48:46.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.476+0000 7f47df2ac640 1 -- start start 2024-09-18T12:48:46.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.476+0000 7f47df2ac640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47d8100860 0x7f47d8104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:46.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.476+0000 7f47df2ac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47d8101a60 0x7f47d8102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:46.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.476+0000 7f47df2ac640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f47d8109680 con 0x7f47d8101a60 2024-09-18T12:48:46.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.476+0000 7f47df2ac640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f47d8109500 con 0x7f47d8100860 2024-09-18T12:48:46.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.476+0000 7f47dc847640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47d8101a60 0x7f47d8102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:46.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.476+0000 7f47dc847640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47d8101a60 0x7f47d8102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36004/0 (socket says 172.21.15.78:36004) 2024-09-18T12:48:46.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.476+0000 7f47dd048640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47d8100860 0x7f47d8104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:46.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.476+0000 7f47dc847640 1 -- 172.21.15.78:0/3991918950 learned_addr learned my addr 172.21.15.78:0/3991918950 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:48:46.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.476+0000 7f47dc847640 1 -- 172.21.15.78:0/3991918950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47d8100860 msgr2=0x7f47d8104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:46.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.476+0000 7f47dc847640 1 --2- 172.21.15.78:0/3991918950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47d8100860 0x7f47d8104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.476+0000 7f47dc847640 1 -- 172.21.15.78:0/3991918950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d8103380 con 0x7f47d8101a60 2024-09-18T12:48:46.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.477+0000 7f47dc847640 1 --2- 172.21.15.78:0/3991918950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47d8101a60 0x7f47d8102e40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f47c800e970 tx=0x7f47c800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:46.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.477+0000 7f47ce7fc640 1 -- 172.21.15.78:0/3991918950 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47c800cac0 con 0x7f47d8101a60 2024-09-18T12:48:46.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.477+0000 7f47df2ac640 1 -- 172.21.15.78:0/3991918950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d8103670 con 0x7f47d8101a60 2024-09-18T12:48:46.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.477+0000 7f47ce7fc640 1 -- 172.21.15.78:0/3991918950 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47c800cc60 con 0x7f47d8101a60 2024-09-18T12:48:46.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.477+0000 7f47df2ac640 1 -- 172.21.15.78:0/3991918950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d8103c00 con 0x7f47d8101a60 2024-09-18T12:48:46.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.478+0000 7f47ce7fc640 1 -- 172.21.15.78:0/3991918950 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47c8010600 con 0x7f47d8101a60 2024-09-18T12:48:46.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.478+0000 7f47df2ac640 1 -- 172.21.15.78:0/3991918950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d8100c60 con 0x7f47d8101a60 2024-09-18T12:48:46.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.479+0000 7f47ce7fc640 1 -- 172.21.15.78:0/3991918950 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 97939+0+0 (secure 0 0 0) 0x7f47c801f020 con 0x7f47d8101a60 2024-09-18T12:48:46.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.480+0000 7f47ce7fc640 1 --2- 172.21.15.78:0/3991918950 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f47c40748f0 0x7f47c4076db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:46.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.480+0000 7f47ce7fc640 1 -- 172.21.15.78:0/3991918950 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f47c8096910 con 0x7f47d8101a60 2024-09-18T12:48:46.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.480+0000 7f47dd048640 1 --2- 172.21.15.78:0/3991918950 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f47c40748f0 0x7f47c4076db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:46.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.480+0000 7f47dd048640 1 --2- 172.21.15.78:0/3991918950 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f47c40748f0 0x7f47c4076db0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009230 tx=0x7f47d40058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:46.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.483+0000 7f47ce7fc640 1 -- 172.21.15.78:0/3991918950 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47c8064290 con 0x7f47d8101a60 2024-09-18T12:48:46.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.762+0000 7f47df2ac640 1 -- 172.21.15.78:0/3991918950 --> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f47d806a3e0 con 0x7f47c40748f0 2024-09-18T12:48:46.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.763+0000 7f47ce7fc640 1 -- 172.21.15.78:0/3991918950 <== mgr.14217 v2:172.21.15.78:6800/934367305 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f47d806a3e0 con 0x7f47c40748f0 2024-09-18T12:48:46.764 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:48:46.764 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:48:46.765 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:48:46.765 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:48:46.765 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [], 2024-09-18T12:48:46.765 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "1/2 daemons upgraded", 2024-09-18T12:48:46.765 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mgr daemons", 2024-09-18T12:48:46.765 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:48:46.765 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:48:46.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.765+0000 7f47df2ac640 1 -- 172.21.15.78:0/3991918950 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f47c40748f0 msgr2=0x7f47c4076db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:46.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.765+0000 7f47df2ac640 1 --2- 172.21.15.78:0/3991918950 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f47c40748f0 0x7f47c4076db0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009230 tx=0x7f47d40058d0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.765+0000 7f47df2ac640 1 -- 172.21.15.78:0/3991918950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47d8101a60 msgr2=0x7f47d8102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:46.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.765+0000 7f47df2ac640 1 --2- 172.21.15.78:0/3991918950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47d8101a60 0x7f47d8102e40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f47c800e970 tx=0x7f47c800ee30 comp rx=0 tx=0).stop 2024-09-18T12:48:46.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.766+0000 7f47df2ac640 1 -- 172.21.15.78:0/3991918950 shutdown_connections 2024-09-18T12:48:46.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.766+0000 7f47df2ac640 1 --2- 172.21.15.78:0/3991918950 >> [v2:172.21.15.78:6800/934367305,v1:172.21.15.78:6801/934367305] conn(0x7f47c40748f0 0x7f47c4076db0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.766+0000 7f47df2ac640 1 --2- 172.21.15.78:0/3991918950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47d8101a60 0x7f47d8102e40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.766+0000 7f47df2ac640 1 --2- 172.21.15.78:0/3991918950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47d8100860 0x7f47d8104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.766+0000 7f47df2ac640 1 -- 172.21.15.78:0/3991918950 >> 172.21.15.78:0/3991918950 conn(0x7f47d80fc010 msgr2=0x7f47d8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:46.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.766+0000 7f47df2ac640 1 -- 172.21.15.78:0/3991918950 shutdown_connections 2024-09-18T12:48:46.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:48:46.766+0000 7f47df2ac640 1 -- 172.21.15.78:0/3991918950 wait complete. 2024-09-18T12:48:47.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:47 smithi078 ceph-mon[28091]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:47.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:47 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/879422136' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:48:47.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:47 smithi078 ceph-mon[28091]: pgmap v247: 65 pgs: 65 active+clean; 159 MiB data, 683 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.4 MiB/s wr, 268 op/s 2024-09-18T12:48:47.285 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:47 smithi148 ceph-mon[35352]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:47.285 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:47 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/879422136' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:48:47.285 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:47 smithi148 ceph-mon[35352]: pgmap v247: 65 pgs: 65 active+clean; 159 MiB data, 683 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.4 MiB/s wr, 268 op/s 2024-09-18T12:48:48.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:48 smithi148 ceph-mon[35352]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:48.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:48 smithi078 ceph-mon[28091]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:49.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:49 smithi148 ceph-mon[35352]: pgmap v248: 65 pgs: 65 active+clean; 162 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.9 MiB/s wr, 286 op/s 2024-09-18T12:48:49.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:49 smithi078 ceph-mon[28091]: pgmap v248: 65 pgs: 65 active+clean; 162 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.9 MiB/s wr, 286 op/s 2024-09-18T12:48:51.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:51.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:51.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:51.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:51.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:51.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:51.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr fail", "who": "smithi078.ohifux"}]: dispatch 2024-09-18T12:48:51.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: Activating manager daemon smithi148.bfgshs 2024-09-18T12:48:51.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "mgr fail", "who": "smithi078.ohifux"}]': finished 2024-09-18T12:48:51.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: osdmap e46: 6 total, 6 up, 6 in 2024-09-18T12:48:51.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: mgrmap e21: smithi148.bfgshs(active, starting, since 0.00749189s) 2024-09-18T12:48:51.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:48:51.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:48:51.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi078.eakgoe"}]: dispatch 2024-09-18T12:48:51.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi078.furyab"}]: dispatch 2024-09-18T12:48:51.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.tvvouo"}]: dispatch 2024-09-18T12:48:51.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.fqecmm"}]: dispatch 2024-09-18T12:48:51.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mgr metadata", "who": "smithi148.bfgshs", "id": "smithi148.bfgshs"}]: dispatch 2024-09-18T12:48:51.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:48:51.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:48:51.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:48:51.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:48:51.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:48:51.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:48:51.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:48:51.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:48:51.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:48:51.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:51 smithi148 ceph-mon[35352]: Manager daemon smithi148.bfgshs is now available 2024-09-18T12:48:51.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:51.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:51.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:51.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:51.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' 2024-09-18T12:48:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr fail", "who": "smithi078.ohifux"}]: dispatch 2024-09-18T12:48:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: Activating manager daemon smithi148.bfgshs 2024-09-18T12:48:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.14217 172.21.15.78:0/3338749656' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "mgr fail", "who": "smithi078.ohifux"}]': finished 2024-09-18T12:48:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: osdmap e46: 6 total, 6 up, 6 in 2024-09-18T12:48:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: mgrmap e21: smithi148.bfgshs(active, starting, since 0.00749189s) 2024-09-18T12:48:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:48:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:48:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi078.eakgoe"}]: dispatch 2024-09-18T12:48:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi078.furyab"}]: dispatch 2024-09-18T12:48:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.tvvouo"}]: dispatch 2024-09-18T12:48:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.fqecmm"}]: dispatch 2024-09-18T12:48:51.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mgr metadata", "who": "smithi148.bfgshs", "id": "smithi148.bfgshs"}]: dispatch 2024-09-18T12:48:51.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:48:51.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:48:51.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:48:51.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:48:51.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:48:51.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:48:51.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:48:51.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:48:51.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:48:51.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:51 smithi078 ceph-mon[28091]: Manager daemon smithi148.bfgshs is now available 2024-09-18T12:48:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:52 smithi078 ceph-mon[28091]: mgrmap e22: smithi148.bfgshs(active, since 1.00997s) 2024-09-18T12:48:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:52 smithi078 ceph-mon[28091]: pgmap v3: 65 pgs: 65 active+clean; 182 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:52 smithi148 ceph-mon[35352]: mgrmap e22: smithi148.bfgshs(active, since 1.00997s) 2024-09-18T12:48:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:52 smithi148 ceph-mon[35352]: pgmap v3: 65 pgs: 65 active+clean; 182 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:53 smithi148 ceph-mon[35352]: pgmap v4: 65 pgs: 65 active+clean; 182 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:53 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:48:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:53 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:48:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:53 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:48:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:53 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:53 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:53 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:48:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:53 smithi148 ceph-mon[35352]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:48:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:53 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.bfgshs/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:48:54.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:53 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.bfgshs/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:48:54.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:53 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.bfgshs/trash_purge_schedule"}]: dispatch 2024-09-18T12:48:54.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:53 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.bfgshs/trash_purge_schedule"}]: dispatch 2024-09-18T12:48:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:53 smithi078 ceph-mon[28091]: pgmap v4: 65 pgs: 65 active+clean; 182 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:53 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:48:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:53 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:48:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:53 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:48:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:53 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:53 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:53 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:48:54.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:53 smithi078 ceph-mon[28091]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:48:54.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:53 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.bfgshs/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:48:54.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:53 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.bfgshs/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:48:54.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:53 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.bfgshs/trash_purge_schedule"}]: dispatch 2024-09-18T12:48:54.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:53 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.bfgshs/trash_purge_schedule"}]: dispatch 2024-09-18T12:48:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:54 smithi078 ceph-mon[28091]: Deploying cephadm binary to smithi148 2024-09-18T12:48:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:54 smithi078 ceph-mon[28091]: Deploying cephadm binary to smithi078 2024-09-18T12:48:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:54 smithi078 ceph-mon[28091]: [18/Sep/2024:12:48:53] ENGINE Bus STARTING 2024-09-18T12:48:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:54 smithi078 ceph-mon[28091]: [18/Sep/2024:12:48:53] ENGINE Serving on https://172.21.15.148:7150 2024-09-18T12:48:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:54 smithi078 ceph-mon[28091]: [18/Sep/2024:12:48:53] ENGINE Error in HTTPServer.serve 2024-09-18T12:48:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Traceback (most recent call last): 2024-09-18T12:48:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:48:54.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:48:54.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:48:54.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self._run(expiration_interval) 2024-09-18T12:48:54.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:48:54.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:48:54.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:48:54.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:48:54.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:48:54.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: s = self.context.wrap_socket( 2024-09-18T12:48:54.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:48:54.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: return self.sslsocket_class._create( 2024-09-18T12:48:54.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:48:54.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self.do_handshake() 2024-09-18T12:48:54.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:48:54.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self._sslobj.do_handshake() 2024-09-18T12:48:54.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:48:54.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:54 smithi078 ceph-mon[28091]: mgrmap e23: smithi148.bfgshs(active, since 4s) 2024-09-18T12:48:55.012 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:54 smithi148 ceph-mon[35352]: Deploying cephadm binary to smithi148 2024-09-18T12:48:55.012 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:54 smithi148 ceph-mon[35352]: Deploying cephadm binary to smithi078 2024-09-18T12:48:55.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:54 smithi148 ceph-mon[35352]: [18/Sep/2024:12:48:53] ENGINE Bus STARTING 2024-09-18T12:48:55.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:54 smithi148 ceph-mon[35352]: [18/Sep/2024:12:48:53] ENGINE Serving on https://172.21.15.148:7150 2024-09-18T12:48:55.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:54 smithi148 ceph-mon[35352]: [18/Sep/2024:12:48:53] ENGINE Error in HTTPServer.serve 2024-09-18T12:48:55.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Traceback (most recent call last): 2024-09-18T12:48:55.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:48:55.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:48:55.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:48:55.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: self._run(expiration_interval) 2024-09-18T12:48:55.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:48:55.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:48:55.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:48:55.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:48:55.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:48:55.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: s = self.context.wrap_socket( 2024-09-18T12:48:55.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:48:55.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: return self.sslsocket_class._create( 2024-09-18T12:48:55.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:48:55.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: self.do_handshake() 2024-09-18T12:48:55.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:48:55.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: self._sslobj.do_handshake() 2024-09-18T12:48:55.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:48:55.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:54 smithi148 ceph-mon[35352]: mgrmap e23: smithi148.bfgshs(active, since 4s) 2024-09-18T12:48:55.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:55 smithi148 ceph-mon[35352]: [18/Sep/2024:12:48:53] ENGINE Serving on http://172.21.15.148:8765 2024-09-18T12:48:55.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:55 smithi148 ceph-mon[35352]: [18/Sep/2024:12:48:53] ENGINE Bus STARTED 2024-09-18T12:48:55.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:55 smithi148 ceph-mon[35352]: pgmap v5: 65 pgs: 65 active+clean; 182 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:56.063 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:55 smithi078 ceph-mon[28091]: [18/Sep/2024:12:48:53] ENGINE Serving on http://172.21.15.148:8765 2024-09-18T12:48:56.063 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:55 smithi078 ceph-mon[28091]: [18/Sep/2024:12:48:53] ENGINE Bus STARTED 2024-09-18T12:48:56.063 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:55 smithi078 ceph-mon[28091]: pgmap v5: 65 pgs: 65 active+clean; 182 MiB data, 778 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:56.736 INFO:tasks.workunit.client.0.smithi078.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-18T12:48:56.744 INFO:tasks.workunit.client.0.smithi078.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-18T12:48:56.744 INFO:tasks.workunit.client.0.smithi078.stderr:+ make 2024-09-18T12:48:57.019 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:56 smithi078 ceph-mon[28091]: mgrmap e24: smithi148.bfgshs(active, since 5s) 2024-09-18T12:48:57.145 INFO:tasks.workunit.client.0.smithi078.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-18T12:48:57.222 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:56 smithi148 ceph-mon[35352]: mgrmap e24: smithi148.bfgshs(active, since 5s) 2024-09-18T12:48:57.804 INFO:tasks.workunit.client.0.smithi078.stderr:++ readlink -f fsstress 2024-09-18T12:48:57.805 INFO:tasks.workunit.client.0.smithi078.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-18T12:48:57.806 INFO:tasks.workunit.client.0.smithi078.stderr:+ popd 2024-09-18T12:48:57.806 INFO:tasks.workunit.client.0.smithi078.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-18T12:48:57.807 INFO:tasks.workunit.client.0.smithi078.stderr:+ popd 2024-09-18T12:48:57.807 INFO:tasks.workunit.client.0.smithi078.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-18T12:48:57.808 INFO:tasks.workunit.client.0.smithi078.stderr:++ mktemp -d -p . 2024-09-18T12:48:57.810 INFO:tasks.workunit.client.0.smithi078.stderr:+ T=./tmp.yAeSTZ1uBq 2024-09-18T12:48:57.810 INFO:tasks.workunit.client.0.smithi078.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.yAeSTZ1uBq -l 1 -n 1000 -p 10 -v 2024-09-18T12:48:57.813 INFO:tasks.workunit.client.0.smithi078.stdout:seed = 1726391927 2024-09-18T12:48:57.820 INFO:tasks.workunit.client.0.smithi078.stdout:1/0: unlink - no file 2024-09-18T12:48:57.820 INFO:tasks.workunit.client.0.smithi078.stdout:1/1: chown . 13 1 2024-09-18T12:48:57.821 INFO:tasks.workunit.client.0.smithi078.stdout:1/2: dread - no filename 2024-09-18T12:48:57.821 INFO:tasks.workunit.client.0.smithi078.stdout:1/3: chown . 127 1 2024-09-18T12:48:57.821 INFO:tasks.workunit.client.0.smithi078.stdout:0/0: mknod c0 0 2024-09-18T12:48:57.821 INFO:tasks.workunit.client.0.smithi078.stdout:2/0: write - no filename 2024-09-18T12:48:57.822 INFO:tasks.workunit.client.0.smithi078.stdout:0/1: creat f1 x:0 0 0 2024-09-18T12:48:57.823 INFO:tasks.workunit.client.0.smithi078.stdout:1/4: mkdir d0 0 2024-09-18T12:48:57.823 INFO:tasks.workunit.client.0.smithi078.stdout:1/5: unlink - no file 2024-09-18T12:48:57.824 INFO:tasks.workunit.client.0.smithi078.stdout:0/2: write f1 [780610,42750] 0 2024-09-18T12:48:57.824 INFO:tasks.workunit.client.0.smithi078.stdout:0/3: readlink - no filename 2024-09-18T12:48:57.825 INFO:tasks.workunit.client.0.smithi078.stdout:3/0: dread - no filename 2024-09-18T12:48:57.825 INFO:tasks.workunit.client.0.smithi078.stdout:3/1: fsync - no filename 2024-09-18T12:48:57.825 INFO:tasks.workunit.client.0.smithi078.stdout:3/2: dread - no filename 2024-09-18T12:48:57.828 INFO:tasks.workunit.client.0.smithi078.stdout:2/1: getdents . 0 2024-09-18T12:48:57.828 INFO:tasks.workunit.client.0.smithi078.stdout:2/2: dwrite - no filename 2024-09-18T12:48:57.829 INFO:tasks.workunit.client.0.smithi078.stdout:4/0: dread - no filename 2024-09-18T12:48:57.829 INFO:tasks.workunit.client.0.smithi078.stdout:2/3: dread - no filename 2024-09-18T12:48:57.829 INFO:tasks.workunit.client.0.smithi078.stdout:3/3: symlink l0 0 2024-09-18T12:48:57.831 INFO:tasks.workunit.client.0.smithi078.stdout:3/4: chown l0 124 1 2024-09-18T12:48:57.831 INFO:tasks.workunit.client.0.smithi078.stdout:3/5: dwrite - no filename 2024-09-18T12:48:57.833 INFO:tasks.workunit.client.0.smithi078.stdout:2/4: mknod c0 0 2024-09-18T12:48:57.833 INFO:tasks.workunit.client.0.smithi078.stdout:2/5: fdatasync - no filename 2024-09-18T12:48:57.834 INFO:tasks.workunit.client.0.smithi078.stdout:4/1: getdents . 0 2024-09-18T12:48:57.834 INFO:tasks.workunit.client.0.smithi078.stdout:6/0: stat - no entries 2024-09-18T12:48:57.834 INFO:tasks.workunit.client.0.smithi078.stdout:0/4: dwrite f1 [0,4194304] 0 2024-09-18T12:48:57.836 INFO:tasks.workunit.client.0.smithi078.stdout:2/6: unlink c0 0 2024-09-18T12:48:57.837 INFO:tasks.workunit.client.0.smithi078.stdout:5/0: creat f0 x:0 0 0 2024-09-18T12:48:57.839 INFO:tasks.workunit.client.0.smithi078.stdout:5/1: truncate f0 696634 0 2024-09-18T12:48:57.840 INFO:tasks.workunit.client.0.smithi078.stdout:0/5: creat f2 x:0 0 0 2024-09-18T12:48:57.840 INFO:tasks.workunit.client.0.smithi078.stdout:5/2: write f0 [300385,8576] 0 2024-09-18T12:48:57.841 INFO:tasks.workunit.client.0.smithi078.stdout:5/3: write f0 [803778,55454] 0 2024-09-18T12:48:57.843 INFO:tasks.workunit.client.0.smithi078.stdout:8/0: link - no file 2024-09-18T12:48:57.844 INFO:tasks.workunit.client.0.smithi078.stdout:2/7: symlink l1 0 2024-09-18T12:48:57.845 INFO:tasks.workunit.client.0.smithi078.stdout:6/1: symlink l0 0 2024-09-18T12:48:57.845 INFO:tasks.workunit.client.0.smithi078.stdout:6/2: write - no filename 2024-09-18T12:48:57.845 INFO:tasks.workunit.client.0.smithi078.stdout:6/3: read - no filename 2024-09-18T12:48:57.845 INFO:tasks.workunit.client.0.smithi078.stdout:6/4: dread - no filename 2024-09-18T12:48:57.845 INFO:tasks.workunit.client.0.smithi078.stdout:6/5: read - no filename 2024-09-18T12:48:57.846 INFO:tasks.workunit.client.0.smithi078.stdout:2/8: readlink l1 0 2024-09-18T12:48:57.846 INFO:tasks.workunit.client.0.smithi078.stdout:7/0: mknod c0 0 2024-09-18T12:48:57.847 INFO:tasks.workunit.client.0.smithi078.stdout:0/6: mkdir d3 0 2024-09-18T12:48:57.848 INFO:tasks.workunit.client.0.smithi078.stdout:7/1: chown c0 7270183 1 2024-09-18T12:48:57.848 INFO:tasks.workunit.client.0.smithi078.stdout:7/2: write - no filename 2024-09-18T12:48:57.850 INFO:tasks.workunit.client.0.smithi078.stdout:2/9: creat f2 x:0 0 0 2024-09-18T12:48:57.850 INFO:tasks.workunit.client.0.smithi078.stdout:9/0: dwrite - no filename 2024-09-18T12:48:57.850 INFO:tasks.workunit.client.0.smithi078.stdout:9/1: truncate - no filename 2024-09-18T12:48:57.850 INFO:tasks.workunit.client.0.smithi078.stdout:9/2: dwrite - no filename 2024-09-18T12:48:57.852 INFO:tasks.workunit.client.0.smithi078.stdout:8/1: mkdir d0 0 2024-09-18T12:48:57.853 INFO:tasks.workunit.client.0.smithi078.stdout:7/3: symlink l1 0 2024-09-18T12:48:57.854 INFO:tasks.workunit.client.0.smithi078.stdout:5/4: dwrite f0 [0,4194304] 0 2024-09-18T12:48:57.855 INFO:tasks.workunit.client.0.smithi078.stdout:7/4: chown l1 1333 1 2024-09-18T12:48:57.856 INFO:tasks.workunit.client.0.smithi078.stdout:2/10: creat f3 x:0 0 0 2024-09-18T12:48:57.857 INFO:tasks.workunit.client.0.smithi078.stdout:2/11: dread - f2 zero size 2024-09-18T12:48:57.857 INFO:tasks.workunit.client.0.smithi078.stdout:0/7: dread f1 [0,4194304] 0 2024-09-18T12:48:57.857 INFO:tasks.workunit.client.0.smithi078.stdout:0/8: dread - f2 zero size 2024-09-18T12:48:57.857 INFO:tasks.workunit.client.0.smithi078.stdout:2/12: chown f3 378726 1 2024-09-18T12:48:57.859 INFO:tasks.workunit.client.0.smithi078.stdout:6/6: link l0 l1 0 2024-09-18T12:48:57.859 INFO:tasks.workunit.client.0.smithi078.stdout:6/7: write - no filename 2024-09-18T12:48:57.863 INFO:tasks.workunit.client.0.smithi078.stdout:7/5: mknod c2 0 2024-09-18T12:48:57.863 INFO:tasks.workunit.client.0.smithi078.stdout:7/6: dwrite - no filename 2024-09-18T12:48:57.863 INFO:tasks.workunit.client.0.smithi078.stdout:7/7: write - no filename 2024-09-18T12:48:57.863 INFO:tasks.workunit.client.0.smithi078.stdout:7/8: dwrite - no filename 2024-09-18T12:48:57.863 INFO:tasks.workunit.client.0.smithi078.stdout:7/9: readlink l1 0 2024-09-18T12:48:57.864 INFO:tasks.workunit.client.0.smithi078.stdout:8/2: creat d0/f1 x:0 0 0 2024-09-18T12:48:57.870 INFO:tasks.workunit.client.0.smithi078.stdout:7/10: symlink l3 0 2024-09-18T12:48:57.870 INFO:tasks.workunit.client.0.smithi078.stdout:7/11: write - no filename 2024-09-18T12:48:57.870 INFO:tasks.workunit.client.0.smithi078.stdout:7/12: write - no filename 2024-09-18T12:48:57.873 INFO:tasks.workunit.client.0.smithi078.stdout:8/3: dwrite d0/f1 [0,4194304] 0 2024-09-18T12:48:57.874 INFO:tasks.workunit.client.0.smithi078.stdout:6/8: chown l1 8 1 2024-09-18T12:48:57.878 INFO:tasks.workunit.client.0.smithi078.stdout:8/4: dread d0/f1 [0,4194304] 0 2024-09-18T12:48:57.881 INFO:tasks.workunit.client.0.smithi078.stdout:7/13: mknod c4 0 2024-09-18T12:48:57.881 INFO:tasks.workunit.client.0.smithi078.stdout:7/14: dwrite - no filename 2024-09-18T12:48:57.881 INFO:tasks.workunit.client.0.smithi078.stdout:7/15: truncate - no filename 2024-09-18T12:48:57.886 INFO:tasks.workunit.client.0.smithi078.stdout:6/9: creat f2 x:0 0 0 2024-09-18T12:48:57.887 INFO:tasks.workunit.client.0.smithi078.stdout:6/10: dread - f2 zero size 2024-09-18T12:48:57.888 INFO:tasks.workunit.client.0.smithi078.stdout:6/11: write f2 [297412,84460] 0 2024-09-18T12:48:57.889 INFO:tasks.workunit.client.0.smithi078.stdout:8/5: creat d0/f2 x:0 0 0 2024-09-18T12:48:57.890 INFO:tasks.workunit.client.0.smithi078.stdout:7/16: unlink c2 0 2024-09-18T12:48:57.897 INFO:tasks.workunit.client.0.smithi078.stdout:6/12: dread f2 [0,4194304] 0 2024-09-18T12:48:57.897 INFO:tasks.workunit.client.0.smithi078.stdout:6/13: rmdir - no directory 2024-09-18T12:48:57.899 INFO:tasks.workunit.client.0.smithi078.stdout:8/6: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:48:57.899 INFO:tasks.workunit.client.0.smithi078.stdout:6/14: dread f2 [0,4194304] 0 2024-09-18T12:48:57.899 INFO:tasks.workunit.client.0.smithi078.stdout:6/15: rmdir - no directory 2024-09-18T12:48:57.899 INFO:tasks.workunit.client.0.smithi078.stdout:8/7: chown d0/f1 14 1 2024-09-18T12:48:57.900 INFO:tasks.workunit.client.0.smithi078.stdout:6/16: dread f2 [0,4194304] 0 2024-09-18T12:48:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:57 smithi078 ceph-mon[28091]: pgmap v6: 65 pgs: 65 active+clean; 187 MiB data, 792 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 159 op/s 2024-09-18T12:48:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:57 smithi078 ceph-mon[28091]: Standby manager daemon smithi078.ohifux started 2024-09-18T12:48:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:57 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.78:0/3221145470' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi078.ohifux/crt"}]: dispatch 2024-09-18T12:48:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:57 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.78:0/3221145470' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:48:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:57 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.78:0/3221145470' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi078.ohifux/key"}]: dispatch 2024-09-18T12:48:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:57 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.78:0/3221145470' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:48:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:57 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:48:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:57 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:48:58.050 INFO:tasks.workunit.client.0.smithi078.stdout:6/17: stat l1 0 2024-09-18T12:48:58.054 INFO:tasks.workunit.client.0.smithi078.stdout:6/18: chown l1 98663034 1 2024-09-18T12:48:58.055 INFO:tasks.workunit.client.0.smithi078.stdout:6/19: creat f3 x:0 0 0 2024-09-18T12:48:58.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:57 smithi148 ceph-mon[35352]: pgmap v6: 65 pgs: 65 active+clean; 187 MiB data, 792 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 159 op/s 2024-09-18T12:48:58.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:57 smithi148 ceph-mon[35352]: Standby manager daemon smithi078.ohifux started 2024-09-18T12:48:58.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:57 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.78:0/3221145470' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi078.ohifux/crt"}]: dispatch 2024-09-18T12:48:58.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:57 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.78:0/3221145470' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:48:58.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:57 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.78:0/3221145470' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi078.ohifux/key"}]: dispatch 2024-09-18T12:48:58.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:57 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.78:0/3221145470' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:48:58.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:57 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:48:58.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:57 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:48:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:0/9: fsync f1 0 2024-09-18T12:48:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:0/10: readlink - no filename 2024-09-18T12:48:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:3/6: getdents . 0 2024-09-18T12:48:58.295 INFO:tasks.workunit.client.0.smithi078.stdout:3/7: symlink l1 0 2024-09-18T12:48:58.297 INFO:tasks.workunit.client.0.smithi078.stdout:3/8: chown l1 275832070 1 2024-09-18T12:48:58.297 INFO:tasks.workunit.client.0.smithi078.stdout:3/9: stat l0 0 2024-09-18T12:48:58.298 INFO:tasks.workunit.client.0.smithi078.stdout:0/11: dwrite f2 [0,4194304] 0 2024-09-18T12:48:58.301 INFO:tasks.workunit.client.0.smithi078.stdout:3/10: mknod c2 0 2024-09-18T12:48:58.301 INFO:tasks.workunit.client.0.smithi078.stdout:5/5: getdents . 0 2024-09-18T12:48:58.302 INFO:tasks.workunit.client.0.smithi078.stdout:5/6: write f0 [122952,21084] 0 2024-09-18T12:48:58.303 INFO:tasks.workunit.client.0.smithi078.stdout:5/7: stat f0 0 2024-09-18T12:48:58.304 INFO:tasks.workunit.client.0.smithi078.stdout:3/11: rename l0 to l3 0 2024-09-18T12:48:58.307 INFO:tasks.workunit.client.0.smithi078.stdout:5/8: dread f0 [0,4194304] 0 2024-09-18T12:48:58.309 INFO:tasks.workunit.client.0.smithi078.stdout:3/12: rename c2 to c4 0 2024-09-18T12:48:58.311 INFO:tasks.workunit.client.0.smithi078.stdout:5/9: creat f1 x:0 0 0 2024-09-18T12:48:58.313 INFO:tasks.workunit.client.0.smithi078.stdout:3/13: mknod c5 0 2024-09-18T12:48:58.313 INFO:tasks.workunit.client.0.smithi078.stdout:3/14: dwrite - no filename 2024-09-18T12:48:58.315 INFO:tasks.workunit.client.0.smithi078.stdout:5/10: write f0 [3924663,34733] 0 2024-09-18T12:48:58.316 INFO:tasks.workunit.client.0.smithi078.stdout:5/11: dread - f1 zero size 2024-09-18T12:48:58.316 INFO:tasks.workunit.client.0.smithi078.stdout:5/12: fdatasync f1 0 2024-09-18T12:48:58.319 INFO:tasks.workunit.client.0.smithi078.stdout:5/13: mkdir d2 0 2024-09-18T12:48:58.320 INFO:tasks.workunit.client.0.smithi078.stdout:2/13: getdents . 0 2024-09-18T12:48:58.323 INFO:tasks.workunit.client.0.smithi078.stdout:2/14: unlink f3 0 2024-09-18T12:48:58.323 INFO:tasks.workunit.client.0.smithi078.stdout:5/14: dread f0 [0,4194304] 0 2024-09-18T12:48:58.323 INFO:tasks.workunit.client.0.smithi078.stdout:2/15: readlink l1 0 2024-09-18T12:48:58.324 INFO:tasks.workunit.client.0.smithi078.stdout:5/15: chown f0 1840959 1 2024-09-18T12:48:58.327 INFO:tasks.workunit.client.0.smithi078.stdout:2/16: mkdir d4 0 2024-09-18T12:48:58.328 INFO:tasks.workunit.client.0.smithi078.stdout:2/17: write f2 [627411,58441] 0 2024-09-18T12:48:58.329 INFO:tasks.workunit.client.0.smithi078.stdout:5/16: getdents d2 0 2024-09-18T12:48:58.331 INFO:tasks.workunit.client.0.smithi078.stdout:6/20: fsync f2 0 2024-09-18T12:48:58.332 INFO:tasks.workunit.client.0.smithi078.stdout:6/21: write f2 [1022274,2550] 0 2024-09-18T12:48:58.333 INFO:tasks.workunit.client.0.smithi078.stdout:6/22: read f2 [113517,54804] 0 2024-09-18T12:48:58.333 INFO:tasks.workunit.client.0.smithi078.stdout:2/18: creat d4/f5 x:0 0 0 2024-09-18T12:48:58.333 INFO:tasks.workunit.client.0.smithi078.stdout:2/19: chown l1 3657 1 2024-09-18T12:48:58.334 INFO:tasks.workunit.client.0.smithi078.stdout:5/17: creat d2/f3 x:0 0 0 2024-09-18T12:48:58.335 INFO:tasks.workunit.client.0.smithi078.stdout:5/18: chown d2/f3 12 1 2024-09-18T12:48:58.335 INFO:tasks.workunit.client.0.smithi078.stdout:5/19: readlink - no filename 2024-09-18T12:48:58.338 INFO:tasks.workunit.client.0.smithi078.stdout:6/23: symlink l4 0 2024-09-18T12:48:58.339 INFO:tasks.workunit.client.0.smithi078.stdout:2/20: mknod d4/c6 0 2024-09-18T12:48:58.342 INFO:tasks.workunit.client.0.smithi078.stdout:5/20: mkdir d2/d4 0 2024-09-18T12:48:58.345 INFO:tasks.workunit.client.0.smithi078.stdout:2/21: unlink f2 0 2024-09-18T12:48:58.348 INFO:tasks.workunit.client.0.smithi078.stdout:6/24: dwrite f3 [0,4194304] 0 2024-09-18T12:48:58.348 INFO:tasks.workunit.client.0.smithi078.stdout:2/22: truncate d4/f5 87487 0 2024-09-18T12:48:58.348 INFO:tasks.workunit.client.0.smithi078.stdout:2/23: dread d4/f5 [0,4194304] 0 2024-09-18T12:48:58.349 INFO:tasks.workunit.client.0.smithi078.stdout:2/24: write d4/f5 [1041987,108805] 0 2024-09-18T12:48:58.351 INFO:tasks.workunit.client.0.smithi078.stdout:6/25: unlink f2 0 2024-09-18T12:48:58.352 INFO:tasks.workunit.client.0.smithi078.stdout:2/25: fdatasync d4/f5 0 2024-09-18T12:48:58.352 INFO:tasks.workunit.client.0.smithi078.stdout:2/26: fdatasync d4/f5 0 2024-09-18T12:48:58.356 INFO:tasks.workunit.client.0.smithi078.stdout:5/21: creat d2/d4/f5 x:0 0 0 2024-09-18T12:48:58.360 INFO:tasks.workunit.client.0.smithi078.stdout:5/22: dread f0 [0,4194304] 0 2024-09-18T12:48:58.360 INFO:tasks.workunit.client.0.smithi078.stdout:5/23: dread - d2/f3 zero size 2024-09-18T12:48:58.361 INFO:tasks.workunit.client.0.smithi078.stdout:5/24: dread - d2/f3 zero size 2024-09-18T12:48:58.361 INFO:tasks.workunit.client.0.smithi078.stdout:2/27: write d4/f5 [1081175,74933] 0 2024-09-18T12:48:58.366 INFO:tasks.workunit.client.0.smithi078.stdout:6/26: rename l0 to l5 0 2024-09-18T12:48:58.367 INFO:tasks.workunit.client.0.smithi078.stdout:5/25: mknod d2/c6 0 2024-09-18T12:48:58.370 INFO:tasks.workunit.client.0.smithi078.stdout:2/28: creat d4/f7 x:0 0 0 2024-09-18T12:48:58.373 INFO:tasks.workunit.client.0.smithi078.stdout:5/26: creat d2/f7 x:0 0 0 2024-09-18T12:48:58.373 INFO:tasks.workunit.client.0.smithi078.stdout:2/29: mkdir d4/d8 0 2024-09-18T12:48:58.374 INFO:tasks.workunit.client.0.smithi078.stdout:2/30: chown d4/c6 27819033 1 2024-09-18T12:48:58.374 INFO:tasks.workunit.client.0.smithi078.stdout:2/31: chown d4/c6 6969 1 2024-09-18T12:48:58.376 INFO:tasks.workunit.client.0.smithi078.stdout:6/27: fdatasync f3 0 2024-09-18T12:48:58.377 INFO:tasks.workunit.client.0.smithi078.stdout:2/32: rename d4/f7 to d4/f9 0 2024-09-18T12:48:58.378 INFO:tasks.workunit.client.0.smithi078.stdout:6/28: mknod c6 0 2024-09-18T12:48:58.379 INFO:tasks.workunit.client.0.smithi078.stdout:6/29: write f3 [3798902,103361] 0 2024-09-18T12:48:58.379 INFO:tasks.workunit.client.0.smithi078.stdout:2/33: mknod d4/ca 0 2024-09-18T12:48:58.380 INFO:tasks.workunit.client.0.smithi078.stdout:6/30: write f3 [1335483,130594] 0 2024-09-18T12:48:58.424 INFO:tasks.workunit.client.0.smithi078.stdout:3/15: getdents . 0 2024-09-18T12:48:58.424 INFO:tasks.workunit.client.0.smithi078.stdout:3/16: chown l1 0 1 2024-09-18T12:48:58.424 INFO:tasks.workunit.client.0.smithi078.stdout:3/17: dwrite - no filename 2024-09-18T12:48:58.429 INFO:tasks.workunit.client.0.smithi078.stdout:5/27: fsync d2/f3 0 2024-09-18T12:48:58.432 INFO:tasks.workunit.client.0.smithi078.stdout:5/28: rename d2/f3 to d2/d4/f8 0 2024-09-18T12:48:58.442 INFO:tasks.workunit.client.0.smithi078.stdout:6/31: readlink l5 0 2024-09-18T12:48:58.442 INFO:tasks.workunit.client.0.smithi078.stdout:6/32: rmdir - no directory 2024-09-18T12:48:58.448 INFO:tasks.workunit.client.0.smithi078.stdout:6/33: getdents . 0 2024-09-18T12:48:58.448 INFO:tasks.workunit.client.0.smithi078.stdout:6/34: read f3 [614088,124810] 0 2024-09-18T12:48:58.452 INFO:tasks.workunit.client.0.smithi078.stdout:2/34: truncate d4/f5 1056160 0 2024-09-18T12:48:58.452 INFO:tasks.workunit.client.0.smithi078.stdout:6/35: dread f3 [0,4194304] 0 2024-09-18T12:48:58.454 INFO:tasks.workunit.client.0.smithi078.stdout:2/35: mkdir d4/db 0 2024-09-18T12:48:58.458 INFO:tasks.workunit.client.0.smithi078.stdout:2/36: mkdir d4/db/dc 0 2024-09-18T12:48:58.458 INFO:tasks.workunit.client.0.smithi078.stdout:2/37: chown d4/c6 734 1 2024-09-18T12:48:58.461 INFO:tasks.workunit.client.0.smithi078.stdout:6/36: link l5 l7 0 2024-09-18T12:48:58.464 INFO:tasks.workunit.client.0.smithi078.stdout:6/37: symlink l8 0 2024-09-18T12:48:58.466 INFO:tasks.workunit.client.0.smithi078.stdout:6/38: creat f9 x:0 0 0 2024-09-18T12:48:58.469 INFO:tasks.workunit.client.0.smithi078.stdout:5/29: getdents d2/d4 0 2024-09-18T12:48:58.470 INFO:tasks.workunit.client.0.smithi078.stdout:6/39: dread f3 [0,4194304] 0 2024-09-18T12:48:58.470 INFO:tasks.workunit.client.0.smithi078.stdout:5/30: mkdir d2/d4/d9 0 2024-09-18T12:48:58.471 INFO:tasks.workunit.client.0.smithi078.stdout:6/40: creat fa x:0 0 0 2024-09-18T12:48:58.473 INFO:tasks.workunit.client.0.smithi078.stdout:5/31: mkdir d2/d4/d9/da 0 2024-09-18T12:48:58.482 INFO:tasks.workunit.client.0.smithi078.stdout:6/41: dwrite fa [0,4194304] 0 2024-09-18T12:48:58.483 INFO:tasks.workunit.client.0.smithi078.stdout:2/38: dread d4/f5 [0,4194304] 0 2024-09-18T12:48:58.485 INFO:tasks.workunit.client.0.smithi078.stdout:2/39: read - d4/f9 zero size 2024-09-18T12:48:58.489 INFO:tasks.workunit.client.0.smithi078.stdout:5/32: dwrite d2/f7 [0,4194304] 0 2024-09-18T12:48:58.492 INFO:tasks.workunit.client.0.smithi078.stdout:6/42: dread fa [0,4194304] 0 2024-09-18T12:48:58.493 INFO:tasks.workunit.client.0.smithi078.stdout:6/43: stat l8 0 2024-09-18T12:48:58.493 INFO:tasks.workunit.client.0.smithi078.stdout:2/40: mkdir d4/dd 0 2024-09-18T12:48:58.494 INFO:tasks.workunit.client.0.smithi078.stdout:5/33: dread f0 [0,4194304] 0 2024-09-18T12:48:58.495 INFO:tasks.workunit.client.0.smithi078.stdout:5/34: chown d2/c6 12 1 2024-09-18T12:48:58.496 INFO:tasks.workunit.client.0.smithi078.stdout:6/44: creat fb x:0 0 0 2024-09-18T12:48:58.497 INFO:tasks.workunit.client.0.smithi078.stdout:2/41: mknod d4/db/ce 0 2024-09-18T12:48:58.498 INFO:tasks.workunit.client.0.smithi078.stdout:2/42: stat d4/db/ce 0 2024-09-18T12:48:58.499 INFO:tasks.workunit.client.0.smithi078.stdout:5/35: symlink d2/d4/d9/lb 0 2024-09-18T12:48:58.502 INFO:tasks.workunit.client.0.smithi078.stdout:2/43: rename d4/c6 to d4/db/dc/cf 0 2024-09-18T12:48:58.502 INFO:tasks.workunit.client.0.smithi078.stdout:5/36: creat d2/fc x:0 0 0 2024-09-18T12:48:58.503 INFO:tasks.workunit.client.0.smithi078.stdout:6/45: truncate fa 473425 0 2024-09-18T12:48:58.508 INFO:tasks.workunit.client.0.smithi078.stdout:6/46: dwrite f9 [0,4194304] 0 2024-09-18T12:48:58.657 INFO:tasks.workunit.client.0.smithi078.stdout:5/37: mknod d2/cd 0 2024-09-18T12:48:58.657 INFO:tasks.workunit.client.0.smithi078.stdout:2/44: mknod d4/d8/c10 0 2024-09-18T12:48:58.794 INFO:tasks.workunit.client.0.smithi078.stdout:6/47: rename l1 to lc 0 2024-09-18T12:48:58.796 INFO:tasks.workunit.client.0.smithi078.stdout:2/45: rename l1 to d4/dd/l11 0 2024-09-18T12:48:58.797 INFO:tasks.workunit.client.0.smithi078.stdout:6/48: symlink ld 0 2024-09-18T12:48:58.798 INFO:tasks.workunit.client.0.smithi078.stdout:6/49: write fb [404419,120143] 0 2024-09-18T12:48:58.800 INFO:tasks.workunit.client.0.smithi078.stdout:5/38: dwrite f0 [0,4194304] 0 2024-09-18T12:48:58.801 INFO:tasks.workunit.client.0.smithi078.stdout:5/39: dread - d2/fc zero size 2024-09-18T12:48:58.802 INFO:tasks.workunit.client.0.smithi078.stdout:5/40: read - d2/fc zero size 2024-09-18T12:48:58.803 INFO:tasks.workunit.client.0.smithi078.stdout:5/41: chown d2/c6 21114804 1 2024-09-18T12:48:58.804 INFO:tasks.workunit.client.0.smithi078.stdout:6/50: dread f3 [0,4194304] 0 2024-09-18T12:48:58.804 INFO:tasks.workunit.client.0.smithi078.stdout:6/51: rmdir - no directory 2024-09-18T12:48:58.805 INFO:tasks.workunit.client.0.smithi078.stdout:5/42: creat d2/fe x:0 0 0 2024-09-18T12:48:58.806 INFO:tasks.workunit.client.0.smithi078.stdout:5/43: dread - f1 zero size 2024-09-18T12:48:58.806 INFO:tasks.workunit.client.0.smithi078.stdout:6/52: mknod ce 0 2024-09-18T12:48:58.808 INFO:tasks.workunit.client.0.smithi078.stdout:6/53: fsync f3 0 2024-09-18T12:48:58.815 INFO:tasks.workunit.client.0.smithi078.stdout:6/54: dwrite fb [0,4194304] 0 2024-09-18T12:48:58.818 INFO:tasks.workunit.client.0.smithi078.stdout:6/55: rename fa to ff 0 2024-09-18T12:48:58.821 INFO:tasks.workunit.client.0.smithi078.stdout:6/56: mkdir d10 0 2024-09-18T12:48:58.825 INFO:tasks.workunit.client.0.smithi078.stdout:6/57: rename ld to d10/l11 0 2024-09-18T12:48:58.825 INFO:tasks.workunit.client.0.smithi078.stdout:5/44: fsync f0 0 2024-09-18T12:48:58.826 INFO:tasks.workunit.client.0.smithi078.stdout:5/45: dread - d2/fe zero size 2024-09-18T12:48:58.827 INFO:tasks.workunit.client.0.smithi078.stdout:5/46: fsync d2/f7 0 2024-09-18T12:48:58.829 INFO:tasks.workunit.client.0.smithi078.stdout:6/58: dread f9 [0,4194304] 0 2024-09-18T12:48:58.832 INFO:tasks.workunit.client.0.smithi078.stdout:6/59: write ff [259568,109018] 0 2024-09-18T12:48:58.835 INFO:tasks.workunit.client.0.smithi078.stdout:6/60: dread ff [0,4194304] 0 2024-09-18T12:48:58.836 INFO:tasks.workunit.client.0.smithi078.stdout:5/47: dwrite d2/d4/f5 [0,4194304] 0 2024-09-18T12:48:58.836 INFO:tasks.workunit.client.0.smithi078.stdout:6/61: chown f3 30747953 1 2024-09-18T12:48:58.840 INFO:tasks.workunit.client.0.smithi078.stdout:6/62: creat d10/f12 x:0 0 0 2024-09-18T12:48:58.843 INFO:tasks.workunit.client.0.smithi078.stdout:5/48: creat d2/d4/d9/da/ff x:0 0 0 2024-09-18T12:48:58.844 INFO:tasks.workunit.client.0.smithi078.stdout:6/63: dread f9 [0,4194304] 0 2024-09-18T12:48:58.845 INFO:tasks.workunit.client.0.smithi078.stdout:5/49: creat d2/d4/f10 x:0 0 0 2024-09-18T12:48:58.846 INFO:tasks.workunit.client.0.smithi078.stdout:5/50: stat d2/cd 0 2024-09-18T12:48:58.846 INFO:tasks.workunit.client.0.smithi078.stdout:6/64: symlink d10/l13 0 2024-09-18T12:48:58.846 INFO:tasks.workunit.client.0.smithi078.stdout:5/51: fdatasync d2/f7 0 2024-09-18T12:48:58.847 INFO:tasks.workunit.client.0.smithi078.stdout:6/65: chown ff 9 1 2024-09-18T12:48:58.859 INFO:tasks.workunit.client.0.smithi078.stdout:5/52: dwrite d2/d4/d9/da/ff [0,4194304] 0 2024-09-18T12:48:58.859 INFO:tasks.workunit.client.0.smithi078.stdout:6/66: dwrite d10/f12 [0,4194304] 0 2024-09-18T12:48:58.860 INFO:tasks.workunit.client.0.smithi078.stdout:5/53: chown d2/d4/f8 260 1 2024-09-18T12:48:58.866 INFO:tasks.workunit.client.0.smithi078.stdout:5/54: unlink f0 0 2024-09-18T12:48:58.869 INFO:tasks.workunit.client.0.smithi078.stdout:6/67: dwrite d10/f12 [0,4194304] 0 2024-09-18T12:48:58.870 INFO:tasks.workunit.client.0.smithi078.stdout:6/68: chown ff 6 1 2024-09-18T12:48:58.872 INFO:tasks.workunit.client.0.smithi078.stdout:5/55: unlink d2/d4/f5 0 2024-09-18T12:48:58.879 INFO:tasks.workunit.client.0.smithi078.stdout:6/69: dwrite d10/f12 [0,4194304] 0 2024-09-18T12:48:58.879 INFO:tasks.workunit.client.0.smithi078.stdout:6/70: chown d10/f12 0 1 2024-09-18T12:48:58.881 INFO:tasks.workunit.client.0.smithi078.stdout:6/71: write fb [722699,110783] 0 2024-09-18T12:48:58.882 INFO:tasks.workunit.client.0.smithi078.stdout:5/56: getdents d2/d4/d9 0 2024-09-18T12:48:59.043 INFO:tasks.workunit.client.0.smithi078.stdout:2/46: getdents d4/dd 0 2024-09-18T12:48:59.045 INFO:tasks.workunit.client.0.smithi078.stdout:2/47: creat d4/d8/f12 x:0 0 0 2024-09-18T12:48:59.045 INFO:tasks.workunit.client.0.smithi078.stdout:2/48: stat d4/dd 0 2024-09-18T12:48:59.057 INFO:tasks.workunit.client.0.smithi078.stdout:5/57: getdents d2/d4/d9/da 0 2024-09-18T12:48:59.057 INFO:tasks.workunit.client.0.smithi078.stdout:5/58: read - d2/d4/f10 zero size 2024-09-18T12:48:59.058 INFO:tasks.workunit.client.0.smithi078.stdout:5/59: dread - d2/fe zero size 2024-09-18T12:48:59.058 INFO:tasks.workunit.client.0.smithi078.stdout:6/72: getdents d10 0 2024-09-18T12:48:59.058 INFO:tasks.workunit.client.0.smithi078.stdout:6/73: stat ff 0 2024-09-18T12:48:59.060 INFO:tasks.workunit.client.0.smithi078.stdout:6/74: truncate f3 4864097 0 2024-09-18T12:48:59.060 INFO:tasks.workunit.client.0.smithi078.stdout:5/60: write d2/fe [724494,82194] 0 2024-09-18T12:48:59.061 INFO:tasks.workunit.client.0.smithi078.stdout:5/61: truncate f1 389236 0 2024-09-18T12:48:59.062 INFO:tasks.workunit.client.0.smithi078.stdout:5/62: write d2/f7 [1018104,39590] 0 2024-09-18T12:48:59.064 INFO:tasks.workunit.client.0.smithi078.stdout:6/75: dread fb [0,4194304] 0 2024-09-18T12:48:59.065 INFO:tasks.workunit.client.0.smithi078.stdout:6/76: write d10/f12 [2278936,76748] 0 2024-09-18T12:48:59.066 INFO:tasks.workunit.client.0.smithi078.stdout:5/63: fsync d2/d4/f8 0 2024-09-18T12:48:59.071 INFO:tasks.workunit.client.0.smithi078.stdout:5/64: dwrite d2/f7 [0,4194304] 0 2024-09-18T12:48:59.075 INFO:tasks.workunit.client.0.smithi078.stdout:5/65: symlink d2/d4/l11 0 2024-09-18T12:48:59.076 INFO:tasks.workunit.client.0.smithi078.stdout:5/66: read d2/d4/d9/da/ff [818753,50275] 0 2024-09-18T12:48:59.076 INFO:tasks.workunit.client.0.smithi078.stdout:5/67: stat f1 0 2024-09-18T12:48:59.103 INFO:tasks.workunit.client.0.smithi078.stdout:2/49: dwrite d4/f5 [0,4194304] 0 2024-09-18T12:48:59.106 INFO:tasks.workunit.client.0.smithi078.stdout:2/50: mknod d4/db/c13 0 2024-09-18T12:48:59.110 INFO:tasks.workunit.client.0.smithi078.stdout:2/51: mknod d4/db/dc/c14 0 2024-09-18T12:48:59.110 INFO:tasks.workunit.client.0.smithi078.stdout:2/52: readlink d4/dd/l11 0 2024-09-18T12:48:59.110 INFO:tasks.workunit.client.0.smithi078.stdout:5/68: truncate d2/f7 2476916 0 2024-09-18T12:48:59.111 INFO:tasks.workunit.client.0.smithi078.stdout:2/53: chown d4 145059063 1 2024-09-18T12:48:59.112 INFO:tasks.workunit.client.0.smithi078.stdout:5/69: mkdir d2/d4/d12 0 2024-09-18T12:48:59.113 INFO:tasks.workunit.client.0.smithi078.stdout:2/54: creat d4/db/f15 x:0 0 0 2024-09-18T12:48:59.116 INFO:tasks.workunit.client.0.smithi078.stdout:5/70: creat d2/d4/d9/f13 x:0 0 0 2024-09-18T12:48:59.117 INFO:tasks.workunit.client.0.smithi078.stdout:5/71: write f1 [1077985,114586] 0 2024-09-18T12:48:59.117 INFO:tasks.workunit.client.0.smithi078.stdout:2/55: rmdir d4/db 39 2024-09-18T12:48:59.120 INFO:tasks.workunit.client.0.smithi078.stdout:2/56: symlink d4/l16 0 2024-09-18T12:48:59.124 INFO:tasks.workunit.client.0.smithi078.stdout:5/72: dwrite d2/fc [0,4194304] 0 2024-09-18T12:48:59.125 INFO:tasks.workunit.client.0.smithi078.stdout:5/73: chown d2/cd 5320429 1 2024-09-18T12:48:59.127 INFO:tasks.workunit.client.0.smithi078.stdout:2/57: getdents d4/d8 0 2024-09-18T12:48:59.128 INFO:tasks.workunit.client.0.smithi078.stdout:5/74: mknod d2/d4/c14 0 2024-09-18T12:48:59.132 INFO:tasks.workunit.client.0.smithi078.stdout:2/58: write d4/db/f15 [592907,121597] 0 2024-09-18T12:48:59.138 INFO:tasks.workunit.client.0.smithi078.stdout:2/59: symlink d4/l17 0 2024-09-18T12:48:59.139 INFO:tasks.workunit.client.0.smithi078.stdout:2/60: readlink d4/l16 0 2024-09-18T12:48:59.139 INFO:tasks.workunit.client.0.smithi078.stdout:2/61: dread - d4/d8/f12 zero size 2024-09-18T12:48:59.141 INFO:tasks.workunit.client.0.smithi078.stdout:2/62: unlink d4/db/dc/c14 0 2024-09-18T12:48:59.141 INFO:tasks.workunit.client.0.smithi078.stdout:2/63: write d4/f5 [893988,86183] 0 2024-09-18T12:48:59.142 INFO:tasks.workunit.client.0.smithi078.stdout:2/64: stat d4/db/f15 0 2024-09-18T12:48:59.145 INFO:tasks.workunit.client.0.smithi078.stdout:2/65: mkdir d4/dd/d18 0 2024-09-18T12:48:59.145 INFO:tasks.workunit.client.0.smithi078.stdout:5/75: truncate d2/fc 230850 0 2024-09-18T12:48:59.148 INFO:tasks.workunit.client.0.smithi078.stdout:5/76: creat d2/d4/d9/f15 x:0 0 0 2024-09-18T12:48:59.149 INFO:tasks.workunit.client.0.smithi078.stdout:2/66: mknod d4/dd/d18/c19 0 2024-09-18T12:48:59.152 INFO:tasks.workunit.client.0.smithi078.stdout:5/77: mkdir d2/d4/d12/d16 0 2024-09-18T12:48:59.153 INFO:tasks.workunit.client.0.smithi078.stdout:2/67: mkdir d4/d1a 0 2024-09-18T12:48:59.154 INFO:tasks.workunit.client.0.smithi078.stdout:2/68: truncate d4/d8/f12 669134 0 2024-09-18T12:48:59.155 INFO:tasks.workunit.client.0.smithi078.stdout:2/69: chown d4/d8/c10 29132982 1 2024-09-18T12:48:59.157 INFO:tasks.workunit.client.0.smithi078.stdout:2/70: write d4/f9 [404075,92338] 0 2024-09-18T12:48:59.160 INFO:tasks.workunit.client.0.smithi078.stdout:2/71: creat d4/db/dc/f1b x:0 0 0 2024-09-18T12:48:59.163 INFO:tasks.workunit.client.0.smithi078.stdout:2/72: getdents d4/d8 0 2024-09-18T12:48:59.163 INFO:tasks.workunit.client.0.smithi078.stdout:5/78: write d2/d4/d9/da/ff [4995145,17291] 0 2024-09-18T12:48:59.164 INFO:tasks.workunit.client.0.smithi078.stdout:2/73: readlink d4/l16 0 2024-09-18T12:48:59.164 INFO:tasks.workunit.client.0.smithi078.stdout:5/79: chown d2 615711 1 2024-09-18T12:48:59.165 INFO:tasks.workunit.client.0.smithi078.stdout:5/80: unlink d2/c6 0 2024-09-18T12:48:59.166 INFO:tasks.workunit.client.0.smithi078.stdout:2/74: creat d4/db/f1c x:0 0 0 2024-09-18T12:48:59.166 INFO:tasks.workunit.client.0.smithi078.stdout:5/81: truncate d2/fc 649511 0 2024-09-18T12:48:59.168 INFO:tasks.workunit.client.0.smithi078.stdout:2/75: creat d4/d8/f1d x:0 0 0 2024-09-18T12:48:59.169 INFO:tasks.workunit.client.0.smithi078.stdout:5/82: dread d2/fc [0,4194304] 0 2024-09-18T12:48:59.169 INFO:tasks.workunit.client.0.smithi078.stdout:2/76: rmdir d4/dd/d18 39 2024-09-18T12:48:59.171 INFO:tasks.workunit.client.0.smithi078.stdout:5/83: symlink d2/d4/d9/da/l17 0 2024-09-18T12:48:59.171 INFO:tasks.workunit.client.0.smithi078.stdout:2/77: dread d4/d8/f12 [0,4194304] 0 2024-09-18T12:48:59.172 INFO:tasks.workunit.client.0.smithi078.stdout:5/84: readlink d2/d4/l11 0 2024-09-18T12:48:59.173 INFO:tasks.workunit.client.0.smithi078.stdout:5/85: mknod d2/d4/d9/da/c18 0 2024-09-18T12:48:59.176 INFO:tasks.workunit.client.0.smithi078.stdout:5/86: creat d2/d4/d9/da/f19 x:0 0 0 2024-09-18T12:48:59.177 INFO:tasks.workunit.client.0.smithi078.stdout:2/78: dwrite d4/d8/f1d [0,4194304] 0 2024-09-18T12:48:59.178 INFO:tasks.workunit.client.0.smithi078.stdout:5/87: read d2/d4/d9/da/ff [568236,90735] 0 2024-09-18T12:48:59.179 INFO:tasks.workunit.client.0.smithi078.stdout:2/79: read d4/f5 [2907739,128041] 0 2024-09-18T12:48:59.181 INFO:tasks.workunit.client.0.smithi078.stdout:5/88: rmdir d2 39 2024-09-18T12:48:59.184 INFO:tasks.workunit.client.0.smithi078.stdout:2/80: symlink d4/db/l1e 0 2024-09-18T12:48:59.188 INFO:tasks.workunit.client.0.smithi078.stdout:2/81: symlink d4/db/dc/l1f 0 2024-09-18T12:48:59.189 INFO:tasks.workunit.client.0.smithi078.stdout:5/89: symlink d2/l1a 0 2024-09-18T12:48:59.189 INFO:tasks.workunit.client.0.smithi078.stdout:2/82: write d4/db/dc/f1b [190559,130806] 0 2024-09-18T12:48:59.194 INFO:tasks.workunit.client.0.smithi078.stdout:2/83: dread d4/db/f15 [0,4194304] 0 2024-09-18T12:48:59.198 INFO:tasks.workunit.client.0.smithi078.stdout:5/90: dwrite d2/d4/f10 [0,4194304] 0 2024-09-18T12:48:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:5/91: creat d2/d4/d12/f1b x:0 0 0 2024-09-18T12:48:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:2/84: dwrite d4/db/dc/f1b [0,4194304] 0 2024-09-18T12:48:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:5/92: truncate d2/d4/d12/f1b 222753 0 2024-09-18T12:48:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:5/93: stat d2/d4/f10 0 2024-09-18T12:48:59.207 INFO:tasks.workunit.client.0.smithi078.stdout:5/94: dread - d2/d4/f8 zero size 2024-09-18T12:48:59.208 INFO:tasks.workunit.client.0.smithi078.stdout:5/95: chown d2/d4/c14 2928693 1 2024-09-18T12:48:59.210 INFO:tasks.workunit.client.0.smithi078.stdout:2/85: mkdir d4/d20 0 2024-09-18T12:48:59.211 INFO:tasks.workunit.client.0.smithi078.stdout:5/96: creat d2/d4/d9/f1c x:0 0 0 2024-09-18T12:48:59.215 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:58 smithi148 ceph-mon[35352]: mgrmap e25: smithi148.bfgshs(active, since 7s), standbys: smithi078.ohifux 2024-09-18T12:48:59.215 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:58 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mgr metadata", "who": "smithi078.ohifux", "id": "smithi078.ohifux"}]: dispatch 2024-09-18T12:48:59.215 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:58 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:48:59.215 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:58 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:48:59.215 INFO:tasks.workunit.client.0.smithi078.stdout:2/86: dread d4/d8/f1d [0,4194304] 0 2024-09-18T12:48:59.215 INFO:tasks.workunit.client.0.smithi078.stdout:5/97: getdents d2 0 2024-09-18T12:48:59.216 INFO:tasks.workunit.client.0.smithi078.stdout:5/98: readlink d2/d4/l11 0 2024-09-18T12:48:59.217 INFO:tasks.workunit.client.0.smithi078.stdout:2/87: fdatasync d4/db/f15 0 2024-09-18T12:48:59.218 INFO:tasks.workunit.client.0.smithi078.stdout:5/99: rename d2/fe to d2/d4/f1d 0 2024-09-18T12:48:59.225 INFO:tasks.workunit.client.0.smithi078.stdout:5/100: getdents d2/d4/d12/d16 0 2024-09-18T12:48:59.228 INFO:tasks.workunit.client.0.smithi078.stdout:5/101: creat d2/d4/f1e x:0 0 0 2024-09-18T12:48:59.230 INFO:tasks.workunit.client.0.smithi078.stdout:5/102: creat d2/d4/d12/d16/f1f x:0 0 0 2024-09-18T12:48:59.231 INFO:tasks.workunit.client.0.smithi078.stdout:5/103: stat d2/d4/d12/d16 0 2024-09-18T12:48:59.231 INFO:tasks.workunit.client.0.smithi078.stdout:2/88: truncate d4/f9 450278 0 2024-09-18T12:48:59.233 INFO:tasks.workunit.client.0.smithi078.stdout:5/104: creat d2/d4/d9/da/f20 x:0 0 0 2024-09-18T12:48:59.234 INFO:tasks.workunit.client.0.smithi078.stdout:2/89: rename d4/l16 to d4/db/dc/l21 0 2024-09-18T12:48:59.236 INFO:tasks.workunit.client.0.smithi078.stdout:2/90: dread d4/d8/f12 [0,4194304] 0 2024-09-18T12:48:59.237 INFO:tasks.workunit.client.0.smithi078.stdout:2/91: truncate d4/d8/f1d 4453868 0 2024-09-18T12:48:59.238 INFO:tasks.workunit.client.0.smithi078.stdout:5/105: dread f1 [0,4194304] 0 2024-09-18T12:48:59.240 INFO:tasks.workunit.client.0.smithi078.stdout:2/92: unlink d4/db/dc/cf 0 2024-09-18T12:48:59.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:58 smithi078 ceph-mon[28091]: mgrmap e25: smithi148.bfgshs(active, since 7s), standbys: smithi078.ohifux 2024-09-18T12:48:59.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:58 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mgr metadata", "who": "smithi078.ohifux", "id": "smithi078.ohifux"}]: dispatch 2024-09-18T12:48:59.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:58 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:48:59.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:58 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:48:59.242 INFO:tasks.workunit.client.0.smithi078.stdout:5/106: creat d2/d4/d12/d16/f21 x:0 0 0 2024-09-18T12:48:59.243 INFO:tasks.workunit.client.0.smithi078.stdout:5/107: fsync d2/f7 0 2024-09-18T12:48:59.248 INFO:tasks.workunit.client.0.smithi078.stdout:5/108: link d2/d4/d9/da/c18 d2/c22 0 2024-09-18T12:48:59.250 INFO:tasks.workunit.client.0.smithi078.stdout:5/109: mknod d2/d4/d9/da/c23 0 2024-09-18T12:48:59.252 INFO:tasks.workunit.client.0.smithi078.stdout:5/110: creat d2/d4/d12/d16/f24 x:0 0 0 2024-09-18T12:48:59.261 INFO:tasks.workunit.client.0.smithi078.stdout:5/111: dwrite f1 [0,4194304] 0 2024-09-18T12:48:59.263 INFO:tasks.workunit.client.0.smithi078.stdout:5/112: chown d2/f7 3 1 2024-09-18T12:48:59.263 INFO:tasks.workunit.client.0.smithi078.stdout:2/93: dwrite d4/f5 [0,4194304] 0 2024-09-18T12:48:59.266 INFO:tasks.workunit.client.0.smithi078.stdout:2/94: dread d4/d8/f1d [4194304,4194304] 0 2024-09-18T12:48:59.271 INFO:tasks.workunit.client.0.smithi078.stdout:2/95: rename d4/d8/f12 to d4/d1a/f22 0 2024-09-18T12:48:59.275 INFO:tasks.workunit.client.0.smithi078.stdout:2/96: mkdir d4/d8/d23 0 2024-09-18T12:48:59.275 INFO:tasks.workunit.client.0.smithi078.stdout:5/113: dwrite d2/d4/f1d [0,4194304] 0 2024-09-18T12:48:59.276 INFO:tasks.workunit.client.0.smithi078.stdout:2/97: write d4/db/f1c [813181,70392] 0 2024-09-18T12:48:59.278 INFO:tasks.workunit.client.0.smithi078.stdout:2/98: mknod d4/d8/c24 0 2024-09-18T12:48:59.280 INFO:tasks.workunit.client.0.smithi078.stdout:2/99: truncate d4/f9 1479547 0 2024-09-18T12:48:59.292 INFO:tasks.workunit.client.0.smithi078.stdout:2/100: dread d4/db/f1c [0,4194304] 0 2024-09-18T12:48:59.295 INFO:tasks.workunit.client.0.smithi078.stdout:2/101: getdents d4/d1a 0 2024-09-18T12:48:59.296 INFO:tasks.workunit.client.0.smithi078.stdout:2/102: mkdir d4/db/d25 0 2024-09-18T12:48:59.300 INFO:tasks.workunit.client.0.smithi078.stdout:2/103: dread d4/f5 [0,4194304] 0 2024-09-18T12:48:59.301 INFO:tasks.workunit.client.0.smithi078.stdout:2/104: write d4/db/f1c [1357590,29487] 0 2024-09-18T12:48:59.305 INFO:tasks.workunit.client.0.smithi078.stdout:2/105: link d4/d8/c10 d4/d1a/c26 0 2024-09-18T12:48:59.306 INFO:tasks.workunit.client.0.smithi078.stdout:2/106: symlink d4/dd/l27 0 2024-09-18T12:48:59.307 INFO:tasks.workunit.client.0.smithi078.stdout:2/107: chown d4/dd/d18/c19 6 1 2024-09-18T12:48:59.308 INFO:tasks.workunit.client.0.smithi078.stdout:2/108: chown d4/db/dc/l1f 29517 1 2024-09-18T12:48:59.309 INFO:tasks.workunit.client.0.smithi078.stdout:2/109: symlink d4/db/l28 0 2024-09-18T12:48:59.321 INFO:tasks.workunit.client.0.smithi078.stdout:2/110: write d4/f9 [258996,35504] 0 2024-09-18T12:48:59.332 INFO:tasks.workunit.client.0.smithi078.stdout:2/111: dwrite d4/d1a/f22 [0,4194304] 0 2024-09-18T12:48:59.333 INFO:tasks.workunit.client.0.smithi078.stdout:2/112: chown d4/db/l28 1033016 1 2024-09-18T12:48:59.334 INFO:tasks.workunit.client.0.smithi078.stdout:2/113: fsync d4/db/f15 0 2024-09-18T12:48:59.336 INFO:tasks.workunit.client.0.smithi078.stdout:2/114: creat d4/d20/f29 x:0 0 0 2024-09-18T12:48:59.339 INFO:tasks.workunit.client.0.smithi078.stdout:2/115: link d4/db/f1c d4/db/f2a 0 2024-09-18T12:48:59.339 INFO:tasks.workunit.client.0.smithi078.stdout:2/116: chown d4/d20 1474058361 1 2024-09-18T12:48:59.342 INFO:tasks.workunit.client.0.smithi078.stdout:2/117: getdents d4 0 2024-09-18T12:48:59.351 INFO:tasks.workunit.client.0.smithi078.stdout:2/118: fsync d4/db/f2a 0 2024-09-18T12:48:59.359 INFO:tasks.workunit.client.0.smithi078.stdout:2/119: dwrite d4/f5 [0,4194304] 0 2024-09-18T12:48:59.362 INFO:tasks.workunit.client.0.smithi078.stdout:2/120: write d4/d8/f1d [3970519,83961] 0 2024-09-18T12:48:59.364 INFO:tasks.workunit.client.0.smithi078.stdout:2/121: chown d4/d8/c10 22142 1 2024-09-18T12:48:59.370 INFO:tasks.workunit.client.0.smithi078.stdout:2/122: truncate d4/d20/f29 269587 0 2024-09-18T12:48:59.370 INFO:tasks.workunit.client.0.smithi078.stdout:2/123: link d4/d1a/c26 d4/dd/c2b 0 2024-09-18T12:48:59.371 INFO:tasks.workunit.client.0.smithi078.stdout:2/124: symlink d4/db/dc/l2c 0 2024-09-18T12:48:59.372 INFO:tasks.workunit.client.0.smithi078.stdout:2/125: dread d4/d20/f29 [0,4194304] 0 2024-09-18T12:48:59.377 INFO:tasks.workunit.client.0.smithi078.stdout:2/126: dwrite d4/f5 [0,4194304] 0 2024-09-18T12:48:59.380 INFO:tasks.workunit.client.0.smithi078.stdout:2/127: creat d4/d8/f2d x:0 0 0 2024-09-18T12:48:59.383 INFO:tasks.workunit.client.0.smithi078.stdout:2/128: creat d4/d1a/f2e x:0 0 0 2024-09-18T12:48:59.385 INFO:tasks.workunit.client.0.smithi078.stdout:2/129: creat d4/db/dc/f2f x:0 0 0 2024-09-18T12:48:59.386 INFO:tasks.workunit.client.0.smithi078.stdout:2/130: readlink d4/db/dc/l21 0 2024-09-18T12:48:59.387 INFO:tasks.workunit.client.0.smithi078.stdout:2/131: rmdir d4/dd/d18 39 2024-09-18T12:48:59.389 INFO:tasks.workunit.client.0.smithi078.stdout:2/132: rename d4/d8/f2d to d4/d1a/f30 0 2024-09-18T12:48:59.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:48:59 smithi148 ceph-mon[35352]: pgmap v7: 65 pgs: 65 active+clean; 203 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 25 KiB/s rd, 3.1 MiB/s wr, 260 op/s 2024-09-18T12:49:00.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:48:59 smithi078 ceph-mon[28091]: pgmap v7: 65 pgs: 65 active+clean; 203 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 25 KiB/s rd, 3.1 MiB/s wr, 260 op/s 2024-09-18T12:49:00.745 INFO:tasks.workunit.client.1.smithi148.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-18T12:49:00.749 INFO:tasks.workunit.client.1.smithi148.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-18T12:49:00.749 INFO:tasks.workunit.client.1.smithi148.stderr:+ make 2024-09-18T12:49:00.872 INFO:tasks.workunit.client.1.smithi148.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-18T12:49:01.439 INFO:tasks.workunit.client.1.smithi148.stderr:++ readlink -f fsstress 2024-09-18T12:49:01.440 INFO:tasks.workunit.client.1.smithi148.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-18T12:49:01.440 INFO:tasks.workunit.client.1.smithi148.stderr:+ popd 2024-09-18T12:49:01.441 INFO:tasks.workunit.client.1.smithi148.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-18T12:49:01.441 INFO:tasks.workunit.client.1.smithi148.stderr:+ popd 2024-09-18T12:49:01.441 INFO:tasks.workunit.client.1.smithi148.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-18T12:49:01.442 INFO:tasks.workunit.client.1.smithi148.stderr:++ mktemp -d -p . 2024-09-18T12:49:01.444 INFO:tasks.workunit.client.1.smithi148.stderr:+ T=./tmp.Os10ZdscgQ 2024-09-18T12:49:01.444 INFO:tasks.workunit.client.1.smithi148.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.Os10ZdscgQ -l 1 -n 1000 -p 10 -v 2024-09-18T12:49:01.446 INFO:tasks.workunit.client.1.smithi148.stdout:seed = 1726750170 2024-09-18T12:49:01.480 INFO:tasks.workunit.client.1.smithi148.stdout:0/0: mknod c0 0 2024-09-18T12:49:01.481 INFO:tasks.workunit.client.1.smithi148.stdout:0/1: read - no filename 2024-09-18T12:49:01.481 INFO:tasks.workunit.client.1.smithi148.stdout:0/2: write - no filename 2024-09-18T12:49:01.481 INFO:tasks.workunit.client.1.smithi148.stdout:2/0: dwrite - no filename 2024-09-18T12:49:01.482 INFO:tasks.workunit.client.1.smithi148.stdout:0/3: creat f1 x:0 0 0 2024-09-18T12:49:01.482 INFO:tasks.workunit.client.1.smithi148.stdout:1/0: mkdir d0 0 2024-09-18T12:49:01.484 INFO:tasks.workunit.client.1.smithi148.stdout:0/4: mknod c2 0 2024-09-18T12:49:01.485 INFO:tasks.workunit.client.1.smithi148.stdout:0/5: write f1 [503005,115310] 0 2024-09-18T12:49:01.485 INFO:tasks.workunit.client.1.smithi148.stdout:2/1: symlink l0 0 2024-09-18T12:49:01.486 INFO:tasks.workunit.client.1.smithi148.stdout:4/0: unlink - no file 2024-09-18T12:49:01.486 INFO:tasks.workunit.client.1.smithi148.stdout:4/1: rename - no filename 2024-09-18T12:49:01.488 INFO:tasks.workunit.client.1.smithi148.stdout:0/6: read f1 [400145,43519] 0 2024-09-18T12:49:01.488 INFO:tasks.workunit.client.1.smithi148.stdout:2/2: rename l0 to l1 0 2024-09-18T12:49:01.488 INFO:tasks.workunit.client.1.smithi148.stdout:3/0: mknod c0 0 2024-09-18T12:49:01.488 INFO:tasks.workunit.client.1.smithi148.stdout:0/7: chown c2 7 1 2024-09-18T12:49:01.489 INFO:tasks.workunit.client.1.smithi148.stdout:1/1: rmdir d0 0 2024-09-18T12:49:01.489 INFO:tasks.workunit.client.1.smithi148.stdout:1/2: truncate - no filename 2024-09-18T12:49:01.489 INFO:tasks.workunit.client.1.smithi148.stdout:1/3: rmdir - no directory 2024-09-18T12:49:01.490 INFO:tasks.workunit.client.1.smithi148.stdout:5/0: fsync - no filename 2024-09-18T12:49:01.490 INFO:tasks.workunit.client.1.smithi148.stdout:5/1: dwrite - no filename 2024-09-18T12:49:01.490 INFO:tasks.workunit.client.1.smithi148.stdout:5/2: truncate - no filename 2024-09-18T12:49:01.491 INFO:tasks.workunit.client.1.smithi148.stdout:0/8: dread f1 [0,4194304] 0 2024-09-18T12:49:01.491 INFO:tasks.workunit.client.1.smithi148.stdout:1/4: creat f1 x:0 0 0 2024-09-18T12:49:01.492 INFO:tasks.workunit.client.1.smithi148.stdout:4/2: creat f0 x:0 0 0 2024-09-18T12:49:01.493 INFO:tasks.workunit.client.1.smithi148.stdout:6/0: dread - no filename 2024-09-18T12:49:01.494 INFO:tasks.workunit.client.1.smithi148.stdout:4/3: symlink l1 0 2024-09-18T12:49:01.495 INFO:tasks.workunit.client.1.smithi148.stdout:0/9: write f1 [1535140,71215] 0 2024-09-18T12:49:01.496 INFO:tasks.workunit.client.1.smithi148.stdout:4/4: dread - f0 zero size 2024-09-18T12:49:01.496 INFO:tasks.workunit.client.1.smithi148.stdout:3/1: link c0 c1 0 2024-09-18T12:49:01.497 INFO:tasks.workunit.client.1.smithi148.stdout:3/2: fsync - no filename 2024-09-18T12:49:01.497 INFO:tasks.workunit.client.1.smithi148.stdout:7/0: dwrite - no filename 2024-09-18T12:49:01.497 INFO:tasks.workunit.client.1.smithi148.stdout:7/1: link - no file 2024-09-18T12:49:01.498 INFO:tasks.workunit.client.1.smithi148.stdout:4/5: dread - f0 zero size 2024-09-18T12:49:01.498 INFO:tasks.workunit.client.1.smithi148.stdout:7/2: chown . 416 1 2024-09-18T12:49:01.498 INFO:tasks.workunit.client.1.smithi148.stdout:7/3: unlink - no file 2024-09-18T12:49:01.498 INFO:tasks.workunit.client.1.smithi148.stdout:7/4: rmdir - no directory 2024-09-18T12:49:01.498 INFO:tasks.workunit.client.1.smithi148.stdout:7/5: rmdir - no directory 2024-09-18T12:49:01.498 INFO:tasks.workunit.client.1.smithi148.stdout:7/6: dwrite - no filename 2024-09-18T12:49:01.499 INFO:tasks.workunit.client.1.smithi148.stdout:7/7: rmdir - no directory 2024-09-18T12:49:01.499 INFO:tasks.workunit.client.1.smithi148.stdout:5/3: getdents . 0 2024-09-18T12:49:01.499 INFO:tasks.workunit.client.1.smithi148.stdout:5/4: truncate - no filename 2024-09-18T12:49:01.499 INFO:tasks.workunit.client.1.smithi148.stdout:5/5: dwrite - no filename 2024-09-18T12:49:01.499 INFO:tasks.workunit.client.1.smithi148.stdout:5/6: fsync - no filename 2024-09-18T12:49:01.499 INFO:tasks.workunit.client.1.smithi148.stdout:7/8: chown . 61 1 2024-09-18T12:49:01.499 INFO:tasks.workunit.client.1.smithi148.stdout:7/9: fdatasync - no filename 2024-09-18T12:49:01.499 INFO:tasks.workunit.client.1.smithi148.stdout:7/10: rename - no filename 2024-09-18T12:49:01.499 INFO:tasks.workunit.client.1.smithi148.stdout:7/11: dwrite - no filename 2024-09-18T12:49:01.499 INFO:tasks.workunit.client.1.smithi148.stdout:7/12: read - no filename 2024-09-18T12:49:01.499 INFO:tasks.workunit.client.1.smithi148.stdout:7/13: rename - no filename 2024-09-18T12:49:01.500 INFO:tasks.workunit.client.1.smithi148.stdout:0/10: creat f3 x:0 0 0 2024-09-18T12:49:01.500 INFO:tasks.workunit.client.1.smithi148.stdout:3/3: creat f2 x:0 0 0 2024-09-18T12:49:01.501 INFO:tasks.workunit.client.1.smithi148.stdout:8/0: fsync - no filename 2024-09-18T12:49:01.501 INFO:tasks.workunit.client.1.smithi148.stdout:6/1: getdents . 0 2024-09-18T12:49:01.501 INFO:tasks.workunit.client.1.smithi148.stdout:6/2: dread - no filename 2024-09-18T12:49:01.503 INFO:tasks.workunit.client.1.smithi148.stdout:1/5: dwrite f1 [0,4194304] 0 2024-09-18T12:49:01.503 INFO:tasks.workunit.client.1.smithi148.stdout:3/4: write f2 [840528,70504] 0 2024-09-18T12:49:01.505 INFO:tasks.workunit.client.1.smithi148.stdout:9/0: write - no filename 2024-09-18T12:49:01.505 INFO:tasks.workunit.client.1.smithi148.stdout:9/1: rename - no filename 2024-09-18T12:49:01.505 INFO:tasks.workunit.client.1.smithi148.stdout:9/2: write - no filename 2024-09-18T12:49:01.505 INFO:tasks.workunit.client.1.smithi148.stdout:9/3: dwrite - no filename 2024-09-18T12:49:01.505 INFO:tasks.workunit.client.1.smithi148.stdout:7/14: mknod c0 0 2024-09-18T12:49:01.505 INFO:tasks.workunit.client.1.smithi148.stdout:7/15: dwrite - no filename 2024-09-18T12:49:01.505 INFO:tasks.workunit.client.1.smithi148.stdout:7/16: truncate - no filename 2024-09-18T12:49:01.506 INFO:tasks.workunit.client.1.smithi148.stdout:9/4: chown . 208 1 2024-09-18T12:49:01.506 INFO:tasks.workunit.client.1.smithi148.stdout:9/5: dread - no filename 2024-09-18T12:49:01.506 INFO:tasks.workunit.client.1.smithi148.stdout:9/6: read - no filename 2024-09-18T12:49:01.506 INFO:tasks.workunit.client.1.smithi148.stdout:9/7: write - no filename 2024-09-18T12:49:01.506 INFO:tasks.workunit.client.1.smithi148.stdout:5/7: creat f0 x:0 0 0 2024-09-18T12:49:01.508 INFO:tasks.workunit.client.1.smithi148.stdout:1/6: creat f2 x:0 0 0 2024-09-18T12:49:01.509 INFO:tasks.workunit.client.1.smithi148.stdout:8/1: symlink l0 0 2024-09-18T12:49:01.509 INFO:tasks.workunit.client.1.smithi148.stdout:8/2: write - no filename 2024-09-18T12:49:01.511 INFO:tasks.workunit.client.1.smithi148.stdout:6/3: mknod c0 0 2024-09-18T12:49:01.511 INFO:tasks.workunit.client.1.smithi148.stdout:6/4: dread - no filename 2024-09-18T12:49:01.511 INFO:tasks.workunit.client.1.smithi148.stdout:6/5: truncate - no filename 2024-09-18T12:49:01.511 INFO:tasks.workunit.client.1.smithi148.stdout:6/6: write - no filename 2024-09-18T12:49:01.512 INFO:tasks.workunit.client.1.smithi148.stdout:7/17: creat f1 x:0 0 0 2024-09-18T12:49:01.515 INFO:tasks.workunit.client.1.smithi148.stdout:8/3: chown l0 601 1 2024-09-18T12:49:01.515 INFO:tasks.workunit.client.1.smithi148.stdout:8/4: truncate - no filename 2024-09-18T12:49:01.515 INFO:tasks.workunit.client.1.smithi148.stdout:8/5: fdatasync - no filename 2024-09-18T12:49:01.515 INFO:tasks.workunit.client.1.smithi148.stdout:8/6: dwrite - no filename 2024-09-18T12:49:01.516 INFO:tasks.workunit.client.1.smithi148.stdout:8/7: dread - no filename 2024-09-18T12:49:01.517 INFO:tasks.workunit.client.1.smithi148.stdout:7/18: dread - f1 zero size 2024-09-18T12:49:01.517 INFO:tasks.workunit.client.1.smithi148.stdout:3/5: dread f2 [0,4194304] 0 2024-09-18T12:49:01.518 INFO:tasks.workunit.client.1.smithi148.stdout:9/8: creat f0 x:0 0 0 2024-09-18T12:49:01.519 INFO:tasks.workunit.client.1.smithi148.stdout:6/7: mknod c1 0 2024-09-18T12:49:01.519 INFO:tasks.workunit.client.1.smithi148.stdout:6/8: read - no filename 2024-09-18T12:49:01.519 INFO:tasks.workunit.client.1.smithi148.stdout:6/9: dread - no filename 2024-09-18T12:49:01.519 INFO:tasks.workunit.client.1.smithi148.stdout:6/10: write - no filename 2024-09-18T12:49:01.519 INFO:tasks.workunit.client.1.smithi148.stdout:4/6: dwrite f0 [0,4194304] 0 2024-09-18T12:49:01.521 INFO:tasks.workunit.client.1.smithi148.stdout:8/8: creat f1 x:0 0 0 2024-09-18T12:49:01.522 INFO:tasks.workunit.client.1.smithi148.stdout:3/6: symlink l3 0 2024-09-18T12:49:01.523 INFO:tasks.workunit.client.1.smithi148.stdout:7/19: rename f1 to f2 0 2024-09-18T12:49:01.524 INFO:tasks.workunit.client.1.smithi148.stdout:0/11: dwrite f1 [0,4194304] 0 2024-09-18T12:49:01.525 INFO:tasks.workunit.client.1.smithi148.stdout:9/9: creat f1 x:0 0 0 2024-09-18T12:49:01.525 INFO:tasks.workunit.client.1.smithi148.stdout:6/11: rename c1 to c2 0 2024-09-18T12:49:01.527 INFO:tasks.workunit.client.1.smithi148.stdout:3/7: mkdir d4 0 2024-09-18T12:49:01.528 INFO:tasks.workunit.client.1.smithi148.stdout:8/9: mknod c2 0 2024-09-18T12:49:01.531 INFO:tasks.workunit.client.1.smithi148.stdout:9/10: creat f2 x:0 0 0 2024-09-18T12:49:01.532 INFO:tasks.workunit.client.1.smithi148.stdout:6/12: creat f3 x:0 0 0 2024-09-18T12:49:01.532 INFO:tasks.workunit.client.1.smithi148.stdout:7/20: write f2 [848465,90100] 0 2024-09-18T12:49:01.534 INFO:tasks.workunit.client.1.smithi148.stdout:1/7: dwrite f1 [0,4194304] 0 2024-09-18T12:49:01.534 INFO:tasks.workunit.client.1.smithi148.stdout:6/13: truncate f3 339631 0 2024-09-18T12:49:01.535 INFO:tasks.workunit.client.1.smithi148.stdout:7/21: write f2 [1548169,66777] 0 2024-09-18T12:49:01.536 INFO:tasks.workunit.client.1.smithi148.stdout:9/11: mknod c3 0 2024-09-18T12:49:01.537 INFO:tasks.workunit.client.1.smithi148.stdout:6/14: dread f3 [0,4194304] 0 2024-09-18T12:49:01.538 INFO:tasks.workunit.client.1.smithi148.stdout:4/7: dread f0 [0,4194304] 0 2024-09-18T12:49:01.542 INFO:tasks.workunit.client.1.smithi148.stdout:6/15: mknod c4 0 2024-09-18T12:49:01.543 INFO:tasks.workunit.client.1.smithi148.stdout:8/10: link c2 c3 0 2024-09-18T12:49:01.546 INFO:tasks.workunit.client.1.smithi148.stdout:4/8: creat f2 x:0 0 0 2024-09-18T12:49:01.546 INFO:tasks.workunit.client.1.smithi148.stdout:9/12: dwrite f1 [0,4194304] 0 2024-09-18T12:49:01.549 INFO:tasks.workunit.client.1.smithi148.stdout:6/16: mkdir d5 0 2024-09-18T12:49:01.550 INFO:tasks.workunit.client.1.smithi148.stdout:8/11: symlink l4 0 2024-09-18T12:49:01.552 INFO:tasks.workunit.client.1.smithi148.stdout:4/9: mknod c3 0 2024-09-18T12:49:01.553 INFO:tasks.workunit.client.1.smithi148.stdout:9/13: rename f1 to f4 0 2024-09-18T12:49:01.554 INFO:tasks.workunit.client.1.smithi148.stdout:6/17: read f3 [101233,55254] 0 2024-09-18T12:49:01.556 INFO:tasks.workunit.client.1.smithi148.stdout:4/10: mknod c4 0 2024-09-18T12:49:01.559 INFO:tasks.workunit.client.1.smithi148.stdout:8/12: dwrite f1 [0,4194304] 0 2024-09-18T12:49:01.559 INFO:tasks.workunit.client.1.smithi148.stdout:2/3: getdents . 0 2024-09-18T12:49:01.559 INFO:tasks.workunit.client.1.smithi148.stdout:2/4: dread - no filename 2024-09-18T12:49:01.559 INFO:tasks.workunit.client.1.smithi148.stdout:2/5: rmdir - no directory 2024-09-18T12:49:01.560 INFO:tasks.workunit.client.1.smithi148.stdout:8/13: chown l4 1269525069 1 2024-09-18T12:49:01.560 INFO:tasks.workunit.client.1.smithi148.stdout:2/6: chown l1 102117 1 2024-09-18T12:49:01.560 INFO:tasks.workunit.client.1.smithi148.stdout:4/11: unlink c3 0 2024-09-18T12:49:01.562 INFO:tasks.workunit.client.1.smithi148.stdout:6/18: symlink d5/l6 0 2024-09-18T12:49:01.564 INFO:tasks.workunit.client.1.smithi148.stdout:8/14: dread f1 [0,4194304] 0 2024-09-18T12:49:01.565 INFO:tasks.workunit.client.1.smithi148.stdout:2/7: mknod c2 0 2024-09-18T12:49:01.565 INFO:tasks.workunit.client.1.smithi148.stdout:4/12: symlink l5 0 2024-09-18T12:49:01.567 INFO:tasks.workunit.client.1.smithi148.stdout:6/19: creat d5/f7 x:0 0 0 2024-09-18T12:49:01.568 INFO:tasks.workunit.client.1.smithi148.stdout:8/15: write f1 [1123579,81144] 0 2024-09-18T12:49:01.569 INFO:tasks.workunit.client.1.smithi148.stdout:2/8: rename l1 to l3 0 2024-09-18T12:49:01.571 INFO:tasks.workunit.client.1.smithi148.stdout:4/13: mknod c6 0 2024-09-18T12:49:01.571 INFO:tasks.workunit.client.1.smithi148.stdout:1/8: write f1 [4698072,80224] 0 2024-09-18T12:49:01.572 INFO:tasks.workunit.client.1.smithi148.stdout:8/16: dread f1 [0,4194304] 0 2024-09-18T12:49:01.572 INFO:tasks.workunit.client.1.smithi148.stdout:6/20: mknod d5/c8 0 2024-09-18T12:49:01.575 INFO:tasks.workunit.client.1.smithi148.stdout:2/9: mknod c4 0 2024-09-18T12:49:01.577 INFO:tasks.workunit.client.1.smithi148.stdout:1/9: rename f1 to f3 0 2024-09-18T12:49:01.578 INFO:tasks.workunit.client.1.smithi148.stdout:6/21: symlink d5/l9 0 2024-09-18T12:49:01.578 INFO:tasks.workunit.client.1.smithi148.stdout:5/8: getdents . 0 2024-09-18T12:49:01.580 INFO:tasks.workunit.client.1.smithi148.stdout:6/22: chown d5/l9 1 1 2024-09-18T12:49:01.580 INFO:tasks.workunit.client.1.smithi148.stdout:2/10: creat f5 x:0 0 0 2024-09-18T12:49:01.580 INFO:tasks.workunit.client.1.smithi148.stdout:8/17: dwrite f1 [0,4194304] 0 2024-09-18T12:49:01.581 INFO:tasks.workunit.client.1.smithi148.stdout:2/11: dread - f5 zero size 2024-09-18T12:49:01.581 INFO:tasks.workunit.client.1.smithi148.stdout:6/23: chown d5/c8 785 1 2024-09-18T12:49:01.582 INFO:tasks.workunit.client.1.smithi148.stdout:1/10: fdatasync f3 0 2024-09-18T12:49:01.582 INFO:tasks.workunit.client.1.smithi148.stdout:1/11: chown f3 48387 1 2024-09-18T12:49:01.583 INFO:tasks.workunit.client.1.smithi148.stdout:6/24: truncate d5/f7 284239 0 2024-09-18T12:49:01.583 INFO:tasks.workunit.client.1.smithi148.stdout:5/9: rename f0 to f1 0 2024-09-18T12:49:01.587 INFO:tasks.workunit.client.1.smithi148.stdout:1/12: mknod c4 0 2024-09-18T12:49:01.589 INFO:tasks.workunit.client.1.smithi148.stdout:6/25: creat d5/fa x:0 0 0 2024-09-18T12:49:01.589 INFO:tasks.workunit.client.1.smithi148.stdout:6/26: readlink d5/l6 0 2024-09-18T12:49:01.590 INFO:tasks.workunit.client.1.smithi148.stdout:7/22: rename f2 to f3 0 2024-09-18T12:49:01.592 INFO:tasks.workunit.client.1.smithi148.stdout:5/10: creat f2 x:0 0 0 2024-09-18T12:49:01.592 INFO:tasks.workunit.client.1.smithi148.stdout:5/11: dread - f1 zero size 2024-09-18T12:49:01.593 INFO:tasks.workunit.client.1.smithi148.stdout:5/12: dread - f2 zero size 2024-09-18T12:49:01.593 INFO:tasks.workunit.client.1.smithi148.stdout:5/13: dread - f2 zero size 2024-09-18T12:49:01.593 INFO:tasks.workunit.client.1.smithi148.stdout:5/14: dread - f2 zero size 2024-09-18T12:49:01.596 INFO:tasks.workunit.client.1.smithi148.stdout:1/13: rename f2 to f5 0 2024-09-18T12:49:01.597 INFO:tasks.workunit.client.1.smithi148.stdout:1/14: chown c4 3 1 2024-09-18T12:49:01.597 INFO:tasks.workunit.client.1.smithi148.stdout:1/15: read f3 [2119923,94781] 0 2024-09-18T12:49:01.598 INFO:tasks.workunit.client.1.smithi148.stdout:6/27: mkdir d5/db 0 2024-09-18T12:49:01.598 INFO:tasks.workunit.client.1.smithi148.stdout:8/18: link l0 l5 0 2024-09-18T12:49:01.600 INFO:tasks.workunit.client.1.smithi148.stdout:5/15: creat f3 x:0 0 0 2024-09-18T12:49:01.619 INFO:tasks.workunit.client.1.smithi148.stdout:3/8: truncate f2 865944 0 2024-09-18T12:49:01.620 INFO:tasks.workunit.client.1.smithi148.stdout:1/16: write f5 [626094,95410] 0 2024-09-18T12:49:01.623 INFO:tasks.workunit.client.1.smithi148.stdout:9/14: write f4 [4862115,29191] 0 2024-09-18T12:49:01.626 INFO:tasks.workunit.client.1.smithi148.stdout:0/12: dwrite f1 [4194304,4194304] 0 2024-09-18T12:49:01.627 INFO:tasks.workunit.client.1.smithi148.stdout:4/14: getdents . 0 2024-09-18T12:49:01.629 INFO:tasks.workunit.client.1.smithi148.stdout:2/12: getdents . 0 2024-09-18T12:49:01.630 INFO:tasks.workunit.client.1.smithi148.stdout:5/16: dwrite f3 [0,4194304] 0 2024-09-18T12:49:01.630 INFO:tasks.workunit.client.1.smithi148.stdout:2/13: stat f5 0 2024-09-18T12:49:01.633 INFO:tasks.workunit.client.1.smithi148.stdout:2/14: write f5 [342410,129561] 0 2024-09-18T12:49:01.633 INFO:tasks.workunit.client.1.smithi148.stdout:8/19: rename c3 to c6 0 2024-09-18T12:49:01.634 INFO:tasks.workunit.client.1.smithi148.stdout:3/9: chown c1 3694 1 2024-09-18T12:49:01.634 INFO:tasks.workunit.client.1.smithi148.stdout:4/15: creat f7 x:0 0 0 2024-09-18T12:49:01.635 INFO:tasks.workunit.client.1.smithi148.stdout:5/17: creat f4 x:0 0 0 2024-09-18T12:49:01.635 INFO:tasks.workunit.client.1.smithi148.stdout:9/15: dwrite f4 [0,4194304] 0 2024-09-18T12:49:01.636 INFO:tasks.workunit.client.1.smithi148.stdout:4/16: dread - f7 zero size 2024-09-18T12:49:01.636 INFO:tasks.workunit.client.1.smithi148.stdout:2/15: creat f6 x:0 0 0 2024-09-18T12:49:01.637 INFO:tasks.workunit.client.1.smithi148.stdout:3/10: unlink c1 0 2024-09-18T12:49:01.637 INFO:tasks.workunit.client.1.smithi148.stdout:0/13: dread f1 [0,4194304] 0 2024-09-18T12:49:01.639 INFO:tasks.workunit.client.1.smithi148.stdout:9/16: creat f5 x:0 0 0 2024-09-18T12:49:01.639 INFO:tasks.workunit.client.1.smithi148.stdout:1/17: getdents . 0 2024-09-18T12:49:01.640 INFO:tasks.workunit.client.1.smithi148.stdout:9/17: dread - f5 zero size 2024-09-18T12:49:01.641 INFO:tasks.workunit.client.1.smithi148.stdout:4/17: creat f8 x:0 0 0 2024-09-18T12:49:01.642 INFO:tasks.workunit.client.1.smithi148.stdout:2/16: creat f7 x:0 0 0 2024-09-18T12:49:01.643 INFO:tasks.workunit.client.1.smithi148.stdout:4/18: chown c6 431 1 2024-09-18T12:49:01.643 INFO:tasks.workunit.client.1.smithi148.stdout:2/17: chown f6 2 1 2024-09-18T12:49:01.645 INFO:tasks.workunit.client.1.smithi148.stdout:4/19: truncate f0 5147739 0 2024-09-18T12:49:01.645 INFO:tasks.workunit.client.1.smithi148.stdout:4/20: rmdir - no directory 2024-09-18T12:49:01.645 INFO:tasks.workunit.client.1.smithi148.stdout:2/18: write f5 [177102,2536] 0 2024-09-18T12:49:01.647 INFO:tasks.workunit.client.1.smithi148.stdout:5/18: dwrite f1 [0,4194304] 0 2024-09-18T12:49:01.647 INFO:tasks.workunit.client.1.smithi148.stdout:0/14: dread f1 [4194304,4194304] 0 2024-09-18T12:49:01.648 INFO:tasks.workunit.client.1.smithi148.stdout:4/21: creat f9 x:0 0 0 2024-09-18T12:49:01.649 INFO:tasks.workunit.client.1.smithi148.stdout:0/15: chown f3 445097 1 2024-09-18T12:49:01.649 INFO:tasks.workunit.client.1.smithi148.stdout:5/19: write f3 [759451,33998] 0 2024-09-18T12:49:01.649 INFO:tasks.workunit.client.1.smithi148.stdout:4/22: chown f7 134411 1 2024-09-18T12:49:01.649 INFO:tasks.workunit.client.1.smithi148.stdout:2/19: link f5 f8 0 2024-09-18T12:49:01.650 INFO:tasks.workunit.client.1.smithi148.stdout:2/20: stat c4 0 2024-09-18T12:49:01.650 INFO:tasks.workunit.client.1.smithi148.stdout:5/20: symlink l5 0 2024-09-18T12:49:01.650 INFO:tasks.workunit.client.1.smithi148.stdout:0/16: write f3 [636851,28856] 0 2024-09-18T12:49:01.651 INFO:tasks.workunit.client.1.smithi148.stdout:9/18: dwrite f4 [0,4194304] 0 2024-09-18T12:49:01.651 INFO:tasks.workunit.client.1.smithi148.stdout:5/21: stat f1 0 2024-09-18T12:49:01.652 INFO:tasks.workunit.client.1.smithi148.stdout:9/19: rmdir - no directory 2024-09-18T12:49:01.652 INFO:tasks.workunit.client.1.smithi148.stdout:4/23: unlink f8 0 2024-09-18T12:49:01.652 INFO:tasks.workunit.client.1.smithi148.stdout:4/24: rmdir - no directory 2024-09-18T12:49:01.662 INFO:tasks.workunit.client.1.smithi148.stdout:0/17: chown f3 7287064 1 2024-09-18T12:49:01.662 INFO:tasks.workunit.client.1.smithi148.stdout:5/22: creat f6 x:0 0 0 2024-09-18T12:49:01.662 INFO:tasks.workunit.client.1.smithi148.stdout:2/21: write f5 [577872,8414] 0 2024-09-18T12:49:01.663 INFO:tasks.workunit.client.1.smithi148.stdout:4/25: write f2 [500441,22722] 0 2024-09-18T12:49:01.665 INFO:tasks.workunit.client.1.smithi148.stdout:5/23: dread f1 [0,4194304] 0 2024-09-18T12:49:01.701 INFO:tasks.workunit.client.1.smithi148.stdout:1/18: fsync f5 0 2024-09-18T12:49:01.715 INFO:tasks.workunit.client.1.smithi148.stdout:6/28: truncate d5/f7 69869 0 2024-09-18T12:49:01.726 INFO:tasks.workunit.client.1.smithi148.stdout:8/20: truncate f1 1335152 0 2024-09-18T12:49:01.775 INFO:tasks.workunit.client.1.smithi148.stdout:0/18: symlink l4 0 2024-09-18T12:49:01.777 INFO:tasks.workunit.client.1.smithi148.stdout:4/26: creat fa x:0 0 0 2024-09-18T12:49:01.778 INFO:tasks.workunit.client.1.smithi148.stdout:5/24: mkdir d7 0 2024-09-18T12:49:01.779 INFO:tasks.workunit.client.1.smithi148.stdout:4/27: write f9 [267659,88073] 0 2024-09-18T12:49:01.780 INFO:tasks.workunit.client.1.smithi148.stdout:6/29: truncate f3 1236298 0 2024-09-18T12:49:01.780 INFO:tasks.workunit.client.1.smithi148.stdout:4/28: write f7 [839700,60832] 0 2024-09-18T12:49:01.781 INFO:tasks.workunit.client.1.smithi148.stdout:4/29: write f2 [1333194,57742] 0 2024-09-18T12:49:01.782 INFO:tasks.workunit.client.1.smithi148.stdout:4/30: dread - fa zero size 2024-09-18T12:49:01.782 INFO:tasks.workunit.client.1.smithi148.stdout:0/19: unlink c2 0 2024-09-18T12:49:01.786 INFO:tasks.workunit.client.1.smithi148.stdout:1/19: link f5 f6 0 2024-09-18T12:49:01.786 INFO:tasks.workunit.client.1.smithi148.stdout:1/20: stat f6 0 2024-09-18T12:49:01.789 INFO:tasks.workunit.client.1.smithi148.stdout:5/25: dread f1 [0,4194304] 0 2024-09-18T12:49:01.794 INFO:tasks.workunit.client.1.smithi148.stdout:0/20: creat f5 x:0 0 0 2024-09-18T12:49:01.795 INFO:tasks.workunit.client.1.smithi148.stdout:1/21: symlink l7 0 2024-09-18T12:49:01.800 INFO:tasks.workunit.client.1.smithi148.stdout:0/21: write f1 [9173793,20863] 0 2024-09-18T12:49:01.800 INFO:tasks.workunit.client.1.smithi148.stdout:0/22: readlink l4 0 2024-09-18T12:49:01.804 INFO:tasks.workunit.client.1.smithi148.stdout:8/21: getdents . 0 2024-09-18T12:49:01.805 INFO:tasks.workunit.client.1.smithi148.stdout:5/26: mkdir d7/d8 0 2024-09-18T12:49:01.806 INFO:tasks.workunit.client.1.smithi148.stdout:4/31: link c6 cb 0 2024-09-18T12:49:01.809 INFO:tasks.workunit.client.1.smithi148.stdout:4/32: chown f2 2 1 2024-09-18T12:49:01.810 INFO:tasks.workunit.client.1.smithi148.stdout:0/23: dwrite f5 [0,4194304] 0 2024-09-18T12:49:01.810 INFO:tasks.workunit.client.1.smithi148.stdout:4/33: read - fa zero size 2024-09-18T12:49:01.811 INFO:tasks.workunit.client.1.smithi148.stdout:1/22: dwrite f5 [0,4194304] 0 2024-09-18T12:49:01.812 INFO:tasks.workunit.client.1.smithi148.stdout:0/24: chown c0 0 1 2024-09-18T12:49:01.816 INFO:tasks.workunit.client.1.smithi148.stdout:4/34: creat fc x:0 0 0 2024-09-18T12:49:01.820 INFO:tasks.workunit.client.1.smithi148.stdout:0/25: symlink l6 0 2024-09-18T12:49:01.822 INFO:tasks.workunit.client.1.smithi148.stdout:5/27: getdents d7/d8 0 2024-09-18T12:49:01.824 INFO:tasks.workunit.client.1.smithi148.stdout:4/35: creat fd x:0 0 0 2024-09-18T12:49:01.827 INFO:tasks.workunit.client.1.smithi148.stdout:0/26: creat f7 x:0 0 0 2024-09-18T12:49:01.829 INFO:tasks.workunit.client.1.smithi148.stdout:1/23: link f5 f8 0 2024-09-18T12:49:01.832 INFO:tasks.workunit.client.1.smithi148.stdout:4/36: rename f7 to fe 0 2024-09-18T12:49:01.834 INFO:tasks.workunit.client.1.smithi148.stdout:0/27: rename f7 to f8 0 2024-09-18T12:49:01.836 INFO:tasks.workunit.client.1.smithi148.stdout:1/24: creat f9 x:0 0 0 2024-09-18T12:49:01.837 INFO:tasks.workunit.client.1.smithi148.stdout:1/25: write f9 [277949,120037] 0 2024-09-18T12:49:01.837 INFO:tasks.workunit.client.1.smithi148.stdout:1/26: stat c4 0 2024-09-18T12:49:01.837 INFO:tasks.workunit.client.1.smithi148.stdout:5/28: creat d7/d8/f9 x:0 0 0 2024-09-18T12:49:01.843 INFO:tasks.workunit.client.1.smithi148.stdout:5/29: rename f1 to d7/d8/fa 0 2024-09-18T12:49:01.847 INFO:tasks.workunit.client.1.smithi148.stdout:5/30: creat d7/d8/fb x:0 0 0 2024-09-18T12:49:01.847 INFO:tasks.workunit.client.1.smithi148.stdout:5/31: stat l5 0 2024-09-18T12:49:01.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:01 smithi148 ceph-mon[35352]: pgmap v8: 65 pgs: 65 active+clean; 203 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 202 op/s 2024-09-18T12:49:01.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:01 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:01.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:01 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:01.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:01 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:01.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:01 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:01.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:01 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:01.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:01 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:01.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:01 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:01.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:01 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:01.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:01 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:01.983 INFO:tasks.workunit.client.1.smithi148.stdout:6/30: truncate f3 58933 0 2024-09-18T12:49:01.995 INFO:tasks.workunit.client.1.smithi148.stdout:1/27: truncate f5 3711001 0 2024-09-18T12:49:01.996 INFO:tasks.workunit.client.1.smithi148.stdout:1/28: symlink la 0 2024-09-18T12:49:01.999 INFO:tasks.workunit.client.1.smithi148.stdout:1/29: dread f9 [0,4194304] 0 2024-09-18T12:49:01.999 INFO:tasks.workunit.client.1.smithi148.stdout:0/28: getdents . 0 2024-09-18T12:49:02.000 INFO:tasks.workunit.client.1.smithi148.stdout:0/29: creat f9 x:0 0 0 2024-09-18T12:49:02.000 INFO:tasks.workunit.client.1.smithi148.stdout:0/30: readlink l6 0 2024-09-18T12:49:02.001 INFO:tasks.workunit.client.1.smithi148.stdout:0/31: creat fa x:0 0 0 2024-09-18T12:49:02.004 INFO:tasks.workunit.client.1.smithi148.stdout:5/32: getdents d7/d8 0 2024-09-18T12:49:02.008 INFO:tasks.workunit.client.1.smithi148.stdout:0/32: dwrite f3 [0,4194304] 0 2024-09-18T12:49:02.012 INFO:tasks.workunit.client.1.smithi148.stdout:5/33: dwrite f6 [0,4194304] 0 2024-09-18T12:49:02.016 INFO:tasks.workunit.client.1.smithi148.stdout:5/34: mkdir d7/d8/dc 0 2024-09-18T12:49:02.018 INFO:tasks.workunit.client.1.smithi148.stdout:5/35: write d7/d8/fb [528782,53564] 0 2024-09-18T12:49:02.019 INFO:tasks.workunit.client.1.smithi148.stdout:0/33: dwrite f8 [0,4194304] 0 2024-09-18T12:49:02.020 INFO:tasks.workunit.client.1.smithi148.stdout:5/36: chown d7/d8/dc 1913108546 1 2024-09-18T12:49:02.025 INFO:tasks.workunit.client.1.smithi148.stdout:5/37: rename f3 to d7/fd 0 2024-09-18T12:49:02.026 INFO:tasks.workunit.client.1.smithi148.stdout:5/38: chown f2 1033 1 2024-09-18T12:49:02.028 INFO:tasks.workunit.client.1.smithi148.stdout:5/39: symlink d7/d8/le 0 2024-09-18T12:49:02.032 INFO:tasks.workunit.client.1.smithi148.stdout:5/40: dread f6 [0,4194304] 0 2024-09-18T12:49:02.033 INFO:tasks.workunit.client.1.smithi148.stdout:5/41: write f6 [348219,5843] 0 2024-09-18T12:49:02.037 INFO:tasks.workunit.client.1.smithi148.stdout:8/22: dwrite f1 [0,4194304] 0 2024-09-18T12:49:02.039 INFO:tasks.workunit.client.1.smithi148.stdout:0/34: fsync f3 0 2024-09-18T12:49:02.039 INFO:tasks.workunit.client.1.smithi148.stdout:8/23: mknod c7 0 2024-09-18T12:49:02.040 INFO:tasks.workunit.client.1.smithi148.stdout:0/35: chown f8 0 1 2024-09-18T12:49:02.043 INFO:tasks.workunit.client.1.smithi148.stdout:8/24: write f1 [3929023,16402] 0 2024-09-18T12:49:02.044 INFO:tasks.workunit.client.1.smithi148.stdout:5/42: dwrite d7/d8/f9 [0,4194304] 0 2024-09-18T12:49:02.044 INFO:tasks.workunit.client.1.smithi148.stdout:0/36: symlink lb 0 2024-09-18T12:49:02.046 INFO:tasks.workunit.client.1.smithi148.stdout:8/25: chown l0 74 1 2024-09-18T12:49:02.049 INFO:tasks.workunit.client.1.smithi148.stdout:5/43: creat d7/d8/dc/ff x:0 0 0 2024-09-18T12:49:02.051 INFO:tasks.workunit.client.1.smithi148.stdout:6/31: dwrite f3 [0,4194304] 0 2024-09-18T12:49:02.062 INFO:tasks.workunit.client.1.smithi148.stdout:6/32: dwrite d5/fa [0,4194304] 0 2024-09-18T12:49:02.064 INFO:tasks.workunit.client.1.smithi148.stdout:6/33: mkdir d5/db/dc 0 2024-09-18T12:49:02.066 INFO:tasks.workunit.client.1.smithi148.stdout:6/34: chown c2 26521897 1 2024-09-18T12:49:02.068 INFO:tasks.workunit.client.1.smithi148.stdout:6/35: symlink d5/ld 0 2024-09-18T12:49:02.075 INFO:tasks.workunit.client.1.smithi148.stdout:6/36: dwrite d5/fa [0,4194304] 0 2024-09-18T12:49:02.077 INFO:tasks.workunit.client.1.smithi148.stdout:6/37: dread d5/f7 [0,4194304] 0 2024-09-18T12:49:02.079 INFO:tasks.workunit.client.1.smithi148.stdout:6/38: mknod d5/db/ce 0 2024-09-18T12:49:02.081 INFO:tasks.workunit.client.1.smithi148.stdout:6/39: fsync d5/f7 0 2024-09-18T12:49:02.082 INFO:tasks.workunit.client.1.smithi148.stdout:6/40: dread d5/f7 [0,4194304] 0 2024-09-18T12:49:02.088 INFO:tasks.workunit.client.1.smithi148.stdout:6/41: dwrite f3 [0,4194304] 0 2024-09-18T12:49:02.093 INFO:tasks.workunit.client.1.smithi148.stdout:6/42: dread f3 [0,4194304] 0 2024-09-18T12:49:02.094 INFO:tasks.workunit.client.1.smithi148.stdout:6/43: creat d5/ff x:0 0 0 2024-09-18T12:49:02.095 INFO:tasks.workunit.client.1.smithi148.stdout:6/44: stat d5/ld 0 2024-09-18T12:49:02.212 INFO:tasks.workunit.client.1.smithi148.stdout:6/45: link d5/ld d5/db/dc/l10 0 2024-09-18T12:49:02.213 INFO:tasks.workunit.client.1.smithi148.stdout:8/26: write f1 [4658658,101860] 0 2024-09-18T12:49:02.215 INFO:tasks.workunit.client.1.smithi148.stdout:8/27: chown c6 558579102 1 2024-09-18T12:49:02.218 INFO:tasks.workunit.client.1.smithi148.stdout:0/37: truncate f1 2204248 0 2024-09-18T12:49:02.219 INFO:tasks.workunit.client.1.smithi148.stdout:0/38: readlink lb 0 2024-09-18T12:49:02.220 INFO:tasks.workunit.client.1.smithi148.stdout:6/46: getdents d5/db 0 2024-09-18T12:49:02.223 INFO:tasks.workunit.client.1.smithi148.stdout:0/39: link f3 fc 0 2024-09-18T12:49:02.224 INFO:tasks.workunit.client.1.smithi148.stdout:8/28: dwrite f1 [4194304,4194304] 0 2024-09-18T12:49:02.229 INFO:tasks.workunit.client.1.smithi148.stdout:8/29: write f1 [1102840,18965] 0 2024-09-18T12:49:02.229 INFO:tasks.workunit.client.1.smithi148.stdout:6/47: rename d5/ld to d5/db/l11 0 2024-09-18T12:49:02.229 INFO:tasks.workunit.client.1.smithi148.stdout:5/44: dwrite d7/d8/fa [4194304,4194304] 0 2024-09-18T12:49:02.231 INFO:tasks.workunit.client.1.smithi148.stdout:6/48: dread - d5/ff zero size 2024-09-18T12:49:02.235 INFO:tasks.workunit.client.1.smithi148.stdout:6/49: fdatasync d5/f7 0 2024-09-18T12:49:02.237 INFO:tasks.workunit.client.1.smithi148.stdout:8/30: dread f1 [4194304,4194304] 0 2024-09-18T12:49:02.238 INFO:tasks.workunit.client.1.smithi148.stdout:6/50: rmdir d5 39 2024-09-18T12:49:02.239 INFO:tasks.workunit.client.1.smithi148.stdout:0/40: fsync f3 0 2024-09-18T12:49:02.241 INFO:tasks.workunit.client.1.smithi148.stdout:8/31: mkdir d8 0 2024-09-18T12:49:02.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:01 smithi078 ceph-mon[28091]: pgmap v8: 65 pgs: 65 active+clean; 203 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 202 op/s 2024-09-18T12:49:02.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:01 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:02.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:01 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:02.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:01 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:02.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:01 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:02.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:01 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:02.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:01 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:02.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:01 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:02.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:01 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:02.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:01 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:02.243 INFO:tasks.workunit.client.1.smithi148.stdout:5/45: dwrite d7/d8/dc/ff [0,4194304] 0 2024-09-18T12:49:02.243 INFO:tasks.workunit.client.1.smithi148.stdout:6/51: mknod d5/c12 0 2024-09-18T12:49:02.244 INFO:tasks.workunit.client.1.smithi148.stdout:8/32: symlink d8/l9 0 2024-09-18T12:49:02.245 INFO:tasks.workunit.client.1.smithi148.stdout:0/41: dread f3 [0,4194304] 0 2024-09-18T12:49:02.247 INFO:tasks.workunit.client.1.smithi148.stdout:0/42: write fc [2005242,23684] 0 2024-09-18T12:49:02.250 INFO:tasks.workunit.client.1.smithi148.stdout:0/43: symlink ld 0 2024-09-18T12:49:02.251 INFO:tasks.workunit.client.1.smithi148.stdout:5/46: dread d7/fd [0,4194304] 0 2024-09-18T12:49:02.252 INFO:tasks.workunit.client.1.smithi148.stdout:0/44: mkdir de 0 2024-09-18T12:49:02.253 INFO:tasks.workunit.client.1.smithi148.stdout:6/52: dread f3 [0,4194304] 0 2024-09-18T12:49:02.254 INFO:tasks.workunit.client.1.smithi148.stdout:5/47: creat d7/f10 x:0 0 0 2024-09-18T12:49:02.255 INFO:tasks.workunit.client.1.smithi148.stdout:8/33: dwrite f1 [0,4194304] 0 2024-09-18T12:49:02.256 INFO:tasks.workunit.client.1.smithi148.stdout:6/53: mknod d5/db/c13 0 2024-09-18T12:49:02.257 INFO:tasks.workunit.client.1.smithi148.stdout:5/48: link f4 d7/f11 0 2024-09-18T12:49:02.258 INFO:tasks.workunit.client.1.smithi148.stdout:5/49: write f6 [1225457,2289] 0 2024-09-18T12:49:02.259 INFO:tasks.workunit.client.1.smithi148.stdout:5/50: chown d7/d8/f9 798 1 2024-09-18T12:49:02.262 INFO:tasks.workunit.client.1.smithi148.stdout:5/51: dread d7/fd [0,4194304] 0 2024-09-18T12:49:02.263 INFO:tasks.workunit.client.1.smithi148.stdout:8/34: link c2 d8/ca 0 2024-09-18T12:49:02.264 INFO:tasks.workunit.client.1.smithi148.stdout:8/35: write f1 [3905891,634] 0 2024-09-18T12:49:02.264 INFO:tasks.workunit.client.1.smithi148.stdout:6/54: link d5/l9 d5/db/dc/l14 0 2024-09-18T12:49:02.266 INFO:tasks.workunit.client.1.smithi148.stdout:5/52: dread d7/d8/fb [0,4194304] 0 2024-09-18T12:49:02.267 INFO:tasks.workunit.client.1.smithi148.stdout:8/36: creat d8/fb x:0 0 0 2024-09-18T12:49:02.267 INFO:tasks.workunit.client.1.smithi148.stdout:0/45: dread f1 [0,4194304] 0 2024-09-18T12:49:02.267 INFO:tasks.workunit.client.1.smithi148.stdout:6/55: mknod d5/db/c15 0 2024-09-18T12:49:02.268 INFO:tasks.workunit.client.1.smithi148.stdout:0/46: write f9 [302111,79838] 0 2024-09-18T12:49:02.268 INFO:tasks.workunit.client.1.smithi148.stdout:5/53: mkdir d7/d8/dc/d12 0 2024-09-18T12:49:02.269 INFO:tasks.workunit.client.1.smithi148.stdout:8/37: symlink d8/lc 0 2024-09-18T12:49:02.270 INFO:tasks.workunit.client.1.smithi148.stdout:6/56: mknod d5/c16 0 2024-09-18T12:49:02.271 INFO:tasks.workunit.client.1.smithi148.stdout:8/38: creat d8/fd x:0 0 0 2024-09-18T12:49:02.273 INFO:tasks.workunit.client.1.smithi148.stdout:6/57: mknod d5/db/c17 0 2024-09-18T12:49:02.274 INFO:tasks.workunit.client.1.smithi148.stdout:8/39: write d8/fb [411579,93137] 0 2024-09-18T12:49:02.278 INFO:tasks.workunit.client.1.smithi148.stdout:6/58: creat d5/db/f18 x:0 0 0 2024-09-18T12:49:02.278 INFO:tasks.workunit.client.1.smithi148.stdout:8/40: mknod d8/ce 0 2024-09-18T12:49:02.280 INFO:tasks.workunit.client.1.smithi148.stdout:5/54: dwrite d7/d8/f9 [4194304,4194304] 0 2024-09-18T12:49:02.281 INFO:tasks.workunit.client.1.smithi148.stdout:0/47: dwrite fa [0,4194304] 0 2024-09-18T12:49:02.282 INFO:tasks.workunit.client.1.smithi148.stdout:0/48: stat f1 0 2024-09-18T12:49:02.283 INFO:tasks.workunit.client.1.smithi148.stdout:8/41: write d8/fd [846704,107021] 0 2024-09-18T12:49:02.284 INFO:tasks.workunit.client.1.smithi148.stdout:6/59: creat d5/f19 x:0 0 0 2024-09-18T12:49:02.285 INFO:tasks.workunit.client.1.smithi148.stdout:6/60: read f3 [811264,49704] 0 2024-09-18T12:49:02.286 INFO:tasks.workunit.client.1.smithi148.stdout:5/55: rename d7/d8/fb to d7/d8/f13 0 2024-09-18T12:49:02.287 INFO:tasks.workunit.client.1.smithi148.stdout:8/42: chown d8/ca 2371663 1 2024-09-18T12:49:02.287 INFO:tasks.workunit.client.1.smithi148.stdout:8/43: stat l0 0 2024-09-18T12:49:02.289 INFO:tasks.workunit.client.1.smithi148.stdout:6/61: rename d5/db to d5/d1a 0 2024-09-18T12:49:02.289 INFO:tasks.workunit.client.1.smithi148.stdout:6/62: dread - d5/ff zero size 2024-09-18T12:49:02.289 INFO:tasks.workunit.client.1.smithi148.stdout:0/49: creat de/ff x:0 0 0 2024-09-18T12:49:02.290 INFO:tasks.workunit.client.1.smithi148.stdout:0/50: stat de/ff 0 2024-09-18T12:49:02.290 INFO:tasks.workunit.client.1.smithi148.stdout:8/44: mkdir d8/df 0 2024-09-18T12:49:02.292 INFO:tasks.workunit.client.1.smithi148.stdout:6/63: rename d5/d1a/f18 to d5/f1b 0 2024-09-18T12:49:02.295 INFO:tasks.workunit.client.1.smithi148.stdout:0/51: rename fc to de/f10 0 2024-09-18T12:49:02.295 INFO:tasks.workunit.client.1.smithi148.stdout:8/45: creat d8/df/f10 x:0 0 0 2024-09-18T12:49:02.297 INFO:tasks.workunit.client.1.smithi148.stdout:8/46: mknod d8/df/c11 0 2024-09-18T12:49:02.298 INFO:tasks.workunit.client.1.smithi148.stdout:6/64: link d5/d1a/c17 d5/c1c 0 2024-09-18T12:49:02.300 INFO:tasks.workunit.client.1.smithi148.stdout:6/65: chown f3 14 1 2024-09-18T12:49:02.303 INFO:tasks.workunit.client.1.smithi148.stdout:0/52: dwrite f8 [4194304,4194304] 0 2024-09-18T12:49:02.303 INFO:tasks.workunit.client.1.smithi148.stdout:5/56: getdents d7/d8 0 2024-09-18T12:49:02.309 INFO:tasks.workunit.client.1.smithi148.stdout:0/53: getdents de 0 2024-09-18T12:49:02.310 INFO:tasks.workunit.client.1.smithi148.stdout:8/47: getdents d8/df 0 2024-09-18T12:49:02.310 INFO:tasks.workunit.client.1.smithi148.stdout:8/48: dread - d8/df/f10 zero size 2024-09-18T12:49:02.311 INFO:tasks.workunit.client.1.smithi148.stdout:0/54: getdents de 0 2024-09-18T12:49:02.312 INFO:tasks.workunit.client.1.smithi148.stdout:0/55: creat de/f11 x:0 0 0 2024-09-18T12:49:02.316 INFO:tasks.workunit.client.1.smithi148.stdout:5/57: truncate d7/fd 2875961 0 2024-09-18T12:49:02.319 INFO:tasks.workunit.client.1.smithi148.stdout:8/49: dwrite d8/fb [0,4194304] 0 2024-09-18T12:49:02.323 INFO:tasks.workunit.client.1.smithi148.stdout:0/56: dwrite de/f11 [0,4194304] 0 2024-09-18T12:49:02.326 INFO:tasks.workunit.client.1.smithi148.stdout:5/58: dread d7/d8/f9 [4194304,4194304] 0 2024-09-18T12:49:02.328 INFO:tasks.workunit.client.1.smithi148.stdout:8/50: getdents d8 0 2024-09-18T12:49:02.329 INFO:tasks.workunit.client.1.smithi148.stdout:5/59: unlink d7/d8/le 0 2024-09-18T12:49:02.329 INFO:tasks.workunit.client.1.smithi148.stdout:0/57: dread f3 [0,4194304] 0 2024-09-18T12:49:02.330 INFO:tasks.workunit.client.1.smithi148.stdout:8/51: rmdir d8/df 39 2024-09-18T12:49:02.330 INFO:tasks.workunit.client.1.smithi148.stdout:5/60: chown d7/f10 3 1 2024-09-18T12:49:02.331 INFO:tasks.workunit.client.1.smithi148.stdout:0/58: write f9 [1098520,122794] 0 2024-09-18T12:49:02.333 INFO:tasks.workunit.client.1.smithi148.stdout:5/61: mknod d7/d8/dc/c14 0 2024-09-18T12:49:02.333 INFO:tasks.workunit.client.1.smithi148.stdout:5/62: chown d7 6971520 1 2024-09-18T12:49:02.334 INFO:tasks.workunit.client.1.smithi148.stdout:0/59: creat de/f12 x:0 0 0 2024-09-18T12:49:02.335 INFO:tasks.workunit.client.1.smithi148.stdout:8/52: mkdir d8/d12 0 2024-09-18T12:49:02.335 INFO:tasks.workunit.client.1.smithi148.stdout:5/63: truncate d7/f11 307894 0 2024-09-18T12:49:02.338 INFO:tasks.workunit.client.1.smithi148.stdout:8/53: chown c2 818 1 2024-09-18T12:49:02.339 INFO:tasks.workunit.client.1.smithi148.stdout:8/54: creat d8/d12/f13 x:0 0 0 2024-09-18T12:49:02.340 INFO:tasks.workunit.client.1.smithi148.stdout:0/60: dread fa [0,4194304] 0 2024-09-18T12:49:02.342 INFO:tasks.workunit.client.1.smithi148.stdout:0/61: fsync fa 0 2024-09-18T12:49:02.344 INFO:tasks.workunit.client.1.smithi148.stdout:5/64: dwrite d7/d8/dc/ff [0,4194304] 0 2024-09-18T12:49:02.345 INFO:tasks.workunit.client.1.smithi148.stdout:0/62: link de/f12 de/f13 0 2024-09-18T12:49:02.346 INFO:tasks.workunit.client.1.smithi148.stdout:5/65: rmdir d7/d8/dc 39 2024-09-18T12:49:02.348 INFO:tasks.workunit.client.1.smithi148.stdout:0/63: write de/f10 [4821759,18908] 0 2024-09-18T12:49:02.348 INFO:tasks.workunit.client.1.smithi148.stdout:5/66: creat d7/f15 x:0 0 0 2024-09-18T12:49:02.349 INFO:tasks.workunit.client.1.smithi148.stdout:0/64: chown l6 39 1 2024-09-18T12:49:02.351 INFO:tasks.workunit.client.1.smithi148.stdout:5/67: unlink d7/f11 0 2024-09-18T12:49:02.351 INFO:tasks.workunit.client.1.smithi148.stdout:0/65: rmdir de 39 2024-09-18T12:49:02.355 INFO:tasks.workunit.client.1.smithi148.stdout:0/66: write de/f12 [197102,12859] 0 2024-09-18T12:49:02.355 INFO:tasks.workunit.client.1.smithi148.stdout:5/68: creat d7/d8/dc/f16 x:0 0 0 2024-09-18T12:49:02.357 INFO:tasks.workunit.client.1.smithi148.stdout:8/55: dwrite d8/fb [4194304,4194304] 0 2024-09-18T12:49:02.357 INFO:tasks.workunit.client.1.smithi148.stdout:5/69: write f6 [2424379,38310] 0 2024-09-18T12:49:02.364 INFO:tasks.workunit.client.1.smithi148.stdout:0/67: dwrite de/f11 [0,4194304] 0 2024-09-18T12:49:02.366 INFO:tasks.workunit.client.1.smithi148.stdout:0/68: mkdir de/d14 0 2024-09-18T12:49:02.368 INFO:tasks.workunit.client.1.smithi148.stdout:0/69: rename de/ff to de/d14/f15 0 2024-09-18T12:49:02.369 INFO:tasks.workunit.client.1.smithi148.stdout:0/70: chown de/f10 241 1 2024-09-18T12:49:02.371 INFO:tasks.workunit.client.1.smithi148.stdout:0/71: creat de/d14/f16 x:0 0 0 2024-09-18T12:49:02.372 INFO:tasks.workunit.client.1.smithi148.stdout:0/72: fsync f8 0 2024-09-18T12:49:02.374 INFO:tasks.workunit.client.1.smithi148.stdout:8/56: dread d8/fd [0,4194304] 0 2024-09-18T12:49:02.374 INFO:tasks.workunit.client.1.smithi148.stdout:0/73: creat de/d14/f17 x:0 0 0 2024-09-18T12:49:02.375 INFO:tasks.workunit.client.1.smithi148.stdout:0/74: truncate de/d14/f17 49231 0 2024-09-18T12:49:02.375 INFO:tasks.workunit.client.1.smithi148.stdout:0/75: chown de/d14 32063 1 2024-09-18T12:49:02.376 INFO:tasks.workunit.client.1.smithi148.stdout:0/76: dread - de/d14/f15 zero size 2024-09-18T12:49:02.376 INFO:tasks.workunit.client.1.smithi148.stdout:8/57: creat d8/df/f14 x:0 0 0 2024-09-18T12:49:02.383 INFO:tasks.workunit.client.1.smithi148.stdout:0/77: dwrite de/f10 [4194304,4194304] 0 2024-09-18T12:49:02.383 INFO:tasks.workunit.client.1.smithi148.stdout:8/58: dwrite d8/fb [4194304,4194304] 0 2024-09-18T12:49:02.387 INFO:tasks.workunit.client.1.smithi148.stdout:0/78: unlink de/f10 0 2024-09-18T12:49:02.395 INFO:tasks.workunit.client.1.smithi148.stdout:0/79: getdents de/d14 0 2024-09-18T12:49:02.398 INFO:tasks.workunit.client.1.smithi148.stdout:0/80: creat de/f18 x:0 0 0 2024-09-18T12:49:02.398 INFO:tasks.workunit.client.1.smithi148.stdout:0/81: read f1 [1420831,78440] 0 2024-09-18T12:49:02.401 INFO:tasks.workunit.client.1.smithi148.stdout:0/82: rename f8 to de/f19 0 2024-09-18T12:49:02.401 INFO:tasks.workunit.client.1.smithi148.stdout:0/83: truncate de/d14/f16 921206 0 2024-09-18T12:49:02.403 INFO:tasks.workunit.client.1.smithi148.stdout:0/84: creat de/d14/f1a x:0 0 0 2024-09-18T12:49:02.403 INFO:tasks.workunit.client.1.smithi148.stdout:0/85: write fa [2377341,120198] 0 2024-09-18T12:49:02.404 INFO:tasks.workunit.client.1.smithi148.stdout:0/86: truncate de/f13 484624 0 2024-09-18T12:49:02.405 INFO:tasks.workunit.client.1.smithi148.stdout:0/87: write de/f18 [862453,23811] 0 2024-09-18T12:49:02.405 INFO:tasks.workunit.client.1.smithi148.stdout:0/88: rename de/d14 to de/d14/d1b 22 2024-09-18T12:49:02.406 INFO:tasks.workunit.client.1.smithi148.stdout:0/89: write de/f11 [1737594,62712] 0 2024-09-18T12:49:02.407 INFO:tasks.workunit.client.1.smithi148.stdout:0/90: write de/f18 [1578857,49550] 0 2024-09-18T12:49:02.409 INFO:tasks.workunit.client.1.smithi148.stdout:0/91: creat de/f1c x:0 0 0 2024-09-18T12:49:02.409 INFO:tasks.workunit.client.1.smithi148.stdout:0/92: chown de/d14/f16 179593140 1 2024-09-18T12:49:02.412 INFO:tasks.workunit.client.1.smithi148.stdout:0/93: unlink f3 0 2024-09-18T12:49:02.414 INFO:tasks.workunit.client.1.smithi148.stdout:0/94: creat de/f1d x:0 0 0 2024-09-18T12:49:02.417 INFO:tasks.workunit.client.1.smithi148.stdout:0/95: link fa de/f1e 0 2024-09-18T12:49:02.419 INFO:tasks.workunit.client.1.smithi148.stdout:0/96: creat de/d14/f1f x:0 0 0 2024-09-18T12:49:02.426 INFO:tasks.workunit.client.1.smithi148.stdout:0/97: truncate de/f19 6953031 0 2024-09-18T12:49:02.427 INFO:tasks.workunit.client.1.smithi148.stdout:0/98: truncate de/d14/f15 850790 0 2024-09-18T12:49:02.428 INFO:tasks.workunit.client.1.smithi148.stdout:0/99: symlink de/d14/l20 0 2024-09-18T12:49:02.429 INFO:tasks.workunit.client.1.smithi148.stdout:0/100: fdatasync de/d14/f1f 0 2024-09-18T12:49:02.433 INFO:tasks.workunit.client.1.smithi148.stdout:0/101: write fa [1057275,25636] 0 2024-09-18T12:49:02.434 INFO:tasks.workunit.client.1.smithi148.stdout:0/102: write de/f12 [1157740,109936] 0 2024-09-18T12:49:02.435 INFO:tasks.workunit.client.1.smithi148.stdout:0/103: fsync de/d14/f1f 0 2024-09-18T12:49:02.436 INFO:tasks.workunit.client.1.smithi148.stdout:0/104: fsync de/f11 0 2024-09-18T12:49:02.438 INFO:tasks.workunit.client.1.smithi148.stdout:0/105: link de/f11 de/f21 0 2024-09-18T12:49:02.439 INFO:tasks.workunit.client.1.smithi148.stdout:0/106: read f9 [68452,32570] 0 2024-09-18T12:49:02.440 INFO:tasks.workunit.client.1.smithi148.stdout:0/107: mknod de/c22 0 2024-09-18T12:49:02.444 INFO:tasks.workunit.client.1.smithi148.stdout:0/108: fsync de/f19 0 2024-09-18T12:49:02.450 INFO:tasks.workunit.client.1.smithi148.stdout:0/109: dwrite de/f13 [0,4194304] 0 2024-09-18T12:49:02.450 INFO:tasks.workunit.client.1.smithi148.stdout:0/110: stat l6 0 2024-09-18T12:49:02.452 INFO:tasks.workunit.client.1.smithi148.stdout:0/111: symlink de/d14/l23 0 2024-09-18T12:49:02.452 INFO:tasks.workunit.client.1.smithi148.stdout:0/112: stat f9 0 2024-09-18T12:49:02.453 INFO:tasks.workunit.client.1.smithi148.stdout:0/113: write f5 [3645304,80845] 0 2024-09-18T12:49:02.455 INFO:tasks.workunit.client.1.smithi148.stdout:0/114: chown f9 86230981 1 2024-09-18T12:49:02.457 INFO:tasks.workunit.client.1.smithi148.stdout:0/115: creat de/f24 x:0 0 0 2024-09-18T12:49:02.460 INFO:tasks.workunit.client.1.smithi148.stdout:0/116: dread de/f21 [0,4194304] 0 2024-09-18T12:49:02.461 INFO:tasks.workunit.client.1.smithi148.stdout:0/117: write fa [4690282,84006] 0 2024-09-18T12:49:02.462 INFO:tasks.workunit.client.1.smithi148.stdout:0/118: dread de/d14/f16 [0,4194304] 0 2024-09-18T12:49:02.463 INFO:tasks.workunit.client.1.smithi148.stdout:0/119: fsync de/f1e 0 2024-09-18T12:49:02.465 INFO:tasks.workunit.client.1.smithi148.stdout:0/120: creat de/d14/f25 x:0 0 0 2024-09-18T12:49:02.466 INFO:tasks.workunit.client.1.smithi148.stdout:0/121: creat de/d14/f26 x:0 0 0 2024-09-18T12:49:02.467 INFO:tasks.workunit.client.1.smithi148.stdout:0/122: write de/f1c [509997,28303] 0 2024-09-18T12:49:02.467 INFO:tasks.workunit.client.1.smithi148.stdout:0/123: chown de/f1e 371401705 1 2024-09-18T12:49:02.467 INFO:tasks.workunit.client.1.smithi148.stdout:0/124: stat l4 0 2024-09-18T12:49:02.469 INFO:tasks.workunit.client.1.smithi148.stdout:0/125: rmdir de/d14 39 2024-09-18T12:49:02.470 INFO:tasks.workunit.client.1.smithi148.stdout:0/126: dread - de/d14/f25 zero size 2024-09-18T12:49:02.471 INFO:tasks.workunit.client.1.smithi148.stdout:0/127: write de/d14/f15 [548008,85216] 0 2024-09-18T12:49:02.471 INFO:tasks.workunit.client.1.smithi148.stdout:0/128: readlink lb 0 2024-09-18T12:49:02.472 INFO:tasks.workunit.client.1.smithi148.stdout:0/129: truncate de/f18 1940519 0 2024-09-18T12:49:02.474 INFO:tasks.workunit.client.1.smithi148.stdout:0/130: mkdir de/d27 0 2024-09-18T12:49:02.475 INFO:tasks.workunit.client.1.smithi148.stdout:0/131: creat de/d14/f28 x:0 0 0 2024-09-18T12:49:02.477 INFO:tasks.workunit.client.1.smithi148.stdout:0/132: symlink de/d14/l29 0 2024-09-18T12:49:02.483 INFO:tasks.workunit.client.1.smithi148.stdout:0/133: dwrite f5 [4194304,4194304] 0 2024-09-18T12:49:02.483 INFO:tasks.workunit.client.1.smithi148.stdout:0/134: truncate de/d14/f1f 68817 0 2024-09-18T12:49:02.485 INFO:tasks.workunit.client.1.smithi148.stdout:0/135: write fa [5192386,32629] 0 2024-09-18T12:49:02.487 INFO:tasks.workunit.client.1.smithi148.stdout:0/136: creat de/d14/f2a x:0 0 0 2024-09-18T12:49:02.488 INFO:tasks.workunit.client.1.smithi148.stdout:0/137: write de/f1e [3057508,33820] 0 2024-09-18T12:49:02.491 INFO:tasks.workunit.client.1.smithi148.stdout:0/138: link de/d14/f17 de/d27/f2b 0 2024-09-18T12:49:02.492 INFO:tasks.workunit.client.1.smithi148.stdout:0/139: chown lb 5050676 1 2024-09-18T12:49:02.492 INFO:tasks.workunit.client.1.smithi148.stdout:0/140: chown de/d14/f1a 513562 1 2024-09-18T12:49:02.500 INFO:tasks.workunit.client.1.smithi148.stdout:0/141: dwrite de/d14/f25 [0,4194304] 0 2024-09-18T12:49:02.508 INFO:tasks.workunit.client.1.smithi148.stdout:0/142: dwrite de/d14/f25 [0,4194304] 0 2024-09-18T12:49:02.509 INFO:tasks.workunit.client.1.smithi148.stdout:0/143: fsync de/d14/f26 0 2024-09-18T12:49:02.511 INFO:tasks.workunit.client.1.smithi148.stdout:0/144: mkdir de/d14/d2c 0 2024-09-18T12:49:02.513 INFO:tasks.workunit.client.1.smithi148.stdout:0/145: read de/d14/f16 [850283,130297] 0 2024-09-18T12:49:02.514 INFO:tasks.workunit.client.1.smithi148.stdout:0/146: write de/f24 [443320,15581] 0 2024-09-18T12:49:02.519 INFO:tasks.workunit.client.1.smithi148.stdout:0/147: creat de/f2d x:0 0 0 2024-09-18T12:49:02.520 INFO:tasks.workunit.client.1.smithi148.stdout:0/148: read - de/f1d zero size 2024-09-18T12:49:02.521 INFO:tasks.workunit.client.1.smithi148.stdout:0/149: mkdir de/d27/d2e 0 2024-09-18T12:49:02.522 INFO:tasks.workunit.client.1.smithi148.stdout:0/150: dread - de/f1d zero size 2024-09-18T12:49:02.533 INFO:tasks.workunit.client.1.smithi148.stdout:0/151: truncate de/f18 564210 0 2024-09-18T12:49:02.537 INFO:tasks.workunit.client.1.smithi148.stdout:0/152: rename l4 to de/l2f 0 2024-09-18T12:49:02.538 INFO:tasks.workunit.client.1.smithi148.stdout:0/153: rename de to de/d30 22 2024-09-18T12:49:02.540 INFO:tasks.workunit.client.1.smithi148.stdout:0/154: creat de/d27/f31 x:0 0 0 2024-09-18T12:49:02.540 INFO:tasks.workunit.client.1.smithi148.stdout:0/155: dread de/d14/f1f [0,4194304] 0 2024-09-18T12:49:02.544 INFO:tasks.workunit.client.1.smithi148.stdout:0/156: creat de/f32 x:0 0 0 2024-09-18T12:49:02.548 INFO:tasks.workunit.client.1.smithi148.stdout:0/157: stat de/l2f 0 2024-09-18T12:49:02.551 INFO:tasks.workunit.client.1.smithi148.stdout:0/158: link de/f21 de/d27/d2e/f33 0 2024-09-18T12:49:02.554 INFO:tasks.workunit.client.1.smithi148.stdout:0/159: link de/d14/l23 de/l34 0 2024-09-18T12:49:02.554 INFO:tasks.workunit.client.1.smithi148.stdout:0/160: rmdir de/d27 39 2024-09-18T12:49:02.556 INFO:tasks.workunit.client.1.smithi148.stdout:0/161: mknod de/d27/d2e/c35 0 2024-09-18T12:49:02.557 INFO:tasks.workunit.client.1.smithi148.stdout:0/162: readlink lb 0 2024-09-18T12:49:02.559 INFO:tasks.workunit.client.1.smithi148.stdout:0/163: dread de/f19 [0,4194304] 0 2024-09-18T12:49:02.560 INFO:tasks.workunit.client.1.smithi148.stdout:0/164: write de/f1e [111771,39588] 0 2024-09-18T12:49:02.655 INFO:tasks.workunit.client.1.smithi148.stdout:0/165: dwrite de/d14/f1f [0,4194304] 0 2024-09-18T12:49:02.656 INFO:tasks.workunit.client.1.smithi148.stdout:0/166: dread - de/f1d zero size 2024-09-18T12:49:02.657 INFO:tasks.workunit.client.1.smithi148.stdout:0/167: mknod de/d14/c36 0 2024-09-18T12:49:02.658 INFO:tasks.workunit.client.1.smithi148.stdout:0/168: write de/d14/f15 [1643185,1312] 0 2024-09-18T12:49:02.674 INFO:tasks.workunit.client.1.smithi148.stdout:0/169: dwrite de/d14/f15 [0,4194304] 0 2024-09-18T12:49:02.681 INFO:tasks.workunit.client.1.smithi148.stdout:0/170: dwrite de/f1d [0,4194304] 0 2024-09-18T12:49:02.770 INFO:tasks.workunit.client.1.smithi148.stdout:0/171: symlink de/l37 0 2024-09-18T12:49:02.772 INFO:tasks.workunit.client.1.smithi148.stdout:0/172: mkdir de/d27/d38 0 2024-09-18T12:49:02.858 INFO:tasks.workunit.client.1.smithi148.stdout:0/173: write de/d14/f16 [1382615,78951] 0 2024-09-18T12:49:02.861 INFO:tasks.workunit.client.1.smithi148.stdout:0/174: creat de/d27/d38/f39 x:0 0 0 2024-09-18T12:49:02.863 INFO:tasks.workunit.client.1.smithi148.stdout:0/175: rmdir de/d14/d2c 0 2024-09-18T12:49:02.865 INFO:tasks.workunit.client.1.smithi148.stdout:0/176: creat de/d27/f3a x:0 0 0 2024-09-18T12:49:02.865 INFO:tasks.workunit.client.1.smithi148.stdout:0/177: dread - de/f32 zero size 2024-09-18T12:49:02.866 INFO:tasks.workunit.client.1.smithi148.stdout:0/178: write de/f1e [5854419,59104] 0 2024-09-18T12:49:02.869 INFO:tasks.workunit.client.1.smithi148.stdout:0/179: getdents de 0 2024-09-18T12:49:02.877 INFO:tasks.workunit.client.1.smithi148.stdout:0/180: dwrite de/f21 [0,4194304] 0 2024-09-18T12:49:02.878 INFO:tasks.workunit.client.1.smithi148.stdout:0/181: mkdir de/d14/d3b 0 2024-09-18T12:49:02.887 INFO:tasks.workunit.client.1.smithi148.stdout:0/182: dwrite de/f19 [0,4194304] 0 2024-09-18T12:49:02.889 INFO:tasks.workunit.client.1.smithi148.stdout:0/183: mknod de/d14/c3c 0 2024-09-18T12:49:02.890 INFO:tasks.workunit.client.1.smithi148.stdout:0/184: stat de/f12 0 2024-09-18T12:49:02.890 INFO:tasks.workunit.client.1.smithi148.stdout:0/185: chown de/c22 29 1 2024-09-18T12:49:02.892 INFO:tasks.workunit.client.1.smithi148.stdout:0/186: creat de/d14/f3d x:0 0 0 2024-09-18T12:49:02.897 INFO:tasks.workunit.client.1.smithi148.stdout:0/187: dread de/d14/f1f [0,4194304] 0 2024-09-18T12:49:02.899 INFO:tasks.workunit.client.1.smithi148.stdout:0/188: mknod de/d27/d2e/c3e 0 2024-09-18T12:49:02.901 INFO:tasks.workunit.client.1.smithi148.stdout:0/189: creat de/f3f x:0 0 0 2024-09-18T12:49:02.903 INFO:tasks.workunit.client.1.smithi148.stdout:0/190: symlink de/l40 0 2024-09-18T12:49:02.904 INFO:tasks.workunit.client.1.smithi148.stdout:0/191: truncate de/d14/f17 331008 0 2024-09-18T12:49:02.905 INFO:tasks.workunit.client.1.smithi148.stdout:0/192: creat de/d27/d38/f41 x:0 0 0 2024-09-18T12:49:02.906 INFO:tasks.workunit.client.1.smithi148.stdout:0/193: symlink de/d14/l42 0 2024-09-18T12:49:02.907 INFO:tasks.workunit.client.1.smithi148.stdout:0/194: chown de/f11 28783 1 2024-09-18T12:49:02.913 INFO:tasks.workunit.client.1.smithi148.stdout:0/195: dwrite de/d27/d38/f39 [0,4194304] 0 2024-09-18T12:49:02.917 INFO:tasks.workunit.client.1.smithi148.stdout:0/196: dread de/f1e [0,4194304] 0 2024-09-18T12:49:02.921 INFO:tasks.workunit.client.1.smithi148.stdout:0/197: read de/f18 [512037,117379] 0 2024-09-18T12:49:02.921 INFO:tasks.workunit.client.1.smithi148.stdout:0/198: readlink de/l2f 0 2024-09-18T12:49:02.922 INFO:tasks.workunit.client.1.smithi148.stdout:0/199: read de/d27/d2e/f33 [1054544,22613] 0 2024-09-18T12:49:02.924 INFO:tasks.workunit.client.1.smithi148.stdout:0/200: unlink de/d27/f31 0 2024-09-18T12:49:02.924 INFO:tasks.workunit.client.1.smithi148.stdout:0/201: fdatasync de/f1c 0 2024-09-18T12:49:02.926 INFO:tasks.workunit.client.1.smithi148.stdout:0/202: unlink de/f21 0 2024-09-18T12:49:02.927 INFO:tasks.workunit.client.1.smithi148.stdout:0/203: write de/f3f [899605,29823] 0 2024-09-18T12:49:02.927 INFO:tasks.workunit.client.1.smithi148.stdout:0/204: write de/f32 [502124,79066] 0 2024-09-18T12:49:02.930 INFO:tasks.workunit.client.1.smithi148.stdout:0/205: rename de/d14/d3b to de/d14/d43 0 2024-09-18T12:49:02.933 INFO:tasks.workunit.client.1.smithi148.stdout:0/206: dread de/d14/f16 [0,4194304] 0 2024-09-18T12:49:02.935 INFO:tasks.workunit.client.1.smithi148.stdout:0/207: creat de/d27/f44 x:0 0 0 2024-09-18T12:49:02.938 INFO:tasks.workunit.client.1.smithi148.stdout:0/208: dread de/f1e [0,4194304] 0 2024-09-18T12:49:02.939 INFO:tasks.workunit.client.1.smithi148.stdout:0/209: creat de/d27/f45 x:0 0 0 2024-09-18T12:49:02.945 INFO:tasks.workunit.client.1.smithi148.stdout:0/210: dwrite de/f13 [0,4194304] 0 2024-09-18T12:49:02.946 INFO:tasks.workunit.client.1.smithi148.stdout:0/211: chown de/l34 22 1 2024-09-18T12:49:02.948 INFO:tasks.workunit.client.1.smithi148.stdout:0/212: symlink de/d27/d2e/l46 0 2024-09-18T12:49:02.950 INFO:tasks.workunit.client.1.smithi148.stdout:0/213: rename de/f2d to de/d14/f47 0 2024-09-18T12:49:02.952 INFO:tasks.workunit.client.1.smithi148.stdout:0/214: mknod de/d27/c48 0 2024-09-18T12:49:02.954 INFO:tasks.workunit.client.1.smithi148.stdout:0/215: dread de/f19 [4194304,4194304] 0 2024-09-18T12:49:02.954 INFO:tasks.workunit.client.1.smithi148.stdout:0/216: chown fa 391 1 2024-09-18T12:49:02.964 INFO:tasks.workunit.client.1.smithi148.stdout:0/217: dwrite de/d27/f2b [0,4194304] 0 2024-09-18T12:49:02.965 INFO:tasks.workunit.client.1.smithi148.stdout:0/218: dread - de/d14/f28 zero size 2024-09-18T12:49:02.967 INFO:tasks.workunit.client.1.smithi148.stdout:0/219: unlink de/d14/f1a 0 2024-09-18T12:49:02.969 INFO:tasks.workunit.client.1.smithi148.stdout:0/220: creat de/d27/f49 x:0 0 0 2024-09-18T12:49:02.970 INFO:tasks.workunit.client.1.smithi148.stdout:0/221: fsync de/d27/f45 0 2024-09-18T12:49:02.972 INFO:tasks.workunit.client.1.smithi148.stdout:0/222: symlink de/d14/l4a 0 2024-09-18T12:49:02.979 INFO:tasks.workunit.client.1.smithi148.stdout:0/223: dwrite de/d14/f1f [0,4194304] 0 2024-09-18T12:49:02.979 INFO:tasks.workunit.client.1.smithi148.stdout:0/224: chown de/d27/d38/f41 13932 1 2024-09-18T12:49:02.981 INFO:tasks.workunit.client.1.smithi148.stdout:0/225: write fa [5933250,103145] 0 2024-09-18T12:49:02.982 INFO:tasks.workunit.client.1.smithi148.stdout:0/226: write de/d14/f15 [3685956,119885] 0 2024-09-18T12:49:02.989 INFO:tasks.workunit.client.1.smithi148.stdout:0/227: dwrite de/d14/f28 [0,4194304] 0 2024-09-18T12:49:02.991 INFO:tasks.workunit.client.1.smithi148.stdout:0/228: creat de/d14/d43/f4b x:0 0 0 2024-09-18T12:49:02.992 INFO:tasks.workunit.client.1.smithi148.stdout:0/229: write de/f1e [6376495,112304] 0 2024-09-18T12:49:02.994 INFO:tasks.workunit.client.1.smithi148.stdout:0/230: mknod de/d27/c4c 0 2024-09-18T12:49:02.996 INFO:tasks.workunit.client.1.smithi148.stdout:0/231: creat de/d14/d43/f4d x:0 0 0 2024-09-18T12:49:03.000 INFO:tasks.workunit.client.1.smithi148.stdout:0/232: dread de/f18 [0,4194304] 0 2024-09-18T12:49:03.001 INFO:tasks.workunit.client.1.smithi148.stdout:0/233: creat de/d27/f4e x:0 0 0 2024-09-18T12:49:03.003 INFO:tasks.workunit.client.1.smithi148.stdout:0/234: creat de/f4f x:0 0 0 2024-09-18T12:49:03.005 INFO:tasks.workunit.client.1.smithi148.stdout:0/235: unlink de/d14/f16 0 2024-09-18T12:49:03.005 INFO:tasks.workunit.client.1.smithi148.stdout:0/236: read f1 [1089735,34140] 0 2024-09-18T12:49:03.007 INFO:tasks.workunit.client.1.smithi148.stdout:0/237: creat de/d27/d38/f50 x:0 0 0 2024-09-18T12:49:03.008 INFO:tasks.workunit.client.1.smithi148.stdout:0/238: creat de/d27/d38/f51 x:0 0 0 2024-09-18T12:49:03.011 INFO:tasks.workunit.client.1.smithi148.stdout:0/239: link de/l40 de/d14/l52 0 2024-09-18T12:49:03.011 INFO:tasks.workunit.client.1.smithi148.stdout:0/240: write de/d27/d38/f51 [785595,7251] 0 2024-09-18T12:49:03.012 INFO:tasks.workunit.client.1.smithi148.stdout:0/241: write de/f24 [1391999,7114] 0 2024-09-18T12:49:03.014 INFO:tasks.workunit.client.1.smithi148.stdout:0/242: mkdir de/d27/d53 0 2024-09-18T12:49:03.015 INFO:tasks.workunit.client.1.smithi148.stdout:0/243: write de/d27/d38/f39 [1568497,11867] 0 2024-09-18T12:49:03.017 INFO:tasks.workunit.client.1.smithi148.stdout:0/244: chown de/l40 10197 1 2024-09-18T12:49:03.018 INFO:tasks.workunit.client.1.smithi148.stdout:0/245: creat de/d27/d38/f54 x:0 0 0 2024-09-18T12:49:03.143 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:02 smithi078 ceph-mon[28091]: Adjusting osd_memory_target on smithi148 to 2240M 2024-09-18T12:49:03.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:02 smithi148 ceph-mon[35352]: Adjusting osd_memory_target on smithi148 to 2240M 2024-09-18T12:49:03.304 INFO:tasks.workunit.client.1.smithi148.stdout:3/11: sync 2024-09-18T12:49:03.304 INFO:tasks.workunit.client.1.smithi148.stdout:9/20: sync 2024-09-18T12:49:03.304 INFO:tasks.workunit.client.1.smithi148.stdout:7/23: sync 2024-09-18T12:49:03.304 INFO:tasks.workunit.client.1.smithi148.stdout:7/24: stat f3 0 2024-09-18T12:49:03.306 INFO:tasks.workunit.client.1.smithi148.stdout:9/21: creat f6 x:0 0 0 2024-09-18T12:49:03.306 INFO:tasks.workunit.client.1.smithi148.stdout:9/22: dread - f0 zero size 2024-09-18T12:49:03.307 INFO:tasks.workunit.client.1.smithi148.stdout:7/25: creat f4 x:0 0 0 2024-09-18T12:49:03.308 INFO:tasks.workunit.client.1.smithi148.stdout:7/26: write f4 [447757,35328] 0 2024-09-18T12:49:03.308 INFO:tasks.workunit.client.1.smithi148.stdout:3/12: creat d4/f5 x:0 0 0 2024-09-18T12:49:03.310 INFO:tasks.workunit.client.1.smithi148.stdout:9/23: rename f5 to f7 0 2024-09-18T12:49:03.311 INFO:tasks.workunit.client.1.smithi148.stdout:9/24: dread - f2 zero size 2024-09-18T12:49:03.311 INFO:tasks.workunit.client.1.smithi148.stdout:7/27: dread f4 [0,4194304] 0 2024-09-18T12:49:03.311 INFO:tasks.workunit.client.1.smithi148.stdout:7/28: rmdir - no directory 2024-09-18T12:49:03.312 INFO:tasks.workunit.client.1.smithi148.stdout:7/29: chown f4 37 1 2024-09-18T12:49:03.313 INFO:tasks.workunit.client.1.smithi148.stdout:9/25: mkdir d8 0 2024-09-18T12:49:03.315 INFO:tasks.workunit.client.1.smithi148.stdout:9/26: mknod d8/c9 0 2024-09-18T12:49:03.317 INFO:tasks.workunit.client.1.smithi148.stdout:9/27: mkdir d8/da 0 2024-09-18T12:49:03.317 INFO:tasks.workunit.client.1.smithi148.stdout:7/30: fsync f4 0 2024-09-18T12:49:03.318 INFO:tasks.workunit.client.1.smithi148.stdout:3/13: getdents d4 0 2024-09-18T12:49:03.319 INFO:tasks.workunit.client.1.smithi148.stdout:9/28: creat d8/da/fb x:0 0 0 2024-09-18T12:49:03.319 INFO:tasks.workunit.client.0.smithi078.stdout:1/6: sync 2024-09-18T12:49:03.320 INFO:tasks.workunit.client.0.smithi078.stdout:1/7: dread - no filename 2024-09-18T12:49:03.320 INFO:tasks.workunit.client.1.smithi148.stdout:7/31: symlink l5 0 2024-09-18T12:49:03.321 INFO:tasks.workunit.client.1.smithi148.stdout:3/14: read f2 [732519,27202] 0 2024-09-18T12:49:03.322 INFO:tasks.workunit.client.1.smithi148.stdout:7/32: symlink l6 0 2024-09-18T12:49:03.322 INFO:tasks.workunit.client.1.smithi148.stdout:7/33: chown f3 253850 1 2024-09-18T12:49:03.323 INFO:tasks.workunit.client.0.smithi078.stdout:1/8: mknod d0/c1 0 2024-09-18T12:49:03.324 INFO:tasks.workunit.client.1.smithi148.stdout:3/15: creat d4/f6 x:0 0 0 2024-09-18T12:49:03.327 INFO:tasks.workunit.client.1.smithi148.stdout:7/34: link l5 l7 0 2024-09-18T12:49:03.328 INFO:tasks.workunit.client.0.smithi078.stdout:1/9: link d0/c1 d0/c2 0 2024-09-18T12:49:03.328 INFO:tasks.workunit.client.0.smithi078.stdout:1/10: write - no filename 2024-09-18T12:49:03.328 INFO:tasks.workunit.client.0.smithi078.stdout:1/11: truncate - no filename 2024-09-18T12:49:03.328 INFO:tasks.workunit.client.0.smithi078.stdout:1/12: write - no filename 2024-09-18T12:49:03.330 INFO:tasks.workunit.client.1.smithi148.stdout:9/29: truncate f4 520430 0 2024-09-18T12:49:03.330 INFO:tasks.workunit.client.0.smithi078.stdout:1/13: symlink d0/l3 0 2024-09-18T12:49:03.332 INFO:tasks.workunit.client.1.smithi148.stdout:7/35: link f4 f8 0 2024-09-18T12:49:03.332 INFO:tasks.workunit.client.1.smithi148.stdout:7/36: chown f4 281549847 1 2024-09-18T12:49:03.334 INFO:tasks.workunit.client.0.smithi078.stdout:1/14: unlink d0/c2 0 2024-09-18T12:49:03.335 INFO:tasks.workunit.client.1.smithi148.stdout:7/37: mknod c9 0 2024-09-18T12:49:03.337 INFO:tasks.workunit.client.1.smithi148.stdout:9/30: dwrite f0 [0,4194304] 0 2024-09-18T12:49:03.338 INFO:tasks.workunit.client.1.smithi148.stdout:9/31: read - f7 zero size 2024-09-18T12:49:03.339 INFO:tasks.workunit.client.1.smithi148.stdout:7/38: creat fa x:0 0 0 2024-09-18T12:49:03.339 INFO:tasks.workunit.client.0.smithi078.stdout:1/15: link d0/c1 d0/c4 0 2024-09-18T12:49:03.340 INFO:tasks.workunit.client.0.smithi078.stdout:1/16: dread - no filename 2024-09-18T12:49:03.341 INFO:tasks.workunit.client.1.smithi148.stdout:7/39: dread f4 [0,4194304] 0 2024-09-18T12:49:03.342 INFO:tasks.workunit.client.0.smithi078.stdout:1/17: creat d0/f5 x:0 0 0 2024-09-18T12:49:03.342 INFO:tasks.workunit.client.1.smithi148.stdout:3/16: dwrite f2 [0,4194304] 0 2024-09-18T12:49:03.343 INFO:tasks.workunit.client.0.smithi078.stdout:1/18: read - d0/f5 zero size 2024-09-18T12:49:03.346 INFO:tasks.workunit.client.1.smithi148.stdout:9/32: link f2 d8/da/fc 0 2024-09-18T12:49:03.348 INFO:tasks.workunit.client.1.smithi148.stdout:7/40: mkdir db 0 2024-09-18T12:49:03.349 INFO:tasks.workunit.client.1.smithi148.stdout:3/17: mknod d4/c7 0 2024-09-18T12:49:03.350 INFO:tasks.workunit.client.1.smithi148.stdout:3/18: write d4/f5 [286221,28929] 0 2024-09-18T12:49:03.351 INFO:tasks.workunit.client.0.smithi078.stdout:1/19: dwrite d0/f5 [0,4194304] 0 2024-09-18T12:49:03.351 INFO:tasks.workunit.client.1.smithi148.stdout:3/19: stat d4/c7 0 2024-09-18T12:49:03.351 INFO:tasks.workunit.client.1.smithi148.stdout:3/20: fdatasync d4/f6 0 2024-09-18T12:49:03.351 INFO:tasks.workunit.client.1.smithi148.stdout:3/21: chown d4/f5 437419979 1 2024-09-18T12:49:03.356 INFO:tasks.workunit.client.0.smithi078.stdout:1/20: creat d0/f6 x:0 0 0 2024-09-18T12:49:03.357 INFO:tasks.workunit.client.0.smithi078.stdout:1/21: dread - d0/f6 zero size 2024-09-18T12:49:03.358 INFO:tasks.workunit.client.1.smithi148.stdout:3/22: chown c0 2046 1 2024-09-18T12:49:03.359 INFO:tasks.workunit.client.1.smithi148.stdout:2/22: sync 2024-09-18T12:49:03.359 INFO:tasks.workunit.client.1.smithi148.stdout:4/37: sync 2024-09-18T12:49:03.359 INFO:tasks.workunit.client.1.smithi148.stdout:2/23: readlink l3 0 2024-09-18T12:49:03.360 INFO:tasks.workunit.client.1.smithi148.stdout:4/38: read - fa zero size 2024-09-18T12:49:03.360 INFO:tasks.workunit.client.1.smithi148.stdout:2/24: fdatasync f7 0 2024-09-18T12:49:03.360 INFO:tasks.workunit.client.1.smithi148.stdout:7/41: mkdir db/dc 0 2024-09-18T12:49:03.360 INFO:tasks.workunit.client.1.smithi148.stdout:2/25: stat f7 0 2024-09-18T12:49:03.361 INFO:tasks.workunit.client.0.smithi078.stdout:1/22: creat d0/f7 x:0 0 0 2024-09-18T12:49:03.362 INFO:tasks.workunit.client.1.smithi148.stdout:3/23: mkdir d4/d8 0 2024-09-18T12:49:03.364 INFO:tasks.workunit.client.1.smithi148.stdout:2/26: dread f5 [0,4194304] 0 2024-09-18T12:49:03.364 INFO:tasks.workunit.client.1.smithi148.stdout:4/39: rename l5 to lf 0 2024-09-18T12:49:03.365 INFO:tasks.workunit.client.0.smithi078.stdout:1/23: dread d0/f5 [0,4194304] 0 2024-09-18T12:49:03.366 INFO:tasks.workunit.client.0.smithi078.stdout:1/24: mkdir d0/d8 0 2024-09-18T12:49:03.367 INFO:tasks.workunit.client.0.smithi078.stdout:1/25: mkdir d0/d9 0 2024-09-18T12:49:03.368 INFO:tasks.workunit.client.1.smithi148.stdout:4/40: write f2 [1306218,124133] 0 2024-09-18T12:49:03.370 INFO:tasks.workunit.client.0.smithi078.stdout:1/26: mkdir d0/d8/da 0 2024-09-18T12:49:03.371 INFO:tasks.workunit.client.1.smithi148.stdout:4/41: symlink l10 0 2024-09-18T12:49:03.372 INFO:tasks.workunit.client.0.smithi078.stdout:1/27: creat d0/fb x:0 0 0 2024-09-18T12:49:03.373 INFO:tasks.workunit.client.1.smithi148.stdout:7/42: write f4 [284702,26532] 0 2024-09-18T12:49:03.373 INFO:tasks.workunit.client.1.smithi148.stdout:3/24: dwrite f2 [0,4194304] 0 2024-09-18T12:49:03.374 INFO:tasks.workunit.client.0.smithi078.stdout:1/28: creat d0/fc x:0 0 0 2024-09-18T12:49:03.374 INFO:tasks.workunit.client.1.smithi148.stdout:4/42: write fd [841706,123444] 0 2024-09-18T12:49:03.375 INFO:tasks.workunit.client.1.smithi148.stdout:4/43: dread - fa zero size 2024-09-18T12:49:03.378 INFO:tasks.workunit.client.1.smithi148.stdout:7/43: mkdir db/dd 0 2024-09-18T12:49:03.378 INFO:tasks.workunit.client.0.smithi078.stdout:1/29: link d0/l3 d0/ld 0 2024-09-18T12:49:03.378 INFO:tasks.workunit.client.1.smithi148.stdout:2/27: dwrite f8 [0,4194304] 0 2024-09-18T12:49:03.379 INFO:tasks.workunit.client.0.smithi078.stdout:1/30: chown d0/fc 31640693 1 2024-09-18T12:49:03.380 INFO:tasks.workunit.client.1.smithi148.stdout:2/28: write f6 [133535,51990] 0 2024-09-18T12:49:03.382 INFO:tasks.workunit.client.0.smithi078.stdout:1/31: unlink d0/f6 0 2024-09-18T12:49:03.382 INFO:tasks.workunit.client.1.smithi148.stdout:4/44: chown c6 1400 1 2024-09-18T12:49:03.384 INFO:tasks.workunit.client.0.smithi078.stdout:1/32: readlink d0/l3 0 2024-09-18T12:49:03.386 INFO:tasks.workunit.client.1.smithi148.stdout:2/29: mkdir d9 0 2024-09-18T12:49:03.386 INFO:tasks.workunit.client.1.smithi148.stdout:3/25: creat d4/d8/f9 x:0 0 0 2024-09-18T12:49:03.387 INFO:tasks.workunit.client.1.smithi148.stdout:9/33: dwrite f4 [0,4194304] 0 2024-09-18T12:49:03.388 INFO:tasks.workunit.client.1.smithi148.stdout:4/45: symlink l11 0 2024-09-18T12:49:03.388 INFO:tasks.workunit.client.1.smithi148.stdout:9/34: dread - f7 zero size 2024-09-18T12:49:03.389 INFO:tasks.workunit.client.0.smithi078.stdout:1/33: rmdir d0/d9 0 2024-09-18T12:49:03.389 INFO:tasks.workunit.client.0.smithi078.stdout:1/34: chown d0/f7 31822 1 2024-09-18T12:49:03.390 INFO:tasks.workunit.client.1.smithi148.stdout:4/46: mknod c12 0 2024-09-18T12:49:03.391 INFO:tasks.workunit.client.1.smithi148.stdout:3/26: creat d4/d8/fa x:0 0 0 2024-09-18T12:49:03.391 INFO:tasks.workunit.client.1.smithi148.stdout:3/27: dread - d4/d8/f9 zero size 2024-09-18T12:49:03.392 INFO:tasks.workunit.client.1.smithi148.stdout:3/28: dread - d4/d8/f9 zero size 2024-09-18T12:49:03.393 INFO:tasks.workunit.client.1.smithi148.stdout:9/35: mkdir d8/da/dd 0 2024-09-18T12:49:03.393 INFO:tasks.workunit.client.1.smithi148.stdout:9/36: chown d8 22520559 1 2024-09-18T12:49:03.393 INFO:tasks.workunit.client.1.smithi148.stdout:9/37: dread - f6 zero size 2024-09-18T12:49:03.394 INFO:tasks.workunit.client.1.smithi148.stdout:4/47: mknod c13 0 2024-09-18T12:49:03.395 INFO:tasks.workunit.client.1.smithi148.stdout:2/30: mknod d9/ca 0 2024-09-18T12:49:03.396 INFO:tasks.workunit.client.1.smithi148.stdout:3/29: mknod d4/cb 0 2024-09-18T12:49:03.398 INFO:tasks.workunit.client.1.smithi148.stdout:9/38: creat d8/fe x:0 0 0 2024-09-18T12:49:03.402 INFO:tasks.workunit.client.1.smithi148.stdout:9/39: mkdir d8/da/df 0 2024-09-18T12:49:03.403 INFO:tasks.workunit.client.1.smithi148.stdout:9/40: chown d8/da/fb 34199294 1 2024-09-18T12:49:03.404 INFO:tasks.workunit.client.1.smithi148.stdout:9/41: fdatasync d8/da/fc 0 2024-09-18T12:49:03.405 INFO:tasks.workunit.client.1.smithi148.stdout:9/42: dread - f2 zero size 2024-09-18T12:49:03.405 INFO:tasks.workunit.client.1.smithi148.stdout:9/43: readlink - no filename 2024-09-18T12:49:03.406 INFO:tasks.workunit.client.0.smithi078.stdout:8/8: sync 2024-09-18T12:49:03.406 INFO:tasks.workunit.client.0.smithi078.stdout:4/2: sync 2024-09-18T12:49:03.406 INFO:tasks.workunit.client.0.smithi078.stdout:4/3: write - no filename 2024-09-18T12:49:03.406 INFO:tasks.workunit.client.0.smithi078.stdout:9/3: sync 2024-09-18T12:49:03.406 INFO:tasks.workunit.client.0.smithi078.stdout:9/4: dread - no filename 2024-09-18T12:49:03.406 INFO:tasks.workunit.client.0.smithi078.stdout:5/114: sync 2024-09-18T12:49:03.407 INFO:tasks.workunit.client.0.smithi078.stdout:6/77: sync 2024-09-18T12:49:03.407 INFO:tasks.workunit.client.0.smithi078.stdout:2/133: sync 2024-09-18T12:49:03.407 INFO:tasks.workunit.client.0.smithi078.stdout:3/18: sync 2024-09-18T12:49:03.407 INFO:tasks.workunit.client.0.smithi078.stdout:3/19: dread - no filename 2024-09-18T12:49:03.407 INFO:tasks.workunit.client.0.smithi078.stdout:0/12: sync 2024-09-18T12:49:03.407 INFO:tasks.workunit.client.0.smithi078.stdout:7/17: sync 2024-09-18T12:49:03.407 INFO:tasks.workunit.client.1.smithi148.stdout:7/44: truncate f3 1270377 0 2024-09-18T12:49:03.408 INFO:tasks.workunit.client.0.smithi078.stdout:7/18: readlink l3 0 2024-09-18T12:49:03.409 INFO:tasks.workunit.client.0.smithi078.stdout:7/19: chown l3 0 1 2024-09-18T12:49:03.409 INFO:tasks.workunit.client.0.smithi078.stdout:7/20: write - no filename 2024-09-18T12:49:03.409 INFO:tasks.workunit.client.1.smithi148.stdout:9/44: creat d8/f10 x:0 0 0 2024-09-18T12:49:03.409 INFO:tasks.workunit.client.1.smithi148.stdout:6/66: sync 2024-09-18T12:49:03.409 INFO:tasks.workunit.client.1.smithi148.stdout:8/59: sync 2024-09-18T12:49:03.409 INFO:tasks.workunit.client.1.smithi148.stdout:1/30: sync 2024-09-18T12:49:03.409 INFO:tasks.workunit.client.1.smithi148.stdout:5/70: sync 2024-09-18T12:49:03.409 INFO:tasks.workunit.client.1.smithi148.stdout:0/246: sync 2024-09-18T12:49:03.410 INFO:tasks.workunit.client.0.smithi078.stdout:1/35: getdents d0 0 2024-09-18T12:49:03.411 INFO:tasks.workunit.client.1.smithi148.stdout:3/30: getdents d4/d8 0 2024-09-18T12:49:03.411 INFO:tasks.workunit.client.1.smithi148.stdout:3/31: fdatasync d4/f6 0 2024-09-18T12:49:03.413 INFO:tasks.workunit.client.1.smithi148.stdout:0/247: creat de/f55 x:0 0 0 2024-09-18T12:49:03.413 INFO:tasks.workunit.client.0.smithi078.stdout:6/78: dread d10/f12 [0,4194304] 0 2024-09-18T12:49:03.414 INFO:tasks.workunit.client.1.smithi148.stdout:0/248: truncate de/d14/f2a 670451 0 2024-09-18T12:49:03.414 INFO:tasks.workunit.client.1.smithi148.stdout:0/249: dread - de/f4f zero size 2024-09-18T12:49:03.415 INFO:tasks.workunit.client.0.smithi078.stdout:5/115: dwrite f1 [0,4194304] 0 2024-09-18T12:49:03.415 INFO:tasks.workunit.client.0.smithi078.stdout:3/20: symlink l6 0 2024-09-18T12:49:03.415 INFO:tasks.workunit.client.0.smithi078.stdout:6/79: read ff [59060,75813] 0 2024-09-18T12:49:03.415 INFO:tasks.workunit.client.0.smithi078.stdout:6/80: fsync d10/f12 0 2024-09-18T12:49:03.415 INFO:tasks.workunit.client.1.smithi148.stdout:6/67: write d5/f1b [266053,31571] 0 2024-09-18T12:49:03.416 INFO:tasks.workunit.client.1.smithi148.stdout:0/250: dread de/d14/f2a [0,4194304] 0 2024-09-18T12:49:03.424 INFO:tasks.workunit.client.0.smithi078.stdout:8/9: dwrite d0/f1 [0,4194304] 0 2024-09-18T12:49:03.427 INFO:tasks.workunit.client.1.smithi148.stdout:5/71: symlink d7/l17 0 2024-09-18T12:49:03.427 INFO:tasks.workunit.client.1.smithi148.stdout:4/48: truncate f0 2538674 0 2024-09-18T12:49:03.427 INFO:tasks.workunit.client.1.smithi148.stdout:2/31: truncate f5 2637061 0 2024-09-18T12:49:03.428 INFO:tasks.workunit.client.0.smithi078.stdout:7/21: creat f5 x:0 0 0 2024-09-18T12:49:03.428 INFO:tasks.workunit.client.1.smithi148.stdout:8/60: creat d8/d12/f15 x:0 0 0 2024-09-18T12:49:03.428 INFO:tasks.workunit.client.1.smithi148.stdout:7/45: creat db/dd/fe x:0 0 0 2024-09-18T12:49:03.429 INFO:tasks.workunit.client.1.smithi148.stdout:6/68: rmdir d5/d1a/dc 39 2024-09-18T12:49:03.429 INFO:tasks.workunit.client.0.smithi078.stdout:9/5: getdents . 0 2024-09-18T12:49:03.430 INFO:tasks.workunit.client.1.smithi148.stdout:7/46: chown db/dd/fe 8491 1 2024-09-18T12:49:03.430 INFO:tasks.workunit.client.1.smithi148.stdout:7/47: readlink l6 0 2024-09-18T12:49:03.431 INFO:tasks.workunit.client.1.smithi148.stdout:0/251: mknod de/c56 0 2024-09-18T12:49:03.431 INFO:tasks.workunit.client.1.smithi148.stdout:0/252: write de/f4f [16331,54016] 0 2024-09-18T12:49:03.432 INFO:tasks.workunit.client.0.smithi078.stdout:1/36: unlink d0/f5 0 2024-09-18T12:49:03.433 INFO:tasks.workunit.client.1.smithi148.stdout:0/253: read f9 [175081,80781] 0 2024-09-18T12:49:03.434 INFO:tasks.workunit.client.0.smithi078.stdout:3/21: creat f7 x:0 0 0 2024-09-18T12:49:03.434 INFO:tasks.workunit.client.0.smithi078.stdout:3/22: dread - f7 zero size 2024-09-18T12:49:03.437 INFO:tasks.workunit.client.0.smithi078.stdout:5/116: symlink d2/d4/d12/l25 0 2024-09-18T12:49:03.438 INFO:tasks.workunit.client.1.smithi148.stdout:2/32: rmdir d9 39 2024-09-18T12:49:03.439 INFO:tasks.workunit.client.0.smithi078.stdout:4/4: mknod c0 0 2024-09-18T12:49:03.439 INFO:tasks.workunit.client.1.smithi148.stdout:0/254: dread de/d27/d38/f39 [0,4194304] 0 2024-09-18T12:49:03.440 INFO:tasks.workunit.client.0.smithi078.stdout:5/117: dread d2/f7 [0,4194304] 0 2024-09-18T12:49:03.440 INFO:tasks.workunit.client.1.smithi148.stdout:3/32: link d4/f6 d4/fc 0 2024-09-18T12:49:03.441 INFO:tasks.workunit.client.0.smithi078.stdout:6/81: unlink l4 0 2024-09-18T12:49:03.444 INFO:tasks.workunit.client.0.smithi078.stdout:0/13: creat d3/f4 x:0 0 0 2024-09-18T12:49:03.445 INFO:tasks.workunit.client.0.smithi078.stdout:0/14: write f2 [2500462,42965] 0 2024-09-18T12:49:03.446 INFO:tasks.workunit.client.1.smithi148.stdout:3/33: dwrite f2 [0,4194304] 0 2024-09-18T12:49:03.448 INFO:tasks.workunit.client.0.smithi078.stdout:0/15: dread - d3/f4 zero size 2024-09-18T12:49:03.448 INFO:tasks.workunit.client.0.smithi078.stdout:8/10: creat d0/f3 x:0 0 0 2024-09-18T12:49:03.449 INFO:tasks.workunit.client.0.smithi078.stdout:8/11: rename d0 to d0/d4 22 2024-09-18T12:49:03.450 INFO:tasks.workunit.client.0.smithi078.stdout:2/134: dwrite d4/db/f2a [0,4194304] 0 2024-09-18T12:49:03.452 INFO:tasks.workunit.client.0.smithi078.stdout:2/135: truncate d4/db/dc/f2f 173290 0 2024-09-18T12:49:03.452 INFO:tasks.workunit.client.0.smithi078.stdout:7/22: mknod c6 0 2024-09-18T12:49:03.454 INFO:tasks.workunit.client.0.smithi078.stdout:1/37: mknod d0/d8/ce 0 2024-09-18T12:49:03.455 INFO:tasks.workunit.client.0.smithi078.stdout:1/38: dread - d0/fc zero size 2024-09-18T12:49:03.455 INFO:tasks.workunit.client.1.smithi148.stdout:5/72: mkdir d7/d8/d18 0 2024-09-18T12:49:03.455 INFO:tasks.workunit.client.0.smithi078.stdout:1/39: stat d0/d8/ce 0 2024-09-18T12:49:03.456 INFO:tasks.workunit.client.0.smithi078.stdout:1/40: fsync d0/fc 0 2024-09-18T12:49:03.456 INFO:tasks.workunit.client.1.smithi148.stdout:2/33: write f8 [3006931,29542] 0 2024-09-18T12:49:03.457 INFO:tasks.workunit.client.0.smithi078.stdout:4/5: mknod c1 0 2024-09-18T12:49:03.457 INFO:tasks.workunit.client.1.smithi148.stdout:2/34: truncate f7 929495 0 2024-09-18T12:49:03.458 INFO:tasks.workunit.client.0.smithi078.stdout:5/118: creat d2/f26 x:0 0 0 2024-09-18T12:49:03.459 INFO:tasks.workunit.client.0.smithi078.stdout:6/82: creat d10/f14 x:0 0 0 2024-09-18T12:49:03.459 INFO:tasks.workunit.client.1.smithi148.stdout:2/35: dread f6 [0,4194304] 0 2024-09-18T12:49:03.460 INFO:tasks.workunit.client.0.smithi078.stdout:6/83: stat c6 0 2024-09-18T12:49:03.462 INFO:tasks.workunit.client.0.smithi078.stdout:0/16: creat d3/f5 x:0 0 0 2024-09-18T12:49:03.463 INFO:tasks.workunit.client.0.smithi078.stdout:8/12: creat d0/f5 x:0 0 0 2024-09-18T12:49:03.466 INFO:tasks.workunit.client.1.smithi148.stdout:7/48: mkdir db/dc/df 0 2024-09-18T12:49:03.466 INFO:tasks.workunit.client.1.smithi148.stdout:7/49: stat l6 0 2024-09-18T12:49:03.466 INFO:tasks.workunit.client.1.smithi148.stdout:7/50: read f8 [36566,12021] 0 2024-09-18T12:49:03.467 INFO:tasks.workunit.client.0.smithi078.stdout:9/6: creat f0 x:0 0 0 2024-09-18T12:49:03.469 INFO:tasks.workunit.client.0.smithi078.stdout:8/13: dwrite d0/f1 [0,4194304] 0 2024-09-18T12:49:03.470 INFO:tasks.workunit.client.0.smithi078.stdout:1/41: creat d0/d8/ff x:0 0 0 2024-09-18T12:49:03.470 INFO:tasks.workunit.client.0.smithi078.stdout:8/14: dread - d0/f5 zero size 2024-09-18T12:49:03.471 INFO:tasks.workunit.client.0.smithi078.stdout:4/6: symlink l2 0 2024-09-18T12:49:03.471 INFO:tasks.workunit.client.1.smithi148.stdout:7/51: dwrite db/dd/fe [0,4194304] 0 2024-09-18T12:49:03.474 INFO:tasks.workunit.client.0.smithi078.stdout:5/119: rename d2/d4/d9/f15 to d2/d4/d12/d16/f27 0 2024-09-18T12:49:03.475 INFO:tasks.workunit.client.0.smithi078.stdout:5/120: chown f1 81 1 2024-09-18T12:49:03.476 INFO:tasks.workunit.client.0.smithi078.stdout:6/84: fsync d10/f12 0 2024-09-18T12:49:03.478 INFO:tasks.workunit.client.0.smithi078.stdout:0/17: rmdir d3 39 2024-09-18T12:49:03.480 INFO:tasks.workunit.client.0.smithi078.stdout:1/42: dwrite d0/f7 [0,4194304] 0 2024-09-18T12:49:03.486 INFO:tasks.workunit.client.1.smithi148.stdout:5/73: symlink d7/d8/d18/l19 0 2024-09-18T12:49:03.487 INFO:tasks.workunit.client.0.smithi078.stdout:0/18: dwrite f1 [0,4194304] 0 2024-09-18T12:49:03.487 INFO:tasks.workunit.client.1.smithi148.stdout:5/74: chown d7/d8/f9 1558 1 2024-09-18T12:49:03.489 INFO:tasks.workunit.client.0.smithi078.stdout:9/7: creat f1 x:0 0 0 2024-09-18T12:49:03.491 INFO:tasks.workunit.client.0.smithi078.stdout:3/23: link c4 c8 0 2024-09-18T12:49:03.491 INFO:tasks.workunit.client.0.smithi078.stdout:9/8: chown f1 52431476 1 2024-09-18T12:49:03.491 INFO:tasks.workunit.client.0.smithi078.stdout:9/9: readlink - no filename 2024-09-18T12:49:03.491 INFO:tasks.workunit.client.0.smithi078.stdout:3/24: readlink l3 0 2024-09-18T12:49:03.492 INFO:tasks.workunit.client.0.smithi078.stdout:3/25: truncate f7 211433 0 2024-09-18T12:49:03.495 INFO:tasks.workunit.client.1.smithi148.stdout:3/34: link l3 d4/ld 0 2024-09-18T12:49:03.497 INFO:tasks.workunit.client.0.smithi078.stdout:4/7: symlink l3 0 2024-09-18T12:49:03.498 INFO:tasks.workunit.client.1.smithi148.stdout:6/69: rename d5/d1a/c17 to d5/d1a/c1d 0 2024-09-18T12:49:03.499 INFO:tasks.workunit.client.1.smithi148.stdout:8/61: truncate f1 5991960 0 2024-09-18T12:49:03.500 INFO:tasks.workunit.client.0.smithi078.stdout:5/121: creat d2/d4/f28 x:0 0 0 2024-09-18T12:49:03.502 INFO:tasks.workunit.client.1.smithi148.stdout:5/75: rename f2 to d7/d8/d18/f1a 0 2024-09-18T12:49:03.503 INFO:tasks.workunit.client.0.smithi078.stdout:6/85: rename ce to d10/c15 0 2024-09-18T12:49:03.505 INFO:tasks.workunit.client.1.smithi148.stdout:0/255: getdents de/d14 0 2024-09-18T12:49:03.506 INFO:tasks.workunit.client.1.smithi148.stdout:4/49: read f0 [2408772,33048] 0 2024-09-18T12:49:03.508 INFO:tasks.workunit.client.0.smithi078.stdout:2/136: rmdir d4/db/d25 0 2024-09-18T12:49:03.509 INFO:tasks.workunit.client.1.smithi148.stdout:5/76: dwrite d7/d8/dc/ff [4194304,4194304] 0 2024-09-18T12:49:03.510 INFO:tasks.workunit.client.0.smithi078.stdout:9/10: creat f2 x:0 0 0 2024-09-18T12:49:03.512 INFO:tasks.workunit.client.0.smithi078.stdout:3/26: mkdir d9 0 2024-09-18T12:49:03.514 INFO:tasks.workunit.client.0.smithi078.stdout:3/27: fdatasync f7 0 2024-09-18T12:49:03.514 INFO:tasks.workunit.client.1.smithi148.stdout:4/50: dwrite fc [0,4194304] 0 2024-09-18T12:49:03.515 INFO:tasks.workunit.client.1.smithi148.stdout:4/51: write f2 [1341417,62298] 0 2024-09-18T12:49:03.517 INFO:tasks.workunit.client.0.smithi078.stdout:3/28: write f7 [1001700,62616] 0 2024-09-18T12:49:03.518 INFO:tasks.workunit.client.0.smithi078.stdout:8/15: rename d0/f3 to d0/f6 0 2024-09-18T12:49:03.519 INFO:tasks.workunit.client.0.smithi078.stdout:2/137: dwrite d4/f9 [0,4194304] 0 2024-09-18T12:49:03.519 INFO:tasks.workunit.client.1.smithi148.stdout:0/256: readlink de/d14/l52 0 2024-09-18T12:49:03.520 INFO:tasks.workunit.client.0.smithi078.stdout:3/29: chown f7 11985 1 2024-09-18T12:49:03.520 INFO:tasks.workunit.client.1.smithi148.stdout:7/52: write db/dd/fe [5036083,124509] 0 2024-09-18T12:49:03.520 INFO:tasks.workunit.client.1.smithi148.stdout:3/35: stat d4/ld 0 2024-09-18T12:49:03.521 INFO:tasks.workunit.client.1.smithi148.stdout:3/36: truncate d4/f6 601761 0 2024-09-18T12:49:03.522 INFO:tasks.workunit.client.1.smithi148.stdout:9/45: sync 2024-09-18T12:49:03.522 INFO:tasks.workunit.client.1.smithi148.stdout:9/46: fdatasync f6 0 2024-09-18T12:49:03.524 INFO:tasks.workunit.client.0.smithi078.stdout:9/11: dwrite f0 [0,4194304] 0 2024-09-18T12:49:03.524 INFO:tasks.workunit.client.0.smithi078.stdout:5/122: mknod d2/d4/d12/d16/c29 0 2024-09-18T12:49:03.525 INFO:tasks.workunit.client.1.smithi148.stdout:6/70: symlink d5/d1a/l1e 0 2024-09-18T12:49:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:9/12: chown f2 10190341 1 2024-09-18T12:49:03.528 INFO:tasks.workunit.client.1.smithi148.stdout:3/37: dwrite d4/f5 [0,4194304] 0 2024-09-18T12:49:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:6/86: creat d10/f16 x:0 0 0 2024-09-18T12:49:03.533 INFO:tasks.workunit.client.1.smithi148.stdout:8/62: mkdir d8/d16 0 2024-09-18T12:49:03.534 INFO:tasks.workunit.client.1.smithi148.stdout:8/63: truncate d8/d12/f13 348752 0 2024-09-18T12:49:03.534 INFO:tasks.workunit.client.0.smithi078.stdout:3/30: dread f7 [0,4194304] 0 2024-09-18T12:49:03.534 INFO:tasks.workunit.client.1.smithi148.stdout:2/36: sync 2024-09-18T12:49:03.534 INFO:tasks.workunit.client.1.smithi148.stdout:1/31: sync 2024-09-18T12:49:03.535 INFO:tasks.workunit.client.1.smithi148.stdout:1/32: chown f9 399887 1 2024-09-18T12:49:03.535 INFO:tasks.workunit.client.0.smithi078.stdout:7/23: getdents . 0 2024-09-18T12:49:03.537 INFO:tasks.workunit.client.1.smithi148.stdout:5/77: rename d7/d8/dc/f16 to d7/f1b 0 2024-09-18T12:49:03.539 INFO:tasks.workunit.client.1.smithi148.stdout:5/78: dread - d7/f15 zero size 2024-09-18T12:49:03.539 INFO:tasks.workunit.client.0.smithi078.stdout:2/138: dwrite d4/db/f15 [0,4194304] 0 2024-09-18T12:49:03.542 INFO:tasks.workunit.client.0.smithi078.stdout:3/31: dread f7 [0,4194304] 0 2024-09-18T12:49:03.543 INFO:tasks.workunit.client.1.smithi148.stdout:2/37: dwrite f7 [0,4194304] 0 2024-09-18T12:49:03.544 INFO:tasks.workunit.client.0.smithi078.stdout:2/139: stat d4/db/dc 0 2024-09-18T12:49:03.546 INFO:tasks.workunit.client.1.smithi148.stdout:4/52: symlink l14 0 2024-09-18T12:49:03.548 INFO:tasks.workunit.client.1.smithi148.stdout:4/53: write fd [417271,121041] 0 2024-09-18T12:49:03.549 INFO:tasks.workunit.client.0.smithi078.stdout:8/16: mkdir d0/d7 0 2024-09-18T12:49:03.551 INFO:tasks.workunit.client.1.smithi148.stdout:7/53: mkdir db/d10 0 2024-09-18T12:49:03.552 INFO:tasks.workunit.client.1.smithi148.stdout:5/79: dwrite d7/f15 [0,4194304] 0 2024-09-18T12:49:03.553 INFO:tasks.workunit.client.1.smithi148.stdout:5/80: chown d7 75476895 1 2024-09-18T12:49:03.555 INFO:tasks.workunit.client.0.smithi078.stdout:9/13: unlink f1 0 2024-09-18T12:49:03.556 INFO:tasks.workunit.client.0.smithi078.stdout:9/14: truncate f0 4406227 0 2024-09-18T12:49:03.556 INFO:tasks.workunit.client.0.smithi078.stdout:9/15: chown f2 33311 1 2024-09-18T12:49:03.556 INFO:tasks.workunit.client.0.smithi078.stdout:9/16: stat f0 0 2024-09-18T12:49:03.556 INFO:tasks.workunit.client.0.smithi078.stdout:1/43: rename d0/c1 to d0/d8/da/c10 0 2024-09-18T12:49:03.557 INFO:tasks.workunit.client.0.smithi078.stdout:9/17: write f0 [4098543,17850] 0 2024-09-18T12:49:03.557 INFO:tasks.workunit.client.0.smithi078.stdout:1/44: chown d0/f7 56920 1 2024-09-18T12:49:03.558 INFO:tasks.workunit.client.0.smithi078.stdout:9/18: write f2 [497334,71662] 0 2024-09-18T12:49:03.559 INFO:tasks.workunit.client.1.smithi148.stdout:1/33: write f5 [1580442,109707] 0 2024-09-18T12:49:03.559 INFO:tasks.workunit.client.1.smithi148.stdout:1/34: readlink l7 0 2024-09-18T12:49:03.559 INFO:tasks.workunit.client.1.smithi148.stdout:1/35: stat f3 0 2024-09-18T12:49:03.560 INFO:tasks.workunit.client.1.smithi148.stdout:1/36: fsync f3 0 2024-09-18T12:49:03.560 INFO:tasks.workunit.client.1.smithi148.stdout:3/38: rename d4/d8/fa to d4/fe 0 2024-09-18T12:49:03.561 INFO:tasks.workunit.client.1.smithi148.stdout:3/39: write f2 [330853,34370] 0 2024-09-18T12:49:03.562 INFO:tasks.workunit.client.0.smithi078.stdout:7/24: mkdir d7 0 2024-09-18T12:49:03.563 INFO:tasks.workunit.client.1.smithi148.stdout:2/38: unlink c2 0 2024-09-18T12:49:03.565 INFO:tasks.workunit.client.0.smithi078.stdout:2/140: mkdir d4/db/d31 0 2024-09-18T12:49:03.566 INFO:tasks.workunit.client.0.smithi078.stdout:6/87: dwrite ff [0,4194304] 0 2024-09-18T12:49:03.570 INFO:tasks.workunit.client.1.smithi148.stdout:2/39: dwrite f7 [0,4194304] 0 2024-09-18T12:49:03.572 INFO:tasks.workunit.client.1.smithi148.stdout:7/54: chown l5 43 1 2024-09-18T12:49:03.572 INFO:tasks.workunit.client.1.smithi148.stdout:7/55: readlink l7 0 2024-09-18T12:49:03.573 INFO:tasks.workunit.client.0.smithi078.stdout:5/123: unlink d2/d4/f28 0 2024-09-18T12:49:03.576 INFO:tasks.workunit.client.0.smithi078.stdout:6/88: dwrite d10/f14 [0,4194304] 0 2024-09-18T12:49:03.580 INFO:tasks.workunit.client.1.smithi148.stdout:9/47: symlink d8/da/dd/l11 0 2024-09-18T12:49:03.580 INFO:tasks.workunit.client.1.smithi148.stdout:9/48: write f6 [1010615,10725] 0 2024-09-18T12:49:03.581 INFO:tasks.workunit.client.0.smithi078.stdout:9/19: creat f3 x:0 0 0 2024-09-18T12:49:03.581 INFO:tasks.workunit.client.0.smithi078.stdout:6/89: stat d10/l13 0 2024-09-18T12:49:03.581 INFO:tasks.workunit.client.0.smithi078.stdout:6/90: chown d10 131764079 1 2024-09-18T12:49:03.581 INFO:tasks.workunit.client.0.smithi078.stdout:9/20: write f3 [658565,32307] 0 2024-09-18T12:49:03.581 INFO:tasks.workunit.client.0.smithi078.stdout:6/91: chown d10/f12 617623668 1 2024-09-18T12:49:03.581 INFO:tasks.workunit.client.0.smithi078.stdout:1/45: mknod d0/d8/da/c11 0 2024-09-18T12:49:03.581 INFO:tasks.workunit.client.0.smithi078.stdout:1/46: chown d0/fb 510680 1 2024-09-18T12:49:03.581 INFO:tasks.workunit.client.0.smithi078.stdout:9/21: chown f2 1067 1 2024-09-18T12:49:03.581 INFO:tasks.workunit.client.0.smithi078.stdout:9/22: stat f2 0 2024-09-18T12:49:03.581 INFO:tasks.workunit.client.0.smithi078.stdout:1/47: fdatasync d0/f7 0 2024-09-18T12:49:03.582 INFO:tasks.workunit.client.0.smithi078.stdout:1/48: dread - d0/fc zero size 2024-09-18T12:49:03.583 INFO:tasks.workunit.client.0.smithi078.stdout:3/32: creat d9/fa x:0 0 0 2024-09-18T12:49:03.585 INFO:tasks.workunit.client.1.smithi148.stdout:1/37: rename f9 to fb 0 2024-09-18T12:49:03.585 INFO:tasks.workunit.client.1.smithi148.stdout:1/38: rmdir - no directory 2024-09-18T12:49:03.585 INFO:tasks.workunit.client.1.smithi148.stdout:1/39: fdatasync f8 0 2024-09-18T12:49:03.586 INFO:tasks.workunit.client.0.smithi078.stdout:7/25: stat c0 0 2024-09-18T12:49:03.588 INFO:tasks.workunit.client.1.smithi148.stdout:8/64: rename l0 to d8/d12/l17 0 2024-09-18T12:49:03.589 INFO:tasks.workunit.client.0.smithi078.stdout:8/17: link d0/f1 d0/d7/f8 0 2024-09-18T12:49:03.590 INFO:tasks.workunit.client.0.smithi078.stdout:1/49: dwrite d0/fc [0,4194304] 0 2024-09-18T12:49:03.592 INFO:tasks.workunit.client.0.smithi078.stdout:4/8: getdents . 0 2024-09-18T12:49:03.596 INFO:tasks.workunit.client.1.smithi148.stdout:7/56: unlink c0 0 2024-09-18T12:49:03.598 INFO:tasks.workunit.client.1.smithi148.stdout:6/71: creat d5/d1a/f1f x:0 0 0 2024-09-18T12:49:03.600 INFO:tasks.workunit.client.0.smithi078.stdout:5/124: rename f1 to d2/d4/d9/f2a 0 2024-09-18T12:49:03.602 INFO:tasks.workunit.client.1.smithi148.stdout:9/49: rmdir d8/da/dd 39 2024-09-18T12:49:03.602 INFO:tasks.workunit.client.1.smithi148.stdout:9/50: dread - f2 zero size 2024-09-18T12:49:03.606 INFO:tasks.workunit.client.0.smithi078.stdout:9/23: creat f4 x:0 0 0 2024-09-18T12:49:03.607 INFO:tasks.workunit.client.1.smithi148.stdout:0/257: truncate de/f1e 1013587 0 2024-09-18T12:49:03.608 INFO:tasks.workunit.client.0.smithi078.stdout:6/92: dwrite fb [0,4194304] 0 2024-09-18T12:49:03.608 INFO:tasks.workunit.client.1.smithi148.stdout:9/51: dwrite f0 [0,4194304] 0 2024-09-18T12:49:03.608 INFO:tasks.workunit.client.1.smithi148.stdout:1/40: mkdir dc 0 2024-09-18T12:49:03.609 INFO:tasks.workunit.client.1.smithi148.stdout:0/258: write de/d14/f1f [2354832,76618] 0 2024-09-18T12:49:03.609 INFO:tasks.workunit.client.0.smithi078.stdout:7/26: readlink l3 0 2024-09-18T12:49:03.610 INFO:tasks.workunit.client.1.smithi148.stdout:4/54: write f0 [456350,113577] 0 2024-09-18T12:49:03.611 INFO:tasks.workunit.client.1.smithi148.stdout:4/55: write f0 [507369,71834] 0 2024-09-18T12:49:03.613 INFO:tasks.workunit.client.0.smithi078.stdout:6/93: dread ff [0,4194304] 0 2024-09-18T12:49:03.616 INFO:tasks.workunit.client.1.smithi148.stdout:3/40: rename l3 to d4/d8/lf 0 2024-09-18T12:49:03.618 INFO:tasks.workunit.client.1.smithi148.stdout:2/40: creat d9/fb x:0 0 0 2024-09-18T12:49:03.620 INFO:tasks.workunit.client.0.smithi078.stdout:1/50: chown d0/d8/da/c10 6481 1 2024-09-18T12:49:03.620 INFO:tasks.workunit.client.1.smithi148.stdout:7/57: truncate f8 939243 0 2024-09-18T12:49:03.621 INFO:tasks.workunit.client.0.smithi078.stdout:1/51: write d0/d8/ff [941998,52016] 0 2024-09-18T12:49:03.623 INFO:tasks.workunit.client.1.smithi148.stdout:6/72: creat d5/d1a/dc/f20 x:0 0 0 2024-09-18T12:49:03.625 INFO:tasks.workunit.client.1.smithi148.stdout:5/81: creat d7/d8/f1c x:0 0 0 2024-09-18T12:49:03.625 INFO:tasks.workunit.client.1.smithi148.stdout:2/41: dwrite f7 [4194304,4194304] 0 2024-09-18T12:49:03.626 INFO:tasks.workunit.client.0.smithi078.stdout:5/125: stat d2/d4/d9/da/c18 0 2024-09-18T12:49:03.628 INFO:tasks.workunit.client.0.smithi078.stdout:9/24: mkdir d5 0 2024-09-18T12:49:03.629 INFO:tasks.workunit.client.0.smithi078.stdout:9/25: read f0 [3929632,51610] 0 2024-09-18T12:49:03.629 INFO:tasks.workunit.client.0.smithi078.stdout:9/26: chown d5 1224861 1 2024-09-18T12:49:03.629 INFO:tasks.workunit.client.0.smithi078.stdout:2/141: write d4/f9 [5153913,114190] 0 2024-09-18T12:49:03.630 INFO:tasks.workunit.client.1.smithi148.stdout:7/58: dwrite db/dd/fe [0,4194304] 0 2024-09-18T12:49:03.630 INFO:tasks.workunit.client.0.smithi078.stdout:9/27: fsync f0 0 2024-09-18T12:49:03.633 INFO:tasks.workunit.client.1.smithi148.stdout:9/52: write f7 [7732,116830] 0 2024-09-18T12:49:03.639 INFO:tasks.workunit.client.1.smithi148.stdout:0/259: mkdir de/d14/d43/d57 0 2024-09-18T12:49:03.640 INFO:tasks.workunit.client.0.smithi078.stdout:6/94: chown l5 3 1 2024-09-18T12:49:03.642 INFO:tasks.workunit.client.0.smithi078.stdout:8/18: mknod d0/d7/c9 0 2024-09-18T12:49:03.644 INFO:tasks.workunit.client.1.smithi148.stdout:8/65: stat l5 0 2024-09-18T12:49:03.646 INFO:tasks.workunit.client.1.smithi148.stdout:4/56: mkdir d15 0 2024-09-18T12:49:03.648 INFO:tasks.workunit.client.0.smithi078.stdout:1/52: mknod d0/d8/da/c12 0 2024-09-18T12:49:03.650 INFO:tasks.workunit.client.1.smithi148.stdout:3/41: rename c0 to d4/d8/c10 0 2024-09-18T12:49:03.652 INFO:tasks.workunit.client.1.smithi148.stdout:4/57: dwrite f0 [0,4194304] 0 2024-09-18T12:49:03.655 INFO:tasks.workunit.client.0.smithi078.stdout:3/33: link l1 d9/lb 0 2024-09-18T12:49:03.656 INFO:tasks.workunit.client.0.smithi078.stdout:1/53: dwrite d0/d8/ff [0,4194304] 0 2024-09-18T12:49:03.661 INFO:tasks.workunit.client.1.smithi148.stdout:5/82: symlink d7/d8/dc/l1d 0 2024-09-18T12:49:03.663 INFO:tasks.workunit.client.0.smithi078.stdout:7/27: mknod d7/c8 0 2024-09-18T12:49:03.665 INFO:tasks.workunit.client.0.smithi078.stdout:6/95: creat d10/f17 x:0 0 0 2024-09-18T12:49:03.667 INFO:tasks.workunit.client.1.smithi148.stdout:1/41: creat dc/fd x:0 0 0 2024-09-18T12:49:03.667 INFO:tasks.workunit.client.1.smithi148.stdout:1/42: fdatasync dc/fd 0 2024-09-18T12:49:03.667 INFO:tasks.workunit.client.1.smithi148.stdout:1/43: readlink la 0 2024-09-18T12:49:03.667 INFO:tasks.workunit.client.0.smithi078.stdout:4/9: link c1 c4 0 2024-09-18T12:49:03.669 INFO:tasks.workunit.client.1.smithi148.stdout:0/260: symlink de/d27/l58 0 2024-09-18T12:49:03.669 INFO:tasks.workunit.client.1.smithi148.stdout:0/261: dread - de/d14/f47 zero size 2024-09-18T12:49:03.670 INFO:tasks.workunit.client.0.smithi078.stdout:6/96: dread fb [0,4194304] 0 2024-09-18T12:49:03.674 INFO:tasks.workunit.client.0.smithi078.stdout:1/54: creat d0/f13 x:0 0 0 2024-09-18T12:49:03.675 INFO:tasks.workunit.client.0.smithi078.stdout:2/142: mknod d4/dd/c32 0 2024-09-18T12:49:03.675 INFO:tasks.workunit.client.0.smithi078.stdout:5/126: dwrite d2/d4/d9/da/ff [4194304,4194304] 0 2024-09-18T12:49:03.677 INFO:tasks.workunit.client.0.smithi078.stdout:5/127: read d2/fc [257524,25541] 0 2024-09-18T12:49:03.677 INFO:tasks.workunit.client.0.smithi078.stdout:9/28: creat d5/f6 x:0 0 0 2024-09-18T12:49:03.679 INFO:tasks.workunit.client.0.smithi078.stdout:9/29: write f4 [368255,124328] 0 2024-09-18T12:49:03.680 INFO:tasks.workunit.client.0.smithi078.stdout:5/128: chown d2/d4/d9/da/c18 2 1 2024-09-18T12:49:03.681 INFO:tasks.workunit.client.0.smithi078.stdout:4/10: mknod c5 0 2024-09-18T12:49:03.681 INFO:tasks.workunit.client.0.smithi078.stdout:4/11: fsync - no filename 2024-09-18T12:49:03.681 INFO:tasks.workunit.client.0.smithi078.stdout:4/12: write - no filename 2024-09-18T12:49:03.681 INFO:tasks.workunit.client.0.smithi078.stdout:4/13: dread - no filename 2024-09-18T12:49:03.684 INFO:tasks.workunit.client.0.smithi078.stdout:2/143: dread d4/db/f2a [0,4194304] 0 2024-09-18T12:49:03.685 INFO:tasks.workunit.client.0.smithi078.stdout:1/55: creat d0/d8/f14 x:0 0 0 2024-09-18T12:49:03.687 INFO:tasks.workunit.client.0.smithi078.stdout:2/144: truncate d4/f9 5781107 0 2024-09-18T12:49:03.688 INFO:tasks.workunit.client.1.smithi148.stdout:9/53: unlink d8/da/dd/l11 0 2024-09-18T12:49:03.689 INFO:tasks.workunit.client.0.smithi078.stdout:7/28: dwrite f5 [0,4194304] 0 2024-09-18T12:49:03.689 INFO:tasks.workunit.client.1.smithi148.stdout:3/42: chown d4/d8/lf 5 1 2024-09-18T12:49:03.689 INFO:tasks.workunit.client.1.smithi148.stdout:4/58: write fe [1711118,115535] 0 2024-09-18T12:49:03.689 INFO:tasks.workunit.client.1.smithi148.stdout:1/44: creat dc/fe x:0 0 0 2024-09-18T12:49:03.690 INFO:tasks.workunit.client.1.smithi148.stdout:0/262: rmdir de/d14/d43 39 2024-09-18T12:49:03.691 INFO:tasks.workunit.client.1.smithi148.stdout:8/66: symlink d8/l18 0 2024-09-18T12:49:03.691 INFO:tasks.workunit.client.0.smithi078.stdout:1/56: dread d0/f7 [0,4194304] 0 2024-09-18T12:49:03.694 INFO:tasks.workunit.client.0.smithi078.stdout:5/129: mkdir d2/d4/d9/da/d2b 0 2024-09-18T12:49:03.696 INFO:tasks.workunit.client.1.smithi148.stdout:9/54: truncate d8/fe 345784 0 2024-09-18T12:49:03.698 INFO:tasks.workunit.client.1.smithi148.stdout:2/42: dwrite f6 [0,4194304] 0 2024-09-18T12:49:03.700 INFO:tasks.workunit.client.1.smithi148.stdout:7/59: write f8 [1616346,70026] 0 2024-09-18T12:49:03.702 INFO:tasks.workunit.client.0.smithi078.stdout:2/145: unlink d4/db/f15 0 2024-09-18T12:49:03.702 INFO:tasks.workunit.client.0.smithi078.stdout:2/146: chown d4/dd/c32 5558 1 2024-09-18T12:49:03.703 INFO:tasks.workunit.client.1.smithi148.stdout:6/73: dwrite d5/f7 [0,4194304] 0 2024-09-18T12:49:03.706 INFO:tasks.workunit.client.1.smithi148.stdout:6/74: write d5/f7 [206008,76809] 0 2024-09-18T12:49:03.706 INFO:tasks.workunit.client.0.smithi078.stdout:1/57: rename d0/c4 to d0/c15 0 2024-09-18T12:49:03.709 INFO:tasks.workunit.client.0.smithi078.stdout:5/130: rmdir d2/d4/d12 39 2024-09-18T12:49:03.709 INFO:tasks.workunit.client.1.smithi148.stdout:8/67: dwrite d8/df/f14 [0,4194304] 0 2024-09-18T12:49:03.709 INFO:tasks.workunit.client.1.smithi148.stdout:8/68: readlink d8/l9 0 2024-09-18T12:49:03.709 INFO:tasks.workunit.client.0.smithi078.stdout:5/131: dread - d2/d4/d9/da/f19 zero size 2024-09-18T12:49:03.710 INFO:tasks.workunit.client.0.smithi078.stdout:5/132: readlink d2/d4/l11 0 2024-09-18T12:49:03.710 INFO:tasks.workunit.client.0.smithi078.stdout:6/97: truncate fb 357863 0 2024-09-18T12:49:03.719 INFO:tasks.workunit.client.0.smithi078.stdout:1/58: mknod d0/c16 0 2024-09-18T12:49:03.719 INFO:tasks.workunit.client.0.smithi078.stdout:1/59: fsync d0/fc 0 2024-09-18T12:49:03.721 INFO:tasks.workunit.client.0.smithi078.stdout:6/98: write f9 [1224943,13214] 0 2024-09-18T12:49:03.722 INFO:tasks.workunit.client.0.smithi078.stdout:2/147: mkdir d4/dd/d18/d33 0 2024-09-18T12:49:03.724 INFO:tasks.workunit.client.0.smithi078.stdout:9/30: getdents d5 0 2024-09-18T12:49:03.725 INFO:tasks.workunit.client.0.smithi078.stdout:9/31: fsync f4 0 2024-09-18T12:49:03.729 INFO:tasks.workunit.client.0.smithi078.stdout:1/60: dread d0/f7 [0,4194304] 0 2024-09-18T12:49:03.730 INFO:tasks.workunit.client.0.smithi078.stdout:6/99: dwrite f9 [4194304,4194304] 0 2024-09-18T12:49:03.731 INFO:tasks.workunit.client.0.smithi078.stdout:9/32: rmdir d5 39 2024-09-18T12:49:03.733 INFO:tasks.workunit.client.0.smithi078.stdout:1/61: truncate d0/f13 143425 0 2024-09-18T12:49:03.735 INFO:tasks.workunit.client.0.smithi078.stdout:2/148: dwrite d4/db/dc/f2f [0,4194304] 0 2024-09-18T12:49:03.744 INFO:tasks.workunit.client.0.smithi078.stdout:5/133: link d2/d4/d9/da/l17 d2/d4/d12/l2c 0 2024-09-18T12:49:03.745 INFO:tasks.workunit.client.0.smithi078.stdout:1/62: creat d0/d8/da/f17 x:0 0 0 2024-09-18T12:49:03.748 INFO:tasks.workunit.client.0.smithi078.stdout:9/33: mkdir d5/d7 0 2024-09-18T12:49:03.751 INFO:tasks.workunit.client.0.smithi078.stdout:5/134: rmdir d2/d4/d9 39 2024-09-18T12:49:03.752 INFO:tasks.workunit.client.1.smithi148.stdout:5/83: sync 2024-09-18T12:49:03.755 INFO:tasks.workunit.client.0.smithi078.stdout:5/135: unlink d2/d4/f10 0 2024-09-18T12:49:03.756 INFO:tasks.workunit.client.0.smithi078.stdout:5/136: truncate d2/f26 1016205 0 2024-09-18T12:49:03.759 INFO:tasks.workunit.client.0.smithi078.stdout:9/34: mkdir d5/d7/d8 0 2024-09-18T12:49:03.763 INFO:tasks.workunit.client.0.smithi078.stdout:5/137: mkdir d2/d4/d12/d2d 0 2024-09-18T12:49:03.765 INFO:tasks.workunit.client.0.smithi078.stdout:9/35: read f0 [962906,53277] 0 2024-09-18T12:49:03.767 INFO:tasks.workunit.client.0.smithi078.stdout:5/138: fsync d2/fc 0 2024-09-18T12:49:03.768 INFO:tasks.workunit.client.0.smithi078.stdout:5/139: dread d2/f26 [0,4194304] 0 2024-09-18T12:49:03.770 INFO:tasks.workunit.client.0.smithi078.stdout:9/36: creat d5/f9 x:0 0 0 2024-09-18T12:49:03.771 INFO:tasks.workunit.client.0.smithi078.stdout:6/100: write ff [3972266,1885] 0 2024-09-18T12:49:03.774 INFO:tasks.workunit.client.0.smithi078.stdout:1/63: getdents d0/d8/da 0 2024-09-18T12:49:03.777 INFO:tasks.workunit.client.0.smithi078.stdout:9/37: mknod d5/d7/ca 0 2024-09-18T12:49:03.778 INFO:tasks.workunit.client.0.smithi078.stdout:9/38: read f0 [2708017,123180] 0 2024-09-18T12:49:03.780 INFO:tasks.workunit.client.0.smithi078.stdout:6/101: dwrite d10/f17 [0,4194304] 0 2024-09-18T12:49:03.783 INFO:tasks.workunit.client.0.smithi078.stdout:0/19: sync 2024-09-18T12:49:03.786 INFO:tasks.workunit.client.0.smithi078.stdout:6/102: symlink d10/l18 0 2024-09-18T12:49:03.787 INFO:tasks.workunit.client.0.smithi078.stdout:1/64: dwrite d0/d8/da/f17 [0,4194304] 0 2024-09-18T12:49:03.790 INFO:tasks.workunit.client.0.smithi078.stdout:5/140: symlink d2/d4/d9/da/d2b/l2e 0 2024-09-18T12:49:03.793 INFO:tasks.workunit.client.0.smithi078.stdout:0/20: unlink f1 0 2024-09-18T12:49:03.795 INFO:tasks.workunit.client.0.smithi078.stdout:9/39: dwrite d5/f6 [0,4194304] 0 2024-09-18T12:49:03.795 INFO:tasks.workunit.client.0.smithi078.stdout:9/40: readlink - no filename 2024-09-18T12:49:03.797 INFO:tasks.workunit.client.0.smithi078.stdout:5/141: write d2/d4/d12/d16/f21 [279846,28811] 0 2024-09-18T12:49:03.801 INFO:tasks.workunit.client.0.smithi078.stdout:5/142: write d2/d4/d9/f13 [294688,51580] 0 2024-09-18T12:49:03.803 INFO:tasks.workunit.client.0.smithi078.stdout:6/103: dwrite ff [0,4194304] 0 2024-09-18T12:49:03.805 INFO:tasks.workunit.client.0.smithi078.stdout:1/65: dread d0/d8/da/f17 [0,4194304] 0 2024-09-18T12:49:03.805 INFO:tasks.workunit.client.0.smithi078.stdout:0/21: dread - d3/f4 zero size 2024-09-18T12:49:03.805 INFO:tasks.workunit.client.0.smithi078.stdout:0/22: rename d3 to d3/d6 22 2024-09-18T12:49:03.810 INFO:tasks.workunit.client.0.smithi078.stdout:5/143: mkdir d2/d4/d9/d2f 0 2024-09-18T12:49:03.813 INFO:tasks.workunit.client.0.smithi078.stdout:6/104: mknod d10/c19 0 2024-09-18T12:49:03.816 INFO:tasks.workunit.client.0.smithi078.stdout:6/105: write f3 [613387,74192] 0 2024-09-18T12:49:03.816 INFO:tasks.workunit.client.0.smithi078.stdout:9/41: creat d5/d7/d8/fb x:0 0 0 2024-09-18T12:49:03.818 INFO:tasks.workunit.client.0.smithi078.stdout:1/66: mkdir d0/d18 0 2024-09-18T12:49:03.818 INFO:tasks.workunit.client.0.smithi078.stdout:0/23: dwrite d3/f4 [0,4194304] 0 2024-09-18T12:49:03.828 INFO:tasks.workunit.client.0.smithi078.stdout:1/67: creat d0/f19 x:0 0 0 2024-09-18T12:49:03.829 INFO:tasks.workunit.client.0.smithi078.stdout:6/106: dwrite ff [0,4194304] 0 2024-09-18T12:49:03.830 INFO:tasks.workunit.client.0.smithi078.stdout:9/42: dwrite f4 [0,4194304] 0 2024-09-18T12:49:03.831 INFO:tasks.workunit.client.0.smithi078.stdout:0/24: mknod d3/c7 0 2024-09-18T12:49:03.831 INFO:tasks.workunit.client.0.smithi078.stdout:1/68: dread - d0/f19 zero size 2024-09-18T12:49:03.832 INFO:tasks.workunit.client.0.smithi078.stdout:0/25: stat c0 0 2024-09-18T12:49:03.832 INFO:tasks.workunit.client.0.smithi078.stdout:6/107: write f3 [2476522,58332] 0 2024-09-18T12:49:03.841 INFO:tasks.workunit.client.0.smithi078.stdout:0/26: dwrite f2 [0,4194304] 0 2024-09-18T12:49:03.843 INFO:tasks.workunit.client.0.smithi078.stdout:0/27: read f2 [1040962,86086] 0 2024-09-18T12:49:03.844 INFO:tasks.workunit.client.0.smithi078.stdout:0/28: truncate d3/f5 454051 0 2024-09-18T12:49:03.844 INFO:tasks.workunit.client.0.smithi078.stdout:1/69: unlink d0/c16 0 2024-09-18T12:49:03.847 INFO:tasks.workunit.client.0.smithi078.stdout:6/108: mknod d10/c1a 0 2024-09-18T12:49:03.854 INFO:tasks.workunit.client.0.smithi078.stdout:1/70: rmdir d0 39 2024-09-18T12:49:03.856 INFO:tasks.workunit.client.0.smithi078.stdout:5/144: getdents d2/d4/d9/da 0 2024-09-18T12:49:03.856 INFO:tasks.workunit.client.0.smithi078.stdout:5/145: chown d2 0 1 2024-09-18T12:49:03.861 INFO:tasks.workunit.client.0.smithi078.stdout:9/43: getdents d5/d7/d8 0 2024-09-18T12:49:03.861 INFO:tasks.workunit.client.0.smithi078.stdout:0/29: fdatasync f2 0 2024-09-18T12:49:03.863 INFO:tasks.workunit.client.0.smithi078.stdout:9/44: write d5/f9 [685975,37816] 0 2024-09-18T12:49:03.865 INFO:tasks.workunit.client.0.smithi078.stdout:0/30: rmdir d3 39 2024-09-18T12:49:03.865 INFO:tasks.workunit.client.0.smithi078.stdout:9/45: chown d5/f9 672 1 2024-09-18T12:49:03.866 INFO:tasks.workunit.client.0.smithi078.stdout:5/146: dwrite d2/d4/d12/d16/f24 [0,4194304] 0 2024-09-18T12:49:03.867 INFO:tasks.workunit.client.0.smithi078.stdout:1/71: dread d0/fc [0,4194304] 0 2024-09-18T12:49:03.870 INFO:tasks.workunit.client.0.smithi078.stdout:5/147: truncate d2/f26 1203108 0 2024-09-18T12:49:03.872 INFO:tasks.workunit.client.0.smithi078.stdout:6/109: getdents d10 0 2024-09-18T12:49:03.875 INFO:tasks.workunit.client.0.smithi078.stdout:0/31: creat d3/f8 x:0 0 0 2024-09-18T12:49:03.879 INFO:tasks.workunit.client.0.smithi078.stdout:1/72: rename d0/ld to d0/d8/da/l1a 0 2024-09-18T12:49:03.880 INFO:tasks.workunit.client.0.smithi078.stdout:1/73: chown d0/f7 2996 1 2024-09-18T12:49:03.881 INFO:tasks.workunit.client.0.smithi078.stdout:6/110: dwrite ff [4194304,4194304] 0 2024-09-18T12:49:03.881 INFO:tasks.workunit.client.0.smithi078.stdout:1/74: chown d0/fb 13798 1 2024-09-18T12:49:03.882 INFO:tasks.workunit.client.0.smithi078.stdout:1/75: chown d0/d8/da 7752 1 2024-09-18T12:49:03.882 INFO:tasks.workunit.client.0.smithi078.stdout:5/148: mkdir d2/d4/d9/d2f/d30 0 2024-09-18T12:49:03.890 INFO:tasks.workunit.client.0.smithi078.stdout:1/76: dread d0/d8/ff [0,4194304] 0 2024-09-18T12:49:03.890 INFO:tasks.workunit.client.0.smithi078.stdout:6/111: dwrite d10/f14 [0,4194304] 0 2024-09-18T12:49:03.891 INFO:tasks.workunit.client.0.smithi078.stdout:6/112: chown l5 9 1 2024-09-18T12:49:03.892 INFO:tasks.workunit.client.0.smithi078.stdout:1/77: read d0/f7 [2612268,67768] 0 2024-09-18T12:49:03.893 INFO:tasks.workunit.client.0.smithi078.stdout:1/78: read - d0/d8/f14 zero size 2024-09-18T12:49:03.897 INFO:tasks.workunit.client.0.smithi078.stdout:0/32: link d3/c7 d3/c9 0 2024-09-18T12:49:03.904 INFO:tasks.workunit.client.0.smithi078.stdout:5/149: dwrite d2/d4/d12/d16/f27 [0,4194304] 0 2024-09-18T12:49:03.905 INFO:tasks.workunit.client.0.smithi078.stdout:0/33: rmdir d3 39 2024-09-18T12:49:03.910 INFO:tasks.workunit.client.0.smithi078.stdout:5/150: dread d2/d4/f1d [0,4194304] 0 2024-09-18T12:49:03.915 INFO:tasks.workunit.client.0.smithi078.stdout:0/34: dwrite f2 [4194304,4194304] 0 2024-09-18T12:49:03.917 INFO:tasks.workunit.client.0.smithi078.stdout:5/151: mknod d2/d4/d9/d2f/c31 0 2024-09-18T12:49:03.922 INFO:tasks.workunit.client.0.smithi078.stdout:0/35: write d3/f4 [4031911,47575] 0 2024-09-18T12:49:03.929 INFO:tasks.workunit.client.0.smithi078.stdout:0/36: mknod d3/ca 0 2024-09-18T12:49:03.930 INFO:tasks.workunit.client.0.smithi078.stdout:6/113: truncate d10/f17 729395 0 2024-09-18T12:49:03.932 INFO:tasks.workunit.client.0.smithi078.stdout:0/37: dread d3/f4 [0,4194304] 0 2024-09-18T12:49:03.933 INFO:tasks.workunit.client.0.smithi078.stdout:6/114: unlink d10/c15 0 2024-09-18T12:49:03.936 INFO:tasks.workunit.client.0.smithi078.stdout:0/38: mknod d3/cb 0 2024-09-18T12:49:03.937 INFO:tasks.workunit.client.0.smithi078.stdout:6/115: dread ff [4194304,4194304] 0 2024-09-18T12:49:03.939 INFO:tasks.workunit.client.0.smithi078.stdout:0/39: symlink d3/lc 0 2024-09-18T12:49:03.941 INFO:tasks.workunit.client.0.smithi078.stdout:6/116: unlink d10/l13 0 2024-09-18T12:49:03.945 INFO:tasks.workunit.client.0.smithi078.stdout:5/152: truncate d2/d4/d9/f2a 203549 0 2024-09-18T12:49:03.947 INFO:tasks.workunit.client.0.smithi078.stdout:6/117: creat d10/f1b x:0 0 0 2024-09-18T12:49:03.951 INFO:tasks.workunit.client.0.smithi078.stdout:5/153: creat d2/d4/d12/f32 x:0 0 0 2024-09-18T12:49:03.954 INFO:tasks.workunit.client.0.smithi078.stdout:0/40: link d3/lc d3/ld 0 2024-09-18T12:49:03.957 INFO:tasks.workunit.client.0.smithi078.stdout:0/41: mknod d3/ce 0 2024-09-18T12:49:03.960 INFO:tasks.workunit.client.0.smithi078.stdout:0/42: rename d3/ca to d3/cf 0 2024-09-18T12:49:03.963 INFO:tasks.workunit.client.0.smithi078.stdout:0/43: symlink d3/l10 0 2024-09-18T12:49:03.963 INFO:tasks.workunit.client.0.smithi078.stdout:6/118: truncate ff 6596737 0 2024-09-18T12:49:03.965 INFO:tasks.workunit.client.0.smithi078.stdout:5/154: truncate d2/d4/d9/f2a 774859 0 2024-09-18T12:49:03.966 INFO:tasks.workunit.client.0.smithi078.stdout:0/44: fdatasync d3/f4 0 2024-09-18T12:49:03.967 INFO:tasks.workunit.client.0.smithi078.stdout:0/45: dread d3/f5 [0,4194304] 0 2024-09-18T12:49:03.968 INFO:tasks.workunit.client.0.smithi078.stdout:0/46: fsync d3/f5 0 2024-09-18T12:49:03.969 INFO:tasks.workunit.client.0.smithi078.stdout:6/119: rename d10/f12 to d10/f1c 0 2024-09-18T12:49:03.971 INFO:tasks.workunit.client.0.smithi078.stdout:0/47: dread f2 [0,4194304] 0 2024-09-18T12:49:03.975 INFO:tasks.workunit.client.0.smithi078.stdout:6/120: symlink d10/l1d 0 2024-09-18T12:49:03.980 INFO:tasks.workunit.client.0.smithi078.stdout:0/48: mknod d3/c11 0 2024-09-18T12:49:03.988 INFO:tasks.workunit.client.0.smithi078.stdout:5/155: getdents d2/d4 0 2024-09-18T12:49:03.995 INFO:tasks.workunit.client.0.smithi078.stdout:5/156: dwrite d2/fc [0,4194304] 0 2024-09-18T12:49:03.995 INFO:tasks.workunit.client.0.smithi078.stdout:0/49: getdents d3 0 2024-09-18T12:49:04.004 INFO:tasks.workunit.client.0.smithi078.stdout:5/157: dwrite d2/d4/d9/da/ff [4194304,4194304] 0 2024-09-18T12:49:04.005 INFO:tasks.workunit.client.0.smithi078.stdout:5/158: write d2/f7 [2730376,43328] 0 2024-09-18T12:49:04.007 INFO:tasks.workunit.client.0.smithi078.stdout:5/159: dread - d2/d4/d9/f1c zero size 2024-09-18T12:49:04.007 INFO:tasks.workunit.client.0.smithi078.stdout:0/50: rename d3/c9 to d3/c12 0 2024-09-18T12:49:04.010 INFO:tasks.workunit.client.0.smithi078.stdout:5/160: unlink d2/d4/d12/f32 0 2024-09-18T12:49:04.013 INFO:tasks.workunit.client.0.smithi078.stdout:0/51: fdatasync f2 0 2024-09-18T12:49:04.016 INFO:tasks.workunit.client.0.smithi078.stdout:6/121: dread ff [0,4194304] 0 2024-09-18T12:49:04.017 INFO:tasks.workunit.client.0.smithi078.stdout:6/122: read d10/f14 [768043,87041] 0 2024-09-18T12:49:04.017 INFO:tasks.workunit.client.0.smithi078.stdout:5/161: creat d2/d4/f33 x:0 0 0 2024-09-18T12:49:04.020 INFO:tasks.workunit.client.0.smithi078.stdout:0/52: symlink d3/l13 0 2024-09-18T12:49:04.024 INFO:tasks.workunit.client.0.smithi078.stdout:0/53: symlink d3/l14 0 2024-09-18T12:49:04.027 INFO:tasks.workunit.client.0.smithi078.stdout:6/123: link d10/f14 d10/f1e 0 2024-09-18T12:49:04.029 INFO:tasks.workunit.client.0.smithi078.stdout:0/54: symlink d3/l15 0 2024-09-18T12:49:04.029 INFO:tasks.workunit.client.0.smithi078.stdout:0/55: chown f2 0 1 2024-09-18T12:49:04.029 INFO:tasks.workunit.client.0.smithi078.stdout:0/56: read - d3/f8 zero size 2024-09-18T12:49:04.030 INFO:tasks.workunit.client.0.smithi078.stdout:0/57: chown d3 26 1 2024-09-18T12:49:04.031 INFO:tasks.workunit.client.0.smithi078.stdout:6/124: rename d10/l1d to d10/l1f 0 2024-09-18T12:49:04.032 INFO:tasks.workunit.client.0.smithi078.stdout:6/125: chown l5 116365077 1 2024-09-18T12:49:04.034 INFO:tasks.workunit.client.0.smithi078.stdout:5/162: creat d2/d4/f34 x:0 0 0 2024-09-18T12:49:04.036 INFO:tasks.workunit.client.0.smithi078.stdout:6/126: write d10/f14 [122341,20845] 0 2024-09-18T12:49:04.040 INFO:tasks.workunit.client.0.smithi078.stdout:6/127: rename d10/c19 to d10/c20 0 2024-09-18T12:49:04.040 INFO:tasks.workunit.client.0.smithi078.stdout:6/128: fsync f3 0 2024-09-18T12:49:04.041 INFO:tasks.workunit.client.0.smithi078.stdout:6/129: chown d10/f1b 1340810 1 2024-09-18T12:49:04.042 INFO:tasks.workunit.client.0.smithi078.stdout:5/163: symlink d2/d4/l35 0 2024-09-18T12:49:04.045 INFO:tasks.workunit.client.0.smithi078.stdout:6/130: creat d10/f21 x:0 0 0 2024-09-18T12:49:04.045 INFO:tasks.workunit.client.0.smithi078.stdout:6/131: chown d10 603133 1 2024-09-18T12:49:04.045 INFO:tasks.workunit.client.0.smithi078.stdout:0/58: write d3/f5 [1245154,99026] 0 2024-09-18T12:49:04.046 INFO:tasks.workunit.client.0.smithi078.stdout:5/164: chown d2/d4/d12/d16/c29 19192 1 2024-09-18T12:49:04.048 INFO:tasks.workunit.client.0.smithi078.stdout:6/132: read fb [52662,121160] 0 2024-09-18T12:49:04.050 INFO:tasks.workunit.client.0.smithi078.stdout:0/59: symlink d3/l16 0 2024-09-18T12:49:04.051 INFO:tasks.workunit.client.0.smithi078.stdout:5/165: mkdir d2/d4/d12/d16/d36 0 2024-09-18T12:49:04.054 INFO:tasks.workunit.client.0.smithi078.stdout:6/133: dwrite d10/f14 [0,4194304] 0 2024-09-18T12:49:04.055 INFO:tasks.workunit.client.0.smithi078.stdout:0/60: dread f2 [0,4194304] 0 2024-09-18T12:49:04.055 INFO:tasks.workunit.client.0.smithi078.stdout:0/61: dread - d3/f8 zero size 2024-09-18T12:49:04.061 INFO:tasks.workunit.client.0.smithi078.stdout:0/62: creat d3/f17 x:0 0 0 2024-09-18T12:49:04.062 INFO:tasks.workunit.client.0.smithi078.stdout:0/63: dread - d3/f8 zero size 2024-09-18T12:49:04.062 INFO:tasks.workunit.client.0.smithi078.stdout:0/64: chown c0 74156 1 2024-09-18T12:49:04.063 INFO:tasks.workunit.client.1.smithi148.stdout:1/45: rmdir dc 39 2024-09-18T12:49:04.065 INFO:tasks.workunit.client.0.smithi078.stdout:5/166: link d2/d4/d9/lb d2/d4/d9/da/l37 0 2024-09-18T12:49:04.068 INFO:tasks.workunit.client.1.smithi148.stdout:3/43: creat d4/f11 x:0 0 0 2024-09-18T12:49:04.069 INFO:tasks.workunit.client.1.smithi148.stdout:3/44: write d4/f5 [113655,25855] 0 2024-09-18T12:49:04.069 INFO:tasks.workunit.client.0.smithi078.stdout:5/167: dread - d2/d4/d9/f1c zero size 2024-09-18T12:49:04.069 INFO:tasks.workunit.client.0.smithi078.stdout:5/168: chown d2/d4/l35 0 1 2024-09-18T12:49:04.072 INFO:tasks.workunit.client.1.smithi148.stdout:4/59: rename fc to d15/f16 0 2024-09-18T12:49:04.072 INFO:tasks.workunit.client.1.smithi148.stdout:1/46: dwrite f8 [0,4194304] 0 2024-09-18T12:49:04.072 INFO:tasks.workunit.client.0.smithi078.stdout:5/169: dread d2/d4/d9/f2a [0,4194304] 0 2024-09-18T12:49:04.074 INFO:tasks.workunit.client.0.smithi078.stdout:0/65: unlink d3/ld 0 2024-09-18T12:49:04.075 INFO:tasks.workunit.client.1.smithi148.stdout:2/43: creat d9/fc x:0 0 0 2024-09-18T12:49:04.075 INFO:tasks.workunit.client.1.smithi148.stdout:2/44: chown f5 5745451 1 2024-09-18T12:49:04.076 INFO:tasks.workunit.client.1.smithi148.stdout:2/45: chown f5 10296582 1 2024-09-18T12:49:04.078 INFO:tasks.workunit.client.0.smithi078.stdout:0/66: creat d3/f18 x:0 0 0 2024-09-18T12:49:04.079 INFO:tasks.workunit.client.0.smithi078.stdout:0/67: read - d3/f17 zero size 2024-09-18T12:49:04.079 INFO:tasks.workunit.client.0.smithi078.stdout:0/68: dread - d3/f18 zero size 2024-09-18T12:49:04.081 INFO:tasks.workunit.client.0.smithi078.stdout:5/170: unlink d2/d4/d9/da/l17 0 2024-09-18T12:49:04.083 INFO:tasks.workunit.client.0.smithi078.stdout:0/69: rmdir d3 39 2024-09-18T12:49:04.084 INFO:tasks.workunit.client.0.smithi078.stdout:5/171: symlink d2/d4/d9/l38 0 2024-09-18T12:49:04.085 INFO:tasks.workunit.client.0.smithi078.stdout:5/172: fsync d2/d4/d9/f1c 0 2024-09-18T12:49:04.085 INFO:tasks.workunit.client.1.smithi148.stdout:6/75: readlink d5/l9 0 2024-09-18T12:49:04.085 INFO:tasks.workunit.client.1.smithi148.stdout:6/76: chown d5/f7 1674255 1 2024-09-18T12:49:04.086 INFO:tasks.workunit.client.0.smithi078.stdout:0/70: chown d3/ce 5 1 2024-09-18T12:49:04.086 INFO:tasks.workunit.client.1.smithi148.stdout:6/77: truncate d5/f19 889959 0 2024-09-18T12:49:04.087 INFO:tasks.workunit.client.0.smithi078.stdout:0/71: truncate d3/f18 688937 0 2024-09-18T12:49:04.087 INFO:tasks.workunit.client.1.smithi148.stdout:8/69: creat d8/df/f19 x:0 0 0 2024-09-18T12:49:04.088 INFO:tasks.workunit.client.0.smithi078.stdout:5/173: mknod d2/c39 0 2024-09-18T12:49:04.088 INFO:tasks.workunit.client.0.smithi078.stdout:5/174: write d2/f7 [2282562,32512] 0 2024-09-18T12:49:04.089 INFO:tasks.workunit.client.1.smithi148.stdout:5/84: symlink d7/d8/d18/l1e 0 2024-09-18T12:49:04.090 INFO:tasks.workunit.client.0.smithi078.stdout:0/72: creat d3/f19 x:0 0 0 2024-09-18T12:49:04.090 INFO:tasks.workunit.client.1.smithi148.stdout:5/85: readlink d7/d8/dc/l1d 0 2024-09-18T12:49:04.091 INFO:tasks.workunit.client.1.smithi148.stdout:6/78: dread d5/f7 [0,4194304] 0 2024-09-18T12:49:04.094 INFO:tasks.workunit.client.0.smithi078.stdout:6/134: dwrite d10/f17 [0,4194304] 0 2024-09-18T12:49:04.095 INFO:tasks.workunit.client.0.smithi078.stdout:0/73: rename c0 to d3/c1a 0 2024-09-18T12:49:04.095 INFO:tasks.workunit.client.1.smithi148.stdout:8/70: dwrite d8/d12/f15 [0,4194304] 0 2024-09-18T12:49:04.097 INFO:tasks.workunit.client.1.smithi148.stdout:8/71: truncate d8/df/f19 887709 0 2024-09-18T12:49:04.099 INFO:tasks.workunit.client.0.smithi078.stdout:5/175: creat d2/d4/d12/d2d/f3a x:0 0 0 2024-09-18T12:49:04.101 INFO:tasks.workunit.client.1.smithi148.stdout:4/60: mkdir d15/d17 0 2024-09-18T12:49:04.101 INFO:tasks.workunit.client.1.smithi148.stdout:4/61: chown c6 412862751 1 2024-09-18T12:49:04.102 INFO:tasks.workunit.client.0.smithi078.stdout:6/135: creat d10/f22 x:0 0 0 2024-09-18T12:49:04.106 INFO:tasks.workunit.client.0.smithi078.stdout:0/74: mknod d3/c1b 0 2024-09-18T12:49:04.108 INFO:tasks.workunit.client.1.smithi148.stdout:2/46: creat d9/fd x:0 0 0 2024-09-18T12:49:04.109 INFO:tasks.workunit.client.1.smithi148.stdout:2/47: chown f8 0 1 2024-09-18T12:49:04.109 INFO:tasks.workunit.client.1.smithi148.stdout:2/48: chown c4 13 1 2024-09-18T12:49:04.111 INFO:tasks.workunit.client.0.smithi078.stdout:5/176: unlink d2/f7 0 2024-09-18T12:49:04.112 INFO:tasks.workunit.client.1.smithi148.stdout:0/263: write fa [1693686,33917] 0 2024-09-18T12:49:04.114 INFO:tasks.workunit.client.1.smithi148.stdout:0/264: chown de/d27/f2b 664392 1 2024-09-18T12:49:04.115 INFO:tasks.workunit.client.1.smithi148.stdout:0/265: chown de/d27/d53 5 1 2024-09-18T12:49:04.115 INFO:tasks.workunit.client.1.smithi148.stdout:2/49: dwrite f7 [4194304,4194304] 0 2024-09-18T12:49:04.115 INFO:tasks.workunit.client.1.smithi148.stdout:2/50: readlink l3 0 2024-09-18T12:49:04.118 INFO:tasks.workunit.client.0.smithi078.stdout:0/75: unlink d3/l16 0 2024-09-18T12:49:04.122 INFO:tasks.workunit.client.1.smithi148.stdout:0/266: dwrite de/d14/f26 [0,4194304] 0 2024-09-18T12:49:04.127 INFO:tasks.workunit.client.1.smithi148.stdout:7/60: write f3 [1487182,2568] 0 2024-09-18T12:49:04.128 INFO:tasks.workunit.client.0.smithi078.stdout:0/76: dwrite d3/f19 [0,4194304] 0 2024-09-18T12:49:04.132 INFO:tasks.workunit.client.1.smithi148.stdout:8/72: symlink d8/d12/l1a 0 2024-09-18T12:49:04.137 INFO:tasks.workunit.client.0.smithi078.stdout:6/136: dwrite fb [0,4194304] 0 2024-09-18T12:49:04.138 INFO:tasks.workunit.client.1.smithi148.stdout:1/47: rename l7 to dc/lf 0 2024-09-18T12:49:04.142 INFO:tasks.workunit.client.1.smithi148.stdout:9/55: link d8/da/fc d8/da/df/f12 0 2024-09-18T12:49:04.142 INFO:tasks.workunit.client.1.smithi148.stdout:9/56: dread - d8/f10 zero size 2024-09-18T12:49:04.143 INFO:tasks.workunit.client.0.smithi078.stdout:6/137: dread fb [0,4194304] 0 2024-09-18T12:49:04.144 INFO:tasks.workunit.client.1.smithi148.stdout:2/51: creat d9/fe x:0 0 0 2024-09-18T12:49:04.147 INFO:tasks.workunit.client.1.smithi148.stdout:5/86: mkdir d7/d8/dc/d12/d1f 0 2024-09-18T12:49:04.150 INFO:tasks.workunit.client.0.smithi078.stdout:6/138: dwrite d10/f1e [0,4194304] 0 2024-09-18T12:49:04.154 INFO:tasks.workunit.client.0.smithi078.stdout:6/139: dread f9 [4194304,4194304] 0 2024-09-18T12:49:04.154 INFO:tasks.workunit.client.1.smithi148.stdout:5/87: dwrite d7/d8/f1c [0,4194304] 0 2024-09-18T12:49:04.156 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:03 smithi078 ceph-mon[28091]: pgmap v9: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 356 KiB/s rd, 14 MiB/s wr, 243 op/s 2024-09-18T12:49:04.190 INFO:tasks.workunit.client.0.smithi078.stdout:8/19: sync 2024-09-18T12:49:04.198 INFO:tasks.workunit.client.0.smithi078.stdout:6/140: rename l8 to d10/l23 0 2024-09-18T12:49:04.199 INFO:tasks.workunit.client.1.smithi148.stdout:3/45: link d4/d8/lf d4/l12 0 2024-09-18T12:49:04.199 INFO:tasks.workunit.client.1.smithi148.stdout:3/46: chown d4/fe 5 1 2024-09-18T12:49:04.200 INFO:tasks.workunit.client.1.smithi148.stdout:3/47: chown d4/fe 595 1 2024-09-18T12:49:04.200 INFO:tasks.workunit.client.1.smithi148.stdout:3/48: dread - d4/f11 zero size 2024-09-18T12:49:04.200 INFO:tasks.workunit.client.0.smithi078.stdout:5/177: link d2/d4/d9/l38 d2/d4/d12/l3b 0 2024-09-18T12:49:04.201 INFO:tasks.workunit.client.0.smithi078.stdout:0/77: dwrite f2 [0,4194304] 0 2024-09-18T12:49:04.202 INFO:tasks.workunit.client.1.smithi148.stdout:8/73: creat d8/d12/f1b x:0 0 0 2024-09-18T12:49:04.204 INFO:tasks.workunit.client.0.smithi078.stdout:8/20: creat d0/d7/fa x:0 0 0 2024-09-18T12:49:04.204 INFO:tasks.workunit.client.1.smithi148.stdout:4/62: symlink d15/d17/l18 0 2024-09-18T12:49:04.205 INFO:tasks.workunit.client.0.smithi078.stdout:8/21: stat d0/d7/fa 0 2024-09-18T12:49:04.207 INFO:tasks.workunit.client.1.smithi148.stdout:1/48: creat dc/f10 x:0 0 0 2024-09-18T12:49:04.209 INFO:tasks.workunit.client.0.smithi078.stdout:6/141: creat d10/f24 x:0 0 0 2024-09-18T12:49:04.209 INFO:tasks.workunit.client.0.smithi078.stdout:0/78: dwrite d3/f19 [4194304,4194304] 0 2024-09-18T12:49:04.210 INFO:tasks.workunit.client.1.smithi148.stdout:8/74: dwrite d8/df/f19 [0,4194304] 0 2024-09-18T12:49:04.211 INFO:tasks.workunit.client.0.smithi078.stdout:6/142: chown c6 1970 1 2024-09-18T12:49:04.212 INFO:tasks.workunit.client.1.smithi148.stdout:2/52: creat d9/ff x:0 0 0 2024-09-18T12:49:04.213 INFO:tasks.workunit.client.1.smithi148.stdout:2/53: write d9/fb [435484,50834] 0 2024-09-18T12:49:04.215 INFO:tasks.workunit.client.0.smithi078.stdout:8/22: rename d0/f6 to d0/d7/fb 0 2024-09-18T12:49:04.216 INFO:tasks.workunit.client.0.smithi078.stdout:8/23: chown d0/d7/fa 16432 1 2024-09-18T12:49:04.217 INFO:tasks.workunit.client.1.smithi148.stdout:5/88: mkdir d7/d8/dc/d12/d20 0 2024-09-18T12:49:04.217 INFO:tasks.workunit.client.0.smithi078.stdout:0/79: rmdir d3 39 2024-09-18T12:49:04.220 INFO:tasks.workunit.client.1.smithi148.stdout:6/79: creat d5/d1a/f21 x:0 0 0 2024-09-18T12:49:04.220 INFO:tasks.workunit.client.1.smithi148.stdout:6/80: chown d5/d1a/c15 7818617 1 2024-09-18T12:49:04.221 INFO:tasks.workunit.client.0.smithi078.stdout:5/178: mknod d2/d4/d12/c3c 0 2024-09-18T12:49:04.222 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:03 smithi148 ceph-mon[35352]: pgmap v9: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 356 KiB/s rd, 14 MiB/s wr, 243 op/s 2024-09-18T12:49:04.223 INFO:tasks.workunit.client.1.smithi148.stdout:3/49: rmdir d4/d8 39 2024-09-18T12:49:04.226 INFO:tasks.workunit.client.0.smithi078.stdout:8/24: mkdir d0/d7/dc 0 2024-09-18T12:49:04.229 INFO:tasks.workunit.client.0.smithi078.stdout:6/143: link fb d10/f25 0 2024-09-18T12:49:04.229 INFO:tasks.workunit.client.0.smithi078.stdout:6/144: readlink l5 0 2024-09-18T12:49:04.230 INFO:tasks.workunit.client.0.smithi078.stdout:6/145: chown d10/f16 50 1 2024-09-18T12:49:04.230 INFO:tasks.workunit.client.0.smithi078.stdout:6/146: chown d10/f16 110171544 1 2024-09-18T12:49:04.231 INFO:tasks.workunit.client.0.smithi078.stdout:0/80: rename d3/l14 to d3/l1c 0 2024-09-18T12:49:04.232 INFO:tasks.workunit.client.1.smithi148.stdout:1/49: mkdir dc/d11 0 2024-09-18T12:49:04.233 INFO:tasks.workunit.client.0.smithi078.stdout:8/25: dread d0/f1 [0,4194304] 0 2024-09-18T12:49:04.233 INFO:tasks.workunit.client.0.smithi078.stdout:8/26: readlink - no filename 2024-09-18T12:49:04.234 INFO:tasks.workunit.client.0.smithi078.stdout:8/27: truncate d0/f5 537694 0 2024-09-18T12:49:04.236 INFO:tasks.workunit.client.0.smithi078.stdout:6/147: mknod d10/c26 0 2024-09-18T12:49:04.236 INFO:tasks.workunit.client.0.smithi078.stdout:8/28: write d0/d7/fa [47670,68769] 0 2024-09-18T12:49:04.238 INFO:tasks.workunit.client.1.smithi148.stdout:2/54: symlink d9/l10 0 2024-09-18T12:49:04.239 INFO:tasks.workunit.client.0.smithi078.stdout:6/148: write d10/f22 [246295,13531] 0 2024-09-18T12:49:04.239 INFO:tasks.workunit.client.1.smithi148.stdout:5/89: mkdir d7/d8/d18/d21 0 2024-09-18T12:49:04.240 INFO:tasks.workunit.client.1.smithi148.stdout:1/50: dwrite dc/f10 [0,4194304] 0 2024-09-18T12:49:04.240 INFO:tasks.workunit.client.0.smithi078.stdout:0/81: dwrite d3/f4 [0,4194304] 0 2024-09-18T12:49:04.243 INFO:tasks.workunit.client.1.smithi148.stdout:0/267: mkdir de/d14/d43/d57/d59 0 2024-09-18T12:49:04.248 INFO:tasks.workunit.client.1.smithi148.stdout:4/63: link f9 d15/d17/f19 0 2024-09-18T12:49:04.249 INFO:tasks.workunit.client.0.smithi078.stdout:0/82: link d3/f4 d3/f1d 0 2024-09-18T12:49:04.251 INFO:tasks.workunit.client.1.smithi148.stdout:4/64: write f0 [188111,113085] 0 2024-09-18T12:49:04.251 INFO:tasks.workunit.client.1.smithi148.stdout:9/57: creat d8/da/f13 x:0 0 0 2024-09-18T12:49:04.251 INFO:tasks.workunit.client.1.smithi148.stdout:8/75: mkdir d8/d16/d1c 0 2024-09-18T12:49:04.254 INFO:tasks.workunit.client.1.smithi148.stdout:0/268: dread de/f24 [0,4194304] 0 2024-09-18T12:49:04.254 INFO:tasks.workunit.client.0.smithi078.stdout:8/29: dwrite d0/f1 [0,4194304] 0 2024-09-18T12:49:04.256 INFO:tasks.workunit.client.0.smithi078.stdout:8/30: write d0/f1 [1220655,79326] 0 2024-09-18T12:49:04.256 INFO:tasks.workunit.client.1.smithi148.stdout:2/55: symlink d9/l11 0 2024-09-18T12:49:04.257 INFO:tasks.workunit.client.0.smithi078.stdout:8/31: read - d0/d7/fb zero size 2024-09-18T12:49:04.257 INFO:tasks.workunit.client.1.smithi148.stdout:3/50: dwrite d4/d8/f9 [0,4194304] 0 2024-09-18T12:49:04.257 INFO:tasks.workunit.client.1.smithi148.stdout:8/76: dread d8/fd [0,4194304] 0 2024-09-18T12:49:04.257 INFO:tasks.workunit.client.1.smithi148.stdout:5/90: mkdir d7/d8/dc/d22 0 2024-09-18T12:49:04.258 INFO:tasks.workunit.client.0.smithi078.stdout:8/32: write d0/d7/f8 [2039271,50885] 0 2024-09-18T12:49:04.262 INFO:tasks.workunit.client.1.smithi148.stdout:3/51: dread d4/fc [0,4194304] 0 2024-09-18T12:49:04.263 INFO:tasks.workunit.client.0.smithi078.stdout:0/83: link d3/ce d3/c1e 0 2024-09-18T12:49:04.264 INFO:tasks.workunit.client.1.smithi148.stdout:4/65: dwrite f0 [0,4194304] 0 2024-09-18T12:49:04.266 INFO:tasks.workunit.client.1.smithi148.stdout:2/56: dread f7 [4194304,4194304] 0 2024-09-18T12:49:04.266 INFO:tasks.workunit.client.0.smithi078.stdout:8/33: rename d0/d7/fa to d0/fd 0 2024-09-18T12:49:04.267 INFO:tasks.workunit.client.1.smithi148.stdout:1/51: creat dc/d11/f12 x:0 0 0 2024-09-18T12:49:04.268 INFO:tasks.workunit.client.0.smithi078.stdout:8/34: chown d0/d7/f8 0 1 2024-09-18T12:49:04.268 INFO:tasks.workunit.client.1.smithi148.stdout:4/66: read fe [906341,26336] 0 2024-09-18T12:49:04.268 INFO:tasks.workunit.client.1.smithi148.stdout:1/52: write f6 [3822668,4556] 0 2024-09-18T12:49:04.269 INFO:tasks.workunit.client.0.smithi078.stdout:0/84: mkdir d3/d1f 0 2024-09-18T12:49:04.274 INFO:tasks.workunit.client.1.smithi148.stdout:0/269: creat de/d27/f5a x:0 0 0 2024-09-18T12:49:04.274 INFO:tasks.workunit.client.1.smithi148.stdout:0/270: stat de/d27/d38/f51 0 2024-09-18T12:49:04.276 INFO:tasks.workunit.client.0.smithi078.stdout:8/35: dwrite d0/f5 [0,4194304] 0 2024-09-18T12:49:04.277 INFO:tasks.workunit.client.0.smithi078.stdout:8/36: readlink - no filename 2024-09-18T12:49:04.277 INFO:tasks.workunit.client.0.smithi078.stdout:8/37: readlink - no filename 2024-09-18T12:49:04.277 INFO:tasks.workunit.client.1.smithi148.stdout:6/81: link d5/ff d5/d1a/f22 0 2024-09-18T12:49:04.279 INFO:tasks.workunit.client.0.smithi078.stdout:0/85: creat d3/f20 x:0 0 0 2024-09-18T12:49:04.281 INFO:tasks.workunit.client.1.smithi148.stdout:0/271: dwrite de/f4f [0,4194304] 0 2024-09-18T12:49:04.283 INFO:tasks.workunit.client.0.smithi078.stdout:0/86: dread d3/f1d [0,4194304] 0 2024-09-18T12:49:04.284 INFO:tasks.workunit.client.1.smithi148.stdout:8/77: mknod d8/d16/c1d 0 2024-09-18T12:49:04.284 INFO:tasks.workunit.client.0.smithi078.stdout:0/87: fdatasync d3/f19 0 2024-09-18T12:49:04.285 INFO:tasks.workunit.client.0.smithi078.stdout:8/38: fsync d0/f2 0 2024-09-18T12:49:04.285 INFO:tasks.workunit.client.1.smithi148.stdout:8/78: chown d8/ca 30492 1 2024-09-18T12:49:04.290 INFO:tasks.workunit.client.0.smithi078.stdout:8/39: dread d0/d7/f8 [0,4194304] 0 2024-09-18T12:49:04.290 INFO:tasks.workunit.client.1.smithi148.stdout:5/91: mknod d7/d8/d18/c23 0 2024-09-18T12:49:04.291 INFO:tasks.workunit.client.0.smithi078.stdout:8/40: chown d0/d7/dc 18 1 2024-09-18T12:49:04.291 INFO:tasks.workunit.client.0.smithi078.stdout:0/88: chown d3/c7 448814468 1 2024-09-18T12:49:04.292 INFO:tasks.workunit.client.0.smithi078.stdout:0/89: read d3/f1d [1201686,2685] 0 2024-09-18T12:49:04.292 INFO:tasks.workunit.client.0.smithi078.stdout:8/41: truncate d0/fd 1086534 0 2024-09-18T12:49:04.292 INFO:tasks.workunit.client.1.smithi148.stdout:7/61: sync 2024-09-18T12:49:04.293 INFO:tasks.workunit.client.0.smithi078.stdout:8/42: write d0/d7/f8 [2449974,46868] 0 2024-09-18T12:49:04.295 INFO:tasks.workunit.client.0.smithi078.stdout:0/90: creat d3/f21 x:0 0 0 2024-09-18T12:49:04.296 INFO:tasks.workunit.client.1.smithi148.stdout:2/57: symlink d9/l12 0 2024-09-18T12:49:04.297 INFO:tasks.workunit.client.1.smithi148.stdout:2/58: fdatasync f5 0 2024-09-18T12:49:04.298 INFO:tasks.workunit.client.0.smithi078.stdout:0/91: symlink d3/l22 0 2024-09-18T12:49:04.299 INFO:tasks.workunit.client.1.smithi148.stdout:7/62: dwrite f4 [0,4194304] 0 2024-09-18T12:49:04.299 INFO:tasks.workunit.client.1.smithi148.stdout:4/67: creat d15/d17/f1a x:0 0 0 2024-09-18T12:49:04.299 INFO:tasks.workunit.client.0.smithi078.stdout:0/92: write d3/f17 [813677,122085] 0 2024-09-18T12:49:04.300 INFO:tasks.workunit.client.1.smithi148.stdout:4/68: dread - d15/d17/f1a zero size 2024-09-18T12:49:04.301 INFO:tasks.workunit.client.1.smithi148.stdout:6/82: rename d5/f7 to d5/f23 0 2024-09-18T12:49:04.302 INFO:tasks.workunit.client.1.smithi148.stdout:6/83: dread - d5/ff zero size 2024-09-18T12:49:04.304 INFO:tasks.workunit.client.0.smithi078.stdout:0/93: symlink d3/d1f/l23 0 2024-09-18T12:49:04.306 INFO:tasks.workunit.client.1.smithi148.stdout:5/92: creat d7/d8/dc/d12/f24 x:0 0 0 2024-09-18T12:49:04.307 INFO:tasks.workunit.client.0.smithi078.stdout:0/94: write d3/f18 [651017,48928] 0 2024-09-18T12:49:04.307 INFO:tasks.workunit.client.0.smithi078.stdout:8/43: fsync d0/f1 0 2024-09-18T12:49:04.311 INFO:tasks.workunit.client.1.smithi148.stdout:4/69: dwrite d15/d17/f1a [0,4194304] 0 2024-09-18T12:49:04.311 INFO:tasks.workunit.client.0.smithi078.stdout:0/95: mknod d3/d1f/c24 0 2024-09-18T12:49:04.311 INFO:tasks.workunit.client.0.smithi078.stdout:8/44: dread d0/f1 [0,4194304] 0 2024-09-18T12:49:04.312 INFO:tasks.workunit.client.1.smithi148.stdout:4/70: readlink l1 0 2024-09-18T12:49:04.313 INFO:tasks.workunit.client.1.smithi148.stdout:8/79: dread f1 [0,4194304] 0 2024-09-18T12:49:04.313 INFO:tasks.workunit.client.1.smithi148.stdout:6/84: dwrite d5/fa [0,4194304] 0 2024-09-18T12:49:04.314 INFO:tasks.workunit.client.1.smithi148.stdout:8/80: truncate d8/fd 975664 0 2024-09-18T12:49:04.315 INFO:tasks.workunit.client.1.smithi148.stdout:2/59: symlink d9/l13 0 2024-09-18T12:49:04.319 INFO:tasks.workunit.client.0.smithi078.stdout:8/45: rename d0/fd to d0/fe 0 2024-09-18T12:49:04.320 INFO:tasks.workunit.client.0.smithi078.stdout:0/96: dwrite d3/f18 [0,4194304] 0 2024-09-18T12:49:04.321 INFO:tasks.workunit.client.0.smithi078.stdout:0/97: chown d3/c12 22540537 1 2024-09-18T12:49:04.321 INFO:tasks.workunit.client.1.smithi148.stdout:0/272: link de/f13 de/d27/d38/f5b 0 2024-09-18T12:49:04.322 INFO:tasks.workunit.client.1.smithi148.stdout:0/273: chown de/f55 31 1 2024-09-18T12:49:04.329 INFO:tasks.workunit.client.1.smithi148.stdout:9/58: getdents d8 0 2024-09-18T12:49:04.329 INFO:tasks.workunit.client.1.smithi148.stdout:9/59: read - d8/da/fb zero size 2024-09-18T12:49:04.330 INFO:tasks.workunit.client.0.smithi078.stdout:0/98: dwrite d3/f21 [0,4194304] 0 2024-09-18T12:49:04.331 INFO:tasks.workunit.client.1.smithi148.stdout:4/71: mknod d15/c1b 0 2024-09-18T12:49:04.332 INFO:tasks.workunit.client.1.smithi148.stdout:4/72: truncate f0 4571213 0 2024-09-18T12:49:04.333 INFO:tasks.workunit.client.0.smithi078.stdout:0/99: write d3/f4 [619141,27315] 0 2024-09-18T12:49:04.333 INFO:tasks.workunit.client.1.smithi148.stdout:2/60: symlink d9/l14 0 2024-09-18T12:49:04.335 INFO:tasks.workunit.client.1.smithi148.stdout:0/274: unlink de/f3f 0 2024-09-18T12:49:04.336 INFO:tasks.workunit.client.0.smithi078.stdout:0/100: mkdir d3/d1f/d25 0 2024-09-18T12:49:04.336 INFO:tasks.workunit.client.1.smithi148.stdout:9/60: dread f6 [0,4194304] 0 2024-09-18T12:49:04.337 INFO:tasks.workunit.client.1.smithi148.stdout:5/93: truncate d7/fd 632480 0 2024-09-18T12:49:04.337 INFO:tasks.workunit.client.0.smithi078.stdout:0/101: read d3/f19 [1178764,96940] 0 2024-09-18T12:49:04.338 INFO:tasks.workunit.client.1.smithi148.stdout:1/53: getdents dc 0 2024-09-18T12:49:04.341 INFO:tasks.workunit.client.1.smithi148.stdout:2/61: mknod d9/c15 0 2024-09-18T12:49:04.343 INFO:tasks.workunit.client.1.smithi148.stdout:1/54: write dc/fe [755938,6521] 0 2024-09-18T12:49:04.343 INFO:tasks.workunit.client.1.smithi148.stdout:4/73: dwrite fa [0,4194304] 0 2024-09-18T12:49:04.345 INFO:tasks.workunit.client.0.smithi078.stdout:0/102: dwrite d3/f21 [0,4194304] 0 2024-09-18T12:49:04.351 INFO:tasks.workunit.client.0.smithi078.stdout:0/103: rename d3/f8 to d3/d1f/f26 0 2024-09-18T12:49:04.353 INFO:tasks.workunit.client.0.smithi078.stdout:0/104: mknod d3/c27 0 2024-09-18T12:49:04.354 INFO:tasks.workunit.client.0.smithi078.stdout:0/105: chown d3/d1f/f26 5434678 1 2024-09-18T12:49:04.356 INFO:tasks.workunit.client.0.smithi078.stdout:0/106: creat d3/f28 x:0 0 0 2024-09-18T12:49:04.365 INFO:tasks.workunit.client.0.smithi078.stdout:0/107: dwrite d3/d1f/f26 [0,4194304] 0 2024-09-18T12:49:04.365 INFO:tasks.workunit.client.0.smithi078.stdout:8/46: write d0/d7/fb [416797,105698] 0 2024-09-18T12:49:04.367 INFO:tasks.workunit.client.1.smithi148.stdout:9/61: creat d8/da/dd/f14 x:0 0 0 2024-09-18T12:49:04.368 INFO:tasks.workunit.client.1.smithi148.stdout:8/81: rename d8/fd to d8/f1e 0 2024-09-18T12:49:04.368 INFO:tasks.workunit.client.0.smithi078.stdout:0/108: mkdir d3/d1f/d29 0 2024-09-18T12:49:04.369 INFO:tasks.workunit.client.1.smithi148.stdout:5/94: write d7/d8/d18/f1a [715282,72628] 0 2024-09-18T12:49:04.369 INFO:tasks.workunit.client.1.smithi148.stdout:2/62: creat d9/f16 x:0 0 0 2024-09-18T12:49:04.369 INFO:tasks.workunit.client.0.smithi078.stdout:0/109: write d3/f5 [2277130,96772] 0 2024-09-18T12:49:04.370 INFO:tasks.workunit.client.0.smithi078.stdout:0/110: readlink d3/l15 0 2024-09-18T12:49:04.373 INFO:tasks.workunit.client.1.smithi148.stdout:7/63: truncate db/dd/fe 4977056 0 2024-09-18T12:49:04.375 INFO:tasks.workunit.client.1.smithi148.stdout:6/85: getdents d5/d1a 0 2024-09-18T12:49:04.377 INFO:tasks.workunit.client.0.smithi078.stdout:8/47: symlink d0/d7/dc/lf 0 2024-09-18T12:49:04.379 INFO:tasks.workunit.client.1.smithi148.stdout:6/86: truncate d5/d1a/f21 157548 0 2024-09-18T12:49:04.380 INFO:tasks.workunit.client.1.smithi148.stdout:6/87: dread - d5/d1a/f1f zero size 2024-09-18T12:49:04.380 INFO:tasks.workunit.client.0.smithi078.stdout:0/111: dread d3/f17 [0,4194304] 0 2024-09-18T12:49:04.381 INFO:tasks.workunit.client.1.smithi148.stdout:2/63: dread f6 [0,4194304] 0 2024-09-18T12:49:04.381 INFO:tasks.workunit.client.1.smithi148.stdout:4/74: creat d15/d17/f1c x:0 0 0 2024-09-18T12:49:04.382 INFO:tasks.workunit.client.1.smithi148.stdout:6/88: read - d5/d1a/f22 zero size 2024-09-18T12:49:04.383 INFO:tasks.workunit.client.1.smithi148.stdout:4/75: truncate fd 1239538 0 2024-09-18T12:49:04.384 INFO:tasks.workunit.client.1.smithi148.stdout:5/95: dwrite d7/d8/d18/f1a [0,4194304] 0 2024-09-18T12:49:04.385 INFO:tasks.workunit.client.1.smithi148.stdout:5/96: chown d7/f15 18 1 2024-09-18T12:49:04.387 INFO:tasks.workunit.client.1.smithi148.stdout:5/97: chown d7/d8/f13 583 1 2024-09-18T12:49:04.387 INFO:tasks.workunit.client.0.smithi078.stdout:0/112: dwrite d3/f5 [0,4194304] 0 2024-09-18T12:49:04.388 INFO:tasks.workunit.client.0.smithi078.stdout:0/113: read d3/f21 [2677806,10591] 0 2024-09-18T12:49:04.389 INFO:tasks.workunit.client.1.smithi148.stdout:5/98: chown d7/d8/d18/d21 0 1 2024-09-18T12:49:04.391 INFO:tasks.workunit.client.1.smithi148.stdout:5/99: write d7/d8/f1c [3709887,122367] 0 2024-09-18T12:49:04.393 INFO:tasks.workunit.client.1.smithi148.stdout:6/89: dwrite d5/f1b [0,4194304] 0 2024-09-18T12:49:04.394 INFO:tasks.workunit.client.1.smithi148.stdout:5/100: stat d7/d8/dc/d12/d1f 0 2024-09-18T12:49:04.394 INFO:tasks.workunit.client.1.smithi148.stdout:6/90: readlink d5/d1a/l1e 0 2024-09-18T12:49:04.396 INFO:tasks.workunit.client.1.smithi148.stdout:2/64: mkdir d9/d17 0 2024-09-18T12:49:04.398 INFO:tasks.workunit.client.0.smithi078.stdout:0/114: rename d3/c1a to d3/d1f/c2a 0 2024-09-18T12:49:04.399 INFO:tasks.workunit.client.0.smithi078.stdout:0/115: fdatasync d3/f19 0 2024-09-18T12:49:04.402 INFO:tasks.workunit.client.1.smithi148.stdout:4/76: mkdir d15/d1d 0 2024-09-18T12:49:04.404 INFO:tasks.workunit.client.0.smithi078.stdout:0/116: creat d3/d1f/d25/f2b x:0 0 0 2024-09-18T12:49:04.405 INFO:tasks.workunit.client.0.smithi078.stdout:0/117: stat d3/d1f/d29 0 2024-09-18T12:49:04.405 INFO:tasks.workunit.client.1.smithi148.stdout:1/55: truncate f8 1723432 0 2024-09-18T12:49:04.406 INFO:tasks.workunit.client.1.smithi148.stdout:7/64: mkdir db/dc/df/d11 0 2024-09-18T12:49:04.407 INFO:tasks.workunit.client.1.smithi148.stdout:9/62: dwrite f2 [0,4194304] 0 2024-09-18T12:49:04.408 INFO:tasks.workunit.client.1.smithi148.stdout:6/91: dwrite d5/f19 [0,4194304] 0 2024-09-18T12:49:04.411 INFO:tasks.workunit.client.1.smithi148.stdout:2/65: creat d9/f18 x:0 0 0 2024-09-18T12:49:04.411 INFO:tasks.workunit.client.0.smithi078.stdout:0/118: link d3/cb d3/c2c 0 2024-09-18T12:49:04.414 INFO:tasks.workunit.client.0.smithi078.stdout:0/119: chown d3/lc 0 1 2024-09-18T12:49:04.415 INFO:tasks.workunit.client.1.smithi148.stdout:1/56: creat dc/f13 x:0 0 0 2024-09-18T12:49:04.419 INFO:tasks.workunit.client.1.smithi148.stdout:6/92: symlink d5/d1a/l24 0 2024-09-18T12:49:04.420 INFO:tasks.workunit.client.1.smithi148.stdout:2/66: mkdir d9/d19 0 2024-09-18T12:49:04.421 INFO:tasks.workunit.client.1.smithi148.stdout:2/67: dread - d9/f16 zero size 2024-09-18T12:49:04.421 INFO:tasks.workunit.client.1.smithi148.stdout:3/52: sync 2024-09-18T12:49:04.422 INFO:tasks.workunit.client.0.smithi078.stdout:0/120: dread d3/f21 [0,4194304] 0 2024-09-18T12:49:04.422 INFO:tasks.workunit.client.1.smithi148.stdout:4/77: creat d15/d1d/f1e x:0 0 0 2024-09-18T12:49:04.423 INFO:tasks.workunit.client.1.smithi148.stdout:4/78: write f2 [2003283,65628] 0 2024-09-18T12:49:04.424 INFO:tasks.workunit.client.1.smithi148.stdout:4/79: chown fa 1007462 1 2024-09-18T12:49:04.425 INFO:tasks.workunit.client.1.smithi148.stdout:6/93: dwrite d5/fa [0,4194304] 0 2024-09-18T12:49:04.427 INFO:tasks.workunit.client.0.smithi078.stdout:0/121: write d3/f17 [723546,32728] 0 2024-09-18T12:49:04.427 INFO:tasks.workunit.client.1.smithi148.stdout:8/82: truncate d8/d12/f13 275068 0 2024-09-18T12:49:04.429 INFO:tasks.workunit.client.1.smithi148.stdout:3/53: rmdir d4 39 2024-09-18T12:49:04.430 INFO:tasks.workunit.client.1.smithi148.stdout:4/80: dread f9 [0,4194304] 0 2024-09-18T12:49:04.430 INFO:tasks.workunit.client.1.smithi148.stdout:8/83: fsync d8/df/f19 0 2024-09-18T12:49:04.432 INFO:tasks.workunit.client.0.smithi078.stdout:0/122: unlink d3/f19 0 2024-09-18T12:49:04.434 INFO:tasks.workunit.client.1.smithi148.stdout:9/63: link f6 d8/da/df/f15 0 2024-09-18T12:49:04.435 INFO:tasks.workunit.client.0.smithi078.stdout:0/123: creat d3/d1f/f2d x:0 0 0 2024-09-18T12:49:04.436 INFO:tasks.workunit.client.1.smithi148.stdout:8/84: truncate d8/d12/f1b 18731 0 2024-09-18T12:49:04.437 INFO:tasks.workunit.client.0.smithi078.stdout:0/124: mkdir d3/d1f/d2e 0 2024-09-18T12:49:04.438 INFO:tasks.workunit.client.1.smithi148.stdout:8/85: stat d8/ce 0 2024-09-18T12:49:04.440 INFO:tasks.workunit.client.0.smithi078.stdout:0/125: mknod d3/c2f 0 2024-09-18T12:49:04.441 INFO:tasks.workunit.client.1.smithi148.stdout:3/54: mkdir d4/d8/d13 0 2024-09-18T12:49:04.442 INFO:tasks.workunit.client.1.smithi148.stdout:8/86: write d8/fb [7053730,24473] 0 2024-09-18T12:49:04.443 INFO:tasks.workunit.client.1.smithi148.stdout:4/81: dwrite d15/d1d/f1e [0,4194304] 0 2024-09-18T12:49:04.444 INFO:tasks.workunit.client.1.smithi148.stdout:3/55: chown d4/c7 369 1 2024-09-18T12:49:04.446 INFO:tasks.workunit.client.1.smithi148.stdout:8/87: read d8/f1e [443091,74934] 0 2024-09-18T12:49:04.448 INFO:tasks.workunit.client.1.smithi148.stdout:4/82: mkdir d15/d17/d1f 0 2024-09-18T12:49:04.449 INFO:tasks.workunit.client.1.smithi148.stdout:9/64: dwrite d8/da/fb [0,4194304] 0 2024-09-18T12:49:04.450 INFO:tasks.workunit.client.1.smithi148.stdout:3/56: mknod d4/d8/d13/c14 0 2024-09-18T12:49:04.452 INFO:tasks.workunit.client.1.smithi148.stdout:4/83: truncate f0 5164696 0 2024-09-18T12:49:04.452 INFO:tasks.workunit.client.1.smithi148.stdout:5/101: truncate d7/d8/f13 114455 0 2024-09-18T12:49:04.453 INFO:tasks.workunit.client.1.smithi148.stdout:8/88: symlink d8/d16/d1c/l1f 0 2024-09-18T12:49:04.453 INFO:tasks.workunit.client.1.smithi148.stdout:7/65: dwrite f4 [4194304,4194304] 0 2024-09-18T12:49:04.455 INFO:tasks.workunit.client.1.smithi148.stdout:9/65: dread - d8/da/dd/f14 zero size 2024-09-18T12:49:04.455 INFO:tasks.workunit.client.1.smithi148.stdout:5/102: chown d7/d8/fa 9535 1 2024-09-18T12:49:04.455 INFO:tasks.workunit.client.1.smithi148.stdout:9/66: chown d8/c9 4706514 1 2024-09-18T12:49:04.455 INFO:tasks.workunit.client.1.smithi148.stdout:5/103: truncate d7/f15 5215206 0 2024-09-18T12:49:04.456 INFO:tasks.workunit.client.1.smithi148.stdout:3/57: creat d4/d8/f15 x:0 0 0 2024-09-18T12:49:04.460 INFO:tasks.workunit.client.1.smithi148.stdout:6/94: readlink d5/d1a/dc/l14 0 2024-09-18T12:49:04.461 INFO:tasks.workunit.client.1.smithi148.stdout:6/95: stat d5/fa 0 2024-09-18T12:49:04.462 INFO:tasks.workunit.client.1.smithi148.stdout:6/96: chown d5/l6 2011 1 2024-09-18T12:49:04.463 INFO:tasks.workunit.client.1.smithi148.stdout:4/84: creat d15/d1d/f20 x:0 0 0 2024-09-18T12:49:04.463 INFO:tasks.workunit.client.1.smithi148.stdout:7/66: creat db/dc/f12 x:0 0 0 2024-09-18T12:49:04.464 INFO:tasks.workunit.client.1.smithi148.stdout:7/67: chown f3 94756435 1 2024-09-18T12:49:04.464 INFO:tasks.workunit.client.1.smithi148.stdout:9/67: creat d8/f16 x:0 0 0 2024-09-18T12:49:04.466 INFO:tasks.workunit.client.1.smithi148.stdout:3/58: mknod d4/d8/c16 0 2024-09-18T12:49:04.469 INFO:tasks.workunit.client.1.smithi148.stdout:6/97: rename c0 to d5/c25 0 2024-09-18T12:49:04.470 INFO:tasks.workunit.client.1.smithi148.stdout:1/57: dwrite f5 [0,4194304] 0 2024-09-18T12:49:04.472 INFO:tasks.workunit.client.1.smithi148.stdout:3/59: symlink d4/d8/d13/l17 0 2024-09-18T12:49:04.477 INFO:tasks.workunit.client.1.smithi148.stdout:5/104: mkdir d7/d8/dc/d12/d1f/d25 0 2024-09-18T12:49:04.477 INFO:tasks.workunit.client.1.smithi148.stdout:5/105: dread - d7/f1b zero size 2024-09-18T12:49:04.477 INFO:tasks.workunit.client.1.smithi148.stdout:6/98: symlink d5/l26 0 2024-09-18T12:49:04.477 INFO:tasks.workunit.client.1.smithi148.stdout:5/106: write d7/d8/dc/d12/f24 [608638,8199] 0 2024-09-18T12:49:04.477 INFO:tasks.workunit.client.1.smithi148.stdout:4/85: creat d15/d17/d1f/f21 x:0 0 0 2024-09-18T12:49:04.477 INFO:tasks.workunit.client.1.smithi148.stdout:5/107: write d7/d8/dc/ff [8809732,44178] 0 2024-09-18T12:49:04.478 INFO:tasks.workunit.client.1.smithi148.stdout:7/68: creat db/d10/f13 x:0 0 0 2024-09-18T12:49:04.480 INFO:tasks.workunit.client.0.smithi078.stdout:0/126: truncate d3/f5 1016211 0 2024-09-18T12:49:04.480 INFO:tasks.workunit.client.1.smithi148.stdout:9/68: mknod d8/da/df/c17 0 2024-09-18T12:49:04.481 INFO:tasks.workunit.client.1.smithi148.stdout:9/69: fdatasync d8/da/f13 0 2024-09-18T12:49:04.483 INFO:tasks.workunit.client.1.smithi148.stdout:6/99: write f3 [1393081,36385] 0 2024-09-18T12:49:04.483 INFO:tasks.workunit.client.0.smithi078.stdout:0/127: mkdir d3/d1f/d25/d30 0 2024-09-18T12:49:04.488 INFO:tasks.workunit.client.0.smithi078.stdout:0/128: mknod d3/d1f/d25/d30/c31 0 2024-09-18T12:49:04.489 INFO:tasks.workunit.client.1.smithi148.stdout:4/86: dwrite d15/d17/f1a [0,4194304] 0 2024-09-18T12:49:04.489 INFO:tasks.workunit.client.1.smithi148.stdout:8/89: write f1 [6655092,54610] 0 2024-09-18T12:49:04.489 INFO:tasks.workunit.client.1.smithi148.stdout:9/70: read f6 [879265,47404] 0 2024-09-18T12:49:04.490 INFO:tasks.workunit.client.1.smithi148.stdout:7/69: fdatasync db/dd/fe 0 2024-09-18T12:49:04.493 INFO:tasks.workunit.client.1.smithi148.stdout:3/60: creat d4/f18 x:0 0 0 2024-09-18T12:49:04.498 INFO:tasks.workunit.client.1.smithi148.stdout:1/58: dread f3 [0,4194304] 0 2024-09-18T12:49:04.499 INFO:tasks.workunit.client.1.smithi148.stdout:8/90: dwrite f1 [0,4194304] 0 2024-09-18T12:49:04.500 INFO:tasks.workunit.client.1.smithi148.stdout:5/108: dread d7/fd [0,4194304] 0 2024-09-18T12:49:04.502 INFO:tasks.workunit.client.1.smithi148.stdout:8/91: write f1 [2295203,63993] 0 2024-09-18T12:49:04.503 INFO:tasks.workunit.client.1.smithi148.stdout:9/71: creat d8/da/df/f18 x:0 0 0 2024-09-18T12:49:04.503 INFO:tasks.workunit.client.1.smithi148.stdout:1/59: write dc/d11/f12 [134480,113409] 0 2024-09-18T12:49:04.503 INFO:tasks.workunit.client.1.smithi148.stdout:0/275: sync 2024-09-18T12:49:04.505 INFO:tasks.workunit.client.1.smithi148.stdout:9/72: stat d8/da/fc 0 2024-09-18T12:49:04.506 INFO:tasks.workunit.client.1.smithi148.stdout:0/276: dread - de/d27/f44 zero size 2024-09-18T12:49:04.506 INFO:tasks.workunit.client.1.smithi148.stdout:9/73: stat d8/da/df 0 2024-09-18T12:49:04.506 INFO:tasks.workunit.client.1.smithi148.stdout:3/61: unlink d4/d8/lf 0 2024-09-18T12:49:04.511 INFO:tasks.workunit.client.1.smithi148.stdout:1/60: mknod dc/c14 0 2024-09-18T12:49:04.513 INFO:tasks.workunit.client.1.smithi148.stdout:8/92: rename d8/ce to d8/d12/c20 0 2024-09-18T12:49:04.515 INFO:tasks.workunit.client.1.smithi148.stdout:3/62: mknod d4/d8/c19 0 2024-09-18T12:49:04.517 INFO:tasks.workunit.client.1.smithi148.stdout:9/74: dwrite d8/fe [0,4194304] 0 2024-09-18T12:49:04.517 INFO:tasks.workunit.client.1.smithi148.stdout:0/277: dwrite de/d14/f25 [0,4194304] 0 2024-09-18T12:49:04.518 INFO:tasks.workunit.client.0.smithi078.stdout:0/129: write d3/f5 [1582284,49546] 0 2024-09-18T12:49:04.519 INFO:tasks.workunit.client.1.smithi148.stdout:4/87: write fe [2000595,109294] 0 2024-09-18T12:49:04.521 INFO:tasks.workunit.client.1.smithi148.stdout:8/93: mknod d8/df/c21 0 2024-09-18T12:49:04.522 INFO:tasks.workunit.client.1.smithi148.stdout:7/70: getdents db/d10 0 2024-09-18T12:49:04.523 INFO:tasks.workunit.client.1.smithi148.stdout:4/88: write fe [919262,114432] 0 2024-09-18T12:49:04.523 INFO:tasks.workunit.client.1.smithi148.stdout:9/75: chown d8/f10 10 1 2024-09-18T12:49:04.526 INFO:tasks.workunit.client.1.smithi148.stdout:1/61: dread dc/f10 [0,4194304] 0 2024-09-18T12:49:04.526 INFO:tasks.workunit.client.0.smithi078.stdout:0/130: truncate d3/f21 968430 0 2024-09-18T12:49:04.527 INFO:tasks.workunit.client.0.smithi078.stdout:0/131: chown d3/d1f/d2e 576534 1 2024-09-18T12:49:04.527 INFO:tasks.workunit.client.0.smithi078.stdout:0/132: truncate d3/f28 543111 0 2024-09-18T12:49:04.528 INFO:tasks.workunit.client.1.smithi148.stdout:6/100: dwrite d5/f23 [0,4194304] 0 2024-09-18T12:49:04.528 INFO:tasks.workunit.client.0.smithi078.stdout:0/133: write d3/f17 [1913745,99933] 0 2024-09-18T12:49:04.529 INFO:tasks.workunit.client.1.smithi148.stdout:6/101: fsync d5/d1a/dc/f20 0 2024-09-18T12:49:04.529 INFO:tasks.workunit.client.0.smithi078.stdout:0/134: rename d3 to d3/d32 22 2024-09-18T12:49:04.529 INFO:tasks.workunit.client.0.smithi078.stdout:0/135: chown d3/d1f/d2e 28068522 1 2024-09-18T12:49:04.530 INFO:tasks.workunit.client.1.smithi148.stdout:7/71: unlink f8 0 2024-09-18T12:49:04.530 INFO:tasks.workunit.client.0.smithi078.stdout:0/136: fsync d3/f18 0 2024-09-18T12:49:04.530 INFO:tasks.workunit.client.0.smithi078.stdout:0/137: fsync d3/f1d 0 2024-09-18T12:49:04.530 INFO:tasks.workunit.client.0.smithi078.stdout:0/138: readlink d3/lc 0 2024-09-18T12:49:04.532 INFO:tasks.workunit.client.1.smithi148.stdout:5/109: truncate d7/d8/fa 8029740 0 2024-09-18T12:49:04.534 INFO:tasks.workunit.client.1.smithi148.stdout:8/94: symlink d8/df/l22 0 2024-09-18T12:49:04.536 INFO:tasks.workunit.client.1.smithi148.stdout:5/110: write d7/d8/d18/f1a [3800268,14989] 0 2024-09-18T12:49:04.538 INFO:tasks.workunit.client.0.smithi078.stdout:0/139: readlink d3/l1c 0 2024-09-18T12:49:04.538 INFO:tasks.workunit.client.1.smithi148.stdout:9/76: mknod d8/c19 0 2024-09-18T12:49:04.541 INFO:tasks.workunit.client.1.smithi148.stdout:4/89: creat d15/d1d/f22 x:0 0 0 2024-09-18T12:49:04.543 INFO:tasks.workunit.client.1.smithi148.stdout:3/63: link d4/f5 d4/d8/f1a 0 2024-09-18T12:49:04.544 INFO:tasks.workunit.client.1.smithi148.stdout:2/68: sync 2024-09-18T12:49:04.545 INFO:tasks.workunit.client.1.smithi148.stdout:7/72: dwrite db/d10/f13 [0,4194304] 0 2024-09-18T12:49:04.545 INFO:tasks.workunit.client.1.smithi148.stdout:1/62: creat dc/d11/f15 x:0 0 0 2024-09-18T12:49:04.546 INFO:tasks.workunit.client.0.smithi078.stdout:0/140: symlink d3/d1f/d2e/l33 0 2024-09-18T12:49:04.546 INFO:tasks.workunit.client.1.smithi148.stdout:4/90: write d15/d17/d1f/f21 [168657,24704] 0 2024-09-18T12:49:04.552 INFO:tasks.workunit.client.1.smithi148.stdout:0/278: creat de/d14/d43/d57/d59/f5c x:0 0 0 2024-09-18T12:49:04.552 INFO:tasks.workunit.client.1.smithi148.stdout:6/102: dread d5/d1a/f21 [0,4194304] 0 2024-09-18T12:49:04.552 INFO:tasks.workunit.client.1.smithi148.stdout:4/91: write f0 [4819364,22956] 0 2024-09-18T12:49:04.556 INFO:tasks.workunit.client.0.smithi078.stdout:0/141: link d3/d1f/c24 d3/d1f/d25/c34 0 2024-09-18T12:49:04.556 INFO:tasks.workunit.client.1.smithi148.stdout:5/111: symlink d7/d8/dc/d12/l26 0 2024-09-18T12:49:04.556 INFO:tasks.workunit.client.1.smithi148.stdout:8/95: dwrite d8/df/f19 [0,4194304] 0 2024-09-18T12:49:04.558 INFO:tasks.workunit.client.1.smithi148.stdout:9/77: dread f0 [0,4194304] 0 2024-09-18T12:49:04.561 INFO:tasks.workunit.client.1.smithi148.stdout:1/63: dwrite f8 [0,4194304] 0 2024-09-18T12:49:04.561 INFO:tasks.workunit.client.0.smithi078.stdout:0/142: link d3/f20 d3/d1f/d2e/f35 0 2024-09-18T12:49:04.562 INFO:tasks.workunit.client.0.smithi078.stdout:0/143: chown d3/l13 2 1 2024-09-18T12:49:04.563 INFO:tasks.workunit.client.1.smithi148.stdout:7/73: rename c9 to db/dc/df/c14 0 2024-09-18T12:49:04.569 INFO:tasks.workunit.client.1.smithi148.stdout:4/92: creat d15/d1d/f23 x:0 0 0 2024-09-18T12:49:04.570 INFO:tasks.workunit.client.1.smithi148.stdout:4/93: dread - d15/d1d/f20 zero size 2024-09-18T12:49:04.572 INFO:tasks.workunit.client.1.smithi148.stdout:6/103: dwrite d5/fa [0,4194304] 0 2024-09-18T12:49:04.575 INFO:tasks.workunit.client.0.smithi078.stdout:0/144: link d3/d1f/c2a d3/d1f/c36 0 2024-09-18T12:49:04.575 INFO:tasks.workunit.client.0.smithi078.stdout:0/145: truncate d3/f20 762358 0 2024-09-18T12:49:04.576 INFO:tasks.workunit.client.0.smithi078.stdout:0/146: chown d3/c11 0 1 2024-09-18T12:49:04.576 INFO:tasks.workunit.client.1.smithi148.stdout:5/112: dread d7/d8/f13 [0,4194304] 0 2024-09-18T12:49:04.577 INFO:tasks.workunit.client.1.smithi148.stdout:9/78: symlink d8/da/df/l1a 0 2024-09-18T12:49:04.578 INFO:tasks.workunit.client.1.smithi148.stdout:1/64: creat dc/d11/f16 x:0 0 0 2024-09-18T12:49:04.578 INFO:tasks.workunit.client.1.smithi148.stdout:9/79: dread - d8/da/f13 zero size 2024-09-18T12:49:04.579 INFO:tasks.workunit.client.0.smithi078.stdout:0/147: mkdir d3/d1f/d29/d37 0 2024-09-18T12:49:04.580 INFO:tasks.workunit.client.1.smithi148.stdout:7/74: read f4 [1291016,74817] 0 2024-09-18T12:49:04.581 INFO:tasks.workunit.client.0.smithi078.stdout:0/148: write d3/f18 [1419625,64197] 0 2024-09-18T12:49:04.581 INFO:tasks.workunit.client.1.smithi148.stdout:0/279: mknod de/d14/c5d 0 2024-09-18T12:49:04.581 INFO:tasks.workunit.client.1.smithi148.stdout:7/75: read db/d10/f13 [2292407,36611] 0 2024-09-18T12:49:04.582 INFO:tasks.workunit.client.1.smithi148.stdout:2/69: rmdir d9/d19 0 2024-09-18T12:49:04.583 INFO:tasks.workunit.client.1.smithi148.stdout:4/94: rmdir d15/d17/d1f 39 2024-09-18T12:49:04.583 INFO:tasks.workunit.client.0.smithi078.stdout:0/149: mknod d3/d1f/d25/c38 0 2024-09-18T12:49:04.584 INFO:tasks.workunit.client.1.smithi148.stdout:1/65: dread f5 [0,4194304] 0 2024-09-18T12:49:04.584 INFO:tasks.workunit.client.1.smithi148.stdout:1/66: fsync f3 0 2024-09-18T12:49:04.585 INFO:tasks.workunit.client.1.smithi148.stdout:8/96: symlink d8/l23 0 2024-09-18T12:49:04.585 INFO:tasks.workunit.client.1.smithi148.stdout:1/67: write f8 [2647377,71342] 0 2024-09-18T12:49:04.586 INFO:tasks.workunit.client.1.smithi148.stdout:3/64: symlink d4/l1b 0 2024-09-18T12:49:04.586 INFO:tasks.workunit.client.1.smithi148.stdout:5/113: symlink d7/d8/dc/d12/d1f/l27 0 2024-09-18T12:49:04.587 INFO:tasks.workunit.client.1.smithi148.stdout:8/97: fdatasync d8/df/f10 0 2024-09-18T12:49:04.588 INFO:tasks.workunit.client.1.smithi148.stdout:9/80: creat d8/da/dd/f1b x:0 0 0 2024-09-18T12:49:04.592 INFO:tasks.workunit.client.1.smithi148.stdout:7/76: creat db/dc/f15 x:0 0 0 2024-09-18T12:49:04.593 INFO:tasks.workunit.client.1.smithi148.stdout:9/81: dread - d8/da/df/f18 zero size 2024-09-18T12:49:04.593 INFO:tasks.workunit.client.1.smithi148.stdout:0/280: link de/f1c de/d14/d43/f5e 0 2024-09-18T12:49:04.594 INFO:tasks.workunit.client.1.smithi148.stdout:1/68: unlink f5 0 2024-09-18T12:49:04.594 INFO:tasks.workunit.client.1.smithi148.stdout:7/77: dread - db/dc/f15 zero size 2024-09-18T12:49:04.594 INFO:tasks.workunit.client.1.smithi148.stdout:3/65: mknod d4/c1c 0 2024-09-18T12:49:04.595 INFO:tasks.workunit.client.1.smithi148.stdout:6/104: dwrite d5/d1a/f1f [0,4194304] 0 2024-09-18T12:49:04.595 INFO:tasks.workunit.client.1.smithi148.stdout:9/82: write d8/da/fb [4900179,60218] 0 2024-09-18T12:49:04.603 INFO:tasks.workunit.client.0.smithi078.stdout:0/150: fdatasync d3/f21 0 2024-09-18T12:49:04.606 INFO:tasks.workunit.client.0.smithi078.stdout:0/151: rename d3/f4 to d3/d1f/d25/d30/f39 0 2024-09-18T12:49:04.606 INFO:tasks.workunit.client.1.smithi148.stdout:4/95: creat d15/d17/d1f/f24 x:0 0 0 2024-09-18T12:49:04.607 INFO:tasks.workunit.client.0.smithi078.stdout:0/152: fdatasync d3/d1f/f2d 0 2024-09-18T12:49:04.608 INFO:tasks.workunit.client.0.smithi078.stdout:0/153: chown d3/l13 3 1 2024-09-18T12:49:04.608 INFO:tasks.workunit.client.1.smithi148.stdout:7/78: dread - db/dc/f12 zero size 2024-09-18T12:49:04.608 INFO:tasks.workunit.client.1.smithi148.stdout:1/69: write dc/f13 [695928,9940] 0 2024-09-18T12:49:04.609 INFO:tasks.workunit.client.1.smithi148.stdout:9/83: write f7 [1072796,39604] 0 2024-09-18T12:49:04.610 INFO:tasks.workunit.client.1.smithi148.stdout:9/84: chown d8/fe 62 1 2024-09-18T12:49:04.611 INFO:tasks.workunit.client.1.smithi148.stdout:0/281: rename de/f19 to de/d14/d43/f5f 0 2024-09-18T12:49:04.611 INFO:tasks.workunit.client.1.smithi148.stdout:9/85: write f4 [1513707,59513] 0 2024-09-18T12:49:04.612 INFO:tasks.workunit.client.0.smithi078.stdout:0/154: write d3/f1d [663580,11269] 0 2024-09-18T12:49:04.613 INFO:tasks.workunit.client.1.smithi148.stdout:9/86: write d8/da/dd/f1b [912695,126039] 0 2024-09-18T12:49:04.613 INFO:tasks.workunit.client.1.smithi148.stdout:6/105: dwrite d5/fa [0,4194304] 0 2024-09-18T12:49:04.615 INFO:tasks.workunit.client.1.smithi148.stdout:4/96: rmdir d15/d1d 39 2024-09-18T12:49:04.616 INFO:tasks.workunit.client.0.smithi078.stdout:0/155: symlink d3/d1f/d2e/l3a 0 2024-09-18T12:49:04.622 INFO:tasks.workunit.client.0.smithi078.stdout:0/156: dwrite d3/f17 [0,4194304] 0 2024-09-18T12:49:04.630 INFO:tasks.workunit.client.0.smithi078.stdout:0/157: dwrite d3/d1f/f2d [0,4194304] 0 2024-09-18T12:49:04.632 INFO:tasks.workunit.client.0.smithi078.stdout:0/158: chown d3/c2c 26053641 1 2024-09-18T12:49:04.633 INFO:tasks.workunit.client.0.smithi078.stdout:0/159: write d3/d1f/f2d [752122,46745] 0 2024-09-18T12:49:04.634 INFO:tasks.workunit.client.0.smithi078.stdout:0/160: stat d3/d1f/d25/d30 0 2024-09-18T12:49:04.635 INFO:tasks.workunit.client.0.smithi078.stdout:0/161: write d3/f1d [4465587,49974] 0 2024-09-18T12:49:04.638 INFO:tasks.workunit.client.0.smithi078.stdout:0/162: unlink d3/d1f/f26 0 2024-09-18T12:49:04.640 INFO:tasks.workunit.client.0.smithi078.stdout:0/163: mknod d3/d1f/d29/c3b 0 2024-09-18T12:49:04.643 INFO:tasks.workunit.client.0.smithi078.stdout:0/164: symlink d3/d1f/d29/d37/l3c 0 2024-09-18T12:49:04.647 INFO:tasks.workunit.client.0.smithi078.stdout:0/165: getdents d3 0 2024-09-18T12:49:04.651 INFO:tasks.workunit.client.0.smithi078.stdout:7/29: sync 2024-09-18T12:49:04.651 INFO:tasks.workunit.client.0.smithi078.stdout:3/34: sync 2024-09-18T12:49:04.654 INFO:tasks.workunit.client.0.smithi078.stdout:3/35: write f7 [194272,13744] 0 2024-09-18T12:49:04.655 INFO:tasks.workunit.client.0.smithi078.stdout:7/30: getdents d7 0 2024-09-18T12:49:04.657 INFO:tasks.workunit.client.0.smithi078.stdout:3/36: mkdir d9/dc 0 2024-09-18T12:49:04.658 INFO:tasks.workunit.client.0.smithi078.stdout:0/166: dwrite d3/f20 [0,4194304] 0 2024-09-18T12:49:04.665 INFO:tasks.workunit.client.0.smithi078.stdout:0/167: dwrite d3/f5 [0,4194304] 0 2024-09-18T12:49:04.667 INFO:tasks.workunit.client.1.smithi148.stdout:4/97: readlink l1 0 2024-09-18T12:49:04.667 INFO:tasks.workunit.client.1.smithi148.stdout:7/79: mkdir db/dc/d16 0 2024-09-18T12:49:04.668 INFO:tasks.workunit.client.1.smithi148.stdout:9/87: unlink f2 0 2024-09-18T12:49:04.668 INFO:tasks.workunit.client.1.smithi148.stdout:6/106: symlink d5/d1a/dc/l27 0 2024-09-18T12:49:04.675 INFO:tasks.workunit.client.1.smithi148.stdout:3/66: dwrite d4/fe [0,4194304] 0 2024-09-18T12:49:04.693 INFO:tasks.workunit.client.1.smithi148.stdout:2/70: sync 2024-09-18T12:49:04.693 INFO:tasks.workunit.client.0.smithi078.stdout:2/149: sync 2024-09-18T12:49:04.694 INFO:tasks.workunit.client.0.smithi078.stdout:4/14: sync 2024-09-18T12:49:04.697 INFO:tasks.workunit.client.1.smithi148.stdout:2/71: fdatasync d9/fc 0 2024-09-18T12:49:04.698 INFO:tasks.workunit.client.1.smithi148.stdout:2/72: chown f8 7553 1 2024-09-18T12:49:04.736 INFO:tasks.workunit.client.1.smithi148.stdout:5/114: sync 2024-09-18T12:49:04.739 INFO:tasks.workunit.client.0.smithi078.stdout:3/37: chown c8 940506 1 2024-09-18T12:49:04.739 INFO:tasks.workunit.client.1.smithi148.stdout:5/115: dread d7/d8/d18/f1a [0,4194304] 0 2024-09-18T12:49:04.740 INFO:tasks.workunit.client.1.smithi148.stdout:4/98: rmdir d15/d17/d1f 39 2024-09-18T12:49:04.742 INFO:tasks.workunit.client.0.smithi078.stdout:0/168: rename d3/f21 to d3/d1f/d29/f3d 0 2024-09-18T12:49:04.743 INFO:tasks.workunit.client.1.smithi148.stdout:5/116: dwrite f6 [0,4194304] 0 2024-09-18T12:49:04.743 INFO:tasks.workunit.client.1.smithi148.stdout:7/80: rename l5 to db/dc/df/l17 0 2024-09-18T12:49:04.745 INFO:tasks.workunit.client.0.smithi078.stdout:3/38: dwrite d9/fa [0,4194304] 0 2024-09-18T12:49:04.747 INFO:tasks.workunit.client.0.smithi078.stdout:2/150: unlink d4/db/ce 0 2024-09-18T12:49:04.748 INFO:tasks.workunit.client.0.smithi078.stdout:2/151: write d4/db/dc/f2f [415644,18708] 0 2024-09-18T12:49:04.748 INFO:tasks.workunit.client.1.smithi148.stdout:6/107: write d5/ff [15630,77151] 0 2024-09-18T12:49:04.749 INFO:tasks.workunit.client.1.smithi148.stdout:9/88: symlink d8/da/dd/l1c 0 2024-09-18T12:49:04.753 INFO:tasks.workunit.client.1.smithi148.stdout:5/117: dwrite d7/f10 [0,4194304] 0 2024-09-18T12:49:04.755 INFO:tasks.workunit.client.1.smithi148.stdout:5/118: write d7/d8/f1c [4135959,77493] 0 2024-09-18T12:49:04.756 INFO:tasks.workunit.client.1.smithi148.stdout:6/108: dread d5/f19 [0,4194304] 0 2024-09-18T12:49:04.757 INFO:tasks.workunit.client.1.smithi148.stdout:6/109: stat d5 0 2024-09-18T12:49:04.767 INFO:tasks.workunit.client.0.smithi078.stdout:0/169: rmdir d3/d1f/d29/d37 39 2024-09-18T12:49:04.770 INFO:tasks.workunit.client.1.smithi148.stdout:1/70: sync 2024-09-18T12:49:04.770 INFO:tasks.workunit.client.1.smithi148.stdout:8/98: sync 2024-09-18T12:49:04.770 INFO:tasks.workunit.client.1.smithi148.stdout:0/282: sync 2024-09-18T12:49:04.771 INFO:tasks.workunit.client.1.smithi148.stdout:0/283: chown de/f1d 7 1 2024-09-18T12:49:04.772 INFO:tasks.workunit.client.1.smithi148.stdout:0/284: chown de/d14/f3d 1000 0 2024-09-18T12:49:04.774 INFO:tasks.workunit.client.0.smithi078.stdout:0/170: dread d3/d1f/d29/f3d [0,4194304] 0 2024-09-18T12:49:04.774 INFO:tasks.workunit.client.0.smithi078.stdout:4/15: link c4 c6 0 2024-09-18T12:49:04.776 INFO:tasks.workunit.client.0.smithi078.stdout:3/39: mknod d9/dc/cd 0 2024-09-18T12:49:04.778 INFO:tasks.workunit.client.0.smithi078.stdout:2/152: dwrite d4/d1a/f2e [0,4194304] 0 2024-09-18T12:49:04.781 INFO:tasks.workunit.client.0.smithi078.stdout:4/16: mknod c7 0 2024-09-18T12:49:04.784 INFO:tasks.workunit.client.0.smithi078.stdout:3/40: dwrite f7 [0,4194304] 0 2024-09-18T12:49:04.786 INFO:tasks.workunit.client.0.smithi078.stdout:0/171: symlink d3/d1f/d2e/l3e 0 2024-09-18T12:49:04.786 INFO:tasks.workunit.client.0.smithi078.stdout:0/172: write d3/f5 [3373157,127155] 0 2024-09-18T12:49:04.789 INFO:tasks.workunit.client.0.smithi078.stdout:4/17: symlink l8 0 2024-09-18T12:49:04.789 INFO:tasks.workunit.client.0.smithi078.stdout:4/18: dwrite - no filename 2024-09-18T12:49:04.791 INFO:tasks.workunit.client.0.smithi078.stdout:3/41: creat d9/dc/fe x:0 0 0 2024-09-18T12:49:04.795 INFO:tasks.workunit.client.0.smithi078.stdout:3/42: dread d9/fa [0,4194304] 0 2024-09-18T12:49:04.796 INFO:tasks.workunit.client.0.smithi078.stdout:0/173: creat d3/f3f x:0 0 0 2024-09-18T12:49:04.797 INFO:tasks.workunit.client.0.smithi078.stdout:0/174: read - d3/d1f/d25/f2b zero size 2024-09-18T12:49:04.798 INFO:tasks.workunit.client.0.smithi078.stdout:4/19: symlink l9 0 2024-09-18T12:49:04.801 INFO:tasks.workunit.client.0.smithi078.stdout:3/43: mkdir d9/df 0 2024-09-18T12:49:04.805 INFO:tasks.workunit.client.0.smithi078.stdout:4/20: mknod ca 0 2024-09-18T12:49:04.805 INFO:tasks.workunit.client.0.smithi078.stdout:4/21: fdatasync - no filename 2024-09-18T12:49:04.805 INFO:tasks.workunit.client.0.smithi078.stdout:4/22: read - no filename 2024-09-18T12:49:04.806 INFO:tasks.workunit.client.0.smithi078.stdout:3/44: fdatasync f7 0 2024-09-18T12:49:04.810 INFO:tasks.workunit.client.0.smithi078.stdout:4/23: chown c1 401528927 1 2024-09-18T12:49:04.811 INFO:tasks.workunit.client.0.smithi078.stdout:4/24: rmdir - no directory 2024-09-18T12:49:04.811 INFO:tasks.workunit.client.0.smithi078.stdout:4/25: dwrite - no filename 2024-09-18T12:49:04.811 INFO:tasks.workunit.client.0.smithi078.stdout:4/26: fsync - no filename 2024-09-18T12:49:04.812 INFO:tasks.workunit.client.0.smithi078.stdout:3/45: rename d9/dc/fe to d9/dc/f10 0 2024-09-18T12:49:04.814 INFO:tasks.workunit.client.0.smithi078.stdout:4/27: creat fb x:0 0 0 2024-09-18T12:49:04.814 INFO:tasks.workunit.client.0.smithi078.stdout:4/28: truncate fb 179711 0 2024-09-18T12:49:04.815 INFO:tasks.workunit.client.0.smithi078.stdout:4/29: stat fb 0 2024-09-18T12:49:04.816 INFO:tasks.workunit.client.0.smithi078.stdout:4/30: dread fb [0,4194304] 0 2024-09-18T12:49:04.819 INFO:tasks.workunit.client.0.smithi078.stdout:4/31: mknod cc 0 2024-09-18T12:49:04.819 INFO:tasks.workunit.client.0.smithi078.stdout:4/32: stat l2 0 2024-09-18T12:49:04.823 INFO:tasks.workunit.client.0.smithi078.stdout:4/33: write fb [464302,40812] 0 2024-09-18T12:49:04.826 INFO:tasks.workunit.client.0.smithi078.stdout:4/34: mknod cd 0 2024-09-18T12:49:04.832 INFO:tasks.workunit.client.0.smithi078.stdout:4/35: mknod ce 0 2024-09-18T12:49:04.832 INFO:tasks.workunit.client.0.smithi078.stdout:0/175: dwrite d3/d1f/d29/f3d [0,4194304] 0 2024-09-18T12:49:04.834 INFO:tasks.workunit.client.0.smithi078.stdout:0/176: dread d3/f17 [0,4194304] 0 2024-09-18T12:49:04.834 INFO:tasks.workunit.client.0.smithi078.stdout:0/177: fdatasync f2 0 2024-09-18T12:49:04.838 INFO:tasks.workunit.client.0.smithi078.stdout:0/178: dread d3/d1f/d2e/f35 [0,4194304] 0 2024-09-18T12:49:04.844 INFO:tasks.workunit.client.0.smithi078.stdout:0/179: dwrite d3/f18 [4194304,4194304] 0 2024-09-18T12:49:04.845 INFO:tasks.workunit.client.0.smithi078.stdout:0/180: chown d3/d1f/d25/c38 25 1 2024-09-18T12:49:04.845 INFO:tasks.workunit.client.0.smithi078.stdout:0/181: chown d3/l1c 767 1 2024-09-18T12:49:04.846 INFO:tasks.workunit.client.0.smithi078.stdout:0/182: chown d3/f28 1 1 2024-09-18T12:49:04.853 INFO:tasks.workunit.client.0.smithi078.stdout:0/183: dwrite d3/f20 [4194304,4194304] 0 2024-09-18T12:49:04.859 INFO:tasks.workunit.client.0.smithi078.stdout:0/184: dwrite d3/f28 [0,4194304] 0 2024-09-18T12:49:04.880 INFO:tasks.workunit.client.0.smithi078.stdout:1/79: sync 2024-09-18T12:49:04.880 INFO:tasks.workunit.client.0.smithi078.stdout:4/36: mknod cf 0 2024-09-18T12:49:04.880 INFO:tasks.workunit.client.0.smithi078.stdout:9/46: sync 2024-09-18T12:49:04.882 INFO:tasks.workunit.client.0.smithi078.stdout:1/80: write d0/f13 [914152,91347] 0 2024-09-18T12:49:04.882 INFO:tasks.workunit.client.0.smithi078.stdout:9/47: truncate d5/f9 779709 0 2024-09-18T12:49:04.891 INFO:tasks.workunit.client.0.smithi078.stdout:9/48: dwrite f3 [0,4194304] 0 2024-09-18T12:49:04.892 INFO:tasks.workunit.client.0.smithi078.stdout:1/81: dwrite d0/d8/f14 [0,4194304] 0 2024-09-18T12:49:04.915 INFO:tasks.workunit.client.0.smithi078.stdout:0/185: rmdir d3/d1f 39 2024-09-18T12:49:04.918 INFO:tasks.workunit.client.0.smithi078.stdout:4/37: mknod c10 0 2024-09-18T12:49:04.920 INFO:tasks.workunit.client.0.smithi078.stdout:4/38: write fb [1551192,3490] 0 2024-09-18T12:49:04.921 INFO:tasks.workunit.client.0.smithi078.stdout:0/186: dread f2 [0,4194304] 0 2024-09-18T12:49:04.927 INFO:tasks.workunit.client.0.smithi078.stdout:4/39: dread fb [0,4194304] 0 2024-09-18T12:49:04.927 INFO:tasks.workunit.client.0.smithi078.stdout:4/40: rmdir - no directory 2024-09-18T12:49:04.928 INFO:tasks.workunit.client.0.smithi078.stdout:1/82: readlink d0/l3 0 2024-09-18T12:49:04.934 INFO:tasks.workunit.client.0.smithi078.stdout:1/83: dwrite d0/d8/f14 [0,4194304] 0 2024-09-18T12:49:04.939 INFO:tasks.workunit.client.0.smithi078.stdout:0/187: rmdir d3 39 2024-09-18T12:49:04.941 INFO:tasks.workunit.client.0.smithi078.stdout:4/41: mkdir d11 0 2024-09-18T12:49:04.951 INFO:tasks.workunit.client.0.smithi078.stdout:1/84: truncate d0/fc 1971906 0 2024-09-18T12:49:04.953 INFO:tasks.workunit.client.0.smithi078.stdout:0/188: write d3/d1f/f2d [4910455,5840] 0 2024-09-18T12:49:04.954 INFO:tasks.workunit.client.0.smithi078.stdout:1/85: mknod d0/d8/da/c1b 0 2024-09-18T12:49:04.959 INFO:tasks.workunit.client.0.smithi078.stdout:0/189: dwrite d3/f28 [0,4194304] 0 2024-09-18T12:49:04.960 INFO:tasks.workunit.client.0.smithi078.stdout:0/190: write d3/f28 [975906,125139] 0 2024-09-18T12:49:04.961 INFO:tasks.workunit.client.0.smithi078.stdout:0/191: write d3/f1d [3090335,58576] 0 2024-09-18T12:49:04.962 INFO:tasks.workunit.client.0.smithi078.stdout:0/192: fsync d3/d1f/f2d 0 2024-09-18T12:49:04.966 INFO:tasks.workunit.client.0.smithi078.stdout:0/193: dread d3/f1d [0,4194304] 0 2024-09-18T12:49:04.971 INFO:tasks.workunit.client.0.smithi078.stdout:1/86: rmdir d0/d18 0 2024-09-18T12:49:04.975 INFO:tasks.workunit.client.0.smithi078.stdout:1/87: creat d0/d8/da/f1c x:0 0 0 2024-09-18T12:49:04.996 INFO:tasks.workunit.client.0.smithi078.stdout:0/194: truncate d3/f17 5060548 0 2024-09-18T12:49:04.998 INFO:tasks.workunit.client.0.smithi078.stdout:0/195: symlink d3/d1f/d25/d30/l40 0 2024-09-18T12:49:05.000 INFO:tasks.workunit.client.0.smithi078.stdout:0/196: creat d3/d1f/f41 x:0 0 0 2024-09-18T12:49:05.001 INFO:tasks.workunit.client.0.smithi078.stdout:0/197: write d3/d1f/f41 [511605,64242] 0 2024-09-18T12:49:05.002 INFO:tasks.workunit.client.0.smithi078.stdout:0/198: chown d3/d1f/d2e/l3a 0 1 2024-09-18T12:49:05.006 INFO:tasks.workunit.client.0.smithi078.stdout:0/199: rename d3/l22 to d3/d1f/d25/d30/l42 0 2024-09-18T12:49:05.007 INFO:tasks.workunit.client.0.smithi078.stdout:0/200: chown d3/f1d 38 1 2024-09-18T12:49:05.010 INFO:tasks.workunit.client.0.smithi078.stdout:0/201: mkdir d3/d43 0 2024-09-18T12:49:05.012 INFO:tasks.workunit.client.0.smithi078.stdout:4/42: truncate fb 225224 0 2024-09-18T12:49:05.014 INFO:tasks.workunit.client.0.smithi078.stdout:0/202: rename d3/d1f/f2d to d3/d1f/d25/f44 0 2024-09-18T12:49:05.015 INFO:tasks.workunit.client.0.smithi078.stdout:0/203: write d3/d1f/d25/f2b [48943,43331] 0 2024-09-18T12:49:05.019 INFO:tasks.workunit.client.0.smithi078.stdout:0/204: dread d3/f18 [4194304,4194304] 0 2024-09-18T12:49:05.020 INFO:tasks.workunit.client.0.smithi078.stdout:1/88: fsync d0/fc 0 2024-09-18T12:49:05.021 INFO:tasks.workunit.client.0.smithi078.stdout:1/89: stat d0/d8/ce 0 2024-09-18T12:49:05.024 INFO:tasks.workunit.client.0.smithi078.stdout:0/205: dread d3/f18 [4194304,4194304] 0 2024-09-18T12:49:05.025 INFO:tasks.workunit.client.0.smithi078.stdout:1/90: dread d0/f13 [0,4194304] 0 2024-09-18T12:49:05.025 INFO:tasks.workunit.client.0.smithi078.stdout:1/91: chown d0/fb 1442 1 2024-09-18T12:49:05.036 INFO:tasks.workunit.client.0.smithi078.stdout:0/206: creat d3/d1f/d29/d37/f45 x:0 0 0 2024-09-18T12:49:05.036 INFO:tasks.workunit.client.0.smithi078.stdout:0/207: chown d3/d1f/d2e/l3e 512 1 2024-09-18T12:49:05.038 INFO:tasks.workunit.client.0.smithi078.stdout:1/92: rename d0/d8/da/c10 to d0/d8/c1d 0 2024-09-18T12:49:05.039 INFO:tasks.workunit.client.0.smithi078.stdout:1/93: write d0/fb [629276,32516] 0 2024-09-18T12:49:05.042 INFO:tasks.workunit.client.0.smithi078.stdout:0/208: rename d3/c2f to d3/d1f/d2e/c46 0 2024-09-18T12:49:05.042 INFO:tasks.workunit.client.0.smithi078.stdout:0/209: chown d3/f1d 1733753 1 2024-09-18T12:49:05.044 INFO:tasks.workunit.client.0.smithi078.stdout:1/94: write d0/d8/da/f17 [386170,108567] 0 2024-09-18T12:49:05.047 INFO:tasks.workunit.client.0.smithi078.stdout:1/95: dread d0/d8/ff [0,4194304] 0 2024-09-18T12:49:05.050 INFO:tasks.workunit.client.0.smithi078.stdout:0/210: creat d3/f47 x:0 0 0 2024-09-18T12:49:05.052 INFO:tasks.workunit.client.0.smithi078.stdout:1/96: symlink d0/d8/da/l1e 0 2024-09-18T12:49:05.053 INFO:tasks.workunit.client.0.smithi078.stdout:1/97: truncate d0/d8/da/f1c 420545 0 2024-09-18T12:49:05.054 INFO:tasks.workunit.client.0.smithi078.stdout:0/211: chown d3/d1f/c2a 1955469734 1 2024-09-18T12:49:05.056 INFO:tasks.workunit.client.0.smithi078.stdout:1/98: creat d0/d8/da/f1f x:0 0 0 2024-09-18T12:49:05.057 INFO:tasks.workunit.client.0.smithi078.stdout:1/99: readlink d0/d8/da/l1a 0 2024-09-18T12:49:05.057 INFO:tasks.workunit.client.0.smithi078.stdout:1/100: readlink d0/l3 0 2024-09-18T12:49:05.060 INFO:tasks.workunit.client.0.smithi078.stdout:5/179: sync 2024-09-18T12:49:05.060 INFO:tasks.workunit.client.0.smithi078.stdout:8/48: sync 2024-09-18T12:49:05.060 INFO:tasks.workunit.client.0.smithi078.stdout:6/149: sync 2024-09-18T12:49:05.061 INFO:tasks.workunit.client.0.smithi078.stdout:8/49: chown d0/f5 740 1 2024-09-18T12:49:05.061 INFO:tasks.workunit.client.0.smithi078.stdout:5/180: dread - d2/d4/d9/da/f19 zero size 2024-09-18T12:49:05.063 INFO:tasks.workunit.client.0.smithi078.stdout:0/212: link d3/d1f/d29/f3d d3/d1f/d29/f48 0 2024-09-18T12:49:05.064 INFO:tasks.workunit.client.0.smithi078.stdout:6/150: rmdir d10 39 2024-09-18T12:49:05.068 INFO:tasks.workunit.client.0.smithi078.stdout:8/50: dwrite d0/f1 [4194304,4194304] 0 2024-09-18T12:49:05.069 INFO:tasks.workunit.client.0.smithi078.stdout:0/213: read d3/d1f/d2e/f35 [7783666,23433] 0 2024-09-18T12:49:05.070 INFO:tasks.workunit.client.0.smithi078.stdout:0/214: dread - d3/f47 zero size 2024-09-18T12:49:05.075 INFO:tasks.workunit.client.0.smithi078.stdout:6/151: dread d10/f22 [0,4194304] 0 2024-09-18T12:49:05.078 INFO:tasks.workunit.client.0.smithi078.stdout:5/181: mknod d2/d4/d12/d16/d36/c3d 0 2024-09-18T12:49:05.079 INFO:tasks.workunit.client.0.smithi078.stdout:5/182: truncate d2/d4/d9/f1c 47958 0 2024-09-18T12:49:05.084 INFO:tasks.workunit.client.0.smithi078.stdout:5/183: dread - d2/d4/d12/d16/f1f zero size 2024-09-18T12:49:05.089 INFO:tasks.workunit.client.0.smithi078.stdout:0/215: creat d3/d1f/d29/f49 x:0 0 0 2024-09-18T12:49:05.090 INFO:tasks.workunit.client.0.smithi078.stdout:0/216: readlink d3/l1c 0 2024-09-18T12:49:05.093 INFO:tasks.workunit.client.0.smithi078.stdout:0/217: mknod d3/d1f/d25/d30/c4a 0 2024-09-18T12:49:05.096 INFO:tasks.workunit.client.0.smithi078.stdout:6/152: getdents d10 0 2024-09-18T12:49:05.103 INFO:tasks.workunit.client.0.smithi078.stdout:0/218: creat d3/f4b x:0 0 0 2024-09-18T12:49:05.104 INFO:tasks.workunit.client.0.smithi078.stdout:6/153: dwrite d10/f1c [0,4194304] 0 2024-09-18T12:49:05.104 INFO:tasks.workunit.client.0.smithi078.stdout:0/219: chown d3/d1f/d29/c3b 36820 1 2024-09-18T12:49:05.105 INFO:tasks.workunit.client.0.smithi078.stdout:6/154: write d10/f1e [4445204,46324] 0 2024-09-18T12:49:05.110 INFO:tasks.workunit.client.0.smithi078.stdout:6/155: mkdir d10/d27 0 2024-09-18T12:49:05.113 INFO:tasks.workunit.client.0.smithi078.stdout:0/220: rename d3/ce to d3/d1f/d29/d37/c4c 0 2024-09-18T12:49:05.115 INFO:tasks.workunit.client.0.smithi078.stdout:6/156: dread f3 [0,4194304] 0 2024-09-18T12:49:05.116 INFO:tasks.workunit.client.1.smithi148.stdout:7/81: mknod db/dd/c18 0 2024-09-18T12:49:05.118 INFO:tasks.workunit.client.0.smithi078.stdout:6/157: truncate f9 1909975 0 2024-09-18T12:49:05.118 INFO:tasks.workunit.client.1.smithi148.stdout:7/82: read f3 [1183477,66470] 0 2024-09-18T12:49:05.120 INFO:tasks.workunit.client.1.smithi148.stdout:5/119: creat d7/d8/dc/f28 x:0 0 0 2024-09-18T12:49:05.121 INFO:tasks.workunit.client.1.smithi148.stdout:4/99: dwrite d15/d1d/f22 [0,4194304] 0 2024-09-18T12:49:05.121 INFO:tasks.workunit.client.1.smithi148.stdout:6/110: creat d5/f28 x:0 0 0 2024-09-18T12:49:05.122 INFO:tasks.workunit.client.1.smithi148.stdout:5/120: write f6 [1108244,80624] 0 2024-09-18T12:49:05.126 INFO:tasks.workunit.client.1.smithi148.stdout:4/100: dread d15/d1d/f1e [0,4194304] 0 2024-09-18T12:49:05.127 INFO:tasks.workunit.client.1.smithi148.stdout:0/285: symlink de/d14/d43/d57/l60 0 2024-09-18T12:49:05.127 INFO:tasks.workunit.client.1.smithi148.stdout:0/286: chown de/d14/d43/f4b 1372573 1 2024-09-18T12:49:05.128 INFO:tasks.workunit.client.1.smithi148.stdout:2/73: getdents d9/d17 0 2024-09-18T12:49:05.138 INFO:tasks.workunit.client.1.smithi148.stdout:1/71: mkdir dc/d11/d17 0 2024-09-18T12:49:05.141 INFO:tasks.workunit.client.1.smithi148.stdout:0/287: creat de/d27/d38/f61 x:0 0 0 2024-09-18T12:49:05.142 INFO:tasks.workunit.client.1.smithi148.stdout:2/74: symlink d9/l1a 0 2024-09-18T12:49:05.143 INFO:tasks.workunit.client.0.smithi078.stdout:1/101: fsync d0/d8/da/f1f 0 2024-09-18T12:49:05.147 INFO:tasks.workunit.client.0.smithi078.stdout:1/102: rename d0/d8/da/c11 to d0/c20 0 2024-09-18T12:49:05.148 INFO:tasks.workunit.client.0.smithi078.stdout:1/103: stat d0/d8/da/c12 0 2024-09-18T12:49:05.149 INFO:tasks.workunit.client.1.smithi148.stdout:6/111: mkdir d5/d1a/d29 0 2024-09-18T12:49:05.150 INFO:tasks.workunit.client.1.smithi148.stdout:1/72: mkdir dc/d18 0 2024-09-18T12:49:05.151 INFO:tasks.workunit.client.1.smithi148.stdout:4/101: mknod d15/c25 0 2024-09-18T12:49:05.153 INFO:tasks.workunit.client.1.smithi148.stdout:2/75: mknod d9/c1b 0 2024-09-18T12:49:05.154 INFO:tasks.workunit.client.1.smithi148.stdout:9/89: rename f4 to d8/da/f1d 0 2024-09-18T12:49:05.156 INFO:tasks.workunit.client.1.smithi148.stdout:1/73: mknod dc/d11/c19 0 2024-09-18T12:49:05.158 INFO:tasks.workunit.client.1.smithi148.stdout:0/288: fsync de/d27/d2e/f33 0 2024-09-18T12:49:05.159 INFO:tasks.workunit.client.1.smithi148.stdout:0/289: readlink de/d27/d2e/l46 0 2024-09-18T12:49:05.160 INFO:tasks.workunit.client.1.smithi148.stdout:7/83: rename db/dd/c18 to db/dc/df/c19 0 2024-09-18T12:49:05.161 INFO:tasks.workunit.client.1.smithi148.stdout:6/112: mknod d5/d1a/dc/c2a 0 2024-09-18T12:49:05.162 INFO:tasks.workunit.client.1.smithi148.stdout:1/74: dwrite dc/f13 [0,4194304] 0 2024-09-18T12:49:05.162 INFO:tasks.workunit.client.1.smithi148.stdout:4/102: link d15/d1d/f20 d15/d1d/f26 0 2024-09-18T12:49:05.166 INFO:tasks.workunit.client.1.smithi148.stdout:6/113: mkdir d5/d1a/dc/d2b 0 2024-09-18T12:49:05.166 INFO:tasks.workunit.client.1.smithi148.stdout:2/76: dread f5 [0,4194304] 0 2024-09-18T12:49:05.170 INFO:tasks.workunit.client.1.smithi148.stdout:6/114: symlink d5/d1a/l2c 0 2024-09-18T12:49:05.173 INFO:tasks.workunit.client.1.smithi148.stdout:4/103: rename d15/d1d/f1e to d15/d17/f27 0 2024-09-18T12:49:05.174 INFO:tasks.workunit.client.1.smithi148.stdout:1/75: dread f6 [0,4194304] 0 2024-09-18T12:49:05.174 INFO:tasks.workunit.client.1.smithi148.stdout:6/115: creat d5/d1a/dc/f2d x:0 0 0 2024-09-18T12:49:05.176 INFO:tasks.workunit.client.0.smithi078.stdout:5/184: dwrite d2/d4/d12/d16/f1f [0,4194304] 0 2024-09-18T12:49:05.177 INFO:tasks.workunit.client.1.smithi148.stdout:2/77: dwrite d9/f16 [0,4194304] 0 2024-09-18T12:49:05.179 INFO:tasks.workunit.client.1.smithi148.stdout:6/116: creat d5/f2e x:0 0 0 2024-09-18T12:49:05.183 INFO:tasks.workunit.client.1.smithi148.stdout:1/76: rename f3 to dc/d11/f1a 0 2024-09-18T12:49:05.184 INFO:tasks.workunit.client.0.smithi078.stdout:5/185: getdents d2/d4/d9/da/d2b 0 2024-09-18T12:49:05.185 INFO:tasks.workunit.client.1.smithi148.stdout:0/290: dread de/d27/d38/f5b [0,4194304] 0 2024-09-18T12:49:05.186 INFO:tasks.workunit.client.1.smithi148.stdout:4/104: dwrite f2 [0,4194304] 0 2024-09-18T12:49:05.189 INFO:tasks.workunit.client.1.smithi148.stdout:2/78: rename d9/l1a to d9/d17/l1c 0 2024-09-18T12:49:05.189 INFO:tasks.workunit.client.0.smithi078.stdout:5/186: dread d2/d4/d9/da/ff [4194304,4194304] 0 2024-09-18T12:49:05.190 INFO:tasks.workunit.client.1.smithi148.stdout:1/77: symlink dc/d11/l1b 0 2024-09-18T12:49:05.190 INFO:tasks.workunit.client.0.smithi078.stdout:5/187: dread d2/d4/d9/f1c [0,4194304] 0 2024-09-18T12:49:05.192 INFO:tasks.workunit.client.0.smithi078.stdout:4/43: write fb [765011,67751] 0 2024-09-18T12:49:05.194 INFO:tasks.workunit.client.0.smithi078.stdout:6/158: getdents d10 0 2024-09-18T12:49:05.197 INFO:tasks.workunit.client.0.smithi078.stdout:5/188: mkdir d2/d4/d9/da/d2b/d3e 0 2024-09-18T12:49:05.202 INFO:tasks.workunit.client.0.smithi078.stdout:5/189: rename d2/l1a to d2/d4/d9/d2f/d30/l3f 0 2024-09-18T12:49:05.204 INFO:tasks.workunit.client.1.smithi148.stdout:0/291: mknod de/d27/d53/c62 0 2024-09-18T12:49:05.204 INFO:tasks.workunit.client.1.smithi148.stdout:3/67: write d4/fc [928898,123696] 0 2024-09-18T12:49:05.204 INFO:tasks.workunit.client.0.smithi078.stdout:4/44: creat d11/f12 x:0 0 0 2024-09-18T12:49:05.206 INFO:tasks.workunit.client.1.smithi148.stdout:6/117: rename d5/d1a/c1d to d5/d1a/dc/c2f 0 2024-09-18T12:49:05.207 INFO:tasks.workunit.client.1.smithi148.stdout:6/118: chown d5/d1a/dc/f2d 2 1 2024-09-18T12:49:05.207 INFO:tasks.workunit.client.1.smithi148.stdout:4/105: creat d15/f28 x:0 0 0 2024-09-18T12:49:05.209 INFO:tasks.workunit.client.1.smithi148.stdout:0/292: write de/d14/f47 [17296,76603] 0 2024-09-18T12:49:05.212 INFO:tasks.workunit.client.1.smithi148.stdout:1/78: rename dc/fe to dc/d18/f1c 0 2024-09-18T12:49:05.216 INFO:tasks.workunit.client.0.smithi078.stdout:5/190: dwrite d2/d4/d9/f1c [0,4194304] 0 2024-09-18T12:49:05.216 INFO:tasks.workunit.client.1.smithi148.stdout:8/99: dwrite d8/d12/f13 [0,4194304] 0 2024-09-18T12:49:05.216 INFO:tasks.workunit.client.1.smithi148.stdout:3/68: mknod d4/d8/d13/c1d 0 2024-09-18T12:49:05.219 INFO:tasks.workunit.client.0.smithi078.stdout:4/45: link c7 d11/c13 0 2024-09-18T12:49:05.225 INFO:tasks.workunit.client.0.smithi078.stdout:4/46: creat d11/f14 x:0 0 0 2024-09-18T12:49:05.225 INFO:tasks.workunit.client.0.smithi078.stdout:4/47: chown d11/f12 2769 1 2024-09-18T12:49:05.227 INFO:tasks.workunit.client.0.smithi078.stdout:4/48: read fb [256774,72361] 0 2024-09-18T12:49:05.231 INFO:tasks.workunit.client.0.smithi078.stdout:4/49: symlink d11/l15 0 2024-09-18T12:49:05.238 INFO:tasks.workunit.client.0.smithi078.stdout:4/50: dwrite d11/f12 [0,4194304] 0 2024-09-18T12:49:05.245 INFO:tasks.workunit.client.0.smithi078.stdout:6/159: truncate d10/f17 2743872 0 2024-09-18T12:49:05.245 INFO:tasks.workunit.client.0.smithi078.stdout:6/160: stat d10/f14 0 2024-09-18T12:49:05.247 INFO:tasks.workunit.client.1.smithi148.stdout:8/100: fdatasync d8/fb 0 2024-09-18T12:49:05.249 INFO:tasks.workunit.client.1.smithi148.stdout:7/84: write db/d10/f13 [5096052,80154] 0 2024-09-18T12:49:05.249 INFO:tasks.workunit.client.1.smithi148.stdout:0/293: dwrite de/d14/f1f [0,4194304] 0 2024-09-18T12:49:05.251 INFO:tasks.workunit.client.1.smithi148.stdout:0/294: rename de to de/d14/d43/d63 22 2024-09-18T12:49:05.252 INFO:tasks.workunit.client.1.smithi148.stdout:6/119: dread d5/d1a/f1f [0,4194304] 0 2024-09-18T12:49:05.253 INFO:tasks.workunit.client.1.smithi148.stdout:4/106: link d15/d17/d1f/f21 d15/d1d/f29 0 2024-09-18T12:49:05.253 INFO:tasks.workunit.client.1.smithi148.stdout:0/295: write de/d14/f3d [431706,29813] 0 2024-09-18T12:49:05.254 INFO:tasks.workunit.client.1.smithi148.stdout:8/101: mknod d8/d16/d1c/c24 0 2024-09-18T12:49:05.256 INFO:tasks.workunit.client.0.smithi078.stdout:5/191: write d2/d4/d12/f1b [411605,54322] 0 2024-09-18T12:49:05.257 INFO:tasks.workunit.client.0.smithi078.stdout:5/192: dread - d2/d4/f34 zero size 2024-09-18T12:49:05.258 INFO:tasks.workunit.client.1.smithi148.stdout:7/85: dread db/d10/f13 [0,4194304] 0 2024-09-18T12:49:05.258 INFO:tasks.workunit.client.1.smithi148.stdout:2/79: chown d9/d17/l1c 5696 1 2024-09-18T12:49:05.260 INFO:tasks.workunit.client.0.smithi078.stdout:4/51: getdents d11 0 2024-09-18T12:49:05.260 INFO:tasks.workunit.client.1.smithi148.stdout:6/120: dread d5/fa [0,4194304] 0 2024-09-18T12:49:05.260 INFO:tasks.workunit.client.1.smithi148.stdout:2/80: dread - d9/ff zero size 2024-09-18T12:49:05.260 INFO:tasks.workunit.client.1.smithi148.stdout:6/121: fsync d5/ff 0 2024-09-18T12:49:05.261 INFO:tasks.workunit.client.0.smithi078.stdout:4/52: creat d11/f16 x:0 0 0 2024-09-18T12:49:05.262 INFO:tasks.workunit.client.1.smithi148.stdout:8/102: rmdir d8 39 2024-09-18T12:49:05.262 INFO:tasks.workunit.client.1.smithi148.stdout:8/103: stat c6 0 2024-09-18T12:49:05.266 INFO:tasks.workunit.client.1.smithi148.stdout:0/296: dread de/f24 [0,4194304] 0 2024-09-18T12:49:05.269 INFO:tasks.workunit.client.0.smithi078.stdout:6/161: dwrite fb [0,4194304] 0 2024-09-18T12:49:05.270 INFO:tasks.workunit.client.0.smithi078.stdout:6/162: read - d10/f21 zero size 2024-09-18T12:49:05.273 INFO:tasks.workunit.client.1.smithi148.stdout:0/297: creat de/d27/f64 x:0 0 0 2024-09-18T12:49:05.274 INFO:tasks.workunit.client.1.smithi148.stdout:7/86: dread f3 [0,4194304] 0 2024-09-18T12:49:05.276 INFO:tasks.workunit.client.1.smithi148.stdout:0/298: chown de/d14/c36 4166019 1 2024-09-18T12:49:05.276 INFO:tasks.workunit.client.1.smithi148.stdout:4/107: creat d15/d17/f2a x:0 0 0 2024-09-18T12:49:05.277 INFO:tasks.workunit.client.1.smithi148.stdout:6/122: dwrite d5/d1a/f22 [0,4194304] 0 2024-09-18T12:49:05.277 INFO:tasks.workunit.client.0.smithi078.stdout:6/163: creat d10/d27/f28 x:0 0 0 2024-09-18T12:49:05.278 INFO:tasks.workunit.client.0.smithi078.stdout:4/53: write fb [730266,13160] 0 2024-09-18T12:49:05.278 INFO:tasks.workunit.client.1.smithi148.stdout:3/69: dwrite d4/f5 [4194304,4194304] 0 2024-09-18T12:49:05.280 INFO:tasks.workunit.client.1.smithi148.stdout:2/81: truncate f5 2682116 0 2024-09-18T12:49:05.281 INFO:tasks.workunit.client.1.smithi148.stdout:8/104: symlink d8/d16/l25 0 2024-09-18T12:49:05.282 INFO:tasks.workunit.client.0.smithi078.stdout:6/164: rename d10/l18 to d10/l29 0 2024-09-18T12:49:05.284 INFO:tasks.workunit.client.0.smithi078.stdout:4/54: symlink d11/l17 0 2024-09-18T12:49:05.284 INFO:tasks.workunit.client.0.smithi078.stdout:6/165: write d10/f25 [4899229,39106] 0 2024-09-18T12:49:05.286 INFO:tasks.workunit.client.0.smithi078.stdout:4/55: truncate d11/f14 847961 0 2024-09-18T12:49:05.288 INFO:tasks.workunit.client.1.smithi148.stdout:0/299: dwrite de/d27/f44 [0,4194304] 0 2024-09-18T12:49:05.288 INFO:tasks.workunit.client.1.smithi148.stdout:5/121: sync 2024-09-18T12:49:05.293 INFO:tasks.workunit.client.0.smithi078.stdout:4/56: unlink ce 0 2024-09-18T12:49:05.293 INFO:tasks.workunit.client.0.smithi078.stdout:4/57: write d11/f14 [956783,37231] 0 2024-09-18T12:49:05.293 INFO:tasks.workunit.client.0.smithi078.stdout:6/166: truncate ff 635891 0 2024-09-18T12:49:05.293 INFO:tasks.workunit.client.1.smithi148.stdout:6/123: chown d5/d1a/dc/c2f 8136 1 2024-09-18T12:49:05.293 INFO:tasks.workunit.client.1.smithi148.stdout:2/82: dwrite d9/ff [0,4194304] 0 2024-09-18T12:49:05.294 INFO:tasks.workunit.client.1.smithi148.stdout:6/124: chown d5/f19 340467945 1 2024-09-18T12:49:05.294 INFO:tasks.workunit.client.1.smithi148.stdout:6/125: chown d5/d1a 2 1 2024-09-18T12:49:05.296 INFO:tasks.workunit.client.0.smithi078.stdout:6/167: symlink d10/l2a 0 2024-09-18T12:49:05.301 INFO:tasks.workunit.client.0.smithi078.stdout:6/168: dread d10/f1e [0,4194304] 0 2024-09-18T12:49:05.301 INFO:tasks.workunit.client.1.smithi148.stdout:4/108: creat d15/d17/f2b x:0 0 0 2024-09-18T12:49:05.301 INFO:tasks.workunit.client.1.smithi148.stdout:4/109: readlink l14 0 2024-09-18T12:49:05.302 INFO:tasks.workunit.client.0.smithi078.stdout:6/169: dread - d10/d27/f28 zero size 2024-09-18T12:49:05.304 INFO:tasks.workunit.client.1.smithi148.stdout:5/122: creat d7/d8/dc/d12/d20/f29 x:0 0 0 2024-09-18T12:49:05.305 INFO:tasks.workunit.client.1.smithi148.stdout:7/87: getdents db/dd 0 2024-09-18T12:49:05.307 INFO:tasks.workunit.client.0.smithi078.stdout:6/170: mkdir d10/d2b 0 2024-09-18T12:49:05.309 INFO:tasks.workunit.client.0.smithi078.stdout:6/171: symlink d10/l2c 0 2024-09-18T12:49:05.313 INFO:tasks.workunit.client.1.smithi148.stdout:4/110: creat d15/d17/d1f/f2c x:0 0 0 2024-09-18T12:49:05.315 INFO:tasks.workunit.client.1.smithi148.stdout:5/123: creat d7/d8/dc/f2a x:0 0 0 2024-09-18T12:49:05.315 INFO:tasks.workunit.client.1.smithi148.stdout:5/124: readlink d7/l17 0 2024-09-18T12:49:05.316 INFO:tasks.workunit.client.1.smithi148.stdout:7/88: creat db/dd/f1a x:0 0 0 2024-09-18T12:49:05.318 INFO:tasks.workunit.client.1.smithi148.stdout:7/89: truncate db/dc/f12 842191 0 2024-09-18T12:49:05.318 INFO:tasks.workunit.client.1.smithi148.stdout:7/90: readlink l6 0 2024-09-18T12:49:05.319 INFO:tasks.workunit.client.1.smithi148.stdout:0/300: link f1 de/d14/f65 0 2024-09-18T12:49:05.319 INFO:tasks.workunit.client.1.smithi148.stdout:8/105: dread d8/fb [0,4194304] 0 2024-09-18T12:49:05.320 INFO:tasks.workunit.client.1.smithi148.stdout:8/106: read d8/d12/f13 [1259199,62418] 0 2024-09-18T12:49:05.322 INFO:tasks.workunit.client.1.smithi148.stdout:8/107: chown d8/l18 2397423 1 2024-09-18T12:49:05.324 INFO:tasks.workunit.client.1.smithi148.stdout:7/91: dread db/dd/fe [0,4194304] 0 2024-09-18T12:49:05.325 INFO:tasks.workunit.client.1.smithi148.stdout:3/70: fdatasync d4/d8/f1a 0 2024-09-18T12:49:05.326 INFO:tasks.workunit.client.1.smithi148.stdout:7/92: read - db/dd/f1a zero size 2024-09-18T12:49:05.328 INFO:tasks.workunit.client.1.smithi148.stdout:6/126: dwrite d5/d1a/f21 [0,4194304] 0 2024-09-18T12:49:05.328 INFO:tasks.workunit.client.1.smithi148.stdout:4/111: creat d15/f2d x:0 0 0 2024-09-18T12:49:05.330 INFO:tasks.workunit.client.1.smithi148.stdout:8/108: mknod d8/d16/d1c/c26 0 2024-09-18T12:49:05.331 INFO:tasks.workunit.client.0.smithi078.stdout:6/172: dwrite d10/f17 [0,4194304] 0 2024-09-18T12:49:05.334 INFO:tasks.workunit.client.1.smithi148.stdout:0/301: creat de/d14/f66 x:0 0 0 2024-09-18T12:49:05.336 INFO:tasks.workunit.client.1.smithi148.stdout:4/112: creat d15/d17/d1f/f2e x:0 0 0 2024-09-18T12:49:05.337 INFO:tasks.workunit.client.1.smithi148.stdout:5/125: getdents d7 0 2024-09-18T12:49:05.338 INFO:tasks.workunit.client.1.smithi148.stdout:3/71: dread d4/f6 [0,4194304] 0 2024-09-18T12:49:05.338 INFO:tasks.workunit.client.1.smithi148.stdout:8/109: rmdir d8/df 39 2024-09-18T12:49:05.341 INFO:tasks.workunit.client.0.smithi078.stdout:6/173: dwrite d10/f1e [0,4194304] 0 2024-09-18T12:49:05.341 INFO:tasks.workunit.client.1.smithi148.stdout:7/93: unlink l7 0 2024-09-18T12:49:05.344 INFO:tasks.workunit.client.1.smithi148.stdout:0/302: symlink de/d14/d43/d57/d59/l67 0 2024-09-18T12:49:05.345 INFO:tasks.workunit.client.1.smithi148.stdout:5/126: dwrite d7/d8/dc/ff [4194304,4194304] 0 2024-09-18T12:49:05.345 INFO:tasks.workunit.client.1.smithi148.stdout:0/303: dread - de/d27/d38/f41 zero size 2024-09-18T12:49:05.349 INFO:tasks.workunit.client.0.smithi078.stdout:6/174: creat d10/d27/f2d x:0 0 0 2024-09-18T12:49:05.349 INFO:tasks.workunit.client.0.smithi078.stdout:6/175: readlink d10/l23 0 2024-09-18T12:49:05.351 INFO:tasks.workunit.client.1.smithi148.stdout:8/110: chown d8/df/c21 28372820 1 2024-09-18T12:49:05.351 INFO:tasks.workunit.client.1.smithi148.stdout:8/111: readlink d8/d16/l25 0 2024-09-18T12:49:05.352 INFO:tasks.workunit.client.1.smithi148.stdout:7/94: rename db/dd/fe to db/dc/df/d11/f1b 0 2024-09-18T12:49:05.353 INFO:tasks.workunit.client.1.smithi148.stdout:5/127: mkdir d7/d2b 0 2024-09-18T12:49:05.354 INFO:tasks.workunit.client.0.smithi078.stdout:6/176: rmdir d10 39 2024-09-18T12:49:05.355 INFO:tasks.workunit.client.1.smithi148.stdout:8/112: dread f1 [0,4194304] 0 2024-09-18T12:49:05.355 INFO:tasks.workunit.client.1.smithi148.stdout:8/113: chown d8/ca 11 1 2024-09-18T12:49:05.357 INFO:tasks.workunit.client.1.smithi148.stdout:8/114: truncate d8/d12/f1b 487396 0 2024-09-18T12:49:05.359 INFO:tasks.workunit.client.1.smithi148.stdout:4/113: write d15/d17/f19 [712080,35919] 0 2024-09-18T12:49:05.360 INFO:tasks.workunit.client.1.smithi148.stdout:6/127: getdents d5 0 2024-09-18T12:49:05.361 INFO:tasks.workunit.client.0.smithi078.stdout:6/177: dread d10/f1c [0,4194304] 0 2024-09-18T12:49:05.363 INFO:tasks.workunit.client.1.smithi148.stdout:0/304: write de/f13 [3252264,50220] 0 2024-09-18T12:49:05.365 INFO:tasks.workunit.client.1.smithi148.stdout:8/115: dwrite d8/df/f19 [4194304,4194304] 0 2024-09-18T12:49:05.366 INFO:tasks.workunit.client.1.smithi148.stdout:5/128: rename f4 to d7/d8/dc/d12/d1f/f2c 0 2024-09-18T12:49:05.367 INFO:tasks.workunit.client.1.smithi148.stdout:0/305: mknod de/d27/c68 0 2024-09-18T12:49:05.367 INFO:tasks.workunit.client.1.smithi148.stdout:6/128: getdents d5/d1a/d29 0 2024-09-18T12:49:05.370 INFO:tasks.workunit.client.1.smithi148.stdout:8/116: fsync f1 0 2024-09-18T12:49:05.372 INFO:tasks.workunit.client.1.smithi148.stdout:0/306: symlink de/d27/d53/l69 0 2024-09-18T12:49:05.373 INFO:tasks.workunit.client.1.smithi148.stdout:8/117: fsync d8/df/f14 0 2024-09-18T12:49:05.375 INFO:tasks.workunit.client.1.smithi148.stdout:0/307: readlink de/d14/l29 0 2024-09-18T12:49:05.376 INFO:tasks.workunit.client.1.smithi148.stdout:0/308: chown de/d14 101 1 2024-09-18T12:49:05.377 INFO:tasks.workunit.client.1.smithi148.stdout:6/129: link d5/fa d5/d1a/dc/d2b/f30 0 2024-09-18T12:49:05.379 INFO:tasks.workunit.client.1.smithi148.stdout:8/118: dread d8/f1e [0,4194304] 0 2024-09-18T12:49:05.380 INFO:tasks.workunit.client.1.smithi148.stdout:5/129: dwrite f6 [4194304,4194304] 0 2024-09-18T12:49:05.382 INFO:tasks.workunit.client.1.smithi148.stdout:4/114: dwrite d15/d17/f27 [0,4194304] 0 2024-09-18T12:49:05.382 INFO:tasks.workunit.client.1.smithi148.stdout:3/72: dread f2 [0,4194304] 0 2024-09-18T12:49:05.382 INFO:tasks.workunit.client.1.smithi148.stdout:6/130: unlink d5/d1a/dc/f2d 0 2024-09-18T12:49:05.383 INFO:tasks.workunit.client.1.smithi148.stdout:0/309: rmdir de/d14/d43/d57 39 2024-09-18T12:49:05.384 INFO:tasks.workunit.client.1.smithi148.stdout:4/115: fsync d15/d17/d1f/f24 0 2024-09-18T12:49:05.384 INFO:tasks.workunit.client.1.smithi148.stdout:6/131: dread - d5/f2e zero size 2024-09-18T12:49:05.385 INFO:tasks.workunit.client.1.smithi148.stdout:8/119: rename d8/d16/d1c to d8/d16/d27 0 2024-09-18T12:49:05.386 INFO:tasks.workunit.client.1.smithi148.stdout:3/73: unlink d4/fc 0 2024-09-18T12:49:05.388 INFO:tasks.workunit.client.1.smithi148.stdout:4/116: stat d15/d1d/f29 0 2024-09-18T12:49:05.389 INFO:tasks.workunit.client.1.smithi148.stdout:0/310: dread - de/d27/f4e zero size 2024-09-18T12:49:05.394 INFO:tasks.workunit.client.1.smithi148.stdout:8/120: rename d8/d12/c20 to d8/df/c28 0 2024-09-18T12:49:05.398 INFO:tasks.workunit.client.1.smithi148.stdout:8/121: rename d8/l9 to d8/d16/l29 0 2024-09-18T12:49:05.399 INFO:tasks.workunit.client.1.smithi148.stdout:0/311: dwrite de/d14/f47 [0,4194304] 0 2024-09-18T12:49:05.401 INFO:tasks.workunit.client.1.smithi148.stdout:6/132: dwrite d5/f1b [4194304,4194304] 0 2024-09-18T12:49:05.403 INFO:tasks.workunit.client.1.smithi148.stdout:1/79: sync 2024-09-18T12:49:05.403 INFO:tasks.workunit.client.1.smithi148.stdout:9/90: sync 2024-09-18T12:49:05.404 INFO:tasks.workunit.client.1.smithi148.stdout:6/133: dread - d5/f28 zero size 2024-09-18T12:49:05.404 INFO:tasks.workunit.client.1.smithi148.stdout:6/134: fdatasync d5/f28 0 2024-09-18T12:49:05.406 INFO:tasks.workunit.client.1.smithi148.stdout:8/122: rename d8/df/f14 to d8/d16/f2a 0 2024-09-18T12:49:05.406 INFO:tasks.workunit.client.1.smithi148.stdout:0/312: mknod de/d27/c6a 0 2024-09-18T12:49:05.409 INFO:tasks.workunit.client.1.smithi148.stdout:9/91: write d8/fe [3701585,5799] 0 2024-09-18T12:49:05.410 INFO:tasks.workunit.client.1.smithi148.stdout:1/80: symlink dc/d11/d17/l1d 0 2024-09-18T12:49:05.411 INFO:tasks.workunit.client.1.smithi148.stdout:6/135: read d5/d1a/f1f [3714277,33727] 0 2024-09-18T12:49:05.411 INFO:tasks.workunit.client.1.smithi148.stdout:9/92: dread - d8/f16 zero size 2024-09-18T12:49:05.412 INFO:tasks.workunit.client.1.smithi148.stdout:6/136: stat d5/f1b 0 2024-09-18T12:49:05.414 INFO:tasks.workunit.client.1.smithi148.stdout:0/313: mkdir de/d14/d6b 0 2024-09-18T12:49:05.415 INFO:tasks.workunit.client.1.smithi148.stdout:1/81: symlink dc/d18/l1e 0 2024-09-18T12:49:05.417 INFO:tasks.workunit.client.1.smithi148.stdout:6/137: mkdir d5/d1a/d31 0 2024-09-18T12:49:05.418 INFO:tasks.workunit.client.1.smithi148.stdout:9/93: unlink d8/da/df/c17 0 2024-09-18T12:49:05.419 INFO:tasks.workunit.client.1.smithi148.stdout:8/123: rename d8/d16/d27/c26 to d8/c2b 0 2024-09-18T12:49:05.420 INFO:tasks.workunit.client.1.smithi148.stdout:6/138: mkdir d5/d32 0 2024-09-18T12:49:05.420 INFO:tasks.workunit.client.1.smithi148.stdout:5/130: dread d7/d8/fa [4194304,4194304] 0 2024-09-18T12:49:05.421 INFO:tasks.workunit.client.1.smithi148.stdout:9/94: symlink d8/da/df/l1e 0 2024-09-18T12:49:05.421 INFO:tasks.workunit.client.1.smithi148.stdout:8/124: rmdir d8/d12 39 2024-09-18T12:49:05.422 INFO:tasks.workunit.client.1.smithi148.stdout:5/131: chown d7/d8/d18/l19 164 1 2024-09-18T12:49:05.424 INFO:tasks.workunit.client.1.smithi148.stdout:6/139: creat d5/d32/f33 x:0 0 0 2024-09-18T12:49:05.424 INFO:tasks.workunit.client.1.smithi148.stdout:1/82: dwrite f6 [0,4194304] 0 2024-09-18T12:49:05.425 INFO:tasks.workunit.client.1.smithi148.stdout:9/95: fsync d8/da/dd/f14 0 2024-09-18T12:49:05.426 INFO:tasks.workunit.client.1.smithi148.stdout:5/132: chown d7/d8/dc/d12/l26 49 1 2024-09-18T12:49:05.428 INFO:tasks.workunit.client.1.smithi148.stdout:1/83: creat dc/d18/f1f x:0 0 0 2024-09-18T12:49:05.430 INFO:tasks.workunit.client.1.smithi148.stdout:3/74: dwrite d4/f6 [0,4194304] 0 2024-09-18T12:49:05.430 INFO:tasks.workunit.client.1.smithi148.stdout:6/140: rename d5/c8 to d5/d1a/d29/c34 0 2024-09-18T12:49:05.432 INFO:tasks.workunit.client.1.smithi148.stdout:6/141: chown d5/d1a/dc/c2a 67 1 2024-09-18T12:49:05.432 INFO:tasks.workunit.client.1.smithi148.stdout:6/142: fdatasync f3 0 2024-09-18T12:49:05.433 INFO:tasks.workunit.client.1.smithi148.stdout:5/133: rmdir d7 39 2024-09-18T12:49:05.433 INFO:tasks.workunit.client.1.smithi148.stdout:3/75: write d4/d8/f15 [375935,99512] 0 2024-09-18T12:49:05.434 INFO:tasks.workunit.client.1.smithi148.stdout:8/125: link d8/df/f19 d8/d12/f2c 0 2024-09-18T12:49:05.435 INFO:tasks.workunit.client.1.smithi148.stdout:1/84: rename dc/lf to dc/d18/l20 0 2024-09-18T12:49:05.436 INFO:tasks.workunit.client.1.smithi148.stdout:6/143: write d5/d1a/dc/f20 [878080,73819] 0 2024-09-18T12:49:05.437 INFO:tasks.workunit.client.1.smithi148.stdout:8/126: chown d8/d12/l1a 894600 1 2024-09-18T12:49:05.437 INFO:tasks.workunit.client.1.smithi148.stdout:3/76: write d4/d8/f1a [5134356,80071] 0 2024-09-18T12:49:05.440 INFO:tasks.workunit.client.1.smithi148.stdout:8/127: write d8/d12/f1b [1390788,84150] 0 2024-09-18T12:49:05.440 INFO:tasks.workunit.client.1.smithi148.stdout:3/77: readlink d4/l1b 0 2024-09-18T12:49:05.441 INFO:tasks.workunit.client.1.smithi148.stdout:3/78: write d4/d8/f15 [290410,87642] 0 2024-09-18T12:49:05.464 INFO:tasks.workunit.client.1.smithi148.stdout:6/144: dread f3 [0,4194304] 0 2024-09-18T12:49:05.465 INFO:tasks.workunit.client.1.smithi148.stdout:6/145: dread - d5/f28 zero size 2024-09-18T12:49:05.467 INFO:tasks.workunit.client.0.smithi078.stdout:7/31: sync 2024-09-18T12:49:05.469 INFO:tasks.workunit.client.0.smithi078.stdout:2/153: sync 2024-09-18T12:49:05.473 INFO:tasks.workunit.client.1.smithi148.stdout:3/79: unlink d4/d8/d13/c14 0 2024-09-18T12:49:05.473 INFO:tasks.workunit.client.0.smithi078.stdout:7/32: dwrite f5 [0,4194304] 0 2024-09-18T12:49:05.474 INFO:tasks.workunit.client.1.smithi148.stdout:5/134: dwrite d7/f1b [0,4194304] 0 2024-09-18T12:49:05.474 INFO:tasks.workunit.client.0.smithi078.stdout:2/154: fdatasync d4/d1a/f22 0 2024-09-18T12:49:05.476 INFO:tasks.workunit.client.1.smithi148.stdout:6/146: unlink d5/c12 0 2024-09-18T12:49:05.478 INFO:tasks.workunit.client.0.smithi078.stdout:7/33: mkdir d7/d9 0 2024-09-18T12:49:05.479 INFO:tasks.workunit.client.1.smithi148.stdout:8/128: dwrite d8/d12/f13 [0,4194304] 0 2024-09-18T12:49:05.482 INFO:tasks.workunit.client.0.smithi078.stdout:7/34: dread f5 [0,4194304] 0 2024-09-18T12:49:05.482 INFO:tasks.workunit.client.0.smithi078.stdout:7/35: stat d7/c8 0 2024-09-18T12:49:05.483 INFO:tasks.workunit.client.0.smithi078.stdout:7/36: chown d7 6203 1 2024-09-18T12:49:05.483 INFO:tasks.workunit.client.1.smithi148.stdout:3/80: rmdir d4/d8 39 2024-09-18T12:49:05.483 INFO:tasks.workunit.client.0.smithi078.stdout:2/155: creat d4/db/dc/f34 x:0 0 0 2024-09-18T12:49:05.487 INFO:tasks.workunit.client.0.smithi078.stdout:7/37: creat d7/fa x:0 0 0 2024-09-18T12:49:05.489 INFO:tasks.workunit.client.1.smithi148.stdout:3/81: fsync d4/d8/f9 0 2024-09-18T12:49:05.489 INFO:tasks.workunit.client.1.smithi148.stdout:5/135: link d7/d8/dc/d12/d1f/f2c d7/d8/dc/d12/f2d 0 2024-09-18T12:49:05.490 INFO:tasks.workunit.client.0.smithi078.stdout:7/38: rmdir d7 39 2024-09-18T12:49:05.491 INFO:tasks.workunit.client.1.smithi148.stdout:1/85: dwrite fb [0,4194304] 0 2024-09-18T12:49:05.492 INFO:tasks.workunit.client.1.smithi148.stdout:8/129: dread d8/fb [4194304,4194304] 0 2024-09-18T12:49:05.493 INFO:tasks.workunit.client.1.smithi148.stdout:3/82: mkdir d4/d8/d1e 0 2024-09-18T12:49:05.493 INFO:tasks.workunit.client.1.smithi148.stdout:6/147: dwrite d5/f1b [4194304,4194304] 0 2024-09-18T12:49:05.497 INFO:tasks.workunit.client.1.smithi148.stdout:3/83: stat d4/d8 0 2024-09-18T12:49:05.498 INFO:tasks.workunit.client.1.smithi148.stdout:5/136: creat d7/d8/dc/d12/d20/f2e x:0 0 0 2024-09-18T12:49:05.498 INFO:tasks.workunit.client.1.smithi148.stdout:3/84: link d4/d8/f9 d4/d8/f1f 0 2024-09-18T12:49:05.499 INFO:tasks.workunit.client.1.smithi148.stdout:8/130: rename d8/f1e to d8/f2d 0 2024-09-18T12:49:05.499 INFO:tasks.workunit.client.1.smithi148.stdout:5/137: creat d7/d8/d18/d21/f2f x:0 0 0 2024-09-18T12:49:05.500 INFO:tasks.workunit.client.1.smithi148.stdout:3/85: mkdir d4/d8/d20 0 2024-09-18T12:49:05.500 INFO:tasks.workunit.client.1.smithi148.stdout:6/148: dread d5/d1a/f1f [0,4194304] 0 2024-09-18T12:49:05.503 INFO:tasks.workunit.client.1.smithi148.stdout:2/83: sync 2024-09-18T12:49:05.503 INFO:tasks.workunit.client.1.smithi148.stdout:3/86: creat d4/d8/d13/f21 x:0 0 0 2024-09-18T12:49:05.505 INFO:tasks.workunit.client.1.smithi148.stdout:6/149: mkdir d5/d1a/dc/d2b/d35 0 2024-09-18T12:49:05.506 INFO:tasks.workunit.client.1.smithi148.stdout:1/86: dwrite dc/d18/f1c [0,4194304] 0 2024-09-18T12:49:05.507 INFO:tasks.workunit.client.1.smithi148.stdout:2/84: mknod d9/d17/c1d 0 2024-09-18T12:49:05.511 INFO:tasks.workunit.client.1.smithi148.stdout:6/150: fdatasync d5/d1a/dc/f20 0 2024-09-18T12:49:05.512 INFO:tasks.workunit.client.1.smithi148.stdout:5/138: link d7/d8/dc/c14 d7/d8/dc/d12/d20/c30 0 2024-09-18T12:49:05.517 INFO:tasks.workunit.client.1.smithi148.stdout:8/131: dwrite d8/df/f10 [0,4194304] 0 2024-09-18T12:49:05.519 INFO:tasks.workunit.client.1.smithi148.stdout:6/151: symlink d5/d1a/dc/d2b/l36 0 2024-09-18T12:49:05.522 INFO:tasks.workunit.client.0.smithi078.stdout:7/39: getdents d7 0 2024-09-18T12:49:05.523 INFO:tasks.workunit.client.0.smithi078.stdout:7/40: fdatasync d7/fa 0 2024-09-18T12:49:05.528 INFO:tasks.workunit.client.0.smithi078.stdout:7/41: symlink d7/d9/lb 0 2024-09-18T12:49:05.529 INFO:tasks.workunit.client.1.smithi148.stdout:8/132: link c6 d8/df/c2e 0 2024-09-18T12:49:05.531 INFO:tasks.workunit.client.1.smithi148.stdout:1/87: dwrite dc/d11/f1a [0,4194304] 0 2024-09-18T12:49:05.531 INFO:tasks.workunit.client.0.smithi078.stdout:7/42: dread f5 [0,4194304] 0 2024-09-18T12:49:05.532 INFO:tasks.workunit.client.1.smithi148.stdout:1/88: write f6 [5229618,23831] 0 2024-09-18T12:49:05.533 INFO:tasks.workunit.client.1.smithi148.stdout:6/152: link d5/f19 d5/d1a/f37 0 2024-09-18T12:49:05.533 INFO:tasks.workunit.client.0.smithi078.stdout:7/43: chown l1 1819069174 1 2024-09-18T12:49:05.535 INFO:tasks.workunit.client.1.smithi148.stdout:1/89: creat dc/d11/d17/f21 x:0 0 0 2024-09-18T12:49:05.536 INFO:tasks.workunit.client.0.smithi078.stdout:7/44: creat d7/fc x:0 0 0 2024-09-18T12:49:05.537 INFO:tasks.workunit.client.1.smithi148.stdout:6/153: mkdir d5/d32/d38 0 2024-09-18T12:49:05.537 INFO:tasks.workunit.client.1.smithi148.stdout:1/90: mknod dc/c22 0 2024-09-18T12:49:05.538 INFO:tasks.workunit.client.0.smithi078.stdout:7/45: rename c0 to d7/d9/cd 0 2024-09-18T12:49:05.539 INFO:tasks.workunit.client.1.smithi148.stdout:1/91: write dc/d11/d17/f21 [61851,101655] 0 2024-09-18T12:49:05.539 INFO:tasks.workunit.client.0.smithi078.stdout:7/46: creat d7/d9/fe x:0 0 0 2024-09-18T12:49:05.541 INFO:tasks.workunit.client.1.smithi148.stdout:6/154: truncate d5/d1a/dc/d2b/f30 4588471 0 2024-09-18T12:49:05.543 INFO:tasks.workunit.client.0.smithi078.stdout:7/47: symlink d7/d9/lf 0 2024-09-18T12:49:05.546 INFO:tasks.workunit.client.0.smithi078.stdout:7/48: dread f5 [0,4194304] 0 2024-09-18T12:49:05.546 INFO:tasks.workunit.client.1.smithi148.stdout:1/92: dwrite dc/f13 [0,4194304] 0 2024-09-18T12:49:05.547 INFO:tasks.workunit.client.1.smithi148.stdout:3/87: dread d4/d8/f1f [0,4194304] 0 2024-09-18T12:49:05.549 INFO:tasks.workunit.client.1.smithi148.stdout:6/155: dread d5/d1a/f21 [0,4194304] 0 2024-09-18T12:49:05.549 INFO:tasks.workunit.client.1.smithi148.stdout:1/93: write dc/fd [54303,36958] 0 2024-09-18T12:49:05.549 INFO:tasks.workunit.client.0.smithi078.stdout:7/49: creat d7/d9/f10 x:0 0 0 2024-09-18T12:49:05.550 INFO:tasks.workunit.client.1.smithi148.stdout:5/139: rename d7/d8/d18/d21 to d7/d8/dc/d12/d31 0 2024-09-18T12:49:05.551 INFO:tasks.workunit.client.0.smithi078.stdout:7/50: rmdir d7 39 2024-09-18T12:49:05.552 INFO:tasks.workunit.client.1.smithi148.stdout:3/88: readlink d4/l12 0 2024-09-18T12:49:05.554 INFO:tasks.workunit.client.1.smithi148.stdout:5/140: fdatasync d7/d8/dc/d12/d20/f29 0 2024-09-18T12:49:05.556 INFO:tasks.workunit.client.1.smithi148.stdout:1/94: dwrite dc/d11/f16 [0,4194304] 0 2024-09-18T12:49:05.556 INFO:tasks.workunit.client.1.smithi148.stdout:3/89: read - d4/f18 zero size 2024-09-18T12:49:05.559 INFO:tasks.workunit.client.1.smithi148.stdout:7/95: sync 2024-09-18T12:49:05.561 INFO:tasks.workunit.client.1.smithi148.stdout:8/133: fsync d8/df/f10 0 2024-09-18T12:49:05.562 INFO:tasks.workunit.client.0.smithi078.stdout:7/51: dwrite d7/fa [0,4194304] 0 2024-09-18T12:49:05.562 INFO:tasks.workunit.client.1.smithi148.stdout:1/95: creat dc/d11/d17/f23 x:0 0 0 2024-09-18T12:49:05.562 INFO:tasks.workunit.client.1.smithi148.stdout:8/134: stat d8/d12 0 2024-09-18T12:49:05.563 INFO:tasks.workunit.client.1.smithi148.stdout:8/135: stat c7 0 2024-09-18T12:49:05.563 INFO:tasks.workunit.client.1.smithi148.stdout:3/90: dread d4/f6 [0,4194304] 0 2024-09-18T12:49:05.568 INFO:tasks.workunit.client.0.smithi078.stdout:7/52: mkdir d7/d11 0 2024-09-18T12:49:05.569 INFO:tasks.workunit.client.1.smithi148.stdout:2/85: dwrite f6 [0,4194304] 0 2024-09-18T12:49:05.574 INFO:tasks.workunit.client.1.smithi148.stdout:2/86: write d9/fc [433786,90371] 0 2024-09-18T12:49:05.575 INFO:tasks.workunit.client.1.smithi148.stdout:1/96: symlink dc/l24 0 2024-09-18T12:49:05.577 INFO:tasks.workunit.client.0.smithi078.stdout:7/53: rmdir d7/d11 0 2024-09-18T12:49:05.578 INFO:tasks.workunit.client.1.smithi148.stdout:1/97: fsync dc/d11/f1a 0 2024-09-18T12:49:05.579 INFO:tasks.workunit.client.0.smithi078.stdout:7/54: write d7/d9/f10 [838953,92339] 0 2024-09-18T12:49:05.580 INFO:tasks.workunit.client.1.smithi148.stdout:2/87: read d9/ff [3352895,47842] 0 2024-09-18T12:49:05.581 INFO:tasks.workunit.client.1.smithi148.stdout:7/96: dwrite db/d10/f13 [4194304,4194304] 0 2024-09-18T12:49:05.583 INFO:tasks.workunit.client.1.smithi148.stdout:4/117: sync 2024-09-18T12:49:05.583 INFO:tasks.workunit.client.1.smithi148.stdout:0/314: sync 2024-09-18T12:49:05.583 INFO:tasks.workunit.client.1.smithi148.stdout:9/96: sync 2024-09-18T12:49:05.583 INFO:tasks.workunit.client.1.smithi148.stdout:3/91: creat d4/d8/d1e/f22 x:0 0 0 2024-09-18T12:49:05.585 INFO:tasks.workunit.client.1.smithi148.stdout:1/98: readlink dc/d18/l20 0 2024-09-18T12:49:05.586 INFO:tasks.workunit.client.1.smithi148.stdout:8/136: creat d8/f2f x:0 0 0 2024-09-18T12:49:05.588 INFO:tasks.workunit.client.1.smithi148.stdout:2/88: rename f6 to d9/f1e 0 2024-09-18T12:49:05.589 INFO:tasks.workunit.client.1.smithi148.stdout:4/118: rename d15 to d15/d17/d1f/d2f 22 2024-09-18T12:49:05.589 INFO:tasks.workunit.client.1.smithi148.stdout:7/97: readlink db/dc/df/l17 0 2024-09-18T12:49:05.590 INFO:tasks.workunit.client.1.smithi148.stdout:0/315: fdatasync f9 0 2024-09-18T12:49:05.591 INFO:tasks.workunit.client.1.smithi148.stdout:6/156: dread d5/f1b [0,4194304] 0 2024-09-18T12:49:05.593 INFO:tasks.workunit.client.1.smithi148.stdout:8/137: fdatasync d8/f2d 0 2024-09-18T12:49:05.593 INFO:tasks.workunit.client.1.smithi148.stdout:3/92: write d4/f11 [911342,36208] 0 2024-09-18T12:49:05.594 INFO:tasks.workunit.client.1.smithi148.stdout:1/99: dwrite dc/d11/f16 [0,4194304] 0 2024-09-18T12:49:05.595 INFO:tasks.workunit.client.1.smithi148.stdout:2/89: mkdir d9/d1f 0 2024-09-18T12:49:05.596 INFO:tasks.workunit.client.1.smithi148.stdout:7/98: mknod db/dd/c1c 0 2024-09-18T12:49:05.596 INFO:tasks.workunit.client.1.smithi148.stdout:2/90: dread - d9/f18 zero size 2024-09-18T12:49:05.599 INFO:tasks.workunit.client.1.smithi148.stdout:6/157: mknod d5/d1a/d31/c39 0 2024-09-18T12:49:05.600 INFO:tasks.workunit.client.1.smithi148.stdout:6/158: fdatasync d5/d32/f33 0 2024-09-18T12:49:05.603 INFO:tasks.workunit.client.1.smithi148.stdout:0/316: link de/d27/c68 de/d27/d38/c6c 0 2024-09-18T12:49:05.605 INFO:tasks.workunit.client.1.smithi148.stdout:5/141: truncate d7/f1b 3730113 0 2024-09-18T12:49:05.605 INFO:tasks.workunit.client.1.smithi148.stdout:1/100: dwrite f6 [4194304,4194304] 0 2024-09-18T12:49:05.606 INFO:tasks.workunit.client.1.smithi148.stdout:3/93: link d4/d8/f1f d4/d8/f23 0 2024-09-18T12:49:05.607 INFO:tasks.workunit.client.1.smithi148.stdout:7/99: dread f4 [0,4194304] 0 2024-09-18T12:49:05.608 INFO:tasks.workunit.client.1.smithi148.stdout:2/91: rmdir d9/d1f 0 2024-09-18T12:49:05.610 INFO:tasks.workunit.client.1.smithi148.stdout:1/101: creat dc/f25 x:0 0 0 2024-09-18T12:49:05.615 INFO:tasks.workunit.client.1.smithi148.stdout:7/100: mkdir db/dc/df/d1d 0 2024-09-18T12:49:05.615 INFO:tasks.workunit.client.1.smithi148.stdout:5/142: dread d7/d8/dc/d12/f24 [0,4194304] 0 2024-09-18T12:49:05.616 INFO:tasks.workunit.client.1.smithi148.stdout:6/159: mknod d5/d32/d38/c3a 0 2024-09-18T12:49:05.617 INFO:tasks.workunit.client.1.smithi148.stdout:0/317: symlink de/d14/d43/l6d 0 2024-09-18T12:49:05.617 INFO:tasks.workunit.client.1.smithi148.stdout:6/160: chown d5/d1a/dc/d2b 2 1 2024-09-18T12:49:05.617 INFO:tasks.workunit.client.1.smithi148.stdout:2/92: rmdir d9/d17 39 2024-09-18T12:49:05.618 INFO:tasks.workunit.client.1.smithi148.stdout:9/97: truncate f7 416257 0 2024-09-18T12:49:05.619 INFO:tasks.workunit.client.1.smithi148.stdout:0/318: write de/d27/d38/f51 [109310,30072] 0 2024-09-18T12:49:05.619 INFO:tasks.workunit.client.1.smithi148.stdout:1/102: rmdir dc 39 2024-09-18T12:49:05.620 INFO:tasks.workunit.client.1.smithi148.stdout:8/138: dread d8/d12/f15 [0,4194304] 0 2024-09-18T12:49:05.620 INFO:tasks.workunit.client.1.smithi148.stdout:3/94: rename d4/d8/f9 to d4/d8/f24 0 2024-09-18T12:49:05.622 INFO:tasks.workunit.client.1.smithi148.stdout:6/161: creat d5/d32/f3b x:0 0 0 2024-09-18T12:49:05.622 INFO:tasks.workunit.client.1.smithi148.stdout:6/162: chown d5/d32/f3b 0 1 2024-09-18T12:49:05.623 INFO:tasks.workunit.client.1.smithi148.stdout:9/98: dread - d8/da/f13 zero size 2024-09-18T12:49:05.626 INFO:tasks.workunit.client.1.smithi148.stdout:7/101: link db/d10/f13 db/d10/f1e 0 2024-09-18T12:49:05.627 INFO:tasks.workunit.client.1.smithi148.stdout:2/93: mknod d9/c20 0 2024-09-18T12:49:05.628 INFO:tasks.workunit.client.1.smithi148.stdout:5/143: link d7/d8/dc/ff d7/d8/dc/d12/d31/f32 0 2024-09-18T12:49:05.628 INFO:tasks.workunit.client.1.smithi148.stdout:1/103: mknod dc/d11/c26 0 2024-09-18T12:49:05.630 INFO:tasks.workunit.client.1.smithi148.stdout:8/139: link d8/d16/f2a d8/d16/d27/f30 0 2024-09-18T12:49:05.631 INFO:tasks.workunit.client.1.smithi148.stdout:8/140: chown d8/d12/l17 429 1 2024-09-18T12:49:05.634 INFO:tasks.workunit.client.1.smithi148.stdout:1/104: mknod dc/d18/c27 0 2024-09-18T12:49:05.634 INFO:tasks.workunit.client.1.smithi148.stdout:5/144: creat d7/d8/dc/d12/d1f/f33 x:0 0 0 2024-09-18T12:49:05.634 INFO:tasks.workunit.client.1.smithi148.stdout:5/145: stat d7 0 2024-09-18T12:49:05.634 INFO:tasks.workunit.client.1.smithi148.stdout:1/105: chown dc/d11/f16 61628 1 2024-09-18T12:49:05.636 INFO:tasks.workunit.client.1.smithi148.stdout:2/94: unlink d9/d17/l1c 0 2024-09-18T12:49:05.637 INFO:tasks.workunit.client.1.smithi148.stdout:0/319: link de/d27/d38/c6c de/d14/d43/d57/d59/c6e 0 2024-09-18T12:49:05.639 INFO:tasks.workunit.client.1.smithi148.stdout:9/99: dread d8/fe [0,4194304] 0 2024-09-18T12:49:05.640 INFO:tasks.workunit.client.1.smithi148.stdout:5/146: unlink d7/d8/d18/c23 0 2024-09-18T12:49:05.642 INFO:tasks.workunit.client.1.smithi148.stdout:5/147: dread d7/d8/dc/d12/f2d [0,4194304] 0 2024-09-18T12:49:05.642 INFO:tasks.workunit.client.1.smithi148.stdout:0/320: unlink de/d14/f15 0 2024-09-18T12:49:05.644 INFO:tasks.workunit.client.1.smithi148.stdout:2/95: dread f8 [0,4194304] 0 2024-09-18T12:49:05.645 INFO:tasks.workunit.client.1.smithi148.stdout:1/106: dread f8 [4194304,4194304] 0 2024-09-18T12:49:05.650 INFO:tasks.workunit.client.1.smithi148.stdout:5/148: creat d7/d8/dc/d12/f34 x:0 0 0 2024-09-18T12:49:05.651 INFO:tasks.workunit.client.1.smithi148.stdout:8/141: link d8/df/c11 d8/c31 0 2024-09-18T12:49:05.653 INFO:tasks.workunit.client.1.smithi148.stdout:0/321: creat de/d14/d43/d57/f6f x:0 0 0 2024-09-18T12:49:05.654 INFO:tasks.workunit.client.1.smithi148.stdout:2/96: write d9/ff [60408,83378] 0 2024-09-18T12:49:05.655 INFO:tasks.workunit.client.1.smithi148.stdout:1/107: symlink dc/l28 0 2024-09-18T12:49:05.656 INFO:tasks.workunit.client.1.smithi148.stdout:1/108: read f8 [2791744,1050] 0 2024-09-18T12:49:05.657 INFO:tasks.workunit.client.1.smithi148.stdout:3/95: write d4/d8/f23 [1258517,48468] 0 2024-09-18T12:49:05.658 INFO:tasks.workunit.client.1.smithi148.stdout:9/100: link d8/c19 d8/da/dd/c1f 0 2024-09-18T12:49:05.658 INFO:tasks.workunit.client.1.smithi148.stdout:6/163: write d5/fa [175304,49546] 0 2024-09-18T12:49:05.659 INFO:tasks.workunit.client.1.smithi148.stdout:1/109: dread - dc/d11/f15 zero size 2024-09-18T12:49:05.660 INFO:tasks.workunit.client.1.smithi148.stdout:6/164: fsync d5/f2e 0 2024-09-18T12:49:05.660 INFO:tasks.workunit.client.1.smithi148.stdout:5/149: symlink d7/d8/l35 0 2024-09-18T12:49:05.660 INFO:tasks.workunit.client.1.smithi148.stdout:5/150: stat l5 0 2024-09-18T12:49:05.661 INFO:tasks.workunit.client.1.smithi148.stdout:6/165: fsync d5/f2e 0 2024-09-18T12:49:05.661 INFO:tasks.workunit.client.1.smithi148.stdout:1/110: chown dc/c22 1045570 1 2024-09-18T12:49:05.661 INFO:tasks.workunit.client.1.smithi148.stdout:3/96: truncate d4/fe 4231693 0 2024-09-18T12:49:05.662 INFO:tasks.workunit.client.1.smithi148.stdout:0/322: mkdir de/d14/d43/d70 0 2024-09-18T12:49:05.663 INFO:tasks.workunit.client.1.smithi148.stdout:9/101: write d8/da/fb [819063,18114] 0 2024-09-18T12:49:05.663 INFO:tasks.workunit.client.1.smithi148.stdout:9/102: fsync d8/f16 0 2024-09-18T12:49:05.664 INFO:tasks.workunit.client.1.smithi148.stdout:9/103: readlink d8/da/df/l1a 0 2024-09-18T12:49:05.664 INFO:tasks.workunit.client.1.smithi148.stdout:9/104: chown f0 511 1 2024-09-18T12:49:05.665 INFO:tasks.workunit.client.1.smithi148.stdout:1/111: mknod dc/d11/d17/c29 0 2024-09-18T12:49:05.666 INFO:tasks.workunit.client.1.smithi148.stdout:6/166: mknod d5/d1a/d31/c3c 0 2024-09-18T12:49:05.667 INFO:tasks.workunit.client.1.smithi148.stdout:3/97: creat d4/d8/d1e/f25 x:0 0 0 2024-09-18T12:49:05.667 INFO:tasks.workunit.client.1.smithi148.stdout:3/98: fsync d4/d8/f23 0 2024-09-18T12:49:05.668 INFO:tasks.workunit.client.1.smithi148.stdout:3/99: readlink d4/l1b 0 2024-09-18T12:49:05.669 INFO:tasks.workunit.client.1.smithi148.stdout:1/112: dread f8 [0,4194304] 0 2024-09-18T12:49:05.670 INFO:tasks.workunit.client.1.smithi148.stdout:3/100: chown d4/d8/f1a 27067 1 2024-09-18T12:49:05.670 INFO:tasks.workunit.client.1.smithi148.stdout:2/97: getdents d9 0 2024-09-18T12:49:05.670 INFO:tasks.workunit.client.1.smithi148.stdout:1/113: stat dc/f25 0 2024-09-18T12:49:05.670 INFO:tasks.workunit.client.1.smithi148.stdout:5/151: creat d7/d2b/f36 x:0 0 0 2024-09-18T12:49:05.672 INFO:tasks.workunit.client.1.smithi148.stdout:8/142: write d8/d12/f2c [8898873,31321] 0 2024-09-18T12:49:05.673 INFO:tasks.workunit.client.1.smithi148.stdout:6/167: write d5/d1a/f21 [4524586,54201] 0 2024-09-18T12:49:05.674 INFO:tasks.workunit.client.1.smithi148.stdout:2/98: dread d9/fb [0,4194304] 0 2024-09-18T12:49:05.674 INFO:tasks.workunit.client.1.smithi148.stdout:9/105: mknod d8/da/c20 0 2024-09-18T12:49:05.677 INFO:tasks.workunit.client.1.smithi148.stdout:1/114: mknod dc/d18/c2a 0 2024-09-18T12:49:05.678 INFO:tasks.workunit.client.1.smithi148.stdout:5/152: symlink d7/d8/dc/d12/d31/l37 0 2024-09-18T12:49:05.680 INFO:tasks.workunit.client.1.smithi148.stdout:8/143: mknod d8/d16/c32 0 2024-09-18T12:49:05.681 INFO:tasks.workunit.client.1.smithi148.stdout:2/99: dwrite d9/fe [0,4194304] 0 2024-09-18T12:49:05.682 INFO:tasks.workunit.client.1.smithi148.stdout:5/153: chown d7/d8/f13 1859539 1 2024-09-18T12:49:05.682 INFO:tasks.workunit.client.1.smithi148.stdout:3/101: creat d4/d8/d20/f26 x:0 0 0 2024-09-18T12:49:05.686 INFO:tasks.workunit.client.1.smithi148.stdout:6/168: rename d5/d1a/d31 to d5/d1a/d3d 0 2024-09-18T12:49:05.687 INFO:tasks.workunit.client.1.smithi148.stdout:2/100: fsync f5 0 2024-09-18T12:49:05.689 INFO:tasks.workunit.client.1.smithi148.stdout:3/102: fsync f2 0 2024-09-18T12:49:05.694 INFO:tasks.workunit.client.1.smithi148.stdout:1/115: dwrite dc/f25 [0,4194304] 0 2024-09-18T12:49:05.694 INFO:tasks.workunit.client.1.smithi148.stdout:0/323: dwrite de/f24 [0,4194304] 0 2024-09-18T12:49:05.694 INFO:tasks.workunit.client.1.smithi148.stdout:6/169: write d5/d1a/f21 [139243,467] 0 2024-09-18T12:49:05.710 INFO:tasks.workunit.client.1.smithi148.stdout:9/106: dread f0 [0,4194304] 0 2024-09-18T12:49:05.713 INFO:tasks.workunit.client.1.smithi148.stdout:5/154: dwrite d7/d8/fa [0,4194304] 0 2024-09-18T12:49:05.715 INFO:tasks.workunit.client.1.smithi148.stdout:9/107: dread f0 [0,4194304] 0 2024-09-18T12:49:05.720 INFO:tasks.workunit.client.1.smithi148.stdout:4/119: sync 2024-09-18T12:49:05.729 INFO:tasks.workunit.client.1.smithi148.stdout:0/324: dread de/d14/f65 [0,4194304] 0 2024-09-18T12:49:05.730 INFO:tasks.workunit.client.1.smithi148.stdout:0/325: fsync de/d14/d43/f4d 0 2024-09-18T12:49:05.794 INFO:tasks.workunit.client.1.smithi148.stdout:8/144: link d8/df/c2e d8/df/c33 0 2024-09-18T12:49:05.794 INFO:tasks.workunit.client.1.smithi148.stdout:8/145: write d8/d12/f2c [9956200,7606] 0 2024-09-18T12:49:05.796 INFO:tasks.workunit.client.1.smithi148.stdout:3/103: truncate d4/d8/f24 12557 0 2024-09-18T12:49:05.797 INFO:tasks.workunit.client.1.smithi148.stdout:8/146: dread d8/f2d [0,4194304] 0 2024-09-18T12:49:05.798 INFO:tasks.workunit.client.1.smithi148.stdout:8/147: dread - d8/f2f zero size 2024-09-18T12:49:05.799 INFO:tasks.workunit.client.1.smithi148.stdout:5/155: rename d7/d8/dc/d12/d20/f29 to d7/d8/d18/f38 0 2024-09-18T12:49:05.801 INFO:tasks.workunit.client.1.smithi148.stdout:4/120: mknod d15/d1d/c30 0 2024-09-18T12:49:05.805 INFO:tasks.workunit.client.1.smithi148.stdout:7/102: sync 2024-09-18T12:49:05.806 INFO:tasks.workunit.client.1.smithi148.stdout:7/103: write db/dd/f1a [513275,7486] 0 2024-09-18T12:49:05.806 INFO:tasks.workunit.client.1.smithi148.stdout:7/104: readlink db/dc/df/l17 0 2024-09-18T12:49:05.807 INFO:tasks.workunit.client.1.smithi148.stdout:8/148: creat d8/d16/f34 x:0 0 0 2024-09-18T12:49:05.810 INFO:tasks.workunit.client.1.smithi148.stdout:5/156: mkdir d7/d8/dc/d12/d1f/d39 0 2024-09-18T12:49:05.811 INFO:tasks.workunit.client.1.smithi148.stdout:8/149: dread d8/fb [4194304,4194304] 0 2024-09-18T12:49:05.811 INFO:tasks.workunit.client.1.smithi148.stdout:4/121: mknod d15/d1d/c31 0 2024-09-18T12:49:05.812 INFO:tasks.workunit.client.1.smithi148.stdout:0/326: link de/d27/d38/f50 de/d27/d38/f71 0 2024-09-18T12:49:05.813 INFO:tasks.workunit.client.1.smithi148.stdout:0/327: fdatasync de/d27/d38/f61 0 2024-09-18T12:49:05.814 INFO:tasks.workunit.client.1.smithi148.stdout:3/104: rename d4/d8/c10 to d4/d8/d1e/c27 0 2024-09-18T12:49:05.815 INFO:tasks.workunit.client.1.smithi148.stdout:3/105: rename d4 to d4/d8/d13/d28 22 2024-09-18T12:49:05.815 INFO:tasks.workunit.client.1.smithi148.stdout:8/150: stat d8/df/c2e 0 2024-09-18T12:49:05.815 INFO:tasks.workunit.client.1.smithi148.stdout:9/108: dread d8/da/df/f12 [0,4194304] 0 2024-09-18T12:49:05.817 INFO:tasks.workunit.client.1.smithi148.stdout:3/106: truncate d4/f18 462739 0 2024-09-18T12:49:05.818 INFO:tasks.workunit.client.1.smithi148.stdout:8/151: mknod d8/d16/d27/c35 0 2024-09-18T12:49:05.818 INFO:tasks.workunit.client.1.smithi148.stdout:8/152: read f1 [4978375,102051] 0 2024-09-18T12:49:05.820 INFO:tasks.workunit.client.1.smithi148.stdout:5/157: creat d7/d8/f3a x:0 0 0 2024-09-18T12:49:05.821 INFO:tasks.workunit.client.1.smithi148.stdout:7/105: getdents db 0 2024-09-18T12:49:05.823 INFO:tasks.workunit.client.1.smithi148.stdout:8/153: mknod d8/df/c36 0 2024-09-18T12:49:05.825 INFO:tasks.workunit.client.1.smithi148.stdout:8/154: rmdir d8/df 39 2024-09-18T12:49:05.826 INFO:tasks.workunit.client.1.smithi148.stdout:9/109: dwrite d8/da/fb [4194304,4194304] 0 2024-09-18T12:49:05.826 INFO:tasks.workunit.client.1.smithi148.stdout:7/106: rename db/d10 to db/dd/d1f 0 2024-09-18T12:49:05.828 INFO:tasks.workunit.client.1.smithi148.stdout:3/107: dwrite d4/d8/f15 [0,4194304] 0 2024-09-18T12:49:05.832 INFO:tasks.workunit.client.1.smithi148.stdout:2/101: sync 2024-09-18T12:49:05.833 INFO:tasks.workunit.client.1.smithi148.stdout:7/107: fdatasync db/dd/d1f/f1e 0 2024-09-18T12:49:05.835 INFO:tasks.workunit.client.1.smithi148.stdout:5/158: getdents d7/d8/dc/d12/d31 0 2024-09-18T12:49:05.838 INFO:tasks.workunit.client.1.smithi148.stdout:7/108: dread db/dd/f1a [0,4194304] 0 2024-09-18T12:49:05.847 INFO:tasks.workunit.client.1.smithi148.stdout:3/108: rename d4/d8/d1e/f22 to d4/f29 0 2024-09-18T12:49:05.856 INFO:tasks.workunit.client.1.smithi148.stdout:8/155: dread d8/d16/f2a [0,4194304] 0 2024-09-18T12:49:05.858 INFO:tasks.workunit.client.1.smithi148.stdout:8/156: mknod d8/d16/c37 0 2024-09-18T12:49:05.861 INFO:tasks.workunit.client.1.smithi148.stdout:8/157: mkdir d8/df/d38 0 2024-09-18T12:49:05.863 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:05 smithi078 ceph-mon[28091]: pgmap v10: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 326 KiB/s rd, 13 MiB/s wr, 223 op/s 2024-09-18T12:49:05.864 INFO:tasks.workunit.client.1.smithi148.stdout:8/158: mkdir d8/df/d38/d39 0 2024-09-18T12:49:05.865 INFO:tasks.workunit.client.1.smithi148.stdout:8/159: mknod d8/d16/d27/c3a 0 2024-09-18T12:49:05.866 INFO:tasks.workunit.client.1.smithi148.stdout:8/160: readlink d8/d16/d27/l1f 0 2024-09-18T12:49:05.868 INFO:tasks.workunit.client.1.smithi148.stdout:8/161: mkdir d8/df/d38/d39/d3b 0 2024-09-18T12:49:05.874 INFO:tasks.workunit.client.1.smithi148.stdout:1/116: truncate dc/f13 2193520 0 2024-09-18T12:49:05.876 INFO:tasks.workunit.client.1.smithi148.stdout:1/117: mkdir dc/d11/d17/d2b 0 2024-09-18T12:49:05.877 INFO:tasks.workunit.client.1.smithi148.stdout:1/118: write dc/d18/f1f [796544,97607] 0 2024-09-18T12:49:05.877 INFO:tasks.workunit.client.1.smithi148.stdout:6/170: truncate d5/ff 3832151 0 2024-09-18T12:49:05.879 INFO:tasks.workunit.client.1.smithi148.stdout:6/171: symlink d5/d1a/l3e 0 2024-09-18T12:49:05.881 INFO:tasks.workunit.client.1.smithi148.stdout:4/122: write d15/d17/d1f/f21 [567220,65972] 0 2024-09-18T12:49:05.883 INFO:tasks.workunit.client.1.smithi148.stdout:0/328: truncate de/d27/f2b 3216866 0 2024-09-18T12:49:05.884 INFO:tasks.workunit.client.1.smithi148.stdout:4/123: creat d15/d17/d1f/f32 x:0 0 0 2024-09-18T12:49:05.884 INFO:tasks.workunit.client.1.smithi148.stdout:4/124: chown c6 0 1 2024-09-18T12:49:05.885 INFO:tasks.workunit.client.1.smithi148.stdout:0/329: symlink de/d27/l72 0 2024-09-18T12:49:05.885 INFO:tasks.workunit.client.1.smithi148.stdout:4/125: fsync d15/d1d/f22 0 2024-09-18T12:49:05.888 INFO:tasks.workunit.client.1.smithi148.stdout:0/330: rename de/d27/f5a to de/d27/d2e/f73 0 2024-09-18T12:49:05.889 INFO:tasks.workunit.client.1.smithi148.stdout:4/126: link d15/d17/f2a d15/d1d/f33 0 2024-09-18T12:49:05.891 INFO:tasks.workunit.client.1.smithi148.stdout:5/159: truncate d7/d8/fa 5572501 0 2024-09-18T12:49:05.891 INFO:tasks.workunit.client.1.smithi148.stdout:0/331: mkdir de/d27/d74 0 2024-09-18T12:49:05.893 INFO:tasks.workunit.client.1.smithi148.stdout:3/109: truncate d4/f18 397393 0 2024-09-18T12:49:05.893 INFO:tasks.workunit.client.1.smithi148.stdout:8/162: truncate d8/d16/f2a 5005296 0 2024-09-18T12:49:05.896 INFO:tasks.workunit.client.1.smithi148.stdout:1/119: dread dc/f10 [0,4194304] 0 2024-09-18T12:49:05.896 INFO:tasks.workunit.client.1.smithi148.stdout:4/127: write d15/d17/d1f/f21 [478165,35359] 0 2024-09-18T12:49:05.897 INFO:tasks.workunit.client.1.smithi148.stdout:3/110: chown d4/d8/d13/l17 749 1 2024-09-18T12:49:05.899 INFO:tasks.workunit.client.1.smithi148.stdout:9/110: dwrite d8/da/df/f12 [4194304,4194304] 0 2024-09-18T12:49:05.901 INFO:tasks.workunit.client.1.smithi148.stdout:6/172: getdents d5/d1a 0 2024-09-18T12:49:05.905 INFO:tasks.workunit.client.0.smithi078.stdout:3/46: sync 2024-09-18T12:49:05.905 INFO:tasks.workunit.client.1.smithi148.stdout:4/128: fdatasync d15/d17/d1f/f24 0 2024-09-18T12:49:05.905 INFO:tasks.workunit.client.1.smithi148.stdout:2/102: dwrite f8 [0,4194304] 0 2024-09-18T12:49:05.905 INFO:tasks.workunit.client.1.smithi148.stdout:0/332: mknod de/d14/d43/d57/d59/c75 0 2024-09-18T12:49:05.906 INFO:tasks.workunit.client.1.smithi148.stdout:5/160: truncate d7/f1b 2634989 0 2024-09-18T12:49:05.906 INFO:tasks.workunit.client.1.smithi148.stdout:3/111: truncate d4/f29 928869 0 2024-09-18T12:49:05.908 INFO:tasks.workunit.client.1.smithi148.stdout:2/103: dread - d9/fd zero size 2024-09-18T12:49:05.908 INFO:tasks.workunit.client.1.smithi148.stdout:3/112: fsync f2 0 2024-09-18T12:49:05.911 INFO:tasks.workunit.client.1.smithi148.stdout:7/109: dwrite db/dc/df/d11/f1b [4194304,4194304] 0 2024-09-18T12:49:05.916 INFO:tasks.workunit.client.1.smithi148.stdout:1/120: symlink dc/l2c 0 2024-09-18T12:49:05.918 INFO:tasks.workunit.client.1.smithi148.stdout:5/161: dread - d7/d8/dc/d12/f34 zero size 2024-09-18T12:49:05.919 INFO:tasks.workunit.client.1.smithi148.stdout:9/111: dread f6 [0,4194304] 0 2024-09-18T12:49:05.920 INFO:tasks.workunit.client.1.smithi148.stdout:3/113: write d4/f5 [6512693,80179] 0 2024-09-18T12:49:05.922 INFO:tasks.workunit.client.1.smithi148.stdout:5/162: chown d7/d8/f1c 224921706 1 2024-09-18T12:49:05.923 INFO:tasks.workunit.client.1.smithi148.stdout:0/333: creat de/d27/f76 x:0 0 0 2024-09-18T12:49:05.924 INFO:tasks.workunit.client.1.smithi148.stdout:3/114: chown d4/d8/d1e 466 1 2024-09-18T12:49:05.925 INFO:tasks.workunit.client.1.smithi148.stdout:4/129: dwrite d15/f28 [0,4194304] 0 2024-09-18T12:49:05.927 INFO:tasks.workunit.client.1.smithi148.stdout:4/130: chown d15/d1d/f33 807521764 1 2024-09-18T12:49:05.928 INFO:tasks.workunit.client.1.smithi148.stdout:4/131: chown c6 3089126 1 2024-09-18T12:49:05.930 INFO:tasks.workunit.client.1.smithi148.stdout:9/112: mknod d8/c21 0 2024-09-18T12:49:05.930 INFO:tasks.workunit.client.1.smithi148.stdout:8/163: link d8/df/l22 d8/df/l3c 0 2024-09-18T12:49:05.932 INFO:tasks.workunit.client.1.smithi148.stdout:4/132: mkdir d15/d1d/d34 0 2024-09-18T12:49:05.932 INFO:tasks.workunit.client.1.smithi148.stdout:2/104: dwrite d9/fe [0,4194304] 0 2024-09-18T12:49:05.933 INFO:tasks.workunit.client.1.smithi148.stdout:9/113: dread - d8/da/f13 zero size 2024-09-18T12:49:05.941 INFO:tasks.workunit.client.0.smithi078.stdout:3/47: write d9/fa [4138676,56864] 0 2024-09-18T12:49:05.947 INFO:tasks.workunit.client.0.smithi078.stdout:3/48: dread d9/fa [0,4194304] 0 2024-09-18T12:49:05.954 INFO:tasks.workunit.client.1.smithi148.stdout:8/164: unlink c2 0 2024-09-18T12:49:05.957 INFO:tasks.workunit.client.1.smithi148.stdout:1/121: truncate dc/d11/f12 123227 0 2024-09-18T12:49:05.959 INFO:tasks.workunit.client.1.smithi148.stdout:0/334: link de/d27/d2e/f73 de/f77 0 2024-09-18T12:49:05.961 INFO:tasks.workunit.client.1.smithi148.stdout:1/122: fdatasync dc/d18/f1c 0 2024-09-18T12:49:05.962 INFO:tasks.workunit.client.1.smithi148.stdout:8/165: creat d8/df/d38/d39/f3d x:0 0 0 2024-09-18T12:49:05.968 INFO:tasks.workunit.client.1.smithi148.stdout:4/133: dwrite d15/f2d [0,4194304] 0 2024-09-18T12:49:05.968 INFO:tasks.workunit.client.1.smithi148.stdout:2/105: getdents d9 0 2024-09-18T12:49:05.969 INFO:tasks.workunit.client.1.smithi148.stdout:7/110: dwrite f4 [4194304,4194304] 0 2024-09-18T12:49:05.972 INFO:tasks.workunit.client.1.smithi148.stdout:5/163: read d7/d8/fa [3257660,20675] 0 2024-09-18T12:49:05.972 INFO:tasks.workunit.client.1.smithi148.stdout:6/173: dwrite d5/d1a/f37 [0,4194304] 0 2024-09-18T12:49:05.973 INFO:tasks.workunit.client.1.smithi148.stdout:4/134: truncate d15/f28 4259191 0 2024-09-18T12:49:05.973 INFO:tasks.workunit.client.1.smithi148.stdout:0/335: fdatasync de/d27/d2e/f73 0 2024-09-18T12:49:05.975 INFO:tasks.workunit.client.1.smithi148.stdout:9/114: getdents d8 0 2024-09-18T12:49:05.977 INFO:tasks.workunit.client.1.smithi148.stdout:1/123: mknod dc/d11/d17/d2b/c2d 0 2024-09-18T12:49:05.978 INFO:tasks.workunit.client.1.smithi148.stdout:4/135: chown d15/f16 17 1 2024-09-18T12:49:05.978 INFO:tasks.workunit.client.1.smithi148.stdout:0/336: chown de/c56 0 1 2024-09-18T12:49:05.979 INFO:tasks.workunit.client.1.smithi148.stdout:4/136: dread - d15/d17/f1c zero size 2024-09-18T12:49:05.979 INFO:tasks.workunit.client.1.smithi148.stdout:5/164: unlink d7/d8/f3a 0 2024-09-18T12:49:05.981 INFO:tasks.workunit.client.1.smithi148.stdout:7/111: symlink db/dc/df/d1d/l20 0 2024-09-18T12:49:05.982 INFO:tasks.workunit.client.1.smithi148.stdout:2/106: link d9/fc d9/f21 0 2024-09-18T12:49:05.983 INFO:tasks.workunit.client.1.smithi148.stdout:8/166: dread d8/df/f10 [0,4194304] 0 2024-09-18T12:49:05.984 INFO:tasks.workunit.client.1.smithi148.stdout:1/124: creat dc/d11/d17/d2b/f2e x:0 0 0 2024-09-18T12:49:05.984 INFO:tasks.workunit.client.1.smithi148.stdout:5/165: chown d7/d8/dc/d22 68200513 1 2024-09-18T12:49:05.985 INFO:tasks.workunit.client.1.smithi148.stdout:6/174: getdents d5/d1a/dc 0 2024-09-18T12:49:05.987 INFO:tasks.workunit.client.1.smithi148.stdout:9/115: dread d8/fe [0,4194304] 0 2024-09-18T12:49:05.987 INFO:tasks.workunit.client.1.smithi148.stdout:0/337: mknod de/d14/d43/d57/c78 0 2024-09-18T12:49:05.988 INFO:tasks.workunit.client.1.smithi148.stdout:2/107: fdatasync f7 0 2024-09-18T12:49:05.988 INFO:tasks.workunit.client.1.smithi148.stdout:7/112: unlink db/dc/df/c19 0 2024-09-18T12:49:05.988 INFO:tasks.workunit.client.1.smithi148.stdout:8/167: dread - d8/f2f zero size 2024-09-18T12:49:05.990 INFO:tasks.workunit.client.1.smithi148.stdout:5/166: symlink d7/d8/dc/d12/d1f/d39/l3b 0 2024-09-18T12:49:05.992 INFO:tasks.workunit.client.1.smithi148.stdout:0/338: unlink de/d27/d2e/c35 0 2024-09-18T12:49:05.992 INFO:tasks.workunit.client.1.smithi148.stdout:8/168: mkdir d8/df/d3e 0 2024-09-18T12:49:05.993 INFO:tasks.workunit.client.1.smithi148.stdout:2/108: symlink d9/d17/l22 0 2024-09-18T12:49:05.993 INFO:tasks.workunit.client.1.smithi148.stdout:5/167: fsync d7/d8/dc/d12/f34 0 2024-09-18T12:49:05.994 INFO:tasks.workunit.client.1.smithi148.stdout:9/116: truncate d8/da/df/f18 189056 0 2024-09-18T12:49:05.995 INFO:tasks.workunit.client.1.smithi148.stdout:7/113: unlink db/dd/d1f/f1e 0 2024-09-18T12:49:05.995 INFO:tasks.workunit.client.1.smithi148.stdout:4/137: dwrite d15/d17/d1f/f32 [0,4194304] 0 2024-09-18T12:49:05.996 INFO:tasks.workunit.client.1.smithi148.stdout:8/169: write d8/d12/f1b [1337213,108316] 0 2024-09-18T12:49:05.997 INFO:tasks.workunit.client.1.smithi148.stdout:6/175: link d5/d1a/dc/c2a d5/c3f 0 2024-09-18T12:49:06.000 INFO:tasks.workunit.client.1.smithi148.stdout:9/117: creat d8/f22 x:0 0 0 2024-09-18T12:49:06.001 INFO:tasks.workunit.client.1.smithi148.stdout:0/339: dread de/d14/f65 [0,4194304] 0 2024-09-18T12:49:06.002 INFO:tasks.workunit.client.1.smithi148.stdout:5/168: rename d7/d8/dc/d12/d31/f2f to d7/d2b/f3c 0 2024-09-18T12:49:06.009 INFO:tasks.workunit.client.1.smithi148.stdout:8/170: link d8/l18 d8/df/d38/l3f 0 2024-09-18T12:49:06.009 INFO:tasks.workunit.client.1.smithi148.stdout:6/176: dwrite d5/d32/f33 [0,4194304] 0 2024-09-18T12:49:06.010 INFO:tasks.workunit.client.1.smithi148.stdout:7/114: rename db/dd/d1f/f13 to db/dc/df/d1d/f21 0 2024-09-18T12:49:06.013 INFO:tasks.workunit.client.1.smithi148.stdout:5/169: dwrite d7/d8/f1c [4194304,4194304] 0 2024-09-18T12:49:06.013 INFO:tasks.workunit.client.1.smithi148.stdout:8/171: creat d8/df/d38/d39/f40 x:0 0 0 2024-09-18T12:49:06.014 INFO:tasks.workunit.client.0.smithi078.stdout:8/51: sync 2024-09-18T12:49:06.014 INFO:tasks.workunit.client.0.smithi078.stdout:9/49: sync 2024-09-18T12:49:06.015 INFO:tasks.workunit.client.1.smithi148.stdout:8/172: read d8/df/f10 [671259,116713] 0 2024-09-18T12:49:06.016 INFO:tasks.workunit.client.1.smithi148.stdout:6/177: dread d5/d1a/f1f [0,4194304] 0 2024-09-18T12:49:06.030 INFO:tasks.workunit.client.0.smithi078.stdout:8/52: dread d0/f2 [0,4194304] 0 2024-09-18T12:49:06.032 INFO:tasks.workunit.client.1.smithi148.stdout:0/340: dread de/d27/d38/f39 [0,4194304] 0 2024-09-18T12:49:06.035 INFO:tasks.workunit.client.0.smithi078.stdout:8/53: dwrite d0/d7/fb [0,4194304] 0 2024-09-18T12:49:06.044 INFO:tasks.workunit.client.0.smithi078.stdout:8/54: truncate d0/fe 1818273 0 2024-09-18T12:49:06.046 INFO:tasks.workunit.client.1.smithi148.stdout:7/115: symlink db/l22 0 2024-09-18T12:49:06.047 INFO:tasks.workunit.client.1.smithi148.stdout:9/118: link d8/da/dd/c1f d8/da/df/c23 0 2024-09-18T12:49:06.049 INFO:tasks.workunit.client.0.smithi078.stdout:9/50: rename d5/f6 to d5/d7/fc 0 2024-09-18T12:49:06.050 INFO:tasks.workunit.client.0.smithi078.stdout:9/51: chown d5/d7/d8/fb 485567 1 2024-09-18T12:49:06.053 INFO:tasks.workunit.client.1.smithi148.stdout:0/341: symlink de/d27/d2e/l79 0 2024-09-18T12:49:06.057 INFO:tasks.workunit.client.0.smithi078.stdout:9/52: rename f4 to d5/d7/d8/fd 0 2024-09-18T12:49:06.058 INFO:tasks.workunit.client.0.smithi078.stdout:8/55: dwrite d0/fe [0,4194304] 0 2024-09-18T12:49:06.058 INFO:tasks.workunit.client.0.smithi078.stdout:9/53: fsync d5/d7/d8/fb 0 2024-09-18T12:49:06.058 INFO:tasks.workunit.client.1.smithi148.stdout:5/170: getdents d7/d8/dc/d12/d1f/d25 0 2024-09-18T12:49:06.061 INFO:tasks.workunit.client.1.smithi148.stdout:7/116: mkdir db/dc/d16/d23 0 2024-09-18T12:49:06.061 INFO:tasks.workunit.client.0.smithi078.stdout:9/54: creat d5/d7/d8/fe x:0 0 0 2024-09-18T12:49:06.062 INFO:tasks.workunit.client.1.smithi148.stdout:7/117: rmdir db/dc 39 2024-09-18T12:49:06.063 INFO:tasks.workunit.client.0.smithi078.stdout:9/55: symlink d5/d7/lf 0 2024-09-18T12:49:06.064 INFO:tasks.workunit.client.1.smithi148.stdout:9/119: getdents d8/da 0 2024-09-18T12:49:06.065 INFO:tasks.workunit.client.0.smithi078.stdout:9/56: chown d5/d7/ca 6465 1 2024-09-18T12:49:06.066 INFO:tasks.workunit.client.0.smithi078.stdout:8/56: dwrite d0/d7/fb [0,4194304] 0 2024-09-18T12:49:06.068 INFO:tasks.workunit.client.1.smithi148.stdout:3/115: sync 2024-09-18T12:49:06.068 INFO:tasks.workunit.client.0.smithi078.stdout:8/57: write d0/f1 [3309304,58459] 0 2024-09-18T12:49:06.072 INFO:tasks.workunit.client.0.smithi078.stdout:8/58: fsync d0/f5 0 2024-09-18T12:49:06.072 INFO:tasks.workunit.client.1.smithi148.stdout:0/342: dread de/d27/d38/f5b [0,4194304] 0 2024-09-18T12:49:06.073 INFO:tasks.workunit.client.0.smithi078.stdout:8/59: readlink d0/d7/dc/lf 0 2024-09-18T12:49:06.074 INFO:tasks.workunit.client.1.smithi148.stdout:5/171: dwrite f6 [0,4194304] 0 2024-09-18T12:49:06.074 INFO:tasks.workunit.client.1.smithi148.stdout:3/116: rmdir d4 39 2024-09-18T12:49:06.075 INFO:tasks.workunit.client.0.smithi078.stdout:9/57: dwrite f3 [0,4194304] 0 2024-09-18T12:49:06.076 INFO:tasks.workunit.client.1.smithi148.stdout:7/118: dwrite fa [0,4194304] 0 2024-09-18T12:49:06.076 INFO:tasks.workunit.client.1.smithi148.stdout:5/172: readlink d7/d8/dc/d12/l26 0 2024-09-18T12:49:06.081 INFO:tasks.workunit.client.1.smithi148.stdout:5/173: mkdir d7/d8/dc/d12/d1f/d3d 0 2024-09-18T12:49:06.081 INFO:tasks.workunit.client.1.smithi148.stdout:3/117: chown d4/d8/f24 920785625 1 2024-09-18T12:49:06.084 INFO:tasks.workunit.client.1.smithi148.stdout:7/119: mkdir db/dd/d1f/d24 0 2024-09-18T12:49:06.086 INFO:tasks.workunit.client.1.smithi148.stdout:0/343: rename de/d27/d74 to de/d27/d7a 0 2024-09-18T12:49:06.087 INFO:tasks.workunit.client.1.smithi148.stdout:0/344: chown de/d14/f66 57769180 1 2024-09-18T12:49:06.087 INFO:tasks.workunit.client.1.smithi148.stdout:3/118: write d4/f29 [427555,58628] 0 2024-09-18T12:49:06.089 INFO:tasks.workunit.client.1.smithi148.stdout:3/119: write d4/f5 [3592852,64571] 0 2024-09-18T12:49:06.090 INFO:tasks.workunit.client.1.smithi148.stdout:7/120: chown db/dc 215358 1 2024-09-18T12:49:06.095 INFO:tasks.workunit.client.1.smithi148.stdout:3/120: symlink d4/d8/d13/l2a 0 2024-09-18T12:49:06.096 INFO:tasks.workunit.client.1.smithi148.stdout:7/121: dread db/dd/f1a [0,4194304] 0 2024-09-18T12:49:06.097 INFO:tasks.workunit.client.1.smithi148.stdout:5/174: rename d7/d8/dc/d12/d1f/f33 to d7/d8/f3e 0 2024-09-18T12:49:06.098 INFO:tasks.workunit.client.1.smithi148.stdout:8/173: write d8/d16/d27/f30 [3241668,105639] 0 2024-09-18T12:49:06.098 INFO:tasks.workunit.client.1.smithi148.stdout:3/121: mkdir d4/d8/d20/d2b 0 2024-09-18T12:49:06.100 INFO:tasks.workunit.client.1.smithi148.stdout:5/175: rmdir d7/d8/dc/d12/d31 39 2024-09-18T12:49:06.100 INFO:tasks.workunit.client.1.smithi148.stdout:5/176: dread - d7/d8/dc/f28 zero size 2024-09-18T12:49:06.101 INFO:tasks.workunit.client.1.smithi148.stdout:5/177: chown d7/d8/dc/d12/f34 249674 1 2024-09-18T12:49:06.101 INFO:tasks.workunit.client.1.smithi148.stdout:8/174: mkdir d8/df/d38/d39/d3b/d41 0 2024-09-18T12:49:06.102 INFO:tasks.workunit.client.1.smithi148.stdout:3/122: creat d4/d8/d20/d2b/f2c x:0 0 0 2024-09-18T12:49:06.103 INFO:tasks.workunit.client.1.smithi148.stdout:7/122: rmdir db/dc/d16/d23 0 2024-09-18T12:49:06.103 INFO:tasks.workunit.client.1.smithi148.stdout:8/175: mknod d8/d16/d27/c42 0 2024-09-18T12:49:06.104 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:05 smithi148 ceph-mon[35352]: pgmap v10: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 326 KiB/s rd, 13 MiB/s wr, 223 op/s 2024-09-18T12:49:06.104 INFO:tasks.workunit.client.1.smithi148.stdout:5/178: dread d7/d8/dc/d12/f2d [0,4194304] 0 2024-09-18T12:49:06.104 INFO:tasks.workunit.client.1.smithi148.stdout:3/123: rmdir d4/d8/d20/d2b 39 2024-09-18T12:49:06.107 INFO:tasks.workunit.client.1.smithi148.stdout:5/179: fsync d7/d8/f13 0 2024-09-18T12:49:06.107 INFO:tasks.workunit.client.1.smithi148.stdout:3/124: rmdir d4/d8/d1e 39 2024-09-18T12:49:06.110 INFO:tasks.workunit.client.1.smithi148.stdout:9/120: truncate d8/da/fc 1560334 0 2024-09-18T12:49:06.111 INFO:tasks.workunit.client.1.smithi148.stdout:5/180: mkdir d7/d8/d18/d3f 0 2024-09-18T12:49:06.112 INFO:tasks.workunit.client.0.smithi078.stdout:8/60: truncate d0/d7/f8 4403507 0 2024-09-18T12:49:06.113 INFO:tasks.workunit.client.1.smithi148.stdout:5/181: dread d7/d8/f13 [0,4194304] 0 2024-09-18T12:49:06.113 INFO:tasks.workunit.client.1.smithi148.stdout:8/176: creat d8/df/d38/d39/d3b/d41/f43 x:0 0 0 2024-09-18T12:49:06.115 INFO:tasks.workunit.client.1.smithi148.stdout:9/121: symlink d8/da/df/l24 0 2024-09-18T12:49:06.115 INFO:tasks.workunit.client.1.smithi148.stdout:8/177: truncate d8/df/d38/d39/f3d 131710 0 2024-09-18T12:49:06.116 INFO:tasks.workunit.client.1.smithi148.stdout:3/125: mkdir d4/d2d 0 2024-09-18T12:49:06.119 INFO:tasks.workunit.client.1.smithi148.stdout:5/182: rename f6 to d7/f40 0 2024-09-18T12:49:06.119 INFO:tasks.workunit.client.1.smithi148.stdout:3/126: dread d4/f11 [0,4194304] 0 2024-09-18T12:49:06.121 INFO:tasks.workunit.client.1.smithi148.stdout:0/345: dread de/d14/f26 [0,4194304] 0 2024-09-18T12:49:06.122 INFO:tasks.workunit.client.1.smithi148.stdout:8/178: unlink d8/df/c21 0 2024-09-18T12:49:06.124 INFO:tasks.workunit.client.1.smithi148.stdout:8/179: chown d8/df/d38/d39/d3b/d41/f43 43 1 2024-09-18T12:49:06.124 INFO:tasks.workunit.client.1.smithi148.stdout:1/125: sync 2024-09-18T12:49:06.125 INFO:tasks.workunit.client.1.smithi148.stdout:3/127: dwrite d4/f29 [0,4194304] 0 2024-09-18T12:49:06.126 INFO:tasks.workunit.client.1.smithi148.stdout:7/123: write db/dd/f1a [518303,23338] 0 2024-09-18T12:49:06.129 INFO:tasks.workunit.client.1.smithi148.stdout:0/346: creat de/d27/f7b x:0 0 0 2024-09-18T12:49:06.134 INFO:tasks.workunit.client.1.smithi148.stdout:8/180: write f1 [6395917,130830] 0 2024-09-18T12:49:06.136 INFO:tasks.workunit.client.1.smithi148.stdout:7/124: dwrite db/dc/f12 [0,4194304] 0 2024-09-18T12:49:06.137 INFO:tasks.workunit.client.1.smithi148.stdout:8/181: write d8/f2d [1889763,15075] 0 2024-09-18T12:49:06.139 INFO:tasks.workunit.client.1.smithi148.stdout:0/347: creat de/d14/d43/d57/d59/f7c x:0 0 0 2024-09-18T12:49:06.141 INFO:tasks.workunit.client.1.smithi148.stdout:3/128: symlink d4/d8/d20/l2e 0 2024-09-18T12:49:06.142 INFO:tasks.workunit.client.1.smithi148.stdout:3/129: fsync d4/d8/f1a 0 2024-09-18T12:49:06.144 INFO:tasks.workunit.client.1.smithi148.stdout:5/183: rmdir d7/d8/dc/d12/d1f/d3d 0 2024-09-18T12:49:06.144 INFO:tasks.workunit.client.1.smithi148.stdout:3/130: chown d4/d8/f1a 686 1 2024-09-18T12:49:06.195 INFO:tasks.workunit.client.1.smithi148.stdout:1/126: link la dc/d11/d17/d2b/l2f 0 2024-09-18T12:49:06.197 INFO:tasks.workunit.client.1.smithi148.stdout:0/348: dwrite de/f4f [0,4194304] 0 2024-09-18T12:49:06.198 INFO:tasks.workunit.client.1.smithi148.stdout:7/125: write f3 [1242277,57316] 0 2024-09-18T12:49:06.201 INFO:tasks.workunit.client.1.smithi148.stdout:7/126: fdatasync fa 0 2024-09-18T12:49:06.203 INFO:tasks.workunit.client.1.smithi148.stdout:1/127: write dc/d11/d17/f23 [685195,30741] 0 2024-09-18T12:49:06.205 INFO:tasks.workunit.client.1.smithi148.stdout:0/349: creat de/d27/d53/f7d x:0 0 0 2024-09-18T12:49:06.207 INFO:tasks.workunit.client.1.smithi148.stdout:3/131: dwrite d4/d8/f15 [0,4194304] 0 2024-09-18T12:49:06.207 INFO:tasks.workunit.client.1.smithi148.stdout:7/127: chown db/dc/df/d11 20867215 1 2024-09-18T12:49:06.209 INFO:tasks.workunit.client.1.smithi148.stdout:1/128: readlink dc/l24 0 2024-09-18T12:49:06.210 INFO:tasks.workunit.client.1.smithi148.stdout:0/350: rmdir de/d14 39 2024-09-18T12:49:06.211 INFO:tasks.workunit.client.1.smithi148.stdout:5/184: dwrite d7/d2b/f3c [0,4194304] 0 2024-09-18T12:49:06.212 INFO:tasks.workunit.client.1.smithi148.stdout:7/128: unlink f4 0 2024-09-18T12:49:06.212 INFO:tasks.workunit.client.1.smithi148.stdout:9/122: dwrite d8/da/fc [0,4194304] 0 2024-09-18T12:49:06.219 INFO:tasks.workunit.client.1.smithi148.stdout:9/123: unlink d8/da/dd/c1f 0 2024-09-18T12:49:06.219 INFO:tasks.workunit.client.1.smithi148.stdout:3/132: creat d4/d8/d20/f2f x:0 0 0 2024-09-18T12:49:06.219 INFO:tasks.workunit.client.1.smithi148.stdout:7/129: truncate db/dc/f15 312044 0 2024-09-18T12:49:06.221 INFO:tasks.workunit.client.1.smithi148.stdout:5/185: dread d7/fd [0,4194304] 0 2024-09-18T12:49:06.222 INFO:tasks.workunit.client.1.smithi148.stdout:9/124: write f0 [3854895,118024] 0 2024-09-18T12:49:06.222 INFO:tasks.workunit.client.1.smithi148.stdout:1/129: dread dc/d18/f1c [0,4194304] 0 2024-09-18T12:49:06.224 INFO:tasks.workunit.client.1.smithi148.stdout:7/130: truncate db/dc/f15 892806 0 2024-09-18T12:49:06.226 INFO:tasks.workunit.client.1.smithi148.stdout:9/125: creat d8/f25 x:0 0 0 2024-09-18T12:49:06.226 INFO:tasks.workunit.client.1.smithi148.stdout:1/130: creat dc/d11/f30 x:0 0 0 2024-09-18T12:49:06.227 INFO:tasks.workunit.client.1.smithi148.stdout:7/131: rename db/dc/d16 to db/dd/d25 0 2024-09-18T12:49:06.228 INFO:tasks.workunit.client.1.smithi148.stdout:7/132: stat db/dc/f12 0 2024-09-18T12:49:06.229 INFO:tasks.workunit.client.1.smithi148.stdout:9/126: write d8/da/fb [4517091,98518] 0 2024-09-18T12:49:06.229 INFO:tasks.workunit.client.1.smithi148.stdout:1/131: rmdir dc/d11/d17/d2b 39 2024-09-18T12:49:06.230 INFO:tasks.workunit.client.1.smithi148.stdout:7/133: stat db/dc/df/d11/f1b 0 2024-09-18T12:49:06.232 INFO:tasks.workunit.client.1.smithi148.stdout:0/351: truncate de/f1e 134442 0 2024-09-18T12:49:06.233 INFO:tasks.workunit.client.1.smithi148.stdout:1/132: mkdir dc/d18/d31 0 2024-09-18T12:49:06.234 INFO:tasks.workunit.client.1.smithi148.stdout:3/133: dwrite d4/d8/d20/d2b/f2c [0,4194304] 0 2024-09-18T12:49:06.236 INFO:tasks.workunit.client.1.smithi148.stdout:9/127: link f6 d8/f26 0 2024-09-18T12:49:06.239 INFO:tasks.workunit.client.1.smithi148.stdout:7/134: dread fa [0,4194304] 0 2024-09-18T12:49:06.240 INFO:tasks.workunit.client.1.smithi148.stdout:9/128: readlink d8/da/df/l1e 0 2024-09-18T12:49:06.242 INFO:tasks.workunit.client.1.smithi148.stdout:9/129: mkdir d8/da/df/d27 0 2024-09-18T12:49:06.243 INFO:tasks.workunit.client.1.smithi148.stdout:7/135: creat db/dd/f26 x:0 0 0 2024-09-18T12:49:06.244 INFO:tasks.workunit.client.1.smithi148.stdout:9/130: write d8/da/f1d [5177023,47730] 0 2024-09-18T12:49:06.248 INFO:tasks.workunit.client.1.smithi148.stdout:5/186: dread d7/f10 [0,4194304] 0 2024-09-18T12:49:06.249 INFO:tasks.workunit.client.1.smithi148.stdout:5/187: stat d7/d8/d18/f38 0 2024-09-18T12:49:06.253 INFO:tasks.workunit.client.1.smithi148.stdout:1/133: write dc/f13 [1731841,805] 0 2024-09-18T12:49:06.255 INFO:tasks.workunit.client.1.smithi148.stdout:4/138: sync 2024-09-18T12:49:06.256 INFO:tasks.workunit.client.1.smithi148.stdout:2/109: sync 2024-09-18T12:49:06.256 INFO:tasks.workunit.client.1.smithi148.stdout:6/178: sync 2024-09-18T12:49:06.257 INFO:tasks.workunit.client.1.smithi148.stdout:1/134: write dc/d18/f1f [912228,34810] 0 2024-09-18T12:49:06.264 INFO:tasks.workunit.client.1.smithi148.stdout:4/139: creat d15/d1d/d34/f35 x:0 0 0 2024-09-18T12:49:06.264 INFO:tasks.workunit.client.1.smithi148.stdout:5/188: dwrite d7/d8/dc/f2a [0,4194304] 0 2024-09-18T12:49:06.264 INFO:tasks.workunit.client.1.smithi148.stdout:9/131: dwrite f6 [0,4194304] 0 2024-09-18T12:49:06.264 INFO:tasks.workunit.client.1.smithi148.stdout:1/135: creat dc/d18/f32 x:0 0 0 2024-09-18T12:49:06.266 INFO:tasks.workunit.client.1.smithi148.stdout:3/134: dread d4/f5 [4194304,4194304] 0 2024-09-18T12:49:06.270 INFO:tasks.workunit.client.1.smithi148.stdout:1/136: symlink dc/d18/d31/l33 0 2024-09-18T12:49:06.271 INFO:tasks.workunit.client.1.smithi148.stdout:5/189: creat d7/d8/dc/d12/d1f/d39/f41 x:0 0 0 2024-09-18T12:49:06.272 INFO:tasks.workunit.client.1.smithi148.stdout:3/135: write d4/f5 [2888879,118828] 0 2024-09-18T12:49:06.274 INFO:tasks.workunit.client.1.smithi148.stdout:7/136: dread db/dc/df/d1d/f21 [0,4194304] 0 2024-09-18T12:49:06.278 INFO:tasks.workunit.client.1.smithi148.stdout:6/179: dwrite d5/ff [0,4194304] 0 2024-09-18T12:49:06.278 INFO:tasks.workunit.client.1.smithi148.stdout:5/190: read - d7/d8/dc/d12/d1f/d39/f41 zero size 2024-09-18T12:49:06.278 INFO:tasks.workunit.client.1.smithi148.stdout:1/137: dread dc/d11/f12 [0,4194304] 0 2024-09-18T12:49:06.279 INFO:tasks.workunit.client.1.smithi148.stdout:9/132: dread d8/da/fc [0,4194304] 0 2024-09-18T12:49:06.281 INFO:tasks.workunit.client.1.smithi148.stdout:9/133: stat d8/f10 0 2024-09-18T12:49:06.281 INFO:tasks.workunit.client.1.smithi148.stdout:6/180: truncate d5/d32/f3b 970106 0 2024-09-18T12:49:06.283 INFO:tasks.workunit.client.1.smithi148.stdout:1/138: symlink dc/d18/d31/l34 0 2024-09-18T12:49:06.285 INFO:tasks.workunit.client.1.smithi148.stdout:6/181: symlink d5/d32/l40 0 2024-09-18T12:49:06.285 INFO:tasks.workunit.client.1.smithi148.stdout:1/139: write fb [1824955,59874] 0 2024-09-18T12:49:06.287 INFO:tasks.workunit.client.1.smithi148.stdout:3/136: write d4/f18 [872016,100336] 0 2024-09-18T12:49:06.289 INFO:tasks.workunit.client.1.smithi148.stdout:9/134: getdents d8/da/df/d27 0 2024-09-18T12:49:06.289 INFO:tasks.workunit.client.1.smithi148.stdout:6/182: write d5/d1a/f21 [3474891,5938] 0 2024-09-18T12:49:06.292 INFO:tasks.workunit.client.1.smithi148.stdout:6/183: rmdir d5 39 2024-09-18T12:49:06.292 INFO:tasks.workunit.client.1.smithi148.stdout:4/140: dread f2 [0,4194304] 0 2024-09-18T12:49:06.293 INFO:tasks.workunit.client.1.smithi148.stdout:3/137: dread - d4/d8/d1e/f25 zero size 2024-09-18T12:49:06.293 INFO:tasks.workunit.client.1.smithi148.stdout:1/140: truncate dc/d11/d17/d2b/f2e 52026 0 2024-09-18T12:49:06.295 INFO:tasks.workunit.client.1.smithi148.stdout:1/141: write dc/d18/f1f [343686,16733] 0 2024-09-18T12:49:06.296 INFO:tasks.workunit.client.1.smithi148.stdout:6/184: mkdir d5/d32/d38/d41 0 2024-09-18T12:49:06.312 INFO:tasks.workunit.client.0.smithi078.stdout:0/221: sync 2024-09-18T12:49:06.312 INFO:tasks.workunit.client.0.smithi078.stdout:1/104: sync 2024-09-18T12:49:06.312 INFO:tasks.workunit.client.0.smithi078.stdout:5/193: sync 2024-09-18T12:49:06.313 INFO:tasks.workunit.client.0.smithi078.stdout:0/222: read - d3/f3f zero size 2024-09-18T12:49:06.313 INFO:tasks.workunit.client.0.smithi078.stdout:1/105: write d0/f19 [211476,80904] 0 2024-09-18T12:49:06.314 INFO:tasks.workunit.client.0.smithi078.stdout:5/194: dread - d2/d4/d9/da/f19 zero size 2024-09-18T12:49:06.315 INFO:tasks.workunit.client.0.smithi078.stdout:0/223: truncate d3/d1f/d29/f48 4491526 0 2024-09-18T12:49:06.315 INFO:tasks.workunit.client.0.smithi078.stdout:1/106: fsync d0/d8/ff 0 2024-09-18T12:49:06.316 INFO:tasks.workunit.client.0.smithi078.stdout:0/224: rmdir d3/d1f/d2e 39 2024-09-18T12:49:06.318 INFO:tasks.workunit.client.0.smithi078.stdout:1/107: mkdir d0/d21 0 2024-09-18T12:49:06.319 INFO:tasks.workunit.client.0.smithi078.stdout:0/225: fdatasync d3/d1f/d25/f44 0 2024-09-18T12:49:06.319 INFO:tasks.workunit.client.0.smithi078.stdout:1/108: dread - d0/d8/da/f1f zero size 2024-09-18T12:49:06.321 INFO:tasks.workunit.client.0.smithi078.stdout:5/195: rename d2/d4/d12/d16/f1f to d2/d4/d12/f40 0 2024-09-18T12:49:06.324 INFO:tasks.workunit.client.0.smithi078.stdout:1/109: dwrite d0/d8/da/f17 [0,4194304] 0 2024-09-18T12:49:06.329 INFO:tasks.workunit.client.0.smithi078.stdout:5/196: write d2/d4/f1d [2848514,97126] 0 2024-09-18T12:49:06.329 INFO:tasks.workunit.client.0.smithi078.stdout:1/110: write d0/fc [115722,40426] 0 2024-09-18T12:49:06.332 INFO:tasks.workunit.client.0.smithi078.stdout:5/197: creat d2/d4/d12/d16/d36/f41 x:0 0 0 2024-09-18T12:49:06.334 INFO:tasks.workunit.client.0.smithi078.stdout:5/198: write d2/d4/d9/f1c [1670537,51828] 0 2024-09-18T12:49:06.337 INFO:tasks.workunit.client.0.smithi078.stdout:5/199: creat d2/d4/d12/d2d/f42 x:0 0 0 2024-09-18T12:49:06.339 INFO:tasks.workunit.client.0.smithi078.stdout:5/200: symlink d2/d4/d9/l43 0 2024-09-18T12:49:06.340 INFO:tasks.workunit.client.0.smithi078.stdout:5/201: symlink d2/d4/d9/da/d2b/l44 0 2024-09-18T12:49:06.341 INFO:tasks.workunit.client.0.smithi078.stdout:5/202: truncate d2/d4/d12/d2d/f3a 645443 0 2024-09-18T12:49:06.343 INFO:tasks.workunit.client.0.smithi078.stdout:5/203: write d2/d4/d9/f13 [987835,73914] 0 2024-09-18T12:49:06.344 INFO:tasks.workunit.client.0.smithi078.stdout:5/204: read d2/d4/d12/d2d/f3a [222113,76540] 0 2024-09-18T12:49:06.344 INFO:tasks.workunit.client.1.smithi148.stdout:1/142: write dc/d18/f1f [286044,29043] 0 2024-09-18T12:49:06.345 INFO:tasks.workunit.client.1.smithi148.stdout:6/185: truncate d5/f2e 586528 0 2024-09-18T12:49:06.346 INFO:tasks.workunit.client.1.smithi148.stdout:9/135: dwrite f6 [0,4194304] 0 2024-09-18T12:49:06.349 INFO:tasks.workunit.client.0.smithi078.stdout:5/205: getdents d2/d4/d9/da/d2b 0 2024-09-18T12:49:06.351 INFO:tasks.workunit.client.1.smithi148.stdout:4/141: dwrite d15/d17/f1c [0,4194304] 0 2024-09-18T12:49:06.351 INFO:tasks.workunit.client.1.smithi148.stdout:6/186: unlink d5/d1a/dc/l27 0 2024-09-18T12:49:06.351 INFO:tasks.workunit.client.1.smithi148.stdout:9/136: write d8/da/dd/f14 [760681,74354] 0 2024-09-18T12:49:06.351 INFO:tasks.workunit.client.1.smithi148.stdout:5/191: dwrite d7/f1b [0,4194304] 0 2024-09-18T12:49:06.352 INFO:tasks.workunit.client.0.smithi078.stdout:5/206: mkdir d2/d4/d9/da/d2b/d45 0 2024-09-18T12:49:06.353 INFO:tasks.workunit.client.1.smithi148.stdout:6/187: truncate d5/f2e 1037875 0 2024-09-18T12:49:06.353 INFO:tasks.workunit.client.1.smithi148.stdout:5/192: stat d7/d8/dc/d12/d1f/d39 0 2024-09-18T12:49:06.356 INFO:tasks.workunit.client.1.smithi148.stdout:5/193: dread d7/fd [0,4194304] 0 2024-09-18T12:49:06.357 INFO:tasks.workunit.client.1.smithi148.stdout:5/194: dread - d7/d8/dc/f28 zero size 2024-09-18T12:49:06.358 INFO:tasks.workunit.client.1.smithi148.stdout:4/142: creat d15/d17/f36 x:0 0 0 2024-09-18T12:49:06.359 INFO:tasks.workunit.client.1.smithi148.stdout:5/195: read d7/d8/f13 [64393,19975] 0 2024-09-18T12:49:06.360 INFO:tasks.workunit.client.1.smithi148.stdout:6/188: dread d5/ff [0,4194304] 0 2024-09-18T12:49:06.366 INFO:tasks.workunit.client.1.smithi148.stdout:6/189: dread d5/d1a/f22 [0,4194304] 0 2024-09-18T12:49:06.367 INFO:tasks.workunit.client.1.smithi148.stdout:5/196: rename d7/d8/dc/d12/d31/l37 to d7/d8/dc/d12/d1f/l42 0 2024-09-18T12:49:06.369 INFO:tasks.workunit.client.1.smithi148.stdout:1/143: truncate dc/f13 646343 0 2024-09-18T12:49:06.370 INFO:tasks.workunit.client.1.smithi148.stdout:5/197: rename d7/d8/dc/d12/f2d to d7/d8/dc/d22/f43 0 2024-09-18T12:49:06.372 INFO:tasks.workunit.client.1.smithi148.stdout:4/143: write d15/d1d/f33 [973606,116324] 0 2024-09-18T12:49:06.373 INFO:tasks.workunit.client.1.smithi148.stdout:5/198: truncate d7/fd 907428 0 2024-09-18T12:49:06.373 INFO:tasks.workunit.client.1.smithi148.stdout:6/190: link d5/d1a/l24 d5/d1a/dc/d2b/d35/l42 0 2024-09-18T12:49:06.375 INFO:tasks.workunit.client.1.smithi148.stdout:1/144: creat dc/d11/d17/f35 x:0 0 0 2024-09-18T12:49:06.375 INFO:tasks.workunit.client.1.smithi148.stdout:4/144: mknod d15/c37 0 2024-09-18T12:49:06.376 INFO:tasks.workunit.client.1.smithi148.stdout:1/145: write dc/d18/f1c [2812291,86599] 0 2024-09-18T12:49:06.377 INFO:tasks.workunit.client.1.smithi148.stdout:4/145: write d15/d17/f36 [637558,131061] 0 2024-09-18T12:49:06.379 INFO:tasks.workunit.client.1.smithi148.stdout:5/199: dread d7/d8/dc/f2a [0,4194304] 0 2024-09-18T12:49:06.379 INFO:tasks.workunit.client.1.smithi148.stdout:4/146: rmdir d15/d17 39 2024-09-18T12:49:06.379 INFO:tasks.workunit.client.1.smithi148.stdout:6/191: link d5/c3f d5/d32/d38/c43 0 2024-09-18T12:49:06.381 INFO:tasks.workunit.client.1.smithi148.stdout:7/137: sync 2024-09-18T12:49:06.381 INFO:tasks.workunit.client.1.smithi148.stdout:2/110: sync 2024-09-18T12:49:06.381 INFO:tasks.workunit.client.1.smithi148.stdout:8/182: sync 2024-09-18T12:49:06.382 INFO:tasks.workunit.client.1.smithi148.stdout:0/352: sync 2024-09-18T12:49:06.382 INFO:tasks.workunit.client.1.smithi148.stdout:6/192: rename c2 to d5/d32/d38/d41/c44 0 2024-09-18T12:49:06.384 INFO:tasks.workunit.client.1.smithi148.stdout:1/146: dread dc/d11/f16 [0,4194304] 0 2024-09-18T12:49:06.384 INFO:tasks.workunit.client.1.smithi148.stdout:8/183: chown d8/l18 11047608 1 2024-09-18T12:49:06.385 INFO:tasks.workunit.client.1.smithi148.stdout:7/138: stat db/dc/df/c14 0 2024-09-18T12:49:06.385 INFO:tasks.workunit.client.1.smithi148.stdout:5/200: rename d7/l17 to d7/d8/dc/d12/d1f/d39/l44 0 2024-09-18T12:49:06.387 INFO:tasks.workunit.client.1.smithi148.stdout:6/193: write d5/d1a/f21 [5443910,100003] 0 2024-09-18T12:49:06.389 INFO:tasks.workunit.client.1.smithi148.stdout:8/184: symlink d8/df/l44 0 2024-09-18T12:49:06.389 INFO:tasks.workunit.client.0.smithi078.stdout:6/178: sync 2024-09-18T12:49:06.389 INFO:tasks.workunit.client.0.smithi078.stdout:4/58: sync 2024-09-18T12:49:06.390 INFO:tasks.workunit.client.1.smithi148.stdout:1/147: write dc/d11/d17/f21 [38886,70368] 0 2024-09-18T12:49:06.392 INFO:tasks.workunit.client.1.smithi148.stdout:6/194: read d5/f23 [1637606,105622] 0 2024-09-18T12:49:06.393 INFO:tasks.workunit.client.1.smithi148.stdout:2/111: dread f5 [0,4194304] 0 2024-09-18T12:49:06.395 INFO:tasks.workunit.client.0.smithi078.stdout:6/179: dwrite f3 [0,4194304] 0 2024-09-18T12:49:06.395 INFO:tasks.workunit.client.1.smithi148.stdout:2/112: read d9/fe [1582347,120626] 0 2024-09-18T12:49:06.395 INFO:tasks.workunit.client.1.smithi148.stdout:0/353: rename de/f13 to de/d14/d43/f7e 0 2024-09-18T12:49:06.395 INFO:tasks.workunit.client.0.smithi078.stdout:6/180: chown l5 3051 1 2024-09-18T12:49:06.396 INFO:tasks.workunit.client.1.smithi148.stdout:2/113: chown d9/l12 422 1 2024-09-18T12:49:06.397 INFO:tasks.workunit.client.1.smithi148.stdout:7/139: dwrite db/dc/df/d11/f1b [0,4194304] 0 2024-09-18T12:49:06.398 INFO:tasks.workunit.client.0.smithi078.stdout:6/181: mknod d10/d27/c2e 0 2024-09-18T12:49:06.399 INFO:tasks.workunit.client.0.smithi078.stdout:6/182: dread - d10/f1b zero size 2024-09-18T12:49:06.399 INFO:tasks.workunit.client.1.smithi148.stdout:1/148: mknod dc/d18/c36 0 2024-09-18T12:49:06.402 INFO:tasks.workunit.client.1.smithi148.stdout:6/195: write d5/f23 [357062,75259] 0 2024-09-18T12:49:06.406 INFO:tasks.workunit.client.1.smithi148.stdout:0/354: rename de/d27/d38 to de/d14/d43/d70/d7f 0 2024-09-18T12:49:06.409 INFO:tasks.workunit.client.1.smithi148.stdout:7/140: dwrite db/dc/f12 [0,4194304] 0 2024-09-18T12:49:06.409 INFO:tasks.workunit.client.1.smithi148.stdout:5/201: link d7/f15 d7/d8/dc/d12/f45 0 2024-09-18T12:49:06.411 INFO:tasks.workunit.client.1.smithi148.stdout:4/147: dwrite d15/d1d/f26 [0,4194304] 0 2024-09-18T12:49:06.411 INFO:tasks.workunit.client.1.smithi148.stdout:7/141: read - db/dd/f26 zero size 2024-09-18T12:49:06.415 INFO:tasks.workunit.client.1.smithi148.stdout:0/355: symlink de/d27/d7a/l80 0 2024-09-18T12:49:06.416 INFO:tasks.workunit.client.1.smithi148.stdout:8/185: truncate f1 2826832 0 2024-09-18T12:49:06.420 INFO:tasks.workunit.client.1.smithi148.stdout:2/114: getdents d9 0 2024-09-18T12:49:06.421 INFO:tasks.workunit.client.1.smithi148.stdout:8/186: chown d8/df/d38/d39/f3d 16789 1 2024-09-18T12:49:06.422 INFO:tasks.workunit.client.1.smithi148.stdout:1/149: dwrite f8 [4194304,4194304] 0 2024-09-18T12:49:06.425 INFO:tasks.workunit.client.1.smithi148.stdout:8/187: dread - d8/df/d38/d39/f40 zero size 2024-09-18T12:49:06.425 INFO:tasks.workunit.client.1.smithi148.stdout:1/150: readlink dc/d11/d17/l1d 0 2024-09-18T12:49:06.425 INFO:tasks.workunit.client.1.smithi148.stdout:7/142: dread fa [0,4194304] 0 2024-09-18T12:49:06.426 INFO:tasks.workunit.client.1.smithi148.stdout:0/356: getdents de/d14/d43 0 2024-09-18T12:49:06.428 INFO:tasks.workunit.client.1.smithi148.stdout:7/143: mknod db/dd/d1f/c27 0 2024-09-18T12:49:06.435 INFO:tasks.workunit.client.1.smithi148.stdout:1/151: dwrite dc/d18/f1c [0,4194304] 0 2024-09-18T12:49:06.435 INFO:tasks.workunit.client.1.smithi148.stdout:8/188: dwrite d8/d12/f1b [0,4194304] 0 2024-09-18T12:49:06.436 INFO:tasks.workunit.client.1.smithi148.stdout:1/152: chown dc/d11/d17/d2b 89013096 1 2024-09-18T12:49:06.437 INFO:tasks.workunit.client.1.smithi148.stdout:1/153: write dc/d11/f15 [172998,58997] 0 2024-09-18T12:49:06.437 INFO:tasks.workunit.client.1.smithi148.stdout:4/148: read fe [1328002,14969] 0 2024-09-18T12:49:06.438 INFO:tasks.workunit.client.0.smithi078.stdout:6/183: dwrite d10/f14 [4194304,4194304] 0 2024-09-18T12:49:06.439 INFO:tasks.workunit.client.1.smithi148.stdout:0/357: creat de/d14/f81 x:0 0 0 2024-09-18T12:49:06.443 INFO:tasks.workunit.client.0.smithi078.stdout:6/184: unlink l7 0 2024-09-18T12:49:06.444 INFO:tasks.workunit.client.0.smithi078.stdout:6/185: fsync d10/f21 0 2024-09-18T12:49:06.445 INFO:tasks.workunit.client.1.smithi148.stdout:0/358: chown de/d14/d43/d70/d7f/c6c 21835566 1 2024-09-18T12:49:06.446 INFO:tasks.workunit.client.1.smithi148.stdout:1/154: symlink dc/d11/d17/l37 0 2024-09-18T12:49:06.450 INFO:tasks.workunit.client.1.smithi148.stdout:0/359: unlink de/d27/d53/f7d 0 2024-09-18T12:49:06.451 INFO:tasks.workunit.client.1.smithi148.stdout:0/360: chown de/f77 2612 1 2024-09-18T12:49:06.453 INFO:tasks.workunit.client.1.smithi148.stdout:4/149: dread d15/d17/d1f/f21 [0,4194304] 0 2024-09-18T12:49:06.455 INFO:tasks.workunit.client.1.smithi148.stdout:8/189: getdents d8/d12 0 2024-09-18T12:49:06.455 INFO:tasks.workunit.client.1.smithi148.stdout:1/155: rmdir dc/d11/d17 39 2024-09-18T12:49:06.460 INFO:tasks.workunit.client.1.smithi148.stdout:0/361: dread - de/d27/d2e/f73 zero size 2024-09-18T12:49:06.460 INFO:tasks.workunit.client.1.smithi148.stdout:6/196: truncate d5/f1b 4439316 0 2024-09-18T12:49:06.461 INFO:tasks.workunit.client.1.smithi148.stdout:2/115: write d9/f21 [1077686,110860] 0 2024-09-18T12:49:06.462 INFO:tasks.workunit.client.1.smithi148.stdout:1/156: mkdir dc/d11/d38 0 2024-09-18T12:49:06.463 INFO:tasks.workunit.client.1.smithi148.stdout:1/157: truncate dc/fd 793999 0 2024-09-18T12:49:06.464 INFO:tasks.workunit.client.1.smithi148.stdout:0/362: rename de/f1d to de/d14/d43/d70/f82 0 2024-09-18T12:49:06.464 INFO:tasks.workunit.client.1.smithi148.stdout:4/150: link c4 d15/d17/d1f/c38 0 2024-09-18T12:49:06.465 INFO:tasks.workunit.client.1.smithi148.stdout:2/116: symlink d9/d17/l23 0 2024-09-18T12:49:06.466 INFO:tasks.workunit.client.1.smithi148.stdout:8/190: getdents d8/df/d38 0 2024-09-18T12:49:06.467 INFO:tasks.workunit.client.1.smithi148.stdout:4/151: symlink d15/d17/d1f/l39 0 2024-09-18T12:49:06.468 INFO:tasks.workunit.client.1.smithi148.stdout:2/117: mkdir d9/d24 0 2024-09-18T12:49:06.469 INFO:tasks.workunit.client.1.smithi148.stdout:6/197: link d5/d1a/d3d/c3c d5/d32/d38/d41/c45 0 2024-09-18T12:49:06.470 INFO:tasks.workunit.client.1.smithi148.stdout:2/118: stat d9/f21 0 2024-09-18T12:49:06.471 INFO:tasks.workunit.client.1.smithi148.stdout:2/119: chown d9/d24 27043 1 2024-09-18T12:49:06.471 INFO:tasks.workunit.client.1.smithi148.stdout:7/144: truncate db/dc/df/d11/f1b 56498 0 2024-09-18T12:49:06.472 INFO:tasks.workunit.client.1.smithi148.stdout:0/363: rename de/d14/d43/f4d to de/d14/f83 0 2024-09-18T12:49:06.475 INFO:tasks.workunit.client.1.smithi148.stdout:1/158: dwrite dc/d11/f16 [0,4194304] 0 2024-09-18T12:49:06.475 INFO:tasks.workunit.client.1.smithi148.stdout:7/145: write db/dc/f12 [3659856,44249] 0 2024-09-18T12:49:06.476 INFO:tasks.workunit.client.0.smithi078.stdout:6/186: write ff [1359144,123599] 0 2024-09-18T12:49:06.477 INFO:tasks.workunit.client.1.smithi148.stdout:7/146: chown db 784 1 2024-09-18T12:49:06.480 INFO:tasks.workunit.client.1.smithi148.stdout:8/191: dwrite d8/df/f10 [0,4194304] 0 2024-09-18T12:49:06.482 INFO:tasks.workunit.client.1.smithi148.stdout:3/138: sync 2024-09-18T12:49:06.484 INFO:tasks.workunit.client.0.smithi078.stdout:6/187: dwrite ff [0,4194304] 0 2024-09-18T12:49:06.485 INFO:tasks.workunit.client.1.smithi148.stdout:3/139: read d4/f5 [6337849,6506] 0 2024-09-18T12:49:06.485 INFO:tasks.workunit.client.1.smithi148.stdout:2/120: creat d9/d24/f25 x:0 0 0 2024-09-18T12:49:06.486 INFO:tasks.workunit.client.1.smithi148.stdout:0/364: dwrite de/d14/f25 [0,4194304] 0 2024-09-18T12:49:06.489 INFO:tasks.workunit.client.0.smithi078.stdout:6/188: dread d10/f1e [4194304,4194304] 0 2024-09-18T12:49:06.491 INFO:tasks.workunit.client.0.smithi078.stdout:6/189: write fb [2487129,75608] 0 2024-09-18T12:49:06.492 INFO:tasks.workunit.client.1.smithi148.stdout:1/159: dread dc/d11/d17/f23 [0,4194304] 0 2024-09-18T12:49:06.494 INFO:tasks.workunit.client.1.smithi148.stdout:7/147: dread db/dc/df/d11/f1b [0,4194304] 0 2024-09-18T12:49:06.496 INFO:tasks.workunit.client.1.smithi148.stdout:8/192: symlink d8/df/d38/d39/d3b/l45 0 2024-09-18T12:49:06.497 INFO:tasks.workunit.client.1.smithi148.stdout:8/193: chown d8/lc 0 1 2024-09-18T12:49:06.497 INFO:tasks.workunit.client.1.smithi148.stdout:3/140: dwrite d4/d8/f15 [4194304,4194304] 0 2024-09-18T12:49:06.499 INFO:tasks.workunit.client.1.smithi148.stdout:2/121: creat d9/f26 x:0 0 0 2024-09-18T12:49:06.500 INFO:tasks.workunit.client.1.smithi148.stdout:6/198: write d5/f1b [3662716,39589] 0 2024-09-18T12:49:06.500 INFO:tasks.workunit.client.1.smithi148.stdout:8/194: dread - d8/d16/f34 zero size 2024-09-18T12:49:06.502 INFO:tasks.workunit.client.0.smithi078.stdout:6/190: creat d10/d2b/f2f x:0 0 0 2024-09-18T12:49:06.502 INFO:tasks.workunit.client.0.smithi078.stdout:6/191: readlink d10/l11 0 2024-09-18T12:49:06.502 INFO:tasks.workunit.client.1.smithi148.stdout:8/195: dread - d8/d16/f34 zero size 2024-09-18T12:49:06.504 INFO:tasks.workunit.client.1.smithi148.stdout:9/137: sync 2024-09-18T12:49:06.505 INFO:tasks.workunit.client.0.smithi078.stdout:6/192: rename d10/f22 to d10/f30 0 2024-09-18T12:49:06.505 INFO:tasks.workunit.client.1.smithi148.stdout:0/365: creat de/d27/d7a/f84 x:0 0 0 2024-09-18T12:49:06.506 INFO:tasks.workunit.client.1.smithi148.stdout:4/152: truncate d15/d17/f27 2102748 0 2024-09-18T12:49:06.506 INFO:tasks.workunit.client.1.smithi148.stdout:1/160: unlink dc/d18/f32 0 2024-09-18T12:49:06.507 INFO:tasks.workunit.client.1.smithi148.stdout:9/138: stat d8/da/fb 0 2024-09-18T12:49:06.508 INFO:tasks.workunit.client.1.smithi148.stdout:3/141: rmdir d4 39 2024-09-18T12:49:06.509 INFO:tasks.workunit.client.0.smithi078.stdout:6/193: mknod d10/c31 0 2024-09-18T12:49:06.511 INFO:tasks.workunit.client.1.smithi148.stdout:2/122: mkdir d9/d24/d27 0 2024-09-18T12:49:06.511 INFO:tasks.workunit.client.0.smithi078.stdout:6/194: symlink d10/l32 0 2024-09-18T12:49:06.512 INFO:tasks.workunit.client.1.smithi148.stdout:4/153: read fa [3344900,83353] 0 2024-09-18T12:49:06.512 INFO:tasks.workunit.client.1.smithi148.stdout:8/196: dwrite d8/df/f10 [0,4194304] 0 2024-09-18T12:49:06.512 INFO:tasks.workunit.client.1.smithi148.stdout:6/199: symlink d5/d1a/d29/l46 0 2024-09-18T12:49:06.512 INFO:tasks.workunit.client.1.smithi148.stdout:7/148: dwrite db/dd/f1a [0,4194304] 0 2024-09-18T12:49:06.516 INFO:tasks.workunit.client.0.smithi078.stdout:6/195: truncate d10/d2b/f2f 1027792 0 2024-09-18T12:49:06.516 INFO:tasks.workunit.client.0.smithi078.stdout:6/196: readlink l5 0 2024-09-18T12:49:06.517 INFO:tasks.workunit.client.1.smithi148.stdout:7/149: dread - db/dd/f26 zero size 2024-09-18T12:49:06.517 INFO:tasks.workunit.client.1.smithi148.stdout:8/197: chown d8/df/d38/d39/d3b/d41 0 1 2024-09-18T12:49:06.517 INFO:tasks.workunit.client.0.smithi078.stdout:6/197: symlink d10/d27/l33 0 2024-09-18T12:49:06.518 INFO:tasks.workunit.client.1.smithi148.stdout:1/161: mkdir dc/d18/d31/d39 0 2024-09-18T12:49:06.518 INFO:tasks.workunit.client.1.smithi148.stdout:3/142: stat d4/d8/f1a 0 2024-09-18T12:49:06.520 INFO:tasks.workunit.client.0.smithi078.stdout:6/198: write d10/f1e [3441737,22168] 0 2024-09-18T12:49:06.522 INFO:tasks.workunit.client.1.smithi148.stdout:9/139: symlink d8/da/l28 0 2024-09-18T12:49:06.522 INFO:tasks.workunit.client.1.smithi148.stdout:2/123: creat d9/d24/f28 x:0 0 0 2024-09-18T12:49:06.523 INFO:tasks.workunit.client.1.smithi148.stdout:1/162: write dc/f25 [4973754,56473] 0 2024-09-18T12:49:06.523 INFO:tasks.workunit.client.1.smithi148.stdout:7/150: creat db/dc/f28 x:0 0 0 2024-09-18T12:49:06.523 INFO:tasks.workunit.client.0.smithi078.stdout:6/199: symlink d10/l34 0 2024-09-18T12:49:06.523 INFO:tasks.workunit.client.1.smithi148.stdout:7/151: chown db/dd/f26 4320270 1 2024-09-18T12:49:06.524 INFO:tasks.workunit.client.1.smithi148.stdout:8/198: mkdir d8/d12/d46 0 2024-09-18T12:49:06.524 INFO:tasks.workunit.client.1.smithi148.stdout:7/152: readlink db/dc/df/l17 0 2024-09-18T12:49:06.526 INFO:tasks.workunit.client.1.smithi148.stdout:2/124: mkdir d9/d17/d29 0 2024-09-18T12:49:06.526 INFO:tasks.workunit.client.1.smithi148.stdout:1/163: dread dc/fd [0,4194304] 0 2024-09-18T12:49:06.527 INFO:tasks.workunit.client.1.smithi148.stdout:2/125: dread - d9/fd zero size 2024-09-18T12:49:06.529 INFO:tasks.workunit.client.0.smithi078.stdout:6/200: dwrite d10/f1e [0,4194304] 0 2024-09-18T12:49:06.531 INFO:tasks.workunit.client.0.smithi078.stdout:6/201: symlink d10/d2b/l35 0 2024-09-18T12:49:06.532 INFO:tasks.workunit.client.0.smithi078.stdout:6/202: fdatasync d10/f25 0 2024-09-18T12:49:06.533 INFO:tasks.workunit.client.0.smithi078.stdout:6/203: write d10/d27/f2d [534949,56563] 0 2024-09-18T12:49:06.536 INFO:tasks.workunit.client.0.smithi078.stdout:6/204: symlink d10/d27/l36 0 2024-09-18T12:49:06.543 INFO:tasks.workunit.client.0.smithi078.stdout:6/205: dwrite d10/d27/f28 [0,4194304] 0 2024-09-18T12:49:06.550 INFO:tasks.workunit.client.1.smithi148.stdout:3/143: mknod d4/d2d/c30 0 2024-09-18T12:49:06.550 INFO:tasks.workunit.client.1.smithi148.stdout:2/126: stat d9/d17/c1d 0 2024-09-18T12:49:06.551 INFO:tasks.workunit.client.1.smithi148.stdout:7/153: creat db/dc/df/f29 x:0 0 0 2024-09-18T12:49:06.551 INFO:tasks.workunit.client.1.smithi148.stdout:4/154: creat d15/f3a x:0 0 0 2024-09-18T12:49:06.553 INFO:tasks.workunit.client.1.smithi148.stdout:7/154: dread - db/dc/df/f29 zero size 2024-09-18T12:49:06.553 INFO:tasks.workunit.client.1.smithi148.stdout:1/164: symlink dc/d11/d17/d2b/l3a 0 2024-09-18T12:49:06.554 INFO:tasks.workunit.client.1.smithi148.stdout:7/155: rename db to db/dd/d25/d2a 22 2024-09-18T12:49:06.555 INFO:tasks.workunit.client.1.smithi148.stdout:4/155: mknod d15/d1d/c3b 0 2024-09-18T12:49:06.555 INFO:tasks.workunit.client.1.smithi148.stdout:2/127: write f5 [930620,87106] 0 2024-09-18T12:49:06.555 INFO:tasks.workunit.client.1.smithi148.stdout:0/366: dread de/d14/d43/d70/d7f/f51 [0,4194304] 0 2024-09-18T12:49:06.557 INFO:tasks.workunit.client.1.smithi148.stdout:4/156: fdatasync d15/f28 0 2024-09-18T12:49:06.559 INFO:tasks.workunit.client.1.smithi148.stdout:2/128: creat d9/d17/f2a x:0 0 0 2024-09-18T12:49:06.560 INFO:tasks.workunit.client.0.smithi078.stdout:6/206: getdents d10/d2b 0 2024-09-18T12:49:06.560 INFO:tasks.workunit.client.1.smithi148.stdout:8/199: link f1 d8/d16/d27/f47 0 2024-09-18T12:49:06.561 INFO:tasks.workunit.client.1.smithi148.stdout:7/156: rmdir db/dc/df/d11 39 2024-09-18T12:49:06.561 INFO:tasks.workunit.client.1.smithi148.stdout:2/129: chown d9/l10 67223 1 2024-09-18T12:49:06.562 INFO:tasks.workunit.client.1.smithi148.stdout:2/130: readlink d9/l11 0 2024-09-18T12:49:06.562 INFO:tasks.workunit.client.1.smithi148.stdout:0/367: write de/d14/d43/d70/f82 [3869566,58303] 0 2024-09-18T12:49:06.562 INFO:tasks.workunit.client.0.smithi078.stdout:6/207: dread d10/d2b/f2f [0,4194304] 0 2024-09-18T12:49:06.562 INFO:tasks.workunit.client.0.smithi078.stdout:6/208: chown d10 3 1 2024-09-18T12:49:06.563 INFO:tasks.workunit.client.0.smithi078.stdout:6/209: readlink d10/d27/l36 0 2024-09-18T12:49:06.563 INFO:tasks.workunit.client.0.smithi078.stdout:6/210: stat d10/l11 0 2024-09-18T12:49:06.564 INFO:tasks.workunit.client.1.smithi148.stdout:4/157: creat d15/d1d/f3c x:0 0 0 2024-09-18T12:49:06.565 INFO:tasks.workunit.client.1.smithi148.stdout:3/144: dread f2 [0,4194304] 0 2024-09-18T12:49:06.565 INFO:tasks.workunit.client.1.smithi148.stdout:3/145: chown d4 6250 1 2024-09-18T12:49:06.566 INFO:tasks.workunit.client.0.smithi078.stdout:6/211: mkdir d10/d2b/d37 0 2024-09-18T12:49:06.566 INFO:tasks.workunit.client.1.smithi148.stdout:7/157: dread fa [0,4194304] 0 2024-09-18T12:49:06.566 INFO:tasks.workunit.client.1.smithi148.stdout:6/200: dread d5/f23 [0,4194304] 0 2024-09-18T12:49:06.567 INFO:tasks.workunit.client.1.smithi148.stdout:7/158: chown db/dc 8913227 1 2024-09-18T12:49:06.569 INFO:tasks.workunit.client.0.smithi078.stdout:6/212: dread d10/f1e [4194304,4194304] 0 2024-09-18T12:49:06.569 INFO:tasks.workunit.client.1.smithi148.stdout:0/368: mknod de/d27/d2e/c85 0 2024-09-18T12:49:06.570 INFO:tasks.workunit.client.1.smithi148.stdout:6/201: dread d5/fa [4194304,4194304] 0 2024-09-18T12:49:06.570 INFO:tasks.workunit.client.0.smithi078.stdout:6/213: truncate d10/f24 174980 0 2024-09-18T12:49:06.570 INFO:tasks.workunit.client.1.smithi148.stdout:4/158: creat d15/d1d/f3d x:0 0 0 2024-09-18T12:49:06.571 INFO:tasks.workunit.client.1.smithi148.stdout:6/202: fdatasync f3 0 2024-09-18T12:49:06.571 INFO:tasks.workunit.client.1.smithi148.stdout:3/146: fdatasync d4/d8/f1a 0 2024-09-18T12:49:06.573 INFO:tasks.workunit.client.0.smithi078.stdout:6/214: dread d10/d27/f2d [0,4194304] 0 2024-09-18T12:49:06.574 INFO:tasks.workunit.client.1.smithi148.stdout:7/159: mknod db/dd/d1f/c2b 0 2024-09-18T12:49:06.574 INFO:tasks.workunit.client.1.smithi148.stdout:1/165: dwrite dc/d11/f12 [0,4194304] 0 2024-09-18T12:49:06.574 INFO:tasks.workunit.client.1.smithi148.stdout:6/203: chown d5/f23 2918 1 2024-09-18T12:49:06.575 INFO:tasks.workunit.client.1.smithi148.stdout:4/159: dread d15/d1d/f29 [0,4194304] 0 2024-09-18T12:49:06.576 INFO:tasks.workunit.client.1.smithi148.stdout:3/147: dread d4/d8/f24 [0,4194304] 0 2024-09-18T12:49:06.577 INFO:tasks.workunit.client.1.smithi148.stdout:8/200: link d8/d16/c1d d8/d12/d46/c48 0 2024-09-18T12:49:06.580 INFO:tasks.workunit.client.1.smithi148.stdout:7/160: chown db/dc/df/d11 16353114 1 2024-09-18T12:49:06.582 INFO:tasks.workunit.client.1.smithi148.stdout:7/161: fsync db/dc/f12 0 2024-09-18T12:49:06.582 INFO:tasks.workunit.client.1.smithi148.stdout:2/131: truncate f8 1193370 0 2024-09-18T12:49:06.583 INFO:tasks.workunit.client.0.smithi078.stdout:6/215: getdents d10/d2b 0 2024-09-18T12:49:06.584 INFO:tasks.workunit.client.1.smithi148.stdout:6/204: creat d5/d1a/f47 x:0 0 0 2024-09-18T12:49:06.584 INFO:tasks.workunit.client.1.smithi148.stdout:7/162: write db/dd/f26 [731654,72368] 0 2024-09-18T12:49:06.584 INFO:tasks.workunit.client.1.smithi148.stdout:4/160: dwrite d15/d17/f2a [0,4194304] 0 2024-09-18T12:49:06.587 INFO:tasks.workunit.client.1.smithi148.stdout:3/148: mkdir d4/d2d/d31 0 2024-09-18T12:49:06.590 INFO:tasks.workunit.client.1.smithi148.stdout:7/163: dread fa [0,4194304] 0 2024-09-18T12:49:06.591 INFO:tasks.workunit.client.1.smithi148.stdout:1/166: mkdir dc/d11/d3b 0 2024-09-18T12:49:06.592 INFO:tasks.workunit.client.1.smithi148.stdout:1/167: stat dc/d11/d17/c29 0 2024-09-18T12:49:06.594 INFO:tasks.workunit.client.1.smithi148.stdout:3/149: rename d4/l12 to d4/d2d/l32 0 2024-09-18T12:49:06.595 INFO:tasks.workunit.client.1.smithi148.stdout:7/164: rmdir db/dd 39 2024-09-18T12:49:06.595 INFO:tasks.workunit.client.1.smithi148.stdout:2/132: symlink d9/d17/d29/l2b 0 2024-09-18T12:49:06.598 INFO:tasks.workunit.client.1.smithi148.stdout:8/201: link d8/df/d38/d39/d3b/l45 d8/df/l49 0 2024-09-18T12:49:06.598 INFO:tasks.workunit.client.1.smithi148.stdout:1/168: fsync dc/f10 0 2024-09-18T12:49:06.599 INFO:tasks.workunit.client.1.smithi148.stdout:0/369: truncate de/d14/f25 1164106 0 2024-09-18T12:49:06.599 INFO:tasks.workunit.client.1.smithi148.stdout:8/202: write d8/df/f10 [4945701,34696] 0 2024-09-18T12:49:06.600 INFO:tasks.workunit.client.0.smithi078.stdout:6/216: write d10/f30 [702855,82913] 0 2024-09-18T12:49:06.600 INFO:tasks.workunit.client.1.smithi148.stdout:2/133: fdatasync d9/fb 0 2024-09-18T12:49:06.601 INFO:tasks.workunit.client.0.smithi078.stdout:6/217: chown d10/f30 135763 1 2024-09-18T12:49:06.601 INFO:tasks.workunit.client.1.smithi148.stdout:1/169: write dc/d11/f12 [4085989,41700] 0 2024-09-18T12:49:06.602 INFO:tasks.workunit.client.0.smithi078.stdout:6/218: read ff [1805240,41876] 0 2024-09-18T12:49:06.602 INFO:tasks.workunit.client.0.smithi078.stdout:6/219: write d10/f30 [654310,28832] 0 2024-09-18T12:49:06.602 INFO:tasks.workunit.client.0.smithi078.stdout:6/220: stat d10 0 2024-09-18T12:49:06.603 INFO:tasks.workunit.client.1.smithi148.stdout:5/202: sync 2024-09-18T12:49:06.605 INFO:tasks.workunit.client.0.smithi078.stdout:6/221: creat d10/d27/f38 x:0 0 0 2024-09-18T12:49:06.605 INFO:tasks.workunit.client.1.smithi148.stdout:7/165: mkdir db/dc/df/d2c 0 2024-09-18T12:49:06.608 INFO:tasks.workunit.client.0.smithi078.stdout:2/156: sync 2024-09-18T12:49:06.610 INFO:tasks.workunit.client.1.smithi148.stdout:4/161: link lf d15/d17/d1f/l3e 0 2024-09-18T12:49:06.611 INFO:tasks.workunit.client.1.smithi148.stdout:6/205: dread d5/f1b [0,4194304] 0 2024-09-18T12:49:06.611 INFO:tasks.workunit.client.0.smithi078.stdout:2/157: symlink d4/d8/l35 0 2024-09-18T12:49:06.612 INFO:tasks.workunit.client.1.smithi148.stdout:2/134: dwrite d9/fc [0,4194304] 0 2024-09-18T12:49:06.612 INFO:tasks.workunit.client.1.smithi148.stdout:4/162: write d15/d17/f2b [382502,75586] 0 2024-09-18T12:49:06.612 INFO:tasks.workunit.client.1.smithi148.stdout:3/150: creat d4/d8/d20/f33 x:0 0 0 2024-09-18T12:49:06.614 INFO:tasks.workunit.client.0.smithi078.stdout:2/158: stat d4/dd/c2b 0 2024-09-18T12:49:06.615 INFO:tasks.workunit.client.0.smithi078.stdout:2/159: dread - d4/d1a/f30 zero size 2024-09-18T12:49:06.615 INFO:tasks.workunit.client.1.smithi148.stdout:2/135: truncate d9/fe 4824256 0 2024-09-18T12:49:06.616 INFO:tasks.workunit.client.1.smithi148.stdout:5/203: unlink d7/d8/dc/d12/f34 0 2024-09-18T12:49:06.616 INFO:tasks.workunit.client.1.smithi148.stdout:4/163: truncate d15/d1d/f23 17532 0 2024-09-18T12:49:06.617 INFO:tasks.workunit.client.1.smithi148.stdout:9/140: sync 2024-09-18T12:49:06.617 INFO:tasks.workunit.client.1.smithi148.stdout:7/166: fsync db/dc/df/d1d/f21 0 2024-09-18T12:49:06.618 INFO:tasks.workunit.client.1.smithi148.stdout:5/204: fsync d7/d2b/f36 0 2024-09-18T12:49:06.618 INFO:tasks.workunit.client.0.smithi078.stdout:2/160: mknod d4/db/c36 0 2024-09-18T12:49:06.619 INFO:tasks.workunit.client.1.smithi148.stdout:3/151: dread d4/f18 [0,4194304] 0 2024-09-18T12:49:06.619 INFO:tasks.workunit.client.1.smithi148.stdout:4/164: write d15/d17/f19 [191339,88249] 0 2024-09-18T12:49:06.620 INFO:tasks.workunit.client.1.smithi148.stdout:9/141: fdatasync d8/da/df/f15 0 2024-09-18T12:49:06.622 INFO:tasks.workunit.client.1.smithi148.stdout:4/165: dread - d15/d1d/f3d zero size 2024-09-18T12:49:06.622 INFO:tasks.workunit.client.1.smithi148.stdout:3/152: write f2 [1661608,7615] 0 2024-09-18T12:49:06.625 INFO:tasks.workunit.client.1.smithi148.stdout:8/203: dread d8/fb [4194304,4194304] 0 2024-09-18T12:49:06.628 INFO:tasks.workunit.client.1.smithi148.stdout:5/205: symlink d7/d8/dc/d22/l46 0 2024-09-18T12:49:06.629 INFO:tasks.workunit.client.1.smithi148.stdout:9/142: unlink d8/da/fc 0 2024-09-18T12:49:06.630 INFO:tasks.workunit.client.1.smithi148.stdout:9/143: truncate d8/f10 955677 0 2024-09-18T12:49:06.631 INFO:tasks.workunit.client.1.smithi148.stdout:6/206: fsync d5/d1a/dc/d2b/f30 0 2024-09-18T12:49:06.632 INFO:tasks.workunit.client.1.smithi148.stdout:6/207: chown d5/d1a/dc 927494 1 2024-09-18T12:49:06.633 INFO:tasks.workunit.client.1.smithi148.stdout:1/170: link dc/d18/f1c dc/d11/d17/f3c 0 2024-09-18T12:49:06.633 INFO:tasks.workunit.client.1.smithi148.stdout:6/208: chown d5/c16 115066 1 2024-09-18T12:49:06.634 INFO:tasks.workunit.client.1.smithi148.stdout:3/153: truncate d4/f11 768744 0 2024-09-18T12:49:06.634 INFO:tasks.workunit.client.1.smithi148.stdout:0/370: dwrite de/d14/d43/d70/d7f/f39 [0,4194304] 0 2024-09-18T12:49:06.635 INFO:tasks.workunit.client.1.smithi148.stdout:2/136: mknod d9/d24/d27/c2c 0 2024-09-18T12:49:06.636 INFO:tasks.workunit.client.1.smithi148.stdout:8/204: creat d8/d16/d27/f4a x:0 0 0 2024-09-18T12:49:06.636 INFO:tasks.workunit.client.1.smithi148.stdout:0/371: chown de/d14/d43/d70/d7f/f41 1532918258 1 2024-09-18T12:49:06.637 INFO:tasks.workunit.client.1.smithi148.stdout:5/206: symlink d7/d8/dc/d12/d31/l47 0 2024-09-18T12:49:06.638 INFO:tasks.workunit.client.1.smithi148.stdout:4/166: mkdir d15/d3f 0 2024-09-18T12:49:06.638 INFO:tasks.workunit.client.1.smithi148.stdout:8/205: dread - d8/d16/d27/f4a zero size 2024-09-18T12:49:06.639 INFO:tasks.workunit.client.1.smithi148.stdout:4/167: fdatasync f9 0 2024-09-18T12:49:06.639 INFO:tasks.workunit.client.1.smithi148.stdout:5/207: dread - d7/d8/d18/f38 zero size 2024-09-18T12:49:06.639 INFO:tasks.workunit.client.1.smithi148.stdout:6/209: symlink d5/d32/l48 0 2024-09-18T12:49:06.643 INFO:tasks.workunit.client.1.smithi148.stdout:6/210: write f3 [4993977,68690] 0 2024-09-18T12:49:06.646 INFO:tasks.workunit.client.1.smithi148.stdout:3/154: dwrite f2 [0,4194304] 0 2024-09-18T12:49:06.647 INFO:tasks.workunit.client.1.smithi148.stdout:0/372: symlink de/d14/l86 0 2024-09-18T12:49:06.653 INFO:tasks.workunit.client.1.smithi148.stdout:6/211: write d5/f23 [3286679,38849] 0 2024-09-18T12:49:06.654 INFO:tasks.workunit.client.1.smithi148.stdout:5/208: dread d7/d8/dc/d12/d1f/f2c [0,4194304] 0 2024-09-18T12:49:06.655 INFO:tasks.workunit.client.1.smithi148.stdout:3/155: write d4/d8/d20/f33 [502230,131059] 0 2024-09-18T12:49:06.659 INFO:tasks.workunit.client.1.smithi148.stdout:1/171: write dc/f13 [342528,90402] 0 2024-09-18T12:49:06.660 INFO:tasks.workunit.client.1.smithi148.stdout:6/212: write f3 [4639666,114126] 0 2024-09-18T12:49:06.660 INFO:tasks.workunit.client.1.smithi148.stdout:4/168: dwrite d15/d17/f19 [0,4194304] 0 2024-09-18T12:49:06.662 INFO:tasks.workunit.client.1.smithi148.stdout:8/206: dwrite d8/df/d38/d39/f40 [0,4194304] 0 2024-09-18T12:49:06.665 INFO:tasks.workunit.client.1.smithi148.stdout:6/213: mkdir d5/d1a/dc/d49 0 2024-09-18T12:49:06.666 INFO:tasks.workunit.client.1.smithi148.stdout:2/137: dread d9/f1e [0,4194304] 0 2024-09-18T12:49:06.667 INFO:tasks.workunit.client.1.smithi148.stdout:5/209: fdatasync d7/d8/dc/d12/d1f/f2c 0 2024-09-18T12:49:06.667 INFO:tasks.workunit.client.1.smithi148.stdout:2/138: dread - d9/f18 zero size 2024-09-18T12:49:06.668 INFO:tasks.workunit.client.1.smithi148.stdout:4/169: mknod d15/d1d/c40 0 2024-09-18T12:49:06.668 INFO:tasks.workunit.client.1.smithi148.stdout:1/172: creat dc/d18/f3d x:0 0 0 2024-09-18T12:49:06.670 INFO:tasks.workunit.client.1.smithi148.stdout:2/139: write d9/f18 [55559,109994] 0 2024-09-18T12:49:06.671 INFO:tasks.workunit.client.1.smithi148.stdout:3/156: creat d4/d2d/d31/f34 x:0 0 0 2024-09-18T12:49:06.672 INFO:tasks.workunit.client.1.smithi148.stdout:3/157: chown d4/d8/d13/f21 12237309 1 2024-09-18T12:49:06.673 INFO:tasks.workunit.client.1.smithi148.stdout:1/173: rmdir dc/d11 39 2024-09-18T12:49:06.675 INFO:tasks.workunit.client.1.smithi148.stdout:4/170: rename l1 to d15/d17/d1f/l41 0 2024-09-18T12:49:06.676 INFO:tasks.workunit.client.1.smithi148.stdout:0/373: truncate de/d14/d43/d70/f82 3490617 0 2024-09-18T12:49:06.680 INFO:tasks.workunit.client.1.smithi148.stdout:5/210: rename d7/f10 to d7/d8/dc/d12/d31/f48 0 2024-09-18T12:49:06.680 INFO:tasks.workunit.client.1.smithi148.stdout:6/214: write d5/fa [2174897,8029] 0 2024-09-18T12:49:06.681 INFO:tasks.workunit.client.1.smithi148.stdout:0/374: fdatasync de/d14/f2a 0 2024-09-18T12:49:06.682 INFO:tasks.workunit.client.1.smithi148.stdout:2/140: link d9/d17/c1d d9/c2d 0 2024-09-18T12:49:06.683 INFO:tasks.workunit.client.1.smithi148.stdout:0/375: write de/f32 [529546,105711] 0 2024-09-18T12:49:06.683 INFO:tasks.workunit.client.1.smithi148.stdout:4/171: getdents d15/d3f 0 2024-09-18T12:49:06.684 INFO:tasks.workunit.client.1.smithi148.stdout:3/158: creat d4/d8/f35 x:0 0 0 2024-09-18T12:49:06.685 INFO:tasks.workunit.client.1.smithi148.stdout:0/376: readlink de/l34 0 2024-09-18T12:49:06.685 INFO:tasks.workunit.client.1.smithi148.stdout:6/215: read d5/d1a/f22 [2780860,37556] 0 2024-09-18T12:49:06.686 INFO:tasks.workunit.client.1.smithi148.stdout:5/211: write d7/d8/f3e [239937,53568] 0 2024-09-18T12:49:06.686 INFO:tasks.workunit.client.1.smithi148.stdout:2/141: write d9/fd [405757,33211] 0 2024-09-18T12:49:06.688 INFO:tasks.workunit.client.1.smithi148.stdout:1/174: mknod dc/d11/d3b/c3e 0 2024-09-18T12:49:06.688 INFO:tasks.workunit.client.1.smithi148.stdout:2/142: readlink d9/l13 0 2024-09-18T12:49:06.689 INFO:tasks.workunit.client.1.smithi148.stdout:5/212: fsync d7/d8/dc/d12/f45 0 2024-09-18T12:49:06.692 INFO:tasks.workunit.client.1.smithi148.stdout:1/175: write dc/d11/f16 [1101996,66060] 0 2024-09-18T12:49:06.693 INFO:tasks.workunit.client.1.smithi148.stdout:5/213: readlink d7/d8/dc/d12/d31/l47 0 2024-09-18T12:49:06.693 INFO:tasks.workunit.client.1.smithi148.stdout:6/216: symlink d5/d32/d38/d41/l4a 0 2024-09-18T12:49:06.694 INFO:tasks.workunit.client.1.smithi148.stdout:3/159: dread d4/d8/d20/f33 [0,4194304] 0 2024-09-18T12:49:06.695 INFO:tasks.workunit.client.1.smithi148.stdout:8/207: dwrite f1 [0,4194304] 0 2024-09-18T12:49:06.696 INFO:tasks.workunit.client.1.smithi148.stdout:4/172: link d15/d1d/f22 d15/d17/f42 0 2024-09-18T12:49:06.697 INFO:tasks.workunit.client.1.smithi148.stdout:5/214: dread d7/d8/f13 [0,4194304] 0 2024-09-18T12:49:06.697 INFO:tasks.workunit.client.1.smithi148.stdout:6/217: write d5/f23 [4738969,97570] 0 2024-09-18T12:49:06.700 INFO:tasks.workunit.client.1.smithi148.stdout:3/160: creat d4/d2d/d31/f36 x:0 0 0 2024-09-18T12:49:06.702 INFO:tasks.workunit.client.1.smithi148.stdout:6/218: write d5/f1b [4523566,32218] 0 2024-09-18T12:49:06.705 INFO:tasks.workunit.client.1.smithi148.stdout:8/208: creat d8/f4b x:0 0 0 2024-09-18T12:49:06.705 INFO:tasks.workunit.client.1.smithi148.stdout:6/219: fdatasync d5/f19 0 2024-09-18T12:49:06.705 INFO:tasks.workunit.client.1.smithi148.stdout:3/161: dread d4/d8/d20/f33 [0,4194304] 0 2024-09-18T12:49:06.706 INFO:tasks.workunit.client.1.smithi148.stdout:4/173: dread fd [0,4194304] 0 2024-09-18T12:49:06.707 INFO:tasks.workunit.client.1.smithi148.stdout:1/176: truncate f8 459410 0 2024-09-18T12:49:06.713 INFO:tasks.workunit.client.1.smithi148.stdout:6/220: chown d5/d1a/d3d 12565 1 2024-09-18T12:49:06.716 INFO:tasks.workunit.client.1.smithi148.stdout:5/215: dwrite d7/d8/dc/d12/d20/f2e [0,4194304] 0 2024-09-18T12:49:06.717 INFO:tasks.workunit.client.1.smithi148.stdout:1/177: creat dc/d18/f3f x:0 0 0 2024-09-18T12:49:06.720 INFO:tasks.workunit.client.1.smithi148.stdout:2/143: dread d9/f16 [0,4194304] 0 2024-09-18T12:49:06.723 INFO:tasks.workunit.client.1.smithi148.stdout:8/209: creat d8/df/d38/d39/d3b/d41/f4c x:0 0 0 2024-09-18T12:49:06.724 INFO:tasks.workunit.client.1.smithi148.stdout:3/162: dwrite d4/d8/f35 [0,4194304] 0 2024-09-18T12:49:06.725 INFO:tasks.workunit.client.1.smithi148.stdout:6/221: write d5/d1a/f22 [1787239,55475] 0 2024-09-18T12:49:06.725 INFO:tasks.workunit.client.1.smithi148.stdout:1/178: creat dc/d18/d31/d39/f40 x:0 0 0 2024-09-18T12:49:06.726 INFO:tasks.workunit.client.1.smithi148.stdout:2/144: unlink d9/l10 0 2024-09-18T12:49:06.727 INFO:tasks.workunit.client.1.smithi148.stdout:3/163: readlink d4/d8/d20/l2e 0 2024-09-18T12:49:06.727 INFO:tasks.workunit.client.1.smithi148.stdout:8/210: creat d8/d16/f4d x:0 0 0 2024-09-18T12:49:06.727 INFO:tasks.workunit.client.1.smithi148.stdout:2/145: chown d9/l12 0 1 2024-09-18T12:49:06.728 INFO:tasks.workunit.client.1.smithi148.stdout:2/146: write d9/d17/f2a [518992,103361] 0 2024-09-18T12:49:06.729 INFO:tasks.workunit.client.1.smithi148.stdout:6/222: creat d5/d32/d38/d41/f4b x:0 0 0 2024-09-18T12:49:06.730 INFO:tasks.workunit.client.1.smithi148.stdout:3/164: mknod d4/c37 0 2024-09-18T12:49:06.731 INFO:tasks.workunit.client.1.smithi148.stdout:2/147: dread d9/f18 [0,4194304] 0 2024-09-18T12:49:06.731 INFO:tasks.workunit.client.1.smithi148.stdout:2/148: chown d9/fe 323805 1 2024-09-18T12:49:06.732 INFO:tasks.workunit.client.1.smithi148.stdout:8/211: mkdir d8/df/d38/d39/d3b/d4e 0 2024-09-18T12:49:06.736 INFO:tasks.workunit.client.1.smithi148.stdout:2/149: symlink d9/d17/l2e 0 2024-09-18T12:49:06.738 INFO:tasks.workunit.client.1.smithi148.stdout:1/179: creat dc/d11/d17/f41 x:0 0 0 2024-09-18T12:49:06.741 INFO:tasks.workunit.client.1.smithi148.stdout:3/165: symlink d4/l38 0 2024-09-18T12:49:06.743 INFO:tasks.workunit.client.1.smithi148.stdout:3/166: dread d4/d8/f1f [0,4194304] 0 2024-09-18T12:49:06.743 INFO:tasks.workunit.client.1.smithi148.stdout:1/180: mknod dc/d11/d3b/c42 0 2024-09-18T12:49:06.746 INFO:tasks.workunit.client.1.smithi148.stdout:4/174: dwrite d15/d1d/f22 [0,4194304] 0 2024-09-18T12:49:06.746 INFO:tasks.workunit.client.1.smithi148.stdout:1/181: read - dc/d11/f30 zero size 2024-09-18T12:49:06.748 INFO:tasks.workunit.client.1.smithi148.stdout:6/223: truncate d5/d1a/f22 313460 0 2024-09-18T12:49:06.748 INFO:tasks.workunit.client.1.smithi148.stdout:8/212: dread d8/d16/f2a [0,4194304] 0 2024-09-18T12:49:06.748 INFO:tasks.workunit.client.1.smithi148.stdout:1/182: fsync dc/d11/f16 0 2024-09-18T12:49:06.751 INFO:tasks.workunit.client.1.smithi148.stdout:1/183: dread dc/d11/d17/d2b/f2e [0,4194304] 0 2024-09-18T12:49:06.757 INFO:tasks.workunit.client.1.smithi148.stdout:8/213: getdents d8/df 0 2024-09-18T12:49:06.757 INFO:tasks.workunit.client.1.smithi148.stdout:7/167: sync 2024-09-18T12:49:06.760 INFO:tasks.workunit.client.1.smithi148.stdout:7/168: write f3 [219726,55722] 0 2024-09-18T12:49:06.761 INFO:tasks.workunit.client.1.smithi148.stdout:1/184: rename dc/d11/d3b to dc/d18/d43 0 2024-09-18T12:49:06.762 INFO:tasks.workunit.client.1.smithi148.stdout:3/167: dwrite d4/d8/f1a [4194304,4194304] 0 2024-09-18T12:49:06.762 INFO:tasks.workunit.client.1.smithi148.stdout:2/150: dwrite f5 [0,4194304] 0 2024-09-18T12:49:06.763 INFO:tasks.workunit.client.1.smithi148.stdout:4/175: truncate d15/d17/f19 3623343 0 2024-09-18T12:49:06.764 INFO:tasks.workunit.client.1.smithi148.stdout:6/224: truncate d5/f23 3806731 0 2024-09-18T12:49:06.764 INFO:tasks.workunit.client.1.smithi148.stdout:1/185: write dc/f25 [3723148,91798] 0 2024-09-18T12:49:06.765 INFO:tasks.workunit.client.1.smithi148.stdout:4/176: readlink d15/d17/l18 0 2024-09-18T12:49:06.772 INFO:tasks.workunit.client.1.smithi148.stdout:3/168: mknod d4/d2d/d31/c39 0 2024-09-18T12:49:06.772 INFO:tasks.workunit.client.1.smithi148.stdout:7/169: unlink db/dc/df/c14 0 2024-09-18T12:49:06.772 INFO:tasks.workunit.client.1.smithi148.stdout:8/214: creat d8/df/d38/d39/d3b/d41/f4f x:0 0 0 2024-09-18T12:49:06.772 INFO:tasks.workunit.client.1.smithi148.stdout:6/225: dread d5/f1b [4194304,4194304] 0 2024-09-18T12:49:06.773 INFO:tasks.workunit.client.1.smithi148.stdout:1/186: symlink dc/d18/l44 0 2024-09-18T12:49:06.775 INFO:tasks.workunit.client.1.smithi148.stdout:4/177: mknod d15/d1d/d34/c43 0 2024-09-18T12:49:06.776 INFO:tasks.workunit.client.1.smithi148.stdout:3/169: unlink d4/d8/d13/c1d 0 2024-09-18T12:49:06.778 INFO:tasks.workunit.client.1.smithi148.stdout:7/170: mknod db/dc/df/d11/c2d 0 2024-09-18T12:49:06.779 INFO:tasks.workunit.client.1.smithi148.stdout:3/170: creat d4/d8/d20/d2b/f3a x:0 0 0 2024-09-18T12:49:06.780 INFO:tasks.workunit.client.1.smithi148.stdout:1/187: dread dc/fd [0,4194304] 0 2024-09-18T12:49:06.780 INFO:tasks.workunit.client.1.smithi148.stdout:6/226: getdents d5/d1a/dc/d2b 0 2024-09-18T12:49:06.780 INFO:tasks.workunit.client.1.smithi148.stdout:2/151: dwrite d9/f21 [0,4194304] 0 2024-09-18T12:49:06.781 INFO:tasks.workunit.client.1.smithi148.stdout:7/171: stat db/dc/df/d1d/l20 0 2024-09-18T12:49:06.782 INFO:tasks.workunit.client.1.smithi148.stdout:8/215: truncate d8/df/d38/d39/d3b/d41/f4c 335314 0 2024-09-18T12:49:06.782 INFO:tasks.workunit.client.1.smithi148.stdout:6/227: rename d5/d1a/dc to d5/d1a/dc/d4c 22 2024-09-18T12:49:06.783 INFO:tasks.workunit.client.1.smithi148.stdout:3/171: unlink d4/l38 0 2024-09-18T12:49:06.783 INFO:tasks.workunit.client.1.smithi148.stdout:6/228: chown d5/d1a/dc/d49 33198519 1 2024-09-18T12:49:06.784 INFO:tasks.workunit.client.1.smithi148.stdout:2/152: creat d9/d24/f2f x:0 0 0 2024-09-18T12:49:06.786 INFO:tasks.workunit.client.1.smithi148.stdout:2/153: fsync d9/d24/f28 0 2024-09-18T12:49:06.788 INFO:tasks.workunit.client.1.smithi148.stdout:3/172: symlink d4/d8/d20/l3b 0 2024-09-18T12:49:06.788 INFO:tasks.workunit.client.1.smithi148.stdout:7/172: mkdir db/dd/d25/d2e 0 2024-09-18T12:49:06.789 INFO:tasks.workunit.client.1.smithi148.stdout:2/154: rmdir d9/d17/d29 39 2024-09-18T12:49:06.794 INFO:tasks.workunit.client.1.smithi148.stdout:3/173: write d4/d8/f15 [2242968,78394] 0 2024-09-18T12:49:06.796 INFO:tasks.workunit.client.1.smithi148.stdout:1/188: dwrite dc/d11/d17/f21 [0,4194304] 0 2024-09-18T12:49:06.802 INFO:tasks.workunit.client.1.smithi148.stdout:6/229: dwrite d5/fa [0,4194304] 0 2024-09-18T12:49:06.810 INFO:tasks.workunit.client.1.smithi148.stdout:3/174: getdents d4 0 2024-09-18T12:49:06.811 INFO:tasks.workunit.client.1.smithi148.stdout:4/178: dread d15/f2d [0,4194304] 0 2024-09-18T12:49:06.811 INFO:tasks.workunit.client.1.smithi148.stdout:8/216: dread d8/fb [0,4194304] 0 2024-09-18T12:49:06.812 INFO:tasks.workunit.client.1.smithi148.stdout:6/230: link d5/d1a/dc/f20 d5/d1a/dc/d49/f4d 0 2024-09-18T12:49:06.813 INFO:tasks.workunit.client.1.smithi148.stdout:8/217: readlink d8/d12/l1a 0 2024-09-18T12:49:06.813 INFO:tasks.workunit.client.1.smithi148.stdout:3/175: creat d4/d2d/d31/f3c x:0 0 0 2024-09-18T12:49:06.814 INFO:tasks.workunit.client.1.smithi148.stdout:6/231: chown d5/d1a/dc/d49/f4d 1666577 1 2024-09-18T12:49:06.814 INFO:tasks.workunit.client.1.smithi148.stdout:8/218: fsync d8/df/f19 0 2024-09-18T12:49:06.815 INFO:tasks.workunit.client.1.smithi148.stdout:2/155: truncate d9/fe 1636895 0 2024-09-18T12:49:06.816 INFO:tasks.workunit.client.1.smithi148.stdout:3/176: write d4/f5 [4750821,58560] 0 2024-09-18T12:49:06.816 INFO:tasks.workunit.client.1.smithi148.stdout:1/189: write dc/d18/f1c [3846925,131045] 0 2024-09-18T12:49:06.817 INFO:tasks.workunit.client.1.smithi148.stdout:4/179: unlink d15/d1d/c40 0 2024-09-18T12:49:06.818 INFO:tasks.workunit.client.1.smithi148.stdout:8/219: chown d8/d12/f13 47616 1 2024-09-18T12:49:06.821 INFO:tasks.workunit.client.1.smithi148.stdout:1/190: symlink dc/d18/d43/l45 0 2024-09-18T12:49:06.822 INFO:tasks.workunit.client.1.smithi148.stdout:7/173: dwrite db/dc/df/d1d/f21 [4194304,4194304] 0 2024-09-18T12:49:06.822 INFO:tasks.workunit.client.1.smithi148.stdout:2/156: getdents d9/d17 0 2024-09-18T12:49:06.824 INFO:tasks.workunit.client.1.smithi148.stdout:8/220: dread d8/df/d38/d39/d3b/d41/f4c [0,4194304] 0 2024-09-18T12:49:06.826 INFO:tasks.workunit.client.1.smithi148.stdout:4/180: rename d15/d17/d1f/l3e to d15/d17/d1f/l44 0 2024-09-18T12:49:06.826 INFO:tasks.workunit.client.1.smithi148.stdout:8/221: stat d8/df/d38/d39/d3b/d41 0 2024-09-18T12:49:06.827 INFO:tasks.workunit.client.1.smithi148.stdout:2/157: symlink d9/l30 0 2024-09-18T12:49:06.829 INFO:tasks.workunit.client.1.smithi148.stdout:3/177: getdents d4/d8/d20/d2b 0 2024-09-18T12:49:06.830 INFO:tasks.workunit.client.1.smithi148.stdout:8/222: read d8/df/d38/d39/f40 [237651,127494] 0 2024-09-18T12:49:06.833 INFO:tasks.workunit.client.1.smithi148.stdout:2/158: mkdir d9/d24/d31 0 2024-09-18T12:49:06.833 INFO:tasks.workunit.client.1.smithi148.stdout:8/223: mknod d8/df/d3e/c50 0 2024-09-18T12:49:06.834 INFO:tasks.workunit.client.1.smithi148.stdout:7/174: dwrite db/dc/f12 [0,4194304] 0 2024-09-18T12:49:06.835 INFO:tasks.workunit.client.1.smithi148.stdout:8/224: fsync d8/f4b 0 2024-09-18T12:49:06.838 INFO:tasks.workunit.client.1.smithi148.stdout:9/144: sync 2024-09-18T12:49:06.842 INFO:tasks.workunit.client.1.smithi148.stdout:2/159: link d9/d17/f2a d9/d24/f32 0 2024-09-18T12:49:06.844 INFO:tasks.workunit.client.1.smithi148.stdout:3/178: dwrite d4/d2d/d31/f36 [0,4194304] 0 2024-09-18T12:49:06.848 INFO:tasks.workunit.client.1.smithi148.stdout:3/179: dread - d4/d8/d20/f2f zero size 2024-09-18T12:49:06.853 INFO:tasks.workunit.client.1.smithi148.stdout:6/232: write d5/ff [799498,100188] 0 2024-09-18T12:49:06.853 INFO:tasks.workunit.client.1.smithi148.stdout:1/191: write f8 [942846,71161] 0 2024-09-18T12:49:06.853 INFO:tasks.workunit.client.1.smithi148.stdout:7/175: dwrite db/dd/f1a [0,4194304] 0 2024-09-18T12:49:06.854 INFO:tasks.workunit.client.1.smithi148.stdout:9/145: mknod d8/da/df/d27/c29 0 2024-09-18T12:49:06.855 INFO:tasks.workunit.client.1.smithi148.stdout:6/233: fdatasync d5/fa 0 2024-09-18T12:49:06.855 INFO:tasks.workunit.client.1.smithi148.stdout:4/181: truncate f2 459074 0 2024-09-18T12:49:06.855 INFO:tasks.workunit.client.1.smithi148.stdout:8/225: dwrite d8/df/d38/d39/f3d [0,4194304] 0 2024-09-18T12:49:06.858 INFO:tasks.workunit.client.1.smithi148.stdout:1/192: write dc/d11/f1a [1928702,52261] 0 2024-09-18T12:49:06.858 INFO:tasks.workunit.client.1.smithi148.stdout:6/234: chown d5/d32/d38/d41 30 1 2024-09-18T12:49:06.858 INFO:tasks.workunit.client.1.smithi148.stdout:2/160: dread d9/f21 [0,4194304] 0 2024-09-18T12:49:06.858 INFO:tasks.workunit.client.1.smithi148.stdout:0/377: sync 2024-09-18T12:49:06.859 INFO:tasks.workunit.client.1.smithi148.stdout:5/216: sync 2024-09-18T12:49:06.859 INFO:tasks.workunit.client.1.smithi148.stdout:9/146: symlink d8/l2a 0 2024-09-18T12:49:06.888 INFO:tasks.workunit.client.0.smithi078.stdout:9/58: sync 2024-09-18T12:49:06.888 INFO:tasks.workunit.client.0.smithi078.stdout:7/55: sync 2024-09-18T12:49:06.888 INFO:tasks.workunit.client.0.smithi078.stdout:3/49: sync 2024-09-18T12:49:06.888 INFO:tasks.workunit.client.0.smithi078.stdout:3/50: chown d9/fa 2004187169 1 2024-09-18T12:49:06.889 INFO:tasks.workunit.client.0.smithi078.stdout:9/59: mknod d5/c10 0 2024-09-18T12:49:06.893 INFO:tasks.workunit.client.1.smithi148.stdout:8/226: fdatasync d8/d12/f15 0 2024-09-18T12:49:06.894 INFO:tasks.workunit.client.1.smithi148.stdout:3/180: link d4/f6 d4/d8/d20/f3d 0 2024-09-18T12:49:06.895 INFO:tasks.workunit.client.1.smithi148.stdout:4/182: rename d15/d17/l18 to d15/d17/d1f/l45 0 2024-09-18T12:49:06.895 INFO:tasks.workunit.client.1.smithi148.stdout:9/147: truncate d8/f22 403999 0 2024-09-18T12:49:06.895 INFO:tasks.workunit.client.0.smithi078.stdout:7/56: dwrite d7/d9/f10 [0,4194304] 0 2024-09-18T12:49:06.895 INFO:tasks.workunit.client.0.smithi078.stdout:9/60: link d5/d7/lf d5/d7/d8/l11 0 2024-09-18T12:49:06.896 INFO:tasks.workunit.client.0.smithi078.stdout:3/51: dwrite f7 [0,4194304] 0 2024-09-18T12:49:06.897 INFO:tasks.workunit.client.1.smithi148.stdout:2/161: write d9/f16 [5165612,56492] 0 2024-09-18T12:49:06.897 INFO:tasks.workunit.client.0.smithi078.stdout:7/57: write d7/d9/f10 [2991684,72504] 0 2024-09-18T12:49:06.899 INFO:tasks.workunit.client.1.smithi148.stdout:8/227: mkdir d8/d12/d51 0 2024-09-18T12:49:06.900 INFO:tasks.workunit.client.1.smithi148.stdout:3/181: creat d4/d2d/f3e x:0 0 0 2024-09-18T12:49:06.900 INFO:tasks.workunit.client.0.smithi078.stdout:9/61: fdatasync d5/d7/fc 0 2024-09-18T12:49:06.901 INFO:tasks.workunit.client.1.smithi148.stdout:3/182: fdatasync d4/d2d/d31/f34 0 2024-09-18T12:49:06.901 INFO:tasks.workunit.client.0.smithi078.stdout:9/62: dread - d5/d7/d8/fb zero size 2024-09-18T12:49:06.902 INFO:tasks.workunit.client.0.smithi078.stdout:7/58: dread f5 [0,4194304] 0 2024-09-18T12:49:06.902 INFO:tasks.workunit.client.1.smithi148.stdout:0/378: mknod de/d14/d43/c87 0 2024-09-18T12:49:06.902 INFO:tasks.workunit.client.1.smithi148.stdout:3/183: write d4/d2d/d31/f3c [62572,46545] 0 2024-09-18T12:49:06.902 INFO:tasks.workunit.client.0.smithi078.stdout:9/63: read d5/d7/fc [2479991,86703] 0 2024-09-18T12:49:06.908 INFO:tasks.workunit.client.0.smithi078.stdout:3/52: mkdir d9/df/d11 0 2024-09-18T12:49:06.909 INFO:tasks.workunit.client.1.smithi148.stdout:5/217: truncate d7/d8/dc/d12/f45 4921062 0 2024-09-18T12:49:06.910 INFO:tasks.workunit.client.0.smithi078.stdout:7/59: creat d7/d9/f12 x:0 0 0 2024-09-18T12:49:06.912 INFO:tasks.workunit.client.1.smithi148.stdout:0/379: dwrite de/d14/d43/d70/d7f/f61 [0,4194304] 0 2024-09-18T12:49:06.915 INFO:tasks.workunit.client.0.smithi078.stdout:3/53: rename d9/fa to d9/f12 0 2024-09-18T12:49:06.915 INFO:tasks.workunit.client.0.smithi078.stdout:3/54: chown d9/df/d11 19 1 2024-09-18T12:49:06.916 INFO:tasks.workunit.client.0.smithi078.stdout:3/55: chown d9/dc 313 1 2024-09-18T12:49:06.917 INFO:tasks.workunit.client.1.smithi148.stdout:2/162: symlink d9/d24/l33 0 2024-09-18T12:49:06.917 INFO:tasks.workunit.client.1.smithi148.stdout:2/163: write d9/fd [512950,111147] 0 2024-09-18T12:49:06.919 INFO:tasks.workunit.client.1.smithi148.stdout:2/164: write f5 [3880649,118214] 0 2024-09-18T12:49:06.919 INFO:tasks.workunit.client.0.smithi078.stdout:7/60: write f5 [3826592,89809] 0 2024-09-18T12:49:06.919 INFO:tasks.workunit.client.0.smithi078.stdout:7/61: stat d7/d9/lf 0 2024-09-18T12:49:06.922 INFO:tasks.workunit.client.1.smithi148.stdout:8/228: unlink d8/d16/c32 0 2024-09-18T12:49:06.923 INFO:tasks.workunit.client.0.smithi078.stdout:3/56: mkdir d9/d13 0 2024-09-18T12:49:06.926 INFO:tasks.workunit.client.0.smithi078.stdout:7/62: creat d7/d9/f13 x:0 0 0 2024-09-18T12:49:06.926 INFO:tasks.workunit.client.1.smithi148.stdout:6/235: dwrite d5/f23 [0,4194304] 0 2024-09-18T12:49:06.928 INFO:tasks.workunit.client.1.smithi148.stdout:6/236: write d5/d1a/dc/d2b/f30 [4316096,108619] 0 2024-09-18T12:49:06.929 INFO:tasks.workunit.client.0.smithi078.stdout:7/63: mkdir d7/d9/d14 0 2024-09-18T12:49:06.932 INFO:tasks.workunit.client.1.smithi148.stdout:5/218: unlink d7/f40 0 2024-09-18T12:49:06.933 INFO:tasks.workunit.client.1.smithi148.stdout:5/219: dread - d7/d8/d18/f38 zero size 2024-09-18T12:49:06.935 INFO:tasks.workunit.client.1.smithi148.stdout:6/237: dwrite d5/f19 [0,4194304] 0 2024-09-18T12:49:06.935 INFO:tasks.workunit.client.0.smithi078.stdout:7/64: creat d7/d9/f15 x:0 0 0 2024-09-18T12:49:06.936 INFO:tasks.workunit.client.0.smithi078.stdout:3/57: dwrite d9/f12 [0,4194304] 0 2024-09-18T12:49:06.937 INFO:tasks.workunit.client.0.smithi078.stdout:3/58: write d9/f12 [1778160,78758] 0 2024-09-18T12:49:06.938 INFO:tasks.workunit.client.0.smithi078.stdout:7/65: write d7/d9/f13 [261500,110831] 0 2024-09-18T12:49:06.941 INFO:tasks.workunit.client.0.smithi078.stdout:3/59: dread d9/f12 [0,4194304] 0 2024-09-18T12:49:06.942 INFO:tasks.workunit.client.1.smithi148.stdout:5/220: dwrite d7/d8/f3e [0,4194304] 0 2024-09-18T12:49:06.944 INFO:tasks.workunit.client.0.smithi078.stdout:7/66: symlink d7/d9/l16 0 2024-09-18T12:49:06.945 INFO:tasks.workunit.client.1.smithi148.stdout:0/380: readlink de/d14/d43/d57/l60 0 2024-09-18T12:49:06.950 INFO:tasks.workunit.client.0.smithi078.stdout:7/67: rename d7/fc to d7/f17 0 2024-09-18T12:49:06.951 INFO:tasks.workunit.client.0.smithi078.stdout:9/64: truncate d5/d7/d8/fd 2012128 0 2024-09-18T12:49:06.952 INFO:tasks.workunit.client.0.smithi078.stdout:3/60: symlink d9/d13/l14 0 2024-09-18T12:49:06.954 INFO:tasks.workunit.client.1.smithi148.stdout:8/229: dread d8/d12/f13 [0,4194304] 0 2024-09-18T12:49:06.955 INFO:tasks.workunit.client.0.smithi078.stdout:9/65: dread f3 [0,4194304] 0 2024-09-18T12:49:06.956 INFO:tasks.workunit.client.1.smithi148.stdout:1/193: getdents dc/d18/d43 0 2024-09-18T12:49:06.957 INFO:tasks.workunit.client.0.smithi078.stdout:9/66: write d5/d7/d8/fe [637555,115471] 0 2024-09-18T12:49:06.957 INFO:tasks.workunit.client.0.smithi078.stdout:7/68: unlink d7/d9/lb 0 2024-09-18T12:49:06.958 INFO:tasks.workunit.client.1.smithi148.stdout:0/381: dwrite de/d27/f64 [0,4194304] 0 2024-09-18T12:49:06.960 INFO:tasks.workunit.client.1.smithi148.stdout:0/382: read - de/d27/d2e/f73 zero size 2024-09-18T12:49:06.961 INFO:tasks.workunit.client.0.smithi078.stdout:3/61: fsync d9/dc/f10 0 2024-09-18T12:49:06.961 INFO:tasks.workunit.client.1.smithi148.stdout:8/230: dread d8/d12/f1b [0,4194304] 0 2024-09-18T12:49:06.963 INFO:tasks.workunit.client.1.smithi148.stdout:5/221: symlink d7/d8/d18/l49 0 2024-09-18T12:49:06.963 INFO:tasks.workunit.client.0.smithi078.stdout:3/62: write d9/dc/f10 [899775,80093] 0 2024-09-18T12:49:06.963 INFO:tasks.workunit.client.1.smithi148.stdout:5/222: chown d7/d8/dc/f2a 824348 1 2024-09-18T12:49:06.964 INFO:tasks.workunit.client.1.smithi148.stdout:9/148: truncate d8/da/f1d 5055439 0 2024-09-18T12:49:06.965 INFO:tasks.workunit.client.1.smithi148.stdout:9/149: write d8/da/fb [6345842,129436] 0 2024-09-18T12:49:06.965 INFO:tasks.workunit.client.0.smithi078.stdout:7/69: dwrite d7/fa [0,4194304] 0 2024-09-18T12:49:06.965 INFO:tasks.workunit.client.1.smithi148.stdout:9/150: chown d8/f25 5734 1 2024-09-18T12:49:06.966 INFO:tasks.workunit.client.0.smithi078.stdout:9/67: mknod d5/d7/d8/c12 0 2024-09-18T12:49:06.966 INFO:tasks.workunit.client.1.smithi148.stdout:9/151: read d8/f26 [3085799,49820] 0 2024-09-18T12:49:06.967 INFO:tasks.workunit.client.1.smithi148.stdout:9/152: write d8/f16 [172515,106680] 0 2024-09-18T12:49:06.968 INFO:tasks.workunit.client.1.smithi148.stdout:4/183: truncate d15/d1d/f26 1880818 0 2024-09-18T12:49:06.970 INFO:tasks.workunit.client.1.smithi148.stdout:7/176: sync 2024-09-18T12:49:06.971 INFO:tasks.workunit.client.0.smithi078.stdout:9/68: dread d5/d7/fc [0,4194304] 0 2024-09-18T12:49:06.972 INFO:tasks.workunit.client.1.smithi148.stdout:3/184: creat d4/d8/d20/f3f x:0 0 0 2024-09-18T12:49:06.972 INFO:tasks.workunit.client.0.smithi078.stdout:9/69: chown d5/d7/ca 512364 1 2024-09-18T12:49:06.972 INFO:tasks.workunit.client.0.smithi078.stdout:3/63: mknod d9/dc/c15 0 2024-09-18T12:49:06.975 INFO:tasks.workunit.client.0.smithi078.stdout:9/70: dread - d5/d7/d8/fb zero size 2024-09-18T12:49:06.976 INFO:tasks.workunit.client.1.smithi148.stdout:0/383: dread - de/d14/d43/f4b zero size 2024-09-18T12:49:06.978 INFO:tasks.workunit.client.0.smithi078.stdout:9/71: unlink f2 0 2024-09-18T12:49:06.979 INFO:tasks.workunit.client.1.smithi148.stdout:8/231: symlink d8/d12/l52 0 2024-09-18T12:49:06.980 INFO:tasks.workunit.client.0.smithi078.stdout:3/64: fdatasync d9/dc/f10 0 2024-09-18T12:49:06.980 INFO:tasks.workunit.client.1.smithi148.stdout:8/232: dread - d8/f2f zero size 2024-09-18T12:49:06.981 INFO:tasks.workunit.client.1.smithi148.stdout:9/153: readlink d8/da/df/l1a 0 2024-09-18T12:49:06.981 INFO:tasks.workunit.client.0.smithi078.stdout:9/72: mknod d5/d7/d8/c13 0 2024-09-18T12:49:06.982 INFO:tasks.workunit.client.1.smithi148.stdout:4/184: creat d15/d17/d1f/f46 x:0 0 0 2024-09-18T12:49:06.983 INFO:tasks.workunit.client.1.smithi148.stdout:4/185: stat d15/d1d/c3b 0 2024-09-18T12:49:06.983 INFO:tasks.workunit.client.1.smithi148.stdout:4/186: chown c12 6337207 1 2024-09-18T12:49:06.983 INFO:tasks.workunit.client.0.smithi078.stdout:7/70: link d7/d9/cd d7/c18 0 2024-09-18T12:49:06.986 INFO:tasks.workunit.client.1.smithi148.stdout:7/177: mknod db/dd/c2f 0 2024-09-18T12:49:06.988 INFO:tasks.workunit.client.0.smithi078.stdout:9/73: unlink d5/d7/d8/c12 0 2024-09-18T12:49:06.989 INFO:tasks.workunit.client.1.smithi148.stdout:3/185: creat d4/f40 x:0 0 0 2024-09-18T12:49:06.993 INFO:tasks.workunit.client.1.smithi148.stdout:1/194: symlink dc/d11/l46 0 2024-09-18T12:49:06.994 INFO:tasks.workunit.client.0.smithi078.stdout:9/74: rmdir d5/d7 39 2024-09-18T12:49:06.997 INFO:tasks.workunit.client.0.smithi078.stdout:7/71: rename d7/c18 to d7/d9/d14/c19 0 2024-09-18T12:49:06.998 INFO:tasks.workunit.client.0.smithi078.stdout:3/65: link d9/dc/c15 d9/c16 0 2024-09-18T12:49:07.000 INFO:tasks.workunit.client.1.smithi148.stdout:8/233: rename d8/df/d38 to d8/d16/d53 0 2024-09-18T12:49:07.002 INFO:tasks.workunit.client.1.smithi148.stdout:2/165: dwrite d9/fe [0,4194304] 0 2024-09-18T12:49:07.003 INFO:tasks.workunit.client.1.smithi148.stdout:9/154: chown d8/da/df/c23 223628 1 2024-09-18T12:49:07.003 INFO:tasks.workunit.client.1.smithi148.stdout:2/166: readlink d9/l13 0 2024-09-18T12:49:07.004 INFO:tasks.workunit.client.1.smithi148.stdout:9/155: write d8/f26 [3919965,57406] 0 2024-09-18T12:49:07.004 INFO:tasks.workunit.client.0.smithi078.stdout:7/72: symlink d7/d9/d14/l1a 0 2024-09-18T12:49:07.006 INFO:tasks.workunit.client.0.smithi078.stdout:3/66: rmdir d9/d13 39 2024-09-18T12:49:07.006 INFO:tasks.workunit.client.1.smithi148.stdout:6/238: truncate d5/f23 1034677 0 2024-09-18T12:49:07.007 INFO:tasks.workunit.client.0.smithi078.stdout:3/67: write d9/dc/f10 [874379,37492] 0 2024-09-18T12:49:07.007 INFO:tasks.workunit.client.1.smithi148.stdout:4/187: dread d15/f16 [0,4194304] 0 2024-09-18T12:49:07.009 INFO:tasks.workunit.client.0.smithi078.stdout:9/75: creat d5/d7/d8/f14 x:0 0 0 2024-09-18T12:49:07.009 INFO:tasks.workunit.client.0.smithi078.stdout:8/61: sync 2024-09-18T12:49:07.010 INFO:tasks.workunit.client.1.smithi148.stdout:2/167: dwrite f5 [0,4194304] 0 2024-09-18T12:49:07.011 INFO:tasks.workunit.client.1.smithi148.stdout:2/168: chown d9/d17/l23 30748 1 2024-09-18T12:49:07.014 INFO:tasks.workunit.client.0.smithi078.stdout:9/76: dread f0 [0,4194304] 0 2024-09-18T12:49:07.015 INFO:tasks.workunit.client.0.smithi078.stdout:3/68: chown d9/d13/l14 968 1 2024-09-18T12:49:07.017 INFO:tasks.workunit.client.0.smithi078.stdout:8/62: unlink d0/f5 0 2024-09-18T12:49:07.018 INFO:tasks.workunit.client.0.smithi078.stdout:9/77: dread d5/d7/fc [0,4194304] 0 2024-09-18T12:49:07.020 INFO:tasks.workunit.client.0.smithi078.stdout:7/73: chown d7/d9/cd 443115689 1 2024-09-18T12:49:07.022 INFO:tasks.workunit.client.0.smithi078.stdout:3/69: rmdir d9/dc 39 2024-09-18T12:49:07.023 INFO:tasks.workunit.client.1.smithi148.stdout:7/178: symlink db/dc/df/l30 0 2024-09-18T12:49:07.026 INFO:tasks.workunit.client.1.smithi148.stdout:6/239: fsync d5/d1a/dc/f20 0 2024-09-18T12:49:07.029 INFO:tasks.workunit.client.0.smithi078.stdout:8/63: rename d0/d7/c9 to d0/d7/dc/c10 0 2024-09-18T12:49:07.029 INFO:tasks.workunit.client.1.smithi148.stdout:9/156: dread d8/fe [0,4194304] 0 2024-09-18T12:49:07.030 INFO:tasks.workunit.client.0.smithi078.stdout:7/74: rmdir d7/d9/d14 39 2024-09-18T12:49:07.030 INFO:tasks.workunit.client.0.smithi078.stdout:7/75: dread - d7/f17 zero size 2024-09-18T12:49:07.031 INFO:tasks.workunit.client.1.smithi148.stdout:7/179: dwrite f3 [0,4194304] 0 2024-09-18T12:49:07.031 INFO:tasks.workunit.client.1.smithi148.stdout:5/223: getdents d7/d8/dc/d22 0 2024-09-18T12:49:07.032 INFO:tasks.workunit.client.1.smithi148.stdout:0/384: link de/d14/d43/d70/d7f/c6c de/d27/d2e/c88 0 2024-09-18T12:49:07.033 INFO:tasks.workunit.client.1.smithi148.stdout:1/195: write dc/fd [673551,24113] 0 2024-09-18T12:49:07.034 INFO:tasks.workunit.client.0.smithi078.stdout:8/64: creat d0/d7/dc/f11 x:0 0 0 2024-09-18T12:49:07.036 INFO:tasks.workunit.client.1.smithi148.stdout:8/234: truncate d8/fb 1243549 0 2024-09-18T12:49:07.036 INFO:tasks.workunit.client.1.smithi148.stdout:0/385: stat de/d14/f81 0 2024-09-18T12:49:07.037 INFO:tasks.workunit.client.0.smithi078.stdout:7/76: creat d7/f1b x:0 0 0 2024-09-18T12:49:07.037 INFO:tasks.workunit.client.0.smithi078.stdout:7/77: stat f5 0 2024-09-18T12:49:07.038 INFO:tasks.workunit.client.0.smithi078.stdout:3/70: mknod d9/df/d11/c17 0 2024-09-18T12:49:07.038 INFO:tasks.workunit.client.1.smithi148.stdout:1/196: write dc/d18/f3d [868459,53920] 0 2024-09-18T12:49:07.039 INFO:tasks.workunit.client.1.smithi148.stdout:0/386: readlink de/d14/l42 0 2024-09-18T12:49:07.040 INFO:tasks.workunit.client.1.smithi148.stdout:6/240: dwrite d5/d1a/f47 [0,4194304] 0 2024-09-18T12:49:07.041 INFO:tasks.workunit.client.1.smithi148.stdout:8/235: write d8/d16/d27/f47 [109646,58065] 0 2024-09-18T12:49:07.042 INFO:tasks.workunit.client.0.smithi078.stdout:9/78: creat d5/f15 x:0 0 0 2024-09-18T12:49:07.044 INFO:tasks.workunit.client.1.smithi148.stdout:7/180: dwrite fa [0,4194304] 0 2024-09-18T12:49:07.044 INFO:tasks.workunit.client.0.smithi078.stdout:8/65: mknod d0/c12 0 2024-09-18T12:49:07.045 INFO:tasks.workunit.client.1.smithi148.stdout:7/181: write db/dc/f15 [468107,112470] 0 2024-09-18T12:49:07.046 INFO:tasks.workunit.client.0.smithi078.stdout:3/71: dwrite f7 [0,4194304] 0 2024-09-18T12:49:07.047 INFO:tasks.workunit.client.0.smithi078.stdout:7/78: mknod d7/c1c 0 2024-09-18T12:49:07.052 INFO:tasks.workunit.client.1.smithi148.stdout:4/188: getdents d15/d3f 0 2024-09-18T12:49:07.052 INFO:tasks.workunit.client.0.smithi078.stdout:8/66: dread d0/fe [0,4194304] 0 2024-09-18T12:49:07.053 INFO:tasks.workunit.client.0.smithi078.stdout:9/79: creat d5/d7/d8/f16 x:0 0 0 2024-09-18T12:49:07.058 INFO:tasks.workunit.client.0.smithi078.stdout:7/79: creat d7/f1d x:0 0 0 2024-09-18T12:49:07.058 INFO:tasks.workunit.client.1.smithi148.stdout:2/169: write d9/d17/f2a [1139849,44006] 0 2024-09-18T12:49:07.058 INFO:tasks.workunit.client.0.smithi078.stdout:7/80: fsync d7/d9/fe 0 2024-09-18T12:49:07.059 INFO:tasks.workunit.client.0.smithi078.stdout:3/72: mkdir d9/df/d11/d18 0 2024-09-18T12:49:07.060 INFO:tasks.workunit.client.1.smithi148.stdout:5/224: creat d7/d8/dc/d12/d31/f4a x:0 0 0 2024-09-18T12:49:07.061 INFO:tasks.workunit.client.0.smithi078.stdout:8/67: creat d0/f13 x:0 0 0 2024-09-18T12:49:07.065 INFO:tasks.workunit.client.0.smithi078.stdout:7/81: chown c4 155370981 1 2024-09-18T12:49:07.069 INFO:tasks.workunit.client.0.smithi078.stdout:8/68: rmdir d0/d7/dc 39 2024-09-18T12:49:07.071 INFO:tasks.workunit.client.1.smithi148.stdout:1/197: creat dc/d11/d17/d2b/f47 x:0 0 0 2024-09-18T12:49:07.071 INFO:tasks.workunit.client.1.smithi148.stdout:1/198: chown dc/d11/d17/l1d 2090078067 1 2024-09-18T12:49:07.072 INFO:tasks.workunit.client.0.smithi078.stdout:7/82: dwrite d7/d9/f13 [0,4194304] 0 2024-09-18T12:49:07.072 INFO:tasks.workunit.client.1.smithi148.stdout:1/199: read - dc/d11/d17/d2b/f47 zero size 2024-09-18T12:49:07.072 INFO:tasks.workunit.client.1.smithi148.stdout:8/236: fdatasync d8/d16/d53/d39/f40 0 2024-09-18T12:49:07.073 INFO:tasks.workunit.client.0.smithi078.stdout:7/83: dread - d7/d9/fe zero size 2024-09-18T12:49:07.073 INFO:tasks.workunit.client.1.smithi148.stdout:1/200: chown dc/d18/d31/l34 84935 1 2024-09-18T12:49:07.073 INFO:tasks.workunit.client.1.smithi148.stdout:8/237: readlink d8/d16/l25 0 2024-09-18T12:49:07.074 INFO:tasks.workunit.client.0.smithi078.stdout:3/73: mkdir d9/dc/d19 0 2024-09-18T12:49:07.075 INFO:tasks.workunit.client.0.smithi078.stdout:3/74: rename d9/df/d11 to d9/df/d11/d18/d1a 22 2024-09-18T12:49:07.077 INFO:tasks.workunit.client.0.smithi078.stdout:8/69: dread - d0/d7/dc/f11 zero size 2024-09-18T12:49:07.078 INFO:tasks.workunit.client.1.smithi148.stdout:7/182: symlink db/dc/df/d1d/l31 0 2024-09-18T12:49:07.078 INFO:tasks.workunit.client.0.smithi078.stdout:8/70: write d0/d7/dc/f11 [500854,17442] 0 2024-09-18T12:49:07.080 INFO:tasks.workunit.client.0.smithi078.stdout:8/71: truncate d0/d7/dc/f11 836323 0 2024-09-18T12:49:07.080 INFO:tasks.workunit.client.1.smithi148.stdout:9/157: truncate f7 1218016 0 2024-09-18T12:49:07.081 INFO:tasks.workunit.client.1.smithi148.stdout:8/238: dwrite d8/d16/d27/f4a [0,4194304] 0 2024-09-18T12:49:07.081 INFO:tasks.workunit.client.0.smithi078.stdout:3/75: creat d9/df/d11/f1b x:0 0 0 2024-09-18T12:49:07.083 INFO:tasks.workunit.client.1.smithi148.stdout:8/239: write d8/f2d [415806,101362] 0 2024-09-18T12:49:07.084 INFO:tasks.workunit.client.1.smithi148.stdout:8/240: readlink d8/d16/l25 0 2024-09-18T12:49:07.086 INFO:tasks.workunit.client.1.smithi148.stdout:8/241: chown d8/d16/d53/d39/f40 12719 1 2024-09-18T12:49:07.086 INFO:tasks.workunit.client.1.smithi148.stdout:9/158: dread d8/f26 [0,4194304] 0 2024-09-18T12:49:07.087 INFO:tasks.workunit.client.0.smithi078.stdout:3/76: rename d9/d13/l14 to d9/df/d11/l1c 0 2024-09-18T12:49:07.088 INFO:tasks.workunit.client.1.smithi148.stdout:0/387: write f1 [1929814,26467] 0 2024-09-18T12:49:07.089 INFO:tasks.workunit.client.1.smithi148.stdout:6/241: creat d5/d1a/d29/f4e x:0 0 0 2024-09-18T12:49:07.090 INFO:tasks.workunit.client.0.smithi078.stdout:3/77: creat d9/d13/f1d x:0 0 0 2024-09-18T12:49:07.092 INFO:tasks.workunit.client.1.smithi148.stdout:6/242: dread d5/ff [0,4194304] 0 2024-09-18T12:49:07.093 INFO:tasks.workunit.client.1.smithi148.stdout:1/201: symlink dc/d11/d17/d2b/l48 0 2024-09-18T12:49:07.093 INFO:tasks.workunit.client.1.smithi148.stdout:0/388: dread de/d27/f64 [0,4194304] 0 2024-09-18T12:49:07.094 INFO:tasks.workunit.client.1.smithi148.stdout:1/202: fsync f6 0 2024-09-18T12:49:07.095 INFO:tasks.workunit.client.1.smithi148.stdout:0/389: write de/d14/d43/d70/d7f/f39 [1676603,77797] 0 2024-09-18T12:49:07.096 INFO:tasks.workunit.client.0.smithi078.stdout:3/78: dwrite f7 [0,4194304] 0 2024-09-18T12:49:07.096 INFO:tasks.workunit.client.0.smithi078.stdout:7/84: fdatasync d7/d9/f13 0 2024-09-18T12:49:07.096 INFO:tasks.workunit.client.1.smithi148.stdout:5/225: mkdir d7/d8/dc/d12/d1f/d25/d4b 0 2024-09-18T12:49:07.097 INFO:tasks.workunit.client.0.smithi078.stdout:7/85: write d7/fa [3141141,113971] 0 2024-09-18T12:49:07.098 INFO:tasks.workunit.client.1.smithi148.stdout:9/159: symlink d8/da/df/d27/l2b 0 2024-09-18T12:49:07.098 INFO:tasks.workunit.client.1.smithi148.stdout:8/242: chown l4 60 1 2024-09-18T12:49:07.103 INFO:tasks.workunit.client.1.smithi148.stdout:5/226: truncate d7/d8/dc/d12/d1f/d39/f41 798917 0 2024-09-18T12:49:07.105 INFO:tasks.workunit.client.0.smithi078.stdout:7/86: dwrite d7/fa [0,4194304] 0 2024-09-18T12:49:07.105 INFO:tasks.workunit.client.1.smithi148.stdout:6/243: symlink d5/d32/d38/d41/l4f 0 2024-09-18T12:49:07.105 INFO:tasks.workunit.client.1.smithi148.stdout:1/203: dwrite dc/d18/f1c [0,4194304] 0 2024-09-18T12:49:07.105 INFO:tasks.workunit.client.1.smithi148.stdout:5/227: fsync d7/f1b 0 2024-09-18T12:49:07.106 INFO:tasks.workunit.client.0.smithi078.stdout:3/79: creat d9/dc/d19/f1e x:0 0 0 2024-09-18T12:49:07.106 INFO:tasks.workunit.client.1.smithi148.stdout:6/244: fdatasync d5/d1a/d29/f4e 0 2024-09-18T12:49:07.108 INFO:tasks.workunit.client.1.smithi148.stdout:7/183: mknod db/dd/d1f/d24/c32 0 2024-09-18T12:49:07.108 INFO:tasks.workunit.client.1.smithi148.stdout:5/228: chown d7/d8/d18/d3f 127298 1 2024-09-18T12:49:07.108 INFO:tasks.workunit.client.1.smithi148.stdout:6/245: readlink d5/l26 0 2024-09-18T12:49:07.109 INFO:tasks.workunit.client.1.smithi148.stdout:8/243: dread d8/d16/d53/d39/f3d [0,4194304] 0 2024-09-18T12:49:07.112 INFO:tasks.workunit.client.1.smithi148.stdout:8/244: truncate d8/d16/d53/d39/d3b/d41/f43 825222 0 2024-09-18T12:49:07.114 INFO:tasks.workunit.client.1.smithi148.stdout:3/186: truncate d4/d8/f35 4044303 0 2024-09-18T12:49:07.116 INFO:tasks.workunit.client.0.smithi078.stdout:8/72: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:49:07.118 INFO:tasks.workunit.client.1.smithi148.stdout:9/160: symlink d8/da/df/d27/l2c 0 2024-09-18T12:49:07.118 INFO:tasks.workunit.client.0.smithi078.stdout:3/80: dwrite d9/d13/f1d [0,4194304] 0 2024-09-18T12:49:07.123 INFO:tasks.workunit.client.0.smithi078.stdout:8/73: creat d0/f14 x:0 0 0 2024-09-18T12:49:07.124 INFO:tasks.workunit.client.0.smithi078.stdout:3/81: rename d9/df/d11/c17 to d9/df/d11/d18/c1f 0 2024-09-18T12:49:07.125 INFO:tasks.workunit.client.0.smithi078.stdout:7/87: getdents d7 0 2024-09-18T12:49:07.126 INFO:tasks.workunit.client.0.smithi078.stdout:3/82: write d9/dc/d19/f1e [120912,42700] 0 2024-09-18T12:49:07.128 INFO:tasks.workunit.client.1.smithi148.stdout:7/184: unlink db/dd/c2f 0 2024-09-18T12:49:07.128 INFO:tasks.workunit.client.0.smithi078.stdout:3/83: write d9/dc/f10 [595334,59244] 0 2024-09-18T12:49:07.130 INFO:tasks.workunit.client.1.smithi148.stdout:5/229: readlink d7/d8/dc/d12/d1f/d39/l44 0 2024-09-18T12:49:07.130 INFO:tasks.workunit.client.0.smithi078.stdout:8/74: write d0/f1 [1391650,109373] 0 2024-09-18T12:49:07.130 INFO:tasks.workunit.client.1.smithi148.stdout:1/204: truncate dc/d11/d17/d2b/f2e 622917 0 2024-09-18T12:49:07.131 INFO:tasks.workunit.client.1.smithi148.stdout:5/230: dread d7/d8/dc/d22/f43 [0,4194304] 0 2024-09-18T12:49:07.131 INFO:tasks.workunit.client.0.smithi078.stdout:8/75: read d0/f2 [1136255,60403] 0 2024-09-18T12:49:07.131 INFO:tasks.workunit.client.0.smithi078.stdout:7/88: creat d7/f1e x:0 0 0 2024-09-18T12:49:07.131 INFO:tasks.workunit.client.0.smithi078.stdout:8/76: read - d0/f14 zero size 2024-09-18T12:49:07.132 INFO:tasks.workunit.client.0.smithi078.stdout:7/89: readlink d7/d9/l16 0 2024-09-18T12:49:07.132 INFO:tasks.workunit.client.1.smithi148.stdout:6/246: truncate d5/d1a/dc/d49/f4d 172772 0 2024-09-18T12:49:07.134 INFO:tasks.workunit.client.1.smithi148.stdout:8/245: creat d8/df/d3e/f54 x:0 0 0 2024-09-18T12:49:07.135 INFO:tasks.workunit.client.0.smithi078.stdout:3/84: mknod d9/dc/d19/c20 0 2024-09-18T12:49:07.135 INFO:tasks.workunit.client.0.smithi078.stdout:3/85: fsync d9/df/d11/f1b 0 2024-09-18T12:49:07.135 INFO:tasks.workunit.client.1.smithi148.stdout:2/170: getdents d9/d24/d27 0 2024-09-18T12:49:07.137 INFO:tasks.workunit.client.1.smithi148.stdout:8/246: chown d8/d16/d53/d39 204334 1 2024-09-18T12:49:07.138 INFO:tasks.workunit.client.1.smithi148.stdout:7/185: dwrite fa [0,4194304] 0 2024-09-18T12:49:07.140 INFO:tasks.workunit.client.0.smithi078.stdout:3/86: creat d9/df/d11/f21 x:0 0 0 2024-09-18T12:49:07.144 INFO:tasks.workunit.client.1.smithi148.stdout:1/205: symlink dc/d18/d31/l49 0 2024-09-18T12:49:07.145 INFO:tasks.workunit.client.0.smithi078.stdout:3/87: read d9/dc/f10 [807349,28655] 0 2024-09-18T12:49:07.145 INFO:tasks.workunit.client.1.smithi148.stdout:6/247: mkdir d5/d32/d38/d50 0 2024-09-18T12:49:07.148 INFO:tasks.workunit.client.0.smithi078.stdout:7/90: creat d7/d9/f1f x:0 0 0 2024-09-18T12:49:07.148 INFO:tasks.workunit.client.0.smithi078.stdout:7/91: chown l3 211 1 2024-09-18T12:49:07.150 INFO:tasks.workunit.client.1.smithi148.stdout:0/390: dwrite de/d27/d2e/f73 [0,4194304] 0 2024-09-18T12:49:07.151 INFO:tasks.workunit.client.1.smithi148.stdout:5/231: rename d7/d8/dc/d22/f43 to d7/d8/dc/d12/d1f/d25/d4b/f4c 0 2024-09-18T12:49:07.153 INFO:tasks.workunit.client.1.smithi148.stdout:5/232: chown d7/d8/dc/d12/d1f/l27 414057 1 2024-09-18T12:49:07.153 INFO:tasks.workunit.client.0.smithi078.stdout:3/88: creat d9/dc/d19/f22 x:0 0 0 2024-09-18T12:49:07.155 INFO:tasks.workunit.client.0.smithi078.stdout:3/89: truncate d9/f12 5005122 0 2024-09-18T12:49:07.159 INFO:tasks.workunit.client.0.smithi078.stdout:3/90: mknod d9/df/d11/c23 0 2024-09-18T12:49:07.160 INFO:tasks.workunit.client.1.smithi148.stdout:2/171: mkdir d9/d24/d31/d34 0 2024-09-18T12:49:07.161 INFO:tasks.workunit.client.0.smithi078.stdout:8/77: link d0/d7/dc/c10 d0/d7/c15 0 2024-09-18T12:49:07.162 INFO:tasks.workunit.client.1.smithi148.stdout:2/172: write d9/d24/f28 [49235,75093] 0 2024-09-18T12:49:07.164 INFO:tasks.workunit.client.0.smithi078.stdout:3/91: creat d9/df/d11/d18/f24 x:0 0 0 2024-09-18T12:49:07.166 INFO:tasks.workunit.client.0.smithi078.stdout:8/78: creat d0/f16 x:0 0 0 2024-09-18T12:49:07.168 INFO:tasks.workunit.client.1.smithi148.stdout:9/161: creat d8/da/df/f2d x:0 0 0 2024-09-18T12:49:07.168 INFO:tasks.workunit.client.1.smithi148.stdout:3/187: write d4/d8/d20/f3d [2494555,121097] 0 2024-09-18T12:49:07.169 INFO:tasks.workunit.client.0.smithi078.stdout:3/92: write d9/dc/f10 [2002599,129241] 0 2024-09-18T12:49:07.169 INFO:tasks.workunit.client.1.smithi148.stdout:4/189: sync 2024-09-18T12:49:07.170 INFO:tasks.workunit.client.1.smithi148.stdout:4/190: write d15/f3a [527684,61776] 0 2024-09-18T12:49:07.170 INFO:tasks.workunit.client.0.smithi078.stdout:8/79: unlink d0/fe 0 2024-09-18T12:49:07.172 INFO:tasks.workunit.client.0.smithi078.stdout:3/93: write d9/f12 [5851609,44919] 0 2024-09-18T12:49:07.173 INFO:tasks.workunit.client.1.smithi148.stdout:0/391: mkdir de/d27/d53/d89 0 2024-09-18T12:49:07.174 INFO:tasks.workunit.client.1.smithi148.stdout:0/392: write de/f24 [1723135,17219] 0 2024-09-18T12:49:07.174 INFO:tasks.workunit.client.0.smithi078.stdout:8/80: creat d0/f17 x:0 0 0 2024-09-18T12:49:07.178 INFO:tasks.workunit.client.0.smithi078.stdout:8/81: creat d0/f18 x:0 0 0 2024-09-18T12:49:07.182 INFO:tasks.workunit.client.0.smithi078.stdout:8/82: dread d0/d7/fb [0,4194304] 0 2024-09-18T12:49:07.185 INFO:tasks.workunit.client.1.smithi148.stdout:6/248: symlink d5/d1a/dc/d49/l51 0 2024-09-18T12:49:07.186 INFO:tasks.workunit.client.0.smithi078.stdout:8/83: mknod d0/c19 0 2024-09-18T12:49:07.187 INFO:tasks.workunit.client.0.smithi078.stdout:8/84: write d0/f13 [476127,99172] 0 2024-09-18T12:49:07.188 INFO:tasks.workunit.client.0.smithi078.stdout:8/85: chown d0/d7/fb 60076 1 2024-09-18T12:49:07.188 INFO:tasks.workunit.client.0.smithi078.stdout:3/94: getdents d9/d13 0 2024-09-18T12:49:07.189 INFO:tasks.workunit.client.0.smithi078.stdout:8/86: stat d0/d7/dc/f11 0 2024-09-18T12:49:07.189 INFO:tasks.workunit.client.0.smithi078.stdout:3/95: chown d9/dc/d19/f22 3297 1 2024-09-18T12:49:07.190 INFO:tasks.workunit.client.1.smithi148.stdout:9/162: creat d8/da/f2e x:0 0 0 2024-09-18T12:49:07.191 INFO:tasks.workunit.client.1.smithi148.stdout:9/163: write d8/f25 [758071,3824] 0 2024-09-18T12:49:07.193 INFO:tasks.workunit.client.1.smithi148.stdout:8/247: rename d8/df/l3c to d8/d16/d27/l55 0 2024-09-18T12:49:07.195 INFO:tasks.workunit.client.1.smithi148.stdout:7/186: truncate db/dd/f1a 1832991 0 2024-09-18T12:49:07.196 INFO:tasks.workunit.client.1.smithi148.stdout:0/393: creat de/d27/f8a x:0 0 0 2024-09-18T12:49:07.197 INFO:tasks.workunit.client.1.smithi148.stdout:0/394: chown de/d27/f64 5607 1 2024-09-18T12:49:07.197 INFO:tasks.workunit.client.0.smithi078.stdout:8/87: dwrite d0/f14 [0,4194304] 0 2024-09-18T12:49:07.198 INFO:tasks.workunit.client.0.smithi078.stdout:3/96: dwrite d9/dc/d19/f22 [0,4194304] 0 2024-09-18T12:49:07.198 INFO:tasks.workunit.client.0.smithi078.stdout:8/88: stat d0/f17 0 2024-09-18T12:49:07.199 INFO:tasks.workunit.client.1.smithi148.stdout:5/233: dwrite d7/d8/fa [0,4194304] 0 2024-09-18T12:49:07.199 INFO:tasks.workunit.client.1.smithi148.stdout:1/206: link dc/d18/c27 dc/d18/c4a 0 2024-09-18T12:49:07.199 INFO:tasks.workunit.client.1.smithi148.stdout:5/234: chown d7/d8/d18 130467086 1 2024-09-18T12:49:07.201 INFO:tasks.workunit.client.1.smithi148.stdout:1/207: write dc/d18/d31/d39/f40 [974229,110205] 0 2024-09-18T12:49:07.202 INFO:tasks.workunit.client.1.smithi148.stdout:2/173: creat d9/d24/d31/d34/f35 x:0 0 0 2024-09-18T12:49:07.202 INFO:tasks.workunit.client.1.smithi148.stdout:7/187: dread db/dc/f15 [0,4194304] 0 2024-09-18T12:49:07.202 INFO:tasks.workunit.client.1.smithi148.stdout:1/208: stat dc/d11/d17/l1d 0 2024-09-18T12:49:07.204 INFO:tasks.workunit.client.1.smithi148.stdout:1/209: readlink dc/d18/d31/l49 0 2024-09-18T12:49:07.204 INFO:tasks.workunit.client.1.smithi148.stdout:7/188: fdatasync db/dc/df/d1d/f21 0 2024-09-18T12:49:07.206 INFO:tasks.workunit.client.1.smithi148.stdout:7/189: write db/dc/f12 [2769563,41224] 0 2024-09-18T12:49:07.208 INFO:tasks.workunit.client.1.smithi148.stdout:7/190: chown db/dc/df/f29 6576220 1 2024-09-18T12:49:07.209 INFO:tasks.workunit.client.0.smithi078.stdout:3/97: dread d9/dc/f10 [0,4194304] 0 2024-09-18T12:49:07.214 INFO:tasks.workunit.client.0.smithi078.stdout:8/89: dwrite d0/d7/fb [0,4194304] 0 2024-09-18T12:49:07.215 INFO:tasks.workunit.client.1.smithi148.stdout:5/235: mknod d7/d8/dc/d12/d1f/d25/c4d 0 2024-09-18T12:49:07.215 INFO:tasks.workunit.client.0.smithi078.stdout:8/90: chown d0/d7 3690 1 2024-09-18T12:49:07.216 INFO:tasks.workunit.client.1.smithi148.stdout:1/210: dwrite dc/d18/f3d [0,4194304] 0 2024-09-18T12:49:07.216 INFO:tasks.workunit.client.1.smithi148.stdout:2/174: creat d9/d17/d29/f36 x:0 0 0 2024-09-18T12:49:07.217 INFO:tasks.workunit.client.1.smithi148.stdout:6/249: creat d5/d32/d38/d50/f52 x:0 0 0 2024-09-18T12:49:07.218 INFO:tasks.workunit.client.1.smithi148.stdout:3/188: creat d4/f41 x:0 0 0 2024-09-18T12:49:07.219 INFO:tasks.workunit.client.0.smithi078.stdout:8/91: chown d0/d7/dc/c10 250809 1 2024-09-18T12:49:07.221 INFO:tasks.workunit.client.1.smithi148.stdout:4/191: link d15/d1d/f23 d15/d17/f47 0 2024-09-18T12:49:07.221 INFO:tasks.workunit.client.1.smithi148.stdout:8/248: mknod d8/d16/d53/d39/d3b/d4e/c56 0 2024-09-18T12:49:07.224 INFO:tasks.workunit.client.0.smithi078.stdout:8/92: dread d0/f2 [0,4194304] 0 2024-09-18T12:49:07.224 INFO:tasks.workunit.client.1.smithi148.stdout:4/192: fsync d15/d17/d1f/f32 0 2024-09-18T12:49:07.224 INFO:tasks.workunit.client.1.smithi148.stdout:8/249: write f1 [1437454,72267] 0 2024-09-18T12:49:07.225 INFO:tasks.workunit.client.1.smithi148.stdout:7/191: rename db/dd/d1f/d24/c32 to db/dd/d25/d2e/c33 0 2024-09-18T12:49:07.225 INFO:tasks.workunit.client.1.smithi148.stdout:9/164: dwrite d8/da/df/f18 [0,4194304] 0 2024-09-18T12:49:07.227 INFO:tasks.workunit.client.1.smithi148.stdout:5/236: dwrite d7/d2b/f3c [0,4194304] 0 2024-09-18T12:49:07.228 INFO:tasks.workunit.client.1.smithi148.stdout:1/211: mkdir dc/d18/d31/d4b 0 2024-09-18T12:49:07.230 INFO:tasks.workunit.client.0.smithi078.stdout:8/93: rename d0/f17 to d0/f1a 0 2024-09-18T12:49:07.235 INFO:tasks.workunit.client.1.smithi148.stdout:1/212: write dc/d11/d17/f41 [517607,121162] 0 2024-09-18T12:49:07.235 INFO:tasks.workunit.client.1.smithi148.stdout:7/192: dread fa [0,4194304] 0 2024-09-18T12:49:07.235 INFO:tasks.workunit.client.1.smithi148.stdout:2/175: creat d9/d24/d31/d34/f37 x:0 0 0 2024-09-18T12:49:07.235 INFO:tasks.workunit.client.0.smithi078.stdout:8/94: rename d0/f13 to d0/f1b 0 2024-09-18T12:49:07.238 INFO:tasks.workunit.client.0.smithi078.stdout:0/226: sync 2024-09-18T12:49:07.239 INFO:tasks.workunit.client.0.smithi078.stdout:1/111: sync 2024-09-18T12:49:07.239 INFO:tasks.workunit.client.0.smithi078.stdout:8/95: rename d0/d7/dc/f11 to d0/f1c 0 2024-09-18T12:49:07.239 INFO:tasks.workunit.client.0.smithi078.stdout:3/98: fsync d9/dc/d19/f22 0 2024-09-18T12:49:07.241 INFO:tasks.workunit.client.0.smithi078.stdout:3/99: write d9/d13/f1d [3748817,56808] 0 2024-09-18T12:49:07.243 INFO:tasks.workunit.client.0.smithi078.stdout:8/96: mkdir d0/d7/dc/d1d 0 2024-09-18T12:49:07.243 INFO:tasks.workunit.client.1.smithi148.stdout:1/213: dwrite dc/f25 [0,4194304] 0 2024-09-18T12:49:07.244 INFO:tasks.workunit.client.1.smithi148.stdout:8/250: rename d8/df/c36 to d8/d16/d53/d39/c57 0 2024-09-18T12:49:07.245 INFO:tasks.workunit.client.0.smithi078.stdout:0/227: mknod d3/d1f/d25/d30/c4d 0 2024-09-18T12:49:07.245 INFO:tasks.workunit.client.0.smithi078.stdout:0/228: stat d3/c27 0 2024-09-18T12:49:07.245 INFO:tasks.workunit.client.1.smithi148.stdout:8/251: chown d8/d16/d53/d39/d3b/d41 420025096 1 2024-09-18T12:49:07.247 INFO:tasks.workunit.client.0.smithi078.stdout:1/112: symlink d0/d21/l22 0 2024-09-18T12:49:07.247 INFO:tasks.workunit.client.1.smithi148.stdout:5/237: write d7/d8/d18/f38 [483961,58427] 0 2024-09-18T12:49:07.247 INFO:tasks.workunit.client.0.smithi078.stdout:1/113: fdatasync d0/fc 0 2024-09-18T12:49:07.248 INFO:tasks.workunit.client.0.smithi078.stdout:3/100: rename d9/df/d11/f21 to d9/df/d11/f25 0 2024-09-18T12:49:07.251 INFO:tasks.workunit.client.1.smithi148.stdout:0/395: getdents de/d14/d43 0 2024-09-18T12:49:07.253 INFO:tasks.workunit.client.1.smithi148.stdout:8/252: dread d8/d16/f2a [0,4194304] 0 2024-09-18T12:49:07.255 INFO:tasks.workunit.client.0.smithi078.stdout:3/101: mknod d9/dc/c26 0 2024-09-18T12:49:07.260 INFO:tasks.workunit.client.0.smithi078.stdout:8/97: rename d0/d7/dc/d1d to d0/d7/d1e 0 2024-09-18T12:49:07.262 INFO:tasks.workunit.client.1.smithi148.stdout:0/396: mknod de/d27/c8b 0 2024-09-18T12:49:07.264 INFO:tasks.workunit.client.1.smithi148.stdout:7/193: dread db/dc/df/d1d/f21 [0,4194304] 0 2024-09-18T12:49:07.264 INFO:tasks.workunit.client.0.smithi078.stdout:1/114: rename d0/f7 to d0/d8/da/f23 0 2024-09-18T12:49:07.266 INFO:tasks.workunit.client.0.smithi078.stdout:8/98: mkdir d0/d7/dc/d1f 0 2024-09-18T12:49:07.266 INFO:tasks.workunit.client.0.smithi078.stdout:8/99: fdatasync d0/f1 0 2024-09-18T12:49:07.267 INFO:tasks.workunit.client.0.smithi078.stdout:3/102: creat d9/f27 x:0 0 0 2024-09-18T12:49:07.271 INFO:tasks.workunit.client.0.smithi078.stdout:0/229: rename d3/d1f/d29 to d3/d1f/d2e/d4e 0 2024-09-18T12:49:07.271 INFO:tasks.workunit.client.0.smithi078.stdout:1/115: dwrite d0/fc [0,4194304] 0 2024-09-18T12:49:07.272 INFO:tasks.workunit.client.1.smithi148.stdout:2/176: rename d9/d17/d29/f36 to d9/d24/d27/f38 0 2024-09-18T12:49:07.273 INFO:tasks.workunit.client.1.smithi148.stdout:2/177: write d9/d24/f25 [490736,68398] 0 2024-09-18T12:49:07.276 INFO:tasks.workunit.client.1.smithi148.stdout:3/189: creat d4/d8/d20/f42 x:0 0 0 2024-09-18T12:49:07.276 INFO:tasks.workunit.client.0.smithi078.stdout:0/230: chown d3/d1f/d25/d30/c31 252941421 1 2024-09-18T12:49:07.276 INFO:tasks.workunit.client.0.smithi078.stdout:8/100: dwrite d0/d7/f8 [0,4194304] 0 2024-09-18T12:49:07.278 INFO:tasks.workunit.client.1.smithi148.stdout:6/250: getdents d5/d1a/dc 0 2024-09-18T12:49:07.279 INFO:tasks.workunit.client.1.smithi148.stdout:2/178: dread d9/d24/f25 [0,4194304] 0 2024-09-18T12:49:07.280 INFO:tasks.workunit.client.1.smithi148.stdout:0/397: symlink de/d14/d43/d57/l8c 0 2024-09-18T12:49:07.283 INFO:tasks.workunit.client.1.smithi148.stdout:8/253: creat d8/d12/d46/f58 x:0 0 0 2024-09-18T12:49:07.284 INFO:tasks.workunit.client.1.smithi148.stdout:4/193: write d15/d17/f27 [992987,29820] 0 2024-09-18T12:49:07.285 INFO:tasks.workunit.client.0.smithi078.stdout:1/116: dwrite d0/d8/da/f1c [0,4194304] 0 2024-09-18T12:49:07.285 INFO:tasks.workunit.client.1.smithi148.stdout:8/254: write d8/f4b [403293,127929] 0 2024-09-18T12:49:07.285 INFO:tasks.workunit.client.1.smithi148.stdout:7/194: mkdir db/dc/df/d11/d34 0 2024-09-18T12:49:07.288 INFO:tasks.workunit.client.1.smithi148.stdout:9/165: getdents d8/da/df 0 2024-09-18T12:49:07.289 INFO:tasks.workunit.client.1.smithi148.stdout:1/214: rename dc/d11/d17/d2b/l3a to dc/d18/d31/l4c 0 2024-09-18T12:49:07.290 INFO:tasks.workunit.client.0.smithi078.stdout:0/231: mknod d3/d1f/c4f 0 2024-09-18T12:49:07.292 INFO:tasks.workunit.client.1.smithi148.stdout:6/251: symlink d5/d1a/d3d/l53 0 2024-09-18T12:49:07.293 INFO:tasks.workunit.client.0.smithi078.stdout:1/117: dread d0/fc [0,4194304] 0 2024-09-18T12:49:07.294 INFO:tasks.workunit.client.1.smithi148.stdout:4/194: dwrite d15/d17/f2b [0,4194304] 0 2024-09-18T12:49:07.294 INFO:tasks.workunit.client.0.smithi078.stdout:8/101: dwrite d0/f2 [4194304,4194304] 0 2024-09-18T12:49:07.296 INFO:tasks.workunit.client.0.smithi078.stdout:3/103: getdents d9/dc/d19 0 2024-09-18T12:49:07.296 INFO:tasks.workunit.client.1.smithi148.stdout:4/195: dread - d15/d17/d1f/f2e zero size 2024-09-18T12:49:07.297 INFO:tasks.workunit.client.1.smithi148.stdout:2/179: rmdir d9/d17 39 2024-09-18T12:49:07.298 INFO:tasks.workunit.client.0.smithi078.stdout:0/232: rename d3/d1f to d3/d1f/d2e/d4e/d50 22 2024-09-18T12:49:07.300 INFO:tasks.workunit.client.0.smithi078.stdout:1/118: dread d0/fb [0,4194304] 0 2024-09-18T12:49:07.304 INFO:tasks.workunit.client.0.smithi078.stdout:0/233: dread d3/d1f/d2e/d4e/f48 [0,4194304] 0 2024-09-18T12:49:07.307 INFO:tasks.workunit.client.1.smithi148.stdout:9/166: unlink d8/fe 0 2024-09-18T12:49:07.309 INFO:tasks.workunit.client.1.smithi148.stdout:5/238: rename d7/d8/dc/d12/d31/f4a to d7/d8/d18/d3f/f4e 0 2024-09-18T12:49:07.309 INFO:tasks.workunit.client.1.smithi148.stdout:5/239: chown d7/d8/dc/d12 581 1 2024-09-18T12:49:07.310 INFO:tasks.workunit.client.0.smithi078.stdout:3/104: rename c8 to d9/df/c28 0 2024-09-18T12:49:07.312 INFO:tasks.workunit.client.1.smithi148.stdout:6/252: creat d5/d32/d38/f54 x:0 0 0 2024-09-18T12:49:07.313 INFO:tasks.workunit.client.0.smithi078.stdout:1/119: creat d0/f24 x:0 0 0 2024-09-18T12:49:07.313 INFO:tasks.workunit.client.1.smithi148.stdout:1/215: truncate dc/d11/d17/f23 235396 0 2024-09-18T12:49:07.314 INFO:tasks.workunit.client.0.smithi078.stdout:1/120: write d0/d8/da/f1f [724931,45301] 0 2024-09-18T12:49:07.316 INFO:tasks.workunit.client.1.smithi148.stdout:0/398: link de/d27/f3a de/d14/d43/d70/f8d 0 2024-09-18T12:49:07.316 INFO:tasks.workunit.client.0.smithi078.stdout:0/234: creat d3/d1f/d2e/d4e/d37/f51 x:0 0 0 2024-09-18T12:49:07.317 INFO:tasks.workunit.client.0.smithi078.stdout:8/102: symlink d0/d7/dc/d1f/l20 0 2024-09-18T12:49:07.318 INFO:tasks.workunit.client.1.smithi148.stdout:2/180: dread d9/d24/f25 [0,4194304] 0 2024-09-18T12:49:07.319 INFO:tasks.workunit.client.0.smithi078.stdout:1/121: unlink d0/d8/da/c12 0 2024-09-18T12:49:07.321 INFO:tasks.workunit.client.0.smithi078.stdout:1/122: write d0/d8/da/f1c [305485,105165] 0 2024-09-18T12:49:07.321 INFO:tasks.workunit.client.0.smithi078.stdout:8/103: dread d0/f1c [0,4194304] 0 2024-09-18T12:49:07.321 INFO:tasks.workunit.client.1.smithi148.stdout:9/167: mkdir d8/d2f 0 2024-09-18T12:49:07.322 INFO:tasks.workunit.client.0.smithi078.stdout:8/104: read - d0/f16 zero size 2024-09-18T12:49:07.322 INFO:tasks.workunit.client.0.smithi078.stdout:1/123: write d0/f19 [1179446,44755] 0 2024-09-18T12:49:07.323 INFO:tasks.workunit.client.0.smithi078.stdout:8/105: readlink d0/d7/dc/lf 0 2024-09-18T12:49:07.324 INFO:tasks.workunit.client.1.smithi148.stdout:3/190: rename d4/d8/d13 to d4/d8/d20/d2b/d43 0 2024-09-18T12:49:07.325 INFO:tasks.workunit.client.0.smithi078.stdout:3/105: rename d9/df/d11/d18 to d9/d29 0 2024-09-18T12:49:07.325 INFO:tasks.workunit.client.0.smithi078.stdout:3/106: readlink l6 0 2024-09-18T12:49:07.327 INFO:tasks.workunit.client.1.smithi148.stdout:6/253: creat d5/d1a/dc/d2b/f55 x:0 0 0 2024-09-18T12:49:07.327 INFO:tasks.workunit.client.0.smithi078.stdout:0/235: creat d3/d1f/f52 x:0 0 0 2024-09-18T12:49:07.329 INFO:tasks.workunit.client.0.smithi078.stdout:1/124: symlink d0/l25 0 2024-09-18T12:49:07.330 INFO:tasks.workunit.client.1.smithi148.stdout:4/196: mknod d15/d3f/c48 0 2024-09-18T12:49:07.332 INFO:tasks.workunit.client.0.smithi078.stdout:8/106: rmdir d0/d7 39 2024-09-18T12:49:07.332 INFO:tasks.workunit.client.0.smithi078.stdout:8/107: dread d0/f1c [0,4194304] 0 2024-09-18T12:49:07.333 INFO:tasks.workunit.client.1.smithi148.stdout:7/195: creat db/dc/df/f35 x:0 0 0 2024-09-18T12:49:07.335 INFO:tasks.workunit.client.0.smithi078.stdout:1/125: creat d0/d8/f26 x:0 0 0 2024-09-18T12:49:07.335 INFO:tasks.workunit.client.0.smithi078.stdout:1/126: write d0/f19 [1756574,9949] 0 2024-09-18T12:49:07.336 INFO:tasks.workunit.client.0.smithi078.stdout:1/127: readlink d0/l3 0 2024-09-18T12:49:07.336 INFO:tasks.workunit.client.0.smithi078.stdout:1/128: dread - d0/d8/f26 zero size 2024-09-18T12:49:07.337 INFO:tasks.workunit.client.0.smithi078.stdout:1/129: chown d0/d21/l22 802455 1 2024-09-18T12:49:07.339 INFO:tasks.workunit.client.1.smithi148.stdout:3/191: fsync d4/fe 0 2024-09-18T12:49:07.340 INFO:tasks.workunit.client.1.smithi148.stdout:5/240: dread d7/d8/dc/ff [4194304,4194304] 0 2024-09-18T12:49:07.341 INFO:tasks.workunit.client.1.smithi148.stdout:6/254: fsync d5/d1a/f22 0 2024-09-18T12:49:07.343 INFO:tasks.workunit.client.1.smithi148.stdout:1/216: mkdir dc/d4d 0 2024-09-18T12:49:07.343 INFO:tasks.workunit.client.1.smithi148.stdout:1/217: fdatasync f6 0 2024-09-18T12:49:07.344 INFO:tasks.workunit.client.0.smithi078.stdout:3/107: rename d9/dc to d9/d2a 0 2024-09-18T12:49:07.344 INFO:tasks.workunit.client.1.smithi148.stdout:1/218: stat dc/f10 0 2024-09-18T12:49:07.344 INFO:tasks.workunit.client.0.smithi078.stdout:3/108: write d9/d29/f24 [948108,21407] 0 2024-09-18T12:49:07.345 INFO:tasks.workunit.client.1.smithi148.stdout:1/219: truncate dc/d18/d31/d39/f40 1278550 0 2024-09-18T12:49:07.345 INFO:tasks.workunit.client.1.smithi148.stdout:4/197: unlink fd 0 2024-09-18T12:49:07.347 INFO:tasks.workunit.client.0.smithi078.stdout:1/130: truncate d0/f13 1283059 0 2024-09-18T12:49:07.348 INFO:tasks.workunit.client.0.smithi078.stdout:1/131: write d0/f24 [180379,79024] 0 2024-09-18T12:49:07.348 INFO:tasks.workunit.client.1.smithi148.stdout:0/399: symlink de/d14/l8e 0 2024-09-18T12:49:07.349 INFO:tasks.workunit.client.0.smithi078.stdout:8/108: unlink d0/d7/c15 0 2024-09-18T12:49:07.350 INFO:tasks.workunit.client.1.smithi148.stdout:8/255: truncate d8/d16/d27/f47 1595297 0 2024-09-18T12:49:07.352 INFO:tasks.workunit.client.1.smithi148.stdout:8/256: rename d8/d16 to d8/d16/d27/d59 22 2024-09-18T12:49:07.352 INFO:tasks.workunit.client.1.smithi148.stdout:6/255: dread f3 [0,4194304] 0 2024-09-18T12:49:07.353 INFO:tasks.workunit.client.0.smithi078.stdout:3/109: mknod d9/d13/c2b 0 2024-09-18T12:49:07.353 INFO:tasks.workunit.client.1.smithi148.stdout:6/256: readlink d5/l26 0 2024-09-18T12:49:07.354 INFO:tasks.workunit.client.1.smithi148.stdout:9/168: fdatasync f7 0 2024-09-18T12:49:07.355 INFO:tasks.workunit.client.1.smithi148.stdout:6/257: chown d5/d1a/dc/d2b/d35 2848 1 2024-09-18T12:49:07.355 INFO:tasks.workunit.client.1.smithi148.stdout:5/241: dread d7/d8/dc/ff [0,4194304] 0 2024-09-18T12:49:07.355 INFO:tasks.workunit.client.0.smithi078.stdout:1/132: mknod d0/d8/da/c27 0 2024-09-18T12:49:07.356 INFO:tasks.workunit.client.0.smithi078.stdout:1/133: chown d0/d8/da/l1a 0 1 2024-09-18T12:49:07.358 INFO:tasks.workunit.client.0.smithi078.stdout:0/236: getdents d3/d1f/d2e/d4e 0 2024-09-18T12:49:07.359 INFO:tasks.workunit.client.1.smithi148.stdout:3/192: fdatasync d4/f29 0 2024-09-18T12:49:07.360 INFO:tasks.workunit.client.0.smithi078.stdout:8/109: chown d0/d7/dc/c10 2 1 2024-09-18T12:49:07.360 INFO:tasks.workunit.client.1.smithi148.stdout:8/257: dwrite d8/d16/f34 [0,4194304] 0 2024-09-18T12:49:07.360 INFO:tasks.workunit.client.1.smithi148.stdout:3/193: write d4/d8/d20/f3d [358285,2648] 0 2024-09-18T12:49:07.362 INFO:tasks.workunit.client.0.smithi078.stdout:1/134: mknod d0/d8/da/c28 0 2024-09-18T12:49:07.364 INFO:tasks.workunit.client.1.smithi148.stdout:4/198: write d15/d1d/f29 [900440,89061] 0 2024-09-18T12:49:07.368 INFO:tasks.workunit.client.0.smithi078.stdout:8/110: dwrite d0/f2 [4194304,4194304] 0 2024-09-18T12:49:07.373 INFO:tasks.workunit.client.1.smithi148.stdout:2/181: creat d9/f39 x:0 0 0 2024-09-18T12:49:07.374 INFO:tasks.workunit.client.0.smithi078.stdout:1/135: mknod d0/d8/da/c29 0 2024-09-18T12:49:07.378 INFO:tasks.workunit.client.1.smithi148.stdout:6/258: rmdir d5/d1a/dc/d49 39 2024-09-18T12:49:07.379 INFO:tasks.workunit.client.0.smithi078.stdout:1/136: mknod d0/d21/c2a 0 2024-09-18T12:49:07.379 INFO:tasks.workunit.client.1.smithi148.stdout:7/196: dwrite db/dc/f15 [0,4194304] 0 2024-09-18T12:49:07.379 INFO:tasks.workunit.client.1.smithi148.stdout:5/242: fdatasync d7/d8/dc/f2a 0 2024-09-18T12:49:07.380 INFO:tasks.workunit.client.0.smithi078.stdout:6/222: sync 2024-09-18T12:49:07.380 INFO:tasks.workunit.client.0.smithi078.stdout:9/80: sync 2024-09-18T12:49:07.380 INFO:tasks.workunit.client.0.smithi078.stdout:2/161: sync 2024-09-18T12:49:07.380 INFO:tasks.workunit.client.0.smithi078.stdout:4/59: sync 2024-09-18T12:49:07.381 INFO:tasks.workunit.client.0.smithi078.stdout:5/207: sync 2024-09-18T12:49:07.381 INFO:tasks.workunit.client.0.smithi078.stdout:0/237: creat d3/d1f/f53 x:0 0 0 2024-09-18T12:49:07.382 INFO:tasks.workunit.client.0.smithi078.stdout:3/110: truncate d9/d13/f1d 3849567 0 2024-09-18T12:49:07.382 INFO:tasks.workunit.client.0.smithi078.stdout:4/60: dread - d11/f16 zero size 2024-09-18T12:49:07.383 INFO:tasks.workunit.client.0.smithi078.stdout:9/81: fsync d5/d7/d8/f14 0 2024-09-18T12:49:07.383 INFO:tasks.workunit.client.0.smithi078.stdout:6/223: chown d10/l11 46254 1 2024-09-18T12:49:07.385 INFO:tasks.workunit.client.0.smithi078.stdout:1/137: unlink d0/fb 0 2024-09-18T12:49:07.386 INFO:tasks.workunit.client.0.smithi078.stdout:5/208: readlink d2/d4/d9/lb 0 2024-09-18T12:49:07.386 INFO:tasks.workunit.client.0.smithi078.stdout:1/138: write d0/d8/da/f1c [5204366,91063] 0 2024-09-18T12:49:07.388 INFO:tasks.workunit.client.1.smithi148.stdout:8/258: unlink d8/d12/l52 0 2024-09-18T12:49:07.389 INFO:tasks.workunit.client.0.smithi078.stdout:3/111: readlink l1 0 2024-09-18T12:49:07.389 INFO:tasks.workunit.client.1.smithi148.stdout:3/194: symlink d4/d8/d20/d2b/l44 0 2024-09-18T12:49:07.390 INFO:tasks.workunit.client.0.smithi078.stdout:3/112: truncate d9/df/d11/f1b 215346 0 2024-09-18T12:49:07.391 INFO:tasks.workunit.client.0.smithi078.stdout:8/111: creat d0/f21 x:0 0 0 2024-09-18T12:49:07.392 INFO:tasks.workunit.client.0.smithi078.stdout:8/112: write d0/f2 [5327399,80140] 0 2024-09-18T12:49:07.393 INFO:tasks.workunit.client.0.smithi078.stdout:4/61: symlink d11/l18 0 2024-09-18T12:49:07.394 INFO:tasks.workunit.client.1.smithi148.stdout:1/220: link f6 dc/d18/d43/f4e 0 2024-09-18T12:49:07.395 INFO:tasks.workunit.client.1.smithi148.stdout:1/221: stat dc/d11/d17/f3c 0 2024-09-18T12:49:07.396 INFO:tasks.workunit.client.1.smithi148.stdout:2/182: unlink d9/l12 0 2024-09-18T12:49:07.399 INFO:tasks.workunit.client.0.smithi078.stdout:8/113: dwrite d0/f18 [0,4194304] 0 2024-09-18T12:49:07.401 INFO:tasks.workunit.client.0.smithi078.stdout:1/139: creat d0/d8/f2b x:0 0 0 2024-09-18T12:49:07.402 INFO:tasks.workunit.client.0.smithi078.stdout:1/140: stat d0/d8/f14 0 2024-09-18T12:49:07.403 INFO:tasks.workunit.client.1.smithi148.stdout:5/243: creat d7/f4f x:0 0 0 2024-09-18T12:49:07.405 INFO:tasks.workunit.client.0.smithi078.stdout:5/209: mknod d2/d4/d9/da/c46 0 2024-09-18T12:49:07.407 INFO:tasks.workunit.client.1.smithi148.stdout:7/197: creat db/dd/d25/d2e/f36 x:0 0 0 2024-09-18T12:49:07.407 INFO:tasks.workunit.client.1.smithi148.stdout:9/169: dread d8/da/df/f12 [0,4194304] 0 2024-09-18T12:49:07.407 INFO:tasks.workunit.client.0.smithi078.stdout:2/162: getdents d4/db/d31 0 2024-09-18T12:49:07.408 INFO:tasks.workunit.client.1.smithi148.stdout:9/170: chown d8/f16 60 1 2024-09-18T12:49:07.410 INFO:tasks.workunit.client.0.smithi078.stdout:3/113: rename d9/lb to d9/d2a/l2c 0 2024-09-18T12:49:07.410 INFO:tasks.workunit.client.1.smithi148.stdout:7/198: write db/dc/f15 [1300119,96211] 0 2024-09-18T12:49:07.412 INFO:tasks.workunit.client.1.smithi148.stdout:9/171: read d8/da/dd/f1b [1024816,119943] 0 2024-09-18T12:49:07.413 INFO:tasks.workunit.client.1.smithi148.stdout:8/259: creat d8/d12/d46/f5a x:0 0 0 2024-09-18T12:49:07.414 INFO:tasks.workunit.client.1.smithi148.stdout:7/199: dread db/dc/df/d11/f1b [0,4194304] 0 2024-09-18T12:49:07.415 INFO:tasks.workunit.client.1.smithi148.stdout:3/195: stat d4/f18 0 2024-09-18T12:49:07.416 INFO:tasks.workunit.client.1.smithi148.stdout:7/200: stat db/dc/df/d11/d34 0 2024-09-18T12:49:07.416 INFO:tasks.workunit.client.0.smithi078.stdout:0/238: symlink d3/d43/l54 0 2024-09-18T12:49:07.418 INFO:tasks.workunit.client.1.smithi148.stdout:1/222: dread dc/d11/f16 [0,4194304] 0 2024-09-18T12:49:07.418 INFO:tasks.workunit.client.0.smithi078.stdout:3/114: dwrite f7 [0,4194304] 0 2024-09-18T12:49:07.418 INFO:tasks.workunit.client.0.smithi078.stdout:4/62: unlink d11/l17 0 2024-09-18T12:49:07.419 INFO:tasks.workunit.client.1.smithi148.stdout:7/201: truncate db/dc/df/f29 717080 0 2024-09-18T12:49:07.419 INFO:tasks.workunit.client.1.smithi148.stdout:9/172: dwrite d8/da/f2e [0,4194304] 0 2024-09-18T12:49:07.421 INFO:tasks.workunit.client.0.smithi078.stdout:3/115: dread d9/d2a/d19/f1e [0,4194304] 0 2024-09-18T12:49:07.423 INFO:tasks.workunit.client.1.smithi148.stdout:5/244: creat d7/d8/dc/d12/d31/f50 x:0 0 0 2024-09-18T12:49:07.423 INFO:tasks.workunit.client.1.smithi148.stdout:7/202: truncate db/dc/df/f35 36480 0 2024-09-18T12:49:07.423 INFO:tasks.workunit.client.0.smithi078.stdout:6/224: write ff [292231,102215] 0 2024-09-18T12:49:07.424 INFO:tasks.workunit.client.1.smithi148.stdout:6/259: dread d5/d1a/dc/d49/f4d [0,4194304] 0 2024-09-18T12:49:07.426 INFO:tasks.workunit.client.0.smithi078.stdout:6/225: read d10/f17 [4048894,117692] 0 2024-09-18T12:49:07.427 INFO:tasks.workunit.client.1.smithi148.stdout:6/260: dread d5/f23 [0,4194304] 0 2024-09-18T12:49:07.430 INFO:tasks.workunit.client.1.smithi148.stdout:8/260: symlink d8/d16/d53/d39/d3b/d41/l5b 0 2024-09-18T12:49:07.430 INFO:tasks.workunit.client.0.smithi078.stdout:6/226: dread f3 [4194304,4194304] 0 2024-09-18T12:49:07.431 INFO:tasks.workunit.client.0.smithi078.stdout:5/210: mkdir d2/d4/d9/d47 0 2024-09-18T12:49:07.433 INFO:tasks.workunit.client.0.smithi078.stdout:3/116: dwrite d9/f27 [0,4194304] 0 2024-09-18T12:49:07.434 INFO:tasks.workunit.client.0.smithi078.stdout:2/163: creat d4/d8/f37 x:0 0 0 2024-09-18T12:49:07.435 INFO:tasks.workunit.client.0.smithi078.stdout:2/164: readlink d4/dd/l27 0 2024-09-18T12:49:07.435 INFO:tasks.workunit.client.0.smithi078.stdout:3/117: chown d9/d2a/d19/c20 25917895 1 2024-09-18T12:49:07.436 INFO:tasks.workunit.client.0.smithi078.stdout:2/165: dread - d4/d8/f37 zero size 2024-09-18T12:49:07.437 INFO:tasks.workunit.client.0.smithi078.stdout:1/141: dread d0/d8/da/f23 [0,4194304] 0 2024-09-18T12:49:07.437 INFO:tasks.workunit.client.0.smithi078.stdout:3/118: write d9/df/d11/f1b [594672,6116] 0 2024-09-18T12:49:07.438 INFO:tasks.workunit.client.0.smithi078.stdout:3/119: chown d9 963 1 2024-09-18T12:49:07.438 INFO:tasks.workunit.client.0.smithi078.stdout:0/239: creat d3/d1f/d2e/d4e/d37/f55 x:0 0 0 2024-09-18T12:49:07.439 INFO:tasks.workunit.client.1.smithi148.stdout:1/223: readlink la 0 2024-09-18T12:49:07.441 INFO:tasks.workunit.client.1.smithi148.stdout:2/183: mkdir d9/d3a 0 2024-09-18T12:49:07.441 INFO:tasks.workunit.client.1.smithi148.stdout:1/224: write dc/fd [1835919,81516] 0 2024-09-18T12:49:07.443 INFO:tasks.workunit.client.1.smithi148.stdout:2/184: write d9/fd [288258,70766] 0 2024-09-18T12:49:07.444 INFO:tasks.workunit.client.0.smithi078.stdout:9/82: creat d5/f17 x:0 0 0 2024-09-18T12:49:07.453 INFO:tasks.workunit.client.0.smithi078.stdout:6/227: unlink d10/d2b/f2f 0 2024-09-18T12:49:07.456 INFO:tasks.workunit.client.1.smithi148.stdout:8/261: symlink d8/df/d3e/l5c 0 2024-09-18T12:49:07.457 INFO:tasks.workunit.client.0.smithi078.stdout:7/92: sync 2024-09-18T12:49:07.457 INFO:tasks.workunit.client.0.smithi078.stdout:2/166: dread d4/db/dc/f2f [0,4194304] 0 2024-09-18T12:49:07.458 INFO:tasks.workunit.client.1.smithi148.stdout:4/199: getdents d15/d3f 0 2024-09-18T12:49:07.458 INFO:tasks.workunit.client.1.smithi148.stdout:4/200: stat c6 0 2024-09-18T12:49:07.459 INFO:tasks.workunit.client.1.smithi148.stdout:4/201: chown l14 32572097 1 2024-09-18T12:49:07.462 INFO:tasks.workunit.client.1.smithi148.stdout:9/173: dwrite f7 [0,4194304] 0 2024-09-18T12:49:07.463 INFO:tasks.workunit.client.0.smithi078.stdout:9/83: mknod d5/d7/d8/c18 0 2024-09-18T12:49:07.465 INFO:tasks.workunit.client.0.smithi078.stdout:8/114: link d0/f21 d0/d7/f22 0 2024-09-18T12:49:07.466 INFO:tasks.workunit.client.1.smithi148.stdout:1/225: dread dc/d11/f12 [0,4194304] 0 2024-09-18T12:49:07.467 INFO:tasks.workunit.client.1.smithi148.stdout:1/226: fdatasync dc/f13 0 2024-09-18T12:49:07.468 INFO:tasks.workunit.client.1.smithi148.stdout:4/202: dwrite d15/d17/d1f/f21 [0,4194304] 0 2024-09-18T12:49:07.469 INFO:tasks.workunit.client.0.smithi078.stdout:5/211: mkdir d2/d4/d48 0 2024-09-18T12:49:07.471 INFO:tasks.workunit.client.0.smithi078.stdout:2/167: fdatasync d4/d1a/f22 0 2024-09-18T12:49:07.473 INFO:tasks.workunit.client.0.smithi078.stdout:1/142: write d0/fc [1564365,94268] 0 2024-09-18T12:49:07.474 INFO:tasks.workunit.client.0.smithi078.stdout:1/143: stat d0/d8/ce 0 2024-09-18T12:49:07.475 INFO:tasks.workunit.client.1.smithi148.stdout:9/174: symlink d8/da/df/l30 0 2024-09-18T12:49:07.475 INFO:tasks.workunit.client.1.smithi148.stdout:7/203: truncate f3 259168 0 2024-09-18T12:49:07.477 INFO:tasks.workunit.client.0.smithi078.stdout:0/240: symlink d3/d1f/l56 0 2024-09-18T12:49:07.478 INFO:tasks.workunit.client.1.smithi148.stdout:1/227: dwrite dc/d11/d17/f41 [0,4194304] 0 2024-09-18T12:49:07.478 INFO:tasks.workunit.client.1.smithi148.stdout:4/203: dwrite d15/d17/f2a [0,4194304] 0 2024-09-18T12:49:07.482 INFO:tasks.workunit.client.1.smithi148.stdout:5/245: truncate d7/d8/dc/d12/d31/f32 722952 0 2024-09-18T12:49:07.483 INFO:tasks.workunit.client.0.smithi078.stdout:1/144: dwrite d0/d8/da/f1f [0,4194304] 0 2024-09-18T12:49:07.484 INFO:tasks.workunit.client.1.smithi148.stdout:6/261: truncate d5/f2e 233871 0 2024-09-18T12:49:07.486 INFO:tasks.workunit.client.1.smithi148.stdout:0/400: sync 2024-09-18T12:49:07.488 INFO:tasks.workunit.client.1.smithi148.stdout:1/228: dread dc/f25 [0,4194304] 0 2024-09-18T12:49:07.488 INFO:tasks.workunit.client.1.smithi148.stdout:6/262: dread d5/ff [0,4194304] 0 2024-09-18T12:49:07.489 INFO:tasks.workunit.client.0.smithi078.stdout:9/84: rename d5/f9 to d5/d7/f19 0 2024-09-18T12:49:07.490 INFO:tasks.workunit.client.1.smithi148.stdout:0/401: dread - de/d14/d43/d57/d59/f5c zero size 2024-09-18T12:49:07.490 INFO:tasks.workunit.client.1.smithi148.stdout:0/402: readlink de/d27/d2e/l79 0 2024-09-18T12:49:07.491 INFO:tasks.workunit.client.0.smithi078.stdout:9/85: dread - d5/f17 zero size 2024-09-18T12:49:07.491 INFO:tasks.workunit.client.0.smithi078.stdout:9/86: chown d5 7 1 2024-09-18T12:49:07.491 INFO:tasks.workunit.client.0.smithi078.stdout:8/115: fsync d0/f1b 0 2024-09-18T12:49:07.494 INFO:tasks.workunit.client.0.smithi078.stdout:5/212: mkdir d2/d4/d9/d49 0 2024-09-18T12:49:07.494 INFO:tasks.workunit.client.1.smithi148.stdout:1/229: dread dc/d11/d17/f41 [0,4194304] 0 2024-09-18T12:49:07.495 INFO:tasks.workunit.client.1.smithi148.stdout:4/204: readlink d15/d17/d1f/l44 0 2024-09-18T12:49:07.496 INFO:tasks.workunit.client.1.smithi148.stdout:1/230: chown dc/d18/d43 1620674 1 2024-09-18T12:49:07.497 INFO:tasks.workunit.client.1.smithi148.stdout:9/175: dread d8/f26 [0,4194304] 0 2024-09-18T12:49:07.497 INFO:tasks.workunit.client.0.smithi078.stdout:0/241: creat d3/d1f/d2e/d4e/d37/f57 x:0 0 0 2024-09-18T12:49:07.498 INFO:tasks.workunit.client.1.smithi148.stdout:5/246: stat d7/d8/dc/d12/d1f/l42 0 2024-09-18T12:49:07.498 INFO:tasks.workunit.client.0.smithi078.stdout:1/145: stat d0/c20 0 2024-09-18T12:49:07.499 INFO:tasks.workunit.client.0.smithi078.stdout:4/63: getdents d11 0 2024-09-18T12:49:07.499 INFO:tasks.workunit.client.1.smithi148.stdout:6/263: chown d5/d1a/c15 26 1 2024-09-18T12:49:07.500 INFO:tasks.workunit.client.0.smithi078.stdout:1/146: dread - d0/d8/f26 zero size 2024-09-18T12:49:07.501 INFO:tasks.workunit.client.0.smithi078.stdout:4/64: dread - d11/f16 zero size 2024-09-18T12:49:07.502 INFO:tasks.workunit.client.1.smithi148.stdout:2/185: getdents d9/d24/d27 0 2024-09-18T12:49:07.503 INFO:tasks.workunit.client.0.smithi078.stdout:8/116: mkdir d0/d7/dc/d1f/d23 0 2024-09-18T12:49:07.504 INFO:tasks.workunit.client.0.smithi078.stdout:6/228: link d10/l34 d10/d27/l39 0 2024-09-18T12:49:07.506 INFO:tasks.workunit.client.0.smithi078.stdout:8/117: stat d0/d7/dc/d1f/d23 0 2024-09-18T12:49:07.506 INFO:tasks.workunit.client.0.smithi078.stdout:0/242: dwrite d3/d1f/d2e/d4e/d37/f51 [0,4194304] 0 2024-09-18T12:49:07.507 INFO:tasks.workunit.client.1.smithi148.stdout:1/231: symlink dc/d18/l4f 0 2024-09-18T12:49:07.507 INFO:tasks.workunit.client.0.smithi078.stdout:8/118: truncate d0/f1b 1212224 0 2024-09-18T12:49:07.508 INFO:tasks.workunit.client.1.smithi148.stdout:4/205: rmdir d15/d17/d1f 39 2024-09-18T12:49:07.508 INFO:tasks.workunit.client.0.smithi078.stdout:8/119: chown d0/d7/dc/d1f 62411030 1 2024-09-18T12:49:07.509 INFO:tasks.workunit.client.0.smithi078.stdout:1/147: rename d0/fc to d0/d8/f2c 0 2024-09-18T12:49:07.510 INFO:tasks.workunit.client.1.smithi148.stdout:8/262: link f1 d8/d16/f5d 0 2024-09-18T12:49:07.510 INFO:tasks.workunit.client.1.smithi148.stdout:3/196: sync 2024-09-18T12:49:07.511 INFO:tasks.workunit.client.0.smithi078.stdout:1/148: write d0/d8/f2b [591723,18443] 0 2024-09-18T12:49:07.514 INFO:tasks.workunit.client.0.smithi078.stdout:8/120: dread d0/d7/f8 [0,4194304] 0 2024-09-18T12:49:07.514 INFO:tasks.workunit.client.1.smithi148.stdout:9/176: creat d8/da/dd/f31 x:0 0 0 2024-09-18T12:49:07.515 INFO:tasks.workunit.client.1.smithi148.stdout:9/177: fdatasync f0 0 2024-09-18T12:49:07.515 INFO:tasks.workunit.client.0.smithi078.stdout:6/229: symlink d10/l3a 0 2024-09-18T12:49:07.518 INFO:tasks.workunit.client.1.smithi148.stdout:6/264: unlink d5/c25 0 2024-09-18T12:49:07.519 INFO:tasks.workunit.client.1.smithi148.stdout:3/197: dread d4/f18 [0,4194304] 0 2024-09-18T12:49:07.521 INFO:tasks.workunit.client.0.smithi078.stdout:5/213: truncate d2/f26 688549 0 2024-09-18T12:49:07.521 INFO:tasks.workunit.client.1.smithi148.stdout:3/198: chown d4/d8/d20/l2e 3 1 2024-09-18T12:49:07.521 INFO:tasks.workunit.client.0.smithi078.stdout:5/214: chown d2/d4/d9/da/d2b/d45 12815 1 2024-09-18T12:49:07.522 INFO:tasks.workunit.client.1.smithi148.stdout:3/199: chown d4/d8/d20/d2b/f2c 31 1 2024-09-18T12:49:07.522 INFO:tasks.workunit.client.0.smithi078.stdout:3/120: truncate d9/f27 3585356 0 2024-09-18T12:49:07.523 INFO:tasks.workunit.client.0.smithi078.stdout:4/65: getdents d11 0 2024-09-18T12:49:07.524 INFO:tasks.workunit.client.0.smithi078.stdout:4/66: truncate d11/f16 1000197 0 2024-09-18T12:49:07.529 INFO:tasks.workunit.client.0.smithi078.stdout:2/168: dread d4/db/f1c [0,4194304] 0 2024-09-18T12:49:07.529 INFO:tasks.workunit.client.0.smithi078.stdout:4/67: dread d11/f14 [0,4194304] 0 2024-09-18T12:49:07.529 INFO:tasks.workunit.client.0.smithi078.stdout:2/169: stat d4/dd/d18/c19 0 2024-09-18T12:49:07.530 INFO:tasks.workunit.client.0.smithi078.stdout:0/243: rename d3/d1f/d25 to d3/d1f/d2e/d58 0 2024-09-18T12:49:07.531 INFO:tasks.workunit.client.0.smithi078.stdout:4/68: write d11/f14 [59724,90314] 0 2024-09-18T12:49:07.533 INFO:tasks.workunit.client.0.smithi078.stdout:4/69: dread d11/f16 [0,4194304] 0 2024-09-18T12:49:07.533 INFO:tasks.workunit.client.0.smithi078.stdout:1/149: unlink d0/f24 0 2024-09-18T12:49:07.534 INFO:tasks.workunit.client.1.smithi148.stdout:8/263: symlink d8/d12/l5e 0 2024-09-18T12:49:07.537 INFO:tasks.workunit.client.0.smithi078.stdout:9/87: getdents d5/d7/d8 0 2024-09-18T12:49:07.538 INFO:tasks.workunit.client.1.smithi148.stdout:7/204: truncate db/dc/f12 753610 0 2024-09-18T12:49:07.538 INFO:tasks.workunit.client.1.smithi148.stdout:6/265: dread d5/d32/f33 [0,4194304] 0 2024-09-18T12:49:07.540 INFO:tasks.workunit.client.1.smithi148.stdout:9/178: symlink d8/da/l32 0 2024-09-18T12:49:07.544 INFO:tasks.workunit.client.0.smithi078.stdout:2/170: mknod d4/dd/d18/c38 0 2024-09-18T12:49:07.545 INFO:tasks.workunit.client.0.smithi078.stdout:9/88: dread d5/d7/d8/fd [0,4194304] 0 2024-09-18T12:49:07.545 INFO:tasks.workunit.client.0.smithi078.stdout:2/171: chown d4/db/dc/f34 299707086 1 2024-09-18T12:49:07.547 INFO:tasks.workunit.client.0.smithi078.stdout:6/230: rename d10/d27/l36 to d10/d2b/l3b 0 2024-09-18T12:49:07.548 INFO:tasks.workunit.client.1.smithi148.stdout:3/200: write d4/d8/d20/f33 [466459,31565] 0 2024-09-18T12:49:07.550 INFO:tasks.workunit.client.1.smithi148.stdout:2/186: creat d9/d17/d29/f3b x:0 0 0 2024-09-18T12:49:07.552 INFO:tasks.workunit.client.0.smithi078.stdout:9/89: dwrite d5/d7/d8/f16 [0,4194304] 0 2024-09-18T12:49:07.553 INFO:tasks.workunit.client.1.smithi148.stdout:5/247: dwrite d7/d8/f13 [0,4194304] 0 2024-09-18T12:49:07.553 INFO:tasks.workunit.client.1.smithi148.stdout:5/248: chown d7/d8/dc/d12/d1f/d25 1 1 2024-09-18T12:49:07.555 INFO:tasks.workunit.client.1.smithi148.stdout:1/232: mknod dc/d18/d31/d4b/c50 0 2024-09-18T12:49:07.556 INFO:tasks.workunit.client.0.smithi078.stdout:4/70: rmdir d11 39 2024-09-18T12:49:07.562 INFO:tasks.workunit.client.1.smithi148.stdout:7/205: creat db/dc/f37 x:0 0 0 2024-09-18T12:49:07.564 INFO:tasks.workunit.client.0.smithi078.stdout:5/215: unlink d2/d4/d12/l25 0 2024-09-18T12:49:07.565 INFO:tasks.workunit.client.0.smithi078.stdout:5/216: read d2/d4/d9/f13 [1054192,6532] 0 2024-09-18T12:49:07.565 INFO:tasks.workunit.client.1.smithi148.stdout:6/266: unlink d5/d1a/f22 0 2024-09-18T12:49:07.568 INFO:tasks.workunit.client.1.smithi148.stdout:9/179: mkdir d8/d33 0 2024-09-18T12:49:07.568 INFO:tasks.workunit.client.1.smithi148.stdout:9/180: write f7 [739169,71414] 0 2024-09-18T12:49:07.574 INFO:tasks.workunit.client.1.smithi148.stdout:3/201: creat d4/d8/d20/d2b/f45 x:0 0 0 2024-09-18T12:49:07.574 INFO:tasks.workunit.client.0.smithi078.stdout:2/172: dwrite d4/d1a/f30 [0,4194304] 0 2024-09-18T12:49:07.580 INFO:tasks.workunit.client.0.smithi078.stdout:9/90: unlink d5/d7/d8/fe 0 2024-09-18T12:49:07.583 INFO:tasks.workunit.client.1.smithi148.stdout:0/403: link de/d14/l8e de/d14/l8f 0 2024-09-18T12:49:07.583 INFO:tasks.workunit.client.0.smithi078.stdout:2/173: dwrite d4/d1a/f2e [4194304,4194304] 0 2024-09-18T12:49:07.584 INFO:tasks.workunit.client.0.smithi078.stdout:2/174: write d4/f9 [3577263,22307] 0 2024-09-18T12:49:07.585 INFO:tasks.workunit.client.0.smithi078.stdout:2/175: chown d4/db/dc/l2c 22 1 2024-09-18T12:49:07.586 INFO:tasks.workunit.client.0.smithi078.stdout:2/176: chown d4/d20 26028069 1 2024-09-18T12:49:07.587 INFO:tasks.workunit.client.0.smithi078.stdout:2/177: rename d4 to d4/dd/d18/d33/d39 22 2024-09-18T12:49:07.589 INFO:tasks.workunit.client.0.smithi078.stdout:8/121: creat d0/d7/f24 x:0 0 0 2024-09-18T12:49:07.593 INFO:tasks.workunit.client.0.smithi078.stdout:6/231: symlink d10/d2b/d37/l3c 0 2024-09-18T12:49:07.597 INFO:tasks.workunit.client.1.smithi148.stdout:8/264: rename d8/c31 to d8/d12/c5f 0 2024-09-18T12:49:07.598 INFO:tasks.workunit.client.1.smithi148.stdout:7/206: write db/dc/df/d11/f1b [771268,966] 0 2024-09-18T12:49:07.601 INFO:tasks.workunit.client.1.smithi148.stdout:6/267: dread d5/ff [0,4194304] 0 2024-09-18T12:49:07.603 INFO:tasks.workunit.client.0.smithi078.stdout:4/71: symlink d11/l19 0 2024-09-18T12:49:07.603 INFO:tasks.workunit.client.0.smithi078.stdout:4/72: stat cf 0 2024-09-18T12:49:07.605 INFO:tasks.workunit.client.0.smithi078.stdout:0/244: truncate d3/f18 3991667 0 2024-09-18T12:49:07.607 INFO:tasks.workunit.client.0.smithi078.stdout:1/150: write d0/f13 [456432,126596] 0 2024-09-18T12:49:07.608 INFO:tasks.workunit.client.1.smithi148.stdout:2/187: mknod d9/d3a/c3c 0 2024-09-18T12:49:07.608 INFO:tasks.workunit.client.0.smithi078.stdout:1/151: chown d0/l25 90 1 2024-09-18T12:49:07.610 INFO:tasks.workunit.client.1.smithi148.stdout:0/404: creat de/d14/d43/d70/f90 x:0 0 0 2024-09-18T12:49:07.611 INFO:tasks.workunit.client.0.smithi078.stdout:0/245: dwrite d3/d1f/d2e/d58/f44 [0,4194304] 0 2024-09-18T12:49:07.616 INFO:tasks.workunit.client.0.smithi078.stdout:0/246: dread d3/d1f/d2e/f35 [4194304,4194304] 0 2024-09-18T12:49:07.616 INFO:tasks.workunit.client.1.smithi148.stdout:1/233: mkdir dc/d51 0 2024-09-18T12:49:07.617 INFO:tasks.workunit.client.1.smithi148.stdout:1/234: write dc/d11/f1a [3919067,83560] 0 2024-09-18T12:49:07.619 INFO:tasks.workunit.client.1.smithi148.stdout:4/206: link d15/d3f/c48 d15/d17/c49 0 2024-09-18T12:49:07.619 INFO:tasks.workunit.client.0.smithi078.stdout:9/91: write f0 [5202512,29628] 0 2024-09-18T12:49:07.620 INFO:tasks.workunit.client.1.smithi148.stdout:4/207: write f0 [6085558,23735] 0 2024-09-18T12:49:07.620 INFO:tasks.workunit.client.0.smithi078.stdout:6/232: mknod d10/d27/c3d 0 2024-09-18T12:49:07.623 INFO:tasks.workunit.client.1.smithi148.stdout:7/207: mkdir db/dd/d25/d38 0 2024-09-18T12:49:07.624 INFO:tasks.workunit.client.1.smithi148.stdout:8/265: dread d8/fb [0,4194304] 0 2024-09-18T12:49:07.625 INFO:tasks.workunit.client.1.smithi148.stdout:7/208: write db/dc/f37 [397860,43410] 0 2024-09-18T12:49:07.626 INFO:tasks.workunit.client.0.smithi078.stdout:1/152: rename d0/d8/da/f1f to d0/d21/f2d 0 2024-09-18T12:49:07.627 INFO:tasks.workunit.client.1.smithi148.stdout:4/208: dwrite d15/d17/f1c [4194304,4194304] 0 2024-09-18T12:49:07.627 INFO:tasks.workunit.client.0.smithi078.stdout:2/178: mknod d4/d8/d23/c3a 0 2024-09-18T12:49:07.627 INFO:tasks.workunit.client.0.smithi078.stdout:6/233: dwrite d10/f1b [0,4194304] 0 2024-09-18T12:49:07.630 INFO:tasks.workunit.client.0.smithi078.stdout:8/122: creat d0/d7/dc/d1f/d23/f25 x:0 0 0 2024-09-18T12:49:07.631 INFO:tasks.workunit.client.1.smithi148.stdout:9/181: creat d8/d33/f34 x:0 0 0 2024-09-18T12:49:07.631 INFO:tasks.workunit.client.0.smithi078.stdout:8/123: chown d0/d7/fb 2034164 1 2024-09-18T12:49:07.632 INFO:tasks.workunit.client.1.smithi148.stdout:3/202: mkdir d4/d2d/d31/d46 0 2024-09-18T12:49:07.632 INFO:tasks.workunit.client.0.smithi078.stdout:0/247: creat d3/d1f/d2e/d58/d30/f59 x:0 0 0 2024-09-18T12:49:07.632 INFO:tasks.workunit.client.0.smithi078.stdout:0/248: chown d3/d1f/d2e/d58/d30/f39 498535 1 2024-09-18T12:49:07.633 INFO:tasks.workunit.client.0.smithi078.stdout:9/92: truncate f3 3093605 0 2024-09-18T12:49:07.633 INFO:tasks.workunit.client.0.smithi078.stdout:9/93: stat d5/d7/fc 0 2024-09-18T12:49:07.633 INFO:tasks.workunit.client.1.smithi148.stdout:2/188: creat d9/d24/d31/f3d x:0 0 0 2024-09-18T12:49:07.634 INFO:tasks.workunit.client.0.smithi078.stdout:9/94: dread - d5/f15 zero size 2024-09-18T12:49:07.635 INFO:tasks.workunit.client.0.smithi078.stdout:9/95: truncate d5/d7/f19 1327592 0 2024-09-18T12:49:07.637 INFO:tasks.workunit.client.1.smithi148.stdout:8/266: dwrite d8/d16/f4d [0,4194304] 0 2024-09-18T12:49:07.637 INFO:tasks.workunit.client.1.smithi148.stdout:2/189: fdatasync d9/d24/f2f 0 2024-09-18T12:49:07.637 INFO:tasks.workunit.client.1.smithi148.stdout:3/203: chown d4/d8/d20/f33 37809 1 2024-09-18T12:49:07.637 INFO:tasks.workunit.client.0.smithi078.stdout:1/153: rmdir d0/d8 39 2024-09-18T12:49:07.639 INFO:tasks.workunit.client.1.smithi148.stdout:8/267: fdatasync d8/f4b 0 2024-09-18T12:49:07.639 INFO:tasks.workunit.client.0.smithi078.stdout:6/234: symlink d10/l3e 0 2024-09-18T12:49:07.640 INFO:tasks.workunit.client.0.smithi078.stdout:6/235: chown d10/d2b/l35 196975871 1 2024-09-18T12:49:07.642 INFO:tasks.workunit.client.1.smithi148.stdout:7/209: mknod db/dc/df/d11/c39 0 2024-09-18T12:49:07.642 INFO:tasks.workunit.client.1.smithi148.stdout:8/268: write d8/d16/d53/d39/d3b/d41/f4f [728957,112462] 0 2024-09-18T12:49:07.643 INFO:tasks.workunit.client.1.smithi148.stdout:6/268: dwrite d5/f23 [0,4194304] 0 2024-09-18T12:49:07.644 INFO:tasks.workunit.client.1.smithi148.stdout:9/182: dread f7 [0,4194304] 0 2024-09-18T12:49:07.645 INFO:tasks.workunit.client.0.smithi078.stdout:8/124: creat d0/d7/dc/f26 x:0 0 0 2024-09-18T12:49:07.647 INFO:tasks.workunit.client.0.smithi078.stdout:8/125: write d0/f2 [4270463,87589] 0 2024-09-18T12:49:07.648 INFO:tasks.workunit.client.0.smithi078.stdout:8/126: write d0/d7/f24 [571622,19941] 0 2024-09-18T12:49:07.648 INFO:tasks.workunit.client.0.smithi078.stdout:0/249: rmdir d3/d1f/d2e/d58/d30 39 2024-09-18T12:49:07.649 INFO:tasks.workunit.client.1.smithi148.stdout:8/269: dread d8/f4b [0,4194304] 0 2024-09-18T12:49:07.651 INFO:tasks.workunit.client.0.smithi078.stdout:4/73: link d11/f16 d11/f1a 0 2024-09-18T12:49:07.651 INFO:tasks.workunit.client.0.smithi078.stdout:4/74: readlink d11/l15 0 2024-09-18T12:49:07.653 INFO:tasks.workunit.client.1.smithi148.stdout:0/405: creat de/d27/d53/d89/f91 x:0 0 0 2024-09-18T12:49:07.653 INFO:tasks.workunit.client.1.smithi148.stdout:0/406: write de/d27/f8a [571642,19438] 0 2024-09-18T12:49:07.654 INFO:tasks.workunit.client.1.smithi148.stdout:0/407: dread - de/f55 zero size 2024-09-18T12:49:07.655 INFO:tasks.workunit.client.1.smithi148.stdout:5/249: getdents d7/d8/dc/d12/d20 0 2024-09-18T12:49:07.657 INFO:tasks.workunit.client.0.smithi078.stdout:4/75: dread d11/f12 [0,4194304] 0 2024-09-18T12:49:07.658 INFO:tasks.workunit.client.1.smithi148.stdout:1/235: symlink dc/d51/l52 0 2024-09-18T12:49:07.659 INFO:tasks.workunit.client.1.smithi148.stdout:1/236: read - dc/d11/d17/f35 zero size 2024-09-18T12:49:07.659 INFO:tasks.workunit.client.0.smithi078.stdout:6/236: mkdir d10/d27/d3f 0 2024-09-18T12:49:07.661 INFO:tasks.workunit.client.0.smithi078.stdout:6/237: write ff [4026090,8604] 0 2024-09-18T12:49:07.664 INFO:tasks.workunit.client.0.smithi078.stdout:1/154: dwrite d0/d8/f2b [0,4194304] 0 2024-09-18T12:49:07.667 INFO:tasks.workunit.client.0.smithi078.stdout:0/250: rmdir d3/d43 39 2024-09-18T12:49:07.669 INFO:tasks.workunit.client.0.smithi078.stdout:8/127: rmdir d0/d7/dc/d1f/d23 39 2024-09-18T12:49:07.670 INFO:tasks.workunit.client.1.smithi148.stdout:3/204: dread d4/d8/d20/d2b/f2c [0,4194304] 0 2024-09-18T12:49:07.670 INFO:tasks.workunit.client.0.smithi078.stdout:8/128: chown d0/f1 302533 1 2024-09-18T12:49:07.671 INFO:tasks.workunit.client.1.smithi148.stdout:7/210: creat db/dc/df/d11/f3a x:0 0 0 2024-09-18T12:49:07.672 INFO:tasks.workunit.client.0.smithi078.stdout:8/129: stat d0/d7/dc/lf 0 2024-09-18T12:49:07.672 INFO:tasks.workunit.client.1.smithi148.stdout:7/211: write db/dc/f37 [952254,117855] 0 2024-09-18T12:49:07.672 INFO:tasks.workunit.client.0.smithi078.stdout:8/130: fsync d0/f16 0 2024-09-18T12:49:07.673 INFO:tasks.workunit.client.1.smithi148.stdout:1/237: dread f8 [0,4194304] 0 2024-09-18T12:49:07.673 INFO:tasks.workunit.client.1.smithi148.stdout:7/212: fdatasync db/dc/df/d11/f1b 0 2024-09-18T12:49:07.673 INFO:tasks.workunit.client.0.smithi078.stdout:8/131: chown d0/d7/f8 118 1 2024-09-18T12:49:07.674 INFO:tasks.workunit.client.0.smithi078.stdout:8/132: stat d0 0 2024-09-18T12:49:07.674 INFO:tasks.workunit.client.0.smithi078.stdout:8/133: readlink d0/d7/dc/lf 0 2024-09-18T12:49:07.674 INFO:tasks.workunit.client.1.smithi148.stdout:9/183: mkdir d8/da/dd/d35 0 2024-09-18T12:49:07.675 INFO:tasks.workunit.client.0.smithi078.stdout:8/134: write d0/f14 [3706089,76296] 0 2024-09-18T12:49:07.677 INFO:tasks.workunit.client.1.smithi148.stdout:6/269: rename d5/d1a/dc/d49 to d5/d32/d56 0 2024-09-18T12:49:07.678 INFO:tasks.workunit.client.1.smithi148.stdout:1/238: dwrite fb [0,4194304] 0 2024-09-18T12:49:07.680 INFO:tasks.workunit.client.0.smithi078.stdout:2/179: write d4/db/f1c [3506765,91340] 0 2024-09-18T12:49:07.680 INFO:tasks.workunit.client.1.smithi148.stdout:1/239: write dc/d18/f3f [89569,26951] 0 2024-09-18T12:49:07.682 INFO:tasks.workunit.client.1.smithi148.stdout:8/270: mknod d8/d16/d53/d39/d3b/d41/c60 0 2024-09-18T12:49:07.683 INFO:tasks.workunit.client.1.smithi148.stdout:0/408: fdatasync de/d14/f83 0 2024-09-18T12:49:07.683 INFO:tasks.workunit.client.0.smithi078.stdout:6/238: rmdir d10/d2b/d37 39 2024-09-18T12:49:07.685 INFO:tasks.workunit.client.0.smithi078.stdout:1/155: creat d0/d21/f2e x:0 0 0 2024-09-18T12:49:07.686 INFO:tasks.workunit.client.1.smithi148.stdout:1/240: dread dc/d11/d17/f3c [0,4194304] 0 2024-09-18T12:49:07.686 INFO:tasks.workunit.client.1.smithi148.stdout:1/241: chown dc/d11/f16 26 1 2024-09-18T12:49:07.687 INFO:tasks.workunit.client.0.smithi078.stdout:0/251: truncate d3/f1d 4857143 0 2024-09-18T12:49:07.691 INFO:tasks.workunit.client.1.smithi148.stdout:2/190: dwrite d9/d24/d27/f38 [0,4194304] 0 2024-09-18T12:49:07.693 INFO:tasks.workunit.client.1.smithi148.stdout:2/191: write d9/fd [119774,46174] 0 2024-09-18T12:49:07.693 INFO:tasks.workunit.client.1.smithi148.stdout:3/205: creat d4/d2d/f47 x:0 0 0 2024-09-18T12:49:07.694 INFO:tasks.workunit.client.0.smithi078.stdout:9/96: truncate d5/d7/f19 109432 0 2024-09-18T12:49:07.694 INFO:tasks.workunit.client.0.smithi078.stdout:8/135: dread d0/f1 [0,4194304] 0 2024-09-18T12:49:07.699 INFO:tasks.workunit.client.0.smithi078.stdout:6/239: chown d10/d2b/l3b 212485458 1 2024-09-18T12:49:07.700 INFO:tasks.workunit.client.0.smithi078.stdout:6/240: stat d10/f1b 0 2024-09-18T12:49:07.701 INFO:tasks.workunit.client.0.smithi078.stdout:9/97: dwrite d5/f15 [0,4194304] 0 2024-09-18T12:49:07.702 INFO:tasks.workunit.client.0.smithi078.stdout:1/156: mkdir d0/d8/d2f 0 2024-09-18T12:49:07.705 INFO:tasks.workunit.client.0.smithi078.stdout:0/252: creat d3/d1f/d2e/d4e/d37/f5a x:0 0 0 2024-09-18T12:49:07.707 INFO:tasks.workunit.client.1.smithi148.stdout:5/250: dread d7/f15 [0,4194304] 0 2024-09-18T12:49:07.708 INFO:tasks.workunit.client.1.smithi148.stdout:5/251: chown d7/f1b 1 1 2024-09-18T12:49:07.709 INFO:tasks.workunit.client.1.smithi148.stdout:6/270: read d5/d32/f33 [75185,13372] 0 2024-09-18T12:49:07.709 INFO:tasks.workunit.client.0.smithi078.stdout:4/76: link l2 d11/l1b 0 2024-09-18T12:49:07.709 INFO:tasks.workunit.client.1.smithi148.stdout:5/252: write d7/d8/dc/d12/d20/f2e [1794701,23231] 0 2024-09-18T12:49:07.711 INFO:tasks.workunit.client.0.smithi078.stdout:1/157: dread d0/f19 [0,4194304] 0 2024-09-18T12:49:07.711 INFO:tasks.workunit.client.1.smithi148.stdout:5/253: read d7/d8/dc/d12/f24 [542086,61758] 0 2024-09-18T12:49:07.712 INFO:tasks.workunit.client.1.smithi148.stdout:5/254: chown d7/d2b/f3c 21 1 2024-09-18T12:49:07.715 INFO:tasks.workunit.client.1.smithi148.stdout:0/409: rename de/d14/d43/d57/d59/f7c to de/d27/d7a/f92 0 2024-09-18T12:49:07.716 INFO:tasks.workunit.client.1.smithi148.stdout:4/209: getdents d15/d1d/d34 0 2024-09-18T12:49:07.716 INFO:tasks.workunit.client.1.smithi148.stdout:0/410: truncate de/d27/f45 946379 0 2024-09-18T12:49:07.718 INFO:tasks.workunit.client.1.smithi148.stdout:2/192: creat d9/d17/d29/f3e x:0 0 0 2024-09-18T12:49:07.718 INFO:tasks.workunit.client.0.smithi078.stdout:0/253: truncate d3/d1f/d2e/d58/d30/f59 296197 0 2024-09-18T12:49:07.719 INFO:tasks.workunit.client.0.smithi078.stdout:4/77: unlink c10 0 2024-09-18T12:49:07.720 INFO:tasks.workunit.client.1.smithi148.stdout:3/206: mknod d4/d8/d20/d2b/c48 0 2024-09-18T12:49:07.721 INFO:tasks.workunit.client.0.smithi078.stdout:6/241: mkdir d10/d27/d3f/d40 0 2024-09-18T12:49:07.722 INFO:tasks.workunit.client.0.smithi078.stdout:6/242: read ff [4110372,92752] 0 2024-09-18T12:49:07.722 INFO:tasks.workunit.client.1.smithi148.stdout:7/213: mknod db/c3b 0 2024-09-18T12:49:07.728 INFO:tasks.workunit.client.0.smithi078.stdout:9/98: rename d5/d7/f19 to d5/d7/d8/f1a 0 2024-09-18T12:49:07.730 INFO:tasks.workunit.client.1.smithi148.stdout:6/271: creat d5/d1a/dc/d2b/f57 x:0 0 0 2024-09-18T12:49:07.731 INFO:tasks.workunit.client.0.smithi078.stdout:8/136: creat d0/d7/f27 x:0 0 0 2024-09-18T12:49:07.735 INFO:tasks.workunit.client.0.smithi078.stdout:6/243: rename d10/f1b to d10/f41 0 2024-09-18T12:49:07.736 INFO:tasks.workunit.client.0.smithi078.stdout:6/244: read d10/d27/f2d [495768,103240] 0 2024-09-18T12:49:07.740 INFO:tasks.workunit.client.0.smithi078.stdout:0/254: rename d3/c2c to d3/d1f/d2e/d4e/c5b 0 2024-09-18T12:49:07.742 INFO:tasks.workunit.client.1.smithi148.stdout:9/184: write d8/da/f1d [1095606,71410] 0 2024-09-18T12:49:07.746 INFO:tasks.workunit.client.1.smithi148.stdout:2/193: creat d9/d24/f3f x:0 0 0 2024-09-18T12:49:07.747 INFO:tasks.workunit.client.1.smithi148.stdout:8/271: write f1 [2394353,26906] 0 2024-09-18T12:49:07.747 INFO:tasks.workunit.client.0.smithi078.stdout:6/245: fsync d10/f1c 0 2024-09-18T12:49:07.804 INFO:tasks.workunit.client.1.smithi148.stdout:7/214: rename db/dd/d25/d2e/f36 to db/dd/d25/f3c 0 2024-09-18T12:49:07.805 INFO:tasks.workunit.client.1.smithi148.stdout:7/215: readlink l6 0 2024-09-18T12:49:07.806 INFO:tasks.workunit.client.0.smithi078.stdout:9/99: mknod d5/c1b 0 2024-09-18T12:49:07.806 INFO:tasks.workunit.client.0.smithi078.stdout:9/100: chown d5/d7/d8/f14 64826108 1 2024-09-18T12:49:07.806 INFO:tasks.workunit.client.0.smithi078.stdout:9/101: stat d5/f15 0 2024-09-18T12:49:07.807 INFO:tasks.workunit.client.1.smithi148.stdout:6/272: creat d5/d32/f58 x:0 0 0 2024-09-18T12:49:07.811 INFO:tasks.workunit.client.1.smithi148.stdout:1/242: creat dc/d11/f53 x:0 0 0 2024-09-18T12:49:07.812 INFO:tasks.workunit.client.0.smithi078.stdout:1/158: getdents d0/d8 0 2024-09-18T12:49:07.813 INFO:tasks.workunit.client.1.smithi148.stdout:4/210: symlink d15/d17/l4a 0 2024-09-18T12:49:07.816 INFO:tasks.workunit.client.1.smithi148.stdout:0/411: mkdir de/d14/d93 0 2024-09-18T12:49:07.816 INFO:tasks.workunit.client.0.smithi078.stdout:9/102: mkdir d5/d7/d8/d1c 0 2024-09-18T12:49:07.817 INFO:tasks.workunit.client.0.smithi078.stdout:9/103: chown d5/d7/d8/d1c 30 1 2024-09-18T12:49:07.818 INFO:tasks.workunit.client.0.smithi078.stdout:8/137: creat d0/d7/dc/d1f/f28 x:0 0 0 2024-09-18T12:49:07.819 INFO:tasks.workunit.client.0.smithi078.stdout:4/78: link c7 d11/c1c 0 2024-09-18T12:49:07.820 INFO:tasks.workunit.client.0.smithi078.stdout:6/246: write ff [17612,38256] 0 2024-09-18T12:49:07.821 INFO:tasks.workunit.client.0.smithi078.stdout:0/255: creat d3/d1f/d2e/d4e/d37/f5c x:0 0 0 2024-09-18T12:49:07.824 INFO:tasks.workunit.client.1.smithi148.stdout:6/273: creat d5/d32/d38/d50/f59 x:0 0 0 2024-09-18T12:49:07.824 INFO:tasks.workunit.client.0.smithi078.stdout:8/138: truncate d0/d7/f8 1070757 0 2024-09-18T12:49:07.825 INFO:tasks.workunit.client.1.smithi148.stdout:5/255: creat d7/d8/dc/d12/f51 x:0 0 0 2024-09-18T12:49:07.827 INFO:tasks.workunit.client.0.smithi078.stdout:6/247: rename d10/f14 to d10/d27/d3f/d40/f42 0 2024-09-18T12:49:07.831 INFO:tasks.workunit.client.0.smithi078.stdout:9/104: link d5/d7/d8/f14 d5/d7/d8/f1d 0 2024-09-18T12:49:07.833 INFO:tasks.workunit.client.0.smithi078.stdout:9/105: chown d5/d7/d8/fd 738361 1 2024-09-18T12:49:07.834 INFO:tasks.workunit.client.0.smithi078.stdout:6/248: dwrite d10/f21 [0,4194304] 0 2024-09-18T12:49:07.840 INFO:tasks.workunit.client.0.smithi078.stdout:4/79: dwrite d11/f14 [0,4194304] 0 2024-09-18T12:49:07.841 INFO:tasks.workunit.client.0.smithi078.stdout:6/249: dread d10/d27/d3f/d40/f42 [4194304,4194304] 0 2024-09-18T12:49:07.842 INFO:tasks.workunit.client.0.smithi078.stdout:0/256: creat d3/d43/f5d x:0 0 0 2024-09-18T12:49:07.843 INFO:tasks.workunit.client.1.smithi148.stdout:8/272: truncate d8/d12/f2c 5898434 0 2024-09-18T12:49:07.844 INFO:tasks.workunit.client.0.smithi078.stdout:0/257: write f2 [6770168,129230] 0 2024-09-18T12:49:07.845 INFO:tasks.workunit.client.1.smithi148.stdout:7/216: mknod db/dd/d25/d38/c3d 0 2024-09-18T12:49:07.846 INFO:tasks.workunit.client.0.smithi078.stdout:0/258: dread - d3/f47 zero size 2024-09-18T12:49:07.846 INFO:tasks.workunit.client.0.smithi078.stdout:9/106: rmdir d5/d7 39 2024-09-18T12:49:07.849 INFO:tasks.workunit.client.0.smithi078.stdout:8/139: mkdir d0/d7/dc/d1f/d23/d29 0 2024-09-18T12:49:07.850 INFO:tasks.workunit.client.1.smithi148.stdout:1/243: symlink dc/l54 0 2024-09-18T12:49:07.851 INFO:tasks.workunit.client.1.smithi148.stdout:1/244: chown dc/c22 173699703 1 2024-09-18T12:49:07.853 INFO:tasks.workunit.client.1.smithi148.stdout:5/256: creat d7/d8/dc/d12/d1f/d25/f52 x:0 0 0 2024-09-18T12:49:07.853 INFO:tasks.workunit.client.0.smithi078.stdout:8/140: dread d0/d7/f24 [0,4194304] 0 2024-09-18T12:49:07.853 INFO:tasks.workunit.client.0.smithi078.stdout:4/80: fdatasync d11/f12 0 2024-09-18T12:49:07.854 INFO:tasks.workunit.client.1.smithi148.stdout:9/185: link d8/da/df/d27/l2b d8/da/df/d27/l36 0 2024-09-18T12:49:07.857 INFO:tasks.workunit.client.1.smithi148.stdout:2/194: link d9/d24/d27/f38 d9/f40 0 2024-09-18T12:49:07.859 INFO:tasks.workunit.client.1.smithi148.stdout:3/207: link d4/f6 d4/f49 0 2024-09-18T12:49:07.859 INFO:tasks.workunit.client.0.smithi078.stdout:8/141: dwrite d0/f14 [0,4194304] 0 2024-09-18T12:49:07.860 INFO:tasks.workunit.client.0.smithi078.stdout:8/142: readlink d0/d7/dc/lf 0 2024-09-18T12:49:07.862 INFO:tasks.workunit.client.1.smithi148.stdout:8/273: unlink d8/d16/d53/d39/d3b/d41/f43 0 2024-09-18T12:49:07.864 INFO:tasks.workunit.client.0.smithi078.stdout:6/250: mkdir d10/d2b/d43 0 2024-09-18T12:49:07.865 INFO:tasks.workunit.client.1.smithi148.stdout:8/274: dread d8/d16/f2a [0,4194304] 0 2024-09-18T12:49:07.866 INFO:tasks.workunit.client.0.smithi078.stdout:0/259: mknod d3/c5e 0 2024-09-18T12:49:07.867 INFO:tasks.workunit.client.0.smithi078.stdout:0/260: write d3/d1f/d2e/d58/f44 [2766254,17433] 0 2024-09-18T12:49:07.868 INFO:tasks.workunit.client.0.smithi078.stdout:9/107: creat d5/d7/f1e x:0 0 0 2024-09-18T12:49:07.868 INFO:tasks.workunit.client.0.smithi078.stdout:9/108: fdatasync d5/d7/fc 0 2024-09-18T12:49:07.869 INFO:tasks.workunit.client.1.smithi148.stdout:5/257: write d7/d8/dc/d12/d31/f48 [1432257,59197] 0 2024-09-18T12:49:07.869 INFO:tasks.workunit.client.0.smithi078.stdout:9/109: fdatasync d5/f15 0 2024-09-18T12:49:07.870 INFO:tasks.workunit.client.0.smithi078.stdout:9/110: chown d5/d7/d8/d1c 6160 1 2024-09-18T12:49:07.871 INFO:tasks.workunit.client.1.smithi148.stdout:9/186: mknod d8/c37 0 2024-09-18T12:49:07.872 INFO:tasks.workunit.client.1.smithi148.stdout:9/187: stat d8/da/l32 0 2024-09-18T12:49:07.872 INFO:tasks.workunit.client.1.smithi148.stdout:8/275: dwrite d8/d12/d46/f58 [0,4194304] 0 2024-09-18T12:49:07.872 INFO:tasks.workunit.client.0.smithi078.stdout:4/81: rename d11/f1a to d11/f1d 0 2024-09-18T12:49:07.873 INFO:tasks.workunit.client.0.smithi078.stdout:9/111: dread d5/d7/d8/fd [0,4194304] 0 2024-09-18T12:49:07.873 INFO:tasks.workunit.client.0.smithi078.stdout:4/82: truncate fb 1833165 0 2024-09-18T12:49:07.873 INFO:tasks.workunit.client.1.smithi148.stdout:0/412: creat de/f94 x:0 0 0 2024-09-18T12:49:07.874 INFO:tasks.workunit.client.0.smithi078.stdout:4/83: read d11/f14 [632775,62616] 0 2024-09-18T12:49:07.874 INFO:tasks.workunit.client.0.smithi078.stdout:9/112: rename d5/d7 to d5/d7/d1f 22 2024-09-18T12:49:07.875 INFO:tasks.workunit.client.1.smithi148.stdout:0/413: write de/d14/f3d [967679,51717] 0 2024-09-18T12:49:07.875 INFO:tasks.workunit.client.1.smithi148.stdout:2/195: symlink d9/d24/d31/d34/l41 0 2024-09-18T12:49:07.875 INFO:tasks.workunit.client.1.smithi148.stdout:0/414: chown lb 2220 1 2024-09-18T12:49:07.875 INFO:tasks.workunit.client.1.smithi148.stdout:0/415: chown de/d27 0 1 2024-09-18T12:49:07.877 INFO:tasks.workunit.client.1.smithi148.stdout:3/208: creat d4/d2d/f4a x:0 0 0 2024-09-18T12:49:07.878 INFO:tasks.workunit.client.1.smithi148.stdout:7/217: mknod db/dc/df/d2c/c3e 0 2024-09-18T12:49:07.884 INFO:tasks.workunit.client.1.smithi148.stdout:1/245: symlink dc/d4d/l55 0 2024-09-18T12:49:07.885 INFO:tasks.workunit.client.0.smithi078.stdout:4/84: fdatasync d11/f12 0 2024-09-18T12:49:07.885 INFO:tasks.workunit.client.0.smithi078.stdout:4/85: readlink l8 0 2024-09-18T12:49:07.886 INFO:tasks.workunit.client.1.smithi148.stdout:4/211: rename c4 to d15/c4b 0 2024-09-18T12:49:07.892 INFO:tasks.workunit.client.0.smithi078.stdout:6/251: link d10/f30 d10/d2b/f44 0 2024-09-18T12:49:07.892 INFO:tasks.workunit.client.0.smithi078.stdout:6/252: stat d10/l3a 0 2024-09-18T12:49:07.893 INFO:tasks.workunit.client.0.smithi078.stdout:6/253: readlink d10/l2c 0 2024-09-18T12:49:07.896 INFO:tasks.workunit.client.1.smithi148.stdout:8/276: unlink d8/d16/f34 0 2024-09-18T12:49:07.897 INFO:tasks.workunit.client.0.smithi078.stdout:4/86: symlink d11/l1e 0 2024-09-18T12:49:07.898 INFO:tasks.workunit.client.1.smithi148.stdout:3/209: dread d4/f49 [0,4194304] 0 2024-09-18T12:49:07.899 INFO:tasks.workunit.client.0.smithi078.stdout:6/254: dwrite d10/f25 [0,4194304] 0 2024-09-18T12:49:07.900 INFO:tasks.workunit.client.0.smithi078.stdout:6/255: stat d10/f17 0 2024-09-18T12:49:07.901 INFO:tasks.workunit.client.0.smithi078.stdout:8/143: write d0/d7/f22 [379918,50111] 0 2024-09-18T12:49:07.901 INFO:tasks.workunit.client.0.smithi078.stdout:0/261: link d3/d1f/c4f d3/d1f/d2e/c5f 0 2024-09-18T12:49:07.902 INFO:tasks.workunit.client.1.smithi148.stdout:8/277: dwrite d8/d12/d46/f5a [0,4194304] 0 2024-09-18T12:49:07.902 INFO:tasks.workunit.client.1.smithi148.stdout:7/218: rmdir db/dd/d25/d2e 39 2024-09-18T12:49:07.908 INFO:tasks.workunit.client.0.smithi078.stdout:9/113: rename d5/d7/ca to d5/c20 0 2024-09-18T12:49:07.910 INFO:tasks.workunit.client.1.smithi148.stdout:4/212: dread d15/d17/f42 [0,4194304] 0 2024-09-18T12:49:07.913 INFO:tasks.workunit.client.1.smithi148.stdout:6/274: truncate d5/d1a/f1f 2252579 0 2024-09-18T12:49:07.914 INFO:tasks.workunit.client.0.smithi078.stdout:8/144: fdatasync d0/f1c 0 2024-09-18T12:49:07.914 INFO:tasks.workunit.client.0.smithi078.stdout:8/145: dread - d0/d7/f27 zero size 2024-09-18T12:49:07.917 INFO:tasks.workunit.client.0.smithi078.stdout:9/114: unlink d5/d7/d8/c18 0 2024-09-18T12:49:07.919 INFO:tasks.workunit.client.0.smithi078.stdout:4/87: dwrite d11/f12 [0,4194304] 0 2024-09-18T12:49:07.922 INFO:tasks.workunit.client.1.smithi148.stdout:5/258: write d7/d8/f9 [4115124,34227] 0 2024-09-18T12:49:07.923 INFO:tasks.workunit.client.0.smithi078.stdout:0/262: symlink d3/d1f/l60 0 2024-09-18T12:49:07.923 INFO:tasks.workunit.client.0.smithi078.stdout:0/263: readlink d3/d1f/d2e/d58/d30/l40 0 2024-09-18T12:49:07.924 INFO:tasks.workunit.client.1.smithi148.stdout:3/210: creat d4/d8/d20/d2b/d43/f4b x:0 0 0 2024-09-18T12:49:07.925 INFO:tasks.workunit.client.1.smithi148.stdout:9/188: write d8/da/dd/f1b [377319,105892] 0 2024-09-18T12:49:07.925 INFO:tasks.workunit.client.0.smithi078.stdout:9/115: rmdir d5/d7 39 2024-09-18T12:49:07.926 INFO:tasks.workunit.client.0.smithi078.stdout:9/116: read - d5/f17 zero size 2024-09-18T12:49:07.926 INFO:tasks.workunit.client.0.smithi078.stdout:9/117: chown d5 101 1 2024-09-18T12:49:07.930 INFO:tasks.workunit.client.1.smithi148.stdout:5/259: dwrite d7/d8/d18/f38 [0,4194304] 0 2024-09-18T12:49:07.932 INFO:tasks.workunit.client.1.smithi148.stdout:5/260: write d7/d8/dc/d12/d20/f2e [3726332,46998] 0 2024-09-18T12:49:07.932 INFO:tasks.workunit.client.1.smithi148.stdout:7/219: creat db/dd/d25/d38/f3f x:0 0 0 2024-09-18T12:49:07.934 INFO:tasks.workunit.client.0.smithi078.stdout:8/146: symlink d0/l2a 0 2024-09-18T12:49:07.935 INFO:tasks.workunit.client.0.smithi078.stdout:8/147: write d0/d7/dc/d1f/d23/f25 [1006473,79560] 0 2024-09-18T12:49:07.936 INFO:tasks.workunit.client.0.smithi078.stdout:8/148: readlink d0/l2a 0 2024-09-18T12:49:07.937 INFO:tasks.workunit.client.1.smithi148.stdout:1/246: truncate dc/d11/f16 1057808 0 2024-09-18T12:49:07.937 INFO:tasks.workunit.client.1.smithi148.stdout:1/247: stat dc/d11/d17/l1d 0 2024-09-18T12:49:07.940 INFO:tasks.workunit.client.1.smithi148.stdout:2/196: truncate f8 1607878 0 2024-09-18T12:49:07.940 INFO:tasks.workunit.client.1.smithi148.stdout:2/197: readlink d9/d17/l2e 0 2024-09-18T12:49:07.941 INFO:tasks.workunit.client.1.smithi148.stdout:4/213: chown d15/d17/d1f/f24 17 1 2024-09-18T12:49:07.942 INFO:tasks.workunit.client.0.smithi078.stdout:4/88: truncate d11/f1d 1278591 0 2024-09-18T12:49:07.942 INFO:tasks.workunit.client.1.smithi148.stdout:4/214: stat d15/d1d/f23 0 2024-09-18T12:49:07.944 INFO:tasks.workunit.client.1.smithi148.stdout:6/275: chown d5/d1a/f37 4 1 2024-09-18T12:49:07.945 INFO:tasks.workunit.client.1.smithi148.stdout:8/278: write d8/fb [2237285,35063] 0 2024-09-18T12:49:07.945 INFO:tasks.workunit.client.1.smithi148.stdout:6/276: write d5/d32/d38/d41/f4b [479267,14904] 0 2024-09-18T12:49:07.946 INFO:tasks.workunit.client.1.smithi148.stdout:3/211: mknod d4/d8/d20/d2b/c4c 0 2024-09-18T12:49:07.947 INFO:tasks.workunit.client.0.smithi078.stdout:6/256: getdents d10/d2b/d37 0 2024-09-18T12:49:07.948 INFO:tasks.workunit.client.0.smithi078.stdout:4/89: dwrite fb [0,4194304] 0 2024-09-18T12:49:07.948 INFO:tasks.workunit.client.1.smithi148.stdout:9/189: mkdir d8/d33/d38 0 2024-09-18T12:49:07.949 INFO:tasks.workunit.client.1.smithi148.stdout:3/212: dread d4/f49 [0,4194304] 0 2024-09-18T12:49:07.950 INFO:tasks.workunit.client.1.smithi148.stdout:3/213: write f2 [5085622,35654] 0 2024-09-18T12:49:07.951 INFO:tasks.workunit.client.0.smithi078.stdout:8/149: symlink d0/d7/l2b 0 2024-09-18T12:49:07.954 INFO:tasks.workunit.client.1.smithi148.stdout:5/261: creat d7/d8/dc/d12/d20/f53 x:0 0 0 2024-09-18T12:49:07.956 INFO:tasks.workunit.client.1.smithi148.stdout:7/220: mknod db/dc/df/d1d/c40 0 2024-09-18T12:49:07.957 INFO:tasks.workunit.client.0.smithi078.stdout:4/90: mkdir d11/d1f 0 2024-09-18T12:49:07.958 INFO:tasks.workunit.client.1.smithi148.stdout:2/198: truncate f7 6121368 0 2024-09-18T12:49:07.959 INFO:tasks.workunit.client.1.smithi148.stdout:6/277: stat d5/d1a/l2c 0 2024-09-18T12:49:07.961 INFO:tasks.workunit.client.0.smithi078.stdout:9/118: getdents d5/d7/d8 0 2024-09-18T12:49:07.964 INFO:tasks.workunit.client.0.smithi078.stdout:8/150: rename d0/f18 to d0/d7/f2c 0 2024-09-18T12:49:07.965 INFO:tasks.workunit.client.1.smithi148.stdout:5/262: creat d7/d8/dc/d12/d1f/d25/f54 x:0 0 0 2024-09-18T12:49:07.966 INFO:tasks.workunit.client.1.smithi148.stdout:1/248: getdents dc/d11/d38 0 2024-09-18T12:49:07.968 INFO:tasks.workunit.client.0.smithi078.stdout:8/151: symlink d0/d7/dc/l2d 0 2024-09-18T12:49:07.971 INFO:tasks.workunit.client.0.smithi078.stdout:9/119: mknod d5/c21 0 2024-09-18T12:49:07.971 INFO:tasks.workunit.client.0.smithi078.stdout:8/152: dread d0/f21 [0,4194304] 0 2024-09-18T12:49:07.975 INFO:tasks.workunit.client.0.smithi078.stdout:9/120: fsync d5/d7/d8/f1d 0 2024-09-18T12:49:07.979 INFO:tasks.workunit.client.1.smithi148.stdout:7/221: chown db/dd/d25/d2e/c33 1320355 1 2024-09-18T12:49:07.982 INFO:tasks.workunit.client.0.smithi078.stdout:9/121: dwrite d5/d7/d8/fb [0,4194304] 0 2024-09-18T12:49:08.006 INFO:tasks.workunit.client.1.smithi148.stdout:1/249: chown dc/d11/d17/f23 61598916 1 2024-09-18T12:49:08.007 INFO:tasks.workunit.client.0.smithi078.stdout:8/153: mkdir d0/d7/dc/d1f/d23/d29/d2e 0 2024-09-18T12:49:08.008 INFO:tasks.workunit.client.1.smithi148.stdout:2/199: truncate d9/d24/d27/f38 2934269 0 2024-09-18T12:49:08.009 INFO:tasks.workunit.client.1.smithi148.stdout:2/200: truncate d9/ff 4598588 0 2024-09-18T12:49:08.009 INFO:tasks.workunit.client.1.smithi148.stdout:2/201: write d9/ff [2172627,9994] 0 2024-09-18T12:49:08.011 INFO:tasks.workunit.client.0.smithi078.stdout:8/154: mknod d0/d7/d1e/c2f 0 2024-09-18T12:49:08.012 INFO:tasks.workunit.client.1.smithi148.stdout:7/222: rmdir db 39 2024-09-18T12:49:08.013 INFO:tasks.workunit.client.0.smithi078.stdout:6/257: dwrite d10/f30 [0,4194304] 0 2024-09-18T12:49:08.019 INFO:tasks.workunit.client.0.smithi078.stdout:6/258: mkdir d10/d27/d3f/d40/d45 0 2024-09-18T12:49:08.019 INFO:tasks.workunit.client.1.smithi148.stdout:3/214: dwrite d4/d8/d20/f3d [0,4194304] 0 2024-09-18T12:49:08.022 INFO:tasks.workunit.client.1.smithi148.stdout:1/250: rmdir dc/d18/d43 39 2024-09-18T12:49:08.022 INFO:tasks.workunit.client.0.smithi078.stdout:8/155: dwrite d0/d7/f22 [0,4194304] 0 2024-09-18T12:49:08.023 INFO:tasks.workunit.client.1.smithi148.stdout:4/215: truncate d15/d17/f2a 1739483 0 2024-09-18T12:49:08.024 INFO:tasks.workunit.client.1.smithi148.stdout:1/251: chown dc/d18/f3d 34 1 2024-09-18T12:49:08.025 INFO:tasks.workunit.client.1.smithi148.stdout:2/202: mkdir d9/d24/d31/d34/d42 0 2024-09-18T12:49:08.026 INFO:tasks.workunit.client.0.smithi078.stdout:8/156: rmdir d0/d7 39 2024-09-18T12:49:08.026 INFO:tasks.workunit.client.1.smithi148.stdout:8/279: getdents d8/d16/d53/d39/d3b/d4e 0 2024-09-18T12:49:08.029 INFO:tasks.workunit.client.0.smithi078.stdout:4/91: write d11/f1d [533105,93358] 0 2024-09-18T12:49:08.032 INFO:tasks.workunit.client.1.smithi148.stdout:2/203: dread - d9/d24/f2f zero size 2024-09-18T12:49:08.032 INFO:tasks.workunit.client.1.smithi148.stdout:6/278: link d5/d1a/l11 d5/l5a 0 2024-09-18T12:49:08.032 INFO:tasks.workunit.client.1.smithi148.stdout:4/216: mkdir d15/d17/d1f/d4c 0 2024-09-18T12:49:08.032 INFO:tasks.workunit.client.1.smithi148.stdout:3/215: dwrite d4/d8/d20/d2b/f3a [0,4194304] 0 2024-09-18T12:49:08.037 INFO:tasks.workunit.client.0.smithi078.stdout:8/157: mkdir d0/d7/d1e/d30 0 2024-09-18T12:49:08.040 INFO:tasks.workunit.client.0.smithi078.stdout:4/92: creat d11/d1f/f20 x:0 0 0 2024-09-18T12:49:08.040 INFO:tasks.workunit.client.1.smithi148.stdout:5/263: getdents d7/d8/dc/d12/d31 0 2024-09-18T12:49:08.040 INFO:tasks.workunit.client.0.smithi078.stdout:4/93: stat c6 0 2024-09-18T12:49:08.043 INFO:tasks.workunit.client.0.smithi078.stdout:4/94: symlink d11/l21 0 2024-09-18T12:49:08.049 INFO:tasks.workunit.client.0.smithi078.stdout:6/259: truncate ff 257316 0 2024-09-18T12:49:08.050 INFO:tasks.workunit.client.0.smithi078.stdout:6/260: write fb [2443570,36451] 0 2024-09-18T12:49:08.051 INFO:tasks.workunit.client.0.smithi078.stdout:4/95: dread d11/f14 [0,4194304] 0 2024-09-18T12:49:08.051 INFO:tasks.workunit.client.1.smithi148.stdout:3/216: creat d4/d2d/f4d x:0 0 0 2024-09-18T12:49:08.051 INFO:tasks.workunit.client.1.smithi148.stdout:2/204: dread d9/f16 [0,4194304] 0 2024-09-18T12:49:08.051 INFO:tasks.workunit.client.1.smithi148.stdout:2/205: stat d9/d17/d29/f3b 0 2024-09-18T12:49:08.054 INFO:tasks.workunit.client.0.smithi078.stdout:8/158: getdents d0/d7/d1e 0 2024-09-18T12:49:08.054 INFO:tasks.workunit.client.0.smithi078.stdout:8/159: fsync d0/d7/fb 0 2024-09-18T12:49:08.055 INFO:tasks.workunit.client.0.smithi078.stdout:8/160: dread - d0/f16 zero size 2024-09-18T12:49:08.055 INFO:tasks.workunit.client.0.smithi078.stdout:4/96: mknod d11/c22 0 2024-09-18T12:49:08.059 INFO:tasks.workunit.client.1.smithi148.stdout:6/279: write d5/d32/f33 [1257842,40155] 0 2024-09-18T12:49:08.059 INFO:tasks.workunit.client.0.smithi078.stdout:8/161: mknod d0/d7/d1e/c31 0 2024-09-18T12:49:08.060 INFO:tasks.workunit.client.1.smithi148.stdout:5/264: dwrite d7/d8/dc/d12/f24 [0,4194304] 0 2024-09-18T12:49:08.061 INFO:tasks.workunit.client.1.smithi148.stdout:9/190: sync 2024-09-18T12:49:08.061 INFO:tasks.workunit.client.1.smithi148.stdout:0/416: sync 2024-09-18T12:49:08.062 INFO:tasks.workunit.client.1.smithi148.stdout:5/265: write d7/d8/fa [5583881,113412] 0 2024-09-18T12:49:08.062 INFO:tasks.workunit.client.0.smithi078.stdout:4/97: rename d11/d1f/f20 to d11/f23 0 2024-09-18T12:49:08.064 INFO:tasks.workunit.client.1.smithi148.stdout:3/217: rename d4/d8/c16 to d4/d2d/c4e 0 2024-09-18T12:49:08.065 INFO:tasks.workunit.client.0.smithi078.stdout:6/261: creat d10/d27/d3f/d40/d45/f46 x:0 0 0 2024-09-18T12:49:08.069 INFO:tasks.workunit.client.0.smithi078.stdout:4/98: mkdir d11/d1f/d24 0 2024-09-18T12:49:08.069 INFO:tasks.workunit.client.1.smithi148.stdout:4/217: dread d15/d17/f19 [0,4194304] 0 2024-09-18T12:49:08.070 INFO:tasks.workunit.client.0.smithi078.stdout:6/262: symlink d10/l47 0 2024-09-18T12:49:08.071 INFO:tasks.workunit.client.0.smithi078.stdout:8/162: symlink d0/d7/d1e/d30/l32 0 2024-09-18T12:49:08.071 INFO:tasks.workunit.client.1.smithi148.stdout:3/218: dwrite d4/d2d/f4a [0,4194304] 0 2024-09-18T12:49:08.073 INFO:tasks.workunit.client.0.smithi078.stdout:4/99: mknod d11/c25 0 2024-09-18T12:49:08.073 INFO:tasks.workunit.client.1.smithi148.stdout:6/280: readlink d5/d1a/l1e 0 2024-09-18T12:49:08.073 INFO:tasks.workunit.client.1.smithi148.stdout:1/252: getdents dc/d18/d31/d39 0 2024-09-18T12:49:08.074 INFO:tasks.workunit.client.0.smithi078.stdout:4/100: read fb [1675683,128656] 0 2024-09-18T12:49:08.075 INFO:tasks.workunit.client.0.smithi078.stdout:8/163: mkdir d0/d7/d1e/d33 0 2024-09-18T12:49:08.075 INFO:tasks.workunit.client.0.smithi078.stdout:4/101: read d11/f1d [155630,73016] 0 2024-09-18T12:49:08.076 INFO:tasks.workunit.client.1.smithi148.stdout:5/266: symlink d7/d8/d18/d3f/l55 0 2024-09-18T12:49:08.080 INFO:tasks.workunit.client.1.smithi148.stdout:8/280: getdents d8/d12/d46 0 2024-09-18T12:49:08.083 INFO:tasks.workunit.client.0.smithi078.stdout:4/102: symlink d11/l26 0 2024-09-18T12:49:08.085 INFO:tasks.workunit.client.0.smithi078.stdout:4/103: chown d11/c22 14 1 2024-09-18T12:49:08.086 INFO:tasks.workunit.client.0.smithi078.stdout:4/104: chown d11/l21 2211 1 2024-09-18T12:49:08.088 INFO:tasks.workunit.client.0.smithi078.stdout:8/164: dwrite d0/f1a [0,4194304] 0 2024-09-18T12:49:08.089 INFO:tasks.workunit.client.1.smithi148.stdout:1/253: creat dc/d4d/f56 x:0 0 0 2024-09-18T12:49:08.090 INFO:tasks.workunit.client.0.smithi078.stdout:8/165: dread - d0/d7/dc/d1f/f28 zero size 2024-09-18T12:49:08.090 INFO:tasks.workunit.client.0.smithi078.stdout:6/263: dread ff [0,4194304] 0 2024-09-18T12:49:08.090 INFO:tasks.workunit.client.1.smithi148.stdout:1/254: fsync dc/d11/d17/f21 0 2024-09-18T12:49:08.091 INFO:tasks.workunit.client.1.smithi148.stdout:1/255: dread - dc/d11/f53 zero size 2024-09-18T12:49:08.092 INFO:tasks.workunit.client.1.smithi148.stdout:1/256: readlink dc/d11/l1b 0 2024-09-18T12:49:08.092 INFO:tasks.workunit.client.0.smithi078.stdout:4/105: dread d11/f14 [0,4194304] 0 2024-09-18T12:49:08.092 INFO:tasks.workunit.client.1.smithi148.stdout:9/191: mknod d8/da/dd/d35/c39 0 2024-09-18T12:49:08.095 INFO:tasks.workunit.client.1.smithi148.stdout:2/206: creat d9/f43 x:0 0 0 2024-09-18T12:49:08.095 INFO:tasks.workunit.client.1.smithi148.stdout:5/267: dread d7/d8/f3e [0,4194304] 0 2024-09-18T12:49:08.096 INFO:tasks.workunit.client.0.smithi078.stdout:6/264: rename d10/d27/f28 to d10/d2b/d37/f48 0 2024-09-18T12:49:08.097 INFO:tasks.workunit.client.1.smithi148.stdout:2/207: truncate d9/f39 758002 0 2024-09-18T12:49:08.097 INFO:tasks.workunit.client.1.smithi148.stdout:1/257: dread dc/d11/f12 [0,4194304] 0 2024-09-18T12:49:08.097 INFO:tasks.workunit.client.1.smithi148.stdout:8/281: symlink d8/d16/l61 0 2024-09-18T12:49:08.098 INFO:tasks.workunit.client.0.smithi078.stdout:4/106: write d11/f1d [2141570,58966] 0 2024-09-18T12:49:08.099 INFO:tasks.workunit.client.1.smithi148.stdout:4/218: fsync d15/d17/f2a 0 2024-09-18T12:49:08.103 INFO:tasks.workunit.client.1.smithi148.stdout:5/268: dread d7/d8/dc/d12/f24 [0,4194304] 0 2024-09-18T12:49:08.103 INFO:tasks.workunit.client.0.smithi078.stdout:8/166: rename d0/f1b to d0/d7/dc/d1f/d23/d29/d2e/f34 0 2024-09-18T12:49:08.104 INFO:tasks.workunit.client.1.smithi148.stdout:4/219: dread d15/d17/f2a [0,4194304] 0 2024-09-18T12:49:08.104 INFO:tasks.workunit.client.1.smithi148.stdout:8/282: dwrite d8/f2d [0,4194304] 0 2024-09-18T12:49:08.105 INFO:tasks.workunit.client.0.smithi078.stdout:4/107: truncate d11/f14 2990459 0 2024-09-18T12:49:08.105 INFO:tasks.workunit.client.1.smithi148.stdout:8/283: truncate d8/fb 2727114 0 2024-09-18T12:49:08.108 INFO:tasks.workunit.client.0.smithi078.stdout:8/167: dread d0/f1a [0,4194304] 0 2024-09-18T12:49:08.108 INFO:tasks.workunit.client.0.smithi078.stdout:8/168: fdatasync d0/f2 0 2024-09-18T12:49:08.109 INFO:tasks.workunit.client.0.smithi078.stdout:8/169: chown d0/d7/dc/l2d 3 1 2024-09-18T12:49:08.114 INFO:tasks.workunit.client.0.smithi078.stdout:4/108: mkdir d11/d27 0 2024-09-18T12:49:08.119 INFO:tasks.workunit.client.1.smithi148.stdout:3/219: rename d4/f40 to d4/d8/f4f 0 2024-09-18T12:49:08.119 INFO:tasks.workunit.client.1.smithi148.stdout:3/220: fdatasync d4/d8/d20/f33 0 2024-09-18T12:49:08.121 INFO:tasks.workunit.client.0.smithi078.stdout:8/170: mknod d0/d7/dc/d1f/c35 0 2024-09-18T12:49:08.122 INFO:tasks.workunit.client.1.smithi148.stdout:6/281: creat d5/d1a/dc/f5b x:0 0 0 2024-09-18T12:49:08.122 INFO:tasks.workunit.client.1.smithi148.stdout:8/284: rmdir d8/d12/d46 39 2024-09-18T12:49:08.123 INFO:tasks.workunit.client.1.smithi148.stdout:6/282: readlink d5/d1a/l1e 0 2024-09-18T12:49:08.123 INFO:tasks.workunit.client.1.smithi148.stdout:6/283: chown d5/f1b 72602 1 2024-09-18T12:49:08.128 INFO:tasks.workunit.client.0.smithi078.stdout:4/109: write fb [2518844,61251] 0 2024-09-18T12:49:08.130 INFO:tasks.workunit.client.1.smithi148.stdout:5/269: symlink d7/d8/l56 0 2024-09-18T12:49:08.131 INFO:tasks.workunit.client.0.smithi078.stdout:4/110: stat d11/l1b 0 2024-09-18T12:49:08.133 INFO:tasks.workunit.client.1.smithi148.stdout:3/221: mknod d4/d8/d20/d2b/c50 0 2024-09-18T12:49:08.133 INFO:tasks.workunit.client.0.smithi078.stdout:4/111: write d11/f1d [1089390,89037] 0 2024-09-18T12:49:08.133 INFO:tasks.workunit.client.1.smithi148.stdout:4/220: truncate f2 1253858 0 2024-09-18T12:49:08.133 INFO:tasks.workunit.client.1.smithi148.stdout:3/222: chown d4/d8/f15 44 1 2024-09-18T12:49:08.134 INFO:tasks.workunit.client.1.smithi148.stdout:4/221: chown d15/d1d 436 1 2024-09-18T12:49:08.134 INFO:tasks.workunit.client.1.smithi148.stdout:4/222: readlink l14 0 2024-09-18T12:49:08.134 INFO:tasks.workunit.client.1.smithi148.stdout:3/223: write d4/f6 [4055631,128233] 0 2024-09-18T12:49:08.135 INFO:tasks.workunit.client.1.smithi148.stdout:7/223: sync 2024-09-18T12:49:08.136 INFO:tasks.workunit.client.1.smithi148.stdout:8/285: read d8/d12/f2c [1443613,98906] 0 2024-09-18T12:49:08.137 INFO:tasks.workunit.client.0.smithi078.stdout:8/171: dwrite d0/f1 [0,4194304] 0 2024-09-18T12:49:08.137 INFO:tasks.workunit.client.1.smithi148.stdout:9/192: rmdir d8/d33/d38 0 2024-09-18T12:49:08.139 INFO:tasks.workunit.client.0.smithi078.stdout:4/112: dread d11/f12 [0,4194304] 0 2024-09-18T12:49:08.139 INFO:tasks.workunit.client.1.smithi148.stdout:2/208: rename f8 to d9/d24/d31/d34/d42/f44 0 2024-09-18T12:49:08.140 INFO:tasks.workunit.client.1.smithi148.stdout:9/193: dread d8/da/f2e [0,4194304] 0 2024-09-18T12:49:08.140 INFO:tasks.workunit.client.1.smithi148.stdout:9/194: chown d8/da/df/d27 1 1 2024-09-18T12:49:08.141 INFO:tasks.workunit.client.1.smithi148.stdout:5/270: fdatasync d7/d8/dc/d12/f24 0 2024-09-18T12:49:08.141 INFO:tasks.workunit.client.1.smithi148.stdout:9/195: chown d8/da/dd 26652 1 2024-09-18T12:49:08.144 INFO:tasks.workunit.client.0.smithi078.stdout:8/172: mknod d0/d7/d1e/c36 0 2024-09-18T12:49:08.148 INFO:tasks.workunit.client.0.smithi078.stdout:8/173: write d0/f21 [3805758,93883] 0 2024-09-18T12:49:08.148 INFO:tasks.workunit.client.0.smithi078.stdout:4/113: mknod d11/d1f/c28 0 2024-09-18T12:49:08.148 INFO:tasks.workunit.client.0.smithi078.stdout:4/114: chown ca 1 1 2024-09-18T12:49:08.149 INFO:tasks.workunit.client.1.smithi148.stdout:7/224: fdatasync db/dc/df/d1d/f21 0 2024-09-18T12:49:08.150 INFO:tasks.workunit.client.1.smithi148.stdout:6/284: unlink d5/d1a/d3d/c3c 0 2024-09-18T12:49:08.155 INFO:tasks.workunit.client.0.smithi078.stdout:4/115: dwrite d11/f12 [0,4194304] 0 2024-09-18T12:49:08.156 INFO:tasks.workunit.client.1.smithi148.stdout:2/209: truncate d9/f18 16618 0 2024-09-18T12:49:08.157 INFO:tasks.workunit.client.1.smithi148.stdout:5/271: mknod d7/d8/dc/c57 0 2024-09-18T12:49:08.158 INFO:tasks.workunit.client.0.smithi078.stdout:8/174: dwrite d0/d7/dc/d1f/d23/d29/d2e/f34 [0,4194304] 0 2024-09-18T12:49:08.159 INFO:tasks.workunit.client.1.smithi148.stdout:9/196: creat d8/da/df/f3a x:0 0 0 2024-09-18T12:49:08.159 INFO:tasks.workunit.client.0.smithi078.stdout:8/175: readlink d0/d7/d1e/d30/l32 0 2024-09-18T12:49:08.160 INFO:tasks.workunit.client.1.smithi148.stdout:9/197: stat d8/da/dd/l1c 0 2024-09-18T12:49:08.160 INFO:tasks.workunit.client.0.smithi078.stdout:4/116: creat d11/f29 x:0 0 0 2024-09-18T12:49:08.160 INFO:tasks.workunit.client.1.smithi148.stdout:0/417: sync 2024-09-18T12:49:08.161 INFO:tasks.workunit.client.1.smithi148.stdout:0/418: chown de/d14/c5d 1115 1 2024-09-18T12:49:08.162 INFO:tasks.workunit.client.1.smithi148.stdout:4/223: mkdir d15/d17/d4d 0 2024-09-18T12:49:08.162 INFO:tasks.workunit.client.1.smithi148.stdout:4/224: chown d15/d17 106 1 2024-09-18T12:49:08.164 INFO:tasks.workunit.client.1.smithi148.stdout:6/285: mkdir d5/d1a/d29/d5c 0 2024-09-18T12:49:08.165 INFO:tasks.workunit.client.0.smithi078.stdout:8/176: creat d0/d7/dc/d1f/d23/d29/f37 x:0 0 0 2024-09-18T12:49:08.165 INFO:tasks.workunit.client.1.smithi148.stdout:4/225: dread - d15/d1d/d34/f35 zero size 2024-09-18T12:49:08.165 INFO:tasks.workunit.client.1.smithi148.stdout:0/419: truncate de/d14/d43/d70/d7f/f41 684796 0 2024-09-18T12:49:08.166 INFO:tasks.workunit.client.0.smithi078.stdout:8/177: fsync d0/d7/dc/d1f/f28 0 2024-09-18T12:49:08.167 INFO:tasks.workunit.client.1.smithi148.stdout:0/420: read de/d14/d43/f5e [99039,32566] 0 2024-09-18T12:49:08.169 INFO:tasks.workunit.client.0.smithi078.stdout:4/117: link l8 d11/l2a 0 2024-09-18T12:49:08.170 INFO:tasks.workunit.client.0.smithi078.stdout:4/118: truncate d11/f29 388026 0 2024-09-18T12:49:08.172 INFO:tasks.workunit.client.1.smithi148.stdout:5/272: creat d7/d8/dc/d12/d1f/d25/d4b/f58 x:0 0 0 2024-09-18T12:49:08.174 INFO:tasks.workunit.client.0.smithi078.stdout:8/178: creat d0/d7/f38 x:0 0 0 2024-09-18T12:49:08.174 INFO:tasks.workunit.client.1.smithi148.stdout:9/198: fdatasync f7 0 2024-09-18T12:49:08.175 INFO:tasks.workunit.client.0.smithi078.stdout:8/179: fsync d0/f1c 0 2024-09-18T12:49:08.175 INFO:tasks.workunit.client.1.smithi148.stdout:9/199: write d8/f25 [1513009,77950] 0 2024-09-18T12:49:08.176 INFO:tasks.workunit.client.0.smithi078.stdout:4/119: creat d11/d1f/f2b x:0 0 0 2024-09-18T12:49:08.179 INFO:tasks.workunit.client.1.smithi148.stdout:6/286: creat d5/d1a/d29/f5d x:0 0 0 2024-09-18T12:49:08.180 INFO:tasks.workunit.client.1.smithi148.stdout:9/200: dread d8/f25 [0,4194304] 0 2024-09-18T12:49:08.181 INFO:tasks.workunit.client.0.smithi078.stdout:8/180: dwrite d0/d7/fb [0,4194304] 0 2024-09-18T12:49:08.181 INFO:tasks.workunit.client.1.smithi148.stdout:8/286: creat d8/f62 x:0 0 0 2024-09-18T12:49:08.184 INFO:tasks.workunit.client.1.smithi148.stdout:9/201: dread d8/da/dd/f14 [0,4194304] 0 2024-09-18T12:49:08.185 INFO:tasks.workunit.client.1.smithi148.stdout:9/202: truncate d8/da/df/f3a 410956 0 2024-09-18T12:49:08.185 INFO:tasks.workunit.client.1.smithi148.stdout:9/203: readlink d8/da/l32 0 2024-09-18T12:49:08.185 INFO:tasks.workunit.client.1.smithi148.stdout:9/204: stat d8/f22 0 2024-09-18T12:49:08.188 INFO:tasks.workunit.client.1.smithi148.stdout:0/421: symlink de/d14/d43/d70/l95 0 2024-09-18T12:49:08.189 INFO:tasks.workunit.client.1.smithi148.stdout:9/205: dread d8/da/df/f12 [0,4194304] 0 2024-09-18T12:49:08.189 INFO:tasks.workunit.client.0.smithi078.stdout:8/181: dwrite d0/d7/dc/d1f/d23/d29/d2e/f34 [0,4194304] 0 2024-09-18T12:49:08.191 INFO:tasks.workunit.client.1.smithi148.stdout:1/258: rename dc/d11/f1a to dc/f57 0 2024-09-18T12:49:08.192 INFO:tasks.workunit.client.1.smithi148.stdout:1/259: chown dc/d4d/f56 4595 1 2024-09-18T12:49:08.193 INFO:tasks.workunit.client.1.smithi148.stdout:7/225: write f3 [706019,87410] 0 2024-09-18T12:49:08.194 INFO:tasks.workunit.client.1.smithi148.stdout:7/226: fsync db/dc/df/f29 0 2024-09-18T12:49:08.195 INFO:tasks.workunit.client.0.smithi078.stdout:8/182: dread d0/d7/f2c [0,4194304] 0 2024-09-18T12:49:08.195 INFO:tasks.workunit.client.1.smithi148.stdout:7/227: readlink db/dc/df/l17 0 2024-09-18T12:49:08.198 INFO:tasks.workunit.client.0.smithi078.stdout:8/183: unlink d0/d7/d1e/d30/l32 0 2024-09-18T12:49:08.200 INFO:tasks.workunit.client.0.smithi078.stdout:8/184: write d0/d7/dc/d1f/d23/d29/f37 [672770,24843] 0 2024-09-18T12:49:08.200 INFO:tasks.workunit.client.0.smithi078.stdout:8/185: fsync d0/d7/f22 0 2024-09-18T12:49:08.201 INFO:tasks.workunit.client.1.smithi148.stdout:4/226: symlink d15/d17/l4e 0 2024-09-18T12:49:08.204 INFO:tasks.workunit.client.0.smithi078.stdout:8/186: rmdir d0/d7/dc/d1f/d23 39 2024-09-18T12:49:08.206 INFO:tasks.workunit.client.1.smithi148.stdout:4/227: dwrite d15/d1d/f29 [0,4194304] 0 2024-09-18T12:49:08.206 INFO:tasks.workunit.client.1.smithi148.stdout:9/206: rename d8/da/f2e to d8/d2f/f3b 0 2024-09-18T12:49:08.207 INFO:tasks.workunit.client.1.smithi148.stdout:4/228: read d15/d17/f1c [6058294,60723] 0 2024-09-18T12:49:08.207 INFO:tasks.workunit.client.1.smithi148.stdout:1/260: mknod dc/d18/d31/d39/c58 0 2024-09-18T12:49:08.208 INFO:tasks.workunit.client.1.smithi148.stdout:1/261: readlink dc/d11/d17/l1d 0 2024-09-18T12:49:08.212 INFO:tasks.workunit.client.0.smithi078.stdout:8/187: getdents d0/d7 0 2024-09-18T12:49:08.214 INFO:tasks.workunit.client.1.smithi148.stdout:7/228: mkdir db/dc/df/d1d/d41 0 2024-09-18T12:49:08.215 INFO:tasks.workunit.client.1.smithi148.stdout:3/224: link d4/d8/f35 d4/d8/f51 0 2024-09-18T12:49:08.218 INFO:tasks.workunit.client.1.smithi148.stdout:0/422: mknod de/c96 0 2024-09-18T12:49:08.220 INFO:tasks.workunit.client.1.smithi148.stdout:8/287: dread d8/d12/f2c [0,4194304] 0 2024-09-18T12:49:08.221 INFO:tasks.workunit.client.1.smithi148.stdout:9/207: mknod d8/da/dd/d35/c3c 0 2024-09-18T12:49:08.222 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:07 smithi148 ceph-mon[35352]: pgmap v11: 65 pgs: 65 active+clean; 559 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.1 MiB/s rd, 55 MiB/s wr, 262 op/s 2024-09-18T12:49:08.222 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:07 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:08.223 INFO:tasks.workunit.client.1.smithi148.stdout:4/229: rename d15/d1d to d15/d17/d1f/d4c/d4f 0 2024-09-18T12:49:08.224 INFO:tasks.workunit.client.1.smithi148.stdout:2/210: link d9/d24/d31/d34/d42/f44 d9/d17/f45 0 2024-09-18T12:49:08.224 INFO:tasks.workunit.client.1.smithi148.stdout:1/262: mknod dc/d18/d31/d4b/c59 0 2024-09-18T12:49:08.225 INFO:tasks.workunit.client.1.smithi148.stdout:5/273: creat d7/d8/f59 x:0 0 0 2024-09-18T12:49:08.226 INFO:tasks.workunit.client.1.smithi148.stdout:5/274: readlink d7/d8/dc/d12/l26 0 2024-09-18T12:49:08.226 INFO:tasks.workunit.client.1.smithi148.stdout:7/229: mknod db/dd/d1f/c42 0 2024-09-18T12:49:08.227 INFO:tasks.workunit.client.0.smithi078.stdout:8/188: rename d0/d7/d1e/d30 to d0/d39 0 2024-09-18T12:49:08.233 INFO:tasks.workunit.client.1.smithi148.stdout:0/423: symlink de/d27/l97 0 2024-09-18T12:49:08.236 INFO:tasks.workunit.client.1.smithi148.stdout:9/208: symlink d8/da/dd/l3d 0 2024-09-18T12:49:08.237 INFO:tasks.workunit.client.1.smithi148.stdout:9/209: chown d8/da/dd/f1b 33 1 2024-09-18T12:49:08.237 INFO:tasks.workunit.client.1.smithi148.stdout:9/210: readlink d8/l2a 0 2024-09-18T12:49:08.239 INFO:tasks.workunit.client.0.smithi078.stdout:8/189: rename d0/d7/dc/d1f/d23/d29/d2e/f34 to d0/d7/dc/d1f/d23/d29/d2e/f3a 0 2024-09-18T12:49:08.240 INFO:tasks.workunit.client.0.smithi078.stdout:8/190: truncate d0/f16 232649 0 2024-09-18T12:49:08.240 INFO:tasks.workunit.client.0.smithi078.stdout:8/191: fsync d0/f2 0 2024-09-18T12:49:08.241 INFO:tasks.workunit.client.1.smithi148.stdout:2/211: mkdir d9/d24/d31/d46 0 2024-09-18T12:49:08.241 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:07 smithi078 ceph-mon[28091]: pgmap v11: 65 pgs: 65 active+clean; 559 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.1 MiB/s rd, 55 MiB/s wr, 262 op/s 2024-09-18T12:49:08.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:07 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:08.242 INFO:tasks.workunit.client.1.smithi148.stdout:7/230: rmdir db/dd/d25 39 2024-09-18T12:49:08.243 INFO:tasks.workunit.client.1.smithi148.stdout:7/231: dread - db/dc/f28 zero size 2024-09-18T12:49:08.244 INFO:tasks.workunit.client.0.smithi078.stdout:8/192: dread d0/f2 [4194304,4194304] 0 2024-09-18T12:49:08.244 INFO:tasks.workunit.client.1.smithi148.stdout:6/287: creat d5/d32/d38/d41/f5e x:0 0 0 2024-09-18T12:49:08.245 INFO:tasks.workunit.client.1.smithi148.stdout:8/288: getdents d8/d12/d51 0 2024-09-18T12:49:08.248 INFO:tasks.workunit.client.1.smithi148.stdout:7/232: dwrite db/dc/f15 [0,4194304] 0 2024-09-18T12:49:08.255 INFO:tasks.workunit.client.1.smithi148.stdout:0/424: fsync de/f1e 0 2024-09-18T12:49:08.256 INFO:tasks.workunit.client.1.smithi148.stdout:4/230: write f9 [1281746,125172] 0 2024-09-18T12:49:08.256 INFO:tasks.workunit.client.1.smithi148.stdout:8/289: rmdir d8/df/d3e 39 2024-09-18T12:49:08.256 INFO:tasks.workunit.client.1.smithi148.stdout:0/425: chown de/d14/l20 69412 1 2024-09-18T12:49:08.259 INFO:tasks.workunit.client.1.smithi148.stdout:7/233: mkdir db/dc/df/d11/d43 0 2024-09-18T12:49:08.259 INFO:tasks.workunit.client.1.smithi148.stdout:2/212: rmdir d9/d17 39 2024-09-18T12:49:08.260 INFO:tasks.workunit.client.1.smithi148.stdout:1/263: link dc/d18/l4f dc/d18/d31/d4b/l5a 0 2024-09-18T12:49:08.262 INFO:tasks.workunit.client.1.smithi148.stdout:1/264: write dc/d11/f30 [283924,127024] 0 2024-09-18T12:49:08.262 INFO:tasks.workunit.client.0.smithi078.stdout:8/193: truncate d0/f14 2939528 0 2024-09-18T12:49:08.262 INFO:tasks.workunit.client.0.smithi078.stdout:8/194: readlink d0/d7/dc/l2d 0 2024-09-18T12:49:08.263 INFO:tasks.workunit.client.0.smithi078.stdout:8/195: stat d0/f21 0 2024-09-18T12:49:08.265 INFO:tasks.workunit.client.1.smithi148.stdout:4/231: mknod d15/d17/d1f/d4c/c50 0 2024-09-18T12:49:08.265 INFO:tasks.workunit.client.1.smithi148.stdout:9/211: dwrite d8/f26 [0,4194304] 0 2024-09-18T12:49:08.266 INFO:tasks.workunit.client.1.smithi148.stdout:8/290: creat d8/d16/d53/d39/d3b/f63 x:0 0 0 2024-09-18T12:49:08.267 INFO:tasks.workunit.client.1.smithi148.stdout:4/232: write d15/d17/d1f/f21 [5015518,52761] 0 2024-09-18T12:49:08.267 INFO:tasks.workunit.client.0.smithi078.stdout:8/196: creat d0/d7/dc/d1f/d23/d29/f3b x:0 0 0 2024-09-18T12:49:08.267 INFO:tasks.workunit.client.0.smithi078.stdout:8/197: stat d0 0 2024-09-18T12:49:08.268 INFO:tasks.workunit.client.1.smithi148.stdout:6/288: write d5/f2e [487908,109235] 0 2024-09-18T12:49:08.269 INFO:tasks.workunit.client.1.smithi148.stdout:7/234: unlink db/dd/f26 0 2024-09-18T12:49:08.272 INFO:tasks.workunit.client.0.smithi078.stdout:8/198: dread d0/d7/fb [0,4194304] 0 2024-09-18T12:49:08.273 INFO:tasks.workunit.client.1.smithi148.stdout:0/426: write f5 [54040,16458] 0 2024-09-18T12:49:08.276 INFO:tasks.workunit.client.1.smithi148.stdout:7/235: dwrite db/dc/f28 [0,4194304] 0 2024-09-18T12:49:08.278 INFO:tasks.workunit.client.1.smithi148.stdout:8/291: write d8/d12/d46/f5a [1593823,14258] 0 2024-09-18T12:49:08.280 INFO:tasks.workunit.client.0.smithi078.stdout:8/199: link d0/f1c d0/d7/dc/f3c 0 2024-09-18T12:49:08.281 INFO:tasks.workunit.client.1.smithi148.stdout:8/292: write d8/d16/d53/d39/f40 [1304272,122655] 0 2024-09-18T12:49:08.284 INFO:tasks.workunit.client.1.smithi148.stdout:6/289: dread - d5/d32/d38/d41/f5e zero size 2024-09-18T12:49:08.284 INFO:tasks.workunit.client.1.smithi148.stdout:1/265: mkdir dc/d5b 0 2024-09-18T12:49:08.285 INFO:tasks.workunit.client.1.smithi148.stdout:8/293: write d8/d16/d27/f4a [3344197,104787] 0 2024-09-18T12:49:08.286 INFO:tasks.workunit.client.1.smithi148.stdout:0/427: dwrite de/d27/f8a [0,4194304] 0 2024-09-18T12:49:08.287 INFO:tasks.workunit.client.1.smithi148.stdout:6/290: chown d5/d1a/dc/d2b/l36 1105 1 2024-09-18T12:49:08.288 INFO:tasks.workunit.client.0.smithi078.stdout:8/200: dwrite d0/d7/dc/d1f/d23/d29/f3b [0,4194304] 0 2024-09-18T12:49:08.296 INFO:tasks.workunit.client.1.smithi148.stdout:8/294: creat d8/d16/d53/d39/d3b/d41/f64 x:0 0 0 2024-09-18T12:49:08.297 INFO:tasks.workunit.client.1.smithi148.stdout:0/428: symlink de/d27/l98 0 2024-09-18T12:49:08.297 INFO:tasks.workunit.client.1.smithi148.stdout:8/295: fsync d8/f2f 0 2024-09-18T12:49:08.299 INFO:tasks.workunit.client.1.smithi148.stdout:4/233: rename d15/d3f/c48 to d15/c51 0 2024-09-18T12:49:08.300 INFO:tasks.workunit.client.1.smithi148.stdout:6/291: dwrite d5/d32/d38/d50/f59 [0,4194304] 0 2024-09-18T12:49:08.300 INFO:tasks.workunit.client.1.smithi148.stdout:9/212: getdents d8/d2f 0 2024-09-18T12:49:08.301 INFO:tasks.workunit.client.1.smithi148.stdout:7/236: write fa [4341096,87535] 0 2024-09-18T12:49:08.304 INFO:tasks.workunit.client.1.smithi148.stdout:7/237: readlink db/dc/df/l30 0 2024-09-18T12:49:08.304 INFO:tasks.workunit.client.1.smithi148.stdout:6/292: write d5/d1a/f37 [2580679,43016] 0 2024-09-18T12:49:08.306 INFO:tasks.workunit.client.1.smithi148.stdout:6/293: write d5/f2e [87457,103342] 0 2024-09-18T12:49:08.307 INFO:tasks.workunit.client.1.smithi148.stdout:2/213: dwrite d9/f18 [0,4194304] 0 2024-09-18T12:49:08.307 INFO:tasks.workunit.client.1.smithi148.stdout:6/294: readlink d5/d1a/l1e 0 2024-09-18T12:49:08.309 INFO:tasks.workunit.client.1.smithi148.stdout:9/213: mknod d8/d2f/c3e 0 2024-09-18T12:49:08.310 INFO:tasks.workunit.client.0.smithi078.stdout:8/201: dwrite d0/f1a [0,4194304] 0 2024-09-18T12:49:08.315 INFO:tasks.workunit.client.1.smithi148.stdout:8/296: rename d8/ca to d8/d16/d27/c65 0 2024-09-18T12:49:08.315 INFO:tasks.workunit.client.1.smithi148.stdout:1/266: link dc/d18/d31/d4b/l5a dc/d18/d31/d39/l5c 0 2024-09-18T12:49:08.317 INFO:tasks.workunit.client.0.smithi078.stdout:8/202: truncate d0/f14 3510116 0 2024-09-18T12:49:08.319 INFO:tasks.workunit.client.1.smithi148.stdout:6/295: creat d5/d1a/dc/d2b/f5f x:0 0 0 2024-09-18T12:49:08.320 INFO:tasks.workunit.client.1.smithi148.stdout:5/275: sync 2024-09-18T12:49:08.320 INFO:tasks.workunit.client.1.smithi148.stdout:3/225: sync 2024-09-18T12:49:08.321 INFO:tasks.workunit.client.1.smithi148.stdout:7/238: mknod db/dd/d25/d38/c44 0 2024-09-18T12:49:08.322 INFO:tasks.workunit.client.1.smithi148.stdout:9/214: dwrite d8/da/f13 [0,4194304] 0 2024-09-18T12:49:08.323 INFO:tasks.workunit.client.0.smithi078.stdout:7/93: sync 2024-09-18T12:49:08.323 INFO:tasks.workunit.client.1.smithi148.stdout:6/296: chown d5/d32/d56/f4d 14569 1 2024-09-18T12:49:08.324 INFO:tasks.workunit.client.1.smithi148.stdout:1/267: rename dc/d11/f15 to dc/d18/d31/f5d 0 2024-09-18T12:49:08.324 INFO:tasks.workunit.client.1.smithi148.stdout:2/214: read f7 [5814425,26618] 0 2024-09-18T12:49:08.325 INFO:tasks.workunit.client.0.smithi078.stdout:7/94: write d7/d9/f12 [591290,12048] 0 2024-09-18T12:49:08.326 INFO:tasks.workunit.client.0.smithi078.stdout:8/203: dwrite d0/d7/dc/f26 [0,4194304] 0 2024-09-18T12:49:08.326 INFO:tasks.workunit.client.0.smithi078.stdout:7/95: fsync d7/f1d 0 2024-09-18T12:49:08.328 INFO:tasks.workunit.client.1.smithi148.stdout:4/234: getdents d15/d17/d1f/d4c/d4f 0 2024-09-18T12:49:08.329 INFO:tasks.workunit.client.1.smithi148.stdout:6/297: dread d5/d1a/dc/f20 [0,4194304] 0 2024-09-18T12:49:08.329 INFO:tasks.workunit.client.1.smithi148.stdout:7/239: unlink db/dd/d25/d2e/c33 0 2024-09-18T12:49:08.332 INFO:tasks.workunit.client.1.smithi148.stdout:8/297: dwrite d8/d16/d27/f47 [0,4194304] 0 2024-09-18T12:49:08.333 INFO:tasks.workunit.client.1.smithi148.stdout:1/268: fdatasync dc/d11/f12 0 2024-09-18T12:49:08.336 INFO:tasks.workunit.client.0.smithi078.stdout:7/96: creat d7/d9/f20 x:0 0 0 2024-09-18T12:49:08.339 INFO:tasks.workunit.client.1.smithi148.stdout:7/240: write db/dc/df/d11/f3a [328180,60322] 0 2024-09-18T12:49:08.341 INFO:tasks.workunit.client.1.smithi148.stdout:5/276: dwrite d7/d8/f59 [0,4194304] 0 2024-09-18T12:49:08.342 INFO:tasks.workunit.client.1.smithi148.stdout:9/215: dwrite d8/f26 [0,4194304] 0 2024-09-18T12:49:08.344 INFO:tasks.workunit.client.0.smithi078.stdout:7/97: dwrite d7/d9/f10 [0,4194304] 0 2024-09-18T12:49:08.346 INFO:tasks.workunit.client.1.smithi148.stdout:9/216: write d8/da/df/f2d [513851,35656] 0 2024-09-18T12:49:08.352 INFO:tasks.workunit.client.1.smithi148.stdout:8/298: unlink d8/d16/d53/d39/f40 0 2024-09-18T12:49:08.352 INFO:tasks.workunit.client.1.smithi148.stdout:0/429: dwrite de/d27/f2b [0,4194304] 0 2024-09-18T12:49:08.353 INFO:tasks.workunit.client.1.smithi148.stdout:4/235: mkdir d15/d17/d52 0 2024-09-18T12:49:08.354 INFO:tasks.workunit.client.1.smithi148.stdout:3/226: link d4/l1b d4/d2d/d31/l52 0 2024-09-18T12:49:08.355 INFO:tasks.workunit.client.1.smithi148.stdout:7/241: symlink db/dd/d25/d2e/l45 0 2024-09-18T12:49:08.357 INFO:tasks.workunit.client.1.smithi148.stdout:4/236: write d15/d17/f2b [608004,10194] 0 2024-09-18T12:49:08.357 INFO:tasks.workunit.client.1.smithi148.stdout:9/217: unlink d8/da/df/d27/c29 0 2024-09-18T12:49:08.358 INFO:tasks.workunit.client.1.smithi148.stdout:8/299: stat d8/d12/l17 0 2024-09-18T12:49:08.360 INFO:tasks.workunit.client.1.smithi148.stdout:9/218: stat d8/da/l32 0 2024-09-18T12:49:08.360 INFO:tasks.workunit.client.1.smithi148.stdout:1/269: truncate dc/d11/f16 117360 0 2024-09-18T12:49:08.362 INFO:tasks.workunit.client.1.smithi148.stdout:2/215: getdents d9/d24/d31/d34 0 2024-09-18T12:49:08.364 INFO:tasks.workunit.client.1.smithi148.stdout:0/430: creat de/d14/d43/d57/d59/f99 x:0 0 0 2024-09-18T12:49:08.364 INFO:tasks.workunit.client.1.smithi148.stdout:5/277: dwrite d7/f1b [4194304,4194304] 0 2024-09-18T12:49:08.364 INFO:tasks.workunit.client.1.smithi148.stdout:9/219: stat d8/f22 0 2024-09-18T12:49:08.367 INFO:tasks.workunit.client.1.smithi148.stdout:8/300: chown d8/df/d3e/c50 17276 1 2024-09-18T12:49:08.367 INFO:tasks.workunit.client.1.smithi148.stdout:3/227: creat d4/d8/d20/d2b/f53 x:0 0 0 2024-09-18T12:49:08.368 INFO:tasks.workunit.client.1.smithi148.stdout:1/270: mkdir dc/d51/d5e 0 2024-09-18T12:49:08.368 INFO:tasks.workunit.client.1.smithi148.stdout:5/278: write d7/d2b/f3c [4358421,25389] 0 2024-09-18T12:49:08.369 INFO:tasks.workunit.client.1.smithi148.stdout:3/228: chown d4 2 1 2024-09-18T12:49:08.370 INFO:tasks.workunit.client.1.smithi148.stdout:0/431: creat de/d27/f9a x:0 0 0 2024-09-18T12:49:08.372 INFO:tasks.workunit.client.1.smithi148.stdout:7/242: creat db/dc/df/d11/d43/f46 x:0 0 0 2024-09-18T12:49:08.373 INFO:tasks.workunit.client.1.smithi148.stdout:9/220: mkdir d8/da/dd/d3f 0 2024-09-18T12:49:08.373 INFO:tasks.workunit.client.1.smithi148.stdout:4/237: rmdir d15/d17/d4d 0 2024-09-18T12:49:08.374 INFO:tasks.workunit.client.1.smithi148.stdout:2/216: dread d9/f16 [0,4194304] 0 2024-09-18T12:49:08.374 INFO:tasks.workunit.client.1.smithi148.stdout:9/221: chown f0 2515582 1 2024-09-18T12:49:08.375 INFO:tasks.workunit.client.1.smithi148.stdout:3/229: mkdir d4/d2d/d31/d54 0 2024-09-18T12:49:08.376 INFO:tasks.workunit.client.1.smithi148.stdout:6/298: write d5/ff [1409833,55680] 0 2024-09-18T12:49:08.380 INFO:tasks.workunit.client.1.smithi148.stdout:5/279: dread d7/d8/f59 [0,4194304] 0 2024-09-18T12:49:08.381 INFO:tasks.workunit.client.1.smithi148.stdout:6/299: dread d5/f2e [0,4194304] 0 2024-09-18T12:49:08.381 INFO:tasks.workunit.client.1.smithi148.stdout:5/280: stat d7/d8/dc/d12/d1f/d25/d4b 0 2024-09-18T12:49:08.381 INFO:tasks.workunit.client.1.smithi148.stdout:6/300: truncate d5/ff 2089568 0 2024-09-18T12:49:08.383 INFO:tasks.workunit.client.1.smithi148.stdout:0/432: creat de/f9b x:0 0 0 2024-09-18T12:49:08.384 INFO:tasks.workunit.client.1.smithi148.stdout:0/433: dread - de/d14/d43/d70/f8d zero size 2024-09-18T12:49:08.386 INFO:tasks.workunit.client.1.smithi148.stdout:9/222: rename d8/f26 to d8/da/dd/f40 0 2024-09-18T12:49:08.389 INFO:tasks.workunit.client.1.smithi148.stdout:1/271: getdents dc/d11 0 2024-09-18T12:49:08.389 INFO:tasks.workunit.client.1.smithi148.stdout:1/272: chown dc/c14 3041160 1 2024-09-18T12:49:08.390 INFO:tasks.workunit.client.1.smithi148.stdout:7/243: link db/dd/d25/d38/f3f db/dc/df/d11/f47 0 2024-09-18T12:49:08.390 INFO:tasks.workunit.client.1.smithi148.stdout:1/273: fsync dc/d18/d31/d39/f40 0 2024-09-18T12:49:08.391 INFO:tasks.workunit.client.1.smithi148.stdout:5/281: mkdir d7/d8/dc/d12/d31/d5a 0 2024-09-18T12:49:08.392 INFO:tasks.workunit.client.1.smithi148.stdout:5/282: read d7/d8/f3e [2264655,87016] 0 2024-09-18T12:49:08.400 INFO:tasks.workunit.client.1.smithi148.stdout:8/301: dread d8/d16/d53/d39/f3d [0,4194304] 0 2024-09-18T12:49:08.400 INFO:tasks.workunit.client.1.smithi148.stdout:4/238: dread d15/d17/f27 [0,4194304] 0 2024-09-18T12:49:08.402 INFO:tasks.workunit.client.1.smithi148.stdout:8/302: write d8/f62 [722011,97887] 0 2024-09-18T12:49:08.402 INFO:tasks.workunit.client.1.smithi148.stdout:2/217: dwrite d9/d24/f25 [0,4194304] 0 2024-09-18T12:49:08.403 INFO:tasks.workunit.client.1.smithi148.stdout:8/303: readlink d8/lc 0 2024-09-18T12:49:08.404 INFO:tasks.workunit.client.1.smithi148.stdout:5/283: mknod d7/d8/dc/d12/d1f/c5b 0 2024-09-18T12:49:08.408 INFO:tasks.workunit.client.1.smithi148.stdout:3/230: truncate d4/d8/d20/d2b/f3a 3930381 0 2024-09-18T12:49:08.410 INFO:tasks.workunit.client.1.smithi148.stdout:9/223: link d8/da/dd/l1c d8/da/df/d27/l41 0 2024-09-18T12:49:08.411 INFO:tasks.workunit.client.1.smithi148.stdout:9/224: stat d8/d2f 0 2024-09-18T12:49:08.412 INFO:tasks.workunit.client.1.smithi148.stdout:6/301: dread d5/d1a/dc/d2b/f30 [0,4194304] 0 2024-09-18T12:49:08.412 INFO:tasks.workunit.client.1.smithi148.stdout:3/231: truncate d4/d8/d20/d2b/f45 511660 0 2024-09-18T12:49:08.413 INFO:tasks.workunit.client.1.smithi148.stdout:0/434: dwrite de/f18 [0,4194304] 0 2024-09-18T12:49:08.414 INFO:tasks.workunit.client.1.smithi148.stdout:0/435: readlink de/d14/d43/d57/l8c 0 2024-09-18T12:49:08.419 INFO:tasks.workunit.client.1.smithi148.stdout:3/232: dwrite d4/d8/d1e/f25 [0,4194304] 0 2024-09-18T12:49:08.425 INFO:tasks.workunit.client.1.smithi148.stdout:3/233: dwrite d4/d2d/d31/f34 [0,4194304] 0 2024-09-18T12:49:08.483 INFO:tasks.workunit.client.1.smithi148.stdout:5/284: truncate d7/f15 858521 0 2024-09-18T12:49:08.485 INFO:tasks.workunit.client.1.smithi148.stdout:5/285: write d7/d8/dc/d12/d1f/d25/f54 [455811,36623] 0 2024-09-18T12:49:08.485 INFO:tasks.workunit.client.1.smithi148.stdout:1/274: creat dc/d11/d17/f5f x:0 0 0 2024-09-18T12:49:08.488 INFO:tasks.workunit.client.1.smithi148.stdout:8/304: mkdir d8/df/d66 0 2024-09-18T12:49:08.489 INFO:tasks.workunit.client.1.smithi148.stdout:8/305: read d8/d16/f4d [2769777,61256] 0 2024-09-18T12:49:08.490 INFO:tasks.workunit.client.1.smithi148.stdout:9/225: creat d8/d33/f42 x:0 0 0 2024-09-18T12:49:08.491 INFO:tasks.workunit.client.1.smithi148.stdout:6/302: readlink d5/d32/d38/d41/l4f 0 2024-09-18T12:49:08.491 INFO:tasks.workunit.client.1.smithi148.stdout:0/436: creat de/d14/d43/d57/f9c x:0 0 0 2024-09-18T12:49:08.492 INFO:tasks.workunit.client.1.smithi148.stdout:7/244: dwrite db/dc/f12 [0,4194304] 0 2024-09-18T12:49:08.492 INFO:tasks.workunit.client.1.smithi148.stdout:8/306: truncate d8/d16/f2a 5028658 0 2024-09-18T12:49:08.492 INFO:tasks.workunit.client.1.smithi148.stdout:6/303: chown d5/f19 445144 1 2024-09-18T12:49:08.493 INFO:tasks.workunit.client.1.smithi148.stdout:7/245: chown db/dc/df/d11/c39 116269284 1 2024-09-18T12:49:08.494 INFO:tasks.workunit.client.1.smithi148.stdout:6/304: dread - d5/d1a/d29/f4e zero size 2024-09-18T12:49:08.494 INFO:tasks.workunit.client.1.smithi148.stdout:5/286: mkdir d7/d8/dc/d12/d1f/d5c 0 2024-09-18T12:49:08.494 INFO:tasks.workunit.client.1.smithi148.stdout:0/437: write de/d14/f65 [1737785,87717] 0 2024-09-18T12:49:08.495 INFO:tasks.workunit.client.1.smithi148.stdout:4/239: rename d15/d17/d1f/f21 to d15/f53 0 2024-09-18T12:49:08.497 INFO:tasks.workunit.client.1.smithi148.stdout:7/246: fsync db/dc/f37 0 2024-09-18T12:49:08.498 INFO:tasks.workunit.client.1.smithi148.stdout:0/438: fsync de/d27/d2e/f73 0 2024-09-18T12:49:08.498 INFO:tasks.workunit.client.1.smithi148.stdout:9/226: readlink d8/da/dd/l1c 0 2024-09-18T12:49:08.498 INFO:tasks.workunit.client.1.smithi148.stdout:3/234: getdents d4/d2d/d31/d46 0 2024-09-18T12:49:08.500 INFO:tasks.workunit.client.1.smithi148.stdout:4/240: write d15/d17/d1f/f32 [4876494,72636] 0 2024-09-18T12:49:08.500 INFO:tasks.workunit.client.1.smithi148.stdout:3/235: dread - d4/f41 zero size 2024-09-18T12:49:08.500 INFO:tasks.workunit.client.1.smithi148.stdout:8/307: creat d8/d16/d53/d39/f67 x:0 0 0 2024-09-18T12:49:08.503 INFO:tasks.workunit.client.1.smithi148.stdout:7/247: truncate db/dd/d25/f3c 383690 0 2024-09-18T12:49:08.504 INFO:tasks.workunit.client.1.smithi148.stdout:2/218: rename d9/d24/d31/d46 to d9/d24/d47 0 2024-09-18T12:49:08.508 INFO:tasks.workunit.client.1.smithi148.stdout:0/439: dwrite de/f24 [0,4194304] 0 2024-09-18T12:49:08.509 INFO:tasks.workunit.client.1.smithi148.stdout:2/219: truncate d9/d24/d31/f3d 628654 0 2024-09-18T12:49:08.509 INFO:tasks.workunit.client.1.smithi148.stdout:0/440: chown de/d27/f76 6581241 1 2024-09-18T12:49:08.510 INFO:tasks.workunit.client.1.smithi148.stdout:6/305: mknod d5/d1a/d29/d5c/c60 0 2024-09-18T12:49:08.511 INFO:tasks.workunit.client.1.smithi148.stdout:2/220: chown d9/d24/d31/f3d 4597 1 2024-09-18T12:49:08.512 INFO:tasks.workunit.client.1.smithi148.stdout:0/441: chown de/d14/f26 4 1 2024-09-18T12:49:08.512 INFO:tasks.workunit.client.1.smithi148.stdout:7/248: dwrite db/dc/df/f35 [0,4194304] 0 2024-09-18T12:49:08.517 INFO:tasks.workunit.client.1.smithi148.stdout:0/442: dread de/d27/f2b [0,4194304] 0 2024-09-18T12:49:08.518 INFO:tasks.workunit.client.1.smithi148.stdout:7/249: dread db/dc/f15 [0,4194304] 0 2024-09-18T12:49:08.518 INFO:tasks.workunit.client.1.smithi148.stdout:0/443: fdatasync de/d14/f28 0 2024-09-18T12:49:08.521 INFO:tasks.workunit.client.1.smithi148.stdout:3/236: mknod d4/d2d/d31/d46/c55 0 2024-09-18T12:49:08.521 INFO:tasks.workunit.client.1.smithi148.stdout:3/237: write d4/d8/f15 [4815657,109445] 0 2024-09-18T12:49:08.522 INFO:tasks.workunit.client.1.smithi148.stdout:3/238: chown d4/d8/d20/d2b/l44 332893 1 2024-09-18T12:49:08.523 INFO:tasks.workunit.client.1.smithi148.stdout:2/221: mkdir d9/d24/d27/d48 0 2024-09-18T12:49:08.523 INFO:tasks.workunit.client.1.smithi148.stdout:6/306: read d5/d1a/f1f [1760777,15625] 0 2024-09-18T12:49:08.524 INFO:tasks.workunit.client.1.smithi148.stdout:6/307: stat d5/d32/f3b 0 2024-09-18T12:49:08.526 INFO:tasks.workunit.client.1.smithi148.stdout:8/308: link d8/d16/d27/f4a d8/f68 0 2024-09-18T12:49:08.526 INFO:tasks.workunit.client.1.smithi148.stdout:9/227: link d8/da/df/l24 d8/d33/l43 0 2024-09-18T12:49:08.528 INFO:tasks.workunit.client.1.smithi148.stdout:5/287: fdatasync d7/d8/dc/d12/f45 0 2024-09-18T12:49:08.528 INFO:tasks.workunit.client.1.smithi148.stdout:5/288: fdatasync d7/d2b/f36 0 2024-09-18T12:49:08.529 INFO:tasks.workunit.client.1.smithi148.stdout:3/239: mknod d4/d2d/d31/d46/c56 0 2024-09-18T12:49:08.530 INFO:tasks.workunit.client.1.smithi148.stdout:3/240: write d4/d8/d20/f33 [246348,98117] 0 2024-09-18T12:49:08.531 INFO:tasks.workunit.client.1.smithi148.stdout:6/308: creat d5/d32/d38/d50/f61 x:0 0 0 2024-09-18T12:49:08.533 INFO:tasks.workunit.client.1.smithi148.stdout:6/309: write d5/d32/f33 [5060168,102256] 0 2024-09-18T12:49:08.533 INFO:tasks.workunit.client.1.smithi148.stdout:1/275: rename dc/d18/d43/l45 to dc/d11/d17/l60 0 2024-09-18T12:49:08.533 INFO:tasks.workunit.client.1.smithi148.stdout:2/222: dread d9/d24/d27/f38 [0,4194304] 0 2024-09-18T12:49:08.534 INFO:tasks.workunit.client.1.smithi148.stdout:8/309: unlink d8/d16/d53/l3f 0 2024-09-18T12:49:08.535 INFO:tasks.workunit.client.1.smithi148.stdout:8/310: dread - d8/d16/d53/d39/f67 zero size 2024-09-18T12:49:08.536 INFO:tasks.workunit.client.1.smithi148.stdout:8/311: chown d8/d16/d27/c24 231666 1 2024-09-18T12:49:08.536 INFO:tasks.workunit.client.1.smithi148.stdout:5/289: unlink d7/d8/d18/d3f/f4e 0 2024-09-18T12:49:08.537 INFO:tasks.workunit.client.1.smithi148.stdout:3/241: creat d4/d2d/d31/d46/f57 x:0 0 0 2024-09-18T12:49:08.539 INFO:tasks.workunit.client.1.smithi148.stdout:6/310: symlink d5/d32/d56/l62 0 2024-09-18T12:49:08.541 INFO:tasks.workunit.client.1.smithi148.stdout:2/223: symlink d9/d24/d31/l49 0 2024-09-18T12:49:08.545 INFO:tasks.workunit.client.1.smithi148.stdout:6/311: symlink d5/d32/l63 0 2024-09-18T12:49:08.545 INFO:tasks.workunit.client.1.smithi148.stdout:9/228: link d8/da/dd/d35/c3c d8/c44 0 2024-09-18T12:49:08.546 INFO:tasks.workunit.client.1.smithi148.stdout:0/444: write de/d14/f2a [412735,58710] 0 2024-09-18T12:49:08.546 INFO:tasks.workunit.client.1.smithi148.stdout:9/229: stat d8/f22 0 2024-09-18T12:49:08.546 INFO:tasks.workunit.client.1.smithi148.stdout:1/276: link fb dc/d18/d31/d39/f61 0 2024-09-18T12:49:08.547 INFO:tasks.workunit.client.1.smithi148.stdout:9/230: stat d8/da/df/f3a 0 2024-09-18T12:49:08.548 INFO:tasks.workunit.client.1.smithi148.stdout:5/290: truncate d7/d8/dc/d12/f24 3668418 0 2024-09-18T12:49:08.549 INFO:tasks.workunit.client.1.smithi148.stdout:7/250: rename f3 to db/dd/d25/f48 0 2024-09-18T12:49:08.550 INFO:tasks.workunit.client.1.smithi148.stdout:6/312: creat d5/d32/f64 x:0 0 0 2024-09-18T12:49:08.551 INFO:tasks.workunit.client.1.smithi148.stdout:0/445: mkdir de/d27/d53/d89/d9d 0 2024-09-18T12:49:08.552 INFO:tasks.workunit.client.1.smithi148.stdout:8/312: dread d8/d12/f15 [0,4194304] 0 2024-09-18T12:49:08.552 INFO:tasks.workunit.client.1.smithi148.stdout:9/231: readlink d8/d33/l43 0 2024-09-18T12:49:08.554 INFO:tasks.workunit.client.1.smithi148.stdout:1/277: dread dc/d11/f12 [0,4194304] 0 2024-09-18T12:49:08.554 INFO:tasks.workunit.client.1.smithi148.stdout:7/251: creat db/dd/d25/d38/f49 x:0 0 0 2024-09-18T12:49:08.556 INFO:tasks.workunit.client.1.smithi148.stdout:3/242: dread f2 [0,4194304] 0 2024-09-18T12:49:08.558 INFO:tasks.workunit.client.1.smithi148.stdout:1/278: fdatasync dc/d11/d17/f41 0 2024-09-18T12:49:08.558 INFO:tasks.workunit.client.1.smithi148.stdout:0/446: getdents de/d27/d53/d89/d9d 0 2024-09-18T12:49:08.559 INFO:tasks.workunit.client.1.smithi148.stdout:1/279: stat dc/d18/d43/c42 0 2024-09-18T12:49:08.561 INFO:tasks.workunit.client.1.smithi148.stdout:1/280: read - dc/d11/d17/f5f zero size 2024-09-18T12:49:08.561 INFO:tasks.workunit.client.1.smithi148.stdout:2/224: rename d9/d24/d27 to d9/d4a 0 2024-09-18T12:49:08.562 INFO:tasks.workunit.client.1.smithi148.stdout:7/252: dwrite db/dc/df/f35 [4194304,4194304] 0 2024-09-18T12:49:08.563 INFO:tasks.workunit.client.1.smithi148.stdout:3/243: unlink d4/d2d/d31/d46/f57 0 2024-09-18T12:49:08.564 INFO:tasks.workunit.client.1.smithi148.stdout:5/291: getdents d7/d8/dc/d12/d20 0 2024-09-18T12:49:08.569 INFO:tasks.workunit.client.1.smithi148.stdout:6/313: rename d5/d32/d38/d41 to d5/d1a/dc/d2b/d35/d65 0 2024-09-18T12:49:08.572 INFO:tasks.workunit.client.1.smithi148.stdout:3/244: creat d4/d2d/d31/f58 x:0 0 0 2024-09-18T12:49:08.572 INFO:tasks.workunit.client.1.smithi148.stdout:3/245: fdatasync d4/f6 0 2024-09-18T12:49:08.572 INFO:tasks.workunit.client.1.smithi148.stdout:5/292: creat d7/d8/dc/f5d x:0 0 0 2024-09-18T12:49:08.573 INFO:tasks.workunit.client.1.smithi148.stdout:3/246: readlink d4/d8/d20/d2b/d43/l2a 0 2024-09-18T12:49:08.574 INFO:tasks.workunit.client.1.smithi148.stdout:0/447: link de/d27/f76 de/d27/d53/d89/d9d/f9e 0 2024-09-18T12:49:08.574 INFO:tasks.workunit.client.1.smithi148.stdout:0/448: stat de/d27/f9a 0 2024-09-18T12:49:08.575 INFO:tasks.workunit.client.1.smithi148.stdout:0/449: write de/f18 [4127545,24253] 0 2024-09-18T12:49:08.575 INFO:tasks.workunit.client.1.smithi148.stdout:8/313: rename d8/d12/f2c to d8/d16/d53/d39/d3b/d41/f69 0 2024-09-18T12:49:08.576 INFO:tasks.workunit.client.1.smithi148.stdout:0/450: chown de/d27/d2e/f33 139 1 2024-09-18T12:49:08.576 INFO:tasks.workunit.client.1.smithi148.stdout:8/314: fsync d8/df/f10 0 2024-09-18T12:49:08.577 INFO:tasks.workunit.client.1.smithi148.stdout:6/314: dread d5/f2e [0,4194304] 0 2024-09-18T12:49:08.598 INFO:tasks.workunit.client.1.smithi148.stdout:7/253: creat db/dd/d25/f4a x:0 0 0 2024-09-18T12:49:08.600 INFO:tasks.workunit.client.1.smithi148.stdout:2/225: write f5 [2562633,76453] 0 2024-09-18T12:49:08.600 INFO:tasks.workunit.client.1.smithi148.stdout:1/281: truncate dc/f57 4697278 0 2024-09-18T12:49:08.601 INFO:tasks.workunit.client.1.smithi148.stdout:5/293: truncate d7/d8/d18/f38 1940513 0 2024-09-18T12:49:08.602 INFO:tasks.workunit.client.1.smithi148.stdout:9/232: dread f7 [0,4194304] 0 2024-09-18T12:49:08.604 INFO:tasks.workunit.client.1.smithi148.stdout:7/254: read db/dc/df/d11/f1b [313700,67374] 0 2024-09-18T12:49:08.604 INFO:tasks.workunit.client.1.smithi148.stdout:6/315: link d5/d1a/dc/d2b/f57 d5/d1a/d29/d5c/f66 0 2024-09-18T12:49:08.605 INFO:tasks.workunit.client.1.smithi148.stdout:8/315: dwrite d8/df/d3e/f54 [0,4194304] 0 2024-09-18T12:49:08.605 INFO:tasks.workunit.client.1.smithi148.stdout:9/233: truncate f6 5053096 0 2024-09-18T12:49:08.609 INFO:tasks.workunit.client.1.smithi148.stdout:5/294: creat d7/d8/dc/d12/d1f/d39/f5e x:0 0 0 2024-09-18T12:49:08.609 INFO:tasks.workunit.client.1.smithi148.stdout:9/234: dread d8/da/df/f3a [0,4194304] 0 2024-09-18T12:49:08.610 INFO:tasks.workunit.client.1.smithi148.stdout:8/316: dread f1 [0,4194304] 0 2024-09-18T12:49:08.610 INFO:tasks.workunit.client.1.smithi148.stdout:7/255: unlink db/dd/d25/f4a 0 2024-09-18T12:49:08.613 INFO:tasks.workunit.client.1.smithi148.stdout:6/316: creat d5/d1a/d29/d5c/f67 x:0 0 0 2024-09-18T12:49:08.616 INFO:tasks.workunit.client.1.smithi148.stdout:5/295: creat d7/d8/dc/d22/f5f x:0 0 0 2024-09-18T12:49:08.617 INFO:tasks.workunit.client.0.smithi078.stdout:3/121: sync 2024-09-18T12:49:08.618 INFO:tasks.workunit.client.1.smithi148.stdout:8/317: chown c6 2047 1 2024-09-18T12:49:08.618 INFO:tasks.workunit.client.0.smithi078.stdout:3/122: read d9/f12 [4329876,64677] 0 2024-09-18T12:49:08.619 INFO:tasks.workunit.client.1.smithi148.stdout:1/282: dwrite dc/d18/d43/f4e [0,4194304] 0 2024-09-18T12:49:08.619 INFO:tasks.workunit.client.1.smithi148.stdout:5/296: write d7/d8/dc/d12/d20/f2e [256641,96848] 0 2024-09-18T12:49:08.621 INFO:tasks.workunit.client.1.smithi148.stdout:5/297: write d7/d8/dc/d12/d1f/d25/f54 [455494,25747] 0 2024-09-18T12:49:08.623 INFO:tasks.workunit.client.1.smithi148.stdout:9/235: mkdir d8/da/dd/d3f/d45 0 2024-09-18T12:49:08.623 INFO:tasks.workunit.client.1.smithi148.stdout:7/256: symlink db/l4b 0 2024-09-18T12:49:08.626 INFO:tasks.workunit.client.1.smithi148.stdout:8/318: creat d8/d16/d53/d39/d3b/f6a x:0 0 0 2024-09-18T12:49:08.626 INFO:tasks.workunit.client.0.smithi078.stdout:3/123: dwrite d9/df/d11/f1b [0,4194304] 0 2024-09-18T12:49:08.627 INFO:tasks.workunit.client.0.smithi078.stdout:3/124: fsync f7 0 2024-09-18T12:49:08.631 INFO:tasks.workunit.client.1.smithi148.stdout:2/226: truncate d9/f1e 2278688 0 2024-09-18T12:49:08.635 INFO:tasks.workunit.client.1.smithi148.stdout:7/257: mkdir db/dc/d4c 0 2024-09-18T12:49:08.637 INFO:tasks.workunit.client.1.smithi148.stdout:8/319: rmdir d8/d12/d46 39 2024-09-18T12:49:08.638 INFO:tasks.workunit.client.1.smithi148.stdout:1/283: truncate dc/d11/d17/d2b/f2e 255468 0 2024-09-18T12:49:08.639 INFO:tasks.workunit.client.1.smithi148.stdout:5/298: symlink d7/d8/dc/d12/l60 0 2024-09-18T12:49:08.640 INFO:tasks.workunit.client.1.smithi148.stdout:7/258: creat db/dd/d1f/f4d x:0 0 0 2024-09-18T12:49:08.640 INFO:tasks.workunit.client.1.smithi148.stdout:9/236: dread d8/da/df/f18 [0,4194304] 0 2024-09-18T12:49:08.642 INFO:tasks.workunit.client.1.smithi148.stdout:6/317: link d5/d1a/dc/c2a d5/d32/d56/c68 0 2024-09-18T12:49:08.646 INFO:tasks.workunit.client.1.smithi148.stdout:8/320: unlink d8/d16/d27/l55 0 2024-09-18T12:49:08.648 INFO:tasks.workunit.client.1.smithi148.stdout:6/318: dwrite d5/d1a/dc/d2b/d35/d65/f5e [0,4194304] 0 2024-09-18T12:49:08.649 INFO:tasks.workunit.client.1.smithi148.stdout:4/241: sync 2024-09-18T12:49:08.649 INFO:tasks.workunit.client.0.smithi078.stdout:3/125: dwrite d9/df/d11/f1b [4194304,4194304] 0 2024-09-18T12:49:08.655 INFO:tasks.workunit.client.0.smithi078.stdout:3/126: dread d9/d2a/d19/f22 [0,4194304] 0 2024-09-18T12:49:08.660 INFO:tasks.workunit.client.0.smithi078.stdout:3/127: truncate d9/f12 4426220 0 2024-09-18T12:49:08.661 INFO:tasks.workunit.client.0.smithi078.stdout:3/128: readlink d9/d2a/l2c 0 2024-09-18T12:49:08.662 INFO:tasks.workunit.client.0.smithi078.stdout:3/129: mknod d9/df/c2d 0 2024-09-18T12:49:08.700 INFO:tasks.workunit.client.1.smithi148.stdout:2/227: chown d9/f1e 186222583 1 2024-09-18T12:49:08.700 INFO:tasks.workunit.client.1.smithi148.stdout:9/237: mkdir d8/da/dd/d3f/d45/d46 0 2024-09-18T12:49:08.701 INFO:tasks.workunit.client.1.smithi148.stdout:6/319: creat d5/d1a/dc/d2b/d35/f69 x:0 0 0 2024-09-18T12:49:08.702 INFO:tasks.workunit.client.1.smithi148.stdout:9/238: fsync d8/d33/f34 0 2024-09-18T12:49:08.703 INFO:tasks.workunit.client.1.smithi148.stdout:2/228: chown d9/d4a/f38 34869 1 2024-09-18T12:49:08.704 INFO:tasks.workunit.client.1.smithi148.stdout:7/259: dread db/dd/f1a [0,4194304] 0 2024-09-18T12:49:08.706 INFO:tasks.workunit.client.1.smithi148.stdout:4/242: dwrite d15/d17/d1f/d4c/d4f/d34/f35 [0,4194304] 0 2024-09-18T12:49:08.711 INFO:tasks.workunit.client.1.smithi148.stdout:7/260: truncate db/dc/f37 1370567 0 2024-09-18T12:49:08.713 INFO:tasks.workunit.client.1.smithi148.stdout:8/321: dwrite d8/d16/d53/d39/d3b/d41/f4c [0,4194304] 0 2024-09-18T12:49:08.716 INFO:tasks.workunit.client.1.smithi148.stdout:5/299: dwrite d7/d8/d18/f38 [0,4194304] 0 2024-09-18T12:49:08.716 INFO:tasks.workunit.client.1.smithi148.stdout:4/243: chown d15/d17/d1f/f2e 8596210 1 2024-09-18T12:49:08.721 INFO:tasks.workunit.client.1.smithi148.stdout:2/229: dwrite d9/fb [0,4194304] 0 2024-09-18T12:49:08.721 INFO:tasks.workunit.client.1.smithi148.stdout:2/230: stat d9/c15 0 2024-09-18T12:49:08.723 INFO:tasks.workunit.client.1.smithi148.stdout:2/231: truncate d9/d24/f32 2176423 0 2024-09-18T12:49:08.750 INFO:tasks.workunit.client.1.smithi148.stdout:7/261: dread db/dc/df/d1d/f21 [4194304,4194304] 0 2024-09-18T12:49:08.755 INFO:tasks.workunit.client.0.smithi078.stdout:3/130: dwrite d9/f27 [0,4194304] 0 2024-09-18T12:49:08.756 INFO:tasks.workunit.client.1.smithi148.stdout:7/262: dwrite db/dc/f28 [0,4194304] 0 2024-09-18T12:49:08.758 INFO:tasks.workunit.client.1.smithi148.stdout:9/239: dwrite d8/da/dd/f40 [0,4194304] 0 2024-09-18T12:49:08.758 INFO:tasks.workunit.client.0.smithi078.stdout:3/131: dread d9/d29/f24 [0,4194304] 0 2024-09-18T12:49:08.760 INFO:tasks.workunit.client.1.smithi148.stdout:9/240: write d8/da/f1d [791878,62567] 0 2024-09-18T12:49:08.763 INFO:tasks.workunit.client.1.smithi148.stdout:9/241: stat d8/da/df/l30 0 2024-09-18T12:49:08.763 INFO:tasks.workunit.client.1.smithi148.stdout:1/284: sync 2024-09-18T12:49:08.763 INFO:tasks.workunit.client.1.smithi148.stdout:3/247: sync 2024-09-18T12:49:08.764 INFO:tasks.workunit.client.1.smithi148.stdout:0/451: sync 2024-09-18T12:49:08.799 INFO:tasks.workunit.client.0.smithi078.stdout:5/217: sync 2024-09-18T12:49:08.805 INFO:tasks.workunit.client.0.smithi078.stdout:3/132: rename l1 to d9/df/l2e 0 2024-09-18T12:49:08.805 INFO:tasks.workunit.client.0.smithi078.stdout:3/133: stat d9/f27 0 2024-09-18T12:49:08.808 INFO:tasks.workunit.client.1.smithi148.stdout:5/300: creat d7/d8/dc/d12/d20/f61 x:0 0 0 2024-09-18T12:49:08.808 INFO:tasks.workunit.client.1.smithi148.stdout:8/322: mknod d8/d16/d53/d39/c6b 0 2024-09-18T12:49:08.810 INFO:tasks.workunit.client.1.smithi148.stdout:4/244: rmdir d15/d17/d1f/d4c/d4f/d34 39 2024-09-18T12:49:08.811 INFO:tasks.workunit.client.1.smithi148.stdout:2/232: creat d9/d3a/f4b x:0 0 0 2024-09-18T12:49:08.812 INFO:tasks.workunit.client.1.smithi148.stdout:2/233: chown d9/d24/d47 3585 1 2024-09-18T12:49:08.813 INFO:tasks.workunit.client.1.smithi148.stdout:6/320: mknod d5/d1a/c6a 0 2024-09-18T12:49:08.817 INFO:tasks.workunit.client.1.smithi148.stdout:9/242: mkdir d8/da/dd/d35/d47 0 2024-09-18T12:49:08.817 INFO:tasks.workunit.client.1.smithi148.stdout:9/243: chown d8/c9 1 1 2024-09-18T12:49:08.818 INFO:tasks.workunit.client.1.smithi148.stdout:1/285: symlink dc/d11/d17/d2b/l62 0 2024-09-18T12:49:08.820 INFO:tasks.workunit.client.0.smithi078.stdout:5/218: truncate d2/fc 1346473 0 2024-09-18T12:49:08.821 INFO:tasks.workunit.client.1.smithi148.stdout:2/234: symlink d9/d24/l4c 0 2024-09-18T12:49:08.823 INFO:tasks.workunit.client.1.smithi148.stdout:9/244: dwrite d8/da/df/f15 [0,4194304] 0 2024-09-18T12:49:08.823 INFO:tasks.workunit.client.0.smithi078.stdout:5/219: write d2/d4/d9/da/ff [905420,26261] 0 2024-09-18T12:49:08.824 INFO:tasks.workunit.client.1.smithi148.stdout:1/286: dread dc/d18/d43/f4e [0,4194304] 0 2024-09-18T12:49:08.824 INFO:tasks.workunit.client.1.smithi148.stdout:7/263: truncate db/dc/df/d11/f1b 635980 0 2024-09-18T12:49:08.825 INFO:tasks.workunit.client.1.smithi148.stdout:0/452: write de/d14/f17 [1978873,20047] 0 2024-09-18T12:49:08.825 INFO:tasks.workunit.client.1.smithi148.stdout:9/245: write d8/f10 [856733,17149] 0 2024-09-18T12:49:08.827 INFO:tasks.workunit.client.1.smithi148.stdout:8/323: mknod d8/d12/c6c 0 2024-09-18T12:49:08.829 INFO:tasks.workunit.client.0.smithi078.stdout:3/134: dread d9/f12 [0,4194304] 0 2024-09-18T12:49:08.832 INFO:tasks.workunit.client.1.smithi148.stdout:5/301: symlink d7/d8/dc/d12/d1f/d5c/l62 0 2024-09-18T12:49:08.832 INFO:tasks.workunit.client.1.smithi148.stdout:7/264: dwrite db/dc/df/d1d/f21 [0,4194304] 0 2024-09-18T12:49:08.835 INFO:tasks.workunit.client.1.smithi148.stdout:4/245: mknod d15/d17/d52/c54 0 2024-09-18T12:49:08.836 INFO:tasks.workunit.client.0.smithi078.stdout:3/135: write d9/d2a/f10 [1523084,94288] 0 2024-09-18T12:49:08.838 INFO:tasks.workunit.client.1.smithi148.stdout:6/321: symlink d5/d1a/l6b 0 2024-09-18T12:49:08.840 INFO:tasks.workunit.client.0.smithi078.stdout:5/220: rmdir d2/d4/d9/da/d2b/d45 0 2024-09-18T12:49:08.841 INFO:tasks.workunit.client.0.smithi078.stdout:3/136: fdatasync d9/f12 0 2024-09-18T12:49:08.842 INFO:tasks.workunit.client.0.smithi078.stdout:3/137: fdatasync d9/f27 0 2024-09-18T12:49:08.843 INFO:tasks.workunit.client.1.smithi148.stdout:5/302: dwrite d7/d8/fa [4194304,4194304] 0 2024-09-18T12:49:08.844 INFO:tasks.workunit.client.1.smithi148.stdout:9/246: symlink d8/da/df/l48 0 2024-09-18T12:49:08.845 INFO:tasks.workunit.client.1.smithi148.stdout:0/453: creat de/d14/d43/d70/d7f/f9f x:0 0 0 2024-09-18T12:49:08.846 INFO:tasks.workunit.client.1.smithi148.stdout:5/303: write d7/d8/dc/d12/f51 [824760,92178] 0 2024-09-18T12:49:08.847 INFO:tasks.workunit.client.1.smithi148.stdout:6/322: dwrite d5/f19 [0,4194304] 0 2024-09-18T12:49:08.849 INFO:tasks.workunit.client.1.smithi148.stdout:6/323: read - d5/d1a/d29/f5d zero size 2024-09-18T12:49:08.850 INFO:tasks.workunit.client.1.smithi148.stdout:6/324: chown d5/d1a/dc/d2b/d35/f69 28 1 2024-09-18T12:49:08.855 INFO:tasks.workunit.client.0.smithi078.stdout:9/122: sync 2024-09-18T12:49:08.855 INFO:tasks.workunit.client.0.smithi078.stdout:0/264: sync 2024-09-18T12:49:08.855 INFO:tasks.workunit.client.0.smithi078.stdout:1/159: sync 2024-09-18T12:49:08.855 INFO:tasks.workunit.client.0.smithi078.stdout:2/180: sync 2024-09-18T12:49:08.860 INFO:tasks.workunit.client.1.smithi148.stdout:8/324: dread d8/f68 [0,4194304] 0 2024-09-18T12:49:08.864 INFO:tasks.workunit.client.0.smithi078.stdout:5/221: dwrite d2/d4/d12/d2d/f3a [0,4194304] 0 2024-09-18T12:49:08.864 INFO:tasks.workunit.client.0.smithi078.stdout:9/123: rename d5/c10 to d5/d7/c22 0 2024-09-18T12:49:08.865 INFO:tasks.workunit.client.0.smithi078.stdout:0/265: truncate d3/f17 2872313 0 2024-09-18T12:49:08.866 INFO:tasks.workunit.client.1.smithi148.stdout:2/235: rmdir d9/d4a/d48 0 2024-09-18T12:49:08.869 INFO:tasks.workunit.client.1.smithi148.stdout:4/246: fdatasync f2 0 2024-09-18T12:49:08.870 INFO:tasks.workunit.client.1.smithi148.stdout:0/454: truncate de/d14/f25 1614788 0 2024-09-18T12:49:08.870 INFO:tasks.workunit.client.1.smithi148.stdout:1/287: truncate dc/d18/d43/f4e 2212064 0 2024-09-18T12:49:08.870 INFO:tasks.workunit.client.0.smithi078.stdout:5/222: dwrite d2/d4/f34 [0,4194304] 0 2024-09-18T12:49:08.871 INFO:tasks.workunit.client.1.smithi148.stdout:0/455: chown de/d14/d43/d70/d7f/f50 87714 1 2024-09-18T12:49:08.872 INFO:tasks.workunit.client.1.smithi148.stdout:5/304: dread d7/d8/dc/d12/d31/f32 [0,4194304] 0 2024-09-18T12:49:08.873 INFO:tasks.workunit.client.1.smithi148.stdout:5/305: write d7/d8/fa [9134312,34657] 0 2024-09-18T12:49:08.873 INFO:tasks.workunit.client.0.smithi078.stdout:1/160: rmdir d0/d8/d2f 0 2024-09-18T12:49:08.877 INFO:tasks.workunit.client.1.smithi148.stdout:6/325: mknod d5/d1a/dc/c6c 0 2024-09-18T12:49:08.878 INFO:tasks.workunit.client.1.smithi148.stdout:6/326: dread - d5/d1a/dc/d2b/f5f zero size 2024-09-18T12:49:08.879 INFO:tasks.workunit.client.1.smithi148.stdout:6/327: dread - d5/d32/f64 zero size 2024-09-18T12:49:08.880 INFO:tasks.workunit.client.1.smithi148.stdout:7/265: rmdir db/dd/d1f/d24 0 2024-09-18T12:49:08.881 INFO:tasks.workunit.client.0.smithi078.stdout:5/223: dwrite d2/d4/d12/d16/d36/f41 [0,4194304] 0 2024-09-18T12:49:08.882 INFO:tasks.workunit.client.0.smithi078.stdout:0/266: fsync d3/f1d 0 2024-09-18T12:49:08.883 INFO:tasks.workunit.client.0.smithi078.stdout:1/161: dread d0/d8/f2b [0,4194304] 0 2024-09-18T12:49:08.885 INFO:tasks.workunit.client.0.smithi078.stdout:9/124: symlink d5/l23 0 2024-09-18T12:49:08.885 INFO:tasks.workunit.client.0.smithi078.stdout:9/125: truncate f0 6214385 0 2024-09-18T12:49:08.886 INFO:tasks.workunit.client.1.smithi148.stdout:6/328: dwrite d5/f19 [4194304,4194304] 0 2024-09-18T12:49:08.888 INFO:tasks.workunit.client.1.smithi148.stdout:4/247: creat d15/d3f/f55 x:0 0 0 2024-09-18T12:49:08.892 INFO:tasks.workunit.client.1.smithi148.stdout:8/325: getdents d8/d12/d51 0 2024-09-18T12:49:08.901 INFO:tasks.workunit.client.1.smithi148.stdout:5/306: symlink d7/d2b/l63 0 2024-09-18T12:49:08.902 INFO:tasks.workunit.client.1.smithi148.stdout:5/307: readlink d7/d8/dc/d12/d1f/d39/l44 0 2024-09-18T12:49:08.902 INFO:tasks.workunit.client.1.smithi148.stdout:5/308: chown d7/d8/dc 61 1 2024-09-18T12:49:08.903 INFO:tasks.workunit.client.0.smithi078.stdout:2/181: dread d4/d1a/f22 [0,4194304] 0 2024-09-18T12:49:08.903 INFO:tasks.workunit.client.1.smithi148.stdout:5/309: fsync d7/d2b/f3c 0 2024-09-18T12:49:08.910 INFO:tasks.workunit.client.1.smithi148.stdout:1/288: mkdir dc/d18/d63 0 2024-09-18T12:49:08.912 INFO:tasks.workunit.client.0.smithi078.stdout:5/224: dread d2/d4/d9/f1c [0,4194304] 0 2024-09-18T12:49:08.913 INFO:tasks.workunit.client.0.smithi078.stdout:9/126: creat d5/d7/d8/d1c/f24 x:0 0 0 2024-09-18T12:49:08.916 INFO:tasks.workunit.client.0.smithi078.stdout:2/182: rename d4/db/d31 to d4/dd/d18/d3b 0 2024-09-18T12:49:08.918 INFO:tasks.workunit.client.0.smithi078.stdout:0/267: creat d3/d1f/d2e/d58/f61 x:0 0 0 2024-09-18T12:49:08.919 INFO:tasks.workunit.client.1.smithi148.stdout:3/248: sync 2024-09-18T12:49:08.919 INFO:tasks.workunit.client.1.smithi148.stdout:3/249: fsync d4/d2d/d31/f58 0 2024-09-18T12:49:08.920 INFO:tasks.workunit.client.0.smithi078.stdout:5/225: mknod d2/d4/d9/da/c4a 0 2024-09-18T12:49:08.920 INFO:tasks.workunit.client.1.smithi148.stdout:5/310: mknod d7/d8/dc/d12/d1f/d5c/c64 0 2024-09-18T12:49:08.921 INFO:tasks.workunit.client.1.smithi148.stdout:7/266: write db/dc/f15 [3233129,109012] 0 2024-09-18T12:49:08.921 INFO:tasks.workunit.client.0.smithi078.stdout:5/226: write d2/d4/d9/da/f19 [747584,53448] 0 2024-09-18T12:49:08.924 INFO:tasks.workunit.client.0.smithi078.stdout:9/127: rename d5/d7/d8/f16 to d5/d7/f25 0 2024-09-18T12:49:08.924 INFO:tasks.workunit.client.1.smithi148.stdout:4/248: write d15/d17/d1f/d4c/d4f/f22 [1371462,85059] 0 2024-09-18T12:49:08.924 INFO:tasks.workunit.client.0.smithi078.stdout:0/268: dwrite f2 [0,4194304] 0 2024-09-18T12:49:08.926 INFO:tasks.workunit.client.1.smithi148.stdout:2/236: creat d9/f4d x:0 0 0 2024-09-18T12:49:08.926 INFO:tasks.workunit.client.0.smithi078.stdout:9/128: chown d5/d7/d8/fb 21393 1 2024-09-18T12:49:08.926 INFO:tasks.workunit.client.0.smithi078.stdout:1/162: truncate d0/f13 142226 0 2024-09-18T12:49:08.927 INFO:tasks.workunit.client.1.smithi148.stdout:7/267: dwrite db/dc/df/d1d/f21 [4194304,4194304] 0 2024-09-18T12:49:08.928 INFO:tasks.workunit.client.1.smithi148.stdout:7/268: stat db/l22 0 2024-09-18T12:49:08.931 INFO:tasks.workunit.client.0.smithi078.stdout:5/227: chown d2/d4/l11 244388 1 2024-09-18T12:49:08.932 INFO:tasks.workunit.client.1.smithi148.stdout:4/249: dread d15/f3a [0,4194304] 0 2024-09-18T12:49:08.933 INFO:tasks.workunit.client.0.smithi078.stdout:5/228: chown d2/d4/d12/d16/f21 441881 1 2024-09-18T12:49:08.933 INFO:tasks.workunit.client.0.smithi078.stdout:9/129: rmdir d5/d7/d8 39 2024-09-18T12:49:08.934 INFO:tasks.workunit.client.1.smithi148.stdout:4/250: write d15/d17/d1f/d4c/d4f/f3c [39038,75382] 0 2024-09-18T12:49:08.935 INFO:tasks.workunit.client.1.smithi148.stdout:8/326: truncate d8/df/f19 5574275 0 2024-09-18T12:49:08.935 INFO:tasks.workunit.client.1.smithi148.stdout:7/269: dread db/dc/df/d11/f3a [0,4194304] 0 2024-09-18T12:49:08.936 INFO:tasks.workunit.client.0.smithi078.stdout:1/163: creat d0/d21/f30 x:0 0 0 2024-09-18T12:49:08.936 INFO:tasks.workunit.client.1.smithi148.stdout:8/327: chown f1 124136700 1 2024-09-18T12:49:08.937 INFO:tasks.workunit.client.1.smithi148.stdout:4/251: chown d15/d17/d1f/d4c/d4f/f3c 0 1 2024-09-18T12:49:08.937 INFO:tasks.workunit.client.0.smithi078.stdout:1/164: truncate d0/d21/f2e 352021 0 2024-09-18T12:49:08.939 INFO:tasks.workunit.client.1.smithi148.stdout:9/247: sync 2024-09-18T12:49:08.940 INFO:tasks.workunit.client.1.smithi148.stdout:9/248: fsync d8/d33/f34 0 2024-09-18T12:49:08.940 INFO:tasks.workunit.client.1.smithi148.stdout:3/250: mkdir d4/d2d/d31/d59 0 2024-09-18T12:49:08.941 INFO:tasks.workunit.client.0.smithi078.stdout:0/269: link d3/d1f/d2e/d4e/d37/f45 d3/d1f/d2e/d58/d30/f62 0 2024-09-18T12:49:08.943 INFO:tasks.workunit.client.1.smithi148.stdout:5/311: creat d7/d2b/f65 x:0 0 0 2024-09-18T12:49:08.946 INFO:tasks.workunit.client.1.smithi148.stdout:5/312: chown d7/d8/dc/d12/d1f/d39/f5e 31 1 2024-09-18T12:49:08.946 INFO:tasks.workunit.client.1.smithi148.stdout:9/249: dwrite f6 [4194304,4194304] 0 2024-09-18T12:49:08.947 INFO:tasks.workunit.client.1.smithi148.stdout:5/313: readlink d7/d8/dc/d12/d1f/d5c/l62 0 2024-09-18T12:49:08.948 INFO:tasks.workunit.client.1.smithi148.stdout:9/250: dread - d8/d33/f34 zero size 2024-09-18T12:49:08.949 INFO:tasks.workunit.client.1.smithi148.stdout:1/289: getdents dc/d51/d5e 0 2024-09-18T12:49:08.950 INFO:tasks.workunit.client.1.smithi148.stdout:1/290: dread - dc/d11/f53 zero size 2024-09-18T12:49:08.952 INFO:tasks.workunit.client.1.smithi148.stdout:7/270: symlink db/dd/d25/d2e/l4e 0 2024-09-18T12:49:08.954 INFO:tasks.workunit.client.1.smithi148.stdout:8/328: write d8/d12/f13 [2710950,125858] 0 2024-09-18T12:49:08.954 INFO:tasks.workunit.client.0.smithi078.stdout:2/183: write d4/d20/f29 [641131,110562] 0 2024-09-18T12:49:08.956 INFO:tasks.workunit.client.0.smithi078.stdout:2/184: write d4/db/f2a [333976,45933] 0 2024-09-18T12:49:08.957 INFO:tasks.workunit.client.0.smithi078.stdout:0/270: creat d3/d1f/f63 x:0 0 0 2024-09-18T12:49:08.958 INFO:tasks.workunit.client.1.smithi148.stdout:6/329: truncate d5/d1a/f47 4050281 0 2024-09-18T12:49:08.958 INFO:tasks.workunit.client.0.smithi078.stdout:2/185: dread - d4/d8/f37 zero size 2024-09-18T12:49:08.959 INFO:tasks.workunit.client.1.smithi148.stdout:0/456: getdents de/d14/d43 0 2024-09-18T12:49:08.959 INFO:tasks.workunit.client.0.smithi078.stdout:1/165: getdents d0 0 2024-09-18T12:49:08.960 INFO:tasks.workunit.client.1.smithi148.stdout:6/330: dread - d5/d32/d38/d50/f61 zero size 2024-09-18T12:49:08.960 INFO:tasks.workunit.client.1.smithi148.stdout:0/457: chown fa 699665 1 2024-09-18T12:49:08.964 INFO:tasks.workunit.client.1.smithi148.stdout:2/237: fdatasync d9/f1e 0 2024-09-18T12:49:08.964 INFO:tasks.workunit.client.1.smithi148.stdout:8/329: dwrite d8/d16/d53/d39/d3b/d41/f4f [0,4194304] 0 2024-09-18T12:49:08.965 INFO:tasks.workunit.client.1.smithi148.stdout:8/330: readlink d8/d12/l5e 0 2024-09-18T12:49:08.965 INFO:tasks.workunit.client.1.smithi148.stdout:8/331: chown d8 172716099 1 2024-09-18T12:49:08.965 INFO:tasks.workunit.client.1.smithi148.stdout:9/251: fsync d8/da/df/f18 0 2024-09-18T12:49:08.965 INFO:tasks.workunit.client.0.smithi078.stdout:2/186: creat d4/dd/d18/f3c x:0 0 0 2024-09-18T12:49:08.965 INFO:tasks.workunit.client.0.smithi078.stdout:1/166: symlink d0/d21/l31 0 2024-09-18T12:49:08.966 INFO:tasks.workunit.client.1.smithi148.stdout:5/314: mknod d7/d8/dc/d12/d20/c66 0 2024-09-18T12:49:08.969 INFO:tasks.workunit.client.0.smithi078.stdout:2/187: read d4/db/dc/f2f [894689,85020] 0 2024-09-18T12:49:08.969 INFO:tasks.workunit.client.1.smithi148.stdout:5/315: chown d7/d8/dc/d12/d1f/d5c/c64 3828431 1 2024-09-18T12:49:08.970 INFO:tasks.workunit.client.1.smithi148.stdout:0/458: dwrite de/f32 [0,4194304] 0 2024-09-18T12:49:08.972 INFO:tasks.workunit.client.0.smithi078.stdout:1/167: write d0/d8/f2c [4946865,100862] 0 2024-09-18T12:49:08.974 INFO:tasks.workunit.client.1.smithi148.stdout:5/316: dread - d7/d8/dc/d12/d1f/d25/d4b/f58 zero size 2024-09-18T12:49:08.974 INFO:tasks.workunit.client.0.smithi078.stdout:0/271: getdents d3/d1f/d2e/d4e 0 2024-09-18T12:49:08.975 INFO:tasks.workunit.client.1.smithi148.stdout:5/317: fdatasync d7/d8/dc/d12/d1f/d25/f54 0 2024-09-18T12:49:08.980 INFO:tasks.workunit.client.1.smithi148.stdout:3/251: dread d4/fe [0,4194304] 0 2024-09-18T12:49:08.980 INFO:tasks.workunit.client.0.smithi078.stdout:1/168: creat d0/d21/f32 x:0 0 0 2024-09-18T12:49:08.981 INFO:tasks.workunit.client.0.smithi078.stdout:5/229: write d2/fc [1835051,39426] 0 2024-09-18T12:49:08.981 INFO:tasks.workunit.client.0.smithi078.stdout:1/169: chown d0/d8/f26 83656 1 2024-09-18T12:49:08.982 INFO:tasks.workunit.client.1.smithi148.stdout:0/459: dwrite de/d27/f45 [0,4194304] 0 2024-09-18T12:49:08.982 INFO:tasks.workunit.client.0.smithi078.stdout:0/272: unlink d3/d1f/d2e/d58/c38 0 2024-09-18T12:49:08.982 INFO:tasks.workunit.client.0.smithi078.stdout:5/230: read d2/d4/d12/d16/d36/f41 [2397860,63521] 0 2024-09-18T12:49:08.983 INFO:tasks.workunit.client.0.smithi078.stdout:1/170: fsync d0/d8/f14 0 2024-09-18T12:49:08.984 INFO:tasks.workunit.client.0.smithi078.stdout:5/231: fsync d2/d4/d12/d16/f21 0 2024-09-18T12:49:08.984 INFO:tasks.workunit.client.0.smithi078.stdout:5/232: stat d2/d4/l35 0 2024-09-18T12:49:08.991 INFO:tasks.workunit.client.1.smithi148.stdout:8/332: mknod d8/d16/d53/d39/d3b/d4e/c6d 0 2024-09-18T12:49:08.991 INFO:tasks.workunit.client.0.smithi078.stdout:1/171: mknod d0/c33 0 2024-09-18T12:49:08.992 INFO:tasks.workunit.client.1.smithi148.stdout:8/333: dread - d8/d16/d53/d39/d3b/d41/f64 zero size 2024-09-18T12:49:08.992 INFO:tasks.workunit.client.1.smithi148.stdout:8/334: fsync d8/f2f 0 2024-09-18T12:49:08.993 INFO:tasks.workunit.client.0.smithi078.stdout:0/273: creat d3/d1f/d2e/d58/d30/f64 x:0 0 0 2024-09-18T12:49:08.994 INFO:tasks.workunit.client.0.smithi078.stdout:5/233: dread d2/d4/d9/f2a [0,4194304] 0 2024-09-18T12:49:08.995 INFO:tasks.workunit.client.0.smithi078.stdout:5/234: stat d2/d4/d12/d16/c29 0 2024-09-18T12:49:08.998 INFO:tasks.workunit.client.1.smithi148.stdout:5/318: symlink d7/d8/dc/d12/d1f/d25/l67 0 2024-09-18T12:49:09.001 INFO:tasks.workunit.client.1.smithi148.stdout:1/291: dwrite dc/f25 [0,4194304] 0 2024-09-18T12:49:09.003 INFO:tasks.workunit.client.1.smithi148.stdout:7/271: dwrite db/dc/df/d11/f47 [0,4194304] 0 2024-09-18T12:49:09.003 INFO:tasks.workunit.client.0.smithi078.stdout:5/235: read - d2/d4/f1e zero size 2024-09-18T12:49:09.004 INFO:tasks.workunit.client.0.smithi078.stdout:5/236: stat d2/d4 0 2024-09-18T12:49:09.005 INFO:tasks.workunit.client.1.smithi148.stdout:7/272: read db/dc/df/f35 [326836,52037] 0 2024-09-18T12:49:09.005 INFO:tasks.workunit.client.0.smithi078.stdout:2/188: dwrite d4/d8/f1d [0,4194304] 0 2024-09-18T12:49:09.006 INFO:tasks.workunit.client.1.smithi148.stdout:3/252: symlink d4/d2d/d31/l5a 0 2024-09-18T12:49:09.008 INFO:tasks.workunit.client.0.smithi078.stdout:0/274: rename d3/d1f/d2e/d58/d30/c31 to d3/d1f/d2e/d58/c65 0 2024-09-18T12:49:09.010 INFO:tasks.workunit.client.0.smithi078.stdout:0/275: chown d3/d1f/d2e/d58/d30/c4d 1 1 2024-09-18T12:49:09.011 INFO:tasks.workunit.client.0.smithi078.stdout:0/276: write d3/d1f/d2e/d58/f44 [1879887,76565] 0 2024-09-18T12:49:09.015 INFO:tasks.workunit.client.1.smithi148.stdout:9/252: dwrite f7 [0,4194304] 0 2024-09-18T12:49:09.017 INFO:tasks.workunit.client.0.smithi078.stdout:0/277: rmdir d3/d1f 39 2024-09-18T12:49:09.017 INFO:tasks.workunit.client.0.smithi078.stdout:5/237: dwrite d2/d4/d12/f40 [0,4194304] 0 2024-09-18T12:49:09.020 INFO:tasks.workunit.client.1.smithi148.stdout:4/252: link d15/d17/d1f/l41 d15/d17/d1f/l56 0 2024-09-18T12:49:09.020 INFO:tasks.workunit.client.1.smithi148.stdout:4/253: stat d15/d17/f2b 0 2024-09-18T12:49:09.023 INFO:tasks.workunit.client.0.smithi078.stdout:6/265: sync 2024-09-18T12:49:09.023 INFO:tasks.workunit.client.0.smithi078.stdout:4/120: sync 2024-09-18T12:49:09.025 INFO:tasks.workunit.client.0.smithi078.stdout:2/189: mknod d4/dd/d18/d33/c3d 0 2024-09-18T12:49:09.026 INFO:tasks.workunit.client.0.smithi078.stdout:2/190: chown d4/d8/f1d 90863876 1 2024-09-18T12:49:09.026 INFO:tasks.workunit.client.0.smithi078.stdout:5/238: dread d2/d4/d12/d16/f21 [0,4194304] 0 2024-09-18T12:49:09.027 INFO:tasks.workunit.client.1.smithi148.stdout:1/292: unlink dc/d51/l52 0 2024-09-18T12:49:09.027 INFO:tasks.workunit.client.1.smithi148.stdout:4/254: dwrite d15/d17/f19 [0,4194304] 0 2024-09-18T12:49:09.027 INFO:tasks.workunit.client.0.smithi078.stdout:1/172: dread d0/d8/f2c [0,4194304] 0 2024-09-18T12:49:09.030 INFO:tasks.workunit.client.1.smithi148.stdout:6/331: creat d5/d1a/dc/f6d x:0 0 0 2024-09-18T12:49:09.035 INFO:tasks.workunit.client.0.smithi078.stdout:6/266: symlink d10/d2b/d37/l49 0 2024-09-18T12:49:09.037 INFO:tasks.workunit.client.1.smithi148.stdout:3/253: mknod d4/d8/d20/d2b/c5b 0 2024-09-18T12:49:09.038 INFO:tasks.workunit.client.0.smithi078.stdout:2/191: symlink d4/dd/d18/d3b/l3e 0 2024-09-18T12:49:09.038 INFO:tasks.workunit.client.1.smithi148.stdout:7/273: dread fa [0,4194304] 0 2024-09-18T12:49:09.039 INFO:tasks.workunit.client.1.smithi148.stdout:8/335: symlink d8/d12/d51/l6e 0 2024-09-18T12:49:09.039 INFO:tasks.workunit.client.1.smithi148.stdout:0/460: dwrite de/d14/d43/f5e [0,4194304] 0 2024-09-18T12:49:09.041 INFO:tasks.workunit.client.1.smithi148.stdout:0/461: chown de/d14/d43/d57/d59/c75 0 1 2024-09-18T12:49:09.041 INFO:tasks.workunit.client.1.smithi148.stdout:9/253: rename d8/da/dd/d3f/d45 to d8/da/df/d49 0 2024-09-18T12:49:09.042 INFO:tasks.workunit.client.0.smithi078.stdout:4/121: mknod d11/d27/c2c 0 2024-09-18T12:49:09.043 INFO:tasks.workunit.client.0.smithi078.stdout:6/267: creat d10/d2b/d37/f4a x:0 0 0 2024-09-18T12:49:09.044 INFO:tasks.workunit.client.0.smithi078.stdout:1/173: creat d0/d21/f34 x:0 0 0 2024-09-18T12:49:09.045 INFO:tasks.workunit.client.0.smithi078.stdout:6/268: dread ff [0,4194304] 0 2024-09-18T12:49:09.046 INFO:tasks.workunit.client.1.smithi148.stdout:6/332: rmdir d5/d32 39 2024-09-18T12:49:09.047 INFO:tasks.workunit.client.0.smithi078.stdout:4/122: creat d11/d1f/f2d x:0 0 0 2024-09-18T12:49:09.048 INFO:tasks.workunit.client.0.smithi078.stdout:1/174: fdatasync d0/d21/f2d 0 2024-09-18T12:49:09.049 INFO:tasks.workunit.client.0.smithi078.stdout:4/123: write d11/d1f/f2d [918432,66905] 0 2024-09-18T12:49:09.050 INFO:tasks.workunit.client.0.smithi078.stdout:6/269: write d10/f41 [3651373,85092] 0 2024-09-18T12:49:09.050 INFO:tasks.workunit.client.1.smithi148.stdout:5/319: creat d7/d8/f68 x:0 0 0 2024-09-18T12:49:09.050 INFO:tasks.workunit.client.0.smithi078.stdout:5/239: link d2/d4/d9/f13 d2/d4/d9/d49/f4b 0 2024-09-18T12:49:09.051 INFO:tasks.workunit.client.0.smithi078.stdout:6/270: stat d10/d2b/l35 0 2024-09-18T12:49:09.051 INFO:tasks.workunit.client.1.smithi148.stdout:7/274: read db/dc/df/f35 [3257112,90694] 0 2024-09-18T12:49:09.052 INFO:tasks.workunit.client.0.smithi078.stdout:4/124: rmdir d11/d27 39 2024-09-18T12:49:09.053 INFO:tasks.workunit.client.0.smithi078.stdout:4/125: readlink d11/l15 0 2024-09-18T12:49:09.053 INFO:tasks.workunit.client.1.smithi148.stdout:8/336: creat d8/d16/f6f x:0 0 0 2024-09-18T12:49:09.054 INFO:tasks.workunit.client.0.smithi078.stdout:6/271: truncate f3 2528471 0 2024-09-18T12:49:09.055 INFO:tasks.workunit.client.0.smithi078.stdout:4/126: write d11/f12 [4310017,3210] 0 2024-09-18T12:49:09.055 INFO:tasks.workunit.client.1.smithi148.stdout:0/462: creat de/d14/d43/fa0 x:0 0 0 2024-09-18T12:49:09.055 INFO:tasks.workunit.client.1.smithi148.stdout:2/238: sync 2024-09-18T12:49:09.056 INFO:tasks.workunit.client.1.smithi148.stdout:0/463: chown de/d14/l29 131538702 1 2024-09-18T12:49:09.056 INFO:tasks.workunit.client.1.smithi148.stdout:8/337: dread f1 [0,4194304] 0 2024-09-18T12:49:09.057 INFO:tasks.workunit.client.1.smithi148.stdout:2/239: write d9/d24/d31/d34/f37 [793254,50603] 0 2024-09-18T12:49:09.057 INFO:tasks.workunit.client.0.smithi078.stdout:5/240: mkdir d2/d4/d12/d16/d36/d4c 0 2024-09-18T12:49:09.057 INFO:tasks.workunit.client.0.smithi078.stdout:6/272: fdatasync d10/d27/d3f/d40/d45/f46 0 2024-09-18T12:49:09.058 INFO:tasks.workunit.client.1.smithi148.stdout:0/464: chown de/d14/d43/d70/d7f/f54 1256409 1 2024-09-18T12:49:09.059 INFO:tasks.workunit.client.1.smithi148.stdout:4/255: rename d15/d17/d1f/d4c/d4f/f3c to d15/d17/d1f/d4c/f57 0 2024-09-18T12:49:09.061 INFO:tasks.workunit.client.1.smithi148.stdout:1/293: mknod dc/d18/c64 0 2024-09-18T12:49:09.061 INFO:tasks.workunit.client.0.smithi078.stdout:1/175: dwrite d0/d8/f14 [0,4194304] 0 2024-09-18T12:49:09.063 INFO:tasks.workunit.client.0.smithi078.stdout:5/241: truncate d2/d4/d12/d16/f21 917354 0 2024-09-18T12:49:09.064 INFO:tasks.workunit.client.0.smithi078.stdout:6/273: write d10/f1e [1330205,17021] 0 2024-09-18T12:49:09.065 INFO:tasks.workunit.client.1.smithi148.stdout:3/254: symlink d4/l5c 0 2024-09-18T12:49:09.066 INFO:tasks.workunit.client.0.smithi078.stdout:6/274: chown d10/f24 241521 1 2024-09-18T12:49:09.066 INFO:tasks.workunit.client.0.smithi078.stdout:4/127: dwrite d11/d1f/f2b [0,4194304] 0 2024-09-18T12:49:09.068 INFO:tasks.workunit.client.1.smithi148.stdout:5/320: unlink d7/d8/dc/d12/d1f/d25/f52 0 2024-09-18T12:49:09.070 INFO:tasks.workunit.client.0.smithi078.stdout:1/176: creat d0/d8/da/f35 x:0 0 0 2024-09-18T12:49:09.073 INFO:tasks.workunit.client.0.smithi078.stdout:4/128: dread d11/f12 [0,4194304] 0 2024-09-18T12:49:09.076 INFO:tasks.workunit.client.1.smithi148.stdout:8/338: rmdir d8/d16/d53/d39/d3b/d41 39 2024-09-18T12:49:09.078 INFO:tasks.workunit.client.0.smithi078.stdout:6/275: rename d10/d27/c3d to d10/d2b/d37/c4b 0 2024-09-18T12:49:09.079 INFO:tasks.workunit.client.1.smithi148.stdout:0/465: symlink de/d14/d43/d70/la1 0 2024-09-18T12:49:09.080 INFO:tasks.workunit.client.0.smithi078.stdout:6/276: write d10/f41 [1025193,62549] 0 2024-09-18T12:49:09.081 INFO:tasks.workunit.client.0.smithi078.stdout:1/177: creat d0/d21/f36 x:0 0 0 2024-09-18T12:49:09.083 INFO:tasks.workunit.client.1.smithi148.stdout:9/254: rename d8/da/df to d8/da/dd/d4a 0 2024-09-18T12:49:09.084 INFO:tasks.workunit.client.0.smithi078.stdout:0/278: dwrite d3/f17 [0,4194304] 0 2024-09-18T12:49:09.084 INFO:tasks.workunit.client.0.smithi078.stdout:5/242: mkdir d2/d4/d9/d47/d4d 0 2024-09-18T12:49:09.085 INFO:tasks.workunit.client.1.smithi148.stdout:4/256: mknod d15/d17/d52/c58 0 2024-09-18T12:49:09.086 INFO:tasks.workunit.client.1.smithi148.stdout:4/257: write d15/d17/f2b [3218275,127590] 0 2024-09-18T12:49:09.087 INFO:tasks.workunit.client.1.smithi148.stdout:1/294: chown dc/d18/d43/f4e 16 1 2024-09-18T12:49:09.088 INFO:tasks.workunit.client.1.smithi148.stdout:1/295: chown dc/d11/d17/l37 13499090 1 2024-09-18T12:49:09.089 INFO:tasks.workunit.client.1.smithi148.stdout:6/333: unlink d5/d1a/ce 0 2024-09-18T12:49:09.092 INFO:tasks.workunit.client.0.smithi078.stdout:6/277: mknod d10/d27/c4c 0 2024-09-18T12:49:09.092 INFO:tasks.workunit.client.0.smithi078.stdout:6/278: dread - d10/d27/f38 zero size 2024-09-18T12:49:09.096 INFO:tasks.workunit.client.1.smithi148.stdout:5/321: rename d7/d8/dc/d12/d1f/d5c to d7/d8/dc/d12/d1f/d69 0 2024-09-18T12:49:09.099 INFO:tasks.workunit.client.0.smithi078.stdout:5/243: dread - d2/d4/f8 zero size 2024-09-18T12:49:09.100 INFO:tasks.workunit.client.1.smithi148.stdout:0/466: symlink de/d14/d43/d57/la2 0 2024-09-18T12:49:09.103 INFO:tasks.workunit.client.1.smithi148.stdout:9/255: mkdir d8/da/dd/d3f/d4b 0 2024-09-18T12:49:09.104 INFO:tasks.workunit.client.1.smithi148.stdout:9/256: dread - d8/d33/f34 zero size 2024-09-18T12:49:09.104 INFO:tasks.workunit.client.0.smithi078.stdout:1/178: mkdir d0/d37 0 2024-09-18T12:49:09.105 INFO:tasks.workunit.client.1.smithi148.stdout:9/257: fdatasync d8/d33/f34 0 2024-09-18T12:49:09.106 INFO:tasks.workunit.client.0.smithi078.stdout:0/279: mknod d3/d1f/d2e/d58/d30/c66 0 2024-09-18T12:49:09.109 INFO:tasks.workunit.client.0.smithi078.stdout:5/244: rename d2/d4/d12/d2d/f3a to d2/d4/d48/f4e 0 2024-09-18T12:49:09.111 INFO:tasks.workunit.client.1.smithi148.stdout:1/296: creat dc/d18/d31/d4b/f65 x:0 0 0 2024-09-18T12:49:09.111 INFO:tasks.workunit.client.1.smithi148.stdout:1/297: stat dc/fd 0 2024-09-18T12:49:09.112 INFO:tasks.workunit.client.1.smithi148.stdout:1/298: dread - dc/d11/d17/f5f zero size 2024-09-18T12:49:09.113 INFO:tasks.workunit.client.1.smithi148.stdout:1/299: write dc/d18/d31/d39/f40 [234094,113826] 0 2024-09-18T12:49:09.115 INFO:tasks.workunit.client.1.smithi148.stdout:7/275: sync 2024-09-18T12:49:09.115 INFO:tasks.workunit.client.1.smithi148.stdout:8/339: dread d8/d12/f1b [0,4194304] 0 2024-09-18T12:49:09.115 INFO:tasks.workunit.client.1.smithi148.stdout:3/255: fdatasync d4/f11 0 2024-09-18T12:49:09.116 INFO:tasks.workunit.client.1.smithi148.stdout:8/340: fsync d8/df/f10 0 2024-09-18T12:49:09.116 INFO:tasks.workunit.client.0.smithi078.stdout:5/245: dwrite d2/d4/f33 [0,4194304] 0 2024-09-18T12:49:09.122 INFO:tasks.workunit.client.0.smithi078.stdout:4/129: link c4 d11/c2e 0 2024-09-18T12:49:09.122 INFO:tasks.workunit.client.0.smithi078.stdout:4/130: chown c5 5538135 1 2024-09-18T12:49:09.128 INFO:tasks.workunit.client.0.smithi078.stdout:1/179: creat d0/d8/f38 x:0 0 0 2024-09-18T12:49:09.130 INFO:tasks.workunit.client.0.smithi078.stdout:4/131: dread d11/f1d [0,4194304] 0 2024-09-18T12:49:09.130 INFO:tasks.workunit.client.1.smithi148.stdout:4/258: truncate d15/d17/f36 87389 0 2024-09-18T12:49:09.131 INFO:tasks.workunit.client.1.smithi148.stdout:4/259: truncate d15/d17/d1f/f46 58368 0 2024-09-18T12:49:09.133 INFO:tasks.workunit.client.1.smithi148.stdout:3/256: fsync d4/f18 0 2024-09-18T12:49:09.134 INFO:tasks.workunit.client.1.smithi148.stdout:0/467: mkdir de/da3 0 2024-09-18T12:49:09.136 INFO:tasks.workunit.client.1.smithi148.stdout:2/240: rename d9/fd to d9/d17/f4e 0 2024-09-18T12:49:09.136 INFO:tasks.workunit.client.0.smithi078.stdout:1/180: mkdir d0/d8/da/d39 0 2024-09-18T12:49:09.139 INFO:tasks.workunit.client.0.smithi078.stdout:0/280: creat d3/d1f/f67 x:0 0 0 2024-09-18T12:49:09.141 INFO:tasks.workunit.client.0.smithi078.stdout:4/132: readlink l8 0 2024-09-18T12:49:09.144 INFO:tasks.workunit.client.1.smithi148.stdout:7/276: mkdir db/dd/d4f 0 2024-09-18T12:49:09.146 INFO:tasks.workunit.client.0.smithi078.stdout:8/204: sync 2024-09-18T12:49:09.146 INFO:tasks.workunit.client.0.smithi078.stdout:7/98: sync 2024-09-18T12:49:09.146 INFO:tasks.workunit.client.0.smithi078.stdout:9/130: sync 2024-09-18T12:49:09.146 INFO:tasks.workunit.client.0.smithi078.stdout:3/138: sync 2024-09-18T12:49:09.147 INFO:tasks.workunit.client.0.smithi078.stdout:5/246: creat d2/d4/f4f x:0 0 0 2024-09-18T12:49:09.150 INFO:tasks.workunit.client.0.smithi078.stdout:0/281: rename d3/d1f/d2e/d58 to d3/d1f/d2e/d68 0 2024-09-18T12:49:09.153 INFO:tasks.workunit.client.0.smithi078.stdout:6/279: dwrite f3 [0,4194304] 0 2024-09-18T12:49:09.156 INFO:tasks.workunit.client.0.smithi078.stdout:4/133: dread d11/f14 [0,4194304] 0 2024-09-18T12:49:09.156 INFO:tasks.workunit.client.1.smithi148.stdout:5/322: rename d7/d8/dc/d12/d1f/d69/c64 to d7/d8/d18/c6a 0 2024-09-18T12:49:09.157 INFO:tasks.workunit.client.1.smithi148.stdout:2/241: fdatasync d9/f16 0 2024-09-18T12:49:09.158 INFO:tasks.workunit.client.0.smithi078.stdout:9/131: rename d5/d7 to d5/d7/d8/d1c/d26 22 2024-09-18T12:49:09.159 INFO:tasks.workunit.client.1.smithi148.stdout:9/258: link d8/c37 d8/d33/c4c 0 2024-09-18T12:49:09.159 INFO:tasks.workunit.client.1.smithi148.stdout:9/259: readlink d8/da/l32 0 2024-09-18T12:49:09.160 INFO:tasks.workunit.client.0.smithi078.stdout:5/247: fdatasync d2/d4/d48/f4e 0 2024-09-18T12:49:09.162 INFO:tasks.workunit.client.0.smithi078.stdout:8/205: symlink d0/d7/dc/d1f/d23/d29/l3d 0 2024-09-18T12:49:09.162 INFO:tasks.workunit.client.0.smithi078.stdout:8/206: chown d0/d7 6837544 1 2024-09-18T12:49:09.163 INFO:tasks.workunit.client.1.smithi148.stdout:6/334: link d5/d32/d56/f4d d5/d1a/d29/f6e 0 2024-09-18T12:49:09.163 INFO:tasks.workunit.client.0.smithi078.stdout:8/207: chown d0/d7/dc/d1f/d23/d29/f3b 4 1 2024-09-18T12:49:09.164 INFO:tasks.workunit.client.0.smithi078.stdout:1/181: unlink d0/f13 0 2024-09-18T12:49:09.164 INFO:tasks.workunit.client.0.smithi078.stdout:8/208: fsync d0/f1a 0 2024-09-18T12:49:09.164 INFO:tasks.workunit.client.1.smithi148.stdout:6/335: fsync d5/d1a/d29/d5c/f67 0 2024-09-18T12:49:09.165 INFO:tasks.workunit.client.0.smithi078.stdout:3/139: mkdir d9/d2f 0 2024-09-18T12:49:09.167 INFO:tasks.workunit.client.1.smithi148.stdout:3/257: dwrite d4/d8/f23 [0,4194304] 0 2024-09-18T12:49:09.167 INFO:tasks.workunit.client.1.smithi148.stdout:6/336: truncate d5/d1a/dc/d2b/f5f 137262 0 2024-09-18T12:49:09.168 INFO:tasks.workunit.client.1.smithi148.stdout:3/258: write d4/d2d/f3e [919717,31549] 0 2024-09-18T12:49:09.170 INFO:tasks.workunit.client.0.smithi078.stdout:7/99: creat d7/d9/d14/f21 x:0 0 0 2024-09-18T12:49:09.171 INFO:tasks.workunit.client.0.smithi078.stdout:7/100: chown d7/c8 275647574 1 2024-09-18T12:49:09.174 INFO:tasks.workunit.client.1.smithi148.stdout:0/468: mkdir de/d27/d53/d89/d9d/da4 0 2024-09-18T12:49:09.174 INFO:tasks.workunit.client.1.smithi148.stdout:0/469: stat de/f4f 0 2024-09-18T12:49:09.176 INFO:tasks.workunit.client.0.smithi078.stdout:5/248: fdatasync d2/d4/f8 0 2024-09-18T12:49:09.177 INFO:tasks.workunit.client.1.smithi148.stdout:8/341: rename d8/d16/d27/c3a to d8/df/d66/c70 0 2024-09-18T12:49:09.179 INFO:tasks.workunit.client.1.smithi148.stdout:5/323: symlink d7/d8/dc/d12/d1f/d39/l6b 0 2024-09-18T12:49:09.180 INFO:tasks.workunit.client.1.smithi148.stdout:2/242: truncate d9/d4a/f38 1874070 0 2024-09-18T12:49:09.182 INFO:tasks.workunit.client.1.smithi148.stdout:9/260: creat d8/da/f4d x:0 0 0 2024-09-18T12:49:09.182 INFO:tasks.workunit.client.1.smithi148.stdout:9/261: chown d8/da/dd/d4a/d27/l2c 1 1 2024-09-18T12:49:09.183 INFO:tasks.workunit.client.1.smithi148.stdout:1/300: getdents dc/d4d 0 2024-09-18T12:49:09.183 INFO:tasks.workunit.client.1.smithi148.stdout:9/262: write d8/da/fb [79558,11359] 0 2024-09-18T12:49:09.184 INFO:tasks.workunit.client.1.smithi148.stdout:9/263: truncate d8/da/f4d 902549 0 2024-09-18T12:49:09.184 INFO:tasks.workunit.client.0.smithi078.stdout:3/140: symlink d9/d2a/d19/l30 0 2024-09-18T12:49:09.187 INFO:tasks.workunit.client.1.smithi148.stdout:7/277: getdents db/dc/df/d1d/d41 0 2024-09-18T12:49:09.187 INFO:tasks.workunit.client.1.smithi148.stdout:7/278: readlink db/l22 0 2024-09-18T12:49:09.188 INFO:tasks.workunit.client.0.smithi078.stdout:9/132: dwrite d5/d7/d8/f1d [0,4194304] 0 2024-09-18T12:49:09.188 INFO:tasks.workunit.client.0.smithi078.stdout:4/134: creat d11/d27/f2f x:0 0 0 2024-09-18T12:49:09.189 INFO:tasks.workunit.client.0.smithi078.stdout:9/133: write d5/f17 [801954,96075] 0 2024-09-18T12:49:09.189 INFO:tasks.workunit.client.1.smithi148.stdout:9/264: dwrite d8/d33/f34 [0,4194304] 0 2024-09-18T12:49:09.191 INFO:tasks.workunit.client.1.smithi148.stdout:9/265: fsync d8/da/dd/d4a/f18 0 2024-09-18T12:49:09.191 INFO:tasks.workunit.client.0.smithi078.stdout:7/101: mkdir d7/d9/d14/d22 0 2024-09-18T12:49:09.195 INFO:tasks.workunit.client.1.smithi148.stdout:4/260: dwrite d15/d17/f36 [0,4194304] 0 2024-09-18T12:49:09.196 INFO:tasks.workunit.client.0.smithi078.stdout:6/280: truncate fb 2190338 0 2024-09-18T12:49:09.197 INFO:tasks.workunit.client.1.smithi148.stdout:0/470: write de/f12 [4376802,12131] 0 2024-09-18T12:49:09.201 INFO:tasks.workunit.client.0.smithi078.stdout:1/182: link d0/d8/ff d0/d8/f3a 0 2024-09-18T12:49:09.202 INFO:tasks.workunit.client.1.smithi148.stdout:8/342: symlink d8/d16/l71 0 2024-09-18T12:49:09.203 INFO:tasks.workunit.client.0.smithi078.stdout:8/209: mkdir d0/d7/d1e/d33/d3e 0 2024-09-18T12:49:09.205 INFO:tasks.workunit.client.1.smithi148.stdout:5/324: mkdir d7/d8/dc/d12/d31/d6c 0 2024-09-18T12:49:09.206 INFO:tasks.workunit.client.1.smithi148.stdout:2/243: symlink d9/d24/d31/d34/l4f 0 2024-09-18T12:49:09.207 INFO:tasks.workunit.client.0.smithi078.stdout:3/141: chown d9/df/d11/l1c 456545 1 2024-09-18T12:49:09.207 INFO:tasks.workunit.client.0.smithi078.stdout:3/142: fdatasync d9/d2a/d19/f22 0 2024-09-18T12:49:09.209 INFO:tasks.workunit.client.1.smithi148.stdout:8/343: dwrite d8/f2f [0,4194304] 0 2024-09-18T12:49:09.210 INFO:tasks.workunit.client.0.smithi078.stdout:7/102: unlink d7/d9/d14/l1a 0 2024-09-18T12:49:09.211 INFO:tasks.workunit.client.0.smithi078.stdout:7/103: dread - d7/d9/d14/f21 zero size 2024-09-18T12:49:09.212 INFO:tasks.workunit.client.0.smithi078.stdout:6/281: rmdir d10/d27 39 2024-09-18T12:49:09.213 INFO:tasks.workunit.client.1.smithi148.stdout:5/325: dwrite d7/d8/dc/f5d [0,4194304] 0 2024-09-18T12:49:09.218 INFO:tasks.workunit.client.0.smithi078.stdout:1/183: symlink d0/d8/da/l3b 0 2024-09-18T12:49:09.220 INFO:tasks.workunit.client.0.smithi078.stdout:8/210: creat d0/d7/dc/f3f x:0 0 0 2024-09-18T12:49:09.222 INFO:tasks.workunit.client.0.smithi078.stdout:1/184: read d0/d8/da/f23 [506381,124703] 0 2024-09-18T12:49:09.223 INFO:tasks.workunit.client.1.smithi148.stdout:4/261: mknod d15/d17/d52/c59 0 2024-09-18T12:49:09.225 INFO:tasks.workunit.client.0.smithi078.stdout:4/135: symlink d11/l30 0 2024-09-18T12:49:09.226 INFO:tasks.workunit.client.0.smithi078.stdout:5/249: dwrite d2/d4/d9/da/f20 [0,4194304] 0 2024-09-18T12:49:09.227 INFO:tasks.workunit.client.0.smithi078.stdout:3/143: creat d9/df/d11/f31 x:0 0 0 2024-09-18T12:49:09.231 INFO:tasks.workunit.client.1.smithi148.stdout:2/244: mknod d9/d24/d47/c50 0 2024-09-18T12:49:09.232 INFO:tasks.workunit.client.0.smithi078.stdout:7/104: rmdir d7/d9 39 2024-09-18T12:49:09.233 INFO:tasks.workunit.client.1.smithi148.stdout:2/245: write d9/f26 [817203,30822] 0 2024-09-18T12:49:09.237 INFO:tasks.workunit.client.0.smithi078.stdout:8/211: mkdir d0/d7/dc/d1f/d23/d40 0 2024-09-18T12:49:09.238 INFO:tasks.workunit.client.1.smithi148.stdout:1/301: dwrite fb [0,4194304] 0 2024-09-18T12:49:09.240 INFO:tasks.workunit.client.0.smithi078.stdout:1/185: rmdir d0/d8/da 39 2024-09-18T12:49:09.242 INFO:tasks.workunit.client.0.smithi078.stdout:4/136: read d11/f1d [291510,29199] 0 2024-09-18T12:49:09.244 INFO:tasks.workunit.client.1.smithi148.stdout:6/337: creat d5/d1a/f6f x:0 0 0 2024-09-18T12:49:09.244 INFO:tasks.workunit.client.0.smithi078.stdout:5/250: rmdir d2/d4/d12/d16 39 2024-09-18T12:49:09.245 INFO:tasks.workunit.client.0.smithi078.stdout:5/251: write d2/d4/d48/f4e [4586512,72492] 0 2024-09-18T12:49:09.246 INFO:tasks.workunit.client.1.smithi148.stdout:5/326: symlink d7/d8/d18/l6d 0 2024-09-18T12:49:09.248 INFO:tasks.workunit.client.1.smithi148.stdout:8/344: dwrite d8/d16/d27/f4a [0,4194304] 0 2024-09-18T12:49:09.249 INFO:tasks.workunit.client.1.smithi148.stdout:6/338: truncate d5/d32/d38/d50/f61 367984 0 2024-09-18T12:49:09.251 INFO:tasks.workunit.client.1.smithi148.stdout:1/302: dwrite dc/d18/f1f [0,4194304] 0 2024-09-18T12:49:09.251 INFO:tasks.workunit.client.1.smithi148.stdout:9/266: mkdir d8/da/dd/d35/d47/d4e 0 2024-09-18T12:49:09.252 INFO:tasks.workunit.client.0.smithi078.stdout:7/105: write d7/d9/f10 [3100163,49717] 0 2024-09-18T12:49:09.253 INFO:tasks.workunit.client.0.smithi078.stdout:6/282: creat d10/d27/d3f/d40/f4d x:0 0 0 2024-09-18T12:49:09.253 INFO:tasks.workunit.client.0.smithi078.stdout:6/283: fsync f3 0 2024-09-18T12:49:09.254 INFO:tasks.workunit.client.1.smithi148.stdout:3/259: link d4/d8/d20/l2e d4/d8/d1e/l5d 0 2024-09-18T12:49:09.256 INFO:tasks.workunit.client.1.smithi148.stdout:4/262: unlink d15/d17/f2a 0 2024-09-18T12:49:09.257 INFO:tasks.workunit.client.1.smithi148.stdout:0/471: link de/d14/d43/f7e de/d14/d93/fa5 0 2024-09-18T12:49:09.257 INFO:tasks.workunit.client.1.smithi148.stdout:3/260: dread d4/d8/d20/d2b/f45 [0,4194304] 0 2024-09-18T12:49:09.259 INFO:tasks.workunit.client.1.smithi148.stdout:4/263: write d15/d17/d1f/f2c [300682,57273] 0 2024-09-18T12:49:09.259 INFO:tasks.workunit.client.0.smithi078.stdout:4/137: symlink d11/d1f/l31 0 2024-09-18T12:49:09.261 INFO:tasks.workunit.client.1.smithi148.stdout:4/264: write d15/d3f/f55 [409139,56045] 0 2024-09-18T12:49:09.261 INFO:tasks.workunit.client.1.smithi148.stdout:7/279: rmdir db/dc/d4c 0 2024-09-18T12:49:09.263 INFO:tasks.workunit.client.1.smithi148.stdout:2/246: dread d9/fe [0,4194304] 0 2024-09-18T12:49:09.263 INFO:tasks.workunit.client.1.smithi148.stdout:8/345: mknod d8/d16/c72 0 2024-09-18T12:49:09.263 INFO:tasks.workunit.client.1.smithi148.stdout:4/265: dread d15/d17/d1f/d4c/f57 [0,4194304] 0 2024-09-18T12:49:09.264 INFO:tasks.workunit.client.0.smithi078.stdout:3/144: rename d9/df/d11/f31 to d9/d2a/d19/f32 0 2024-09-18T12:49:09.264 INFO:tasks.workunit.client.1.smithi148.stdout:4/266: write d15/d17/d1f/f2e [666063,47500] 0 2024-09-18T12:49:09.266 INFO:tasks.workunit.client.0.smithi078.stdout:9/134: link f3 d5/d7/d8/f27 0 2024-09-18T12:49:09.266 INFO:tasks.workunit.client.1.smithi148.stdout:4/267: read d15/d17/d1f/d4c/d4f/f23 [12474,123249] 0 2024-09-18T12:49:09.267 INFO:tasks.workunit.client.1.smithi148.stdout:1/303: fdatasync dc/d18/d43/f4e 0 2024-09-18T12:49:09.270 INFO:tasks.workunit.client.1.smithi148.stdout:9/267: symlink d8/da/dd/d4a/d27/l4f 0 2024-09-18T12:49:09.270 INFO:tasks.workunit.client.1.smithi148.stdout:9/268: write d8/da/dd/f1b [53616,121637] 0 2024-09-18T12:49:09.272 INFO:tasks.workunit.client.1.smithi148.stdout:6/339: symlink d5/d1a/d29/l70 0 2024-09-18T12:49:09.272 INFO:tasks.workunit.client.1.smithi148.stdout:6/340: chown d5/d1a/d29 0 1 2024-09-18T12:49:09.273 INFO:tasks.workunit.client.1.smithi148.stdout:6/341: chown d5/d1a/d29/d5c/c60 6320735 1 2024-09-18T12:49:09.274 INFO:tasks.workunit.client.1.smithi148.stdout:6/342: dread - d5/d1a/dc/d2b/f55 zero size 2024-09-18T12:49:09.274 INFO:tasks.workunit.client.1.smithi148.stdout:6/343: fdatasync d5/d32/f64 0 2024-09-18T12:49:09.275 INFO:tasks.workunit.client.0.smithi078.stdout:4/138: symlink d11/d1f/l32 0 2024-09-18T12:49:09.276 INFO:tasks.workunit.client.1.smithi148.stdout:3/261: chown d4/f5 1991143 1 2024-09-18T12:49:09.277 INFO:tasks.workunit.client.1.smithi148.stdout:3/262: write d4/f49 [4931841,108279] 0 2024-09-18T12:49:09.277 INFO:tasks.workunit.client.1.smithi148.stdout:0/472: symlink de/d27/d7a/la6 0 2024-09-18T12:49:09.278 INFO:tasks.workunit.client.0.smithi078.stdout:3/145: chown d9/df/l2e 704 1 2024-09-18T12:49:09.280 INFO:tasks.workunit.client.0.smithi078.stdout:8/212: rename d0/l2a to d0/d7/d1e/d33/l41 0 2024-09-18T12:49:09.281 INFO:tasks.workunit.client.1.smithi148.stdout:6/344: dwrite d5/d32/d38/d50/f52 [0,4194304] 0 2024-09-18T12:49:09.281 INFO:tasks.workunit.client.0.smithi078.stdout:8/213: chown d0/d7/f27 20065 1 2024-09-18T12:49:09.283 INFO:tasks.workunit.client.0.smithi078.stdout:3/146: dread d9/d2a/d19/f22 [0,4194304] 0 2024-09-18T12:49:09.285 INFO:tasks.workunit.client.1.smithi148.stdout:8/346: chown d8/c2b 34 1 2024-09-18T12:49:09.286 INFO:tasks.workunit.client.0.smithi078.stdout:5/252: truncate d2/d4/d9/f1c 3751013 0 2024-09-18T12:49:09.288 INFO:tasks.workunit.client.0.smithi078.stdout:7/106: rename d7/d9/f15 to d7/d9/d14/f23 0 2024-09-18T12:49:09.289 INFO:tasks.workunit.client.0.smithi078.stdout:5/253: fdatasync d2/d4/d48/f4e 0 2024-09-18T12:49:09.290 INFO:tasks.workunit.client.1.smithi148.stdout:4/268: creat d15/d3f/f5a x:0 0 0 2024-09-18T12:49:09.290 INFO:tasks.workunit.client.0.smithi078.stdout:9/135: symlink d5/l28 0 2024-09-18T12:49:09.290 INFO:tasks.workunit.client.1.smithi148.stdout:7/280: dwrite fa [4194304,4194304] 0 2024-09-18T12:49:09.291 INFO:tasks.workunit.client.0.smithi078.stdout:3/147: mkdir d9/d13/d33 0 2024-09-18T12:49:09.291 INFO:tasks.workunit.client.1.smithi148.stdout:6/345: dwrite d5/d1a/d29/f4e [0,4194304] 0 2024-09-18T12:49:09.293 INFO:tasks.workunit.client.0.smithi078.stdout:1/186: dwrite d0/f19 [0,4194304] 0 2024-09-18T12:49:09.295 INFO:tasks.workunit.client.0.smithi078.stdout:2/192: sync 2024-09-18T12:49:09.296 INFO:tasks.workunit.client.0.smithi078.stdout:8/214: dwrite d0/d7/f38 [0,4194304] 0 2024-09-18T12:49:09.297 INFO:tasks.workunit.client.1.smithi148.stdout:9/269: symlink d8/l50 0 2024-09-18T12:49:09.304 INFO:tasks.workunit.client.1.smithi148.stdout:0/473: symlink de/d14/d43/d70/d7f/la7 0 2024-09-18T12:49:09.306 INFO:tasks.workunit.client.0.smithi078.stdout:1/187: dread - d0/d8/f38 zero size 2024-09-18T12:49:09.307 INFO:tasks.workunit.client.0.smithi078.stdout:8/215: dread - d0/d7/dc/d1f/f28 zero size 2024-09-18T12:49:09.307 INFO:tasks.workunit.client.0.smithi078.stdout:6/284: rename d10/l1f to d10/d2b/d43/l4e 0 2024-09-18T12:49:09.308 INFO:tasks.workunit.client.0.smithi078.stdout:4/139: creat d11/f33 x:0 0 0 2024-09-18T12:49:09.309 INFO:tasks.workunit.client.1.smithi148.stdout:8/347: rmdir d8/df/d3e 39 2024-09-18T12:49:09.310 INFO:tasks.workunit.client.0.smithi078.stdout:2/193: creat d4/dd/d18/d3b/f3f x:0 0 0 2024-09-18T12:49:09.310 INFO:tasks.workunit.client.1.smithi148.stdout:8/348: chown d8/d12/f1b 671265238 1 2024-09-18T12:49:09.312 INFO:tasks.workunit.client.0.smithi078.stdout:2/194: read d4/d20/f29 [408313,78589] 0 2024-09-18T12:49:09.314 INFO:tasks.workunit.client.0.smithi078.stdout:1/188: fsync d0/d8/da/f1c 0 2024-09-18T12:49:09.317 INFO:tasks.workunit.client.0.smithi078.stdout:6/285: creat d10/d27/f4f x:0 0 0 2024-09-18T12:49:09.318 INFO:tasks.workunit.client.1.smithi148.stdout:1/304: symlink dc/d18/l66 0 2024-09-18T12:49:09.319 INFO:tasks.workunit.client.1.smithi148.stdout:1/305: write dc/d11/f53 [313678,60196] 0 2024-09-18T12:49:09.319 INFO:tasks.workunit.client.0.smithi078.stdout:9/136: mkdir d5/d7/d29 0 2024-09-18T12:49:09.321 INFO:tasks.workunit.client.0.smithi078.stdout:3/148: mkdir d9/d13/d33/d34 0 2024-09-18T12:49:09.322 INFO:tasks.workunit.client.0.smithi078.stdout:5/254: mknod d2/d4/d9/d47/d4d/c50 0 2024-09-18T12:49:09.323 INFO:tasks.workunit.client.1.smithi148.stdout:6/346: rmdir d5/d1a/dc/d2b/d35/d65 39 2024-09-18T12:49:09.324 INFO:tasks.workunit.client.0.smithi078.stdout:4/140: rename d11/f33 to d11/d27/f34 0 2024-09-18T12:49:09.324 INFO:tasks.workunit.client.1.smithi148.stdout:9/270: truncate d8/da/dd/f14 227745 0 2024-09-18T12:49:09.326 INFO:tasks.workunit.client.1.smithi148.stdout:3/263: link d4/f29 d4/d8/d1e/f5e 0 2024-09-18T12:49:09.327 INFO:tasks.workunit.client.1.smithi148.stdout:3/264: stat d4/d8/d20/f3f 0 2024-09-18T12:49:09.329 INFO:tasks.workunit.client.1.smithi148.stdout:5/327: getdents d7/d8/dc 0 2024-09-18T12:49:09.330 INFO:tasks.workunit.client.1.smithi148.stdout:5/328: chown d7/d8/dc/d12/d1f/d25/l67 7216766 1 2024-09-18T12:49:09.331 INFO:tasks.workunit.client.1.smithi148.stdout:5/329: write d7/d8/dc/d12/d20/f61 [48784,103986] 0 2024-09-18T12:49:09.333 INFO:tasks.workunit.client.1.smithi148.stdout:5/330: read d7/d8/f1c [7833967,29332] 0 2024-09-18T12:49:09.335 INFO:tasks.workunit.client.1.smithi148.stdout:1/306: unlink dc/d18/f1c 0 2024-09-18T12:49:09.336 INFO:tasks.workunit.client.0.smithi078.stdout:9/137: truncate d5/d7/d8/f1a 697678 0 2024-09-18T12:49:09.336 INFO:tasks.workunit.client.1.smithi148.stdout:8/349: dwrite d8/d16/f2a [4194304,4194304] 0 2024-09-18T12:49:09.339 INFO:tasks.workunit.client.0.smithi078.stdout:3/149: truncate d9/f12 1386007 0 2024-09-18T12:49:09.340 INFO:tasks.workunit.client.0.smithi078.stdout:6/286: dwrite d10/f17 [0,4194304] 0 2024-09-18T12:49:09.341 INFO:tasks.workunit.client.1.smithi148.stdout:6/347: chown d5/l5a 3 1 2024-09-18T12:49:09.343 INFO:tasks.workunit.client.1.smithi148.stdout:1/307: dwrite dc/d18/d31/d4b/f65 [0,4194304] 0 2024-09-18T12:49:09.344 INFO:tasks.workunit.client.1.smithi148.stdout:9/271: unlink d8/da/dd/d4a/l30 0 2024-09-18T12:49:09.350 INFO:tasks.workunit.client.1.smithi148.stdout:2/247: getdents d9/d24/d47 0 2024-09-18T12:49:09.354 INFO:tasks.workunit.client.1.smithi148.stdout:4/269: truncate d15/d17/f27 1653587 0 2024-09-18T12:49:09.355 INFO:tasks.workunit.client.1.smithi148.stdout:4/270: chown d15/d17/d52/c54 6528967 1 2024-09-18T12:49:09.355 INFO:tasks.workunit.client.1.smithi148.stdout:8/350: read - d8/d16/d53/d39/d3b/d41/f64 zero size 2024-09-18T12:49:09.358 INFO:tasks.workunit.client.0.smithi078.stdout:1/189: creat d0/d37/f3c x:0 0 0 2024-09-18T12:49:09.359 INFO:tasks.workunit.client.1.smithi148.stdout:7/281: truncate db/dc/f12 4021762 0 2024-09-18T12:49:09.360 INFO:tasks.workunit.client.1.smithi148.stdout:6/348: mknod d5/d1a/d3d/c71 0 2024-09-18T12:49:09.364 INFO:tasks.workunit.client.1.smithi148.stdout:5/331: dread d7/d8/dc/f2a [0,4194304] 0 2024-09-18T12:49:09.364 INFO:tasks.workunit.client.1.smithi148.stdout:1/308: unlink dc/d18/d31/d39/f61 0 2024-09-18T12:49:09.365 INFO:tasks.workunit.client.1.smithi148.stdout:1/309: chown dc/d18/f3f 22526391 1 2024-09-18T12:49:09.365 INFO:tasks.workunit.client.0.smithi078.stdout:8/216: truncate d0/d7/dc/d1f/d23/f25 1015536 0 2024-09-18T12:49:09.366 INFO:tasks.workunit.client.1.smithi148.stdout:9/272: symlink d8/da/dd/d3f/l51 0 2024-09-18T12:49:09.367 INFO:tasks.workunit.client.1.smithi148.stdout:9/273: truncate d8/d33/f34 4633882 0 2024-09-18T12:49:09.368 INFO:tasks.workunit.client.1.smithi148.stdout:9/274: write d8/da/dd/f40 [8672190,27429] 0 2024-09-18T12:49:09.368 INFO:tasks.workunit.client.1.smithi148.stdout:9/275: stat f7 0 2024-09-18T12:49:09.369 INFO:tasks.workunit.client.1.smithi148.stdout:3/265: link d4/f6 d4/d2d/d31/d59/f5f 0 2024-09-18T12:49:09.373 INFO:tasks.workunit.client.1.smithi148.stdout:2/248: dread d9/d4a/f38 [0,4194304] 0 2024-09-18T12:49:09.373 INFO:tasks.workunit.client.0.smithi078.stdout:6/287: creat d10/d2b/d43/f50 x:0 0 0 2024-09-18T12:49:09.373 INFO:tasks.workunit.client.0.smithi078.stdout:8/217: dwrite d0/f21 [4194304,4194304] 0 2024-09-18T12:49:09.374 INFO:tasks.workunit.client.0.smithi078.stdout:6/288: chown d10/f30 36395 1 2024-09-18T12:49:09.374 INFO:tasks.workunit.client.0.smithi078.stdout:4/141: mknod d11/c35 0 2024-09-18T12:49:09.375 INFO:tasks.workunit.client.1.smithi148.stdout:4/271: fsync d15/f16 0 2024-09-18T12:49:09.376 INFO:tasks.workunit.client.1.smithi148.stdout:4/272: stat d15/d17/d52/c59 0 2024-09-18T12:49:09.378 INFO:tasks.workunit.client.0.smithi078.stdout:2/195: link d4/f9 d4/dd/f40 0 2024-09-18T12:49:09.379 INFO:tasks.workunit.client.0.smithi078.stdout:2/196: chown d4/db/dc 208110656 1 2024-09-18T12:49:09.382 INFO:tasks.workunit.client.0.smithi078.stdout:1/190: chown d0/c15 25494961 1 2024-09-18T12:49:09.383 INFO:tasks.workunit.client.0.smithi078.stdout:4/142: dwrite d11/d1f/f2b [4194304,4194304] 0 2024-09-18T12:49:09.389 INFO:tasks.workunit.client.0.smithi078.stdout:3/150: mknod d9/d13/d33/d34/c35 0 2024-09-18T12:49:09.391 INFO:tasks.workunit.client.0.smithi078.stdout:3/151: write d9/f27 [2528571,117856] 0 2024-09-18T12:49:09.393 INFO:tasks.workunit.client.1.smithi148.stdout:5/332: mknod d7/d8/dc/d12/d1f/d39/c6e 0 2024-09-18T12:49:09.394 INFO:tasks.workunit.client.0.smithi078.stdout:6/289: mknod d10/d27/d3f/c51 0 2024-09-18T12:49:09.395 INFO:tasks.workunit.client.1.smithi148.stdout:5/333: write d7/d8/dc/d12/d1f/d39/f5e [562133,7227] 0 2024-09-18T12:49:09.395 INFO:tasks.workunit.client.0.smithi078.stdout:6/290: fsync d10/d27/d3f/d40/f4d 0 2024-09-18T12:49:09.395 INFO:tasks.workunit.client.0.smithi078.stdout:6/291: readlink l5 0 2024-09-18T12:49:09.395 INFO:tasks.workunit.client.1.smithi148.stdout:5/334: stat d7/d8/dc/d12/d20/f53 0 2024-09-18T12:49:09.396 INFO:tasks.workunit.client.0.smithi078.stdout:8/218: write d0/d7/dc/d1f/d23/d29/d2e/f3a [4757304,106119] 0 2024-09-18T12:49:09.397 INFO:tasks.workunit.client.1.smithi148.stdout:5/335: write d7/d8/dc/d22/f5f [841653,39072] 0 2024-09-18T12:49:09.397 INFO:tasks.workunit.client.1.smithi148.stdout:0/474: sync 2024-09-18T12:49:09.400 INFO:tasks.workunit.client.1.smithi148.stdout:4/273: dread d15/d17/f1a [0,4194304] 0 2024-09-18T12:49:09.401 INFO:tasks.workunit.client.0.smithi078.stdout:5/255: write d2/d4/d9/f1c [1360477,98934] 0 2024-09-18T12:49:09.401 INFO:tasks.workunit.client.1.smithi148.stdout:9/276: creat d8/da/dd/d4a/d27/f52 x:0 0 0 2024-09-18T12:49:09.402 INFO:tasks.workunit.client.1.smithi148.stdout:9/277: stat d8/da 0 2024-09-18T12:49:09.403 INFO:tasks.workunit.client.1.smithi148.stdout:9/278: truncate d8/d33/f34 5479618 0 2024-09-18T12:49:09.403 INFO:tasks.workunit.client.0.smithi078.stdout:6/292: dwrite d10/d2b/f44 [0,4194304] 0 2024-09-18T12:49:09.406 INFO:tasks.workunit.client.0.smithi078.stdout:2/197: mknod d4/dd/d18/d3b/c41 0 2024-09-18T12:49:09.408 INFO:tasks.workunit.client.0.smithi078.stdout:1/191: symlink d0/d8/da/l3d 0 2024-09-18T12:49:09.409 INFO:tasks.workunit.client.0.smithi078.stdout:1/192: write d0/f19 [183838,83699] 0 2024-09-18T12:49:09.410 INFO:tasks.workunit.client.1.smithi148.stdout:5/336: dread d7/d8/f13 [0,4194304] 0 2024-09-18T12:49:09.411 INFO:tasks.workunit.client.1.smithi148.stdout:5/337: write d7/d8/dc/f5d [2643598,45574] 0 2024-09-18T12:49:09.413 INFO:tasks.workunit.client.1.smithi148.stdout:5/338: write d7/d8/dc/f28 [86394,36136] 0 2024-09-18T12:49:09.414 INFO:tasks.workunit.client.1.smithi148.stdout:7/282: symlink db/dc/df/l50 0 2024-09-18T12:49:09.415 INFO:tasks.workunit.client.1.smithi148.stdout:7/283: fdatasync db/dc/f15 0 2024-09-18T12:49:09.416 INFO:tasks.workunit.client.1.smithi148.stdout:6/349: fsync d5/d1a/f47 0 2024-09-18T12:49:09.417 INFO:tasks.workunit.client.1.smithi148.stdout:6/350: write d5/ff [1614676,118553] 0 2024-09-18T12:49:09.421 INFO:tasks.workunit.client.0.smithi078.stdout:8/219: fdatasync d0/d7/dc/f3c 0 2024-09-18T12:49:09.422 INFO:tasks.workunit.client.1.smithi148.stdout:3/266: dwrite d4/f29 [4194304,4194304] 0 2024-09-18T12:49:09.422 INFO:tasks.workunit.client.1.smithi148.stdout:1/310: mknod dc/d18/c67 0 2024-09-18T12:49:09.428 INFO:tasks.workunit.client.0.smithi078.stdout:6/293: creat d10/d27/f52 x:0 0 0 2024-09-18T12:49:09.428 INFO:tasks.workunit.client.0.smithi078.stdout:4/143: dwrite d11/f1d [0,4194304] 0 2024-09-18T12:49:09.430 INFO:tasks.workunit.client.1.smithi148.stdout:9/279: dread d8/da/f13 [0,4194304] 0 2024-09-18T12:49:09.433 INFO:tasks.workunit.client.1.smithi148.stdout:7/284: dread db/dc/f37 [0,4194304] 0 2024-09-18T12:49:09.434 INFO:tasks.workunit.client.0.smithi078.stdout:1/193: mkdir d0/d8/da/d3e 0 2024-09-18T12:49:09.435 INFO:tasks.workunit.client.1.smithi148.stdout:2/249: fdatasync d9/d17/f2a 0 2024-09-18T12:49:09.435 INFO:tasks.workunit.client.1.smithi148.stdout:2/250: stat d9/d24/d31 0 2024-09-18T12:49:09.436 INFO:tasks.workunit.client.1.smithi148.stdout:2/251: stat d9/d24/f28 0 2024-09-18T12:49:09.436 INFO:tasks.workunit.client.0.smithi078.stdout:9/138: getdents d5 0 2024-09-18T12:49:09.436 INFO:tasks.workunit.client.1.smithi148.stdout:2/252: fdatasync d9/d24/f28 0 2024-09-18T12:49:09.438 INFO:tasks.workunit.client.1.smithi148.stdout:8/351: creat d8/df/f73 x:0 0 0 2024-09-18T12:49:09.440 INFO:tasks.workunit.client.1.smithi148.stdout:5/339: creat d7/d8/d18/d3f/f6f x:0 0 0 2024-09-18T12:49:09.442 INFO:tasks.workunit.client.1.smithi148.stdout:5/340: write d7/d8/dc/d12/d20/f2e [789397,52034] 0 2024-09-18T12:49:09.442 INFO:tasks.workunit.client.1.smithi148.stdout:2/253: read d9/fc [577024,76474] 0 2024-09-18T12:49:09.442 INFO:tasks.workunit.client.0.smithi078.stdout:2/198: write d4/dd/f40 [3822451,91176] 0 2024-09-18T12:49:09.444 INFO:tasks.workunit.client.0.smithi078.stdout:4/144: unlink d11/d27/c2c 0 2024-09-18T12:49:09.447 INFO:tasks.workunit.client.0.smithi078.stdout:6/294: rename d10/d27/d3f/d40 to d10/d2b/d43/d53 0 2024-09-18T12:49:09.448 INFO:tasks.workunit.client.0.smithi078.stdout:2/199: dwrite d4/d1a/f30 [0,4194304] 0 2024-09-18T12:49:09.449 INFO:tasks.workunit.client.0.smithi078.stdout:6/295: write d10/d27/f38 [335353,113237] 0 2024-09-18T12:49:09.450 INFO:tasks.workunit.client.0.smithi078.stdout:6/296: write d10/f1e [9142259,37795] 0 2024-09-18T12:49:09.455 INFO:tasks.workunit.client.0.smithi078.stdout:9/139: mkdir d5/d7/d8/d1c/d2a 0 2024-09-18T12:49:09.455 INFO:tasks.workunit.client.0.smithi078.stdout:3/152: dread d9/d13/f1d [0,4194304] 0 2024-09-18T12:49:09.457 INFO:tasks.workunit.client.0.smithi078.stdout:8/220: link d0/d7/dc/d1f/d23/d29/d2e/f3a d0/d7/dc/d1f/d23/d40/f42 0 2024-09-18T12:49:09.458 INFO:tasks.workunit.client.1.smithi148.stdout:3/267: mkdir d4/d2d/d31/d60 0 2024-09-18T12:49:09.459 INFO:tasks.workunit.client.0.smithi078.stdout:5/256: dwrite d2/d4/d9/f13 [0,4194304] 0 2024-09-18T12:49:09.464 INFO:tasks.workunit.client.0.smithi078.stdout:6/297: rmdir d10 39 2024-09-18T12:49:09.468 INFO:tasks.workunit.client.0.smithi078.stdout:0/282: sync 2024-09-18T12:49:09.471 INFO:tasks.workunit.client.0.smithi078.stdout:8/221: symlink d0/d7/dc/l43 0 2024-09-18T12:49:09.472 INFO:tasks.workunit.client.0.smithi078.stdout:1/194: write d0/d8/f2b [1682957,67110] 0 2024-09-18T12:49:09.474 INFO:tasks.workunit.client.1.smithi148.stdout:5/341: creat d7/d8/d18/d3f/f70 x:0 0 0 2024-09-18T12:49:09.475 INFO:tasks.workunit.client.0.smithi078.stdout:5/257: symlink d2/d4/d9/d47/d4d/l51 0 2024-09-18T12:49:09.475 INFO:tasks.workunit.client.1.smithi148.stdout:5/342: chown d7/d2b/l63 48433 1 2024-09-18T12:49:09.478 INFO:tasks.workunit.client.1.smithi148.stdout:0/475: truncate de/f1c 94636 0 2024-09-18T12:49:09.480 INFO:tasks.workunit.client.1.smithi148.stdout:7/285: write db/dd/f1a [1768593,5843] 0 2024-09-18T12:49:09.480 INFO:tasks.workunit.client.1.smithi148.stdout:3/268: rmdir d4/d8/d20 39 2024-09-18T12:49:09.481 INFO:tasks.workunit.client.1.smithi148.stdout:5/343: dwrite d7/d8/dc/d12/d1f/d25/d4b/f58 [0,4194304] 0 2024-09-18T12:49:09.482 INFO:tasks.workunit.client.0.smithi078.stdout:0/283: rename f2 to d3/d43/f69 0 2024-09-18T12:49:09.483 INFO:tasks.workunit.client.0.smithi078.stdout:0/284: chown d3/d1f/d2e/d4e/d37/f55 250 1 2024-09-18T12:49:09.484 INFO:tasks.workunit.client.1.smithi148.stdout:4/274: rename d15/d17/d1f/d4c/d4f/d34/f35 to d15/d17/d1f/d4c/f5b 0 2024-09-18T12:49:09.486 INFO:tasks.workunit.client.1.smithi148.stdout:8/352: mkdir d8/d12/d46/d74 0 2024-09-18T12:49:09.486 INFO:tasks.workunit.client.1.smithi148.stdout:4/275: stat d15/d17/d1f/d4c/c50 0 2024-09-18T12:49:09.488 INFO:tasks.workunit.client.1.smithi148.stdout:2/254: symlink d9/d17/l51 0 2024-09-18T12:49:09.489 INFO:tasks.workunit.client.0.smithi078.stdout:1/195: readlink d0/d21/l22 0 2024-09-18T12:49:09.489 INFO:tasks.workunit.client.1.smithi148.stdout:5/344: dwrite d7/d2b/f65 [0,4194304] 0 2024-09-18T12:49:09.490 INFO:tasks.workunit.client.0.smithi078.stdout:3/153: dwrite d9/d2a/d19/f32 [0,4194304] 0 2024-09-18T12:49:09.490 INFO:tasks.workunit.client.0.smithi078.stdout:1/196: stat d0/d8/c1d 0 2024-09-18T12:49:09.491 INFO:tasks.workunit.client.0.smithi078.stdout:1/197: write d0/d21/f36 [60940,48705] 0 2024-09-18T12:49:09.492 INFO:tasks.workunit.client.1.smithi148.stdout:6/351: creat d5/d1a/dc/d2b/d35/f72 x:0 0 0 2024-09-18T12:49:09.493 INFO:tasks.workunit.client.0.smithi078.stdout:2/200: creat d4/dd/f42 x:0 0 0 2024-09-18T12:49:09.494 INFO:tasks.workunit.client.0.smithi078.stdout:2/201: dread - d4/dd/d18/d3b/f3f zero size 2024-09-18T12:49:09.496 INFO:tasks.workunit.client.1.smithi148.stdout:6/352: write d5/d1a/dc/f5b [988542,77057] 0 2024-09-18T12:49:09.497 INFO:tasks.workunit.client.0.smithi078.stdout:6/298: truncate f9 572541 0 2024-09-18T12:49:09.500 INFO:tasks.workunit.client.0.smithi078.stdout:9/140: rmdir d5/d7/d29 0 2024-09-18T12:49:09.501 INFO:tasks.workunit.client.1.smithi148.stdout:5/345: dwrite d7/d8/dc/d12/f45 [0,4194304] 0 2024-09-18T12:49:09.506 INFO:tasks.workunit.client.1.smithi148.stdout:7/286: creat db/dc/df/d11/f51 x:0 0 0 2024-09-18T12:49:09.508 INFO:tasks.workunit.client.1.smithi148.stdout:6/353: dwrite d5/d32/d38/d50/f59 [0,4194304] 0 2024-09-18T12:49:09.508 INFO:tasks.workunit.client.0.smithi078.stdout:4/145: getdents d11/d27 0 2024-09-18T12:49:09.509 INFO:tasks.workunit.client.0.smithi078.stdout:5/258: write d2/d4/d9/f2a [1615411,68547] 0 2024-09-18T12:49:09.511 INFO:tasks.workunit.client.0.smithi078.stdout:8/222: dwrite d0/d7/dc/d1f/d23/d40/f42 [0,4194304] 0 2024-09-18T12:49:09.512 INFO:tasks.workunit.client.1.smithi148.stdout:1/311: dread dc/d11/d17/f21 [0,4194304] 0 2024-09-18T12:49:09.516 INFO:tasks.workunit.client.1.smithi148.stdout:8/353: unlink d8/df/c2e 0 2024-09-18T12:49:09.517 INFO:tasks.workunit.client.0.smithi078.stdout:4/146: dwrite d11/d1f/f2b [4194304,4194304] 0 2024-09-18T12:49:09.521 INFO:tasks.workunit.client.1.smithi148.stdout:6/354: dread d5/f2e [0,4194304] 0 2024-09-18T12:49:09.521 INFO:tasks.workunit.client.1.smithi148.stdout:4/276: mknod d15/d17/d1f/d4c/d4f/d34/c5c 0 2024-09-18T12:49:09.522 INFO:tasks.workunit.client.1.smithi148.stdout:9/280: sync 2024-09-18T12:49:09.523 INFO:tasks.workunit.client.1.smithi148.stdout:6/355: truncate d5/d1a/f6f 223646 0 2024-09-18T12:49:09.523 INFO:tasks.workunit.client.1.smithi148.stdout:9/281: fdatasync d8/da/dd/d4a/d27/f52 0 2024-09-18T12:49:09.524 INFO:tasks.workunit.client.0.smithi078.stdout:3/154: symlink d9/df/l36 0 2024-09-18T12:49:09.524 INFO:tasks.workunit.client.0.smithi078.stdout:7/107: sync 2024-09-18T12:49:09.525 INFO:tasks.workunit.client.0.smithi078.stdout:3/155: write d9/d2a/d19/f32 [4095897,18980] 0 2024-09-18T12:49:09.525 INFO:tasks.workunit.client.0.smithi078.stdout:7/108: readlink d7/d9/l16 0 2024-09-18T12:49:09.526 INFO:tasks.workunit.client.0.smithi078.stdout:7/109: fdatasync d7/d9/f13 0 2024-09-18T12:49:09.530 INFO:tasks.workunit.client.0.smithi078.stdout:2/202: creat d4/d1a/f43 x:0 0 0 2024-09-18T12:49:09.533 INFO:tasks.workunit.client.1.smithi148.stdout:3/269: mkdir d4/d8/d20/d2b/d43/d61 0 2024-09-18T12:49:09.535 INFO:tasks.workunit.client.1.smithi148.stdout:7/287: unlink db/dc/df/d11/d43/f46 0 2024-09-18T12:49:09.538 INFO:tasks.workunit.client.1.smithi148.stdout:1/312: symlink dc/d18/d31/d39/l68 0 2024-09-18T12:49:09.539 INFO:tasks.workunit.client.0.smithi078.stdout:8/223: mkdir d0/d7/dc/d1f/d23/d44 0 2024-09-18T12:49:09.541 INFO:tasks.workunit.client.1.smithi148.stdout:8/354: rename d8/d12/l17 to d8/d16/d53/d39/d3b/d4e/l75 0 2024-09-18T12:49:09.541 INFO:tasks.workunit.client.1.smithi148.stdout:8/355: readlink d8/d12/l5e 0 2024-09-18T12:49:09.542 INFO:tasks.workunit.client.0.smithi078.stdout:8/224: dread d0/d7/fb [0,4194304] 0 2024-09-18T12:49:09.543 INFO:tasks.workunit.client.0.smithi078.stdout:3/156: fdatasync d9/df/d11/f25 0 2024-09-18T12:49:09.545 INFO:tasks.workunit.client.0.smithi078.stdout:7/110: mknod d7/d9/d14/c24 0 2024-09-18T12:49:09.546 INFO:tasks.workunit.client.1.smithi148.stdout:0/476: write de/f1c [175210,335] 0 2024-09-18T12:49:09.548 INFO:tasks.workunit.client.1.smithi148.stdout:4/277: dwrite fe [0,4194304] 0 2024-09-18T12:49:09.551 INFO:tasks.workunit.client.0.smithi078.stdout:3/157: dwrite d9/d2a/d19/f32 [0,4194304] 0 2024-09-18T12:49:09.552 INFO:tasks.workunit.client.0.smithi078.stdout:4/147: symlink d11/d1f/d24/l36 0 2024-09-18T12:49:09.554 INFO:tasks.workunit.client.0.smithi078.stdout:4/148: dread - d11/d27/f2f zero size 2024-09-18T12:49:09.556 INFO:tasks.workunit.client.0.smithi078.stdout:1/198: link d0/d21/f2e d0/d8/f3f 0 2024-09-18T12:49:09.557 INFO:tasks.workunit.client.1.smithi148.stdout:8/356: dread d8/df/f10 [0,4194304] 0 2024-09-18T12:49:09.558 INFO:tasks.workunit.client.1.smithi148.stdout:8/357: write d8/d12/d46/f58 [4656680,39835] 0 2024-09-18T12:49:09.559 INFO:tasks.workunit.client.0.smithi078.stdout:3/158: dread d9/f27 [0,4194304] 0 2024-09-18T12:49:09.559 INFO:tasks.workunit.client.1.smithi148.stdout:1/313: dread - dc/d11/d17/f5f zero size 2024-09-18T12:49:09.560 INFO:tasks.workunit.client.1.smithi148.stdout:8/358: dread - d8/d16/d53/d39/d3b/f63 zero size 2024-09-18T12:49:09.561 INFO:tasks.workunit.client.1.smithi148.stdout:9/282: rename d8/c19 to d8/da/dd/d35/d47/c53 0 2024-09-18T12:49:09.565 INFO:tasks.workunit.client.0.smithi078.stdout:9/141: creat d5/d7/f2b x:0 0 0 2024-09-18T12:49:09.567 INFO:tasks.workunit.client.1.smithi148.stdout:1/314: dwrite dc/d11/f53 [0,4194304] 0 2024-09-18T12:49:09.571 INFO:tasks.workunit.client.0.smithi078.stdout:0/285: rename d3/d1f/d2e/d4e/d37/c4c to d3/d1f/c6a 0 2024-09-18T12:49:09.573 INFO:tasks.workunit.client.1.smithi148.stdout:4/278: creat d15/d17/d1f/d4c/f5d x:0 0 0 2024-09-18T12:49:09.573 INFO:tasks.workunit.client.1.smithi148.stdout:2/255: truncate d9/fe 922940 0 2024-09-18T12:49:09.574 INFO:tasks.workunit.client.1.smithi148.stdout:2/256: read d9/f39 [455560,79381] 0 2024-09-18T12:49:09.575 INFO:tasks.workunit.client.0.smithi078.stdout:5/259: symlink d2/d4/d12/d16/d36/d4c/l52 0 2024-09-18T12:49:09.579 INFO:tasks.workunit.client.0.smithi078.stdout:4/149: symlink d11/d1f/l37 0 2024-09-18T12:49:09.581 INFO:tasks.workunit.client.0.smithi078.stdout:4/150: dread - d11/d27/f34 zero size 2024-09-18T12:49:09.581 INFO:tasks.workunit.client.0.smithi078.stdout:2/203: dread d4/f5 [0,4194304] 0 2024-09-18T12:49:09.582 INFO:tasks.workunit.client.1.smithi148.stdout:6/356: link d5/l9 d5/d1a/d3d/l73 0 2024-09-18T12:49:09.582 INFO:tasks.workunit.client.1.smithi148.stdout:7/288: dread db/dc/df/f35 [4194304,4194304] 0 2024-09-18T12:49:09.583 INFO:tasks.workunit.client.1.smithi148.stdout:7/289: chown db 221 1 2024-09-18T12:49:09.583 INFO:tasks.workunit.client.0.smithi078.stdout:5/260: dwrite d2/d4/d48/f4e [0,4194304] 0 2024-09-18T12:49:09.583 INFO:tasks.workunit.client.0.smithi078.stdout:3/159: fsync d9/d13/f1d 0 2024-09-18T12:49:09.584 INFO:tasks.workunit.client.1.smithi148.stdout:7/290: write db/dd/d25/d38/f3f [3532309,118047] 0 2024-09-18T12:49:09.584 INFO:tasks.workunit.client.1.smithi148.stdout:7/291: chown db/dd/d1f 0 1 2024-09-18T12:49:09.585 INFO:tasks.workunit.client.1.smithi148.stdout:6/357: read d5/d1a/dc/d2b/f30 [3547063,94157] 0 2024-09-18T12:49:09.586 INFO:tasks.workunit.client.1.smithi148.stdout:5/346: link d7/d8/dc/d12/d1f/d39/l3b d7/d8/l71 0 2024-09-18T12:49:09.587 INFO:tasks.workunit.client.0.smithi078.stdout:5/261: write d2/d4/d12/f40 [2166285,116822] 0 2024-09-18T12:49:09.588 INFO:tasks.workunit.client.1.smithi148.stdout:5/347: read d7/d8/d18/f38 [2500468,1963] 0 2024-09-18T12:49:09.589 INFO:tasks.workunit.client.0.smithi078.stdout:5/262: stat d2/d4/l35 0 2024-09-18T12:49:09.590 INFO:tasks.workunit.client.1.smithi148.stdout:1/315: rmdir dc/d18/d43 39 2024-09-18T12:49:09.590 INFO:tasks.workunit.client.0.smithi078.stdout:2/204: dwrite d4/d8/f1d [0,4194304] 0 2024-09-18T12:49:09.591 INFO:tasks.workunit.client.0.smithi078.stdout:2/205: chown d4/dd/c32 3201 1 2024-09-18T12:49:09.592 INFO:tasks.workunit.client.0.smithi078.stdout:2/206: chown d4/d1a/f43 13529964 1 2024-09-18T12:49:09.594 INFO:tasks.workunit.client.0.smithi078.stdout:2/207: write d4/db/dc/f34 [1036293,2538] 0 2024-09-18T12:49:09.594 INFO:tasks.workunit.client.0.smithi078.stdout:2/208: chown d4 3 1 2024-09-18T12:49:09.595 INFO:tasks.workunit.client.0.smithi078.stdout:5/263: dread d2/d4/d9/da/f20 [0,4194304] 0 2024-09-18T12:49:09.596 INFO:tasks.workunit.client.0.smithi078.stdout:0/286: mknod d3/d1f/d2e/d68/d30/c6b 0 2024-09-18T12:49:09.596 INFO:tasks.workunit.client.1.smithi148.stdout:1/316: dwrite dc/fd [0,4194304] 0 2024-09-18T12:49:09.598 INFO:tasks.workunit.client.0.smithi078.stdout:0/287: dread - d3/d1f/f63 zero size 2024-09-18T12:49:09.600 INFO:tasks.workunit.client.1.smithi148.stdout:2/257: fdatasync d9/f40 0 2024-09-18T12:49:09.604 INFO:tasks.workunit.client.0.smithi078.stdout:2/209: dwrite d4/db/dc/f34 [0,4194304] 0 2024-09-18T12:49:09.604 INFO:tasks.workunit.client.1.smithi148.stdout:0/477: dwrite de/d27/d53/d89/d9d/f9e [0,4194304] 0 2024-09-18T12:49:09.604 INFO:tasks.workunit.client.0.smithi078.stdout:1/199: link d0/d8/da/f23 d0/d8/da/f40 0 2024-09-18T12:49:09.605 INFO:tasks.workunit.client.1.smithi148.stdout:3/270: link d4/d8/f23 d4/d8/d20/f62 0 2024-09-18T12:49:09.606 INFO:tasks.workunit.client.0.smithi078.stdout:1/200: stat d0/c33 0 2024-09-18T12:49:09.609 INFO:tasks.workunit.client.1.smithi148.stdout:8/359: rename d8/d16/d53/d39/d3b/d41/f69 to d8/d16/d27/f76 0 2024-09-18T12:49:09.610 INFO:tasks.workunit.client.1.smithi148.stdout:8/360: fsync d8/fb 0 2024-09-18T12:49:09.610 INFO:tasks.workunit.client.0.smithi078.stdout:1/201: chown d0/d8/da/l3b 801871 1 2024-09-18T12:49:09.612 INFO:tasks.workunit.client.1.smithi148.stdout:9/283: mkdir d8/da/dd/d4a/d49/d46/d54 0 2024-09-18T12:49:09.617 INFO:tasks.workunit.client.0.smithi078.stdout:3/160: mkdir d9/d13/d37 0 2024-09-18T12:49:09.619 INFO:tasks.workunit.client.1.smithi148.stdout:9/284: dwrite d8/da/dd/d4a/f2d [0,4194304] 0 2024-09-18T12:49:09.619 INFO:tasks.workunit.client.0.smithi078.stdout:8/225: creat d0/d7/dc/d1f/f45 x:0 0 0 2024-09-18T12:49:09.623 INFO:tasks.workunit.client.1.smithi148.stdout:5/348: symlink d7/d8/dc/d22/l72 0 2024-09-18T12:49:09.623 INFO:tasks.workunit.client.0.smithi078.stdout:9/142: symlink d5/d7/l2c 0 2024-09-18T12:49:09.626 INFO:tasks.workunit.client.1.smithi148.stdout:5/349: write d7/d8/dc/d12/d1f/d25/f54 [1412582,89150] 0 2024-09-18T12:49:09.627 INFO:tasks.workunit.client.0.smithi078.stdout:4/151: dwrite d11/d27/f34 [0,4194304] 0 2024-09-18T12:49:09.628 INFO:tasks.workunit.client.1.smithi148.stdout:5/350: truncate d7/d8/dc/d12/d20/f53 788913 0 2024-09-18T12:49:09.629 INFO:tasks.workunit.client.1.smithi148.stdout:2/258: creat d9/d3a/f52 x:0 0 0 2024-09-18T12:49:09.632 INFO:tasks.workunit.client.1.smithi148.stdout:3/271: mkdir d4/d8/d1e/d63 0 2024-09-18T12:49:09.632 INFO:tasks.workunit.client.0.smithi078.stdout:1/202: mkdir d0/d21/d41 0 2024-09-18T12:49:09.632 INFO:tasks.workunit.client.0.smithi078.stdout:0/288: chown d3/d1f/d2e/c5f 62145250 1 2024-09-18T12:49:09.636 INFO:tasks.workunit.client.0.smithi078.stdout:9/143: dwrite f0 [4194304,4194304] 0 2024-09-18T12:49:09.638 INFO:tasks.workunit.client.1.smithi148.stdout:3/272: dwrite d4/f5 [0,4194304] 0 2024-09-18T12:49:09.639 INFO:tasks.workunit.client.1.smithi148.stdout:3/273: dread - d4/d2d/f4d zero size 2024-09-18T12:49:09.639 INFO:tasks.workunit.client.0.smithi078.stdout:7/111: getdents d7/d9/d14 0 2024-09-18T12:49:09.641 INFO:tasks.workunit.client.0.smithi078.stdout:6/299: rename d10/d27/d3f/c51 to d10/c54 0 2024-09-18T12:49:09.642 INFO:tasks.workunit.client.0.smithi078.stdout:7/112: truncate d7/f1b 697328 0 2024-09-18T12:49:09.643 INFO:tasks.workunit.client.0.smithi078.stdout:6/300: write d10/d2b/d43/f50 [532214,20494] 0 2024-09-18T12:49:09.644 INFO:tasks.workunit.client.0.smithi078.stdout:5/264: creat d2/d4/d9/da/d2b/d3e/f53 x:0 0 0 2024-09-18T12:49:09.649 INFO:tasks.workunit.client.1.smithi148.stdout:9/285: dread d8/f25 [0,4194304] 0 2024-09-18T12:49:09.650 INFO:tasks.workunit.client.1.smithi148.stdout:9/286: write d8/d33/f42 [755785,25969] 0 2024-09-18T12:49:09.651 INFO:tasks.workunit.client.0.smithi078.stdout:5/265: stat d2/d4/d9/da/d2b/l44 0 2024-09-18T12:49:09.654 INFO:tasks.workunit.client.1.smithi148.stdout:1/317: truncate dc/f13 531476 0 2024-09-18T12:49:09.654 INFO:tasks.workunit.client.1.smithi148.stdout:0/478: dread de/d14/f25 [0,4194304] 0 2024-09-18T12:49:09.655 INFO:tasks.workunit.client.1.smithi148.stdout:1/318: write dc/d11/f12 [5134444,37629] 0 2024-09-18T12:49:09.656 INFO:tasks.workunit.client.0.smithi078.stdout:3/161: creat d9/d2f/f38 x:0 0 0 2024-09-18T12:49:09.661 INFO:tasks.workunit.client.0.smithi078.stdout:8/226: symlink d0/d7/dc/d1f/d23/d40/l46 0 2024-09-18T12:49:09.661 INFO:tasks.workunit.client.0.smithi078.stdout:2/210: dread d4/db/f1c [0,4194304] 0 2024-09-18T12:49:09.662 INFO:tasks.workunit.client.1.smithi148.stdout:9/287: fdatasync d8/d33/f42 0 2024-09-18T12:49:09.662 INFO:tasks.workunit.client.1.smithi148.stdout:5/351: creat d7/d8/dc/d12/d1f/d69/f73 x:0 0 0 2024-09-18T12:49:09.663 INFO:tasks.workunit.client.1.smithi148.stdout:9/288: chown d8/l2a 932872501 1 2024-09-18T12:49:09.663 INFO:tasks.workunit.client.1.smithi148.stdout:9/289: stat d8/f22 0 2024-09-18T12:49:09.663 INFO:tasks.workunit.client.0.smithi078.stdout:7/113: dwrite f5 [0,4194304] 0 2024-09-18T12:49:09.664 INFO:tasks.workunit.client.1.smithi148.stdout:9/290: chown d8/da/dd/d3f 0 1 2024-09-18T12:49:09.666 INFO:tasks.workunit.client.0.smithi078.stdout:7/114: dread - d7/f1e zero size 2024-09-18T12:49:09.666 INFO:tasks.workunit.client.1.smithi148.stdout:5/352: dread d7/d8/dc/f5d [0,4194304] 0 2024-09-18T12:49:09.667 INFO:tasks.workunit.client.1.smithi148.stdout:5/353: fdatasync d7/d8/d18/d3f/f70 0 2024-09-18T12:49:09.668 INFO:tasks.workunit.client.0.smithi078.stdout:7/115: fsync d7/d9/f10 0 2024-09-18T12:49:09.670 INFO:tasks.workunit.client.0.smithi078.stdout:7/116: dread - d7/d9/f20 zero size 2024-09-18T12:49:09.671 INFO:tasks.workunit.client.1.smithi148.stdout:7/292: rename db/dd to db/d52 0 2024-09-18T12:49:09.672 INFO:tasks.workunit.client.0.smithi078.stdout:7/117: dread - d7/d9/d14/f21 zero size 2024-09-18T12:49:09.673 INFO:tasks.workunit.client.0.smithi078.stdout:3/162: dread d9/d13/f1d [0,4194304] 0 2024-09-18T12:49:09.673 INFO:tasks.workunit.client.0.smithi078.stdout:8/227: dwrite d0/d7/f22 [0,4194304] 0 2024-09-18T12:49:09.674 INFO:tasks.workunit.client.0.smithi078.stdout:5/266: creat d2/d4/d9/da/d2b/f54 x:0 0 0 2024-09-18T12:49:09.675 INFO:tasks.workunit.client.0.smithi078.stdout:3/163: read - d9/d2f/f38 zero size 2024-09-18T12:49:09.677 INFO:tasks.workunit.client.0.smithi078.stdout:9/144: dread f3 [0,4194304] 0 2024-09-18T12:49:09.677 INFO:tasks.workunit.client.0.smithi078.stdout:6/301: rename d10/d27 to d10/d2b/d43/d53/d45/d55 0 2024-09-18T12:49:09.677 INFO:tasks.workunit.client.0.smithi078.stdout:3/164: chown d9/d2a/f10 25 1 2024-09-18T12:49:09.678 INFO:tasks.workunit.client.0.smithi078.stdout:6/302: chown d10/d2b/d37/f4a 139986042 1 2024-09-18T12:49:09.680 INFO:tasks.workunit.client.1.smithi148.stdout:3/274: rmdir d4 39 2024-09-18T12:49:09.682 INFO:tasks.workunit.client.0.smithi078.stdout:1/203: creat d0/d8/da/d3e/f42 x:0 0 0 2024-09-18T12:49:09.685 INFO:tasks.workunit.client.1.smithi148.stdout:4/279: getdents d15/d3f 0 2024-09-18T12:49:09.687 INFO:tasks.workunit.client.0.smithi078.stdout:6/303: dwrite d10/f41 [0,4194304] 0 2024-09-18T12:49:09.687 INFO:tasks.workunit.client.0.smithi078.stdout:2/211: creat d4/d20/f44 x:0 0 0 2024-09-18T12:49:09.689 INFO:tasks.workunit.client.0.smithi078.stdout:2/212: write d4/dd/d18/f3c [86416,38225] 0 2024-09-18T12:49:09.691 INFO:tasks.workunit.client.0.smithi078.stdout:7/118: creat d7/d9/d14/f25 x:0 0 0 2024-09-18T12:49:09.692 INFO:tasks.workunit.client.0.smithi078.stdout:7/119: readlink d7/d9/l16 0 2024-09-18T12:49:09.693 INFO:tasks.workunit.client.1.smithi148.stdout:0/479: creat de/d27/d53/d89/fa8 x:0 0 0 2024-09-18T12:49:09.693 INFO:tasks.workunit.client.0.smithi078.stdout:7/120: fdatasync d7/d9/d14/f25 0 2024-09-18T12:49:09.695 INFO:tasks.workunit.client.1.smithi148.stdout:0/480: write de/d27/d2e/f73 [1048095,5150] 0 2024-09-18T12:49:09.695 INFO:tasks.workunit.client.0.smithi078.stdout:0/289: creat d3/f6c x:0 0 0 2024-09-18T12:49:09.696 INFO:tasks.workunit.client.1.smithi148.stdout:0/481: chown de/d14/f2a 0 1 2024-09-18T12:49:09.696 INFO:tasks.workunit.client.1.smithi148.stdout:1/319: read dc/f57 [2011822,121173] 0 2024-09-18T12:49:09.701 INFO:tasks.workunit.client.1.smithi148.stdout:9/291: rename d8/c37 to d8/da/dd/d35/c55 0 2024-09-18T12:49:09.702 INFO:tasks.workunit.client.1.smithi148.stdout:2/259: dwrite d9/d17/f4e [0,4194304] 0 2024-09-18T12:49:09.703 INFO:tasks.workunit.client.0.smithi078.stdout:3/165: rename d9/d2a/f10 to d9/d13/f39 0 2024-09-18T12:49:09.703 INFO:tasks.workunit.client.1.smithi148.stdout:5/354: dread d7/d8/f1c [4194304,4194304] 0 2024-09-18T12:49:09.704 INFO:tasks.workunit.client.1.smithi148.stdout:9/292: dread d8/da/f4d [0,4194304] 0 2024-09-18T12:49:09.708 INFO:tasks.workunit.client.1.smithi148.stdout:6/358: getdents d5 0 2024-09-18T12:49:09.709 INFO:tasks.workunit.client.0.smithi078.stdout:4/152: getdents d11/d1f/d24 0 2024-09-18T12:49:09.709 INFO:tasks.workunit.client.0.smithi078.stdout:4/153: stat d11/c13 0 2024-09-18T12:49:09.710 INFO:tasks.workunit.client.0.smithi078.stdout:4/154: chown d11/l1e 684718 1 2024-09-18T12:49:09.712 INFO:tasks.workunit.client.0.smithi078.stdout:2/213: unlink d4/db/l28 0 2024-09-18T12:49:09.713 INFO:tasks.workunit.client.0.smithi078.stdout:2/214: stat d4/db/f2a 0 2024-09-18T12:49:09.714 INFO:tasks.workunit.client.0.smithi078.stdout:5/267: mkdir d2/d4/d55 0 2024-09-18T12:49:09.717 INFO:tasks.workunit.client.1.smithi148.stdout:0/482: symlink de/d27/la9 0 2024-09-18T12:49:09.722 INFO:tasks.workunit.client.0.smithi078.stdout:3/166: symlink d9/df/l3a 0 2024-09-18T12:49:09.723 INFO:tasks.workunit.client.1.smithi148.stdout:7/293: rename db/dc/f37 to db/dc/df/d11/f53 0 2024-09-18T12:49:09.724 INFO:tasks.workunit.client.0.smithi078.stdout:5/268: dwrite d2/d4/d9/da/d2b/f54 [0,4194304] 0 2024-09-18T12:49:09.725 INFO:tasks.workunit.client.0.smithi078.stdout:1/204: rename d0/d8/da/d39 to d0/d8/da/d3e/d43 0 2024-09-18T12:49:09.726 INFO:tasks.workunit.client.0.smithi078.stdout:1/205: chown d0/d21/f2d 3771 1 2024-09-18T12:49:09.726 INFO:tasks.workunit.client.0.smithi078.stdout:0/290: dread d3/d43/f69 [4194304,4194304] 0 2024-09-18T12:49:09.727 INFO:tasks.workunit.client.0.smithi078.stdout:9/145: creat d5/d7/d8/d1c/d2a/f2d x:0 0 0 2024-09-18T12:49:09.727 INFO:tasks.workunit.client.0.smithi078.stdout:1/206: fdatasync d0/d8/f2b 0 2024-09-18T12:49:09.728 INFO:tasks.workunit.client.1.smithi148.stdout:2/260: symlink d9/d3a/l53 0 2024-09-18T12:49:09.730 INFO:tasks.workunit.client.1.smithi148.stdout:8/361: link d8/l23 d8/d16/d53/d39/d3b/l77 0 2024-09-18T12:49:09.730 INFO:tasks.workunit.client.0.smithi078.stdout:0/291: fsync d3/f17 0 2024-09-18T12:49:09.732 INFO:tasks.workunit.client.0.smithi078.stdout:2/215: mkdir d4/db/d45 0 2024-09-18T12:49:09.732 INFO:tasks.workunit.client.0.smithi078.stdout:1/207: chown d0/d8/da/d3e/f42 494 1 2024-09-18T12:49:09.733 INFO:tasks.workunit.client.0.smithi078.stdout:8/228: truncate d0/d7/f22 1032609 0 2024-09-18T12:49:09.734 INFO:tasks.workunit.client.0.smithi078.stdout:1/208: write d0/d21/f2d [1835468,26162] 0 2024-09-18T12:49:09.734 INFO:tasks.workunit.client.0.smithi078.stdout:7/121: mkdir d7/d26 0 2024-09-18T12:49:09.735 INFO:tasks.workunit.client.1.smithi148.stdout:8/362: read d8/d12/d46/f5a [682853,128715] 0 2024-09-18T12:49:09.735 INFO:tasks.workunit.client.1.smithi148.stdout:9/293: rmdir d8/da 39 2024-09-18T12:49:09.736 INFO:tasks.workunit.client.0.smithi078.stdout:2/216: read d4/dd/d18/f3c [37849,51977] 0 2024-09-18T12:49:09.737 INFO:tasks.workunit.client.0.smithi078.stdout:1/209: chown d0/d21/f36 56321508 1 2024-09-18T12:49:09.738 INFO:tasks.workunit.client.0.smithi078.stdout:3/167: symlink d9/d2a/l3b 0 2024-09-18T12:49:09.744 INFO:tasks.workunit.client.1.smithi148.stdout:7/294: symlink db/dc/df/d11/l54 0 2024-09-18T12:49:09.746 INFO:tasks.workunit.client.0.smithi078.stdout:8/229: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:49:09.746 INFO:tasks.workunit.client.0.smithi078.stdout:2/217: dwrite d4/f9 [4194304,4194304] 0 2024-09-18T12:49:09.747 INFO:tasks.workunit.client.1.smithi148.stdout:2/261: creat d9/d3a/f54 x:0 0 0 2024-09-18T12:49:09.749 INFO:tasks.workunit.client.0.smithi078.stdout:2/218: write d4/dd/f42 [856162,79805] 0 2024-09-18T12:49:09.749 INFO:tasks.workunit.client.0.smithi078.stdout:9/146: creat d5/d7/d8/d1c/d2a/f2e x:0 0 0 2024-09-18T12:49:09.750 INFO:tasks.workunit.client.0.smithi078.stdout:9/147: fdatasync d5/d7/f1e 0 2024-09-18T12:49:09.754 INFO:tasks.workunit.client.1.smithi148.stdout:8/363: creat d8/d16/d53/d39/d3b/d41/f78 x:0 0 0 2024-09-18T12:49:09.758 INFO:tasks.workunit.client.0.smithi078.stdout:9/148: dwrite d5/f15 [4194304,4194304] 0 2024-09-18T12:49:09.759 INFO:tasks.workunit.client.1.smithi148.stdout:3/275: mknod d4/d8/d20/c64 0 2024-09-18T12:49:09.759 INFO:tasks.workunit.client.0.smithi078.stdout:9/149: write d5/f17 [1155629,7937] 0 2024-09-18T12:49:09.760 INFO:tasks.workunit.client.1.smithi148.stdout:3/276: chown d4/d2d/d31/d60 5028 1 2024-09-18T12:49:09.762 INFO:tasks.workunit.client.0.smithi078.stdout:1/210: mknod d0/d8/da/c44 0 2024-09-18T12:49:09.763 INFO:tasks.workunit.client.0.smithi078.stdout:1/211: chown d0/d8/da/c27 6 1 2024-09-18T12:49:09.763 INFO:tasks.workunit.client.0.smithi078.stdout:1/212: fsync d0/d8/f38 0 2024-09-18T12:49:09.764 INFO:tasks.workunit.client.0.smithi078.stdout:1/213: write d0/d21/f36 [589455,21693] 0 2024-09-18T12:49:09.766 INFO:tasks.workunit.client.0.smithi078.stdout:5/269: creat d2/d4/d9/d49/f56 x:0 0 0 2024-09-18T12:49:09.768 INFO:tasks.workunit.client.1.smithi148.stdout:0/483: mknod de/d14/d6b/caa 0 2024-09-18T12:49:09.768 INFO:tasks.workunit.client.1.smithi148.stdout:0/484: readlink de/d14/l23 0 2024-09-18T12:49:09.769 INFO:tasks.workunit.client.1.smithi148.stdout:0/485: chown de/d14/c36 35746337 1 2024-09-18T12:49:09.770 INFO:tasks.workunit.client.1.smithi148.stdout:0/486: chown de/d27/f7b 1 1 2024-09-18T12:49:09.771 INFO:tasks.workunit.client.0.smithi078.stdout:6/304: rename d10/f25 to d10/d2b/d43/d53/f56 0 2024-09-18T12:49:09.771 INFO:tasks.workunit.client.1.smithi148.stdout:1/320: link dc/l2c dc/d18/d31/d39/l69 0 2024-09-18T12:49:09.774 INFO:tasks.workunit.client.1.smithi148.stdout:7/295: read db/dc/df/d11/f1b [270766,99108] 0 2024-09-18T12:49:09.774 INFO:tasks.workunit.client.0.smithi078.stdout:5/270: dwrite d2/d4/d9/d49/f4b [0,4194304] 0 2024-09-18T12:49:09.774 INFO:tasks.workunit.client.0.smithi078.stdout:4/155: creat d11/f38 x:0 0 0 2024-09-18T12:49:09.776 INFO:tasks.workunit.client.1.smithi148.stdout:2/262: creat d9/d3a/f55 x:0 0 0 2024-09-18T12:49:09.779 INFO:tasks.workunit.client.1.smithi148.stdout:7/296: dwrite fa [0,4194304] 0 2024-09-18T12:49:09.780 INFO:tasks.workunit.client.0.smithi078.stdout:2/219: symlink d4/l46 0 2024-09-18T12:49:09.784 INFO:tasks.workunit.client.1.smithi148.stdout:7/297: write db/dc/df/d11/f51 [810190,63777] 0 2024-09-18T12:49:09.785 INFO:tasks.workunit.client.1.smithi148.stdout:7/298: readlink db/dc/df/d11/l54 0 2024-09-18T12:49:09.785 INFO:tasks.workunit.client.1.smithi148.stdout:9/294: mkdir d8/da/d56 0 2024-09-18T12:49:09.785 INFO:tasks.workunit.client.0.smithi078.stdout:7/122: creat d7/d9/d14/d22/f27 x:0 0 0 2024-09-18T12:49:09.785 INFO:tasks.workunit.client.0.smithi078.stdout:7/123: write d7/d9/f10 [2296606,39422] 0 2024-09-18T12:49:09.787 INFO:tasks.workunit.client.0.smithi078.stdout:7/124: dread - d7/d9/d14/f25 zero size 2024-09-18T12:49:09.788 INFO:tasks.workunit.client.1.smithi148.stdout:6/359: creat d5/d1a/dc/f74 x:0 0 0 2024-09-18T12:49:09.789 INFO:tasks.workunit.client.1.smithi148.stdout:6/360: write d5/d1a/dc/f6d [990526,106202] 0 2024-09-18T12:49:09.790 INFO:tasks.workunit.client.1.smithi148.stdout:3/277: creat d4/d2d/d31/f65 x:0 0 0 2024-09-18T12:49:09.793 INFO:tasks.workunit.client.1.smithi148.stdout:4/280: getdents d15/d17 0 2024-09-18T12:49:09.796 INFO:tasks.workunit.client.1.smithi148.stdout:0/487: mkdir de/d14/d43/d70/d7f/dab 0 2024-09-18T12:49:09.796 INFO:tasks.workunit.client.1.smithi148.stdout:4/281: chown d15/d3f/f5a 330640664 1 2024-09-18T12:49:09.797 INFO:tasks.workunit.client.0.smithi078.stdout:1/214: mkdir d0/d8/da/d45 0 2024-09-18T12:49:09.798 INFO:tasks.workunit.client.1.smithi148.stdout:0/488: read - de/f55 zero size 2024-09-18T12:49:09.798 INFO:tasks.workunit.client.1.smithi148.stdout:1/321: rename dc/d11/d17/f5f to dc/d51/f6a 0 2024-09-18T12:49:09.800 INFO:tasks.workunit.client.1.smithi148.stdout:9/295: rename d8/da/dd to d8/da/dd/d4a/d49/d46/d57 22 2024-09-18T12:49:09.800 INFO:tasks.workunit.client.0.smithi078.stdout:3/168: rename d9/d2a to d9/d13/d33/d3c 0 2024-09-18T12:49:09.801 INFO:tasks.workunit.client.1.smithi148.stdout:3/278: dwrite d4/d8/d20/f26 [0,4194304] 0 2024-09-18T12:49:09.801 INFO:tasks.workunit.client.1.smithi148.stdout:6/361: dwrite d5/d1a/f6f [0,4194304] 0 2024-09-18T12:49:09.801 INFO:tasks.workunit.client.1.smithi148.stdout:9/296: chown c3 1064235443 1 2024-09-18T12:49:09.802 INFO:tasks.workunit.client.1.smithi148.stdout:0/489: dread - de/d14/d43/d57/f9c zero size 2024-09-18T12:49:09.804 INFO:tasks.workunit.client.1.smithi148.stdout:9/297: write f0 [4170257,116783] 0 2024-09-18T12:49:09.804 INFO:tasks.workunit.client.0.smithi078.stdout:4/156: creat d11/d1f/f39 x:0 0 0 2024-09-18T12:49:09.805 INFO:tasks.workunit.client.1.smithi148.stdout:2/263: symlink d9/d4a/l56 0 2024-09-18T12:49:09.805 INFO:tasks.workunit.client.1.smithi148.stdout:9/298: chown d8/c21 59195516 1 2024-09-18T12:49:09.805 INFO:tasks.workunit.client.0.smithi078.stdout:4/157: fsync d11/d1f/f2b 0 2024-09-18T12:49:09.806 INFO:tasks.workunit.client.0.smithi078.stdout:4/158: truncate d11/f38 110904 0 2024-09-18T12:49:09.807 INFO:tasks.workunit.client.1.smithi148.stdout:4/282: dread d15/d17/f1a [0,4194304] 0 2024-09-18T12:49:09.807 INFO:tasks.workunit.client.0.smithi078.stdout:0/292: creat d3/f6d x:0 0 0 2024-09-18T12:49:09.808 INFO:tasks.workunit.client.1.smithi148.stdout:5/355: getdents d7/d8/d18/d3f 0 2024-09-18T12:49:09.808 INFO:tasks.workunit.client.0.smithi078.stdout:4/159: dread d11/f29 [0,4194304] 0 2024-09-18T12:49:09.809 INFO:tasks.workunit.client.1.smithi148.stdout:7/299: mkdir db/dc/df/d2c/d55 0 2024-09-18T12:49:09.810 INFO:tasks.workunit.client.1.smithi148.stdout:5/356: stat d7/d8/dc/d12/d20/f53 0 2024-09-18T12:49:09.810 INFO:tasks.workunit.client.1.smithi148.stdout:5/357: stat d7/d2b/f36 0 2024-09-18T12:49:09.811 INFO:tasks.workunit.client.1.smithi148.stdout:5/358: rename d7 to d7/d8/dc/d12/d20/d74 22 2024-09-18T12:49:09.811 INFO:tasks.workunit.client.0.smithi078.stdout:5/271: fsync d2/d4/d9/da/f20 0 2024-09-18T12:49:09.812 INFO:tasks.workunit.client.0.smithi078.stdout:4/160: write d11/d27/f2f [954575,49433] 0 2024-09-18T12:49:09.812 INFO:tasks.workunit.client.1.smithi148.stdout:8/364: symlink d8/df/d3e/l79 0 2024-09-18T12:49:09.820 INFO:tasks.workunit.client.0.smithi078.stdout:8/230: creat d0/f47 x:0 0 0 2024-09-18T12:49:09.821 INFO:tasks.workunit.client.0.smithi078.stdout:3/169: fdatasync d9/d13/f1d 0 2024-09-18T12:49:09.824 INFO:tasks.workunit.client.1.smithi148.stdout:6/362: symlink d5/d32/d38/d50/l75 0 2024-09-18T12:49:09.824 INFO:tasks.workunit.client.1.smithi148.stdout:0/490: rmdir de/d27/d53/d89 39 2024-09-18T12:49:09.825 INFO:tasks.workunit.client.1.smithi148.stdout:0/491: chown de/f18 112 1 2024-09-18T12:49:09.826 INFO:tasks.workunit.client.1.smithi148.stdout:9/299: fsync d8/da/dd/d4a/f12 0 2024-09-18T12:49:09.826 INFO:tasks.workunit.client.0.smithi078.stdout:7/125: dread d7/fa [0,4194304] 0 2024-09-18T12:49:09.827 INFO:tasks.workunit.client.1.smithi148.stdout:0/492: chown de/d14/d43/d70/d7f/f9f 8050144 1 2024-09-18T12:49:09.828 INFO:tasks.workunit.client.1.smithi148.stdout:2/264: mkdir d9/d24/d31/d34/d57 0 2024-09-18T12:49:09.828 INFO:tasks.workunit.client.1.smithi148.stdout:6/363: dread d5/d1a/dc/f6d [0,4194304] 0 2024-09-18T12:49:09.829 INFO:tasks.workunit.client.1.smithi148.stdout:6/364: dread - d5/d1a/dc/d2b/d35/f72 zero size 2024-09-18T12:49:09.830 INFO:tasks.workunit.client.0.smithi078.stdout:0/293: write d3/d43/f69 [6263108,77226] 0 2024-09-18T12:49:09.831 INFO:tasks.workunit.client.1.smithi148.stdout:4/283: truncate d15/d17/d1f/d4c/d4f/f3d 882139 0 2024-09-18T12:49:09.831 INFO:tasks.workunit.client.1.smithi148.stdout:7/300: creat db/d52/d25/d2e/f56 x:0 0 0 2024-09-18T12:49:09.833 INFO:tasks.workunit.client.1.smithi148.stdout:8/365: creat d8/d16/f7a x:0 0 0 2024-09-18T12:49:09.835 INFO:tasks.workunit.client.0.smithi078.stdout:4/161: creat d11/d1f/f3a x:0 0 0 2024-09-18T12:49:09.836 INFO:tasks.workunit.client.1.smithi148.stdout:1/322: mknod dc/d11/d17/c6b 0 2024-09-18T12:49:09.837 INFO:tasks.workunit.client.0.smithi078.stdout:2/220: readlink d4/d8/l35 0 2024-09-18T12:49:09.837 INFO:tasks.workunit.client.1.smithi148.stdout:1/323: fdatasync dc/d11/f12 0 2024-09-18T12:49:09.837 INFO:tasks.workunit.client.1.smithi148.stdout:3/279: dread d4/d8/f35 [0,4194304] 0 2024-09-18T12:49:09.838 INFO:tasks.workunit.client.1.smithi148.stdout:1/324: stat dc/c14 0 2024-09-18T12:49:09.838 INFO:tasks.workunit.client.0.smithi078.stdout:6/305: truncate d10/f17 603379 0 2024-09-18T12:49:09.839 INFO:tasks.workunit.client.1.smithi148.stdout:9/300: creat d8/da/dd/d3f/f58 x:0 0 0 2024-09-18T12:49:09.840 INFO:tasks.workunit.client.0.smithi078.stdout:9/150: getdents d5 0 2024-09-18T12:49:09.840 INFO:tasks.workunit.client.1.smithi148.stdout:0/493: mkdir de/d14/d43/dac 0 2024-09-18T12:49:09.841 INFO:tasks.workunit.client.1.smithi148.stdout:0/494: chown de/d27/l72 407 1 2024-09-18T12:49:09.842 INFO:tasks.workunit.client.1.smithi148.stdout:2/265: creat d9/d24/f58 x:0 0 0 2024-09-18T12:49:09.842 INFO:tasks.workunit.client.0.smithi078.stdout:6/306: dread d10/d2b/d43/d53/d45/d55/f2d [0,4194304] 0 2024-09-18T12:49:09.843 INFO:tasks.workunit.client.1.smithi148.stdout:6/365: creat d5/d32/f76 x:0 0 0 2024-09-18T12:49:09.845 INFO:tasks.workunit.client.0.smithi078.stdout:3/170: rename d9/d13/d33/d3c/d19/f32 to d9/d2f/f3d 0 2024-09-18T12:49:09.846 INFO:tasks.workunit.client.1.smithi148.stdout:7/301: fsync db/dc/df/d11/f1b 0 2024-09-18T12:49:09.847 INFO:tasks.workunit.client.0.smithi078.stdout:7/126: rmdir d7/d9 39 2024-09-18T12:49:09.848 INFO:tasks.workunit.client.1.smithi148.stdout:8/366: rename d8/d16/c37 to d8/d16/d53/c7b 0 2024-09-18T12:49:09.848 INFO:tasks.workunit.client.0.smithi078.stdout:5/272: dread d2/d4/d12/d16/f27 [0,4194304] 0 2024-09-18T12:49:09.849 INFO:tasks.workunit.client.1.smithi148.stdout:4/284: dwrite d15/d17/d1f/d4c/d4f/f22 [0,4194304] 0 2024-09-18T12:49:09.849 INFO:tasks.workunit.client.0.smithi078.stdout:5/273: chown d2/fc 18825 1 2024-09-18T12:49:09.852 INFO:tasks.workunit.client.0.smithi078.stdout:0/294: rename d3/d43/f69 to d3/d43/f6e 0 2024-09-18T12:49:09.853 INFO:tasks.workunit.client.1.smithi148.stdout:4/285: dread fe [0,4194304] 0 2024-09-18T12:49:09.856 INFO:tasks.workunit.client.0.smithi078.stdout:4/162: symlink d11/d1f/l3b 0 2024-09-18T12:49:09.857 INFO:tasks.workunit.client.0.smithi078.stdout:4/163: dread - d11/f23 zero size 2024-09-18T12:49:09.857 INFO:tasks.workunit.client.0.smithi078.stdout:4/164: readlink l9 0 2024-09-18T12:49:09.858 INFO:tasks.workunit.client.1.smithi148.stdout:3/280: mknod d4/d2d/d31/c66 0 2024-09-18T12:49:09.859 INFO:tasks.workunit.client.1.smithi148.stdout:4/286: dwrite d15/d17/f36 [4194304,4194304] 0 2024-09-18T12:49:09.862 INFO:tasks.workunit.client.1.smithi148.stdout:9/301: dread d8/da/f4d [0,4194304] 0 2024-09-18T12:49:09.865 INFO:tasks.workunit.client.1.smithi148.stdout:2/266: stat d9/d17/d29 0 2024-09-18T12:49:09.866 INFO:tasks.workunit.client.0.smithi078.stdout:4/165: dwrite d11/d1f/f2b [8388608,4194304] 0 2024-09-18T12:49:09.866 INFO:tasks.workunit.client.0.smithi078.stdout:8/231: fsync d0/f14 0 2024-09-18T12:49:09.867 INFO:tasks.workunit.client.0.smithi078.stdout:4/166: chown d11/d1f/f3a 4 1 2024-09-18T12:49:09.867 INFO:tasks.workunit.client.1.smithi148.stdout:2/267: chown d9/d24/d31/d34/f35 1870355 1 2024-09-18T12:49:09.871 INFO:tasks.workunit.client.1.smithi148.stdout:5/359: write d7/d8/dc/d12/d1f/d25/d4b/f4c [435418,53045] 0 2024-09-18T12:49:09.872 INFO:tasks.workunit.client.1.smithi148.stdout:7/302: creat db/dc/df/d1d/f57 x:0 0 0 2024-09-18T12:49:09.873 INFO:tasks.workunit.client.1.smithi148.stdout:5/360: dread - d7/d2b/f36 zero size 2024-09-18T12:49:09.874 INFO:tasks.workunit.client.1.smithi148.stdout:9/302: dwrite d8/da/dd/f31 [0,4194304] 0 2024-09-18T12:49:09.885 INFO:tasks.workunit.client.1.smithi148.stdout:0/495: dwrite de/d14/d43/d70/d7f/f50 [0,4194304] 0 2024-09-18T12:49:09.889 INFO:tasks.workunit.client.1.smithi148.stdout:9/303: dread d8/da/dd/d4a/f12 [0,4194304] 0 2024-09-18T12:49:09.892 INFO:tasks.workunit.client.1.smithi148.stdout:2/268: dread d9/d24/f32 [0,4194304] 0 2024-09-18T12:49:09.899 INFO:tasks.workunit.client.1.smithi148.stdout:0/496: dread de/d14/f65 [0,4194304] 0 2024-09-18T12:49:09.900 INFO:tasks.workunit.client.1.smithi148.stdout:6/366: dread d5/d1a/dc/d2b/d35/d65/f5e [0,4194304] 0 2024-09-18T12:49:09.901 INFO:tasks.workunit.client.1.smithi148.stdout:6/367: chown d5/d32/d56/l51 75037 1 2024-09-18T12:49:09.906 INFO:tasks.workunit.client.0.smithi078.stdout:2/221: mknod d4/db/c47 0 2024-09-18T12:49:09.911 INFO:tasks.workunit.client.1.smithi148.stdout:4/287: creat d15/d3f/f5e x:0 0 0 2024-09-18T12:49:09.912 INFO:tasks.workunit.client.1.smithi148.stdout:8/367: write d8/d12/f1b [53795,96906] 0 2024-09-18T12:49:09.917 INFO:tasks.workunit.client.0.smithi078.stdout:1/215: getdents d0 0 2024-09-18T12:49:09.922 INFO:tasks.workunit.client.0.smithi078.stdout:4/167: creat d11/d1f/f3c x:0 0 0 2024-09-18T12:49:09.923 INFO:tasks.workunit.client.0.smithi078.stdout:4/168: write d11/d1f/f2d [904016,86511] 0 2024-09-18T12:49:09.925 INFO:tasks.workunit.client.0.smithi078.stdout:4/169: truncate d11/f16 5056783 0 2024-09-18T12:49:09.925 INFO:tasks.workunit.client.0.smithi078.stdout:6/307: symlink d10/d2b/l57 0 2024-09-18T12:49:09.928 INFO:tasks.workunit.client.0.smithi078.stdout:3/171: truncate d9/f12 1280038 0 2024-09-18T12:49:09.930 INFO:tasks.workunit.client.1.smithi148.stdout:7/303: creat db/dc/df/d1d/f58 x:0 0 0 2024-09-18T12:49:09.943 INFO:tasks.workunit.client.0.smithi078.stdout:1/216: mkdir d0/d8/da/d3e/d46 0 2024-09-18T12:49:09.944 INFO:tasks.workunit.client.1.smithi148.stdout:9/304: mkdir d8/da/dd/d35/d59 0 2024-09-18T12:49:09.951 INFO:tasks.workunit.client.0.smithi078.stdout:4/170: creat d11/d1f/d24/f3d x:0 0 0 2024-09-18T12:49:09.952 INFO:tasks.workunit.client.0.smithi078.stdout:4/171: stat d11/f1d 0 2024-09-18T12:49:09.953 INFO:tasks.workunit.client.0.smithi078.stdout:6/308: mknod d10/d2b/d43/c58 0 2024-09-18T12:49:09.956 INFO:tasks.workunit.client.0.smithi078.stdout:3/172: mknod d9/d13/c3e 0 2024-09-18T12:49:09.956 INFO:tasks.workunit.client.0.smithi078.stdout:4/172: dread d11/d27/f2f [0,4194304] 0 2024-09-18T12:49:09.957 INFO:tasks.workunit.client.0.smithi078.stdout:4/173: chown d11/d27 5836990 1 2024-09-18T12:49:09.958 INFO:tasks.workunit.client.1.smithi148.stdout:4/288: unlink d15/d17/d52/c54 0 2024-09-18T12:49:09.961 INFO:tasks.workunit.client.0.smithi078.stdout:7/127: link d7/f17 d7/f28 0 2024-09-18T12:49:09.964 INFO:tasks.workunit.client.0.smithi078.stdout:5/274: rename d2/d4/d9/d2f/c31 to d2/d4/c57 0 2024-09-18T12:49:09.965 INFO:tasks.workunit.client.0.smithi078.stdout:4/174: dwrite d11/d1f/f39 [0,4194304] 0 2024-09-18T12:49:09.967 INFO:tasks.workunit.client.0.smithi078.stdout:0/295: getdents d3/d1f/d2e/d4e 0 2024-09-18T12:49:09.968 INFO:tasks.workunit.client.0.smithi078.stdout:0/296: dread - d3/f6c zero size 2024-09-18T12:49:09.971 INFO:tasks.workunit.client.0.smithi078.stdout:2/222: fdatasync d4/dd/d18/f3c 0 2024-09-18T12:49:09.974 INFO:tasks.workunit.client.0.smithi078.stdout:1/217: fdatasync d0/d8/f3a 0 2024-09-18T12:49:09.975 INFO:tasks.workunit.client.1.smithi148.stdout:5/361: creat d7/d8/dc/d12/d31/d6c/f75 x:0 0 0 2024-09-18T12:49:09.979 INFO:tasks.workunit.client.0.smithi078.stdout:6/309: creat d10/d2b/d37/f59 x:0 0 0 2024-09-18T12:49:09.980 INFO:tasks.workunit.client.1.smithi148.stdout:1/325: rename dc/l24 to dc/d18/l6c 0 2024-09-18T12:49:09.981 INFO:tasks.workunit.client.0.smithi078.stdout:3/173: fsync d9/d2f/f3d 0 2024-09-18T12:49:09.982 INFO:tasks.workunit.client.1.smithi148.stdout:1/326: read dc/d18/f3d [1459972,21813] 0 2024-09-18T12:49:09.983 INFO:tasks.workunit.client.0.smithi078.stdout:7/128: fsync d7/d9/d14/f21 0 2024-09-18T12:49:09.984 INFO:tasks.workunit.client.1.smithi148.stdout:0/497: mknod de/d14/d43/dac/cad 0 2024-09-18T12:49:09.984 INFO:tasks.workunit.client.1.smithi148.stdout:8/368: mknod d8/d16/c7c 0 2024-09-18T12:49:09.985 INFO:tasks.workunit.client.1.smithi148.stdout:8/369: write d8/f62 [540270,22307] 0 2024-09-18T12:49:09.989 INFO:tasks.workunit.client.1.smithi148.stdout:7/304: mknod db/dc/df/d11/d34/c59 0 2024-09-18T12:49:09.989 INFO:tasks.workunit.client.1.smithi148.stdout:3/281: write d4/f6 [726715,9435] 0 2024-09-18T12:49:09.990 INFO:tasks.workunit.client.0.smithi078.stdout:4/175: creat d11/d27/f3e x:0 0 0 2024-09-18T12:49:09.990 INFO:tasks.workunit.client.1.smithi148.stdout:7/305: stat db/d52/d25/d38/c3d 0 2024-09-18T12:49:09.991 INFO:tasks.workunit.client.0.smithi078.stdout:4/176: write fb [1822772,19955] 0 2024-09-18T12:49:09.991 INFO:tasks.workunit.client.1.smithi148.stdout:3/282: write d4/d2d/d31/f65 [777590,86274] 0 2024-09-18T12:49:09.991 INFO:tasks.workunit.client.1.smithi148.stdout:5/362: mknod d7/d2b/c76 0 2024-09-18T12:49:09.992 INFO:tasks.workunit.client.0.smithi078.stdout:4/177: chown d11/d1f/d24 35 1 2024-09-18T12:49:09.992 INFO:tasks.workunit.client.0.smithi078.stdout:9/151: truncate d5/f15 2560660 0 2024-09-18T12:49:09.993 INFO:tasks.workunit.client.1.smithi148.stdout:9/305: symlink d8/da/dd/d4a/d49/d46/d54/l5a 0 2024-09-18T12:49:09.995 INFO:tasks.workunit.client.1.smithi148.stdout:9/306: write d8/da/dd/f1b [1190080,38822] 0 2024-09-18T12:49:09.999 INFO:tasks.workunit.client.1.smithi148.stdout:0/498: dread de/d27/f2b [0,4194304] 0 2024-09-18T12:49:10.000 INFO:tasks.workunit.client.0.smithi078.stdout:2/223: chown d4/l17 2984473 1 2024-09-18T12:49:10.005 INFO:tasks.workunit.client.0.smithi078.stdout:1/218: mkdir d0/d21/d47 0 2024-09-18T12:49:10.005 INFO:tasks.workunit.client.1.smithi148.stdout:4/289: dread d15/d17/d1f/d4c/d4f/f29 [0,4194304] 0 2024-09-18T12:49:10.016 INFO:tasks.workunit.client.1.smithi148.stdout:8/370: unlink d8/d16/d53/d39/c6b 0 2024-09-18T12:49:10.019 INFO:tasks.workunit.client.1.smithi148.stdout:5/363: mkdir d7/d8/dc/d12/d1f/d77 0 2024-09-18T12:49:10.021 INFO:tasks.workunit.client.0.smithi078.stdout:5/275: mkdir d2/d4/d58 0 2024-09-18T12:49:10.026 INFO:tasks.workunit.client.0.smithi078.stdout:2/224: creat d4/dd/d18/d33/f48 x:0 0 0 2024-09-18T12:49:10.028 INFO:tasks.workunit.client.1.smithi148.stdout:1/327: fdatasync dc/d18/d43/f4e 0 2024-09-18T12:49:10.031 INFO:tasks.workunit.client.1.smithi148.stdout:6/368: getdents d5/d32/d56 0 2024-09-18T12:49:10.032 INFO:tasks.workunit.client.0.smithi078.stdout:7/129: creat d7/d26/f29 x:0 0 0 2024-09-18T12:49:10.033 INFO:tasks.workunit.client.0.smithi078.stdout:7/130: chown d7 1084 1 2024-09-18T12:49:10.034 INFO:tasks.workunit.client.1.smithi148.stdout:8/371: creat d8/d12/d46/f7d x:0 0 0 2024-09-18T12:49:10.036 INFO:tasks.workunit.client.1.smithi148.stdout:5/364: truncate d7/d8/dc/f5d 163249 0 2024-09-18T12:49:10.037 INFO:tasks.workunit.client.0.smithi078.stdout:1/219: getdents d0/d8/da/d3e/d43 0 2024-09-18T12:49:10.038 INFO:tasks.workunit.client.0.smithi078.stdout:2/225: truncate d4/db/dc/f1b 5010587 0 2024-09-18T12:49:10.040 INFO:tasks.workunit.client.1.smithi148.stdout:9/307: symlink d8/l5b 0 2024-09-18T12:49:10.041 INFO:tasks.workunit.client.0.smithi078.stdout:7/131: creat d7/d26/f2a x:0 0 0 2024-09-18T12:49:10.043 INFO:tasks.workunit.client.1.smithi148.stdout:3/283: rename d4/f6 to d4/d2d/d31/d54/f67 0 2024-09-18T12:49:10.043 INFO:tasks.workunit.client.1.smithi148.stdout:3/284: stat d4/d2d/d31/f36 0 2024-09-18T12:49:10.044 INFO:tasks.workunit.client.1.smithi148.stdout:3/285: stat d4/d2d/d31/f3c 0 2024-09-18T12:49:10.044 INFO:tasks.workunit.client.1.smithi148.stdout:3/286: stat d4/d8/d20/d2b/l44 0 2024-09-18T12:49:10.045 INFO:tasks.workunit.client.0.smithi078.stdout:0/297: getdents d3 0 2024-09-18T12:49:10.048 INFO:tasks.workunit.client.0.smithi078.stdout:1/220: creat d0/d37/f48 x:0 0 0 2024-09-18T12:49:10.049 INFO:tasks.workunit.client.0.smithi078.stdout:1/221: chown d0/d8/f14 109 1 2024-09-18T12:49:10.049 INFO:tasks.workunit.client.1.smithi148.stdout:8/372: chown d8/d12/c5f 253094845 1 2024-09-18T12:49:10.050 INFO:tasks.workunit.client.0.smithi078.stdout:0/298: dread d3/d1f/f41 [0,4194304] 0 2024-09-18T12:49:10.050 INFO:tasks.workunit.client.0.smithi078.stdout:2/226: mknod d4/db/dc/c49 0 2024-09-18T12:49:10.051 INFO:tasks.workunit.client.0.smithi078.stdout:0/299: truncate d3/f4b 1016091 0 2024-09-18T12:49:10.052 INFO:tasks.workunit.client.1.smithi148.stdout:5/365: mknod d7/d8/dc/d22/c78 0 2024-09-18T12:49:10.052 INFO:tasks.workunit.client.0.smithi078.stdout:0/300: fsync d3/d1f/d2e/d4e/d37/f57 0 2024-09-18T12:49:10.056 INFO:tasks.workunit.client.0.smithi078.stdout:8/232: rename d0/f21 to d0/d7/dc/d1f/d23/f48 0 2024-09-18T12:49:10.058 INFO:tasks.workunit.client.0.smithi078.stdout:2/227: dwrite d4/dd/d18/d33/f48 [0,4194304] 0 2024-09-18T12:49:10.059 INFO:tasks.workunit.client.0.smithi078.stdout:1/222: unlink d0/d8/da/f1c 0 2024-09-18T12:49:10.060 INFO:tasks.workunit.client.1.smithi148.stdout:8/373: rmdir d8/d16/d53/d39/d3b/d4e 39 2024-09-18T12:49:10.062 INFO:tasks.workunit.client.1.smithi148.stdout:5/366: rename d7/d2b/f65 to d7/d8/dc/d22/f79 0 2024-09-18T12:49:10.063 INFO:tasks.workunit.client.0.smithi078.stdout:2/228: dread d4/db/f2a [0,4194304] 0 2024-09-18T12:49:10.067 INFO:tasks.workunit.client.1.smithi148.stdout:8/374: mkdir d8/d12/d46/d7e 0 2024-09-18T12:49:10.068 INFO:tasks.workunit.client.0.smithi078.stdout:9/152: rename d5/d7/d8/c13 to d5/c2f 0 2024-09-18T12:49:10.070 INFO:tasks.workunit.client.0.smithi078.stdout:8/233: mknod d0/d7/dc/d1f/d23/d29/d2e/c49 0 2024-09-18T12:49:10.071 INFO:tasks.workunit.client.1.smithi148.stdout:5/367: creat d7/d2b/f7a x:0 0 0 2024-09-18T12:49:10.072 INFO:tasks.workunit.client.1.smithi148.stdout:8/375: dwrite d8/f62 [0,4194304] 0 2024-09-18T12:49:10.072 INFO:tasks.workunit.client.0.smithi078.stdout:7/132: rename d7/d9/f12 to d7/d9/f2b 0 2024-09-18T12:49:10.074 INFO:tasks.workunit.client.1.smithi148.stdout:9/308: creat d8/f5c x:0 0 0 2024-09-18T12:49:10.075 INFO:tasks.workunit.client.0.smithi078.stdout:2/229: mknod d4/dd/d18/d3b/c4a 0 2024-09-18T12:49:10.075 INFO:tasks.workunit.client.1.smithi148.stdout:8/376: chown d8/d16/d53/d39/d3b/f63 1 1 2024-09-18T12:49:10.077 INFO:tasks.workunit.client.0.smithi078.stdout:4/178: rename d11/d1f/f3c to d11/d1f/d24/f3f 0 2024-09-18T12:49:10.077 INFO:tasks.workunit.client.1.smithi148.stdout:2/269: dwrite d9/fe [0,4194304] 0 2024-09-18T12:49:10.079 INFO:tasks.workunit.client.0.smithi078.stdout:4/179: dread - d11/d1f/d24/f3d zero size 2024-09-18T12:49:10.080 INFO:tasks.workunit.client.0.smithi078.stdout:4/180: stat d11/d27 0 2024-09-18T12:49:10.080 INFO:tasks.workunit.client.0.smithi078.stdout:9/153: creat d5/d7/d8/d1c/f30 x:0 0 0 2024-09-18T12:49:10.081 INFO:tasks.workunit.client.0.smithi078.stdout:3/174: creat d9/f3f x:0 0 0 2024-09-18T12:49:10.082 INFO:tasks.workunit.client.0.smithi078.stdout:7/133: dwrite d7/d9/d14/f25 [0,4194304] 0 2024-09-18T12:49:10.083 INFO:tasks.workunit.client.1.smithi148.stdout:5/368: creat d7/d8/dc/d12/d31/f7b x:0 0 0 2024-09-18T12:49:10.083 INFO:tasks.workunit.client.0.smithi078.stdout:4/181: chown d11/d27/f2f 0 1 2024-09-18T12:49:10.085 INFO:tasks.workunit.client.0.smithi078.stdout:4/182: dread - d11/d27/f3e zero size 2024-09-18T12:49:10.087 INFO:tasks.workunit.client.0.smithi078.stdout:4/183: chown d11/l2a 87696985 1 2024-09-18T12:49:10.088 INFO:tasks.workunit.client.0.smithi078.stdout:4/184: dread - d11/f23 zero size 2024-09-18T12:49:10.089 INFO:tasks.workunit.client.1.smithi148.stdout:9/309: unlink d8/c9 0 2024-09-18T12:49:10.091 INFO:tasks.workunit.client.1.smithi148.stdout:3/287: getdents d4/d2d/d31/d59 0 2024-09-18T12:49:10.095 INFO:tasks.workunit.client.1.smithi148.stdout:2/270: mknod d9/d17/d29/c59 0 2024-09-18T12:49:10.096 INFO:tasks.workunit.client.1.smithi148.stdout:2/271: write d9/d24/f25 [4693325,999] 0 2024-09-18T12:49:10.097 INFO:tasks.workunit.client.1.smithi148.stdout:4/290: mkdir d15/d5f 0 2024-09-18T12:49:10.097 INFO:tasks.workunit.client.0.smithi078.stdout:7/134: fsync d7/fa 0 2024-09-18T12:49:10.098 INFO:tasks.workunit.client.1.smithi148.stdout:2/272: read d9/d17/f4e [867355,51766] 0 2024-09-18T12:49:10.098 INFO:tasks.workunit.client.0.smithi078.stdout:2/230: dwrite d4/f9 [0,4194304] 0 2024-09-18T12:49:10.098 INFO:tasks.workunit.client.1.smithi148.stdout:4/291: chown d15/d17/d1f/d4c/d4f/d34 7 1 2024-09-18T12:49:10.099 INFO:tasks.workunit.client.1.smithi148.stdout:4/292: write d15/d17/d1f/d4c/d4f/f3d [1397212,103935] 0 2024-09-18T12:49:10.100 INFO:tasks.workunit.client.0.smithi078.stdout:8/234: creat d0/d7/dc/d1f/d23/d44/f4a x:0 0 0 2024-09-18T12:49:10.101 INFO:tasks.workunit.client.0.smithi078.stdout:7/135: truncate d7/d9/d14/d22/f27 78466 0 2024-09-18T12:49:10.102 INFO:tasks.workunit.client.1.smithi148.stdout:9/310: rename d8/da/dd/d3f/d4b to d8/da/dd/d3f/d5d 0 2024-09-18T12:49:10.104 INFO:tasks.workunit.client.0.smithi078.stdout:8/235: truncate d0/d7/dc/d1f/f28 306408 0 2024-09-18T12:49:10.104 INFO:tasks.workunit.client.0.smithi078.stdout:7/136: truncate d7/d9/d14/f21 350549 0 2024-09-18T12:49:10.105 INFO:tasks.workunit.client.0.smithi078.stdout:7/137: dread - d7/f1d zero size 2024-09-18T12:49:10.105 INFO:tasks.workunit.client.0.smithi078.stdout:9/154: creat d5/d7/d8/d1c/f31 x:0 0 0 2024-09-18T12:49:10.105 INFO:tasks.workunit.client.1.smithi148.stdout:3/288: symlink d4/d2d/d31/d46/l68 0 2024-09-18T12:49:10.106 INFO:tasks.workunit.client.1.smithi148.stdout:7/306: write db/dc/df/d11/f1b [1148225,15881] 0 2024-09-18T12:49:10.109 INFO:tasks.workunit.client.1.smithi148.stdout:8/377: mknod d8/c7f 0 2024-09-18T12:49:10.110 INFO:tasks.workunit.client.0.smithi078.stdout:9/155: dread d5/d7/d8/f27 [0,4194304] 0 2024-09-18T12:49:10.110 INFO:tasks.workunit.client.1.smithi148.stdout:8/378: truncate d8/d16/d53/d39/d3b/f6a 826385 0 2024-09-18T12:49:10.111 INFO:tasks.workunit.client.0.smithi078.stdout:9/156: chown d5/d7/d8/f27 1781 1 2024-09-18T12:49:10.114 INFO:tasks.workunit.client.0.smithi078.stdout:8/236: mkdir d0/d7/d1e/d4b 0 2024-09-18T12:49:10.115 INFO:tasks.workunit.client.1.smithi148.stdout:2/273: rmdir d9/d24/d31/d34 39 2024-09-18T12:49:10.116 INFO:tasks.workunit.client.0.smithi078.stdout:6/310: truncate d10/f21 2394919 0 2024-09-18T12:49:10.117 INFO:tasks.workunit.client.0.smithi078.stdout:8/237: write d0/d7/dc/d1f/d23/d29/f3b [3483826,14848] 0 2024-09-18T12:49:10.119 INFO:tasks.workunit.client.0.smithi078.stdout:6/311: truncate d10/d2b/d43/d53/d45/d55/f4f 533551 0 2024-09-18T12:49:10.120 INFO:tasks.workunit.client.0.smithi078.stdout:3/175: rename d9/d29/c1f to d9/d2f/c40 0 2024-09-18T12:49:10.120 INFO:tasks.workunit.client.0.smithi078.stdout:6/312: stat d10/d2b/d43/d53/d45/d55/d3f 0 2024-09-18T12:49:10.126 INFO:tasks.workunit.client.1.smithi148.stdout:9/311: fdatasync d8/da/f4d 0 2024-09-18T12:49:10.127 INFO:tasks.workunit.client.1.smithi148.stdout:9/312: read d8/da/dd/f40 [7576092,104295] 0 2024-09-18T12:49:10.127 INFO:tasks.workunit.client.0.smithi078.stdout:5/276: dwrite d2/d4/d12/d16/f27 [0,4194304] 0 2024-09-18T12:49:10.128 INFO:tasks.workunit.client.1.smithi148.stdout:9/313: chown d8/da/dd/d35/d47/d4e 506 1 2024-09-18T12:49:10.128 INFO:tasks.workunit.client.1.smithi148.stdout:9/314: fdatasync d8/da/dd/d4a/f12 0 2024-09-18T12:49:10.131 INFO:tasks.workunit.client.1.smithi148.stdout:1/328: truncate f6 3090829 0 2024-09-18T12:49:10.132 INFO:tasks.workunit.client.0.smithi078.stdout:8/238: mkdir d0/d39/d4c 0 2024-09-18T12:49:10.133 INFO:tasks.workunit.client.0.smithi078.stdout:5/277: dread d2/d4/d9/f2a [0,4194304] 0 2024-09-18T12:49:10.134 INFO:tasks.workunit.client.1.smithi148.stdout:8/379: creat d8/d16/f80 x:0 0 0 2024-09-18T12:49:10.137 INFO:tasks.workunit.client.0.smithi078.stdout:6/313: rmdir d10/d2b/d37 39 2024-09-18T12:49:10.141 INFO:tasks.workunit.client.1.smithi148.stdout:4/293: mknod d15/d17/d1f/d4c/d4f/c60 0 2024-09-18T12:49:10.144 INFO:tasks.workunit.client.0.smithi078.stdout:6/314: dwrite f3 [0,4194304] 0 2024-09-18T12:49:10.146 INFO:tasks.workunit.client.0.smithi078.stdout:6/315: truncate d10/d2b/d43/d53/d45/d55/f38 589788 0 2024-09-18T12:49:10.147 INFO:tasks.workunit.client.0.smithi078.stdout:8/239: creat d0/d7/f4d x:0 0 0 2024-09-18T12:49:10.147 INFO:tasks.workunit.client.0.smithi078.stdout:6/316: readlink l5 0 2024-09-18T12:49:10.147 INFO:tasks.workunit.client.1.smithi148.stdout:3/289: symlink d4/d8/d20/d2b/d43/d61/l69 0 2024-09-18T12:49:10.148 INFO:tasks.workunit.client.1.smithi148.stdout:3/290: write d4/d2d/f4a [2646409,78749] 0 2024-09-18T12:49:10.148 INFO:tasks.workunit.client.0.smithi078.stdout:5/278: creat d2/d4/d9/d2f/d30/f59 x:0 0 0 2024-09-18T12:49:10.149 INFO:tasks.workunit.client.0.smithi078.stdout:5/279: chown d2/d4/d12/d2d/f42 118575104 1 2024-09-18T12:49:10.151 INFO:tasks.workunit.client.0.smithi078.stdout:7/138: unlink d7/d9/f2b 0 2024-09-18T12:49:10.153 INFO:tasks.workunit.client.1.smithi148.stdout:7/307: fdatasync db/dc/df/d11/f53 0 2024-09-18T12:49:10.154 INFO:tasks.workunit.client.1.smithi148.stdout:7/308: chown db/d52/c1c 5387 1 2024-09-18T12:49:10.154 INFO:tasks.workunit.client.1.smithi148.stdout:7/309: stat db/dc/df/d11/f1b 0 2024-09-18T12:49:10.155 INFO:tasks.workunit.client.1.smithi148.stdout:7/310: read fa [6493344,82209] 0 2024-09-18T12:49:10.155 INFO:tasks.workunit.client.0.smithi078.stdout:4/185: getdents d11/d1f 0 2024-09-18T12:49:10.156 INFO:tasks.workunit.client.1.smithi148.stdout:1/329: creat dc/d18/d31/d4b/f6d x:0 0 0 2024-09-18T12:49:10.157 INFO:tasks.workunit.client.0.smithi078.stdout:4/186: write d11/f16 [3627283,53028] 0 2024-09-18T12:49:10.157 INFO:tasks.workunit.client.1.smithi148.stdout:1/330: truncate dc/d11/f30 908619 0 2024-09-18T12:49:10.158 INFO:tasks.workunit.client.0.smithi078.stdout:7/139: dread d7/d9/d14/f25 [0,4194304] 0 2024-09-18T12:49:10.159 INFO:tasks.workunit.client.1.smithi148.stdout:8/380: symlink d8/d16/l81 0 2024-09-18T12:49:10.159 INFO:tasks.workunit.client.0.smithi078.stdout:7/140: chown d7/d9/d14/f23 18394715 1 2024-09-18T12:49:10.163 INFO:tasks.workunit.client.1.smithi148.stdout:4/294: stat d15/d17/d1f/d4c/d4f/f33 0 2024-09-18T12:49:10.165 INFO:tasks.workunit.client.1.smithi148.stdout:4/295: dread d15/d3f/f55 [0,4194304] 0 2024-09-18T12:49:10.167 INFO:tasks.workunit.client.0.smithi078.stdout:7/141: dwrite d7/d9/f10 [0,4194304] 0 2024-09-18T12:49:10.169 INFO:tasks.workunit.client.0.smithi078.stdout:7/142: truncate d7/d9/f1f 94467 0 2024-09-18T12:49:10.170 INFO:tasks.workunit.client.0.smithi078.stdout:7/143: readlink l1 0 2024-09-18T12:49:10.171 INFO:tasks.workunit.client.0.smithi078.stdout:4/187: unlink d11/l18 0 2024-09-18T12:49:10.173 INFO:tasks.workunit.client.1.smithi148.stdout:9/315: fdatasync d8/da/dd/f14 0 2024-09-18T12:49:10.174 INFO:tasks.workunit.client.1.smithi148.stdout:9/316: fsync d8/da/f1d 0 2024-09-18T12:49:10.175 INFO:tasks.workunit.client.0.smithi078.stdout:9/157: rename d5/d7/d8/d1c to d5/d7/d32 0 2024-09-18T12:49:10.175 INFO:tasks.workunit.client.1.smithi148.stdout:0/499: sync 2024-09-18T12:49:10.176 INFO:tasks.workunit.client.0.smithi078.stdout:9/158: dread - d5/d7/d32/d2a/f2d zero size 2024-09-18T12:49:10.177 INFO:tasks.workunit.client.0.smithi078.stdout:9/159: fdatasync d5/d7/fc 0 2024-09-18T12:49:10.180 INFO:tasks.workunit.client.1.smithi148.stdout:7/311: creat db/dc/df/d11/d34/f5a x:0 0 0 2024-09-18T12:49:10.181 INFO:tasks.workunit.client.1.smithi148.stdout:1/331: creat dc/d11/f6e x:0 0 0 2024-09-18T12:49:10.183 INFO:tasks.workunit.client.1.smithi148.stdout:1/332: fdatasync dc/d18/d31/d4b/f6d 0 2024-09-18T12:49:10.185 INFO:tasks.workunit.client.0.smithi078.stdout:4/188: rmdir d11/d1f/d24 39 2024-09-18T12:49:10.186 INFO:tasks.workunit.client.1.smithi148.stdout:5/369: dwrite d7/fd [0,4194304] 0 2024-09-18T12:49:10.186 INFO:tasks.workunit.client.1.smithi148.stdout:8/381: dread d8/d16/d53/d39/d3b/d41/f4c [0,4194304] 0 2024-09-18T12:49:10.188 INFO:tasks.workunit.client.0.smithi078.stdout:2/231: truncate d4/db/f1c 582904 0 2024-09-18T12:49:10.188 INFO:tasks.workunit.client.1.smithi148.stdout:2/274: creat d9/d24/d31/f5a x:0 0 0 2024-09-18T12:49:10.189 INFO:tasks.workunit.client.0.smithi078.stdout:9/160: creat d5/d7/d8/f33 x:0 0 0 2024-09-18T12:49:10.190 INFO:tasks.workunit.client.0.smithi078.stdout:3/176: read d9/f12 [166522,124706] 0 2024-09-18T12:49:10.191 INFO:tasks.workunit.client.0.smithi078.stdout:3/177: chown d9/df/l2e 8 1 2024-09-18T12:49:10.191 INFO:tasks.workunit.client.0.smithi078.stdout:7/144: mknod d7/c2c 0 2024-09-18T12:49:10.192 INFO:tasks.workunit.client.1.smithi148.stdout:3/291: mkdir d4/d8/d6a 0 2024-09-18T12:49:10.197 INFO:tasks.workunit.client.0.smithi078.stdout:7/145: mknod d7/d26/c2d 0 2024-09-18T12:49:10.197 INFO:tasks.workunit.client.0.smithi078.stdout:7/146: chown d7/d26/f29 71854139 1 2024-09-18T12:49:10.198 INFO:tasks.workunit.client.1.smithi148.stdout:0/500: creat de/d27/fae x:0 0 0 2024-09-18T12:49:10.200 INFO:tasks.workunit.client.1.smithi148.stdout:3/292: read d4/d2d/d31/f3c [31432,112581] 0 2024-09-18T12:49:10.203 INFO:tasks.workunit.client.0.smithi078.stdout:6/317: rename l5 to d10/l5a 0 2024-09-18T12:49:10.205 INFO:tasks.workunit.client.0.smithi078.stdout:4/189: dwrite d11/d1f/d24/f3f [0,4194304] 0 2024-09-18T12:49:10.206 INFO:tasks.workunit.client.0.smithi078.stdout:6/318: write d10/d2b/d43/d53/d45/d55/f38 [516039,97556] 0 2024-09-18T12:49:10.208 INFO:tasks.workunit.client.1.smithi148.stdout:7/312: dread db/dc/df/d11/f47 [0,4194304] 0 2024-09-18T12:49:10.210 INFO:tasks.workunit.client.0.smithi078.stdout:7/147: unlink d7/d9/d14/f21 0 2024-09-18T12:49:10.213 INFO:tasks.workunit.client.0.smithi078.stdout:5/280: dwrite d2/d4/d9/da/f20 [0,4194304] 0 2024-09-18T12:49:10.215 INFO:tasks.workunit.client.0.smithi078.stdout:3/178: rename d9/df/d11/l1c to d9/d13/d33/d3c/l41 0 2024-09-18T12:49:10.217 INFO:tasks.workunit.client.1.smithi148.stdout:5/370: mkdir d7/d8/d18/d3f/d7c 0 2024-09-18T12:49:10.217 INFO:tasks.workunit.client.1.smithi148.stdout:5/371: readlink d7/d8/dc/d12/l26 0 2024-09-18T12:49:10.222 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:09 smithi148 ceph-mon[35352]: pgmap v12: 65 pgs: 65 active+clean; 866 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.3 MiB/s rd, 95 MiB/s wr, 274 op/s 2024-09-18T12:49:10.224 INFO:tasks.workunit.client.1.smithi148.stdout:5/372: dwrite d7/d8/dc/d12/d1f/d25/f54 [0,4194304] 0 2024-09-18T12:49:10.226 INFO:tasks.workunit.client.0.smithi078.stdout:7/148: fsync d7/d9/d14/f25 0 2024-09-18T12:49:10.227 INFO:tasks.workunit.client.0.smithi078.stdout:7/149: fsync d7/d9/f1f 0 2024-09-18T12:49:10.230 INFO:tasks.workunit.client.0.smithi078.stdout:5/281: creat d2/d4/d9/da/f5a x:0 0 0 2024-09-18T12:49:10.233 INFO:tasks.workunit.client.1.smithi148.stdout:5/373: dwrite d7/f1b [4194304,4194304] 0 2024-09-18T12:49:10.234 INFO:tasks.workunit.client.0.smithi078.stdout:9/161: getdents d5/d7/d32 0 2024-09-18T12:49:10.236 INFO:tasks.workunit.client.0.smithi078.stdout:9/162: chown d5/d7/d32 120975449 1 2024-09-18T12:49:10.236 INFO:tasks.workunit.client.1.smithi148.stdout:4/296: dwrite d15/d17/f47 [0,4194304] 0 2024-09-18T12:49:10.237 INFO:tasks.workunit.client.0.smithi078.stdout:4/190: mkdir d11/d1f/d40 0 2024-09-18T12:49:10.238 INFO:tasks.workunit.client.0.smithi078.stdout:9/163: fsync d5/d7/f2b 0 2024-09-18T12:49:10.238 INFO:tasks.workunit.client.1.smithi148.stdout:1/333: creat dc/d11/d38/f6f x:0 0 0 2024-09-18T12:49:10.240 INFO:tasks.workunit.client.0.smithi078.stdout:5/282: dwrite d2/d4/d9/d49/f56 [0,4194304] 0 2024-09-18T12:49:10.241 INFO:tasks.workunit.client.0.smithi078.stdout:3/179: dread d9/df/d11/f1b [4194304,4194304] 0 2024-09-18T12:49:10.241 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:09 smithi078 ceph-mon[28091]: pgmap v12: 65 pgs: 65 active+clean; 866 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.3 MiB/s rd, 95 MiB/s wr, 274 op/s 2024-09-18T12:49:10.244 INFO:tasks.workunit.client.1.smithi148.stdout:5/374: dread d7/d8/dc/d22/f5f [0,4194304] 0 2024-09-18T12:49:10.244 INFO:tasks.workunit.client.1.smithi148.stdout:9/317: dwrite d8/f25 [0,4194304] 0 2024-09-18T12:49:10.244 INFO:tasks.workunit.client.1.smithi148.stdout:8/382: truncate d8/df/f10 3295704 0 2024-09-18T12:49:10.245 INFO:tasks.workunit.client.1.smithi148.stdout:8/383: chown d8/d16/l61 37910 1 2024-09-18T12:49:10.246 INFO:tasks.workunit.client.1.smithi148.stdout:5/375: write d7/d8/f68 [497941,46516] 0 2024-09-18T12:49:10.251 INFO:tasks.workunit.client.0.smithi078.stdout:3/180: dread d9/df/d11/f1b [4194304,4194304] 0 2024-09-18T12:49:10.262 INFO:tasks.workunit.client.1.smithi148.stdout:3/293: write d4/d8/f24 [4231185,44792] 0 2024-09-18T12:49:10.266 INFO:tasks.workunit.client.0.smithi078.stdout:6/319: truncate f3 1194131 0 2024-09-18T12:49:10.270 INFO:tasks.workunit.client.1.smithi148.stdout:8/384: mkdir d8/df/d3e/d82 0 2024-09-18T12:49:10.270 INFO:tasks.workunit.client.1.smithi148.stdout:1/334: dread dc/f25 [0,4194304] 0 2024-09-18T12:49:10.271 INFO:tasks.workunit.client.1.smithi148.stdout:9/318: mkdir d8/da/dd/d35/d5e 0 2024-09-18T12:49:10.273 INFO:tasks.workunit.client.0.smithi078.stdout:4/191: creat d11/d1f/d40/f41 x:0 0 0 2024-09-18T12:49:10.275 INFO:tasks.workunit.client.0.smithi078.stdout:4/192: truncate d11/d1f/d40/f41 9918 0 2024-09-18T12:49:10.276 INFO:tasks.workunit.client.1.smithi148.stdout:3/294: rmdir d4/d8 39 2024-09-18T12:49:10.277 INFO:tasks.workunit.client.1.smithi148.stdout:1/335: dwrite dc/f10 [4194304,4194304] 0 2024-09-18T12:49:10.279 INFO:tasks.workunit.client.0.smithi078.stdout:8/240: dwrite d0/d7/dc/d1f/d23/f25 [0,4194304] 0 2024-09-18T12:49:10.282 INFO:tasks.workunit.client.1.smithi148.stdout:1/336: dread dc/d11/f53 [0,4194304] 0 2024-09-18T12:49:10.282 INFO:tasks.workunit.client.0.smithi078.stdout:3/181: rename d9/d13/d33/d3c/l41 to d9/d13/d33/d34/l42 0 2024-09-18T12:49:10.282 INFO:tasks.workunit.client.0.smithi078.stdout:9/164: getdents d5/d7/d32 0 2024-09-18T12:49:10.282 INFO:tasks.workunit.client.0.smithi078.stdout:9/165: readlink d5/d7/l2c 0 2024-09-18T12:49:10.283 INFO:tasks.workunit.client.0.smithi078.stdout:9/166: chown f3 11624 1 2024-09-18T12:49:10.284 INFO:tasks.workunit.client.1.smithi148.stdout:0/501: rename de/d27/d2e/c88 to de/d14/caf 0 2024-09-18T12:49:10.284 INFO:tasks.workunit.client.1.smithi148.stdout:7/313: truncate db/d52/d25/d38/f3f 761391 0 2024-09-18T12:49:10.285 INFO:tasks.workunit.client.0.smithi078.stdout:4/193: read d11/f12 [2322802,22584] 0 2024-09-18T12:49:10.286 INFO:tasks.workunit.client.1.smithi148.stdout:7/314: truncate db/d52/d1f/f4d 203712 0 2024-09-18T12:49:10.289 INFO:tasks.workunit.client.0.smithi078.stdout:7/150: truncate d7/d9/f10 2282157 0 2024-09-18T12:49:10.292 INFO:tasks.workunit.client.0.smithi078.stdout:6/320: truncate d10/f17 1190455 0 2024-09-18T12:49:10.294 INFO:tasks.workunit.client.0.smithi078.stdout:9/167: rmdir d5/d7 39 2024-09-18T12:49:10.294 INFO:tasks.workunit.client.0.smithi078.stdout:3/182: dread d9/d13/f39 [0,4194304] 0 2024-09-18T12:49:10.295 INFO:tasks.workunit.client.1.smithi148.stdout:6/369: sync 2024-09-18T12:49:10.295 INFO:tasks.workunit.client.1.smithi148.stdout:9/319: symlink d8/l5f 0 2024-09-18T12:49:10.296 INFO:tasks.workunit.client.1.smithi148.stdout:9/320: truncate d8/da/fb 8423029 0 2024-09-18T12:49:10.297 INFO:tasks.workunit.client.0.smithi078.stdout:4/194: unlink fb 0 2024-09-18T12:49:10.298 INFO:tasks.workunit.client.1.smithi148.stdout:1/337: creat dc/d51/f70 x:0 0 0 2024-09-18T12:49:10.298 INFO:tasks.workunit.client.0.smithi078.stdout:5/283: getdents d2/d4/d9/da/d2b/d3e 0 2024-09-18T12:49:10.298 INFO:tasks.workunit.client.0.smithi078.stdout:8/241: dread d0/d7/dc/f3c [0,4194304] 0 2024-09-18T12:49:10.302 INFO:tasks.workunit.client.0.smithi078.stdout:6/321: symlink d10/d2b/d43/d53/d45/l5b 0 2024-09-18T12:49:10.303 INFO:tasks.workunit.client.1.smithi148.stdout:7/315: mknod db/d52/d1f/c5b 0 2024-09-18T12:49:10.304 INFO:tasks.workunit.client.1.smithi148.stdout:1/338: dread dc/d18/d31/d39/f40 [0,4194304] 0 2024-09-18T12:49:10.305 INFO:tasks.workunit.client.1.smithi148.stdout:4/297: getdents d15 0 2024-09-18T12:49:10.306 INFO:tasks.workunit.client.0.smithi078.stdout:3/183: mkdir d9/d2f/d43 0 2024-09-18T12:49:10.306 INFO:tasks.workunit.client.0.smithi078.stdout:8/242: dwrite d0/d7/dc/d1f/d23/d29/f37 [0,4194304] 0 2024-09-18T12:49:10.307 INFO:tasks.workunit.client.1.smithi148.stdout:6/370: dread d5/d32/d38/d50/f52 [0,4194304] 0 2024-09-18T12:49:10.307 INFO:tasks.workunit.client.0.smithi078.stdout:8/243: fdatasync d0/d7/dc/f26 0 2024-09-18T12:49:10.308 INFO:tasks.workunit.client.0.smithi078.stdout:8/244: dread - d0/d7/dc/d1f/f45 zero size 2024-09-18T12:49:10.311 INFO:tasks.workunit.client.1.smithi148.stdout:0/502: dread de/d14/d43/d70/d7f/f61 [0,4194304] 0 2024-09-18T12:49:10.361 INFO:tasks.workunit.client.1.smithi148.stdout:2/275: sync 2024-09-18T12:49:10.378 INFO:tasks.workunit.client.0.smithi078.stdout:4/195: mkdir d11/d1f/d24/d42 0 2024-09-18T12:49:10.380 INFO:tasks.workunit.client.0.smithi078.stdout:5/284: mknod d2/c5b 0 2024-09-18T12:49:10.381 INFO:tasks.workunit.client.0.smithi078.stdout:5/285: write d2/d4/f4f [514490,83830] 0 2024-09-18T12:49:10.382 INFO:tasks.workunit.client.1.smithi148.stdout:9/321: dread d8/da/dd/d4a/f3a [0,4194304] 0 2024-09-18T12:49:10.387 INFO:tasks.workunit.client.1.smithi148.stdout:8/385: rename d8/l18 to d8/d16/d53/d39/d3b/d41/l83 0 2024-09-18T12:49:10.388 INFO:tasks.workunit.client.0.smithi078.stdout:8/245: write d0/d7/dc/d1f/d23/f25 [4645705,90432] 0 2024-09-18T12:49:10.388 INFO:tasks.workunit.client.0.smithi078.stdout:9/168: chown d5/d7/d8/f1a 102 1 2024-09-18T12:49:10.389 INFO:tasks.workunit.client.1.smithi148.stdout:8/386: dread d8/d16/d53/d39/d3b/f6a [0,4194304] 0 2024-09-18T12:49:10.389 INFO:tasks.workunit.client.0.smithi078.stdout:8/246: write d0/d7/dc/f3f [159227,120297] 0 2024-09-18T12:49:10.390 INFO:tasks.workunit.client.0.smithi078.stdout:9/169: write d5/d7/d32/f24 [32055,34109] 0 2024-09-18T12:49:10.390 INFO:tasks.workunit.client.0.smithi078.stdout:6/322: write d10/d2b/d43/d53/d45/d55/f2d [1527703,78199] 0 2024-09-18T12:49:10.392 INFO:tasks.workunit.client.0.smithi078.stdout:9/170: write d5/d7/d8/f14 [2354159,16689] 0 2024-09-18T12:49:10.392 INFO:tasks.workunit.client.1.smithi148.stdout:7/316: unlink db/d52/f1a 0 2024-09-18T12:49:10.394 INFO:tasks.workunit.client.0.smithi078.stdout:6/323: truncate d10/d2b/d43/d53/d45/f46 535852 0 2024-09-18T12:49:10.400 INFO:tasks.workunit.client.1.smithi148.stdout:5/376: sync 2024-09-18T12:49:10.400 INFO:tasks.workunit.client.1.smithi148.stdout:7/317: dwrite db/dc/df/d1d/f58 [0,4194304] 0 2024-09-18T12:49:10.400 INFO:tasks.workunit.client.1.smithi148.stdout:5/377: chown d7/d8/dc/d12/d1f/d77 13838006 1 2024-09-18T12:49:10.400 INFO:tasks.workunit.client.1.smithi148.stdout:7/318: fsync db/dc/df/d1d/f57 0 2024-09-18T12:49:10.401 INFO:tasks.workunit.client.1.smithi148.stdout:5/378: stat d7/d8 0 2024-09-18T12:49:10.401 INFO:tasks.workunit.client.1.smithi148.stdout:7/319: readlink db/l22 0 2024-09-18T12:49:10.401 INFO:tasks.workunit.client.0.smithi078.stdout:4/196: rmdir d11/d1f/d40 39 2024-09-18T12:49:10.404 INFO:tasks.workunit.client.0.smithi078.stdout:5/286: creat d2/d4/d12/d16/d36/f5c x:0 0 0 2024-09-18T12:49:10.405 INFO:tasks.workunit.client.0.smithi078.stdout:7/151: dwrite d7/f17 [0,4194304] 0 2024-09-18T12:49:10.405 INFO:tasks.workunit.client.1.smithi148.stdout:8/387: dread d8/d16/d53/d39/f3d [0,4194304] 0 2024-09-18T12:49:10.409 INFO:tasks.workunit.client.0.smithi078.stdout:8/247: dread d0/d7/f22 [0,4194304] 0 2024-09-18T12:49:10.409 INFO:tasks.workunit.client.1.smithi148.stdout:3/295: rename d4/d2d to d4/d8/d1e/d6b 0 2024-09-18T12:49:10.410 INFO:tasks.workunit.client.0.smithi078.stdout:7/152: dread f5 [0,4194304] 0 2024-09-18T12:49:10.418 INFO:tasks.workunit.client.1.smithi148.stdout:6/371: getdents d5/d32/d56 0 2024-09-18T12:49:10.419 INFO:tasks.workunit.client.0.smithi078.stdout:4/197: stat d11/d1f/d40 0 2024-09-18T12:49:10.420 INFO:tasks.workunit.client.1.smithi148.stdout:0/503: mkdir de/d14/d43/d70/d7f/dab/db0 0 2024-09-18T12:49:10.421 INFO:tasks.workunit.client.1.smithi148.stdout:2/276: symlink d9/l5b 0 2024-09-18T12:49:10.422 INFO:tasks.workunit.client.1.smithi148.stdout:7/320: write db/d52/d25/f48 [1751072,69929] 0 2024-09-18T12:49:10.423 INFO:tasks.workunit.client.0.smithi078.stdout:3/184: dwrite d9/d13/d33/d3c/d19/f1e [0,4194304] 0 2024-09-18T12:49:10.424 INFO:tasks.workunit.client.1.smithi148.stdout:9/322: mknod d8/da/dd/d35/d59/c60 0 2024-09-18T12:49:10.425 INFO:tasks.workunit.client.0.smithi078.stdout:3/185: readlink l3 0 2024-09-18T12:49:10.425 INFO:tasks.workunit.client.0.smithi078.stdout:3/186: dread - d9/d2f/f38 zero size 2024-09-18T12:49:10.427 INFO:tasks.workunit.client.1.smithi148.stdout:3/296: mknod d4/d8/d1e/d6b/d31/d46/c6c 0 2024-09-18T12:49:10.429 INFO:tasks.workunit.client.1.smithi148.stdout:9/323: dwrite d8/da/dd/f31 [0,4194304] 0 2024-09-18T12:49:10.430 INFO:tasks.workunit.client.1.smithi148.stdout:9/324: chown d8/da/dd/d4a/d49/d46/d54 100933164 1 2024-09-18T12:49:10.431 INFO:tasks.workunit.client.0.smithi078.stdout:6/324: fdatasync fb 0 2024-09-18T12:49:10.435 INFO:tasks.workunit.client.1.smithi148.stdout:6/372: creat d5/d1a/d29/d5c/f77 x:0 0 0 2024-09-18T12:49:10.435 INFO:tasks.workunit.client.0.smithi078.stdout:9/171: write d5/d7/d8/fd [2629844,119771] 0 2024-09-18T12:49:10.437 INFO:tasks.workunit.client.1.smithi148.stdout:0/504: dread - de/d27/d53/d89/fa8 zero size 2024-09-18T12:49:10.438 INFO:tasks.workunit.client.1.smithi148.stdout:0/505: fsync de/f4f 0 2024-09-18T12:49:10.438 INFO:tasks.workunit.client.0.smithi078.stdout:5/287: mknod d2/d4/c5d 0 2024-09-18T12:49:10.438 INFO:tasks.workunit.client.1.smithi148.stdout:0/506: stat de/d27/fae 0 2024-09-18T12:49:10.440 INFO:tasks.workunit.client.0.smithi078.stdout:6/325: dwrite d10/d2b/f44 [0,4194304] 0 2024-09-18T12:49:10.443 INFO:tasks.workunit.client.0.smithi078.stdout:6/326: dread d10/d2b/d43/d53/d45/f46 [0,4194304] 0 2024-09-18T12:49:10.444 INFO:tasks.workunit.client.0.smithi078.stdout:9/172: dread d5/d7/d8/f14 [0,4194304] 0 2024-09-18T12:49:10.444 INFO:tasks.workunit.client.0.smithi078.stdout:3/187: mknod d9/d29/c44 0 2024-09-18T12:49:10.446 INFO:tasks.workunit.client.0.smithi078.stdout:3/188: write d9/f3f [971562,62253] 0 2024-09-18T12:49:10.447 INFO:tasks.workunit.client.1.smithi148.stdout:4/298: getdents d15/d17/d52 0 2024-09-18T12:49:10.449 INFO:tasks.workunit.client.0.smithi078.stdout:9/173: dread d5/d7/d8/f14 [0,4194304] 0 2024-09-18T12:49:10.451 INFO:tasks.workunit.client.0.smithi078.stdout:7/153: rename d7/c1c to d7/c2e 0 2024-09-18T12:49:10.452 INFO:tasks.workunit.client.0.smithi078.stdout:7/154: write d7/d9/f13 [555501,98146] 0 2024-09-18T12:49:10.452 INFO:tasks.workunit.client.0.smithi078.stdout:7/155: readlink l1 0 2024-09-18T12:49:10.454 INFO:tasks.workunit.client.1.smithi148.stdout:7/321: link db/dc/df/d1d/f57 db/dc/df/d1d/f5c 0 2024-09-18T12:49:10.455 INFO:tasks.workunit.client.0.smithi078.stdout:6/327: mknod d10/d2b/d43/d53/c5c 0 2024-09-18T12:49:10.456 INFO:tasks.workunit.client.0.smithi078.stdout:6/328: rename d10/d2b to d10/d2b/d43/d53/d5d 22 2024-09-18T12:49:10.458 INFO:tasks.workunit.client.1.smithi148.stdout:3/297: truncate d4/d8/d20/f3d 1721484 0 2024-09-18T12:49:10.459 INFO:tasks.workunit.client.1.smithi148.stdout:3/298: truncate d4/d8/d1e/d6b/f4d 137389 0 2024-09-18T12:49:10.460 INFO:tasks.workunit.client.1.smithi148.stdout:3/299: chown d4/d8/d20/d2b/d43/d61/l69 9075254 1 2024-09-18T12:49:10.461 INFO:tasks.workunit.client.1.smithi148.stdout:9/325: truncate d8/d33/f42 152291 0 2024-09-18T12:49:10.461 INFO:tasks.workunit.client.1.smithi148.stdout:9/326: readlink d8/da/dd/d4a/d49/d46/d54/l5a 0 2024-09-18T12:49:10.462 INFO:tasks.workunit.client.0.smithi078.stdout:9/174: mknod d5/d7/d32/c34 0 2024-09-18T12:49:10.463 INFO:tasks.workunit.client.0.smithi078.stdout:8/248: truncate d0/d7/dc/d1f/d23/f25 4707524 0 2024-09-18T12:49:10.464 INFO:tasks.workunit.client.1.smithi148.stdout:0/507: dread de/d27/d2e/f73 [0,4194304] 0 2024-09-18T12:49:10.465 INFO:tasks.workunit.client.1.smithi148.stdout:0/508: read - de/d14/d43/d57/f9c zero size 2024-09-18T12:49:10.467 INFO:tasks.workunit.client.1.smithi148.stdout:6/373: dread d5/d1a/f21 [0,4194304] 0 2024-09-18T12:49:10.469 INFO:tasks.workunit.client.1.smithi148.stdout:1/339: rename dc/d11/d17/l37 to dc/d18/l71 0 2024-09-18T12:49:10.469 INFO:tasks.workunit.client.0.smithi078.stdout:9/175: dwrite d5/f17 [0,4194304] 0 2024-09-18T12:49:10.471 INFO:tasks.workunit.client.1.smithi148.stdout:0/509: dwrite de/d14/d43/d57/f6f [0,4194304] 0 2024-09-18T12:49:10.472 INFO:tasks.workunit.client.0.smithi078.stdout:5/288: dwrite d2/d4/d12/d16/d36/f41 [0,4194304] 0 2024-09-18T12:49:10.477 INFO:tasks.workunit.client.0.smithi078.stdout:6/329: mknod d10/c5e 0 2024-09-18T12:49:10.480 INFO:tasks.workunit.client.1.smithi148.stdout:7/322: mknod db/dc/df/d1d/d41/c5d 0 2024-09-18T12:49:10.482 INFO:tasks.workunit.client.0.smithi078.stdout:6/330: write d10/d2b/d43/d53/d45/d55/f2d [1636909,35929] 0 2024-09-18T12:49:10.482 INFO:tasks.workunit.client.0.smithi078.stdout:8/249: dwrite d0/d7/f27 [0,4194304] 0 2024-09-18T12:49:10.483 INFO:tasks.workunit.client.0.smithi078.stdout:9/176: creat d5/d7/d8/f35 x:0 0 0 2024-09-18T12:49:10.483 INFO:tasks.workunit.client.1.smithi148.stdout:7/323: write db/dc/df/d11/f1b [781563,88944] 0 2024-09-18T12:49:10.483 INFO:tasks.workunit.client.1.smithi148.stdout:5/379: sync 2024-09-18T12:49:10.485 INFO:tasks.workunit.client.1.smithi148.stdout:6/374: creat d5/d32/d56/f78 x:0 0 0 2024-09-18T12:49:10.486 INFO:tasks.workunit.client.0.smithi078.stdout:9/177: chown d5/d7/d32/d2a/f2d 5 1 2024-09-18T12:49:10.486 INFO:tasks.workunit.client.0.smithi078.stdout:5/289: symlink d2/d4/d48/l5e 0 2024-09-18T12:49:10.487 INFO:tasks.workunit.client.0.smithi078.stdout:9/178: chown d5/d7/d32/f31 4537555 1 2024-09-18T12:49:10.490 INFO:tasks.workunit.client.0.smithi078.stdout:7/156: creat d7/d9/f2f x:0 0 0 2024-09-18T12:49:10.493 INFO:tasks.workunit.client.1.smithi148.stdout:1/340: mkdir dc/d11/d38/d72 0 2024-09-18T12:49:10.494 INFO:tasks.workunit.client.0.smithi078.stdout:3/189: link d9/c16 d9/d13/d33/c45 0 2024-09-18T12:49:10.495 INFO:tasks.workunit.client.1.smithi148.stdout:3/300: mknod d4/d8/c6d 0 2024-09-18T12:49:10.495 INFO:tasks.workunit.client.0.smithi078.stdout:9/179: dwrite f0 [0,4194304] 0 2024-09-18T12:49:10.496 INFO:tasks.workunit.client.1.smithi148.stdout:9/327: symlink d8/da/dd/d35/d47/d4e/l61 0 2024-09-18T12:49:10.500 INFO:tasks.workunit.client.0.smithi078.stdout:6/331: creat d10/d2b/d43/d53/d45/d55/d3f/f5f x:0 0 0 2024-09-18T12:49:10.506 INFO:tasks.workunit.client.1.smithi148.stdout:6/375: mkdir d5/d79 0 2024-09-18T12:49:10.509 INFO:tasks.workunit.client.1.smithi148.stdout:8/388: rename c6 to d8/d16/d53/d39/d3b/d41/c84 0 2024-09-18T12:49:10.511 INFO:tasks.workunit.client.0.smithi078.stdout:3/190: rmdir d9 39 2024-09-18T12:49:10.512 INFO:tasks.workunit.client.1.smithi148.stdout:7/324: dread db/dc/df/f35 [0,4194304] 0 2024-09-18T12:49:10.517 INFO:tasks.workunit.client.0.smithi078.stdout:6/332: rename d10/d2b/d43/d53/d45/d55/f38 to d10/d2b/d43/f60 0 2024-09-18T12:49:10.522 INFO:tasks.workunit.client.1.smithi148.stdout:5/380: mkdir d7/d8/d18/d3f/d7c/d7d 0 2024-09-18T12:49:10.523 INFO:tasks.workunit.client.1.smithi148.stdout:5/381: read d7/d8/f59 [866773,126801] 0 2024-09-18T12:49:10.525 INFO:tasks.workunit.client.1.smithi148.stdout:5/382: stat d7/d8/dc/d12/d1f/d39/l6b 0 2024-09-18T12:49:10.526 INFO:tasks.workunit.client.1.smithi148.stdout:9/328: dread d8/d33/f34 [0,4194304] 0 2024-09-18T12:49:10.526 INFO:tasks.workunit.client.1.smithi148.stdout:2/277: rename d9/d24/d31/d34/l4f to d9/d24/l5c 0 2024-09-18T12:49:10.527 INFO:tasks.workunit.client.0.smithi078.stdout:8/250: dwrite d0/d7/f22 [0,4194304] 0 2024-09-18T12:49:10.530 INFO:tasks.workunit.client.0.smithi078.stdout:5/290: dwrite d2/d4/f1e [0,4194304] 0 2024-09-18T12:49:10.532 INFO:tasks.workunit.client.0.smithi078.stdout:5/291: fdatasync d2/d4/d9/f1c 0 2024-09-18T12:49:10.533 INFO:tasks.workunit.client.0.smithi078.stdout:7/157: dwrite f5 [0,4194304] 0 2024-09-18T12:49:10.533 INFO:tasks.workunit.client.0.smithi078.stdout:9/180: write f3 [390099,90708] 0 2024-09-18T12:49:10.534 INFO:tasks.workunit.client.1.smithi148.stdout:2/278: dwrite d9/d3a/f52 [0,4194304] 0 2024-09-18T12:49:10.535 INFO:tasks.workunit.client.0.smithi078.stdout:9/181: read - d5/d7/d32/f30 zero size 2024-09-18T12:49:10.541 INFO:tasks.workunit.client.0.smithi078.stdout:7/158: dread d7/f28 [0,4194304] 0 2024-09-18T12:49:10.542 INFO:tasks.workunit.client.1.smithi148.stdout:3/301: creat d4/d8/d1e/d6b/d31/d60/f6e x:0 0 0 2024-09-18T12:49:10.543 INFO:tasks.workunit.client.0.smithi078.stdout:6/333: mkdir d10/d2b/d61 0 2024-09-18T12:49:10.544 INFO:tasks.workunit.client.1.smithi148.stdout:4/299: link d15/d17/d1f/d4c/d4f/f26 d15/d17/d1f/d4c/d4f/f61 0 2024-09-18T12:49:10.546 INFO:tasks.workunit.client.1.smithi148.stdout:8/389: write d8/d16/d53/d39/f3d [1747870,27609] 0 2024-09-18T12:49:10.546 INFO:tasks.workunit.client.0.smithi078.stdout:9/182: dwrite d5/d7/f1e [0,4194304] 0 2024-09-18T12:49:10.551 INFO:tasks.workunit.client.1.smithi148.stdout:9/329: unlink d8/da/dd/l3d 0 2024-09-18T12:49:10.553 INFO:tasks.workunit.client.1.smithi148.stdout:6/376: write d5/d32/d38/f54 [693094,26652] 0 2024-09-18T12:49:10.553 INFO:tasks.workunit.client.0.smithi078.stdout:3/191: dwrite d9/d29/f24 [0,4194304] 0 2024-09-18T12:49:10.555 INFO:tasks.workunit.client.1.smithi148.stdout:0/510: rename de/d14/d43/f5f to de/d14/d43/d57/fb1 0 2024-09-18T12:49:10.556 INFO:tasks.workunit.client.1.smithi148.stdout:0/511: chown ld 2754 1 2024-09-18T12:49:10.559 INFO:tasks.workunit.client.1.smithi148.stdout:1/341: dwrite dc/d11/d17/f3c [0,4194304] 0 2024-09-18T12:49:10.560 INFO:tasks.workunit.client.0.smithi078.stdout:3/192: dread d9/d13/f39 [0,4194304] 0 2024-09-18T12:49:10.560 INFO:tasks.workunit.client.0.smithi078.stdout:7/159: creat d7/d26/f30 x:0 0 0 2024-09-18T12:49:10.562 INFO:tasks.workunit.client.0.smithi078.stdout:3/193: truncate d9/d29/f24 5161472 0 2024-09-18T12:49:10.563 INFO:tasks.workunit.client.0.smithi078.stdout:8/251: mkdir d0/d4e 0 2024-09-18T12:49:10.563 INFO:tasks.workunit.client.1.smithi148.stdout:3/302: mknod d4/d8/d1e/c6f 0 2024-09-18T12:49:10.564 INFO:tasks.workunit.client.0.smithi078.stdout:9/183: mkdir d5/d7/d32/d2a/d36 0 2024-09-18T12:49:10.567 INFO:tasks.workunit.client.1.smithi148.stdout:8/390: mknod d8/d16/d53/d39/d3b/d41/c85 0 2024-09-18T12:49:10.570 INFO:tasks.workunit.client.1.smithi148.stdout:5/383: rename d7/d8/dc/d22/l72 to d7/d8/dc/d12/d1f/d77/l7e 0 2024-09-18T12:49:10.572 INFO:tasks.workunit.client.1.smithi148.stdout:0/512: mknod de/d14/d43/dac/cb2 0 2024-09-18T12:49:10.572 INFO:tasks.workunit.client.0.smithi078.stdout:7/160: symlink d7/d26/l31 0 2024-09-18T12:49:10.573 INFO:tasks.workunit.client.0.smithi078.stdout:7/161: chown d7/d26/f2a 4 1 2024-09-18T12:49:10.573 INFO:tasks.workunit.client.0.smithi078.stdout:3/194: fsync d9/d13/f39 0 2024-09-18T12:49:10.575 INFO:tasks.workunit.client.1.smithi148.stdout:8/391: creat d8/d16/d53/d39/f86 x:0 0 0 2024-09-18T12:49:10.576 INFO:tasks.workunit.client.1.smithi148.stdout:7/325: dread db/dc/f12 [0,4194304] 0 2024-09-18T12:49:10.576 INFO:tasks.workunit.client.1.smithi148.stdout:1/342: dread dc/d11/f53 [0,4194304] 0 2024-09-18T12:49:10.577 INFO:tasks.workunit.client.1.smithi148.stdout:6/377: chown d5/d1a/dc/c2a 757048 1 2024-09-18T12:49:10.577 INFO:tasks.workunit.client.1.smithi148.stdout:1/343: chown dc/f10 243 1 2024-09-18T12:49:10.578 INFO:tasks.workunit.client.1.smithi148.stdout:7/326: truncate db/dc/df/d11/d34/f5a 136712 0 2024-09-18T12:49:10.579 INFO:tasks.workunit.client.0.smithi078.stdout:9/184: creat d5/d7/d32/d2a/d36/f37 x:0 0 0 2024-09-18T12:49:10.579 INFO:tasks.workunit.client.1.smithi148.stdout:5/384: mknod d7/d8/d18/c7f 0 2024-09-18T12:49:10.580 INFO:tasks.workunit.client.0.smithi078.stdout:7/162: dwrite d7/d9/fe [0,4194304] 0 2024-09-18T12:49:10.582 INFO:tasks.workunit.client.0.smithi078.stdout:7/163: write d7/d9/d14/d22/f27 [993060,37578] 0 2024-09-18T12:49:10.583 INFO:tasks.workunit.client.0.smithi078.stdout:3/195: rename d9/c16 to d9/df/c46 0 2024-09-18T12:49:10.584 INFO:tasks.workunit.client.0.smithi078.stdout:8/252: getdents d0/d7/dc/d1f/d23/d29 0 2024-09-18T12:49:10.587 INFO:tasks.workunit.client.1.smithi148.stdout:1/344: unlink dc/d4d/l55 0 2024-09-18T12:49:10.589 INFO:tasks.workunit.client.1.smithi148.stdout:7/327: creat db/dc/df/d2c/f5e x:0 0 0 2024-09-18T12:49:10.589 INFO:tasks.workunit.client.0.smithi078.stdout:3/196: dread d9/df/d11/f1b [4194304,4194304] 0 2024-09-18T12:49:10.590 INFO:tasks.workunit.client.0.smithi078.stdout:7/164: mkdir d7/d9/d32 0 2024-09-18T12:49:10.591 INFO:tasks.workunit.client.1.smithi148.stdout:5/385: mknod d7/d8/dc/d12/d1f/c80 0 2024-09-18T12:49:10.593 INFO:tasks.workunit.client.0.smithi078.stdout:8/253: dwrite d0/d7/dc/d1f/f28 [0,4194304] 0 2024-09-18T12:49:10.595 INFO:tasks.workunit.client.0.smithi078.stdout:8/254: write d0/d7/dc/d1f/d23/f48 [1184799,87422] 0 2024-09-18T12:49:10.597 INFO:tasks.workunit.client.0.smithi078.stdout:8/255: dread - d0/d7/dc/d1f/d23/d44/f4a zero size 2024-09-18T12:49:10.598 INFO:tasks.workunit.client.1.smithi148.stdout:8/392: link d8/df/f73 d8/d16/d53/d39/f87 0 2024-09-18T12:49:10.599 INFO:tasks.workunit.client.0.smithi078.stdout:3/197: symlink d9/d13/l47 0 2024-09-18T12:49:10.604 INFO:tasks.workunit.client.1.smithi148.stdout:2/279: rename d9/f4d to d9/d17/f5d 0 2024-09-18T12:49:10.606 INFO:tasks.workunit.client.0.smithi078.stdout:6/334: dwrite d10/d2b/d43/d53/f56 [0,4194304] 0 2024-09-18T12:49:10.609 INFO:tasks.workunit.client.0.smithi078.stdout:3/198: fsync d9/f12 0 2024-09-18T12:49:10.609 INFO:tasks.workunit.client.1.smithi148.stdout:5/386: creat d7/d2b/f81 x:0 0 0 2024-09-18T12:49:10.610 INFO:tasks.workunit.client.1.smithi148.stdout:4/300: dwrite d15/d17/f1a [0,4194304] 0 2024-09-18T12:49:10.612 INFO:tasks.workunit.client.0.smithi078.stdout:7/165: creat d7/f33 x:0 0 0 2024-09-18T12:49:10.612 INFO:tasks.workunit.client.0.smithi078.stdout:3/199: write d9/f3f [1466588,81466] 0 2024-09-18T12:49:10.613 INFO:tasks.workunit.client.0.smithi078.stdout:5/292: truncate d2/d4/d9/da/f19 328839 0 2024-09-18T12:49:10.613 INFO:tasks.workunit.client.1.smithi148.stdout:3/303: getdents d4/d8/d1e/d6b/d31/d54 0 2024-09-18T12:49:10.616 INFO:tasks.workunit.client.0.smithi078.stdout:8/256: symlink d0/d4e/l4f 0 2024-09-18T12:49:10.616 INFO:tasks.workunit.client.0.smithi078.stdout:6/335: dwrite d10/d2b/d43/d53/f56 [0,4194304] 0 2024-09-18T12:49:10.617 INFO:tasks.workunit.client.1.smithi148.stdout:8/393: mkdir d8/df/d3e/d88 0 2024-09-18T12:49:10.617 INFO:tasks.workunit.client.0.smithi078.stdout:3/200: chown d9/f3f 5 1 2024-09-18T12:49:10.620 INFO:tasks.workunit.client.0.smithi078.stdout:5/293: readlink d2/d4/d9/lb 0 2024-09-18T12:49:10.622 INFO:tasks.workunit.client.0.smithi078.stdout:6/336: dread d10/d2b/d43/d53/d45/d55/f4f [0,4194304] 0 2024-09-18T12:49:10.623 INFO:tasks.workunit.client.0.smithi078.stdout:5/294: write d2/d4/f33 [4032374,2768] 0 2024-09-18T12:49:10.625 INFO:tasks.workunit.client.0.smithi078.stdout:5/295: fdatasync d2/d4/f1d 0 2024-09-18T12:49:10.625 INFO:tasks.workunit.client.1.smithi148.stdout:0/513: write de/d27/f2b [1441078,8723] 0 2024-09-18T12:49:10.626 INFO:tasks.workunit.client.1.smithi148.stdout:0/514: stat de/f32 0 2024-09-18T12:49:10.626 INFO:tasks.workunit.client.0.smithi078.stdout:5/296: stat d2/d4/d12/d16/f21 0 2024-09-18T12:49:10.628 INFO:tasks.workunit.client.0.smithi078.stdout:5/297: chown d2/d4/d9/da/d2b/d3e/f53 7870 1 2024-09-18T12:49:10.628 INFO:tasks.workunit.client.1.smithi148.stdout:9/330: rename d8/d2f to d8/da/dd/d35/d47/d62 0 2024-09-18T12:49:10.629 INFO:tasks.workunit.client.1.smithi148.stdout:9/331: write d8/da/fb [6012380,70] 0 2024-09-18T12:49:10.631 INFO:tasks.workunit.client.1.smithi148.stdout:1/345: creat dc/d11/d38/d72/f73 x:0 0 0 2024-09-18T12:49:10.632 INFO:tasks.workunit.client.0.smithi078.stdout:3/201: rmdir d9/d13/d33/d34 39 2024-09-18T12:49:10.633 INFO:tasks.workunit.client.0.smithi078.stdout:3/202: dread - d9/df/d11/f25 zero size 2024-09-18T12:49:10.633 INFO:tasks.workunit.client.1.smithi148.stdout:7/328: mkdir db/dc/df/d5f 0 2024-09-18T12:49:10.635 INFO:tasks.workunit.client.1.smithi148.stdout:4/301: readlink d15/d17/d1f/l56 0 2024-09-18T12:49:10.636 INFO:tasks.workunit.client.1.smithi148.stdout:4/302: write f0 [2427771,48242] 0 2024-09-18T12:49:10.638 INFO:tasks.workunit.client.1.smithi148.stdout:5/387: mknod d7/d8/dc/d12/d1f/d69/c82 0 2024-09-18T12:49:10.639 INFO:tasks.workunit.client.1.smithi148.stdout:7/329: dread db/dc/df/d11/f53 [0,4194304] 0 2024-09-18T12:49:10.640 INFO:tasks.workunit.client.0.smithi078.stdout:6/337: truncate ff 165014 0 2024-09-18T12:49:10.641 INFO:tasks.workunit.client.1.smithi148.stdout:8/394: chown d8/d16/d27/f76 202291 1 2024-09-18T12:49:10.643 INFO:tasks.workunit.client.1.smithi148.stdout:6/378: getdents d5/d1a/d29 0 2024-09-18T12:49:10.643 INFO:tasks.workunit.client.1.smithi148.stdout:0/515: truncate fa 67846 0 2024-09-18T12:49:10.644 INFO:tasks.workunit.client.1.smithi148.stdout:0/516: write de/d14/f83 [261918,79204] 0 2024-09-18T12:49:10.645 INFO:tasks.workunit.client.1.smithi148.stdout:2/280: rename d9/d17/d29/f3b to d9/d24/d47/f5e 0 2024-09-18T12:49:10.650 INFO:tasks.workunit.client.1.smithi148.stdout:9/332: creat d8/da/dd/d4a/d49/f63 x:0 0 0 2024-09-18T12:49:10.653 INFO:tasks.workunit.client.1.smithi148.stdout:1/346: dread - dc/d11/d17/f35 zero size 2024-09-18T12:49:10.655 INFO:tasks.workunit.client.0.smithi078.stdout:6/338: rename d10/d2b/d43/d53/d45/f46 to d10/d2b/d43/d53/d45/f62 0 2024-09-18T12:49:10.661 INFO:tasks.workunit.client.1.smithi148.stdout:3/304: mknod d4/d8/d1e/d63/c70 0 2024-09-18T12:49:10.661 INFO:tasks.workunit.client.1.smithi148.stdout:5/388: dread d7/d8/f9 [0,4194304] 0 2024-09-18T12:49:10.662 INFO:tasks.workunit.client.0.smithi078.stdout:3/203: rename d9/df/d11/f1b to d9/d13/d33/d34/f48 0 2024-09-18T12:49:10.665 INFO:tasks.workunit.client.0.smithi078.stdout:6/339: mkdir d10/d2b/d43/d53/d63 0 2024-09-18T12:49:10.666 INFO:tasks.workunit.client.0.smithi078.stdout:6/340: write d10/f1c [596696,45807] 0 2024-09-18T12:49:10.669 INFO:tasks.workunit.client.0.smithi078.stdout:7/166: getdents d7/d9 0 2024-09-18T12:49:10.670 INFO:tasks.workunit.client.0.smithi078.stdout:3/204: creat d9/d13/d33/d3c/d19/f49 x:0 0 0 2024-09-18T12:49:10.671 INFO:tasks.workunit.client.1.smithi148.stdout:0/517: mkdir de/d27/db3 0 2024-09-18T12:49:10.672 INFO:tasks.workunit.client.0.smithi078.stdout:8/257: truncate d0/d7/dc/d1f/d23/d29/d2e/f3a 2211179 0 2024-09-18T12:49:10.673 INFO:tasks.workunit.client.0.smithi078.stdout:8/258: chown d0/d7/dc/f26 3227061 1 2024-09-18T12:49:10.674 INFO:tasks.workunit.client.0.smithi078.stdout:7/167: stat d7/d9/cd 0 2024-09-18T12:49:10.675 INFO:tasks.workunit.client.0.smithi078.stdout:5/298: truncate d2/d4/d9/d49/f56 3731135 0 2024-09-18T12:49:10.677 INFO:tasks.workunit.client.0.smithi078.stdout:5/299: write d2/d4/d12/d16/d36/f41 [4220054,117549] 0 2024-09-18T12:49:10.678 INFO:tasks.workunit.client.1.smithi148.stdout:9/333: mknod d8/da/dd/d35/d47/d62/c64 0 2024-09-18T12:49:10.681 INFO:tasks.workunit.client.0.smithi078.stdout:6/341: fsync d10/d2b/d43/d53/d45/f62 0 2024-09-18T12:49:10.682 INFO:tasks.workunit.client.1.smithi148.stdout:3/305: creat d4/d8/d20/d2b/f71 x:0 0 0 2024-09-18T12:49:10.684 INFO:tasks.workunit.client.1.smithi148.stdout:0/518: dread de/d14/f47 [0,4194304] 0 2024-09-18T12:49:10.685 INFO:tasks.workunit.client.1.smithi148.stdout:0/519: chown de/d14/d43/d70/d7f/f54 0 1 2024-09-18T12:49:10.686 INFO:tasks.workunit.client.1.smithi148.stdout:0/520: dread - de/d14/d43/d57/d59/f5c zero size 2024-09-18T12:49:10.687 INFO:tasks.workunit.client.0.smithi078.stdout:3/205: rename d9/d13/d33/c45 to d9/d2f/c4a 0 2024-09-18T12:49:10.688 INFO:tasks.workunit.client.1.smithi148.stdout:8/395: creat d8/d12/d46/d7e/f89 x:0 0 0 2024-09-18T12:49:10.690 INFO:tasks.workunit.client.0.smithi078.stdout:5/300: creat d2/d4/d9/d2f/d30/f5f x:0 0 0 2024-09-18T12:49:10.693 INFO:tasks.workunit.client.0.smithi078.stdout:8/259: mkdir d0/d7/d1e/d50 0 2024-09-18T12:49:10.695 INFO:tasks.workunit.client.1.smithi148.stdout:2/281: symlink d9/d17/l5f 0 2024-09-18T12:49:10.696 INFO:tasks.workunit.client.1.smithi148.stdout:9/334: mkdir d8/da/dd/d65 0 2024-09-18T12:49:10.697 INFO:tasks.workunit.client.0.smithi078.stdout:6/342: creat d10/d2b/d43/f64 x:0 0 0 2024-09-18T12:49:10.698 INFO:tasks.workunit.client.1.smithi148.stdout:7/330: write db/d52/d25/d38/f3f [829877,35769] 0 2024-09-18T12:49:10.698 INFO:tasks.workunit.client.1.smithi148.stdout:1/347: symlink dc/d11/d17/l74 0 2024-09-18T12:49:10.699 INFO:tasks.workunit.client.0.smithi078.stdout:6/343: chown d10/d2b/d43/d53/d45/d55/l33 9110262 1 2024-09-18T12:49:10.701 INFO:tasks.workunit.client.0.smithi078.stdout:5/301: mkdir d2/d4/d9/da/d60 0 2024-09-18T12:49:10.703 INFO:tasks.workunit.client.1.smithi148.stdout:3/306: creat d4/d8/d1e/d6b/d31/d46/f72 x:0 0 0 2024-09-18T12:49:10.704 INFO:tasks.workunit.client.1.smithi148.stdout:3/307: write d4/d8/d20/f3f [48588,110669] 0 2024-09-18T12:49:10.706 INFO:tasks.workunit.client.1.smithi148.stdout:0/521: symlink de/d27/d53/d89/lb4 0 2024-09-18T12:49:10.708 INFO:tasks.workunit.client.1.smithi148.stdout:8/396: unlink d8/d16/f80 0 2024-09-18T12:49:10.711 INFO:tasks.workunit.client.1.smithi148.stdout:4/303: rename d15/d17/d52/c59 to d15/d17/d1f/d4c/d4f/c62 0 2024-09-18T12:49:10.713 INFO:tasks.workunit.client.1.smithi148.stdout:7/331: mknod db/dc/c60 0 2024-09-18T12:49:10.714 INFO:tasks.workunit.client.1.smithi148.stdout:7/332: read - db/dc/df/d1d/f5c zero size 2024-09-18T12:49:10.715 INFO:tasks.workunit.client.1.smithi148.stdout:1/348: fsync dc/d18/f3d 0 2024-09-18T12:49:10.716 INFO:tasks.workunit.client.0.smithi078.stdout:3/206: truncate d9/d29/f24 5078353 0 2024-09-18T12:49:10.718 INFO:tasks.workunit.client.1.smithi148.stdout:3/308: creat d4/d8/d20/d2b/f73 x:0 0 0 2024-09-18T12:49:10.722 INFO:tasks.workunit.client.0.smithi078.stdout:6/344: truncate d10/f41 4170957 0 2024-09-18T12:49:10.725 INFO:tasks.workunit.client.1.smithi148.stdout:8/397: symlink d8/d16/d53/l8a 0 2024-09-18T12:49:10.726 INFO:tasks.workunit.client.0.smithi078.stdout:5/302: truncate d2/fc 63260 0 2024-09-18T12:49:10.726 INFO:tasks.workunit.client.1.smithi148.stdout:8/398: write d8/f2f [5190480,127699] 0 2024-09-18T12:49:10.727 INFO:tasks.workunit.client.0.smithi078.stdout:5/303: fdatasync d2/d4/d9/da/ff 0 2024-09-18T12:49:10.728 INFO:tasks.workunit.client.1.smithi148.stdout:4/304: write d15/f2d [4217214,68328] 0 2024-09-18T12:49:10.729 INFO:tasks.workunit.client.1.smithi148.stdout:2/282: creat d9/d24/d31/d34/d57/f60 x:0 0 0 2024-09-18T12:49:10.730 INFO:tasks.workunit.client.1.smithi148.stdout:0/522: write f1 [315292,113445] 0 2024-09-18T12:49:10.733 INFO:tasks.workunit.client.0.smithi078.stdout:3/207: truncate d9/d13/d33/d3c/d19/f1e 1813549 0 2024-09-18T12:49:10.740 INFO:tasks.workunit.client.0.smithi078.stdout:6/345: dread d10/f21 [0,4194304] 0 2024-09-18T12:49:10.741 INFO:tasks.workunit.client.1.smithi148.stdout:3/309: symlink d4/d8/d1e/d6b/d31/d60/l74 0 2024-09-18T12:49:10.743 INFO:tasks.workunit.client.0.smithi078.stdout:5/304: getdents d2/d4/d9/da/d2b/d3e 0 2024-09-18T12:49:10.777 INFO:tasks.workunit.client.0.smithi078.stdout:3/208: mkdir d9/d29/d4b 0 2024-09-18T12:49:10.778 INFO:tasks.workunit.client.0.smithi078.stdout:3/209: write d9/d13/f39 [2436124,30292] 0 2024-09-18T12:49:10.779 INFO:tasks.workunit.client.0.smithi078.stdout:3/210: readlink d9/d13/d33/d3c/d19/l30 0 2024-09-18T12:49:10.780 INFO:tasks.workunit.client.0.smithi078.stdout:3/211: dread - d9/d13/d33/d3c/d19/f49 zero size 2024-09-18T12:49:10.782 INFO:tasks.workunit.client.0.smithi078.stdout:6/346: symlink d10/d2b/d43/d53/d45/l65 0 2024-09-18T12:49:10.783 INFO:tasks.workunit.client.0.smithi078.stdout:6/347: fdatasync d10/d2b/d43/d53/d45/d55/f52 0 2024-09-18T12:49:10.787 INFO:tasks.workunit.client.1.smithi148.stdout:6/379: rename d5/c3f to d5/d32/d38/d50/c7a 0 2024-09-18T12:49:10.788 INFO:tasks.workunit.client.1.smithi148.stdout:8/399: mknod d8/d12/d46/c8b 0 2024-09-18T12:49:10.790 INFO:tasks.workunit.client.1.smithi148.stdout:4/305: mknod d15/d17/d1f/c63 0 2024-09-18T12:49:10.791 INFO:tasks.workunit.client.1.smithi148.stdout:4/306: chown d15/d17/d1f/d4c/d4f/f3d 95 1 2024-09-18T12:49:10.792 INFO:tasks.workunit.client.0.smithi078.stdout:6/348: creat d10/d2b/d61/f66 x:0 0 0 2024-09-18T12:49:10.792 INFO:tasks.workunit.client.0.smithi078.stdout:6/349: write d10/f30 [4614921,71431] 0 2024-09-18T12:49:10.795 INFO:tasks.workunit.client.0.smithi078.stdout:6/350: symlink d10/d2b/d43/d53/l67 0 2024-09-18T12:49:10.796 INFO:tasks.workunit.client.0.smithi078.stdout:6/351: chown d10/c5e 242335 1 2024-09-18T12:49:10.798 INFO:tasks.workunit.client.0.smithi078.stdout:3/212: stat d9/d13/d33/d3c/d19/f1e 0 2024-09-18T12:49:10.799 INFO:tasks.workunit.client.1.smithi148.stdout:3/310: read d4/d8/d20/d2b/f3a [2430991,128068] 0 2024-09-18T12:49:10.799 INFO:tasks.workunit.client.0.smithi078.stdout:6/352: rename d10/c20 to d10/d2b/d43/d53/d45/d55/d3f/c68 0 2024-09-18T12:49:10.800 INFO:tasks.workunit.client.1.smithi148.stdout:3/311: truncate d4/d8/d20/f2f 277739 0 2024-09-18T12:49:10.801 INFO:tasks.workunit.client.1.smithi148.stdout:9/335: rename d8/da/dd/d4a/d27/l2c to d8/da/dd/d35/d59/l66 0 2024-09-18T12:49:10.805 INFO:tasks.workunit.client.0.smithi078.stdout:3/213: mkdir d9/d29/d4b/d4c 0 2024-09-18T12:49:10.806 INFO:tasks.workunit.client.1.smithi148.stdout:9/336: dwrite d8/da/f1d [0,4194304] 0 2024-09-18T12:49:10.807 INFO:tasks.workunit.client.1.smithi148.stdout:1/349: write f8 [163421,87265] 0 2024-09-18T12:49:10.808 INFO:tasks.workunit.client.0.smithi078.stdout:5/305: dwrite d2/f26 [0,4194304] 0 2024-09-18T12:49:10.808 INFO:tasks.workunit.client.1.smithi148.stdout:6/380: dread f3 [0,4194304] 0 2024-09-18T12:49:10.809 INFO:tasks.workunit.client.0.smithi078.stdout:5/306: fdatasync d2/d4/f4f 0 2024-09-18T12:49:10.813 INFO:tasks.workunit.client.1.smithi148.stdout:1/350: dwrite dc/d11/d17/f21 [0,4194304] 0 2024-09-18T12:49:10.814 INFO:tasks.workunit.client.0.smithi078.stdout:3/214: fdatasync d9/d29/f24 0 2024-09-18T12:49:10.815 INFO:tasks.workunit.client.1.smithi148.stdout:1/351: chown dc/d18/d31/d39/c58 103985 1 2024-09-18T12:49:10.815 INFO:tasks.workunit.client.0.smithi078.stdout:3/215: write d9/d2f/f38 [307212,20875] 0 2024-09-18T12:49:10.816 INFO:tasks.workunit.client.1.smithi148.stdout:5/389: sync 2024-09-18T12:49:10.820 INFO:tasks.workunit.client.1.smithi148.stdout:7/333: getdents db/dc/df 0 2024-09-18T12:49:10.822 INFO:tasks.workunit.client.1.smithi148.stdout:7/334: write db/d52/d1f/f4d [1167352,85960] 0 2024-09-18T12:49:10.822 INFO:tasks.workunit.client.1.smithi148.stdout:9/337: creat d8/da/dd/d35/d47/d4e/f67 x:0 0 0 2024-09-18T12:49:10.824 INFO:tasks.workunit.client.1.smithi148.stdout:3/312: symlink d4/d8/d6a/l75 0 2024-09-18T12:49:10.826 INFO:tasks.workunit.client.1.smithi148.stdout:3/313: write d4/d8/d1e/d6b/d31/f36 [4216418,87879] 0 2024-09-18T12:49:10.826 INFO:tasks.workunit.client.1.smithi148.stdout:8/400: creat d8/f8c x:0 0 0 2024-09-18T12:49:10.827 INFO:tasks.workunit.client.0.smithi078.stdout:6/353: link d10/d2b/d37/c4b d10/d2b/d43/d53/d45/c69 0 2024-09-18T12:49:10.829 INFO:tasks.workunit.client.0.smithi078.stdout:6/354: write d10/d2b/d43/d53/d45/d55/f2d [1860752,3922] 0 2024-09-18T12:49:10.829 INFO:tasks.workunit.client.1.smithi148.stdout:1/352: rename dc/d51/f6a to dc/d18/d31/d39/f75 0 2024-09-18T12:49:10.830 INFO:tasks.workunit.client.0.smithi078.stdout:6/355: rename d10 to d10/d2b/d43/d6a 22 2024-09-18T12:49:10.831 INFO:tasks.workunit.client.0.smithi078.stdout:6/356: write d10/f1c [725795,57428] 0 2024-09-18T12:49:10.832 INFO:tasks.workunit.client.1.smithi148.stdout:0/523: getdents de/d14 0 2024-09-18T12:49:10.832 INFO:tasks.workunit.client.1.smithi148.stdout:5/390: readlink d7/d8/dc/d12/d1f/d77/l7e 0 2024-09-18T12:49:10.833 INFO:tasks.workunit.client.1.smithi148.stdout:0/524: write de/f32 [917051,110643] 0 2024-09-18T12:49:10.834 INFO:tasks.workunit.client.1.smithi148.stdout:5/391: write d7/d8/dc/d12/d20/f2e [2450122,10234] 0 2024-09-18T12:49:10.835 INFO:tasks.workunit.client.1.smithi148.stdout:7/335: creat db/dc/df/d11/d34/f61 x:0 0 0 2024-09-18T12:49:10.838 INFO:tasks.workunit.client.1.smithi148.stdout:4/307: getdents d15/d17/d52 0 2024-09-18T12:49:10.838 INFO:tasks.workunit.client.1.smithi148.stdout:1/353: read dc/d18/d31/f5d [136381,124687] 0 2024-09-18T12:49:10.840 INFO:tasks.workunit.client.1.smithi148.stdout:8/401: unlink d8/d12/c6c 0 2024-09-18T12:49:10.842 INFO:tasks.workunit.client.1.smithi148.stdout:9/338: symlink d8/l68 0 2024-09-18T12:49:10.844 INFO:tasks.workunit.client.0.smithi078.stdout:3/216: write d9/d13/f1d [1097318,72732] 0 2024-09-18T12:49:10.844 INFO:tasks.workunit.client.0.smithi078.stdout:3/217: stat d9/f12 0 2024-09-18T12:49:10.845 INFO:tasks.workunit.client.1.smithi148.stdout:0/525: write de/d27/d2e/f73 [4991896,117056] 0 2024-09-18T12:49:10.846 INFO:tasks.workunit.client.0.smithi078.stdout:5/307: truncate d2/d4/d12/f40 838812 0 2024-09-18T12:49:10.847 INFO:tasks.workunit.client.1.smithi148.stdout:0/526: write de/d14/d43/f5e [33377,44264] 0 2024-09-18T12:49:10.848 INFO:tasks.workunit.client.0.smithi078.stdout:3/218: mkdir d9/d13/d4d 0 2024-09-18T12:49:10.849 INFO:tasks.workunit.client.1.smithi148.stdout:2/283: sync 2024-09-18T12:49:10.850 INFO:tasks.workunit.client.1.smithi148.stdout:1/354: mknod dc/d18/d43/c76 0 2024-09-18T12:49:10.850 INFO:tasks.workunit.client.0.smithi078.stdout:5/308: mkdir d2/d4/d9/da/d60/d61 0 2024-09-18T12:49:10.853 INFO:tasks.workunit.client.1.smithi148.stdout:8/402: unlink d8/d16/d53/d39/f87 0 2024-09-18T12:49:10.854 INFO:tasks.workunit.client.1.smithi148.stdout:9/339: creat d8/da/dd/d35/d59/f69 x:0 0 0 2024-09-18T12:49:10.856 INFO:tasks.workunit.client.0.smithi078.stdout:6/357: dwrite ff [0,4194304] 0 2024-09-18T12:49:10.858 INFO:tasks.workunit.client.1.smithi148.stdout:3/314: dwrite d4/d8/d20/d2b/f45 [0,4194304] 0 2024-09-18T12:49:10.858 INFO:tasks.workunit.client.1.smithi148.stdout:6/381: write d5/d1a/dc/f6d [176562,34101] 0 2024-09-18T12:49:10.859 INFO:tasks.workunit.client.0.smithi078.stdout:3/219: rename d9/df/d11 to d9/d13/d33/d4e 0 2024-09-18T12:49:10.865 INFO:tasks.workunit.client.1.smithi148.stdout:7/336: symlink db/d52/d4f/l62 0 2024-09-18T12:49:10.869 INFO:tasks.workunit.client.0.smithi078.stdout:5/309: rename d2/d4/d9/d47 to d2/d4/d12/d16/d36/d4c/d62 0 2024-09-18T12:49:10.870 INFO:tasks.workunit.client.0.smithi078.stdout:5/310: dread - d2/d4/d9/da/d2b/d3e/f53 zero size 2024-09-18T12:49:10.871 INFO:tasks.workunit.client.1.smithi148.stdout:0/527: mkdir de/d14/d43/d70/d7f/db5 0 2024-09-18T12:49:10.872 INFO:tasks.workunit.client.0.smithi078.stdout:3/220: unlink d9/d13/c3e 0 2024-09-18T12:49:10.875 INFO:tasks.workunit.client.0.smithi078.stdout:6/358: mkdir d10/d2b/d43/d53/d63/d6b 0 2024-09-18T12:49:10.875 INFO:tasks.workunit.client.1.smithi148.stdout:0/528: dwrite de/f24 [0,4194304] 0 2024-09-18T12:49:10.876 INFO:tasks.workunit.client.1.smithi148.stdout:2/284: mknod d9/d4a/c61 0 2024-09-18T12:49:10.877 INFO:tasks.workunit.client.1.smithi148.stdout:2/285: read d9/d24/f32 [625129,68678] 0 2024-09-18T12:49:10.880 INFO:tasks.workunit.client.0.smithi078.stdout:3/221: dread d9/d2f/f3d [0,4194304] 0 2024-09-18T12:49:10.880 INFO:tasks.workunit.client.0.smithi078.stdout:6/359: truncate d10/d2b/d37/f48 4562323 0 2024-09-18T12:49:10.881 INFO:tasks.workunit.client.0.smithi078.stdout:3/222: chown d9/d13/d33/d3c/l2c 1 1 2024-09-18T12:49:10.881 INFO:tasks.workunit.client.1.smithi148.stdout:1/355: symlink dc/d18/d31/l77 0 2024-09-18T12:49:10.882 INFO:tasks.workunit.client.1.smithi148.stdout:1/356: stat dc/l28 0 2024-09-18T12:49:10.882 INFO:tasks.workunit.client.1.smithi148.stdout:8/403: rename d8/f4b to d8/d12/d46/f8d 0 2024-09-18T12:49:10.882 INFO:tasks.workunit.client.1.smithi148.stdout:0/529: dread de/d27/f2b [0,4194304] 0 2024-09-18T12:49:10.882 INFO:tasks.workunit.client.1.smithi148.stdout:8/404: write d8/d16/d27/f30 [7365667,124961] 0 2024-09-18T12:49:10.882 INFO:tasks.workunit.client.0.smithi078.stdout:5/311: link d2/d4/f34 d2/d4/d9/da/d2b/f63 0 2024-09-18T12:49:10.883 INFO:tasks.workunit.client.0.smithi078.stdout:5/312: write d2/d4/d9/da/f5a [422233,17186] 0 2024-09-18T12:49:10.884 INFO:tasks.workunit.client.0.smithi078.stdout:5/313: chown d2/d4/d48/l5e 0 1 2024-09-18T12:49:10.885 INFO:tasks.workunit.client.1.smithi148.stdout:0/530: dwrite de/f24 [0,4194304] 0 2024-09-18T12:49:10.885 INFO:tasks.workunit.client.1.smithi148.stdout:0/531: readlink de/d14/l20 0 2024-09-18T12:49:10.885 INFO:tasks.workunit.client.1.smithi148.stdout:0/532: readlink lb 0 2024-09-18T12:49:10.886 INFO:tasks.workunit.client.1.smithi148.stdout:0/533: chown de/d14/l8f 23 1 2024-09-18T12:49:10.886 INFO:tasks.workunit.client.0.smithi078.stdout:6/360: creat d10/d2b/d43/f6c x:0 0 0 2024-09-18T12:49:10.889 INFO:tasks.workunit.client.1.smithi148.stdout:4/308: truncate fe 1674010 0 2024-09-18T12:49:10.890 INFO:tasks.workunit.client.1.smithi148.stdout:9/340: rmdir d8/da/dd/d35/d59 39 2024-09-18T12:49:10.894 INFO:tasks.workunit.client.0.smithi078.stdout:5/314: creat d2/d4/d12/d16/d36/d4c/d62/f64 x:0 0 0 2024-09-18T12:49:10.897 INFO:tasks.workunit.client.1.smithi148.stdout:7/337: mknod db/dc/df/d1d/c63 0 2024-09-18T12:49:10.898 INFO:tasks.workunit.client.1.smithi148.stdout:7/338: write db/dc/df/d11/f51 [289647,3025] 0 2024-09-18T12:49:10.899 INFO:tasks.workunit.client.1.smithi148.stdout:7/339: fdatasync db/dc/df/d1d/f58 0 2024-09-18T12:49:10.899 INFO:tasks.workunit.client.0.smithi078.stdout:5/315: creat d2/d4/d12/d16/d36/d4c/f65 x:0 0 0 2024-09-18T12:49:10.901 INFO:tasks.workunit.client.1.smithi148.stdout:1/357: chown dc/d11/f16 7 1 2024-09-18T12:49:10.902 INFO:tasks.workunit.client.1.smithi148.stdout:7/340: dread db/dc/f12 [0,4194304] 0 2024-09-18T12:49:10.902 INFO:tasks.workunit.client.1.smithi148.stdout:7/341: stat db/d52/d25/d2e 0 2024-09-18T12:49:10.902 INFO:tasks.workunit.client.0.smithi078.stdout:6/361: dwrite d10/d2b/d43/f60 [0,4194304] 0 2024-09-18T12:49:10.905 INFO:tasks.workunit.client.1.smithi148.stdout:9/341: creat d8/da/dd/d3f/f6a x:0 0 0 2024-09-18T12:49:10.907 INFO:tasks.workunit.client.1.smithi148.stdout:5/392: getdents d7/d8/dc/d12 0 2024-09-18T12:49:10.907 INFO:tasks.workunit.client.1.smithi148.stdout:7/342: dwrite db/dc/f28 [0,4194304] 0 2024-09-18T12:49:10.908 INFO:tasks.workunit.client.1.smithi148.stdout:7/343: readlink db/l22 0 2024-09-18T12:49:10.909 INFO:tasks.workunit.client.0.smithi078.stdout:5/316: creat d2/d4/f66 x:0 0 0 2024-09-18T12:49:10.909 INFO:tasks.workunit.client.1.smithi148.stdout:6/382: symlink d5/d32/d56/l7b 0 2024-09-18T12:49:10.909 INFO:tasks.workunit.client.1.smithi148.stdout:6/383: readlink d5/d1a/l6b 0 2024-09-18T12:49:10.910 INFO:tasks.workunit.client.1.smithi148.stdout:9/342: dread d8/f25 [0,4194304] 0 2024-09-18T12:49:10.911 INFO:tasks.workunit.client.1.smithi148.stdout:9/343: fsync d8/da/fb 0 2024-09-18T12:49:10.918 INFO:tasks.workunit.client.1.smithi148.stdout:9/344: dwrite d8/da/dd/d4a/d27/f52 [0,4194304] 0 2024-09-18T12:49:10.931 INFO:tasks.workunit.client.1.smithi148.stdout:8/405: mknod d8/d12/c8e 0 2024-09-18T12:49:10.931 INFO:tasks.workunit.client.0.smithi078.stdout:3/223: dwrite d9/f12 [0,4194304] 0 2024-09-18T12:49:10.932 INFO:tasks.workunit.client.1.smithi148.stdout:8/406: stat d8/d16/d53/d39/d3b/d41/f78 0 2024-09-18T12:49:10.934 INFO:tasks.workunit.client.0.smithi078.stdout:5/317: rename d2/d4/d12/d16/d36/d4c/d62/f64 to d2/d4/d12/f67 0 2024-09-18T12:49:10.935 INFO:tasks.workunit.client.1.smithi148.stdout:4/309: mkdir d15/d17/d1f/d4c/d4f/d64 0 2024-09-18T12:49:10.941 INFO:tasks.workunit.client.0.smithi078.stdout:3/224: unlink l3 0 2024-09-18T12:49:10.947 INFO:tasks.workunit.client.0.smithi078.stdout:6/362: dwrite d10/d2b/d43/d53/d45/f62 [0,4194304] 0 2024-09-18T12:49:10.951 INFO:tasks.workunit.client.1.smithi148.stdout:3/315: creat d4/f76 x:0 0 0 2024-09-18T12:49:10.954 INFO:tasks.workunit.client.1.smithi148.stdout:9/345: symlink d8/da/dd/d35/d47/d4e/l6b 0 2024-09-18T12:49:10.955 INFO:tasks.workunit.client.0.smithi078.stdout:5/318: getdents d2/d4/d9/da/d60 0 2024-09-18T12:49:10.955 INFO:tasks.workunit.client.0.smithi078.stdout:5/319: stat d2/d4/d48 0 2024-09-18T12:49:10.956 INFO:tasks.workunit.client.1.smithi148.stdout:2/286: creat d9/d24/d31/f62 x:0 0 0 2024-09-18T12:49:10.957 INFO:tasks.workunit.client.0.smithi078.stdout:6/363: symlink d10/l6d 0 2024-09-18T12:49:10.960 INFO:tasks.workunit.client.0.smithi078.stdout:5/320: mkdir d2/d4/d12/d16/d36/d68 0 2024-09-18T12:49:10.962 INFO:tasks.workunit.client.1.smithi148.stdout:0/534: rename de/d14/d43/d70/d7f/f51 to de/d27/d53/fb6 0 2024-09-18T12:49:10.964 INFO:tasks.workunit.client.0.smithi078.stdout:5/321: unlink d2/d4/d9/da/ff 0 2024-09-18T12:49:10.965 INFO:tasks.workunit.client.1.smithi148.stdout:4/310: write d15/d17/d1f/d4c/f57 [535894,126794] 0 2024-09-18T12:49:10.969 INFO:tasks.workunit.client.1.smithi148.stdout:6/384: mkdir d5/d79/d7c 0 2024-09-18T12:49:10.971 INFO:tasks.workunit.client.0.smithi078.stdout:6/364: rename d10/f30 to d10/d2b/f6e 0 2024-09-18T12:49:10.973 INFO:tasks.workunit.client.1.smithi148.stdout:3/316: dread - d4/d8/d20/d2b/d43/f21 zero size 2024-09-18T12:49:10.974 INFO:tasks.workunit.client.1.smithi148.stdout:7/344: dwrite fa [8388608,4194304] 0 2024-09-18T12:49:10.974 INFO:tasks.workunit.client.1.smithi148.stdout:3/317: chown d4/d8/d20/d2b/f3a 552055377 1 2024-09-18T12:49:10.975 INFO:tasks.workunit.client.0.smithi078.stdout:3/225: dread f7 [0,4194304] 0 2024-09-18T12:49:10.979 INFO:tasks.workunit.client.0.smithi078.stdout:6/365: link d10/f24 d10/d2b/d43/f6f 0 2024-09-18T12:49:10.981 INFO:tasks.workunit.client.1.smithi148.stdout:8/407: mkdir d8/df/d3e/d82/d8f 0 2024-09-18T12:49:10.982 INFO:tasks.workunit.client.1.smithi148.stdout:8/408: write d8/d16/d53/d39/f3d [1080076,25586] 0 2024-09-18T12:49:10.983 INFO:tasks.workunit.client.0.smithi078.stdout:3/226: dwrite d9/d13/d33/d4e/f25 [0,4194304] 0 2024-09-18T12:49:10.987 INFO:tasks.workunit.client.1.smithi148.stdout:4/311: read d15/d3f/f55 [279931,34487] 0 2024-09-18T12:49:10.987 INFO:tasks.workunit.client.0.smithi078.stdout:6/366: rmdir d10/d2b/d43/d53/d45/d55 39 2024-09-18T12:49:10.990 INFO:tasks.workunit.client.1.smithi148.stdout:5/393: creat d7/d8/f83 x:0 0 0 2024-09-18T12:49:10.991 INFO:tasks.workunit.client.1.smithi148.stdout:5/394: chown d7/d8/dc/d12/d1f/d39 487841 1 2024-09-18T12:49:10.994 INFO:tasks.workunit.client.1.smithi148.stdout:9/346: symlink d8/da/dd/d35/d5e/l6c 0 2024-09-18T12:49:10.995 INFO:tasks.workunit.client.1.smithi148.stdout:7/345: mknod db/dc/df/d11/c64 0 2024-09-18T12:49:10.997 INFO:tasks.workunit.client.1.smithi148.stdout:7/346: read db/dc/df/f29 [386767,78448] 0 2024-09-18T12:49:10.997 INFO:tasks.workunit.client.0.smithi078.stdout:5/322: dwrite d2/d4/d12/f1b [0,4194304] 0 2024-09-18T12:49:10.997 INFO:tasks.workunit.client.0.smithi078.stdout:6/367: dwrite d10/d2b/d37/f59 [0,4194304] 0 2024-09-18T12:49:10.998 INFO:tasks.workunit.client.1.smithi148.stdout:7/347: chown db/dc/f15 7 1 2024-09-18T12:49:10.999 INFO:tasks.workunit.client.0.smithi078.stdout:5/323: fsync d2/f26 0 2024-09-18T12:49:10.999 INFO:tasks.workunit.client.0.smithi078.stdout:6/368: chown d10/d2b/d43/f6f 926 1 2024-09-18T12:49:11.002 INFO:tasks.workunit.client.1.smithi148.stdout:3/318: symlink d4/d8/d1e/d6b/d31/d60/l77 0 2024-09-18T12:49:11.002 INFO:tasks.workunit.client.1.smithi148.stdout:9/347: dwrite d8/f5c [0,4194304] 0 2024-09-18T12:49:11.003 INFO:tasks.workunit.client.1.smithi148.stdout:9/348: stat d8/da/d56 0 2024-09-18T12:49:11.007 INFO:tasks.workunit.client.1.smithi148.stdout:4/312: dread d15/d17/f27 [0,4194304] 0 2024-09-18T12:49:11.007 INFO:tasks.workunit.client.1.smithi148.stdout:0/535: creat de/d14/d43/d70/d7f/db5/fb7 x:0 0 0 2024-09-18T12:49:11.007 INFO:tasks.workunit.client.0.smithi078.stdout:5/324: dwrite d2/d4/d48/f4e [0,4194304] 0 2024-09-18T12:49:11.012 INFO:tasks.workunit.client.1.smithi148.stdout:5/395: mknod d7/d8/dc/d12/d1f/d25/d4b/c84 0 2024-09-18T12:49:11.013 INFO:tasks.workunit.client.0.smithi078.stdout:5/325: rmdir d2/d4/d12 39 2024-09-18T12:49:11.016 INFO:tasks.workunit.client.1.smithi148.stdout:6/385: mknod d5/d1a/dc/d2b/d35/c7d 0 2024-09-18T12:49:11.021 INFO:tasks.workunit.client.0.smithi078.stdout:3/227: dwrite d9/d13/d33/d3c/d19/f1e [0,4194304] 0 2024-09-18T12:49:11.021 INFO:tasks.workunit.client.1.smithi148.stdout:7/348: rename db/dc/df/d1d/f58 to db/dc/df/d11/f65 0 2024-09-18T12:49:11.022 INFO:tasks.workunit.client.0.smithi078.stdout:3/228: chown d9/d13/d33/d3c/l2c 46 1 2024-09-18T12:49:11.023 INFO:tasks.workunit.client.1.smithi148.stdout:3/319: symlink d4/d8/d6a/l78 0 2024-09-18T12:49:11.024 INFO:tasks.workunit.client.1.smithi148.stdout:1/358: link dc/d11/d17/l1d dc/d18/l78 0 2024-09-18T12:49:11.024 INFO:tasks.workunit.client.1.smithi148.stdout:7/349: chown db/d52/d25/f3c 856724790 1 2024-09-18T12:49:11.026 INFO:tasks.workunit.client.0.smithi078.stdout:3/229: dread d9/d2f/f38 [0,4194304] 0 2024-09-18T12:49:11.026 INFO:tasks.workunit.client.1.smithi148.stdout:6/386: dwrite d5/d1a/dc/d2b/f55 [0,4194304] 0 2024-09-18T12:49:11.026 INFO:tasks.workunit.client.1.smithi148.stdout:3/320: readlink d4/d8/d1e/d6b/d31/l5a 0 2024-09-18T12:49:11.026 INFO:tasks.workunit.client.0.smithi078.stdout:3/230: fsync f7 0 2024-09-18T12:49:11.027 INFO:tasks.workunit.client.1.smithi148.stdout:6/387: write d5/d32/f3b [1052226,72988] 0 2024-09-18T12:49:11.028 INFO:tasks.workunit.client.1.smithi148.stdout:5/396: symlink d7/d8/dc/d12/d1f/l85 0 2024-09-18T12:49:11.028 INFO:tasks.workunit.client.1.smithi148.stdout:7/350: write db/d52/d25/d2e/f56 [176666,23860] 0 2024-09-18T12:49:11.029 INFO:tasks.workunit.client.1.smithi148.stdout:2/287: getdents d9/d24 0 2024-09-18T12:49:11.030 INFO:tasks.workunit.client.0.smithi078.stdout:3/231: creat d9/d13/d33/d34/f4f x:0 0 0 2024-09-18T12:49:11.031 INFO:tasks.workunit.client.0.smithi078.stdout:3/232: chown d9/d13/d37 38140388 1 2024-09-18T12:49:11.031 INFO:tasks.workunit.client.1.smithi148.stdout:7/351: dread - db/dc/df/d11/d34/f61 zero size 2024-09-18T12:49:11.032 INFO:tasks.workunit.client.1.smithi148.stdout:9/349: rename d8/da/dd/d4a/f12 to d8/da/dd/d65/f6d 0 2024-09-18T12:49:11.034 INFO:tasks.workunit.client.0.smithi078.stdout:3/233: mknod d9/d13/d33/d4e/c50 0 2024-09-18T12:49:11.034 INFO:tasks.workunit.client.1.smithi148.stdout:3/321: mkdir d4/d8/d1e/d79 0 2024-09-18T12:49:11.035 INFO:tasks.workunit.client.1.smithi148.stdout:5/397: mknod d7/d8/d18/c86 0 2024-09-18T12:49:11.035 INFO:tasks.workunit.client.1.smithi148.stdout:3/322: fdatasync d4/d8/d20/d2b/f73 0 2024-09-18T12:49:11.038 INFO:tasks.workunit.client.1.smithi148.stdout:1/359: mknod dc/d18/c79 0 2024-09-18T12:49:11.039 INFO:tasks.workunit.client.1.smithi148.stdout:2/288: rename d9/d3a/f54 to d9/d24/d47/f63 0 2024-09-18T12:49:11.040 INFO:tasks.workunit.client.0.smithi078.stdout:3/234: creat d9/d13/d33/f51 x:0 0 0 2024-09-18T12:49:11.040 INFO:tasks.workunit.client.1.smithi148.stdout:8/409: dread d8/d12/d46/f5a [0,4194304] 0 2024-09-18T12:49:11.040 INFO:tasks.workunit.client.1.smithi148.stdout:2/289: chown d9/d24/d47/c50 16329417 1 2024-09-18T12:49:11.042 INFO:tasks.workunit.client.1.smithi148.stdout:0/536: getdents de/d27/d53/d89/d9d 0 2024-09-18T12:49:11.044 INFO:tasks.workunit.client.1.smithi148.stdout:0/537: write de/d27/d7a/f84 [20437,5649] 0 2024-09-18T12:49:11.046 INFO:tasks.workunit.client.1.smithi148.stdout:8/410: mknod d8/d12/d51/c90 0 2024-09-18T12:49:11.048 INFO:tasks.workunit.client.1.smithi148.stdout:8/411: write d8/fb [942503,16764] 0 2024-09-18T12:49:11.049 INFO:tasks.workunit.client.1.smithi148.stdout:2/290: dwrite d9/f26 [0,4194304] 0 2024-09-18T12:49:11.049 INFO:tasks.workunit.client.1.smithi148.stdout:4/313: dread d15/d17/f1c [4194304,4194304] 0 2024-09-18T12:49:11.050 INFO:tasks.workunit.client.1.smithi148.stdout:3/323: creat d4/f7a x:0 0 0 2024-09-18T12:49:11.051 INFO:tasks.workunit.client.1.smithi148.stdout:0/538: creat de/d14/d6b/fb8 x:0 0 0 2024-09-18T12:49:11.052 INFO:tasks.workunit.client.0.smithi078.stdout:6/369: write d10/f41 [1633650,86458] 0 2024-09-18T12:49:11.052 INFO:tasks.workunit.client.1.smithi148.stdout:7/352: getdents db/dc/df/d11/d43 0 2024-09-18T12:49:11.053 INFO:tasks.workunit.client.1.smithi148.stdout:7/353: fdatasync db/dc/df/d1d/f21 0 2024-09-18T12:49:11.055 INFO:tasks.workunit.client.1.smithi148.stdout:7/354: read db/dc/df/d11/f65 [3207803,27407] 0 2024-09-18T12:49:11.056 INFO:tasks.workunit.client.1.smithi148.stdout:4/314: rmdir d15/d17/d52 39 2024-09-18T12:49:11.056 INFO:tasks.workunit.client.1.smithi148.stdout:4/315: stat d15/d17 0 2024-09-18T12:49:11.058 INFO:tasks.workunit.client.0.smithi078.stdout:6/370: mkdir d10/d2b/d43/d53/d63/d70 0 2024-09-18T12:49:11.060 INFO:tasks.workunit.client.1.smithi148.stdout:3/324: mknod d4/d8/d1e/c7b 0 2024-09-18T12:49:11.061 INFO:tasks.workunit.client.1.smithi148.stdout:0/539: creat de/d27/d53/d89/d9d/fb9 x:0 0 0 2024-09-18T12:49:11.061 INFO:tasks.workunit.client.1.smithi148.stdout:3/325: write d4/d8/d1e/d6b/d31/d60/f6e [877065,93148] 0 2024-09-18T12:49:11.062 INFO:tasks.workunit.client.0.smithi078.stdout:6/371: truncate d10/f21 1005190 0 2024-09-18T12:49:11.062 INFO:tasks.workunit.client.0.smithi078.stdout:3/235: dread d9/f27 [0,4194304] 0 2024-09-18T12:49:11.062 INFO:tasks.workunit.client.0.smithi078.stdout:5/326: dwrite d2/d4/d9/da/d2b/f63 [0,4194304] 0 2024-09-18T12:49:11.064 INFO:tasks.workunit.client.0.smithi078.stdout:6/372: chown d10/d2b/d43/d53/f4d 6910998 1 2024-09-18T12:49:11.065 INFO:tasks.workunit.client.0.smithi078.stdout:5/327: read d2/d4/f4f [39195,26734] 0 2024-09-18T12:49:11.065 INFO:tasks.workunit.client.1.smithi148.stdout:8/412: dread d8/d12/d46/f58 [0,4194304] 0 2024-09-18T12:49:11.067 INFO:tasks.workunit.client.1.smithi148.stdout:7/355: rmdir db/d52/d25 39 2024-09-18T12:49:11.069 INFO:tasks.workunit.client.1.smithi148.stdout:7/356: read db/d52/d1f/f4d [1146559,23469] 0 2024-09-18T12:49:11.070 INFO:tasks.workunit.client.1.smithi148.stdout:7/357: write db/dc/df/d11/d34/f61 [644792,26243] 0 2024-09-18T12:49:11.071 INFO:tasks.workunit.client.1.smithi148.stdout:7/358: write db/dc/f15 [638615,122049] 0 2024-09-18T12:49:11.072 INFO:tasks.workunit.client.1.smithi148.stdout:0/540: rmdir de/d27/d7a 39 2024-09-18T12:49:11.073 INFO:tasks.workunit.client.1.smithi148.stdout:7/359: dread db/dc/df/f29 [0,4194304] 0 2024-09-18T12:49:11.073 INFO:tasks.workunit.client.0.smithi078.stdout:5/328: readlink d2/d4/d12/d16/d36/d4c/d62/d4d/l51 0 2024-09-18T12:49:11.074 INFO:tasks.workunit.client.1.smithi148.stdout:7/360: write fa [12686539,80004] 0 2024-09-18T12:49:11.074 INFO:tasks.workunit.client.1.smithi148.stdout:7/361: stat db/dc/df/d11/d34/c59 0 2024-09-18T12:49:11.075 INFO:tasks.workunit.client.1.smithi148.stdout:3/326: creat d4/d8/d20/d2b/d43/d61/f7c x:0 0 0 2024-09-18T12:49:11.076 INFO:tasks.workunit.client.1.smithi148.stdout:9/350: truncate f7 1816894 0 2024-09-18T12:49:11.076 INFO:tasks.workunit.client.1.smithi148.stdout:3/327: write d4/d8/d20/d2b/f73 [42953,49484] 0 2024-09-18T12:49:11.077 INFO:tasks.workunit.client.1.smithi148.stdout:9/351: write d8/f22 [933507,58377] 0 2024-09-18T12:49:11.078 INFO:tasks.workunit.client.1.smithi148.stdout:8/413: symlink d8/d16/d27/l91 0 2024-09-18T12:49:11.081 INFO:tasks.workunit.client.0.smithi078.stdout:3/236: rmdir d9/d13/d4d 0 2024-09-18T12:49:11.081 INFO:tasks.workunit.client.0.smithi078.stdout:3/237: chown f7 11601 1 2024-09-18T12:49:11.085 INFO:tasks.workunit.client.0.smithi078.stdout:3/238: unlink d9/df/c2d 0 2024-09-18T12:49:11.088 INFO:tasks.workunit.client.0.smithi078.stdout:3/239: rmdir d9/d13 39 2024-09-18T12:49:11.092 INFO:tasks.workunit.client.0.smithi078.stdout:3/240: dread - d9/d13/d33/d3c/d19/f49 zero size 2024-09-18T12:49:11.093 INFO:tasks.workunit.client.0.smithi078.stdout:6/373: write f3 [908714,80389] 0 2024-09-18T12:49:11.094 INFO:tasks.workunit.client.0.smithi078.stdout:3/241: symlink d9/d13/d33/d34/l52 0 2024-09-18T12:49:11.096 INFO:tasks.workunit.client.0.smithi078.stdout:3/242: truncate d9/d13/d33/f51 232504 0 2024-09-18T12:49:11.101 INFO:tasks.workunit.client.0.smithi078.stdout:3/243: mknod d9/d2f/d43/c53 0 2024-09-18T12:49:11.101 INFO:tasks.workunit.client.0.smithi078.stdout:3/244: truncate f7 4561757 0 2024-09-18T12:49:11.106 INFO:tasks.workunit.client.0.smithi078.stdout:3/245: write d9/f27 [191605,21602] 0 2024-09-18T12:49:11.108 INFO:tasks.workunit.client.0.smithi078.stdout:3/246: chown c4 15 1 2024-09-18T12:49:11.109 INFO:tasks.workunit.client.1.smithi148.stdout:5/398: truncate d7/d8/dc/d12/d31/f48 1347497 0 2024-09-18T12:49:11.109 INFO:tasks.workunit.client.1.smithi148.stdout:8/414: chown d8/df/d3e/d88 2880 1 2024-09-18T12:49:11.109 INFO:tasks.workunit.client.1.smithi148.stdout:1/360: truncate f8 1855686 0 2024-09-18T12:49:11.109 INFO:tasks.workunit.client.1.smithi148.stdout:4/316: creat d15/d17/d52/f65 x:0 0 0 2024-09-18T12:49:11.109 INFO:tasks.workunit.client.1.smithi148.stdout:9/352: dread - d8/da/dd/d3f/f6a zero size 2024-09-18T12:49:11.110 INFO:tasks.workunit.client.1.smithi148.stdout:2/291: getdents d9/d24/d47 0 2024-09-18T12:49:11.111 INFO:tasks.workunit.client.0.smithi078.stdout:6/374: dwrite d10/f17 [0,4194304] 0 2024-09-18T12:49:11.111 INFO:tasks.workunit.client.1.smithi148.stdout:3/328: symlink d4/d8/d1e/d6b/d31/d59/l7d 0 2024-09-18T12:49:11.111 INFO:tasks.workunit.client.1.smithi148.stdout:5/399: chown d7/d8/dc/d12/d1f/d77/l7e 36366905 1 2024-09-18T12:49:11.113 INFO:tasks.workunit.client.0.smithi078.stdout:6/375: read fb [3926610,68935] 0 2024-09-18T12:49:11.113 INFO:tasks.workunit.client.1.smithi148.stdout:5/400: read d7/d8/f9 [5839252,116564] 0 2024-09-18T12:49:11.116 INFO:tasks.workunit.client.1.smithi148.stdout:9/353: symlink d8/da/dd/d3f/d5d/l6e 0 2024-09-18T12:49:11.117 INFO:tasks.workunit.client.1.smithi148.stdout:4/317: rename d15/d17/d1f/f24 to d15/d17/d52/f66 0 2024-09-18T12:49:11.117 INFO:tasks.workunit.client.0.smithi078.stdout:3/247: dwrite f7 [4194304,4194304] 0 2024-09-18T12:49:11.120 INFO:tasks.workunit.client.1.smithi148.stdout:5/401: read d7/d8/f68 [387941,126915] 0 2024-09-18T12:49:11.123 INFO:tasks.workunit.client.1.smithi148.stdout:9/354: write d8/da/dd/f31 [3251909,115155] 0 2024-09-18T12:49:11.123 INFO:tasks.workunit.client.0.smithi078.stdout:6/376: dwrite d10/d2b/d37/f59 [0,4194304] 0 2024-09-18T12:49:11.124 INFO:tasks.workunit.client.0.smithi078.stdout:3/248: dread f7 [4194304,4194304] 0 2024-09-18T12:49:11.124 INFO:tasks.workunit.client.1.smithi148.stdout:3/329: dread d4/d8/d1e/d6b/f3e [0,4194304] 0 2024-09-18T12:49:11.124 INFO:tasks.workunit.client.1.smithi148.stdout:1/361: dwrite dc/d18/d31/d4b/f65 [4194304,4194304] 0 2024-09-18T12:49:11.127 INFO:tasks.workunit.client.1.smithi148.stdout:7/362: dwrite db/dc/df/d1d/f57 [0,4194304] 0 2024-09-18T12:49:11.127 INFO:tasks.workunit.client.1.smithi148.stdout:5/402: dread - d7/d8/d18/d3f/f70 zero size 2024-09-18T12:49:11.131 INFO:tasks.workunit.client.0.smithi078.stdout:6/377: symlink d10/d2b/l71 0 2024-09-18T12:49:11.133 INFO:tasks.workunit.client.0.smithi078.stdout:3/249: dwrite d9/f27 [0,4194304] 0 2024-09-18T12:49:11.134 INFO:tasks.workunit.client.0.smithi078.stdout:6/378: rename d10/d2b to d10/d2b/d43/d53/d63/d70/d72 22 2024-09-18T12:49:11.135 INFO:tasks.workunit.client.0.smithi078.stdout:3/250: write d9/f27 [1959995,16859] 0 2024-09-18T12:49:11.136 INFO:tasks.workunit.client.0.smithi078.stdout:6/379: truncate d10/d2b/d61/f66 400757 0 2024-09-18T12:49:11.140 INFO:tasks.workunit.client.1.smithi148.stdout:4/318: dread d15/d17/d1f/d4c/d4f/f23 [0,4194304] 0 2024-09-18T12:49:11.142 INFO:tasks.workunit.client.0.smithi078.stdout:3/251: dread d9/f27 [0,4194304] 0 2024-09-18T12:49:11.143 INFO:tasks.workunit.client.0.smithi078.stdout:6/380: dread d10/d2b/f6e [0,4194304] 0 2024-09-18T12:49:11.144 INFO:tasks.workunit.client.0.smithi078.stdout:6/381: stat d10/l32 0 2024-09-18T12:49:11.144 INFO:tasks.workunit.client.0.smithi078.stdout:6/382: read f3 [820086,114839] 0 2024-09-18T12:49:11.145 INFO:tasks.workunit.client.0.smithi078.stdout:3/252: dread d9/d13/d33/f51 [0,4194304] 0 2024-09-18T12:49:11.146 INFO:tasks.workunit.client.1.smithi148.stdout:3/330: mknod d4/d8/d1e/d79/c7e 0 2024-09-18T12:49:11.147 INFO:tasks.workunit.client.1.smithi148.stdout:4/319: creat d15/d17/d1f/d4c/f67 x:0 0 0 2024-09-18T12:49:11.147 INFO:tasks.workunit.client.1.smithi148.stdout:5/403: creat d7/d8/f87 x:0 0 0 2024-09-18T12:49:11.149 INFO:tasks.workunit.client.1.smithi148.stdout:4/320: write d15/d17/f36 [6142870,112391] 0 2024-09-18T12:49:11.149 INFO:tasks.workunit.client.1.smithi148.stdout:7/363: dwrite db/dc/df/d11/f65 [4194304,4194304] 0 2024-09-18T12:49:11.149 INFO:tasks.workunit.client.1.smithi148.stdout:5/404: stat d7/d8/dc/d12 0 2024-09-18T12:49:11.150 INFO:tasks.workunit.client.0.smithi078.stdout:6/383: mkdir d10/d2b/d73 0 2024-09-18T12:49:11.151 INFO:tasks.workunit.client.1.smithi148.stdout:4/321: fdatasync d15/d17/f2b 0 2024-09-18T12:49:11.152 INFO:tasks.workunit.client.1.smithi148.stdout:7/364: truncate db/dc/df/d1d/f57 4807759 0 2024-09-18T12:49:11.153 INFO:tasks.workunit.client.1.smithi148.stdout:5/405: write d7/d8/dc/d12/d1f/d69/f73 [829211,16483] 0 2024-09-18T12:49:11.154 INFO:tasks.workunit.client.1.smithi148.stdout:7/365: stat db/dc/df/d1d/f5c 0 2024-09-18T12:49:11.155 INFO:tasks.workunit.client.0.smithi078.stdout:6/384: symlink d10/d2b/d43/d53/d45/l74 0 2024-09-18T12:49:11.155 INFO:tasks.workunit.client.1.smithi148.stdout:1/362: link dc/d11/d17/d2b/l2f dc/d11/d17/l7a 0 2024-09-18T12:49:11.156 INFO:tasks.workunit.client.1.smithi148.stdout:4/322: mkdir d15/d17/d52/d68 0 2024-09-18T12:49:11.157 INFO:tasks.workunit.client.1.smithi148.stdout:5/406: creat d7/d8/d18/f88 x:0 0 0 2024-09-18T12:49:11.160 INFO:tasks.workunit.client.1.smithi148.stdout:5/407: mknod d7/c89 0 2024-09-18T12:49:11.161 INFO:tasks.workunit.client.1.smithi148.stdout:5/408: chown d7/d8/f87 104466615 1 2024-09-18T12:49:11.163 INFO:tasks.workunit.client.1.smithi148.stdout:7/366: dread db/dc/df/d11/f1b [0,4194304] 0 2024-09-18T12:49:11.165 INFO:tasks.workunit.client.1.smithi148.stdout:7/367: mkdir db/dc/df/d2c/d66 0 2024-09-18T12:49:11.166 INFO:tasks.workunit.client.1.smithi148.stdout:7/368: truncate db/dc/df/f29 940158 0 2024-09-18T12:49:11.169 INFO:tasks.workunit.client.1.smithi148.stdout:7/369: dread db/dc/df/d11/f3a [0,4194304] 0 2024-09-18T12:49:11.170 INFO:tasks.workunit.client.1.smithi148.stdout:7/370: chown db/dc/df/d11/d34 37 1 2024-09-18T12:49:11.171 INFO:tasks.workunit.client.1.smithi148.stdout:7/371: rmdir db/dc/df/d11 39 2024-09-18T12:49:11.172 INFO:tasks.workunit.client.1.smithi148.stdout:7/372: stat db/d52/d25 0 2024-09-18T12:49:11.174 INFO:tasks.workunit.client.1.smithi148.stdout:7/373: rename db/dc/df/d1d/d41 to db/dc/df/d1d/d41/d67 22 2024-09-18T12:49:11.175 INFO:tasks.workunit.client.1.smithi148.stdout:2/292: truncate d9/f21 3569632 0 2024-09-18T12:49:11.176 INFO:tasks.workunit.client.1.smithi148.stdout:2/293: dread - d9/d24/d31/f5a zero size 2024-09-18T12:49:11.177 INFO:tasks.workunit.client.1.smithi148.stdout:7/374: mkdir db/dc/df/d1d/d68 0 2024-09-18T12:49:11.178 INFO:tasks.workunit.client.1.smithi148.stdout:2/294: truncate d9/d24/d31/d34/f37 1212688 0 2024-09-18T12:49:11.179 INFO:tasks.workunit.client.1.smithi148.stdout:7/375: write db/dc/df/d2c/f5e [843195,31500] 0 2024-09-18T12:49:11.182 INFO:tasks.workunit.client.1.smithi148.stdout:7/376: write db/dc/df/d11/f65 [1040630,13049] 0 2024-09-18T12:49:11.183 INFO:tasks.workunit.client.1.smithi148.stdout:1/363: write dc/d11/d17/f23 [108881,14441] 0 2024-09-18T12:49:11.186 INFO:tasks.workunit.client.1.smithi148.stdout:1/364: fdatasync dc/d18/d31/d4b/f65 0 2024-09-18T12:49:11.187 INFO:tasks.workunit.client.1.smithi148.stdout:7/377: write db/dc/df/d11/f65 [1090135,6219] 0 2024-09-18T12:49:11.189 INFO:tasks.workunit.client.1.smithi148.stdout:3/331: dwrite d4/d8/d20/d2b/f3a [0,4194304] 0 2024-09-18T12:49:11.190 INFO:tasks.workunit.client.1.smithi148.stdout:1/365: read - dc/d51/f70 zero size 2024-09-18T12:49:11.191 INFO:tasks.workunit.client.1.smithi148.stdout:7/378: readlink db/dc/df/d1d/l20 0 2024-09-18T12:49:11.192 INFO:tasks.workunit.client.1.smithi148.stdout:5/409: dread d7/d8/d18/f1a [0,4194304] 0 2024-09-18T12:49:11.192 INFO:tasks.workunit.client.1.smithi148.stdout:4/323: dwrite d15/f3a [0,4194304] 0 2024-09-18T12:49:11.193 INFO:tasks.workunit.client.1.smithi148.stdout:5/410: chown d7/d8/dc/d12/d1f/d39 135844 1 2024-09-18T12:49:11.196 INFO:tasks.workunit.client.1.smithi148.stdout:3/332: mkdir d4/d8/d20/d2b/d7f 0 2024-09-18T12:49:11.196 INFO:tasks.workunit.client.1.smithi148.stdout:1/366: write dc/d18/f3d [1345892,2783] 0 2024-09-18T12:49:11.198 INFO:tasks.workunit.client.1.smithi148.stdout:5/411: mknod d7/c8a 0 2024-09-18T12:49:11.200 INFO:tasks.workunit.client.1.smithi148.stdout:5/412: write d7/d8/dc/f2a [3412507,37051] 0 2024-09-18T12:49:11.201 INFO:tasks.workunit.client.1.smithi148.stdout:3/333: fsync d4/d8/f51 0 2024-09-18T12:49:11.205 INFO:tasks.workunit.client.1.smithi148.stdout:4/324: dwrite d15/d17/d1f/d4c/d4f/f29 [0,4194304] 0 2024-09-18T12:49:11.206 INFO:tasks.workunit.client.1.smithi148.stdout:5/413: mkdir d7/d8/dc/d12/d1f/d69/d8b 0 2024-09-18T12:49:11.207 INFO:tasks.workunit.client.1.smithi148.stdout:3/334: dread d4/f11 [0,4194304] 0 2024-09-18T12:49:11.209 INFO:tasks.workunit.client.1.smithi148.stdout:3/335: dread - d4/d8/d1e/d6b/d31/f58 zero size 2024-09-18T12:49:11.216 INFO:tasks.workunit.client.1.smithi148.stdout:5/414: dread d7/d8/dc/d12/f51 [0,4194304] 0 2024-09-18T12:49:11.218 INFO:tasks.workunit.client.1.smithi148.stdout:7/379: truncate db/dc/df/d2c/f5e 820138 0 2024-09-18T12:49:11.219 INFO:tasks.workunit.client.1.smithi148.stdout:3/336: truncate d4/d8/f35 1342932 0 2024-09-18T12:49:11.222 INFO:tasks.workunit.client.1.smithi148.stdout:7/380: mkdir db/dc/df/d11/d34/d69 0 2024-09-18T12:49:11.222 INFO:tasks.workunit.client.1.smithi148.stdout:3/337: rmdir d4/d8/d20/d2b/d43 39 2024-09-18T12:49:11.224 INFO:tasks.workunit.client.1.smithi148.stdout:3/338: rmdir d4/d8/d6a 39 2024-09-18T12:49:11.224 INFO:tasks.workunit.client.1.smithi148.stdout:1/367: dwrite dc/d11/f53 [0,4194304] 0 2024-09-18T12:49:11.225 INFO:tasks.workunit.client.1.smithi148.stdout:7/381: dread db/dc/df/d11/f3a [0,4194304] 0 2024-09-18T12:49:11.226 INFO:tasks.workunit.client.1.smithi148.stdout:4/325: dwrite d15/d17/f47 [0,4194304] 0 2024-09-18T12:49:11.227 INFO:tasks.workunit.client.1.smithi148.stdout:7/382: readlink db/d52/d25/d2e/l4e 0 2024-09-18T12:49:11.228 INFO:tasks.workunit.client.1.smithi148.stdout:7/383: chown db/dc/df/d2c/d55 119850 1 2024-09-18T12:49:11.229 INFO:tasks.workunit.client.1.smithi148.stdout:4/326: readlink d15/d17/d1f/l56 0 2024-09-18T12:49:11.230 INFO:tasks.workunit.client.1.smithi148.stdout:3/339: creat d4/d8/d1e/d6b/d31/d46/f80 x:0 0 0 2024-09-18T12:49:11.230 INFO:tasks.workunit.client.1.smithi148.stdout:5/415: dread d7/d8/dc/d12/d31/f48 [0,4194304] 0 2024-09-18T12:49:11.232 INFO:tasks.workunit.client.1.smithi148.stdout:7/384: mkdir db/dc/d6a 0 2024-09-18T12:49:11.232 INFO:tasks.workunit.client.1.smithi148.stdout:4/327: fdatasync d15/d17/d1f/d4c/f5b 0 2024-09-18T12:49:11.232 INFO:tasks.workunit.client.1.smithi148.stdout:7/385: stat db/dc/f28 0 2024-09-18T12:49:11.233 INFO:tasks.workunit.client.1.smithi148.stdout:4/328: chown d15/f28 5696984 1 2024-09-18T12:49:11.233 INFO:tasks.workunit.client.1.smithi148.stdout:7/386: readlink db/dc/df/d1d/l20 0 2024-09-18T12:49:11.234 INFO:tasks.workunit.client.1.smithi148.stdout:4/329: readlink d15/d17/d1f/l44 0 2024-09-18T12:49:11.235 INFO:tasks.workunit.client.1.smithi148.stdout:4/330: chown d15/d17/l4a 654 1 2024-09-18T12:49:11.281 INFO:tasks.workunit.client.1.smithi148.stdout:6/388: sync 2024-09-18T12:49:11.292 INFO:tasks.workunit.client.1.smithi148.stdout:1/368: read dc/d18/f3d [3202862,106977] 0 2024-09-18T12:49:11.292 INFO:tasks.workunit.client.1.smithi148.stdout:4/331: mkdir d15/d5f/d69 0 2024-09-18T12:49:11.294 INFO:tasks.workunit.client.1.smithi148.stdout:5/416: dwrite d7/d8/f13 [0,4194304] 0 2024-09-18T12:49:11.296 INFO:tasks.workunit.client.1.smithi148.stdout:7/387: dwrite fa [0,4194304] 0 2024-09-18T12:49:11.297 INFO:tasks.workunit.client.1.smithi148.stdout:1/369: mkdir dc/d11/d38/d7b 0 2024-09-18T12:49:11.299 INFO:tasks.workunit.client.1.smithi148.stdout:4/332: rename d15/d17/d1f to d15/d6a 0 2024-09-18T12:49:11.299 INFO:tasks.workunit.client.1.smithi148.stdout:6/389: mknod d5/d1a/dc/d2b/d35/c7e 0 2024-09-18T12:49:11.306 INFO:tasks.workunit.client.1.smithi148.stdout:6/390: fsync d5/d1a/dc/d2b/f30 0 2024-09-18T12:49:11.308 INFO:tasks.workunit.client.1.smithi148.stdout:1/370: dwrite dc/d4d/f56 [0,4194304] 0 2024-09-18T12:49:11.308 INFO:tasks.workunit.client.1.smithi148.stdout:6/391: getdents d5/d79/d7c 0 2024-09-18T12:49:11.312 INFO:tasks.workunit.client.1.smithi148.stdout:6/392: creat d5/d1a/f7f x:0 0 0 2024-09-18T12:49:11.320 INFO:tasks.workunit.client.1.smithi148.stdout:4/333: fsync d15/d17/f2b 0 2024-09-18T12:49:11.321 INFO:tasks.workunit.client.1.smithi148.stdout:7/388: truncate db/dc/df/d11/f65 1844663 0 2024-09-18T12:49:11.322 INFO:tasks.workunit.client.1.smithi148.stdout:7/389: fsync db/dc/df/d1d/f5c 0 2024-09-18T12:49:11.324 INFO:tasks.workunit.client.1.smithi148.stdout:7/390: creat db/dc/df/d11/f6b x:0 0 0 2024-09-18T12:49:11.328 INFO:tasks.workunit.client.1.smithi148.stdout:4/334: dwrite d15/d6a/d4c/f5d [0,4194304] 0 2024-09-18T12:49:11.331 INFO:tasks.workunit.client.1.smithi148.stdout:7/391: mknod db/d52/d25/d38/c6c 0 2024-09-18T12:49:11.331 INFO:tasks.workunit.client.1.smithi148.stdout:6/393: dwrite d5/d1a/dc/d2b/d35/d65/f5e [0,4194304] 0 2024-09-18T12:49:11.332 INFO:tasks.workunit.client.1.smithi148.stdout:4/335: creat d15/d6a/d4c/d4f/d34/f6b x:0 0 0 2024-09-18T12:49:11.335 INFO:tasks.workunit.client.1.smithi148.stdout:6/394: write d5/d1a/f7f [602826,83035] 0 2024-09-18T12:49:11.336 INFO:tasks.workunit.client.1.smithi148.stdout:4/336: read d15/d3f/f55 [155101,31897] 0 2024-09-18T12:49:11.340 INFO:tasks.workunit.client.1.smithi148.stdout:7/392: rename db/dc/f15 to db/dc/df/d1d/f6d 0 2024-09-18T12:49:11.340 INFO:tasks.workunit.client.1.smithi148.stdout:4/337: write d15/d17/f42 [4175753,19345] 0 2024-09-18T12:49:11.342 INFO:tasks.workunit.client.1.smithi148.stdout:7/393: write db/dc/df/d1d/f6d [4756955,97960] 0 2024-09-18T12:49:11.346 INFO:tasks.workunit.client.1.smithi148.stdout:7/394: creat db/dc/df/d2c/d55/f6e x:0 0 0 2024-09-18T12:49:11.346 INFO:tasks.workunit.client.1.smithi148.stdout:4/338: dread d15/d6a/d4c/f57 [0,4194304] 0 2024-09-18T12:49:11.346 INFO:tasks.workunit.client.1.smithi148.stdout:4/339: stat f0 0 2024-09-18T12:49:11.354 INFO:tasks.workunit.client.1.smithi148.stdout:6/395: write d5/f28 [396854,129938] 0 2024-09-18T12:49:11.355 INFO:tasks.workunit.client.1.smithi148.stdout:4/340: dread f2 [0,4194304] 0 2024-09-18T12:49:11.358 INFO:tasks.workunit.client.1.smithi148.stdout:4/341: creat d15/d6a/d4c/d4f/f6c x:0 0 0 2024-09-18T12:49:11.358 INFO:tasks.workunit.client.1.smithi148.stdout:4/342: chown d15/d6a 812416339 1 2024-09-18T12:49:11.360 INFO:tasks.workunit.client.1.smithi148.stdout:4/343: mknod d15/d6a/d4c/d4f/d64/c6d 0 2024-09-18T12:49:11.395 INFO:tasks.workunit.client.1.smithi148.stdout:0/541: sync 2024-09-18T12:49:11.397 INFO:tasks.workunit.client.1.smithi148.stdout:0/542: write de/d14/f26 [4492369,77674] 0 2024-09-18T12:49:11.397 INFO:tasks.workunit.client.1.smithi148.stdout:4/344: getdents d15/d5f 0 2024-09-18T12:49:11.398 INFO:tasks.workunit.client.1.smithi148.stdout:4/345: creat d15/d3f/f6e x:0 0 0 2024-09-18T12:49:11.399 INFO:tasks.workunit.client.1.smithi148.stdout:0/543: creat de/d14/d43/d70/d7f/dab/fba x:0 0 0 2024-09-18T12:49:11.401 INFO:tasks.workunit.client.1.smithi148.stdout:4/346: truncate d15/d6a/d4c/d4f/f6c 802797 0 2024-09-18T12:49:11.401 INFO:tasks.workunit.client.1.smithi148.stdout:6/396: dread d5/d32/d38/d50/f59 [0,4194304] 0 2024-09-18T12:49:11.402 INFO:tasks.workunit.client.1.smithi148.stdout:6/397: dread - d5/d32/f64 zero size 2024-09-18T12:49:11.402 INFO:tasks.workunit.client.1.smithi148.stdout:4/347: chown d15/d6a/d4c/f5b 4623229 1 2024-09-18T12:49:11.407 INFO:tasks.workunit.client.1.smithi148.stdout:6/398: dwrite d5/d1a/d29/d5c/f77 [0,4194304] 0 2024-09-18T12:49:11.409 INFO:tasks.workunit.client.1.smithi148.stdout:0/544: truncate de/f77 1368123 0 2024-09-18T12:49:11.409 INFO:tasks.workunit.client.1.smithi148.stdout:4/348: truncate d15/f53 5004269 0 2024-09-18T12:49:11.410 INFO:tasks.workunit.client.1.smithi148.stdout:6/399: chown d5/d1a/dc/f5b 9 1 2024-09-18T12:49:11.410 INFO:tasks.workunit.client.1.smithi148.stdout:0/545: dread - de/d14/d43/fa0 zero size 2024-09-18T12:49:11.410 INFO:tasks.workunit.client.1.smithi148.stdout:4/349: stat d15/d6a/d4c/f67 0 2024-09-18T12:49:11.411 INFO:tasks.workunit.client.1.smithi148.stdout:0/546: truncate de/d27/d53/d89/fa8 793874 0 2024-09-18T12:49:11.412 INFO:tasks.workunit.client.1.smithi148.stdout:4/350: mknod d15/d17/d52/c6f 0 2024-09-18T12:49:11.412 INFO:tasks.workunit.client.1.smithi148.stdout:0/547: chown de/d14/d43/d70/d7f/f9f 169781 1 2024-09-18T12:49:11.416 INFO:tasks.workunit.client.1.smithi148.stdout:6/400: rename d5/d1a/d3d/l73 to d5/d1a/dc/d2b/d35/l80 0 2024-09-18T12:49:11.421 INFO:tasks.workunit.client.1.smithi148.stdout:0/548: rename de/d14/d43/d70/d7f to de/d27/d53/d89/dbb 0 2024-09-18T12:49:11.421 INFO:tasks.workunit.client.1.smithi148.stdout:6/401: rmdir d5/d32/d56 39 2024-09-18T12:49:11.421 INFO:tasks.workunit.client.1.smithi148.stdout:0/549: readlink de/d14/l8e 0 2024-09-18T12:49:11.425 INFO:tasks.workunit.client.1.smithi148.stdout:6/402: dwrite d5/d32/d38/f54 [0,4194304] 0 2024-09-18T12:49:11.428 INFO:tasks.workunit.client.1.smithi148.stdout:6/403: mknod d5/d32/d38/d50/c81 0 2024-09-18T12:49:11.431 INFO:tasks.workunit.client.1.smithi148.stdout:6/404: write d5/f19 [3278925,125567] 0 2024-09-18T12:49:11.434 INFO:tasks.workunit.client.1.smithi148.stdout:0/550: dwrite de/f1e [0,4194304] 0 2024-09-18T12:49:11.437 INFO:tasks.workunit.client.1.smithi148.stdout:0/551: rename de/d14/d6b/caa to de/d14/d6b/cbc 0 2024-09-18T12:49:11.440 INFO:tasks.workunit.client.1.smithi148.stdout:0/552: unlink de/d14/d43/d70/f82 0 2024-09-18T12:49:11.444 INFO:tasks.workunit.client.1.smithi148.stdout:0/553: mkdir de/d27/d53/d89/dbb/dab/dbd 0 2024-09-18T12:49:11.445 INFO:tasks.workunit.client.1.smithi148.stdout:6/405: write d5/d32/d56/f4d [587975,70936] 0 2024-09-18T12:49:11.446 INFO:tasks.workunit.client.1.smithi148.stdout:0/554: creat de/d27/d53/d89/dbb/dab/dbd/fbe x:0 0 0 2024-09-18T12:49:11.447 INFO:tasks.workunit.client.1.smithi148.stdout:0/555: dread - de/d14/d43/d70/f8d zero size 2024-09-18T12:49:11.447 INFO:tasks.workunit.client.1.smithi148.stdout:6/406: symlink d5/d1a/d29/l82 0 2024-09-18T12:49:11.448 INFO:tasks.workunit.client.1.smithi148.stdout:0/556: chown de/d27/d53/d89/dbb/f39 0 1 2024-09-18T12:49:11.451 INFO:tasks.workunit.client.1.smithi148.stdout:6/407: dread d5/d1a/d29/d5c/f77 [0,4194304] 0 2024-09-18T12:49:11.454 INFO:tasks.workunit.client.1.smithi148.stdout:6/408: read d5/d1a/dc/d2b/d35/d65/f4b [142075,63590] 0 2024-09-18T12:49:11.454 INFO:tasks.workunit.client.1.smithi148.stdout:0/557: dread f9 [0,4194304] 0 2024-09-18T12:49:11.455 INFO:tasks.workunit.client.1.smithi148.stdout:6/409: chown d5/d1a/dc/d2b/d35/d65/c45 722 1 2024-09-18T12:49:11.462 INFO:tasks.workunit.client.1.smithi148.stdout:6/410: dread d5/d1a/f1f [0,4194304] 0 2024-09-18T12:49:11.477 INFO:tasks.workunit.client.1.smithi148.stdout:6/411: dread d5/d1a/f37 [4194304,4194304] 0 2024-09-18T12:49:11.478 INFO:tasks.workunit.client.1.smithi148.stdout:6/412: fsync d5/d1a/f21 0 2024-09-18T12:49:11.480 INFO:tasks.workunit.client.1.smithi148.stdout:6/413: write d5/f19 [298141,120534] 0 2024-09-18T12:49:11.480 INFO:tasks.workunit.client.1.smithi148.stdout:9/355: sync 2024-09-18T12:49:11.480 INFO:tasks.workunit.client.1.smithi148.stdout:8/415: sync 2024-09-18T12:49:11.480 INFO:tasks.workunit.client.1.smithi148.stdout:2/295: sync 2024-09-18T12:49:11.481 INFO:tasks.workunit.client.1.smithi148.stdout:6/414: chown d5/d1a/f7f 888 1 2024-09-18T12:49:11.482 INFO:tasks.workunit.client.1.smithi148.stdout:9/356: mkdir d8/d6f 0 2024-09-18T12:49:11.484 INFO:tasks.workunit.client.1.smithi148.stdout:6/415: rename d5/d1a/dc/d2b/f57 to d5/d1a/d29/f83 0 2024-09-18T12:49:11.485 INFO:tasks.workunit.client.1.smithi148.stdout:2/296: getdents d9/d24 0 2024-09-18T12:49:11.486 INFO:tasks.workunit.client.1.smithi148.stdout:2/297: stat d9/f21 0 2024-09-18T12:49:11.540 INFO:tasks.workunit.client.1.smithi148.stdout:8/416: dwrite d8/d16/d53/d39/d3b/f63 [0,4194304] 0 2024-09-18T12:49:11.542 INFO:tasks.workunit.client.1.smithi148.stdout:6/416: getdents d5/d32/d38/d50 0 2024-09-18T12:49:11.544 INFO:tasks.workunit.client.1.smithi148.stdout:8/417: fsync d8/df/f73 0 2024-09-18T12:49:11.546 INFO:tasks.workunit.client.1.smithi148.stdout:6/417: mknod d5/c84 0 2024-09-18T12:49:11.548 INFO:tasks.workunit.client.1.smithi148.stdout:6/418: chown d5/d32/f76 94 1 2024-09-18T12:49:11.548 INFO:tasks.workunit.client.1.smithi148.stdout:2/298: dwrite d9/f43 [0,4194304] 0 2024-09-18T12:49:11.549 INFO:tasks.workunit.client.1.smithi148.stdout:8/418: creat d8/f92 x:0 0 0 2024-09-18T12:49:11.550 INFO:tasks.workunit.client.1.smithi148.stdout:8/419: dread - d8/f92 zero size 2024-09-18T12:49:11.550 INFO:tasks.workunit.client.1.smithi148.stdout:2/299: truncate d9/f40 1878590 0 2024-09-18T12:49:11.552 INFO:tasks.workunit.client.1.smithi148.stdout:2/300: write d9/d3a/f52 [4047493,95194] 0 2024-09-18T12:49:11.553 INFO:tasks.workunit.client.1.smithi148.stdout:2/301: fdatasync d9/f18 0 2024-09-18T12:49:11.555 INFO:tasks.workunit.client.1.smithi148.stdout:8/420: getdents d8/d12/d46/d7e 0 2024-09-18T12:49:11.556 INFO:tasks.workunit.client.1.smithi148.stdout:2/302: unlink d9/d24/f58 0 2024-09-18T12:49:11.556 INFO:tasks.workunit.client.1.smithi148.stdout:2/303: stat d9/d24/f28 0 2024-09-18T12:49:11.557 INFO:tasks.workunit.client.1.smithi148.stdout:8/421: truncate d8/d16/f4d 584773 0 2024-09-18T12:49:11.558 INFO:tasks.workunit.client.1.smithi148.stdout:2/304: mkdir d9/d4a/d64 0 2024-09-18T12:49:11.563 INFO:tasks.workunit.client.1.smithi148.stdout:8/422: dwrite d8/f68 [0,4194304] 0 2024-09-18T12:49:11.566 INFO:tasks.workunit.client.1.smithi148.stdout:3/340: sync 2024-09-18T12:49:11.567 INFO:tasks.workunit.client.1.smithi148.stdout:5/417: sync 2024-09-18T12:49:11.569 INFO:tasks.workunit.client.1.smithi148.stdout:5/418: unlink d7/d8/d18/f1a 0 2024-09-18T12:49:11.570 INFO:tasks.workunit.client.1.smithi148.stdout:3/341: creat d4/d8/d1e/d6b/f81 x:0 0 0 2024-09-18T12:49:11.572 INFO:tasks.workunit.client.1.smithi148.stdout:8/423: unlink d8/d16/f4d 0 2024-09-18T12:49:11.573 INFO:tasks.workunit.client.1.smithi148.stdout:8/424: write d8/f8c [318389,2827] 0 2024-09-18T12:49:11.573 INFO:tasks.workunit.client.1.smithi148.stdout:5/419: link d7/f4f d7/f8c 0 2024-09-18T12:49:11.574 INFO:tasks.workunit.client.1.smithi148.stdout:5/420: stat d7/d8/dc/f28 0 2024-09-18T12:49:11.575 INFO:tasks.workunit.client.1.smithi148.stdout:3/342: creat d4/d8/d1e/f82 x:0 0 0 2024-09-18T12:49:11.576 INFO:tasks.workunit.client.1.smithi148.stdout:5/421: chown d7/d8/dc/d12/d1f/d77/l7e 143851 1 2024-09-18T12:49:11.576 INFO:tasks.workunit.client.1.smithi148.stdout:8/425: unlink d8/d16/c72 0 2024-09-18T12:49:11.576 INFO:tasks.workunit.client.1.smithi148.stdout:3/343: write d4/d8/d1e/f5e [4726777,4893] 0 2024-09-18T12:49:11.578 INFO:tasks.workunit.client.1.smithi148.stdout:5/422: fdatasync d7/d8/dc/d12/d1f/d39/f41 0 2024-09-18T12:49:11.580 INFO:tasks.workunit.client.1.smithi148.stdout:3/344: mknod d4/d8/d1e/d6b/d31/d60/c83 0 2024-09-18T12:49:11.582 INFO:tasks.workunit.client.1.smithi148.stdout:2/305: dread d9/f40 [0,4194304] 0 2024-09-18T12:49:11.585 INFO:tasks.workunit.client.1.smithi148.stdout:8/426: dwrite d8/d16/d27/f30 [0,4194304] 0 2024-09-18T12:49:11.587 INFO:tasks.workunit.client.1.smithi148.stdout:3/345: getdents d4/d8/d20/d2b 0 2024-09-18T12:49:11.587 INFO:tasks.workunit.client.1.smithi148.stdout:5/423: dwrite d7/d2b/f36 [0,4194304] 0 2024-09-18T12:49:11.589 INFO:tasks.workunit.client.1.smithi148.stdout:2/306: rename d9/c2d to d9/c65 0 2024-09-18T12:49:11.591 INFO:tasks.workunit.client.1.smithi148.stdout:5/424: chown d7/d8/l71 14389 1 2024-09-18T12:49:11.592 INFO:tasks.workunit.client.1.smithi148.stdout:2/307: dread d9/d17/f2a [0,4194304] 0 2024-09-18T12:49:11.593 INFO:tasks.workunit.client.1.smithi148.stdout:8/427: rename d8/d16/d53/d39/d3b/d41/f4f to d8/d16/d27/f93 0 2024-09-18T12:49:11.594 INFO:tasks.workunit.client.1.smithi148.stdout:8/428: fdatasync d8/d16/f6f 0 2024-09-18T12:49:11.596 INFO:tasks.workunit.client.1.smithi148.stdout:5/425: symlink d7/d8/d18/d3f/d7c/l8d 0 2024-09-18T12:49:11.598 INFO:tasks.workunit.client.1.smithi148.stdout:5/426: write d7/d8/dc/d12/d1f/d39/f5e [358724,32694] 0 2024-09-18T12:49:11.602 INFO:tasks.workunit.client.1.smithi148.stdout:3/346: dread d4/d8/f15 [0,4194304] 0 2024-09-18T12:49:11.609 INFO:tasks.workunit.client.1.smithi148.stdout:1/371: sync 2024-09-18T12:49:11.609 INFO:tasks.workunit.client.1.smithi148.stdout:4/351: sync 2024-09-18T12:49:11.609 INFO:tasks.workunit.client.1.smithi148.stdout:7/395: sync 2024-09-18T12:49:11.609 INFO:tasks.workunit.client.1.smithi148.stdout:0/558: sync 2024-09-18T12:49:11.610 INFO:tasks.workunit.client.1.smithi148.stdout:7/396: dread - db/dc/df/d11/f6b zero size 2024-09-18T12:49:11.613 INFO:tasks.workunit.client.1.smithi148.stdout:7/397: creat db/dc/df/d1d/d41/f6f x:0 0 0 2024-09-18T12:49:11.614 INFO:tasks.workunit.client.1.smithi148.stdout:7/398: mkdir db/dc/d70 0 2024-09-18T12:49:11.615 INFO:tasks.workunit.client.1.smithi148.stdout:7/399: truncate db/d52/d25/f3c 707639 0 2024-09-18T12:49:11.648 INFO:tasks.workunit.client.1.smithi148.stdout:8/429: rename d8/d16/d53/d39/d3b/d41 to d8/d12/d51/d94 0 2024-09-18T12:49:11.649 INFO:tasks.workunit.client.1.smithi148.stdout:7/400: dread db/dc/df/d11/d34/f5a [0,4194304] 0 2024-09-18T12:49:11.650 INFO:tasks.workunit.client.1.smithi148.stdout:1/372: truncate dc/d11/d17/f21 1533883 0 2024-09-18T12:49:11.650 INFO:tasks.workunit.client.1.smithi148.stdout:4/352: write d15/d3f/f55 [825698,59861] 0 2024-09-18T12:49:11.651 INFO:tasks.workunit.client.1.smithi148.stdout:3/347: rename d4/fe to d4/d8/d1e/d79/f84 0 2024-09-18T12:49:11.652 INFO:tasks.workunit.client.1.smithi148.stdout:1/373: stat dc/d51/f70 0 2024-09-18T12:49:11.652 INFO:tasks.workunit.client.1.smithi148.stdout:5/427: dread d7/d8/d18/f38 [0,4194304] 0 2024-09-18T12:49:11.653 INFO:tasks.workunit.client.1.smithi148.stdout:8/430: mkdir d8/df/d3e/d82/d8f/d95 0 2024-09-18T12:49:11.653 INFO:tasks.workunit.client.1.smithi148.stdout:7/401: rmdir db/dc 39 2024-09-18T12:49:11.653 INFO:tasks.workunit.client.1.smithi148.stdout:4/353: chown d15/d17/f2b 4 1 2024-09-18T12:49:11.654 INFO:tasks.workunit.client.1.smithi148.stdout:1/374: chown dc/d11/d38/d72 120 1 2024-09-18T12:49:11.654 INFO:tasks.workunit.client.1.smithi148.stdout:3/348: symlink d4/d8/d1e/d79/l85 0 2024-09-18T12:49:11.656 INFO:tasks.workunit.client.1.smithi148.stdout:3/349: readlink d4/l1b 0 2024-09-18T12:49:11.657 INFO:tasks.workunit.client.1.smithi148.stdout:2/308: dwrite f7 [0,4194304] 0 2024-09-18T12:49:11.659 INFO:tasks.workunit.client.1.smithi148.stdout:2/309: chown d9/d24/d31/d34/f35 6 1 2024-09-18T12:49:11.661 INFO:tasks.workunit.client.1.smithi148.stdout:8/431: dwrite d8/f62 [0,4194304] 0 2024-09-18T12:49:11.663 INFO:tasks.workunit.client.1.smithi148.stdout:8/432: write d8/d12/d51/d94/f78 [951540,20533] 0 2024-09-18T12:49:11.691 INFO:tasks.workunit.client.1.smithi148.stdout:9/357: sync 2024-09-18T12:49:11.692 INFO:tasks.workunit.client.1.smithi148.stdout:6/419: sync 2024-09-18T12:49:11.697 INFO:tasks.workunit.client.1.smithi148.stdout:6/420: dwrite d5/d32/d56/f78 [0,4194304] 0 2024-09-18T12:49:11.698 INFO:tasks.workunit.client.1.smithi148.stdout:6/421: truncate d5/d32/d56/f78 5074604 0 2024-09-18T12:49:11.702 INFO:tasks.workunit.client.1.smithi148.stdout:6/422: dread d5/d32/d56/f78 [0,4194304] 0 2024-09-18T12:49:11.707 INFO:tasks.workunit.client.1.smithi148.stdout:6/423: dwrite d5/d32/d38/d50/f61 [0,4194304] 0 2024-09-18T12:49:11.711 INFO:tasks.workunit.client.1.smithi148.stdout:6/424: dread d5/d32/d38/d50/f61 [0,4194304] 0 2024-09-18T12:49:11.716 INFO:tasks.workunit.client.1.smithi148.stdout:6/425: dread d5/d1a/d29/f6e [0,4194304] 0 2024-09-18T12:49:11.743 INFO:tasks.workunit.client.1.smithi148.stdout:0/559: sync 2024-09-18T12:49:11.750 INFO:tasks.workunit.client.1.smithi148.stdout:5/428: unlink d7/d8/dc/d12/d1f/d25/f54 0 2024-09-18T12:49:11.751 INFO:tasks.workunit.client.1.smithi148.stdout:5/429: chown d7/d8/dc/d12/f51 458 1 2024-09-18T12:49:11.761 INFO:tasks.workunit.client.1.smithi148.stdout:4/354: write d15/d6a/d4c/d4f/f61 [2503896,83170] 0 2024-09-18T12:49:11.766 INFO:tasks.workunit.client.1.smithi148.stdout:6/426: truncate d5/d1a/f1f 620185 0 2024-09-18T12:49:11.767 INFO:tasks.workunit.client.1.smithi148.stdout:6/427: fsync d5/d1a/d29/f5d 0 2024-09-18T12:49:11.771 INFO:tasks.workunit.client.1.smithi148.stdout:7/402: creat db/dc/df/d11/d34/d69/f71 x:0 0 0 2024-09-18T12:49:11.772 INFO:tasks.workunit.client.1.smithi148.stdout:8/433: creat d8/d16/d53/d39/d3b/d4e/f96 x:0 0 0 2024-09-18T12:49:11.774 INFO:tasks.workunit.client.1.smithi148.stdout:4/355: write d15/f2d [3550862,129835] 0 2024-09-18T12:49:11.775 INFO:tasks.workunit.client.1.smithi148.stdout:5/430: dwrite d7/d8/f1c [4194304,4194304] 0 2024-09-18T12:49:11.776 INFO:tasks.workunit.client.1.smithi148.stdout:1/375: truncate dc/f25 2601794 0 2024-09-18T12:49:11.777 INFO:tasks.workunit.client.1.smithi148.stdout:1/376: stat dc/d11/d17/d2b/l62 0 2024-09-18T12:49:11.778 INFO:tasks.workunit.client.1.smithi148.stdout:6/428: mknod d5/d1a/dc/d2b/c85 0 2024-09-18T12:49:11.778 INFO:tasks.workunit.client.1.smithi148.stdout:3/350: sync 2024-09-18T12:49:11.779 INFO:tasks.workunit.client.1.smithi148.stdout:3/351: write d4/d8/d1e/f5e [8852576,72967] 0 2024-09-18T12:49:11.780 INFO:tasks.workunit.client.1.smithi148.stdout:2/310: rename d9/d17/f2a to d9/d24/d31/f66 0 2024-09-18T12:49:11.781 INFO:tasks.workunit.client.1.smithi148.stdout:4/356: dread d15/d6a/d4c/d4f/f3d [0,4194304] 0 2024-09-18T12:49:11.783 INFO:tasks.workunit.client.1.smithi148.stdout:8/434: creat d8/d16/d53/d39/d3b/d4e/f97 x:0 0 0 2024-09-18T12:49:11.785 INFO:tasks.workunit.client.1.smithi148.stdout:5/431: mknod d7/c8e 0 2024-09-18T12:49:11.786 INFO:tasks.workunit.client.1.smithi148.stdout:1/377: mknod dc/d18/d43/c7c 0 2024-09-18T12:49:11.788 INFO:tasks.workunit.client.1.smithi148.stdout:7/403: rename db/dc/df/d11/f51 to db/dc/df/d11/d43/f72 0 2024-09-18T12:49:11.789 INFO:tasks.workunit.client.1.smithi148.stdout:2/311: mkdir d9/d24/d67 0 2024-09-18T12:49:11.789 INFO:tasks.workunit.client.1.smithi148.stdout:9/358: link d8/l5f d8/l70 0 2024-09-18T12:49:11.790 INFO:tasks.workunit.client.1.smithi148.stdout:3/352: fsync d4/d8/d1e/d6b/f3e 0 2024-09-18T12:49:11.790 INFO:tasks.workunit.client.1.smithi148.stdout:2/312: stat d9/d24/d47/f5e 0 2024-09-18T12:49:11.791 INFO:tasks.workunit.client.1.smithi148.stdout:5/432: symlink d7/d2b/l8f 0 2024-09-18T12:49:11.793 INFO:tasks.workunit.client.1.smithi148.stdout:8/435: chown d8/d12/d51/d94/c84 7631380 1 2024-09-18T12:49:11.793 INFO:tasks.workunit.client.1.smithi148.stdout:6/429: mknod d5/d1a/dc/d2b/d35/c86 0 2024-09-18T12:49:11.793 INFO:tasks.workunit.client.1.smithi148.stdout:0/560: getdents de/d27 0 2024-09-18T12:49:11.794 INFO:tasks.workunit.client.1.smithi148.stdout:9/359: creat d8/da/dd/d35/d47/d4e/f71 x:0 0 0 2024-09-18T12:49:11.795 INFO:tasks.workunit.client.1.smithi148.stdout:7/404: dread db/dc/df/d11/d34/f61 [0,4194304] 0 2024-09-18T12:49:11.795 INFO:tasks.workunit.client.1.smithi148.stdout:1/378: mkdir dc/d18/d7d 0 2024-09-18T12:49:11.795 INFO:tasks.workunit.client.1.smithi148.stdout:8/436: mknod d8/d16/c98 0 2024-09-18T12:49:11.796 INFO:tasks.workunit.client.1.smithi148.stdout:2/313: symlink d9/l68 0 2024-09-18T12:49:11.798 INFO:tasks.workunit.client.1.smithi148.stdout:0/561: symlink de/d27/d53/d89/d9d/da4/lbf 0 2024-09-18T12:49:11.798 INFO:tasks.workunit.client.1.smithi148.stdout:8/437: read - d8/d16/d53/d39/d3b/d4e/f96 zero size 2024-09-18T12:49:11.800 INFO:tasks.workunit.client.1.smithi148.stdout:1/379: mkdir dc/d18/d7d/d7e 0 2024-09-18T12:49:11.800 INFO:tasks.workunit.client.1.smithi148.stdout:7/405: creat db/dc/df/d2c/d55/f73 x:0 0 0 2024-09-18T12:49:11.801 INFO:tasks.workunit.client.1.smithi148.stdout:2/314: creat d9/d24/d31/d34/d42/f69 x:0 0 0 2024-09-18T12:49:11.803 INFO:tasks.workunit.client.1.smithi148.stdout:6/430: getdents d5/d1a/d29/d5c 0 2024-09-18T12:49:11.804 INFO:tasks.workunit.client.1.smithi148.stdout:1/380: write dc/d11/d17/f35 [979279,94794] 0 2024-09-18T12:49:11.805 INFO:tasks.workunit.client.1.smithi148.stdout:9/360: getdents d8/da/dd/d4a/d49 0 2024-09-18T12:49:11.805 INFO:tasks.workunit.client.1.smithi148.stdout:8/438: chown d8/d16/d53/c7b 11783 1 2024-09-18T12:49:11.806 INFO:tasks.workunit.client.1.smithi148.stdout:3/353: dwrite d4/d8/d20/d2b/f2c [4194304,4194304] 0 2024-09-18T12:49:11.810 INFO:tasks.workunit.client.1.smithi148.stdout:0/562: rename de/d27/d53/d89/dbb/dab to de/d27/d53/d89/dc0 0 2024-09-18T12:49:11.811 INFO:tasks.workunit.client.1.smithi148.stdout:1/381: truncate dc/d11/d17/d2b/f47 404468 0 2024-09-18T12:49:11.813 INFO:tasks.workunit.client.1.smithi148.stdout:6/431: symlink d5/d79/d7c/l87 0 2024-09-18T12:49:11.813 INFO:tasks.workunit.client.1.smithi148.stdout:3/354: truncate d4/d8/d20/d2b/d43/f4b 134288 0 2024-09-18T12:49:11.813 INFO:tasks.workunit.client.1.smithi148.stdout:0/563: write de/d14/f83 [738677,51948] 0 2024-09-18T12:49:11.816 INFO:tasks.workunit.client.1.smithi148.stdout:2/315: dwrite d9/d24/d31/f62 [0,4194304] 0 2024-09-18T12:49:11.817 INFO:tasks.workunit.client.1.smithi148.stdout:1/382: write dc/d11/d17/d2b/f47 [1414804,99526] 0 2024-09-18T12:49:11.817 INFO:tasks.workunit.client.1.smithi148.stdout:7/406: rename db/dc/df/d2c/c3e to db/dc/df/d1d/d41/c74 0 2024-09-18T12:49:11.817 INFO:tasks.workunit.client.1.smithi148.stdout:8/439: dread d8/f62 [0,4194304] 0 2024-09-18T12:49:11.819 INFO:tasks.workunit.client.1.smithi148.stdout:3/355: creat d4/d8/d1e/d63/f86 x:0 0 0 2024-09-18T12:49:11.821 INFO:tasks.workunit.client.1.smithi148.stdout:5/433: truncate d7/d8/fa 5065762 0 2024-09-18T12:49:11.822 INFO:tasks.workunit.client.1.smithi148.stdout:7/407: truncate db/dc/df/d11/f1b 1745583 0 2024-09-18T12:49:11.822 INFO:tasks.workunit.client.1.smithi148.stdout:0/564: rename de/d14/d43/dac to de/d27/d53/d89/dc1 0 2024-09-18T12:49:11.823 INFO:tasks.workunit.client.1.smithi148.stdout:0/565: readlink l6 0 2024-09-18T12:49:11.824 INFO:tasks.workunit.client.1.smithi148.stdout:8/440: rename d8/df/d3e/f54 to d8/df/d3e/f99 0 2024-09-18T12:49:11.825 INFO:tasks.workunit.client.1.smithi148.stdout:2/316: creat d9/d17/f6a x:0 0 0 2024-09-18T12:49:11.826 INFO:tasks.workunit.client.1.smithi148.stdout:5/434: mknod d7/d8/dc/d12/d1f/d77/c90 0 2024-09-18T12:49:11.826 INFO:tasks.workunit.client.1.smithi148.stdout:2/317: write d9/f16 [784737,129166] 0 2024-09-18T12:49:11.829 INFO:tasks.workunit.client.1.smithi148.stdout:1/383: rename dc/d18/d31/l33 to dc/d18/d7d/l7f 0 2024-09-18T12:49:11.833 INFO:tasks.workunit.client.1.smithi148.stdout:0/566: unlink de/d14/d93/fa5 0 2024-09-18T12:49:11.833 INFO:tasks.workunit.client.1.smithi148.stdout:3/356: symlink d4/d8/d20/d2b/d7f/l87 0 2024-09-18T12:49:11.833 INFO:tasks.workunit.client.1.smithi148.stdout:8/441: rmdir d8/d12/d51/d94 39 2024-09-18T12:49:11.833 INFO:tasks.workunit.client.1.smithi148.stdout:0/567: dread - de/d27/d53/d89/f91 zero size 2024-09-18T12:49:11.835 INFO:tasks.workunit.client.1.smithi148.stdout:5/435: dwrite d7/fd [0,4194304] 0 2024-09-18T12:49:11.836 INFO:tasks.workunit.client.1.smithi148.stdout:2/318: creat d9/d4a/f6b x:0 0 0 2024-09-18T12:49:11.837 INFO:tasks.workunit.client.1.smithi148.stdout:9/361: dread d8/da/dd/d4a/f15 [4194304,4194304] 0 2024-09-18T12:49:11.837 INFO:tasks.workunit.client.1.smithi148.stdout:5/436: dread - d7/d8/f87 zero size 2024-09-18T12:49:11.838 INFO:tasks.workunit.client.1.smithi148.stdout:7/408: rename db/d52/d25/d2e to db/dc/d70/d75 0 2024-09-18T12:49:11.840 INFO:tasks.workunit.client.1.smithi148.stdout:1/384: mkdir dc/d11/d17/d2b/d80 0 2024-09-18T12:49:11.841 INFO:tasks.workunit.client.1.smithi148.stdout:5/437: write d7/d8/dc/d12/f45 [4076170,88049] 0 2024-09-18T12:49:11.844 INFO:tasks.workunit.client.1.smithi148.stdout:0/568: creat de/d27/d53/d89/fc2 x:0 0 0 2024-09-18T12:49:11.844 INFO:tasks.workunit.client.1.smithi148.stdout:3/357: creat d4/d8/d20/d2b/f88 x:0 0 0 2024-09-18T12:49:11.846 INFO:tasks.workunit.client.1.smithi148.stdout:2/319: mknod d9/d24/d31/d34/d42/c6c 0 2024-09-18T12:49:11.846 INFO:tasks.workunit.client.1.smithi148.stdout:7/409: dread db/dc/df/d11/f1b [0,4194304] 0 2024-09-18T12:49:11.846 INFO:tasks.workunit.client.1.smithi148.stdout:9/362: mkdir d8/da/dd/d35/d47/d62/d72 0 2024-09-18T12:49:11.848 INFO:tasks.workunit.client.1.smithi148.stdout:9/363: chown d8/da/dd/f1b 401 1 2024-09-18T12:49:11.849 INFO:tasks.workunit.client.1.smithi148.stdout:7/410: dread - db/dc/df/d1d/d41/f6f zero size 2024-09-18T12:49:11.852 INFO:tasks.workunit.client.1.smithi148.stdout:5/438: dread d7/d8/f13 [0,4194304] 0 2024-09-18T12:49:11.853 INFO:tasks.workunit.client.1.smithi148.stdout:0/569: fsync de/d14/f81 0 2024-09-18T12:49:11.855 INFO:tasks.workunit.client.1.smithi148.stdout:2/320: dwrite d9/d17/f45 [0,4194304] 0 2024-09-18T12:49:11.861 INFO:tasks.workunit.client.1.smithi148.stdout:9/364: rename d8/da/d56 to d8/d73 0 2024-09-18T12:49:11.861 INFO:tasks.workunit.client.1.smithi148.stdout:8/442: dwrite d8/d12/d51/d94/f4c [4194304,4194304] 0 2024-09-18T12:49:11.861 INFO:tasks.workunit.client.1.smithi148.stdout:0/570: rmdir de/d14/d43 39 2024-09-18T12:49:11.862 INFO:tasks.workunit.client.1.smithi148.stdout:2/321: symlink d9/d24/d31/d34/l6d 0 2024-09-18T12:49:11.862 INFO:tasks.workunit.client.1.smithi148.stdout:7/411: truncate db/dc/df/d1d/f21 4355395 0 2024-09-18T12:49:11.866 INFO:tasks.workunit.client.1.smithi148.stdout:7/412: truncate db/dc/d70/d75/f56 792660 0 2024-09-18T12:49:11.866 INFO:tasks.workunit.client.1.smithi148.stdout:9/365: fdatasync d8/da/dd/d35/d59/f69 0 2024-09-18T12:49:11.867 INFO:tasks.workunit.client.1.smithi148.stdout:8/443: mknod d8/d12/d51/d94/c9a 0 2024-09-18T12:49:11.867 INFO:tasks.workunit.client.1.smithi148.stdout:7/413: chown db/d52/d1f/c27 34942088 1 2024-09-18T12:49:11.868 INFO:tasks.workunit.client.1.smithi148.stdout:0/571: creat de/d14/d93/fc3 x:0 0 0 2024-09-18T12:49:11.869 INFO:tasks.workunit.client.1.smithi148.stdout:7/414: creat db/dc/df/d11/d34/f76 x:0 0 0 2024-09-18T12:49:11.872 INFO:tasks.workunit.client.1.smithi148.stdout:8/444: getdents d8/df/d3e/d82 0 2024-09-18T12:49:11.874 INFO:tasks.workunit.client.1.smithi148.stdout:7/415: write db/dc/df/f29 [158647,129189] 0 2024-09-18T12:49:11.877 INFO:tasks.workunit.client.1.smithi148.stdout:8/445: creat d8/d12/d46/d74/f9b x:0 0 0 2024-09-18T12:49:11.877 INFO:tasks.workunit.client.1.smithi148.stdout:0/572: dwrite de/d27/f45 [0,4194304] 0 2024-09-18T12:49:11.877 INFO:tasks.workunit.client.1.smithi148.stdout:1/385: dread dc/d11/f12 [0,4194304] 0 2024-09-18T12:49:11.879 INFO:tasks.workunit.client.1.smithi148.stdout:7/416: rename db/dc/d6a to db/dc/d70/d77 0 2024-09-18T12:49:11.880 INFO:tasks.workunit.client.1.smithi148.stdout:0/573: stat de/d14/d43/d57/l8c 0 2024-09-18T12:49:11.882 INFO:tasks.workunit.client.1.smithi148.stdout:0/574: readlink de/d14/l42 0 2024-09-18T12:49:11.883 INFO:tasks.workunit.client.1.smithi148.stdout:1/386: truncate dc/d18/d43/f4e 2852758 0 2024-09-18T12:49:11.884 INFO:tasks.workunit.client.1.smithi148.stdout:0/575: creat de/d14/d43/d57/d59/fc4 x:0 0 0 2024-09-18T12:49:11.890 INFO:tasks.workunit.client.1.smithi148.stdout:2/322: dread d9/d17/f4e [0,4194304] 0 2024-09-18T12:49:11.901 INFO:tasks.workunit.client.1.smithi148.stdout:4/357: sync 2024-09-18T12:49:11.909 INFO:tasks.workunit.client.0.smithi078.stdout:1/223: sync 2024-09-18T12:49:11.909 INFO:tasks.workunit.client.0.smithi078.stdout:0/301: sync 2024-09-18T12:49:11.914 INFO:tasks.workunit.client.0.smithi078.stdout:0/302: creat d3/d1f/f6f x:0 0 0 2024-09-18T12:49:11.916 INFO:tasks.workunit.client.0.smithi078.stdout:0/303: chown d3/d1f/d2e/d4e/c5b 6204 1 2024-09-18T12:49:11.917 INFO:tasks.workunit.client.0.smithi078.stdout:0/304: rename d3 to d3/d1f/d2e/d4e/d37/d70 22 2024-09-18T12:49:11.919 INFO:tasks.workunit.client.1.smithi148.stdout:1/387: dread dc/f13 [0,4194304] 0 2024-09-18T12:49:11.920 INFO:tasks.workunit.client.1.smithi148.stdout:2/323: fdatasync d9/d24/f32 0 2024-09-18T12:49:11.920 INFO:tasks.workunit.client.1.smithi148.stdout:8/446: dread d8/d16/d27/f93 [0,4194304] 0 2024-09-18T12:49:11.920 INFO:tasks.workunit.client.1.smithi148.stdout:4/358: rmdir d15/d17 39 2024-09-18T12:49:11.920 INFO:tasks.workunit.client.1.smithi148.stdout:1/388: stat dc/d11/d17/d2b/l62 0 2024-09-18T12:49:11.922 INFO:tasks.workunit.client.1.smithi148.stdout:3/358: write d4/d8/d20/d2b/f45 [2517042,40079] 0 2024-09-18T12:49:11.923 INFO:tasks.workunit.client.1.smithi148.stdout:8/447: write d8/d16/d53/d39/f3d [3761554,98269] 0 2024-09-18T12:49:11.924 INFO:tasks.workunit.client.1.smithi148.stdout:2/324: creat d9/d24/d31/d34/f6e x:0 0 0 2024-09-18T12:49:11.925 INFO:tasks.workunit.client.0.smithi078.stdout:0/305: dwrite d3/d1f/d2e/d4e/d37/f5c [0,4194304] 0 2024-09-18T12:49:11.927 INFO:tasks.workunit.client.1.smithi148.stdout:3/359: readlink d4/ld 0 2024-09-18T12:49:11.927 INFO:tasks.workunit.client.0.smithi078.stdout:1/224: dread d0/d8/f14 [0,4194304] 0 2024-09-18T12:49:11.928 INFO:tasks.workunit.client.1.smithi148.stdout:1/389: truncate dc/d18/d31/d39/f40 1992777 0 2024-09-18T12:49:11.928 INFO:tasks.workunit.client.1.smithi148.stdout:8/448: rmdir d8/df/d3e/d82 39 2024-09-18T12:49:11.928 INFO:tasks.workunit.client.0.smithi078.stdout:1/225: truncate d0/d37/f48 102014 0 2024-09-18T12:49:11.929 INFO:tasks.workunit.client.0.smithi078.stdout:0/306: symlink d3/d1f/d2e/d4e/l71 0 2024-09-18T12:49:11.929 INFO:tasks.workunit.client.0.smithi078.stdout:1/226: fdatasync d0/d8/da/d3e/f42 0 2024-09-18T12:49:11.930 INFO:tasks.workunit.client.1.smithi148.stdout:2/325: symlink d9/d24/d31/d34/l6f 0 2024-09-18T12:49:11.931 INFO:tasks.workunit.client.0.smithi078.stdout:1/227: creat d0/f49 x:0 0 0 2024-09-18T12:49:11.932 INFO:tasks.workunit.client.1.smithi148.stdout:1/390: dread dc/d11/f16 [0,4194304] 0 2024-09-18T12:49:11.932 INFO:tasks.workunit.client.0.smithi078.stdout:0/307: mkdir d3/d1f/d2e/d4e/d37/d72 0 2024-09-18T12:49:11.934 INFO:tasks.workunit.client.1.smithi148.stdout:0/576: dread de/d27/f64 [0,4194304] 0 2024-09-18T12:49:11.934 INFO:tasks.workunit.client.1.smithi148.stdout:2/326: mknod d9/d24/d47/c70 0 2024-09-18T12:49:11.934 INFO:tasks.workunit.client.1.smithi148.stdout:8/449: dwrite d8/fb [0,4194304] 0 2024-09-18T12:49:11.934 INFO:tasks.workunit.client.0.smithi078.stdout:0/308: mknod d3/d1f/d2e/d4e/d37/c73 0 2024-09-18T12:49:11.935 INFO:tasks.workunit.client.1.smithi148.stdout:8/450: readlink d8/d12/l5e 0 2024-09-18T12:49:11.935 INFO:tasks.workunit.client.1.smithi148.stdout:1/391: symlink dc/d11/d17/d2b/l81 0 2024-09-18T12:49:11.940 INFO:tasks.workunit.client.0.smithi078.stdout:0/309: dwrite d3/d1f/f63 [0,4194304] 0 2024-09-18T12:49:11.941 INFO:tasks.workunit.client.1.smithi148.stdout:1/392: creat dc/d11/d17/f82 x:0 0 0 2024-09-18T12:49:11.943 INFO:tasks.workunit.client.1.smithi148.stdout:1/393: write dc/d18/d31/d4b/f65 [8716996,94734] 0 2024-09-18T12:49:11.943 INFO:tasks.workunit.client.0.smithi078.stdout:0/310: symlink d3/d1f/d2e/d4e/d37/d72/l74 0 2024-09-18T12:49:11.949 INFO:tasks.workunit.client.1.smithi148.stdout:2/327: dread d9/d3a/f52 [0,4194304] 0 2024-09-18T12:49:11.949 INFO:tasks.workunit.client.0.smithi078.stdout:0/311: dwrite d3/d1f/d2e/d68/f44 [0,4194304] 0 2024-09-18T12:49:11.951 INFO:tasks.workunit.client.0.smithi078.stdout:0/312: symlink d3/l75 0 2024-09-18T12:49:11.952 INFO:tasks.workunit.client.1.smithi148.stdout:0/577: dread de/d27/d53/d89/dbb/f39 [0,4194304] 0 2024-09-18T12:49:11.953 INFO:tasks.workunit.client.1.smithi148.stdout:2/328: creat d9/f71 x:0 0 0 2024-09-18T12:49:11.953 INFO:tasks.workunit.client.1.smithi148.stdout:2/329: chown d9/d17 5673247 1 2024-09-18T12:49:11.954 INFO:tasks.workunit.client.1.smithi148.stdout:0/578: dread de/d27/d53/d89/dbb/f41 [0,4194304] 0 2024-09-18T12:49:11.955 INFO:tasks.workunit.client.1.smithi148.stdout:0/579: chown f9 0 1 2024-09-18T12:49:11.957 INFO:tasks.workunit.client.1.smithi148.stdout:2/330: mkdir d9/d24/d67/d72 0 2024-09-18T12:49:11.957 INFO:tasks.workunit.client.1.smithi148.stdout:2/331: read d9/f40 [791435,1784] 0 2024-09-18T12:49:11.958 INFO:tasks.workunit.client.1.smithi148.stdout:2/332: fdatasync d9/d24/d31/d34/d42/f69 0 2024-09-18T12:49:11.958 INFO:tasks.workunit.client.1.smithi148.stdout:0/580: unlink de/d27/d53/d89/fa8 0 2024-09-18T12:49:11.960 INFO:tasks.workunit.client.1.smithi148.stdout:0/581: unlink de/f4f 0 2024-09-18T12:49:11.961 INFO:tasks.workunit.client.1.smithi148.stdout:2/333: mkdir d9/d73 0 2024-09-18T12:49:11.962 INFO:tasks.workunit.client.1.smithi148.stdout:2/334: write d9/d24/d31/d34/d57/f60 [115854,36195] 0 2024-09-18T12:49:11.962 INFO:tasks.workunit.client.1.smithi148.stdout:0/582: creat de/d14/d43/d57/fc5 x:0 0 0 2024-09-18T12:49:11.965 INFO:tasks.workunit.client.1.smithi148.stdout:2/335: mknod d9/d24/d31/c74 0 2024-09-18T12:49:11.971 INFO:tasks.workunit.client.1.smithi148.stdout:0/583: dread f1 [0,4194304] 0 2024-09-18T12:49:11.971 INFO:tasks.workunit.client.1.smithi148.stdout:0/584: read - de/d27/d7a/f92 zero size 2024-09-18T12:49:11.972 INFO:tasks.workunit.client.1.smithi148.stdout:0/585: readlink de/d27/d53/d89/d9d/da4/lbf 0 2024-09-18T12:49:11.973 INFO:tasks.workunit.client.1.smithi148.stdout:0/586: chown de/d14/f2a 722789 1 2024-09-18T12:49:11.978 INFO:tasks.workunit.client.1.smithi148.stdout:0/587: dwrite de/d14/f28 [0,4194304] 0 2024-09-18T12:49:11.980 INFO:tasks.workunit.client.1.smithi148.stdout:0/588: unlink de/d14/d43/d57/d59/fc4 0 2024-09-18T12:49:11.996 INFO:tasks.workunit.client.1.smithi148.stdout:6/432: sync 2024-09-18T12:49:12.028 INFO:tasks.workunit.client.1.smithi148.stdout:5/439: chown d7/d8/fa 1 1 2024-09-18T12:49:12.029 INFO:tasks.workunit.client.1.smithi148.stdout:9/366: dwrite d8/d33/f42 [0,4194304] 0 2024-09-18T12:49:12.030 INFO:tasks.workunit.client.1.smithi148.stdout:9/367: fdatasync d8/f10 0 2024-09-18T12:49:12.033 INFO:tasks.workunit.client.1.smithi148.stdout:9/368: creat d8/da/dd/d35/d47/d62/d72/f74 x:0 0 0 2024-09-18T12:49:12.034 INFO:tasks.workunit.client.1.smithi148.stdout:9/369: dread - d8/da/dd/d35/d47/d4e/f71 zero size 2024-09-18T12:49:12.036 INFO:tasks.workunit.client.1.smithi148.stdout:9/370: rmdir d8/da/dd/d35/d47/d62/d72 39 2024-09-18T12:49:12.043 INFO:tasks.workunit.client.1.smithi148.stdout:9/371: dwrite d8/da/dd/d35/d47/d62/f3b [4194304,4194304] 0 2024-09-18T12:49:12.051 INFO:tasks.workunit.client.1.smithi148.stdout:9/372: dwrite d8/da/dd/d35/d47/d62/d72/f74 [0,4194304] 0 2024-09-18T12:49:12.053 INFO:tasks.workunit.client.1.smithi148.stdout:4/359: write fe [2508207,113661] 0 2024-09-18T12:49:12.058 INFO:tasks.workunit.client.1.smithi148.stdout:4/360: readlink d15/d17/l4a 0 2024-09-18T12:49:12.062 INFO:tasks.workunit.client.1.smithi148.stdout:2/336: getdents d9/d24/d47 0 2024-09-18T12:49:12.062 INFO:tasks.workunit.client.1.smithi148.stdout:4/361: fsync d15/d6a/d4c/d4f/f20 0 2024-09-18T12:49:12.063 INFO:tasks.workunit.client.0.smithi078.stdout:1/228: mknod d0/d8/da/d3e/d46/c4a 0 2024-09-18T12:49:12.065 INFO:tasks.workunit.client.1.smithi148.stdout:3/360: dwrite d4/d8/d20/f3d [0,4194304] 0 2024-09-18T12:49:12.066 INFO:tasks.workunit.client.0.smithi078.stdout:1/229: fdatasync d0/d8/da/f40 0 2024-09-18T12:49:12.067 INFO:tasks.workunit.client.1.smithi148.stdout:2/337: creat d9/d3a/f75 x:0 0 0 2024-09-18T12:49:12.071 INFO:tasks.workunit.client.1.smithi148.stdout:2/338: truncate d9/d24/f32 3087320 0 2024-09-18T12:49:12.072 INFO:tasks.workunit.client.1.smithi148.stdout:7/417: sync 2024-09-18T12:49:12.073 INFO:tasks.workunit.client.1.smithi148.stdout:4/362: symlink d15/d5f/l70 0 2024-09-18T12:49:12.075 INFO:tasks.workunit.client.1.smithi148.stdout:8/451: dwrite d8/df/f73 [0,4194304] 0 2024-09-18T12:49:12.077 INFO:tasks.workunit.client.1.smithi148.stdout:8/452: truncate d8/d12/d51/d94/f64 291846 0 2024-09-18T12:49:12.078 INFO:tasks.workunit.client.0.smithi078.stdout:1/230: creat d0/f4b x:0 0 0 2024-09-18T12:49:12.079 INFO:tasks.workunit.client.1.smithi148.stdout:3/361: dread d4/f18 [0,4194304] 0 2024-09-18T12:49:12.079 INFO:tasks.workunit.client.0.smithi078.stdout:0/313: creat d3/d1f/d2e/f76 x:0 0 0 2024-09-18T12:49:12.080 INFO:tasks.workunit.client.0.smithi078.stdout:0/314: readlink d3/d1f/d2e/l33 0 2024-09-18T12:49:12.082 INFO:tasks.workunit.client.1.smithi148.stdout:2/339: rename d9/d24/d31/f5a to d9/d24/d67/f76 0 2024-09-18T12:49:12.086 INFO:tasks.workunit.client.0.smithi078.stdout:1/231: unlink d0/d8/da/c29 0 2024-09-18T12:49:12.091 INFO:tasks.workunit.client.1.smithi148.stdout:5/440: write d7/d8/dc/d22/f5f [285988,109911] 0 2024-09-18T12:49:12.092 INFO:tasks.workunit.client.1.smithi148.stdout:3/362: dread d4/d8/d20/f33 [0,4194304] 0 2024-09-18T12:49:12.094 INFO:tasks.workunit.client.0.smithi078.stdout:0/315: getdents d3/d1f/d2e/d68/d30 0 2024-09-18T12:49:12.095 INFO:tasks.workunit.client.1.smithi148.stdout:8/453: dwrite d8/df/d3e/f99 [0,4194304] 0 2024-09-18T12:49:12.096 INFO:tasks.workunit.client.1.smithi148.stdout:0/589: dwrite de/d27/f4e [0,4194304] 0 2024-09-18T12:49:12.096 INFO:tasks.workunit.client.0.smithi078.stdout:0/316: read - d3/d1f/d2e/d4e/f49 zero size 2024-09-18T12:49:12.097 INFO:tasks.workunit.client.1.smithi148.stdout:3/363: read d4/d8/d1e/d6b/d31/d59/f5f [3638751,9490] 0 2024-09-18T12:49:12.097 INFO:tasks.workunit.client.1.smithi148.stdout:8/454: fsync d8/df/f73 0 2024-09-18T12:49:12.098 INFO:tasks.workunit.client.0.smithi078.stdout:0/317: rmdir d3/d1f 39 2024-09-18T12:49:12.100 INFO:tasks.workunit.client.1.smithi148.stdout:4/363: getdents d15 0 2024-09-18T12:49:12.101 INFO:tasks.workunit.client.1.smithi148.stdout:4/364: readlink l11 0 2024-09-18T12:49:12.103 INFO:tasks.workunit.client.1.smithi148.stdout:0/590: dread de/d14/f2a [0,4194304] 0 2024-09-18T12:49:12.106 INFO:tasks.workunit.client.0.smithi078.stdout:0/318: mknod d3/d1f/d2e/c77 0 2024-09-18T12:49:12.108 INFO:tasks.workunit.client.1.smithi148.stdout:4/365: creat d15/d5f/f71 x:0 0 0 2024-09-18T12:49:12.111 INFO:tasks.workunit.client.1.smithi148.stdout:7/418: write db/dc/df/d2c/f5e [909611,84722] 0 2024-09-18T12:49:12.112 INFO:tasks.workunit.client.1.smithi148.stdout:1/394: dwrite dc/d18/d31/d39/f40 [0,4194304] 0 2024-09-18T12:49:12.116 INFO:tasks.workunit.client.1.smithi148.stdout:3/364: dwrite d4/d8/d1e/d6b/d31/f65 [0,4194304] 0 2024-09-18T12:49:12.117 INFO:tasks.workunit.client.0.smithi078.stdout:1/232: dwrite d0/d8/ff [4194304,4194304] 0 2024-09-18T12:49:12.118 INFO:tasks.workunit.client.1.smithi148.stdout:3/365: chown d4 460 1 2024-09-18T12:49:12.125 INFO:tasks.workunit.client.1.smithi148.stdout:0/591: dread de/f1e [0,4194304] 0 2024-09-18T12:49:12.127 INFO:tasks.workunit.client.0.smithi078.stdout:1/233: rmdir d0/d21/d41 0 2024-09-18T12:49:12.128 INFO:tasks.workunit.client.1.smithi148.stdout:5/441: dread d7/d8/dc/d12/f24 [0,4194304] 0 2024-09-18T12:49:12.129 INFO:tasks.workunit.client.1.smithi148.stdout:4/366: dwrite d15/d17/f1a [0,4194304] 0 2024-09-18T12:49:12.129 INFO:tasks.workunit.client.1.smithi148.stdout:8/455: dread d8/d12/f15 [0,4194304] 0 2024-09-18T12:49:12.131 INFO:tasks.workunit.client.1.smithi148.stdout:2/340: dwrite d9/f21 [0,4194304] 0 2024-09-18T12:49:12.131 INFO:tasks.workunit.client.1.smithi148.stdout:6/433: sync 2024-09-18T12:49:12.132 INFO:tasks.workunit.client.1.smithi148.stdout:3/366: getdents d4/d8/d1e/d6b/d31/d54 0 2024-09-18T12:49:12.138 INFO:tasks.workunit.client.0.smithi078.stdout:0/319: dread d3/f18 [0,4194304] 0 2024-09-18T12:49:12.139 INFO:tasks.workunit.client.1.smithi148.stdout:4/367: mkdir d15/d6a/d4c/d72 0 2024-09-18T12:49:12.140 INFO:tasks.workunit.client.1.smithi148.stdout:8/456: creat d8/d16/f9c x:0 0 0 2024-09-18T12:49:12.141 INFO:tasks.workunit.client.1.smithi148.stdout:4/368: stat d15/d17/d52/f65 0 2024-09-18T12:49:12.144 INFO:tasks.workunit.client.1.smithi148.stdout:2/341: mkdir d9/d24/d67/d72/d77 0 2024-09-18T12:49:12.145 INFO:tasks.workunit.client.1.smithi148.stdout:5/442: getdents d7/d8 0 2024-09-18T12:49:12.146 INFO:tasks.workunit.client.1.smithi148.stdout:6/434: mknod d5/d1a/dc/c88 0 2024-09-18T12:49:12.147 INFO:tasks.workunit.client.1.smithi148.stdout:8/457: creat d8/d16/f9d x:0 0 0 2024-09-18T12:49:12.150 INFO:tasks.workunit.client.1.smithi148.stdout:6/435: write d5/d32/f64 [306756,113733] 0 2024-09-18T12:49:12.152 INFO:tasks.workunit.client.1.smithi148.stdout:2/342: rename d9/d24/l33 to d9/d24/d31/d34/l78 0 2024-09-18T12:49:12.152 INFO:tasks.workunit.client.1.smithi148.stdout:7/419: dwrite db/d52/d1f/f4d [0,4194304] 0 2024-09-18T12:49:12.154 INFO:tasks.workunit.client.1.smithi148.stdout:5/443: dread d7/d8/dc/d12/d20/f53 [0,4194304] 0 2024-09-18T12:49:12.157 INFO:tasks.workunit.client.1.smithi148.stdout:4/369: dwrite d15/d6a/f2e [0,4194304] 0 2024-09-18T12:49:12.158 INFO:tasks.workunit.client.1.smithi148.stdout:6/436: mknod d5/d32/c89 0 2024-09-18T12:49:12.160 INFO:tasks.workunit.client.1.smithi148.stdout:4/370: chown lf 492 1 2024-09-18T12:49:12.162 INFO:tasks.workunit.client.1.smithi148.stdout:5/444: mknod d7/d8/d18/d3f/c91 0 2024-09-18T12:49:12.163 INFO:tasks.workunit.client.0.smithi078.stdout:1/234: dread d0/d8/da/f40 [0,4194304] 0 2024-09-18T12:49:12.163 INFO:tasks.workunit.client.1.smithi148.stdout:6/437: rmdir d5/d1a/dc/d2b/d35/d65 39 2024-09-18T12:49:12.164 INFO:tasks.workunit.client.1.smithi148.stdout:2/343: dread d9/d3a/f52 [0,4194304] 0 2024-09-18T12:49:12.165 INFO:tasks.workunit.client.1.smithi148.stdout:8/458: link d8/d16/d27/l1f d8/d16/l9e 0 2024-09-18T12:49:12.166 INFO:tasks.workunit.client.0.smithi078.stdout:0/320: write d3/f18 [495215,8428] 0 2024-09-18T12:49:12.166 INFO:tasks.workunit.client.0.smithi078.stdout:1/235: dread - d0/d37/f3c zero size 2024-09-18T12:49:12.167 INFO:tasks.workunit.client.1.smithi148.stdout:5/445: write d7/d8/d18/d3f/f70 [932218,99972] 0 2024-09-18T12:49:12.167 INFO:tasks.workunit.client.0.smithi078.stdout:1/236: dread - d0/d8/da/d3e/f42 zero size 2024-09-18T12:49:12.168 INFO:tasks.workunit.client.0.smithi078.stdout:0/321: write d3/d1f/d2e/d4e/d37/f51 [2383732,90009] 0 2024-09-18T12:49:12.170 INFO:tasks.workunit.client.1.smithi148.stdout:1/395: dread dc/d18/d31/d4b/f65 [4194304,4194304] 0 2024-09-18T12:49:12.172 INFO:tasks.workunit.client.1.smithi148.stdout:8/459: mknod d8/d16/d53/d39/c9f 0 2024-09-18T12:49:12.172 INFO:tasks.workunit.client.1.smithi148.stdout:5/446: chown d7/d8/dc/d12/d1f/f2c 151122 1 2024-09-18T12:49:12.173 INFO:tasks.workunit.client.0.smithi078.stdout:0/322: creat d3/d1f/d2e/d4e/d37/d72/f78 x:0 0 0 2024-09-18T12:49:12.173 INFO:tasks.workunit.client.0.smithi078.stdout:2/232: sync 2024-09-18T12:49:12.173 INFO:tasks.workunit.client.0.smithi078.stdout:4/198: sync 2024-09-18T12:49:12.176 INFO:tasks.workunit.client.0.smithi078.stdout:1/237: dwrite d0/f4b [0,4194304] 0 2024-09-18T12:49:12.176 INFO:tasks.workunit.client.1.smithi148.stdout:3/367: dwrite d4/f18 [0,4194304] 0 2024-09-18T12:49:12.178 INFO:tasks.workunit.client.1.smithi148.stdout:8/460: write d8/d16/d53/d39/f3d [3001333,39315] 0 2024-09-18T12:49:12.179 INFO:tasks.workunit.client.1.smithi148.stdout:2/344: dwrite d9/d24/f25 [0,4194304] 0 2024-09-18T12:49:12.180 INFO:tasks.workunit.client.0.smithi078.stdout:4/199: mknod d11/d1f/d24/c43 0 2024-09-18T12:49:12.182 INFO:tasks.workunit.client.1.smithi148.stdout:4/371: link d15/d17/l4e d15/d17/d52/d68/l73 0 2024-09-18T12:49:12.183 INFO:tasks.workunit.client.0.smithi078.stdout:0/323: symlink d3/d1f/d2e/d4e/d37/l79 0 2024-09-18T12:49:12.184 INFO:tasks.workunit.client.0.smithi078.stdout:2/233: rmdir d4/d20 39 2024-09-18T12:49:12.185 INFO:tasks.workunit.client.0.smithi078.stdout:2/234: chown d4/db/c47 42 1 2024-09-18T12:49:12.189 INFO:tasks.workunit.client.1.smithi148.stdout:3/368: dread - d4/d8/d20/d2b/d43/f21 zero size 2024-09-18T12:49:12.189 INFO:tasks.workunit.client.1.smithi148.stdout:5/447: dwrite d7/d2b/f3c [4194304,4194304] 0 2024-09-18T12:49:12.190 INFO:tasks.workunit.client.1.smithi148.stdout:3/369: read - d4/f7a zero size 2024-09-18T12:49:12.190 INFO:tasks.workunit.client.1.smithi148.stdout:8/461: mkdir d8/d16/d53/da0 0 2024-09-18T12:49:12.190 INFO:tasks.workunit.client.1.smithi148.stdout:5/448: stat d7/d8/dc/ff 0 2024-09-18T12:49:12.196 INFO:tasks.workunit.client.0.smithi078.stdout:2/235: fsync d4/db/dc/f2f 0 2024-09-18T12:49:12.197 INFO:tasks.workunit.client.1.smithi148.stdout:4/372: mknod d15/d6a/d4c/d4f/d34/c74 0 2024-09-18T12:49:12.198 INFO:tasks.workunit.client.0.smithi078.stdout:7/168: sync 2024-09-18T12:49:12.198 INFO:tasks.workunit.client.0.smithi078.stdout:9/185: sync 2024-09-18T12:49:12.200 INFO:tasks.workunit.client.0.smithi078.stdout:1/238: mknod d0/c4c 0 2024-09-18T12:49:12.200 INFO:tasks.workunit.client.0.smithi078.stdout:0/324: dwrite d3/f6c [0,4194304] 0 2024-09-18T12:49:12.200 INFO:tasks.workunit.client.0.smithi078.stdout:9/186: fdatasync d5/d7/d32/d2a/f2d 0 2024-09-18T12:49:12.201 INFO:tasks.workunit.client.1.smithi148.stdout:6/438: dread d5/d1a/d29/f4e [0,4194304] 0 2024-09-18T12:49:12.202 INFO:tasks.workunit.client.0.smithi078.stdout:4/200: unlink c1 0 2024-09-18T12:49:12.202 INFO:tasks.workunit.client.0.smithi078.stdout:4/201: chown d11/f16 366642 1 2024-09-18T12:49:12.209 INFO:tasks.workunit.client.1.smithi148.stdout:3/370: dwrite d4/d8/d20/d2b/f88 [0,4194304] 0 2024-09-18T12:49:12.209 INFO:tasks.workunit.client.1.smithi148.stdout:8/462: dwrite d8/d16/d27/f4a [4194304,4194304] 0 2024-09-18T12:49:12.209 INFO:tasks.workunit.client.1.smithi148.stdout:7/420: dwrite db/dc/df/d1d/f21 [0,4194304] 0 2024-09-18T12:49:12.211 INFO:tasks.workunit.client.0.smithi078.stdout:2/236: dread - d4/d20/f44 zero size 2024-09-18T12:49:12.212 INFO:tasks.workunit.client.0.smithi078.stdout:2/237: fdatasync d4/dd/f40 0 2024-09-18T12:49:12.213 INFO:tasks.workunit.client.0.smithi078.stdout:9/187: readlink d5/d7/lf 0 2024-09-18T12:49:12.215 INFO:tasks.workunit.client.0.smithi078.stdout:0/325: rmdir d3/d1f/d2e/d68/d30 39 2024-09-18T12:49:12.217 INFO:tasks.workunit.client.0.smithi078.stdout:1/239: rename d0/d21/f34 to d0/d8/da/d3e/d46/f4d 0 2024-09-18T12:49:12.218 INFO:tasks.workunit.client.1.smithi148.stdout:6/439: symlink d5/d1a/d3d/l8a 0 2024-09-18T12:49:12.221 INFO:tasks.workunit.client.0.smithi078.stdout:2/238: unlink d4/db/dc/f34 0 2024-09-18T12:49:12.222 INFO:tasks.workunit.client.1.smithi148.stdout:4/373: dwrite d15/f3a [0,4194304] 0 2024-09-18T12:49:12.222 INFO:tasks.workunit.client.0.smithi078.stdout:0/326: rmdir d3/d1f/d2e/d68 39 2024-09-18T12:49:12.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:11 smithi148 ceph-mon[35352]: pgmap v13: 65 pgs: 65 active+clean; 866 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.2 MiB/s rd, 93 MiB/s wr, 189 op/s 2024-09-18T12:49:12.223 INFO:tasks.workunit.client.1.smithi148.stdout:9/373: sync 2024-09-18T12:49:12.225 INFO:tasks.workunit.client.1.smithi148.stdout:1/396: dread dc/d4d/f56 [0,4194304] 0 2024-09-18T12:49:12.225 INFO:tasks.workunit.client.0.smithi078.stdout:4/202: unlink c6 0 2024-09-18T12:49:12.225 INFO:tasks.workunit.client.1.smithi148.stdout:7/421: write db/d52/d25/f48 [1112660,68336] 0 2024-09-18T12:49:12.226 INFO:tasks.workunit.client.0.smithi078.stdout:1/240: truncate d0/d8/f2c 179149 0 2024-09-18T12:49:12.226 INFO:tasks.workunit.client.1.smithi148.stdout:8/463: mkdir d8/d12/d46/d7e/da1 0 2024-09-18T12:49:12.227 INFO:tasks.workunit.client.0.smithi078.stdout:1/241: truncate d0/f4b 4889135 0 2024-09-18T12:49:12.228 INFO:tasks.workunit.client.1.smithi148.stdout:5/449: getdents d7/d8/dc/d12/d1f/d25/d4b 0 2024-09-18T12:49:12.228 INFO:tasks.workunit.client.1.smithi148.stdout:6/440: symlink d5/d1a/dc/d2b/l8b 0 2024-09-18T12:49:12.230 INFO:tasks.workunit.client.1.smithi148.stdout:4/374: rename l10 to d15/d6a/l75 0 2024-09-18T12:49:12.232 INFO:tasks.workunit.client.1.smithi148.stdout:2/345: dwrite d9/d4a/f38 [0,4194304] 0 2024-09-18T12:49:12.233 INFO:tasks.workunit.client.1.smithi148.stdout:6/441: dread - d5/d1a/d29/f83 zero size 2024-09-18T12:49:12.235 INFO:tasks.workunit.client.1.smithi148.stdout:9/374: write d8/da/dd/d35/d47/d4e/f67 [1035168,77029] 0 2024-09-18T12:49:12.236 INFO:tasks.workunit.client.0.smithi078.stdout:0/327: dread d3/d1f/d2e/d68/f44 [0,4194304] 0 2024-09-18T12:49:12.237 INFO:tasks.workunit.client.0.smithi078.stdout:9/188: rename d5/l23 to d5/l38 0 2024-09-18T12:49:12.237 INFO:tasks.workunit.client.0.smithi078.stdout:0/328: chown d3/d1f/c2a 789 1 2024-09-18T12:49:12.238 INFO:tasks.workunit.client.1.smithi148.stdout:3/371: dwrite d4/d8/d1e/d6b/f47 [0,4194304] 0 2024-09-18T12:49:12.238 INFO:tasks.workunit.client.1.smithi148.stdout:2/346: chown d9/d4a/c2c 36 1 2024-09-18T12:49:12.240 INFO:tasks.workunit.client.0.smithi078.stdout:9/189: read d5/d7/d32/f24 [40464,44631] 0 2024-09-18T12:49:12.241 INFO:tasks.workunit.client.1.smithi148.stdout:9/375: write d8/da/dd/d3f/f58 [760775,107460] 0 2024-09-18T12:49:12.241 INFO:tasks.workunit.client.0.smithi078.stdout:1/242: dwrite d0/f19 [0,4194304] 0 2024-09-18T12:49:12.241 INFO:tasks.workunit.client.0.smithi078.stdout:9/190: fsync d5/d7/fc 0 2024-09-18T12:49:12.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:11 smithi078 ceph-mon[28091]: pgmap v13: 65 pgs: 65 active+clean; 866 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.2 MiB/s rd, 93 MiB/s wr, 189 op/s 2024-09-18T12:49:12.244 INFO:tasks.workunit.client.1.smithi148.stdout:7/422: dwrite fa [8388608,4194304] 0 2024-09-18T12:49:12.244 INFO:tasks.workunit.client.1.smithi148.stdout:4/375: rename f2 to d15/f76 0 2024-09-18T12:49:12.248 INFO:tasks.workunit.client.1.smithi148.stdout:5/450: symlink d7/d8/dc/d12/d1f/d69/d8b/l92 0 2024-09-18T12:49:12.248 INFO:tasks.workunit.client.0.smithi078.stdout:9/191: dread f0 [0,4194304] 0 2024-09-18T12:49:12.249 INFO:tasks.workunit.client.1.smithi148.stdout:9/376: dread d8/f16 [0,4194304] 0 2024-09-18T12:49:12.257 INFO:tasks.workunit.client.0.smithi078.stdout:0/329: symlink d3/d1f/d2e/d68/l7a 0 2024-09-18T12:49:12.259 INFO:tasks.workunit.client.1.smithi148.stdout:2/347: dwrite d9/d24/d47/f5e [0,4194304] 0 2024-09-18T12:49:12.260 INFO:tasks.workunit.client.1.smithi148.stdout:3/372: dwrite d4/d8/d20/d2b/f73 [0,4194304] 0 2024-09-18T12:49:12.268 INFO:tasks.workunit.client.1.smithi148.stdout:9/377: dread d8/f22 [0,4194304] 0 2024-09-18T12:49:12.268 INFO:tasks.workunit.client.1.smithi148.stdout:2/348: dread d9/d24/d31/d34/d42/f44 [0,4194304] 0 2024-09-18T12:49:12.268 INFO:tasks.workunit.client.1.smithi148.stdout:2/349: stat d9/d24/d31 0 2024-09-18T12:49:12.268 INFO:tasks.workunit.client.1.smithi148.stdout:2/350: chown d9/f71 82204 1 2024-09-18T12:49:12.270 INFO:tasks.workunit.client.1.smithi148.stdout:5/451: symlink d7/d8/dc/d12/d1f/d77/l93 0 2024-09-18T12:49:12.271 INFO:tasks.workunit.client.1.smithi148.stdout:5/452: write d7/d8/dc/d22/f5f [591215,89174] 0 2024-09-18T12:49:12.274 INFO:tasks.workunit.client.0.smithi078.stdout:1/243: rmdir d0/d8/da/d3e/d43 0 2024-09-18T12:49:12.274 INFO:tasks.workunit.client.0.smithi078.stdout:1/244: readlink d0/d8/da/l3b 0 2024-09-18T12:49:12.276 INFO:tasks.workunit.client.0.smithi078.stdout:1/245: write d0/d37/f3c [422459,60554] 0 2024-09-18T12:49:12.278 INFO:tasks.workunit.client.0.smithi078.stdout:4/203: write d11/f29 [29140,14396] 0 2024-09-18T12:49:12.279 INFO:tasks.workunit.client.0.smithi078.stdout:2/239: write d4/db/f2a [1354363,14934] 0 2024-09-18T12:49:12.280 INFO:tasks.workunit.client.1.smithi148.stdout:1/397: dwrite dc/f13 [0,4194304] 0 2024-09-18T12:49:12.280 INFO:tasks.workunit.client.0.smithi078.stdout:9/192: creat d5/d7/f39 x:0 0 0 2024-09-18T12:49:12.282 INFO:tasks.workunit.client.1.smithi148.stdout:9/378: mkdir d8/da/dd/d4a/d49/d46/d75 0 2024-09-18T12:49:12.282 INFO:tasks.workunit.client.0.smithi078.stdout:1/246: chown d0/l25 16 1 2024-09-18T12:49:12.283 INFO:tasks.workunit.client.1.smithi148.stdout:9/379: readlink d8/da/dd/d4a/d27/l2b 0 2024-09-18T12:49:12.283 INFO:tasks.workunit.client.1.smithi148.stdout:9/380: chown d8/d73 36569 1 2024-09-18T12:49:12.288 INFO:tasks.workunit.client.0.smithi078.stdout:9/193: mkdir d5/d7/d32/d3a 0 2024-09-18T12:49:12.290 INFO:tasks.workunit.client.1.smithi148.stdout:5/453: symlink d7/d8/dc/d12/d1f/d39/l94 0 2024-09-18T12:49:12.291 INFO:tasks.workunit.client.0.smithi078.stdout:9/194: symlink d5/d7/d8/l3b 0 2024-09-18T12:49:12.292 INFO:tasks.workunit.client.0.smithi078.stdout:2/240: dread d4/d20/f29 [0,4194304] 0 2024-09-18T12:49:12.294 INFO:tasks.workunit.client.1.smithi148.stdout:1/398: creat dc/d51/f83 x:0 0 0 2024-09-18T12:49:12.295 INFO:tasks.workunit.client.1.smithi148.stdout:1/399: dread - dc/d11/d38/d72/f73 zero size 2024-09-18T12:49:12.295 INFO:tasks.workunit.client.0.smithi078.stdout:2/241: truncate d4/dd/f42 1452527 0 2024-09-18T12:49:12.297 INFO:tasks.workunit.client.1.smithi148.stdout:2/351: link d9/d3a/f55 d9/d24/f79 0 2024-09-18T12:49:12.297 INFO:tasks.workunit.client.1.smithi148.stdout:2/352: fdatasync d9/fb 0 2024-09-18T12:49:12.297 INFO:tasks.workunit.client.0.smithi078.stdout:4/204: dwrite d11/f23 [0,4194304] 0 2024-09-18T12:49:12.299 INFO:tasks.workunit.client.0.smithi078.stdout:4/205: write d11/d27/f34 [4351131,1203] 0 2024-09-18T12:49:12.302 INFO:tasks.workunit.client.1.smithi148.stdout:7/423: getdents db/dc/df/d11/d34/d69 0 2024-09-18T12:49:12.304 INFO:tasks.workunit.client.0.smithi078.stdout:2/242: dwrite d4/f9 [4194304,4194304] 0 2024-09-18T12:49:12.306 INFO:tasks.workunit.client.1.smithi148.stdout:3/373: creat d4/f89 x:0 0 0 2024-09-18T12:49:12.309 INFO:tasks.workunit.client.1.smithi148.stdout:5/454: creat d7/d8/dc/d12/d1f/d69/d8b/f95 x:0 0 0 2024-09-18T12:49:12.309 INFO:tasks.workunit.client.0.smithi078.stdout:0/330: dwrite d3/d1f/f41 [0,4194304] 0 2024-09-18T12:49:12.318 INFO:tasks.workunit.client.1.smithi148.stdout:0/592: sync 2024-09-18T12:49:12.320 INFO:tasks.workunit.client.1.smithi148.stdout:9/381: link d8/da/dd/d3f/f6a d8/da/dd/d65/f76 0 2024-09-18T12:49:12.320 INFO:tasks.workunit.client.1.smithi148.stdout:1/400: dwrite dc/d18/d31/d4b/f65 [0,4194304] 0 2024-09-18T12:49:12.323 INFO:tasks.workunit.client.1.smithi148.stdout:7/424: mkdir db/dc/d70/d78 0 2024-09-18T12:49:12.324 INFO:tasks.workunit.client.0.smithi078.stdout:9/195: link d5/c1b d5/d7/c3c 0 2024-09-18T12:49:12.325 INFO:tasks.workunit.client.1.smithi148.stdout:7/425: write db/d52/d25/f48 [1441597,128109] 0 2024-09-18T12:49:12.326 INFO:tasks.workunit.client.1.smithi148.stdout:7/426: chown db/d52/d1f/f4d 4279 1 2024-09-18T12:49:12.326 INFO:tasks.workunit.client.1.smithi148.stdout:3/374: unlink d4/d8/d20/f62 0 2024-09-18T12:49:12.330 INFO:tasks.workunit.client.0.smithi078.stdout:4/206: creat d11/f44 x:0 0 0 2024-09-18T12:49:12.330 INFO:tasks.workunit.client.0.smithi078.stdout:4/207: chown d11/l2a 21490615 1 2024-09-18T12:49:12.333 INFO:tasks.workunit.client.0.smithi078.stdout:9/196: dread d5/d7/d32/f24 [0,4194304] 0 2024-09-18T12:49:12.334 INFO:tasks.workunit.client.1.smithi148.stdout:1/401: mknod dc/d18/d43/c84 0 2024-09-18T12:49:12.335 INFO:tasks.workunit.client.1.smithi148.stdout:4/376: rename d15/d6a to d15/d5f/d77 0 2024-09-18T12:49:12.336 INFO:tasks.workunit.client.0.smithi078.stdout:0/331: creat d3/f7b x:0 0 0 2024-09-18T12:49:12.336 INFO:tasks.workunit.client.0.smithi078.stdout:2/243: getdents d4/dd 0 2024-09-18T12:49:12.338 INFO:tasks.workunit.client.1.smithi148.stdout:7/427: write db/d52/d25/f3c [388596,43059] 0 2024-09-18T12:49:12.339 INFO:tasks.workunit.client.0.smithi078.stdout:9/197: creat d5/d7/d32/d2a/f3d x:0 0 0 2024-09-18T12:49:12.340 INFO:tasks.workunit.client.1.smithi148.stdout:9/382: fsync d8/da/dd/d65/f76 0 2024-09-18T12:49:12.341 INFO:tasks.workunit.client.1.smithi148.stdout:9/383: read d8/da/dd/d4a/f3a [228100,78051] 0 2024-09-18T12:49:12.342 INFO:tasks.workunit.client.1.smithi148.stdout:2/353: link d9/d24/d31/d34/l41 d9/d24/d31/d34/d42/l7a 0 2024-09-18T12:49:12.343 INFO:tasks.workunit.client.1.smithi148.stdout:5/455: write d7/d8/dc/ff [293420,62081] 0 2024-09-18T12:49:12.344 INFO:tasks.workunit.client.1.smithi148.stdout:9/384: dread d8/f10 [0,4194304] 0 2024-09-18T12:49:12.344 INFO:tasks.workunit.client.0.smithi078.stdout:4/208: rename d11/d1f/d24/d42 to d11/d45 0 2024-09-18T12:49:12.345 INFO:tasks.workunit.client.1.smithi148.stdout:5/456: write d7/d8/d18/d3f/f6f [478785,103359] 0 2024-09-18T12:49:12.346 INFO:tasks.workunit.client.1.smithi148.stdout:0/593: mkdir de/d14/d6b/dc6 0 2024-09-18T12:49:12.347 INFO:tasks.workunit.client.0.smithi078.stdout:9/198: symlink d5/d7/d8/l3e 0 2024-09-18T12:49:12.348 INFO:tasks.workunit.client.1.smithi148.stdout:2/354: dread d9/f21 [0,4194304] 0 2024-09-18T12:49:12.349 INFO:tasks.workunit.client.0.smithi078.stdout:0/332: mkdir d3/d1f/d2e/d68/d30/d7c 0 2024-09-18T12:49:12.352 INFO:tasks.workunit.client.1.smithi148.stdout:5/457: dwrite d7/d8/dc/d12/d31/d6c/f75 [0,4194304] 0 2024-09-18T12:49:12.353 INFO:tasks.workunit.client.0.smithi078.stdout:4/209: mknod d11/d27/c46 0 2024-09-18T12:49:12.353 INFO:tasks.workunit.client.0.smithi078.stdout:9/199: dwrite d5/f17 [0,4194304] 0 2024-09-18T12:49:12.354 INFO:tasks.workunit.client.1.smithi148.stdout:5/458: fdatasync d7/d8/dc/d12/f45 0 2024-09-18T12:49:12.355 INFO:tasks.workunit.client.0.smithi078.stdout:8/260: sync 2024-09-18T12:49:12.355 INFO:tasks.workunit.client.0.smithi078.stdout:3/253: sync 2024-09-18T12:49:12.355 INFO:tasks.workunit.client.0.smithi078.stdout:6/385: sync 2024-09-18T12:49:12.355 INFO:tasks.workunit.client.0.smithi078.stdout:5/329: sync 2024-09-18T12:49:12.358 INFO:tasks.workunit.client.0.smithi078.stdout:0/333: dread - d3/f6d zero size 2024-09-18T12:49:12.358 INFO:tasks.workunit.client.0.smithi078.stdout:8/261: write d0/d7/dc/d1f/f45 [990916,36261] 0 2024-09-18T12:49:12.363 INFO:tasks.workunit.client.0.smithi078.stdout:4/210: dwrite d11/f16 [4194304,4194304] 0 2024-09-18T12:49:12.365 INFO:tasks.workunit.client.1.smithi148.stdout:0/594: creat de/d14/d43/fc7 x:0 0 0 2024-09-18T12:49:12.367 INFO:tasks.workunit.client.0.smithi078.stdout:3/254: fsync d9/d29/f24 0 2024-09-18T12:49:12.368 INFO:tasks.workunit.client.1.smithi148.stdout:9/385: dwrite d8/f22 [0,4194304] 0 2024-09-18T12:49:12.370 INFO:tasks.workunit.client.1.smithi148.stdout:2/355: mkdir d9/d24/d31/d34/d7b 0 2024-09-18T12:49:12.372 INFO:tasks.workunit.client.0.smithi078.stdout:5/330: creat d2/d4/d9/da/d2b/f69 x:0 0 0 2024-09-18T12:49:12.373 INFO:tasks.workunit.client.0.smithi078.stdout:5/331: chown d2/d4/d12/d16/d36/d4c/l52 461644 1 2024-09-18T12:49:12.375 INFO:tasks.workunit.client.0.smithi078.stdout:6/386: creat d10/d2b/d43/d53/d63/f75 x:0 0 0 2024-09-18T12:49:12.377 INFO:tasks.workunit.client.0.smithi078.stdout:8/262: write d0/d7/f38 [4832753,47502] 0 2024-09-18T12:49:12.379 INFO:tasks.workunit.client.0.smithi078.stdout:9/200: unlink d5/c2f 0 2024-09-18T12:49:12.380 INFO:tasks.workunit.client.0.smithi078.stdout:9/201: write d5/f17 [2805114,11412] 0 2024-09-18T12:49:12.382 INFO:tasks.workunit.client.0.smithi078.stdout:5/332: rmdir d2/d4/d9/da/d2b/d3e 39 2024-09-18T12:49:12.382 INFO:tasks.workunit.client.0.smithi078.stdout:9/202: dread - d5/d7/d32/f30 zero size 2024-09-18T12:49:12.384 INFO:tasks.workunit.client.0.smithi078.stdout:0/334: mknod d3/c7d 0 2024-09-18T12:49:12.384 INFO:tasks.workunit.client.1.smithi148.stdout:0/595: rmdir de/d27/d53 39 2024-09-18T12:49:12.384 INFO:tasks.workunit.client.0.smithi078.stdout:5/333: write d2/d4/f1e [4724436,78826] 0 2024-09-18T12:49:12.386 INFO:tasks.workunit.client.0.smithi078.stdout:4/211: dread d11/d27/f2f [0,4194304] 0 2024-09-18T12:49:12.390 INFO:tasks.workunit.client.0.smithi078.stdout:8/263: dwrite d0/d7/f22 [4194304,4194304] 0 2024-09-18T12:49:12.395 INFO:tasks.workunit.client.1.smithi148.stdout:4/377: creat d15/d5f/f78 x:0 0 0 2024-09-18T12:49:12.397 INFO:tasks.workunit.client.0.smithi078.stdout:3/255: mkdir d9/d54 0 2024-09-18T12:49:12.399 INFO:tasks.workunit.client.1.smithi148.stdout:4/378: read d15/d5f/d77/d4c/d4f/f61 [1906289,118687] 0 2024-09-18T12:49:12.400 INFO:tasks.workunit.client.1.smithi148.stdout:1/402: dwrite dc/d11/d17/d2b/f2e [0,4194304] 0 2024-09-18T12:49:12.400 INFO:tasks.workunit.client.0.smithi078.stdout:0/335: dwrite d3/d1f/f53 [0,4194304] 0 2024-09-18T12:49:12.401 INFO:tasks.workunit.client.1.smithi148.stdout:5/459: creat d7/d8/dc/d12/d31/d5a/f96 x:0 0 0 2024-09-18T12:49:12.403 INFO:tasks.workunit.client.0.smithi078.stdout:4/212: dwrite d11/f1d [8388608,4194304] 0 2024-09-18T12:49:12.403 INFO:tasks.workunit.client.0.smithi078.stdout:0/336: dread - d3/d1f/f6f zero size 2024-09-18T12:49:12.404 INFO:tasks.workunit.client.0.smithi078.stdout:6/387: dwrite d10/d2b/d43/d53/d45/d55/f2d [0,4194304] 0 2024-09-18T12:49:12.405 INFO:tasks.workunit.client.1.smithi148.stdout:9/386: write d8/da/dd/d4a/f15 [7220043,61058] 0 2024-09-18T12:49:12.405 INFO:tasks.workunit.client.1.smithi148.stdout:8/464: sync 2024-09-18T12:49:12.410 INFO:tasks.workunit.client.0.smithi078.stdout:0/337: truncate d3/d1f/d2e/d4e/d37/d72/f78 228623 0 2024-09-18T12:49:12.415 INFO:tasks.workunit.client.1.smithi148.stdout:3/375: getdents d4/d8/d6a 0 2024-09-18T12:49:12.416 INFO:tasks.workunit.client.1.smithi148.stdout:2/356: dwrite d9/d3a/f55 [0,4194304] 0 2024-09-18T12:49:12.416 INFO:tasks.workunit.client.1.smithi148.stdout:3/376: dread - d4/d8/f4f zero size 2024-09-18T12:49:12.417 INFO:tasks.workunit.client.0.smithi078.stdout:8/264: unlink d0/d7/dc/d1f/f45 0 2024-09-18T12:49:12.417 INFO:tasks.workunit.client.1.smithi148.stdout:2/357: fsync d9/f18 0 2024-09-18T12:49:12.418 INFO:tasks.workunit.client.1.smithi148.stdout:1/403: rmdir dc/d11 39 2024-09-18T12:49:12.422 INFO:tasks.workunit.client.1.smithi148.stdout:5/460: mkdir d7/d8/dc/d12/d97 0 2024-09-18T12:49:12.424 INFO:tasks.workunit.client.0.smithi078.stdout:4/213: rename d11/d1f/d24 to d11/d27/d47 0 2024-09-18T12:49:12.426 INFO:tasks.workunit.client.1.smithi148.stdout:8/465: creat d8/d16/d53/d39/d3b/d4e/fa2 x:0 0 0 2024-09-18T12:49:12.427 INFO:tasks.workunit.client.1.smithi148.stdout:8/466: chown d8/d16/d53/d39/f86 43 1 2024-09-18T12:49:12.427 INFO:tasks.workunit.client.0.smithi078.stdout:0/338: rename d3/d1f/d2e/d4e/c3b to d3/d1f/d2e/d4e/c7e 0 2024-09-18T12:49:12.429 INFO:tasks.workunit.client.0.smithi078.stdout:5/334: symlink d2/d4/d58/l6a 0 2024-09-18T12:49:12.430 INFO:tasks.workunit.client.1.smithi148.stdout:6/442: sync 2024-09-18T12:49:12.431 INFO:tasks.workunit.client.1.smithi148.stdout:3/377: rmdir d4/d8/d1e/d6b/d31/d54 39 2024-09-18T12:49:12.433 INFO:tasks.workunit.client.1.smithi148.stdout:2/358: readlink d9/d24/d31/d34/l78 0 2024-09-18T12:49:12.434 INFO:tasks.workunit.client.0.smithi078.stdout:9/203: creat d5/d7/f3f x:0 0 0 2024-09-18T12:49:12.434 INFO:tasks.workunit.client.1.smithi148.stdout:0/596: mkdir de/d27/d53/d89/dbb/dc8 0 2024-09-18T12:49:12.435 INFO:tasks.workunit.client.0.smithi078.stdout:4/214: truncate d11/f14 3792985 0 2024-09-18T12:49:12.435 INFO:tasks.workunit.client.0.smithi078.stdout:0/339: dwrite d3/f6c [4194304,4194304] 0 2024-09-18T12:49:12.437 INFO:tasks.workunit.client.1.smithi148.stdout:9/387: fdatasync f7 0 2024-09-18T12:49:12.437 INFO:tasks.workunit.client.0.smithi078.stdout:4/215: chown d11/f23 345439975 1 2024-09-18T12:49:12.438 INFO:tasks.workunit.client.0.smithi078.stdout:5/335: dwrite d2/f26 [0,4194304] 0 2024-09-18T12:49:12.440 INFO:tasks.workunit.client.0.smithi078.stdout:5/336: write d2/d4/f1e [4988866,31878] 0 2024-09-18T12:49:12.443 INFO:tasks.workunit.client.0.smithi078.stdout:5/337: write d2/d4/d9/d2f/d30/f5f [41903,65253] 0 2024-09-18T12:49:12.478 INFO:tasks.workunit.client.1.smithi148.stdout:7/428: sync 2024-09-18T12:49:12.537 INFO:tasks.workunit.client.0.smithi078.stdout:9/204: rmdir d5/d7 39 2024-09-18T12:49:12.542 INFO:tasks.workunit.client.0.smithi078.stdout:4/216: creat d11/d27/f48 x:0 0 0 2024-09-18T12:49:12.543 INFO:tasks.workunit.client.0.smithi078.stdout:4/217: write d11/d1f/f3a [572143,12792] 0 2024-09-18T12:49:12.545 INFO:tasks.workunit.client.1.smithi148.stdout:0/597: mknod de/d14/d43/d57/cc9 0 2024-09-18T12:49:12.545 INFO:tasks.workunit.client.0.smithi078.stdout:3/256: dwrite d9/d13/d33/f51 [0,4194304] 0 2024-09-18T12:49:12.547 INFO:tasks.workunit.client.0.smithi078.stdout:5/338: unlink d2/d4/d9/da/c23 0 2024-09-18T12:49:12.549 INFO:tasks.workunit.client.1.smithi148.stdout:4/379: truncate f0 2798099 0 2024-09-18T12:49:12.552 INFO:tasks.workunit.client.0.smithi078.stdout:6/388: getdents d10/d2b/d43 0 2024-09-18T12:49:12.553 INFO:tasks.workunit.client.1.smithi148.stdout:0/598: dwrite de/d27/d53/d89/d9d/fb9 [0,4194304] 0 2024-09-18T12:49:12.555 INFO:tasks.workunit.client.1.smithi148.stdout:0/599: write de/d27/d53/d89/d9d/f9e [815811,21604] 0 2024-09-18T12:49:12.555 INFO:tasks.workunit.client.1.smithi148.stdout:9/388: mkdir d8/da/dd/d77 0 2024-09-18T12:49:12.558 INFO:tasks.workunit.client.1.smithi148.stdout:9/389: chown d8/d33/f42 0 1 2024-09-18T12:49:12.558 INFO:tasks.workunit.client.1.smithi148.stdout:8/467: rmdir d8/df/d3e/d82/d8f 39 2024-09-18T12:49:12.559 INFO:tasks.workunit.client.0.smithi078.stdout:4/218: creat d11/d27/d47/f49 x:0 0 0 2024-09-18T12:49:12.560 INFO:tasks.workunit.client.0.smithi078.stdout:4/219: stat d11/d27/f34 0 2024-09-18T12:49:12.561 INFO:tasks.workunit.client.1.smithi148.stdout:6/443: dwrite d5/d1a/f47 [0,4194304] 0 2024-09-18T12:49:12.562 INFO:tasks.workunit.client.0.smithi078.stdout:0/340: dwrite d3/d1f/d2e/d4e/f49 [0,4194304] 0 2024-09-18T12:49:12.562 INFO:tasks.workunit.client.1.smithi148.stdout:5/461: truncate d7/d8/f1c 2752259 0 2024-09-18T12:49:12.567 INFO:tasks.workunit.client.0.smithi078.stdout:5/339: symlink d2/d4/d12/d16/d36/d4c/d62/l6b 0 2024-09-18T12:49:12.572 INFO:tasks.workunit.client.0.smithi078.stdout:8/265: getdents d0/d7/d1e 0 2024-09-18T12:49:12.573 INFO:tasks.workunit.client.0.smithi078.stdout:5/340: dread d2/d4/f34 [0,4194304] 0 2024-09-18T12:49:12.574 INFO:tasks.workunit.client.1.smithi148.stdout:2/359: truncate d9/fb 1817406 0 2024-09-18T12:49:12.578 INFO:tasks.workunit.client.0.smithi078.stdout:3/257: symlink d9/d13/d37/l55 0 2024-09-18T12:49:12.579 INFO:tasks.workunit.client.0.smithi078.stdout:4/220: rename d11/d27/f3e to d11/d27/f4a 0 2024-09-18T12:49:12.580 INFO:tasks.workunit.client.1.smithi148.stdout:0/600: mkdir de/d27/d53/d89/dca 0 2024-09-18T12:49:12.581 INFO:tasks.workunit.client.0.smithi078.stdout:4/221: dread d11/d1f/d40/f41 [0,4194304] 0 2024-09-18T12:49:12.581 INFO:tasks.workunit.client.1.smithi148.stdout:0/601: truncate de/d14/d43/d57/fc5 233464 0 2024-09-18T12:49:12.582 INFO:tasks.workunit.client.0.smithi078.stdout:4/222: chown d11/d27/f2f 286 1 2024-09-18T12:49:12.589 INFO:tasks.workunit.client.1.smithi148.stdout:1/404: getdents dc/d4d 0 2024-09-18T12:49:12.590 INFO:tasks.workunit.client.0.smithi078.stdout:3/258: rename d9/d29/c44 to d9/d13/c56 0 2024-09-18T12:49:12.592 INFO:tasks.workunit.client.1.smithi148.stdout:2/360: symlink d9/d24/d31/d34/d42/l7c 0 2024-09-18T12:49:12.592 INFO:tasks.workunit.client.1.smithi148.stdout:7/429: link db/d52/d1f/c42 db/d52/d25/d38/c79 0 2024-09-18T12:49:12.595 INFO:tasks.workunit.client.1.smithi148.stdout:2/361: dread d9/d24/f79 [0,4194304] 0 2024-09-18T12:49:12.596 INFO:tasks.workunit.client.1.smithi148.stdout:2/362: write d9/d4a/f38 [1834931,36592] 0 2024-09-18T12:49:12.596 INFO:tasks.workunit.client.0.smithi078.stdout:8/266: dread d0/d7/dc/d1f/d23/d40/f42 [0,4194304] 0 2024-09-18T12:49:12.598 INFO:tasks.workunit.client.1.smithi148.stdout:0/602: creat de/d14/d93/fcb x:0 0 0 2024-09-18T12:49:12.598 INFO:tasks.workunit.client.0.smithi078.stdout:0/341: write d3/d1f/d2e/d68/f44 [2562497,117053] 0 2024-09-18T12:49:12.598 INFO:tasks.workunit.client.0.smithi078.stdout:6/389: link d10/d2b/d43/c58 d10/d2b/d43/d53/d45/d55/d3f/c76 0 2024-09-18T12:49:12.600 INFO:tasks.workunit.client.0.smithi078.stdout:0/342: chown d3/d1f/d2e/d68/f2b 23444 1 2024-09-18T12:49:12.603 INFO:tasks.workunit.client.0.smithi078.stdout:3/259: truncate d9/d29/f24 5756054 0 2024-09-18T12:49:12.605 INFO:tasks.workunit.client.0.smithi078.stdout:4/223: mkdir d11/d1f/d4b 0 2024-09-18T12:49:12.606 INFO:tasks.workunit.client.1.smithi148.stdout:3/378: getdents d4/d8/d1e/d6b/d31/d60 0 2024-09-18T12:49:12.607 INFO:tasks.workunit.client.1.smithi148.stdout:3/379: dread - d4/f76 zero size 2024-09-18T12:49:12.608 INFO:tasks.workunit.client.1.smithi148.stdout:3/380: write d4/d8/d1e/d63/f86 [558414,19718] 0 2024-09-18T12:49:12.608 INFO:tasks.workunit.client.0.smithi078.stdout:8/267: truncate d0/d7/fb 4798891 0 2024-09-18T12:49:12.609 INFO:tasks.workunit.client.0.smithi078.stdout:3/260: dwrite d9/d13/d33/d3c/d19/f1e [0,4194304] 0 2024-09-18T12:49:12.610 INFO:tasks.workunit.client.1.smithi148.stdout:1/405: mkdir dc/d4d/d85 0 2024-09-18T12:49:12.613 INFO:tasks.workunit.client.1.smithi148.stdout:3/381: dwrite d4/f5 [4194304,4194304] 0 2024-09-18T12:49:12.615 INFO:tasks.workunit.client.0.smithi078.stdout:9/205: getdents d5/d7/d32/d2a/d36 0 2024-09-18T12:49:12.615 INFO:tasks.workunit.client.1.smithi148.stdout:9/390: link d8/da/dd/d4a/l1a d8/da/dd/l78 0 2024-09-18T12:49:12.616 INFO:tasks.workunit.client.1.smithi148.stdout:6/444: dwrite d5/f2e [0,4194304] 0 2024-09-18T12:49:12.616 INFO:tasks.workunit.client.0.smithi078.stdout:9/206: dread - d5/d7/f39 zero size 2024-09-18T12:49:12.617 INFO:tasks.workunit.client.0.smithi078.stdout:9/207: stat d5/d7/d8/fd 0 2024-09-18T12:49:12.618 INFO:tasks.workunit.client.0.smithi078.stdout:9/208: chown d5/d7/d32/f24 514125346 1 2024-09-18T12:49:12.618 INFO:tasks.workunit.client.1.smithi148.stdout:9/391: chown d8/da/dd/d4a 61 1 2024-09-18T12:49:12.619 INFO:tasks.workunit.client.1.smithi148.stdout:9/392: stat d8/da/dd/d35 0 2024-09-18T12:49:12.619 INFO:tasks.workunit.client.0.smithi078.stdout:9/209: dread - d5/d7/f2b zero size 2024-09-18T12:49:12.619 INFO:tasks.workunit.client.1.smithi148.stdout:8/468: rename d8/d12/d51/d94/l5b to d8/d16/d53/d39/d3b/la3 0 2024-09-18T12:49:12.621 INFO:tasks.workunit.client.0.smithi078.stdout:8/268: truncate d0/d7/dc/d1f/d23/d40/f42 39621 0 2024-09-18T12:49:12.622 INFO:tasks.workunit.client.0.smithi078.stdout:0/343: mkdir d3/d43/d7f 0 2024-09-18T12:49:12.623 INFO:tasks.workunit.client.1.smithi148.stdout:5/462: mkdir d7/d8/dc/d12/d31/d5a/d98 0 2024-09-18T12:49:12.624 INFO:tasks.workunit.client.0.smithi078.stdout:4/224: mknod d11/d1f/d4b/c4c 0 2024-09-18T12:49:12.624 INFO:tasks.workunit.client.1.smithi148.stdout:5/463: fsync d7/d8/f83 0 2024-09-18T12:49:12.625 INFO:tasks.workunit.client.1.smithi148.stdout:5/464: write d7/d8/d18/d3f/f6f [495138,18383] 0 2024-09-18T12:49:12.625 INFO:tasks.workunit.client.0.smithi078.stdout:4/225: write d11/d27/d47/f49 [841123,46510] 0 2024-09-18T12:49:12.628 INFO:tasks.workunit.client.0.smithi078.stdout:8/269: rmdir d0/d7/dc/d1f/d23/d29/d2e 39 2024-09-18T12:49:12.630 INFO:tasks.workunit.client.0.smithi078.stdout:8/270: chown d0/f1 1567058451 1 2024-09-18T12:49:12.631 INFO:tasks.workunit.client.0.smithi078.stdout:0/344: mknod d3/d1f/d2e/d4e/d37/d72/c80 0 2024-09-18T12:49:12.631 INFO:tasks.workunit.client.1.smithi148.stdout:3/382: stat d4/cb 0 2024-09-18T12:49:12.632 INFO:tasks.workunit.client.1.smithi148.stdout:3/383: write d4/d8/f1a [7170863,62488] 0 2024-09-18T12:49:12.633 INFO:tasks.workunit.client.0.smithi078.stdout:6/390: getdents d10/d2b/d43/d53/d63 0 2024-09-18T12:49:12.634 INFO:tasks.workunit.client.1.smithi148.stdout:0/603: mknod de/ccc 0 2024-09-18T12:49:12.635 INFO:tasks.workunit.client.0.smithi078.stdout:4/226: dwrite d11/d27/f48 [0,4194304] 0 2024-09-18T12:49:12.637 INFO:tasks.workunit.client.1.smithi148.stdout:4/380: rename d15/d3f/f5e to d15/d5f/d77/d4c/d72/f79 0 2024-09-18T12:49:12.637 INFO:tasks.workunit.client.0.smithi078.stdout:4/227: write d11/f1d [2202943,99622] 0 2024-09-18T12:49:12.641 INFO:tasks.workunit.client.0.smithi078.stdout:4/228: truncate d11/d27/f4a 663416 0 2024-09-18T12:49:12.641 INFO:tasks.workunit.client.0.smithi078.stdout:8/271: dwrite d0/d7/f38 [4194304,4194304] 0 2024-09-18T12:49:12.646 INFO:tasks.workunit.client.1.smithi148.stdout:8/469: symlink d8/d12/d51/d94/la4 0 2024-09-18T12:49:12.647 INFO:tasks.workunit.client.1.smithi148.stdout:8/470: write d8/d16/d27/f30 [2468288,23438] 0 2024-09-18T12:49:12.649 INFO:tasks.workunit.client.0.smithi078.stdout:4/229: dwrite d11/d1f/f3a [0,4194304] 0 2024-09-18T12:49:12.653 INFO:tasks.workunit.client.1.smithi148.stdout:5/465: stat d7/d8/dc/d12/d1f/d69/d8b/f95 0 2024-09-18T12:49:12.654 INFO:tasks.workunit.client.1.smithi148.stdout:5/466: readlink d7/d8/dc/d12/d1f/l42 0 2024-09-18T12:49:12.654 INFO:tasks.workunit.client.0.smithi078.stdout:0/345: symlink d3/d1f/d2e/d4e/d37/l81 0 2024-09-18T12:49:12.657 INFO:tasks.workunit.client.0.smithi078.stdout:4/230: dwrite d11/d1f/f39 [0,4194304] 0 2024-09-18T12:49:12.657 INFO:tasks.workunit.client.0.smithi078.stdout:9/210: rename d5/d7/d32/d3a to d5/d40 0 2024-09-18T12:49:12.662 INFO:tasks.workunit.client.0.smithi078.stdout:3/261: link d9/df/c46 d9/d13/d37/c57 0 2024-09-18T12:49:12.667 INFO:tasks.workunit.client.1.smithi148.stdout:7/430: rename db/dc/d70/d77 to db/dc/df/d1d/d68/d7a 0 2024-09-18T12:49:12.668 INFO:tasks.workunit.client.1.smithi148.stdout:4/381: rename d15/d5f/d77/d4c/d4f/d34/c5c to d15/d5f/d77/d4c/d4f/d34/c7a 0 2024-09-18T12:49:12.670 INFO:tasks.workunit.client.1.smithi148.stdout:5/467: mknod d7/d8/dc/d12/d1f/c99 0 2024-09-18T12:49:12.671 INFO:tasks.workunit.client.0.smithi078.stdout:9/211: symlink d5/d7/d32/d2a/l41 0 2024-09-18T12:49:12.672 INFO:tasks.workunit.client.1.smithi148.stdout:5/468: chown d7/d8/dc/d12/d1f/l42 59077 1 2024-09-18T12:49:12.672 INFO:tasks.workunit.client.1.smithi148.stdout:1/406: rmdir dc/d4d/d85 0 2024-09-18T12:49:12.676 INFO:tasks.workunit.client.1.smithi148.stdout:0/604: mkdir de/d14/dcd 0 2024-09-18T12:49:12.676 INFO:tasks.workunit.client.0.smithi078.stdout:6/391: rmdir d10/d2b/d73 0 2024-09-18T12:49:12.677 INFO:tasks.workunit.client.0.smithi078.stdout:9/212: dwrite d5/d7/d32/d2a/f3d [0,4194304] 0 2024-09-18T12:49:12.683 INFO:tasks.workunit.client.1.smithi148.stdout:3/384: link d4/f89 d4/d8/d1e/d6b/d31/d54/f8a 0 2024-09-18T12:49:12.684 INFO:tasks.workunit.client.0.smithi078.stdout:9/213: symlink d5/l42 0 2024-09-18T12:49:12.685 INFO:tasks.workunit.client.1.smithi148.stdout:3/385: dread - d4/d8/d1e/d6b/d31/d46/f72 zero size 2024-09-18T12:49:12.686 INFO:tasks.workunit.client.1.smithi148.stdout:2/363: rename d9/d24/d31/d34/l41 to d9/d24/d31/d34/d42/l7d 0 2024-09-18T12:49:12.686 INFO:tasks.workunit.client.0.smithi078.stdout:4/231: getdents d11/d1f/d40 0 2024-09-18T12:49:12.688 INFO:tasks.workunit.client.1.smithi148.stdout:9/393: getdents d8/da/dd/d35/d47/d62/d72 0 2024-09-18T12:49:12.689 INFO:tasks.workunit.client.0.smithi078.stdout:6/392: mkdir d10/d2b/d43/d53/d63/d70/d77 0 2024-09-18T12:49:12.691 INFO:tasks.workunit.client.1.smithi148.stdout:5/469: fsync d7/d8/dc/d12/d20/f53 0 2024-09-18T12:49:12.691 INFO:tasks.workunit.client.0.smithi078.stdout:9/214: dwrite f3 [0,4194304] 0 2024-09-18T12:49:12.692 INFO:tasks.workunit.client.0.smithi078.stdout:0/346: dread d3/f5 [0,4194304] 0 2024-09-18T12:49:12.692 INFO:tasks.workunit.client.0.smithi078.stdout:6/393: write d10/f1c [4873985,68052] 0 2024-09-18T12:49:12.692 INFO:tasks.workunit.client.0.smithi078.stdout:3/262: getdents d9/d2f/d43 0 2024-09-18T12:49:12.693 INFO:tasks.workunit.client.1.smithi148.stdout:9/394: dwrite d8/da/dd/f31 [0,4194304] 0 2024-09-18T12:49:12.697 INFO:tasks.workunit.client.0.smithi078.stdout:4/232: symlink d11/d27/l4d 0 2024-09-18T12:49:12.698 INFO:tasks.workunit.client.0.smithi078.stdout:3/263: dread d9/d13/d33/d3c/d19/f1e [0,4194304] 0 2024-09-18T12:49:12.700 INFO:tasks.workunit.client.0.smithi078.stdout:3/264: write d9/d13/f39 [3375771,79677] 0 2024-09-18T12:49:12.701 INFO:tasks.workunit.client.1.smithi148.stdout:1/407: dread dc/d18/f1f [0,4194304] 0 2024-09-18T12:49:12.701 INFO:tasks.workunit.client.0.smithi078.stdout:3/265: chown d9/d13/d33/d4e/f25 0 1 2024-09-18T12:49:12.703 INFO:tasks.workunit.client.1.smithi148.stdout:3/386: mkdir d4/d8/d20/d2b/d43/d61/d8b 0 2024-09-18T12:49:12.706 INFO:tasks.workunit.client.0.smithi078.stdout:6/394: unlink d10/d2b/d43/d53/l67 0 2024-09-18T12:49:12.708 INFO:tasks.workunit.client.0.smithi078.stdout:4/233: mkdir d11/d27/d47/d4e 0 2024-09-18T12:49:12.709 INFO:tasks.workunit.client.1.smithi148.stdout:5/470: symlink d7/l9a 0 2024-09-18T12:49:12.710 INFO:tasks.workunit.client.1.smithi148.stdout:5/471: readlink d7/d8/dc/d12/d1f/d39/l94 0 2024-09-18T12:49:12.711 INFO:tasks.workunit.client.1.smithi148.stdout:5/472: truncate d7/d8/dc/d12/d1f/d69/f73 1209255 0 2024-09-18T12:49:12.713 INFO:tasks.workunit.client.1.smithi148.stdout:6/445: rename d5/d1a/dc/c2a to d5/d32/d38/d50/c8c 0 2024-09-18T12:49:12.714 INFO:tasks.workunit.client.1.smithi148.stdout:7/431: rename db/dc to db/dc/d70/d78/d7b 22 2024-09-18T12:49:12.715 INFO:tasks.workunit.client.1.smithi148.stdout:2/364: creat d9/d73/f7e x:0 0 0 2024-09-18T12:49:12.715 INFO:tasks.workunit.client.1.smithi148.stdout:2/365: chown d9/f39 3869292 1 2024-09-18T12:49:12.717 INFO:tasks.workunit.client.0.smithi078.stdout:4/234: mknod d11/d1f/d40/c4f 0 2024-09-18T12:49:12.717 INFO:tasks.workunit.client.0.smithi078.stdout:4/235: chown d11/d1f 128390 1 2024-09-18T12:49:12.718 INFO:tasks.workunit.client.0.smithi078.stdout:6/395: dwrite d10/d2b/d37/f48 [0,4194304] 0 2024-09-18T12:49:12.719 INFO:tasks.workunit.client.0.smithi078.stdout:3/266: symlink d9/d13/d33/l58 0 2024-09-18T12:49:12.720 INFO:tasks.workunit.client.0.smithi078.stdout:9/215: fdatasync f3 0 2024-09-18T12:49:12.722 INFO:tasks.workunit.client.1.smithi148.stdout:5/473: creat d7/d8/dc/d12/d1f/d77/f9b x:0 0 0 2024-09-18T12:49:12.723 INFO:tasks.workunit.client.1.smithi148.stdout:3/387: dread d4/d8/f35 [0,4194304] 0 2024-09-18T12:49:12.723 INFO:tasks.workunit.client.1.smithi148.stdout:3/388: dread - d4/d8/f4f zero size 2024-09-18T12:49:12.725 INFO:tasks.workunit.client.1.smithi148.stdout:6/446: creat d5/d79/f8d x:0 0 0 2024-09-18T12:49:12.727 INFO:tasks.workunit.client.0.smithi078.stdout:1/247: sync 2024-09-18T12:49:12.727 INFO:tasks.workunit.client.0.smithi078.stdout:7/169: sync 2024-09-18T12:49:12.728 INFO:tasks.workunit.client.0.smithi078.stdout:7/170: readlink d7/d26/l31 0 2024-09-18T12:49:12.729 INFO:tasks.workunit.client.0.smithi078.stdout:7/171: chown d7/d26/f2a 132 1 2024-09-18T12:49:12.730 INFO:tasks.workunit.client.1.smithi148.stdout:8/471: sync 2024-09-18T12:49:12.731 INFO:tasks.workunit.client.1.smithi148.stdout:4/382: rename d15/d5f/d77/l44 to d15/d17/d52/l7b 0 2024-09-18T12:49:12.732 INFO:tasks.workunit.client.1.smithi148.stdout:7/432: creat db/dc/d70/f7c x:0 0 0 2024-09-18T12:49:12.732 INFO:tasks.workunit.client.1.smithi148.stdout:9/395: rename d8/da to d8/da/dd/d4a/d49/d46/d54/d79 22 2024-09-18T12:49:12.733 INFO:tasks.workunit.client.1.smithi148.stdout:5/474: dwrite d7/d8/dc/d12/d20/f61 [0,4194304] 0 2024-09-18T12:49:12.733 INFO:tasks.workunit.client.0.smithi078.stdout:9/216: creat d5/d7/d32/d2a/d36/f43 x:0 0 0 2024-09-18T12:49:12.734 INFO:tasks.workunit.client.1.smithi148.stdout:0/605: truncate de/d14/f47 1274687 0 2024-09-18T12:49:12.735 INFO:tasks.workunit.client.1.smithi148.stdout:7/433: dread - db/dc/df/d2c/d55/f73 zero size 2024-09-18T12:49:12.736 INFO:tasks.workunit.client.1.smithi148.stdout:7/434: dread - db/dc/d70/f7c zero size 2024-09-18T12:49:12.737 INFO:tasks.workunit.client.0.smithi078.stdout:6/396: creat d10/d2b/d43/d53/d63/d70/d77/f78 x:0 0 0 2024-09-18T12:49:12.738 INFO:tasks.workunit.client.1.smithi148.stdout:1/408: creat dc/d11/d17/d2b/f86 x:0 0 0 2024-09-18T12:49:12.740 INFO:tasks.workunit.client.0.smithi078.stdout:9/217: dread - d5/d7/d32/f31 zero size 2024-09-18T12:49:12.741 INFO:tasks.workunit.client.0.smithi078.stdout:0/347: dread d3/d1f/d2e/d4e/f48 [0,4194304] 0 2024-09-18T12:49:12.743 INFO:tasks.workunit.client.0.smithi078.stdout:6/397: fsync d10/d2b/d43/f50 0 2024-09-18T12:49:12.743 INFO:tasks.workunit.client.1.smithi148.stdout:3/389: mknod d4/d8/d1e/d6b/d31/d59/c8c 0 2024-09-18T12:49:12.743 INFO:tasks.workunit.client.0.smithi078.stdout:9/218: read - d5/d7/d32/d2a/d36/f43 zero size 2024-09-18T12:49:12.744 INFO:tasks.workunit.client.1.smithi148.stdout:1/409: dwrite dc/d11/d38/d72/f73 [0,4194304] 0 2024-09-18T12:49:12.744 INFO:tasks.workunit.client.0.smithi078.stdout:7/172: dwrite d7/f1b [0,4194304] 0 2024-09-18T12:49:12.744 INFO:tasks.workunit.client.0.smithi078.stdout:0/348: readlink d3/d1f/d2e/l3e 0 2024-09-18T12:49:12.747 INFO:tasks.workunit.client.0.smithi078.stdout:0/349: chown d3/d1f/d2e/d4e/d37/l3c 354023363 1 2024-09-18T12:49:12.748 INFO:tasks.workunit.client.0.smithi078.stdout:4/236: dread d11/f14 [0,4194304] 0 2024-09-18T12:49:12.756 INFO:tasks.workunit.client.0.smithi078.stdout:3/267: dwrite d9/d13/d33/d3c/d19/f1e [0,4194304] 0 2024-09-18T12:49:12.764 INFO:tasks.workunit.client.0.smithi078.stdout:3/268: dwrite d9/d13/f1d [0,4194304] 0 2024-09-18T12:49:12.765 INFO:tasks.workunit.client.0.smithi078.stdout:1/248: symlink d0/d8/da/d45/l4e 0 2024-09-18T12:49:12.766 INFO:tasks.workunit.client.0.smithi078.stdout:1/249: readlink d0/l25 0 2024-09-18T12:49:12.769 INFO:tasks.workunit.client.1.smithi148.stdout:6/447: dwrite d5/d1a/d29/f6e [0,4194304] 0 2024-09-18T12:49:12.771 INFO:tasks.workunit.client.0.smithi078.stdout:9/219: rename d5/d7/d8/fd to d5/d7/d32/f44 0 2024-09-18T12:49:12.772 INFO:tasks.workunit.client.1.smithi148.stdout:4/383: fsync d15/d5f/d77/d4c/f57 0 2024-09-18T12:49:12.772 INFO:tasks.workunit.client.0.smithi078.stdout:9/220: chown d5/d7/d8/f35 534455539 1 2024-09-18T12:49:12.774 INFO:tasks.workunit.client.0.smithi078.stdout:7/173: mknod d7/d9/c34 0 2024-09-18T12:49:12.774 INFO:tasks.workunit.client.1.smithi148.stdout:9/396: mkdir d8/da/dd/d7a 0 2024-09-18T12:49:12.779 INFO:tasks.workunit.client.1.smithi148.stdout:9/397: dwrite d8/f5c [4194304,4194304] 0 2024-09-18T12:49:12.779 INFO:tasks.workunit.client.0.smithi078.stdout:1/250: dread - d0/d8/f26 zero size 2024-09-18T12:49:12.780 INFO:tasks.workunit.client.1.smithi148.stdout:9/398: stat d8/da/dd/d4a/d27/l2b 0 2024-09-18T12:49:12.781 INFO:tasks.workunit.client.1.smithi148.stdout:5/475: unlink d7/d8/dc/l1d 0 2024-09-18T12:49:12.781 INFO:tasks.workunit.client.0.smithi078.stdout:1/251: dread d0/d21/f2e [0,4194304] 0 2024-09-18T12:49:12.783 INFO:tasks.workunit.client.0.smithi078.stdout:6/398: symlink d10/l79 0 2024-09-18T12:49:12.784 INFO:tasks.workunit.client.1.smithi148.stdout:7/435: creat db/dc/d70/f7d x:0 0 0 2024-09-18T12:49:12.786 INFO:tasks.workunit.client.0.smithi078.stdout:7/174: mkdir d7/d9/d14/d22/d35 0 2024-09-18T12:49:12.787 INFO:tasks.workunit.client.0.smithi078.stdout:7/175: write d7/d9/fe [3127254,27416] 0 2024-09-18T12:49:12.787 INFO:tasks.workunit.client.1.smithi148.stdout:0/606: dread de/f18 [0,4194304] 0 2024-09-18T12:49:12.787 INFO:tasks.workunit.client.1.smithi148.stdout:7/436: chown db/dc/df/d11/c2d 54997253 1 2024-09-18T12:49:12.788 INFO:tasks.workunit.client.0.smithi078.stdout:0/350: mkdir d3/d82 0 2024-09-18T12:49:12.789 INFO:tasks.workunit.client.0.smithi078.stdout:7/176: truncate d7/d9/f2f 231901 0 2024-09-18T12:49:12.789 INFO:tasks.workunit.client.1.smithi148.stdout:3/390: mknod d4/d8/d1e/d63/c8d 0 2024-09-18T12:49:12.790 INFO:tasks.workunit.client.0.smithi078.stdout:1/252: creat d0/d8/da/d3e/f4f x:0 0 0 2024-09-18T12:49:12.791 INFO:tasks.workunit.client.1.smithi148.stdout:9/399: dwrite d8/da/dd/d35/d47/d4e/f71 [0,4194304] 0 2024-09-18T12:49:12.792 INFO:tasks.workunit.client.0.smithi078.stdout:6/399: rename d10/l3a to d10/d2b/d43/d53/d45/d55/l7a 0 2024-09-18T12:49:12.796 INFO:tasks.workunit.client.0.smithi078.stdout:1/253: rmdir d0/d8 39 2024-09-18T12:49:12.797 INFO:tasks.workunit.client.1.smithi148.stdout:7/437: dwrite db/dc/df/d2c/d55/f73 [0,4194304] 0 2024-09-18T12:49:12.798 INFO:tasks.workunit.client.0.smithi078.stdout:6/400: creat d10/d2b/d61/f7b x:0 0 0 2024-09-18T12:49:12.799 INFO:tasks.workunit.client.1.smithi148.stdout:8/472: rename d8/d16/d27/l1f to d8/d16/d53/d39/d3b/d4e/la5 0 2024-09-18T12:49:12.804 INFO:tasks.workunit.client.0.smithi078.stdout:3/269: dread d9/d13/d33/d3c/d19/f22 [0,4194304] 0 2024-09-18T12:49:12.805 INFO:tasks.workunit.client.0.smithi078.stdout:0/351: creat d3/d1f/d2e/f83 x:0 0 0 2024-09-18T12:49:12.807 INFO:tasks.workunit.client.1.smithi148.stdout:3/391: chown d4/c7 332557662 1 2024-09-18T12:49:12.808 INFO:tasks.workunit.client.1.smithi148.stdout:3/392: chown d4/d8/d1e/d6b/f47 1175 1 2024-09-18T12:49:12.810 INFO:tasks.workunit.client.1.smithi148.stdout:9/400: mknod d8/da/dd/d35/d5e/c7b 0 2024-09-18T12:49:12.810 INFO:tasks.workunit.client.1.smithi148.stdout:9/401: fdatasync d8/da/dd/d4a/f18 0 2024-09-18T12:49:12.811 INFO:tasks.workunit.client.1.smithi148.stdout:9/402: write d8/da/f1d [4028263,55039] 0 2024-09-18T12:49:12.814 INFO:tasks.workunit.client.0.smithi078.stdout:1/254: unlink d0/d8/da/l3d 0 2024-09-18T12:49:12.814 INFO:tasks.workunit.client.0.smithi078.stdout:7/177: dread d7/d9/f10 [0,4194304] 0 2024-09-18T12:49:12.814 INFO:tasks.workunit.client.0.smithi078.stdout:0/352: dwrite d3/d1f/d2e/d68/f44 [4194304,4194304] 0 2024-09-18T12:49:12.817 INFO:tasks.workunit.client.1.smithi148.stdout:7/438: chown db/dc/df/d11/f65 94173805 1 2024-09-18T12:49:12.817 INFO:tasks.workunit.client.1.smithi148.stdout:7/439: fsync db/dc/d70/f7c 0 2024-09-18T12:49:12.820 INFO:tasks.workunit.client.1.smithi148.stdout:1/410: rename dc/d11/d17 to dc/d11/d38/d87 0 2024-09-18T12:49:12.821 INFO:tasks.workunit.client.1.smithi148.stdout:1/411: write dc/f10 [9344744,11310] 0 2024-09-18T12:49:12.823 INFO:tasks.workunit.client.0.smithi078.stdout:1/255: unlink d0/d8/da/d3e/d46/c4a 0 2024-09-18T12:49:12.824 INFO:tasks.workunit.client.1.smithi148.stdout:8/473: symlink d8/df/d66/la6 0 2024-09-18T12:49:12.824 INFO:tasks.workunit.client.1.smithi148.stdout:7/440: dwrite db/dc/d70/f7c [0,4194304] 0 2024-09-18T12:49:12.825 INFO:tasks.workunit.client.1.smithi148.stdout:2/366: truncate d9/d24/f32 2813581 0 2024-09-18T12:49:12.827 INFO:tasks.workunit.client.1.smithi148.stdout:8/474: write d8/d12/d51/d94/f78 [404494,85419] 0 2024-09-18T12:49:12.827 INFO:tasks.workunit.client.1.smithi148.stdout:2/367: chown d9/d4a/f6b 744346 1 2024-09-18T12:49:12.827 INFO:tasks.workunit.client.0.smithi078.stdout:7/178: creat d7/d9/d32/f36 x:0 0 0 2024-09-18T12:49:12.828 INFO:tasks.workunit.client.0.smithi078.stdout:7/179: readlink d7/d9/lf 0 2024-09-18T12:49:12.828 INFO:tasks.workunit.client.0.smithi078.stdout:7/180: fsync d7/d9/fe 0 2024-09-18T12:49:12.829 INFO:tasks.workunit.client.0.smithi078.stdout:7/181: write f5 [344961,104246] 0 2024-09-18T12:49:12.844 INFO:tasks.workunit.client.1.smithi148.stdout:0/607: dread de/d14/f26 [0,4194304] 0 2024-09-18T12:49:12.872 INFO:tasks.workunit.client.0.smithi078.stdout:2/244: sync 2024-09-18T12:49:12.872 INFO:tasks.workunit.client.0.smithi078.stdout:5/341: sync 2024-09-18T12:49:12.900 INFO:tasks.workunit.client.0.smithi078.stdout:1/256: fsync d0/d8/f3f 0 2024-09-18T12:49:12.905 INFO:tasks.workunit.client.1.smithi148.stdout:9/403: mknod d8/da/dd/d3f/c7c 0 2024-09-18T12:49:12.907 INFO:tasks.workunit.client.0.smithi078.stdout:5/342: rmdir d2/d4 39 2024-09-18T12:49:12.913 INFO:tasks.workunit.client.0.smithi078.stdout:1/257: mkdir d0/d8/da/d3e/d50 0 2024-09-18T12:49:12.914 INFO:tasks.workunit.client.1.smithi148.stdout:1/412: truncate dc/d11/f16 864504 0 2024-09-18T12:49:12.915 INFO:tasks.workunit.client.0.smithi078.stdout:1/258: truncate d0/d37/f48 1074983 0 2024-09-18T12:49:12.915 INFO:tasks.workunit.client.1.smithi148.stdout:1/413: dread - dc/d51/f83 zero size 2024-09-18T12:49:12.918 INFO:tasks.workunit.client.0.smithi078.stdout:6/401: dwrite d10/f24 [0,4194304] 0 2024-09-18T12:49:12.919 INFO:tasks.workunit.client.1.smithi148.stdout:7/441: fsync db/dc/df/d11/f1b 0 2024-09-18T12:49:12.920 INFO:tasks.workunit.client.1.smithi148.stdout:6/448: dwrite d5/d1a/f1f [0,4194304] 0 2024-09-18T12:49:12.921 INFO:tasks.workunit.client.1.smithi148.stdout:7/442: write db/dc/df/d2c/d55/f6e [479262,12605] 0 2024-09-18T12:49:12.925 INFO:tasks.workunit.client.0.smithi078.stdout:1/259: dwrite d0/d8/da/f35 [0,4194304] 0 2024-09-18T12:49:12.927 INFO:tasks.workunit.client.0.smithi078.stdout:0/353: write d3/d1f/d2e/d4e/f3d [1821830,14780] 0 2024-09-18T12:49:12.927 INFO:tasks.workunit.client.0.smithi078.stdout:1/260: dread - d0/d8/f38 zero size 2024-09-18T12:49:12.929 INFO:tasks.workunit.client.0.smithi078.stdout:1/261: dread - d0/d8/da/d3e/f42 zero size 2024-09-18T12:49:12.929 INFO:tasks.workunit.client.0.smithi078.stdout:5/343: dread d2/d4/f4f [0,4194304] 0 2024-09-18T12:49:12.930 INFO:tasks.workunit.client.1.smithi148.stdout:7/443: dread db/dc/df/d11/f47 [0,4194304] 0 2024-09-18T12:49:12.931 INFO:tasks.workunit.client.0.smithi078.stdout:6/402: rename d10/c5e to d10/d2b/d43/d53/d45/d55/c7c 0 2024-09-18T12:49:12.931 INFO:tasks.workunit.client.0.smithi078.stdout:1/262: dread d0/d21/f2e [0,4194304] 0 2024-09-18T12:49:12.935 INFO:tasks.workunit.client.1.smithi148.stdout:0/608: creat de/d27/d53/d89/fce x:0 0 0 2024-09-18T12:49:12.937 INFO:tasks.workunit.client.1.smithi148.stdout:3/393: truncate d4/d8/f24 2366894 0 2024-09-18T12:49:12.938 INFO:tasks.workunit.client.1.smithi148.stdout:9/404: truncate d8/da/dd/d3f/f6a 1015761 0 2024-09-18T12:49:12.940 INFO:tasks.workunit.client.1.smithi148.stdout:4/384: link d15/d5f/d77/l45 d15/d17/d52/l7c 0 2024-09-18T12:49:12.942 INFO:tasks.workunit.client.0.smithi078.stdout:5/344: creat d2/d4/d9/d49/f6c x:0 0 0 2024-09-18T12:49:12.943 INFO:tasks.workunit.client.1.smithi148.stdout:5/476: getdents d7/d8/dc/d12/d1f/d69 0 2024-09-18T12:49:12.945 INFO:tasks.workunit.client.0.smithi078.stdout:1/263: creat d0/d8/da/d3e/d46/f51 x:0 0 0 2024-09-18T12:49:12.947 INFO:tasks.workunit.client.1.smithi148.stdout:1/414: creat dc/d18/d31/f88 x:0 0 0 2024-09-18T12:49:12.948 INFO:tasks.workunit.client.0.smithi078.stdout:6/403: mkdir d10/d2b/d43/d53/d63/d70/d7d 0 2024-09-18T12:49:12.948 INFO:tasks.workunit.client.0.smithi078.stdout:1/264: dread d0/d37/f3c [0,4194304] 0 2024-09-18T12:49:12.949 INFO:tasks.workunit.client.0.smithi078.stdout:6/404: chown d10/d2b/d37/f59 1445830509 1 2024-09-18T12:49:12.950 INFO:tasks.workunit.client.0.smithi078.stdout:1/265: truncate d0/d21/f36 1171329 0 2024-09-18T12:49:12.951 INFO:tasks.workunit.client.0.smithi078.stdout:0/354: fsync d3/f1d 0 2024-09-18T12:49:12.952 INFO:tasks.workunit.client.1.smithi148.stdout:6/449: fdatasync d5/d1a/d29/d5c/f77 0 2024-09-18T12:49:12.953 INFO:tasks.workunit.client.0.smithi078.stdout:7/182: truncate d7/d9/f13 2652040 0 2024-09-18T12:49:12.954 INFO:tasks.workunit.client.0.smithi078.stdout:5/345: mknod d2/d4/d12/d16/d36/d4c/c6d 0 2024-09-18T12:49:12.957 INFO:tasks.workunit.client.0.smithi078.stdout:5/346: truncate d2/d4/d9/da/d2b/f69 342430 0 2024-09-18T12:49:12.957 INFO:tasks.workunit.client.1.smithi148.stdout:8/475: mkdir d8/df/d3e/d82/da7 0 2024-09-18T12:49:12.959 INFO:tasks.workunit.client.0.smithi078.stdout:6/405: creat d10/d2b/d43/d53/d63/d70/d77/f7e x:0 0 0 2024-09-18T12:49:12.960 INFO:tasks.workunit.client.0.smithi078.stdout:6/406: fdatasync d10/d2b/d43/f64 0 2024-09-18T12:49:12.960 INFO:tasks.workunit.client.0.smithi078.stdout:2/245: dwrite d4/db/dc/f1b [0,4194304] 0 2024-09-18T12:49:12.961 INFO:tasks.workunit.client.0.smithi078.stdout:6/407: stat d10/d2b/d37/f4a 0 2024-09-18T12:49:12.962 INFO:tasks.workunit.client.1.smithi148.stdout:7/444: creat db/dc/df/d2c/f7e x:0 0 0 2024-09-18T12:49:12.962 INFO:tasks.workunit.client.1.smithi148.stdout:7/445: chown db/dc/df 1879995 1 2024-09-18T12:49:12.963 INFO:tasks.workunit.client.1.smithi148.stdout:7/446: fsync db/dc/d70/d75/f56 0 2024-09-18T12:49:12.964 INFO:tasks.workunit.client.0.smithi078.stdout:1/266: rename d0/d21 to d0/d8/da/d3e/d46/d52 0 2024-09-18T12:49:12.967 INFO:tasks.workunit.client.0.smithi078.stdout:6/408: dwrite d10/f24 [0,4194304] 0 2024-09-18T12:49:12.970 INFO:tasks.workunit.client.0.smithi078.stdout:7/183: mknod d7/d9/d14/c37 0 2024-09-18T12:49:12.972 INFO:tasks.workunit.client.0.smithi078.stdout:6/409: read d10/d2b/d43/d53/f42 [7720418,9677] 0 2024-09-18T12:49:12.974 INFO:tasks.workunit.client.0.smithi078.stdout:6/410: dread - d10/d2b/d43/d53/d45/d55/d3f/f5f zero size 2024-09-18T12:49:12.974 INFO:tasks.workunit.client.0.smithi078.stdout:5/347: rmdir d2/d4/d12/d16/d36/d4c/d62/d4d 39 2024-09-18T12:49:12.974 INFO:tasks.workunit.client.1.smithi148.stdout:4/385: creat d15/d17/d52/f7d x:0 0 0 2024-09-18T12:49:12.976 INFO:tasks.workunit.client.0.smithi078.stdout:2/246: dread - d4/d1a/f43 zero size 2024-09-18T12:49:12.979 INFO:tasks.workunit.client.1.smithi148.stdout:6/450: creat d5/d79/f8e x:0 0 0 2024-09-18T12:49:12.981 INFO:tasks.workunit.client.0.smithi078.stdout:1/267: write d0/d8/da/d3e/d46/f4d [817195,50635] 0 2024-09-18T12:49:12.982 INFO:tasks.workunit.client.0.smithi078.stdout:1/268: chown d0/l25 11786797 1 2024-09-18T12:49:12.983 INFO:tasks.workunit.client.0.smithi078.stdout:5/348: dwrite d2/d4/d12/d16/d36/f41 [4194304,4194304] 0 2024-09-18T12:49:12.984 INFO:tasks.workunit.client.1.smithi148.stdout:8/476: creat d8/d12/d46/fa8 x:0 0 0 2024-09-18T12:49:12.988 INFO:tasks.workunit.client.0.smithi078.stdout:7/184: creat d7/d9/d32/f38 x:0 0 0 2024-09-18T12:49:12.989 INFO:tasks.workunit.client.1.smithi148.stdout:2/368: link d9/d17/l51 d9/d4a/l7f 0 2024-09-18T12:49:12.991 INFO:tasks.workunit.client.0.smithi078.stdout:1/269: dwrite d0/d8/da/d3e/d46/d52/f2d [4194304,4194304] 0 2024-09-18T12:49:12.996 INFO:tasks.workunit.client.0.smithi078.stdout:2/247: rename d4/dd/d18/d3b/f3f to d4/d8/f4b 0 2024-09-18T12:49:13.000 INFO:tasks.workunit.client.1.smithi148.stdout:3/394: creat d4/d8/d20/d2b/d7f/f8e x:0 0 0 2024-09-18T12:49:13.002 INFO:tasks.workunit.client.1.smithi148.stdout:9/405: rename d8/da/dd/d4a/c23 to d8/da/dd/d4a/d27/c7d 0 2024-09-18T12:49:13.004 INFO:tasks.workunit.client.0.smithi078.stdout:7/185: symlink d7/d26/l39 0 2024-09-18T12:49:13.004 INFO:tasks.workunit.client.0.smithi078.stdout:0/355: dwrite d3/d1f/d2e/d68/d30/f62 [0,4194304] 0 2024-09-18T12:49:13.005 INFO:tasks.workunit.client.1.smithi148.stdout:3/395: dwrite d4/d8/d1e/d6b/f47 [0,4194304] 0 2024-09-18T12:49:13.006 INFO:tasks.workunit.client.1.smithi148.stdout:4/386: symlink d15/d5f/d77/d4c/d4f/d34/l7e 0 2024-09-18T12:49:13.006 INFO:tasks.workunit.client.1.smithi148.stdout:3/396: dread - d4/d8/d1e/d6b/f81 zero size 2024-09-18T12:49:13.008 INFO:tasks.workunit.client.0.smithi078.stdout:6/411: symlink d10/l7f 0 2024-09-18T12:49:13.011 INFO:tasks.workunit.client.1.smithi148.stdout:1/415: creat dc/d18/d7d/d7e/f89 x:0 0 0 2024-09-18T12:49:13.011 INFO:tasks.workunit.client.0.smithi078.stdout:8/272: sync 2024-09-18T12:49:13.011 INFO:tasks.workunit.client.0.smithi078.stdout:4/237: sync 2024-09-18T12:49:13.013 INFO:tasks.workunit.client.1.smithi148.stdout:6/451: creat d5/d1a/d29/d5c/f8f x:0 0 0 2024-09-18T12:49:13.014 INFO:tasks.workunit.client.1.smithi148.stdout:4/387: dwrite d15/d5f/d77/d4c/d4f/d34/f6b [0,4194304] 0 2024-09-18T12:49:13.015 INFO:tasks.workunit.client.0.smithi078.stdout:1/270: truncate d0/d37/f3c 381728 0 2024-09-18T12:49:13.018 INFO:tasks.workunit.client.0.smithi078.stdout:6/412: dwrite d10/d2b/d43/d53/d45/d55/f2d [0,4194304] 0 2024-09-18T12:49:13.019 INFO:tasks.workunit.client.1.smithi148.stdout:2/369: creat d9/d24/f80 x:0 0 0 2024-09-18T12:49:13.021 INFO:tasks.workunit.client.0.smithi078.stdout:5/349: mknod d2/d4/d9/da/d2b/d3e/c6e 0 2024-09-18T12:49:13.022 INFO:tasks.workunit.client.1.smithi148.stdout:0/609: creat de/d14/fcf x:0 0 0 2024-09-18T12:49:13.028 INFO:tasks.workunit.client.0.smithi078.stdout:8/273: symlink d0/d7/dc/d1f/d23/d44/l51 0 2024-09-18T12:49:13.029 INFO:tasks.workunit.client.0.smithi078.stdout:1/271: truncate d0/d8/f3f 730331 0 2024-09-18T12:49:13.031 INFO:tasks.workunit.client.0.smithi078.stdout:6/413: symlink d10/d2b/d43/d53/d63/d70/d77/l80 0 2024-09-18T12:49:13.033 INFO:tasks.workunit.client.0.smithi078.stdout:0/356: dwrite d3/f47 [0,4194304] 0 2024-09-18T12:49:13.033 INFO:tasks.workunit.client.1.smithi148.stdout:6/452: fsync d5/fa 0 2024-09-18T12:49:13.034 INFO:tasks.workunit.client.0.smithi078.stdout:5/350: creat d2/d4/d9/d2f/f6f x:0 0 0 2024-09-18T12:49:13.034 INFO:tasks.workunit.client.0.smithi078.stdout:7/186: mknod d7/d9/d14/d22/d35/c3a 0 2024-09-18T12:49:13.035 INFO:tasks.workunit.client.0.smithi078.stdout:5/351: fsync d2/f26 0 2024-09-18T12:49:13.035 INFO:tasks.workunit.client.0.smithi078.stdout:4/238: getdents d11/d27/d47/d4e 0 2024-09-18T12:49:13.036 INFO:tasks.workunit.client.0.smithi078.stdout:2/248: dread d4/db/dc/f2f [0,4194304] 0 2024-09-18T12:49:13.039 INFO:tasks.workunit.client.1.smithi148.stdout:5/477: sync 2024-09-18T12:49:13.039 INFO:tasks.workunit.client.0.smithi078.stdout:2/249: rename d4/db to d4/db/d4c 22 2024-09-18T12:49:13.039 INFO:tasks.workunit.client.0.smithi078.stdout:0/357: chown d3/d1f/d2e/d4e/d37/d72 586144 1 2024-09-18T12:49:13.040 INFO:tasks.workunit.client.1.smithi148.stdout:9/406: creat d8/da/dd/d4a/d49/d46/d75/f7e x:0 0 0 2024-09-18T12:49:13.042 INFO:tasks.workunit.client.0.smithi078.stdout:1/272: rename d0/d8/da/d3e/d46/d52/c2a to d0/d8/da/d3e/d46/d52/c53 0 2024-09-18T12:49:13.043 INFO:tasks.workunit.client.0.smithi078.stdout:9/221: sync 2024-09-18T12:49:13.043 INFO:tasks.workunit.client.0.smithi078.stdout:3/270: sync 2024-09-18T12:49:13.044 INFO:tasks.workunit.client.1.smithi148.stdout:1/416: mkdir dc/d18/d8a 0 2024-09-18T12:49:13.045 INFO:tasks.workunit.client.1.smithi148.stdout:1/417: fsync dc/d11/d38/d87/f35 0 2024-09-18T12:49:13.046 INFO:tasks.workunit.client.0.smithi078.stdout:7/187: mkdir d7/d9/d32/d3b 0 2024-09-18T12:49:13.047 INFO:tasks.workunit.client.0.smithi078.stdout:2/250: dread d4/dd/f40 [4194304,4194304] 0 2024-09-18T12:49:13.047 INFO:tasks.workunit.client.1.smithi148.stdout:6/453: mknod d5/d32/d38/c90 0 2024-09-18T12:49:13.048 INFO:tasks.workunit.client.0.smithi078.stdout:2/251: stat d4/d1a/f30 0 2024-09-18T12:49:13.048 INFO:tasks.workunit.client.0.smithi078.stdout:2/252: readlink d4/dd/l27 0 2024-09-18T12:49:13.049 INFO:tasks.workunit.client.0.smithi078.stdout:6/414: rename d10/d2b/d43/d53/d63/d70/d77/l80 to d10/d2b/d43/l81 0 2024-09-18T12:49:13.051 INFO:tasks.workunit.client.0.smithi078.stdout:5/352: symlink d2/d4/d12/d16/d36/d4c/l70 0 2024-09-18T12:49:13.052 INFO:tasks.workunit.client.1.smithi148.stdout:8/477: creat d8/df/d3e/d82/fa9 x:0 0 0 2024-09-18T12:49:13.053 INFO:tasks.workunit.client.1.smithi148.stdout:8/478: chown d8/d12/d51/c90 13643 1 2024-09-18T12:49:13.059 INFO:tasks.workunit.client.1.smithi148.stdout:8/479: dwrite d8/d16/f9c [0,4194304] 0 2024-09-18T12:49:13.059 INFO:tasks.workunit.client.1.smithi148.stdout:0/610: rename de/d27/f4e to de/d27/d53/d89/dbb/db5/fd0 0 2024-09-18T12:49:13.059 INFO:tasks.workunit.client.0.smithi078.stdout:8/274: dread d0/d7/fb [0,4194304] 0 2024-09-18T12:49:13.060 INFO:tasks.workunit.client.1.smithi148.stdout:8/480: write d8/d16/d53/d39/f67 [334584,50337] 0 2024-09-18T12:49:13.064 INFO:tasks.workunit.client.1.smithi148.stdout:8/481: truncate d8/d12/f1b 4887960 0 2024-09-18T12:49:13.064 INFO:tasks.workunit.client.1.smithi148.stdout:5/478: dread d7/d2b/f36 [0,4194304] 0 2024-09-18T12:49:13.065 INFO:tasks.workunit.client.1.smithi148.stdout:3/397: creat d4/d8/d20/d2b/f8f x:0 0 0 2024-09-18T12:49:13.065 INFO:tasks.workunit.client.1.smithi148.stdout:5/479: write d7/d8/d18/d3f/f6f [1207936,63005] 0 2024-09-18T12:49:13.066 INFO:tasks.workunit.client.0.smithi078.stdout:3/271: rmdir d9/d2f/d43 39 2024-09-18T12:49:13.066 INFO:tasks.workunit.client.1.smithi148.stdout:3/398: write d4/d8/d1e/d6b/f4d [768847,116631] 0 2024-09-18T12:49:13.071 INFO:tasks.workunit.client.1.smithi148.stdout:7/447: truncate db/d52/d25/f3c 654980 0 2024-09-18T12:49:13.071 INFO:tasks.workunit.client.1.smithi148.stdout:6/454: creat d5/d79/f91 x:0 0 0 2024-09-18T12:49:13.074 INFO:tasks.workunit.client.0.smithi078.stdout:5/353: creat d2/d4/d48/f71 x:0 0 0 2024-09-18T12:49:13.074 INFO:tasks.workunit.client.0.smithi078.stdout:5/354: chown d2/d4/c5d 176260 1 2024-09-18T12:49:13.076 INFO:tasks.workunit.client.1.smithi148.stdout:6/455: dwrite d5/d1a/f1f [0,4194304] 0 2024-09-18T12:49:13.078 INFO:tasks.workunit.client.0.smithi078.stdout:1/273: creat d0/d8/da/d3e/d50/f54 x:0 0 0 2024-09-18T12:49:13.081 INFO:tasks.workunit.client.1.smithi148.stdout:4/388: write d15/d17/f27 [1504152,41618] 0 2024-09-18T12:49:13.087 INFO:tasks.workunit.client.0.smithi078.stdout:7/188: mkdir d7/d3c 0 2024-09-18T12:49:13.087 INFO:tasks.workunit.client.0.smithi078.stdout:4/239: write d11/f14 [4124561,92990] 0 2024-09-18T12:49:13.090 INFO:tasks.workunit.client.0.smithi078.stdout:7/189: write d7/d9/f20 [469796,75918] 0 2024-09-18T12:49:13.090 INFO:tasks.workunit.client.0.smithi078.stdout:6/415: dread fb [0,4194304] 0 2024-09-18T12:49:13.091 INFO:tasks.workunit.client.0.smithi078.stdout:7/190: write d7/d9/f2f [970902,50963] 0 2024-09-18T12:49:13.092 INFO:tasks.workunit.client.0.smithi078.stdout:5/355: unlink d2/d4/f33 0 2024-09-18T12:49:13.092 INFO:tasks.workunit.client.0.smithi078.stdout:6/416: chown d10/d2b/d43/d53/d63/d6b 61 1 2024-09-18T12:49:13.093 INFO:tasks.workunit.client.0.smithi078.stdout:5/356: dread - d2/d4/d12/f67 zero size 2024-09-18T12:49:13.094 INFO:tasks.workunit.client.0.smithi078.stdout:6/417: chown d10/d2b/d43/d53/d45/d55/f4f 0 1 2024-09-18T12:49:13.094 INFO:tasks.workunit.client.0.smithi078.stdout:5/357: chown d2/d4/d48 65308265 1 2024-09-18T12:49:13.095 INFO:tasks.workunit.client.1.smithi148.stdout:3/399: mknod d4/d8/d1e/c90 0 2024-09-18T12:49:13.095 INFO:tasks.workunit.client.0.smithi078.stdout:6/418: chown d10/d2b/d61/f66 26408006 1 2024-09-18T12:49:13.096 INFO:tasks.workunit.client.0.smithi078.stdout:1/274: write d0/d8/f14 [276903,85951] 0 2024-09-18T12:49:13.100 INFO:tasks.workunit.client.1.smithi148.stdout:2/370: dwrite d9/d24/d31/f66 [0,4194304] 0 2024-09-18T12:49:13.103 INFO:tasks.workunit.client.0.smithi078.stdout:0/358: dwrite d3/d1f/d2e/d68/d30/f59 [0,4194304] 0 2024-09-18T12:49:13.104 INFO:tasks.workunit.client.1.smithi148.stdout:6/456: truncate d5/d32/d38/d50/f52 3372036 0 2024-09-18T12:49:13.107 INFO:tasks.workunit.client.1.smithi148.stdout:0/611: mkdir de/d27/dd1 0 2024-09-18T12:49:13.108 INFO:tasks.workunit.client.0.smithi078.stdout:2/253: dwrite d4/d20/f29 [0,4194304] 0 2024-09-18T12:49:13.109 INFO:tasks.workunit.client.0.smithi078.stdout:2/254: stat d4/d8/f1d 0 2024-09-18T12:49:13.111 INFO:tasks.workunit.client.1.smithi148.stdout:9/407: rmdir d8/da/dd/d7a 0 2024-09-18T12:49:13.112 INFO:tasks.workunit.client.0.smithi078.stdout:8/275: write d0/d7/dc/f3c [674644,34022] 0 2024-09-18T12:49:13.114 INFO:tasks.workunit.client.1.smithi148.stdout:9/408: write d8/da/dd/d3f/f58 [1205268,27317] 0 2024-09-18T12:49:13.114 INFO:tasks.workunit.client.1.smithi148.stdout:5/480: mknod d7/d8/dc/d12/c9c 0 2024-09-18T12:49:13.115 INFO:tasks.workunit.client.1.smithi148.stdout:0/612: dwrite de/f9b [0,4194304] 0 2024-09-18T12:49:13.116 INFO:tasks.workunit.client.1.smithi148.stdout:5/481: dread - d7/f4f zero size 2024-09-18T12:49:13.117 INFO:tasks.workunit.client.0.smithi078.stdout:6/419: creat d10/d2b/d43/d53/d63/d70/d77/f82 x:0 0 0 2024-09-18T12:49:13.119 INFO:tasks.workunit.client.1.smithi148.stdout:3/400: rename d4/f41 to d4/d8/d1e/f91 0 2024-09-18T12:49:13.119 INFO:tasks.workunit.client.1.smithi148.stdout:7/448: symlink db/dc/df/l7f 0 2024-09-18T12:49:13.121 INFO:tasks.workunit.client.1.smithi148.stdout:8/482: dwrite d8/d12/d46/f5a [0,4194304] 0 2024-09-18T12:49:13.121 INFO:tasks.workunit.client.1.smithi148.stdout:2/371: fsync f5 0 2024-09-18T12:49:13.122 INFO:tasks.workunit.client.1.smithi148.stdout:8/483: readlink d8/d12/l1a 0 2024-09-18T12:49:13.123 INFO:tasks.workunit.client.1.smithi148.stdout:8/484: dread - d8/d16/f7a zero size 2024-09-18T12:49:13.126 INFO:tasks.workunit.client.1.smithi148.stdout:1/418: truncate dc/d11/d38/d87/f3c 2752408 0 2024-09-18T12:49:13.127 INFO:tasks.workunit.client.0.smithi078.stdout:3/272: creat d9/f59 x:0 0 0 2024-09-18T12:49:13.128 INFO:tasks.workunit.client.1.smithi148.stdout:4/389: mkdir d15/d5f/d69/d7f 0 2024-09-18T12:49:13.131 INFO:tasks.workunit.client.1.smithi148.stdout:0/613: rmdir de 39 2024-09-18T12:49:13.132 INFO:tasks.workunit.client.0.smithi078.stdout:2/255: symlink d4/d1a/l4d 0 2024-09-18T12:49:13.133 INFO:tasks.workunit.client.1.smithi148.stdout:5/482: creat d7/d8/f9d x:0 0 0 2024-09-18T12:49:13.136 INFO:tasks.workunit.client.0.smithi078.stdout:8/276: mkdir d0/d7/d1e/d33/d52 0 2024-09-18T12:49:13.137 INFO:tasks.workunit.client.0.smithi078.stdout:5/358: mknod d2/d4/d12/d16/d36/d4c/d62/c72 0 2024-09-18T12:49:13.137 INFO:tasks.workunit.client.0.smithi078.stdout:3/273: dwrite d9/d13/d33/d3c/d19/f49 [0,4194304] 0 2024-09-18T12:49:13.137 INFO:tasks.workunit.client.0.smithi078.stdout:2/256: dread d4/db/dc/f1b [4194304,4194304] 0 2024-09-18T12:49:13.138 INFO:tasks.workunit.client.1.smithi148.stdout:2/372: unlink d9/fc 0 2024-09-18T12:49:13.142 INFO:tasks.workunit.client.0.smithi078.stdout:6/420: creat d10/d2b/d43/d53/d45/d55/f83 x:0 0 0 2024-09-18T12:49:13.144 INFO:tasks.workunit.client.0.smithi078.stdout:9/222: link d5/d7/c22 d5/d7/c45 0 2024-09-18T12:49:13.145 INFO:tasks.workunit.client.1.smithi148.stdout:1/419: rmdir dc/d51 39 2024-09-18T12:49:13.145 INFO:tasks.workunit.client.0.smithi078.stdout:0/359: truncate d3/f20 6792420 0 2024-09-18T12:49:13.146 INFO:tasks.workunit.client.0.smithi078.stdout:6/421: write d10/d2b/d43/f50 [1053704,103261] 0 2024-09-18T12:49:13.147 INFO:tasks.workunit.client.1.smithi148.stdout:8/485: rename d8/d12/c5f to d8/d12/d46/caa 0 2024-09-18T12:49:13.149 INFO:tasks.workunit.client.1.smithi148.stdout:4/390: readlink d15/d17/d52/d68/l73 0 2024-09-18T12:49:13.149 INFO:tasks.workunit.client.0.smithi078.stdout:9/223: write d5/d7/d32/f31 [156555,125204] 0 2024-09-18T12:49:13.151 INFO:tasks.workunit.client.1.smithi148.stdout:8/486: write d8/d12/d46/fa8 [343710,107193] 0 2024-09-18T12:49:13.151 INFO:tasks.workunit.client.0.smithi078.stdout:5/359: dwrite d2/d4/d9/d49/f4b [0,4194304] 0 2024-09-18T12:49:13.152 INFO:tasks.workunit.client.0.smithi078.stdout:3/274: dwrite d9/d13/d33/d3c/d19/f1e [4194304,4194304] 0 2024-09-18T12:49:13.153 INFO:tasks.workunit.client.1.smithi148.stdout:7/449: mknod db/c80 0 2024-09-18T12:49:13.153 INFO:tasks.workunit.client.1.smithi148.stdout:1/420: dwrite dc/d18/d31/d4b/f65 [4194304,4194304] 0 2024-09-18T12:49:13.155 INFO:tasks.workunit.client.0.smithi078.stdout:2/257: creat d4/dd/f4e x:0 0 0 2024-09-18T12:49:13.155 INFO:tasks.workunit.client.1.smithi148.stdout:2/373: rmdir d9/d24/d31 39 2024-09-18T12:49:13.160 INFO:tasks.workunit.client.0.smithi078.stdout:0/360: mknod d3/d1f/d2e/d4e/d37/c84 0 2024-09-18T12:49:13.162 INFO:tasks.workunit.client.0.smithi078.stdout:3/275: dread d9/d13/d33/d3c/d19/f22 [0,4194304] 0 2024-09-18T12:49:13.163 INFO:tasks.workunit.client.0.smithi078.stdout:9/224: creat d5/d7/d8/f46 x:0 0 0 2024-09-18T12:49:13.164 INFO:tasks.workunit.client.0.smithi078.stdout:2/258: dwrite d4/d20/f29 [0,4194304] 0 2024-09-18T12:49:13.165 INFO:tasks.workunit.client.1.smithi148.stdout:0/614: dwrite de/d14/d43/f5e [0,4194304] 0 2024-09-18T12:49:13.166 INFO:tasks.workunit.client.0.smithi078.stdout:2/259: fdatasync d4/d8/f37 0 2024-09-18T12:49:13.167 INFO:tasks.workunit.client.0.smithi078.stdout:5/360: creat d2/d4/d9/d49/f73 x:0 0 0 2024-09-18T12:49:13.167 INFO:tasks.workunit.client.1.smithi148.stdout:3/401: dread d4/d8/d1e/d6b/d31/d54/f67 [0,4194304] 0 2024-09-18T12:49:13.168 INFO:tasks.workunit.client.0.smithi078.stdout:8/277: truncate d0/d7/f24 94375 0 2024-09-18T12:49:13.168 INFO:tasks.workunit.client.0.smithi078.stdout:2/260: chown d4/db/dc/l2c 5076 1 2024-09-18T12:49:13.169 INFO:tasks.workunit.client.0.smithi078.stdout:2/261: stat d4/d8/l35 0 2024-09-18T12:49:13.170 INFO:tasks.workunit.client.0.smithi078.stdout:0/361: fdatasync d3/f17 0 2024-09-18T12:49:13.170 INFO:tasks.workunit.client.1.smithi148.stdout:2/374: mkdir d9/d73/d81 0 2024-09-18T12:49:13.170 INFO:tasks.workunit.client.1.smithi148.stdout:6/457: link d5/d32/l63 d5/d1a/l92 0 2024-09-18T12:49:13.172 INFO:tasks.workunit.client.1.smithi148.stdout:4/391: symlink d15/l80 0 2024-09-18T12:49:13.172 INFO:tasks.workunit.client.1.smithi148.stdout:7/450: dwrite db/dc/d70/d75/f56 [0,4194304] 0 2024-09-18T12:49:13.174 INFO:tasks.workunit.client.0.smithi078.stdout:6/422: creat d10/d2b/d43/d53/d63/d70/d7d/f84 x:0 0 0 2024-09-18T12:49:13.174 INFO:tasks.workunit.client.1.smithi148.stdout:8/487: getdents d8/df/d3e/d82/da7 0 2024-09-18T12:49:13.177 INFO:tasks.workunit.client.1.smithi148.stdout:1/421: creat dc/d18/d63/f8b x:0 0 0 2024-09-18T12:49:13.177 INFO:tasks.workunit.client.0.smithi078.stdout:9/225: mknod d5/d40/c47 0 2024-09-18T12:49:13.177 INFO:tasks.workunit.client.1.smithi148.stdout:1/422: write dc/d18/d31/f88 [448652,79728] 0 2024-09-18T12:49:13.185 INFO:tasks.workunit.client.0.smithi078.stdout:3/276: rename d9/d13/l47 to d9/d29/d4b/d4c/l5a 0 2024-09-18T12:49:13.186 INFO:tasks.workunit.client.0.smithi078.stdout:1/275: dwrite d0/d8/da/f23 [0,4194304] 0 2024-09-18T12:49:13.187 INFO:tasks.workunit.client.0.smithi078.stdout:0/362: dwrite d3/d1f/d2e/d4e/d37/f5c [4194304,4194304] 0 2024-09-18T12:49:13.187 INFO:tasks.workunit.client.1.smithi148.stdout:2/375: mknod d9/d24/d67/c82 0 2024-09-18T12:49:13.187 INFO:tasks.workunit.client.0.smithi078.stdout:9/226: dread d5/d7/d32/f24 [0,4194304] 0 2024-09-18T12:49:13.188 INFO:tasks.workunit.client.0.smithi078.stdout:3/277: stat d9/d13 0 2024-09-18T12:49:13.198 INFO:tasks.workunit.client.1.smithi148.stdout:6/458: creat d5/d1a/d29/d5c/f93 x:0 0 0 2024-09-18T12:49:13.203 INFO:tasks.workunit.client.1.smithi148.stdout:3/402: rename d4/d8/d1e/d6b/d31/d59 to d4/d8/d1e/d79/d92 0 2024-09-18T12:49:13.203 INFO:tasks.workunit.client.0.smithi078.stdout:3/278: dwrite d9/d13/d33/f51 [4194304,4194304] 0 2024-09-18T12:49:13.203 INFO:tasks.workunit.client.0.smithi078.stdout:4/240: truncate d11/d27/f48 3075171 0 2024-09-18T12:49:13.207 INFO:tasks.workunit.client.1.smithi148.stdout:7/451: creat db/dc/d70/d75/f81 x:0 0 0 2024-09-18T12:49:13.207 INFO:tasks.workunit.client.1.smithi148.stdout:8/488: symlink d8/d16/d53/lab 0 2024-09-18T12:49:13.208 INFO:tasks.workunit.client.1.smithi148.stdout:8/489: stat d8/d12/d46/f7d 0 2024-09-18T12:49:13.208 INFO:tasks.workunit.client.1.smithi148.stdout:8/490: dread - d8/d12/d46/f7d zero size 2024-09-18T12:49:13.209 INFO:tasks.workunit.client.0.smithi078.stdout:4/241: truncate d11/f44 266944 0 2024-09-18T12:49:13.209 INFO:tasks.workunit.client.1.smithi148.stdout:8/491: dread - d8/d12/d46/f7d zero size 2024-09-18T12:49:13.211 INFO:tasks.workunit.client.1.smithi148.stdout:8/492: write d8/d16/d53/d39/d3b/f63 [392935,36677] 0 2024-09-18T12:49:13.212 INFO:tasks.workunit.client.0.smithi078.stdout:5/361: mkdir d2/d74 0 2024-09-18T12:49:13.213 INFO:tasks.workunit.client.1.smithi148.stdout:9/409: sync 2024-09-18T12:49:13.215 INFO:tasks.workunit.client.1.smithi148.stdout:0/615: mkdir de/d14/dd2 0 2024-09-18T12:49:13.216 INFO:tasks.workunit.client.0.smithi078.stdout:9/227: dwrite d5/d7/d32/d2a/f3d [0,4194304] 0 2024-09-18T12:49:13.219 INFO:tasks.workunit.client.0.smithi078.stdout:8/278: dwrite d0/d7/f8 [4194304,4194304] 0 2024-09-18T12:49:13.219 INFO:tasks.workunit.client.0.smithi078.stdout:7/191: dwrite d7/d9/f13 [0,4194304] 0 2024-09-18T12:49:13.221 INFO:tasks.workunit.client.1.smithi148.stdout:4/392: mkdir d15/d3f/d81 0 2024-09-18T12:49:13.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:12 smithi148 ceph-mon[35352]: pgmap v14: 65 pgs: 65 active+clean; 1.5 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 45 MiB/s rd, 206 MiB/s wr, 408 op/s 2024-09-18T12:49:13.228 INFO:tasks.workunit.client.1.smithi148.stdout:7/452: fsync db/dc/df/d11/f3a 0 2024-09-18T12:49:13.231 INFO:tasks.workunit.client.1.smithi148.stdout:1/423: symlink dc/d11/d38/d87/l8c 0 2024-09-18T12:49:13.232 INFO:tasks.workunit.client.1.smithi148.stdout:1/424: chown dc/d18/c27 3782218 1 2024-09-18T12:49:13.237 INFO:tasks.workunit.client.1.smithi148.stdout:8/493: chown d8/d16/d53/d39/d3b/la3 5193 1 2024-09-18T12:49:13.238 INFO:tasks.workunit.client.1.smithi148.stdout:8/494: write d8/d16/f9c [4471203,51084] 0 2024-09-18T12:49:13.238 INFO:tasks.workunit.client.1.smithi148.stdout:0/616: chown de/d27/d2e/l46 5 1 2024-09-18T12:49:13.240 INFO:tasks.workunit.client.1.smithi148.stdout:9/410: creat d8/da/dd/d3f/f7f x:0 0 0 2024-09-18T12:49:13.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:12 smithi078 ceph-mon[28091]: pgmap v14: 65 pgs: 65 active+clean; 1.5 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 45 MiB/s rd, 206 MiB/s wr, 408 op/s 2024-09-18T12:49:13.242 INFO:tasks.workunit.client.1.smithi148.stdout:8/495: dread d8/d16/d53/d39/f67 [0,4194304] 0 2024-09-18T12:49:13.242 INFO:tasks.workunit.client.1.smithi148.stdout:4/393: fdatasync d15/d5f/d77/d4c/d4f/f61 0 2024-09-18T12:49:13.243 INFO:tasks.workunit.client.1.smithi148.stdout:6/459: symlink d5/d32/l94 0 2024-09-18T12:49:13.243 INFO:tasks.workunit.client.1.smithi148.stdout:5/483: symlink d7/d8/dc/d12/d1f/d39/l9e 0 2024-09-18T12:49:13.245 INFO:tasks.workunit.client.1.smithi148.stdout:5/484: chown d7/d8/dc/d12/d1f/d25/d4b/f58 238865 1 2024-09-18T12:49:13.245 INFO:tasks.workunit.client.1.smithi148.stdout:3/403: mkdir d4/d8/d20/d2b/d7f/d93 0 2024-09-18T12:49:13.245 INFO:tasks.workunit.client.0.smithi078.stdout:3/279: mknod d9/d13/d33/d4e/c5b 0 2024-09-18T12:49:13.246 INFO:tasks.workunit.client.1.smithi148.stdout:5/485: write d7/fd [2801715,39725] 0 2024-09-18T12:49:13.246 INFO:tasks.workunit.client.1.smithi148.stdout:7/453: readlink db/dc/df/l50 0 2024-09-18T12:49:13.248 INFO:tasks.workunit.client.1.smithi148.stdout:7/454: dread - db/dc/df/d11/d34/d69/f71 zero size 2024-09-18T12:49:13.260 INFO:tasks.workunit.client.0.smithi078.stdout:9/228: dread d5/f15 [0,4194304] 0 2024-09-18T12:49:13.373 INFO:tasks.workunit.client.0.smithi078.stdout:0/363: creat d3/d1f/d2e/d68/d30/d7c/f85 x:0 0 0 2024-09-18T12:49:13.380 INFO:tasks.workunit.client.1.smithi148.stdout:9/411: fdatasync d8/da/f4d 0 2024-09-18T12:49:13.382 INFO:tasks.workunit.client.0.smithi078.stdout:5/362: creat d2/d4/d9/da/d60/d61/f75 x:0 0 0 2024-09-18T12:49:13.382 INFO:tasks.workunit.client.1.smithi148.stdout:4/394: chown d15/f3a 3304378 1 2024-09-18T12:49:13.383 INFO:tasks.workunit.client.1.smithi148.stdout:4/395: dread d15/d5f/d77/f46 [0,4194304] 0 2024-09-18T12:49:13.384 INFO:tasks.workunit.client.1.smithi148.stdout:8/496: mknod d8/d12/d46/d74/cac 0 2024-09-18T12:49:13.385 INFO:tasks.workunit.client.0.smithi078.stdout:2/262: mkdir d4/dd/d18/d3b/d4f 0 2024-09-18T12:49:13.386 INFO:tasks.workunit.client.1.smithi148.stdout:6/460: rmdir d5/d1a/dc/d2b 39 2024-09-18T12:49:13.388 INFO:tasks.workunit.client.1.smithi148.stdout:4/396: dwrite f9 [0,4194304] 0 2024-09-18T12:49:13.389 INFO:tasks.workunit.client.0.smithi078.stdout:9/229: symlink d5/d7/d32/l48 0 2024-09-18T12:49:13.390 INFO:tasks.workunit.client.0.smithi078.stdout:7/192: mknod d7/c3d 0 2024-09-18T12:49:13.391 INFO:tasks.workunit.client.1.smithi148.stdout:5/486: dread - d7/d8/dc/d12/d31/f50 zero size 2024-09-18T12:49:13.392 INFO:tasks.workunit.client.0.smithi078.stdout:7/193: truncate d7/f1d 267753 0 2024-09-18T12:49:13.394 INFO:tasks.workunit.client.1.smithi148.stdout:1/425: unlink dc/d18/d31/d39/l69 0 2024-09-18T12:49:13.396 INFO:tasks.workunit.client.1.smithi148.stdout:3/404: dwrite d4/d8/d20/d2b/f53 [0,4194304] 0 2024-09-18T12:49:13.397 INFO:tasks.workunit.client.0.smithi078.stdout:6/423: link d10/f1e d10/d2b/d43/d53/d45/f85 0 2024-09-18T12:49:13.400 INFO:tasks.workunit.client.1.smithi148.stdout:7/455: mkdir db/dc/df/d1d/d68/d82 0 2024-09-18T12:49:13.401 INFO:tasks.workunit.client.0.smithi078.stdout:8/279: fdatasync d0/d7/dc/d1f/d23/f25 0 2024-09-18T12:49:13.402 INFO:tasks.workunit.client.1.smithi148.stdout:7/456: fsync db/dc/df/d11/d34/f76 0 2024-09-18T12:49:13.402 INFO:tasks.workunit.client.1.smithi148.stdout:7/457: dread - db/dc/d70/d75/f81 zero size 2024-09-18T12:49:13.403 INFO:tasks.workunit.client.0.smithi078.stdout:7/194: dwrite d7/d9/d14/d22/f27 [0,4194304] 0 2024-09-18T12:49:13.403 INFO:tasks.workunit.client.0.smithi078.stdout:5/363: dread d2/d4/d48/f4e [0,4194304] 0 2024-09-18T12:49:13.403 INFO:tasks.workunit.client.1.smithi148.stdout:7/458: chown db/d52/d25/d38/c6c 0 1 2024-09-18T12:49:13.403 INFO:tasks.workunit.client.1.smithi148.stdout:0/617: mknod de/da3/cd3 0 2024-09-18T12:49:13.404 INFO:tasks.workunit.client.1.smithi148.stdout:7/459: stat db/d52/d25/d38/f49 0 2024-09-18T12:49:13.404 INFO:tasks.workunit.client.0.smithi078.stdout:5/364: chown d2/d4/d9/da/d2b/l44 9514334 1 2024-09-18T12:49:13.406 INFO:tasks.workunit.client.0.smithi078.stdout:3/280: symlink d9/d2f/l5c 0 2024-09-18T12:49:13.409 INFO:tasks.workunit.client.1.smithi148.stdout:2/376: creat d9/d24/d31/f83 x:0 0 0 2024-09-18T12:49:13.411 INFO:tasks.workunit.client.1.smithi148.stdout:7/460: dwrite db/dc/df/f29 [0,4194304] 0 2024-09-18T12:49:13.411 INFO:tasks.workunit.client.0.smithi078.stdout:2/263: creat d4/d8/f50 x:0 0 0 2024-09-18T12:49:13.411 INFO:tasks.workunit.client.0.smithi078.stdout:1/276: link d0/d8/da/d3e/d46/d52/c53 d0/d8/da/d3e/d50/c55 0 2024-09-18T12:49:13.412 INFO:tasks.workunit.client.1.smithi148.stdout:7/461: chown fa 1002 1 2024-09-18T12:49:13.417 INFO:tasks.workunit.client.0.smithi078.stdout:0/364: rename d3/d1f/d2e/d4e/c7e to d3/d1f/d2e/d4e/c86 0 2024-09-18T12:49:13.419 INFO:tasks.workunit.client.0.smithi078.stdout:5/365: dwrite d2/d4/d12/d16/d36/f5c [0,4194304] 0 2024-09-18T12:49:13.421 INFO:tasks.workunit.client.1.smithi148.stdout:7/462: dread db/dc/df/d11/f53 [0,4194304] 0 2024-09-18T12:49:13.422 INFO:tasks.workunit.client.0.smithi078.stdout:0/365: dread - d3/d1f/d2e/d68/d30/d7c/f85 zero size 2024-09-18T12:49:13.422 INFO:tasks.workunit.client.1.smithi148.stdout:6/461: creat d5/d32/d38/d50/f95 x:0 0 0 2024-09-18T12:49:13.431 INFO:tasks.workunit.client.0.smithi078.stdout:7/195: mkdir d7/d9/d14/d22/d3e 0 2024-09-18T12:49:13.432 INFO:tasks.workunit.client.0.smithi078.stdout:7/196: truncate d7/d9/f13 4535836 0 2024-09-18T12:49:13.439 INFO:tasks.workunit.client.0.smithi078.stdout:2/264: mknod d4/db/c51 0 2024-09-18T12:49:13.439 INFO:tasks.workunit.client.0.smithi078.stdout:7/197: dwrite d7/d9/d14/d22/f27 [0,4194304] 0 2024-09-18T12:49:13.443 INFO:tasks.workunit.client.0.smithi078.stdout:1/277: symlink d0/d8/da/d45/l56 0 2024-09-18T12:49:13.444 INFO:tasks.workunit.client.0.smithi078.stdout:1/278: chown d0/d8/da/l1a 0 1 2024-09-18T12:49:13.445 INFO:tasks.workunit.client.1.smithi148.stdout:9/412: dwrite d8/f16 [0,4194304] 0 2024-09-18T12:49:13.447 INFO:tasks.workunit.client.0.smithi078.stdout:6/424: fdatasync d10/f21 0 2024-09-18T12:49:13.450 INFO:tasks.workunit.client.1.smithi148.stdout:7/463: write db/dc/df/d11/d34/f61 [654852,74660] 0 2024-09-18T12:49:13.451 INFO:tasks.workunit.client.0.smithi078.stdout:8/280: mkdir d0/d7/d53 0 2024-09-18T12:49:13.452 INFO:tasks.workunit.client.1.smithi148.stdout:7/464: dread - db/dc/df/d11/d34/f76 zero size 2024-09-18T12:49:13.454 INFO:tasks.workunit.client.1.smithi148.stdout:7/465: read - db/dc/d70/d75/f81 zero size 2024-09-18T12:49:13.454 INFO:tasks.workunit.client.0.smithi078.stdout:9/230: truncate d5/d7/d8/f14 1831357 0 2024-09-18T12:49:13.455 INFO:tasks.workunit.client.1.smithi148.stdout:8/497: dwrite d8/d16/d27/f76 [0,4194304] 0 2024-09-18T12:49:13.455 INFO:tasks.workunit.client.0.smithi078.stdout:5/366: truncate d2/d4/d9/d49/f56 2711973 0 2024-09-18T12:49:13.456 INFO:tasks.workunit.client.0.smithi078.stdout:9/231: chown d5/d7/d32/f44 36069095 1 2024-09-18T12:49:13.457 INFO:tasks.workunit.client.1.smithi148.stdout:1/426: rename dc/d51/d5e to dc/d18/d31/d4b/d8d 0 2024-09-18T12:49:13.458 INFO:tasks.workunit.client.0.smithi078.stdout:9/232: write d5/d7/d8/f33 [963575,53123] 0 2024-09-18T12:49:13.459 INFO:tasks.workunit.client.0.smithi078.stdout:5/367: truncate d2/d4/d9/da/d2b/f69 579995 0 2024-09-18T12:49:13.459 INFO:tasks.workunit.client.1.smithi148.stdout:0/618: creat de/d27/d7a/fd4 x:0 0 0 2024-09-18T12:49:13.460 INFO:tasks.workunit.client.0.smithi078.stdout:0/366: mknod d3/d43/d7f/c87 0 2024-09-18T12:49:13.461 INFO:tasks.workunit.client.1.smithi148.stdout:2/377: stat d9/d24/d47/c70 0 2024-09-18T12:49:13.461 INFO:tasks.workunit.client.1.smithi148.stdout:2/378: stat d9/d24/d31/d34/l6d 0 2024-09-18T12:49:13.463 INFO:tasks.workunit.client.0.smithi078.stdout:6/425: rmdir d10 39 2024-09-18T12:49:13.466 INFO:tasks.workunit.client.0.smithi078.stdout:7/198: mkdir d7/d3f 0 2024-09-18T12:49:13.466 INFO:tasks.workunit.client.1.smithi148.stdout:6/462: truncate d5/d1a/f21 2092467 0 2024-09-18T12:49:13.467 INFO:tasks.workunit.client.0.smithi078.stdout:9/233: write d5/d7/d32/f44 [1809512,21931] 0 2024-09-18T12:49:13.468 INFO:tasks.workunit.client.0.smithi078.stdout:7/199: dread d7/f1d [0,4194304] 0 2024-09-18T12:49:13.468 INFO:tasks.workunit.client.0.smithi078.stdout:9/234: dread - d5/d7/d32/f30 zero size 2024-09-18T12:49:13.469 INFO:tasks.workunit.client.1.smithi148.stdout:4/397: link d15/d17/d52/f66 d15/d5f/d77/d4c/d4f/d64/f82 0 2024-09-18T12:49:13.472 INFO:tasks.workunit.client.1.smithi148.stdout:5/487: creat d7/d8/d18/d3f/d7c/d7d/f9f x:0 0 0 2024-09-18T12:49:13.473 INFO:tasks.workunit.client.1.smithi148.stdout:6/463: dwrite d5/d32/f3b [0,4194304] 0 2024-09-18T12:49:13.479 INFO:tasks.workunit.client.1.smithi148.stdout:3/405: sync 2024-09-18T12:49:13.479 INFO:tasks.workunit.client.1.smithi148.stdout:8/498: fsync d8/d12/d46/f58 0 2024-09-18T12:49:13.480 INFO:tasks.workunit.client.1.smithi148.stdout:8/499: stat d8/d16/f9d 0 2024-09-18T12:49:13.482 INFO:tasks.workunit.client.0.smithi078.stdout:8/281: creat d0/d7/d1e/f54 x:0 0 0 2024-09-18T12:49:13.483 INFO:tasks.workunit.client.1.smithi148.stdout:0/619: rmdir de/d14/d43/d57/d59 39 2024-09-18T12:49:13.487 INFO:tasks.workunit.client.1.smithi148.stdout:1/427: dwrite dc/d18/f3d [4194304,4194304] 0 2024-09-18T12:49:13.491 INFO:tasks.workunit.client.1.smithi148.stdout:4/398: rename d15/d5f/d77/f2c to d15/d5f/d77/d4c/f83 0 2024-09-18T12:49:13.492 INFO:tasks.workunit.client.0.smithi078.stdout:5/368: truncate d2/f26 3053863 0 2024-09-18T12:49:13.492 INFO:tasks.workunit.client.0.smithi078.stdout:1/279: truncate d0/d8/da/d3e/d46/f4d 219018 0 2024-09-18T12:49:13.494 INFO:tasks.workunit.client.0.smithi078.stdout:0/367: mknod d3/d82/c88 0 2024-09-18T12:49:13.497 INFO:tasks.workunit.client.1.smithi148.stdout:9/413: sync 2024-09-18T12:49:13.497 INFO:tasks.workunit.client.0.smithi078.stdout:8/282: readlink d0/d7/dc/l43 0 2024-09-18T12:49:13.498 INFO:tasks.workunit.client.1.smithi148.stdout:9/414: fdatasync d8/da/f1d 0 2024-09-18T12:49:13.498 INFO:tasks.workunit.client.1.smithi148.stdout:7/466: dwrite db/dc/df/d11/f65 [0,4194304] 0 2024-09-18T12:49:13.500 INFO:tasks.workunit.client.1.smithi148.stdout:8/500: creat d8/d12/d46/d74/fad x:0 0 0 2024-09-18T12:49:13.502 INFO:tasks.workunit.client.1.smithi148.stdout:0/620: dread - de/d27/d53/d89/dbb/f54 zero size 2024-09-18T12:49:13.503 INFO:tasks.workunit.client.1.smithi148.stdout:0/621: dread - de/d14/d43/d57/f9c zero size 2024-09-18T12:49:13.506 INFO:tasks.workunit.client.1.smithi148.stdout:1/428: mknod dc/d18/d43/c8e 0 2024-09-18T12:49:13.508 INFO:tasks.workunit.client.1.smithi148.stdout:4/399: creat d15/d5f/d77/f84 x:0 0 0 2024-09-18T12:49:13.508 INFO:tasks.workunit.client.0.smithi078.stdout:8/283: rmdir d0/d7/d1e 39 2024-09-18T12:49:13.515 INFO:tasks.workunit.client.0.smithi078.stdout:9/235: unlink d5/d7/d8/f14 0 2024-09-18T12:49:13.520 INFO:tasks.workunit.client.1.smithi148.stdout:3/406: mkdir d4/d8/d20/d2b/d7f/d93/d94 0 2024-09-18T12:49:13.521 INFO:tasks.workunit.client.0.smithi078.stdout:6/426: dread d10/d2b/d43/d53/f42 [4194304,4194304] 0 2024-09-18T12:49:13.523 INFO:tasks.workunit.client.1.smithi148.stdout:9/415: rename d8/d33/f34 to d8/d6f/f80 0 2024-09-18T12:49:13.524 INFO:tasks.workunit.client.0.smithi078.stdout:7/200: getdents d7/d9/d14/d22/d35 0 2024-09-18T12:49:13.524 INFO:tasks.workunit.client.1.smithi148.stdout:9/416: write d8/da/dd/d4a/f2d [179144,118504] 0 2024-09-18T12:49:13.525 INFO:tasks.workunit.client.0.smithi078.stdout:7/201: fdatasync d7/f1b 0 2024-09-18T12:49:13.526 INFO:tasks.workunit.client.1.smithi148.stdout:7/467: creat db/dc/d70/f83 x:0 0 0 2024-09-18T12:49:13.526 INFO:tasks.workunit.client.0.smithi078.stdout:7/202: chown d7/d9/d32/d3b 1668 1 2024-09-18T12:49:13.526 INFO:tasks.workunit.client.0.smithi078.stdout:6/427: dread d10/f1e [4194304,4194304] 0 2024-09-18T12:49:13.527 INFO:tasks.workunit.client.1.smithi148.stdout:7/468: write db/dc/df/d1d/f5c [89529,112260] 0 2024-09-18T12:49:13.528 INFO:tasks.workunit.client.1.smithi148.stdout:2/379: creat d9/f84 x:0 0 0 2024-09-18T12:49:13.529 INFO:tasks.workunit.client.0.smithi078.stdout:7/203: read d7/d9/fe [3628542,99609] 0 2024-09-18T12:49:13.530 INFO:tasks.workunit.client.1.smithi148.stdout:5/488: write d7/d8/f1c [1400829,28665] 0 2024-09-18T12:49:13.532 INFO:tasks.workunit.client.1.smithi148.stdout:1/429: mkdir dc/d18/d31/d4b/d8d/d8f 0 2024-09-18T12:49:13.533 INFO:tasks.workunit.client.1.smithi148.stdout:7/469: dwrite fa [4194304,4194304] 0 2024-09-18T12:49:13.533 INFO:tasks.workunit.client.0.smithi078.stdout:5/369: write d2/f26 [1270865,1925] 0 2024-09-18T12:49:13.535 INFO:tasks.workunit.client.0.smithi078.stdout:5/370: write d2/d4/f4f [1298213,32421] 0 2024-09-18T12:49:13.535 INFO:tasks.workunit.client.1.smithi148.stdout:7/470: chown db/dc/d70/d75 251137 1 2024-09-18T12:49:13.538 INFO:tasks.workunit.client.1.smithi148.stdout:5/489: dwrite d7/d2b/f3c [4194304,4194304] 0 2024-09-18T12:49:13.540 INFO:tasks.workunit.client.1.smithi148.stdout:6/464: write d5/d1a/dc/d2b/d35/d65/f4b [1276868,71959] 0 2024-09-18T12:49:13.543 INFO:tasks.workunit.client.1.smithi148.stdout:3/407: mknod d4/d8/d1e/d63/c95 0 2024-09-18T12:49:13.544 INFO:tasks.workunit.client.0.smithi078.stdout:0/368: link d3/d1f/c36 d3/d1f/c89 0 2024-09-18T12:49:13.544 INFO:tasks.workunit.client.1.smithi148.stdout:3/408: dread d4/d8/f35 [0,4194304] 0 2024-09-18T12:49:13.545 INFO:tasks.workunit.client.0.smithi078.stdout:1/280: dwrite d0/d8/f2c [0,4194304] 0 2024-09-18T12:49:13.550 INFO:tasks.workunit.client.0.smithi078.stdout:5/371: symlink d2/d4/d12/d16/l76 0 2024-09-18T12:49:13.553 INFO:tasks.workunit.client.0.smithi078.stdout:6/428: symlink d10/l86 0 2024-09-18T12:49:13.556 INFO:tasks.workunit.client.0.smithi078.stdout:9/236: link d5/d7/d32/d2a/l41 d5/d7/d32/l49 0 2024-09-18T12:49:13.557 INFO:tasks.workunit.client.1.smithi148.stdout:0/622: mknod de/d14/d43/d57/cd5 0 2024-09-18T12:49:13.557 INFO:tasks.workunit.client.1.smithi148.stdout:0/623: stat de/f1e 0 2024-09-18T12:49:13.558 INFO:tasks.workunit.client.0.smithi078.stdout:7/204: creat d7/d9/d14/d22/d3e/f40 x:0 0 0 2024-09-18T12:49:13.561 INFO:tasks.workunit.client.0.smithi078.stdout:1/281: creat d0/d37/f57 x:0 0 0 2024-09-18T12:49:13.562 INFO:tasks.workunit.client.1.smithi148.stdout:5/490: symlink d7/d8/dc/d12/d1f/la0 0 2024-09-18T12:49:13.563 INFO:tasks.workunit.client.1.smithi148.stdout:5/491: truncate d7/d8/dc/d12/d31/f32 1136726 0 2024-09-18T12:49:13.567 INFO:tasks.workunit.client.1.smithi148.stdout:2/380: mknod d9/d24/d31/c85 0 2024-09-18T12:49:13.571 INFO:tasks.workunit.client.0.smithi078.stdout:1/282: mkdir d0/d8/da/d3e/d58 0 2024-09-18T12:49:13.571 INFO:tasks.workunit.client.0.smithi078.stdout:1/283: readlink d0/d8/da/l1a 0 2024-09-18T12:49:13.572 INFO:tasks.workunit.client.0.smithi078.stdout:1/284: chown d0/c33 2498 1 2024-09-18T12:49:13.573 INFO:tasks.workunit.client.0.smithi078.stdout:5/372: rename d2/d4/d9/l38 to d2/d4/d9/d49/l77 0 2024-09-18T12:49:13.577 INFO:tasks.workunit.client.0.smithi078.stdout:5/373: dread d2/d4/d12/d16/d36/f41 [4194304,4194304] 0 2024-09-18T12:49:13.579 INFO:tasks.workunit.client.1.smithi148.stdout:4/400: write f0 [1876006,123546] 0 2024-09-18T12:49:13.580 INFO:tasks.workunit.client.0.smithi078.stdout:7/205: truncate d7/fa 1692674 0 2024-09-18T12:49:13.580 INFO:tasks.workunit.client.1.smithi148.stdout:4/401: write d15/d5f/d77/d4c/d4f/f6c [1687022,62482] 0 2024-09-18T12:49:13.581 INFO:tasks.workunit.client.1.smithi148.stdout:3/409: symlink d4/l96 0 2024-09-18T12:49:13.582 INFO:tasks.workunit.client.0.smithi078.stdout:6/429: write f3 [1751690,114645] 0 2024-09-18T12:49:13.584 INFO:tasks.workunit.client.1.smithi148.stdout:9/417: truncate d8/da/f13 914130 0 2024-09-18T12:49:13.584 INFO:tasks.workunit.client.0.smithi078.stdout:7/206: dread d7/f1b [0,4194304] 0 2024-09-18T12:49:13.586 INFO:tasks.workunit.client.1.smithi148.stdout:0/624: truncate de/d27/f3a 978967 0 2024-09-18T12:49:13.589 INFO:tasks.workunit.client.0.smithi078.stdout:9/237: chown d5/d7/d8/l3e 17068 1 2024-09-18T12:49:13.590 INFO:tasks.workunit.client.1.smithi148.stdout:5/492: write d7/f4f [448508,32271] 0 2024-09-18T12:49:13.591 INFO:tasks.workunit.client.0.smithi078.stdout:0/369: dwrite d3/f20 [4194304,4194304] 0 2024-09-18T12:49:13.593 INFO:tasks.workunit.client.0.smithi078.stdout:0/370: dread - d3/d1f/f67 zero size 2024-09-18T12:49:13.593 INFO:tasks.workunit.client.0.smithi078.stdout:5/374: unlink d2/d4/d9/da/d2b/f54 0 2024-09-18T12:49:13.594 INFO:tasks.workunit.client.1.smithi148.stdout:2/381: write d9/d24/f79 [5107264,117357] 0 2024-09-18T12:49:13.594 INFO:tasks.workunit.client.0.smithi078.stdout:5/375: stat d2/d4/d48/l5e 0 2024-09-18T12:49:13.595 INFO:tasks.workunit.client.1.smithi148.stdout:2/382: write d9/d24/d31/f66 [2899430,27367] 0 2024-09-18T12:49:13.596 INFO:tasks.workunit.client.0.smithi078.stdout:5/376: truncate d2/d4/d9/d49/f73 985299 0 2024-09-18T12:49:13.597 INFO:tasks.workunit.client.0.smithi078.stdout:5/377: dread - d2/d4/d9/d49/f6c zero size 2024-09-18T12:49:13.600 INFO:tasks.workunit.client.1.smithi148.stdout:4/402: creat d15/d5f/d69/f85 x:0 0 0 2024-09-18T12:49:13.601 INFO:tasks.workunit.client.1.smithi148.stdout:4/403: readlink d15/d5f/d77/l41 0 2024-09-18T12:49:13.601 INFO:tasks.workunit.client.0.smithi078.stdout:1/285: link d0/d8/da/d3e/d46/f51 d0/d37/f59 0 2024-09-18T12:49:13.601 INFO:tasks.workunit.client.1.smithi148.stdout:4/404: fsync d15/d17/f19 0 2024-09-18T12:49:13.603 INFO:tasks.workunit.client.0.smithi078.stdout:7/207: mknod d7/d9/d14/d22/d3e/c41 0 2024-09-18T12:49:13.603 INFO:tasks.workunit.client.0.smithi078.stdout:7/208: chown d7/c3d 635655 1 2024-09-18T12:49:13.604 INFO:tasks.workunit.client.0.smithi078.stdout:7/209: stat d7/d26/l39 0 2024-09-18T12:49:13.604 INFO:tasks.workunit.client.1.smithi148.stdout:9/418: dread d8/da/dd/d3f/f6a [0,4194304] 0 2024-09-18T12:49:13.605 INFO:tasks.workunit.client.1.smithi148.stdout:9/419: stat d8/f5c 0 2024-09-18T12:49:13.605 INFO:tasks.workunit.client.0.smithi078.stdout:7/210: chown d7/d9/f20 341947 1 2024-09-18T12:49:13.605 INFO:tasks.workunit.client.0.smithi078.stdout:9/238: unlink d5/c21 0 2024-09-18T12:49:13.606 INFO:tasks.workunit.client.1.smithi148.stdout:1/430: getdents dc/d18/d31/d4b/d8d 0 2024-09-18T12:49:13.606 INFO:tasks.workunit.client.1.smithi148.stdout:9/420: write d8/da/dd/d4a/f2d [856140,92286] 0 2024-09-18T12:49:13.607 INFO:tasks.workunit.client.1.smithi148.stdout:6/465: getdents d5/d32/d38 0 2024-09-18T12:49:13.612 INFO:tasks.workunit.client.1.smithi148.stdout:3/410: creat d4/d8/d20/d2b/d43/f97 x:0 0 0 2024-09-18T12:49:13.612 INFO:tasks.workunit.client.1.smithi148.stdout:8/501: sync 2024-09-18T12:49:13.613 INFO:tasks.workunit.client.1.smithi148.stdout:8/502: write d8/d12/d46/f5a [4124961,89748] 0 2024-09-18T12:49:13.616 INFO:tasks.workunit.client.0.smithi078.stdout:7/211: dwrite d7/d26/f29 [0,4194304] 0 2024-09-18T12:49:13.617 INFO:tasks.workunit.client.1.smithi148.stdout:4/405: symlink d15/d5f/d77/l86 0 2024-09-18T12:49:13.617 INFO:tasks.workunit.client.1.smithi148.stdout:0/625: getdents de/d27/d53/d89/dca 0 2024-09-18T12:49:13.618 INFO:tasks.workunit.client.0.smithi078.stdout:9/239: dwrite d5/d7/d32/d2a/f3d [0,4194304] 0 2024-09-18T12:49:13.620 INFO:tasks.workunit.client.0.smithi078.stdout:1/286: getdents d0/d8/da/d3e/d58 0 2024-09-18T12:49:13.620 INFO:tasks.workunit.client.1.smithi148.stdout:8/503: dwrite d8/df/d3e/d82/fa9 [0,4194304] 0 2024-09-18T12:49:13.621 INFO:tasks.workunit.client.0.smithi078.stdout:0/371: dread d3/d1f/d2e/d4e/d37/f51 [0,4194304] 0 2024-09-18T12:49:13.622 INFO:tasks.workunit.client.0.smithi078.stdout:4/242: sync 2024-09-18T12:49:13.622 INFO:tasks.workunit.client.0.smithi078.stdout:1/287: read - d0/d8/f26 zero size 2024-09-18T12:49:13.624 INFO:tasks.workunit.client.0.smithi078.stdout:0/372: write d3/d1f/d2e/d68/f44 [619536,39881] 0 2024-09-18T12:49:13.628 INFO:tasks.workunit.client.1.smithi148.stdout:9/421: rmdir d8/da/dd/d4a/d49/d46 39 2024-09-18T12:49:13.629 INFO:tasks.workunit.client.0.smithi078.stdout:6/430: getdents d10/d2b/d61 0 2024-09-18T12:49:13.629 INFO:tasks.workunit.client.1.smithi148.stdout:1/431: dwrite dc/d18/f1f [0,4194304] 0 2024-09-18T12:49:13.632 INFO:tasks.workunit.client.1.smithi148.stdout:3/411: dread - d4/d8/d20/f42 zero size 2024-09-18T12:49:13.635 INFO:tasks.workunit.client.1.smithi148.stdout:3/412: readlink d4/d8/d1e/d79/l85 0 2024-09-18T12:49:13.636 INFO:tasks.workunit.client.0.smithi078.stdout:9/240: readlink d5/d7/d8/l11 0 2024-09-18T12:49:13.639 INFO:tasks.workunit.client.1.smithi148.stdout:1/432: dwrite dc/f10 [8388608,4194304] 0 2024-09-18T12:49:13.640 INFO:tasks.workunit.client.0.smithi078.stdout:1/288: creat d0/d8/da/d3e/d46/f5a x:0 0 0 2024-09-18T12:49:13.641 INFO:tasks.workunit.client.1.smithi148.stdout:1/433: dread - dc/d51/f70 zero size 2024-09-18T12:49:13.641 INFO:tasks.workunit.client.0.smithi078.stdout:1/289: chown d0/d8/da/f40 2141712 1 2024-09-18T12:49:13.641 INFO:tasks.workunit.client.1.smithi148.stdout:0/626: mkdir de/d14/d43/dd6 0 2024-09-18T12:49:13.643 INFO:tasks.workunit.client.0.smithi078.stdout:0/373: creat d3/d1f/d2e/d4e/d37/f8a x:0 0 0 2024-09-18T12:49:13.644 INFO:tasks.workunit.client.0.smithi078.stdout:0/374: stat d3/d1f/d2e/d4e/d37 0 2024-09-18T12:49:13.644 INFO:tasks.workunit.client.1.smithi148.stdout:4/406: symlink d15/d5f/d77/d4c/d4f/d64/l87 0 2024-09-18T12:49:13.646 INFO:tasks.workunit.client.0.smithi078.stdout:5/378: rename d2/d4/d9/da/d2b/d3e/f53 to d2/d4/f78 0 2024-09-18T12:49:13.646 INFO:tasks.workunit.client.1.smithi148.stdout:8/504: symlink d8/d12/d46/d7e/lae 0 2024-09-18T12:49:13.647 INFO:tasks.workunit.client.0.smithi078.stdout:5/379: fdatasync d2/d4/d9/d49/f4b 0 2024-09-18T12:49:13.647 INFO:tasks.workunit.client.1.smithi148.stdout:8/505: fdatasync d8/d16/d27/f30 0 2024-09-18T12:49:13.648 INFO:tasks.workunit.client.1.smithi148.stdout:8/506: chown d8/d12/d46/d74/f9b 10877450 1 2024-09-18T12:49:13.649 INFO:tasks.workunit.client.1.smithi148.stdout:8/507: chown d8/d16/d53/lab 20285407 1 2024-09-18T12:49:13.649 INFO:tasks.workunit.client.1.smithi148.stdout:6/466: dread d5/ff [0,4194304] 0 2024-09-18T12:49:13.653 INFO:tasks.workunit.client.0.smithi078.stdout:6/431: rename d10/d2b/d43/d53/d45/d55/c2e to d10/d2b/d43/d53/d63/d70/d7d/c87 0 2024-09-18T12:49:13.656 INFO:tasks.workunit.client.1.smithi148.stdout:0/627: mknod de/d27/d53/d89/dbb/cd7 0 2024-09-18T12:49:13.656 INFO:tasks.workunit.client.0.smithi078.stdout:5/380: fdatasync d2/d4/d12/d2d/f42 0 2024-09-18T12:49:13.657 INFO:tasks.workunit.client.0.smithi078.stdout:5/381: dread - d2/d4/d12/d2d/f42 zero size 2024-09-18T12:49:13.658 INFO:tasks.workunit.client.1.smithi148.stdout:4/407: creat d15/d5f/d77/d4c/d4f/d64/f88 x:0 0 0 2024-09-18T12:49:13.659 INFO:tasks.workunit.client.1.smithi148.stdout:9/422: mkdir d8/da/dd/d35/d81 0 2024-09-18T12:49:13.660 INFO:tasks.workunit.client.1.smithi148.stdout:6/467: dread d5/d1a/dc/f6d [0,4194304] 0 2024-09-18T12:49:13.661 INFO:tasks.workunit.client.1.smithi148.stdout:9/423: readlink d8/da/dd/d4a/d27/l36 0 2024-09-18T12:49:13.662 INFO:tasks.workunit.client.0.smithi078.stdout:6/432: creat d10/d2b/d43/d53/d45/d55/f88 x:0 0 0 2024-09-18T12:49:13.662 INFO:tasks.workunit.client.1.smithi148.stdout:6/468: write d5/d1a/dc/f5b [692952,92802] 0 2024-09-18T12:49:13.663 INFO:tasks.workunit.client.0.smithi078.stdout:7/212: write d7/d9/f10 [2799058,123027] 0 2024-09-18T12:49:13.663 INFO:tasks.workunit.client.1.smithi148.stdout:9/424: write d8/da/dd/f1b [1814221,126338] 0 2024-09-18T12:49:13.664 INFO:tasks.workunit.client.0.smithi078.stdout:9/241: creat d5/f4a x:0 0 0 2024-09-18T12:49:13.664 INFO:tasks.workunit.client.1.smithi148.stdout:7/471: sync 2024-09-18T12:49:13.666 INFO:tasks.workunit.client.1.smithi148.stdout:8/508: creat d8/d16/faf x:0 0 0 2024-09-18T12:49:13.666 INFO:tasks.workunit.client.1.smithi148.stdout:4/408: dwrite d15/d5f/d77/f2e [0,4194304] 0 2024-09-18T12:49:13.667 INFO:tasks.workunit.client.1.smithi148.stdout:9/425: read d8/da/dd/d65/f76 [1008825,67309] 0 2024-09-18T12:49:13.667 INFO:tasks.workunit.client.1.smithi148.stdout:7/472: write db/dc/df/d11/f1b [2422224,9895] 0 2024-09-18T12:49:13.668 INFO:tasks.workunit.client.0.smithi078.stdout:4/243: getdents d11/d1f/d4b 0 2024-09-18T12:49:13.671 INFO:tasks.workunit.client.0.smithi078.stdout:5/382: creat d2/d4/d12/d16/d36/f79 x:0 0 0 2024-09-18T12:49:13.672 INFO:tasks.workunit.client.1.smithi148.stdout:8/509: dread d8/d16/d27/f76 [0,4194304] 0 2024-09-18T12:49:13.675 INFO:tasks.workunit.client.0.smithi078.stdout:0/375: creat d3/d1f/d2e/d68/f8b x:0 0 0 2024-09-18T12:49:13.678 INFO:tasks.workunit.client.1.smithi148.stdout:2/383: truncate d9/f26 3289863 0 2024-09-18T12:49:13.679 INFO:tasks.workunit.client.0.smithi078.stdout:7/213: creat d7/d26/f42 x:0 0 0 2024-09-18T12:49:13.679 INFO:tasks.workunit.client.1.smithi148.stdout:8/510: dwrite d8/d16/d27/f76 [0,4194304] 0 2024-09-18T12:49:13.681 INFO:tasks.workunit.client.0.smithi078.stdout:9/242: creat d5/d7/d32/d2a/f4b x:0 0 0 2024-09-18T12:49:13.684 INFO:tasks.workunit.client.1.smithi148.stdout:6/469: chown d5/l26 21 1 2024-09-18T12:49:13.687 INFO:tasks.workunit.client.1.smithi148.stdout:4/409: symlink d15/d5f/l89 0 2024-09-18T12:49:13.687 INFO:tasks.workunit.client.1.smithi148.stdout:7/473: dread db/d52/d1f/f4d [0,4194304] 0 2024-09-18T12:49:13.688 INFO:tasks.workunit.client.1.smithi148.stdout:7/474: write db/dc/df/d11/d34/d69/f71 [245423,128135] 0 2024-09-18T12:49:13.690 INFO:tasks.workunit.client.0.smithi078.stdout:0/376: rename d3/f1d to d3/d1f/d2e/d4e/d37/f8c 0 2024-09-18T12:49:13.691 INFO:tasks.workunit.client.0.smithi078.stdout:0/377: dread - d3/d1f/f67 zero size 2024-09-18T12:49:13.692 INFO:tasks.workunit.client.1.smithi148.stdout:7/475: dread db/dc/df/d11/f3a [0,4194304] 0 2024-09-18T12:49:13.693 INFO:tasks.workunit.client.0.smithi078.stdout:6/433: symlink d10/d2b/d43/d53/d45/l89 0 2024-09-18T12:49:13.694 INFO:tasks.workunit.client.1.smithi148.stdout:9/426: creat d8/da/f82 x:0 0 0 2024-09-18T12:49:13.695 INFO:tasks.workunit.client.0.smithi078.stdout:6/434: write d10/d2b/d43/d53/f4d [594580,99654] 0 2024-09-18T12:49:13.696 INFO:tasks.workunit.client.0.smithi078.stdout:0/378: dread d3/f5 [0,4194304] 0 2024-09-18T12:49:13.697 INFO:tasks.workunit.client.0.smithi078.stdout:7/214: symlink d7/d9/l43 0 2024-09-18T12:49:13.699 INFO:tasks.workunit.client.1.smithi148.stdout:5/493: sync 2024-09-18T12:49:13.699 INFO:tasks.workunit.client.0.smithi078.stdout:4/244: mkdir d11/d27/d47/d4e/d50 0 2024-09-18T12:49:13.703 INFO:tasks.workunit.client.0.smithi078.stdout:6/435: dwrite d10/d2b/d43/d53/f4d [0,4194304] 0 2024-09-18T12:49:13.704 INFO:tasks.workunit.client.1.smithi148.stdout:3/413: creat d4/d8/f98 x:0 0 0 2024-09-18T12:49:13.704 INFO:tasks.workunit.client.1.smithi148.stdout:3/414: chown d4/d8/d6a 254 1 2024-09-18T12:49:13.705 INFO:tasks.workunit.client.0.smithi078.stdout:6/436: read - d10/d2b/d43/d53/d63/d70/d77/f7e zero size 2024-09-18T12:49:13.707 INFO:tasks.workunit.client.1.smithi148.stdout:1/434: creat dc/d18/f90 x:0 0 0 2024-09-18T12:49:13.709 INFO:tasks.workunit.client.0.smithi078.stdout:5/383: write d2/d4/d12/d16/f24 [4999984,107824] 0 2024-09-18T12:49:13.711 INFO:tasks.workunit.client.0.smithi078.stdout:5/384: read d2/d4/d9/d2f/d30/f5f [96938,66147] 0 2024-09-18T12:49:13.712 INFO:tasks.workunit.client.0.smithi078.stdout:7/215: creat d7/d9/f44 x:0 0 0 2024-09-18T12:49:13.715 INFO:tasks.workunit.client.1.smithi148.stdout:2/384: truncate d9/d24/d31/d34/d42/f44 1600179 0 2024-09-18T12:49:13.721 INFO:tasks.workunit.client.0.smithi078.stdout:5/385: write d2/d4/d12/d16/d36/f41 [1340236,81319] 0 2024-09-18T12:49:13.721 INFO:tasks.workunit.client.0.smithi078.stdout:4/245: symlink d11/d27/d47/d4e/d50/l51 0 2024-09-18T12:49:13.722 INFO:tasks.workunit.client.0.smithi078.stdout:4/246: stat d11/d1f/l32 0 2024-09-18T12:49:13.722 INFO:tasks.workunit.client.1.smithi148.stdout:7/476: symlink db/d52/d1f/l84 0 2024-09-18T12:49:13.725 INFO:tasks.workunit.client.0.smithi078.stdout:0/379: write d3/d1f/f52 [351076,36189] 0 2024-09-18T12:49:13.727 INFO:tasks.workunit.client.0.smithi078.stdout:7/216: creat d7/d9/d32/d3b/f45 x:0 0 0 2024-09-18T12:49:13.729 INFO:tasks.workunit.client.0.smithi078.stdout:5/386: creat d2/d4/d9/da/f7a x:0 0 0 2024-09-18T12:49:13.732 INFO:tasks.workunit.client.0.smithi078.stdout:6/437: dread d10/d2b/d43/f60 [0,4194304] 0 2024-09-18T12:49:13.735 INFO:tasks.workunit.client.0.smithi078.stdout:5/387: mkdir d2/d4/d12/d2d/d7b 0 2024-09-18T12:49:13.736 INFO:tasks.workunit.client.0.smithi078.stdout:5/388: dread - d2/d4/d9/d49/f6c zero size 2024-09-18T12:49:13.737 INFO:tasks.workunit.client.1.smithi148.stdout:7/477: dwrite db/dc/df/d2c/f7e [0,4194304] 0 2024-09-18T12:49:13.739 INFO:tasks.workunit.client.1.smithi148.stdout:9/427: dwrite d8/f25 [0,4194304] 0 2024-09-18T12:49:13.739 INFO:tasks.workunit.client.1.smithi148.stdout:6/470: symlink d5/l96 0 2024-09-18T12:49:13.740 INFO:tasks.workunit.client.0.smithi078.stdout:4/247: mknod d11/d1f/c52 0 2024-09-18T12:49:13.741 INFO:tasks.workunit.client.1.smithi148.stdout:3/415: dread d4/f29 [4194304,4194304] 0 2024-09-18T12:49:13.741 INFO:tasks.workunit.client.0.smithi078.stdout:4/248: fdatasync d11/d27/d47/f3d 0 2024-09-18T12:49:13.742 INFO:tasks.workunit.client.0.smithi078.stdout:0/380: symlink d3/d1f/d2e/l8d 0 2024-09-18T12:49:13.744 INFO:tasks.workunit.client.1.smithi148.stdout:5/494: dwrite d7/d8/dc/d22/f79 [0,4194304] 0 2024-09-18T12:49:13.744 INFO:tasks.workunit.client.1.smithi148.stdout:6/471: readlink d5/d1a/l11 0 2024-09-18T12:49:13.744 INFO:tasks.workunit.client.0.smithi078.stdout:0/381: chown d3/d1f/d2e/d4e/d37/f5c 1370616 1 2024-09-18T12:49:13.749 INFO:tasks.workunit.client.0.smithi078.stdout:5/389: creat d2/d4/d9/d2f/d30/f7c x:0 0 0 2024-09-18T12:49:13.750 INFO:tasks.workunit.client.0.smithi078.stdout:5/390: write d2/d4/f66 [669252,31942] 0 2024-09-18T12:49:13.750 INFO:tasks.workunit.client.0.smithi078.stdout:6/438: mknod d10/d2b/c8a 0 2024-09-18T12:49:13.751 INFO:tasks.workunit.client.1.smithi148.stdout:7/478: dwrite db/dc/df/d11/d34/d69/f71 [0,4194304] 0 2024-09-18T12:49:13.754 INFO:tasks.workunit.client.1.smithi148.stdout:7/479: read db/dc/df/d11/d34/f61 [60317,71951] 0 2024-09-18T12:49:13.754 INFO:tasks.workunit.client.0.smithi078.stdout:4/249: rmdir d11/d27/d47/d4e/d50 39 2024-09-18T12:49:13.756 INFO:tasks.workunit.client.1.smithi148.stdout:4/410: write d15/f53 [5687508,121883] 0 2024-09-18T12:49:13.756 INFO:tasks.workunit.client.1.smithi148.stdout:4/411: readlink d15/d17/l4e 0 2024-09-18T12:49:13.756 INFO:tasks.workunit.client.0.smithi078.stdout:0/382: mknod d3/d1f/d2e/d68/d30/c8e 0 2024-09-18T12:49:13.761 INFO:tasks.workunit.client.0.smithi078.stdout:6/439: symlink d10/d2b/d43/d53/d63/d70/l8b 0 2024-09-18T12:49:13.763 INFO:tasks.workunit.client.0.smithi078.stdout:5/391: rename d2/d4/d12/d16/f21 to d2/d4/d9/d49/f7d 0 2024-09-18T12:49:13.767 INFO:tasks.workunit.client.0.smithi078.stdout:6/440: creat d10/d2b/d43/d53/d63/d70/f8c x:0 0 0 2024-09-18T12:49:13.770 INFO:tasks.workunit.client.0.smithi078.stdout:5/392: dwrite d2/d4/d9/da/f20 [0,4194304] 0 2024-09-18T12:49:13.770 INFO:tasks.workunit.client.0.smithi078.stdout:6/441: dread - d10/d2b/d43/d53/d45/d55/f83 zero size 2024-09-18T12:49:13.773 INFO:tasks.workunit.client.0.smithi078.stdout:6/442: write d10/d2b/d43/f6f [5015906,61755] 0 2024-09-18T12:49:13.777 INFO:tasks.workunit.client.1.smithi148.stdout:0/628: getdents de/d27/d53/d89/dc0/dbd 0 2024-09-18T12:49:13.778 INFO:tasks.workunit.client.1.smithi148.stdout:8/511: rename d8/d16/d53/l8a to d8/df/lb0 0 2024-09-18T12:49:13.783 INFO:tasks.workunit.client.0.smithi078.stdout:0/383: getdents d3/d1f/d2e/d4e/d37/d72 0 2024-09-18T12:49:13.784 INFO:tasks.workunit.client.1.smithi148.stdout:9/428: unlink d8/da/dd/l78 0 2024-09-18T12:49:13.786 INFO:tasks.workunit.client.1.smithi148.stdout:9/429: dread d8/da/dd/d4a/f3a [0,4194304] 0 2024-09-18T12:49:13.786 INFO:tasks.workunit.client.0.smithi078.stdout:5/393: creat d2/d4/f7e x:0 0 0 2024-09-18T12:49:13.786 INFO:tasks.workunit.client.0.smithi078.stdout:5/394: readlink d2/d4/l11 0 2024-09-18T12:49:13.789 INFO:tasks.workunit.client.0.smithi078.stdout:5/395: mkdir d2/d4/d9/da/d60/d7f 0 2024-09-18T12:49:13.790 INFO:tasks.workunit.client.0.smithi078.stdout:0/384: mkdir d3/d1f/d2e/d8f 0 2024-09-18T12:49:13.792 INFO:tasks.workunit.client.1.smithi148.stdout:7/480: creat db/dc/df/d1d/d68/d7a/f85 x:0 0 0 2024-09-18T12:49:13.795 INFO:tasks.workunit.client.0.smithi078.stdout:4/250: write d11/d27/f48 [1351456,63153] 0 2024-09-18T12:49:13.797 INFO:tasks.workunit.client.1.smithi148.stdout:1/435: rename dc/d11/d38/d87/l8c to dc/d5b/l91 0 2024-09-18T12:49:13.798 INFO:tasks.workunit.client.1.smithi148.stdout:1/436: chown dc/d11/d38/d72 1104894 1 2024-09-18T12:49:13.798 INFO:tasks.workunit.client.1.smithi148.stdout:1/437: readlink dc/d18/d31/d39/l68 0 2024-09-18T12:49:13.799 INFO:tasks.workunit.client.0.smithi078.stdout:0/385: mkdir d3/d1f/d2e/d8f/d90 0 2024-09-18T12:49:13.803 INFO:tasks.workunit.client.1.smithi148.stdout:3/416: mkdir d4/d8/d20/d99 0 2024-09-18T12:49:13.804 INFO:tasks.workunit.client.0.smithi078.stdout:4/251: mknod d11/d27/d47/d4e/d50/c53 0 2024-09-18T12:49:13.806 INFO:tasks.workunit.client.0.smithi078.stdout:3/281: sync 2024-09-18T12:49:13.806 INFO:tasks.workunit.client.1.smithi148.stdout:9/430: creat d8/da/dd/d3f/d5d/f83 x:0 0 0 2024-09-18T12:49:13.806 INFO:tasks.workunit.client.1.smithi148.stdout:3/417: dread d4/d8/d20/d2b/f53 [0,4194304] 0 2024-09-18T12:49:13.807 INFO:tasks.workunit.client.0.smithi078.stdout:6/443: write d10/f1e [9237592,102391] 0 2024-09-18T12:49:13.807 INFO:tasks.workunit.client.0.smithi078.stdout:0/386: mknod d3/d1f/d2e/c91 0 2024-09-18T12:49:13.807 INFO:tasks.workunit.client.0.smithi078.stdout:3/282: dread - d9/f59 zero size 2024-09-18T12:49:13.807 INFO:tasks.workunit.client.0.smithi078.stdout:3/283: symlink d9/d29/d4b/d4c/l5d 2 2024-09-18T12:49:13.810 INFO:tasks.workunit.client.0.smithi078.stdout:4/252: mknod d11/d1f/d4b/c54 0 2024-09-18T12:49:13.812 INFO:tasks.workunit.client.1.smithi148.stdout:9/431: dread d8/da/dd/f1b [0,4194304] 0 2024-09-18T12:49:13.813 INFO:tasks.workunit.client.1.smithi148.stdout:7/481: symlink db/dc/df/d1d/l86 0 2024-09-18T12:49:13.813 INFO:tasks.workunit.client.1.smithi148.stdout:9/432: read d8/da/dd/f14 [157107,52509] 0 2024-09-18T12:49:13.814 INFO:tasks.workunit.client.0.smithi078.stdout:6/444: creat d10/d2b/d43/d53/d63/d70/d77/f8d x:0 0 0 2024-09-18T12:49:13.818 INFO:tasks.workunit.client.1.smithi148.stdout:0/629: mknod de/d14/dd2/cd8 0 2024-09-18T12:49:13.819 INFO:tasks.workunit.client.0.smithi078.stdout:6/445: truncate d10/d2b/d43/d53/d63/d70/d77/f8d 298927 0 2024-09-18T12:49:13.820 INFO:tasks.workunit.client.0.smithi078.stdout:0/387: symlink d3/d1f/l92 0 2024-09-18T12:49:13.822 INFO:tasks.workunit.client.0.smithi078.stdout:6/446: write d10/d2b/d61/f7b [794337,56790] 0 2024-09-18T12:49:13.823 INFO:tasks.workunit.client.0.smithi078.stdout:5/396: dwrite d2/d4/f34 [4194304,4194304] 0 2024-09-18T12:49:13.825 INFO:tasks.workunit.client.0.smithi078.stdout:5/397: chown d2/cd 399500269 1 2024-09-18T12:49:13.825 INFO:tasks.workunit.client.1.smithi148.stdout:9/433: dread d8/f5c [0,4194304] 0 2024-09-18T12:49:13.826 INFO:tasks.workunit.client.1.smithi148.stdout:5/495: rename d7/d8/dc/ff to d7/d8/dc/d12/d1f/d77/fa1 0 2024-09-18T12:49:13.826 INFO:tasks.workunit.client.1.smithi148.stdout:9/434: fsync d8/da/dd/d35/d59/f69 0 2024-09-18T12:49:13.827 INFO:tasks.workunit.client.0.smithi078.stdout:3/284: dread f7 [4194304,4194304] 0 2024-09-18T12:49:13.829 INFO:tasks.workunit.client.1.smithi148.stdout:2/385: dread d9/d24/d31/d34/d42/f44 [0,4194304] 0 2024-09-18T12:49:13.830 INFO:tasks.workunit.client.0.smithi078.stdout:6/447: dread d10/d2b/d43/d53/f56 [0,4194304] 0 2024-09-18T12:49:13.832 INFO:tasks.workunit.client.0.smithi078.stdout:3/285: read d9/d13/d33/d4e/f25 [58799,45250] 0 2024-09-18T12:49:13.833 INFO:tasks.workunit.client.1.smithi148.stdout:2/386: chown d9/d24/l5c 0 1 2024-09-18T12:49:13.834 INFO:tasks.workunit.client.0.smithi078.stdout:5/398: unlink d2/d4/d9/d2f/d30/f7c 0 2024-09-18T12:49:13.835 INFO:tasks.workunit.client.1.smithi148.stdout:6/472: dwrite d5/f23 [4194304,4194304] 0 2024-09-18T12:49:13.838 INFO:tasks.workunit.client.0.smithi078.stdout:4/253: link d11/f12 d11/f55 0 2024-09-18T12:49:13.846 INFO:tasks.workunit.client.1.smithi148.stdout:7/482: dwrite db/dc/df/d11/d43/f72 [0,4194304] 0 2024-09-18T12:49:13.847 INFO:tasks.workunit.client.1.smithi148.stdout:4/412: creat d15/d5f/d77/d4c/d4f/f8a x:0 0 0 2024-09-18T12:49:13.848 INFO:tasks.workunit.client.0.smithi078.stdout:3/286: chown d9/df/c46 11699125 1 2024-09-18T12:49:13.850 INFO:tasks.workunit.client.1.smithi148.stdout:0/630: mkdir de/d27/d53/d89/dc0/dbd/dd9 0 2024-09-18T12:49:13.851 INFO:tasks.workunit.client.0.smithi078.stdout:5/399: rename d2/d4/d9/d49/f73 to d2/d4/d9/d2f/d30/f80 0 2024-09-18T12:49:13.855 INFO:tasks.workunit.client.1.smithi148.stdout:4/413: dwrite d15/d5f/d69/f85 [0,4194304] 0 2024-09-18T12:49:13.856 INFO:tasks.workunit.client.0.smithi078.stdout:0/388: dread d3/f20 [0,4194304] 0 2024-09-18T12:49:13.856 INFO:tasks.workunit.client.1.smithi148.stdout:8/512: rename d8/d12/d46/f8d to d8/df/d3e/d88/fb1 0 2024-09-18T12:49:13.856 INFO:tasks.workunit.client.1.smithi148.stdout:5/496: rmdir d7/d8/dc/d12/d31 39 2024-09-18T12:49:13.857 INFO:tasks.workunit.client.0.smithi078.stdout:3/287: dwrite d9/f12 [0,4194304] 0 2024-09-18T12:49:13.857 INFO:tasks.workunit.client.1.smithi148.stdout:3/418: dwrite d4/d8/d1e/d6b/d31/d54/f8a [0,4194304] 0 2024-09-18T12:49:13.858 INFO:tasks.workunit.client.0.smithi078.stdout:3/288: chown d9/d13/d33/d3c 2998 1 2024-09-18T12:49:13.860 INFO:tasks.workunit.client.1.smithi148.stdout:3/419: dread - d4/d8/d1e/d6b/d31/d46/f80 zero size 2024-09-18T12:49:13.862 INFO:tasks.workunit.client.1.smithi148.stdout:9/435: unlink d8/da/dd/d35/d47/d4e/f67 0 2024-09-18T12:49:13.867 INFO:tasks.workunit.client.0.smithi078.stdout:0/389: dread d3/d1f/d2e/d4e/d37/f51 [0,4194304] 0 2024-09-18T12:49:13.867 INFO:tasks.workunit.client.1.smithi148.stdout:5/497: dwrite d7/f15 [0,4194304] 0 2024-09-18T12:49:13.868 INFO:tasks.workunit.client.1.smithi148.stdout:9/436: write d8/da/dd/d35/d47/d62/f3b [2909100,80615] 0 2024-09-18T12:49:13.871 INFO:tasks.workunit.client.0.smithi078.stdout:4/254: mkdir d11/d1f/d56 0 2024-09-18T12:49:13.871 INFO:tasks.workunit.client.0.smithi078.stdout:6/448: link d10/l2c d10/d2b/d43/d53/d63/l8e 0 2024-09-18T12:49:13.873 INFO:tasks.workunit.client.0.smithi078.stdout:4/255: truncate d11/d27/d47/f49 1372777 0 2024-09-18T12:49:13.875 INFO:tasks.workunit.client.1.smithi148.stdout:1/438: rename dc/d18/f3f to dc/d18/d8a/f92 0 2024-09-18T12:49:13.875 INFO:tasks.workunit.client.0.smithi078.stdout:4/256: chown d11/d27 501 1 2024-09-18T12:49:13.876 INFO:tasks.workunit.client.1.smithi148.stdout:8/513: fdatasync d8/d16/d27/f47 0 2024-09-18T12:49:13.882 INFO:tasks.workunit.client.0.smithi078.stdout:6/449: rename f3 to d10/d2b/d43/f8f 0 2024-09-18T12:49:13.883 INFO:tasks.workunit.client.0.smithi078.stdout:3/289: dwrite d9/f27 [0,4194304] 0 2024-09-18T12:49:13.889 INFO:tasks.workunit.client.0.smithi078.stdout:3/290: dread d9/d13/f1d [0,4194304] 0 2024-09-18T12:49:13.892 INFO:tasks.workunit.client.0.smithi078.stdout:4/257: creat d11/d27/d47/f57 x:0 0 0 2024-09-18T12:49:13.893 INFO:tasks.workunit.client.1.smithi148.stdout:9/437: creat d8/da/dd/d3f/f84 x:0 0 0 2024-09-18T12:49:13.898 INFO:tasks.workunit.client.0.smithi078.stdout:6/450: mknod d10/d2b/d43/d53/c90 0 2024-09-18T12:49:13.901 INFO:tasks.workunit.client.0.smithi078.stdout:3/291: dwrite d9/f12 [0,4194304] 0 2024-09-18T12:49:13.901 INFO:tasks.workunit.client.1.smithi148.stdout:3/420: dread d4/d8/d1e/f5e [0,4194304] 0 2024-09-18T12:49:13.904 INFO:tasks.workunit.client.0.smithi078.stdout:4/258: dwrite d11/d27/d47/f57 [0,4194304] 0 2024-09-18T12:49:13.906 INFO:tasks.workunit.client.1.smithi148.stdout:7/483: rename db/dc/df/d1d/d41/f6f to db/dc/df/d1d/d68/f87 0 2024-09-18T12:49:13.906 INFO:tasks.workunit.client.0.smithi078.stdout:5/400: link d2/d4/d9/da/f19 d2/d4/d12/f81 0 2024-09-18T12:49:13.910 INFO:tasks.workunit.client.0.smithi078.stdout:0/390: truncate d3/d1f/f53 957268 0 2024-09-18T12:49:13.912 INFO:tasks.workunit.client.1.smithi148.stdout:8/514: unlink d8/d16/d27/c35 0 2024-09-18T12:49:13.913 INFO:tasks.workunit.client.1.smithi148.stdout:6/473: write d5/d1a/f21 [312095,20012] 0 2024-09-18T12:49:13.914 INFO:tasks.workunit.client.1.smithi148.stdout:8/515: fsync d8/d16/d53/d39/f3d 0 2024-09-18T12:49:13.917 INFO:tasks.workunit.client.0.smithi078.stdout:6/451: creat d10/d2b/d43/d53/d63/d70/d77/f91 x:0 0 0 2024-09-18T12:49:13.919 INFO:tasks.workunit.client.0.smithi078.stdout:0/391: dwrite d3/d1f/d2e/d68/f44 [4194304,4194304] 0 2024-09-18T12:49:13.922 INFO:tasks.workunit.client.0.smithi078.stdout:4/259: creat d11/d1f/d40/f58 x:0 0 0 2024-09-18T12:49:13.924 INFO:tasks.workunit.client.1.smithi148.stdout:4/414: dwrite d15/f76 [0,4194304] 0 2024-09-18T12:49:13.925 INFO:tasks.workunit.client.1.smithi148.stdout:4/415: chown d15/d17/f27 83 1 2024-09-18T12:49:13.928 INFO:tasks.workunit.client.0.smithi078.stdout:6/452: creat d10/d2b/d43/d53/f92 x:0 0 0 2024-09-18T12:49:13.930 INFO:tasks.workunit.client.0.smithi078.stdout:0/392: rmdir d3/d43 39 2024-09-18T12:49:13.930 INFO:tasks.workunit.client.0.smithi078.stdout:6/453: chown d10/d2b/d37/f59 7357410 1 2024-09-18T12:49:13.931 INFO:tasks.workunit.client.1.smithi148.stdout:3/421: rename d4/d8/d1e/d6b/d31/f3c to d4/d8/d20/d2b/d7f/d93/d94/f9a 0 2024-09-18T12:49:13.933 INFO:tasks.workunit.client.1.smithi148.stdout:7/484: fsync db/d52/d25/d38/f49 0 2024-09-18T12:49:13.934 INFO:tasks.workunit.client.0.smithi078.stdout:4/260: dwrite d11/d27/d47/f3d [0,4194304] 0 2024-09-18T12:49:13.937 INFO:tasks.workunit.client.0.smithi078.stdout:0/393: write d3/d1f/d2e/d4e/d37/d72/f78 [450080,109273] 0 2024-09-18T12:49:13.937 INFO:tasks.workunit.client.0.smithi078.stdout:4/261: dread - d11/d1f/d40/f58 zero size 2024-09-18T12:49:13.938 INFO:tasks.workunit.client.1.smithi148.stdout:1/439: unlink dc/d11/d38/d87/l1d 0 2024-09-18T12:49:13.938 INFO:tasks.workunit.client.1.smithi148.stdout:1/440: chown dc/d18/d43/c8e 58 1 2024-09-18T12:49:13.942 INFO:tasks.workunit.client.0.smithi078.stdout:3/292: rename d9/d2f/c4a to d9/c5e 0 2024-09-18T12:49:13.944 INFO:tasks.workunit.client.1.smithi148.stdout:2/387: truncate d9/fe 702 0 2024-09-18T12:49:13.945 INFO:tasks.workunit.client.0.smithi078.stdout:4/262: dread d11/d1f/f2d [0,4194304] 0 2024-09-18T12:49:13.948 INFO:tasks.workunit.client.1.smithi148.stdout:6/474: dread d5/d32/d38/f54 [0,4194304] 0 2024-09-18T12:49:13.950 INFO:tasks.workunit.client.1.smithi148.stdout:0/631: getdents de/d27 0 2024-09-18T12:49:13.951 INFO:tasks.workunit.client.0.smithi078.stdout:3/293: dwrite d9/d2f/f3d [4194304,4194304] 0 2024-09-18T12:49:13.951 INFO:tasks.workunit.client.0.smithi078.stdout:0/394: chown d3/d43/l54 116886 1 2024-09-18T12:49:13.952 INFO:tasks.workunit.client.0.smithi078.stdout:3/294: read - d9/f59 zero size 2024-09-18T12:49:13.956 INFO:tasks.workunit.client.1.smithi148.stdout:4/416: creat d15/d17/d52/f8b x:0 0 0 2024-09-18T12:49:13.959 INFO:tasks.workunit.client.0.smithi078.stdout:6/454: creat d10/d2b/d43/d53/d63/d6b/f93 x:0 0 0 2024-09-18T12:49:13.960 INFO:tasks.workunit.client.1.smithi148.stdout:5/498: link d7/d2b/l8f d7/d8/d18/d3f/d7c/d7d/la2 0 2024-09-18T12:49:13.962 INFO:tasks.workunit.client.0.smithi078.stdout:5/401: truncate d2/d4/d9/da/f20 2365066 0 2024-09-18T12:49:13.964 INFO:tasks.workunit.client.0.smithi078.stdout:5/402: dread d2/d4/d9/da/d2b/f69 [0,4194304] 0 2024-09-18T12:49:13.966 INFO:tasks.workunit.client.0.smithi078.stdout:5/403: write d2/d4/f7e [643873,110095] 0 2024-09-18T12:49:13.968 INFO:tasks.workunit.client.1.smithi148.stdout:3/422: stat d4/d8/d20/d2b/f73 0 2024-09-18T12:49:13.968 INFO:tasks.workunit.client.0.smithi078.stdout:5/404: dread - d2/d4/d12/f67 zero size 2024-09-18T12:49:13.969 INFO:tasks.workunit.client.0.smithi078.stdout:3/295: creat d9/d13/f5f x:0 0 0 2024-09-18T12:49:13.969 INFO:tasks.workunit.client.1.smithi148.stdout:3/423: write d4/d8/d1e/d6b/d31/f65 [1548264,22592] 0 2024-09-18T12:49:13.974 INFO:tasks.workunit.client.0.smithi078.stdout:6/455: chown d10/l29 1931 1 2024-09-18T12:49:13.976 INFO:tasks.workunit.client.0.smithi078.stdout:4/263: link d11/d27/d47/f49 d11/d27/f59 0 2024-09-18T12:49:13.976 INFO:tasks.workunit.client.0.smithi078.stdout:2/265: sync 2024-09-18T12:49:13.977 INFO:tasks.workunit.client.0.smithi078.stdout:4/264: write d11/d27/f48 [3457464,1798] 0 2024-09-18T12:49:13.980 INFO:tasks.workunit.client.1.smithi148.stdout:8/516: mkdir d8/df/db2 0 2024-09-18T12:49:13.981 INFO:tasks.workunit.client.1.smithi148.stdout:6/475: dread - d5/d1a/dc/d2b/d35/f69 zero size 2024-09-18T12:49:13.981 INFO:tasks.workunit.client.1.smithi148.stdout:8/517: write d8/d12/d46/f5a [826644,43657] 0 2024-09-18T12:49:13.982 INFO:tasks.workunit.client.1.smithi148.stdout:8/518: write d8/d16/f9d [726025,48597] 0 2024-09-18T12:49:13.983 INFO:tasks.workunit.client.1.smithi148.stdout:0/632: unlink de/d27/d53/d89/f91 0 2024-09-18T12:49:13.984 INFO:tasks.workunit.client.0.smithi078.stdout:3/296: mknod d9/d13/d33/d3c/c60 0 2024-09-18T12:49:13.985 INFO:tasks.workunit.client.1.smithi148.stdout:4/417: creat d15/d5f/d69/f8c x:0 0 0 2024-09-18T12:49:13.986 INFO:tasks.workunit.client.1.smithi148.stdout:4/418: chown d15/d5f/d77/d4c/d4f/d34/l7e 85 1 2024-09-18T12:49:13.987 INFO:tasks.workunit.client.0.smithi078.stdout:6/456: rename d10/l79 to d10/d2b/d43/d53/d63/d70/l94 0 2024-09-18T12:49:13.987 INFO:tasks.workunit.client.1.smithi148.stdout:5/499: mknod d7/d8/dc/d12/d1f/d77/ca3 0 2024-09-18T12:49:13.989 INFO:tasks.workunit.client.1.smithi148.stdout:9/438: creat d8/da/dd/d4a/d49/f85 x:0 0 0 2024-09-18T12:49:13.995 INFO:tasks.workunit.client.0.smithi078.stdout:4/265: mkdir d11/d27/d5a 0 2024-09-18T12:49:13.995 INFO:tasks.workunit.client.0.smithi078.stdout:2/266: dread d4/d8/f1d [0,4194304] 0 2024-09-18T12:49:13.996 INFO:tasks.workunit.client.1.smithi148.stdout:3/424: mkdir d4/d8/d1e/d63/d9b 0 2024-09-18T12:49:13.997 INFO:tasks.workunit.client.0.smithi078.stdout:6/457: dwrite d10/d2b/d43/d53/d45/d55/d3f/f5f [0,4194304] 0 2024-09-18T12:49:13.998 INFO:tasks.workunit.client.0.smithi078.stdout:2/267: truncate d4/dd/f4e 287225 0 2024-09-18T12:49:13.999 INFO:tasks.workunit.client.0.smithi078.stdout:0/395: creat d3/f93 x:0 0 0 2024-09-18T12:49:14.000 INFO:tasks.workunit.client.1.smithi148.stdout:3/425: dwrite d4/f18 [0,4194304] 0 2024-09-18T12:49:14.001 INFO:tasks.workunit.client.1.smithi148.stdout:3/426: chown d4/d8/d1e/d6b/d31/d54 11953 1 2024-09-18T12:49:14.003 INFO:tasks.workunit.client.0.smithi078.stdout:5/405: fdatasync d2/d4/d9/da/f20 0 2024-09-18T12:49:14.006 INFO:tasks.workunit.client.0.smithi078.stdout:5/406: write d2/d4/d9/da/f5a [1036911,29052] 0 2024-09-18T12:49:14.006 INFO:tasks.workunit.client.0.smithi078.stdout:6/458: dread d10/d2b/d43/d53/d45/d55/f2d [0,4194304] 0 2024-09-18T12:49:14.007 INFO:tasks.workunit.client.0.smithi078.stdout:3/297: unlink d9/d13/d33/d3c/d19/l30 0 2024-09-18T12:49:14.015 INFO:tasks.workunit.client.1.smithi148.stdout:2/388: creat d9/d3a/f86 x:0 0 0 2024-09-18T12:49:14.015 INFO:tasks.workunit.client.0.smithi078.stdout:6/459: dwrite d10/d2b/d43/d53/d45/d55/f88 [0,4194304] 0 2024-09-18T12:49:14.016 INFO:tasks.workunit.client.1.smithi148.stdout:2/389: write d9/d24/d31/d34/d57/f60 [40399,127658] 0 2024-09-18T12:49:14.017 INFO:tasks.workunit.client.1.smithi148.stdout:2/390: truncate d9/d24/f28 831969 0 2024-09-18T12:49:14.018 INFO:tasks.workunit.client.0.smithi078.stdout:4/266: rename d11/c35 to d11/d1f/d56/c5b 0 2024-09-18T12:49:14.018 INFO:tasks.workunit.client.1.smithi148.stdout:2/391: fsync d9/d3a/f4b 0 2024-09-18T12:49:14.018 INFO:tasks.workunit.client.0.smithi078.stdout:4/267: chown d11/d1f/f3a 1391 1 2024-09-18T12:49:14.024 INFO:tasks.workunit.client.1.smithi148.stdout:8/519: mknod d8/d16/d53/cb3 0 2024-09-18T12:49:14.030 INFO:tasks.workunit.client.1.smithi148.stdout:8/520: dwrite d8/f8c [0,4194304] 0 2024-09-18T12:49:14.032 INFO:tasks.workunit.client.1.smithi148.stdout:7/485: truncate db/dc/df/d11/f65 787048 0 2024-09-18T12:49:14.035 INFO:tasks.workunit.client.0.smithi078.stdout:6/460: mknod d10/d2b/d43/d53/d63/d70/d7d/c95 0 2024-09-18T12:49:14.036 INFO:tasks.workunit.client.1.smithi148.stdout:9/439: dread d8/da/dd/f1b [0,4194304] 0 2024-09-18T12:49:14.038 INFO:tasks.workunit.client.0.smithi078.stdout:2/268: write d4/d1a/f22 [3136835,99999] 0 2024-09-18T12:49:14.040 INFO:tasks.workunit.client.1.smithi148.stdout:1/441: dwrite dc/f25 [0,4194304] 0 2024-09-18T12:49:14.041 INFO:tasks.workunit.client.1.smithi148.stdout:2/392: creat d9/d24/d47/f87 x:0 0 0 2024-09-18T12:49:14.043 INFO:tasks.workunit.client.0.smithi078.stdout:6/461: rmdir d10/d2b/d43/d53/d63 39 2024-09-18T12:49:14.043 INFO:tasks.workunit.client.1.smithi148.stdout:7/486: dwrite db/dc/d70/f7d [0,4194304] 0 2024-09-18T12:49:14.045 INFO:tasks.workunit.client.0.smithi078.stdout:5/407: rename d2/d4/d9/d49/l77 to d2/d4/d9/d2f/d30/l82 0 2024-09-18T12:49:14.045 INFO:tasks.workunit.client.1.smithi148.stdout:7/487: fdatasync db/dc/df/d1d/f5c 0 2024-09-18T12:49:14.048 INFO:tasks.workunit.client.0.smithi078.stdout:4/268: unlink l9 0 2024-09-18T12:49:14.049 INFO:tasks.workunit.client.0.smithi078.stdout:4/269: fsync d11/f38 0 2024-09-18T12:49:14.051 INFO:tasks.workunit.client.0.smithi078.stdout:2/269: mkdir d4/d8/d23/d52 0 2024-09-18T12:49:14.054 INFO:tasks.workunit.client.0.smithi078.stdout:5/408: dread d2/d4/d12/d16/d36/f41 [4194304,4194304] 0 2024-09-18T12:49:14.055 INFO:tasks.workunit.client.1.smithi148.stdout:8/521: unlink d8/d16/d53/d39/d3b/l77 0 2024-09-18T12:49:14.056 INFO:tasks.workunit.client.1.smithi148.stdout:8/522: chown d8/d16/d27/f30 172796943 1 2024-09-18T12:49:14.056 INFO:tasks.workunit.client.1.smithi148.stdout:8/523: readlink d8/d12/d51/d94/la4 0 2024-09-18T12:49:14.056 INFO:tasks.workunit.client.1.smithi148.stdout:3/427: symlink d4/d8/d1e/d6b/d31/l9c 0 2024-09-18T12:49:14.058 INFO:tasks.workunit.client.1.smithi148.stdout:8/524: write d8/d12/d46/d7e/f89 [584865,19451] 0 2024-09-18T12:49:14.060 INFO:tasks.workunit.client.0.smithi078.stdout:4/270: dwrite d11/d1f/f3a [0,4194304] 0 2024-09-18T12:49:14.063 INFO:tasks.workunit.client.0.smithi078.stdout:4/271: write d11/f38 [1006087,101024] 0 2024-09-18T12:49:14.063 INFO:tasks.workunit.client.1.smithi148.stdout:2/393: dread - d9/d73/f7e zero size 2024-09-18T12:49:14.066 INFO:tasks.workunit.client.0.smithi078.stdout:0/396: dwrite d3/d1f/d2e/d4e/d37/f8c [4194304,4194304] 0 2024-09-18T12:49:14.067 INFO:tasks.workunit.client.0.smithi078.stdout:2/270: creat d4/db/f53 x:0 0 0 2024-09-18T12:49:14.068 INFO:tasks.workunit.client.0.smithi078.stdout:0/397: fdatasync d3/d1f/d2e/d68/d30/d7c/f85 0 2024-09-18T12:49:14.068 INFO:tasks.workunit.client.0.smithi078.stdout:2/271: chown d4/db/dc/f1b 284 1 2024-09-18T12:49:14.069 INFO:tasks.workunit.client.1.smithi148.stdout:0/633: creat de/d14/d43/d57/fda x:0 0 0 2024-09-18T12:49:14.079 INFO:tasks.workunit.client.0.smithi078.stdout:8/284: sync 2024-09-18T12:49:14.080 INFO:tasks.workunit.client.0.smithi078.stdout:3/298: getdents d9/d13/d37 0 2024-09-18T12:49:14.081 INFO:tasks.workunit.client.0.smithi078.stdout:5/409: mkdir d2/d4/d9/da/d60/d61/d83 0 2024-09-18T12:49:14.082 INFO:tasks.workunit.client.0.smithi078.stdout:0/398: chown d3/d1f/d2e/d68/d30/c4a 38699 1 2024-09-18T12:49:14.084 INFO:tasks.workunit.client.0.smithi078.stdout:6/462: symlink d10/l96 0 2024-09-18T12:49:14.084 INFO:tasks.workunit.client.1.smithi148.stdout:7/488: truncate db/dc/f12 1901746 0 2024-09-18T12:49:14.085 INFO:tasks.workunit.client.0.smithi078.stdout:5/410: stat d2/d4/d12/d16/d36/d4c/l52 0 2024-09-18T12:49:14.090 INFO:tasks.workunit.client.0.smithi078.stdout:5/411: write d2/d4/d9/d2f/f6f [1023481,2465] 0 2024-09-18T12:49:14.091 INFO:tasks.workunit.client.1.smithi148.stdout:9/440: mknod d8/da/dd/d35/d47/d62/c86 0 2024-09-18T12:49:14.092 INFO:tasks.workunit.client.0.smithi078.stdout:2/272: dwrite d4/dd/d18/d33/f48 [0,4194304] 0 2024-09-18T12:49:14.093 INFO:tasks.workunit.client.0.smithi078.stdout:6/463: write d10/d2b/d43/d53/f92 [797833,15454] 0 2024-09-18T12:49:14.095 INFO:tasks.workunit.client.0.smithi078.stdout:8/285: dwrite d0/f1c [0,4194304] 0 2024-09-18T12:49:14.097 INFO:tasks.workunit.client.1.smithi148.stdout:9/441: dwrite d8/da/dd/d4a/d27/f52 [0,4194304] 0 2024-09-18T12:49:14.098 INFO:tasks.workunit.client.1.smithi148.stdout:2/394: dread d9/d17/f45 [0,4194304] 0 2024-09-18T12:49:14.100 INFO:tasks.workunit.client.1.smithi148.stdout:6/476: getdents d5/d1a 0 2024-09-18T12:49:14.104 INFO:tasks.workunit.client.0.smithi078.stdout:8/286: write d0/f1c [1763251,3786] 0 2024-09-18T12:49:14.108 INFO:tasks.workunit.client.1.smithi148.stdout:4/419: link lf d15/d3f/l8d 0 2024-09-18T12:49:14.109 INFO:tasks.workunit.client.0.smithi078.stdout:0/399: dwrite d3/d1f/d2e/d68/d30/f64 [0,4194304] 0 2024-09-18T12:49:14.113 INFO:tasks.workunit.client.0.smithi078.stdout:5/412: stat d2/d4/d12/d16/d36/d4c/d62/d4d 0 2024-09-18T12:49:14.113 INFO:tasks.workunit.client.0.smithi078.stdout:3/299: creat d9/f61 x:0 0 0 2024-09-18T12:49:14.115 INFO:tasks.workunit.client.1.smithi148.stdout:4/420: dwrite d15/d17/d52/f7d [0,4194304] 0 2024-09-18T12:49:14.116 INFO:tasks.workunit.client.0.smithi078.stdout:6/464: dwrite d10/d2b/d43/f64 [0,4194304] 0 2024-09-18T12:49:14.116 INFO:tasks.workunit.client.1.smithi148.stdout:3/428: rename d4/d8/d20/d2b/c48 to d4/d8/d20/d2b/d43/d61/c9d 0 2024-09-18T12:49:14.116 INFO:tasks.workunit.client.0.smithi078.stdout:5/413: fdatasync d2/d4/d12/d16/d36/d4c/f65 0 2024-09-18T12:49:14.118 INFO:tasks.workunit.client.0.smithi078.stdout:6/465: chown d10/d2b/d43/f6f 296903 1 2024-09-18T12:49:14.118 INFO:tasks.workunit.client.1.smithi148.stdout:8/525: symlink d8/d16/d53/d39/d3b/lb4 0 2024-09-18T12:49:14.119 INFO:tasks.workunit.client.0.smithi078.stdout:8/287: rmdir d0/d7/dc/d1f/d23 39 2024-09-18T12:49:14.119 INFO:tasks.workunit.client.0.smithi078.stdout:5/414: chown d2/d4/d9/da/l37 26104 1 2024-09-18T12:49:14.120 INFO:tasks.workunit.client.1.smithi148.stdout:8/526: readlink d8/d16/d53/d39/d3b/la3 0 2024-09-18T12:49:14.120 INFO:tasks.workunit.client.1.smithi148.stdout:8/527: chown d8/df 854731 1 2024-09-18T12:49:14.121 INFO:tasks.workunit.client.1.smithi148.stdout:1/442: mkdir dc/d18/d7d/d93 0 2024-09-18T12:49:14.123 INFO:tasks.workunit.client.0.smithi078.stdout:0/400: unlink d3/d1f/d2e/d68/d30/c8e 0 2024-09-18T12:49:14.124 INFO:tasks.workunit.client.0.smithi078.stdout:3/300: fdatasync d9/d13/d33/d34/f48 0 2024-09-18T12:49:14.126 INFO:tasks.workunit.client.1.smithi148.stdout:3/429: dwrite d4/f18 [0,4194304] 0 2024-09-18T12:49:14.129 INFO:tasks.workunit.client.1.smithi148.stdout:6/477: creat d5/d32/d38/d50/f97 x:0 0 0 2024-09-18T12:49:14.129 INFO:tasks.workunit.client.0.smithi078.stdout:5/415: dwrite d2/f26 [0,4194304] 0 2024-09-18T12:49:14.132 INFO:tasks.workunit.client.1.smithi148.stdout:7/489: mknod db/d52/c88 0 2024-09-18T12:49:14.133 INFO:tasks.workunit.client.1.smithi148.stdout:5/500: link d7/d8/dc/d12/d31/l47 d7/d8/la4 0 2024-09-18T12:49:14.134 INFO:tasks.workunit.client.1.smithi148.stdout:8/528: dwrite d8/d12/f13 [0,4194304] 0 2024-09-18T12:49:14.142 INFO:tasks.workunit.client.0.smithi078.stdout:3/301: readlink d9/d29/d4b/d4c/l5a 0 2024-09-18T12:49:14.143 INFO:tasks.workunit.client.0.smithi078.stdout:3/302: chown d9/d13/d33/d34/c35 169549663 1 2024-09-18T12:49:14.146 INFO:tasks.workunit.client.1.smithi148.stdout:1/443: fsync dc/d4d/f56 0 2024-09-18T12:49:14.148 INFO:tasks.workunit.client.0.smithi078.stdout:8/288: unlink d0/d7/d1e/c36 0 2024-09-18T12:49:14.151 INFO:tasks.workunit.client.0.smithi078.stdout:4/272: link d11/c2e d11/d1f/d4b/c5c 0 2024-09-18T12:49:14.153 INFO:tasks.workunit.client.1.smithi148.stdout:2/395: symlink d9/d4a/l88 0 2024-09-18T12:49:14.153 INFO:tasks.workunit.client.1.smithi148.stdout:2/396: chown d9/d17/l5f 1027683 1 2024-09-18T12:49:14.154 INFO:tasks.workunit.client.1.smithi148.stdout:7/490: dread db/dc/df/d11/f1b [0,4194304] 0 2024-09-18T12:49:14.155 INFO:tasks.workunit.client.0.smithi078.stdout:6/466: creat d10/f97 x:0 0 0 2024-09-18T12:49:14.155 INFO:tasks.workunit.client.0.smithi078.stdout:2/273: truncate d4/d20/f29 324893 0 2024-09-18T12:49:14.157 INFO:tasks.workunit.client.1.smithi148.stdout:3/430: creat d4/d8/d20/d2b/d43/d61/f9e x:0 0 0 2024-09-18T12:49:14.157 INFO:tasks.workunit.client.1.smithi148.stdout:3/431: readlink d4/l1b 0 2024-09-18T12:49:14.158 INFO:tasks.workunit.client.1.smithi148.stdout:0/634: write de/d14/d43/d70/f8d [565647,23688] 0 2024-09-18T12:49:14.160 INFO:tasks.workunit.client.0.smithi078.stdout:8/289: rmdir d0 39 2024-09-18T12:49:14.165 INFO:tasks.workunit.client.1.smithi148.stdout:5/501: write d7/d8/dc/d12/d1f/d77/f9b [913069,21313] 0 2024-09-18T12:49:14.166 INFO:tasks.workunit.client.1.smithi148.stdout:5/502: write d7/d8/dc/d22/f79 [1060881,113437] 0 2024-09-18T12:49:14.166 INFO:tasks.workunit.client.0.smithi078.stdout:0/401: dwrite d3/f5 [0,4194304] 0 2024-09-18T12:49:14.167 INFO:tasks.workunit.client.1.smithi148.stdout:9/442: truncate d8/da/dd/f31 3931197 0 2024-09-18T12:49:14.171 INFO:tasks.workunit.client.0.smithi078.stdout:5/416: creat d2/d4/d12/d16/d36/d4c/d62/f84 x:0 0 0 2024-09-18T12:49:14.174 INFO:tasks.workunit.client.1.smithi148.stdout:4/421: creat d15/d5f/d69/d7f/f8e x:0 0 0 2024-09-18T12:49:14.174 INFO:tasks.workunit.client.0.smithi078.stdout:5/417: stat d2/d4/d12/d16/d36/d4c/c6d 0 2024-09-18T12:49:14.175 INFO:tasks.workunit.client.1.smithi148.stdout:4/422: chown d15/d17/f1c 3107205 1 2024-09-18T12:49:14.175 INFO:tasks.workunit.client.1.smithi148.stdout:6/478: dread d5/d1a/f37 [4194304,4194304] 0 2024-09-18T12:49:14.176 INFO:tasks.workunit.client.1.smithi148.stdout:4/423: fsync d15/d5f/d77/d4c/d4f/f23 0 2024-09-18T12:49:14.178 INFO:tasks.workunit.client.1.smithi148.stdout:1/444: read f8 [1571899,107175] 0 2024-09-18T12:49:14.180 INFO:tasks.workunit.client.1.smithi148.stdout:7/491: mkdir db/dc/df/d11/d43/d89 0 2024-09-18T12:49:14.183 INFO:tasks.workunit.client.0.smithi078.stdout:6/467: rmdir d10/d2b/d43/d53/d63/d70/d7d 39 2024-09-18T12:49:14.183 INFO:tasks.workunit.client.0.smithi078.stdout:3/303: truncate d9/d13/d33/d3c/d19/f1e 4556796 0 2024-09-18T12:49:14.185 INFO:tasks.workunit.client.0.smithi078.stdout:0/402: write d3/d1f/d2e/d4e/d37/f51 [3236099,51339] 0 2024-09-18T12:49:14.187 INFO:tasks.workunit.client.0.smithi078.stdout:2/274: symlink d4/db/d45/l54 0 2024-09-18T12:49:14.187 INFO:tasks.workunit.client.0.smithi078.stdout:0/403: fdatasync d3/d1f/d2e/d4e/f49 0 2024-09-18T12:49:14.187 INFO:tasks.workunit.client.0.smithi078.stdout:0/404: readlink d3/d1f/l60 0 2024-09-18T12:49:14.188 INFO:tasks.workunit.client.0.smithi078.stdout:0/405: chown d3/d1f/f41 1503 1 2024-09-18T12:49:14.195 INFO:tasks.workunit.client.1.smithi148.stdout:2/397: symlink d9/d4a/d64/l89 0 2024-09-18T12:49:14.196 INFO:tasks.workunit.client.0.smithi078.stdout:5/418: link d2/d4/d12/d16/d36/f79 d2/d4/d9/d2f/d30/f85 0 2024-09-18T12:49:14.198 INFO:tasks.workunit.client.1.smithi148.stdout:4/424: creat d15/d3f/f8f x:0 0 0 2024-09-18T12:49:14.198 INFO:tasks.workunit.client.0.smithi078.stdout:2/275: truncate d4/d1a/f2e 1820926 0 2024-09-18T12:49:14.198 INFO:tasks.workunit.client.1.smithi148.stdout:4/425: dread - d15/d5f/f71 zero size 2024-09-18T12:49:14.199 INFO:tasks.workunit.client.0.smithi078.stdout:2/276: chown d4/d1a/l4d 289737 1 2024-09-18T12:49:14.200 INFO:tasks.workunit.client.1.smithi148.stdout:7/492: mknod db/dc/df/d11/d34/d69/c8a 0 2024-09-18T12:49:14.201 INFO:tasks.workunit.client.1.smithi148.stdout:0/635: truncate de/d14/f1f 2142196 0 2024-09-18T12:49:14.201 INFO:tasks.workunit.client.1.smithi148.stdout:8/529: dwrite d8/df/f10 [0,4194304] 0 2024-09-18T12:49:14.201 INFO:tasks.workunit.client.0.smithi078.stdout:0/406: symlink d3/d1f/d2e/d68/d30/l94 0 2024-09-18T12:49:14.203 INFO:tasks.workunit.client.1.smithi148.stdout:7/493: write db/dc/d70/d75/f56 [2894494,83367] 0 2024-09-18T12:49:14.204 INFO:tasks.workunit.client.0.smithi078.stdout:3/304: mkdir d9/d2f/d43/d62 0 2024-09-18T12:49:14.205 INFO:tasks.workunit.client.1.smithi148.stdout:4/426: dread d15/d17/f19 [0,4194304] 0 2024-09-18T12:49:14.206 INFO:tasks.workunit.client.1.smithi148.stdout:9/443: fsync d8/d6f/f80 0 2024-09-18T12:49:14.207 INFO:tasks.workunit.client.1.smithi148.stdout:9/444: dread - d8/da/dd/d3f/f7f zero size 2024-09-18T12:49:14.207 INFO:tasks.workunit.client.0.smithi078.stdout:8/290: creat d0/d7/f55 x:0 0 0 2024-09-18T12:49:14.208 INFO:tasks.workunit.client.0.smithi078.stdout:8/291: stat d0/f1a 0 2024-09-18T12:49:14.212 INFO:tasks.workunit.client.0.smithi078.stdout:2/277: mkdir d4/dd/d18/d3b/d55 0 2024-09-18T12:49:14.217 INFO:tasks.workunit.client.0.smithi078.stdout:8/292: dwrite d0/f1c [4194304,4194304] 0 2024-09-18T12:49:14.218 INFO:tasks.workunit.client.0.smithi078.stdout:4/273: getdents d11 0 2024-09-18T12:49:14.219 INFO:tasks.workunit.client.0.smithi078.stdout:4/274: fsync d11/f44 0 2024-09-18T12:49:14.221 INFO:tasks.workunit.client.1.smithi148.stdout:3/432: truncate d4/d8/d1e/d6b/f4a 1717525 0 2024-09-18T12:49:14.222 INFO:tasks.workunit.client.1.smithi148.stdout:1/445: creat dc/d18/d63/f94 x:0 0 0 2024-09-18T12:49:14.223 INFO:tasks.workunit.client.0.smithi078.stdout:3/305: dread d9/d2f/f3d [0,4194304] 0 2024-09-18T12:49:14.226 INFO:tasks.workunit.client.1.smithi148.stdout:4/427: dread d15/d5f/d77/d4c/d4f/f33 [0,4194304] 0 2024-09-18T12:49:14.230 INFO:tasks.workunit.client.1.smithi148.stdout:8/530: symlink d8/d12/d46/lb5 0 2024-09-18T12:49:14.232 INFO:tasks.workunit.client.1.smithi148.stdout:7/494: creat db/dc/df/d2c/d55/f8b x:0 0 0 2024-09-18T12:49:14.233 INFO:tasks.workunit.client.1.smithi148.stdout:7/495: chown db/d52/d1f/c2b 252 1 2024-09-18T12:49:14.238 INFO:tasks.workunit.client.1.smithi148.stdout:5/503: link d7/d8/dc/c57 d7/d8/dc/d12/d31/d5a/ca5 0 2024-09-18T12:49:14.238 INFO:tasks.workunit.client.1.smithi148.stdout:0/636: write de/f11 [591485,4252] 0 2024-09-18T12:49:14.241 INFO:tasks.workunit.client.1.smithi148.stdout:0/637: dread de/f9b [0,4194304] 0 2024-09-18T12:49:14.242 INFO:tasks.workunit.client.0.smithi078.stdout:3/306: mkdir d9/d13/d63 0 2024-09-18T12:49:14.244 INFO:tasks.workunit.client.1.smithi148.stdout:1/446: readlink dc/l2c 0 2024-09-18T12:49:14.245 INFO:tasks.workunit.client.0.smithi078.stdout:5/419: dwrite d2/d4/d9/d49/f56 [0,4194304] 0 2024-09-18T12:49:14.247 INFO:tasks.workunit.client.0.smithi078.stdout:2/278: link d4/d1a/f30 d4/d8/d23/f56 0 2024-09-18T12:49:14.247 INFO:tasks.workunit.client.0.smithi078.stdout:5/420: write d2/d4/d9/da/f5a [946740,15615] 0 2024-09-18T12:49:14.250 INFO:tasks.workunit.client.0.smithi078.stdout:4/275: mkdir d11/d27/d5a/d5d 0 2024-09-18T12:49:14.251 INFO:tasks.workunit.client.1.smithi148.stdout:7/496: symlink db/d52/d4f/l8c 0 2024-09-18T12:49:14.253 INFO:tasks.workunit.client.0.smithi078.stdout:6/468: link d10/d2b/d43/l81 d10/d2b/d43/d53/d63/d70/d7d/l98 0 2024-09-18T12:49:14.257 INFO:tasks.workunit.client.0.smithi078.stdout:8/293: write d0/d7/f24 [197557,121862] 0 2024-09-18T12:49:14.258 INFO:tasks.workunit.client.1.smithi148.stdout:9/445: symlink d8/da/dd/d35/d47/d62/l87 0 2024-09-18T12:49:14.259 INFO:tasks.workunit.client.1.smithi148.stdout:0/638: dread de/d27/d53/d89/dbb/f50 [0,4194304] 0 2024-09-18T12:49:14.260 INFO:tasks.workunit.client.1.smithi148.stdout:0/639: write de/d14/f28 [2547519,108367] 0 2024-09-18T12:49:14.262 INFO:tasks.workunit.client.0.smithi078.stdout:5/421: mkdir d2/d4/d48/d86 0 2024-09-18T12:49:14.263 INFO:tasks.workunit.client.1.smithi148.stdout:6/479: getdents d5/d1a/d29 0 2024-09-18T12:49:14.265 INFO:tasks.workunit.client.0.smithi078.stdout:4/276: creat d11/d27/d5a/f5e x:0 0 0 2024-09-18T12:49:14.265 INFO:tasks.workunit.client.1.smithi148.stdout:2/398: creat d9/d24/d31/f8a x:0 0 0 2024-09-18T12:49:14.267 INFO:tasks.workunit.client.0.smithi078.stdout:4/277: write d11/f14 [4931343,44250] 0 2024-09-18T12:49:14.267 INFO:tasks.workunit.client.0.smithi078.stdout:6/469: symlink d10/d2b/d37/l99 0 2024-09-18T12:49:14.270 INFO:tasks.workunit.client.1.smithi148.stdout:3/433: unlink d4/c37 0 2024-09-18T12:49:14.272 INFO:tasks.workunit.client.0.smithi078.stdout:5/422: dwrite d2/d4/f7e [0,4194304] 0 2024-09-18T12:49:14.275 INFO:tasks.workunit.client.0.smithi078.stdout:1/290: sync 2024-09-18T12:49:14.275 INFO:tasks.workunit.client.0.smithi078.stdout:5/423: read d2/d4/d9/d49/f7d [155810,75250] 0 2024-09-18T12:49:14.276 INFO:tasks.workunit.client.0.smithi078.stdout:1/291: dread - d0/d8/da/d3e/d50/f54 zero size 2024-09-18T12:49:14.277 INFO:tasks.workunit.client.0.smithi078.stdout:6/470: dwrite d10/d2b/d37/f59 [0,4194304] 0 2024-09-18T12:49:14.279 INFO:tasks.workunit.client.0.smithi078.stdout:5/424: dread - d2/d4/d9/da/d60/d61/f75 zero size 2024-09-18T12:49:14.280 INFO:tasks.workunit.client.1.smithi148.stdout:8/531: symlink d8/lb6 0 2024-09-18T12:49:14.281 INFO:tasks.workunit.client.1.smithi148.stdout:7/497: creat db/dc/df/d11/d34/f8d x:0 0 0 2024-09-18T12:49:14.284 INFO:tasks.workunit.client.1.smithi148.stdout:7/498: read db/dc/df/d1d/f21 [1074821,82726] 0 2024-09-18T12:49:14.284 INFO:tasks.workunit.client.1.smithi148.stdout:7/499: chown db/dc/df/d11/f6b 4530331 1 2024-09-18T12:49:14.290 INFO:tasks.workunit.client.0.smithi078.stdout:2/279: dwrite d4/d8/d23/f56 [0,4194304] 0 2024-09-18T12:49:14.291 INFO:tasks.workunit.client.1.smithi148.stdout:0/640: readlink de/d14/l4a 0 2024-09-18T12:49:14.292 INFO:tasks.workunit.client.0.smithi078.stdout:5/425: dread d2/d4/d12/d16/d36/f5c [0,4194304] 0 2024-09-18T12:49:14.293 INFO:tasks.workunit.client.0.smithi078.stdout:6/471: fdatasync d10/d2b/d43/d53/d45/d55/f2d 0 2024-09-18T12:49:14.294 INFO:tasks.workunit.client.0.smithi078.stdout:5/426: dread - d2/d4/f78 zero size 2024-09-18T12:49:14.296 INFO:tasks.workunit.client.1.smithi148.stdout:6/480: mknod d5/d1a/dc/d2b/c98 0 2024-09-18T12:49:14.296 INFO:tasks.workunit.client.0.smithi078.stdout:3/307: link d9/df/l2e d9/d2f/l64 0 2024-09-18T12:49:14.296 INFO:tasks.workunit.client.0.smithi078.stdout:6/472: chown d10/d2b/d43/d53/f56 57 1 2024-09-18T12:49:14.297 INFO:tasks.workunit.client.1.smithi148.stdout:2/399: symlink d9/d4a/d64/l8b 0 2024-09-18T12:49:14.297 INFO:tasks.workunit.client.0.smithi078.stdout:3/308: read - d9/d13/f5f zero size 2024-09-18T12:49:14.298 INFO:tasks.workunit.client.0.smithi078.stdout:2/280: unlink d4/d1a/c26 0 2024-09-18T12:49:14.299 INFO:tasks.workunit.client.0.smithi078.stdout:2/281: fsync d4/dd/d18/d33/f48 0 2024-09-18T12:49:14.310 INFO:tasks.workunit.client.1.smithi148.stdout:8/532: dread d8/d16/d53/d39/f3d [0,4194304] 0 2024-09-18T12:49:14.379 INFO:tasks.workunit.client.1.smithi148.stdout:3/434: symlink d4/d8/d20/d2b/d7f/d93/l9f 0 2024-09-18T12:49:14.380 INFO:tasks.workunit.client.1.smithi148.stdout:3/435: dread - d4/d8/d20/d2b/d43/f97 zero size 2024-09-18T12:49:14.380 INFO:tasks.workunit.client.0.smithi078.stdout:1/292: mkdir d0/d5b 0 2024-09-18T12:49:14.386 INFO:tasks.workunit.client.1.smithi148.stdout:5/504: truncate d7/d8/dc/f2a 558546 0 2024-09-18T12:49:14.386 INFO:tasks.workunit.client.1.smithi148.stdout:5/505: readlink l5 0 2024-09-18T12:49:14.387 INFO:tasks.workunit.client.1.smithi148.stdout:5/506: dread - d7/d8/dc/d12/d1f/d69/d8b/f95 zero size 2024-09-18T12:49:14.388 INFO:tasks.workunit.client.0.smithi078.stdout:4/278: dwrite d11/d1f/d40/f41 [0,4194304] 0 2024-09-18T12:49:14.389 INFO:tasks.workunit.client.1.smithi148.stdout:9/446: mknod d8/da/dd/d35/c88 0 2024-09-18T12:49:14.389 INFO:tasks.workunit.client.0.smithi078.stdout:1/293: dwrite d0/d8/da/f35 [0,4194304] 0 2024-09-18T12:49:14.390 INFO:tasks.workunit.client.1.smithi148.stdout:9/447: write d8/f22 [3048639,93896] 0 2024-09-18T12:49:14.391 INFO:tasks.workunit.client.0.smithi078.stdout:1/294: truncate d0/d37/f57 1017969 0 2024-09-18T12:49:14.394 INFO:tasks.workunit.client.0.smithi078.stdout:6/473: symlink d10/d2b/d43/d53/d63/d70/d7d/l9a 0 2024-09-18T12:49:14.398 INFO:tasks.workunit.client.1.smithi148.stdout:9/448: dwrite d8/da/dd/d4a/f15 [4194304,4194304] 0 2024-09-18T12:49:14.398 INFO:tasks.workunit.client.0.smithi078.stdout:2/282: unlink d4/d20/f44 0 2024-09-18T12:49:14.399 INFO:tasks.workunit.client.0.smithi078.stdout:2/283: write d4/d8/f50 [928837,17534] 0 2024-09-18T12:49:14.400 INFO:tasks.workunit.client.1.smithi148.stdout:1/447: truncate dc/f13 663165 0 2024-09-18T12:49:14.401 INFO:tasks.workunit.client.1.smithi148.stdout:9/449: dread - d8/da/dd/d35/d59/f69 zero size 2024-09-18T12:49:14.401 INFO:tasks.workunit.client.1.smithi148.stdout:2/400: rename d9/d73/f7e to d9/d73/f8c 0 2024-09-18T12:49:14.403 INFO:tasks.workunit.client.1.smithi148.stdout:8/533: readlink d8/df/l22 0 2024-09-18T12:49:14.407 INFO:tasks.workunit.client.0.smithi078.stdout:5/427: write d2/d4/d9/f2a [894364,101919] 0 2024-09-18T12:49:14.410 INFO:tasks.workunit.client.1.smithi148.stdout:4/428: getdents d15/d5f/d77/d4c/d4f/d64 0 2024-09-18T12:49:14.411 INFO:tasks.workunit.client.1.smithi148.stdout:4/429: fdatasync d15/d5f/d77/d4c/f57 0 2024-09-18T12:49:14.411 INFO:tasks.workunit.client.0.smithi078.stdout:3/309: mknod d9/d54/c65 0 2024-09-18T12:49:14.412 INFO:tasks.workunit.client.1.smithi148.stdout:5/507: mkdir d7/d8/dc/da6 0 2024-09-18T12:49:14.414 INFO:tasks.workunit.client.0.smithi078.stdout:4/279: creat d11/d27/d47/f5f x:0 0 0 2024-09-18T12:49:14.415 INFO:tasks.workunit.client.0.smithi078.stdout:4/280: chown d11/f16 147 1 2024-09-18T12:49:14.416 INFO:tasks.workunit.client.1.smithi148.stdout:4/430: dwrite d15/d5f/d77/d4c/f57 [0,4194304] 0 2024-09-18T12:49:14.417 INFO:tasks.workunit.client.0.smithi078.stdout:8/294: write d0/d7/dc/d1f/d23/d29/d2e/f3a [480364,37906] 0 2024-09-18T12:49:14.419 INFO:tasks.workunit.client.0.smithi078.stdout:1/295: symlink d0/d8/da/d3e/d50/l5c 0 2024-09-18T12:49:14.420 INFO:tasks.workunit.client.0.smithi078.stdout:1/296: write d0/d8/f14 [1581687,86141] 0 2024-09-18T12:49:14.422 INFO:tasks.workunit.client.0.smithi078.stdout:1/297: chown d0/d37/f48 4185517 1 2024-09-18T12:49:14.422 INFO:tasks.workunit.client.0.smithi078.stdout:6/474: mknod d10/d2b/d43/d53/d45/d55/d3f/c9b 0 2024-09-18T12:49:14.423 INFO:tasks.workunit.client.0.smithi078.stdout:6/475: write d10/f24 [521236,44952] 0 2024-09-18T12:49:14.425 INFO:tasks.workunit.client.0.smithi078.stdout:4/281: fsync d11/d27/d47/f5f 0 2024-09-18T12:49:14.426 INFO:tasks.workunit.client.1.smithi148.stdout:6/481: mkdir d5/d1a/dc/d2b/d35/d65/d99 0 2024-09-18T12:49:14.426 INFO:tasks.workunit.client.0.smithi078.stdout:4/282: stat d11/d27/d47/d4e/d50/c53 0 2024-09-18T12:49:14.427 INFO:tasks.workunit.client.1.smithi148.stdout:6/482: chown d5/ff 12952 1 2024-09-18T12:49:14.429 INFO:tasks.workunit.client.0.smithi078.stdout:3/310: creat d9/d13/d33/d3c/f66 x:0 0 0 2024-09-18T12:49:14.430 INFO:tasks.workunit.client.1.smithi148.stdout:9/450: symlink d8/d6f/l89 0 2024-09-18T12:49:14.432 INFO:tasks.workunit.client.1.smithi148.stdout:3/436: mknod d4/d8/d20/d2b/d43/d61/d8b/ca0 0 2024-09-18T12:49:14.433 INFO:tasks.workunit.client.1.smithi148.stdout:1/448: dwrite dc/d18/f3d [0,4194304] 0 2024-09-18T12:49:14.435 INFO:tasks.workunit.client.0.smithi078.stdout:9/243: sync 2024-09-18T12:49:14.436 INFO:tasks.workunit.client.1.smithi148.stdout:3/437: dread d4/f89 [0,4194304] 0 2024-09-18T12:49:14.437 INFO:tasks.workunit.client.1.smithi148.stdout:3/438: write d4/d8/d20/f3f [122644,14693] 0 2024-09-18T12:49:14.437 INFO:tasks.workunit.client.1.smithi148.stdout:3/439: dread - d4/d8/d1e/f91 zero size 2024-09-18T12:49:14.438 INFO:tasks.workunit.client.1.smithi148.stdout:3/440: readlink d4/ld 0 2024-09-18T12:49:14.440 INFO:tasks.workunit.client.1.smithi148.stdout:3/441: dread d4/d8/d1e/d6b/d31/d54/f8a [0,4194304] 0 2024-09-18T12:49:14.444 INFO:tasks.workunit.client.1.smithi148.stdout:5/508: truncate d7/d8/f83 466643 0 2024-09-18T12:49:14.448 INFO:tasks.workunit.client.0.smithi078.stdout:4/283: mkdir d11/d27/d60 0 2024-09-18T12:49:14.449 INFO:tasks.workunit.client.0.smithi078.stdout:5/428: creat d2/d4/d48/d86/f87 x:0 0 0 2024-09-18T12:49:14.450 INFO:tasks.workunit.client.1.smithi148.stdout:7/500: rename db/dc/d70 to db/dc/df/d8e 0 2024-09-18T12:49:14.451 INFO:tasks.workunit.client.1.smithi148.stdout:7/501: write db/dc/df/d2c/f7e [3083030,29813] 0 2024-09-18T12:49:14.451 INFO:tasks.workunit.client.1.smithi148.stdout:6/483: rmdir d5/d1a/d29 39 2024-09-18T12:49:14.452 INFO:tasks.workunit.client.0.smithi078.stdout:1/298: mknod d0/d8/da/d3e/d58/c5d 0 2024-09-18T12:49:14.453 INFO:tasks.workunit.client.1.smithi148.stdout:8/534: creat d8/d16/d53/da0/fb7 x:0 0 0 2024-09-18T12:49:14.454 INFO:tasks.workunit.client.0.smithi078.stdout:6/476: mkdir d10/d2b/d43/d53/d45/d9c 0 2024-09-18T12:49:14.456 INFO:tasks.workunit.client.0.smithi078.stdout:4/284: creat d11/f61 x:0 0 0 2024-09-18T12:49:14.457 INFO:tasks.workunit.client.1.smithi148.stdout:9/451: chown d8/da/dd/d4a/d49/d46 2230651 1 2024-09-18T12:49:14.458 INFO:tasks.workunit.client.1.smithi148.stdout:9/452: chown d8/da/dd/d4a/f15 88660 1 2024-09-18T12:49:14.459 INFO:tasks.workunit.client.0.smithi078.stdout:3/311: symlink d9/d13/d33/l67 0 2024-09-18T12:49:14.460 INFO:tasks.workunit.client.1.smithi148.stdout:1/449: chown dc/d18/l66 230194 1 2024-09-18T12:49:14.461 INFO:tasks.workunit.client.1.smithi148.stdout:9/453: read d8/da/dd/d4a/f2d [917727,80724] 0 2024-09-18T12:49:14.461 INFO:tasks.workunit.client.0.smithi078.stdout:9/244: symlink d5/d7/d8/l4c 0 2024-09-18T12:49:14.462 INFO:tasks.workunit.client.0.smithi078.stdout:6/477: dwrite d10/d2b/d43/d53/d63/d70/d77/f78 [0,4194304] 0 2024-09-18T12:49:14.463 INFO:tasks.workunit.client.0.smithi078.stdout:9/245: fdatasync d5/d7/d32/d2a/f4b 0 2024-09-18T12:49:14.463 INFO:tasks.workunit.client.0.smithi078.stdout:9/246: stat d5/d7 0 2024-09-18T12:49:14.464 INFO:tasks.workunit.client.0.smithi078.stdout:9/247: dread - d5/d7/d32/f30 zero size 2024-09-18T12:49:14.465 INFO:tasks.workunit.client.0.smithi078.stdout:9/248: fsync d5/d7/f39 0 2024-09-18T12:49:14.466 INFO:tasks.workunit.client.1.smithi148.stdout:5/509: creat d7/d8/dc/d12/d1f/d25/fa7 x:0 0 0 2024-09-18T12:49:14.470 INFO:tasks.workunit.client.1.smithi148.stdout:8/535: dread d8/d16/d53/d39/d3b/f63 [0,4194304] 0 2024-09-18T12:49:14.471 INFO:tasks.workunit.client.1.smithi148.stdout:4/431: mkdir d15/d90 0 2024-09-18T12:49:14.472 INFO:tasks.workunit.client.1.smithi148.stdout:4/432: write f9 [4109906,5635] 0 2024-09-18T12:49:14.477 INFO:tasks.workunit.client.1.smithi148.stdout:6/484: write d5/f19 [283045,69726] 0 2024-09-18T12:49:14.478 INFO:tasks.workunit.client.0.smithi078.stdout:8/295: getdents d0/d7 0 2024-09-18T12:49:14.479 INFO:tasks.workunit.client.1.smithi148.stdout:8/536: dwrite d8/d16/f9d [0,4194304] 0 2024-09-18T12:49:14.479 INFO:tasks.workunit.client.1.smithi148.stdout:1/450: dread f6 [0,4194304] 0 2024-09-18T12:49:14.480 INFO:tasks.workunit.client.0.smithi078.stdout:3/312: creat d9/d54/f68 x:0 0 0 2024-09-18T12:49:14.480 INFO:tasks.workunit.client.0.smithi078.stdout:1/299: write d0/d8/da/f17 [258323,48079] 0 2024-09-18T12:49:14.481 INFO:tasks.workunit.client.0.smithi078.stdout:3/313: dread - d9/d54/f68 zero size 2024-09-18T12:49:14.483 INFO:tasks.workunit.client.1.smithi148.stdout:0/641: sync 2024-09-18T12:49:14.485 INFO:tasks.workunit.client.1.smithi148.stdout:3/442: dread d4/d8/f23 [0,4194304] 0 2024-09-18T12:49:14.485 INFO:tasks.workunit.client.0.smithi078.stdout:5/429: truncate d2/d4/f7e 756691 0 2024-09-18T12:49:14.486 INFO:tasks.workunit.client.1.smithi148.stdout:3/443: fdatasync d4/f76 0 2024-09-18T12:49:14.487 INFO:tasks.workunit.client.0.smithi078.stdout:9/249: mknod d5/d7/d32/c4d 0 2024-09-18T12:49:14.488 INFO:tasks.workunit.client.1.smithi148.stdout:9/454: symlink d8/da/dd/d4a/d49/d46/d54/l8a 0 2024-09-18T12:49:14.489 INFO:tasks.workunit.client.0.smithi078.stdout:1/300: dwrite d0/d8/ff [0,4194304] 0 2024-09-18T12:49:14.492 INFO:tasks.workunit.client.0.smithi078.stdout:4/285: readlink d11/d1f/l31 0 2024-09-18T12:49:14.493 INFO:tasks.workunit.client.0.smithi078.stdout:1/301: readlink d0/d8/da/l1e 0 2024-09-18T12:49:14.493 INFO:tasks.workunit.client.0.smithi078.stdout:5/430: read d2/d4/d9/f2a [1672523,76942] 0 2024-09-18T12:49:14.493 INFO:tasks.workunit.client.0.smithi078.stdout:8/296: mknod d0/d7/dc/c56 0 2024-09-18T12:49:14.493 INFO:tasks.workunit.client.1.smithi148.stdout:5/510: chown d7/d8/dc/d12/l60 13726 1 2024-09-18T12:49:14.494 INFO:tasks.workunit.client.1.smithi148.stdout:4/433: chown d15/d5f/d77/c38 45872531 1 2024-09-18T12:49:14.494 INFO:tasks.workunit.client.0.smithi078.stdout:3/314: chown d9/d2f/c40 26599374 1 2024-09-18T12:49:14.494 INFO:tasks.workunit.client.0.smithi078.stdout:6/478: mknod d10/d2b/d43/d53/d45/d9c/c9d 0 2024-09-18T12:49:14.497 INFO:tasks.workunit.client.1.smithi148.stdout:8/537: mkdir d8/df/d66/db8 0 2024-09-18T12:49:14.499 INFO:tasks.workunit.client.1.smithi148.stdout:2/401: link d9/f1e d9/d3a/f8d 0 2024-09-18T12:49:14.501 INFO:tasks.workunit.client.0.smithi078.stdout:8/297: rmdir d0/d7/dc/d1f/d23/d40 39 2024-09-18T12:49:14.503 INFO:tasks.workunit.client.0.smithi078.stdout:8/298: stat d0/d7/dc/d1f/d23/f48 0 2024-09-18T12:49:14.504 INFO:tasks.workunit.client.1.smithi148.stdout:3/444: creat d4/d8/d20/d2b/d43/d61/fa1 x:0 0 0 2024-09-18T12:49:14.505 INFO:tasks.workunit.client.1.smithi148.stdout:0/642: dread de/f24 [0,4194304] 0 2024-09-18T12:49:14.505 INFO:tasks.workunit.client.0.smithi078.stdout:6/479: rename ff to d10/d2b/d61/f9e 0 2024-09-18T12:49:14.509 INFO:tasks.workunit.client.1.smithi148.stdout:7/502: creat db/dc/df/f8f x:0 0 0 2024-09-18T12:49:14.509 INFO:tasks.workunit.client.0.smithi078.stdout:4/286: mknod d11/d27/d47/c62 0 2024-09-18T12:49:14.511 INFO:tasks.workunit.client.0.smithi078.stdout:1/302: fdatasync d0/d37/f3c 0 2024-09-18T12:49:14.511 INFO:tasks.workunit.client.1.smithi148.stdout:7/503: read db/dc/f28 [2223967,30895] 0 2024-09-18T12:49:14.512 INFO:tasks.workunit.client.0.smithi078.stdout:1/303: chown d0/d8/da/f40 1632523 1 2024-09-18T12:49:14.514 INFO:tasks.workunit.client.1.smithi148.stdout:1/451: rename dc/d18/d31/l34 to dc/d4d/l95 0 2024-09-18T12:49:14.516 INFO:tasks.workunit.client.0.smithi078.stdout:3/315: mknod d9/d13/d63/c69 0 2024-09-18T12:49:14.517 INFO:tasks.workunit.client.1.smithi148.stdout:1/452: dread f8 [0,4194304] 0 2024-09-18T12:49:14.518 INFO:tasks.workunit.client.1.smithi148.stdout:1/453: dread - dc/d11/d38/d87/d2b/f86 zero size 2024-09-18T12:49:14.518 INFO:tasks.workunit.client.0.smithi078.stdout:3/316: write d9/d13/d33/d34/f4f [110606,12391] 0 2024-09-18T12:49:14.519 INFO:tasks.workunit.client.0.smithi078.stdout:3/317: chown d9/d13/d33/d4e/f25 3985593 1 2024-09-18T12:49:14.520 INFO:tasks.workunit.client.0.smithi078.stdout:3/318: chown d9/d2f/l5c 2694342 1 2024-09-18T12:49:14.522 INFO:tasks.workunit.client.0.smithi078.stdout:8/299: rename d0/d4e to d0/d7/d53/d57 0 2024-09-18T12:49:14.528 INFO:tasks.workunit.client.1.smithi148.stdout:5/511: fdatasync d7/d8/dc/f5d 0 2024-09-18T12:49:14.532 INFO:tasks.workunit.client.0.smithi078.stdout:1/304: symlink d0/d8/da/l5e 0 2024-09-18T12:49:14.533 INFO:tasks.workunit.client.1.smithi148.stdout:4/434: symlink d15/d5f/d77/d4c/d4f/l91 0 2024-09-18T12:49:14.534 INFO:tasks.workunit.client.1.smithi148.stdout:4/435: write d15/d17/f19 [2867537,7940] 0 2024-09-18T12:49:14.534 INFO:tasks.workunit.client.1.smithi148.stdout:4/436: stat d15/d5f/d77/l39 0 2024-09-18T12:49:14.536 INFO:tasks.workunit.client.0.smithi078.stdout:3/319: symlink d9/d29/l6a 0 2024-09-18T12:49:14.538 INFO:tasks.workunit.client.0.smithi078.stdout:3/320: write d9/f3f [190955,124080] 0 2024-09-18T12:49:14.539 INFO:tasks.workunit.client.0.smithi078.stdout:5/431: write d2/d4/f7e [713824,100112] 0 2024-09-18T12:49:14.541 INFO:tasks.workunit.client.1.smithi148.stdout:1/454: mkdir dc/d11/d96 0 2024-09-18T12:49:14.543 INFO:tasks.workunit.client.0.smithi078.stdout:8/300: rmdir d0/d7/dc/d1f/d23/d29 39 2024-09-18T12:49:14.543 INFO:tasks.workunit.client.0.smithi078.stdout:9/250: dwrite d5/d7/d8/f1a [0,4194304] 0 2024-09-18T12:49:14.544 INFO:tasks.workunit.client.0.smithi078.stdout:5/432: write d2/d4/d12/d16/d36/d4c/d62/f84 [462812,49522] 0 2024-09-18T12:49:14.544 INFO:tasks.workunit.client.0.smithi078.stdout:7/217: sync 2024-09-18T12:49:14.545 INFO:tasks.workunit.client.1.smithi148.stdout:3/445: symlink d4/d8/d20/d2b/la2 0 2024-09-18T12:49:14.547 INFO:tasks.workunit.client.1.smithi148.stdout:0/643: write de/d27/f8a [2474983,88804] 0 2024-09-18T12:49:14.547 INFO:tasks.workunit.client.0.smithi078.stdout:5/433: fdatasync d2/d4/d9/da/d60/d61/f75 0 2024-09-18T12:49:14.548 INFO:tasks.workunit.client.1.smithi148.stdout:2/402: dwrite d9/d24/d31/d34/d42/f44 [0,4194304] 0 2024-09-18T12:49:14.549 INFO:tasks.workunit.client.1.smithi148.stdout:0/644: readlink de/d14/d43/d57/la2 0 2024-09-18T12:49:14.550 INFO:tasks.workunit.client.1.smithi148.stdout:2/403: dread - d9/d3a/f86 zero size 2024-09-18T12:49:14.550 INFO:tasks.workunit.client.0.smithi078.stdout:5/434: write d2/d4/d9/da/f7a [182269,58160] 0 2024-09-18T12:49:14.551 INFO:tasks.workunit.client.1.smithi148.stdout:2/404: fsync d9/d3a/f55 0 2024-09-18T12:49:14.553 INFO:tasks.workunit.client.1.smithi148.stdout:2/405: chown d9/d4a 9980908 1 2024-09-18T12:49:14.555 INFO:tasks.workunit.client.0.smithi078.stdout:6/480: truncate d10/d2b/d43/f50 805252 0 2024-09-18T12:49:14.555 INFO:tasks.workunit.client.0.smithi078.stdout:1/305: dread d0/d8/f14 [0,4194304] 0 2024-09-18T12:49:14.556 INFO:tasks.workunit.client.0.smithi078.stdout:5/435: chown d2/d4/d12/d16/d36/f5c 60059981 1 2024-09-18T12:49:14.558 INFO:tasks.workunit.client.0.smithi078.stdout:3/321: write d9/d2f/f38 [460576,76593] 0 2024-09-18T12:49:14.559 INFO:tasks.workunit.client.1.smithi148.stdout:4/437: dread d15/d17/f42 [0,4194304] 0 2024-09-18T12:49:14.562 INFO:tasks.workunit.client.0.smithi078.stdout:9/251: dwrite d5/d7/d32/d2a/d36/f43 [0,4194304] 0 2024-09-18T12:49:14.563 INFO:tasks.workunit.client.0.smithi078.stdout:6/481: write d10/f1e [3519434,75] 0 2024-09-18T12:49:14.563 INFO:tasks.workunit.client.0.smithi078.stdout:7/218: rename d7/d26/l39 to d7/d9/d32/l46 0 2024-09-18T12:49:14.564 INFO:tasks.workunit.client.0.smithi078.stdout:9/252: write d5/d7/f1e [1618045,123306] 0 2024-09-18T12:49:14.565 INFO:tasks.workunit.client.0.smithi078.stdout:4/287: creat d11/d1f/f63 x:0 0 0 2024-09-18T12:49:14.570 INFO:tasks.workunit.client.1.smithi148.stdout:9/455: getdents d8/da/dd/d4a/d49 0 2024-09-18T12:49:14.571 INFO:tasks.workunit.client.0.smithi078.stdout:1/306: creat d0/d8/da/f5f x:0 0 0 2024-09-18T12:49:14.572 INFO:tasks.workunit.client.1.smithi148.stdout:0/645: creat de/d27/fdb x:0 0 0 2024-09-18T12:49:14.573 INFO:tasks.workunit.client.0.smithi078.stdout:9/253: dread d5/d7/d32/d2a/f3d [0,4194304] 0 2024-09-18T12:49:14.574 INFO:tasks.workunit.client.0.smithi078.stdout:5/436: creat d2/d4/d48/f88 x:0 0 0 2024-09-18T12:49:14.576 INFO:tasks.workunit.client.0.smithi078.stdout:9/254: fsync d5/d7/f2b 0 2024-09-18T12:49:14.578 INFO:tasks.workunit.client.0.smithi078.stdout:4/288: dwrite d11/f61 [0,4194304] 0 2024-09-18T12:49:14.581 INFO:tasks.workunit.client.0.smithi078.stdout:9/255: chown d5/d7/d32/d2a/f4b 169 1 2024-09-18T12:49:14.585 INFO:tasks.workunit.client.0.smithi078.stdout:1/307: dwrite d0/d8/da/f35 [0,4194304] 0 2024-09-18T12:49:14.586 INFO:tasks.workunit.client.0.smithi078.stdout:1/308: chown d0/d8/f38 13832 1 2024-09-18T12:49:14.586 INFO:tasks.workunit.client.0.smithi078.stdout:0/407: sync 2024-09-18T12:49:14.586 INFO:tasks.workunit.client.0.smithi078.stdout:2/284: sync 2024-09-18T12:49:14.587 INFO:tasks.workunit.client.1.smithi148.stdout:6/485: link d5/d1a/d29/l82 d5/d1a/dc/d2b/d35/l9a 0 2024-09-18T12:49:14.588 INFO:tasks.workunit.client.1.smithi148.stdout:6/486: stat d5/d1a/dc/c88 0 2024-09-18T12:49:14.590 INFO:tasks.workunit.client.0.smithi078.stdout:6/482: rmdir d10/d2b/d43/d53/d63 39 2024-09-18T12:49:14.591 INFO:tasks.workunit.client.0.smithi078.stdout:1/309: dread d0/f4b [4194304,4194304] 0 2024-09-18T12:49:14.595 INFO:tasks.workunit.client.1.smithi148.stdout:7/504: rename db/c3b to db/c90 0 2024-09-18T12:49:14.595 INFO:tasks.workunit.client.0.smithi078.stdout:1/310: dread d0/d8/da/f35 [0,4194304] 0 2024-09-18T12:49:14.597 INFO:tasks.workunit.client.0.smithi078.stdout:1/311: truncate d0/d8/da/d3e/d46/f5a 724590 0 2024-09-18T12:49:14.597 INFO:tasks.workunit.client.0.smithi078.stdout:1/312: readlink d0/d8/da/l1e 0 2024-09-18T12:49:14.598 INFO:tasks.workunit.client.0.smithi078.stdout:1/313: chown d0/d8/da/d45/l4e 36402 1 2024-09-18T12:49:14.598 INFO:tasks.workunit.client.1.smithi148.stdout:3/446: symlink d4/d8/d1e/d63/d9b/la3 0 2024-09-18T12:49:14.599 INFO:tasks.workunit.client.0.smithi078.stdout:1/314: truncate d0/d37/f59 120961 0 2024-09-18T12:49:14.600 INFO:tasks.workunit.client.1.smithi148.stdout:5/512: write d7/d8/f3e [2907427,14764] 0 2024-09-18T12:49:14.602 INFO:tasks.workunit.client.1.smithi148.stdout:9/456: rename d8/d33/l43 to d8/da/dd/l8b 0 2024-09-18T12:49:14.602 INFO:tasks.workunit.client.1.smithi148.stdout:9/457: chown d8/da 12 1 2024-09-18T12:49:14.604 INFO:tasks.workunit.client.0.smithi078.stdout:4/289: creat d11/d27/d5a/f64 x:0 0 0 2024-09-18T12:49:14.607 INFO:tasks.workunit.client.0.smithi078.stdout:7/219: mkdir d7/d3c/d47 0 2024-09-18T12:49:14.608 INFO:tasks.workunit.client.1.smithi148.stdout:6/487: mkdir d5/d1a/dc/d2b/d9b 0 2024-09-18T12:49:14.610 INFO:tasks.workunit.client.1.smithi148.stdout:7/505: mkdir db/dc/d91 0 2024-09-18T12:49:14.613 INFO:tasks.workunit.client.0.smithi078.stdout:0/408: creat d3/d1f/d2e/d8f/f95 x:0 0 0 2024-09-18T12:49:14.614 INFO:tasks.workunit.client.1.smithi148.stdout:6/488: dwrite d5/d1a/f37 [4194304,4194304] 0 2024-09-18T12:49:14.615 INFO:tasks.workunit.client.1.smithi148.stdout:6/489: stat d5/d1a/dc/d2b/d35/d65/l4f 0 2024-09-18T12:49:14.616 INFO:tasks.workunit.client.1.smithi148.stdout:2/406: write d9/ff [1110825,81228] 0 2024-09-18T12:49:14.616 INFO:tasks.workunit.client.1.smithi148.stdout:5/513: truncate d7/d8/dc/d12/d31/f50 277691 0 2024-09-18T12:49:14.617 INFO:tasks.workunit.client.1.smithi148.stdout:6/490: chown d5/d1a/dc/d2b/d9b 229284 1 2024-09-18T12:49:14.618 INFO:tasks.workunit.client.1.smithi148.stdout:2/407: dread - d9/d24/d47/f87 zero size 2024-09-18T12:49:14.619 INFO:tasks.workunit.client.0.smithi078.stdout:3/322: dwrite d9/d29/f24 [4194304,4194304] 0 2024-09-18T12:49:14.619 INFO:tasks.workunit.client.0.smithi078.stdout:6/483: fsync d10/d2b/d43/d53/d63/d70/d77/f82 0 2024-09-18T12:49:14.625 INFO:tasks.workunit.client.1.smithi148.stdout:6/491: dwrite d5/d1a/dc/d2b/d35/d65/f4b [0,4194304] 0 2024-09-18T12:49:14.626 INFO:tasks.workunit.client.1.smithi148.stdout:6/492: chown d5/f23 41656 1 2024-09-18T12:49:14.627 INFO:tasks.workunit.client.0.smithi078.stdout:5/437: fsync d2/d4/d12/f40 0 2024-09-18T12:49:14.628 INFO:tasks.workunit.client.0.smithi078.stdout:1/315: mkdir d0/d8/da/d3e/d50/d60 0 2024-09-18T12:49:14.632 INFO:tasks.workunit.client.1.smithi148.stdout:1/455: link dc/d18/d43/f4e dc/d11/f97 0 2024-09-18T12:49:14.632 INFO:tasks.workunit.client.0.smithi078.stdout:9/256: unlink d5/d7/d8/l3b 0 2024-09-18T12:49:14.633 INFO:tasks.workunit.client.1.smithi148.stdout:3/447: link d4/d8/f1a d4/d8/d20/d2b/d43/fa4 0 2024-09-18T12:49:14.634 INFO:tasks.workunit.client.1.smithi148.stdout:5/514: unlink d7/d8/dc/d12/d1f/d25/l67 0 2024-09-18T12:49:14.637 INFO:tasks.workunit.client.0.smithi078.stdout:0/409: rmdir d3/d43/d7f 39 2024-09-18T12:49:14.637 INFO:tasks.workunit.client.0.smithi078.stdout:5/438: dread d2/d4/d9/d2f/f6f [0,4194304] 0 2024-09-18T12:49:14.639 INFO:tasks.workunit.client.0.smithi078.stdout:5/439: write d2/d4/d12/d16/f24 [5528595,95178] 0 2024-09-18T12:49:14.639 INFO:tasks.workunit.client.0.smithi078.stdout:2/285: link d4/dd/d18/d33/f48 d4/dd/d18/d3b/d4f/f57 0 2024-09-18T12:49:14.640 INFO:tasks.workunit.client.0.smithi078.stdout:5/440: write d2/d4/f7e [526900,74035] 0 2024-09-18T12:49:14.642 INFO:tasks.workunit.client.1.smithi148.stdout:1/456: dwrite dc/d11/d38/f6f [0,4194304] 0 2024-09-18T12:49:14.642 INFO:tasks.workunit.client.1.smithi148.stdout:7/506: creat db/dc/d91/f92 x:0 0 0 2024-09-18T12:49:14.643 INFO:tasks.workunit.client.1.smithi148.stdout:2/408: dread d9/d24/f32 [0,4194304] 0 2024-09-18T12:49:14.645 INFO:tasks.workunit.client.1.smithi148.stdout:3/448: unlink d4/d8/f98 0 2024-09-18T12:49:14.646 INFO:tasks.workunit.client.0.smithi078.stdout:6/484: mknod d10/d2b/d43/d53/d63/d70/d7d/c9f 0 2024-09-18T12:49:14.647 INFO:tasks.workunit.client.0.smithi078.stdout:6/485: readlink d10/l47 0 2024-09-18T12:49:14.647 INFO:tasks.workunit.client.1.smithi148.stdout:9/458: write d8/da/dd/d65/f76 [27262,27392] 0 2024-09-18T12:49:14.649 INFO:tasks.workunit.client.0.smithi078.stdout:8/301: getdents d0/d7 0 2024-09-18T12:49:14.650 INFO:tasks.workunit.client.1.smithi148.stdout:5/515: dwrite d7/d8/dc/d12/d1f/d25/d4b/f58 [0,4194304] 0 2024-09-18T12:49:14.652 INFO:tasks.workunit.client.1.smithi148.stdout:2/409: truncate d9/d24/d31/f83 587052 0 2024-09-18T12:49:14.653 INFO:tasks.workunit.client.0.smithi078.stdout:6/486: dread d10/d2b/d43/d53/d45/d55/f2d [0,4194304] 0 2024-09-18T12:49:14.658 INFO:tasks.workunit.client.1.smithi148.stdout:8/538: sync 2024-09-18T12:49:14.658 INFO:tasks.workunit.client.1.smithi148.stdout:2/410: truncate d9/d24/d31/d34/d42/f69 543345 0 2024-09-18T12:49:14.659 INFO:tasks.workunit.client.0.smithi078.stdout:1/316: write d0/d8/da/f35 [3180740,121064] 0 2024-09-18T12:49:14.660 INFO:tasks.workunit.client.0.smithi078.stdout:1/317: read - d0/d8/da/d3e/d46/d52/f32 zero size 2024-09-18T12:49:14.660 INFO:tasks.workunit.client.1.smithi148.stdout:0/646: write de/d27/f2b [2390738,130307] 0 2024-09-18T12:49:14.661 INFO:tasks.workunit.client.0.smithi078.stdout:9/257: mkdir d5/d40/d4e 0 2024-09-18T12:49:14.661 INFO:tasks.workunit.client.0.smithi078.stdout:1/318: fsync d0/d8/f2b 0 2024-09-18T12:49:14.661 INFO:tasks.workunit.client.0.smithi078.stdout:9/258: readlink d5/d7/l2c 0 2024-09-18T12:49:14.664 INFO:tasks.workunit.client.1.smithi148.stdout:6/493: dread d5/d32/d38/d50/f59 [0,4194304] 0 2024-09-18T12:49:14.664 INFO:tasks.workunit.client.1.smithi148.stdout:0/647: write de/f11 [2788718,103520] 0 2024-09-18T12:49:14.665 INFO:tasks.workunit.client.1.smithi148.stdout:9/459: dwrite d8/da/dd/d3f/d5d/f83 [0,4194304] 0 2024-09-18T12:49:14.666 INFO:tasks.workunit.client.1.smithi148.stdout:3/449: dwrite d4/d8/d1e/d63/f86 [0,4194304] 0 2024-09-18T12:49:14.666 INFO:tasks.workunit.client.0.smithi078.stdout:0/410: mkdir d3/d1f/d2e/d4e/d37/d72/d96 0 2024-09-18T12:49:14.667 INFO:tasks.workunit.client.1.smithi148.stdout:9/460: fdatasync d8/f16 0 2024-09-18T12:49:14.669 INFO:tasks.workunit.client.0.smithi078.stdout:9/259: dwrite d5/d7/d32/d2a/f2e [0,4194304] 0 2024-09-18T12:49:14.671 INFO:tasks.workunit.client.1.smithi148.stdout:6/494: dread - d5/d1a/d29/d5c/f8f zero size 2024-09-18T12:49:14.671 INFO:tasks.workunit.client.0.smithi078.stdout:9/260: dread - d5/d7/d32/d2a/f4b zero size 2024-09-18T12:49:14.672 INFO:tasks.workunit.client.1.smithi148.stdout:6/495: truncate d5/d1a/dc/f20 4379187 0 2024-09-18T12:49:14.672 INFO:tasks.workunit.client.0.smithi078.stdout:9/261: fdatasync d5/d7/d32/f44 0 2024-09-18T12:49:14.673 INFO:tasks.workunit.client.1.smithi148.stdout:2/411: creat d9/d73/f8e x:0 0 0 2024-09-18T12:49:14.675 INFO:tasks.workunit.client.1.smithi148.stdout:2/412: write d9/d24/d31/d34/d57/f60 [227231,65925] 0 2024-09-18T12:49:14.675 INFO:tasks.workunit.client.0.smithi078.stdout:2/286: creat d4/dd/d18/d3b/f58 x:0 0 0 2024-09-18T12:49:14.679 INFO:tasks.workunit.client.0.smithi078.stdout:5/441: truncate d2/d4/d12/d2d/f42 120550 0 2024-09-18T12:49:14.680 INFO:tasks.workunit.client.0.smithi078.stdout:9/262: dread d5/d7/d32/f24 [0,4194304] 0 2024-09-18T12:49:14.681 INFO:tasks.workunit.client.0.smithi078.stdout:5/442: truncate d2/d4/d48/f71 112847 0 2024-09-18T12:49:14.682 INFO:tasks.workunit.client.1.smithi148.stdout:8/539: mknod d8/df/d3e/d88/cb9 0 2024-09-18T12:49:14.684 INFO:tasks.workunit.client.1.smithi148.stdout:1/457: fdatasync dc/d11/d38/d87/f3c 0 2024-09-18T12:49:14.685 INFO:tasks.workunit.client.1.smithi148.stdout:1/458: fsync dc/d11/d38/d87/f23 0 2024-09-18T12:49:14.685 INFO:tasks.workunit.client.0.smithi078.stdout:8/302: rename d0/f47 to d0/d7/d1e/d50/f58 0 2024-09-18T12:49:14.687 INFO:tasks.workunit.client.0.smithi078.stdout:9/263: dread d5/d7/d32/d2a/d36/f43 [0,4194304] 0 2024-09-18T12:49:14.688 INFO:tasks.workunit.client.1.smithi148.stdout:9/461: rmdir d8/da/dd/d35 39 2024-09-18T12:49:14.690 INFO:tasks.workunit.client.1.smithi148.stdout:5/516: mkdir d7/d8/d18/d3f/d7c/d7d/da8 0 2024-09-18T12:49:14.691 INFO:tasks.workunit.client.0.smithi078.stdout:4/290: creat d11/d27/d47/d4e/f65 x:0 0 0 2024-09-18T12:49:14.693 INFO:tasks.workunit.client.0.smithi078.stdout:4/291: chown d11/d27/f34 2707 1 2024-09-18T12:49:14.697 INFO:tasks.workunit.client.0.smithi078.stdout:4/292: dread - d11/d27/d5a/f64 zero size 2024-09-18T12:49:14.697 INFO:tasks.workunit.client.0.smithi078.stdout:2/287: readlink d4/dd/l27 0 2024-09-18T12:49:14.698 INFO:tasks.workunit.client.1.smithi148.stdout:8/540: mkdir d8/d16/d53/da0/dba 0 2024-09-18T12:49:14.698 INFO:tasks.workunit.client.1.smithi148.stdout:3/450: dread d4/d8/f51 [0,4194304] 0 2024-09-18T12:49:14.698 INFO:tasks.workunit.client.1.smithi148.stdout:1/459: creat dc/d18/d63/f98 x:0 0 0 2024-09-18T12:49:14.698 INFO:tasks.workunit.client.1.smithi148.stdout:7/507: link db/l22 db/dc/df/d11/l93 0 2024-09-18T12:49:14.702 INFO:tasks.workunit.client.1.smithi148.stdout:3/451: dread d4/f29 [0,4194304] 0 2024-09-18T12:49:14.702 INFO:tasks.workunit.client.0.smithi078.stdout:8/303: write d0/d7/d1e/d50/f58 [1038742,39764] 0 2024-09-18T12:49:14.704 INFO:tasks.workunit.client.0.smithi078.stdout:1/319: creat d0/d8/da/d3e/d50/d60/f61 x:0 0 0 2024-09-18T12:49:14.708 INFO:tasks.workunit.client.1.smithi148.stdout:1/460: dwrite dc/d18/d31/d4b/f65 [4194304,4194304] 0 2024-09-18T12:49:14.710 INFO:tasks.workunit.client.1.smithi148.stdout:1/461: chown dc/d11/f12 0 1 2024-09-18T12:49:14.710 INFO:tasks.workunit.client.0.smithi078.stdout:3/323: truncate d9/d13/f39 2098679 0 2024-09-18T12:49:14.711 INFO:tasks.workunit.client.0.smithi078.stdout:2/288: read d4/f5 [1336529,102036] 0 2024-09-18T12:49:14.711 INFO:tasks.workunit.client.0.smithi078.stdout:2/289: fdatasync d4/db/f2a 0 2024-09-18T12:49:14.714 INFO:tasks.workunit.client.1.smithi148.stdout:6/496: getdents d5/d1a/dc 0 2024-09-18T12:49:14.715 INFO:tasks.workunit.client.1.smithi148.stdout:3/452: dwrite d4/d8/d20/d2b/d43/f4b [0,4194304] 0 2024-09-18T12:49:14.717 INFO:tasks.workunit.client.0.smithi078.stdout:9/264: mkdir d5/d7/d8/d4f 0 2024-09-18T12:49:14.718 INFO:tasks.workunit.client.0.smithi078.stdout:9/265: dread - d5/d7/d32/d2a/f2d zero size 2024-09-18T12:49:14.718 INFO:tasks.workunit.client.1.smithi148.stdout:6/497: write d5/d32/d56/f4d [4789988,126500] 0 2024-09-18T12:49:14.720 INFO:tasks.workunit.client.1.smithi148.stdout:8/541: dread d8/d16/f2a [0,4194304] 0 2024-09-18T12:49:14.723 INFO:tasks.workunit.client.1.smithi148.stdout:7/508: dread db/dc/df/d2c/d55/f73 [0,4194304] 0 2024-09-18T12:49:14.724 INFO:tasks.workunit.client.0.smithi078.stdout:4/293: unlink l3 0 2024-09-18T12:49:14.724 INFO:tasks.workunit.client.1.smithi148.stdout:9/462: rename d8/da/dd/l8b to d8/da/dd/d35/d47/d4e/l8c 0 2024-09-18T12:49:14.724 INFO:tasks.workunit.client.1.smithi148.stdout:8/542: fsync d8/df/f10 0 2024-09-18T12:49:14.727 INFO:tasks.workunit.client.1.smithi148.stdout:5/517: link d7/c89 d7/d8/dc/d12/d1f/d69/ca9 0 2024-09-18T12:49:14.731 INFO:tasks.workunit.client.0.smithi078.stdout:5/443: creat d2/d4/f89 x:0 0 0 2024-09-18T12:49:14.733 INFO:tasks.workunit.client.0.smithi078.stdout:5/444: chown d2/d4/d9/da/f7a 85593 1 2024-09-18T12:49:14.734 INFO:tasks.workunit.client.0.smithi078.stdout:5/445: write d2/d4/d9/da/f5a [1018549,49931] 0 2024-09-18T12:49:14.735 INFO:tasks.workunit.client.1.smithi148.stdout:6/498: dwrite d5/f19 [4194304,4194304] 0 2024-09-18T12:49:14.735 INFO:tasks.workunit.client.1.smithi148.stdout:2/413: dwrite d9/d24/d31/f3d [0,4194304] 0 2024-09-18T12:49:14.737 INFO:tasks.workunit.client.0.smithi078.stdout:8/304: symlink d0/d7/dc/d1f/l59 0 2024-09-18T12:49:14.739 INFO:tasks.workunit.client.1.smithi148.stdout:4/438: sync 2024-09-18T12:49:14.741 INFO:tasks.workunit.client.1.smithi148.stdout:9/463: symlink d8/d33/l8d 0 2024-09-18T12:49:14.742 INFO:tasks.workunit.client.1.smithi148.stdout:7/509: rename db/d52/c88 to db/dc/df/d11/d43/c94 0 2024-09-18T12:49:14.742 INFO:tasks.workunit.client.1.smithi148.stdout:4/439: write d15/d17/f27 [653711,87705] 0 2024-09-18T12:49:14.746 INFO:tasks.workunit.client.0.smithi078.stdout:9/266: truncate d5/d7/d8/f35 732813 0 2024-09-18T12:49:14.747 INFO:tasks.workunit.client.0.smithi078.stdout:0/411: getdents d3/d1f/d2e/d8f 0 2024-09-18T12:49:14.747 INFO:tasks.workunit.client.0.smithi078.stdout:9/267: chown f3 1057 1 2024-09-18T12:49:14.750 INFO:tasks.workunit.client.0.smithi078.stdout:4/294: mknod d11/d27/d5a/c66 0 2024-09-18T12:49:14.752 INFO:tasks.workunit.client.1.smithi148.stdout:1/462: write dc/d11/f97 [2764663,83447] 0 2024-09-18T12:49:14.752 INFO:tasks.workunit.client.0.smithi078.stdout:4/295: read d11/d27/f4a [582583,26592] 0 2024-09-18T12:49:14.753 INFO:tasks.workunit.client.0.smithi078.stdout:3/324: fdatasync d9/d13/f39 0 2024-09-18T12:49:14.754 INFO:tasks.workunit.client.0.smithi078.stdout:4/296: truncate d11/d27/d47/f5f 833822 0 2024-09-18T12:49:14.755 INFO:tasks.workunit.client.0.smithi078.stdout:3/325: write d9/d13/d33/d3c/d19/f49 [804069,31355] 0 2024-09-18T12:49:14.756 INFO:tasks.workunit.client.0.smithi078.stdout:2/290: rename d4/dd/f42 to d4/dd/d18/d3b/d55/f59 0 2024-09-18T12:49:14.758 INFO:tasks.workunit.client.0.smithi078.stdout:8/305: rmdir d0/d7/dc/d1f 39 2024-09-18T12:49:14.759 INFO:tasks.workunit.client.0.smithi078.stdout:8/306: fsync d0/d7/f22 0 2024-09-18T12:49:14.760 INFO:tasks.workunit.client.0.smithi078.stdout:5/446: dread d2/d4/d12/f81 [0,4194304] 0 2024-09-18T12:49:14.762 INFO:tasks.workunit.client.1.smithi148.stdout:8/543: creat d8/d12/d46/d7e/da1/fbb x:0 0 0 2024-09-18T12:49:14.764 INFO:tasks.workunit.client.1.smithi148.stdout:2/414: mkdir d9/d24/d67/d72/d8f 0 2024-09-18T12:49:14.765 INFO:tasks.workunit.client.1.smithi148.stdout:2/415: write d9/d3a/f86 [585753,92025] 0 2024-09-18T12:49:14.767 INFO:tasks.workunit.client.1.smithi148.stdout:7/510: stat db/dc/f12 0 2024-09-18T12:49:14.768 INFO:tasks.workunit.client.0.smithi078.stdout:1/320: truncate d0/d8/da/d3e/d46/d52/f2d 336094 0 2024-09-18T12:49:14.768 INFO:tasks.workunit.client.0.smithi078.stdout:9/268: rmdir d5/d7/d32/d2a/d36 39 2024-09-18T12:49:14.770 INFO:tasks.workunit.client.1.smithi148.stdout:4/440: rename d15/d5f/d77 to d15/d17/d52/d92 0 2024-09-18T12:49:14.770 INFO:tasks.workunit.client.1.smithi148.stdout:4/441: fsync d15/d3f/f8f 0 2024-09-18T12:49:14.771 INFO:tasks.workunit.client.1.smithi148.stdout:1/463: mkdir dc/d11/d38/d87/d2b/d99 0 2024-09-18T12:49:14.773 INFO:tasks.workunit.client.1.smithi148.stdout:6/499: mkdir d5/d1a/dc/d2b/d35/d9c 0 2024-09-18T12:49:14.776 INFO:tasks.workunit.client.0.smithi078.stdout:3/326: unlink c5 0 2024-09-18T12:49:14.780 INFO:tasks.workunit.client.1.smithi148.stdout:2/416: rename d9/d24/d31/d34/d57 to d9/d3a/d90 0 2024-09-18T12:49:14.781 INFO:tasks.workunit.client.1.smithi148.stdout:5/518: link d7/d8/dc/d12/d1f/c5b d7/d8/dc/d12/d1f/d25/caa 0 2024-09-18T12:49:14.783 INFO:tasks.workunit.client.0.smithi078.stdout:3/327: dread d9/d13/f39 [0,4194304] 0 2024-09-18T12:49:14.784 INFO:tasks.workunit.client.1.smithi148.stdout:4/442: creat d15/d17/d52/d92/d4c/d72/f93 x:0 0 0 2024-09-18T12:49:14.784 INFO:tasks.workunit.client.0.smithi078.stdout:8/307: stat d0/d7/d1e/d33/l41 0 2024-09-18T12:49:14.785 INFO:tasks.workunit.client.1.smithi148.stdout:8/544: mknod d8/df/d3e/d82/cbc 0 2024-09-18T12:49:14.785 INFO:tasks.workunit.client.1.smithi148.stdout:8/545: chown d8/d16/d27/c65 463311 1 2024-09-18T12:49:14.787 INFO:tasks.workunit.client.0.smithi078.stdout:5/447: symlink d2/d4/d9/da/d60/l8a 0 2024-09-18T12:49:14.789 INFO:tasks.workunit.client.1.smithi148.stdout:2/417: fsync d9/f71 0 2024-09-18T12:49:14.791 INFO:tasks.workunit.client.1.smithi148.stdout:1/464: rename dc/d18/d43/c3e to dc/d18/d31/d4b/d8d/c9a 0 2024-09-18T12:49:14.794 INFO:tasks.workunit.client.1.smithi148.stdout:4/443: fsync d15/d3f/f5a 0 2024-09-18T12:49:14.797 INFO:tasks.workunit.client.0.smithi078.stdout:2/291: creat d4/d8/d23/d52/f5a x:0 0 0 2024-09-18T12:49:14.800 INFO:tasks.workunit.client.0.smithi078.stdout:8/308: fdatasync d0/d7/dc/d1f/d23/d44/f4a 0 2024-09-18T12:49:14.801 INFO:tasks.workunit.client.1.smithi148.stdout:2/418: creat d9/d73/f91 x:0 0 0 2024-09-18T12:49:14.802 INFO:tasks.workunit.client.0.smithi078.stdout:5/448: write d2/d4/d9/d2f/d30/f80 [1169427,94186] 0 2024-09-18T12:49:14.804 INFO:tasks.workunit.client.1.smithi148.stdout:5/519: rename d7/d8/dc/d12/d1f/d25/d4b/f58 to d7/d8/dc/d12/d1f/d69/fab 0 2024-09-18T12:49:14.805 INFO:tasks.workunit.client.1.smithi148.stdout:9/464: truncate d8/da/dd/d65/f6d 3657929 0 2024-09-18T12:49:14.805 INFO:tasks.workunit.client.0.smithi078.stdout:0/412: link d3/d1f/d2e/d4e/d37/f57 d3/d1f/f97 0 2024-09-18T12:49:14.806 INFO:tasks.workunit.client.1.smithi148.stdout:7/511: dwrite db/dc/df/d11/f53 [0,4194304] 0 2024-09-18T12:49:14.808 INFO:tasks.workunit.client.0.smithi078.stdout:1/321: symlink d0/l62 0 2024-09-18T12:49:14.809 INFO:tasks.workunit.client.0.smithi078.stdout:1/322: write d0/d37/f57 [1475533,108041] 0 2024-09-18T12:49:14.809 INFO:tasks.workunit.client.0.smithi078.stdout:9/269: rmdir d5/d7/d32/d2a/d36 39 2024-09-18T12:49:14.811 INFO:tasks.workunit.client.1.smithi148.stdout:4/444: mkdir d15/d5f/d69/d7f/d94 0 2024-09-18T12:49:14.813 INFO:tasks.workunit.client.1.smithi148.stdout:6/500: link d5/d1a/dc/c6c d5/d1a/d29/d5c/c9d 0 2024-09-18T12:49:14.814 INFO:tasks.workunit.client.1.smithi148.stdout:9/465: dwrite d8/da/dd/d35/d47/d62/d72/f74 [0,4194304] 0 2024-09-18T12:49:14.815 INFO:tasks.workunit.client.1.smithi148.stdout:6/501: dread - d5/d32/d38/d50/f97 zero size 2024-09-18T12:49:14.817 INFO:tasks.workunit.client.1.smithi148.stdout:8/546: creat d8/df/db2/fbd x:0 0 0 2024-09-18T12:49:14.818 INFO:tasks.workunit.client.1.smithi148.stdout:2/419: stat d9/l13 0 2024-09-18T12:49:14.822 INFO:tasks.workunit.client.1.smithi148.stdout:2/420: read d9/ff [3924515,74728] 0 2024-09-18T12:49:14.823 INFO:tasks.workunit.client.1.smithi148.stdout:2/421: readlink d9/d4a/d64/l89 0 2024-09-18T12:49:14.824 INFO:tasks.workunit.client.1.smithi148.stdout:7/512: mknod db/dc/df/d1d/d68/c95 0 2024-09-18T12:49:14.827 INFO:tasks.workunit.client.1.smithi148.stdout:4/445: rename f0 to d15/d5f/d69/f95 0 2024-09-18T12:49:14.832 INFO:tasks.workunit.client.0.smithi078.stdout:5/449: mkdir d2/d4/d12/d16/d36/d68/d8b 0 2024-09-18T12:49:14.833 INFO:tasks.workunit.client.0.smithi078.stdout:5/450: stat d2/d4/d12/d16/d36/d68/d8b 0 2024-09-18T12:49:14.833 INFO:tasks.workunit.client.1.smithi148.stdout:5/520: creat d7/d8/dc/d12/d97/fac x:0 0 0 2024-09-18T12:49:14.834 INFO:tasks.workunit.client.0.smithi078.stdout:0/413: link d3/d1f/d2e/f76 d3/d1f/d2e/d4e/f98 0 2024-09-18T12:49:14.835 INFO:tasks.workunit.client.1.smithi148.stdout:2/422: unlink d9/d24/d31/d34/d42/l7c 0 2024-09-18T12:49:14.836 INFO:tasks.workunit.client.1.smithi148.stdout:7/513: readlink db/l22 0 2024-09-18T12:49:14.837 INFO:tasks.workunit.client.1.smithi148.stdout:1/465: truncate dc/d11/f53 1308806 0 2024-09-18T12:49:14.840 INFO:tasks.workunit.client.1.smithi148.stdout:9/466: rename d8/da/dd/d4a/d27/f52 to d8/da/dd/d35/d81/f8e 0 2024-09-18T12:49:14.840 INFO:tasks.workunit.client.0.smithi078.stdout:3/328: link d9/d13/d33/d34/c35 d9/d2f/c6b 0 2024-09-18T12:49:14.841 INFO:tasks.workunit.client.1.smithi148.stdout:9/467: read f6 [1164779,36340] 0 2024-09-18T12:49:14.844 INFO:tasks.workunit.client.1.smithi148.stdout:6/502: dread d5/d1a/f1f [0,4194304] 0 2024-09-18T12:49:14.845 INFO:tasks.workunit.client.0.smithi078.stdout:8/309: truncate d0/d7/dc/d1f/f28 3705901 0 2024-09-18T12:49:14.845 INFO:tasks.workunit.client.1.smithi148.stdout:6/503: write d5/d1a/f6f [1096708,107975] 0 2024-09-18T12:49:14.846 INFO:tasks.workunit.client.0.smithi078.stdout:0/414: symlink d3/d1f/d2e/d4e/d37/d72/l99 0 2024-09-18T12:49:14.848 INFO:tasks.workunit.client.1.smithi148.stdout:5/521: mkdir d7/d8/dc/d12/d1f/d69/d8b/dad 0 2024-09-18T12:49:14.848 INFO:tasks.workunit.client.1.smithi148.stdout:5/522: readlink l5 0 2024-09-18T12:49:14.848 INFO:tasks.workunit.client.1.smithi148.stdout:5/523: fdatasync d7/d2b/f3c 0 2024-09-18T12:49:14.849 INFO:tasks.workunit.client.0.smithi078.stdout:9/270: creat d5/d7/d8/f50 x:0 0 0 2024-09-18T12:49:14.849 INFO:tasks.workunit.client.0.smithi078.stdout:9/271: truncate d5/d7/f3f 1030185 0 2024-09-18T12:49:14.850 INFO:tasks.workunit.client.1.smithi148.stdout:0/648: sync 2024-09-18T12:49:14.850 INFO:tasks.workunit.client.0.smithi078.stdout:2/292: link d4/db/c36 d4/c5b 0 2024-09-18T12:49:14.850 INFO:tasks.workunit.client.1.smithi148.stdout:5/524: write d7/d8/dc/d12/d1f/d25/d4b/f4c [1035847,24896] 0 2024-09-18T12:49:14.859 INFO:tasks.workunit.client.0.smithi078.stdout:0/415: creat d3/d1f/d2e/d8f/f9a x:0 0 0 2024-09-18T12:49:14.862 INFO:tasks.workunit.client.0.smithi078.stdout:1/323: getdents d0 0 2024-09-18T12:49:14.863 INFO:tasks.workunit.client.1.smithi148.stdout:4/446: creat d15/d17/d52/d68/f96 x:0 0 0 2024-09-18T12:49:14.864 INFO:tasks.workunit.client.0.smithi078.stdout:5/451: dwrite d2/d4/d9/d2f/f6f [0,4194304] 0 2024-09-18T12:49:14.865 INFO:tasks.workunit.client.1.smithi148.stdout:9/468: mknod d8/da/dd/d35/d47/c8f 0 2024-09-18T12:49:14.868 INFO:tasks.workunit.client.0.smithi078.stdout:3/329: fdatasync d9/d13/d33/d3c/d19/f1e 0 2024-09-18T12:49:14.869 INFO:tasks.workunit.client.1.smithi148.stdout:4/447: dwrite d15/f76 [4194304,4194304] 0 2024-09-18T12:49:14.869 INFO:tasks.workunit.client.0.smithi078.stdout:3/330: readlink d9/d13/d37/l55 0 2024-09-18T12:49:14.870 INFO:tasks.workunit.client.0.smithi078.stdout:8/310: write d0/f14 [575146,111841] 0 2024-09-18T12:49:14.870 INFO:tasks.workunit.client.0.smithi078.stdout:3/331: readlink d9/df/l36 0 2024-09-18T12:49:14.878 INFO:tasks.workunit.client.0.smithi078.stdout:3/332: dwrite d9/d29/f24 [4194304,4194304] 0 2024-09-18T12:49:14.878 INFO:tasks.workunit.client.0.smithi078.stdout:1/324: truncate d0/f4b 1781543 0 2024-09-18T12:49:14.880 INFO:tasks.workunit.client.1.smithi148.stdout:0/649: fsync de/d27/f45 0 2024-09-18T12:49:14.884 INFO:tasks.workunit.client.0.smithi078.stdout:9/272: mknod d5/d7/d32/d2a/d36/c51 0 2024-09-18T12:49:14.926 INFO:tasks.workunit.client.1.smithi148.stdout:1/466: symlink dc/d11/d38/d7b/l9b 0 2024-09-18T12:49:14.930 INFO:tasks.workunit.client.1.smithi148.stdout:5/525: mkdir d7/d8/dc/d12/d1f/d25/d4b/dae 0 2024-09-18T12:49:14.961 INFO:tasks.workunit.client.1.smithi148.stdout:4/448: mknod d15/d3f/c97 0 2024-09-18T12:49:14.962 INFO:tasks.workunit.client.1.smithi148.stdout:4/449: truncate d15/d17/d52/d92/d4c/d72/f79 881015 0 2024-09-18T12:49:14.967 INFO:tasks.workunit.client.1.smithi148.stdout:3/453: sync 2024-09-18T12:49:14.969 INFO:tasks.workunit.client.1.smithi148.stdout:0/650: fdatasync de/d14/d43/d57/d59/f5c 0 2024-09-18T12:49:14.970 INFO:tasks.workunit.client.1.smithi148.stdout:0/651: write de/d27/f2b [5204592,106561] 0 2024-09-18T12:49:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:14 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:14 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:14 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:14 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:14 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:14 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:14 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:14 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:14 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:14 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:14 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:14 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:14 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:14.975 INFO:tasks.workunit.client.0.smithi078.stdout:8/311: creat d0/d7/d1e/d4b/f5a x:0 0 0 2024-09-18T12:49:14.976 INFO:tasks.workunit.client.0.smithi078.stdout:8/312: write d0/d7/dc/f3f [1028236,9240] 0 2024-09-18T12:49:14.978 INFO:tasks.workunit.client.0.smithi078.stdout:8/313: write d0/d7/d1e/d4b/f5a [641262,116417] 0 2024-09-18T12:49:14.980 INFO:tasks.workunit.client.1.smithi148.stdout:7/514: getdents db/dc/df/d8e/d75 0 2024-09-18T12:49:14.982 INFO:tasks.workunit.client.0.smithi078.stdout:9/273: symlink d5/d7/d8/d4f/l52 0 2024-09-18T12:49:14.987 INFO:tasks.workunit.client.1.smithi148.stdout:3/454: mknod d4/d8/d1e/ca5 0 2024-09-18T12:49:14.991 INFO:tasks.workunit.client.0.smithi078.stdout:8/314: chown d0/d7/dc/c10 21 1 2024-09-18T12:49:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:14 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:14 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:14 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:14.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:14 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:14.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:14 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:14.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:14 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:14.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:14 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:14.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:14 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:14.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:14 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:14.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:14 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:49:14.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:14 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:14.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:14 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:14.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:14 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:14.997 INFO:tasks.workunit.client.1.smithi148.stdout:8/547: rename d8/d12/d46/c48 to d8/d12/d51/cbe 0 2024-09-18T12:49:15.002 INFO:tasks.workunit.client.1.smithi148.stdout:4/450: link d15/d17/d52/d92/f84 d15/d3f/f98 0 2024-09-18T12:49:15.003 INFO:tasks.workunit.client.0.smithi078.stdout:9/274: link d5/l42 d5/d7/d32/d2a/d36/l53 0 2024-09-18T12:49:15.007 INFO:tasks.workunit.client.1.smithi148.stdout:1/467: link dc/d11/d38/d72/f73 dc/d11/d38/d87/f9c 0 2024-09-18T12:49:15.011 INFO:tasks.workunit.client.0.smithi078.stdout:9/275: rename d5/d7/fc to d5/d7/d8/d4f/f54 0 2024-09-18T12:49:15.012 INFO:tasks.workunit.client.1.smithi148.stdout:5/526: link d7/d8/dc/d12/d1f/d77/l7e d7/d8/dc/d12/d1f/d69/d8b/dad/laf 0 2024-09-18T12:49:15.015 INFO:tasks.workunit.client.1.smithi148.stdout:0/652: dread de/d27/d2e/f73 [0,4194304] 0 2024-09-18T12:49:15.015 INFO:tasks.workunit.client.1.smithi148.stdout:9/469: getdents d8/da/dd/d35/d5e 0 2024-09-18T12:49:15.016 INFO:tasks.workunit.client.1.smithi148.stdout:3/455: dread d4/d8/d1e/d6b/d31/f34 [0,4194304] 0 2024-09-18T12:49:15.018 INFO:tasks.workunit.client.1.smithi148.stdout:2/423: sync 2024-09-18T12:49:15.020 INFO:tasks.workunit.client.1.smithi148.stdout:2/424: read d9/d24/f32 [2128624,123464] 0 2024-09-18T12:49:15.023 INFO:tasks.workunit.client.1.smithi148.stdout:8/548: symlink d8/d16/d53/da0/dba/lbf 0 2024-09-18T12:49:15.024 INFO:tasks.workunit.client.1.smithi148.stdout:3/456: dwrite d4/d8/d1e/d6b/d31/f58 [0,4194304] 0 2024-09-18T12:49:15.024 INFO:tasks.workunit.client.1.smithi148.stdout:5/527: dread d7/d8/dc/f5d [0,4194304] 0 2024-09-18T12:49:15.025 INFO:tasks.workunit.client.1.smithi148.stdout:6/504: rename d5/f1b to d5/d1a/dc/d2b/d9b/f9e 0 2024-09-18T12:49:15.028 INFO:tasks.workunit.client.1.smithi148.stdout:8/549: chown d8/d16/f9d 38954 1 2024-09-18T12:49:15.032 INFO:tasks.workunit.client.1.smithi148.stdout:9/470: read d8/da/dd/d65/f6d [687437,30701] 0 2024-09-18T12:49:15.032 INFO:tasks.workunit.client.1.smithi148.stdout:1/468: dwrite dc/d18/f1f [0,4194304] 0 2024-09-18T12:49:15.032 INFO:tasks.workunit.client.1.smithi148.stdout:2/425: mkdir d9/d17/d29/d92 0 2024-09-18T12:49:15.036 INFO:tasks.workunit.client.1.smithi148.stdout:7/515: rename db/dc/df/d11/d43/f72 to db/dc/df/d11/d34/d69/f96 0 2024-09-18T12:49:15.037 INFO:tasks.workunit.client.1.smithi148.stdout:5/528: creat d7/d8/d18/fb0 x:0 0 0 2024-09-18T12:49:15.038 INFO:tasks.workunit.client.1.smithi148.stdout:6/505: fdatasync d5/d1a/d29/f4e 0 2024-09-18T12:49:15.043 INFO:tasks.workunit.client.1.smithi148.stdout:3/457: dwrite d4/d8/d20/d2b/d43/f4b [0,4194304] 0 2024-09-18T12:49:15.044 INFO:tasks.workunit.client.1.smithi148.stdout:5/529: dread d7/d8/dc/d12/d1f/d39/f41 [0,4194304] 0 2024-09-18T12:49:15.046 INFO:tasks.workunit.client.1.smithi148.stdout:7/516: creat db/dc/df/d11/f97 x:0 0 0 2024-09-18T12:49:15.046 INFO:tasks.workunit.client.1.smithi148.stdout:9/471: dwrite d8/da/dd/d4a/f18 [0,4194304] 0 2024-09-18T12:49:15.051 INFO:tasks.workunit.client.1.smithi148.stdout:7/517: write db/dc/df/d8e/f7c [357329,42545] 0 2024-09-18T12:49:15.052 INFO:tasks.workunit.client.1.smithi148.stdout:1/469: creat dc/d11/d38/d87/d2b/d80/f9d x:0 0 0 2024-09-18T12:49:15.053 INFO:tasks.workunit.client.1.smithi148.stdout:2/426: getdents d9/d24/d67/d72/d8f 0 2024-09-18T12:49:15.054 INFO:tasks.workunit.client.1.smithi148.stdout:5/530: rmdir d7/d8/dc/d12/d31/d6c 39 2024-09-18T12:49:15.056 INFO:tasks.workunit.client.1.smithi148.stdout:1/470: chown dc/d11/d38/d87/d2b/l81 12 1 2024-09-18T12:49:15.058 INFO:tasks.workunit.client.1.smithi148.stdout:3/458: dwrite d4/d8/d1e/d6b/f47 [0,4194304] 0 2024-09-18T12:49:15.059 INFO:tasks.workunit.client.1.smithi148.stdout:5/531: mkdir d7/d8/dc/d22/db1 0 2024-09-18T12:49:15.060 INFO:tasks.workunit.client.1.smithi148.stdout:1/471: symlink dc/d5b/l9e 0 2024-09-18T12:49:15.061 INFO:tasks.workunit.client.1.smithi148.stdout:1/472: stat dc/d18/f1f 0 2024-09-18T12:49:15.064 INFO:tasks.workunit.client.1.smithi148.stdout:7/518: truncate db/dc/df/d11/d34/f61 150330 0 2024-09-18T12:49:15.071 INFO:tasks.workunit.client.0.smithi078.stdout:0/416: dwrite d3/f3f [0,4194304] 0 2024-09-18T12:49:15.072 INFO:tasks.workunit.client.1.smithi148.stdout:8/550: getdents d8/d16/d53/d39/d3b 0 2024-09-18T12:49:15.074 INFO:tasks.workunit.client.1.smithi148.stdout:5/532: stat d7/d8/dc/d12/d31/d6c 0 2024-09-18T12:49:15.074 INFO:tasks.workunit.client.1.smithi148.stdout:3/459: write f2 [6168449,121574] 0 2024-09-18T12:49:15.075 INFO:tasks.workunit.client.1.smithi148.stdout:9/472: getdents d8/da/dd/d65 0 2024-09-18T12:49:15.075 INFO:tasks.workunit.client.1.smithi148.stdout:8/551: chown d8/d16/d27/c24 765884684 1 2024-09-18T12:49:15.076 INFO:tasks.workunit.client.1.smithi148.stdout:9/473: chown d8/da/dd/d4a/f3a 15006 1 2024-09-18T12:49:15.076 INFO:tasks.workunit.client.1.smithi148.stdout:8/552: write d8/df/f73 [3516837,38271] 0 2024-09-18T12:49:15.078 INFO:tasks.workunit.client.1.smithi148.stdout:1/473: mkdir dc/d9f 0 2024-09-18T12:49:15.079 INFO:tasks.workunit.client.0.smithi078.stdout:1/325: write d0/d37/f59 [816415,54281] 0 2024-09-18T12:49:15.080 INFO:tasks.workunit.client.1.smithi148.stdout:7/519: write db/dc/df/d11/d34/d69/f96 [1265265,115289] 0 2024-09-18T12:49:15.083 INFO:tasks.workunit.client.0.smithi078.stdout:1/326: truncate d0/d37/f48 1135995 0 2024-09-18T12:49:15.086 INFO:tasks.workunit.client.1.smithi148.stdout:8/553: dwrite d8/d12/d46/d74/f9b [0,4194304] 0 2024-09-18T12:49:15.086 INFO:tasks.workunit.client.1.smithi148.stdout:6/506: dread d5/d32/d56/f78 [0,4194304] 0 2024-09-18T12:49:15.088 INFO:tasks.workunit.client.1.smithi148.stdout:3/460: creat d4/d8/fa6 x:0 0 0 2024-09-18T12:49:15.091 INFO:tasks.workunit.client.1.smithi148.stdout:8/554: truncate d8/df/d3e/d82/fa9 5159051 0 2024-09-18T12:49:15.091 INFO:tasks.workunit.client.1.smithi148.stdout:1/474: dwrite dc/d11/d38/d87/f9c [0,4194304] 0 2024-09-18T12:49:15.092 INFO:tasks.workunit.client.0.smithi078.stdout:1/327: dwrite d0/d8/da/f17 [0,4194304] 0 2024-09-18T12:49:15.104 INFO:tasks.workunit.client.1.smithi148.stdout:7/520: dwrite db/dc/df/f35 [0,4194304] 0 2024-09-18T12:49:15.105 INFO:tasks.workunit.client.0.smithi078.stdout:7/220: sync 2024-09-18T12:49:15.105 INFO:tasks.workunit.client.0.smithi078.stdout:6/487: sync 2024-09-18T12:49:15.105 INFO:tasks.workunit.client.0.smithi078.stdout:4/297: sync 2024-09-18T12:49:15.106 INFO:tasks.workunit.client.1.smithi148.stdout:3/461: dwrite d4/d8/d20/d2b/d43/d61/f7c [0,4194304] 0 2024-09-18T12:49:15.108 INFO:tasks.workunit.client.1.smithi148.stdout:8/555: link d8/d16/d53/d39/f3d d8/d12/d46/d74/fc0 0 2024-09-18T12:49:15.112 INFO:tasks.workunit.client.1.smithi148.stdout:8/556: write d8/d16/faf [63322,31373] 0 2024-09-18T12:49:15.112 INFO:tasks.workunit.client.1.smithi148.stdout:0/653: rename de/d27/d7a/l80 to de/d27/d53/ldc 0 2024-09-18T12:49:15.113 INFO:tasks.workunit.client.1.smithi148.stdout:1/475: dwrite dc/d11/f30 [0,4194304] 0 2024-09-18T12:49:15.115 INFO:tasks.workunit.client.1.smithi148.stdout:8/557: write d8/d12/f13 [2961331,104271] 0 2024-09-18T12:49:15.117 INFO:tasks.workunit.client.0.smithi078.stdout:6/488: dwrite d10/d2b/d43/d53/d63/f75 [0,4194304] 0 2024-09-18T12:49:15.117 INFO:tasks.workunit.client.1.smithi148.stdout:7/521: getdents db/dc/df/d2c/d66 0 2024-09-18T12:49:15.118 INFO:tasks.workunit.client.0.smithi078.stdout:8/315: rmdir d0/d7/dc/d1f/d23/d44 39 2024-09-18T12:49:15.120 INFO:tasks.workunit.client.0.smithi078.stdout:8/316: chown d0/c12 14611 1 2024-09-18T12:49:15.121 INFO:tasks.workunit.client.1.smithi148.stdout:8/558: rmdir d8/d16/d27 39 2024-09-18T12:49:15.122 INFO:tasks.workunit.client.0.smithi078.stdout:6/489: read d10/d2b/d43/d53/d63/d70/d77/f78 [2510153,105531] 0 2024-09-18T12:49:15.124 INFO:tasks.workunit.client.1.smithi148.stdout:4/451: dwrite d15/d17/d52/d92/f32 [0,4194304] 0 2024-09-18T12:49:15.124 INFO:tasks.workunit.client.0.smithi078.stdout:6/490: dread d10/d2b/d43/d53/d63/d70/d77/f8d [0,4194304] 0 2024-09-18T12:49:15.126 INFO:tasks.workunit.client.0.smithi078.stdout:9/276: rename d5/d7/d8/f50 to d5/d7/d32/d2a/d36/f55 0 2024-09-18T12:49:15.127 INFO:tasks.workunit.client.0.smithi078.stdout:9/277: dread - d5/d7/d32/d2a/f4b zero size 2024-09-18T12:49:15.129 INFO:tasks.workunit.client.0.smithi078.stdout:2/293: creat d4/dd/f5c x:0 0 0 2024-09-18T12:49:15.129 INFO:tasks.workunit.client.0.smithi078.stdout:2/294: stat d4/db/dc/c49 0 2024-09-18T12:49:15.129 INFO:tasks.workunit.client.0.smithi078.stdout:8/317: creat d0/d7/d1e/d50/f5b x:0 0 0 2024-09-18T12:49:15.130 INFO:tasks.workunit.client.0.smithi078.stdout:9/278: dread - d5/d7/f39 zero size 2024-09-18T12:49:15.130 INFO:tasks.workunit.client.0.smithi078.stdout:2/295: fsync d4/db/f2a 0 2024-09-18T12:49:15.132 INFO:tasks.workunit.client.1.smithi148.stdout:8/559: dwrite d8/d16/d53/d39/d3b/d4e/f97 [0,4194304] 0 2024-09-18T12:49:15.137 INFO:tasks.workunit.client.0.smithi078.stdout:6/491: rmdir d10/d2b/d43/d53/d63/d70/d77 39 2024-09-18T12:49:15.137 INFO:tasks.workunit.client.0.smithi078.stdout:2/296: read d4/db/f2a [254842,79406] 0 2024-09-18T12:49:15.141 INFO:tasks.workunit.client.0.smithi078.stdout:1/328: rename d0/d8/f2c to d0/d5b/f63 0 2024-09-18T12:49:15.142 INFO:tasks.workunit.client.0.smithi078.stdout:1/329: fsync d0/d8/da/f40 0 2024-09-18T12:49:15.142 INFO:tasks.workunit.client.1.smithi148.stdout:4/452: mknod d15/d5f/d69/d7f/d94/c99 0 2024-09-18T12:49:15.143 INFO:tasks.workunit.client.0.smithi078.stdout:8/318: mkdir d0/d7/d53/d57/d5c 0 2024-09-18T12:49:15.146 INFO:tasks.workunit.client.1.smithi148.stdout:8/560: truncate d8/d16/d53/d39/d3b/f63 3782747 0 2024-09-18T12:49:15.151 INFO:tasks.workunit.client.1.smithi148.stdout:6/507: dread d5/d1a/dc/d2b/d9b/f9e [0,4194304] 0 2024-09-18T12:49:15.151 INFO:tasks.workunit.client.0.smithi078.stdout:1/330: dwrite d0/d8/da/f5f [0,4194304] 0 2024-09-18T12:49:15.153 INFO:tasks.workunit.client.1.smithi148.stdout:8/561: rename d8/d16/l81 to d8/d16/d53/da0/lc1 0 2024-09-18T12:49:15.156 INFO:tasks.workunit.client.1.smithi148.stdout:1/476: getdents dc/d5b 0 2024-09-18T12:49:15.159 INFO:tasks.workunit.client.0.smithi078.stdout:7/221: rename d7/d26/l31 to d7/d3c/d47/l48 0 2024-09-18T12:49:15.160 INFO:tasks.workunit.client.0.smithi078.stdout:7/222: chown d7/d9/l43 578840 1 2024-09-18T12:49:15.162 INFO:tasks.workunit.client.0.smithi078.stdout:9/279: dwrite d5/d7/d8/f27 [4194304,4194304] 0 2024-09-18T12:49:15.165 INFO:tasks.workunit.client.0.smithi078.stdout:9/280: write d5/d7/f2b [250656,80653] 0 2024-09-18T12:49:15.169 INFO:tasks.workunit.client.0.smithi078.stdout:5/452: creat d2/d4/f8c x:0 0 0 2024-09-18T12:49:15.169 INFO:tasks.workunit.client.1.smithi148.stdout:7/522: link db/dc/df/l30 db/dc/df/d5f/l98 0 2024-09-18T12:49:15.170 INFO:tasks.workunit.client.0.smithi078.stdout:0/417: write d3/d1f/d2e/f76 [1038463,32146] 0 2024-09-18T12:49:15.170 INFO:tasks.workunit.client.0.smithi078.stdout:1/331: rmdir d0/d8/da/d3e 39 2024-09-18T12:49:15.173 INFO:tasks.workunit.client.1.smithi148.stdout:1/477: creat dc/d11/d38/d87/d2b/fa0 x:0 0 0 2024-09-18T12:49:15.173 INFO:tasks.workunit.client.1.smithi148.stdout:9/474: write d8/da/dd/d65/f6d [3842045,83175] 0 2024-09-18T12:49:15.174 INFO:tasks.workunit.client.0.smithi078.stdout:7/223: dwrite d7/d9/f20 [0,4194304] 0 2024-09-18T12:49:15.174 INFO:tasks.workunit.client.1.smithi148.stdout:9/475: chown d8/d33/f42 213205 1 2024-09-18T12:49:15.179 INFO:tasks.workunit.client.1.smithi148.stdout:7/523: readlink db/dc/df/l17 0 2024-09-18T12:49:15.183 INFO:tasks.workunit.client.1.smithi148.stdout:4/453: dread d15/f53 [0,4194304] 0 2024-09-18T12:49:15.234 INFO:tasks.workunit.client.1.smithi148.stdout:5/533: sync 2024-09-18T12:49:15.234 INFO:tasks.workunit.client.1.smithi148.stdout:2/427: sync 2024-09-18T12:49:15.234 INFO:tasks.workunit.client.1.smithi148.stdout:0/654: sync 2024-09-18T12:49:15.239 INFO:tasks.workunit.client.1.smithi148.stdout:5/534: dwrite d7/d2b/f81 [0,4194304] 0 2024-09-18T12:49:15.265 INFO:tasks.workunit.client.0.smithi078.stdout:3/333: sync 2024-09-18T12:49:15.268 INFO:tasks.workunit.client.1.smithi148.stdout:1/478: read dc/d11/f16 [254589,88338] 0 2024-09-18T12:49:15.268 INFO:tasks.workunit.client.0.smithi078.stdout:6/492: creat d10/d2b/d43/d53/d45/fa0 x:0 0 0 2024-09-18T12:49:15.269 INFO:tasks.workunit.client.1.smithi148.stdout:9/476: chown d8/da/dd/d4a/d27/c7d 91193981 1 2024-09-18T12:49:15.273 INFO:tasks.workunit.client.0.smithi078.stdout:1/332: write d0/d8/da/d3e/f4f [247115,112828] 0 2024-09-18T12:49:15.274 INFO:tasks.workunit.client.1.smithi148.stdout:7/524: fdatasync db/d52/d25/d38/f3f 0 2024-09-18T12:49:15.277 INFO:tasks.workunit.client.1.smithi148.stdout:4/454: mkdir d15/d17/d52/d92/d4c/d4f/d64/d9a 0 2024-09-18T12:49:15.278 INFO:tasks.workunit.client.1.smithi148.stdout:3/462: dwrite d4/d8/f35 [0,4194304] 0 2024-09-18T12:49:15.280 INFO:tasks.workunit.client.0.smithi078.stdout:7/224: mkdir d7/d9/d14/d22/d35/d49 0 2024-09-18T12:49:15.283 INFO:tasks.workunit.client.1.smithi148.stdout:2/428: dwrite d9/d24/f32 [0,4194304] 0 2024-09-18T12:49:15.283 INFO:tasks.workunit.client.1.smithi148.stdout:2/429: chown d9/d24/f32 1010064 1 2024-09-18T12:49:15.285 INFO:tasks.workunit.client.0.smithi078.stdout:3/334: mkdir d9/d54/d6c 0 2024-09-18T12:49:15.289 INFO:tasks.workunit.client.0.smithi078.stdout:6/493: mkdir d10/d2b/d43/d53/d63/d6b/da1 0 2024-09-18T12:49:15.290 INFO:tasks.workunit.client.0.smithi078.stdout:6/494: write d10/d2b/d43/d53/f42 [2392434,128067] 0 2024-09-18T12:49:15.291 INFO:tasks.workunit.client.0.smithi078.stdout:9/281: link d5/d7/f1e d5/d7/d32/f56 0 2024-09-18T12:49:15.292 INFO:tasks.workunit.client.0.smithi078.stdout:9/282: stat d5/d40 0 2024-09-18T12:49:15.292 INFO:tasks.workunit.client.0.smithi078.stdout:6/495: fdatasync d10/d2b/d43/f64 0 2024-09-18T12:49:15.295 INFO:tasks.workunit.client.0.smithi078.stdout:1/333: creat d0/d37/f64 x:0 0 0 2024-09-18T12:49:15.296 INFO:tasks.workunit.client.0.smithi078.stdout:1/334: write d0/d8/da/d3e/d50/d60/f61 [406844,91477] 0 2024-09-18T12:49:15.297 INFO:tasks.workunit.client.1.smithi148.stdout:8/562: link d8/d16/d53/d39/d3b/f6a d8/df/d3e/d82/d8f/d95/fc2 0 2024-09-18T12:49:15.302 INFO:tasks.workunit.client.0.smithi078.stdout:0/418: creat d3/d1f/d2e/d8f/d90/f9b x:0 0 0 2024-09-18T12:49:15.305 INFO:tasks.workunit.client.1.smithi148.stdout:6/508: write d5/d1a/dc/d2b/d9b/f9e [4678987,77483] 0 2024-09-18T12:49:15.305 INFO:tasks.workunit.client.0.smithi078.stdout:7/225: creat d7/d3c/d47/f4a x:0 0 0 2024-09-18T12:49:15.308 INFO:tasks.workunit.client.0.smithi078.stdout:7/226: readlink d7/d9/l16 0 2024-09-18T12:49:15.308 INFO:tasks.workunit.client.1.smithi148.stdout:3/463: write d4/d8/d20/d2b/f71 [577917,60780] 0 2024-09-18T12:49:15.309 INFO:tasks.workunit.client.1.smithi148.stdout:0/655: creat de/d14/d43/dd6/fdd x:0 0 0 2024-09-18T12:49:15.314 INFO:tasks.workunit.client.1.smithi148.stdout:5/535: mkdir d7/d8/db2 0 2024-09-18T12:49:15.316 INFO:tasks.workunit.client.1.smithi148.stdout:1/479: creat dc/d11/d96/fa1 x:0 0 0 2024-09-18T12:49:15.317 INFO:tasks.workunit.client.0.smithi078.stdout:0/419: dread d3/f17 [0,4194304] 0 2024-09-18T12:49:15.318 INFO:tasks.workunit.client.0.smithi078.stdout:5/453: rmdir d2/d4/d9/da/d60/d61/d83 0 2024-09-18T12:49:15.320 INFO:tasks.workunit.client.1.smithi148.stdout:8/563: creat d8/df/db2/fc3 x:0 0 0 2024-09-18T12:49:15.320 INFO:tasks.workunit.client.1.smithi148.stdout:8/564: truncate d8/f2f 5714802 0 2024-09-18T12:49:15.321 INFO:tasks.workunit.client.1.smithi148.stdout:7/525: getdents db/dc/df/d1d/d68/d82 0 2024-09-18T12:49:15.321 INFO:tasks.workunit.client.1.smithi148.stdout:7/526: fdatasync db/dc/df/d2c/d55/f8b 0 2024-09-18T12:49:15.323 INFO:tasks.workunit.client.0.smithi078.stdout:8/319: rename d0/d7/dc/d1f/d23/d29 to d0/d7/dc/d5d 0 2024-09-18T12:49:15.329 INFO:tasks.workunit.client.0.smithi078.stdout:9/283: link d5/d7/d32/d2a/f4b d5/d40/d4e/f57 0 2024-09-18T12:49:15.330 INFO:tasks.workunit.client.1.smithi148.stdout:3/464: symlink d4/d8/d20/d2b/d43/d61/la7 0 2024-09-18T12:49:15.331 INFO:tasks.workunit.client.0.smithi078.stdout:0/420: write d3/f20 [6274435,122038] 0 2024-09-18T12:49:15.332 INFO:tasks.workunit.client.0.smithi078.stdout:0/421: write d3/d1f/f63 [4246453,37872] 0 2024-09-18T12:49:15.333 INFO:tasks.workunit.client.0.smithi078.stdout:5/454: unlink d2/d4/d9/d2f/f6f 0 2024-09-18T12:49:15.334 INFO:tasks.workunit.client.0.smithi078.stdout:0/422: fsync d3/d1f/d2e/d4e/f98 0 2024-09-18T12:49:15.334 INFO:tasks.workunit.client.1.smithi148.stdout:4/455: dwrite d15/d17/d52/f66 [0,4194304] 0 2024-09-18T12:49:15.334 INFO:tasks.workunit.client.1.smithi148.stdout:2/430: mknod d9/d24/d31/c93 0 2024-09-18T12:49:15.335 INFO:tasks.workunit.client.1.smithi148.stdout:4/456: chown d15/d5f/d69/f8c 46913 1 2024-09-18T12:49:15.339 INFO:tasks.workunit.client.0.smithi078.stdout:8/320: truncate d0/d7/f2c 1864157 0 2024-09-18T12:49:15.342 INFO:tasks.workunit.client.0.smithi078.stdout:3/335: link d9/d13/d33/d4e/f25 d9/d29/f6d 0 2024-09-18T12:49:15.343 INFO:tasks.workunit.client.0.smithi078.stdout:3/336: truncate d9/d2f/f38 1110523 0 2024-09-18T12:49:15.343 INFO:tasks.workunit.client.1.smithi148.stdout:8/565: mknod d8/d16/d53/cc4 0 2024-09-18T12:49:15.347 INFO:tasks.workunit.client.1.smithi148.stdout:6/509: creat d5/d1a/dc/d2b/d35/d9c/f9f x:0 0 0 2024-09-18T12:49:15.352 INFO:tasks.workunit.client.0.smithi078.stdout:6/496: dwrite f9 [0,4194304] 0 2024-09-18T12:49:15.352 INFO:tasks.workunit.client.1.smithi148.stdout:2/431: fsync d9/d24/d31/d34/f35 0 2024-09-18T12:49:15.355 INFO:tasks.workunit.client.0.smithi078.stdout:3/337: dwrite d9/d13/d33/d3c/d19/f49 [0,4194304] 0 2024-09-18T12:49:15.355 INFO:tasks.workunit.client.1.smithi148.stdout:5/536: write d7/d8/dc/d12/f51 [1888994,75743] 0 2024-09-18T12:49:15.356 INFO:tasks.workunit.client.1.smithi148.stdout:5/537: fsync d7/f1b 0 2024-09-18T12:49:15.357 INFO:tasks.workunit.client.0.smithi078.stdout:8/321: creat d0/d7/d53/f5e x:0 0 0 2024-09-18T12:49:15.358 INFO:tasks.workunit.client.1.smithi148.stdout:1/480: rename dc/d18/d7d/d7e/f89 to dc/d18/d8a/fa2 0 2024-09-18T12:49:15.358 INFO:tasks.workunit.client.1.smithi148.stdout:9/477: getdents d8/da/dd/d4a/d49/d46 0 2024-09-18T12:49:15.362 INFO:tasks.workunit.client.0.smithi078.stdout:7/227: getdents d7/d9/d32/d3b 0 2024-09-18T12:49:15.362 INFO:tasks.workunit.client.0.smithi078.stdout:7/228: truncate d7/d3c/d47/f4a 839696 0 2024-09-18T12:49:15.363 INFO:tasks.workunit.client.1.smithi148.stdout:0/656: creat de/d14/fde x:0 0 0 2024-09-18T12:49:15.363 INFO:tasks.workunit.client.0.smithi078.stdout:7/229: stat d7/d9/d14/d22/d3e 0 2024-09-18T12:49:15.365 INFO:tasks.workunit.client.0.smithi078.stdout:7/230: write d7/d9/d14/f25 [2767798,104703] 0 2024-09-18T12:49:15.373 INFO:tasks.workunit.client.0.smithi078.stdout:7/231: dwrite d7/d9/f10 [0,4194304] 0 2024-09-18T12:49:15.374 INFO:tasks.workunit.client.0.smithi078.stdout:8/322: truncate d0/f16 61311 0 2024-09-18T12:49:15.375 INFO:tasks.workunit.client.1.smithi148.stdout:4/457: mkdir d15/d3f/d81/d9b 0 2024-09-18T12:49:15.377 INFO:tasks.workunit.client.0.smithi078.stdout:1/335: rename d0/d8/da/d3e/d46/d52/c53 to d0/d8/da/c65 0 2024-09-18T12:49:15.379 INFO:tasks.workunit.client.0.smithi078.stdout:1/336: read d0/d8/da/f5f [2234099,35055] 0 2024-09-18T12:49:15.379 INFO:tasks.workunit.client.1.smithi148.stdout:2/432: mkdir d9/d3a/d90/d94 0 2024-09-18T12:49:15.381 INFO:tasks.workunit.client.1.smithi148.stdout:3/465: dread d4/d8/d20/d2b/f3a [0,4194304] 0 2024-09-18T12:49:15.385 INFO:tasks.workunit.client.1.smithi148.stdout:5/538: creat d7/d8/dc/d12/d31/d5a/fb3 x:0 0 0 2024-09-18T12:49:15.385 INFO:tasks.workunit.client.1.smithi148.stdout:5/539: truncate d7/f8c 614422 0 2024-09-18T12:49:15.386 INFO:tasks.workunit.client.1.smithi148.stdout:5/540: truncate d7/d8/f83 1333095 0 2024-09-18T12:49:15.387 INFO:tasks.workunit.client.1.smithi148.stdout:5/541: dread - d7/d8/dc/d12/d97/fac zero size 2024-09-18T12:49:15.388 INFO:tasks.workunit.client.0.smithi078.stdout:5/455: dwrite d2/d4/d9/f2a [0,4194304] 0 2024-09-18T12:49:15.389 INFO:tasks.workunit.client.1.smithi148.stdout:9/478: mkdir d8/da/dd/d4a/d49/d46/d54/d90 0 2024-09-18T12:49:15.392 INFO:tasks.workunit.client.1.smithi148.stdout:8/566: mkdir d8/d16/d27/dc5 0 2024-09-18T12:49:15.394 INFO:tasks.workunit.client.1.smithi148.stdout:9/479: dread d8/da/dd/d65/f76 [0,4194304] 0 2024-09-18T12:49:15.395 INFO:tasks.workunit.client.1.smithi148.stdout:0/657: chown de/d14/c5d 65859 1 2024-09-18T12:49:15.397 INFO:tasks.workunit.client.1.smithi148.stdout:7/527: sync 2024-09-18T12:49:15.398 INFO:tasks.workunit.client.1.smithi148.stdout:7/528: write db/dc/df/d2c/d55/f8b [811017,129828] 0 2024-09-18T12:49:15.404 INFO:tasks.workunit.client.0.smithi078.stdout:3/338: truncate d9/f12 3399436 0 2024-09-18T12:49:15.406 INFO:tasks.workunit.client.0.smithi078.stdout:8/323: symlink d0/d7/dc/d1f/d23/d40/l5f 0 2024-09-18T12:49:15.407 INFO:tasks.workunit.client.1.smithi148.stdout:3/466: write d4/d8/d1e/d6b/d31/d54/f67 [1056328,97875] 0 2024-09-18T12:49:15.408 INFO:tasks.workunit.client.0.smithi078.stdout:5/456: mknod d2/d4/d9/da/d60/d61/c8d 0 2024-09-18T12:49:15.414 INFO:tasks.workunit.client.1.smithi148.stdout:8/567: read d8/d16/d53/d39/d3b/f6a [792120,34732] 0 2024-09-18T12:49:15.415 INFO:tasks.workunit.client.1.smithi148.stdout:6/510: dwrite d5/d32/d38/d50/f52 [0,4194304] 0 2024-09-18T12:49:15.415 INFO:tasks.workunit.client.1.smithi148.stdout:8/568: readlink d8/d12/l1a 0 2024-09-18T12:49:15.416 INFO:tasks.workunit.client.0.smithi078.stdout:1/337: creat d0/d8/da/d3e/d46/d52/d47/f66 x:0 0 0 2024-09-18T12:49:15.417 INFO:tasks.workunit.client.1.smithi148.stdout:9/480: creat d8/da/dd/d4a/d49/d46/f91 x:0 0 0 2024-09-18T12:49:15.418 INFO:tasks.workunit.client.0.smithi078.stdout:6/497: getdents d10/d2b/d43 0 2024-09-18T12:49:15.421 INFO:tasks.workunit.client.0.smithi078.stdout:3/339: mknod d9/d29/d4b/c6e 0 2024-09-18T12:49:15.422 INFO:tasks.workunit.client.1.smithi148.stdout:8/569: dwrite d8/fb [0,4194304] 0 2024-09-18T12:49:15.422 INFO:tasks.workunit.client.0.smithi078.stdout:3/340: write d9/f3f [2297353,76637] 0 2024-09-18T12:49:15.423 INFO:tasks.workunit.client.0.smithi078.stdout:8/324: fsync d0/f1a 0 2024-09-18T12:49:15.427 INFO:tasks.workunit.client.1.smithi148.stdout:3/467: mknod d4/d8/d20/d2b/d43/ca8 0 2024-09-18T12:49:15.428 INFO:tasks.workunit.client.0.smithi078.stdout:5/457: truncate d2/d4/d12/d16/d36/f5c 1649436 0 2024-09-18T12:49:15.428 INFO:tasks.workunit.client.1.smithi148.stdout:1/481: creat dc/d11/d38/d87/fa3 x:0 0 0 2024-09-18T12:49:15.428 INFO:tasks.workunit.client.1.smithi148.stdout:1/482: chown dc/d18/f3d 201 1 2024-09-18T12:49:15.429 INFO:tasks.workunit.client.0.smithi078.stdout:7/232: link d7/d9/d14/c37 d7/d9/d14/c4b 0 2024-09-18T12:49:15.430 INFO:tasks.workunit.client.0.smithi078.stdout:3/341: dwrite d9/d13/d33/d34/f48 [0,4194304] 0 2024-09-18T12:49:15.432 INFO:tasks.workunit.client.0.smithi078.stdout:3/342: write d9/f59 [346972,107611] 0 2024-09-18T12:49:15.434 INFO:tasks.workunit.client.1.smithi148.stdout:5/542: symlink d7/d8/dc/d12/d31/d5a/d98/lb4 0 2024-09-18T12:49:15.437 INFO:tasks.workunit.client.0.smithi078.stdout:3/343: dread d9/d2f/f3d [4194304,4194304] 0 2024-09-18T12:49:15.437 INFO:tasks.workunit.client.1.smithi148.stdout:0/658: fdatasync de/d14/f3d 0 2024-09-18T12:49:15.441 INFO:tasks.workunit.client.0.smithi078.stdout:5/458: stat d2/d4/d12/d16/d36/d4c/d62/l6b 0 2024-09-18T12:49:15.445 INFO:tasks.workunit.client.0.smithi078.stdout:6/498: creat d10/d2b/d43/d53/d63/d70/d7d/fa2 x:0 0 0 2024-09-18T12:49:15.445 INFO:tasks.workunit.client.1.smithi148.stdout:9/481: symlink d8/da/dd/d35/d47/d62/d72/l92 0 2024-09-18T12:49:15.448 INFO:tasks.workunit.client.0.smithi078.stdout:6/499: write d10/d2b/d43/d53/f4d [1271455,49684] 0 2024-09-18T12:49:15.450 INFO:tasks.workunit.client.0.smithi078.stdout:8/325: creat d0/d7/f60 x:0 0 0 2024-09-18T12:49:15.452 INFO:tasks.workunit.client.0.smithi078.stdout:8/326: dread - d0/d7/f55 zero size 2024-09-18T12:49:15.454 INFO:tasks.workunit.client.1.smithi148.stdout:5/543: dread d7/f4f [0,4194304] 0 2024-09-18T12:49:15.454 INFO:tasks.workunit.client.1.smithi148.stdout:7/529: mknod db/dc/df/d5f/c99 0 2024-09-18T12:49:15.455 INFO:tasks.workunit.client.1.smithi148.stdout:4/458: rename d15/d17/d52/d92/d4c/d4f/d34/f6b to d15/d17/d52/d92/d4c/d4f/f9c 0 2024-09-18T12:49:15.455 INFO:tasks.workunit.client.1.smithi148.stdout:7/530: readlink db/dc/df/l50 0 2024-09-18T12:49:15.457 INFO:tasks.workunit.client.1.smithi148.stdout:4/459: truncate d15/d17/d52/d92/d4c/f67 423043 0 2024-09-18T12:49:15.457 INFO:tasks.workunit.client.0.smithi078.stdout:9/284: rename d5/d7/d32/l49 to d5/d7/l58 0 2024-09-18T12:49:15.460 INFO:tasks.workunit.client.0.smithi078.stdout:7/233: symlink d7/d9/d14/d22/d3e/l4c 0 2024-09-18T12:49:15.461 INFO:tasks.workunit.client.0.smithi078.stdout:9/285: chown f3 8137 1 2024-09-18T12:49:15.461 INFO:tasks.workunit.client.1.smithi148.stdout:1/483: symlink dc/d18/d31/la4 0 2024-09-18T12:49:15.462 INFO:tasks.workunit.client.0.smithi078.stdout:6/500: fsync d10/d2b/f44 0 2024-09-18T12:49:15.465 INFO:tasks.workunit.client.1.smithi148.stdout:9/482: symlink d8/da/dd/d65/l93 0 2024-09-18T12:49:15.466 INFO:tasks.workunit.client.0.smithi078.stdout:1/338: dread d0/f4b [0,4194304] 0 2024-09-18T12:49:15.467 INFO:tasks.workunit.client.0.smithi078.stdout:8/327: dwrite d0/d7/dc/f3c [0,4194304] 0 2024-09-18T12:49:15.468 INFO:tasks.workunit.client.0.smithi078.stdout:0/423: rename d3/f20 to d3/d1f/d2e/d4e/f9c 0 2024-09-18T12:49:15.475 INFO:tasks.workunit.client.0.smithi078.stdout:0/424: truncate d3/d1f/d2e/d4e/d37/d72/f78 1576714 0 2024-09-18T12:49:15.477 INFO:tasks.workunit.client.1.smithi148.stdout:2/433: getdents d9/d24/d47 0 2024-09-18T12:49:15.478 INFO:tasks.workunit.client.1.smithi148.stdout:2/434: fsync d9/d24/d31/f8a 0 2024-09-18T12:49:15.478 INFO:tasks.workunit.client.0.smithi078.stdout:5/459: creat d2/d4/d12/f8e x:0 0 0 2024-09-18T12:49:15.479 INFO:tasks.workunit.client.1.smithi148.stdout:6/511: dwrite d5/d1a/dc/f6d [0,4194304] 0 2024-09-18T12:49:15.479 INFO:tasks.workunit.client.1.smithi148.stdout:2/435: stat d9/d17/d29/c59 0 2024-09-18T12:49:15.480 INFO:tasks.workunit.client.1.smithi148.stdout:4/460: chown d15/d17/d52/d92/d4c/d4f/c31 51666094 1 2024-09-18T12:49:15.481 INFO:tasks.workunit.client.0.smithi078.stdout:8/328: unlink d0/d7/f8 0 2024-09-18T12:49:15.483 INFO:tasks.workunit.client.0.smithi078.stdout:3/344: write d9/d13/f1d [1141669,129694] 0 2024-09-18T12:49:15.484 INFO:tasks.workunit.client.0.smithi078.stdout:3/345: readlink d9/d13/d33/d34/l52 0 2024-09-18T12:49:15.485 INFO:tasks.workunit.client.0.smithi078.stdout:3/346: fsync d9/d13/d33/d3c/d19/f22 0 2024-09-18T12:49:15.486 INFO:tasks.workunit.client.0.smithi078.stdout:3/347: chown d9/d13/d33/l58 6 1 2024-09-18T12:49:15.487 INFO:tasks.workunit.client.0.smithi078.stdout:1/339: unlink d0/d8/da/d3e/d50/d60/f61 0 2024-09-18T12:49:15.489 INFO:tasks.workunit.client.0.smithi078.stdout:5/460: dread d2/d4/d9/da/f5a [0,4194304] 0 2024-09-18T12:49:15.489 INFO:tasks.workunit.client.1.smithi148.stdout:1/484: mkdir dc/d5b/da5 0 2024-09-18T12:49:15.490 INFO:tasks.workunit.client.1.smithi148.stdout:3/468: write d4/f5 [6322817,55551] 0 2024-09-18T12:49:15.491 INFO:tasks.workunit.client.1.smithi148.stdout:0/659: write de/d14/d43/d70/f90 [464087,43856] 0 2024-09-18T12:49:15.492 INFO:tasks.workunit.client.0.smithi078.stdout:0/425: readlink d3/l15 0 2024-09-18T12:49:15.493 INFO:tasks.workunit.client.1.smithi148.stdout:0/660: write de/d14/fcf [457004,88742] 0 2024-09-18T12:49:15.495 INFO:tasks.workunit.client.0.smithi078.stdout:7/234: write d7/f1d [5563,119849] 0 2024-09-18T12:49:15.496 INFO:tasks.workunit.client.1.smithi148.stdout:5/544: creat d7/d8/db2/fb5 x:0 0 0 2024-09-18T12:49:15.498 INFO:tasks.workunit.client.0.smithi078.stdout:8/329: creat d0/d7/d1e/d4b/f61 x:0 0 0 2024-09-18T12:49:15.501 INFO:tasks.workunit.client.1.smithi148.stdout:4/461: dread f9 [0,4194304] 0 2024-09-18T12:49:15.503 INFO:tasks.workunit.client.0.smithi078.stdout:1/340: write d0/d8/f14 [3688626,92066] 0 2024-09-18T12:49:15.504 INFO:tasks.workunit.client.1.smithi148.stdout:9/483: link d8/f5c d8/da/dd/d35/d47/f94 0 2024-09-18T12:49:15.506 INFO:tasks.workunit.client.0.smithi078.stdout:5/461: unlink d2/c39 0 2024-09-18T12:49:15.509 INFO:tasks.workunit.client.0.smithi078.stdout:9/286: rename d5/f17 to d5/d7/d32/d2a/f59 0 2024-09-18T12:49:15.512 INFO:tasks.workunit.client.1.smithi148.stdout:8/570: rename d8/df/d3e/f99 to d8/d16/fc6 0 2024-09-18T12:49:15.513 INFO:tasks.workunit.client.0.smithi078.stdout:1/341: dwrite d0/d8/da/f35 [0,4194304] 0 2024-09-18T12:49:15.513 INFO:tasks.workunit.client.1.smithi148.stdout:5/545: symlink d7/d8/dc/d12/d31/d6c/lb6 0 2024-09-18T12:49:15.517 INFO:tasks.workunit.client.1.smithi148.stdout:6/512: write d5/d1a/dc/d2b/d35/f69 [202665,108963] 0 2024-09-18T12:49:15.518 INFO:tasks.workunit.client.0.smithi078.stdout:7/235: mkdir d7/d9/d4d 0 2024-09-18T12:49:15.518 INFO:tasks.workunit.client.1.smithi148.stdout:8/571: dwrite d8/d16/faf [0,4194304] 0 2024-09-18T12:49:15.519 INFO:tasks.workunit.client.1.smithi148.stdout:1/485: write dc/d11/f16 [77144,25815] 0 2024-09-18T12:49:15.521 INFO:tasks.workunit.client.0.smithi078.stdout:6/501: link d10/d2b/d43/f6f d10/d2b/d43/d53/d63/d70/d77/fa3 0 2024-09-18T12:49:15.521 INFO:tasks.workunit.client.1.smithi148.stdout:4/462: rmdir d15/d17/d52/d92/d4c/d4f/d34 39 2024-09-18T12:49:15.522 INFO:tasks.workunit.client.1.smithi148.stdout:9/484: symlink d8/d73/l95 0 2024-09-18T12:49:15.525 INFO:tasks.workunit.client.1.smithi148.stdout:2/436: rename d9/d4a to d9/d17/d29/d92/d95 0 2024-09-18T12:49:15.526 INFO:tasks.workunit.client.0.smithi078.stdout:3/348: rename d9/d13/d33/d3c/cd to d9/d13/d33/d3c/d19/c6f 0 2024-09-18T12:49:15.527 INFO:tasks.workunit.client.1.smithi148.stdout:4/463: rename d15/d17/d52 to d15/d17/d52/d92/d4c/d4f/d64/d9a/d9d 22 2024-09-18T12:49:15.527 INFO:tasks.workunit.client.1.smithi148.stdout:6/513: dwrite d5/d32/f76 [0,4194304] 0 2024-09-18T12:49:15.527 INFO:tasks.workunit.client.0.smithi078.stdout:3/349: chown d9/d13/f5f 54484336 1 2024-09-18T12:49:15.528 INFO:tasks.workunit.client.1.smithi148.stdout:4/464: chown d15/d17/d52/d92 4519 1 2024-09-18T12:49:15.531 INFO:tasks.workunit.client.0.smithi078.stdout:0/426: creat d3/d1f/d2e/d4e/d37/d72/d96/f9d x:0 0 0 2024-09-18T12:49:15.532 INFO:tasks.workunit.client.0.smithi078.stdout:4/298: sync 2024-09-18T12:49:15.534 INFO:tasks.workunit.client.0.smithi078.stdout:8/330: mkdir d0/d7/d1e/d33/d52/d62 0 2024-09-18T12:49:15.534 INFO:tasks.workunit.client.0.smithi078.stdout:8/331: fdatasync d0/d7/d1e/d4b/f61 0 2024-09-18T12:49:15.535 INFO:tasks.workunit.client.1.smithi148.stdout:1/486: unlink dc/d11/d38/d87/fa3 0 2024-09-18T12:49:15.536 INFO:tasks.workunit.client.1.smithi148.stdout:4/465: dwrite d15/d17/d52/d92/d4c/d4f/f8a [0,4194304] 0 2024-09-18T12:49:15.536 INFO:tasks.workunit.client.0.smithi078.stdout:7/236: mkdir d7/d9/d32/d3b/d4e 0 2024-09-18T12:49:15.538 INFO:tasks.workunit.client.0.smithi078.stdout:6/502: rmdir d10/d2b/d43/d53/d45/d55/d3f 39 2024-09-18T12:49:15.540 INFO:tasks.workunit.client.0.smithi078.stdout:5/462: mkdir d2/d4/d55/d8f 0 2024-09-18T12:49:15.542 INFO:tasks.workunit.client.1.smithi148.stdout:0/661: truncate de/f9b 3685380 0 2024-09-18T12:49:15.545 INFO:tasks.workunit.client.0.smithi078.stdout:1/342: rename d0/d8/f14 to d0/d8/da/d3e/f67 0 2024-09-18T12:49:15.546 INFO:tasks.workunit.client.1.smithi148.stdout:6/514: unlink d5/d79/d7c/l87 0 2024-09-18T12:49:15.550 INFO:tasks.workunit.client.1.smithi148.stdout:8/572: mkdir d8/d12/d51/dc7 0 2024-09-18T12:49:15.552 INFO:tasks.workunit.client.0.smithi078.stdout:0/427: stat d3/c7 0 2024-09-18T12:49:15.552 INFO:tasks.workunit.client.0.smithi078.stdout:3/350: dwrite f7 [4194304,4194304] 0 2024-09-18T12:49:15.558 INFO:tasks.workunit.client.0.smithi078.stdout:7/237: mkdir d7/d26/d4f 0 2024-09-18T12:49:15.558 INFO:tasks.workunit.client.0.smithi078.stdout:9/287: dwrite d5/f15 [0,4194304] 0 2024-09-18T12:49:15.561 INFO:tasks.workunit.client.0.smithi078.stdout:6/503: mknod d10/d2b/d43/d53/d63/d70/d7d/ca4 0 2024-09-18T12:49:15.564 INFO:tasks.workunit.client.1.smithi148.stdout:9/485: symlink d8/da/dd/l96 0 2024-09-18T12:49:15.565 INFO:tasks.workunit.client.1.smithi148.stdout:9/486: readlink d8/da/dd/d4a/d27/l4f 0 2024-09-18T12:49:15.565 INFO:tasks.workunit.client.0.smithi078.stdout:5/463: unlink d2/d4/d9/da/f5a 0 2024-09-18T12:49:15.568 INFO:tasks.workunit.client.1.smithi148.stdout:6/515: dread d5/d32/d38/d50/f61 [0,4194304] 0 2024-09-18T12:49:15.568 INFO:tasks.workunit.client.1.smithi148.stdout:0/662: unlink de/d27/d7a/la6 0 2024-09-18T12:49:15.569 INFO:tasks.workunit.client.1.smithi148.stdout:5/546: link d7/d8/dc/c57 d7/d8/dc/d12/d1f/d77/cb7 0 2024-09-18T12:49:15.570 INFO:tasks.workunit.client.1.smithi148.stdout:0/663: write de/d14/d43/d70/f90 [1277438,70955] 0 2024-09-18T12:49:15.570 INFO:tasks.workunit.client.1.smithi148.stdout:5/547: fsync d7/d8/f83 0 2024-09-18T12:49:15.570 INFO:tasks.workunit.client.0.smithi078.stdout:1/343: rename d0/d8/da/c44 to d0/d8/da/d3e/d46/c68 0 2024-09-18T12:49:15.571 INFO:tasks.workunit.client.0.smithi078.stdout:1/344: stat d0/d8/da/c1b 0 2024-09-18T12:49:15.571 INFO:tasks.workunit.client.0.smithi078.stdout:3/351: readlink d9/d2f/l64 0 2024-09-18T12:49:15.571 INFO:tasks.workunit.client.0.smithi078.stdout:1/345: readlink d0/l62 0 2024-09-18T12:49:15.572 INFO:tasks.workunit.client.1.smithi148.stdout:1/487: unlink dc/d18/l71 0 2024-09-18T12:49:15.572 INFO:tasks.workunit.client.1.smithi148.stdout:1/488: readlink dc/l28 0 2024-09-18T12:49:15.573 INFO:tasks.workunit.client.0.smithi078.stdout:0/428: unlink d3/d1f/d2e/d68/d30/c6b 0 2024-09-18T12:49:15.573 INFO:tasks.workunit.client.0.smithi078.stdout:0/429: fdatasync d3/f7b 0 2024-09-18T12:49:15.574 INFO:tasks.workunit.client.1.smithi148.stdout:9/487: mkdir d8/da/dd/d4a/d49/d46/d75/d97 0 2024-09-18T12:49:15.576 INFO:tasks.workunit.client.0.smithi078.stdout:7/238: rmdir d7/d9/d32/d3b 39 2024-09-18T12:49:15.578 INFO:tasks.workunit.client.0.smithi078.stdout:6/504: truncate d10/d2b/d43/d53/d45/d55/f4f 729761 0 2024-09-18T12:49:15.580 INFO:tasks.workunit.client.1.smithi148.stdout:6/516: rename d5/d1a/dc/d2b/d35/l9a to d5/d1a/d29/la0 0 2024-09-18T12:49:15.581 INFO:tasks.workunit.client.1.smithi148.stdout:7/531: sync 2024-09-18T12:49:15.581 INFO:tasks.workunit.client.1.smithi148.stdout:7/532: chown db/dc/df/d11/c39 278641671 1 2024-09-18T12:49:15.582 INFO:tasks.workunit.client.1.smithi148.stdout:7/533: dread - db/dc/df/f8f zero size 2024-09-18T12:49:15.582 INFO:tasks.workunit.client.0.smithi078.stdout:7/239: dwrite d7/d26/f42 [0,4194304] 0 2024-09-18T12:49:15.587 INFO:tasks.workunit.client.1.smithi148.stdout:5/548: stat d7/d8/dc/f2a 0 2024-09-18T12:49:15.589 INFO:tasks.workunit.client.0.smithi078.stdout:4/299: creat d11/d1f/f67 x:0 0 0 2024-09-18T12:49:15.590 INFO:tasks.workunit.client.0.smithi078.stdout:8/332: write d0/f1 [336093,94892] 0 2024-09-18T12:49:15.593 INFO:tasks.workunit.client.1.smithi148.stdout:9/488: write d8/da/dd/d35/d81/f8e [3792043,65596] 0 2024-09-18T12:49:15.594 INFO:tasks.workunit.client.1.smithi148.stdout:9/489: write d8/f16 [957200,30561] 0 2024-09-18T12:49:15.594 INFO:tasks.workunit.client.1.smithi148.stdout:6/517: mkdir d5/d1a/d29/d5c/da1 0 2024-09-18T12:49:15.597 INFO:tasks.workunit.client.0.smithi078.stdout:8/333: dwrite d0/d7/dc/f26 [0,4194304] 0 2024-09-18T12:49:15.597 INFO:tasks.workunit.client.0.smithi078.stdout:6/505: creat d10/d2b/d43/d53/d63/d70/d7d/fa5 x:0 0 0 2024-09-18T12:49:15.598 INFO:tasks.workunit.client.0.smithi078.stdout:6/506: write d10/f1e [6251904,124937] 0 2024-09-18T12:49:15.599 INFO:tasks.workunit.client.1.smithi148.stdout:7/534: creat db/dc/df/d11/d43/f9a x:0 0 0 2024-09-18T12:49:15.602 INFO:tasks.workunit.client.1.smithi148.stdout:0/664: dwrite f9 [0,4194304] 0 2024-09-18T12:49:15.602 INFO:tasks.workunit.client.1.smithi148.stdout:8/573: creat d8/df/fc8 x:0 0 0 2024-09-18T12:49:15.603 INFO:tasks.workunit.client.0.smithi078.stdout:5/464: mkdir d2/d4/d12/d16/d36/d68/d8b/d90 0 2024-09-18T12:49:15.603 INFO:tasks.workunit.client.1.smithi148.stdout:6/518: dwrite d5/d1a/d29/f6e [0,4194304] 0 2024-09-18T12:49:15.605 INFO:tasks.workunit.client.0.smithi078.stdout:2/297: sync 2024-09-18T12:49:15.606 INFO:tasks.workunit.client.1.smithi148.stdout:5/549: mkdir d7/d8/dc/db8 0 2024-09-18T12:49:15.608 INFO:tasks.workunit.client.1.smithi148.stdout:4/466: getdents d15/d17/d52/d68 0 2024-09-18T12:49:15.609 INFO:tasks.workunit.client.0.smithi078.stdout:0/430: mknod d3/d1f/d2e/d68/c9e 0 2024-09-18T12:49:15.609 INFO:tasks.workunit.client.1.smithi148.stdout:9/490: chown d8/d33/c4c 2040 1 2024-09-18T12:49:15.610 INFO:tasks.workunit.client.1.smithi148.stdout:7/535: dwrite db/dc/df/d2c/d55/f6e [0,4194304] 0 2024-09-18T12:49:15.611 INFO:tasks.workunit.client.1.smithi148.stdout:9/491: write d8/da/dd/d4a/f18 [168567,35164] 0 2024-09-18T12:49:15.612 INFO:tasks.workunit.client.0.smithi078.stdout:6/507: dwrite d10/d2b/d43/d53/d63/d70/d77/f91 [0,4194304] 0 2024-09-18T12:49:15.613 INFO:tasks.workunit.client.0.smithi078.stdout:9/288: creat d5/d7/f5a x:0 0 0 2024-09-18T12:49:15.614 INFO:tasks.workunit.client.0.smithi078.stdout:9/289: chown d5/d7/d8/f27 455045 1 2024-09-18T12:49:15.617 INFO:tasks.workunit.client.1.smithi148.stdout:8/574: creat d8/df/db2/fc9 x:0 0 0 2024-09-18T12:49:15.617 INFO:tasks.workunit.client.1.smithi148.stdout:0/665: fdatasync de/d27/d2e/f73 0 2024-09-18T12:49:15.618 INFO:tasks.workunit.client.0.smithi078.stdout:5/465: read d2/d4/d9/d49/f4b [3108052,30069] 0 2024-09-18T12:49:15.624 INFO:tasks.workunit.client.1.smithi148.stdout:5/550: mknod d7/d8/dc/d22/cb9 0 2024-09-18T12:49:15.625 INFO:tasks.workunit.client.0.smithi078.stdout:5/466: chown d2/d4/d9/da/c4a 0 1 2024-09-18T12:49:15.625 INFO:tasks.workunit.client.0.smithi078.stdout:7/240: creat d7/d26/d4f/f50 x:0 0 0 2024-09-18T12:49:15.630 INFO:tasks.workunit.client.0.smithi078.stdout:6/508: dwrite d10/d2b/d43/d53/d45/f62 [0,4194304] 0 2024-09-18T12:49:15.630 INFO:tasks.workunit.client.0.smithi078.stdout:5/467: fsync d2/d4/f1d 0 2024-09-18T12:49:15.631 INFO:tasks.workunit.client.0.smithi078.stdout:3/352: rename d9/d2f/f38 to d9/d2f/f70 0 2024-09-18T12:49:15.632 INFO:tasks.workunit.client.0.smithi078.stdout:6/509: stat d10/d2b/d43/f60 0 2024-09-18T12:49:15.633 INFO:tasks.workunit.client.0.smithi078.stdout:9/290: creat d5/d7/d32/f5b x:0 0 0 2024-09-18T12:49:15.635 INFO:tasks.workunit.client.0.smithi078.stdout:4/300: creat d11/d27/d60/f68 x:0 0 0 2024-09-18T12:49:15.635 INFO:tasks.workunit.client.0.smithi078.stdout:2/298: dwrite d4/db/f1c [0,4194304] 0 2024-09-18T12:49:15.636 INFO:tasks.workunit.client.1.smithi148.stdout:9/492: creat d8/da/dd/d4a/f98 x:0 0 0 2024-09-18T12:49:15.637 INFO:tasks.workunit.client.0.smithi078.stdout:5/468: chown d2/d4/d12/f40 2371 1 2024-09-18T12:49:15.637 INFO:tasks.workunit.client.1.smithi148.stdout:9/493: chown d8/da/dd/d35/d47/d62/d72 522 1 2024-09-18T12:49:15.638 INFO:tasks.workunit.client.0.smithi078.stdout:4/301: write d11/d27/d5a/f64 [586431,81199] 0 2024-09-18T12:49:15.638 INFO:tasks.workunit.client.0.smithi078.stdout:5/469: stat d2/d4/d9/da/c46 0 2024-09-18T12:49:15.639 INFO:tasks.workunit.client.0.smithi078.stdout:0/431: creat d3/d1f/d2e/d4e/d37/d72/f9f x:0 0 0 2024-09-18T12:49:15.639 INFO:tasks.workunit.client.0.smithi078.stdout:4/302: write d11/d27/f48 [1214908,94093] 0 2024-09-18T12:49:15.640 INFO:tasks.workunit.client.1.smithi148.stdout:8/575: fdatasync d8/df/d3e/d82/d8f/d95/fc2 0 2024-09-18T12:49:15.644 INFO:tasks.workunit.client.1.smithi148.stdout:1/489: link fb dc/d11/d38/d87/d2b/d80/fa6 0 2024-09-18T12:49:15.644 INFO:tasks.workunit.client.0.smithi078.stdout:7/241: truncate d7/f1e 898705 0 2024-09-18T12:49:15.645 INFO:tasks.workunit.client.1.smithi148.stdout:1/490: chown dc/d18/d31/d4b/c59 1 1 2024-09-18T12:49:15.645 INFO:tasks.workunit.client.0.smithi078.stdout:7/242: stat d7/d9/f44 0 2024-09-18T12:49:15.645 INFO:tasks.workunit.client.1.smithi148.stdout:5/551: creat d7/d8/dc/d12/d97/fba x:0 0 0 2024-09-18T12:49:15.646 INFO:tasks.workunit.client.1.smithi148.stdout:4/467: mknod d15/d3f/d81/d9b/c9e 0 2024-09-18T12:49:15.647 INFO:tasks.workunit.client.1.smithi148.stdout:3/469: sync 2024-09-18T12:49:15.647 INFO:tasks.workunit.client.0.smithi078.stdout:5/470: dwrite d2/d4/d9/d49/f56 [0,4194304] 0 2024-09-18T12:49:15.652 INFO:tasks.workunit.client.1.smithi148.stdout:1/491: dwrite dc/d18/d63/f98 [0,4194304] 0 2024-09-18T12:49:15.653 INFO:tasks.workunit.client.1.smithi148.stdout:8/576: symlink d8/d12/d51/d94/lca 0 2024-09-18T12:49:15.659 INFO:tasks.workunit.client.0.smithi078.stdout:1/346: getdents d0 0 2024-09-18T12:49:15.665 INFO:tasks.workunit.client.0.smithi078.stdout:4/303: fdatasync d11/f16 0 2024-09-18T12:49:15.666 INFO:tasks.workunit.client.0.smithi078.stdout:0/432: dwrite d3/f4b [0,4194304] 0 2024-09-18T12:49:15.666 INFO:tasks.workunit.client.0.smithi078.stdout:9/291: mkdir d5/d5c 0 2024-09-18T12:49:15.667 INFO:tasks.workunit.client.0.smithi078.stdout:9/292: chown d5/d5c 11946904 1 2024-09-18T12:49:15.673 INFO:tasks.workunit.client.0.smithi078.stdout:2/299: chown d4/dd/d18 3469 1 2024-09-18T12:49:15.675 INFO:tasks.workunit.client.0.smithi078.stdout:1/347: dwrite d0/d8/da/d3e/f42 [0,4194304] 0 2024-09-18T12:49:15.675 INFO:tasks.workunit.client.0.smithi078.stdout:5/471: unlink d2/d4/d12/d16/d36/d4c/l52 0 2024-09-18T12:49:15.676 INFO:tasks.workunit.client.0.smithi078.stdout:1/348: write d0/d8/ff [8251894,26761] 0 2024-09-18T12:49:15.677 INFO:tasks.workunit.client.0.smithi078.stdout:6/510: mkdir d10/d2b/d43/d53/d45/d55/d3f/da6 0 2024-09-18T12:49:15.683 INFO:tasks.workunit.client.0.smithi078.stdout:8/334: write d0/f16 [641448,18868] 0 2024-09-18T12:49:15.683 INFO:tasks.workunit.client.0.smithi078.stdout:7/243: creat d7/d9/d14/d22/d35/d49/f51 x:0 0 0 2024-09-18T12:49:15.689 INFO:tasks.workunit.client.0.smithi078.stdout:1/349: stat d0/d8/da/d3e/d46/d52/f2e 0 2024-09-18T12:49:15.690 INFO:tasks.workunit.client.0.smithi078.stdout:5/472: symlink d2/d4/d12/d16/d36/d68/l91 0 2024-09-18T12:49:15.692 INFO:tasks.workunit.client.0.smithi078.stdout:6/511: rmdir d10/d2b/d43 39 2024-09-18T12:49:15.697 INFO:tasks.workunit.client.1.smithi148.stdout:7/536: write db/d52/d25/d38/f49 [786259,42582] 0 2024-09-18T12:49:15.697 INFO:tasks.workunit.client.1.smithi148.stdout:1/492: dwrite dc/d11/d38/d72/f73 [0,4194304] 0 2024-09-18T12:49:15.698 INFO:tasks.workunit.client.0.smithi078.stdout:5/473: dwrite d2/d4/d9/f13 [0,4194304] 0 2024-09-18T12:49:15.698 INFO:tasks.workunit.client.1.smithi148.stdout:9/494: link d8/da/dd/d4a/f2d d8/da/dd/d3f/d5d/f99 0 2024-09-18T12:49:15.698 INFO:tasks.workunit.client.0.smithi078.stdout:0/433: rename d3/d1f/c89 to d3/d1f/d2e/d4e/d37/d72/ca0 0 2024-09-18T12:49:15.699 INFO:tasks.workunit.client.0.smithi078.stdout:5/474: read - d2/d4/f8c zero size 2024-09-18T12:49:15.700 INFO:tasks.workunit.client.1.smithi148.stdout:0/666: getdents de/d27/d53/d89/dbb/db5 0 2024-09-18T12:49:15.702 INFO:tasks.workunit.client.0.smithi078.stdout:5/475: readlink d2/d4/d12/d16/d36/d4c/l70 0 2024-09-18T12:49:15.704 INFO:tasks.workunit.client.0.smithi078.stdout:1/350: creat d0/d8/da/d3e/d46/d52/d47/f69 x:0 0 0 2024-09-18T12:49:15.704 INFO:tasks.workunit.client.1.smithi148.stdout:9/495: write d8/da/dd/d4a/d49/d46/f91 [640183,35086] 0 2024-09-18T12:49:15.705 INFO:tasks.workunit.client.1.smithi148.stdout:1/493: truncate dc/d18/d63/f94 534099 0 2024-09-18T12:49:15.707 INFO:tasks.workunit.client.1.smithi148.stdout:6/519: dwrite d5/d1a/d29/f83 [0,4194304] 0 2024-09-18T12:49:15.709 INFO:tasks.workunit.client.1.smithi148.stdout:1/494: readlink dc/d18/d31/l77 0 2024-09-18T12:49:15.709 INFO:tasks.workunit.client.1.smithi148.stdout:8/577: dwrite d8/d16/d27/f76 [0,4194304] 0 2024-09-18T12:49:15.712 INFO:tasks.workunit.client.0.smithi078.stdout:6/512: write d10/d2b/d43/d53/d63/f75 [3226286,41484] 0 2024-09-18T12:49:15.716 INFO:tasks.workunit.client.1.smithi148.stdout:0/667: mkdir de/d14/d6b/ddf 0 2024-09-18T12:49:15.716 INFO:tasks.workunit.client.0.smithi078.stdout:8/335: symlink d0/d39/d4c/l63 0 2024-09-18T12:49:15.717 INFO:tasks.workunit.client.1.smithi148.stdout:7/537: symlink db/d52/l9b 0 2024-09-18T12:49:15.717 INFO:tasks.workunit.client.1.smithi148.stdout:3/470: dwrite d4/d8/d20/d2b/d43/f21 [0,4194304] 0 2024-09-18T12:49:15.717 INFO:tasks.workunit.client.1.smithi148.stdout:6/520: write d5/d1a/dc/d2b/d35/d65/f5e [47735,90332] 0 2024-09-18T12:49:15.718 INFO:tasks.workunit.client.1.smithi148.stdout:3/471: stat d4/d8/d1e 0 2024-09-18T12:49:15.719 INFO:tasks.workunit.client.1.smithi148.stdout:6/521: fdatasync d5/d79/f8e 0 2024-09-18T12:49:15.719 INFO:tasks.workunit.client.1.smithi148.stdout:7/538: readlink db/dc/df/d8e/d75/l4e 0 2024-09-18T12:49:15.719 INFO:tasks.workunit.client.0.smithi078.stdout:2/300: dread d4/db/dc/f1b [0,4194304] 0 2024-09-18T12:49:15.721 INFO:tasks.workunit.client.0.smithi078.stdout:1/351: dwrite d0/d8/da/d3e/d50/f54 [0,4194304] 0 2024-09-18T12:49:15.721 INFO:tasks.workunit.client.1.smithi148.stdout:6/522: stat d5/d1a/l1e 0 2024-09-18T12:49:15.721 INFO:tasks.workunit.client.1.smithi148.stdout:9/496: truncate f7 1362120 0 2024-09-18T12:49:15.722 INFO:tasks.workunit.client.0.smithi078.stdout:8/336: truncate d0/d7/dc/d1f/d23/f48 8941112 0 2024-09-18T12:49:15.725 INFO:tasks.workunit.client.0.smithi078.stdout:8/337: chown d0/d7/dc/d1f 108936 1 2024-09-18T12:49:15.725 INFO:tasks.workunit.client.1.smithi148.stdout:6/523: dread d5/d1a/dc/f20 [0,4194304] 0 2024-09-18T12:49:15.725 INFO:tasks.workunit.client.1.smithi148.stdout:6/524: chown d5/d32 1772087 1 2024-09-18T12:49:15.727 INFO:tasks.workunit.client.0.smithi078.stdout:8/338: fsync d0/d7/dc/d5d/f37 0 2024-09-18T12:49:15.728 INFO:tasks.workunit.client.1.smithi148.stdout:8/578: write d8/d16/fc6 [535740,43033] 0 2024-09-18T12:49:15.734 INFO:tasks.workunit.client.0.smithi078.stdout:2/301: dwrite d4/d1a/f22 [0,4194304] 0 2024-09-18T12:49:15.736 INFO:tasks.workunit.client.1.smithi148.stdout:1/495: creat dc/d11/d38/d72/fa7 x:0 0 0 2024-09-18T12:49:15.737 INFO:tasks.workunit.client.0.smithi078.stdout:9/293: rename d5/d7/d32/f56 to d5/d40/d4e/f5d 0 2024-09-18T12:49:15.738 INFO:tasks.workunit.client.0.smithi078.stdout:2/302: write d4/db/f53 [725948,52452] 0 2024-09-18T12:49:15.739 INFO:tasks.workunit.client.0.smithi078.stdout:0/434: chown d3/d1f/d2e/d68/c65 2 1 2024-09-18T12:49:15.740 INFO:tasks.workunit.client.1.smithi148.stdout:0/668: rename de/d14/dd2/cd8 to de/d27/d53/d89/ce0 0 2024-09-18T12:49:15.741 INFO:tasks.workunit.client.0.smithi078.stdout:6/513: mkdir d10/d2b/d43/da7 0 2024-09-18T12:49:15.745 INFO:tasks.workunit.client.1.smithi148.stdout:3/472: unlink d4/l1b 0 2024-09-18T12:49:15.747 INFO:tasks.workunit.client.0.smithi078.stdout:7/244: link d7/d9/d14/c19 d7/d26/d4f/c52 0 2024-09-18T12:49:15.751 INFO:tasks.workunit.client.1.smithi148.stdout:3/473: dwrite d4/d8/d20/d2b/d43/f4b [0,4194304] 0 2024-09-18T12:49:15.751 INFO:tasks.workunit.client.0.smithi078.stdout:1/352: symlink d0/d5b/l6a 0 2024-09-18T12:49:15.753 INFO:tasks.workunit.client.1.smithi148.stdout:1/496: write dc/d18/d31/d39/f75 [187674,92682] 0 2024-09-18T12:49:15.753 INFO:tasks.workunit.client.1.smithi148.stdout:2/437: sync 2024-09-18T12:49:15.755 INFO:tasks.workunit.client.0.smithi078.stdout:4/304: link cd d11/c69 0 2024-09-18T12:49:15.755 INFO:tasks.workunit.client.1.smithi148.stdout:1/497: truncate dc/d11/d38/d87/d2b/d80/f9d 799098 0 2024-09-18T12:49:15.757 INFO:tasks.workunit.client.0.smithi078.stdout:7/245: dwrite d7/d9/f44 [0,4194304] 0 2024-09-18T12:49:15.759 INFO:tasks.workunit.client.0.smithi078.stdout:0/435: mkdir d3/d1f/d2e/d8f/da1 0 2024-09-18T12:49:15.761 INFO:tasks.workunit.client.0.smithi078.stdout:7/246: write d7/d26/f29 [4014603,889] 0 2024-09-18T12:49:15.775 INFO:tasks.workunit.client.0.smithi078.stdout:2/303: dread d4/dd/d18/d33/f48 [0,4194304] 0 2024-09-18T12:49:15.781 INFO:tasks.workunit.client.1.smithi148.stdout:9/497: mkdir d8/da/dd/d4a/d49/d46/d54/d90/d9a 0 2024-09-18T12:49:15.785 INFO:tasks.workunit.client.0.smithi078.stdout:6/514: dread d10/d2b/d43/f60 [0,4194304] 0 2024-09-18T12:49:15.785 INFO:tasks.workunit.client.0.smithi078.stdout:1/353: creat d0/d8/da/d3e/d50/d60/f6b x:0 0 0 2024-09-18T12:49:15.786 INFO:tasks.workunit.client.1.smithi148.stdout:9/498: dwrite d8/da/fb [8388608,4194304] 0 2024-09-18T12:49:15.786 INFO:tasks.workunit.client.0.smithi078.stdout:6/515: truncate d10/d2b/d37/f59 5025026 0 2024-09-18T12:49:15.787 INFO:tasks.workunit.client.1.smithi148.stdout:9/499: fdatasync d8/da/dd/d3f/f58 0 2024-09-18T12:49:15.789 INFO:tasks.workunit.client.1.smithi148.stdout:3/474: rename d4/d8/d20/d2b/d43/d61 to d4/d8/d1e/d6b/d31/d60/da9 0 2024-09-18T12:49:15.791 INFO:tasks.workunit.client.0.smithi078.stdout:5/476: truncate d2/d4/d12/f1b 990946 0 2024-09-18T12:49:15.792 INFO:tasks.workunit.client.0.smithi078.stdout:4/305: dread d11/d27/f4a [0,4194304] 0 2024-09-18T12:49:15.794 INFO:tasks.workunit.client.1.smithi148.stdout:6/525: dwrite d5/d1a/d29/d5c/f67 [0,4194304] 0 2024-09-18T12:49:15.795 INFO:tasks.workunit.client.1.smithi148.stdout:8/579: creat d8/df/d3e/fcb x:0 0 0 2024-09-18T12:49:15.799 INFO:tasks.workunit.client.1.smithi148.stdout:3/475: dwrite d4/d8/d20/d2b/f71 [0,4194304] 0 2024-09-18T12:49:15.800 INFO:tasks.workunit.client.0.smithi078.stdout:2/304: rmdir d4/dd/d18 39 2024-09-18T12:49:15.802 INFO:tasks.workunit.client.0.smithi078.stdout:1/354: unlink d0/d8/f26 0 2024-09-18T12:49:15.803 INFO:tasks.workunit.client.0.smithi078.stdout:1/355: write d0/d8/ff [8169867,93986] 0 2024-09-18T12:49:15.805 INFO:tasks.workunit.client.0.smithi078.stdout:9/294: creat d5/f5e x:0 0 0 2024-09-18T12:49:15.806 INFO:tasks.workunit.client.1.smithi148.stdout:7/539: getdents db/dc/df/d1d/d41 0 2024-09-18T12:49:15.808 INFO:tasks.workunit.client.0.smithi078.stdout:8/339: rename d0/d7/dc/d1f/d23/d40/f42 to d0/d7/dc/f64 0 2024-09-18T12:49:15.813 INFO:tasks.workunit.client.1.smithi148.stdout:4/468: sync 2024-09-18T12:49:15.814 INFO:tasks.workunit.client.1.smithi148.stdout:5/552: sync 2024-09-18T12:49:15.814 INFO:tasks.workunit.client.1.smithi148.stdout:0/669: rename de/d14/l4a to de/d14/le1 0 2024-09-18T12:49:15.815 INFO:tasks.workunit.client.0.smithi078.stdout:0/436: creat d3/d1f/d2e/d8f/da1/fa2 x:0 0 0 2024-09-18T12:49:15.815 INFO:tasks.workunit.client.1.smithi148.stdout:5/553: write d7/d8/db2/fb5 [494787,45833] 0 2024-09-18T12:49:15.816 INFO:tasks.workunit.client.0.smithi078.stdout:0/437: write d3/f93 [767279,103588] 0 2024-09-18T12:49:15.818 INFO:tasks.workunit.client.1.smithi148.stdout:8/580: creat d8/d12/d46/d7e/fcc x:0 0 0 2024-09-18T12:49:15.819 INFO:tasks.workunit.client.1.smithi148.stdout:6/526: dread d5/d1a/dc/d2b/d35/d65/f5e [0,4194304] 0 2024-09-18T12:49:15.821 INFO:tasks.workunit.client.0.smithi078.stdout:1/356: creat d0/f6c x:0 0 0 2024-09-18T12:49:15.823 INFO:tasks.workunit.client.0.smithi078.stdout:0/438: dwrite d3/f5 [0,4194304] 0 2024-09-18T12:49:15.825 INFO:tasks.workunit.client.0.smithi078.stdout:9/295: write d5/d7/d8/d4f/f54 [283156,124117] 0 2024-09-18T12:49:15.826 INFO:tasks.workunit.client.1.smithi148.stdout:7/540: symlink db/dc/df/d2c/l9c 0 2024-09-18T12:49:15.827 INFO:tasks.workunit.client.0.smithi078.stdout:7/247: rename d7/d9/l16 to d7/d26/d4f/l53 0 2024-09-18T12:49:15.828 INFO:tasks.workunit.client.0.smithi078.stdout:7/248: write d7/d9/fe [200493,76935] 0 2024-09-18T12:49:15.831 INFO:tasks.workunit.client.1.smithi148.stdout:7/541: dread db/dc/df/d2c/d55/f6e [0,4194304] 0 2024-09-18T12:49:15.832 INFO:tasks.workunit.client.1.smithi148.stdout:5/554: creat d7/d8/dc/d12/d1f/d77/fbb x:0 0 0 2024-09-18T12:49:15.834 INFO:tasks.workunit.client.1.smithi148.stdout:8/581: symlink d8/d12/d46/lcd 0 2024-09-18T12:49:15.836 INFO:tasks.workunit.client.1.smithi148.stdout:3/476: dread d4/d8/d1e/f25 [0,4194304] 0 2024-09-18T12:49:15.837 INFO:tasks.workunit.client.1.smithi148.stdout:6/527: symlink d5/d79/d7c/la2 0 2024-09-18T12:49:15.838 INFO:tasks.workunit.client.1.smithi148.stdout:0/670: dread de/d14/f26 [0,4194304] 0 2024-09-18T12:49:15.838 INFO:tasks.workunit.client.1.smithi148.stdout:6/528: stat d5/d32/d38/c3a 0 2024-09-18T12:49:15.839 INFO:tasks.workunit.client.1.smithi148.stdout:9/500: creat d8/da/dd/d35/f9b x:0 0 0 2024-09-18T12:49:15.841 INFO:tasks.workunit.client.1.smithi148.stdout:2/438: rename d9/d24/d31/f66 to d9/d17/f96 0 2024-09-18T12:49:15.842 INFO:tasks.workunit.client.0.smithi078.stdout:1/357: mkdir d0/d5b/d6d 0 2024-09-18T12:49:15.843 INFO:tasks.workunit.client.0.smithi078.stdout:1/358: chown d0/d8/da/f5f 111877 1 2024-09-18T12:49:15.845 INFO:tasks.workunit.client.0.smithi078.stdout:0/439: mkdir d3/d1f/d2e/d68/d30/d7c/da3 0 2024-09-18T12:49:15.848 INFO:tasks.workunit.client.0.smithi078.stdout:9/296: mknod d5/d7/d8/d4f/c5f 0 2024-09-18T12:49:15.849 INFO:tasks.workunit.client.1.smithi148.stdout:4/469: symlink d15/d90/l9f 0 2024-09-18T12:49:15.852 INFO:tasks.workunit.client.0.smithi078.stdout:6/516: rename d10/d2b/d37/l3c to d10/d2b/d61/la8 0 2024-09-18T12:49:15.854 INFO:tasks.workunit.client.0.smithi078.stdout:6/517: chown d10/f1e 20103302 1 2024-09-18T12:49:15.854 INFO:tasks.workunit.client.0.smithi078.stdout:5/477: dwrite d2/d4/d12/f81 [0,4194304] 0 2024-09-18T12:49:15.856 INFO:tasks.workunit.client.0.smithi078.stdout:8/340: mknod d0/d7/d1e/d33/d3e/c65 0 2024-09-18T12:49:15.858 INFO:tasks.workunit.client.1.smithi148.stdout:7/542: creat db/dc/df/d1d/d68/d7a/f9d x:0 0 0 2024-09-18T12:49:15.860 INFO:tasks.workunit.client.1.smithi148.stdout:7/543: write db/dc/df/d11/f6b [257765,38718] 0 2024-09-18T12:49:15.860 INFO:tasks.workunit.client.1.smithi148.stdout:6/529: dread d5/d1a/d29/d5c/f77 [0,4194304] 0 2024-09-18T12:49:15.862 INFO:tasks.workunit.client.1.smithi148.stdout:6/530: write d5/d1a/f21 [2465982,55386] 0 2024-09-18T12:49:15.863 INFO:tasks.workunit.client.1.smithi148.stdout:6/531: fdatasync d5/d79/f8e 0 2024-09-18T12:49:15.865 INFO:tasks.workunit.client.0.smithi078.stdout:8/341: dwrite d0/f1 [4194304,4194304] 0 2024-09-18T12:49:15.865 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:15 smithi078 ceph-mon[28091]: pgmap v15: 65 pgs: 65 active+clean; 1.5 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 45 MiB/s rd, 195 MiB/s wr, 336 op/s 2024-09-18T12:49:15.865 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:15 smithi078 ceph-mon[28091]: Adjusting osd_memory_target on smithi078 to 1216M 2024-09-18T12:49:15.865 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:15 smithi078 ceph-mon[28091]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-18T12:49:15.865 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:15 smithi078 ceph-mon[28091]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-18T12:49:15.865 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:15 smithi078 ceph-mon[28091]: Updating smithi148:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:49:15.865 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:15 smithi078 ceph-mon[28091]: Updating smithi078:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:49:15.865 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:15 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:15.865 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:15 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:15.866 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:15 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:15.866 INFO:tasks.workunit.client.0.smithi078.stdout:0/440: creat d3/d1f/d2e/d8f/d90/fa4 x:0 0 0 2024-09-18T12:49:15.866 INFO:tasks.workunit.client.0.smithi078.stdout:8/342: truncate d0/f16 841913 0 2024-09-18T12:49:15.868 INFO:tasks.workunit.client.1.smithi148.stdout:9/501: chown d8/da/f13 9606771 1 2024-09-18T12:49:15.868 INFO:tasks.workunit.client.1.smithi148.stdout:2/439: dread d9/d17/d29/d92/d95/f38 [0,4194304] 0 2024-09-18T12:49:15.869 INFO:tasks.workunit.client.1.smithi148.stdout:5/555: dread d7/d8/f1c [0,4194304] 0 2024-09-18T12:49:15.871 INFO:tasks.workunit.client.0.smithi078.stdout:4/306: write d11/f55 [1157386,73801] 0 2024-09-18T12:49:15.872 INFO:tasks.workunit.client.1.smithi148.stdout:5/556: chown d7/d2b/f36 195 1 2024-09-18T12:49:15.872 INFO:tasks.workunit.client.1.smithi148.stdout:7/544: dwrite db/dc/df/d8e/f7d [0,4194304] 0 2024-09-18T12:49:15.875 INFO:tasks.workunit.client.1.smithi148.stdout:1/498: rename dc/d11/l1b to dc/d18/d31/d4b/la8 0 2024-09-18T12:49:15.876 INFO:tasks.workunit.client.0.smithi078.stdout:2/305: truncate d4/d8/f50 846436 0 2024-09-18T12:49:15.879 INFO:tasks.workunit.client.0.smithi078.stdout:1/359: rename d0/d8/da/d3e/d46 to d0/d8/da/d3e/d58/d6e 0 2024-09-18T12:49:15.880 INFO:tasks.workunit.client.1.smithi148.stdout:6/532: dread d5/d1a/d29/d5c/f77 [0,4194304] 0 2024-09-18T12:49:15.880 INFO:tasks.workunit.client.1.smithi148.stdout:0/671: dwrite de/d14/f26 [0,4194304] 0 2024-09-18T12:49:15.882 INFO:tasks.workunit.client.1.smithi148.stdout:6/533: fdatasync d5/d1a/dc/f5b 0 2024-09-18T12:49:15.884 INFO:tasks.workunit.client.1.smithi148.stdout:2/440: dwrite d9/d3a/f75 [0,4194304] 0 2024-09-18T12:49:15.884 INFO:tasks.workunit.client.1.smithi148.stdout:6/534: write d5/d32/d38/d50/f52 [692247,39226] 0 2024-09-18T12:49:15.885 INFO:tasks.workunit.client.0.smithi078.stdout:9/297: dread f3 [0,4194304] 0 2024-09-18T12:49:15.885 INFO:tasks.workunit.client.1.smithi148.stdout:2/441: chown d9/d17/f6a 2724 1 2024-09-18T12:49:15.889 INFO:tasks.workunit.client.0.smithi078.stdout:0/441: symlink d3/d1f/d2e/d4e/la5 0 2024-09-18T12:49:15.891 INFO:tasks.workunit.client.0.smithi078.stdout:2/306: dwrite d4/dd/f5c [0,4194304] 0 2024-09-18T12:49:15.891 INFO:tasks.workunit.client.0.smithi078.stdout:8/343: symlink d0/d7/dc/d1f/d23/d40/l66 0 2024-09-18T12:49:15.891 INFO:tasks.workunit.client.1.smithi148.stdout:4/470: mkdir d15/d17/d52/d92/d4c/d4f/d64/da0 0 2024-09-18T12:49:15.893 INFO:tasks.workunit.client.0.smithi078.stdout:7/249: dread d7/f28 [0,4194304] 0 2024-09-18T12:49:15.894 INFO:tasks.workunit.client.0.smithi078.stdout:0/442: write d3/d1f/d2e/f76 [581826,118604] 0 2024-09-18T12:49:15.897 INFO:tasks.workunit.client.0.smithi078.stdout:7/250: chown d7/d9/f13 10776 1 2024-09-18T12:49:15.898 INFO:tasks.workunit.client.0.smithi078.stdout:7/251: dread - d7/d9/d14/d22/d3e/f40 zero size 2024-09-18T12:49:15.906 INFO:tasks.workunit.client.0.smithi078.stdout:4/307: dwrite d11/d1f/f63 [0,4194304] 0 2024-09-18T12:49:15.907 INFO:tasks.workunit.client.0.smithi078.stdout:6/518: rename d10/f24 to d10/d2b/d43/d53/d63/d6b/fa9 0 2024-09-18T12:49:15.908 INFO:tasks.workunit.client.0.smithi078.stdout:6/519: chown d10/f41 38679232 1 2024-09-18T12:49:15.908 INFO:tasks.workunit.client.1.smithi148.stdout:9/502: creat d8/da/dd/d3f/f9c x:0 0 0 2024-09-18T12:49:15.909 INFO:tasks.workunit.client.1.smithi148.stdout:9/503: write d8/f16 [1118592,112783] 0 2024-09-18T12:49:15.910 INFO:tasks.workunit.client.0.smithi078.stdout:5/478: mknod d2/d4/d12/c92 0 2024-09-18T12:49:15.910 INFO:tasks.workunit.client.0.smithi078.stdout:5/479: readlink d2/d4/d12/d16/l76 0 2024-09-18T12:49:15.910 INFO:tasks.workunit.client.1.smithi148.stdout:9/504: write d8/da/dd/d4a/f98 [203695,74118] 0 2024-09-18T12:49:15.911 INFO:tasks.workunit.client.1.smithi148.stdout:1/499: symlink dc/d11/d38/la9 0 2024-09-18T12:49:15.911 INFO:tasks.workunit.client.1.smithi148.stdout:1/500: chown f6 99037091 1 2024-09-18T12:49:15.911 INFO:tasks.workunit.client.1.smithi148.stdout:9/505: chown d8/da/dd/d4a/d49/d46/d75 718 1 2024-09-18T12:49:15.912 INFO:tasks.workunit.client.0.smithi078.stdout:5/480: dread - d2/d4/d9/da/d60/d61/f75 zero size 2024-09-18T12:49:15.913 INFO:tasks.workunit.client.1.smithi148.stdout:9/506: write d8/da/dd/d35/d81/f8e [4275200,33064] 0 2024-09-18T12:49:15.915 INFO:tasks.workunit.client.0.smithi078.stdout:9/298: creat d5/d40/d4e/f60 x:0 0 0 2024-09-18T12:49:15.916 INFO:tasks.workunit.client.0.smithi078.stdout:9/299: chown d5/d7/d32/l48 16 1 2024-09-18T12:49:15.917 INFO:tasks.workunit.client.0.smithi078.stdout:8/344: rmdir d0/d7/d1e/d33/d52 39 2024-09-18T12:49:15.917 INFO:tasks.workunit.client.1.smithi148.stdout:0/672: rmdir de/d27/d53 39 2024-09-18T12:49:15.918 INFO:tasks.workunit.client.0.smithi078.stdout:0/443: symlink d3/d1f/d2e/d8f/da1/la6 0 2024-09-18T12:49:15.919 INFO:tasks.workunit.client.0.smithi078.stdout:7/252: mknod d7/d9/d14/d22/d35/c54 0 2024-09-18T12:49:15.922 INFO:tasks.workunit.client.0.smithi078.stdout:1/360: rename d0/d8/da/d3e/f42 to d0/d8/da/d3e/d58/d6e/d52/f6f 0 2024-09-18T12:49:15.923 INFO:tasks.workunit.client.0.smithi078.stdout:1/361: stat d0/c15 0 2024-09-18T12:49:15.924 INFO:tasks.workunit.client.0.smithi078.stdout:6/520: write d10/d2b/d61/f9e [880092,40913] 0 2024-09-18T12:49:15.925 INFO:tasks.workunit.client.1.smithi148.stdout:4/471: write d15/d5f/d69/f95 [2014889,104832] 0 2024-09-18T12:49:15.926 INFO:tasks.workunit.client.0.smithi078.stdout:2/307: mknod d4/c5d 0 2024-09-18T12:49:15.927 INFO:tasks.workunit.client.1.smithi148.stdout:3/477: creat d4/d8/d1e/d6b/d31/d60/faa x:0 0 0 2024-09-18T12:49:15.928 INFO:tasks.workunit.client.0.smithi078.stdout:9/300: fsync d5/d7/d32/d2a/f3d 0 2024-09-18T12:49:15.931 INFO:tasks.workunit.client.0.smithi078.stdout:8/345: mkdir d0/d7/d53/d57/d67 0 2024-09-18T12:49:15.942 INFO:tasks.workunit.client.1.smithi148.stdout:1/501: dwrite dc/d18/d31/f5d [0,4194304] 0 2024-09-18T12:49:15.943 INFO:tasks.workunit.client.0.smithi078.stdout:4/308: rename d11/d1f/d56 to d11/d27/d5a/d5d/d6a 0 2024-09-18T12:49:15.944 INFO:tasks.workunit.client.0.smithi078.stdout:4/309: fsync d11/d1f/d40/f41 0 2024-09-18T12:49:15.947 INFO:tasks.workunit.client.1.smithi148.stdout:8/582: sync 2024-09-18T12:49:15.949 INFO:tasks.workunit.client.1.smithi148.stdout:0/673: stat de/d14/caf 0 2024-09-18T12:49:15.951 INFO:tasks.workunit.client.1.smithi148.stdout:2/442: mknod d9/d17/c97 0 2024-09-18T12:49:15.954 INFO:tasks.workunit.client.1.smithi148.stdout:6/535: mkdir d5/d1a/dc/d2b/d35/d65/d99/da3 0 2024-09-18T12:49:15.954 INFO:tasks.workunit.client.1.smithi148.stdout:2/443: write d9/d24/d31/f83 [618247,129688] 0 2024-09-18T12:49:15.955 INFO:tasks.workunit.client.1.smithi148.stdout:8/583: dwrite d8/f92 [0,4194304] 0 2024-09-18T12:49:15.957 INFO:tasks.workunit.client.1.smithi148.stdout:4/472: rename d15/d3f/d81 to d15/d17/d52/d92/d4c/d4f/d64/da0/da1 0 2024-09-18T12:49:15.958 INFO:tasks.workunit.client.0.smithi078.stdout:9/301: mknod d5/d40/d4e/c61 0 2024-09-18T12:49:15.960 INFO:tasks.workunit.client.1.smithi148.stdout:3/478: creat d4/d8/d1e/d79/fab x:0 0 0 2024-09-18T12:49:15.962 INFO:tasks.workunit.client.1.smithi148.stdout:5/557: rmdir d7/d8/dc/db8 0 2024-09-18T12:49:15.963 INFO:tasks.workunit.client.1.smithi148.stdout:8/584: dwrite d8/f8c [0,4194304] 0 2024-09-18T12:49:15.963 INFO:tasks.workunit.client.1.smithi148.stdout:5/558: readlink d7/d8/dc/d12/d31/d5a/d98/lb4 0 2024-09-18T12:49:15.965 INFO:tasks.workunit.client.1.smithi148.stdout:8/585: truncate d8/df/d3e/fcb 100201 0 2024-09-18T12:49:15.968 INFO:tasks.workunit.client.0.smithi078.stdout:0/444: creat d3/d43/d7f/fa7 x:0 0 0 2024-09-18T12:49:15.968 INFO:tasks.workunit.client.0.smithi078.stdout:8/346: dwrite d0/d7/dc/d5d/d2e/f3a [0,4194304] 0 2024-09-18T12:49:15.971 INFO:tasks.workunit.client.1.smithi148.stdout:7/545: link db/d52/d1f/c5b db/dc/df/d2c/d66/c9e 0 2024-09-18T12:49:15.972 INFO:tasks.workunit.client.0.smithi078.stdout:8/347: fdatasync d0/d7/d1e/d50/f5b 0 2024-09-18T12:49:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:15 smithi148 ceph-mon[35352]: pgmap v15: 65 pgs: 65 active+clean; 1.5 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 45 MiB/s rd, 195 MiB/s wr, 336 op/s 2024-09-18T12:49:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:15 smithi148 ceph-mon[35352]: Adjusting osd_memory_target on smithi078 to 1216M 2024-09-18T12:49:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:15 smithi148 ceph-mon[35352]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-18T12:49:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:15 smithi148 ceph-mon[35352]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-18T12:49:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:15 smithi148 ceph-mon[35352]: Updating smithi148:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:49:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:15 smithi148 ceph-mon[35352]: Updating smithi078:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:49:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:15 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:15 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:15 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:15.977 INFO:tasks.workunit.client.0.smithi078.stdout:1/362: symlink d0/d5b/d6d/l70 0 2024-09-18T12:49:15.978 INFO:tasks.workunit.client.1.smithi148.stdout:6/536: dread d5/d1a/f21 [0,4194304] 0 2024-09-18T12:49:15.980 INFO:tasks.workunit.client.0.smithi078.stdout:6/521: symlink d10/d2b/d43/d53/d45/d55/laa 0 2024-09-18T12:49:15.983 INFO:tasks.workunit.client.0.smithi078.stdout:5/481: creat d2/d4/d12/d16/d36/d4c/d62/f93 x:0 0 0 2024-09-18T12:49:15.987 INFO:tasks.workunit.client.1.smithi148.stdout:2/444: mkdir d9/d17/d29/d98 0 2024-09-18T12:49:15.990 INFO:tasks.workunit.client.0.smithi078.stdout:5/482: dread d2/d4/d9/d49/f7d [0,4194304] 0 2024-09-18T12:49:15.999 INFO:tasks.workunit.client.0.smithi078.stdout:3/353: sync 2024-09-18T12:49:15.999 INFO:tasks.workunit.client.0.smithi078.stdout:5/483: dwrite d2/d4/d48/f88 [0,4194304] 0 2024-09-18T12:49:16.001 INFO:tasks.workunit.client.1.smithi148.stdout:8/586: creat d8/d16/d27/fce x:0 0 0 2024-09-18T12:49:16.002 INFO:tasks.workunit.client.0.smithi078.stdout:3/354: write d9/d13/f5f [842664,110399] 0 2024-09-18T12:49:16.002 INFO:tasks.workunit.client.1.smithi148.stdout:8/587: fsync d8/d12/d51/d94/f64 0 2024-09-18T12:49:16.005 INFO:tasks.workunit.client.0.smithi078.stdout:1/363: mknod d0/d8/da/d3e/d58/c71 0 2024-09-18T12:49:16.006 INFO:tasks.workunit.client.0.smithi078.stdout:7/253: truncate d7/d26/f42 2056506 0 2024-09-18T12:49:16.007 INFO:tasks.workunit.client.0.smithi078.stdout:1/364: chown d0/d8/f2b 2 1 2024-09-18T12:49:16.008 INFO:tasks.workunit.client.0.smithi078.stdout:7/254: write d7/d9/d14/d22/d3e/f40 [158166,48931] 0 2024-09-18T12:49:16.009 INFO:tasks.workunit.client.1.smithi148.stdout:6/537: dread d5/d1a/f47 [0,4194304] 0 2024-09-18T12:49:16.011 INFO:tasks.workunit.client.1.smithi148.stdout:8/588: dwrite d8/df/f19 [0,4194304] 0 2024-09-18T12:49:16.012 INFO:tasks.workunit.client.1.smithi148.stdout:8/589: truncate d8/d16/fc6 4660063 0 2024-09-18T12:49:16.013 INFO:tasks.workunit.client.1.smithi148.stdout:8/590: chown d8/d12/d46/f5a 9685 1 2024-09-18T12:49:16.015 INFO:tasks.workunit.client.0.smithi078.stdout:6/522: rmdir d10/d2b/d43/d53 39 2024-09-18T12:49:16.016 INFO:tasks.workunit.client.0.smithi078.stdout:6/523: dread - d10/d2b/d43/f6c zero size 2024-09-18T12:49:16.019 INFO:tasks.workunit.client.1.smithi148.stdout:8/591: dread d8/d12/d46/d7e/f89 [0,4194304] 0 2024-09-18T12:49:16.020 INFO:tasks.workunit.client.1.smithi148.stdout:8/592: dread d8/d12/d51/d94/f64 [0,4194304] 0 2024-09-18T12:49:16.024 INFO:tasks.workunit.client.0.smithi078.stdout:1/365: dwrite d0/d8/ff [8388608,4194304] 0 2024-09-18T12:49:16.024 INFO:tasks.workunit.client.0.smithi078.stdout:2/308: link d4/f9 d4/db/f5e 0 2024-09-18T12:49:16.025 INFO:tasks.workunit.client.0.smithi078.stdout:1/366: chown d0/d8/da/d3e/d50/d60/f6b 1983978 1 2024-09-18T12:49:16.029 INFO:tasks.workunit.client.1.smithi148.stdout:4/473: dwrite d15/d17/d52/d92/d4c/d4f/f33 [0,4194304] 0 2024-09-18T12:49:16.030 INFO:tasks.workunit.client.1.smithi148.stdout:4/474: read d15/d17/d52/d92/d4c/d4f/d64/f82 [1617372,2771] 0 2024-09-18T12:49:16.035 INFO:tasks.workunit.client.0.smithi078.stdout:4/310: truncate d11/d27/d47/f57 2852469 0 2024-09-18T12:49:16.036 INFO:tasks.workunit.client.0.smithi078.stdout:5/484: rmdir d2/d4/d9 39 2024-09-18T12:49:16.037 INFO:tasks.workunit.client.1.smithi148.stdout:5/559: write d7/f8c [475599,103892] 0 2024-09-18T12:49:16.037 INFO:tasks.workunit.client.0.smithi078.stdout:3/355: mknod d9/d13/c71 0 2024-09-18T12:49:16.038 INFO:tasks.workunit.client.1.smithi148.stdout:1/502: write dc/d11/d38/d87/d2b/d80/fa6 [843640,28556] 0 2024-09-18T12:49:16.039 INFO:tasks.workunit.client.1.smithi148.stdout:9/507: getdents d8/da/dd/d35/d47/d62 0 2024-09-18T12:49:16.040 INFO:tasks.workunit.client.0.smithi078.stdout:1/367: dwrite d0/f19 [0,4194304] 0 2024-09-18T12:49:16.040 INFO:tasks.workunit.client.0.smithi078.stdout:1/368: chown d0 61 1 2024-09-18T12:49:16.040 INFO:tasks.workunit.client.0.smithi078.stdout:4/311: truncate d11/d27/d60/f68 134813 0 2024-09-18T12:49:16.041 INFO:tasks.workunit.client.1.smithi148.stdout:6/538: unlink d5/d1a/d3d/l8a 0 2024-09-18T12:49:16.041 INFO:tasks.workunit.client.1.smithi148.stdout:9/508: fdatasync d8/f25 0 2024-09-18T12:49:16.043 INFO:tasks.workunit.client.1.smithi148.stdout:0/674: write de/d14/f81 [414834,129136] 0 2024-09-18T12:49:16.043 INFO:tasks.workunit.client.1.smithi148.stdout:4/475: dwrite d15/d17/d52/d92/d4c/d4f/d64/f88 [0,4194304] 0 2024-09-18T12:49:16.044 INFO:tasks.workunit.client.0.smithi078.stdout:1/369: write d0/d8/da/f23 [1109025,120894] 0 2024-09-18T12:49:16.044 INFO:tasks.workunit.client.0.smithi078.stdout:2/309: mkdir d4/d8/d23/d52/d5f 0 2024-09-18T12:49:16.046 INFO:tasks.workunit.client.1.smithi148.stdout:0/675: dread - de/d14/d93/fc3 zero size 2024-09-18T12:49:16.046 INFO:tasks.workunit.client.1.smithi148.stdout:4/476: read - d15/d5f/d69/d7f/f8e zero size 2024-09-18T12:49:16.047 INFO:tasks.workunit.client.0.smithi078.stdout:8/348: truncate d0/d7/dc/d1f/d23/f48 4121700 0 2024-09-18T12:49:16.047 INFO:tasks.workunit.client.0.smithi078.stdout:4/312: dread - d11/d1f/d40/f58 zero size 2024-09-18T12:49:16.048 INFO:tasks.workunit.client.0.smithi078.stdout:9/302: creat d5/d7/f62 x:0 0 0 2024-09-18T12:49:16.052 INFO:tasks.workunit.client.1.smithi148.stdout:2/445: dwrite d9/d17/f4e [0,4194304] 0 2024-09-18T12:49:16.054 INFO:tasks.workunit.client.1.smithi148.stdout:4/477: write d15/d17/d52/d92/d4c/d72/f93 [375847,113131] 0 2024-09-18T12:49:16.055 INFO:tasks.workunit.client.0.smithi078.stdout:9/303: chown d5/d7/d8/d4f 161 1 2024-09-18T12:49:16.055 INFO:tasks.workunit.client.1.smithi148.stdout:4/478: fdatasync d15/d5f/f71 0 2024-09-18T12:49:16.056 INFO:tasks.workunit.client.0.smithi078.stdout:1/370: creat d0/d8/da/d3e/f72 x:0 0 0 2024-09-18T12:49:16.057 INFO:tasks.workunit.client.1.smithi148.stdout:8/593: dread d8/d12/f15 [0,4194304] 0 2024-09-18T12:49:16.060 INFO:tasks.workunit.client.1.smithi148.stdout:1/503: mknod dc/d11/d96/caa 0 2024-09-18T12:49:16.060 INFO:tasks.workunit.client.0.smithi078.stdout:0/445: link d3/cb d3/d1f/d2e/d68/d30/ca8 0 2024-09-18T12:49:16.061 INFO:tasks.workunit.client.1.smithi148.stdout:5/560: rmdir d7/d8/dc/d12/d1f/d69/d8b 39 2024-09-18T12:49:16.062 INFO:tasks.workunit.client.1.smithi148.stdout:1/504: fsync dc/d11/d38/d87/f35 0 2024-09-18T12:49:16.068 INFO:tasks.workunit.client.1.smithi148.stdout:3/479: sync 2024-09-18T12:49:16.068 INFO:tasks.workunit.client.1.smithi148.stdout:6/539: mkdir d5/d1a/dc/d2b/d35/d65/d99/da4 0 2024-09-18T12:49:16.069 INFO:tasks.workunit.client.1.smithi148.stdout:3/480: dread - d4/d8/d1e/f91 zero size 2024-09-18T12:49:16.071 INFO:tasks.workunit.client.0.smithi078.stdout:5/485: dwrite d2/d4/d12/d16/d36/d4c/f65 [0,4194304] 0 2024-09-18T12:49:16.071 INFO:tasks.workunit.client.0.smithi078.stdout:9/304: dwrite d5/d7/d8/d4f/f54 [0,4194304] 0 2024-09-18T12:49:16.079 INFO:tasks.workunit.client.0.smithi078.stdout:2/310: dwrite d4/db/f53 [0,4194304] 0 2024-09-18T12:49:16.080 INFO:tasks.workunit.client.0.smithi078.stdout:4/313: dread d11/d27/d47/f49 [0,4194304] 0 2024-09-18T12:49:16.081 INFO:tasks.workunit.client.0.smithi078.stdout:2/311: fsync d4/db/f2a 0 2024-09-18T12:49:16.083 INFO:tasks.workunit.client.0.smithi078.stdout:8/349: dwrite d0/d7/dc/f64 [0,4194304] 0 2024-09-18T12:49:16.084 INFO:tasks.workunit.client.0.smithi078.stdout:9/305: truncate d5/d7/d32/f31 838101 0 2024-09-18T12:49:16.086 INFO:tasks.workunit.client.0.smithi078.stdout:1/371: dread - d0/d8/da/d3e/d58/d6e/d52/f32 zero size 2024-09-18T12:49:16.088 INFO:tasks.workunit.client.1.smithi148.stdout:2/446: symlink d9/d17/d29/d92/d95/d64/l99 0 2024-09-18T12:49:16.089 INFO:tasks.workunit.client.1.smithi148.stdout:7/546: getdents db/dc/df 0 2024-09-18T12:49:16.090 INFO:tasks.workunit.client.1.smithi148.stdout:4/479: creat d15/d17/d52/d68/fa2 x:0 0 0 2024-09-18T12:49:16.090 INFO:tasks.workunit.client.0.smithi078.stdout:3/356: truncate d9/d13/d33/d3c/d19/f22 1460429 0 2024-09-18T12:49:16.091 INFO:tasks.workunit.client.0.smithi078.stdout:6/524: creat d10/d2b/d43/d53/d45/d55/fab x:0 0 0 2024-09-18T12:49:16.092 INFO:tasks.workunit.client.1.smithi148.stdout:4/480: truncate d15/d17/d52/f7d 5230890 0 2024-09-18T12:49:16.095 INFO:tasks.workunit.client.0.smithi078.stdout:3/357: dread d9/d13/d33/d34/f4f [0,4194304] 0 2024-09-18T12:49:16.095 INFO:tasks.workunit.client.1.smithi148.stdout:1/505: symlink dc/d11/d38/d87/d2b/d80/lab 0 2024-09-18T12:49:16.097 INFO:tasks.workunit.client.0.smithi078.stdout:7/255: dread d7/fa [0,4194304] 0 2024-09-18T12:49:16.099 INFO:tasks.workunit.client.0.smithi078.stdout:2/312: chown d4/dd/d18/d3b 2 1 2024-09-18T12:49:16.100 INFO:tasks.workunit.client.1.smithi148.stdout:1/506: dwrite dc/d11/d38/d87/d2b/d80/fa6 [0,4194304] 0 2024-09-18T12:49:16.101 INFO:tasks.workunit.client.1.smithi148.stdout:1/507: stat dc/d18/f1f 0 2024-09-18T12:49:16.103 INFO:tasks.workunit.client.1.smithi148.stdout:5/561: dread d7/d8/f3e [0,4194304] 0 2024-09-18T12:49:16.104 INFO:tasks.workunit.client.0.smithi078.stdout:9/306: creat d5/d40/f63 x:0 0 0 2024-09-18T12:49:16.105 INFO:tasks.workunit.client.1.smithi148.stdout:0/676: creat de/d27/d53/d89/dbb/db5/fe2 x:0 0 0 2024-09-18T12:49:16.107 INFO:tasks.workunit.client.1.smithi148.stdout:2/447: write d9/d3a/f52 [232490,89441] 0 2024-09-18T12:49:16.108 INFO:tasks.workunit.client.0.smithi078.stdout:2/313: dwrite d4/dd/f5c [4194304,4194304] 0 2024-09-18T12:49:16.115 INFO:tasks.workunit.client.0.smithi078.stdout:5/486: creat d2/d4/d9/f94 x:0 0 0 2024-09-18T12:49:16.119 INFO:tasks.workunit.client.0.smithi078.stdout:3/358: readlink d9/d13/d33/d34/l42 0 2024-09-18T12:49:16.122 INFO:tasks.workunit.client.0.smithi078.stdout:7/256: symlink d7/d9/d14/d22/l55 0 2024-09-18T12:49:16.123 INFO:tasks.workunit.client.1.smithi148.stdout:9/509: rmdir d8/da/dd/d4a/d49/d46/d54/d90/d9a 0 2024-09-18T12:49:16.124 INFO:tasks.workunit.client.1.smithi148.stdout:9/510: stat d8/d73 0 2024-09-18T12:49:16.125 INFO:tasks.workunit.client.1.smithi148.stdout:9/511: write d8/da/dd/d4a/d49/f85 [236005,73767] 0 2024-09-18T12:49:16.126 INFO:tasks.workunit.client.1.smithi148.stdout:1/508: mknod dc/d18/d31/d39/cac 0 2024-09-18T12:49:16.126 INFO:tasks.workunit.client.0.smithi078.stdout:3/359: dwrite d9/d13/d33/f51 [4194304,4194304] 0 2024-09-18T12:49:16.129 INFO:tasks.workunit.client.0.smithi078.stdout:3/360: readlink d9/d13/d37/l55 0 2024-09-18T12:49:16.130 INFO:tasks.workunit.client.1.smithi148.stdout:0/677: dread - de/d14/d43/f4b zero size 2024-09-18T12:49:16.132 INFO:tasks.workunit.client.0.smithi078.stdout:7/257: dwrite f5 [0,4194304] 0 2024-09-18T12:49:16.133 INFO:tasks.workunit.client.0.smithi078.stdout:9/307: unlink d5/d7/d32/d2a/f4b 0 2024-09-18T12:49:16.136 INFO:tasks.workunit.client.0.smithi078.stdout:4/314: dwrite d11/d1f/f2b [8388608,4194304] 0 2024-09-18T12:49:16.136 INFO:tasks.workunit.client.0.smithi078.stdout:1/372: mknod d0/d8/da/c73 0 2024-09-18T12:49:16.138 INFO:tasks.workunit.client.0.smithi078.stdout:4/315: write d11/d1f/f3a [2627163,110019] 0 2024-09-18T12:49:16.139 INFO:tasks.workunit.client.1.smithi148.stdout:8/594: creat d8/d16/fcf x:0 0 0 2024-09-18T12:49:16.139 INFO:tasks.workunit.client.0.smithi078.stdout:0/446: link d3/l75 d3/d1f/d2e/d4e/d37/d72/la9 0 2024-09-18T12:49:16.142 INFO:tasks.workunit.client.1.smithi148.stdout:8/595: write d8/d12/d46/d74/f9b [3242583,10555] 0 2024-09-18T12:49:16.143 INFO:tasks.workunit.client.1.smithi148.stdout:8/596: chown d8/df/l44 63 1 2024-09-18T12:49:16.143 INFO:tasks.workunit.client.1.smithi148.stdout:6/540: link d5/d1a/dc/f20 d5/d1a/d29/d5c/fa5 0 2024-09-18T12:49:16.145 INFO:tasks.workunit.client.1.smithi148.stdout:6/541: stat d5/d32/d38/d50/f61 0 2024-09-18T12:49:16.146 INFO:tasks.workunit.client.1.smithi148.stdout:9/512: mknod d8/da/dd/d35/d47/c9d 0 2024-09-18T12:49:16.148 INFO:tasks.workunit.client.1.smithi148.stdout:1/509: mkdir dc/d4d/dad 0 2024-09-18T12:49:16.152 INFO:tasks.workunit.client.1.smithi148.stdout:7/547: link db/d52/d25/d38/c6c db/dc/c9f 0 2024-09-18T12:49:16.154 INFO:tasks.workunit.client.1.smithi148.stdout:2/448: creat d9/d17/d29/d98/f9a x:0 0 0 2024-09-18T12:49:16.155 INFO:tasks.workunit.client.1.smithi148.stdout:5/562: dwrite d7/d8/f13 [0,4194304] 0 2024-09-18T12:49:16.156 INFO:tasks.workunit.client.0.smithi078.stdout:7/258: mkdir d7/d9/d14/d22/d35/d49/d56 0 2024-09-18T12:49:16.157 INFO:tasks.workunit.client.1.smithi148.stdout:4/481: rename d15/d17/d52/d92/d4c/d4f/d34/c7a to d15/d90/ca3 0 2024-09-18T12:49:16.159 INFO:tasks.workunit.client.0.smithi078.stdout:9/308: creat d5/d7/d8/d4f/f64 x:0 0 0 2024-09-18T12:49:16.160 INFO:tasks.workunit.client.1.smithi148.stdout:8/597: rmdir d8/d12/d46/d7e/da1 39 2024-09-18T12:49:16.164 INFO:tasks.workunit.client.0.smithi078.stdout:1/373: mkdir d0/d8/da/d3e/d50/d74 0 2024-09-18T12:49:16.165 INFO:tasks.workunit.client.1.smithi148.stdout:9/513: creat d8/da/dd/d35/d81/f9e x:0 0 0 2024-09-18T12:49:16.166 INFO:tasks.workunit.client.1.smithi148.stdout:1/510: mknod dc/d11/d38/d87/d2b/d80/cae 0 2024-09-18T12:49:16.167 INFO:tasks.workunit.client.0.smithi078.stdout:0/447: chown d3/d1f/c24 1953 1 2024-09-18T12:49:16.168 INFO:tasks.workunit.client.1.smithi148.stdout:0/678: fsync de/d14/f1f 0 2024-09-18T12:49:16.170 INFO:tasks.workunit.client.1.smithi148.stdout:2/449: mkdir d9/d17/d29/d92/d95/d9b 0 2024-09-18T12:49:16.174 INFO:tasks.workunit.client.1.smithi148.stdout:5/563: mkdir d7/d8/d18/d3f/d7c/d7d/dbc 0 2024-09-18T12:49:16.175 INFO:tasks.workunit.client.0.smithi078.stdout:3/361: dread d9/f27 [0,4194304] 0 2024-09-18T12:49:16.175 INFO:tasks.workunit.client.0.smithi078.stdout:3/362: dread - d9/f61 zero size 2024-09-18T12:49:16.176 INFO:tasks.workunit.client.1.smithi148.stdout:4/482: mknod d15/d17/d52/d92/d4c/ca4 0 2024-09-18T12:49:16.177 INFO:tasks.workunit.client.0.smithi078.stdout:6/525: rename d10/d2b/d43/d53/d45/d55/d3f to d10/d2b/d43/d53/d63/d70/dac 0 2024-09-18T12:49:16.178 INFO:tasks.workunit.client.0.smithi078.stdout:1/374: rename d0/d8 to d0/d8/da/d3e/d50/d60/d75 22 2024-09-18T12:49:16.178 INFO:tasks.workunit.client.1.smithi148.stdout:4/483: dread d15/d17/d52/d92/d4c/f83 [0,4194304] 0 2024-09-18T12:49:16.179 INFO:tasks.workunit.client.0.smithi078.stdout:6/526: chown d10/d2b/d43/f60 42870415 1 2024-09-18T12:49:16.179 INFO:tasks.workunit.client.0.smithi078.stdout:6/527: dread - d10/d2b/d43/f6c zero size 2024-09-18T12:49:16.180 INFO:tasks.workunit.client.1.smithi148.stdout:6/542: mkdir d5/d1a/dc/d2b/d35/d65/d99/da4/da6 0 2024-09-18T12:49:16.181 INFO:tasks.workunit.client.0.smithi078.stdout:6/528: write d10/f41 [3980693,109952] 0 2024-09-18T12:49:16.181 INFO:tasks.workunit.client.1.smithi148.stdout:3/481: sync 2024-09-18T12:49:16.181 INFO:tasks.workunit.client.0.smithi078.stdout:6/529: readlink d10/d2b/d37/l49 0 2024-09-18T12:49:16.182 INFO:tasks.workunit.client.0.smithi078.stdout:5/487: truncate d2/d4/f1e 3729058 0 2024-09-18T12:49:16.184 INFO:tasks.workunit.client.1.smithi148.stdout:0/679: fsync fa 0 2024-09-18T12:49:16.185 INFO:tasks.workunit.client.0.smithi078.stdout:4/316: symlink d11/d1f/l6b 0 2024-09-18T12:49:16.187 INFO:tasks.workunit.client.1.smithi148.stdout:2/450: fsync d9/d17/d29/f3e 0 2024-09-18T12:49:16.190 INFO:tasks.workunit.client.1.smithi148.stdout:5/564: mkdir d7/d8/dc/d12/d1f/d25/d4b/dbd 0 2024-09-18T12:49:16.191 INFO:tasks.workunit.client.0.smithi078.stdout:3/363: fdatasync d9/d2f/f70 0 2024-09-18T12:49:16.193 INFO:tasks.workunit.client.1.smithi148.stdout:9/514: dread d8/da/dd/d3f/d5d/f99 [0,4194304] 0 2024-09-18T12:49:16.197 INFO:tasks.workunit.client.1.smithi148.stdout:3/482: chown d4/d8/d1e/d6b/d31/d46 698728 1 2024-09-18T12:49:16.199 INFO:tasks.workunit.client.0.smithi078.stdout:6/530: creat d10/d2b/d43/d53/d63/d70/dac/fad x:0 0 0 2024-09-18T12:49:16.200 INFO:tasks.workunit.client.1.smithi148.stdout:6/543: dwrite d5/d1a/f21 [0,4194304] 0 2024-09-18T12:49:16.203 INFO:tasks.workunit.client.0.smithi078.stdout:5/488: mkdir d2/d4/d9/da/d60/d95 0 2024-09-18T12:49:16.204 INFO:tasks.workunit.client.1.smithi148.stdout:2/451: symlink d9/d24/d31/d34/d42/l9c 0 2024-09-18T12:49:16.205 INFO:tasks.workunit.client.1.smithi148.stdout:2/452: chown d9/d73/d81 6625 1 2024-09-18T12:49:16.205 INFO:tasks.workunit.client.0.smithi078.stdout:4/317: creat d11/d1f/d40/f6c x:0 0 0 2024-09-18T12:49:16.206 INFO:tasks.workunit.client.0.smithi078.stdout:4/318: chown d11/d1f/d40 8032430 1 2024-09-18T12:49:16.206 INFO:tasks.workunit.client.1.smithi148.stdout:2/453: readlink d9/d24/d31/d34/d42/l9c 0 2024-09-18T12:49:16.207 INFO:tasks.workunit.client.1.smithi148.stdout:5/565: chown d7/d8/dc/d12/d20/c30 0 1 2024-09-18T12:49:16.208 INFO:tasks.workunit.client.1.smithi148.stdout:5/566: chown d7/d8/dc/d12/d31/d5a/f96 811 1 2024-09-18T12:49:16.208 INFO:tasks.workunit.client.0.smithi078.stdout:0/448: mknod d3/caa 0 2024-09-18T12:49:16.209 INFO:tasks.workunit.client.0.smithi078.stdout:9/309: write d5/d40/d4e/f57 [727582,2388] 0 2024-09-18T12:49:16.210 INFO:tasks.workunit.client.1.smithi148.stdout:8/598: rename d8/d12/d51/d94/f78 to d8/d12/d46/d7e/fd0 0 2024-09-18T12:49:16.211 INFO:tasks.workunit.client.1.smithi148.stdout:4/484: getdents d15/d17/d52/d92/d4c/d4f/d64/d9a 0 2024-09-18T12:49:16.212 INFO:tasks.workunit.client.0.smithi078.stdout:2/314: link d4/dd/f40 d4/dd/d18/f60 0 2024-09-18T12:49:16.213 INFO:tasks.workunit.client.1.smithi148.stdout:9/515: mknod d8/da/dd/d4a/d49/d46/d75/c9f 0 2024-09-18T12:49:16.213 INFO:tasks.workunit.client.0.smithi078.stdout:9/310: fdatasync d5/d7/d8/d4f/f64 0 2024-09-18T12:49:16.214 INFO:tasks.workunit.client.0.smithi078.stdout:4/319: dwrite d11/d27/f48 [0,4194304] 0 2024-09-18T12:49:16.216 INFO:tasks.workunit.client.1.smithi148.stdout:6/544: unlink d5/d1a/c6a 0 2024-09-18T12:49:16.220 INFO:tasks.workunit.client.1.smithi148.stdout:7/548: getdents db/dc/df/d1d/d68 0 2024-09-18T12:49:16.221 INFO:tasks.workunit.client.0.smithi078.stdout:9/311: write d5/f4a [326236,6445] 0 2024-09-18T12:49:16.224 INFO:tasks.workunit.client.0.smithi078.stdout:6/531: write d10/d2b/d43/f60 [1396361,110018] 0 2024-09-18T12:49:16.224 INFO:tasks.workunit.client.1.smithi148.stdout:3/483: dread d4/f89 [0,4194304] 0 2024-09-18T12:49:16.227 INFO:tasks.workunit.client.0.smithi078.stdout:1/375: truncate d0/d8/da/f5f 3205118 0 2024-09-18T12:49:16.227 INFO:tasks.workunit.client.0.smithi078.stdout:0/449: dwrite d3/d1f/d2e/d68/d30/d7c/f85 [0,4194304] 0 2024-09-18T12:49:16.230 INFO:tasks.workunit.client.1.smithi148.stdout:5/567: symlink d7/d8/dc/d12/d1f/d25/d4b/lbe 0 2024-09-18T12:49:16.232 INFO:tasks.workunit.client.0.smithi078.stdout:6/532: read d10/d2b/d43/d53/d63/d70/d77/fa3 [851320,77413] 0 2024-09-18T12:49:16.232 INFO:tasks.workunit.client.1.smithi148.stdout:1/511: rename dc/d11/d38/d87/f82 to dc/d18/d31/faf 0 2024-09-18T12:49:16.234 INFO:tasks.workunit.client.0.smithi078.stdout:6/533: truncate d10/d2b/d43/f6c 195815 0 2024-09-18T12:49:16.235 INFO:tasks.workunit.client.1.smithi148.stdout:8/599: unlink d8/df/d3e/d88/cb9 0 2024-09-18T12:49:16.237 INFO:tasks.workunit.client.0.smithi078.stdout:6/534: write d10/d2b/d43/d53/d63/d70/d7d/fa5 [57420,86509] 0 2024-09-18T12:49:16.238 INFO:tasks.workunit.client.1.smithi148.stdout:4/485: truncate fa 954897 0 2024-09-18T12:49:16.238 INFO:tasks.workunit.client.0.smithi078.stdout:6/535: chown d10/d2b/d61/f9e 2 1 2024-09-18T12:49:16.239 INFO:tasks.workunit.client.0.smithi078.stdout:7/259: link d7/f1e d7/d9/d14/d22/f57 0 2024-09-18T12:49:16.240 INFO:tasks.workunit.client.0.smithi078.stdout:6/536: write d10/f97 [683949,8523] 0 2024-09-18T12:49:16.241 INFO:tasks.workunit.client.1.smithi148.stdout:9/516: mkdir d8/da/dd/d3f/d5d/da0 0 2024-09-18T12:49:16.241 INFO:tasks.workunit.client.0.smithi078.stdout:3/364: dread d9/d13/d33/d4e/f25 [0,4194304] 0 2024-09-18T12:49:16.242 INFO:tasks.workunit.client.0.smithi078.stdout:4/320: symlink d11/d27/d47/l6d 0 2024-09-18T12:49:16.243 INFO:tasks.workunit.client.1.smithi148.stdout:9/517: dread d8/da/dd/f14 [0,4194304] 0 2024-09-18T12:49:16.245 INFO:tasks.workunit.client.1.smithi148.stdout:6/545: creat d5/d79/fa7 x:0 0 0 2024-09-18T12:49:16.246 INFO:tasks.workunit.client.1.smithi148.stdout:6/546: dread - d5/d32/d38/d50/f97 zero size 2024-09-18T12:49:16.249 INFO:tasks.workunit.client.0.smithi078.stdout:9/312: creat d5/d7/d32/f65 x:0 0 0 2024-09-18T12:49:16.249 INFO:tasks.workunit.client.1.smithi148.stdout:3/484: read d4/d8/d1e/d6b/d31/d54/f8a [2069802,82346] 0 2024-09-18T12:49:16.250 INFO:tasks.workunit.client.0.smithi078.stdout:9/313: chown d5/d7/d8/f27 0 1 2024-09-18T12:49:16.250 INFO:tasks.workunit.client.1.smithi148.stdout:2/454: mkdir d9/d24/d31/d9d 0 2024-09-18T12:49:16.254 INFO:tasks.workunit.client.1.smithi148.stdout:5/568: mkdir d7/d8/dc/d22/dbf 0 2024-09-18T12:49:16.255 INFO:tasks.workunit.client.0.smithi078.stdout:0/450: creat d3/d1f/d2e/d4e/d37/d72/d96/fab x:0 0 0 2024-09-18T12:49:16.255 INFO:tasks.workunit.client.0.smithi078.stdout:5/489: getdents d2/d74 0 2024-09-18T12:49:16.256 INFO:tasks.workunit.client.1.smithi148.stdout:2/455: dwrite d9/d73/f91 [0,4194304] 0 2024-09-18T12:49:16.256 INFO:tasks.workunit.client.0.smithi078.stdout:0/451: write d3/d1f/d2e/d4e/f48 [3506971,102368] 0 2024-09-18T12:49:16.257 INFO:tasks.workunit.client.1.smithi148.stdout:2/456: chown d9/d17/d29/d92/d95/d64/l8b 400594063 1 2024-09-18T12:49:16.258 INFO:tasks.workunit.client.0.smithi078.stdout:4/321: dread d11/d1f/f3a [0,4194304] 0 2024-09-18T12:49:16.258 INFO:tasks.workunit.client.1.smithi148.stdout:0/680: rename de/d14/d93/fcb to de/d27/d53/d89/d9d/da4/fe3 0 2024-09-18T12:49:16.260 INFO:tasks.workunit.client.1.smithi148.stdout:0/681: write de/d27/d53/d89/d9d/fb9 [2458054,53719] 0 2024-09-18T12:49:16.262 INFO:tasks.workunit.client.0.smithi078.stdout:7/260: fdatasync d7/d26/f2a 0 2024-09-18T12:49:16.265 INFO:tasks.workunit.client.1.smithi148.stdout:8/600: mknod d8/d16/d53/da0/dba/cd1 0 2024-09-18T12:49:16.266 INFO:tasks.workunit.client.0.smithi078.stdout:6/537: symlink d10/d2b/d43/d53/d63/lae 0 2024-09-18T12:49:16.267 INFO:tasks.workunit.client.0.smithi078.stdout:6/538: stat d10/d2b/d43/d53/d63/d70/d77/fa3 0 2024-09-18T12:49:16.269 INFO:tasks.workunit.client.0.smithi078.stdout:6/539: write d10/d2b/d43/d53/d63/d70/dac/f5f [2425591,1051] 0 2024-09-18T12:49:16.270 INFO:tasks.workunit.client.0.smithi078.stdout:6/540: fsync d10/d2b/d43/f6c 0 2024-09-18T12:49:16.271 INFO:tasks.workunit.client.0.smithi078.stdout:6/541: fdatasync d10/d2b/d43/d53/d63/d70/d7d/fa2 0 2024-09-18T12:49:16.272 INFO:tasks.workunit.client.1.smithi148.stdout:4/486: dwrite d15/d17/d52/f66 [0,4194304] 0 2024-09-18T12:49:16.272 INFO:tasks.workunit.client.0.smithi078.stdout:2/315: link d4/d1a/f43 d4/dd/d18/d3b/d4f/f61 0 2024-09-18T12:49:16.274 INFO:tasks.workunit.client.1.smithi148.stdout:7/549: dwrite db/d52/d25/d38/f3f [0,4194304] 0 2024-09-18T12:49:16.274 INFO:tasks.workunit.client.1.smithi148.stdout:9/518: symlink d8/d33/la1 0 2024-09-18T12:49:16.275 INFO:tasks.workunit.client.0.smithi078.stdout:2/316: truncate d4/dd/d18/d3b/d4f/f61 253920 0 2024-09-18T12:49:16.275 INFO:tasks.workunit.client.0.smithi078.stdout:9/314: mknod d5/d7/d32/c66 0 2024-09-18T12:49:16.276 INFO:tasks.workunit.client.0.smithi078.stdout:9/315: chown d5/d7/f5a 12 1 2024-09-18T12:49:16.277 INFO:tasks.workunit.client.1.smithi148.stdout:6/547: rmdir d5/d1a/dc/d2b 39 2024-09-18T12:49:16.280 INFO:tasks.workunit.client.0.smithi078.stdout:1/376: dwrite d0/f4b [0,4194304] 0 2024-09-18T12:49:16.281 INFO:tasks.workunit.client.1.smithi148.stdout:4/487: dwrite d15/d5f/f78 [0,4194304] 0 2024-09-18T12:49:16.283 INFO:tasks.workunit.client.1.smithi148.stdout:3/485: mkdir d4/d8/d20/d2b/d7f/d93/d94/dac 0 2024-09-18T12:49:16.283 INFO:tasks.workunit.client.1.smithi148.stdout:3/486: write d4/f76 [605270,57014] 0 2024-09-18T12:49:16.284 INFO:tasks.workunit.client.0.smithi078.stdout:1/377: write d0/d8/da/d3e/d58/d6e/f5a [1535067,24812] 0 2024-09-18T12:49:16.287 INFO:tasks.workunit.client.1.smithi148.stdout:3/487: write d4/d8/d20/d2b/f8f [638019,50974] 0 2024-09-18T12:49:16.289 INFO:tasks.workunit.client.0.smithi078.stdout:0/452: mknod d3/d43/d7f/cac 0 2024-09-18T12:49:16.290 INFO:tasks.workunit.client.1.smithi148.stdout:0/682: dread de/d27/d53/d89/dbb/f50 [0,4194304] 0 2024-09-18T12:49:16.290 INFO:tasks.workunit.client.1.smithi148.stdout:4/488: dwrite d15/d17/d52/d92/d4c/d4f/f8a [0,4194304] 0 2024-09-18T12:49:16.290 INFO:tasks.workunit.client.0.smithi078.stdout:2/317: dwrite d4/d8/d23/f56 [0,4194304] 0 2024-09-18T12:49:16.292 INFO:tasks.workunit.client.1.smithi148.stdout:2/457: creat d9/d3a/d90/f9e x:0 0 0 2024-09-18T12:49:16.293 INFO:tasks.workunit.client.0.smithi078.stdout:4/322: symlink d11/d27/d47/d4e/d50/l6e 0 2024-09-18T12:49:16.294 INFO:tasks.workunit.client.1.smithi148.stdout:2/458: write d9/d3a/f75 [2392188,91582] 0 2024-09-18T12:49:16.295 INFO:tasks.workunit.client.1.smithi148.stdout:1/512: mknod dc/d9f/cb0 0 2024-09-18T12:49:16.296 INFO:tasks.workunit.client.1.smithi148.stdout:3/488: dwrite d4/f49 [0,4194304] 0 2024-09-18T12:49:16.297 INFO:tasks.workunit.client.1.smithi148.stdout:1/513: chown dc/d11/d38/d87/d2b/l62 349 1 2024-09-18T12:49:16.312 INFO:tasks.workunit.client.0.smithi078.stdout:6/542: fdatasync d10/d2b/d43/d53/d63/d70/d77/f8d 0 2024-09-18T12:49:16.312 INFO:tasks.workunit.client.0.smithi078.stdout:6/543: dread - d10/d2b/d43/d53/d45/fa0 zero size 2024-09-18T12:49:16.312 INFO:tasks.workunit.client.0.smithi078.stdout:1/378: symlink d0/d37/l76 0 2024-09-18T12:49:16.314 INFO:tasks.workunit.client.0.smithi078.stdout:1/379: write d0/d8/da/f40 [5105167,63155] 0 2024-09-18T12:49:16.314 INFO:tasks.workunit.client.0.smithi078.stdout:6/544: dread - d10/d2b/d43/d53/d45/d55/fab zero size 2024-09-18T12:49:16.315 INFO:tasks.workunit.client.0.smithi078.stdout:1/380: chown d0/d8/da/l1e 31982345 1 2024-09-18T12:49:16.316 INFO:tasks.workunit.client.1.smithi148.stdout:4/489: mkdir d15/d17/d52/d68/da5 0 2024-09-18T12:49:16.319 INFO:tasks.workunit.client.1.smithi148.stdout:8/601: mkdir d8/df/d3e/d82/dd2 0 2024-09-18T12:49:16.319 INFO:tasks.workunit.client.0.smithi078.stdout:2/318: creat d4/db/dc/f62 x:0 0 0 2024-09-18T12:49:16.319 INFO:tasks.workunit.client.0.smithi078.stdout:2/319: readlink d4/dd/d18/d3b/l3e 0 2024-09-18T12:49:16.319 INFO:tasks.workunit.client.1.smithi148.stdout:2/459: read d9/d17/d29/d92/d95/f38 [3820585,3915] 0 2024-09-18T12:49:16.320 INFO:tasks.workunit.client.1.smithi148.stdout:3/489: creat d4/d8/d1e/d63/fad x:0 0 0 2024-09-18T12:49:16.321 INFO:tasks.workunit.client.1.smithi148.stdout:7/550: mkdir db/dc/df/d2c/d66/da0 0 2024-09-18T12:49:16.322 INFO:tasks.workunit.client.0.smithi078.stdout:6/545: dwrite d10/d2b/d43/d53/d63/d70/d7d/f84 [0,4194304] 0 2024-09-18T12:49:16.323 INFO:tasks.workunit.client.0.smithi078.stdout:4/323: dread d11/f12 [4194304,4194304] 0 2024-09-18T12:49:16.323 INFO:tasks.workunit.client.0.smithi078.stdout:0/453: mknod d3/d43/cad 0 2024-09-18T12:49:16.324 INFO:tasks.workunit.client.0.smithi078.stdout:4/324: truncate d11/d1f/f67 177693 0 2024-09-18T12:49:16.325 INFO:tasks.workunit.client.1.smithi148.stdout:8/602: dwrite d8/d16/f2a [4194304,4194304] 0 2024-09-18T12:49:16.326 INFO:tasks.workunit.client.1.smithi148.stdout:0/683: mknod de/d27/d53/d89/dc0/db0/ce4 0 2024-09-18T12:49:16.326 INFO:tasks.workunit.client.0.smithi078.stdout:3/365: link d9/d13/d33/d3c/d19/c6f d9/d13/d33/d3c/d19/c72 0 2024-09-18T12:49:16.327 INFO:tasks.workunit.client.0.smithi078.stdout:9/316: link d5/d7/lf d5/d7/d8/d4f/l67 0 2024-09-18T12:49:16.328 INFO:tasks.workunit.client.1.smithi148.stdout:3/490: dread d4/d8/f51 [0,4194304] 0 2024-09-18T12:49:16.328 INFO:tasks.workunit.client.1.smithi148.stdout:0/684: dread - de/d27/d53/d89/dc0/dbd/fbe zero size 2024-09-18T12:49:16.328 INFO:tasks.workunit.client.0.smithi078.stdout:9/317: chown d5/d7/d32/f44 81954999 1 2024-09-18T12:49:16.329 INFO:tasks.workunit.client.1.smithi148.stdout:4/490: mknod d15/d17/d52/d92/ca6 0 2024-09-18T12:49:16.332 INFO:tasks.workunit.client.1.smithi148.stdout:0/685: fsync de/d14/f26 0 2024-09-18T12:49:16.333 INFO:tasks.workunit.client.0.smithi078.stdout:2/320: creat d4/dd/d18/d3b/f63 x:0 0 0 2024-09-18T12:49:16.333 INFO:tasks.workunit.client.0.smithi078.stdout:2/321: stat d4/d8/f1d 0 2024-09-18T12:49:16.335 INFO:tasks.workunit.client.0.smithi078.stdout:0/454: dread d3/d1f/d2e/d68/f2b [0,4194304] 0 2024-09-18T12:49:16.335 INFO:tasks.workunit.client.1.smithi148.stdout:9/519: link d8/da/l28 d8/da/dd/d65/la2 0 2024-09-18T12:49:16.336 INFO:tasks.workunit.client.0.smithi078.stdout:9/318: fdatasync f0 0 2024-09-18T12:49:16.337 INFO:tasks.workunit.client.1.smithi148.stdout:7/551: truncate db/dc/f28 3597259 0 2024-09-18T12:49:16.338 INFO:tasks.workunit.client.0.smithi078.stdout:9/319: chown d5/d40/f63 8014 1 2024-09-18T12:49:16.339 INFO:tasks.workunit.client.1.smithi148.stdout:6/548: fdatasync d5/d1a/dc/d2b/d35/f72 0 2024-09-18T12:49:16.344 INFO:tasks.workunit.client.0.smithi078.stdout:3/366: fdatasync d9/f12 0 2024-09-18T12:49:16.347 INFO:tasks.workunit.client.1.smithi148.stdout:3/491: creat d4/d8/d1e/d79/d92/fae x:0 0 0 2024-09-18T12:49:16.349 INFO:tasks.workunit.client.0.smithi078.stdout:0/455: creat d3/d1f/d2e/d4e/d37/d72/fae x:0 0 0 2024-09-18T12:49:16.351 INFO:tasks.workunit.client.0.smithi078.stdout:3/367: dwrite d9/d13/d33/d34/f48 [0,4194304] 0 2024-09-18T12:49:16.352 INFO:tasks.workunit.client.1.smithi148.stdout:2/460: write d9/f21 [4779481,49261] 0 2024-09-18T12:49:16.356 INFO:tasks.workunit.client.1.smithi148.stdout:0/686: chown de/d14/c3c 1978 1 2024-09-18T12:49:16.357 INFO:tasks.workunit.client.1.smithi148.stdout:7/552: dread db/d52/d25/f48 [0,4194304] 0 2024-09-18T12:49:16.357 INFO:tasks.workunit.client.1.smithi148.stdout:0/687: chown de/d14/d43/dd6 355 1 2024-09-18T12:49:16.357 INFO:tasks.workunit.client.0.smithi078.stdout:5/490: dwrite d2/d4/d12/d16/d36/f41 [0,4194304] 0 2024-09-18T12:49:16.358 INFO:tasks.workunit.client.1.smithi148.stdout:9/520: dread d8/f25 [0,4194304] 0 2024-09-18T12:49:16.359 INFO:tasks.workunit.client.0.smithi078.stdout:9/320: read d5/d7/d8/f1d [1248857,117663] 0 2024-09-18T12:49:16.360 INFO:tasks.workunit.client.0.smithi078.stdout:5/491: read d2/d4/d9/da/f7a [218255,64108] 0 2024-09-18T12:49:16.364 INFO:tasks.workunit.client.0.smithi078.stdout:4/325: getdents d11/d27 0 2024-09-18T12:49:16.365 INFO:tasks.workunit.client.1.smithi148.stdout:8/603: mknod d8/df/d3e/d82/d8f/d95/cd3 0 2024-09-18T12:49:16.494 INFO:tasks.workunit.client.0.smithi078.stdout:3/368: symlink d9/d13/l73 0 2024-09-18T12:49:16.495 INFO:tasks.workunit.client.0.smithi078.stdout:3/369: write f7 [1728114,24497] 0 2024-09-18T12:49:16.496 INFO:tasks.workunit.client.1.smithi148.stdout:3/492: creat d4/d8/d1e/d6b/d31/d60/faf x:0 0 0 2024-09-18T12:49:16.496 INFO:tasks.workunit.client.1.smithi148.stdout:3/493: truncate d4/f76 1656224 0 2024-09-18T12:49:16.498 INFO:tasks.workunit.client.0.smithi078.stdout:9/321: write d5/d7/d32/d2a/f59 [4230123,121227] 0 2024-09-18T12:49:16.499 INFO:tasks.workunit.client.0.smithi078.stdout:5/492: mknod d2/d4/d48/d86/c96 0 2024-09-18T12:49:16.502 INFO:tasks.workunit.client.1.smithi148.stdout:7/553: mkdir db/dc/d91/da1 0 2024-09-18T12:49:16.503 INFO:tasks.workunit.client.0.smithi078.stdout:9/322: dread d5/d7/f2b [0,4194304] 0 2024-09-18T12:49:16.503 INFO:tasks.workunit.client.1.smithi148.stdout:3/494: dwrite d4/d8/d1e/d6b/f4d [0,4194304] 0 2024-09-18T12:49:16.504 INFO:tasks.workunit.client.0.smithi078.stdout:4/326: creat d11/d1f/d40/f6f x:0 0 0 2024-09-18T12:49:16.505 INFO:tasks.workunit.client.0.smithi078.stdout:4/327: readlink d11/d1f/l37 0 2024-09-18T12:49:16.506 INFO:tasks.workunit.client.0.smithi078.stdout:5/493: dwrite d2/d4/d9/f2a [0,4194304] 0 2024-09-18T12:49:16.506 INFO:tasks.workunit.client.0.smithi078.stdout:4/328: fsync d11/d1f/d40/f6c 0 2024-09-18T12:49:16.506 INFO:tasks.workunit.client.1.smithi148.stdout:9/521: rmdir d8/da/dd/d4a/d49/d46/d75 39 2024-09-18T12:49:16.511 INFO:tasks.workunit.client.1.smithi148.stdout:3/495: dwrite d4/d8/d20/d2b/d43/f4b [0,4194304] 0 2024-09-18T12:49:16.514 INFO:tasks.workunit.client.1.smithi148.stdout:8/604: symlink d8/df/d66/ld4 0 2024-09-18T12:49:16.517 INFO:tasks.workunit.client.0.smithi078.stdout:0/456: creat d3/d1f/faf x:0 0 0 2024-09-18T12:49:16.519 INFO:tasks.workunit.client.1.smithi148.stdout:5/569: truncate d7/d8/f9 1382110 0 2024-09-18T12:49:16.521 INFO:tasks.workunit.client.0.smithi078.stdout:5/494: mkdir d2/d4/d12/d16/d36/d4c/d97 0 2024-09-18T12:49:16.522 INFO:tasks.workunit.client.0.smithi078.stdout:5/495: stat d2/d4/f1d 0 2024-09-18T12:49:16.522 INFO:tasks.workunit.client.1.smithi148.stdout:0/688: dread de/d14/d43/f7e [0,4194304] 0 2024-09-18T12:49:16.524 INFO:tasks.workunit.client.1.smithi148.stdout:1/514: truncate dc/d11/d38/d87/d2b/f2e 1687100 0 2024-09-18T12:49:16.532 INFO:tasks.workunit.client.0.smithi078.stdout:9/323: mkdir d5/d7/d32/d2a/d68 0 2024-09-18T12:49:16.533 INFO:tasks.workunit.client.0.smithi078.stdout:2/322: dwrite d4/db/dc/f2f [0,4194304] 0 2024-09-18T12:49:16.534 INFO:tasks.workunit.client.1.smithi148.stdout:8/605: mkdir d8/d12/d46/d74/dd5 0 2024-09-18T12:49:16.541 INFO:tasks.workunit.client.1.smithi148.stdout:2/461: creat d9/f9f x:0 0 0 2024-09-18T12:49:16.541 INFO:tasks.workunit.client.1.smithi148.stdout:2/462: chown d9/d3a/d90/d94 12 1 2024-09-18T12:49:16.542 INFO:tasks.workunit.client.0.smithi078.stdout:5/496: dread d2/d4/f7e [0,4194304] 0 2024-09-18T12:49:16.543 INFO:tasks.workunit.client.0.smithi078.stdout:0/457: dread d3/d1f/d2e/d68/d30/f64 [0,4194304] 0 2024-09-18T12:49:16.544 INFO:tasks.workunit.client.1.smithi148.stdout:4/491: write d15/f28 [3524006,29746] 0 2024-09-18T12:49:16.544 INFO:tasks.workunit.client.1.smithi148.stdout:1/515: chown dc/d18/f90 12 1 2024-09-18T12:49:16.545 INFO:tasks.workunit.client.0.smithi078.stdout:9/324: unlink d5/d7/d32/c4d 0 2024-09-18T12:49:16.545 INFO:tasks.workunit.client.1.smithi148.stdout:4/492: chown d15/d17/d52/d92/d4c/d4f/d64/da0 130783 1 2024-09-18T12:49:16.548 INFO:tasks.workunit.client.0.smithi078.stdout:5/497: symlink d2/d4/d9/da/d2b/d3e/l98 0 2024-09-18T12:49:16.550 INFO:tasks.workunit.client.1.smithi148.stdout:6/549: getdents d5/d1a/dc/d2b/d35 0 2024-09-18T12:49:16.553 INFO:tasks.workunit.client.0.smithi078.stdout:3/370: dwrite d9/d29/f6d [0,4194304] 0 2024-09-18T12:49:16.555 INFO:tasks.workunit.client.0.smithi078.stdout:5/498: write d2/d4/f7e [1298379,129838] 0 2024-09-18T12:49:16.557 INFO:tasks.workunit.client.0.smithi078.stdout:2/323: creat d4/dd/f64 x:0 0 0 2024-09-18T12:49:16.558 INFO:tasks.workunit.client.0.smithi078.stdout:2/324: dread - d4/d8/d23/d52/f5a zero size 2024-09-18T12:49:16.559 INFO:tasks.workunit.client.0.smithi078.stdout:0/458: mknod d3/d1f/cb0 0 2024-09-18T12:49:16.559 INFO:tasks.workunit.client.0.smithi078.stdout:2/325: chown d4/dd/f40 656 1 2024-09-18T12:49:16.560 INFO:tasks.workunit.client.0.smithi078.stdout:0/459: stat d3/d1f/d2e/d68/f8b 0 2024-09-18T12:49:16.561 INFO:tasks.workunit.client.1.smithi148.stdout:5/570: symlink d7/d8/dc/da6/lc0 0 2024-09-18T12:49:16.563 INFO:tasks.workunit.client.1.smithi148.stdout:0/689: getdents de/d14/d6b/ddf 0 2024-09-18T12:49:16.563 INFO:tasks.workunit.client.1.smithi148.stdout:9/522: write d8/da/dd/d35/d47/f94 [1787275,39144] 0 2024-09-18T12:49:16.565 INFO:tasks.workunit.client.0.smithi078.stdout:5/499: creat d2/d4/d9/d2f/f99 x:0 0 0 2024-09-18T12:49:16.566 INFO:tasks.workunit.client.0.smithi078.stdout:2/326: rmdir d4/db/d45 39 2024-09-18T12:49:16.567 INFO:tasks.workunit.client.0.smithi078.stdout:5/500: truncate d2/d4/d12/f8e 710499 0 2024-09-18T12:49:16.567 INFO:tasks.workunit.client.0.smithi078.stdout:5/501: chown d2/d4/f1d 8161779 1 2024-09-18T12:49:16.569 INFO:tasks.workunit.client.0.smithi078.stdout:5/502: write d2/d4/d9/d2f/f99 [894373,11625] 0 2024-09-18T12:49:16.573 INFO:tasks.workunit.client.0.smithi078.stdout:4/329: truncate d11/d27/f48 586309 0 2024-09-18T12:49:16.574 INFO:tasks.workunit.client.1.smithi148.stdout:3/496: creat d4/d8/d20/fb0 x:0 0 0 2024-09-18T12:49:16.575 INFO:tasks.workunit.client.0.smithi078.stdout:2/327: dread d4/dd/d18/d3b/d55/f59 [0,4194304] 0 2024-09-18T12:49:16.577 INFO:tasks.workunit.client.1.smithi148.stdout:7/554: truncate db/dc/df/d8e/f7c 2856409 0 2024-09-18T12:49:16.577 INFO:tasks.workunit.client.0.smithi078.stdout:9/325: dread d5/d7/f1e [0,4194304] 0 2024-09-18T12:49:16.581 INFO:tasks.workunit.client.1.smithi148.stdout:5/571: rename d7/d8/dc/d12/d1f/d25/c4d to d7/d8/d18/d3f/d7c/d7d/cc1 0 2024-09-18T12:49:16.582 INFO:tasks.workunit.client.0.smithi078.stdout:5/503: creat d2/d4/d9/da/d60/d95/f9a x:0 0 0 2024-09-18T12:49:16.583 INFO:tasks.workunit.client.1.smithi148.stdout:9/523: fsync d8/da/dd/f40 0 2024-09-18T12:49:16.585 INFO:tasks.workunit.client.0.smithi078.stdout:2/328: symlink d4/d1a/l65 0 2024-09-18T12:49:16.585 INFO:tasks.workunit.client.0.smithi078.stdout:9/326: dwrite d5/d40/f63 [0,4194304] 0 2024-09-18T12:49:16.587 INFO:tasks.workunit.client.1.smithi148.stdout:3/497: dread d4/d8/d1e/f5e [0,4194304] 0 2024-09-18T12:49:16.587 INFO:tasks.workunit.client.1.smithi148.stdout:1/516: mkdir dc/d4d/dad/db1 0 2024-09-18T12:49:16.589 INFO:tasks.workunit.client.1.smithi148.stdout:8/606: dwrite d8/d16/f9d [4194304,4194304] 0 2024-09-18T12:49:16.589 INFO:tasks.workunit.client.1.smithi148.stdout:8/607: fdatasync d8/df/fc8 0 2024-09-18T12:49:16.590 INFO:tasks.workunit.client.0.smithi078.stdout:3/371: dread d9/d13/f1d [0,4194304] 0 2024-09-18T12:49:16.590 INFO:tasks.workunit.client.1.smithi148.stdout:1/517: write dc/d11/d38/d87/f23 [448156,113105] 0 2024-09-18T12:49:16.591 INFO:tasks.workunit.client.0.smithi078.stdout:3/372: write d9/d29/f24 [7267717,106831] 0 2024-09-18T12:49:16.591 INFO:tasks.workunit.client.1.smithi148.stdout:6/550: mknod d5/d1a/dc/ca8 0 2024-09-18T12:49:16.593 INFO:tasks.workunit.client.0.smithi078.stdout:0/460: write d3/d1f/d2e/d4e/d37/f57 [662170,101838] 0 2024-09-18T12:49:16.595 INFO:tasks.workunit.client.1.smithi148.stdout:2/463: creat d9/d24/fa0 x:0 0 0 2024-09-18T12:49:16.598 INFO:tasks.workunit.client.1.smithi148.stdout:5/572: dread d7/d8/d18/f38 [0,4194304] 0 2024-09-18T12:49:16.600 INFO:tasks.workunit.client.1.smithi148.stdout:7/555: creat db/dc/df/d1d/d41/fa2 x:0 0 0 2024-09-18T12:49:16.602 INFO:tasks.workunit.client.0.smithi078.stdout:2/329: mknod d4/dd/d18/d33/c66 0 2024-09-18T12:49:16.609 INFO:tasks.workunit.client.0.smithi078.stdout:3/373: write d9/d13/f1d [1923506,342] 0 2024-09-18T12:49:16.611 INFO:tasks.workunit.client.1.smithi148.stdout:4/493: link d15/d17/d52/d92/d4c/d4f/d64/c6d d15/d17/d52/d92/d4c/d4f/d64/d9a/ca7 0 2024-09-18T12:49:16.611 INFO:tasks.workunit.client.0.smithi078.stdout:4/330: dwrite d11/d27/d47/f49 [0,4194304] 0 2024-09-18T12:49:16.615 INFO:tasks.workunit.client.0.smithi078.stdout:2/330: symlink d4/dd/d18/l67 0 2024-09-18T12:49:16.618 INFO:tasks.workunit.client.0.smithi078.stdout:3/374: dwrite d9/d13/f5f [0,4194304] 0 2024-09-18T12:49:16.618 INFO:tasks.workunit.client.1.smithi148.stdout:1/518: chown dc/d18/d31/l4c 885861 1 2024-09-18T12:49:16.619 INFO:tasks.workunit.client.0.smithi078.stdout:5/504: write d2/d4/d9/d2f/d30/f59 [26810,46287] 0 2024-09-18T12:49:16.620 INFO:tasks.workunit.client.0.smithi078.stdout:5/505: chown d2/d4/d9/da/d2b 7641844 1 2024-09-18T12:49:16.623 INFO:tasks.workunit.client.0.smithi078.stdout:5/506: chown d2/d4/d9/da/l37 20471795 1 2024-09-18T12:49:16.624 INFO:tasks.workunit.client.1.smithi148.stdout:1/519: dwrite dc/d11/d38/f6f [0,4194304] 0 2024-09-18T12:49:16.625 INFO:tasks.workunit.client.0.smithi078.stdout:0/461: dread d3/d1f/d2e/d4e/f49 [0,4194304] 0 2024-09-18T12:49:16.628 INFO:tasks.workunit.client.0.smithi078.stdout:5/507: write d2/d4/d9/da/d60/d61/f75 [883085,5912] 0 2024-09-18T12:49:16.630 INFO:tasks.workunit.client.0.smithi078.stdout:3/375: dread d9/d13/d33/d4e/f25 [0,4194304] 0 2024-09-18T12:49:16.631 INFO:tasks.workunit.client.0.smithi078.stdout:9/327: dwrite d5/d7/d32/d2a/f3d [0,4194304] 0 2024-09-18T12:49:16.634 INFO:tasks.workunit.client.1.smithi148.stdout:2/464: link d9/d17/d29/d92/d95/f6b d9/d17/d29/d92/d95/d9b/fa1 0 2024-09-18T12:49:16.635 INFO:tasks.workunit.client.1.smithi148.stdout:6/551: write d5/d32/d56/f78 [3630666,91973] 0 2024-09-18T12:49:16.636 INFO:tasks.workunit.client.0.smithi078.stdout:9/328: chown d5/d7/d32/d2a/l41 90272868 1 2024-09-18T12:49:16.637 INFO:tasks.workunit.client.1.smithi148.stdout:1/520: unlink dc/d18/d43/c42 0 2024-09-18T12:49:16.638 INFO:tasks.workunit.client.0.smithi078.stdout:5/508: creat d2/d4/d12/d16/d36/d4c/d62/d4d/f9b x:0 0 0 2024-09-18T12:49:16.638 INFO:tasks.workunit.client.1.smithi148.stdout:1/521: truncate dc/d51/f83 569981 0 2024-09-18T12:49:16.639 INFO:tasks.workunit.client.0.smithi078.stdout:5/509: chown d2/d4/l35 3463908 1 2024-09-18T12:49:16.641 INFO:tasks.workunit.client.1.smithi148.stdout:1/522: write dc/d11/d38/d87/d2b/d80/fa6 [2610201,42376] 0 2024-09-18T12:49:16.641 INFO:tasks.workunit.client.1.smithi148.stdout:0/690: rename de/d27/d53/d89/d9d/da4/fe3 to de/d14/d43/d57/fe5 0 2024-09-18T12:49:16.641 INFO:tasks.workunit.client.0.smithi078.stdout:9/329: symlink d5/d7/d32/d2a/l69 0 2024-09-18T12:49:16.642 INFO:tasks.workunit.client.1.smithi148.stdout:4/494: mknod d15/d17/d52/d68/da5/ca8 0 2024-09-18T12:49:16.642 INFO:tasks.workunit.client.1.smithi148.stdout:0/691: chown de/d14/d43/d57/d59/f99 7422122 1 2024-09-18T12:49:16.642 INFO:tasks.workunit.client.1.smithi148.stdout:4/495: readlink d15/d5f/l70 0 2024-09-18T12:49:16.647 INFO:tasks.workunit.client.1.smithi148.stdout:4/496: symlink d15/d17/d52/d92/d4c/d72/la9 0 2024-09-18T12:49:16.648 INFO:tasks.workunit.client.0.smithi078.stdout:9/330: rename d5/d7/f2b to d5/d7/d8/f6a 0 2024-09-18T12:49:16.649 INFO:tasks.workunit.client.1.smithi148.stdout:7/556: getdents db/dc/df/d2c 0 2024-09-18T12:49:16.650 INFO:tasks.workunit.client.1.smithi148.stdout:6/552: link d5/d1a/dc/d2b/d35/d65/c45 d5/d79/ca9 0 2024-09-18T12:49:16.653 INFO:tasks.workunit.client.1.smithi148.stdout:3/498: rename d4/d8/d20/l2e to d4/lb1 0 2024-09-18T12:49:16.654 INFO:tasks.workunit.client.1.smithi148.stdout:0/692: dwrite de/d14/d43/d57/fe5 [0,4194304] 0 2024-09-18T12:49:16.655 INFO:tasks.workunit.client.1.smithi148.stdout:6/553: write d5/d32/d38/d50/f61 [819200,88074] 0 2024-09-18T12:49:16.656 INFO:tasks.workunit.client.0.smithi078.stdout:4/331: dread d11/f61 [0,4194304] 0 2024-09-18T12:49:16.656 INFO:tasks.workunit.client.0.smithi078.stdout:9/331: rename d5/d40/d4e to d5/d7/d32/d2a/d6b 0 2024-09-18T12:49:16.658 INFO:tasks.workunit.client.0.smithi078.stdout:4/332: write d11/d27/d60/f68 [904295,111109] 0 2024-09-18T12:49:16.658 INFO:tasks.workunit.client.0.smithi078.stdout:4/333: fsync d11/d27/d5a/f5e 0 2024-09-18T12:49:16.659 INFO:tasks.workunit.client.1.smithi148.stdout:8/608: rename d8/df/c33 to d8/df/d3e/d88/cd6 0 2024-09-18T12:49:16.659 INFO:tasks.workunit.client.1.smithi148.stdout:3/499: dread d4/d8/d20/f3f [0,4194304] 0 2024-09-18T12:49:16.661 INFO:tasks.workunit.client.0.smithi078.stdout:3/376: dread d9/f12 [0,4194304] 0 2024-09-18T12:49:16.661 INFO:tasks.workunit.client.1.smithi148.stdout:0/693: creat de/d27/d53/d89/dbb/fe6 x:0 0 0 2024-09-18T12:49:16.663 INFO:tasks.workunit.client.1.smithi148.stdout:9/524: rename d8/f16 to d8/da/dd/d4a/d49/d46/d75/fa3 0 2024-09-18T12:49:16.663 INFO:tasks.workunit.client.0.smithi078.stdout:9/332: creat d5/f6c x:0 0 0 2024-09-18T12:49:16.664 INFO:tasks.workunit.client.0.smithi078.stdout:9/333: chown f0 9665 1 2024-09-18T12:49:16.664 INFO:tasks.workunit.client.1.smithi148.stdout:7/557: link db/dc/df/d11/c2d db/dc/df/d1d/d68/d7a/ca3 0 2024-09-18T12:49:16.665 INFO:tasks.workunit.client.0.smithi078.stdout:3/377: creat d9/d54/f74 x:0 0 0 2024-09-18T12:49:16.665 INFO:tasks.workunit.client.0.smithi078.stdout:3/378: write d9/f3f [215818,8678] 0 2024-09-18T12:49:16.667 INFO:tasks.workunit.client.1.smithi148.stdout:6/554: dwrite d5/d1a/d29/f4e [0,4194304] 0 2024-09-18T12:49:16.667 INFO:tasks.workunit.client.1.smithi148.stdout:0/694: chown de/d14/l8e 6076493 1 2024-09-18T12:49:16.667 INFO:tasks.workunit.client.1.smithi148.stdout:3/500: truncate d4/d8/f51 733441 0 2024-09-18T12:49:16.669 INFO:tasks.workunit.client.0.smithi078.stdout:3/379: creat d9/d13/d33/d4e/f75 x:0 0 0 2024-09-18T12:49:16.670 INFO:tasks.workunit.client.1.smithi148.stdout:2/465: rename d9/d24/d67/c82 to d9/d17/d29/d92/d95/ca2 0 2024-09-18T12:49:16.671 INFO:tasks.workunit.client.1.smithi148.stdout:0/695: write de/f1c [3761527,42110] 0 2024-09-18T12:49:16.671 INFO:tasks.workunit.client.1.smithi148.stdout:7/558: write db/dc/df/d1d/f5c [3364241,122662] 0 2024-09-18T12:49:16.671 INFO:tasks.workunit.client.1.smithi148.stdout:9/525: unlink d8/da/dd/d35/c88 0 2024-09-18T12:49:16.673 INFO:tasks.workunit.client.1.smithi148.stdout:6/555: creat d5/d1a/d29/faa x:0 0 0 2024-09-18T12:49:16.674 INFO:tasks.workunit.client.1.smithi148.stdout:8/609: dwrite d8/d12/d51/d94/f64 [0,4194304] 0 2024-09-18T12:49:16.676 INFO:tasks.workunit.client.1.smithi148.stdout:4/497: dread d15/f28 [0,4194304] 0 2024-09-18T12:49:16.676 INFO:tasks.workunit.client.1.smithi148.stdout:2/466: mknod d9/ca3 0 2024-09-18T12:49:16.676 INFO:tasks.workunit.client.1.smithi148.stdout:6/556: write d5/d32/d56/f78 [4122357,87788] 0 2024-09-18T12:49:16.677 INFO:tasks.workunit.client.1.smithi148.stdout:3/501: getdents d4/d8 0 2024-09-18T12:49:16.677 INFO:tasks.workunit.client.1.smithi148.stdout:8/610: chown d8/d16/d27/f30 161044359 1 2024-09-18T12:49:16.677 INFO:tasks.workunit.client.1.smithi148.stdout:4/498: readlink d15/d5f/l70 0 2024-09-18T12:49:16.681 INFO:tasks.workunit.client.1.smithi148.stdout:2/467: write d9/d3a/f86 [517273,65327] 0 2024-09-18T12:49:16.683 INFO:tasks.workunit.client.1.smithi148.stdout:4/499: mknod d15/d17/d52/d68/caa 0 2024-09-18T12:49:16.685 INFO:tasks.workunit.client.1.smithi148.stdout:8/611: write d8/df/f10 [1892690,121717] 0 2024-09-18T12:49:16.687 INFO:tasks.workunit.client.1.smithi148.stdout:2/468: creat d9/d17/d29/fa4 x:0 0 0 2024-09-18T12:49:16.689 INFO:tasks.workunit.client.1.smithi148.stdout:7/559: dwrite db/d52/d1f/f4d [4194304,4194304] 0 2024-09-18T12:49:16.691 INFO:tasks.workunit.client.1.smithi148.stdout:8/612: truncate d8/df/db2/fc3 779947 0 2024-09-18T12:49:16.692 INFO:tasks.workunit.client.1.smithi148.stdout:3/502: dwrite d4/d8/fa6 [0,4194304] 0 2024-09-18T12:49:16.693 INFO:tasks.workunit.client.1.smithi148.stdout:2/469: symlink d9/d24/d67/d72/d77/la5 0 2024-09-18T12:49:16.697 INFO:tasks.workunit.client.1.smithi148.stdout:2/470: symlink d9/d24/d67/d72/d8f/la6 0 2024-09-18T12:49:16.698 INFO:tasks.workunit.client.0.smithi078.stdout:8/350: sync 2024-09-18T12:49:16.699 INFO:tasks.workunit.client.0.smithi078.stdout:7/261: sync 2024-09-18T12:49:16.699 INFO:tasks.workunit.client.0.smithi078.stdout:1/381: sync 2024-09-18T12:49:16.699 INFO:tasks.workunit.client.0.smithi078.stdout:6/546: sync 2024-09-18T12:49:16.700 INFO:tasks.workunit.client.0.smithi078.stdout:1/382: chown d0/f6c 272724574 1 2024-09-18T12:49:16.702 INFO:tasks.workunit.client.1.smithi148.stdout:8/613: dwrite d8/d16/faf [0,4194304] 0 2024-09-18T12:49:16.707 INFO:tasks.workunit.client.1.smithi148.stdout:2/471: mknod d9/d24/d67/d72/d77/ca7 0 2024-09-18T12:49:16.707 INFO:tasks.workunit.client.1.smithi148.stdout:2/472: chown d9/d24/d47 72 1 2024-09-18T12:49:16.710 INFO:tasks.workunit.client.1.smithi148.stdout:8/614: rmdir d8/df/d66 39 2024-09-18T12:49:16.711 INFO:tasks.workunit.client.1.smithi148.stdout:2/473: dread d9/f21 [4194304,4194304] 0 2024-09-18T12:49:16.712 INFO:tasks.workunit.client.1.smithi148.stdout:3/503: link d4/d8/d1e/d6b/f81 d4/d8/d1e/d63/fb2 0 2024-09-18T12:49:16.713 INFO:tasks.workunit.client.0.smithi078.stdout:7/262: mknod d7/d3c/d47/c58 0 2024-09-18T12:49:16.713 INFO:tasks.workunit.client.0.smithi078.stdout:6/547: mkdir d10/d2b/d43/d53/d63/d70/d7d/daf 0 2024-09-18T12:49:16.713 INFO:tasks.workunit.client.1.smithi148.stdout:3/504: fdatasync d4/d8/d1e/d79/fab 0 2024-09-18T12:49:16.714 INFO:tasks.workunit.client.1.smithi148.stdout:3/505: readlink d4/d8/d1e/d6b/d31/d60/da9/l69 0 2024-09-18T12:49:16.715 INFO:tasks.workunit.client.1.smithi148.stdout:5/573: write d7/d8/dc/f28 [877750,109006] 0 2024-09-18T12:49:16.717 INFO:tasks.workunit.client.1.smithi148.stdout:2/474: creat d9/d73/fa8 x:0 0 0 2024-09-18T12:49:16.721 INFO:tasks.workunit.client.0.smithi078.stdout:7/263: read d7/f1d [137656,126390] 0 2024-09-18T12:49:16.722 INFO:tasks.workunit.client.0.smithi078.stdout:7/264: readlink d7/d9/l43 0 2024-09-18T12:49:16.723 INFO:tasks.workunit.client.0.smithi078.stdout:7/265: dread - d7/d26/d4f/f50 zero size 2024-09-18T12:49:16.723 INFO:tasks.workunit.client.0.smithi078.stdout:7/266: fsync d7/d9/d32/f36 0 2024-09-18T12:49:16.724 INFO:tasks.workunit.client.0.smithi078.stdout:7/267: dread - d7/d9/d32/f36 zero size 2024-09-18T12:49:16.725 INFO:tasks.workunit.client.1.smithi148.stdout:6/557: dread d5/d1a/dc/d2b/f30 [0,4194304] 0 2024-09-18T12:49:16.727 INFO:tasks.workunit.client.1.smithi148.stdout:5/574: rename d7/d8/db2 to d7/d8/dc/d12/d1f/d39/dc2 0 2024-09-18T12:49:16.730 INFO:tasks.workunit.client.1.smithi148.stdout:2/475: creat d9/d17/d29/d92/d95/d9b/fa9 x:0 0 0 2024-09-18T12:49:16.731 INFO:tasks.workunit.client.1.smithi148.stdout:5/575: mkdir d7/d8/dc/d12/d1f/d77/dc3 0 2024-09-18T12:49:16.732 INFO:tasks.workunit.client.0.smithi078.stdout:7/268: mknod d7/d9/d32/d3b/c59 0 2024-09-18T12:49:16.734 INFO:tasks.workunit.client.0.smithi078.stdout:5/510: dwrite d2/d4/f8 [0,4194304] 0 2024-09-18T12:49:16.735 INFO:tasks.workunit.client.1.smithi148.stdout:6/558: getdents d5/d32/d38 0 2024-09-18T12:49:16.737 INFO:tasks.workunit.client.1.smithi148.stdout:2/476: dwrite d9/d24/d47/f87 [0,4194304] 0 2024-09-18T12:49:16.739 INFO:tasks.workunit.client.1.smithi148.stdout:2/477: chown d9/d24/d31/d34/f6e 1450090 1 2024-09-18T12:49:16.740 INFO:tasks.workunit.client.1.smithi148.stdout:3/506: dread d4/d8/d1e/d6b/d31/f34 [0,4194304] 0 2024-09-18T12:49:16.746 INFO:tasks.workunit.client.0.smithi078.stdout:5/511: link d2/d4/f78 d2/d4/d12/d2d/f9c 0 2024-09-18T12:49:16.749 INFO:tasks.workunit.client.1.smithi148.stdout:2/478: mknod d9/d73/caa 0 2024-09-18T12:49:16.750 INFO:tasks.workunit.client.1.smithi148.stdout:3/507: mkdir d4/d8/d6a/db3 0 2024-09-18T12:49:16.752 INFO:tasks.workunit.client.1.smithi148.stdout:1/523: dwrite dc/d11/d38/d87/f41 [0,4194304] 0 2024-09-18T12:49:16.755 INFO:tasks.workunit.client.0.smithi078.stdout:4/334: dwrite d11/f55 [0,4194304] 0 2024-09-18T12:49:16.760 INFO:tasks.workunit.client.0.smithi078.stdout:9/334: write d5/d7/d32/d2a/d36/f55 [305413,5785] 0 2024-09-18T12:49:16.760 INFO:tasks.workunit.client.0.smithi078.stdout:9/335: write d5/d40/f63 [3385839,60489] 0 2024-09-18T12:49:16.762 INFO:tasks.workunit.client.0.smithi078.stdout:5/512: mknod d2/d4/d58/c9d 0 2024-09-18T12:49:16.767 INFO:tasks.workunit.client.1.smithi148.stdout:5/576: dread d7/d2b/f36 [0,4194304] 0 2024-09-18T12:49:16.767 INFO:tasks.workunit.client.0.smithi078.stdout:7/269: dread d7/d9/f10 [0,4194304] 0 2024-09-18T12:49:16.773 INFO:tasks.workunit.client.0.smithi078.stdout:4/335: dwrite d11/f38 [0,4194304] 0 2024-09-18T12:49:16.776 INFO:tasks.workunit.client.0.smithi078.stdout:5/513: dread d2/d4/f4f [0,4194304] 0 2024-09-18T12:49:16.782 INFO:tasks.workunit.client.1.smithi148.stdout:6/559: dread d5/d32/d38/d50/f61 [0,4194304] 0 2024-09-18T12:49:16.832 INFO:tasks.workunit.client.1.smithi148.stdout:9/526: sync 2024-09-18T12:49:16.833 INFO:tasks.workunit.client.1.smithi148.stdout:9/527: write d8/da/dd/d35/d47/d62/d72/f74 [4330010,26803] 0 2024-09-18T12:49:16.834 INFO:tasks.workunit.client.1.smithi148.stdout:9/528: write d8/f10 [1765708,41434] 0 2024-09-18T12:49:16.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.855+0000 7fa0700fa640 1 -- 172.21.15.78:0/4055595461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa068104d60 msgr2=0x7fa0681051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:16.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.855+0000 7fa0700fa640 1 --2- 172.21.15.78:0/4055595461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa068104d60 0x7fa0681051e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa058009880 tx=0x7fa05802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:16.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.855+0000 7fa0700fa640 1 -- 172.21.15.78:0/4055595461 shutdown_connections 2024-09-18T12:49:16.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.855+0000 7fa0700fa640 1 --2- 172.21.15.78:0/4055595461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa068104d60 0x7fa0681051e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:16.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.855+0000 7fa0700fa640 1 --2- 172.21.15.78:0/4055595461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa068103b60 0x7fa068103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:16.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.855+0000 7fa0700fa640 1 -- 172.21.15.78:0/4055595461 >> 172.21.15.78:0/4055595461 conn(0x7fa0680ff2f0 msgr2=0x7fa068101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:16.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.855+0000 7fa0700fa640 1 -- 172.21.15.78:0/4055595461 shutdown_connections 2024-09-18T12:49:16.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.855+0000 7fa0700fa640 1 -- 172.21.15.78:0/4055595461 wait complete. 2024-09-18T12:49:16.858 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:16 smithi078 ceph-mon[28091]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:49:16.858 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:16 smithi078 ceph-mon[28091]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:49:16.858 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:16 smithi078 ceph-mon[28091]: Updating smithi148:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:49:16.858 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:16 smithi078 ceph-mon[28091]: Updating smithi078:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:49:16.858 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:16 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:16.858 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:16 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:16.858 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:16 smithi078 ceph-mon[28091]: Reconfiguring ceph-exporter.smithi078 (dependencies changed)... 2024-09-18T12:49:16.858 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:16 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi078", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:49:16.858 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:16 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi078", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:49:16.858 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:16 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:16.859 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:16 smithi078 ceph-mon[28091]: Deploying daemon ceph-exporter.smithi078 on smithi078 2024-09-18T12:49:16.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.856+0000 7fa0700fa640 1 Processor -- start 2024-09-18T12:49:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.856+0000 7fa0700fa640 1 -- start start 2024-09-18T12:49:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.856+0000 7fa0700fa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa068103b60 0x7fa0681996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.856+0000 7fa0700fa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa068104d60 0x7fa068199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.856+0000 7fa0700fa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa06810c980 con 0x7fa068103b60 2024-09-18T12:49:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.856+0000 7fa0700fa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa06810c800 con 0x7fa068104d60 2024-09-18T12:49:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.856+0000 7fa06de96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa068103b60 0x7fa0681996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.856+0000 7fa06de96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa068103b60 0x7fa0681996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40768/0 (socket says 172.21.15.78:40768) 2024-09-18T12:49:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.856+0000 7fa06de96640 1 -- 172.21.15.78:0/3341838848 learned_addr learned my addr 172.21.15.78:0/3341838848 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:49:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.857+0000 7fa06d695640 1 --2- 172.21.15.78:0/3341838848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa068104d60 0x7fa068199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.857+0000 7fa06de96640 1 -- 172.21.15.78:0/3341838848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa068104d60 msgr2=0x7fa068199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.857+0000 7fa06de96640 1 --2- 172.21.15.78:0/3341838848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa068104d60 0x7fa068199bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.857+0000 7fa06de96640 1 -- 172.21.15.78:0/3341838848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06819a270 con 0x7fa068103b60 2024-09-18T12:49:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.857+0000 7fa06de96640 1 --2- 172.21.15.78:0/3341838848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa068103b60 0x7fa0681996b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa06400d6f0 tx=0x7fa06400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:16.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.857+0000 7fa05effd640 1 -- 172.21.15.78:0/3341838848 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa064017070 con 0x7fa068103b60 2024-09-18T12:49:16.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.857+0000 7fa0700fa640 1 -- 172.21.15.78:0/3341838848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06819ecb0 con 0x7fa068103b60 2024-09-18T12:49:16.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.857+0000 7fa05effd640 1 -- 172.21.15.78:0/3341838848 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa06400de00 con 0x7fa068103b60 2024-09-18T12:49:16.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.857+0000 7fa05effd640 1 -- 172.21.15.78:0/3341838848 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa064003bc0 con 0x7fa068103b60 2024-09-18T12:49:16.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.857+0000 7fa0700fa640 1 -- 172.21.15.78:0/3341838848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa06819f190 con 0x7fa068103b60 2024-09-18T12:49:16.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.858+0000 7fa0700fa640 1 -- 172.21.15.78:0/3341838848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa068103f60 con 0x7fa068103b60 2024-09-18T12:49:16.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.859+0000 7fa05effd640 1 -- 172.21.15.78:0/3341838848 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fa064010460 con 0x7fa068103b60 2024-09-18T12:49:16.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.859+0000 7fa05effd640 1 --2- 172.21.15.78:0/3341838848 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fa054074a30 0x7fa054076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:16.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.859+0000 7fa05effd640 1 -- 172.21.15.78:0/3341838848 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fa064095f10 con 0x7fa068103b60 2024-09-18T12:49:16.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.860+0000 7fa06d695640 1 --2- 172.21.15.78:0/3341838848 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fa054074a30 0x7fa054076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:16.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.860+0000 7fa06d695640 1 --2- 172.21.15.78:0/3341838848 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fa054074a30 0x7fa054076ef0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa058006010 tx=0x7fa058000bc0 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:16.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:16.864+0000 7fa05effd640 1 -- 172.21.15.78:0/3341838848 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fa064061440 con 0x7fa068103b60 2024-09-18T12:49:16.886 INFO:tasks.workunit.client.0.smithi078.stdout:3/380: truncate d9/d2f/f3d 2912747 0 2024-09-18T12:49:16.886 INFO:tasks.workunit.client.0.smithi078.stdout:3/381: stat d9/d13/d33/l67 0 2024-09-18T12:49:16.888 INFO:tasks.workunit.client.1.smithi148.stdout:0/696: write de/d27/fae [660800,103065] 0 2024-09-18T12:49:16.889 INFO:tasks.workunit.client.0.smithi078.stdout:7/270: rmdir d7/d9/d14 39 2024-09-18T12:49:16.889 INFO:tasks.workunit.client.1.smithi148.stdout:0/697: write f9 [4060084,55856] 0 2024-09-18T12:49:16.892 INFO:tasks.workunit.client.0.smithi078.stdout:4/336: creat d11/d27/d5a/f70 x:0 0 0 2024-09-18T12:49:16.893 INFO:tasks.workunit.client.1.smithi148.stdout:4/500: write d15/d17/f1c [6414688,86217] 0 2024-09-18T12:49:16.897 INFO:tasks.workunit.client.0.smithi078.stdout:3/382: write d9/f27 [3439284,4843] 0 2024-09-18T12:49:16.899 INFO:tasks.workunit.client.1.smithi148.stdout:7/560: dwrite db/d52/d25/f48 [0,4194304] 0 2024-09-18T12:49:16.900 INFO:tasks.workunit.client.0.smithi078.stdout:3/383: write d9/d13/d33/d34/f48 [5341212,113127] 0 2024-09-18T12:49:16.900 INFO:tasks.workunit.client.1.smithi148.stdout:4/501: dwrite d15/d17/d52/d92/d4c/d4f/f20 [0,4194304] 0 2024-09-18T12:49:16.901 INFO:tasks.workunit.client.0.smithi078.stdout:4/337: stat d11/c69 0 2024-09-18T12:49:16.904 INFO:tasks.workunit.client.0.smithi078.stdout:5/514: symlink d2/d4/d55/d8f/l9e 0 2024-09-18T12:49:16.904 INFO:tasks.workunit.client.0.smithi078.stdout:8/351: dwrite d0/d7/dc/d1f/d23/f25 [0,4194304] 0 2024-09-18T12:49:16.904 INFO:tasks.workunit.client.0.smithi078.stdout:4/338: read d11/f38 [2925175,68082] 0 2024-09-18T12:49:16.907 INFO:tasks.workunit.client.0.smithi078.stdout:9/336: creat d5/d7/f6d x:0 0 0 2024-09-18T12:49:16.907 INFO:tasks.workunit.client.0.smithi078.stdout:4/339: write d11/f12 [1671194,114867] 0 2024-09-18T12:49:16.910 INFO:tasks.workunit.client.1.smithi148.stdout:8/615: truncate d8/d16/faf 2156176 0 2024-09-18T12:49:16.910 INFO:tasks.workunit.client.1.smithi148.stdout:4/502: dwrite d15/d17/d52/d92/d4c/d4f/f8a [4194304,4194304] 0 2024-09-18T12:49:16.912 INFO:tasks.workunit.client.0.smithi078.stdout:8/352: truncate d0/d7/d1e/d50/f5b 922271 0 2024-09-18T12:49:16.914 INFO:tasks.workunit.client.0.smithi078.stdout:4/340: dread d11/d1f/f63 [0,4194304] 0 2024-09-18T12:49:16.916 INFO:tasks.workunit.client.0.smithi078.stdout:3/384: dread d9/d13/f39 [0,4194304] 0 2024-09-18T12:49:16.917 INFO:tasks.workunit.client.0.smithi078.stdout:3/385: chown d9/f61 416 1 2024-09-18T12:49:16.917 INFO:tasks.workunit.client.0.smithi078.stdout:3/386: dread - d9/d54/f74 zero size 2024-09-18T12:49:16.918 INFO:tasks.workunit.client.0.smithi078.stdout:6/548: truncate d10/d2b/d37/f48 944519 0 2024-09-18T12:49:16.934 INFO:tasks.workunit.client.0.smithi078.stdout:9/337: stat d5/d7/d32/d2a/d36/l53 0 2024-09-18T12:49:16.934 INFO:tasks.workunit.client.0.smithi078.stdout:7/271: dread d7/d9/d14/f25 [0,4194304] 0 2024-09-18T12:49:16.936 INFO:tasks.workunit.client.0.smithi078.stdout:7/272: write d7/d9/d32/d3b/f45 [433522,117269] 0 2024-09-18T12:49:16.939 INFO:tasks.workunit.client.0.smithi078.stdout:8/353: truncate d0/d7/dc/d1f/d23/d44/f4a 642668 0 2024-09-18T12:49:16.940 INFO:tasks.workunit.client.0.smithi078.stdout:4/341: read d11/f44 [44597,69237] 0 2024-09-18T12:49:16.941 INFO:tasks.workunit.client.1.smithi148.stdout:2/479: rmdir d9/d17/d29/d92/d95/d9b 39 2024-09-18T12:49:16.941 INFO:tasks.workunit.client.0.smithi078.stdout:8/354: write d0/d7/f24 [1141919,62170] 0 2024-09-18T12:49:16.941 INFO:tasks.workunit.client.1.smithi148.stdout:2/480: dread - d9/d24/d67/f76 zero size 2024-09-18T12:49:16.949 INFO:tasks.workunit.client.1.smithi148.stdout:9/529: truncate d8/da/dd/d4a/f2d 3107720 0 2024-09-18T12:49:16.951 INFO:tasks.workunit.client.1.smithi148.stdout:9/530: write d8/da/dd/d35/d81/f9e [701652,29108] 0 2024-09-18T12:49:16.955 INFO:tasks.workunit.client.0.smithi078.stdout:9/338: dwrite d5/d7/d8/f33 [0,4194304] 0 2024-09-18T12:49:16.965 INFO:tasks.workunit.client.0.smithi078.stdout:3/387: unlink d9/d2f/c6b 0 2024-09-18T12:49:16.968 INFO:tasks.workunit.client.0.smithi078.stdout:5/515: rename d2/d4/d58/c9d to d2/d4/d12/c9f 0 2024-09-18T12:49:16.969 INFO:tasks.workunit.client.0.smithi078.stdout:5/516: fdatasync d2/d4/d9/da/d60/d95/f9a 0 2024-09-18T12:49:16.970 INFO:tasks.workunit.client.1.smithi148.stdout:8/616: unlink d8/d12/f13 0 2024-09-18T12:49:16.972 INFO:tasks.workunit.client.1.smithi148.stdout:4/503: mknod d15/d17/d52/d68/da5/cab 0 2024-09-18T12:49:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:16 smithi148 ceph-mon[35352]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:49:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:16 smithi148 ceph-mon[35352]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:49:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:16 smithi148 ceph-mon[35352]: Updating smithi148:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:49:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:16 smithi148 ceph-mon[35352]: Updating smithi078:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:49:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:16 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:16 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:16 smithi148 ceph-mon[35352]: Reconfiguring ceph-exporter.smithi078 (dependencies changed)... 2024-09-18T12:49:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:16 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi078", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:49:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:16 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi078", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:49:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:16 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:16 smithi148 ceph-mon[35352]: Deploying daemon ceph-exporter.smithi078 on smithi078 2024-09-18T12:49:16.976 INFO:tasks.workunit.client.0.smithi078.stdout:9/339: truncate d5/d7/d32/d2a/d36/f43 169761 0 2024-09-18T12:49:16.978 INFO:tasks.workunit.client.1.smithi148.stdout:1/524: link dc/d4d/f56 dc/d18/d43/fb2 0 2024-09-18T12:49:16.979 INFO:tasks.workunit.client.0.smithi078.stdout:8/355: fsync d0/d7/dc/d1f/f28 0 2024-09-18T12:49:16.980 INFO:tasks.workunit.client.0.smithi078.stdout:8/356: chown d0/d7/d1e/d33/d3e 201974 1 2024-09-18T12:49:16.984 INFO:tasks.workunit.client.1.smithi148.stdout:6/560: link d5/d79/fa7 d5/d1a/dc/d2b/d9b/fab 0 2024-09-18T12:49:16.989 INFO:tasks.workunit.client.0.smithi078.stdout:8/357: dwrite d0/d7/dc/f3f [0,4194304] 0 2024-09-18T12:49:16.990 INFO:tasks.workunit.client.0.smithi078.stdout:9/340: truncate d5/d7/d8/f46 952128 0 2024-09-18T12:49:16.991 INFO:tasks.workunit.client.0.smithi078.stdout:9/341: write f0 [2030450,88404] 0 2024-09-18T12:49:16.992 INFO:tasks.workunit.client.0.smithi078.stdout:4/342: dwrite d11/f38 [4194304,4194304] 0 2024-09-18T12:49:16.993 INFO:tasks.workunit.client.0.smithi078.stdout:4/343: fdatasync d11/d1f/f2b 0 2024-09-18T12:49:16.994 INFO:tasks.workunit.client.0.smithi078.stdout:3/388: mkdir d9/d13/d33/d76 0 2024-09-18T12:49:16.995 INFO:tasks.workunit.client.1.smithi148.stdout:8/617: mknod d8/d16/d53/d39/cd7 0 2024-09-18T12:49:16.997 INFO:tasks.workunit.client.1.smithi148.stdout:8/618: write d8/d12/d46/d74/f9b [4697643,52378] 0 2024-09-18T12:49:16.997 INFO:tasks.workunit.client.0.smithi078.stdout:5/517: symlink d2/d74/la0 0 2024-09-18T12:49:16.998 INFO:tasks.workunit.client.1.smithi148.stdout:4/504: creat d15/d5f/d69/d7f/d94/fac x:0 0 0 2024-09-18T12:49:17.001 INFO:tasks.workunit.client.1.smithi148.stdout:3/508: creat d4/d8/d20/d2b/fb4 x:0 0 0 2024-09-18T12:49:17.001 INFO:tasks.workunit.client.1.smithi148.stdout:3/509: chown d4/d8/f15 1 1 2024-09-18T12:49:17.003 INFO:tasks.workunit.client.1.smithi148.stdout:2/481: unlink d9/f1e 0 2024-09-18T12:49:17.004 INFO:tasks.workunit.client.0.smithi078.stdout:8/358: mknod d0/d7/d53/d57/c68 0 2024-09-18T12:49:17.004 INFO:tasks.workunit.client.0.smithi078.stdout:8/359: readlink d0/d7/dc/lf 0 2024-09-18T12:49:17.004 INFO:tasks.workunit.client.1.smithi148.stdout:1/525: truncate dc/f57 867062 0 2024-09-18T12:49:17.006 INFO:tasks.workunit.client.1.smithi148.stdout:5/577: creat d7/d8/dc/d12/d1f/d69/fc4 x:0 0 0 2024-09-18T12:49:17.007 INFO:tasks.workunit.client.1.smithi148.stdout:5/578: chown d7/d8/dc/d12/d1f/d39/f5e 100443 1 2024-09-18T12:49:17.011 INFO:tasks.workunit.client.1.smithi148.stdout:9/531: link d8/d33/f42 d8/da/dd/d35/d47/fa4 0 2024-09-18T12:49:17.012 INFO:tasks.workunit.client.1.smithi148.stdout:0/698: link de/c56 de/d27/d7a/ce7 0 2024-09-18T12:49:17.013 INFO:tasks.workunit.client.0.smithi078.stdout:4/344: symlink d11/d1f/l71 0 2024-09-18T12:49:17.018 INFO:tasks.workunit.client.1.smithi148.stdout:4/505: symlink d15/d5f/d69/d7f/d94/lad 0 2024-09-18T12:49:17.020 INFO:tasks.workunit.client.1.smithi148.stdout:4/506: write d15/d17/d52/d92/d4c/d4f/f23 [1936110,128630] 0 2024-09-18T12:49:17.022 INFO:tasks.workunit.client.0.smithi078.stdout:8/360: symlink d0/d7/dc/l69 0 2024-09-18T12:49:17.024 INFO:tasks.workunit.client.0.smithi078.stdout:7/273: truncate d7/d9/d14/d22/f27 582678 0 2024-09-18T12:49:17.025 INFO:tasks.workunit.client.1.smithi148.stdout:5/579: rmdir d7/d2b 39 2024-09-18T12:49:17.028 INFO:tasks.workunit.client.0.smithi078.stdout:3/389: dread d9/d13/d33/f51 [0,4194304] 0 2024-09-18T12:49:17.029 INFO:tasks.workunit.client.1.smithi148.stdout:6/561: symlink d5/lac 0 2024-09-18T12:49:17.031 INFO:tasks.workunit.client.0.smithi078.stdout:8/361: dwrite d0/d7/dc/d1f/d23/f25 [0,4194304] 0 2024-09-18T12:49:17.032 INFO:tasks.workunit.client.1.smithi148.stdout:9/532: unlink d8/da/c20 0 2024-09-18T12:49:17.035 INFO:tasks.workunit.client.0.smithi078.stdout:9/342: dread d5/d7/d32/d2a/d36/f43 [0,4194304] 0 2024-09-18T12:49:17.036 INFO:tasks.workunit.client.1.smithi148.stdout:0/699: creat de/d14/d43/dd6/fe8 x:0 0 0 2024-09-18T12:49:17.039 INFO:tasks.workunit.client.0.smithi078.stdout:5/518: getdents d2/d4/d9/da/d60/d61 0 2024-09-18T12:49:17.039 INFO:tasks.workunit.client.0.smithi078.stdout:3/390: dread d9/f3f [0,4194304] 0 2024-09-18T12:49:17.041 INFO:tasks.workunit.client.1.smithi148.stdout:3/510: rename d4/d8/d20/d2b/c5b to d4/d8/d20/d99/cb5 0 2024-09-18T12:49:17.042 INFO:tasks.workunit.client.1.smithi148.stdout:3/511: read d4/d8/d20/d2b/d43/f4b [835967,97177] 0 2024-09-18T12:49:17.043 INFO:tasks.workunit.client.1.smithi148.stdout:7/561: write db/dc/df/d11/f65 [1499017,68618] 0 2024-09-18T12:49:17.044 INFO:tasks.workunit.client.1.smithi148.stdout:4/507: chown d15/f2d 407 1 2024-09-18T12:49:17.044 INFO:tasks.workunit.client.1.smithi148.stdout:7/562: readlink db/dc/df/d11/l93 0 2024-09-18T12:49:17.045 INFO:tasks.workunit.client.0.smithi078.stdout:4/345: creat d11/d1f/f72 x:0 0 0 2024-09-18T12:49:17.045 INFO:tasks.workunit.client.1.smithi148.stdout:4/508: read d15/d17/d52/d92/d4c/d4f/d64/f82 [2706161,99552] 0 2024-09-18T12:49:17.046 INFO:tasks.workunit.client.1.smithi148.stdout:7/563: fsync db/dc/df/d1d/d68/d7a/f85 0 2024-09-18T12:49:17.050 INFO:tasks.workunit.client.1.smithi148.stdout:4/509: dwrite d15/f2d [0,4194304] 0 2024-09-18T12:49:17.051 INFO:tasks.workunit.client.1.smithi148.stdout:6/562: unlink d5/d1a/f1f 0 2024-09-18T12:49:17.052 INFO:tasks.workunit.client.1.smithi148.stdout:4/510: fsync d15/d17/d52/d92/d4c/d72/f93 0 2024-09-18T12:49:17.055 INFO:tasks.workunit.client.1.smithi148.stdout:9/533: creat d8/d33/fa5 x:0 0 0 2024-09-18T12:49:17.056 INFO:tasks.workunit.client.1.smithi148.stdout:9/534: chown d8/da/dd/d35/d47/d4e/f71 68867397 1 2024-09-18T12:49:17.057 INFO:tasks.workunit.client.0.smithi078.stdout:5/519: symlink d2/d4/d48/la1 0 2024-09-18T12:49:17.059 INFO:tasks.workunit.client.1.smithi148.stdout:4/511: dwrite d15/d17/d52/d92/d4c/d4f/d64/f88 [0,4194304] 0 2024-09-18T12:49:17.063 INFO:tasks.workunit.client.1.smithi148.stdout:0/700: dwrite de/d14/f2a [0,4194304] 0 2024-09-18T12:49:17.064 INFO:tasks.workunit.client.0.smithi078.stdout:4/346: unlink d11/d27/f34 0 2024-09-18T12:49:17.070 INFO:tasks.workunit.client.1.smithi148.stdout:8/619: write d8/df/d3e/d82/d8f/d95/fc2 [1139038,86898] 0 2024-09-18T12:49:17.076 INFO:tasks.workunit.client.1.smithi148.stdout:8/620: dwrite d8/d16/fc6 [0,4194304] 0 2024-09-18T12:49:17.080 INFO:tasks.workunit.client.1.smithi148.stdout:7/564: rename db/dc/df/d1d/l31 to db/dc/df/d1d/d68/la4 0 2024-09-18T12:49:17.084 INFO:tasks.workunit.client.0.smithi078.stdout:7/274: getdents d7/d9/d14/d22/d3e 0 2024-09-18T12:49:17.085 INFO:tasks.workunit.client.0.smithi078.stdout:7/275: write d7/d9/f20 [2186140,83599] 0 2024-09-18T12:49:17.085 INFO:tasks.workunit.client.0.smithi078.stdout:7/276: readlink l3 0 2024-09-18T12:49:17.087 INFO:tasks.workunit.client.1.smithi148.stdout:3/512: dread d4/d8/d1e/d6b/f4a [0,4194304] 0 2024-09-18T12:49:17.087 INFO:tasks.workunit.client.0.smithi078.stdout:3/391: creat d9/d2f/f77 x:0 0 0 2024-09-18T12:49:17.093 INFO:tasks.workunit.client.1.smithi148.stdout:9/535: mknod d8/da/dd/d3f/d5d/ca6 0 2024-09-18T12:49:17.097 INFO:tasks.workunit.client.0.smithi078.stdout:4/347: link d11/d1f/f2d d11/d27/f73 0 2024-09-18T12:49:17.098 INFO:tasks.workunit.client.0.smithi078.stdout:4/348: read d11/f12 [2188231,75980] 0 2024-09-18T12:49:17.098 INFO:tasks.workunit.client.0.smithi078.stdout:4/349: readlink d11/d1f/l37 0 2024-09-18T12:49:17.100 INFO:tasks.workunit.client.0.smithi078.stdout:3/392: truncate d9/d2f/f3d 3077384 0 2024-09-18T12:49:17.101 INFO:tasks.workunit.client.0.smithi078.stdout:3/393: truncate d9/d54/f68 1014145 0 2024-09-18T12:49:17.105 INFO:tasks.workunit.client.1.smithi148.stdout:4/512: symlink d15/d17/d52/d92/d4c/d4f/d34/lae 0 2024-09-18T12:49:17.105 INFO:tasks.workunit.client.0.smithi078.stdout:9/343: truncate d5/d7/f3f 905048 0 2024-09-18T12:49:17.106 INFO:tasks.workunit.client.0.smithi078.stdout:3/394: chown d9/d13/d33/d34/c35 2064920 1 2024-09-18T12:49:17.107 INFO:tasks.workunit.client.1.smithi148.stdout:0/701: creat de/d14/d43/fe9 x:0 0 0 2024-09-18T12:49:17.109 INFO:tasks.workunit.client.0.smithi078.stdout:9/344: dread d5/d7/d32/d2a/d36/f55 [0,4194304] 0 2024-09-18T12:49:17.111 INFO:tasks.workunit.client.0.smithi078.stdout:3/395: dread d9/d13/f5f [0,4194304] 0 2024-09-18T12:49:17.114 INFO:tasks.workunit.client.1.smithi148.stdout:2/482: link d9/d24/d31/d34/d42/l9c d9/d24/lab 0 2024-09-18T12:49:17.114 INFO:tasks.workunit.client.1.smithi148.stdout:2/483: fdatasync d9/d24/d47/f87 0 2024-09-18T12:49:17.116 INFO:tasks.workunit.client.1.smithi148.stdout:1/526: getdents dc/d11/d38/d87/d2b 0 2024-09-18T12:49:17.118 INFO:tasks.workunit.client.1.smithi148.stdout:8/621: stat d8/d16/d53/d39/d3b/d4e/la5 0 2024-09-18T12:49:17.120 INFO:tasks.workunit.client.1.smithi148.stdout:7/565: mknod db/dc/df/d2c/ca5 0 2024-09-18T12:49:17.121 INFO:tasks.workunit.client.1.smithi148.stdout:5/580: link d7/d8/dc/d12/d20/f2e d7/d8/dc/d12/d1f/d25/d4b/dae/fc5 0 2024-09-18T12:49:17.121 INFO:tasks.workunit.client.1.smithi148.stdout:6/563: dwrite d5/d32/d56/f4d [0,4194304] 0 2024-09-18T12:49:17.124 INFO:tasks.workunit.client.1.smithi148.stdout:3/513: write d4/d8/d1e/d6b/d31/f65 [3500033,59343] 0 2024-09-18T12:49:17.127 INFO:tasks.workunit.client.1.smithi148.stdout:9/536: rmdir d8/da/dd/d35/d47/d62 39 2024-09-18T12:49:17.127 INFO:tasks.workunit.client.1.smithi148.stdout:7/566: dwrite db/dc/df/d1d/f5c [4194304,4194304] 0 2024-09-18T12:49:17.128 INFO:tasks.workunit.client.1.smithi148.stdout:9/537: readlink d8/da/dd/d4a/d49/d46/d54/l8a 0 2024-09-18T12:49:17.129 INFO:tasks.workunit.client.0.smithi078.stdout:9/345: symlink d5/d7/l6e 0 2024-09-18T12:49:17.130 INFO:tasks.workunit.client.0.smithi078.stdout:9/346: chown d5/d7/d32/d2a/f3d 56988750 1 2024-09-18T12:49:17.131 INFO:tasks.workunit.client.0.smithi078.stdout:9/347: chown d5/f6c 2170 1 2024-09-18T12:49:17.131 INFO:tasks.workunit.client.0.smithi078.stdout:9/348: chown d5/l42 30 1 2024-09-18T12:49:17.133 INFO:tasks.workunit.client.0.smithi078.stdout:4/350: truncate d11/d27/f73 851924 0 2024-09-18T12:49:17.134 INFO:tasks.workunit.client.1.smithi148.stdout:4/513: mknod d15/d17/d52/d92/d4c/d4f/d64/da0/da1/caf 0 2024-09-18T12:49:17.135 INFO:tasks.workunit.client.0.smithi078.stdout:3/396: unlink d9/d13/d33/d3c/c15 0 2024-09-18T12:49:17.136 INFO:tasks.workunit.client.1.smithi148.stdout:0/702: truncate f5 1304284 0 2024-09-18T12:49:17.138 INFO:tasks.workunit.client.0.smithi078.stdout:4/351: dread d11/d27/d47/f49 [0,4194304] 0 2024-09-18T12:49:17.139 INFO:tasks.workunit.client.0.smithi078.stdout:4/352: readlink d11/d1f/l37 0 2024-09-18T12:49:17.143 INFO:tasks.workunit.client.0.smithi078.stdout:9/349: rename d5/d7/d32/d2a/f3d to d5/d7/d32/d2a/d68/f6f 0 2024-09-18T12:49:17.144 INFO:tasks.workunit.client.0.smithi078.stdout:3/397: mkdir d9/d13/d63/d78 0 2024-09-18T12:49:17.145 INFO:tasks.workunit.client.0.smithi078.stdout:3/398: read - d9/d13/d33/d4e/f75 zero size 2024-09-18T12:49:17.148 INFO:tasks.workunit.client.1.smithi148.stdout:3/514: symlink d4/d8/d20/d2b/d7f/d93/lb6 0 2024-09-18T12:49:17.150 INFO:tasks.workunit.client.1.smithi148.stdout:7/567: creat db/dc/df/d8e/d75/fa6 x:0 0 0 2024-09-18T12:49:17.153 INFO:tasks.workunit.client.1.smithi148.stdout:3/515: dwrite d4/d8/d1e/d79/fab [0,4194304] 0 2024-09-18T12:49:17.155 INFO:tasks.workunit.client.1.smithi148.stdout:9/538: unlink d8/da/dd/d4a/d49/d46/d54/l8a 0 2024-09-18T12:49:17.155 INFO:tasks.workunit.client.0.smithi078.stdout:4/353: mknod d11/d45/c74 0 2024-09-18T12:49:17.157 INFO:tasks.workunit.client.1.smithi148.stdout:3/516: dread d4/f11 [0,4194304] 0 2024-09-18T12:49:17.160 INFO:tasks.workunit.client.0.smithi078.stdout:3/399: creat d9/d13/d63/d78/f79 x:0 0 0 2024-09-18T12:49:17.161 INFO:tasks.workunit.client.0.smithi078.stdout:3/400: fsync d9/d54/f68 0 2024-09-18T12:49:17.161 INFO:tasks.workunit.client.0.smithi078.stdout:9/350: dwrite f3 [0,4194304] 0 2024-09-18T12:49:17.161 INFO:tasks.workunit.client.1.smithi148.stdout:7/568: mkdir db/dc/df/d1d/d68/d7a/da7 0 2024-09-18T12:49:17.162 INFO:tasks.workunit.client.0.smithi078.stdout:4/354: rmdir d11/d27/d5a/d5d/d6a 39 2024-09-18T12:49:17.167 INFO:tasks.workunit.client.0.smithi078.stdout:3/401: dread d9/d13/d33/f51 [4194304,4194304] 0 2024-09-18T12:49:17.168 INFO:tasks.workunit.client.0.smithi078.stdout:3/402: readlink d9/df/l2e 0 2024-09-18T12:49:17.168 INFO:tasks.workunit.client.0.smithi078.stdout:3/403: dread - d9/f61 zero size 2024-09-18T12:49:17.175 INFO:tasks.workunit.client.0.smithi078.stdout:9/351: chown d5/d7/d32/d2a/d6b/f57 28978423 1 2024-09-18T12:49:17.176 INFO:tasks.workunit.client.1.smithi148.stdout:2/484: creat d9/d17/d29/d92/d95/fac x:0 0 0 2024-09-18T12:49:17.179 INFO:tasks.workunit.client.0.smithi078.stdout:4/355: creat d11/d45/f75 x:0 0 0 2024-09-18T12:49:17.181 INFO:tasks.workunit.client.0.smithi078.stdout:3/404: mknod d9/d13/d63/d78/c7a 0 2024-09-18T12:49:17.181 INFO:tasks.workunit.client.0.smithi078.stdout:4/356: dread d11/f44 [0,4194304] 0 2024-09-18T12:49:17.182 INFO:tasks.workunit.client.0.smithi078.stdout:9/352: dwrite d5/d7/f39 [0,4194304] 0 2024-09-18T12:49:17.182 INFO:tasks.workunit.client.1.smithi148.stdout:8/622: rename d8/d12/d51/d94/f4c to d8/d16/fd8 0 2024-09-18T12:49:17.183 INFO:tasks.workunit.client.0.smithi078.stdout:3/405: readlink d9/d13/d33/d34/l52 0 2024-09-18T12:49:17.183 INFO:tasks.workunit.client.1.smithi148.stdout:8/623: dread - d8/d16/d27/fce zero size 2024-09-18T12:49:17.184 INFO:tasks.workunit.client.0.smithi078.stdout:3/406: write d9/d2f/f70 [1836760,48959] 0 2024-09-18T12:49:17.185 INFO:tasks.workunit.client.0.smithi078.stdout:9/353: write d5/d7/d32/f31 [1839197,56481] 0 2024-09-18T12:49:17.187 INFO:tasks.workunit.client.0.smithi078.stdout:3/407: write d9/d13/d33/d4e/f75 [62704,3635] 0 2024-09-18T12:49:17.192 INFO:tasks.workunit.client.1.smithi148.stdout:4/514: link c12 d15/d17/d52/d92/d4c/d4f/d64/da0/da1/cb0 0 2024-09-18T12:49:17.195 INFO:tasks.workunit.client.0.smithi078.stdout:3/408: dwrite d9/d13/d33/d3c/f66 [0,4194304] 0 2024-09-18T12:49:17.197 INFO:tasks.workunit.client.0.smithi078.stdout:3/409: write d9/d2f/f77 [984423,23838] 0 2024-09-18T12:49:17.197 INFO:tasks.workunit.client.0.smithi078.stdout:9/354: read d5/d7/d32/d2a/d36/f55 [192585,29996] 0 2024-09-18T12:49:17.197 INFO:tasks.workunit.client.1.smithi148.stdout:1/527: getdents dc/d18/d31/d4b 0 2024-09-18T12:49:17.197 INFO:tasks.workunit.client.1.smithi148.stdout:9/539: dread d8/da/dd/f31 [0,4194304] 0 2024-09-18T12:49:17.198 INFO:tasks.workunit.client.0.smithi078.stdout:4/357: mkdir d11/d27/d47/d4e/d76 0 2024-09-18T12:49:17.199 INFO:tasks.workunit.client.0.smithi078.stdout:4/358: chown d11/f44 1967 1 2024-09-18T12:49:17.201 INFO:tasks.workunit.client.0.smithi078.stdout:9/355: chown d5/d7/d32/d2a/f2d 29065 1 2024-09-18T12:49:17.202 INFO:tasks.workunit.client.0.smithi078.stdout:9/356: chown d5/d7/d32/d2a/f59 333479 1 2024-09-18T12:49:17.202 INFO:tasks.workunit.client.1.smithi148.stdout:6/564: rename d5/d32/f3b to d5/d79/fad 0 2024-09-18T12:49:17.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.202+0000 7fa0700fa640 1 -- 172.21.15.78:0/3341838848 --> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa0680626f0 con 0x7fa054074a30 2024-09-18T12:49:17.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.204+0000 7fa05effd640 1 -- 172.21.15.78:0/3341838848 <== mgr.24355 v2:172.21.15.148:6828/2591325460 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7fa0680626f0 con 0x7fa054074a30 2024-09-18T12:49:17.206 INFO:tasks.workunit.client.1.smithi148.stdout:3/517: mkdir d4/d8/d6a/db3/db7 0 2024-09-18T12:49:17.207 INFO:tasks.workunit.client.0.smithi078.stdout:3/410: mknod d9/d29/c7b 0 2024-09-18T12:49:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.207+0000 7fa0700fa640 1 -- 172.21.15.78:0/3341838848 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fa054074a30 msgr2=0x7fa054076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.207+0000 7fa0700fa640 1 --2- 172.21.15.78:0/3341838848 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fa054074a30 0x7fa054076ef0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa058006010 tx=0x7fa058000bc0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.207+0000 7fa0700fa640 1 -- 172.21.15.78:0/3341838848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa068103b60 msgr2=0x7fa0681996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.207+0000 7fa0700fa640 1 --2- 172.21.15.78:0/3341838848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa068103b60 0x7fa0681996b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa06400d6f0 tx=0x7fa06400dbb0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.207+0000 7fa0700fa640 1 -- 172.21.15.78:0/3341838848 shutdown_connections 2024-09-18T12:49:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.207+0000 7fa0700fa640 1 --2- 172.21.15.78:0/3341838848 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fa054074a30 0x7fa054076ef0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.207+0000 7fa0700fa640 1 --2- 172.21.15.78:0/3341838848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa068104d60 0x7fa068199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.207+0000 7fa0700fa640 1 --2- 172.21.15.78:0/3341838848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa068103b60 0x7fa0681996b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.207+0000 7fa0700fa640 1 -- 172.21.15.78:0/3341838848 >> 172.21.15.78:0/3341838848 conn(0x7fa0680ff2f0 msgr2=0x7fa068108270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.208+0000 7fa0700fa640 1 -- 172.21.15.78:0/3341838848 shutdown_connections 2024-09-18T12:49:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.208+0000 7fa0700fa640 1 -- 172.21.15.78:0/3341838848 wait complete. 2024-09-18T12:49:17.210 INFO:tasks.workunit.client.0.smithi078.stdout:4/359: chown ca 750417 1 2024-09-18T12:49:17.211 INFO:tasks.workunit.client.1.smithi148.stdout:4/515: chown d15/d17/d52/d92/l75 2651 1 2024-09-18T12:49:17.211 INFO:tasks.workunit.client.1.smithi148.stdout:6/565: dread d5/d1a/d29/d5c/fa5 [4194304,4194304] 0 2024-09-18T12:49:17.211 INFO:tasks.workunit.client.1.smithi148.stdout:7/569: write db/dc/df/d1d/f21 [4626645,15627] 0 2024-09-18T12:49:17.213 INFO:tasks.workunit.client.0.smithi078.stdout:4/360: truncate d11/d1f/d40/f6c 242833 0 2024-09-18T12:49:17.214 INFO:tasks.workunit.client.1.smithi148.stdout:2/485: creat d9/d24/d31/d34/d7b/fad x:0 0 0 2024-09-18T12:49:17.215 INFO:tasks.workunit.client.0.smithi078.stdout:3/411: dwrite d9/d54/f68 [0,4194304] 0 2024-09-18T12:49:17.215 INFO:tasks.workunit.client.0.smithi078.stdout:9/357: symlink d5/d7/d8/l70 0 2024-09-18T12:49:17.220 INFO:tasks.workunit.client.0.smithi078.stdout:3/412: truncate d9/f12 4384552 0 2024-09-18T12:49:17.222 INFO:tasks.workunit.client.0.smithi078.stdout:3/413: readlink d9/d2f/l5c 0 2024-09-18T12:49:17.223 INFO:tasks.workunit.client.0.smithi078.stdout:3/414: stat d9/d13/d33 0 2024-09-18T12:49:17.225 INFO:tasks.workunit.client.0.smithi078.stdout:9/358: dwrite d5/d7/d32/f65 [0,4194304] 0 2024-09-18T12:49:17.225 INFO:tasks.workunit.client.1.smithi148.stdout:3/518: readlink d4/d8/d1e/d6b/d31/l52 0 2024-09-18T12:49:17.226 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:49:17.231 INFO:tasks.workunit.client.1.smithi148.stdout:7/570: mkdir db/dc/df/d1d/da8 0 2024-09-18T12:49:17.232 INFO:tasks.workunit.client.1.smithi148.stdout:7/571: write db/dc/df/d1d/f57 [2263575,81554] 0 2024-09-18T12:49:17.233 INFO:tasks.workunit.client.0.smithi078.stdout:3/415: rmdir d9/d13/d63 39 2024-09-18T12:49:17.234 INFO:tasks.workunit.client.0.smithi078.stdout:3/416: chown d9/d2f 57032 1 2024-09-18T12:49:17.240 INFO:tasks.workunit.client.0.smithi078.stdout:3/417: dread d9/f59 [0,4194304] 0 2024-09-18T12:49:17.241 INFO:tasks.workunit.client.0.smithi078.stdout:9/359: mkdir d5/d7/d32/d2a/d71 0 2024-09-18T12:49:17.241 INFO:tasks.workunit.client.0.smithi078.stdout:9/360: dread - d5/d7/d32/f5b zero size 2024-09-18T12:49:17.242 INFO:tasks.workunit.client.0.smithi078.stdout:3/418: chown d9/d13/d33/d3c/c60 30 1 2024-09-18T12:49:17.244 INFO:tasks.workunit.client.1.smithi148.stdout:5/581: rename d7/d8/l35 to d7/d8/dc/d12/d31/d5a/d98/lc6 0 2024-09-18T12:49:17.244 INFO:tasks.workunit.client.0.smithi078.stdout:4/361: write d11/d27/d47/f57 [1990207,55516] 0 2024-09-18T12:49:17.244 INFO:tasks.workunit.client.0.smithi078.stdout:4/362: chown d11/d45 72661590 1 2024-09-18T12:49:17.246 INFO:tasks.workunit.client.0.smithi078.stdout:3/419: rmdir d9/d29/d4b 39 2024-09-18T12:49:17.254 INFO:tasks.workunit.client.0.smithi078.stdout:9/361: link d5/f4a d5/d7/d32/d2a/f72 0 2024-09-18T12:49:17.254 INFO:tasks.workunit.client.0.smithi078.stdout:4/363: link d11/c69 d11/d1f/d40/c77 0 2024-09-18T12:49:17.255 INFO:tasks.workunit.client.0.smithi078.stdout:4/364: fdatasync d11/d27/d47/f57 0 2024-09-18T12:49:17.257 INFO:tasks.workunit.client.0.smithi078.stdout:4/365: truncate d11/d27/d47/f5f 1523265 0 2024-09-18T12:49:17.261 INFO:tasks.workunit.client.0.smithi078.stdout:9/362: link d5/d7/c45 d5/d7/d32/c73 0 2024-09-18T12:49:17.263 INFO:tasks.workunit.client.0.smithi078.stdout:9/363: chown d5/d7/d32/d2a/f59 5715229 1 2024-09-18T12:49:17.264 INFO:tasks.workunit.client.0.smithi078.stdout:3/420: dread d9/d13/d33/d3c/d19/f49 [0,4194304] 0 2024-09-18T12:49:17.264 INFO:tasks.workunit.client.0.smithi078.stdout:4/366: dwrite d11/d27/d47/d4e/f65 [0,4194304] 0 2024-09-18T12:49:17.265 INFO:tasks.workunit.client.0.smithi078.stdout:9/364: write f3 [7119774,71097] 0 2024-09-18T12:49:17.267 INFO:tasks.workunit.client.1.smithi148.stdout:8/624: creat d8/df/d3e/d82/fd9 x:0 0 0 2024-09-18T12:49:17.268 INFO:tasks.workunit.client.1.smithi148.stdout:3/519: chown d4/d8/d1e/d6b/c4e 47941081 1 2024-09-18T12:49:17.268 INFO:tasks.workunit.client.1.smithi148.stdout:5/582: chown d7/d8/dc/d12/d97 9 1 2024-09-18T12:49:17.268 INFO:tasks.workunit.client.1.smithi148.stdout:4/516: write d15/d17/f42 [2536118,14924] 0 2024-09-18T12:49:17.269 INFO:tasks.workunit.client.1.smithi148.stdout:7/572: dread db/dc/df/d11/d34/f5a [0,4194304] 0 2024-09-18T12:49:17.269 INFO:tasks.workunit.client.1.smithi148.stdout:9/540: truncate d8/f10 1255939 0 2024-09-18T12:49:17.269 INFO:tasks.workunit.client.0.smithi078.stdout:3/421: rmdir d9/d2f/d43 39 2024-09-18T12:49:17.270 INFO:tasks.workunit.client.1.smithi148.stdout:2/486: truncate d9/d3a/d90/f60 1082559 0 2024-09-18T12:49:17.272 INFO:tasks.workunit.client.1.smithi148.stdout:0/703: rename de/d14/d43/d57/l8c to de/d14/d43/lea 0 2024-09-18T12:49:17.272 INFO:tasks.workunit.client.0.smithi078.stdout:4/367: read d11/f29 [12877,107045] 0 2024-09-18T12:49:17.273 INFO:tasks.workunit.client.1.smithi148.stdout:0/704: chown de/d27/d2e/l79 248 1 2024-09-18T12:49:17.274 INFO:tasks.workunit.client.0.smithi078.stdout:4/368: dread - d11/d1f/d40/f6f zero size 2024-09-18T12:49:17.275 INFO:tasks.workunit.client.1.smithi148.stdout:1/528: getdents dc/d18/d31/d4b/d8d 0 2024-09-18T12:49:17.275 INFO:tasks.workunit.client.0.smithi078.stdout:9/365: dwrite d5/d7/d32/f30 [0,4194304] 0 2024-09-18T12:49:17.276 INFO:tasks.workunit.client.1.smithi148.stdout:3/520: rmdir d4/d8/d20 39 2024-09-18T12:49:17.276 INFO:tasks.workunit.client.0.smithi078.stdout:4/369: read - d11/d27/d5a/f5e zero size 2024-09-18T12:49:17.278 INFO:tasks.workunit.client.0.smithi078.stdout:4/370: dread - d11/d45/f75 zero size 2024-09-18T12:49:17.278 INFO:tasks.workunit.client.1.smithi148.stdout:5/583: creat d7/d8/dc/d22/fc7 x:0 0 0 2024-09-18T12:49:17.283 INFO:tasks.workunit.client.0.smithi078.stdout:3/422: symlink d9/d2f/d43/l7c 0 2024-09-18T12:49:17.286 INFO:tasks.workunit.client.0.smithi078.stdout:4/371: stat c0 0 2024-09-18T12:49:17.289 INFO:tasks.workunit.client.0.smithi078.stdout:4/372: write d11/d45/f75 [328033,68786] 0 2024-09-18T12:49:17.291 INFO:tasks.workunit.client.0.smithi078.stdout:3/423: dwrite d9/d13/f39 [0,4194304] 0 2024-09-18T12:49:17.291 INFO:tasks.workunit.client.0.smithi078.stdout:9/366: getdents d5/d7/d32/d2a 0 2024-09-18T12:49:17.293 INFO:tasks.workunit.client.0.smithi078.stdout:3/424: chown d9/d2f/l5c 161 1 2024-09-18T12:49:17.294 INFO:tasks.workunit.client.0.smithi078.stdout:3/425: chown d9/d13/d33/l67 932797686 1 2024-09-18T12:49:17.294 INFO:tasks.workunit.client.0.smithi078.stdout:4/373: mkdir d11/d27/d47/d78 0 2024-09-18T12:49:17.296 INFO:tasks.workunit.client.1.smithi148.stdout:2/487: rename d9/d3a/f55 to d9/d73/d81/fae 0 2024-09-18T12:49:17.300 INFO:tasks.workunit.client.0.smithi078.stdout:9/367: rename d5/d7/d8/d4f/l52 to d5/d7/d8/d4f/l74 0 2024-09-18T12:49:17.301 INFO:tasks.workunit.client.1.smithi148.stdout:8/625: dread d8/f62 [0,4194304] 0 2024-09-18T12:49:17.303 INFO:tasks.workunit.client.1.smithi148.stdout:7/573: link db/dc/df/d1d/l20 db/dc/d91/la9 0 2024-09-18T12:49:17.303 INFO:tasks.workunit.client.1.smithi148.stdout:9/541: dwrite d8/da/dd/d35/d47/fa4 [0,4194304] 0 2024-09-18T12:49:17.304 INFO:tasks.workunit.client.1.smithi148.stdout:7/574: chown db/dc/df/d11/c64 0 1 2024-09-18T12:49:17.306 INFO:tasks.workunit.client.0.smithi078.stdout:4/374: link d11/f23 d11/d27/d5a/f79 0 2024-09-18T12:49:17.307 INFO:tasks.workunit.client.1.smithi148.stdout:2/488: dread - d9/d17/d29/d92/d95/d9b/fa9 zero size 2024-09-18T12:49:17.309 INFO:tasks.workunit.client.0.smithi078.stdout:4/375: mknod d11/d1f/d4b/c7a 0 2024-09-18T12:49:17.310 INFO:tasks.workunit.client.0.smithi078.stdout:9/368: link d5/d7/l6e d5/l75 0 2024-09-18T12:49:17.311 INFO:tasks.workunit.client.1.smithi148.stdout:4/517: dread d15/d17/d52/d92/d4c/d4f/f22 [0,4194304] 0 2024-09-18T12:49:17.312 INFO:tasks.workunit.client.1.smithi148.stdout:5/584: rmdir d7/d8/dc/d12/d1f/d77/dc3 0 2024-09-18T12:49:17.314 INFO:tasks.workunit.client.0.smithi078.stdout:4/376: mknod d11/d27/d47/c7b 0 2024-09-18T12:49:17.315 INFO:tasks.workunit.client.1.smithi148.stdout:3/521: fdatasync d4/d8/d1e/d6b/d31/f58 0 2024-09-18T12:49:17.315 INFO:tasks.workunit.client.0.smithi078.stdout:9/369: rmdir d5 39 2024-09-18T12:49:17.316 INFO:tasks.workunit.client.1.smithi148.stdout:7/575: rename db/dc/df/l50 to db/dc/df/d8e/d75/laa 0 2024-09-18T12:49:17.317 INFO:tasks.workunit.client.1.smithi148.stdout:1/529: getdents dc/d18/d7d/d7e 0 2024-09-18T12:49:17.318 INFO:tasks.workunit.client.1.smithi148.stdout:0/705: link de/d27/f49 de/d27/d2e/feb 0 2024-09-18T12:49:17.319 INFO:tasks.workunit.client.1.smithi148.stdout:5/585: dwrite d7/d8/dc/d12/d20/f61 [0,4194304] 0 2024-09-18T12:49:17.320 INFO:tasks.workunit.client.1.smithi148.stdout:0/706: fdatasync de/d27/d53/d89/fc2 0 2024-09-18T12:49:17.320 INFO:tasks.workunit.client.1.smithi148.stdout:5/586: stat d7/d8/dc/d12/d1f/d77/fa1 0 2024-09-18T12:49:17.321 INFO:tasks.workunit.client.1.smithi148.stdout:5/587: chown d7/d8/dc/d12/d97 21 1 2024-09-18T12:49:17.322 INFO:tasks.workunit.client.1.smithi148.stdout:5/588: chown d7/d8/d18 3789952 1 2024-09-18T12:49:17.322 INFO:tasks.workunit.client.1.smithi148.stdout:5/589: stat d7/d8/dc/d12/d31/d5a/ca5 0 2024-09-18T12:49:17.324 INFO:tasks.workunit.client.1.smithi148.stdout:3/522: stat d4/d8/d20/d2b/d7f/d93/d94/dac 0 2024-09-18T12:49:17.324 INFO:tasks.workunit.client.1.smithi148.stdout:5/590: chown d7/d8/dc/d22/fc7 515543 1 2024-09-18T12:49:17.325 INFO:tasks.workunit.client.1.smithi148.stdout:7/576: mkdir db/dc/df/d8e/d75/dab 0 2024-09-18T12:49:17.325 INFO:tasks.workunit.client.1.smithi148.stdout:5/591: dread - d7/d8/dc/d12/d1f/d69/fc4 zero size 2024-09-18T12:49:17.327 INFO:tasks.workunit.client.1.smithi148.stdout:4/518: unlink d15/d90/ca3 0 2024-09-18T12:49:17.330 INFO:tasks.workunit.client.1.smithi148.stdout:2/489: creat d9/d3a/faf x:0 0 0 2024-09-18T12:49:17.330 INFO:tasks.workunit.client.1.smithi148.stdout:2/490: fdatasync f5 0 2024-09-18T12:49:17.336 INFO:tasks.workunit.client.1.smithi148.stdout:0/707: creat de/d27/d53/d89/dca/fec x:0 0 0 2024-09-18T12:49:17.342 INFO:tasks.workunit.client.1.smithi148.stdout:4/519: dwrite d15/d17/f19 [4194304,4194304] 0 2024-09-18T12:49:17.343 INFO:tasks.workunit.client.0.smithi078.stdout:9/370: readlink d5/d7/d8/l70 0 2024-09-18T12:49:17.344 INFO:tasks.workunit.client.1.smithi148.stdout:4/520: read d15/d17/d52/d92/d4c/d4f/f20 [3495786,58525] 0 2024-09-18T12:49:17.345 INFO:tasks.workunit.client.1.smithi148.stdout:4/521: fdatasync d15/d17/d52/d92/d4c/d72/f93 0 2024-09-18T12:49:17.345 INFO:tasks.workunit.client.0.smithi078.stdout:4/377: dwrite d11/d27/d47/f3d [0,4194304] 0 2024-09-18T12:49:17.348 INFO:tasks.workunit.client.1.smithi148.stdout:8/626: truncate d8/d16/d27/f93 4112859 0 2024-09-18T12:49:17.350 INFO:tasks.workunit.client.1.smithi148.stdout:0/708: dread de/f77 [0,4194304] 0 2024-09-18T12:49:17.352 INFO:tasks.workunit.client.1.smithi148.stdout:0/709: chown de/l40 501727 1 2024-09-18T12:49:17.354 INFO:tasks.workunit.client.1.smithi148.stdout:1/530: dwrite dc/d4d/f56 [0,4194304] 0 2024-09-18T12:49:17.354 INFO:tasks.workunit.client.0.smithi078.stdout:9/371: rename d5/d7/f3f to d5/d7/d8/d4f/f76 0 2024-09-18T12:49:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.355+0000 7fcd2ef3c640 1 -- 172.21.15.78:0/615303209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd28102b30 msgr2=0x7fcd28104fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.355+0000 7fcd2ef3c640 1 --2- 172.21.15.78:0/615303209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd28102b30 0x7fcd28104fa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009880 tx=0x7fcd1402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.355+0000 7fcd2ef3c640 1 -- 172.21.15.78:0/615303209 shutdown_connections 2024-09-18T12:49:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.355+0000 7fcd2ef3c640 1 --2- 172.21.15.78:0/615303209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd28102b30 0x7fcd28104fa0 secure :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009880 tx=0x7fcd1402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.355+0000 7fcd2ef3c640 1 --2- 172.21.15.78:0/615303209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd281001e0 0x7fcd281025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.355+0000 7fcd2ef3c640 1 -- 172.21.15.78:0/615303209 >> 172.21.15.78:0/615303209 conn(0x7fcd280fc010 msgr2=0x7fcd280fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:17.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.355+0000 7fcd2ef3c640 1 -- 172.21.15.78:0/615303209 shutdown_connections 2024-09-18T12:49:17.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.355+0000 7fcd2ef3c640 1 -- 172.21.15.78:0/615303209 wait complete. 2024-09-18T12:49:17.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.356+0000 7fcd2ef3c640 1 Processor -- start 2024-09-18T12:49:17.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.356+0000 7fcd2ef3c640 1 -- start start 2024-09-18T12:49:17.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.356+0000 7fcd2ef3c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd281001e0 0x7fcd2819dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:17.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.356+0000 7fcd2ef3c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd2819e200 0x7fcd281a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:17.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.357+0000 7fcd2ef3c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcd28110d70 con 0x7fcd281001e0 2024-09-18T12:49:17.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.357+0000 7fcd2ef3c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcd28110bf0 con 0x7fcd2819e200 2024-09-18T12:49:17.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.357+0000 7fcd2ccd8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd281001e0 0x7fcd2819dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:17.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.357+0000 7fcd2ccd8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd281001e0 0x7fcd2819dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40782/0 (socket says 172.21.15.78:40782) 2024-09-18T12:49:17.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.357+0000 7fcd2ccd8640 1 -- 172.21.15.78:0/1419945571 learned_addr learned my addr 172.21.15.78:0/1419945571 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:49:17.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.357+0000 7fcd27fff640 1 --2- 172.21.15.78:0/1419945571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd2819e200 0x7fcd281a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:17.359 INFO:tasks.workunit.client.1.smithi148.stdout:5/592: getdents d7/d8/d18/d3f/d7c/d7d 0 2024-09-18T12:49:17.360 INFO:tasks.workunit.client.1.smithi148.stdout:2/491: write d9/d24/f3f [373325,118393] 0 2024-09-18T12:49:17.360 INFO:tasks.workunit.client.1.smithi148.stdout:3/523: write d4/d8/d1e/d6b/d31/f36 [2562326,17497] 0 2024-09-18T12:49:17.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.357+0000 7fcd2ccd8640 1 -- 172.21.15.78:0/1419945571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd2819e200 msgr2=0x7fcd281a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:17.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.357+0000 7fcd2ccd8640 1 --2- 172.21.15.78:0/1419945571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd2819e200 0x7fcd281a31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.357+0000 7fcd2ccd8640 1 -- 172.21.15.78:0/1419945571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2819e730 con 0x7fcd281001e0 2024-09-18T12:49:17.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.357+0000 7fcd27fff640 1 --2- 172.21.15.78:0/1419945571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd2819e200 0x7fcd281a31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:49:17.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.358+0000 7fcd2ccd8640 1 --2- 172.21.15.78:0/1419945571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd281001e0 0x7fcd2819dcc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00e970 tx=0x7fcd1c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:17.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.358+0000 7fcd25ffb640 1 -- 172.21.15.78:0/1419945571 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd1c00cac0 con 0x7fcd281001e0 2024-09-18T12:49:17.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.358+0000 7fcd25ffb640 1 -- 172.21.15.78:0/1419945571 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd1c00cc60 con 0x7fcd281001e0 2024-09-18T12:49:17.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.358+0000 7fcd25ffb640 1 -- 172.21.15.78:0/1419945571 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd1c018720 con 0x7fcd281001e0 2024-09-18T12:49:17.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.358+0000 7fcd2ef3c640 1 -- 172.21.15.78:0/1419945571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd281a3700 con 0x7fcd281001e0 2024-09-18T12:49:17.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.358+0000 7fcd2ef3c640 1 -- 172.21.15.78:0/1419945571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd281a3c30 con 0x7fcd281001e0 2024-09-18T12:49:17.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.360+0000 7fcd2ef3c640 1 -- 172.21.15.78:0/1419945571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd28102f90 con 0x7fcd281001e0 2024-09-18T12:49:17.364 INFO:tasks.workunit.client.0.smithi078.stdout:9/372: dwrite d5/d7/d32/d2a/f2e [4194304,4194304] 0 2024-09-18T12:49:17.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.362+0000 7fcd25ffb640 1 -- 172.21.15.78:0/1419945571 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fcd1c010430 con 0x7fcd281001e0 2024-09-18T12:49:17.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.362+0000 7fcd25ffb640 1 --2- 172.21.15.78:0/1419945571 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fcd18074a80 0x7fcd18076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:17.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.363+0000 7fcd25ffb640 1 -- 172.21.15.78:0/1419945571 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fcd1c096a30 con 0x7fcd281001e0 2024-09-18T12:49:17.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.363+0000 7fcd27fff640 1 --2- 172.21.15.78:0/1419945571 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fcd18074a80 0x7fcd18076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:17.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.364+0000 7fcd27fff640 1 --2- 172.21.15.78:0/1419945571 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fcd18074a80 0x7fcd18076f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcd14000c00 tx=0x7fcd14004200 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:17.365 INFO:tasks.workunit.client.1.smithi148.stdout:7/577: dwrite db/d52/d25/f3c [0,4194304] 0 2024-09-18T12:49:17.366 INFO:tasks.workunit.client.0.smithi078.stdout:4/378: getdents d11/d27 0 2024-09-18T12:49:17.366 INFO:tasks.workunit.client.1.smithi148.stdout:6/566: sync 2024-09-18T12:49:17.367 INFO:tasks.workunit.client.1.smithi148.stdout:7/578: write db/dc/df/d11/f6b [507470,23933] 0 2024-09-18T12:49:17.369 INFO:tasks.workunit.client.1.smithi148.stdout:1/531: creat dc/d18/d7d/fb3 x:0 0 0 2024-09-18T12:49:17.370 INFO:tasks.workunit.client.0.smithi078.stdout:9/373: creat d5/d7/d32/d2a/d68/f77 x:0 0 0 2024-09-18T12:49:17.371 INFO:tasks.workunit.client.1.smithi148.stdout:4/522: mknod d15/d17/d52/d92/d4c/d4f/d64/d9a/cb1 0 2024-09-18T12:49:17.372 INFO:tasks.workunit.client.1.smithi148.stdout:6/567: dread d5/d1a/d29/f4e [0,4194304] 0 2024-09-18T12:49:17.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.374+0000 7fcd25ffb640 1 -- 172.21.15.78:0/1419945571 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fcd1c061ec0 con 0x7fcd281001e0 2024-09-18T12:49:17.377 INFO:tasks.workunit.client.1.smithi148.stdout:4/523: dwrite d15/d5f/d69/f95 [0,4194304] 0 2024-09-18T12:49:17.378 INFO:tasks.workunit.client.0.smithi078.stdout:9/374: mknod d5/c78 0 2024-09-18T12:49:17.378 INFO:tasks.workunit.client.0.smithi078.stdout:9/375: stat d5/d7/d8/d4f/f54 0 2024-09-18T12:49:17.380 INFO:tasks.workunit.client.1.smithi148.stdout:2/492: mknod d9/d73/cb0 0 2024-09-18T12:49:17.384 INFO:tasks.workunit.client.0.smithi078.stdout:9/376: symlink d5/l79 0 2024-09-18T12:49:17.393 INFO:tasks.workunit.client.0.smithi078.stdout:4/379: write d11/d27/f73 [768074,15188] 0 2024-09-18T12:49:17.394 INFO:tasks.workunit.client.0.smithi078.stdout:4/380: rmdir d11/d45 39 2024-09-18T12:49:17.399 INFO:tasks.workunit.client.0.smithi078.stdout:4/381: link d11/c2e d11/d27/d47/d78/c7c 0 2024-09-18T12:49:17.400 INFO:tasks.workunit.client.0.smithi078.stdout:4/382: fsync d11/d27/d47/f5f 0 2024-09-18T12:49:17.402 INFO:tasks.workunit.client.0.smithi078.stdout:9/377: write d5/f4a [947733,86495] 0 2024-09-18T12:49:17.404 INFO:tasks.workunit.client.0.smithi078.stdout:9/378: write d5/d7/d8/f46 [573794,81121] 0 2024-09-18T12:49:17.405 INFO:tasks.workunit.client.0.smithi078.stdout:4/383: getdents d11/d27/d5a/d5d/d6a 0 2024-09-18T12:49:17.408 INFO:tasks.workunit.client.0.smithi078.stdout:4/384: rename d11/d27/f4a to d11/d27/d5a/f7d 0 2024-09-18T12:49:17.410 INFO:tasks.workunit.client.0.smithi078.stdout:4/385: creat d11/d27/d47/d4e/d76/f7e x:0 0 0 2024-09-18T12:49:17.412 INFO:tasks.workunit.client.0.smithi078.stdout:4/386: chown d11/d45 5884343 1 2024-09-18T12:49:17.414 INFO:tasks.workunit.client.0.smithi078.stdout:4/387: symlink d11/d27/l7f 0 2024-09-18T12:49:17.415 INFO:tasks.workunit.client.0.smithi078.stdout:4/388: dread d11/f44 [0,4194304] 0 2024-09-18T12:49:17.418 INFO:tasks.workunit.client.0.smithi078.stdout:9/379: truncate d5/d7/d32/d2a/d6b/f5d 2688873 0 2024-09-18T12:49:17.418 INFO:tasks.workunit.client.0.smithi078.stdout:4/389: creat d11/d27/d47/d4e/d50/f80 x:0 0 0 2024-09-18T12:49:17.418 INFO:tasks.workunit.client.0.smithi078.stdout:4/390: readlink d11/d27/d47/d4e/d50/l51 0 2024-09-18T12:49:17.423 INFO:tasks.workunit.client.0.smithi078.stdout:9/380: dwrite d5/d7/f5a [0,4194304] 0 2024-09-18T12:49:17.424 INFO:tasks.workunit.client.0.smithi078.stdout:4/391: dread d11/d1f/f2b [8388608,4194304] 0 2024-09-18T12:49:17.425 INFO:tasks.workunit.client.0.smithi078.stdout:9/381: rename d5 to d5/d7a 22 2024-09-18T12:49:17.428 INFO:tasks.workunit.client.1.smithi148.stdout:0/710: mknod de/d27/d53/d89/dc0/dbd/dd9/ced 0 2024-09-18T12:49:17.429 INFO:tasks.workunit.client.0.smithi078.stdout:4/392: mknod d11/d27/d5a/d5d/d6a/c81 0 2024-09-18T12:49:17.429 INFO:tasks.workunit.client.1.smithi148.stdout:7/579: mkdir db/dc/df/d11/dac 0 2024-09-18T12:49:17.429 INFO:tasks.workunit.client.1.smithi148.stdout:5/593: unlink d7/c89 0 2024-09-18T12:49:17.430 INFO:tasks.workunit.client.0.smithi078.stdout:9/382: symlink d5/d7/d32/l7b 0 2024-09-18T12:49:17.431 INFO:tasks.workunit.client.1.smithi148.stdout:6/568: readlink d5/d1a/dc/d2b/d35/l80 0 2024-09-18T12:49:17.433 INFO:tasks.workunit.client.0.smithi078.stdout:9/383: creat d5/d40/f7c x:0 0 0 2024-09-18T12:49:17.434 INFO:tasks.workunit.client.1.smithi148.stdout:8/627: getdents d8/df/d3e 0 2024-09-18T12:49:17.434 INFO:tasks.workunit.client.1.smithi148.stdout:3/524: creat d4/fb8 x:0 0 0 2024-09-18T12:49:17.435 INFO:tasks.workunit.client.1.smithi148.stdout:6/569: chown d5/d1a/dc/d2b/d9b/f9e 2277 1 2024-09-18T12:49:17.435 INFO:tasks.workunit.client.1.smithi148.stdout:7/580: symlink db/dc/df/d5f/lad 0 2024-09-18T12:49:17.436 INFO:tasks.workunit.client.0.smithi078.stdout:9/384: creat d5/d7/d32/d2a/f7d x:0 0 0 2024-09-18T12:49:17.437 INFO:tasks.workunit.client.1.smithi148.stdout:4/524: dwrite d15/d5f/d69/f8c [0,4194304] 0 2024-09-18T12:49:17.438 INFO:tasks.workunit.client.1.smithi148.stdout:0/711: creat de/d27/d53/d89/dc0/db0/fee x:0 0 0 2024-09-18T12:49:17.439 INFO:tasks.workunit.client.1.smithi148.stdout:5/594: creat d7/d8/dc/d12/d1f/d39/fc8 x:0 0 0 2024-09-18T12:49:17.440 INFO:tasks.workunit.client.1.smithi148.stdout:7/581: truncate db/dc/df/d11/f6b 1071797 0 2024-09-18T12:49:17.445 INFO:tasks.workunit.client.0.smithi078.stdout:9/385: mknod d5/d5c/c7e 0 2024-09-18T12:49:17.445 INFO:tasks.workunit.client.1.smithi148.stdout:7/582: dwrite db/dc/df/d2c/d55/f8b [0,4194304] 0 2024-09-18T12:49:17.448 INFO:tasks.workunit.client.1.smithi148.stdout:3/525: creat d4/d8/d1e/d6b/fb9 x:0 0 0 2024-09-18T12:49:17.449 INFO:tasks.workunit.client.1.smithi148.stdout:6/570: mknod d5/d1a/dc/d2b/d35/cae 0 2024-09-18T12:49:17.450 INFO:tasks.workunit.client.0.smithi078.stdout:9/386: mknod d5/d7/d8/c7f 0 2024-09-18T12:49:17.458 INFO:tasks.workunit.client.0.smithi078.stdout:9/387: truncate d5/d7/d32/d2a/f59 4706360 0 2024-09-18T12:49:17.460 INFO:tasks.workunit.client.1.smithi148.stdout:0/712: truncate de/d27/f44 3489983 0 2024-09-18T12:49:17.461 INFO:tasks.workunit.client.1.smithi148.stdout:0/713: dread - de/d14/d43/fc7 zero size 2024-09-18T12:49:17.461 INFO:tasks.workunit.client.1.smithi148.stdout:8/628: creat d8/d12/fda x:0 0 0 2024-09-18T12:49:17.462 INFO:tasks.workunit.client.1.smithi148.stdout:6/571: link d5/d79/f8e d5/d79/faf 0 2024-09-18T12:49:17.462 INFO:tasks.workunit.client.1.smithi148.stdout:0/714: chown de/d27/d7a/f84 14024922 1 2024-09-18T12:49:17.463 INFO:tasks.workunit.client.1.smithi148.stdout:8/629: rmdir d8/d12/d46/d74 39 2024-09-18T12:49:17.464 INFO:tasks.workunit.client.1.smithi148.stdout:9/542: sync 2024-09-18T12:49:17.464 INFO:tasks.workunit.client.1.smithi148.stdout:8/630: chown d8/df/d3e/l79 2 1 2024-09-18T12:49:17.465 INFO:tasks.workunit.client.1.smithi148.stdout:6/572: mknod d5/d32/d56/cb0 0 2024-09-18T12:49:17.465 INFO:tasks.workunit.client.1.smithi148.stdout:0/715: fsync de/d14/f1f 0 2024-09-18T12:49:17.466 INFO:tasks.workunit.client.1.smithi148.stdout:4/525: write d15/d17/f36 [2937563,120686] 0 2024-09-18T12:49:17.466 INFO:tasks.workunit.client.1.smithi148.stdout:8/631: stat d8/d12/d46/d74/dd5 0 2024-09-18T12:49:17.468 INFO:tasks.workunit.client.1.smithi148.stdout:4/526: read d15/d17/f19 [6934767,101689] 0 2024-09-18T12:49:17.469 INFO:tasks.workunit.client.1.smithi148.stdout:2/493: dread d9/d24/d47/f5e [0,4194304] 0 2024-09-18T12:49:17.469 INFO:tasks.workunit.client.1.smithi148.stdout:3/526: write d4/d8/d1e/d6b/f81 [395742,10317] 0 2024-09-18T12:49:17.470 INFO:tasks.workunit.client.1.smithi148.stdout:0/716: stat de/d14/d43/d57/d59/c6e 0 2024-09-18T12:49:17.470 INFO:tasks.workunit.client.1.smithi148.stdout:6/573: rename d5/c16 to d5/d79/cb1 0 2024-09-18T12:49:17.472 INFO:tasks.workunit.client.1.smithi148.stdout:4/527: readlink d15/d17/d52/d92/l56 0 2024-09-18T12:49:17.475 INFO:tasks.workunit.client.1.smithi148.stdout:0/717: fsync de/d27/f76 0 2024-09-18T12:49:17.477 INFO:tasks.workunit.client.1.smithi148.stdout:2/494: symlink d9/d24/d31/d34/d7b/lb1 0 2024-09-18T12:49:17.479 INFO:tasks.workunit.client.1.smithi148.stdout:3/527: creat d4/d8/d1e/fba x:0 0 0 2024-09-18T12:49:17.481 INFO:tasks.workunit.client.1.smithi148.stdout:5/595: dwrite d7/d8/dc/d12/d20/f53 [0,4194304] 0 2024-09-18T12:49:17.482 INFO:tasks.workunit.client.1.smithi148.stdout:7/583: dread db/dc/df/d1d/f6d [0,4194304] 0 2024-09-18T12:49:17.483 INFO:tasks.workunit.client.1.smithi148.stdout:8/632: dwrite d8/d12/d46/d7e/fcc [0,4194304] 0 2024-09-18T12:49:17.485 INFO:tasks.workunit.client.1.smithi148.stdout:2/495: creat d9/d24/d47/fb2 x:0 0 0 2024-09-18T12:49:17.488 INFO:tasks.workunit.client.0.smithi078.stdout:2/331: sync 2024-09-18T12:49:17.489 INFO:tasks.workunit.client.1.smithi148.stdout:0/718: rename de/d14/d43/dd6/fe8 to de/d14/dcd/fef 0 2024-09-18T12:49:17.492 INFO:tasks.workunit.client.1.smithi148.stdout:8/633: fsync d8/d16/fd8 0 2024-09-18T12:49:17.493 INFO:tasks.workunit.client.0.smithi078.stdout:2/332: creat d4/db/f68 x:0 0 0 2024-09-18T12:49:17.493 INFO:tasks.workunit.client.1.smithi148.stdout:0/719: stat de/d14/f47 0 2024-09-18T12:49:17.495 INFO:tasks.workunit.client.1.smithi148.stdout:2/496: creat d9/d73/fb3 x:0 0 0 2024-09-18T12:49:17.495 INFO:tasks.workunit.client.1.smithi148.stdout:4/528: dwrite d15/d17/d52/d92/d4c/d4f/f8a [4194304,4194304] 0 2024-09-18T12:49:17.496 INFO:tasks.workunit.client.1.smithi148.stdout:8/634: rmdir d8 39 2024-09-18T12:49:17.500 INFO:tasks.workunit.client.1.smithi148.stdout:6/574: dwrite d5/d1a/dc/f74 [0,4194304] 0 2024-09-18T12:49:17.502 INFO:tasks.workunit.client.1.smithi148.stdout:7/584: dwrite db/dc/df/f35 [4194304,4194304] 0 2024-09-18T12:49:17.503 INFO:tasks.workunit.client.0.smithi078.stdout:2/333: getdents d4/dd/d18/d33 0 2024-09-18T12:49:17.517 INFO:tasks.workunit.client.1.smithi148.stdout:3/528: dread d4/d8/d1e/d6b/d31/f36 [0,4194304] 0 2024-09-18T12:49:17.531 INFO:tasks.workunit.client.1.smithi148.stdout:9/543: sync 2024-09-18T12:49:17.531 INFO:tasks.workunit.client.1.smithi148.stdout:1/532: sync 2024-09-18T12:49:17.531 INFO:tasks.workunit.client.1.smithi148.stdout:9/544: chown d8/da/dd/d3f/d5d/da0 203 1 2024-09-18T12:49:17.567 INFO:tasks.workunit.client.1.smithi148.stdout:5/596: sync 2024-09-18T12:49:17.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.624+0000 7fcd2ef3c640 1 -- 172.21.15.78:0/1419945571 --> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcd28100a00 con 0x7fcd18074a80 2024-09-18T12:49:17.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.625+0000 7fcd25ffb640 1 -- 172.21.15.78:0/1419945571 <== mgr.24355 v2:172.21.15.148:6828/2591325460 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7fcd28100a00 con 0x7fcd18074a80 2024-09-18T12:49:17.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.627+0000 7fcd2ef3c640 1 -- 172.21.15.78:0/1419945571 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fcd18074a80 msgr2=0x7fcd18076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:17.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.627+0000 7fcd2ef3c640 1 --2- 172.21.15.78:0/1419945571 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fcd18074a80 0x7fcd18076f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcd14000c00 tx=0x7fcd14004200 comp rx=0 tx=0).stop 2024-09-18T12:49:17.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.627+0000 7fcd2ef3c640 1 -- 172.21.15.78:0/1419945571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd281001e0 msgr2=0x7fcd2819dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:17.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.627+0000 7fcd2ef3c640 1 --2- 172.21.15.78:0/1419945571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd281001e0 0x7fcd2819dcc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00e970 tx=0x7fcd1c00ee30 comp rx=0 tx=0).stop 2024-09-18T12:49:17.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.627+0000 7fcd2ef3c640 1 -- 172.21.15.78:0/1419945571 shutdown_connections 2024-09-18T12:49:17.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.627+0000 7fcd2ef3c640 1 --2- 172.21.15.78:0/1419945571 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fcd18074a80 0x7fcd18076f40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.627+0000 7fcd2ef3c640 1 --2- 172.21.15.78:0/1419945571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd2819e200 0x7fcd281a31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.627+0000 7fcd2ef3c640 1 --2- 172.21.15.78:0/1419945571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd281001e0 0x7fcd2819dcc0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.627+0000 7fcd2ef3c640 1 -- 172.21.15.78:0/1419945571 >> 172.21.15.78:0/1419945571 conn(0x7fcd280fc010 msgr2=0x7fcd280fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:17.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.627+0000 7fcd2ef3c640 1 -- 172.21.15.78:0/1419945571 shutdown_connections 2024-09-18T12:49:17.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.627+0000 7fcd2ef3c640 1 -- 172.21.15.78:0/1419945571 wait complete. 2024-09-18T12:49:17.664 INFO:tasks.workunit.client.1.smithi148.stdout:2/497: read d9/ff [1647314,86894] 0 2024-09-18T12:49:17.665 INFO:tasks.workunit.client.1.smithi148.stdout:6/575: write d5/d32/d38/d50/f61 [5186200,69089] 0 2024-09-18T12:49:17.667 INFO:tasks.workunit.client.1.smithi148.stdout:4/529: rename d15/d17/d52/d92/d4c/d4f/d64/da0/da1/caf to d15/d17/d52/d92/d4c/d4f/d34/cb2 0 2024-09-18T12:49:17.668 INFO:tasks.workunit.client.1.smithi148.stdout:4/530: chown d15/d17/d52/d92/d4c/d4f/d34 69398 1 2024-09-18T12:49:17.668 INFO:tasks.workunit.client.1.smithi148.stdout:3/529: creat d4/d8/d20/d2b/d43/fbb x:0 0 0 2024-09-18T12:49:17.669 INFO:tasks.workunit.client.0.smithi078.stdout:2/334: dwrite d4/dd/d18/d3b/d55/f59 [0,4194304] 0 2024-09-18T12:49:17.671 INFO:tasks.workunit.client.1.smithi148.stdout:9/545: creat d8/da/dd/d35/d5e/fa7 x:0 0 0 2024-09-18T12:49:17.672 INFO:tasks.workunit.client.1.smithi148.stdout:5/597: creat d7/d8/dc/d12/d31/d5a/fc9 x:0 0 0 2024-09-18T12:49:17.675 INFO:tasks.workunit.client.1.smithi148.stdout:6/576: dread - d5/d32/f58 zero size 2024-09-18T12:49:17.676 INFO:tasks.workunit.client.1.smithi148.stdout:4/531: dwrite d15/d17/d52/d92/d4c/d4f/f6c [0,4194304] 0 2024-09-18T12:49:17.677 INFO:tasks.workunit.client.0.smithi078.stdout:2/335: creat d4/f69 x:0 0 0 2024-09-18T12:49:17.678 INFO:tasks.workunit.client.0.smithi078.stdout:2/336: truncate d4/db/f68 1016715 0 2024-09-18T12:49:17.679 INFO:tasks.workunit.client.1.smithi148.stdout:3/530: fdatasync d4/d8/d20/f26 0 2024-09-18T12:49:17.684 INFO:tasks.workunit.client.1.smithi148.stdout:8/635: mknod d8/d12/d46/d74/dd5/cdb 0 2024-09-18T12:49:17.684 INFO:tasks.workunit.client.1.smithi148.stdout:0/720: getdents de/d14/d43/d70 0 2024-09-18T12:49:17.685 INFO:tasks.workunit.client.1.smithi148.stdout:8/636: chown d8/d12/d46/d74 1435 1 2024-09-18T12:49:17.685 INFO:tasks.workunit.client.1.smithi148.stdout:7/585: creat db/d52/fae x:0 0 0 2024-09-18T12:49:17.686 INFO:tasks.workunit.client.1.smithi148.stdout:6/577: mknod d5/d1a/dc/d2b/d35/d65/d99/cb2 0 2024-09-18T12:49:17.686 INFO:tasks.workunit.client.1.smithi148.stdout:8/637: fdatasync d8/d12/fda 0 2024-09-18T12:49:17.687 INFO:tasks.workunit.client.1.smithi148.stdout:6/578: fsync d5/f23 0 2024-09-18T12:49:17.687 INFO:tasks.workunit.client.1.smithi148.stdout:4/532: mkdir d15/d17/d52/d92/d4c/d72/db3 0 2024-09-18T12:49:17.687 INFO:tasks.workunit.client.1.smithi148.stdout:7/586: dread - db/dc/df/d11/d34/f76 zero size 2024-09-18T12:49:17.687 INFO:tasks.workunit.client.1.smithi148.stdout:6/579: readlink d5/d1a/l11 0 2024-09-18T12:49:17.688 INFO:tasks.workunit.client.0.smithi078.stdout:2/337: dwrite d4/d8/f4b [0,4194304] 0 2024-09-18T12:49:17.688 INFO:tasks.workunit.client.1.smithi148.stdout:7/587: fdatasync db/dc/df/d1d/f57 0 2024-09-18T12:49:17.689 INFO:tasks.workunit.client.1.smithi148.stdout:6/580: dread - d5/d32/d38/d50/f97 zero size 2024-09-18T12:49:17.689 INFO:tasks.workunit.client.1.smithi148.stdout:3/531: symlink d4/d8/d1e/lbc 0 2024-09-18T12:49:17.690 INFO:tasks.workunit.client.1.smithi148.stdout:6/581: dread - d5/d1a/d29/d5c/f93 zero size 2024-09-18T12:49:17.690 INFO:tasks.workunit.client.1.smithi148.stdout:2/498: creat d9/fb4 x:0 0 0 2024-09-18T12:49:17.691 INFO:tasks.workunit.client.1.smithi148.stdout:4/533: read d15/f76 [5674056,56028] 0 2024-09-18T12:49:17.692 INFO:tasks.workunit.client.1.smithi148.stdout:0/721: rename fa to de/d14/d6b/ff0 0 2024-09-18T12:49:17.693 INFO:tasks.workunit.client.0.smithi078.stdout:2/338: symlink d4/dd/l6a 0 2024-09-18T12:49:17.693 INFO:tasks.workunit.client.1.smithi148.stdout:0/722: fdatasync de/d14/fcf 0 2024-09-18T12:49:17.697 INFO:tasks.workunit.client.1.smithi148.stdout:8/638: symlink d8/df/d3e/d82/d8f/d95/ldc 0 2024-09-18T12:49:17.698 INFO:tasks.workunit.client.1.smithi148.stdout:1/533: write dc/d11/d38/d87/f21 [1051579,82070] 0 2024-09-18T12:49:17.699 INFO:tasks.workunit.client.1.smithi148.stdout:7/588: write db/dc/df/d11/f1b [1252904,9535] 0 2024-09-18T12:49:17.706 INFO:tasks.workunit.client.1.smithi148.stdout:9/546: dwrite d8/da/dd/f14 [0,4194304] 0 2024-09-18T12:49:17.707 INFO:tasks.workunit.client.1.smithi148.stdout:6/582: unlink d5/d1a/dc/f74 0 2024-09-18T12:49:17.708 INFO:tasks.workunit.client.1.smithi148.stdout:9/547: truncate d8/da/dd/d35/d47/d4e/f71 4635986 0 2024-09-18T12:49:17.709 INFO:tasks.workunit.client.1.smithi148.stdout:6/583: chown d5/d1a/dc/d2b/d35/cae 554929 1 2024-09-18T12:49:17.709 INFO:tasks.workunit.client.1.smithi148.stdout:9/548: readlink d8/da/dd/d65/l93 0 2024-09-18T12:49:17.710 INFO:tasks.workunit.client.1.smithi148.stdout:6/584: chown d5/d1a/dc 9 1 2024-09-18T12:49:17.710 INFO:tasks.workunit.client.1.smithi148.stdout:4/534: symlink d15/d17/d52/d92/d4c/d4f/d34/lb4 0 2024-09-18T12:49:17.712 INFO:tasks.workunit.client.1.smithi148.stdout:0/723: mkdir de/d27/d53/d89/dbb/db5/df1 0 2024-09-18T12:49:17.714 INFO:tasks.workunit.client.1.smithi148.stdout:1/534: symlink dc/d18/d31/d39/lb4 0 2024-09-18T12:49:17.715 INFO:tasks.workunit.client.1.smithi148.stdout:1/535: rename dc/d11 to dc/d11/db5 22 2024-09-18T12:49:17.717 INFO:tasks.workunit.client.1.smithi148.stdout:3/532: unlink d4/d8/d1e/d6b/d31/d60/da9/c9d 0 2024-09-18T12:49:17.718 INFO:tasks.workunit.client.1.smithi148.stdout:5/598: truncate d7/d2b/f81 2024225 0 2024-09-18T12:49:17.719 INFO:tasks.workunit.client.1.smithi148.stdout:3/533: write d4/d8/d20/d2b/f71 [3252277,28270] 0 2024-09-18T12:49:17.719 INFO:tasks.workunit.client.0.smithi078.stdout:2/339: write d4/d8/f50 [1683706,10840] 0 2024-09-18T12:49:17.720 INFO:tasks.workunit.client.1.smithi148.stdout:2/499: mknod d9/d17/d29/d92/d95/cb5 0 2024-09-18T12:49:17.720 INFO:tasks.workunit.client.1.smithi148.stdout:3/534: chown d4/d8/d20/d2b/d7f/f8e 3307926 1 2024-09-18T12:49:17.724 INFO:tasks.workunit.client.1.smithi148.stdout:4/535: creat d15/d17/d52/d92/d4c/d4f/d64/da0/fb5 x:0 0 0 2024-09-18T12:49:17.726 INFO:tasks.workunit.client.1.smithi148.stdout:0/724: fsync de/f32 0 2024-09-18T12:49:17.726 INFO:tasks.workunit.client.0.smithi078.stdout:2/340: dwrite d4/dd/d18/d3b/d55/f59 [4194304,4194304] 0 2024-09-18T12:49:17.732 INFO:tasks.workunit.client.1.smithi148.stdout:1/536: chown dc/d18/c2a 86371 1 2024-09-18T12:49:17.733 INFO:tasks.workunit.client.0.smithi078.stdout:2/341: mknod d4/c6b 0 2024-09-18T12:49:17.735 INFO:tasks.workunit.client.0.smithi078.stdout:2/342: dread d4/d1a/f43 [0,4194304] 0 2024-09-18T12:49:17.736 INFO:tasks.workunit.client.0.smithi078.stdout:2/343: fsync d4/dd/f64 0 2024-09-18T12:49:17.736 INFO:tasks.workunit.client.1.smithi148.stdout:5/599: creat d7/d8/dc/fca x:0 0 0 2024-09-18T12:49:17.738 INFO:tasks.workunit.client.1.smithi148.stdout:2/500: creat d9/d24/d67/d72/fb6 x:0 0 0 2024-09-18T12:49:17.739 INFO:tasks.workunit.client.1.smithi148.stdout:7/589: truncate db/dc/df/d11/f6b 978061 0 2024-09-18T12:49:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.740+0000 7f86e3590640 1 -- 172.21.15.78:0/1205057461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc101970 msgr2=0x7f86dc101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.740+0000 7f86e3590640 1 --2- 172.21.15.78:0/1205057461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc101970 0x7f86dc101d70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f86d80097e0 tx=0x7f86d802a3f0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.741+0000 7f86e3590640 1 -- 172.21.15.78:0/1205057461 shutdown_connections 2024-09-18T12:49:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.741+0000 7f86e3590640 1 --2- 172.21.15.78:0/1205057461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86dc102b70 0x7f86dc102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.741+0000 7f86e3590640 1 --2- 172.21.15.78:0/1205057461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc101970 0x7f86dc101d70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.741+0000 7f86e3590640 1 -- 172.21.15.78:0/1205057461 >> 172.21.15.78:0/1205057461 conn(0x7f86dc0fd140 msgr2=0x7f86dc0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.741+0000 7f86e3590640 1 -- 172.21.15.78:0/1205057461 shutdown_connections 2024-09-18T12:49:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.741+0000 7f86e3590640 1 -- 172.21.15.78:0/1205057461 wait complete. 2024-09-18T12:49:17.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.741+0000 7f86e3590640 1 Processor -- start 2024-09-18T12:49:17.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.742+0000 7f86e3590640 1 -- start start 2024-09-18T12:49:17.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.742+0000 7f86e3590640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc101970 0x7f86dc1974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:17.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.742+0000 7f86e3590640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86dc102b70 0x7f86dc197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:17.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.742+0000 7f86e3590640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc10a790 con 0x7f86dc102b70 2024-09-18T12:49:17.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.742+0000 7f86e3590640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc10a610 con 0x7f86dc101970 2024-09-18T12:49:17.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.742+0000 7f86e132c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc101970 0x7f86dc1974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:17.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.742+0000 7f86e132c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc101970 0x7f86dc1974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.78:51984/0 (socket says 172.21.15.78:51984) 2024-09-18T12:49:17.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.742+0000 7f86e132c640 1 -- 172.21.15.78:0/1655227019 learned_addr learned my addr 172.21.15.78:0/1655227019 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:49:17.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.742+0000 7f86e0b2b640 1 --2- 172.21.15.78:0/1655227019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86dc102b70 0x7f86dc197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:17.744 INFO:tasks.workunit.client.0.smithi078.stdout:2/344: mkdir d4/d8/d6c 0 2024-09-18T12:49:17.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.743+0000 7f86e132c640 1 -- 172.21.15.78:0/1655227019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86dc102b70 msgr2=0x7f86dc197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:17.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.743+0000 7f86e132c640 1 --2- 172.21.15.78:0/1655227019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86dc102b70 0x7f86dc197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:17.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.743+0000 7f86e132c640 1 -- 172.21.15.78:0/1655227019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86dc1980a0 con 0x7f86dc101970 2024-09-18T12:49:17.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.743+0000 7f86e132c640 1 --2- 172.21.15.78:0/1655227019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc101970 0x7f86dc1974e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f86d8030750 tx=0x7f86d80043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:17.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.743+0000 7f86d27fc640 1 -- 172.21.15.78:0/1655227019 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86d8040070 con 0x7f86dc101970 2024-09-18T12:49:17.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.743+0000 7f86d27fc640 1 -- 172.21.15.78:0/1655227019 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f86d8030c00 con 0x7f86dc101970 2024-09-18T12:49:17.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.743+0000 7f86e3590640 1 -- 172.21.15.78:0/1655227019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86dc19ca80 con 0x7f86dc101970 2024-09-18T12:49:17.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.743+0000 7f86d27fc640 1 -- 172.21.15.78:0/1655227019 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86d8003ca0 con 0x7f86dc101970 2024-09-18T12:49:17.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.744+0000 7f86e3590640 1 -- 172.21.15.78:0/1655227019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86dc19d010 con 0x7f86dc101970 2024-09-18T12:49:17.746 INFO:tasks.workunit.client.0.smithi078.stdout:2/345: chown d4/dd/d18/d33/c66 441925 1 2024-09-18T12:49:17.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.745+0000 7f86e3590640 1 -- 172.21.15.78:0/1655227019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86dc101d70 con 0x7f86dc101970 2024-09-18T12:49:17.747 INFO:tasks.workunit.client.0.smithi078.stdout:2/346: write d4/dd/d18/d3b/f58 [386682,77705] 0 2024-09-18T12:49:17.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.746+0000 7f86d27fc640 1 -- 172.21.15.78:0/1655227019 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f86d8039040 con 0x7f86dc101970 2024-09-18T12:49:17.748 INFO:tasks.workunit.client.1.smithi148.stdout:4/536: rename d15/d17/d52/d92/d4c/d4f/f26 to d15/d17/d52/d92/d4c/d4f/d34/fb6 0 2024-09-18T12:49:17.748 INFO:tasks.workunit.client.1.smithi148.stdout:4/537: read d15/d17/f1c [2668530,75875] 0 2024-09-18T12:49:17.748 INFO:tasks.workunit.client.1.smithi148.stdout:0/725: fsync de/f18 0 2024-09-18T12:49:17.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.747+0000 7f86d27fc640 1 --2- 172.21.15.78:0/1655227019 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f86c8074ad0 0x7f86c8076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:17.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.747+0000 7f86d27fc640 1 -- 172.21.15.78:0/1655227019 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f86d80b7a40 con 0x7f86dc101970 2024-09-18T12:49:17.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.747+0000 7f86e0b2b640 1 --2- 172.21.15.78:0/1655227019 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f86c8074ad0 0x7f86c8076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:17.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.748+0000 7f86e0b2b640 1 --2- 172.21.15.78:0/1655227019 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f86c8074ad0 0x7f86c8076f90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f86dc198990 tx=0x7f86cc009260 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:17.753 INFO:tasks.workunit.client.0.smithi078.stdout:2/347: creat d4/d8/d23/f6d x:0 0 0 2024-09-18T12:49:17.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:17.752+0000 7f86d27fc640 1 -- 172.21.15.78:0/1655227019 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f86d8082fd0 con 0x7f86dc101970 2024-09-18T12:49:17.754 INFO:tasks.workunit.client.0.smithi078.stdout:2/348: truncate d4/dd/f4e 491820 0 2024-09-18T12:49:17.755 INFO:tasks.workunit.client.1.smithi148.stdout:1/537: stat dc/d18/l78 0 2024-09-18T12:49:17.755 INFO:tasks.workunit.client.1.smithi148.stdout:5/600: mknod d7/d8/dc/d12/d1f/d39/dc2/ccb 0 2024-09-18T12:49:17.755 INFO:tasks.workunit.client.1.smithi148.stdout:9/549: truncate d8/da/dd/d4a/f18 1163415 0 2024-09-18T12:49:17.757 INFO:tasks.workunit.client.1.smithi148.stdout:1/538: write dc/d11/d38/d87/d2b/fa0 [883794,95616] 0 2024-09-18T12:49:17.757 INFO:tasks.workunit.client.1.smithi148.stdout:1/539: dread - dc/d18/d7d/fb3 zero size 2024-09-18T12:49:17.760 INFO:tasks.workunit.client.1.smithi148.stdout:7/590: dread db/dc/df/d11/d34/f61 [0,4194304] 0 2024-09-18T12:49:17.762 INFO:tasks.workunit.client.1.smithi148.stdout:8/639: link d8/df/d66/la6 d8/d16/d53/ldd 0 2024-09-18T12:49:17.766 INFO:tasks.workunit.client.0.smithi078.stdout:2/349: truncate d4/db/f5e 7719047 0 2024-09-18T12:49:17.775 INFO:tasks.workunit.client.1.smithi148.stdout:0/726: dwrite de/d14/f47 [0,4194304] 0 2024-09-18T12:49:17.775 INFO:tasks.workunit.client.0.smithi078.stdout:2/350: unlink d4/db/f5e 0 2024-09-18T12:49:17.776 INFO:tasks.workunit.client.0.smithi078.stdout:2/351: stat d4/dd/d18/d3b 0 2024-09-18T12:49:17.777 INFO:tasks.workunit.client.0.smithi078.stdout:2/352: write d4/d8/f50 [956257,89970] 0 2024-09-18T12:49:17.777 INFO:tasks.workunit.client.0.smithi078.stdout:2/353: readlink d4/d1a/l65 0 2024-09-18T12:49:17.787 INFO:tasks.workunit.client.0.smithi078.stdout:0/462: sync 2024-09-18T12:49:17.792 INFO:tasks.workunit.client.0.smithi078.stdout:0/463: symlink d3/d1f/d2e/d8f/lb1 0 2024-09-18T12:49:17.803 INFO:tasks.workunit.client.0.smithi078.stdout:0/464: write d3/f18 [2033804,87681] 0 2024-09-18T12:49:17.804 INFO:tasks.workunit.client.1.smithi148.stdout:6/585: getdents d5/d1a/d3d 0 2024-09-18T12:49:17.805 INFO:tasks.workunit.client.1.smithi148.stdout:6/586: readlink d5/d1a/dc/d2b/l8b 0 2024-09-18T12:49:17.806 INFO:tasks.workunit.client.1.smithi148.stdout:6/587: write d5/d1a/dc/d2b/d35/d9c/f9f [903481,60983] 0 2024-09-18T12:49:17.807 INFO:tasks.workunit.client.1.smithi148.stdout:9/550: unlink d8/da/dd/d35/d47/d4e/l6b 0 2024-09-18T12:49:17.807 INFO:tasks.workunit.client.1.smithi148.stdout:9/551: readlink d8/l5b 0 2024-09-18T12:49:17.808 INFO:tasks.workunit.client.1.smithi148.stdout:9/552: truncate d8/da/dd/d3f/f58 1658951 0 2024-09-18T12:49:17.810 INFO:tasks.workunit.client.1.smithi148.stdout:1/540: unlink dc/d5b/l9e 0 2024-09-18T12:49:17.810 INFO:tasks.workunit.client.1.smithi148.stdout:1/541: write dc/d11/f16 [1248692,28729] 0 2024-09-18T12:49:17.812 INFO:tasks.workunit.client.0.smithi078.stdout:0/465: dwrite d3/d1f/d2e/d8f/da1/fa2 [0,4194304] 0 2024-09-18T12:49:17.814 INFO:tasks.workunit.client.0.smithi078.stdout:2/354: dread d4/dd/d18/f60 [0,4194304] 0 2024-09-18T12:49:17.816 INFO:tasks.workunit.client.1.smithi148.stdout:2/501: truncate d9/d3a/d90/f60 1070558 0 2024-09-18T12:49:17.816 INFO:tasks.workunit.client.1.smithi148.stdout:2/502: readlink d9/d24/d67/d72/d8f/la6 0 2024-09-18T12:49:17.820 INFO:tasks.workunit.client.0.smithi078.stdout:2/355: mknod d4/dd/d18/d3b/d55/c6e 0 2024-09-18T12:49:17.824 INFO:tasks.workunit.client.1.smithi148.stdout:0/727: mkdir de/d14/d6b/df2 0 2024-09-18T12:49:17.827 INFO:tasks.workunit.client.1.smithi148.stdout:6/588: creat d5/d1a/d3d/fb3 x:0 0 0 2024-09-18T12:49:17.828 INFO:tasks.workunit.client.1.smithi148.stdout:6/589: fsync d5/d1a/d29/faa 0 2024-09-18T12:49:17.830 INFO:tasks.workunit.client.0.smithi078.stdout:2/356: creat d4/db/f6f x:0 0 0 2024-09-18T12:49:17.832 INFO:tasks.workunit.client.1.smithi148.stdout:1/542: dread - dc/d11/f6e zero size 2024-09-18T12:49:17.834 INFO:tasks.workunit.client.1.smithi148.stdout:2/503: fsync d9/d24/f79 0 2024-09-18T12:49:17.834 INFO:tasks.workunit.client.1.smithi148.stdout:9/553: write d8/da/dd/f1b [994544,589] 0 2024-09-18T12:49:17.835 INFO:tasks.workunit.client.0.smithi078.stdout:2/357: mkdir d4/d8/d6c/d70 0 2024-09-18T12:49:17.837 INFO:tasks.workunit.client.1.smithi148.stdout:4/538: rename d15/d17/d52/d92/d4c/d4f/f33 to d15/d17/d52/d92/d4c/d4f/fb7 0 2024-09-18T12:49:17.838 INFO:tasks.workunit.client.1.smithi148.stdout:4/539: write d15/d5f/d69/f95 [2098300,130819] 0 2024-09-18T12:49:17.839 INFO:tasks.workunit.client.1.smithi148.stdout:4/540: readlink d15/d17/d52/d92/l75 0 2024-09-18T12:49:17.839 INFO:tasks.workunit.client.1.smithi148.stdout:6/590: symlink d5/d79/lb4 0 2024-09-18T12:49:17.839 INFO:tasks.workunit.client.1.smithi148.stdout:3/535: sync 2024-09-18T12:49:17.840 INFO:tasks.workunit.client.1.smithi148.stdout:1/543: symlink dc/d4d/lb6 0 2024-09-18T12:49:17.840 INFO:tasks.workunit.client.1.smithi148.stdout:4/541: write d15/d17/d52/f8b [626966,76949] 0 2024-09-18T12:49:17.841 INFO:tasks.workunit.client.0.smithi078.stdout:2/358: dwrite d4/d8/d23/f6d [0,4194304] 0 2024-09-18T12:49:17.842 INFO:tasks.workunit.client.1.smithi148.stdout:8/640: creat d8/d16/fde x:0 0 0 2024-09-18T12:49:17.846 INFO:tasks.workunit.client.1.smithi148.stdout:5/601: getdents d7/d8/d18 0 2024-09-18T12:49:17.848 INFO:tasks.workunit.client.1.smithi148.stdout:5/602: write d7/f8c [581001,35979] 0 2024-09-18T12:49:17.849 INFO:tasks.workunit.client.1.smithi148.stdout:0/728: truncate de/d27/f49 269097 0 2024-09-18T12:49:17.849 INFO:tasks.workunit.client.1.smithi148.stdout:3/536: dwrite d4/d8/d20/d2b/fb4 [0,4194304] 0 2024-09-18T12:49:17.853 INFO:tasks.workunit.client.1.smithi148.stdout:4/542: symlink d15/d90/lb8 0 2024-09-18T12:49:17.854 INFO:tasks.workunit.client.1.smithi148.stdout:1/544: mkdir dc/d18/d31/d4b/db7 0 2024-09-18T12:49:17.857 INFO:tasks.workunit.client.1.smithi148.stdout:8/641: unlink d8/d16/d53/d39/d3b/d4e/c56 0 2024-09-18T12:49:17.858 INFO:tasks.workunit.client.1.smithi148.stdout:8/642: write d8/df/db2/fbd [1045590,62143] 0 2024-09-18T12:49:17.859 INFO:tasks.workunit.client.1.smithi148.stdout:8/643: chown d8/d16/d53/d39/d3b/d4e 9 1 2024-09-18T12:49:17.861 INFO:tasks.workunit.client.1.smithi148.stdout:0/729: rmdir de/d14/dcd 39 2024-09-18T12:49:17.862 INFO:tasks.workunit.client.0.smithi078.stdout:2/359: truncate d4/dd/d18/d33/f48 1451661 0 2024-09-18T12:49:17.864 INFO:tasks.workunit.client.1.smithi148.stdout:4/543: mknod d15/d5f/d69/d7f/d94/cb9 0 2024-09-18T12:49:17.864 INFO:tasks.workunit.client.1.smithi148.stdout:4/544: stat d15/d90 0 2024-09-18T12:49:17.864 INFO:tasks.workunit.client.1.smithi148.stdout:1/545: creat dc/d18/d31/d4b/d8d/fb8 x:0 0 0 2024-09-18T12:49:17.867 INFO:tasks.workunit.client.1.smithi148.stdout:8/644: mknod d8/d12/d51/d94/cdf 0 2024-09-18T12:49:17.867 INFO:tasks.workunit.client.1.smithi148.stdout:6/591: write d5/d1a/d29/f5d [980376,106868] 0 2024-09-18T12:49:17.868 INFO:tasks.workunit.client.1.smithi148.stdout:8/645: chown d8/df/f73 234296 1 2024-09-18T12:49:17.869 INFO:tasks.workunit.client.1.smithi148.stdout:6/592: dread - d5/d32/d38/d50/f95 zero size 2024-09-18T12:49:17.869 INFO:tasks.workunit.client.1.smithi148.stdout:1/546: dread dc/d11/d38/f6f [0,4194304] 0 2024-09-18T12:49:17.869 INFO:tasks.workunit.client.0.smithi078.stdout:2/360: getdents d4/d20 0 2024-09-18T12:49:17.870 INFO:tasks.workunit.client.1.smithi148.stdout:4/545: unlink d15/d17/d52/c6f 0 2024-09-18T12:49:17.875 INFO:tasks.workunit.client.0.smithi078.stdout:6/549: sync 2024-09-18T12:49:17.875 INFO:tasks.workunit.client.0.smithi078.stdout:1/383: sync 2024-09-18T12:49:17.878 INFO:tasks.workunit.client.1.smithi148.stdout:5/603: write d7/d8/dc/d12/d20/f2e [758702,4700] 0 2024-09-18T12:49:17.878 INFO:tasks.workunit.client.1.smithi148.stdout:2/504: link d9/d17/l22 d9/d24/d47/lb7 0 2024-09-18T12:49:17.881 INFO:tasks.workunit.client.0.smithi078.stdout:6/550: truncate d10/f16 593827 0 2024-09-18T12:49:17.881 INFO:tasks.workunit.client.1.smithi148.stdout:1/547: dread dc/f25 [0,4194304] 0 2024-09-18T12:49:17.882 INFO:tasks.workunit.client.1.smithi148.stdout:6/593: write d5/ff [1207202,75617] 0 2024-09-18T12:49:17.883 INFO:tasks.workunit.client.1.smithi148.stdout:1/548: dread - dc/d18/d31/d4b/f6d zero size 2024-09-18T12:49:17.885 INFO:tasks.workunit.client.1.smithi148.stdout:2/505: dwrite d9/d17/f45 [0,4194304] 0 2024-09-18T12:49:17.887 INFO:tasks.workunit.client.1.smithi148.stdout:8/646: mknod d8/d16/d53/da0/dba/ce0 0 2024-09-18T12:49:17.888 INFO:tasks.workunit.client.0.smithi078.stdout:6/551: symlink d10/d2b/d61/lb0 0 2024-09-18T12:49:17.888 INFO:tasks.workunit.client.1.smithi148.stdout:8/647: stat d8/df/d3e/d82/d8f/d95 0 2024-09-18T12:49:17.889 INFO:tasks.workunit.client.0.smithi078.stdout:2/361: write d4/d1a/f2e [1363075,117855] 0 2024-09-18T12:49:17.890 INFO:tasks.workunit.client.1.smithi148.stdout:4/546: mknod d15/d17/d52/d68/cba 0 2024-09-18T12:49:17.895 INFO:tasks.workunit.client.1.smithi148.stdout:6/594: mknod d5/d1a/d29/cb5 0 2024-09-18T12:49:17.896 INFO:tasks.workunit.client.0.smithi078.stdout:2/362: rename d4/db/dc/c49 to d4/d8/d23/d52/c71 0 2024-09-18T12:49:17.897 INFO:tasks.workunit.client.0.smithi078.stdout:1/384: link d0/d8/da/c65 d0/d8/da/d3e/d50/c77 0 2024-09-18T12:49:17.900 INFO:tasks.workunit.client.1.smithi148.stdout:4/547: rmdir d15/d17/d52/d92/d4c/d4f 39 2024-09-18T12:49:17.901 INFO:tasks.workunit.client.0.smithi078.stdout:1/385: rmdir d0/d8/da/d3e 39 2024-09-18T12:49:17.907 INFO:tasks.workunit.client.0.smithi078.stdout:1/386: creat d0/d8/da/d3e/d58/d6e/d52/f78 x:0 0 0 2024-09-18T12:49:17.909 INFO:tasks.workunit.client.0.smithi078.stdout:1/387: truncate d0/d8/da/d3e/d50/d60/f6b 895284 0 2024-09-18T12:49:17.910 INFO:tasks.workunit.client.1.smithi148.stdout:0/730: link de/d27/f9a de/d27/d53/ff3 0 2024-09-18T12:49:17.910 INFO:tasks.workunit.client.1.smithi148.stdout:5/604: write d7/d8/dc/d12/d31/d5a/f96 [357274,100762] 0 2024-09-18T12:49:17.910 INFO:tasks.workunit.client.1.smithi148.stdout:6/595: dwrite d5/d1a/dc/d2b/d35/d65/f5e [0,4194304] 0 2024-09-18T12:49:17.912 INFO:tasks.workunit.client.0.smithi078.stdout:1/388: rename d0/d8/da/c1b to d0/d37/c79 0 2024-09-18T12:49:17.912 INFO:tasks.workunit.client.0.smithi078.stdout:1/389: readlink d0/d5b/l6a 0 2024-09-18T12:49:17.913 INFO:tasks.workunit.client.1.smithi148.stdout:2/506: write f7 [4450969,781] 0 2024-09-18T12:49:17.915 INFO:tasks.workunit.client.0.smithi078.stdout:2/363: truncate d4/d8/f1d 4435874 0 2024-09-18T12:49:17.915 INFO:tasks.workunit.client.1.smithi148.stdout:5/605: creat d7/d8/dc/d12/d31/d5a/fcc x:0 0 0 2024-09-18T12:49:17.916 INFO:tasks.workunit.client.1.smithi148.stdout:6/596: read f3 [3156558,10212] 0 2024-09-18T12:49:17.916 INFO:tasks.workunit.client.0.smithi078.stdout:6/552: dread d10/d2b/f6e [0,4194304] 0 2024-09-18T12:49:17.918 INFO:tasks.workunit.client.1.smithi148.stdout:4/548: link d15/d17/d52/d92/d4c/ca4 d15/d17/d52/d92/d4c/d4f/d64/da0/da1/cbb 0 2024-09-18T12:49:17.920 INFO:tasks.workunit.client.1.smithi148.stdout:1/549: dwrite dc/d11/d38/d87/f3c [0,4194304] 0 2024-09-18T12:49:17.921 INFO:tasks.workunit.client.0.smithi078.stdout:1/390: link d0/d8/f38 d0/d8/da/d3e/d58/d6e/f7a 0 2024-09-18T12:49:17.921 INFO:tasks.workunit.client.1.smithi148.stdout:1/550: stat dc/d18/d31/d4b/f65 0 2024-09-18T12:49:17.922 INFO:tasks.workunit.client.1.smithi148.stdout:1/551: read - dc/d18/d31/faf zero size 2024-09-18T12:49:17.925 INFO:tasks.workunit.client.1.smithi148.stdout:4/549: unlink d15/d17/f2b 0 2024-09-18T12:49:17.927 INFO:tasks.workunit.client.0.smithi078.stdout:2/364: dwrite d4/d8/d23/d52/f5a [0,4194304] 0 2024-09-18T12:49:17.928 INFO:tasks.workunit.client.1.smithi148.stdout:1/552: dwrite dc/d18/f3d [0,4194304] 0 2024-09-18T12:49:17.928 INFO:tasks.workunit.client.0.smithi078.stdout:6/553: dwrite d10/d2b/d43/d53/d45/d55/f88 [4194304,4194304] 0 2024-09-18T12:49:17.929 INFO:tasks.workunit.client.0.smithi078.stdout:2/365: chown d4/db/dc/f62 8843 1 2024-09-18T12:49:17.929 INFO:tasks.workunit.client.1.smithi148.stdout:1/553: write dc/d18/d31/d4b/f65 [1539811,97601] 0 2024-09-18T12:49:17.931 INFO:tasks.workunit.client.1.smithi148.stdout:1/554: truncate dc/d18/d31/d39/f75 895276 0 2024-09-18T12:49:17.932 INFO:tasks.workunit.client.1.smithi148.stdout:2/507: link d9/d24/d47/fb2 d9/d73/fb8 0 2024-09-18T12:49:17.932 INFO:tasks.workunit.client.1.smithi148.stdout:7/591: sync 2024-09-18T12:49:17.934 INFO:tasks.workunit.client.0.smithi078.stdout:2/366: creat d4/dd/d18/d33/f72 x:0 0 0 2024-09-18T12:49:17.941 INFO:tasks.workunit.client.0.smithi078.stdout:6/554: mknod d10/d2b/d43/d53/d63/d6b/cb1 0 2024-09-18T12:49:17.947 INFO:tasks.workunit.client.1.smithi148.stdout:0/731: dread de/d27/d53/d89/dbb/f50 [0,4194304] 0 2024-09-18T12:49:17.948 INFO:tasks.workunit.client.1.smithi148.stdout:4/550: rmdir d15/d17/d52 39 2024-09-18T12:49:17.950 INFO:tasks.workunit.client.0.smithi078.stdout:6/555: dwrite d10/d2b/d43/d53/d63/d6b/f93 [0,4194304] 0 2024-09-18T12:49:17.950 INFO:tasks.workunit.client.0.smithi078.stdout:2/367: creat d4/dd/d18/d33/f73 x:0 0 0 2024-09-18T12:49:17.953 INFO:tasks.workunit.client.0.smithi078.stdout:1/391: link d0/d8/da/c73 d0/d8/da/d3e/d58/d6e/c7b 0 2024-09-18T12:49:17.954 INFO:tasks.workunit.client.1.smithi148.stdout:4/551: dwrite d15/d17/f27 [0,4194304] 0 2024-09-18T12:49:17.957 INFO:tasks.workunit.client.0.smithi078.stdout:6/556: dwrite d10/d2b/d43/d53/d45/d55/f88 [0,4194304] 0 2024-09-18T12:49:17.958 INFO:tasks.workunit.client.1.smithi148.stdout:1/555: creat dc/d18/d7d/d7e/fb9 x:0 0 0 2024-09-18T12:49:17.960 INFO:tasks.workunit.client.1.smithi148.stdout:7/592: rename db/d52/d25 to db/dc/df/d2c/d55/daf 0 2024-09-18T12:49:17.960 INFO:tasks.workunit.client.1.smithi148.stdout:1/556: write dc/d18/d31/d39/f75 [1834171,106752] 0 2024-09-18T12:49:17.963 INFO:tasks.workunit.client.1.smithi148.stdout:2/508: symlink d9/d3a/lb9 0 2024-09-18T12:49:17.964 INFO:tasks.workunit.client.0.smithi078.stdout:2/368: rename d4/d8/d23/d52/c71 to d4/dd/c74 0 2024-09-18T12:49:17.969 INFO:tasks.workunit.client.1.smithi148.stdout:7/593: fsync db/dc/df/d2c/f5e 0 2024-09-18T12:49:17.969 INFO:tasks.workunit.client.1.smithi148.stdout:5/606: write d7/d8/f87 [255788,12457] 0 2024-09-18T12:49:17.970 INFO:tasks.workunit.client.1.smithi148.stdout:4/552: unlink d15/d17/d52/d68/cba 0 2024-09-18T12:49:17.971 INFO:tasks.workunit.client.1.smithi148.stdout:4/553: readlink d15/d17/d52/d92/l86 0 2024-09-18T12:49:17.972 INFO:tasks.workunit.client.1.smithi148.stdout:5/607: write d7/d8/dc/d12/d1f/d39/f41 [1578729,78964] 0 2024-09-18T12:49:17.972 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:17 smithi148 ceph-mon[35352]: pgmap v16: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 63 MiB/s rd, 251 MiB/s wr, 469 op/s 2024-09-18T12:49:17.975 INFO:tasks.workunit.client.0.smithi078.stdout:6/557: rename d10/d2b/d43/d53/f92 to d10/d2b/d61/fb2 0 2024-09-18T12:49:17.977 INFO:tasks.workunit.client.1.smithi148.stdout:4/554: dwrite d15/d17/d52/d92/d4c/d4f/d64/da0/fb5 [0,4194304] 0 2024-09-18T12:49:17.977 INFO:tasks.workunit.client.1.smithi148.stdout:0/732: rename de/d14/f65 to de/d14/dcd/ff4 0 2024-09-18T12:49:17.979 INFO:tasks.workunit.client.1.smithi148.stdout:6/597: truncate d5/d1a/d29/d5c/f66 3244384 0 2024-09-18T12:49:17.980 INFO:tasks.workunit.client.1.smithi148.stdout:1/557: fdatasync dc/f13 0 2024-09-18T12:49:17.980 INFO:tasks.workunit.client.1.smithi148.stdout:9/554: sync 2024-09-18T12:49:17.985 INFO:tasks.workunit.client.1.smithi148.stdout:1/558: read dc/d11/d38/d87/f23 [22526,106525] 0 2024-09-18T12:49:17.987 INFO:tasks.workunit.client.1.smithi148.stdout:5/608: rmdir d7/d8/d18/d3f/d7c 39 2024-09-18T12:49:17.988 INFO:tasks.workunit.client.1.smithi148.stdout:1/559: chown dc/d18/d31/d39/cac 4 1 2024-09-18T12:49:17.989 INFO:tasks.workunit.client.1.smithi148.stdout:9/555: dwrite d8/da/f1d [4194304,4194304] 0 2024-09-18T12:49:17.990 INFO:tasks.workunit.client.1.smithi148.stdout:9/556: dread - d8/da/dd/d3f/f9c zero size 2024-09-18T12:49:17.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:17 smithi078 ceph-mon[28091]: pgmap v16: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 63 MiB/s rd, 251 MiB/s wr, 469 op/s 2024-09-18T12:49:17.993 INFO:tasks.workunit.client.1.smithi148.stdout:7/594: rename db/dc/df/d1d/d68/c95 to db/dc/df/d11/d34/d69/cb0 0 2024-09-18T12:49:17.996 INFO:tasks.workunit.client.0.smithi078.stdout:6/558: creat d10/d2b/d43/d53/fb3 x:0 0 0 2024-09-18T12:49:17.999 INFO:tasks.workunit.client.1.smithi148.stdout:6/598: symlink d5/d1a/dc/d2b/lb6 0 2024-09-18T12:49:18.004 INFO:tasks.workunit.client.1.smithi148.stdout:4/555: truncate d15/d17/d52/d92/d4c/d4f/d64/f82 714069 0 2024-09-18T12:49:18.004 INFO:tasks.workunit.client.0.smithi078.stdout:2/369: dread d4/d1a/f22 [0,4194304] 0 2024-09-18T12:49:18.004 INFO:tasks.workunit.client.0.smithi078.stdout:6/559: dwrite d10/d2b/d43/d53/d45/f85 [0,4194304] 0 2024-09-18T12:49:18.005 INFO:tasks.workunit.client.1.smithi148.stdout:4/556: read - d15/d5f/d69/d7f/f8e zero size 2024-09-18T12:49:18.007 INFO:tasks.workunit.client.1.smithi148.stdout:5/609: mkdir d7/d8/dc/d12/d31/d6c/dcd 0 2024-09-18T12:49:18.012 INFO:tasks.workunit.client.1.smithi148.stdout:5/610: dwrite d7/d8/dc/d12/d97/fac [0,4194304] 0 2024-09-18T12:49:18.016 INFO:tasks.workunit.client.0.smithi078.stdout:2/370: link d4/db/f53 d4/dd/d18/d3b/d55/f75 0 2024-09-18T12:49:18.019 INFO:tasks.workunit.client.0.smithi078.stdout:6/560: creat d10/d2b/fb4 x:0 0 0 2024-09-18T12:49:18.021 INFO:tasks.workunit.client.0.smithi078.stdout:2/371: creat d4/d8/f76 x:0 0 0 2024-09-18T12:49:18.023 INFO:tasks.workunit.client.0.smithi078.stdout:2/372: write d4/d8/d23/f6d [1666930,53923] 0 2024-09-18T12:49:18.024 INFO:tasks.workunit.client.0.smithi078.stdout:6/561: creat d10/d2b/d43/d53/d63/d70/d7d/fb5 x:0 0 0 2024-09-18T12:49:18.027 INFO:tasks.workunit.client.0.smithi078.stdout:2/373: rmdir d4 39 2024-09-18T12:49:18.028 INFO:tasks.workunit.client.1.smithi148.stdout:6/599: getdents d5/d1a/dc/d2b/d35/d65/d99/da3 0 2024-09-18T12:49:18.029 INFO:tasks.workunit.client.1.smithi148.stdout:2/509: dwrite d9/f43 [0,4194304] 0 2024-09-18T12:49:18.030 INFO:tasks.workunit.client.0.smithi078.stdout:6/562: symlink d10/d2b/d43/d53/d63/d70/dac/da6/lb6 0 2024-09-18T12:49:18.030 INFO:tasks.workunit.client.1.smithi148.stdout:2/510: chown d9/d17/d29/f3e 0 1 2024-09-18T12:49:18.031 INFO:tasks.workunit.client.1.smithi148.stdout:2/511: dread - d9/d17/d29/d98/f9a zero size 2024-09-18T12:49:18.032 INFO:tasks.workunit.client.0.smithi078.stdout:2/374: unlink d4/dd/d18/d3b/d55/c6e 0 2024-09-18T12:49:18.033 INFO:tasks.workunit.client.1.smithi148.stdout:5/611: mknod d7/d8/dc/d12/d31/cce 0 2024-09-18T12:49:18.036 INFO:tasks.workunit.client.1.smithi148.stdout:6/600: rename d5/d1a/f21 to d5/d1a/dc/d2b/fb7 0 2024-09-18T12:49:18.037 INFO:tasks.workunit.client.1.smithi148.stdout:9/557: getdents d8/da/dd/d35/d5e 0 2024-09-18T12:49:18.038 INFO:tasks.workunit.client.1.smithi148.stdout:0/733: write de/d27/d53/d89/dbb/f54 [667391,88381] 0 2024-09-18T12:49:18.039 INFO:tasks.workunit.client.1.smithi148.stdout:2/512: readlink d9/l68 0 2024-09-18T12:49:18.040 INFO:tasks.workunit.client.1.smithi148.stdout:0/734: dread - de/d27/d53/d89/fce zero size 2024-09-18T12:49:18.040 INFO:tasks.workunit.client.0.smithi078.stdout:2/375: dwrite d4/dd/d18/d3b/d55/f59 [8388608,4194304] 0 2024-09-18T12:49:18.041 INFO:tasks.workunit.client.1.smithi148.stdout:5/612: creat d7/d2b/fcf x:0 0 0 2024-09-18T12:49:18.042 INFO:tasks.workunit.client.0.smithi078.stdout:2/376: chown d4/dd/d18/l67 258506 1 2024-09-18T12:49:18.043 INFO:tasks.workunit.client.1.smithi148.stdout:5/613: dread - d7/d8/dc/d12/d97/fba zero size 2024-09-18T12:49:18.043 INFO:tasks.workunit.client.1.smithi148.stdout:4/557: getdents d15/d3f 0 2024-09-18T12:49:18.044 INFO:tasks.workunit.client.1.smithi148.stdout:5/614: dread - d7/d8/dc/d12/d31/d5a/fb3 zero size 2024-09-18T12:49:18.045 INFO:tasks.workunit.client.1.smithi148.stdout:7/595: dread db/dc/df/d8e/f7c [0,4194304] 0 2024-09-18T12:49:18.046 INFO:tasks.workunit.client.1.smithi148.stdout:5/615: chown d7/d2b/l8f 4 1 2024-09-18T12:49:18.048 INFO:tasks.workunit.client.1.smithi148.stdout:9/558: creat d8/da/dd/d4a/d49/d46/d54/fa8 x:0 0 0 2024-09-18T12:49:18.049 INFO:tasks.workunit.client.1.smithi148.stdout:8/648: sync 2024-09-18T12:49:18.049 INFO:tasks.workunit.client.1.smithi148.stdout:3/537: sync 2024-09-18T12:49:18.054 INFO:tasks.workunit.client.0.smithi078.stdout:6/563: dread d10/d2b/d43/d53/f56 [0,4194304] 0 2024-09-18T12:49:18.055 INFO:tasks.workunit.client.1.smithi148.stdout:7/596: creat db/dc/fb1 x:0 0 0 2024-09-18T12:49:18.061 INFO:tasks.workunit.client.0.smithi078.stdout:6/564: rename d10/c54 to d10/d2b/d43/d53/d63/d6b/cb7 0 2024-09-18T12:49:18.061 INFO:tasks.workunit.client.1.smithi148.stdout:0/735: getdents de/d14/d43/d70 0 2024-09-18T12:49:18.062 INFO:tasks.workunit.client.0.smithi078.stdout:6/565: truncate d10/d2b/fb4 394584 0 2024-09-18T12:49:18.062 INFO:tasks.workunit.client.1.smithi148.stdout:8/649: creat d8/d16/d53/d39/fe1 x:0 0 0 2024-09-18T12:49:18.063 INFO:tasks.workunit.client.1.smithi148.stdout:8/650: write d8/df/f10 [4528740,95785] 0 2024-09-18T12:49:18.064 INFO:tasks.workunit.client.1.smithi148.stdout:8/651: write d8/f92 [3822496,107824] 0 2024-09-18T12:49:18.064 INFO:tasks.workunit.client.1.smithi148.stdout:4/558: mknod d15/d17/d52/d92/d4c/cbc 0 2024-09-18T12:49:18.066 INFO:tasks.workunit.client.1.smithi148.stdout:8/652: write d8/d12/f1b [5615056,6090] 0 2024-09-18T12:49:18.067 INFO:tasks.workunit.client.0.smithi078.stdout:6/566: symlink d10/d2b/d43/d53/d63/d70/d7d/lb8 0 2024-09-18T12:49:18.067 INFO:tasks.workunit.client.1.smithi148.stdout:4/559: chown d15/d17/d52/d92/d4c/d4f/d34/lae 2977 1 2024-09-18T12:49:18.068 INFO:tasks.workunit.client.1.smithi148.stdout:1/560: sync 2024-09-18T12:49:18.071 INFO:tasks.workunit.client.1.smithi148.stdout:0/736: creat de/d27/d53/d89/dc0/db0/ff5 x:0 0 0 2024-09-18T12:49:18.072 INFO:tasks.workunit.client.1.smithi148.stdout:6/601: truncate d5/d79/fad 1713200 0 2024-09-18T12:49:18.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.072+0000 7f86e3590640 1 -- 172.21.15.78:0/1655227019 --> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f86dc107150 con 0x7f86c8074ad0 2024-09-18T12:49:18.074 INFO:tasks.workunit.client.1.smithi148.stdout:9/559: write d8/da/dd/d4a/f15 [7406650,99737] 0 2024-09-18T12:49:18.075 INFO:tasks.workunit.client.0.smithi078.stdout:6/567: rmdir d10/d2b/d43/d53/d63/d70/d7d/daf 0 2024-09-18T12:49:18.075 INFO:tasks.workunit.client.1.smithi148.stdout:3/538: dread d4/d8/f15 [0,4194304] 0 2024-09-18T12:49:18.078 INFO:tasks.workunit.client.1.smithi148.stdout:5/616: dwrite d7/d8/dc/d12/d1f/d69/fc4 [0,4194304] 0 2024-09-18T12:49:18.081 INFO:tasks.workunit.client.1.smithi148.stdout:7/597: rmdir db/dc/df/d8e/d75/dab 0 2024-09-18T12:49:18.081 INFO:tasks.workunit.client.0.smithi078.stdout:6/568: dwrite d10/d2b/d43/f6c [0,4194304] 0 2024-09-18T12:49:18.082 INFO:tasks.workunit.client.1.smithi148.stdout:3/539: chown d4/d8/d20/d2b/d43/l17 706 1 2024-09-18T12:49:18.082 INFO:tasks.workunit.client.1.smithi148.stdout:2/513: dwrite d9/d73/fb8 [0,4194304] 0 2024-09-18T12:49:18.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.090+0000 7f86d27fc640 1 -- 172.21.15.78:0/1655227019 <== mgr.24355 v2:172.21.15.148:6828/2591325460 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f86dc107150 con 0x7f86c8074ad0 2024-09-18T12:49:18.092 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:49:18.092 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (6m) 4s ago 8m 26.3M - 0.25.0 c8568f914cd2 47a8b8bee5f5 2024-09-18T12:49:18.092 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (8m) 4s ago 8m 8694k - 19.1.1-330-gc2ddf972 ebb0615149de b314296d0168 2024-09-18T12:49:18.092 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (7m) 20s ago 7m 5272k - 19.1.1-330-gc2ddf972 ebb0615149de dad72664a205 2024-09-18T12:49:18.093 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (8m) 4s ago 8m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de bb77146b81c7 2024-09-18T12:49:18.093 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (7m) 20s ago 7m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de f82fdd264dc6 2024-09-18T12:49:18.093 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (6m) 4s ago 7m 78.7M - 9.4.12 2bacad6d85d8 0367cad8b635 2024-09-18T12:49:18.093 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (2m) 4s ago 2m 179M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:49:18.093 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (2m) 4s ago 2m 22.7M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:49:18.093 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (2m) 20s ago 2m 12.4M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:49:18.093 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (2m) 20s ago 2m 13.2M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:49:18.093 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:9283,8765,8443 running (9m) 4s ago 9m 343M - 19.1.1-330-gc2ddf972 ebb0615149de 284f2d8afd38 2024-09-18T12:49:18.093 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (46s) 20s ago 7m 494M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1c064b119458 2024-09-18T12:49:18.093 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (9m) 4s ago 9m 52.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1cb11a5bcd72 2024-09-18T12:49:18.093 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (7m) 20s ago 7m 39.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 02dfe1551226 2024-09-18T12:49:18.093 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (8m) 4s ago 8m 15.6M - 1.5.0 0da6a335fe13 3c6ba926bb86 2024-09-18T12:49:18.093 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (7m) 20s ago 7m 16.5M - 1.5.0 0da6a335fe13 4b7db3027dc5 2024-09-18T12:49:18.093 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (6m) 4s ago 6m 88.4M 1216M 19.1.1-330-gc2ddf972 ebb0615149de f634ad9ddb36 2024-09-18T12:49:18.094 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (5m) 4s ago 5m 98.7M 1216M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:49:18.094 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (5m) 4s ago 5m 88.2M 1216M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:49:18.094 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (4m) 20s ago 4m 102M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:49:18.094 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (4m) 20s ago 4m 95.0M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:49:18.094 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (3m) 20s ago 3m 90.5M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:49:18.094 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (6m) 4s ago 7m 58.1M - 2.43.0 a07b618ecd1d d012486d55b1 2024-09-18T12:49:18.094 INFO:tasks.workunit.client.1.smithi148.stdout:7/598: dread db/dc/df/d1d/f21 [4194304,4194304] 0 2024-09-18T12:49:18.094 INFO:tasks.workunit.client.1.smithi148.stdout:2/514: creat d9/d3a/d90/fba x:0 0 0 2024-09-18T12:49:18.095 INFO:tasks.workunit.client.1.smithi148.stdout:2/515: chown d9/d24/d47/c70 240509 1 2024-09-18T12:49:18.095 INFO:tasks.workunit.client.1.smithi148.stdout:2/516: stat d9/d24/d31/d34/d42/c6c 0 2024-09-18T12:49:18.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.095+0000 7f86e3590640 1 -- 172.21.15.78:0/1655227019 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f86c8074ad0 msgr2=0x7f86c8076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:18.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.095+0000 7f86e3590640 1 --2- 172.21.15.78:0/1655227019 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f86c8074ad0 0x7f86c8076f90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f86dc198990 tx=0x7f86cc009260 comp rx=0 tx=0).stop 2024-09-18T12:49:18.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.095+0000 7f86e3590640 1 -- 172.21.15.78:0/1655227019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc101970 msgr2=0x7f86dc1974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:18.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.095+0000 7f86e3590640 1 --2- 172.21.15.78:0/1655227019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc101970 0x7f86dc1974e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f86d8030750 tx=0x7f86d80043b0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.095+0000 7f86e3590640 1 -- 172.21.15.78:0/1655227019 shutdown_connections 2024-09-18T12:49:18.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.095+0000 7f86e3590640 1 --2- 172.21.15.78:0/1655227019 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f86c8074ad0 0x7f86c8076f90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.095+0000 7f86e3590640 1 --2- 172.21.15.78:0/1655227019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86dc102b70 0x7f86dc197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.095+0000 7f86e3590640 1 --2- 172.21.15.78:0/1655227019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc101970 0x7f86dc1974e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.095+0000 7f86e3590640 1 -- 172.21.15.78:0/1655227019 >> 172.21.15.78:0/1655227019 conn(0x7f86dc0fd140 msgr2=0x7f86dc0ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:18.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.095+0000 7f86e3590640 1 -- 172.21.15.78:0/1655227019 shutdown_connections 2024-09-18T12:49:18.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.095+0000 7f86e3590640 1 -- 172.21.15.78:0/1655227019 wait complete. 2024-09-18T12:49:18.097 INFO:tasks.workunit.client.1.smithi148.stdout:0/737: creat de/d14/d43/d57/ff6 x:0 0 0 2024-09-18T12:49:18.098 INFO:tasks.workunit.client.1.smithi148.stdout:4/560: truncate d15/d17/d52/d92/d4c/d72/f79 29816 0 2024-09-18T12:49:18.099 INFO:tasks.workunit.client.1.smithi148.stdout:9/560: creat d8/da/dd/d4a/d49/d46/d75/d97/fa9 x:0 0 0 2024-09-18T12:49:18.100 INFO:tasks.workunit.client.1.smithi148.stdout:4/561: dread - d15/d3f/f6e zero size 2024-09-18T12:49:18.100 INFO:tasks.workunit.client.1.smithi148.stdout:7/599: dwrite db/dc/df/d1d/f57 [4194304,4194304] 0 2024-09-18T12:49:18.100 INFO:tasks.workunit.client.1.smithi148.stdout:1/561: getdents dc/d9f 0 2024-09-18T12:49:18.135 INFO:tasks.workunit.client.1.smithi148.stdout:3/540: symlink d4/d8/d1e/d6b/d31/lbd 0 2024-09-18T12:49:18.135 INFO:tasks.workunit.client.1.smithi148.stdout:6/602: creat d5/d1a/dc/d2b/d35/d65/fb8 x:0 0 0 2024-09-18T12:49:18.136 INFO:tasks.workunit.client.1.smithi148.stdout:0/738: creat de/d27/d53/d89/dc0/dbd/dd9/ff7 x:0 0 0 2024-09-18T12:49:18.136 INFO:tasks.workunit.client.1.smithi148.stdout:5/617: creat d7/d8/fd0 x:0 0 0 2024-09-18T12:49:18.137 INFO:tasks.workunit.client.1.smithi148.stdout:1/562: write dc/d18/f90 [156246,10711] 0 2024-09-18T12:49:18.138 INFO:tasks.workunit.client.1.smithi148.stdout:6/603: fdatasync d5/d32/d38/d50/f52 0 2024-09-18T12:49:18.141 INFO:tasks.workunit.client.1.smithi148.stdout:0/739: write de/d14/f47 [3672852,18366] 0 2024-09-18T12:49:18.141 INFO:tasks.workunit.client.1.smithi148.stdout:9/561: dread d8/da/dd/d4a/d49/d46/f91 [0,4194304] 0 2024-09-18T12:49:18.142 INFO:tasks.workunit.client.1.smithi148.stdout:1/563: read dc/d18/d31/d39/f75 [1540205,73361] 0 2024-09-18T12:49:18.143 INFO:tasks.workunit.client.1.smithi148.stdout:1/564: write fb [3624325,104945] 0 2024-09-18T12:49:18.148 INFO:tasks.workunit.client.1.smithi148.stdout:0/740: write de/f12 [2211766,24055] 0 2024-09-18T12:49:18.150 INFO:tasks.workunit.client.1.smithi148.stdout:4/562: write d15/d17/d52/d92/f46 [436914,91506] 0 2024-09-18T12:49:18.151 INFO:tasks.workunit.client.1.smithi148.stdout:3/541: rename d4/d8/d1e/d79/c7e to d4/d8/cbe 0 2024-09-18T12:49:18.154 INFO:tasks.workunit.client.1.smithi148.stdout:7/600: dread db/dc/df/d11/d34/d69/f96 [0,4194304] 0 2024-09-18T12:49:18.154 INFO:tasks.workunit.client.1.smithi148.stdout:5/618: creat d7/d8/dc/d12/fd1 x:0 0 0 2024-09-18T12:49:18.156 INFO:tasks.workunit.client.1.smithi148.stdout:0/741: rename de/d27/d53/d89/dc0/dbd/dd9/ff7 to de/d14/d43/d57/d59/ff8 0 2024-09-18T12:49:18.157 INFO:tasks.workunit.client.1.smithi148.stdout:6/604: write d5/d79/f8e [410635,66092] 0 2024-09-18T12:49:18.157 INFO:tasks.workunit.client.1.smithi148.stdout:1/565: getdents dc/d18/d7d/d93 0 2024-09-18T12:49:18.158 INFO:tasks.workunit.client.1.smithi148.stdout:4/563: truncate d15/d3f/f6e 834532 0 2024-09-18T12:49:18.160 INFO:tasks.workunit.client.1.smithi148.stdout:1/566: readlink dc/d11/d38/d87/d2b/l48 0 2024-09-18T12:49:18.160 INFO:tasks.workunit.client.1.smithi148.stdout:4/564: read d15/d17/f42 [3752396,2472] 0 2024-09-18T12:49:18.161 INFO:tasks.workunit.client.1.smithi148.stdout:9/562: getdents d8/da/dd/d3f/d5d 0 2024-09-18T12:49:18.162 INFO:tasks.workunit.client.1.smithi148.stdout:7/601: unlink db/dc/df/d1d/d68/d7a/ca3 0 2024-09-18T12:49:18.163 INFO:tasks.workunit.client.1.smithi148.stdout:0/742: dwrite de/d27/f2b [0,4194304] 0 2024-09-18T12:49:18.163 INFO:tasks.workunit.client.1.smithi148.stdout:9/563: chown d8/da/dd/d35/d5e/c7b 339 1 2024-09-18T12:49:18.164 INFO:tasks.workunit.client.1.smithi148.stdout:6/605: creat d5/d1a/d3d/fb9 x:0 0 0 2024-09-18T12:49:18.168 INFO:tasks.workunit.client.0.smithi078.stdout:8/362: sync 2024-09-18T12:49:18.169 INFO:tasks.workunit.client.0.smithi078.stdout:5/520: sync 2024-09-18T12:49:18.169 INFO:tasks.workunit.client.1.smithi148.stdout:9/564: rename d8/da/dd/d35/d47/d4e/f71 to d8/da/dd/d4a/d49/d46/d54/faa 0 2024-09-18T12:49:18.169 INFO:tasks.workunit.client.0.smithi078.stdout:8/363: chown d0/f16 1031856034 1 2024-09-18T12:49:18.170 INFO:tasks.workunit.client.1.smithi148.stdout:7/602: mknod db/dc/df/d1d/d68/d7a/da7/cb2 0 2024-09-18T12:49:18.170 INFO:tasks.workunit.client.0.smithi078.stdout:5/521: write d2/d4/f89 [537999,66263] 0 2024-09-18T12:49:18.170 INFO:tasks.workunit.client.0.smithi078.stdout:8/364: fsync d0/d7/d1e/d50/f58 0 2024-09-18T12:49:18.171 INFO:tasks.workunit.client.0.smithi078.stdout:5/522: chown d2/d4/f78 0 1 2024-09-18T12:49:18.173 INFO:tasks.workunit.client.0.smithi078.stdout:5/523: chown d2/d4/d9/da/d60/d7f 302349 1 2024-09-18T12:49:18.173 INFO:tasks.workunit.client.1.smithi148.stdout:6/606: creat d5/d1a/dc/d2b/d35/d65/d99/da4/da6/fba x:0 0 0 2024-09-18T12:49:18.173 INFO:tasks.workunit.client.1.smithi148.stdout:8/653: sync 2024-09-18T12:49:18.173 INFO:tasks.workunit.client.1.smithi148.stdout:3/542: dwrite d4/f11 [0,4194304] 0 2024-09-18T12:49:18.173 INFO:tasks.workunit.client.0.smithi078.stdout:5/524: readlink d2/d4/d9/lb 0 2024-09-18T12:49:18.175 INFO:tasks.workunit.client.1.smithi148.stdout:4/565: dread d15/d17/d52/d92/d4c/d4f/f61 [0,4194304] 0 2024-09-18T12:49:18.176 INFO:tasks.workunit.client.1.smithi148.stdout:0/743: creat de/d27/d53/ff9 x:0 0 0 2024-09-18T12:49:18.177 INFO:tasks.workunit.client.1.smithi148.stdout:7/603: mkdir db/dc/df/d11/db3 0 2024-09-18T12:49:18.177 INFO:tasks.workunit.client.1.smithi148.stdout:1/567: getdents dc/d11/d38/d72 0 2024-09-18T12:49:18.178 INFO:tasks.workunit.client.0.smithi078.stdout:5/525: creat d2/d4/d12/d16/d36/d4c/d62/d4d/fa2 x:0 0 0 2024-09-18T12:49:18.179 INFO:tasks.workunit.client.1.smithi148.stdout:9/565: mkdir d8/da/dd/d4a/d49/d46/d54/dab 0 2024-09-18T12:49:18.180 INFO:tasks.workunit.client.0.smithi078.stdout:8/365: link d0/d7/d1e/d50/f5b d0/f6a 0 2024-09-18T12:49:18.184 INFO:tasks.workunit.client.1.smithi148.stdout:0/744: symlink de/d14/d43/lfa 0 2024-09-18T12:49:18.185 INFO:tasks.workunit.client.1.smithi148.stdout:4/566: dread d15/d17/d52/d92/d4c/d72/f93 [0,4194304] 0 2024-09-18T12:49:18.185 INFO:tasks.workunit.client.1.smithi148.stdout:7/604: dwrite db/dc/df/f8f [0,4194304] 0 2024-09-18T12:49:18.189 INFO:tasks.workunit.client.1.smithi148.stdout:0/745: write de/d27/fdb [764590,40862] 0 2024-09-18T12:49:18.189 INFO:tasks.workunit.client.1.smithi148.stdout:6/607: dread d5/d1a/d29/f4e [0,4194304] 0 2024-09-18T12:49:18.190 INFO:tasks.workunit.client.1.smithi148.stdout:3/543: rename d4/d8/d20/f3d to d4/d8/d1e/d6b/d31/d54/fbf 0 2024-09-18T12:49:18.195 INFO:tasks.workunit.client.1.smithi148.stdout:1/568: fsync dc/d11/d38/d87/d2b/f47 0 2024-09-18T12:49:18.195 INFO:tasks.workunit.client.0.smithi078.stdout:8/366: creat d0/d7/d1e/d33/f6b x:0 0 0 2024-09-18T12:49:18.196 INFO:tasks.workunit.client.1.smithi148.stdout:1/569: write dc/d18/d31/d4b/f65 [5865069,115060] 0 2024-09-18T12:49:18.200 INFO:tasks.workunit.client.1.smithi148.stdout:3/544: creat d4/d8/d1e/d6b/d31/d60/fc0 x:0 0 0 2024-09-18T12:49:18.201 INFO:tasks.workunit.client.1.smithi148.stdout:9/566: mknod d8/cac 0 2024-09-18T12:49:18.202 INFO:tasks.workunit.client.1.smithi148.stdout:3/545: chown d4/f76 1191308 1 2024-09-18T12:49:18.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.200+0000 7f9d79187640 1 -- 172.21.15.78:0/3716061661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d74101a60 msgr2=0x7f9d74101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:18.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.200+0000 7f9d79187640 1 --2- 172.21.15.78:0/3716061661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d74101a60 0x7f9d74101ee0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009880 tx=0x7f9d6802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.200+0000 7f9d79187640 1 -- 172.21.15.78:0/3716061661 shutdown_connections 2024-09-18T12:49:18.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.200+0000 7f9d79187640 1 --2- 172.21.15.78:0/3716061661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d74101a60 0x7f9d74101ee0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.200+0000 7f9d79187640 1 --2- 172.21.15.78:0/3716061661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d74100860 0x7f9d74100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.200+0000 7f9d79187640 1 -- 172.21.15.78:0/3716061661 >> 172.21.15.78:0/3716061661 conn(0x7f9d740fc010 msgr2=0x7f9d740fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:18.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.200+0000 7f9d79187640 1 -- 172.21.15.78:0/3716061661 shutdown_connections 2024-09-18T12:49:18.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.200+0000 7f9d79187640 1 -- 172.21.15.78:0/3716061661 wait complete. 2024-09-18T12:49:18.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.201+0000 7f9d79187640 1 Processor -- start 2024-09-18T12:49:18.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.201+0000 7f9d79187640 1 -- start start 2024-09-18T12:49:18.204 INFO:tasks.workunit.client.1.smithi148.stdout:9/567: chown d8/da/dd/d77 5619570 1 2024-09-18T12:49:18.204 INFO:tasks.workunit.client.1.smithi148.stdout:3/546: write d4/f11 [1237535,72901] 0 2024-09-18T12:49:18.204 INFO:tasks.workunit.client.1.smithi148.stdout:8/654: link d8/d16/d27/f4a d8/d16/d53/da0/dba/fe2 0 2024-09-18T12:49:18.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.202+0000 7f9d79187640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d74100860 0x7f9d7406a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.202+0000 7f9d79187640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d74101a60 0x7f9d7419c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.202+0000 7f9d79187640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741096a0 con 0x7f9d74100860 2024-09-18T12:49:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.202+0000 7f9d79187640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74109520 con 0x7f9d74101a60 2024-09-18T12:49:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.202+0000 7f9d72d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d74100860 0x7f9d7406a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.202+0000 7f9d72d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d74100860 0x7f9d7406a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40812/0 (socket says 172.21.15.78:40812) 2024-09-18T12:49:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.202+0000 7f9d72d9d640 1 -- 172.21.15.78:0/836873046 learned_addr learned my addr 172.21.15.78:0/836873046 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:49:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.202+0000 7f9d7259c640 1 --2- 172.21.15.78:0/836873046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d74101a60 0x7f9d7419c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.202+0000 7f9d72d9d640 1 -- 172.21.15.78:0/836873046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d74101a60 msgr2=0x7f9d7419c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.202+0000 7f9d72d9d640 1 --2- 172.21.15.78:0/836873046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d74101a60 0x7f9d7419c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.202+0000 7f9d72d9d640 1 -- 172.21.15.78:0/836873046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7419c800 con 0x7f9d74100860 2024-09-18T12:49:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.203+0000 7f9d72d9d640 1 --2- 172.21.15.78:0/836873046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d74100860 0x7f9d7406a790 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400d8d0 tx=0x7f9d6400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.203+0000 7f9d5bfff640 1 -- 172.21.15.78:0/836873046 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d64017070 con 0x7f9d74100860 2024-09-18T12:49:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.203+0000 7f9d79187640 1 -- 172.21.15.78:0/836873046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7419caf0 con 0x7f9d74100860 2024-09-18T12:49:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.203+0000 7f9d5bfff640 1 -- 172.21.15.78:0/836873046 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d6400be10 con 0x7f9d74100860 2024-09-18T12:49:18.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.203+0000 7f9d5bfff640 1 -- 172.21.15.78:0/836873046 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d64021060 con 0x7f9d74100860 2024-09-18T12:49:18.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.203+0000 7f9d79187640 1 -- 172.21.15.78:0/836873046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d7419cf90 con 0x7f9d74100860 2024-09-18T12:49:18.208 INFO:tasks.workunit.client.1.smithi148.stdout:6/608: creat d5/d1a/d29/d5c/da1/fbb x:0 0 0 2024-09-18T12:49:18.208 INFO:tasks.workunit.client.1.smithi148.stdout:8/655: write d8/d16/fde [167930,32157] 0 2024-09-18T12:49:18.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.205+0000 7f9d59ffb640 1 -- 172.21.15.78:0/836873046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d74100c60 con 0x7f9d74100860 2024-09-18T12:49:18.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.205+0000 7f9d5bfff640 1 -- 172.21.15.78:0/836873046 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f9d6401a070 con 0x7f9d74100860 2024-09-18T12:49:18.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.207+0000 7f9d5bfff640 1 --2- 172.21.15.78:0/836873046 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9d5c074a30 0x7f9d5c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:18.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.207+0000 7f9d5bfff640 1 -- 172.21.15.78:0/836873046 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f9d64095e30 con 0x7f9d74100860 2024-09-18T12:49:18.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.207+0000 7f9d7259c640 1 --2- 172.21.15.78:0/836873046 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9d5c074a30 0x7f9d5c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:18.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.208+0000 7f9d7259c640 1 --2- 172.21.15.78:0/836873046 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9d5c074a30 0x7f9d5c076ef0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d68000c00 tx=0x7f9d68009580 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:18.210 INFO:tasks.workunit.client.1.smithi148.stdout:4/567: getdents d15/d17/d52/d92/d4c/d4f/d64/d9a 0 2024-09-18T12:49:18.214 INFO:tasks.workunit.client.1.smithi148.stdout:8/656: creat d8/d12/d46/d7e/fe3 x:0 0 0 2024-09-18T12:49:18.214 INFO:tasks.workunit.client.1.smithi148.stdout:9/568: dwrite d8/da/dd/d35/d81/f8e [0,4194304] 0 2024-09-18T12:49:18.215 INFO:tasks.workunit.client.1.smithi148.stdout:3/547: dwrite d4/d8/d1e/d63/fad [0,4194304] 0 2024-09-18T12:49:18.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.215+0000 7f9d5bfff640 1 -- 172.21.15.78:0/836873046 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f9d640612d0 con 0x7f9d74100860 2024-09-18T12:49:18.217 INFO:tasks.workunit.client.1.smithi148.stdout:7/605: write db/dc/df/d11/f3a [579211,125177] 0 2024-09-18T12:49:18.218 INFO:tasks.workunit.client.1.smithi148.stdout:4/568: rename d15/d17/d52/c58 to d15/d5f/d69/d7f/d94/cbd 0 2024-09-18T12:49:18.219 INFO:tasks.workunit.client.1.smithi148.stdout:8/657: readlink d8/df/l49 0 2024-09-18T12:49:18.223 INFO:tasks.workunit.client.1.smithi148.stdout:1/570: dread dc/d11/f12 [0,4194304] 0 2024-09-18T12:49:18.225 INFO:tasks.workunit.client.1.smithi148.stdout:7/606: rmdir db/dc/df/d1d/d41 39 2024-09-18T12:49:18.226 INFO:tasks.workunit.client.1.smithi148.stdout:4/569: unlink d15/d17/d52/d92/d4c/d4f/c60 0 2024-09-18T12:49:18.227 INFO:tasks.workunit.client.1.smithi148.stdout:9/569: dread d8/da/dd/d35/d81/f9e [0,4194304] 0 2024-09-18T12:49:18.227 INFO:tasks.workunit.client.1.smithi148.stdout:0/746: dwrite de/d14/d43/d57/f6f [4194304,4194304] 0 2024-09-18T12:49:18.228 INFO:tasks.workunit.client.1.smithi148.stdout:7/607: read - db/dc/df/d8e/d75/fa6 zero size 2024-09-18T12:49:18.228 INFO:tasks.workunit.client.1.smithi148.stdout:2/517: sync 2024-09-18T12:49:18.228 INFO:tasks.workunit.client.1.smithi148.stdout:8/658: mkdir d8/df/d3e/d82/d8f/d95/de4 0 2024-09-18T12:49:18.230 INFO:tasks.workunit.client.1.smithi148.stdout:9/570: chown d8/da/dd/d4a/f3a 693484 1 2024-09-18T12:49:18.232 INFO:tasks.workunit.client.1.smithi148.stdout:3/548: write d4/d8/d1e/f82 [877126,125737] 0 2024-09-18T12:49:18.234 INFO:tasks.workunit.client.1.smithi148.stdout:9/571: write d8/da/dd/d3f/f7f [473723,15601] 0 2024-09-18T12:49:18.236 INFO:tasks.workunit.client.1.smithi148.stdout:4/570: rename d15/d17/d52/d92/d4c/f67 to d15/d90/fbe 0 2024-09-18T12:49:18.237 INFO:tasks.workunit.client.1.smithi148.stdout:7/608: symlink db/dc/df/d11/d34/d69/lb4 0 2024-09-18T12:49:18.241 INFO:tasks.workunit.client.1.smithi148.stdout:1/571: link dc/d18/d31/d4b/d8d/fb8 dc/d11/d38/d72/fba 0 2024-09-18T12:49:18.241 INFO:tasks.workunit.client.1.smithi148.stdout:6/609: dread d5/d1a/f47 [0,4194304] 0 2024-09-18T12:49:18.242 INFO:tasks.workunit.client.1.smithi148.stdout:0/747: link de/f1e de/d27/d53/d89/dca/ffb 0 2024-09-18T12:49:18.243 INFO:tasks.workunit.client.1.smithi148.stdout:4/571: fsync d15/d17/d52/d92/d4c/d72/f93 0 2024-09-18T12:49:18.244 INFO:tasks.workunit.client.1.smithi148.stdout:7/609: write db/dc/df/d8e/d75/f81 [159526,53653] 0 2024-09-18T12:49:18.246 INFO:tasks.workunit.client.1.smithi148.stdout:1/572: creat dc/d9f/fbb x:0 0 0 2024-09-18T12:49:18.247 INFO:tasks.workunit.client.1.smithi148.stdout:4/572: readlink d15/d90/l9f 0 2024-09-18T12:49:18.248 INFO:tasks.workunit.client.1.smithi148.stdout:3/549: dwrite d4/d8/d20/d2b/d43/f97 [0,4194304] 0 2024-09-18T12:49:18.249 INFO:tasks.workunit.client.1.smithi148.stdout:4/573: chown d15/f28 843323226 1 2024-09-18T12:49:18.249 INFO:tasks.workunit.client.1.smithi148.stdout:9/572: dread d8/da/f1d [4194304,4194304] 0 2024-09-18T12:49:18.250 INFO:tasks.workunit.client.1.smithi148.stdout:0/748: fdatasync de/d27/d53/d89/dbb/db5/fd0 0 2024-09-18T12:49:18.251 INFO:tasks.workunit.client.1.smithi148.stdout:1/573: read dc/f13 [348637,54900] 0 2024-09-18T12:49:18.251 INFO:tasks.workunit.client.1.smithi148.stdout:6/610: mknod d5/d1a/dc/d2b/d35/d65/d99/da4/da6/cbc 0 2024-09-18T12:49:18.252 INFO:tasks.workunit.client.1.smithi148.stdout:9/573: chown d8/da/l32 7 1 2024-09-18T12:49:18.253 INFO:tasks.workunit.client.1.smithi148.stdout:7/610: dread - db/dc/df/d1d/d41/fa2 zero size 2024-09-18T12:49:18.253 INFO:tasks.workunit.client.1.smithi148.stdout:4/574: mknod d15/d5f/cbf 0 2024-09-18T12:49:18.253 INFO:tasks.workunit.client.1.smithi148.stdout:3/550: chown d4/d8/f23 15 1 2024-09-18T12:49:18.254 INFO:tasks.workunit.client.1.smithi148.stdout:6/611: stat d5/d32/d56/l51 0 2024-09-18T12:49:18.256 INFO:tasks.workunit.client.1.smithi148.stdout:0/749: creat de/d27/ffc x:0 0 0 2024-09-18T12:49:18.257 INFO:tasks.workunit.client.1.smithi148.stdout:4/575: write d15/d17/d52/d92/f46 [1561862,15760] 0 2024-09-18T12:49:18.257 INFO:tasks.workunit.client.1.smithi148.stdout:9/574: write d8/da/dd/d35/d47/fa4 [624913,119006] 0 2024-09-18T12:49:18.261 INFO:tasks.workunit.client.1.smithi148.stdout:3/551: dread d4/d8/d1e/d6b/f81 [0,4194304] 0 2024-09-18T12:49:18.263 INFO:tasks.workunit.client.1.smithi148.stdout:6/612: dread d5/d1a/dc/d2b/f5f [0,4194304] 0 2024-09-18T12:49:18.263 INFO:tasks.workunit.client.1.smithi148.stdout:8/659: truncate d8/df/d3e/d82/fa9 3283849 0 2024-09-18T12:49:18.264 INFO:tasks.workunit.client.1.smithi148.stdout:2/518: dread d9/d17/d29/d92/d95/f38 [0,4194304] 0 2024-09-18T12:49:18.265 INFO:tasks.workunit.client.1.smithi148.stdout:9/575: symlink d8/d73/lad 0 2024-09-18T12:49:18.266 INFO:tasks.workunit.client.1.smithi148.stdout:1/574: dread dc/d11/d38/f6f [0,4194304] 0 2024-09-18T12:49:18.266 INFO:tasks.workunit.client.1.smithi148.stdout:4/576: mkdir d15/d17/d52/d68/da5/dc0 0 2024-09-18T12:49:18.267 INFO:tasks.workunit.client.1.smithi148.stdout:3/552: creat d4/d8/d20/d99/fc1 x:0 0 0 2024-09-18T12:49:18.268 INFO:tasks.workunit.client.1.smithi148.stdout:1/575: stat dc/d18/d63/f98 0 2024-09-18T12:49:18.268 INFO:tasks.workunit.client.1.smithi148.stdout:7/611: write db/dc/f28 [225309,57063] 0 2024-09-18T12:49:18.269 INFO:tasks.workunit.client.1.smithi148.stdout:0/750: creat de/d14/ffd x:0 0 0 2024-09-18T12:49:18.269 INFO:tasks.workunit.client.1.smithi148.stdout:3/553: readlink d4/d8/d1e/d79/l85 0 2024-09-18T12:49:18.270 INFO:tasks.workunit.client.1.smithi148.stdout:2/519: mknod d9/cbb 0 2024-09-18T12:49:18.271 INFO:tasks.workunit.client.1.smithi148.stdout:8/660: link d8/d16/d53/cc4 d8/d16/d53/d39/ce5 0 2024-09-18T12:49:18.272 INFO:tasks.workunit.client.1.smithi148.stdout:4/577: dread d15/d17/d52/d92/d4c/d72/f79 [0,4194304] 0 2024-09-18T12:49:18.272 INFO:tasks.workunit.client.1.smithi148.stdout:3/554: chown d4/f49 21473 1 2024-09-18T12:49:18.273 INFO:tasks.workunit.client.1.smithi148.stdout:6/613: rename d5/l9 to d5/d1a/dc/d2b/d35/d65/lbd 0 2024-09-18T12:49:18.274 INFO:tasks.workunit.client.1.smithi148.stdout:7/612: mknod db/dc/df/d2c/d66/cb5 0 2024-09-18T12:49:18.277 INFO:tasks.workunit.client.1.smithi148.stdout:0/751: link de/d14/fcf de/d27/d53/d89/dca/ffe 0 2024-09-18T12:49:18.277 INFO:tasks.workunit.client.1.smithi148.stdout:8/661: mknod d8/d16/ce6 0 2024-09-18T12:49:18.278 INFO:tasks.workunit.client.1.smithi148.stdout:3/555: mknod d4/d8/d1e/d63/d9b/cc2 0 2024-09-18T12:49:18.280 INFO:tasks.workunit.client.1.smithi148.stdout:2/520: getdents d9/d17/d29/d92/d95/d64 0 2024-09-18T12:49:18.280 INFO:tasks.workunit.client.1.smithi148.stdout:6/614: rmdir d5/d1a/dc/d2b/d35/d65/d99/da4 39 2024-09-18T12:49:18.281 INFO:tasks.workunit.client.1.smithi148.stdout:1/576: dwrite dc/d11/d38/d87/d2b/d80/f9d [0,4194304] 0 2024-09-18T12:49:18.281 INFO:tasks.workunit.client.1.smithi148.stdout:9/576: rename d8/da/dd/d35/d59/c60 to d8/da/dd/d4a/d49/d46/cae 0 2024-09-18T12:49:18.283 INFO:tasks.workunit.client.1.smithi148.stdout:5/619: sync 2024-09-18T12:49:18.284 INFO:tasks.workunit.client.1.smithi148.stdout:8/662: write d8/df/fc8 [543671,61494] 0 2024-09-18T12:49:18.284 INFO:tasks.workunit.client.1.smithi148.stdout:0/752: chown de/d27/d53/d89/dc0/db0/ce4 13 1 2024-09-18T12:49:18.284 INFO:tasks.workunit.client.1.smithi148.stdout:7/613: symlink db/dc/df/d8e/d78/lb6 0 2024-09-18T12:49:18.287 INFO:tasks.workunit.client.1.smithi148.stdout:2/521: mknod d9/d24/d67/cbc 0 2024-09-18T12:49:18.288 INFO:tasks.workunit.client.1.smithi148.stdout:9/577: rmdir d8/d33 39 2024-09-18T12:49:18.288 INFO:tasks.workunit.client.1.smithi148.stdout:7/614: readlink db/l22 0 2024-09-18T12:49:18.289 INFO:tasks.workunit.client.1.smithi148.stdout:4/578: dwrite d15/f28 [4194304,4194304] 0 2024-09-18T12:49:18.289 INFO:tasks.workunit.client.1.smithi148.stdout:1/577: dread - dc/d11/d96/fa1 zero size 2024-09-18T12:49:18.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/526: dwrite d2/d4/d12/d2d/f9c [0,4194304] 0 2024-09-18T12:49:18.292 INFO:tasks.workunit.client.1.smithi148.stdout:6/615: creat d5/d32/d56/fbe x:0 0 0 2024-09-18T12:49:18.293 INFO:tasks.workunit.client.1.smithi148.stdout:7/615: write db/dc/df/d11/f1b [890824,25034] 0 2024-09-18T12:49:18.293 INFO:tasks.workunit.client.1.smithi148.stdout:4/579: write d15/d5f/f71 [200651,78317] 0 2024-09-18T12:49:18.294 INFO:tasks.workunit.client.1.smithi148.stdout:9/578: write d8/da/dd/d3f/d5d/f83 [4826046,100398] 0 2024-09-18T12:49:18.295 INFO:tasks.workunit.client.1.smithi148.stdout:3/556: symlink d4/d8/d1e/d6b/d31/d46/lc3 0 2024-09-18T12:49:18.295 INFO:tasks.workunit.client.1.smithi148.stdout:6/616: chown d5/d1a/d29/f5d 54234 1 2024-09-18T12:49:18.296 INFO:tasks.workunit.client.1.smithi148.stdout:7/616: truncate db/dc/df/f29 4416806 0 2024-09-18T12:49:18.299 INFO:tasks.workunit.client.1.smithi148.stdout:3/557: truncate d4/d8/d1e/d6b/d31/d60/fc0 782607 0 2024-09-18T12:49:18.299 INFO:tasks.workunit.client.1.smithi148.stdout:2/522: rmdir d9/d24 39 2024-09-18T12:49:18.300 INFO:tasks.workunit.client.1.smithi148.stdout:2/523: write d9/d73/fb8 [1708343,55603] 0 2024-09-18T12:49:18.303 INFO:tasks.workunit.client.0.smithi078.stdout:5/527: mknod d2/d4/d48/d86/ca3 0 2024-09-18T12:49:18.306 INFO:tasks.workunit.client.1.smithi148.stdout:5/620: mkdir d7/d8/dc/d12/d1f/d39/dc2/dd2 0 2024-09-18T12:49:18.310 INFO:tasks.workunit.client.1.smithi148.stdout:1/578: symlink dc/d11/d38/d87/d2b/lbc 0 2024-09-18T12:49:18.311 INFO:tasks.workunit.client.1.smithi148.stdout:1/579: write dc/d18/d7d/fb3 [553691,104908] 0 2024-09-18T12:49:18.312 INFO:tasks.workunit.client.1.smithi148.stdout:4/580: creat d15/d3f/fc1 x:0 0 0 2024-09-18T12:49:18.312 INFO:tasks.workunit.client.1.smithi148.stdout:9/579: fdatasync d8/da/dd/d35/d81/f9e 0 2024-09-18T12:49:18.313 INFO:tasks.workunit.client.0.smithi078.stdout:7/277: sync 2024-09-18T12:49:18.313 INFO:tasks.workunit.client.0.smithi078.stdout:3/426: sync 2024-09-18T12:49:18.314 INFO:tasks.workunit.client.0.smithi078.stdout:5/528: creat d2/d4/d12/fa4 x:0 0 0 2024-09-18T12:49:18.314 INFO:tasks.workunit.client.0.smithi078.stdout:3/427: stat d9/d13/d33/d34/f48 0 2024-09-18T12:49:18.319 INFO:tasks.workunit.client.1.smithi148.stdout:2/524: dread - d9/d17/d29/f3e zero size 2024-09-18T12:49:18.320 INFO:tasks.workunit.client.0.smithi078.stdout:5/529: dread d2/d4/d12/d2d/f42 [0,4194304] 0 2024-09-18T12:49:18.321 INFO:tasks.workunit.client.0.smithi078.stdout:8/367: truncate d0/f1 5942200 0 2024-09-18T12:49:18.322 INFO:tasks.workunit.client.0.smithi078.stdout:8/368: chown d0/d7/f60 51681771 1 2024-09-18T12:49:18.322 INFO:tasks.workunit.client.0.smithi078.stdout:5/530: chown d2/d4/d12/d16/d36/d4c/d62/d4d/fa2 0 1 2024-09-18T12:49:18.326 INFO:tasks.workunit.client.1.smithi148.stdout:4/581: write d15/d17/f19 [5470524,46591] 0 2024-09-18T12:49:18.327 INFO:tasks.workunit.client.0.smithi078.stdout:5/531: truncate d2/d4/d9/da/f7a 1203096 0 2024-09-18T12:49:18.328 INFO:tasks.workunit.client.0.smithi078.stdout:5/532: write d2/d4/d9/f13 [2177172,58551] 0 2024-09-18T12:49:18.331 INFO:tasks.workunit.client.0.smithi078.stdout:3/428: creat d9/d29/f7d x:0 0 0 2024-09-18T12:49:18.331 INFO:tasks.workunit.client.1.smithi148.stdout:6/617: mkdir d5/d1a/dc/dbf 0 2024-09-18T12:49:18.333 INFO:tasks.workunit.client.0.smithi078.stdout:8/369: link d0/d7/d53/f5e d0/d7/dc/d1f/d23/d40/f6c 0 2024-09-18T12:49:18.334 INFO:tasks.workunit.client.1.smithi148.stdout:5/621: dread d7/d2b/f81 [0,4194304] 0 2024-09-18T12:49:18.335 INFO:tasks.workunit.client.0.smithi078.stdout:7/278: dwrite d7/d26/f30 [0,4194304] 0 2024-09-18T12:49:18.335 INFO:tasks.workunit.client.1.smithi148.stdout:5/622: write d7/d8/f87 [940569,55223] 0 2024-09-18T12:49:18.335 INFO:tasks.workunit.client.0.smithi078.stdout:5/533: creat d2/d4/d9/d2f/d30/fa5 x:0 0 0 2024-09-18T12:49:18.337 INFO:tasks.workunit.client.0.smithi078.stdout:5/534: chown d2/d4/d9/d49/f56 1353493 1 2024-09-18T12:49:18.340 INFO:tasks.workunit.client.0.smithi078.stdout:8/370: mkdir d0/d7/dc/d5d/d2e/d6d 0 2024-09-18T12:49:18.344 INFO:tasks.workunit.client.1.smithi148.stdout:3/558: creat d4/d8/d20/d2b/fc4 x:0 0 0 2024-09-18T12:49:18.346 INFO:tasks.workunit.client.1.smithi148.stdout:3/559: chown d4/d8/d1e/d79/d92/c8c 8168741 1 2024-09-18T12:49:18.346 INFO:tasks.workunit.client.0.smithi078.stdout:8/371: mknod d0/d7/d1e/d50/c6e 0 2024-09-18T12:49:18.346 INFO:tasks.workunit.client.1.smithi148.stdout:3/560: read - d4/d8/d20/d2b/d7f/f8e zero size 2024-09-18T12:49:18.348 INFO:tasks.workunit.client.0.smithi078.stdout:8/372: write d0/d7/dc/f26 [1785789,126402] 0 2024-09-18T12:49:18.350 INFO:tasks.workunit.client.1.smithi148.stdout:0/753: rename de/d27/dd1 to de/d27/d53/dff 0 2024-09-18T12:49:18.351 INFO:tasks.workunit.client.0.smithi078.stdout:3/429: mknod d9/df/c7e 0 2024-09-18T12:49:18.352 INFO:tasks.workunit.client.1.smithi148.stdout:5/623: symlink d7/d8/dc/ld3 0 2024-09-18T12:49:18.354 INFO:tasks.workunit.client.1.smithi148.stdout:8/663: link d8/df/d3e/c50 d8/df/ce7 0 2024-09-18T12:49:18.357 INFO:tasks.workunit.client.1.smithi148.stdout:4/582: creat d15/d17/d52/d68/da5/dc0/fc2 x:0 0 0 2024-09-18T12:49:18.357 INFO:tasks.workunit.client.0.smithi078.stdout:5/535: dread d2/d4/d9/f13 [0,4194304] 0 2024-09-18T12:49:18.359 INFO:tasks.workunit.client.1.smithi148.stdout:1/580: truncate dc/d18/d31/f5d 2687339 0 2024-09-18T12:49:18.360 INFO:tasks.workunit.client.1.smithi148.stdout:1/581: write dc/d18/d63/f8b [489090,90701] 0 2024-09-18T12:49:18.361 INFO:tasks.workunit.client.0.smithi078.stdout:7/279: rmdir d7/d9/d32/d3b/d4e 0 2024-09-18T12:49:18.362 INFO:tasks.workunit.client.1.smithi148.stdout:7/617: getdents db/dc/df/d1d/d68 0 2024-09-18T12:49:18.363 INFO:tasks.workunit.client.1.smithi148.stdout:4/583: dwrite d15/d5f/d69/f95 [0,4194304] 0 2024-09-18T12:49:18.363 INFO:tasks.workunit.client.1.smithi148.stdout:7/618: read - db/dc/df/d8e/d75/fa6 zero size 2024-09-18T12:49:18.364 INFO:tasks.workunit.client.1.smithi148.stdout:4/584: write d15/d5f/d69/f95 [1685168,111697] 0 2024-09-18T12:49:18.365 INFO:tasks.workunit.client.1.smithi148.stdout:9/580: rename d8/da/dd/d4a/d27/l2b to d8/da/laf 0 2024-09-18T12:49:18.366 INFO:tasks.workunit.client.1.smithi148.stdout:5/624: mkdir d7/d8/dc/d12/d1f/d77/dd4 0 2024-09-18T12:49:18.367 INFO:tasks.workunit.client.1.smithi148.stdout:4/585: write d15/d5f/d69/f8c [2794710,98176] 0 2024-09-18T12:49:18.367 INFO:tasks.workunit.client.1.smithi148.stdout:4/586: fsync d15/d3f/fc1 0 2024-09-18T12:49:18.368 INFO:tasks.workunit.client.1.smithi148.stdout:6/618: creat d5/d32/fc0 x:0 0 0 2024-09-18T12:49:18.369 INFO:tasks.workunit.client.1.smithi148.stdout:6/619: dread - d5/d32/fc0 zero size 2024-09-18T12:49:18.370 INFO:tasks.workunit.client.1.smithi148.stdout:1/582: symlink dc/d11/d38/d87/d2b/d80/lbd 0 2024-09-18T12:49:18.372 INFO:tasks.workunit.client.0.smithi078.stdout:7/280: dwrite d7/d9/d14/f25 [4194304,4194304] 0 2024-09-18T12:49:18.375 INFO:tasks.workunit.client.0.smithi078.stdout:5/536: symlink d2/d4/d9/da/d2b/la6 0 2024-09-18T12:49:18.376 INFO:tasks.workunit.client.1.smithi148.stdout:3/561: rename d4/d8/d1e/d6b/d31/d60/da9/d8b/ca0 to d4/d8/d1e/cc5 0 2024-09-18T12:49:18.379 INFO:tasks.workunit.client.1.smithi148.stdout:9/581: creat d8/da/dd/d3f/fb0 x:0 0 0 2024-09-18T12:49:18.380 INFO:tasks.workunit.client.0.smithi078.stdout:7/281: symlink d7/d9/d14/d22/d3e/l5a 0 2024-09-18T12:49:18.382 INFO:tasks.workunit.client.1.smithi148.stdout:5/625: mkdir d7/d8/dc/d12/d1f/d39/dd5 0 2024-09-18T12:49:18.383 INFO:tasks.workunit.client.0.smithi078.stdout:8/373: getdents d0/d7/d1e 0 2024-09-18T12:49:18.386 INFO:tasks.workunit.client.1.smithi148.stdout:6/620: mknod d5/d79/cc1 0 2024-09-18T12:49:18.387 INFO:tasks.workunit.client.1.smithi148.stdout:6/621: chown d5/l26 1 1 2024-09-18T12:49:18.388 INFO:tasks.workunit.client.0.smithi078.stdout:7/282: creat d7/d9/d14/d22/d3e/f5b x:0 0 0 2024-09-18T12:49:18.393 INFO:tasks.workunit.client.1.smithi148.stdout:8/664: rename d8/d16/l25 to d8/df/d3e/d82/d8f/d95/le8 0 2024-09-18T12:49:18.394 INFO:tasks.workunit.client.1.smithi148.stdout:8/665: readlink d8/d16/l61 0 2024-09-18T12:49:18.395 INFO:tasks.workunit.client.0.smithi078.stdout:7/283: creat d7/d3c/d47/f5c x:0 0 0 2024-09-18T12:49:18.395 INFO:tasks.workunit.client.0.smithi078.stdout:7/284: chown d7/d26/d4f 1283113025 1 2024-09-18T12:49:18.395 INFO:tasks.workunit.client.0.smithi078.stdout:4/393: sync 2024-09-18T12:49:18.397 INFO:tasks.workunit.client.0.smithi078.stdout:8/374: mkdir d0/d7/dc/d1f/d6f 0 2024-09-18T12:49:18.397 INFO:tasks.workunit.client.0.smithi078.stdout:8/375: fsync d0/d7/dc/d5d/d2e/f3a 0 2024-09-18T12:49:18.399 INFO:tasks.workunit.client.0.smithi078.stdout:3/430: write d9/d13/d33/d3c/d19/f22 [326476,17887] 0 2024-09-18T12:49:18.399 INFO:tasks.workunit.client.1.smithi148.stdout:5/626: mkdir d7/d8/dc/d12/d1f/d25/d4b/dd6 0 2024-09-18T12:49:18.400 INFO:tasks.workunit.client.1.smithi148.stdout:8/666: dwrite d8/df/db2/fc9 [0,4194304] 0 2024-09-18T12:49:18.400 INFO:tasks.workunit.client.1.smithi148.stdout:3/562: dread d4/d8/d1e/d6b/d31/f65 [0,4194304] 0 2024-09-18T12:49:18.401 INFO:tasks.workunit.client.0.smithi078.stdout:4/394: creat d11/d1f/d4b/f82 x:0 0 0 2024-09-18T12:49:18.404 INFO:tasks.workunit.client.0.smithi078.stdout:7/285: mkdir d7/d5d 0 2024-09-18T12:49:18.405 INFO:tasks.workunit.client.0.smithi078.stdout:7/286: chown d7/d9/d32/d3b/c59 27 1 2024-09-18T12:49:18.406 INFO:tasks.workunit.client.0.smithi078.stdout:8/376: fdatasync d0/d7/fb 0 2024-09-18T12:49:18.406 INFO:tasks.workunit.client.1.smithi148.stdout:1/583: creat dc/d5b/da5/fbe x:0 0 0 2024-09-18T12:49:18.406 INFO:tasks.workunit.client.1.smithi148.stdout:9/582: dwrite d8/d33/f42 [0,4194304] 0 2024-09-18T12:49:18.408 INFO:tasks.workunit.client.1.smithi148.stdout:9/583: chown d8/da/dd/d4a/l48 475 1 2024-09-18T12:49:18.409 INFO:tasks.workunit.client.0.smithi078.stdout:5/537: write d2/d4/d9/f1c [1130326,88361] 0 2024-09-18T12:49:18.411 INFO:tasks.workunit.client.0.smithi078.stdout:4/395: rename ca to d11/d27/d47/d4e/d76/c83 0 2024-09-18T12:49:18.414 INFO:tasks.workunit.client.0.smithi078.stdout:3/431: rmdir d9/d13/d63 39 2024-09-18T12:49:18.417 INFO:tasks.workunit.client.0.smithi078.stdout:5/538: symlink d2/d4/d55/d8f/la7 0 2024-09-18T12:49:18.419 INFO:tasks.workunit.client.1.smithi148.stdout:6/622: dread d5/d1a/d29/f83 [0,4194304] 0 2024-09-18T12:49:18.422 INFO:tasks.workunit.client.0.smithi078.stdout:8/377: rename d0/f1c to d0/d7/dc/d1f/d6f/f70 0 2024-09-18T12:49:18.424 INFO:tasks.workunit.client.0.smithi078.stdout:7/287: mkdir d7/d5d/d5e 0 2024-09-18T12:49:18.425 INFO:tasks.workunit.client.0.smithi078.stdout:7/288: chown l1 69554 1 2024-09-18T12:49:18.425 INFO:tasks.workunit.client.1.smithi148.stdout:6/623: dwrite d5/d1a/d29/d5c/f77 [4194304,4194304] 0 2024-09-18T12:49:18.427 INFO:tasks.workunit.client.0.smithi078.stdout:3/432: chown d9/d29/d4b 2184 1 2024-09-18T12:49:18.428 INFO:tasks.workunit.client.1.smithi148.stdout:7/619: getdents db/dc/df/d11/d34 0 2024-09-18T12:49:18.431 INFO:tasks.workunit.client.1.smithi148.stdout:9/584: mknod d8/da/dd/d4a/d27/cb1 0 2024-09-18T12:49:18.435 INFO:tasks.workunit.client.1.smithi148.stdout:2/525: sync 2024-09-18T12:49:18.437 INFO:tasks.workunit.client.0.smithi078.stdout:4/396: rename d11/d1f to d11/d27/d5a/d84 0 2024-09-18T12:49:18.438 INFO:tasks.workunit.client.1.smithi148.stdout:5/627: mknod d7/d8/dc/d12/d31/cd7 0 2024-09-18T12:49:18.439 INFO:tasks.workunit.client.1.smithi148.stdout:5/628: rename d7/d8 to d7/d8/dc/d12/d1f/d39/dd5/dd8 22 2024-09-18T12:49:18.439 INFO:tasks.workunit.client.1.smithi148.stdout:5/629: fdatasync d7/d8/dc/d12/d31/d5a/fb3 0 2024-09-18T12:49:18.440 INFO:tasks.workunit.client.1.smithi148.stdout:4/587: getdents d15/d90 0 2024-09-18T12:49:18.441 INFO:tasks.workunit.client.1.smithi148.stdout:1/584: write dc/d11/f6e [889871,120325] 0 2024-09-18T12:49:18.441 INFO:tasks.workunit.client.0.smithi078.stdout:4/397: dread d11/d27/d47/f3d [0,4194304] 0 2024-09-18T12:49:18.445 INFO:tasks.workunit.client.0.smithi078.stdout:7/289: rename d7/d9/f10 to d7/d5d/d5e/f5f 0 2024-09-18T12:49:18.448 INFO:tasks.workunit.client.1.smithi148.stdout:7/620: chown db/dc/c9f 15 1 2024-09-18T12:49:18.448 INFO:tasks.workunit.client.0.smithi078.stdout:5/539: dwrite d2/d4/d12/d16/f27 [0,4194304] 0 2024-09-18T12:49:18.448 INFO:tasks.workunit.client.0.smithi078.stdout:4/398: dread d11/d27/d60/f68 [0,4194304] 0 2024-09-18T12:49:18.449 INFO:tasks.workunit.client.0.smithi078.stdout:8/378: mkdir d0/d7/dc/d71 0 2024-09-18T12:49:18.451 INFO:tasks.workunit.client.1.smithi148.stdout:8/667: dwrite d8/f68 [0,4194304] 0 2024-09-18T12:49:18.452 INFO:tasks.workunit.client.0.smithi078.stdout:3/433: rmdir d9/d13/d63/d78 39 2024-09-18T12:49:18.455 INFO:tasks.workunit.client.0.smithi078.stdout:7/290: rmdir d7/d9/d14 39 2024-09-18T12:49:18.455 INFO:tasks.workunit.client.1.smithi148.stdout:5/630: truncate d7/d8/dc/d12/d1f/d39/f5e 381110 0 2024-09-18T12:49:18.457 INFO:tasks.workunit.client.1.smithi148.stdout:4/588: mknod d15/d17/d52/d68/da5/dc0/cc3 0 2024-09-18T12:49:18.458 INFO:tasks.workunit.client.1.smithi148.stdout:1/585: creat dc/d4d/dad/fbf x:0 0 0 2024-09-18T12:49:18.460 INFO:tasks.workunit.client.1.smithi148.stdout:7/621: rename db/dc/df/d8e/d78 to db/dc/df/d1d/d41/db7 0 2024-09-18T12:49:18.461 INFO:tasks.workunit.client.0.smithi078.stdout:0/466: sync 2024-09-18T12:49:18.461 INFO:tasks.workunit.client.0.smithi078.stdout:2/377: sync 2024-09-18T12:49:18.461 INFO:tasks.workunit.client.0.smithi078.stdout:9/388: sync 2024-09-18T12:49:18.461 INFO:tasks.workunit.client.0.smithi078.stdout:6/569: sync 2024-09-18T12:49:18.461 INFO:tasks.workunit.client.0.smithi078.stdout:1/392: sync 2024-09-18T12:49:18.463 INFO:tasks.workunit.client.1.smithi148.stdout:1/586: chown dc/d18/d7d/d7e/fb9 32898 1 2024-09-18T12:49:18.463 INFO:tasks.workunit.client.1.smithi148.stdout:7/622: dread - db/dc/df/d11/d34/f8d zero size 2024-09-18T12:49:18.463 INFO:tasks.workunit.client.0.smithi078.stdout:2/378: write d4/d8/f76 [322052,20978] 0 2024-09-18T12:49:18.464 INFO:tasks.workunit.client.1.smithi148.stdout:8/668: dwrite d8/df/fc8 [0,4194304] 0 2024-09-18T12:49:18.466 INFO:tasks.workunit.client.0.smithi078.stdout:6/570: chown d10/d2b/d43/f64 1864796074 1 2024-09-18T12:49:18.471 INFO:tasks.workunit.client.1.smithi148.stdout:7/623: dwrite db/dc/df/d11/d34/f8d [0,4194304] 0 2024-09-18T12:49:18.474 INFO:tasks.workunit.client.0.smithi078.stdout:4/399: unlink d11/l21 0 2024-09-18T12:49:18.477 INFO:tasks.workunit.client.1.smithi148.stdout:6/624: truncate d5/f19 7018693 0 2024-09-18T12:49:18.479 INFO:tasks.workunit.client.0.smithi078.stdout:7/291: dwrite d7/f1d [0,4194304] 0 2024-09-18T12:49:18.479 INFO:tasks.workunit.client.0.smithi078.stdout:5/540: creat d2/d4/d9/da/d60/d7f/fa8 x:0 0 0 2024-09-18T12:49:18.481 INFO:tasks.workunit.client.0.smithi078.stdout:5/541: chown d2/d4/d12/d16/f24 30 1 2024-09-18T12:49:18.481 INFO:tasks.workunit.client.0.smithi078.stdout:8/379: mknod d0/c72 0 2024-09-18T12:49:18.481 INFO:tasks.workunit.client.1.smithi148.stdout:4/589: write d15/d17/d52/d92/d4c/d4f/f29 [856888,70577] 0 2024-09-18T12:49:18.482 INFO:tasks.workunit.client.0.smithi078.stdout:9/389: rmdir d5/d7 39 2024-09-18T12:49:18.482 INFO:tasks.workunit.client.1.smithi148.stdout:9/585: dread d8/da/dd/d35/d47/d62/d72/f74 [0,4194304] 0 2024-09-18T12:49:18.483 INFO:tasks.workunit.client.1.smithi148.stdout:4/590: truncate d15/d3f/fc1 944396 0 2024-09-18T12:49:18.484 INFO:tasks.workunit.client.0.smithi078.stdout:5/542: chown d2/d4/d9/d2f/d30/f5f 6652 1 2024-09-18T12:49:18.484 INFO:tasks.workunit.client.0.smithi078.stdout:2/379: symlink d4/dd/d18/d3b/l77 0 2024-09-18T12:49:18.485 INFO:tasks.workunit.client.1.smithi148.stdout:0/754: sync 2024-09-18T12:49:18.485 INFO:tasks.workunit.client.1.smithi148.stdout:3/563: sync 2024-09-18T12:49:18.487 INFO:tasks.workunit.client.1.smithi148.stdout:0/755: chown de/d27/d7a/f92 13 1 2024-09-18T12:49:18.487 INFO:tasks.workunit.client.0.smithi078.stdout:5/543: write d2/d4/d12/d16/d36/d4c/f65 [4896281,51458] 0 2024-09-18T12:49:18.487 INFO:tasks.workunit.client.1.smithi148.stdout:7/624: symlink db/d52/d4f/lb8 0 2024-09-18T12:49:18.488 INFO:tasks.workunit.client.1.smithi148.stdout:0/756: read - de/d27/d53/d89/dbb/fe6 zero size 2024-09-18T12:49:18.493 INFO:tasks.workunit.client.0.smithi078.stdout:6/571: symlink d10/d2b/d61/lb9 0 2024-09-18T12:49:18.494 INFO:tasks.workunit.client.0.smithi078.stdout:6/572: write d10/d2b/d43/d53/d63/d70/dac/f5f [3841785,81993] 0 2024-09-18T12:49:18.495 INFO:tasks.workunit.client.0.smithi078.stdout:4/400: symlink d11/d45/l85 0 2024-09-18T12:49:18.495 INFO:tasks.workunit.client.1.smithi148.stdout:8/669: dread d8/d12/d46/f58 [0,4194304] 0 2024-09-18T12:49:18.496 INFO:tasks.workunit.client.1.smithi148.stdout:6/625: rename d5/d32/l48 to d5/d32/d56/lc2 0 2024-09-18T12:49:18.496 INFO:tasks.workunit.client.1.smithi148.stdout:1/587: creat dc/d4d/dad/db1/fc0 x:0 0 0 2024-09-18T12:49:18.499 INFO:tasks.workunit.client.0.smithi078.stdout:1/393: dwrite d0/d8/da/d3e/d58/d6e/d52/f6f [0,4194304] 0 2024-09-18T12:49:18.499 INFO:tasks.workunit.client.1.smithi148.stdout:2/526: link d9/l13 d9/d24/d67/d72/lbd 0 2024-09-18T12:49:18.500 INFO:tasks.workunit.client.0.smithi078.stdout:8/380: rmdir d0/d7/d1e 39 2024-09-18T12:49:18.501 INFO:tasks.workunit.client.1.smithi148.stdout:7/625: creat db/dc/df/d2c/fb9 x:0 0 0 2024-09-18T12:49:18.501 INFO:tasks.workunit.client.1.smithi148.stdout:0/757: rmdir de/d27/d7a 39 2024-09-18T12:49:18.502 INFO:tasks.workunit.client.0.smithi078.stdout:1/394: chown d0/d8/f3f 2370738 1 2024-09-18T12:49:18.502 INFO:tasks.workunit.client.0.smithi078.stdout:1/395: chown d0/c15 10483 1 2024-09-18T12:49:18.506 INFO:tasks.workunit.client.1.smithi148.stdout:4/591: link d15/d17/d52/d92/f46 d15/d17/d52/d92/d4c/d4f/d64/da0/fc4 0 2024-09-18T12:49:18.508 INFO:tasks.workunit.client.0.smithi078.stdout:5/544: creat d2/d4/d9/da/d2b/d3e/fa9 x:0 0 0 2024-09-18T12:49:18.508 INFO:tasks.workunit.client.1.smithi148.stdout:5/631: write d7/d8/dc/d12/d31/f7b [463170,40957] 0 2024-09-18T12:49:18.508 INFO:tasks.workunit.client.0.smithi078.stdout:5/545: fdatasync d2/d4/d9/d49/f56 0 2024-09-18T12:49:18.509 INFO:tasks.workunit.client.1.smithi148.stdout:5/632: read - d7/d8/dc/d22/fc7 zero size 2024-09-18T12:49:18.509 INFO:tasks.workunit.client.1.smithi148.stdout:9/586: rename d8/da/dd/d3f/f84 to d8/da/dd/d4a/d49/d46/d54/d90/fb2 0 2024-09-18T12:49:18.512 INFO:tasks.workunit.client.1.smithi148.stdout:3/564: dread d4/d8/d1e/d79/d92/f5f [0,4194304] 0 2024-09-18T12:49:18.514 INFO:tasks.workunit.client.0.smithi078.stdout:3/434: write d9/d2f/f3d [393398,72555] 0 2024-09-18T12:49:18.516 INFO:tasks.workunit.client.1.smithi148.stdout:9/587: dwrite d8/da/dd/d35/d81/f8e [0,4194304] 0 2024-09-18T12:49:18.516 INFO:tasks.workunit.client.0.smithi078.stdout:0/467: truncate d3/d1f/d2e/d4e/f49 1802913 0 2024-09-18T12:49:18.517 INFO:tasks.workunit.client.0.smithi078.stdout:5/546: dwrite d2/d4/d12/f8e [0,4194304] 0 2024-09-18T12:49:18.518 INFO:tasks.workunit.client.0.smithi078.stdout:5/547: stat d2/d4/d9/d2f/d30/fa5 0 2024-09-18T12:49:18.519 INFO:tasks.workunit.client.0.smithi078.stdout:5/548: fdatasync d2/d4/d9/da/d2b/f63 0 2024-09-18T12:49:18.520 INFO:tasks.workunit.client.1.smithi148.stdout:2/527: symlink d9/d24/d67/d72/d77/lbe 0 2024-09-18T12:49:18.524 INFO:tasks.workunit.client.1.smithi148.stdout:0/758: creat de/d27/d53/d89/dc1/f100 x:0 0 0 2024-09-18T12:49:18.525 INFO:tasks.workunit.client.0.smithi078.stdout:6/573: mknod d10/d2b/d43/d53/d45/d9c/cba 0 2024-09-18T12:49:18.526 INFO:tasks.workunit.client.1.smithi148.stdout:9/588: dwrite d8/da/dd/d4a/f98 [0,4194304] 0 2024-09-18T12:49:18.528 INFO:tasks.workunit.client.1.smithi148.stdout:8/670: mkdir d8/df/d3e/d82/de9 0 2024-09-18T12:49:18.530 INFO:tasks.workunit.client.1.smithi148.stdout:4/592: write d15/d17/d52/d92/d4c/d4f/f22 [950756,64259] 0 2024-09-18T12:49:18.532 INFO:tasks.workunit.client.1.smithi148.stdout:9/589: dread d8/da/f1d [4194304,4194304] 0 2024-09-18T12:49:18.533 INFO:tasks.workunit.client.0.smithi078.stdout:2/380: dwrite d4/d1a/f43 [0,4194304] 0 2024-09-18T12:49:18.541 INFO:tasks.workunit.client.1.smithi148.stdout:6/626: rename d5/d1a/d29/d5c/f66 to d5/d1a/dc/dbf/fc3 0 2024-09-18T12:49:18.542 INFO:tasks.workunit.client.0.smithi078.stdout:1/396: dread d0/d8/da/d3e/d58/d6e/f4d [0,4194304] 0 2024-09-18T12:49:18.544 INFO:tasks.workunit.client.1.smithi148.stdout:1/588: mknod dc/d18/d31/d4b/db7/cc1 0 2024-09-18T12:49:18.545 INFO:tasks.workunit.client.1.smithi148.stdout:1/589: chown dc/d11/d38/d87/l74 8 1 2024-09-18T12:49:18.545 INFO:tasks.workunit.client.0.smithi078.stdout:0/468: stat d3/d1f/c2a 0 2024-09-18T12:49:18.546 INFO:tasks.workunit.client.1.smithi148.stdout:0/759: symlink de/d27/d53/d89/l101 0 2024-09-18T12:49:18.547 INFO:tasks.workunit.client.0.smithi078.stdout:3/435: rename d9/d13/d33/d76 to d9/d54/d7f 0 2024-09-18T12:49:18.549 INFO:tasks.workunit.client.1.smithi148.stdout:4/593: mknod d15/d5f/cc5 0 2024-09-18T12:49:18.549 INFO:tasks.workunit.client.1.smithi148.stdout:4/594: readlink l11 0 2024-09-18T12:49:18.550 INFO:tasks.workunit.client.0.smithi078.stdout:5/549: unlink d2/d4/f78 0 2024-09-18T12:49:18.551 INFO:tasks.workunit.client.1.smithi148.stdout:4/595: truncate d15/d17/d52/d92/d4c/d72/f93 1009959 0 2024-09-18T12:49:18.551 INFO:tasks.workunit.client.0.smithi078.stdout:9/390: dread d5/d7/d8/fb [0,4194304] 0 2024-09-18T12:49:18.551 INFO:tasks.workunit.client.1.smithi148.stdout:9/590: symlink d8/da/dd/d35/d47/d4e/lb3 0 2024-09-18T12:49:18.552 INFO:tasks.workunit.client.0.smithi078.stdout:6/574: creat d10/d2b/d61/fbb x:0 0 0 2024-09-18T12:49:18.554 INFO:tasks.workunit.client.0.smithi078.stdout:6/575: chown d10/d2b/d37 0 1 2024-09-18T12:49:18.556 INFO:tasks.workunit.client.1.smithi148.stdout:7/626: rename db/dc/df/f8f to db/dc/df/d2c/d55/daf/d38/fba 0 2024-09-18T12:49:18.557 INFO:tasks.workunit.client.1.smithi148.stdout:7/627: read db/dc/df/d1d/f5c [7231635,40664] 0 2024-09-18T12:49:18.557 INFO:tasks.workunit.client.0.smithi078.stdout:2/381: creat d4/d8/f78 x:0 0 0 2024-09-18T12:49:18.558 INFO:tasks.workunit.client.1.smithi148.stdout:6/627: rmdir d5/d32/d38/d50 39 2024-09-18T12:49:18.558 INFO:tasks.workunit.client.0.smithi078.stdout:6/576: dread - d10/d2b/d43/d53/d63/d70/d7d/fb5 zero size 2024-09-18T12:49:18.558 INFO:tasks.workunit.client.0.smithi078.stdout:5/550: dwrite d2/d4/d12/d16/d36/d4c/d62/f84 [0,4194304] 0 2024-09-18T12:49:18.561 INFO:tasks.workunit.client.1.smithi148.stdout:1/590: mknod dc/d18/d7d/cc2 0 2024-09-18T12:49:18.562 INFO:tasks.workunit.client.0.smithi078.stdout:5/551: chown d2/d4/d9/d2f/d30/f85 0 1 2024-09-18T12:49:18.563 INFO:tasks.workunit.client.0.smithi078.stdout:0/469: mkdir d3/d1f/d2e/d4e/db2 0 2024-09-18T12:49:18.563 INFO:tasks.workunit.client.0.smithi078.stdout:5/552: chown d2/d4/d12/d16/d36/d4c/d62 2742951 1 2024-09-18T12:49:18.566 INFO:tasks.workunit.client.0.smithi078.stdout:5/553: write d2/d4/d9/f2a [2226343,6040] 0 2024-09-18T12:49:18.566 INFO:tasks.workunit.client.1.smithi148.stdout:8/671: creat d8/d12/d51/dc7/fea x:0 0 0 2024-09-18T12:49:18.568 INFO:tasks.workunit.client.0.smithi078.stdout:8/381: rename d0/d7/dc/d5d/f3b to d0/d7/d1e/d4b/f73 0 2024-09-18T12:49:18.569 INFO:tasks.workunit.client.0.smithi078.stdout:8/382: write d0/d7/fb [158525,102476] 0 2024-09-18T12:49:18.572 INFO:tasks.workunit.client.1.smithi148.stdout:9/591: fsync d8/da/dd/d4a/d49/d46/d54/d90/fb2 0 2024-09-18T12:49:18.575 INFO:tasks.workunit.client.1.smithi148.stdout:2/528: dread d9/f26 [0,4194304] 0 2024-09-18T12:49:18.576 INFO:tasks.workunit.client.1.smithi148.stdout:2/529: chown d9/d24/d31/c93 24598345 1 2024-09-18T12:49:18.577 INFO:tasks.workunit.client.1.smithi148.stdout:2/530: fdatasync d9/d17/d29/d92/d95/d9b/fa9 0 2024-09-18T12:49:18.580 INFO:tasks.workunit.client.0.smithi078.stdout:4/401: creat d11/d27/d5a/d5d/f86 x:0 0 0 2024-09-18T12:49:18.582 INFO:tasks.workunit.client.1.smithi148.stdout:6/628: unlink d5/d1a/d3d/c39 0 2024-09-18T12:49:18.582 INFO:tasks.workunit.client.1.smithi148.stdout:7/628: dread db/dc/df/d1d/f5c [0,4194304] 0 2024-09-18T12:49:18.583 INFO:tasks.workunit.client.1.smithi148.stdout:6/629: dread - d5/d1a/dc/d2b/d9b/fab zero size 2024-09-18T12:49:18.585 INFO:tasks.workunit.client.1.smithi148.stdout:0/760: unlink de/d14/f66 0 2024-09-18T12:49:18.586 INFO:tasks.workunit.client.1.smithi148.stdout:1/591: creat dc/d11/d38/d7b/fc3 x:0 0 0 2024-09-18T12:49:18.589 INFO:tasks.workunit.client.1.smithi148.stdout:8/672: unlink d8/df/c28 0 2024-09-18T12:49:18.592 INFO:tasks.workunit.client.1.smithi148.stdout:5/633: truncate d7/d8/f3e 2799551 0 2024-09-18T12:49:18.593 INFO:tasks.workunit.client.1.smithi148.stdout:5/634: fdatasync d7/d8/dc/d12/d31/d5a/fc9 0 2024-09-18T12:49:18.596 INFO:tasks.workunit.client.0.smithi078.stdout:3/436: symlink d9/d13/d63/d78/l80 0 2024-09-18T12:49:18.598 INFO:tasks.workunit.client.1.smithi148.stdout:7/629: mknod db/dc/d91/cbb 0 2024-09-18T12:49:18.598 INFO:tasks.workunit.client.0.smithi078.stdout:4/402: chown d11/l15 15486743 1 2024-09-18T12:49:18.601 INFO:tasks.workunit.client.1.smithi148.stdout:1/592: mknod dc/d51/cc4 0 2024-09-18T12:49:18.603 INFO:tasks.workunit.client.0.smithi078.stdout:2/382: write d4/db/dc/f1b [188699,45996] 0 2024-09-18T12:49:18.605 INFO:tasks.workunit.client.0.smithi078.stdout:2/383: read d4/dd/f5c [4889326,92737] 0 2024-09-18T12:49:18.608 INFO:tasks.workunit.client.1.smithi148.stdout:1/593: dwrite dc/d18/d7d/d7e/fb9 [0,4194304] 0 2024-09-18T12:49:18.608 INFO:tasks.workunit.client.1.smithi148.stdout:4/596: creat d15/fc6 x:0 0 0 2024-09-18T12:49:18.612 INFO:tasks.workunit.client.0.smithi078.stdout:5/554: mknod d2/d4/d12/caa 0 2024-09-18T12:49:18.614 INFO:tasks.workunit.client.0.smithi078.stdout:8/383: symlink d0/d7/dc/d1f/d23/l74 0 2024-09-18T12:49:18.616 INFO:tasks.workunit.client.1.smithi148.stdout:0/761: mkdir de/d27/d53/d102 0 2024-09-18T12:49:18.616 INFO:tasks.workunit.client.1.smithi148.stdout:6/630: write d5/d1a/f7f [1412931,82645] 0 2024-09-18T12:49:18.619 INFO:tasks.workunit.client.1.smithi148.stdout:0/762: truncate de/d27/d53/d89/fce 339531 0 2024-09-18T12:49:18.619 INFO:tasks.workunit.client.0.smithi078.stdout:3/437: dread d9/d13/d33/d34/f4f [0,4194304] 0 2024-09-18T12:49:18.622 INFO:tasks.workunit.client.1.smithi148.stdout:1/594: unlink dc/d18/d31/l77 0 2024-09-18T12:49:18.622 INFO:tasks.workunit.client.1.smithi148.stdout:8/673: dwrite d8/d16/d53/d39/f67 [0,4194304] 0 2024-09-18T12:49:18.626 INFO:tasks.workunit.client.1.smithi148.stdout:3/565: rename d4/c1c to d4/d8/d20/d2b/cc6 0 2024-09-18T12:49:18.627 INFO:tasks.workunit.client.1.smithi148.stdout:3/566: fsync d4/d8/d1e/d6b/d31/d60/faa 0 2024-09-18T12:49:18.627 INFO:tasks.workunit.client.0.smithi078.stdout:1/397: getdents d0/d8 0 2024-09-18T12:49:18.628 INFO:tasks.workunit.client.0.smithi078.stdout:1/398: read d0/d37/f48 [664601,30229] 0 2024-09-18T12:49:18.629 INFO:tasks.workunit.client.1.smithi148.stdout:4/597: symlink d15/d17/d52/d68/da5/lc7 0 2024-09-18T12:49:18.630 INFO:tasks.workunit.client.1.smithi148.stdout:4/598: write d15/d5f/d69/f8c [3483856,66164] 0 2024-09-18T12:49:18.630 INFO:tasks.workunit.client.1.smithi148.stdout:4/599: chown d15/fc6 47 1 2024-09-18T12:49:18.631 INFO:tasks.workunit.client.0.smithi078.stdout:6/577: creat d10/d2b/fbc x:0 0 0 2024-09-18T12:49:18.631 INFO:tasks.workunit.client.0.smithi078.stdout:6/578: write d10/f97 [625225,104695] 0 2024-09-18T12:49:18.635 INFO:tasks.workunit.client.1.smithi148.stdout:6/631: creat d5/d1a/d29/fc4 x:0 0 0 2024-09-18T12:49:18.637 INFO:tasks.workunit.client.0.smithi078.stdout:5/555: mknod d2/d4/d12/d16/d36/d4c/d62/d4d/cab 0 2024-09-18T12:49:18.638 INFO:tasks.workunit.client.1.smithi148.stdout:0/763: write de/d27/d53/d89/dbb/f71 [4854249,22789] 0 2024-09-18T12:49:18.638 INFO:tasks.workunit.client.0.smithi078.stdout:8/384: truncate d0/f6a 1027198 0 2024-09-18T12:49:18.640 INFO:tasks.workunit.client.0.smithi078.stdout:4/403: dwrite d11/d27/d60/f68 [0,4194304] 0 2024-09-18T12:49:18.643 INFO:tasks.workunit.client.0.smithi078.stdout:9/391: rmdir d5/d7/d32/d2a/d71 0 2024-09-18T12:49:18.643 INFO:tasks.workunit.client.0.smithi078.stdout:5/556: write d2/d4/d12/d16/d36/d4c/d62/d4d/fa2 [701018,130493] 0 2024-09-18T12:49:18.643 INFO:tasks.workunit.client.0.smithi078.stdout:4/404: chown d11/d27/d5a/d84/l6b 58529255 1 2024-09-18T12:49:18.645 INFO:tasks.workunit.client.1.smithi148.stdout:0/764: dwrite de/d27/d53/d89/dbb/fe6 [0,4194304] 0 2024-09-18T12:49:18.645 INFO:tasks.workunit.client.1.smithi148.stdout:9/592: rename d8/c21 to d8/da/dd/d4a/d49/d46/d54/d90/cb4 0 2024-09-18T12:49:18.648 INFO:tasks.workunit.client.1.smithi148.stdout:5/635: truncate d7/d8/dc/d12/d20/f2e 191884 0 2024-09-18T12:49:18.650 INFO:tasks.workunit.client.1.smithi148.stdout:4/600: dread d15/f2d [0,4194304] 0 2024-09-18T12:49:18.650 INFO:tasks.workunit.client.1.smithi148.stdout:5/636: chown d7/d8/dc/d22/dbf 1394681 1 2024-09-18T12:49:18.651 INFO:tasks.workunit.client.0.smithi078.stdout:5/557: dwrite d2/d4/d48/f88 [4194304,4194304] 0 2024-09-18T12:49:18.653 INFO:tasks.workunit.client.0.smithi078.stdout:5/558: dread - d2/d4/d9/d2f/d30/fa5 zero size 2024-09-18T12:49:18.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.651+0000 7f9d59ffb640 1 -- 172.21.15.78:0/836873046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9d74063070 con 0x7f9d74100860 2024-09-18T12:49:18.655 INFO:tasks.workunit.client.0.smithi078.stdout:1/399: creat d0/d8/da/d3e/d50/f7c x:0 0 0 2024-09-18T12:49:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.652+0000 7f9d5bfff640 1 -- 172.21.15.78:0/836873046 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f9d64066180 con 0x7f9d74100860 2024-09-18T12:49:18.735 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:49:18.735 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:49:18.735 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:49:18.735 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:49:18.735 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:49:18.735 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-18T12:49:18.735 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:49:18.735 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:49:18.735 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:49:18.735 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:49:18.735 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:49:18.735 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:49:18.736 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:49:18.736 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:49:18.736 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:49:18.736 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 13, 2024-09-18T12:49:18.736 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:49:18.736 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:49:18.736 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:49:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.657+0000 7f9d59ffb640 1 -- 172.21.15.78:0/836873046 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9d5c074a30 msgr2=0x7f9d5c076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.657+0000 7f9d59ffb640 1 --2- 172.21.15.78:0/836873046 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9d5c074a30 0x7f9d5c076ef0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d68000c00 tx=0x7f9d68009580 comp rx=0 tx=0).stop 2024-09-18T12:49:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.657+0000 7f9d59ffb640 1 -- 172.21.15.78:0/836873046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d74100860 msgr2=0x7f9d7406a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.657+0000 7f9d59ffb640 1 --2- 172.21.15.78:0/836873046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d74100860 0x7f9d7406a790 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400d8d0 tx=0x7f9d6400dd90 comp rx=0 tx=0).stop 2024-09-18T12:49:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.658+0000 7f9d59ffb640 1 -- 172.21.15.78:0/836873046 shutdown_connections 2024-09-18T12:49:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.658+0000 7f9d59ffb640 1 --2- 172.21.15.78:0/836873046 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9d5c074a30 0x7f9d5c076ef0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d68000c00 tx=0x7f9d68009580 comp rx=0 tx=0).stop 2024-09-18T12:49:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.658+0000 7f9d59ffb640 1 --2- 172.21.15.78:0/836873046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d74101a60 0x7f9d7419c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.658+0000 7f9d59ffb640 1 --2- 172.21.15.78:0/836873046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d74100860 0x7f9d7406a790 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.658+0000 7f9d59ffb640 1 -- 172.21.15.78:0/836873046 >> 172.21.15.78:0/836873046 conn(0x7f9d740fc010 msgr2=0x7f9d74104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.659+0000 7f9d59ffb640 1 -- 172.21.15.78:0/836873046 shutdown_connections 2024-09-18T12:49:18.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.659+0000 7f9d59ffb640 1 -- 172.21.15.78:0/836873046 wait complete. 2024-09-18T12:49:18.741 INFO:tasks.workunit.client.0.smithi078.stdout:0/470: getdents d3/d1f/d2e/d68/d30 0 2024-09-18T12:49:18.742 INFO:tasks.workunit.client.0.smithi078.stdout:0/471: chown d3/d1f/d2e/d8f/da1 330366 1 2024-09-18T12:49:18.742 INFO:tasks.workunit.client.0.smithi078.stdout:0/472: stat d3/d43/d7f/cac 0 2024-09-18T12:49:18.742 INFO:tasks.workunit.client.0.smithi078.stdout:0/473: chown d3/d43/cad 264 1 2024-09-18T12:49:18.742 INFO:tasks.workunit.client.0.smithi078.stdout:0/474: dread d3/d1f/f63 [4194304,4194304] 0 2024-09-18T12:49:18.742 INFO:tasks.workunit.client.0.smithi078.stdout:3/438: creat d9/d54/d6c/f81 x:0 0 0 2024-09-18T12:49:18.742 INFO:tasks.workunit.client.0.smithi078.stdout:0/475: dwrite d3/d1f/f67 [0,4194304] 0 2024-09-18T12:49:18.742 INFO:tasks.workunit.client.0.smithi078.stdout:8/385: read d0/f2 [582107,43577] 0 2024-09-18T12:49:18.742 INFO:tasks.workunit.client.0.smithi078.stdout:0/476: chown d3/d1f/d2e/d4e/d37/d72/f78 1974067 1 2024-09-18T12:49:18.742 INFO:tasks.workunit.client.0.smithi078.stdout:8/386: read - d0/d7/f60 zero size 2024-09-18T12:49:18.742 INFO:tasks.workunit.client.0.smithi078.stdout:4/405: creat d11/d27/d47/f87 x:0 0 0 2024-09-18T12:49:18.742 INFO:tasks.workunit.client.0.smithi078.stdout:1/400: rename d0/d37 to d0/d8/da/d3e/d58/d6e/d52/d47/d7d 0 2024-09-18T12:49:18.742 INFO:tasks.workunit.client.0.smithi078.stdout:5/559: truncate d2/d4/d9/d2f/d30/f5f 445914 0 2024-09-18T12:49:18.742 INFO:tasks.workunit.client.0.smithi078.stdout:6/579: mkdir d10/d2b/dbd 0 2024-09-18T12:49:18.743 INFO:tasks.workunit.client.0.smithi078.stdout:9/392: creat d5/d7/d32/d2a/d68/f80 x:0 0 0 2024-09-18T12:49:18.743 INFO:tasks.workunit.client.0.smithi078.stdout:8/387: creat d0/d7/dc/d1f/d23/d44/f75 x:0 0 0 2024-09-18T12:49:18.743 INFO:tasks.workunit.client.0.smithi078.stdout:1/401: creat d0/d5b/d6d/f7e x:0 0 0 2024-09-18T12:49:18.743 INFO:tasks.workunit.client.0.smithi078.stdout:3/439: write d9/d13/d33/d34/f4f [898997,129618] 0 2024-09-18T12:49:18.743 INFO:tasks.workunit.client.0.smithi078.stdout:1/402: dread - d0/d8/da/d3e/d58/d6e/d52/f32 zero size 2024-09-18T12:49:18.743 INFO:tasks.workunit.client.0.smithi078.stdout:6/580: read d10/d2b/d37/f48 [424811,97413] 0 2024-09-18T12:49:18.743 INFO:tasks.workunit.client.0.smithi078.stdout:2/384: link d4/c5d d4/db/c79 0 2024-09-18T12:49:18.743 INFO:tasks.workunit.client.0.smithi078.stdout:1/403: dwrite d0/d8/ff [0,4194304] 0 2024-09-18T12:49:18.743 INFO:tasks.workunit.client.0.smithi078.stdout:1/404: dread - d0/d8/da/d3e/d58/d6e/f7a zero size 2024-09-18T12:49:18.743 INFO:tasks.workunit.client.0.smithi078.stdout:2/385: dwrite d4/db/f6f [0,4194304] 0 2024-09-18T12:49:18.743 INFO:tasks.workunit.client.0.smithi078.stdout:0/477: rename d3/d1f/d2e/d4e/c5b to d3/d1f/d2e/d4e/d37/d72/cb3 0 2024-09-18T12:49:18.743 INFO:tasks.workunit.client.0.smithi078.stdout:9/393: unlink d5/d7/d32/d2a/l41 0 2024-09-18T12:49:18.743 INFO:tasks.workunit.client.0.smithi078.stdout:4/406: link d11/f44 d11/d27/d5a/d5d/f88 0 2024-09-18T12:49:18.744 INFO:tasks.workunit.client.0.smithi078.stdout:6/581: dread d10/d2b/d43/d53/d63/d70/d77/fa3 [0,4194304] 0 2024-09-18T12:49:18.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:18 smithi078 ceph-mon[28091]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:18.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:18 smithi078 ceph-mon[28091]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:18.745 INFO:tasks.workunit.client.0.smithi078.stdout:6/582: dread - d10/d2b/d43/d53/d63/d70/dac/fad zero size 2024-09-18T12:49:18.745 INFO:tasks.workunit.client.0.smithi078.stdout:3/440: link f7 d9/d13/d33/d34/f82 0 2024-09-18T12:49:18.746 INFO:tasks.workunit.client.1.smithi148.stdout:6/632: creat d5/d1a/dc/d2b/d35/d9c/fc5 x:0 0 0 2024-09-18T12:49:18.746 INFO:tasks.workunit.client.1.smithi148.stdout:8/674: symlink d8/d16/d27/dc5/leb 0 2024-09-18T12:49:18.746 INFO:tasks.workunit.client.1.smithi148.stdout:6/633: read d5/d32/f76 [3691019,39851] 0 2024-09-18T12:49:18.746 INFO:tasks.workunit.client.1.smithi148.stdout:2/531: rename d9/f71 to d9/d24/d67/d72/d8f/fbf 0 2024-09-18T12:49:18.746 INFO:tasks.workunit.client.1.smithi148.stdout:9/593: unlink d8/d6f/l89 0 2024-09-18T12:49:18.746 INFO:tasks.workunit.client.1.smithi148.stdout:5/637: write d7/d8/dc/d12/d1f/d69/d8b/f95 [711199,101496] 0 2024-09-18T12:49:18.746 INFO:tasks.workunit.client.1.smithi148.stdout:4/601: mknod d15/d17/d52/d92/d4c/d4f/d34/cc8 0 2024-09-18T12:49:18.747 INFO:tasks.workunit.client.1.smithi148.stdout:9/594: dread d8/da/dd/d4a/d49/d46/d75/fa3 [0,4194304] 0 2024-09-18T12:49:18.747 INFO:tasks.workunit.client.1.smithi148.stdout:1/595: link dc/d18/d31/d39/c58 dc/d18/d31/d4b/db7/cc5 0 2024-09-18T12:49:18.747 INFO:tasks.workunit.client.1.smithi148.stdout:1/596: write dc/d5b/da5/fbe [715368,29985] 0 2024-09-18T12:49:18.747 INFO:tasks.workunit.client.1.smithi148.stdout:3/567: write d4/d8/d20/d2b/d7f/d93/d94/f9a [802556,1238] 0 2024-09-18T12:49:18.747 INFO:tasks.workunit.client.1.smithi148.stdout:3/568: stat d4/d8/d1e/d6b/d31/d60/l77 0 2024-09-18T12:49:18.747 INFO:tasks.workunit.client.1.smithi148.stdout:7/630: rename db/dc/d91/f92 to db/dc/df/d2c/d66/da0/fbc 0 2024-09-18T12:49:18.747 INFO:tasks.workunit.client.1.smithi148.stdout:0/765: getdents de/d14/d43/d70 0 2024-09-18T12:49:18.747 INFO:tasks.workunit.client.1.smithi148.stdout:6/634: symlink d5/d32/lc6 0 2024-09-18T12:49:18.747 INFO:tasks.workunit.client.1.smithi148.stdout:9/595: fdatasync d8/da/dd/d3f/f6a 0 2024-09-18T12:49:18.747 INFO:tasks.workunit.client.1.smithi148.stdout:1/597: mkdir dc/d18/d31/dc6 0 2024-09-18T12:49:18.747 INFO:tasks.workunit.client.1.smithi148.stdout:1/598: chown dc/d18/d7d/d93 466527 1 2024-09-18T12:49:18.747 INFO:tasks.workunit.client.1.smithi148.stdout:1/599: dread dc/d11/f30 [0,4194304] 0 2024-09-18T12:49:18.747 INFO:tasks.workunit.client.1.smithi148.stdout:8/675: creat d8/fec x:0 0 0 2024-09-18T12:49:18.748 INFO:tasks.workunit.client.1.smithi148.stdout:2/532: dwrite d9/fb [0,4194304] 0 2024-09-18T12:49:18.748 INFO:tasks.workunit.client.1.smithi148.stdout:6/635: chown d5/l6 2488 1 2024-09-18T12:49:18.748 INFO:tasks.workunit.client.1.smithi148.stdout:3/569: creat d4/d8/d6a/fc7 x:0 0 0 2024-09-18T12:49:18.748 INFO:tasks.workunit.client.1.smithi148.stdout:3/570: chown d4/d8/d6a/db3/db7 72 1 2024-09-18T12:49:18.748 INFO:tasks.workunit.client.1.smithi148.stdout:0/766: creat de/d27/d53/d89/dbb/db5/df1/f103 x:0 0 0 2024-09-18T12:49:18.748 INFO:tasks.workunit.client.1.smithi148.stdout:5/638: creat d7/d8/fd9 x:0 0 0 2024-09-18T12:49:18.748 INFO:tasks.workunit.client.1.smithi148.stdout:5/639: write d7/d8/f13 [1493339,11476] 0 2024-09-18T12:49:18.748 INFO:tasks.workunit.client.1.smithi148.stdout:4/602: truncate d15/d17/d52/d92/d4c/d4f/d64/f88 2795240 0 2024-09-18T12:49:18.748 INFO:tasks.workunit.client.1.smithi148.stdout:5/640: chown d7/d8/dc/d12/d1f/d39/l9e 208 1 2024-09-18T12:49:18.749 INFO:tasks.workunit.client.1.smithi148.stdout:8/676: write d8/df/d3e/d88/fb1 [27973,44160] 0 2024-09-18T12:49:18.750 INFO:tasks.workunit.client.0.smithi078.stdout:8/388: creat d0/d7/d1e/d33/f76 x:0 0 0 2024-09-18T12:49:18.753 INFO:tasks.workunit.client.1.smithi148.stdout:9/596: dwrite f0 [4194304,4194304] 0 2024-09-18T12:49:18.759 INFO:tasks.workunit.client.1.smithi148.stdout:3/571: symlink d4/d8/d20/d2b/d43/lc8 0 2024-09-18T12:49:18.764 INFO:tasks.workunit.client.0.smithi078.stdout:0/478: dread d3/d1f/d2e/d68/d30/f39 [4194304,4194304] 0 2024-09-18T12:49:18.765 INFO:tasks.workunit.client.0.smithi078.stdout:0/479: write d3/d1f/f97 [622603,14846] 0 2024-09-18T12:49:18.765 INFO:tasks.workunit.client.0.smithi078.stdout:5/560: getdents d2/d4/d9/d49 0 2024-09-18T12:49:18.768 INFO:tasks.workunit.client.0.smithi078.stdout:6/583: read - d10/d2b/d37/f4a zero size 2024-09-18T12:49:18.769 INFO:tasks.workunit.client.0.smithi078.stdout:3/441: mknod d9/d29/d4b/d4c/c83 0 2024-09-18T12:49:18.772 INFO:tasks.workunit.client.1.smithi148.stdout:4/603: mkdir d15/d17/d52/d92/dc9 0 2024-09-18T12:49:18.772 INFO:tasks.workunit.client.0.smithi078.stdout:1/405: truncate d0/d8/da/f17 4072162 0 2024-09-18T12:49:18.773 INFO:tasks.workunit.client.1.smithi148.stdout:4/604: dread d15/d90/fbe [0,4194304] 0 2024-09-18T12:49:18.774 INFO:tasks.workunit.client.1.smithi148.stdout:4/605: dread - d15/d17/d52/d68/f96 zero size 2024-09-18T12:49:18.774 INFO:tasks.workunit.client.1.smithi148.stdout:6/636: symlink d5/d1a/dc/d2b/d35/d65/lc7 0 2024-09-18T12:49:18.775 INFO:tasks.workunit.client.1.smithi148.stdout:4/606: truncate d15/d3f/f98 611431 0 2024-09-18T12:49:18.775 INFO:tasks.workunit.client.0.smithi078.stdout:8/389: mkdir d0/d39/d4c/d77 0 2024-09-18T12:49:18.780 INFO:tasks.workunit.client.1.smithi148.stdout:1/600: truncate dc/f25 498709 0 2024-09-18T12:49:18.780 INFO:tasks.workunit.client.0.smithi078.stdout:4/407: dwrite d11/d27/d47/f3f [4194304,4194304] 0 2024-09-18T12:49:18.786 INFO:tasks.workunit.client.0.smithi078.stdout:9/394: truncate f3 2604483 0 2024-09-18T12:49:18.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.796+0000 7fee3501f640 1 -- 172.21.15.78:0/3595654623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3010c5a0 msgr2=0x7fee3010c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:18.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.796+0000 7fee3501f640 1 --2- 172.21.15.78:0/3595654623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3010c5a0 0x7fee3010c9a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fee20009880 tx=0x7fee2002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.796+0000 7fee3501f640 1 -- 172.21.15.78:0/3595654623 shutdown_connections 2024-09-18T12:49:18.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.796+0000 7fee3501f640 1 --2- 172.21.15.78:0/3595654623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3010d510 0x7fee3010d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.796+0000 7fee3501f640 1 --2- 172.21.15.78:0/3595654623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3010c5a0 0x7fee3010c9a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.796+0000 7fee3501f640 1 -- 172.21.15.78:0/3595654623 >> 172.21.15.78:0/3595654623 conn(0x7fee3006bdd0 msgr2=0x7fee3006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:18.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.797+0000 7fee3501f640 1 -- 172.21.15.78:0/3595654623 shutdown_connections 2024-09-18T12:49:18.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.797+0000 7fee3501f640 1 -- 172.21.15.78:0/3595654623 wait complete. 2024-09-18T12:49:18.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.798+0000 7fee3501f640 1 Processor -- start 2024-09-18T12:49:18.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.799+0000 7fee3501f640 1 -- start start 2024-09-18T12:49:18.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.799+0000 7fee3501f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3010c5a0 0x7fee3019dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:18.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.799+0000 7fee3501f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3010d510 0x7fee3019e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:18.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.799+0000 7fee3501f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fee301150f0 con 0x7fee3010c5a0 2024-09-18T12:49:18.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.799+0000 7fee3501f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fee30114f70 con 0x7fee3010d510 2024-09-18T12:49:18.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.799+0000 7fee27fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3010d510 0x7fee3019e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:18.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.799+0000 7fee27fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3010d510 0x7fee3019e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.78:52036/0 (socket says 172.21.15.78:52036) 2024-09-18T12:49:18.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.799+0000 7fee27fff640 1 -- 172.21.15.78:0/1293466314 learned_addr learned my addr 172.21.15.78:0/1293466314 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:49:18.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.799+0000 7fee2ed9d640 1 --2- 172.21.15.78:0/1293466314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3010c5a0 0x7fee3019dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:18.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.800+0000 7fee27fff640 1 -- 172.21.15.78:0/1293466314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3010c5a0 msgr2=0x7fee3019dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:18.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.800+0000 7fee27fff640 1 --2- 172.21.15.78:0/1293466314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3010c5a0 0x7fee3019dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.800+0000 7fee27fff640 1 -- 172.21.15.78:0/1293466314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3019e680 con 0x7fee3010d510 2024-09-18T12:49:18.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.800+0000 7fee27fff640 1 --2- 172.21.15.78:0/1293466314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3010d510 0x7fee3019e000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fee1800e940 tx=0x7fee1800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:18.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.800+0000 7fee2cd99640 1 -- 172.21.15.78:0/1293466314 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee1800cac0 con 0x7fee3010d510 2024-09-18T12:49:18.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.800+0000 7fee2cd99640 1 -- 172.21.15.78:0/1293466314 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee1800cc60 con 0x7fee3010d510 2024-09-18T12:49:18.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.800+0000 7fee2cd99640 1 -- 172.21.15.78:0/1293466314 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee18003de0 con 0x7fee3010d510 2024-09-18T12:49:18.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.800+0000 7fee3501f640 1 -- 172.21.15.78:0/1293466314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee301b40d0 con 0x7fee3010d510 2024-09-18T12:49:18.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.800+0000 7fee3501f640 1 -- 172.21.15.78:0/1293466314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee301b4660 con 0x7fee3010d510 2024-09-18T12:49:18.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.801+0000 7fee3501f640 1 -- 172.21.15.78:0/1293466314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee3010c9a0 con 0x7fee3010d510 2024-09-18T12:49:18.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.802+0000 7fee2cd99640 1 -- 172.21.15.78:0/1293466314 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fee18004020 con 0x7fee3010d510 2024-09-18T12:49:18.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.802+0000 7fee2cd99640 1 --2- 172.21.15.78:0/1293466314 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fee1c074a80 0x7fee1c076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:18.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.802+0000 7fee2cd99640 1 -- 172.21.15.78:0/1293466314 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fee18096a20 con 0x7fee3010d510 2024-09-18T12:49:18.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.803+0000 7fee2ed9d640 1 --2- 172.21.15.78:0/1293466314 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fee1c074a80 0x7fee1c076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:18.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.803+0000 7fee2ed9d640 1 --2- 172.21.15.78:0/1293466314 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fee1c074a80 0x7fee1c076f40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fee20000c00 tx=0x7fee20005a20 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:18.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:18.807+0000 7fee2cd99640 1 -- 172.21.15.78:0/1293466314 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fee18061f30 con 0x7fee3010d510 2024-09-18T12:49:18.813 INFO:tasks.workunit.client.0.smithi078.stdout:5/561: truncate d2/d4/d12/f67 216950 0 2024-09-18T12:49:18.814 INFO:tasks.workunit.client.0.smithi078.stdout:5/562: dread - d2/d4/d9/d2f/d30/f85 zero size 2024-09-18T12:49:18.816 INFO:tasks.workunit.client.0.smithi078.stdout:3/442: mknod d9/d13/d33/d3c/d19/c84 0 2024-09-18T12:49:18.816 INFO:tasks.workunit.client.0.smithi078.stdout:5/563: write d2/d4/d12/d16/d36/d4c/f65 [2853948,18446] 0 2024-09-18T12:49:18.817 INFO:tasks.workunit.client.0.smithi078.stdout:1/406: dread - d0/d8/da/d3e/d58/d6e/d52/f30 zero size 2024-09-18T12:49:18.818 INFO:tasks.workunit.client.1.smithi148.stdout:3/572: write d4/d8/f1a [6278593,127483] 0 2024-09-18T12:49:18.818 INFO:tasks.workunit.client.1.smithi148.stdout:7/631: getdents db/dc/df/d2c/d55 0 2024-09-18T12:49:18.820 INFO:tasks.workunit.client.1.smithi148.stdout:0/767: fsync de/d14/dcd/ff4 0 2024-09-18T12:49:18.822 INFO:tasks.workunit.client.1.smithi148.stdout:8/677: mkdir d8/df/d3e/d82/ded 0 2024-09-18T12:49:18.825 INFO:tasks.workunit.client.1.smithi148.stdout:6/637: write d5/d1a/dc/d2b/d35/d65/d99/da4/da6/fba [862650,70194] 0 2024-09-18T12:49:18.826 INFO:tasks.workunit.client.1.smithi148.stdout:0/768: dwrite de/f1c [0,4194304] 0 2024-09-18T12:49:18.828 INFO:tasks.workunit.client.1.smithi148.stdout:9/597: fdatasync d8/f10 0 2024-09-18T12:49:18.830 INFO:tasks.workunit.client.0.smithi078.stdout:0/480: dwrite d3/d1f/d2e/d4e/d37/f45 [0,4194304] 0 2024-09-18T12:49:18.830 INFO:tasks.workunit.client.0.smithi078.stdout:2/386: getdents d4/d8/d23 0 2024-09-18T12:49:18.831 INFO:tasks.workunit.client.0.smithi078.stdout:0/481: dread - d3/d1f/d2e/d8f/f9a zero size 2024-09-18T12:49:18.833 INFO:tasks.workunit.client.1.smithi148.stdout:1/601: mknod dc/d11/d38/d72/cc7 0 2024-09-18T12:49:18.837 INFO:tasks.workunit.client.0.smithi078.stdout:4/408: write d11/f12 [4002854,58999] 0 2024-09-18T12:49:18.842 INFO:tasks.workunit.client.0.smithi078.stdout:5/564: mknod d2/d4/d9/d2f/d30/cac 0 2024-09-18T12:49:18.843 INFO:tasks.workunit.client.1.smithi148.stdout:8/678: mkdir d8/d16/d27/dc5/dee 0 2024-09-18T12:49:18.844 INFO:tasks.workunit.client.0.smithi078.stdout:8/390: creat d0/d7/dc/d5d/d2e/d6d/f78 x:0 0 0 2024-09-18T12:49:18.845 INFO:tasks.workunit.client.0.smithi078.stdout:1/407: mkdir d0/d8/da/d3e/d58/d6e/d52/d47/d7d/d7f 0 2024-09-18T12:49:18.846 INFO:tasks.workunit.client.1.smithi148.stdout:6/638: symlink d5/d79/d7c/lc8 0 2024-09-18T12:49:18.847 INFO:tasks.workunit.client.0.smithi078.stdout:1/408: write d0/d8/da/d3e/d58/d6e/f51 [1545795,108838] 0 2024-09-18T12:49:18.848 INFO:tasks.workunit.client.1.smithi148.stdout:1/602: creat dc/d18/d31/d39/fc8 x:0 0 0 2024-09-18T12:49:18.849 INFO:tasks.workunit.client.0.smithi078.stdout:2/387: creat d4/dd/d18/f7a x:0 0 0 2024-09-18T12:49:18.850 INFO:tasks.workunit.client.1.smithi148.stdout:3/573: mknod d4/d8/d6a/db3/db7/cc9 0 2024-09-18T12:49:18.853 INFO:tasks.workunit.client.0.smithi078.stdout:0/482: rename d3/d43/f5d to d3/d1f/d2e/d68/d30/d7c/da3/fb4 0 2024-09-18T12:49:18.855 INFO:tasks.workunit.client.0.smithi078.stdout:6/584: rename d10/d2b/f6e to d10/d2b/fbe 0 2024-09-18T12:49:18.855 INFO:tasks.workunit.client.1.smithi148.stdout:4/607: dread d15/d17/d52/d92/f2e [0,4194304] 0 2024-09-18T12:49:18.858 INFO:tasks.workunit.client.0.smithi078.stdout:4/409: mkdir d11/d27/d89 0 2024-09-18T12:49:18.858 INFO:tasks.workunit.client.1.smithi148.stdout:8/679: mkdir d8/d16/d53/d39/def 0 2024-09-18T12:49:18.858 INFO:tasks.workunit.client.1.smithi148.stdout:8/680: chown l4 209 1 2024-09-18T12:49:18.859 INFO:tasks.workunit.client.0.smithi078.stdout:1/409: dwrite d0/d8/da/d3e/d50/d60/f6b [0,4194304] 0 2024-09-18T12:49:18.859 INFO:tasks.workunit.client.1.smithi148.stdout:8/681: write d8/df/f19 [4347794,81731] 0 2024-09-18T12:49:18.860 INFO:tasks.workunit.client.1.smithi148.stdout:8/682: write d8/df/d3e/fcb [538557,119892] 0 2024-09-18T12:49:18.861 INFO:tasks.workunit.client.1.smithi148.stdout:6/639: fsync d5/d32/d56/f4d 0 2024-09-18T12:49:18.861 INFO:tasks.workunit.client.0.smithi078.stdout:6/585: chown d10/d2b/d43/d53/d45/d9c/cba 762 1 2024-09-18T12:49:18.862 INFO:tasks.workunit.client.1.smithi148.stdout:9/598: getdents d8/da/dd/d3f/d5d/da0 0 2024-09-18T12:49:18.864 INFO:tasks.workunit.client.1.smithi148.stdout:1/603: symlink dc/d18/d7d/d7e/lc9 0 2024-09-18T12:49:18.865 INFO:tasks.workunit.client.0.smithi078.stdout:2/388: dwrite d4/dd/d18/d33/f73 [0,4194304] 0 2024-09-18T12:49:18.866 INFO:tasks.workunit.client.0.smithi078.stdout:9/395: mkdir d5/d7/d32/d81 0 2024-09-18T12:49:18.869 INFO:tasks.workunit.client.1.smithi148.stdout:2/533: sync 2024-09-18T12:49:18.872 INFO:tasks.workunit.client.1.smithi148.stdout:7/632: link db/dc/df/d8e/f7c db/dc/df/d11/dac/fbd 0 2024-09-18T12:49:18.875 INFO:tasks.workunit.client.0.smithi078.stdout:0/483: symlink d3/d1f/d2e/d8f/d90/lb5 0 2024-09-18T12:49:18.876 INFO:tasks.workunit.client.1.smithi148.stdout:0/769: creat de/d27/db3/f104 x:0 0 0 2024-09-18T12:49:18.876 INFO:tasks.workunit.client.1.smithi148.stdout:1/604: dwrite dc/d11/f16 [0,4194304] 0 2024-09-18T12:49:18.878 INFO:tasks.workunit.client.1.smithi148.stdout:2/534: truncate d9/d24/d67/d72/fb6 83999 0 2024-09-18T12:49:18.878 INFO:tasks.workunit.client.1.smithi148.stdout:3/574: dread d4/d8/d1e/d79/fab [0,4194304] 0 2024-09-18T12:49:18.879 INFO:tasks.workunit.client.1.smithi148.stdout:0/770: chown de/d14/d43/f7e 36 1 2024-09-18T12:49:18.880 INFO:tasks.workunit.client.1.smithi148.stdout:1/605: fsync dc/d11/f6e 0 2024-09-18T12:49:18.883 INFO:tasks.workunit.client.1.smithi148.stdout:6/640: chown d5/d32/l63 642 1 2024-09-18T12:49:18.884 INFO:tasks.workunit.client.1.smithi148.stdout:7/633: dwrite db/dc/df/f29 [0,4194304] 0 2024-09-18T12:49:18.885 INFO:tasks.workunit.client.1.smithi148.stdout:8/683: symlink d8/d16/d53/da0/dba/lf0 0 2024-09-18T12:49:18.886 INFO:tasks.workunit.client.0.smithi078.stdout:4/410: rmdir d11/d27/d5a/d84/d40 39 2024-09-18T12:49:18.888 INFO:tasks.workunit.client.0.smithi078.stdout:8/391: symlink d0/d7/d1e/d33/d52/l79 0 2024-09-18T12:49:18.889 INFO:tasks.workunit.client.1.smithi148.stdout:4/608: dread fe [0,4194304] 0 2024-09-18T12:49:18.890 INFO:tasks.workunit.client.0.smithi078.stdout:6/586: creat d10/d2b/d43/d53/d63/d70/dac/fbf x:0 0 0 2024-09-18T12:49:18.892 INFO:tasks.workunit.client.0.smithi078.stdout:2/389: fdatasync d4/f5 0 2024-09-18T12:49:18.894 INFO:tasks.workunit.client.0.smithi078.stdout:0/484: rmdir d3/d1f/d2e/d8f 39 2024-09-18T12:49:18.895 INFO:tasks.workunit.client.1.smithi148.stdout:3/575: fdatasync d4/d8/d20/f26 0 2024-09-18T12:49:18.897 INFO:tasks.workunit.client.0.smithi078.stdout:7/292: sync 2024-09-18T12:49:18.899 INFO:tasks.workunit.client.0.smithi078.stdout:6/587: dread d10/d2b/d43/d53/d63/d70/d7d/fa5 [0,4194304] 0 2024-09-18T12:49:18.899 INFO:tasks.workunit.client.1.smithi148.stdout:2/535: creat d9/d17/d29/d92/d95/d9b/fc0 x:0 0 0 2024-09-18T12:49:18.899 INFO:tasks.workunit.client.1.smithi148.stdout:2/536: dread - d9/d24/d31/d34/f35 zero size 2024-09-18T12:49:18.901 INFO:tasks.workunit.client.1.smithi148.stdout:0/771: symlink de/d27/d53/d89/d9d/l105 0 2024-09-18T12:49:18.902 INFO:tasks.workunit.client.0.smithi078.stdout:4/411: creat d11/d45/f8a x:0 0 0 2024-09-18T12:49:18.902 INFO:tasks.workunit.client.1.smithi148.stdout:5/641: sync 2024-09-18T12:49:18.903 INFO:tasks.workunit.client.1.smithi148.stdout:6/641: symlink d5/d1a/dc/dbf/lc9 0 2024-09-18T12:49:18.904 INFO:tasks.workunit.client.0.smithi078.stdout:8/392: rename d0/d7/dc/f3f to d0/d7/dc/d5d/d2e/f7a 0 2024-09-18T12:49:18.905 INFO:tasks.workunit.client.0.smithi078.stdout:8/393: stat d0/d7/dc/c56 0 2024-09-18T12:49:18.906 INFO:tasks.workunit.client.0.smithi078.stdout:8/394: truncate d0/d7/d1e/d33/f76 376005 0 2024-09-18T12:49:18.907 INFO:tasks.workunit.client.0.smithi078.stdout:8/395: chown d0/d7/f24 2493 1 2024-09-18T12:49:18.908 INFO:tasks.workunit.client.1.smithi148.stdout:8/684: rmdir d8/d12/d46/d7e 39 2024-09-18T12:49:18.909 INFO:tasks.workunit.client.1.smithi148.stdout:8/685: dread d8/d16/fde [0,4194304] 0 2024-09-18T12:49:18.910 INFO:tasks.workunit.client.1.smithi148.stdout:8/686: stat d8/d12/d46/d74/f9b 0 2024-09-18T12:49:18.912 INFO:tasks.workunit.client.1.smithi148.stdout:1/606: dread dc/d11/f53 [0,4194304] 0 2024-09-18T12:49:18.912 INFO:tasks.workunit.client.1.smithi148.stdout:4/609: unlink d15/d17/d52/d68/da5/dc0/cc3 0 2024-09-18T12:49:18.917 INFO:tasks.workunit.client.0.smithi078.stdout:0/485: creat d3/d1f/d2e/d68/d30/d7c/da3/fb6 x:0 0 0 2024-09-18T12:49:18.917 INFO:tasks.workunit.client.1.smithi148.stdout:3/576: mknod d4/d8/d20/d2b/d7f/d93/cca 0 2024-09-18T12:49:18.918 INFO:tasks.workunit.client.0.smithi078.stdout:0/486: fdatasync d3/d1f/d2e/d4e/f3d 0 2024-09-18T12:49:18.918 INFO:tasks.workunit.client.0.smithi078.stdout:3/443: link d9/d13/d37/c57 d9/d29/c85 0 2024-09-18T12:49:18.919 INFO:tasks.workunit.client.1.smithi148.stdout:3/577: read d4/d8/d1e/f5e [3574745,6423] 0 2024-09-18T12:49:18.921 INFO:tasks.workunit.client.1.smithi148.stdout:0/772: creat de/d27/d53/dff/f106 x:0 0 0 2024-09-18T12:49:18.922 INFO:tasks.workunit.client.0.smithi078.stdout:5/565: creat d2/d4/d12/d2d/fad x:0 0 0 2024-09-18T12:49:18.923 INFO:tasks.workunit.client.0.smithi078.stdout:8/396: dread d0/d7/dc/d5d/f37 [0,4194304] 0 2024-09-18T12:49:18.924 INFO:tasks.workunit.client.1.smithi148.stdout:5/642: dread d7/d2b/f36 [0,4194304] 0 2024-09-18T12:49:18.926 INFO:tasks.workunit.client.0.smithi078.stdout:8/397: read d0/d7/fb [4257530,59932] 0 2024-09-18T12:49:18.928 INFO:tasks.workunit.client.0.smithi078.stdout:2/390: mknod d4/db/d45/c7b 0 2024-09-18T12:49:18.929 INFO:tasks.workunit.client.1.smithi148.stdout:9/599: creat d8/da/dd/d35/fb5 x:0 0 0 2024-09-18T12:49:18.931 INFO:tasks.workunit.client.0.smithi078.stdout:2/391: read d4/dd/f5c [3167976,41841] 0 2024-09-18T12:49:18.932 INFO:tasks.workunit.client.0.smithi078.stdout:5/566: dwrite d2/d4/d9/da/d60/d7f/fa8 [0,4194304] 0 2024-09-18T12:49:18.936 INFO:tasks.workunit.client.0.smithi078.stdout:9/396: rename d5/d7/d32/d2a/d36/f37 to d5/d7/d8/d4f/f82 0 2024-09-18T12:49:18.940 INFO:tasks.workunit.client.0.smithi078.stdout:3/444: dread d9/d29/f24 [4194304,4194304] 0 2024-09-18T12:49:18.946 INFO:tasks.workunit.client.0.smithi078.stdout:0/487: fsync d3/d1f/d2e/d4e/d37/f5c 0 2024-09-18T12:49:18.947 INFO:tasks.workunit.client.0.smithi078.stdout:3/445: dwrite d9/d29/f24 [0,4194304] 0 2024-09-18T12:49:18.948 INFO:tasks.workunit.client.0.smithi078.stdout:0/488: stat d3/d1f/d2e/d4e/d37/f51 0 2024-09-18T12:49:18.950 INFO:tasks.workunit.client.0.smithi078.stdout:7/293: symlink d7/d9/d32/l60 0 2024-09-18T12:49:18.951 INFO:tasks.workunit.client.0.smithi078.stdout:0/489: read d3/d1f/d2e/d4e/f9c [7626612,16258] 0 2024-09-18T12:49:18.951 INFO:tasks.workunit.client.1.smithi148.stdout:0/773: dread - de/d27/d53/ff3 zero size 2024-09-18T12:49:18.953 INFO:tasks.workunit.client.0.smithi078.stdout:9/397: dread d5/d7/d32/f44 [0,4194304] 0 2024-09-18T12:49:18.953 INFO:tasks.workunit.client.1.smithi148.stdout:3/578: dwrite d4/d8/f15 [0,4194304] 0 2024-09-18T12:49:18.954 INFO:tasks.workunit.client.0.smithi078.stdout:9/398: fsync d5/d7/d32/f30 0 2024-09-18T12:49:18.956 INFO:tasks.workunit.client.1.smithi148.stdout:6/642: write d5/d32/f64 [368007,102444] 0 2024-09-18T12:49:18.956 INFO:tasks.workunit.client.0.smithi078.stdout:1/410: getdents d0/d8/da/d3e/d58/d6e/d52/d47 0 2024-09-18T12:49:18.956 INFO:tasks.workunit.client.1.smithi148.stdout:5/643: mknod d7/d2b/cda 0 2024-09-18T12:49:18.959 INFO:tasks.workunit.client.1.smithi148.stdout:7/634: rmdir db/dc/df/d1d/da8 0 2024-09-18T12:49:18.960 INFO:tasks.workunit.client.0.smithi078.stdout:8/398: mknod d0/d39/d4c/c7b 0 2024-09-18T12:49:18.964 INFO:tasks.workunit.client.1.smithi148.stdout:9/600: mknod d8/da/dd/d3f/d5d/cb6 0 2024-09-18T12:49:18.966 INFO:tasks.workunit.client.1.smithi148.stdout:9/601: write d8/da/dd/d35/d47/f94 [8437338,18018] 0 2024-09-18T12:49:18.969 INFO:tasks.workunit.client.1.smithi148.stdout:8/687: dwrite d8/d12/d46/fa8 [0,4194304] 0 2024-09-18T12:49:18.969 INFO:tasks.workunit.client.1.smithi148.stdout:4/610: write d15/d17/d52/d92/d4c/d4f/f61 [2444295,39706] 0 2024-09-18T12:49:18.969 INFO:tasks.workunit.client.0.smithi078.stdout:2/392: mkdir d4/d8/d23/d52/d7c 0 2024-09-18T12:49:18.972 INFO:tasks.workunit.client.1.smithi148.stdout:2/537: creat d9/d24/fc1 x:0 0 0 2024-09-18T12:49:18.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:18 smithi148 ceph-mon[35352]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:18.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:18 smithi148 ceph-mon[35352]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:18.973 INFO:tasks.workunit.client.1.smithi148.stdout:8/688: write d8/df/f73 [4602362,93172] 0 2024-09-18T12:49:18.973 INFO:tasks.workunit.client.1.smithi148.stdout:4/611: chown d15/d17/d52/d92/d4c/d4f/l91 32082 1 2024-09-18T12:49:18.976 INFO:tasks.workunit.client.1.smithi148.stdout:3/579: mkdir d4/d8/d6a/db3/db7/dcb 0 2024-09-18T12:49:18.977 INFO:tasks.workunit.client.1.smithi148.stdout:0/774: dread de/d14/d43/f7e [0,4194304] 0 2024-09-18T12:49:18.979 INFO:tasks.workunit.client.0.smithi078.stdout:2/393: dwrite d4/d8/d23/f56 [4194304,4194304] 0 2024-09-18T12:49:18.980 INFO:tasks.workunit.client.1.smithi148.stdout:4/612: write d15/d17/d52/d92/d4c/d4f/f23 [2520531,97198] 0 2024-09-18T12:49:18.980 INFO:tasks.workunit.client.1.smithi148.stdout:1/607: dwrite dc/d11/d38/d87/f23 [0,4194304] 0 2024-09-18T12:49:18.981 INFO:tasks.workunit.client.0.smithi078.stdout:0/490: write d3/d1f/d2e/d8f/d90/fa4 [680356,68698] 0 2024-09-18T12:49:18.981 INFO:tasks.workunit.client.0.smithi078.stdout:2/394: chown d4/f69 4913 1 2024-09-18T12:49:18.981 INFO:tasks.workunit.client.0.smithi078.stdout:0/491: stat d3/d1f/d2e/l3e 0 2024-09-18T12:49:18.982 INFO:tasks.workunit.client.1.smithi148.stdout:6/643: dread - d5/d32/d38/d50/f95 zero size 2024-09-18T12:49:18.988 INFO:tasks.workunit.client.1.smithi148.stdout:5/644: truncate d7/d8/d18/d3f/f70 288806 0 2024-09-18T12:49:18.989 INFO:tasks.workunit.client.0.smithi078.stdout:9/399: fsync d5/d7/d32/d2a/f2d 0 2024-09-18T12:49:18.992 INFO:tasks.workunit.client.0.smithi078.stdout:1/411: creat d0/d5b/d6d/f80 x:0 0 0 2024-09-18T12:49:18.994 INFO:tasks.workunit.client.0.smithi078.stdout:1/412: chown d0/d8/da/d3e/d58/d6e/d52/d47/d7d 46 1 2024-09-18T12:49:18.995 INFO:tasks.workunit.client.1.smithi148.stdout:9/602: mkdir d8/da/dd/d35/d81/db7 0 2024-09-18T12:49:18.996 INFO:tasks.workunit.client.0.smithi078.stdout:8/399: write d0/d7/dc/f3c [886726,73224] 0 2024-09-18T12:49:18.997 INFO:tasks.workunit.client.1.smithi148.stdout:9/603: dread d8/da/dd/d35/d81/f9e [0,4194304] 0 2024-09-18T12:49:18.997 INFO:tasks.workunit.client.1.smithi148.stdout:9/604: write d8/da/dd/f1b [943620,54467] 0 2024-09-18T12:49:18.998 INFO:tasks.workunit.client.0.smithi078.stdout:8/400: chown d0/d7/d53/f5e 75952 1 2024-09-18T12:49:19.002 INFO:tasks.workunit.client.0.smithi078.stdout:5/567: dread d2/d4/d12/d2d/f9c [0,4194304] 0 2024-09-18T12:49:19.004 INFO:tasks.workunit.client.0.smithi078.stdout:3/446: symlink d9/l86 0 2024-09-18T12:49:19.005 INFO:tasks.workunit.client.1.smithi148.stdout:8/689: unlink d8/d16/d53/cb3 0 2024-09-18T12:49:19.007 INFO:tasks.workunit.client.0.smithi078.stdout:7/294: mkdir d7/d9/d14/d22/d35/d49/d61 0 2024-09-18T12:49:19.008 INFO:tasks.workunit.client.0.smithi078.stdout:7/295: chown d7/d26 6701 1 2024-09-18T12:49:19.010 INFO:tasks.workunit.client.1.smithi148.stdout:3/580: creat d4/d8/d1e/d6b/d31/d54/fcc x:0 0 0 2024-09-18T12:49:19.010 INFO:tasks.workunit.client.0.smithi078.stdout:2/395: symlink d4/d20/l7d 0 2024-09-18T12:49:19.012 INFO:tasks.workunit.client.0.smithi078.stdout:6/588: link d10/l6d d10/d2b/d43/d53/lc0 0 2024-09-18T12:49:19.012 INFO:tasks.workunit.client.0.smithi078.stdout:5/568: dwrite d2/d4/d12/fa4 [0,4194304] 0 2024-09-18T12:49:19.016 INFO:tasks.workunit.client.0.smithi078.stdout:5/569: chown d2/d4/d12/d2d/fad 1 1 2024-09-18T12:49:19.018 INFO:tasks.workunit.client.1.smithi148.stdout:1/608: dread dc/d11/d38/d87/d2b/d80/fa6 [0,4194304] 0 2024-09-18T12:49:19.019 INFO:tasks.workunit.client.0.smithi078.stdout:8/401: symlink d0/d7/dc/d5d/d2e/l7c 0 2024-09-18T12:49:19.020 INFO:tasks.workunit.client.0.smithi078.stdout:3/447: creat d9/d13/d33/d3c/f87 x:0 0 0 2024-09-18T12:49:19.022 INFO:tasks.workunit.client.0.smithi078.stdout:8/402: write d0/d7/d1e/d33/f6b [932744,124315] 0 2024-09-18T12:49:19.022 INFO:tasks.workunit.client.0.smithi078.stdout:2/396: mknod d4/db/dc/c7e 0 2024-09-18T12:49:19.022 INFO:tasks.workunit.client.0.smithi078.stdout:7/296: dread d7/d9/d14/d22/d3e/f40 [0,4194304] 0 2024-09-18T12:49:19.024 INFO:tasks.workunit.client.1.smithi148.stdout:9/605: chown d8/da/dd/d4a/l24 1 1 2024-09-18T12:49:19.024 INFO:tasks.workunit.client.0.smithi078.stdout:2/397: write d4/d1a/f2e [2046764,55235] 0 2024-09-18T12:49:19.025 INFO:tasks.workunit.client.0.smithi078.stdout:8/403: write d0/d7/d1e/d4b/f5a [835413,16177] 0 2024-09-18T12:49:19.026 INFO:tasks.workunit.client.0.smithi078.stdout:8/404: chown d0/d7/d1e/d50 44046117 1 2024-09-18T12:49:19.030 INFO:tasks.workunit.client.1.smithi148.stdout:2/538: unlink d9/l13 0 2024-09-18T12:49:19.030 INFO:tasks.workunit.client.0.smithi078.stdout:0/492: dread d3/d1f/d2e/d4e/f3d [0,4194304] 0 2024-09-18T12:49:19.032 INFO:tasks.workunit.client.0.smithi078.stdout:6/589: symlink d10/d2b/d43/d53/d45/d9c/lc1 0 2024-09-18T12:49:19.035 INFO:tasks.workunit.client.0.smithi078.stdout:1/413: truncate d0/d8/da/f5f 2847850 0 2024-09-18T12:49:19.037 INFO:tasks.workunit.client.1.smithi148.stdout:3/581: creat d4/d8/d1e/d79/d92/fcd x:0 0 0 2024-09-18T12:49:19.037 INFO:tasks.workunit.client.0.smithi078.stdout:3/448: mknod d9/d13/d33/d4e/c88 0 2024-09-18T12:49:19.038 INFO:tasks.workunit.client.1.smithi148.stdout:1/609: truncate dc/d11/f30 2079563 0 2024-09-18T12:49:19.041 INFO:tasks.workunit.client.0.smithi078.stdout:7/297: mkdir d7/d3c/d47/d62 0 2024-09-18T12:49:19.044 INFO:tasks.workunit.client.1.smithi148.stdout:7/635: creat db/fbe x:0 0 0 2024-09-18T12:49:19.045 INFO:tasks.workunit.client.0.smithi078.stdout:2/398: creat d4/dd/d18/d3b/d55/f7f x:0 0 0 2024-09-18T12:49:19.048 INFO:tasks.workunit.client.0.smithi078.stdout:8/405: rename d0/d7/d1e/d33 to d0/d39/d4c/d77/d7d 0 2024-09-18T12:49:19.048 INFO:tasks.workunit.client.1.smithi148.stdout:5/645: write d7/d2b/f7a [153603,44482] 0 2024-09-18T12:49:19.050 INFO:tasks.workunit.client.1.smithi148.stdout:2/539: creat d9/d17/d29/d92/fc2 x:0 0 0 2024-09-18T12:49:19.052 INFO:tasks.workunit.client.0.smithi078.stdout:9/400: write d5/d7/f1e [2590898,13919] 0 2024-09-18T12:49:19.053 INFO:tasks.workunit.client.0.smithi078.stdout:8/406: dread d0/d7/dc/d5d/f37 [0,4194304] 0 2024-09-18T12:49:19.053 INFO:tasks.workunit.client.0.smithi078.stdout:1/414: symlink d0/d8/da/d3e/d58/d6e/d52/d47/l81 0 2024-09-18T12:49:19.054 INFO:tasks.workunit.client.0.smithi078.stdout:8/407: dread - d0/d7/d1e/d4b/f61 zero size 2024-09-18T12:49:19.056 INFO:tasks.workunit.client.0.smithi078.stdout:3/449: mkdir d9/d54/d89 0 2024-09-18T12:49:19.056 INFO:tasks.workunit.client.1.smithi148.stdout:3/582: fdatasync d4/d8/d20/d2b/f3a 0 2024-09-18T12:49:19.057 INFO:tasks.workunit.client.1.smithi148.stdout:0/775: write de/d14/d43/d57/fb1 [4907821,99788] 0 2024-09-18T12:49:19.059 INFO:tasks.workunit.client.0.smithi078.stdout:3/450: truncate d9/d54/d6c/f81 741213 0 2024-09-18T12:49:19.059 INFO:tasks.workunit.client.0.smithi078.stdout:7/298: symlink d7/d3c/l63 0 2024-09-18T12:49:19.059 INFO:tasks.workunit.client.1.smithi148.stdout:1/610: symlink dc/d4d/lca 0 2024-09-18T12:49:19.060 INFO:tasks.workunit.client.1.smithi148.stdout:3/583: dread d4/d8/d20/d2b/f8f [0,4194304] 0 2024-09-18T12:49:19.061 INFO:tasks.workunit.client.1.smithi148.stdout:4/613: creat d15/d17/d52/d92/d4c/d4f/fca x:0 0 0 2024-09-18T12:49:19.061 INFO:tasks.workunit.client.1.smithi148.stdout:1/611: truncate dc/d11/d38/d72/fa7 721042 0 2024-09-18T12:49:19.062 INFO:tasks.workunit.client.0.smithi078.stdout:9/401: dwrite d5/d7/d32/f30 [0,4194304] 0 2024-09-18T12:49:19.062 INFO:tasks.workunit.client.0.smithi078.stdout:7/299: fsync d7/d9/d14/d22/d3e/f5b 0 2024-09-18T12:49:19.067 INFO:tasks.workunit.client.0.smithi078.stdout:8/408: dwrite d0/d7/dc/d1f/d6f/f70 [4194304,4194304] 0 2024-09-18T12:49:19.070 INFO:tasks.workunit.client.0.smithi078.stdout:2/399: symlink d4/l80 0 2024-09-18T12:49:19.072 INFO:tasks.workunit.client.1.smithi148.stdout:7/636: dwrite db/dc/df/d1d/d68/f87 [0,4194304] 0 2024-09-18T12:49:19.072 INFO:tasks.workunit.client.1.smithi148.stdout:3/584: dwrite d4/d8/d1e/d6b/f4d [0,4194304] 0 2024-09-18T12:49:19.072 INFO:tasks.workunit.client.0.smithi078.stdout:2/400: fdatasync d4/d1a/f30 0 2024-09-18T12:49:19.073 INFO:tasks.workunit.client.1.smithi148.stdout:3/585: dread - d4/fb8 zero size 2024-09-18T12:49:19.073 INFO:tasks.workunit.client.0.smithi078.stdout:0/493: creat d3/d43/fb7 x:0 0 0 2024-09-18T12:49:19.075 INFO:tasks.workunit.client.1.smithi148.stdout:4/614: dwrite d15/d17/f19 [4194304,4194304] 0 2024-09-18T12:49:19.075 INFO:tasks.workunit.client.1.smithi148.stdout:8/690: creat d8/d12/d46/d7e/da1/ff1 x:0 0 0 2024-09-18T12:49:19.076 INFO:tasks.workunit.client.1.smithi148.stdout:7/637: stat db/dc/df/d11/f97 0 2024-09-18T12:49:19.078 INFO:tasks.workunit.client.1.smithi148.stdout:4/615: dread - d15/d5f/d69/d7f/f8e zero size 2024-09-18T12:49:19.083 INFO:tasks.workunit.client.1.smithi148.stdout:0/776: creat de/d27/d53/d89/f107 x:0 0 0 2024-09-18T12:49:19.089 INFO:tasks.workunit.client.1.smithi148.stdout:1/612: symlink dc/d11/d38/d87/d2b/d80/lcb 0 2024-09-18T12:49:19.090 INFO:tasks.workunit.client.0.smithi078.stdout:1/415: write d0/d8/f38 [13019,10150] 0 2024-09-18T12:49:19.091 INFO:tasks.workunit.client.1.smithi148.stdout:1/613: dread - dc/d18/d31/d39/fc8 zero size 2024-09-18T12:49:19.093 INFO:tasks.workunit.client.0.smithi078.stdout:6/590: getdents d10/d2b/d43/d53/d63/d70/d77 0 2024-09-18T12:49:19.094 INFO:tasks.workunit.client.0.smithi078.stdout:7/300: creat d7/d3f/f64 x:0 0 0 2024-09-18T12:49:19.094 INFO:tasks.workunit.client.0.smithi078.stdout:6/591: chown d10/d2b/d43/d53/d63/d70/d77 6531247 1 2024-09-18T12:49:19.095 INFO:tasks.workunit.client.1.smithi148.stdout:2/540: creat d9/d3a/d90/d94/fc3 x:0 0 0 2024-09-18T12:49:19.096 INFO:tasks.workunit.client.0.smithi078.stdout:6/592: stat d10/d2b/d43/d53/d63/lae 0 2024-09-18T12:49:19.097 INFO:tasks.workunit.client.0.smithi078.stdout:6/593: write d10/f1e [636066,15373] 0 2024-09-18T12:49:19.099 INFO:tasks.workunit.client.0.smithi078.stdout:8/409: mknod d0/d7/dc/c7e 0 2024-09-18T12:49:19.100 INFO:tasks.workunit.client.1.smithi148.stdout:3/586: mkdir d4/d8/d1e/d79/d92/dce 0 2024-09-18T12:49:19.101 INFO:tasks.workunit.client.0.smithi078.stdout:2/401: mkdir d4/d8/d23/d52/d5f/d81 0 2024-09-18T12:49:19.104 INFO:tasks.workunit.client.0.smithi078.stdout:7/301: write d7/d9/d14/f23 [362191,47372] 0 2024-09-18T12:49:19.105 INFO:tasks.workunit.client.1.smithi148.stdout:6/644: link d5/f19 d5/d1a/fca 0 2024-09-18T12:49:19.107 INFO:tasks.workunit.client.1.smithi148.stdout:9/606: getdents d8/da/dd/d4a/d49/d46 0 2024-09-18T12:49:19.108 INFO:tasks.workunit.client.0.smithi078.stdout:0/494: creat d3/d1f/fb8 x:0 0 0 2024-09-18T12:49:19.108 INFO:tasks.workunit.client.1.smithi148.stdout:9/607: dread - d8/da/dd/d4a/d49/d46/d54/d90/fb2 zero size 2024-09-18T12:49:19.109 INFO:tasks.workunit.client.0.smithi078.stdout:0/495: chown d3/d1f/d2e/d4e/d37/d72/l99 12 1 2024-09-18T12:49:19.110 INFO:tasks.workunit.client.0.smithi078.stdout:0/496: write d3/d1f/f97 [462473,123249] 0 2024-09-18T12:49:19.110 INFO:tasks.workunit.client.1.smithi148.stdout:2/541: creat d9/d24/d67/fc4 x:0 0 0 2024-09-18T12:49:19.111 INFO:tasks.workunit.client.0.smithi078.stdout:0/497: fdatasync d3/f93 0 2024-09-18T12:49:19.111 INFO:tasks.workunit.client.0.smithi078.stdout:7/302: truncate d7/d9/d14/d22/f57 1608927 0 2024-09-18T12:49:19.113 INFO:tasks.workunit.client.0.smithi078.stdout:2/402: creat d4/d8/d23/d52/d7c/f82 x:0 0 0 2024-09-18T12:49:19.113 INFO:tasks.workunit.client.1.smithi148.stdout:8/691: getdents d8/d16/d53/d39/def 0 2024-09-18T12:49:19.114 INFO:tasks.workunit.client.0.smithi078.stdout:1/416: creat d0/d8/da/f82 x:0 0 0 2024-09-18T12:49:19.115 INFO:tasks.workunit.client.1.smithi148.stdout:6/645: mkdir d5/d1a/dc/dbf/dcb 0 2024-09-18T12:49:19.117 INFO:tasks.workunit.client.0.smithi078.stdout:9/402: link d5/d7/d32/d2a/d6b/f60 d5/d7/d32/d2a/d6b/f83 0 2024-09-18T12:49:19.117 INFO:tasks.workunit.client.0.smithi078.stdout:0/498: dwrite d3/f17 [0,4194304] 0 2024-09-18T12:49:19.118 INFO:tasks.workunit.client.1.smithi148.stdout:1/614: rename dc/d18/l6c to dc/d4d/dad/lcc 0 2024-09-18T12:49:19.128 INFO:tasks.workunit.client.1.smithi148.stdout:2/542: dwrite d9/d24/d47/f63 [0,4194304] 0 2024-09-18T12:49:19.128 INFO:tasks.workunit.client.0.smithi078.stdout:0/499: dwrite d3/d1f/d2e/d8f/d90/f9b [0,4194304] 0 2024-09-18T12:49:19.130 INFO:tasks.workunit.client.1.smithi148.stdout:2/543: truncate d9/d24/f32 5181145 0 2024-09-18T12:49:19.130 INFO:tasks.workunit.client.0.smithi078.stdout:9/403: dwrite d5/d7/d8/f46 [0,4194304] 0 2024-09-18T12:49:19.130 INFO:tasks.workunit.client.0.smithi078.stdout:0/500: stat d3/d1f/f6f 0 2024-09-18T12:49:19.131 INFO:tasks.workunit.client.1.smithi148.stdout:0/777: creat de/f108 x:0 0 0 2024-09-18T12:49:19.132 INFO:tasks.workunit.client.0.smithi078.stdout:0/501: chown d3/d43/d7f/c87 41145 1 2024-09-18T12:49:19.137 INFO:tasks.workunit.client.1.smithi148.stdout:6/646: creat d5/d79/fcc x:0 0 0 2024-09-18T12:49:19.138 INFO:tasks.workunit.client.1.smithi148.stdout:5/646: write d7/d8/dc/d12/d1f/d25/d4b/dae/fc5 [1197592,30662] 0 2024-09-18T12:49:19.139 INFO:tasks.workunit.client.1.smithi148.stdout:6/647: stat d5/d1a/c15 0 2024-09-18T12:49:19.139 INFO:tasks.workunit.client.0.smithi078.stdout:9/404: dwrite d5/f5e [0,4194304] 0 2024-09-18T12:49:19.140 INFO:tasks.workunit.client.1.smithi148.stdout:9/608: dread d8/f25 [0,4194304] 0 2024-09-18T12:49:19.141 INFO:tasks.workunit.client.1.smithi148.stdout:4/616: getdents d15/d17/d52/d68 0 2024-09-18T12:49:19.144 INFO:tasks.workunit.client.1.smithi148.stdout:7/638: getdents db/dc/df/d2c/d55/daf 0 2024-09-18T12:49:19.144 INFO:tasks.workunit.client.1.smithi148.stdout:8/692: dread d8/d16/d53/d39/f3d [0,4194304] 0 2024-09-18T12:49:19.146 INFO:tasks.workunit.client.0.smithi078.stdout:7/303: creat d7/f65 x:0 0 0 2024-09-18T12:49:19.151 INFO:tasks.workunit.client.1.smithi148.stdout:4/617: dread d15/d17/d52/d92/f46 [0,4194304] 0 2024-09-18T12:49:19.152 INFO:tasks.workunit.client.1.smithi148.stdout:2/544: creat d9/d3a/d90/fc5 x:0 0 0 2024-09-18T12:49:19.153 INFO:tasks.workunit.client.1.smithi148.stdout:2/545: dread - d9/d24/fc1 zero size 2024-09-18T12:49:19.154 INFO:tasks.workunit.client.1.smithi148.stdout:0/778: readlink de/d27/l97 0 2024-09-18T12:49:19.155 INFO:tasks.workunit.client.0.smithi078.stdout:7/304: creat d7/d9/d14/d22/d35/d49/f66 x:0 0 0 2024-09-18T12:49:19.156 INFO:tasks.workunit.client.1.smithi148.stdout:1/615: getdents dc/d11/d38/d87/d2b/d99 0 2024-09-18T12:49:19.156 INFO:tasks.workunit.client.1.smithi148.stdout:1/616: chown dc/d4d/lca 21 1 2024-09-18T12:49:19.156 INFO:tasks.workunit.client.0.smithi078.stdout:0/502: symlink d3/d1f/d2e/lb9 0 2024-09-18T12:49:19.157 INFO:tasks.workunit.client.1.smithi148.stdout:6/648: fdatasync d5/d32/f76 0 2024-09-18T12:49:19.158 INFO:tasks.workunit.client.0.smithi078.stdout:9/405: symlink d5/l84 0 2024-09-18T12:49:19.161 INFO:tasks.workunit.client.1.smithi148.stdout:9/609: dread - d8/da/dd/d4a/d49/f63 zero size 2024-09-18T12:49:19.161 INFO:tasks.workunit.client.1.smithi148.stdout:9/610: stat d8/da/dd/d65/l93 0 2024-09-18T12:49:19.161 INFO:tasks.workunit.client.0.smithi078.stdout:2/403: write d4/d20/f29 [328211,102831] 0 2024-09-18T12:49:19.162 INFO:tasks.workunit.client.0.smithi078.stdout:7/305: mknod d7/d3c/c67 0 2024-09-18T12:49:19.162 INFO:tasks.workunit.client.0.smithi078.stdout:7/306: stat d7/d9/f13 0 2024-09-18T12:49:19.164 INFO:tasks.workunit.client.0.smithi078.stdout:0/503: creat d3/d1f/d2e/d4e/d37/d72/fba x:0 0 0 2024-09-18T12:49:19.165 INFO:tasks.workunit.client.1.smithi148.stdout:9/611: dread d8/f10 [0,4194304] 0 2024-09-18T12:49:19.165 INFO:tasks.workunit.client.0.smithi078.stdout:7/307: chown d7/d26/d4f/f50 28 1 2024-09-18T12:49:19.166 INFO:tasks.workunit.client.0.smithi078.stdout:2/404: mknod d4/d1a/c83 0 2024-09-18T12:49:19.167 INFO:tasks.workunit.client.0.smithi078.stdout:7/308: chown d7/d26/d4f 245480782 1 2024-09-18T12:49:19.167 INFO:tasks.workunit.client.1.smithi148.stdout:8/693: mknod d8/df/d3e/d88/cf2 0 2024-09-18T12:49:19.167 INFO:tasks.workunit.client.1.smithi148.stdout:8/694: stat d8/df/f19 0 2024-09-18T12:49:19.168 INFO:tasks.workunit.client.0.smithi078.stdout:7/309: chown c4 32803355 1 2024-09-18T12:49:19.169 INFO:tasks.workunit.client.1.smithi148.stdout:4/618: symlink d15/d17/d52/d92/d4c/d4f/d64/lcb 0 2024-09-18T12:49:19.170 INFO:tasks.workunit.client.0.smithi078.stdout:1/417: dwrite d0/d8/da/d3e/d58/d6e/d52/d47/d7d/f48 [0,4194304] 0 2024-09-18T12:49:19.172 INFO:tasks.workunit.client.1.smithi148.stdout:1/617: mknod dc/d18/d31/d39/ccd 0 2024-09-18T12:49:19.173 INFO:tasks.workunit.client.1.smithi148.stdout:1/618: chown dc/d5b/da5/fbe 368452 1 2024-09-18T12:49:19.174 INFO:tasks.workunit.client.1.smithi148.stdout:6/649: chown d5/d1a/dc/dbf/fc3 0 1 2024-09-18T12:49:19.175 INFO:tasks.workunit.client.1.smithi148.stdout:6/650: chown d5/d32/f33 29101379 1 2024-09-18T12:49:19.175 INFO:tasks.workunit.client.1.smithi148.stdout:5/647: creat d7/d8/dc/d12/d1f/d39/dd5/fdb x:0 0 0 2024-09-18T12:49:19.176 INFO:tasks.workunit.client.0.smithi078.stdout:0/504: mknod d3/d1f/d2e/d4e/db2/cbb 0 2024-09-18T12:49:19.176 INFO:tasks.workunit.client.1.smithi148.stdout:6/651: write d5/d32/f76 [3464082,48500] 0 2024-09-18T12:49:19.177 INFO:tasks.workunit.client.0.smithi078.stdout:9/406: dwrite d5/d7/f5a [0,4194304] 0 2024-09-18T12:49:19.178 INFO:tasks.workunit.client.1.smithi148.stdout:6/652: stat d5/d1a/dc/d2b/f55 0 2024-09-18T12:49:19.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:19.177+0000 7fee3501f640 1 -- 172.21.15.78:0/1293466314 --> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fee30062630 con 0x7fee1c074a80 2024-09-18T12:49:19.179 INFO:tasks.workunit.client.0.smithi078.stdout:9/407: write d5/d7/d32/f44 [1290831,30896] 0 2024-09-18T12:49:19.180 INFO:tasks.workunit.client.1.smithi148.stdout:9/612: rename d8/d73/l95 to d8/da/dd/d4a/d49/d46/d75/d97/lb8 0 2024-09-18T12:49:19.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:19.178+0000 7fee2cd99640 1 -- 172.21.15.78:0/1293466314 <== mgr.24355 v2:172.21.15.148:6828/2591325460 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7fee30062630 con 0x7fee1c074a80 2024-09-18T12:49:19.181 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:49:19.181 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:49:19.181 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:49:19.181 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:49:19.181 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [], 2024-09-18T12:49:19.181 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "1/2 daemons upgraded", 2024-09-18T12:49:19.181 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-18T12:49:19.182 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:49:19.182 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:49:19.182 INFO:tasks.workunit.client.0.smithi078.stdout:9/408: write d5/d7/d32/f30 [1907817,11568] 0 2024-09-18T12:49:19.182 INFO:tasks.workunit.client.0.smithi078.stdout:1/418: symlink d0/d8/da/d3e/l83 0 2024-09-18T12:49:19.184 INFO:tasks.workunit.client.0.smithi078.stdout:1/419: write d0/d8/f38 [375569,93037] 0 2024-09-18T12:49:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:19.183+0000 7fee3501f640 1 -- 172.21.15.78:0/1293466314 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fee1c074a80 msgr2=0x7fee1c076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:19.183+0000 7fee3501f640 1 --2- 172.21.15.78:0/1293466314 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fee1c074a80 0x7fee1c076f40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fee20000c00 tx=0x7fee20005a20 comp rx=0 tx=0).stop 2024-09-18T12:49:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:19.183+0000 7fee3501f640 1 -- 172.21.15.78:0/1293466314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3010d510 msgr2=0x7fee3019e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:19.183+0000 7fee3501f640 1 --2- 172.21.15.78:0/1293466314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3010d510 0x7fee3019e000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fee1800e940 tx=0x7fee1800ee00 comp rx=0 tx=0).stop 2024-09-18T12:49:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:19.183+0000 7fee3501f640 1 -- 172.21.15.78:0/1293466314 shutdown_connections 2024-09-18T12:49:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:19.183+0000 7fee3501f640 1 --2- 172.21.15.78:0/1293466314 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fee1c074a80 0x7fee1c076f40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:19.183+0000 7fee3501f640 1 --2- 172.21.15.78:0/1293466314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3010d510 0x7fee3019e000 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:19.183+0000 7fee3501f640 1 --2- 172.21.15.78:0/1293466314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3010c5a0 0x7fee3019dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:19.183+0000 7fee3501f640 1 -- 172.21.15.78:0/1293466314 >> 172.21.15.78:0/1293466314 conn(0x7fee3006bdd0 msgr2=0x7fee30110a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:19.183+0000 7fee3501f640 1 -- 172.21.15.78:0/1293466314 shutdown_connections 2024-09-18T12:49:19.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:19.183+0000 7fee3501f640 1 -- 172.21.15.78:0/1293466314 wait complete. 2024-09-18T12:49:19.186 INFO:tasks.workunit.client.1.smithi148.stdout:4/619: creat d15/d5f/fcc x:0 0 0 2024-09-18T12:49:19.187 INFO:tasks.workunit.client.0.smithi078.stdout:7/310: creat d7/d9/d14/d22/d35/d49/d56/f68 x:0 0 0 2024-09-18T12:49:19.188 INFO:tasks.workunit.client.0.smithi078.stdout:0/505: read d3/f47 [410721,68603] 0 2024-09-18T12:49:19.188 INFO:tasks.workunit.client.1.smithi148.stdout:9/613: dwrite d8/da/dd/d3f/f7f [0,4194304] 0 2024-09-18T12:49:19.189 INFO:tasks.workunit.client.1.smithi148.stdout:2/546: dread d9/d24/f25 [0,4194304] 0 2024-09-18T12:49:19.189 INFO:tasks.workunit.client.1.smithi148.stdout:4/620: chown d15/f3a 118027 1 2024-09-18T12:49:19.189 INFO:tasks.workunit.client.0.smithi078.stdout:0/506: truncate d3/d1f/d2e/d68/f44 9043277 0 2024-09-18T12:49:19.190 INFO:tasks.workunit.client.1.smithi148.stdout:1/619: creat dc/d11/d38/d87/d2b/fce x:0 0 0 2024-09-18T12:49:19.190 INFO:tasks.workunit.client.1.smithi148.stdout:2/547: fsync d9/d73/f8e 0 2024-09-18T12:49:19.193 INFO:tasks.workunit.client.0.smithi078.stdout:9/409: truncate d5/d7/d32/f24 1064610 0 2024-09-18T12:49:19.193 INFO:tasks.workunit.client.1.smithi148.stdout:7/639: rename db/l4b to db/lbf 0 2024-09-18T12:49:19.195 INFO:tasks.workunit.client.1.smithi148.stdout:5/648: chown d7/d8/dc/d12/d1f/d69/l62 905037926 1 2024-09-18T12:49:19.196 INFO:tasks.workunit.client.0.smithi078.stdout:1/420: creat d0/d8/da/d3e/f84 x:0 0 0 2024-09-18T12:49:19.197 INFO:tasks.workunit.client.1.smithi148.stdout:3/587: sync 2024-09-18T12:49:19.197 INFO:tasks.workunit.client.1.smithi148.stdout:6/653: fdatasync d5/d1a/dc/d2b/f30 0 2024-09-18T12:49:19.199 INFO:tasks.workunit.client.0.smithi078.stdout:9/410: dread d5/d7/d8/fb [0,4194304] 0 2024-09-18T12:49:19.200 INFO:tasks.workunit.client.1.smithi148.stdout:7/640: dread db/dc/df/d11/f3a [0,4194304] 0 2024-09-18T12:49:19.201 INFO:tasks.workunit.client.0.smithi078.stdout:0/507: creat d3/d1f/d2e/d68/d30/d7c/fbc x:0 0 0 2024-09-18T12:49:19.202 INFO:tasks.workunit.client.1.smithi148.stdout:8/695: mkdir d8/df/d3e/d82/d8f/d95/de4/df3 0 2024-09-18T12:49:19.203 INFO:tasks.workunit.client.1.smithi148.stdout:9/614: mkdir d8/da/dd/d65/db9 0 2024-09-18T12:49:19.204 INFO:tasks.workunit.client.0.smithi078.stdout:7/311: dread d7/d9/f2f [0,4194304] 0 2024-09-18T12:49:19.204 INFO:tasks.workunit.client.0.smithi078.stdout:9/411: mknod d5/d40/c85 0 2024-09-18T12:49:19.205 INFO:tasks.workunit.client.1.smithi148.stdout:9/615: write d8/da/dd/d3f/d5d/f83 [5818582,76399] 0 2024-09-18T12:49:19.205 INFO:tasks.workunit.client.1.smithi148.stdout:4/621: symlink d15/d5f/d69/d7f/d94/lcd 0 2024-09-18T12:49:19.205 INFO:tasks.workunit.client.0.smithi078.stdout:9/412: truncate d5/d40/f7c 606032 0 2024-09-18T12:49:19.206 INFO:tasks.workunit.client.0.smithi078.stdout:0/508: creat d3/d1f/d2e/d8f/fbd x:0 0 0 2024-09-18T12:49:19.207 INFO:tasks.workunit.client.1.smithi148.stdout:0/779: write de/d14/d6b/fb8 [570363,110527] 0 2024-09-18T12:49:19.211 INFO:tasks.workunit.client.0.smithi078.stdout:7/312: symlink d7/d5d/l69 0 2024-09-18T12:49:19.215 INFO:tasks.workunit.client.1.smithi148.stdout:3/588: truncate d4/d8/d20/d2b/d43/f4b 3460411 0 2024-09-18T12:49:19.215 INFO:tasks.workunit.client.1.smithi148.stdout:1/620: dread dc/d18/f1f [0,4194304] 0 2024-09-18T12:49:19.217 INFO:tasks.workunit.client.1.smithi148.stdout:1/621: write dc/d11/d38/d87/d2b/fce [46265,128802] 0 2024-09-18T12:49:19.218 INFO:tasks.workunit.client.0.smithi078.stdout:7/313: creat d7/d3f/f6a x:0 0 0 2024-09-18T12:49:19.220 INFO:tasks.workunit.client.0.smithi078.stdout:9/413: symlink d5/d7/d32/d2a/d6b/l86 0 2024-09-18T12:49:19.222 INFO:tasks.workunit.client.0.smithi078.stdout:1/421: getdents d0 0 2024-09-18T12:49:19.223 INFO:tasks.workunit.client.1.smithi148.stdout:0/780: dread de/f1e [0,4194304] 0 2024-09-18T12:49:19.224 INFO:tasks.workunit.client.0.smithi078.stdout:0/509: symlink d3/d1f/lbe 0 2024-09-18T12:49:19.224 INFO:tasks.workunit.client.0.smithi078.stdout:0/510: write d3/d1f/d2e/d8f/fbd [291728,7160] 0 2024-09-18T12:49:19.225 INFO:tasks.workunit.client.0.smithi078.stdout:0/511: chown d3/d1f/d2e/d4e/d37/d72/ca0 9 1 2024-09-18T12:49:19.227 INFO:tasks.workunit.client.0.smithi078.stdout:7/314: chown d7/d3c/d47/l48 212127771 1 2024-09-18T12:49:19.228 INFO:tasks.workunit.client.0.smithi078.stdout:7/315: chown d7/d9/d14/d22/d3e/l5a 1519 1 2024-09-18T12:49:19.229 INFO:tasks.workunit.client.0.smithi078.stdout:1/422: unlink d0/d8/da/f82 0 2024-09-18T12:49:19.230 INFO:tasks.workunit.client.0.smithi078.stdout:0/512: fdatasync d3/d1f/d2e/d4e/d37/f5c 0 2024-09-18T12:49:19.231 INFO:tasks.workunit.client.0.smithi078.stdout:0/513: readlink d3/d43/l54 0 2024-09-18T12:49:19.231 INFO:tasks.workunit.client.1.smithi148.stdout:6/654: write d5/d1a/d29/d5c/fa5 [920776,92094] 0 2024-09-18T12:49:19.233 INFO:tasks.workunit.client.0.smithi078.stdout:7/316: rename d7/d5d/l69 to d7/d9/d14/d22/d3e/l6b 0 2024-09-18T12:49:19.237 INFO:tasks.workunit.client.0.smithi078.stdout:1/423: unlink d0/d8/da/f40 0 2024-09-18T12:49:19.237 INFO:tasks.workunit.client.0.smithi078.stdout:1/424: truncate d0/f19 5212064 0 2024-09-18T12:49:19.239 INFO:tasks.workunit.client.0.smithi078.stdout:0/514: chown d3/d1f/c6a 7 1 2024-09-18T12:49:19.245 INFO:tasks.workunit.client.0.smithi078.stdout:1/425: creat d0/d8/da/d3e/d58/d6e/d52/d47/d7d/f85 x:0 0 0 2024-09-18T12:49:19.246 INFO:tasks.workunit.client.1.smithi148.stdout:7/641: truncate db/dc/df/d2c/d55/daf/d38/f49 806 0 2024-09-18T12:49:19.246 INFO:tasks.workunit.client.0.smithi078.stdout:0/515: dwrite d3/d1f/d2e/d8f/f95 [0,4194304] 0 2024-09-18T12:49:19.247 INFO:tasks.workunit.client.1.smithi148.stdout:7/642: chown db/dc/df/d11/d43/d89 393 1 2024-09-18T12:49:19.248 INFO:tasks.workunit.client.0.smithi078.stdout:7/317: rename d7/d9/cd to d7/d9/d32/d3b/c6c 0 2024-09-18T12:49:19.249 INFO:tasks.workunit.client.1.smithi148.stdout:0/781: dread de/d14/f17 [4194304,4194304] 0 2024-09-18T12:49:19.249 INFO:tasks.workunit.client.1.smithi148.stdout:9/616: truncate d8/da/dd/d3f/d5d/f99 3652093 0 2024-09-18T12:49:19.251 INFO:tasks.workunit.client.1.smithi148.stdout:1/622: write dc/d11/d38/d87/d2b/f47 [1389558,122905] 0 2024-09-18T12:49:19.252 INFO:tasks.workunit.client.0.smithi078.stdout:1/426: write d0/d5b/f63 [3164173,109756] 0 2024-09-18T12:49:19.253 INFO:tasks.workunit.client.1.smithi148.stdout:8/696: write d8/d16/d27/f93 [949812,77957] 0 2024-09-18T12:49:19.254 INFO:tasks.workunit.client.0.smithi078.stdout:7/318: creat d7/d5d/f6d x:0 0 0 2024-09-18T12:49:19.257 INFO:tasks.workunit.client.1.smithi148.stdout:8/697: dread d8/df/d3e/fcb [0,4194304] 0 2024-09-18T12:49:19.258 INFO:tasks.workunit.client.0.smithi078.stdout:1/427: creat d0/d5b/f86 x:0 0 0 2024-09-18T12:49:19.260 INFO:tasks.workunit.client.0.smithi078.stdout:1/428: dread - d0/d8/da/d3e/d58/d6e/d52/d47/f69 zero size 2024-09-18T12:49:19.264 INFO:tasks.workunit.client.1.smithi148.stdout:6/655: write d5/f2e [1203389,39699] 0 2024-09-18T12:49:19.265 INFO:tasks.workunit.client.1.smithi148.stdout:6/656: chown d5/d32/d56/cb0 884 1 2024-09-18T12:49:19.266 INFO:tasks.workunit.client.1.smithi148.stdout:6/657: fdatasync d5/d32/d56/fbe 0 2024-09-18T12:49:19.266 INFO:tasks.workunit.client.0.smithi078.stdout:0/516: dread d3/d1f/d2e/d68/d30/f64 [0,4194304] 0 2024-09-18T12:49:19.269 INFO:tasks.workunit.client.0.smithi078.stdout:1/429: dwrite d0/f4b [0,4194304] 0 2024-09-18T12:49:19.269 INFO:tasks.workunit.client.1.smithi148.stdout:0/782: mknod de/d14/d43/d70/c109 0 2024-09-18T12:49:19.269 INFO:tasks.workunit.client.1.smithi148.stdout:0/783: chown de/d14/f1f 1932531 1 2024-09-18T12:49:19.271 INFO:tasks.workunit.client.0.smithi078.stdout:1/430: chown d0/d8/da/d3e/d58/d6e/d52/d47/d7d/f85 197 1 2024-09-18T12:49:19.272 INFO:tasks.workunit.client.1.smithi148.stdout:4/622: rename d15/d3f/f98 to d15/d17/d52/d92/d4c/fce 0 2024-09-18T12:49:19.275 INFO:tasks.workunit.client.1.smithi148.stdout:0/784: dwrite de/d14/f26 [0,4194304] 0 2024-09-18T12:49:19.276 INFO:tasks.workunit.client.1.smithi148.stdout:2/548: getdents d9/d3a/d90 0 2024-09-18T12:49:19.278 INFO:tasks.workunit.client.1.smithi148.stdout:3/589: truncate d4/d8/d1e/d63/fad 1846810 0 2024-09-18T12:49:19.279 INFO:tasks.workunit.client.0.smithi078.stdout:7/319: write d7/d9/d14/d22/f27 [1333043,70586] 0 2024-09-18T12:49:19.281 INFO:tasks.workunit.client.0.smithi078.stdout:7/320: chown d7/d9/d14/d22/d35/c54 842219 1 2024-09-18T12:49:19.282 INFO:tasks.workunit.client.0.smithi078.stdout:7/321: chown d7/d9/lf 75320 1 2024-09-18T12:49:19.283 INFO:tasks.workunit.client.1.smithi148.stdout:4/623: mkdir d15/d17/d52/d92/d4c/d4f/d64/da0/da1/dcf 0 2024-09-18T12:49:19.283 INFO:tasks.workunit.client.1.smithi148.stdout:4/624: stat d15/d90/l9f 0 2024-09-18T12:49:19.285 INFO:tasks.workunit.client.1.smithi148.stdout:0/785: creat de/d27/d53/d89/dc1/f10a x:0 0 0 2024-09-18T12:49:19.285 INFO:tasks.workunit.client.1.smithi148.stdout:4/625: truncate d15/d5f/d69/d7f/f8e 8722 0 2024-09-18T12:49:19.286 INFO:tasks.workunit.client.0.smithi078.stdout:7/322: rmdir d7/d9/d14/d22/d35/d49/d56 39 2024-09-18T12:49:19.286 INFO:tasks.workunit.client.1.smithi148.stdout:0/786: fdatasync de/d27/d53/d89/d9d/f9e 0 2024-09-18T12:49:19.288 INFO:tasks.workunit.client.1.smithi148.stdout:3/590: symlink d4/d8/d20/d2b/d7f/lcf 0 2024-09-18T12:49:19.291 INFO:tasks.workunit.client.1.smithi148.stdout:3/591: read d4/d8/d1e/f82 [357015,127880] 0 2024-09-18T12:49:19.291 INFO:tasks.workunit.client.0.smithi078.stdout:0/517: dread d3/d1f/d2e/d68/d30/d7c/f85 [0,4194304] 0 2024-09-18T12:49:19.292 INFO:tasks.workunit.client.1.smithi148.stdout:8/698: rename l5 to d8/df/d3e/d82/d8f/d95/lf4 0 2024-09-18T12:49:19.292 INFO:tasks.workunit.client.1.smithi148.stdout:7/643: dwrite db/dc/df/d2c/d55/f6e [0,4194304] 0 2024-09-18T12:49:19.292 INFO:tasks.workunit.client.1.smithi148.stdout:9/617: link d8/da/dd/d3f/d5d/l6e d8/da/dd/d77/lba 0 2024-09-18T12:49:19.293 INFO:tasks.workunit.client.1.smithi148.stdout:8/699: fdatasync d8/d12/d51/dc7/fea 0 2024-09-18T12:49:19.294 INFO:tasks.workunit.client.0.smithi078.stdout:7/323: rename d7/c2e to d7/d9/d14/d22/d3e/c6e 0 2024-09-18T12:49:19.296 INFO:tasks.workunit.client.1.smithi148.stdout:8/700: chown d8/d16/d53/d39/fe1 3245922 1 2024-09-18T12:49:19.298 INFO:tasks.workunit.client.0.smithi078.stdout:7/324: write d7/d9/d14/f23 [1381727,51181] 0 2024-09-18T12:49:19.300 INFO:tasks.workunit.client.1.smithi148.stdout:0/787: creat de/d27/d53/dff/f10b x:0 0 0 2024-09-18T12:49:19.300 INFO:tasks.workunit.client.0.smithi078.stdout:1/431: dwrite d0/d8/da/d3e/d58/d6e/f4d [0,4194304] 0 2024-09-18T12:49:19.302 INFO:tasks.workunit.client.0.smithi078.stdout:0/518: dwrite d3/d1f/f67 [0,4194304] 0 2024-09-18T12:49:19.303 INFO:tasks.workunit.client.0.smithi078.stdout:1/432: fdatasync d0/f4b 0 2024-09-18T12:49:19.303 INFO:tasks.workunit.client.0.smithi078.stdout:7/325: chown d7/d3c/d47/f4a 414 1 2024-09-18T12:49:19.304 INFO:tasks.workunit.client.1.smithi148.stdout:6/658: dread d5/d1a/dc/f6d [0,4194304] 0 2024-09-18T12:49:19.310 INFO:tasks.workunit.client.1.smithi148.stdout:3/592: creat d4/d8/d1e/d6b/fd0 x:0 0 0 2024-09-18T12:49:19.312 INFO:tasks.workunit.client.1.smithi148.stdout:9/618: rmdir d8/da/dd/d3f/d5d 39 2024-09-18T12:49:19.312 INFO:tasks.workunit.client.0.smithi078.stdout:1/433: read d0/d8/da/f23 [1371143,33949] 0 2024-09-18T12:49:19.313 INFO:tasks.workunit.client.0.smithi078.stdout:1/434: read - d0/d5b/d6d/f7e zero size 2024-09-18T12:49:19.315 INFO:tasks.workunit.client.1.smithi148.stdout:7/644: creat db/dc/df/d11/d43/fc0 x:0 0 0 2024-09-18T12:49:19.317 INFO:tasks.workunit.client.0.smithi078.stdout:0/519: rename d3/d1f/d2e/c91 to d3/d1f/d2e/d4e/d37/d72/cbf 0 2024-09-18T12:49:19.317 INFO:tasks.workunit.client.1.smithi148.stdout:4/626: write d15/d17/d52/d92/d4c/d4f/f3d [1139910,20330] 0 2024-09-18T12:49:19.317 INFO:tasks.workunit.client.1.smithi148.stdout:2/549: rmdir d9/d24/d67/d72/d77 39 2024-09-18T12:49:19.318 INFO:tasks.workunit.client.0.smithi078.stdout:7/326: mkdir d7/d9/d4d/d6f 0 2024-09-18T12:49:19.319 INFO:tasks.workunit.client.1.smithi148.stdout:5/649: sync 2024-09-18T12:49:19.319 INFO:tasks.workunit.client.0.smithi078.stdout:0/520: symlink d3/d1f/d2e/d4e/lc0 0 2024-09-18T12:49:19.320 INFO:tasks.workunit.client.1.smithi148.stdout:3/593: dwrite d4/d8/d20/d2b/d43/f97 [0,4194304] 0 2024-09-18T12:49:19.320 INFO:tasks.workunit.client.0.smithi078.stdout:1/435: symlink d0/d8/da/d3e/d50/d74/l87 0 2024-09-18T12:49:19.321 INFO:tasks.workunit.client.1.smithi148.stdout:6/659: mknod d5/d32/d56/ccd 0 2024-09-18T12:49:19.321 INFO:tasks.workunit.client.0.smithi078.stdout:7/327: mkdir d7/d9/d32/d3b/d70 0 2024-09-18T12:49:19.321 INFO:tasks.workunit.client.0.smithi078.stdout:7/328: chown f5 4 1 2024-09-18T12:49:19.324 INFO:tasks.workunit.client.0.smithi078.stdout:1/436: mknod d0/d8/da/d3e/d58/d6e/d52/d47/c88 0 2024-09-18T12:49:19.325 INFO:tasks.workunit.client.0.smithi078.stdout:1/437: write d0/f6c [474205,64968] 0 2024-09-18T12:49:19.325 INFO:tasks.workunit.client.0.smithi078.stdout:0/521: mknod d3/cc1 0 2024-09-18T12:49:19.327 INFO:tasks.workunit.client.1.smithi148.stdout:9/619: symlink d8/da/dd/d4a/d27/lbb 0 2024-09-18T12:49:19.327 INFO:tasks.workunit.client.1.smithi148.stdout:8/701: dread d8/f8c [0,4194304] 0 2024-09-18T12:49:19.329 INFO:tasks.workunit.client.0.smithi078.stdout:7/329: creat d7/d5d/d5e/f71 x:0 0 0 2024-09-18T12:49:19.329 INFO:tasks.workunit.client.1.smithi148.stdout:3/594: dwrite d4/d8/d1e/d6b/d31/d60/da9/f7c [0,4194304] 0 2024-09-18T12:49:19.329 INFO:tasks.workunit.client.1.smithi148.stdout:8/702: stat d8/d16/d53/d39/f3d 0 2024-09-18T12:49:19.329 INFO:tasks.workunit.client.1.smithi148.stdout:9/620: write d8/d33/f42 [4605584,36398] 0 2024-09-18T12:49:19.331 INFO:tasks.workunit.client.1.smithi148.stdout:8/703: write d8/d16/d53/d39/fe1 [61052,115586] 0 2024-09-18T12:49:19.331 INFO:tasks.workunit.client.0.smithi078.stdout:1/438: rename d0/d8/da/f35 to d0/f89 0 2024-09-18T12:49:19.334 INFO:tasks.workunit.client.0.smithi078.stdout:0/522: dwrite d3/d1f/d2e/d8f/d90/f9b [0,4194304] 0 2024-09-18T12:49:19.334 INFO:tasks.workunit.client.1.smithi148.stdout:0/788: mkdir de/d14/d10c 0 2024-09-18T12:49:19.335 INFO:tasks.workunit.client.1.smithi148.stdout:7/645: creat db/dc/df/d2c/d66/da0/fc1 x:0 0 0 2024-09-18T12:49:19.335 INFO:tasks.workunit.client.1.smithi148.stdout:7/646: chown db/dc/c60 46458723 1 2024-09-18T12:49:19.337 INFO:tasks.workunit.client.1.smithi148.stdout:6/660: symlink d5/d1a/dc/d2b/d9b/lce 0 2024-09-18T12:49:19.338 INFO:tasks.workunit.client.1.smithi148.stdout:4/627: write d15/d17/d52/d92/d4c/d4f/fb7 [1787997,50179] 0 2024-09-18T12:49:19.338 INFO:tasks.workunit.client.1.smithi148.stdout:0/789: truncate de/d14/d43/dd6/fdd 190035 0 2024-09-18T12:49:19.339 INFO:tasks.workunit.client.1.smithi148.stdout:6/661: write d5/d1a/d29/faa [84075,73369] 0 2024-09-18T12:49:19.339 INFO:tasks.workunit.client.0.smithi078.stdout:0/523: creat d3/d1f/d2e/d68/d30/fc2 x:0 0 0 2024-09-18T12:49:19.341 INFO:tasks.workunit.client.1.smithi148.stdout:4/628: write d15/d17/d52/d92/d4c/d4f/fb7 [2379409,87103] 0 2024-09-18T12:49:19.342 INFO:tasks.workunit.client.0.smithi078.stdout:1/439: rename d0/d8/da/d3e/d58/d6e/d52/d47/d7d/f3c to d0/d8/da/d3e/d58/d6e/d52/d47/f8a 0 2024-09-18T12:49:19.344 INFO:tasks.workunit.client.0.smithi078.stdout:7/330: link d7/d9/d14/d22/l55 d7/d3c/d47/l72 0 2024-09-18T12:49:19.346 INFO:tasks.workunit.client.1.smithi148.stdout:3/595: rmdir d4/d8/d1e/d6b 39 2024-09-18T12:49:19.349 INFO:tasks.workunit.client.1.smithi148.stdout:8/704: creat d8/d16/d53/da0/ff5 x:0 0 0 2024-09-18T12:49:19.349 INFO:tasks.workunit.client.1.smithi148.stdout:8/705: chown d8/df/d66/ld4 2540 1 2024-09-18T12:49:19.352 INFO:tasks.workunit.client.1.smithi148.stdout:0/790: creat de/d27/d53/dff/f10d x:0 0 0 2024-09-18T12:49:19.353 INFO:tasks.workunit.client.0.smithi078.stdout:0/524: truncate d3/d1f/d2e/d4e/f48 2638143 0 2024-09-18T12:49:19.354 INFO:tasks.workunit.client.1.smithi148.stdout:6/662: fsync d5/d32/f33 0 2024-09-18T12:49:19.354 INFO:tasks.workunit.client.0.smithi078.stdout:0/525: chown d3/d1f/d2e/d4e/d37/d72 197 1 2024-09-18T12:49:19.355 INFO:tasks.workunit.client.0.smithi078.stdout:7/331: mkdir d7/d3c/d47/d62/d73 0 2024-09-18T12:49:19.356 INFO:tasks.workunit.client.1.smithi148.stdout:0/791: read de/d14/d43/d57/f6f [7810126,102771] 0 2024-09-18T12:49:19.356 INFO:tasks.workunit.client.0.smithi078.stdout:0/526: stat d3/d1f/d2e/d4e/d37/f55 0 2024-09-18T12:49:19.357 INFO:tasks.workunit.client.1.smithi148.stdout:5/650: link d7/d8/dc/d12/d20/f61 d7/d8/dc/d12/d1f/d69/d8b/dad/fdc 0 2024-09-18T12:49:19.358 INFO:tasks.workunit.client.0.smithi078.stdout:1/440: dread d0/d8/da/d3e/d58/d6e/d52/f36 [0,4194304] 0 2024-09-18T12:49:19.361 INFO:tasks.workunit.client.1.smithi148.stdout:3/596: mkdir d4/d8/d20/d2b/d7f/d93/dd1 0 2024-09-18T12:49:19.363 INFO:tasks.workunit.client.1.smithi148.stdout:2/550: creat d9/d24/d67/d72/fc6 x:0 0 0 2024-09-18T12:49:19.365 INFO:tasks.workunit.client.1.smithi148.stdout:8/706: rename d8/d16/l9e to d8/d12/d51/dc7/lf6 0 2024-09-18T12:49:19.367 INFO:tasks.workunit.client.1.smithi148.stdout:8/707: write d8/d16/fcf [806111,12921] 0 2024-09-18T12:49:19.368 INFO:tasks.workunit.client.1.smithi148.stdout:7/647: truncate db/dc/df/d11/f6b 1675612 0 2024-09-18T12:49:19.370 INFO:tasks.workunit.client.0.smithi078.stdout:1/441: rename d0/l62 to d0/d8/da/l8b 0 2024-09-18T12:49:19.370 INFO:tasks.workunit.client.1.smithi148.stdout:7/648: write db/dc/fb1 [42260,31082] 0 2024-09-18T12:49:19.371 INFO:tasks.workunit.client.1.smithi148.stdout:2/551: dwrite d9/fb [0,4194304] 0 2024-09-18T12:49:19.372 INFO:tasks.workunit.client.0.smithi078.stdout:1/442: write d0/d5b/d6d/f80 [501321,100614] 0 2024-09-18T12:49:19.372 INFO:tasks.workunit.client.0.smithi078.stdout:7/332: dread d7/d5d/d5e/f5f [0,4194304] 0 2024-09-18T12:49:19.372 INFO:tasks.workunit.client.1.smithi148.stdout:7/649: dread - db/dc/df/d2c/d66/da0/fc1 zero size 2024-09-18T12:49:19.373 INFO:tasks.workunit.client.1.smithi148.stdout:6/663: rmdir d5/d1a/d29 39 2024-09-18T12:49:19.373 INFO:tasks.workunit.client.0.smithi078.stdout:7/333: readlink d7/d3c/l63 0 2024-09-18T12:49:19.373 INFO:tasks.workunit.client.0.smithi078.stdout:0/527: dread d3/d1f/d2e/d4e/f9c [4194304,4194304] 0 2024-09-18T12:49:19.374 INFO:tasks.workunit.client.1.smithi148.stdout:7/650: dread - db/dc/df/d2c/d66/da0/fc1 zero size 2024-09-18T12:49:19.375 INFO:tasks.workunit.client.1.smithi148.stdout:0/792: creat de/d27/d53/d89/d9d/f10e x:0 0 0 2024-09-18T12:49:19.375 INFO:tasks.workunit.client.0.smithi078.stdout:1/443: fsync d0/d8/da/d3e/f67 0 2024-09-18T12:49:19.378 INFO:tasks.workunit.client.0.smithi078.stdout:7/334: creat d7/d5d/f74 x:0 0 0 2024-09-18T12:49:19.383 INFO:tasks.workunit.client.1.smithi148.stdout:2/552: mkdir d9/d24/d67/dc7 0 2024-09-18T12:49:19.384 INFO:tasks.workunit.client.0.smithi078.stdout:0/528: mknod d3/d1f/d2e/d68/cc3 0 2024-09-18T12:49:19.385 INFO:tasks.workunit.client.0.smithi078.stdout:7/335: dwrite d7/d5d/f74 [0,4194304] 0 2024-09-18T12:49:19.390 INFO:tasks.workunit.client.1.smithi148.stdout:7/651: chown db/dc/df/d5f/l98 1 1 2024-09-18T12:49:19.391 INFO:tasks.workunit.client.1.smithi148.stdout:4/629: dwrite d15/f76 [0,4194304] 0 2024-09-18T12:49:19.394 INFO:tasks.workunit.client.0.smithi078.stdout:0/529: dwrite d3/d1f/d2e/f76 [0,4194304] 0 2024-09-18T12:49:19.394 INFO:tasks.workunit.client.1.smithi148.stdout:1/623: sync 2024-09-18T12:49:19.395 INFO:tasks.workunit.client.1.smithi148.stdout:5/651: rename d7/d8/dc/d12/d1f/d39/f5e to d7/d2b/fdd 0 2024-09-18T12:49:19.396 INFO:tasks.workunit.client.0.smithi078.stdout:0/530: write d3/d1f/d2e/d4e/d37/f45 [1294637,39210] 0 2024-09-18T12:49:19.396 INFO:tasks.workunit.client.0.smithi078.stdout:7/336: symlink d7/d9/d14/d22/d35/d49/d56/l75 0 2024-09-18T12:49:19.403 INFO:tasks.workunit.client.0.smithi078.stdout:7/337: truncate d7/fa 2145306 0 2024-09-18T12:49:19.404 INFO:tasks.workunit.client.0.smithi078.stdout:7/338: write f5 [4929857,58553] 0 2024-09-18T12:49:19.408 INFO:tasks.workunit.client.1.smithi148.stdout:6/664: write d5/d1a/dc/d2b/f55 [219094,82628] 0 2024-09-18T12:49:19.410 INFO:tasks.workunit.client.0.smithi078.stdout:7/339: unlink d7/d9/d14/d22/f27 0 2024-09-18T12:49:19.411 INFO:tasks.workunit.client.1.smithi148.stdout:3/597: truncate d4/f76 509918 0 2024-09-18T12:49:19.411 INFO:tasks.workunit.client.1.smithi148.stdout:3/598: chown d4/d8/d1e/d63/d9b/cc2 29855608 1 2024-09-18T12:49:19.412 INFO:tasks.workunit.client.1.smithi148.stdout:4/630: mkdir d15/d17/d52/d92/d4c/dd0 0 2024-09-18T12:49:19.416 INFO:tasks.workunit.client.1.smithi148.stdout:8/708: rename d8/df/d3e/d82/fa9 to d8/df/db2/ff7 0 2024-09-18T12:49:19.416 INFO:tasks.workunit.client.1.smithi148.stdout:3/599: dread d4/d8/f15 [0,4194304] 0 2024-09-18T12:49:19.417 INFO:tasks.workunit.client.0.smithi078.stdout:7/340: creat d7/d26/d4f/f76 x:0 0 0 2024-09-18T12:49:19.417 INFO:tasks.workunit.client.1.smithi148.stdout:1/624: mknod dc/d18/d7d/d93/ccf 0 2024-09-18T12:49:19.420 INFO:tasks.workunit.client.1.smithi148.stdout:8/709: write d8/d12/d46/d7e/fcc [3489704,115496] 0 2024-09-18T12:49:19.421 INFO:tasks.workunit.client.1.smithi148.stdout:5/652: rename d7/d8/dc/d12/d1f/d77/fa1 to d7/d8/dc/d12/d31/d5a/fde 0 2024-09-18T12:49:19.422 INFO:tasks.workunit.client.1.smithi148.stdout:0/793: dwrite de/d14/d43/d57/f9c [0,4194304] 0 2024-09-18T12:49:19.422 INFO:tasks.workunit.client.1.smithi148.stdout:6/665: creat d5/d1a/d29/fcf x:0 0 0 2024-09-18T12:49:19.425 INFO:tasks.workunit.client.1.smithi148.stdout:8/710: fsync d8/d12/d46/f7d 0 2024-09-18T12:49:19.427 INFO:tasks.workunit.client.1.smithi148.stdout:4/631: creat d15/fd1 x:0 0 0 2024-09-18T12:49:19.429 INFO:tasks.workunit.client.1.smithi148.stdout:0/794: creat de/d27/d53/d89/f10f x:0 0 0 2024-09-18T12:49:19.430 INFO:tasks.workunit.client.0.smithi078.stdout:0/531: write d3/d1f/d2e/d4e/f3d [1096329,51936] 0 2024-09-18T12:49:19.431 INFO:tasks.workunit.client.0.smithi078.stdout:7/341: dread d7/f17 [0,4194304] 0 2024-09-18T12:49:19.431 INFO:tasks.workunit.client.0.smithi078.stdout:0/532: fdatasync d3/d1f/d2e/d4e/d37/f45 0 2024-09-18T12:49:19.432 INFO:tasks.workunit.client.0.smithi078.stdout:7/342: chown d7/f17 659012 1 2024-09-18T12:49:19.433 INFO:tasks.workunit.client.1.smithi148.stdout:1/625: dwrite dc/d5b/da5/fbe [0,4194304] 0 2024-09-18T12:49:19.434 INFO:tasks.workunit.client.0.smithi078.stdout:7/343: truncate d7/d9/d14/d22/d3e/f5b 484786 0 2024-09-18T12:49:19.437 INFO:tasks.workunit.client.0.smithi078.stdout:0/533: symlink d3/d43/d7f/lc4 0 2024-09-18T12:49:19.440 INFO:tasks.workunit.client.1.smithi148.stdout:5/653: mkdir d7/d8/dc/d12/d1f/d25/d4b/dd6/ddf 0 2024-09-18T12:49:19.440 INFO:tasks.workunit.client.1.smithi148.stdout:4/632: dwrite d15/fc6 [0,4194304] 0 2024-09-18T12:49:19.441 INFO:tasks.workunit.client.0.smithi078.stdout:7/344: rename d7/c8 to d7/d9/d14/d22/c77 0 2024-09-18T12:49:19.442 INFO:tasks.workunit.client.0.smithi078.stdout:0/534: mknod d3/d1f/d2e/d8f/d90/cc5 0 2024-09-18T12:49:19.443 INFO:tasks.workunit.client.1.smithi148.stdout:6/666: mknod d5/d1a/dc/dbf/dcb/cd0 0 2024-09-18T12:49:19.444 INFO:tasks.workunit.client.1.smithi148.stdout:7/652: dwrite db/dc/df/d2c/d55/daf/d38/f49 [0,4194304] 0 2024-09-18T12:49:19.445 INFO:tasks.workunit.client.1.smithi148.stdout:7/653: dread - db/fbe zero size 2024-09-18T12:49:19.446 INFO:tasks.workunit.client.1.smithi148.stdout:3/600: dread d4/d8/d1e/d79/f84 [0,4194304] 0 2024-09-18T12:49:19.447 INFO:tasks.workunit.client.1.smithi148.stdout:3/601: chown d4/d8/d1e/d63 8 1 2024-09-18T12:49:19.448 INFO:tasks.workunit.client.0.smithi078.stdout:0/535: creat d3/d1f/d2e/d68/d30/d7c/fc6 x:0 0 0 2024-09-18T12:49:19.449 INFO:tasks.workunit.client.0.smithi078.stdout:0/536: dread - d3/d1f/d2e/d8f/f9a zero size 2024-09-18T12:49:19.450 INFO:tasks.workunit.client.0.smithi078.stdout:7/345: getdents d7/d9/d32/d3b/d70 0 2024-09-18T12:49:19.450 INFO:tasks.workunit.client.0.smithi078.stdout:0/537: write d3/f93 [246327,122224] 0 2024-09-18T12:49:19.453 INFO:tasks.workunit.client.1.smithi148.stdout:9/621: sync 2024-09-18T12:49:19.453 INFO:tasks.workunit.client.1.smithi148.stdout:0/795: mknod de/d14/d43/d57/c110 0 2024-09-18T12:49:19.454 INFO:tasks.workunit.client.1.smithi148.stdout:9/622: chown d8/l50 373642220 1 2024-09-18T12:49:19.455 INFO:tasks.workunit.client.0.smithi078.stdout:0/538: fdatasync d3/f93 0 2024-09-18T12:49:19.457 INFO:tasks.workunit.client.1.smithi148.stdout:8/711: write d8/d16/f9c [4409081,12599] 0 2024-09-18T12:49:19.458 INFO:tasks.workunit.client.0.smithi078.stdout:7/346: truncate d7/f17 1072457 0 2024-09-18T12:49:19.459 INFO:tasks.workunit.client.1.smithi148.stdout:7/654: creat db/dc/fc2 x:0 0 0 2024-09-18T12:49:19.459 INFO:tasks.workunit.client.0.smithi078.stdout:0/539: rmdir d3/d1f/d2e/d4e/db2 39 2024-09-18T12:49:19.459 INFO:tasks.workunit.client.0.smithi078.stdout:0/540: fsync d3/f7b 0 2024-09-18T12:49:19.462 INFO:tasks.workunit.client.0.smithi078.stdout:7/347: creat d7/d9/d14/d22/d35/d49/d56/f78 x:0 0 0 2024-09-18T12:49:19.463 INFO:tasks.workunit.client.0.smithi078.stdout:0/541: chown d3/c11 23282463 1 2024-09-18T12:49:19.463 INFO:tasks.workunit.client.1.smithi148.stdout:9/623: mknod d8/da/dd/d35/d59/cbc 0 2024-09-18T12:49:19.464 INFO:tasks.workunit.client.0.smithi078.stdout:7/348: creat d7/d26/f79 x:0 0 0 2024-09-18T12:49:19.464 INFO:tasks.workunit.client.1.smithi148.stdout:8/712: rmdir d8/d16/d53/da0 39 2024-09-18T12:49:19.465 INFO:tasks.workunit.client.1.smithi148.stdout:0/796: dread de/d14/f25 [0,4194304] 0 2024-09-18T12:49:19.469 INFO:tasks.workunit.client.1.smithi148.stdout:5/654: dread d7/d2b/f3c [0,4194304] 0 2024-09-18T12:49:19.478 INFO:tasks.workunit.client.1.smithi148.stdout:2/553: sync 2024-09-18T12:49:19.478 INFO:tasks.workunit.client.1.smithi148.stdout:1/626: dread dc/fd [0,4194304] 0 2024-09-18T12:49:19.479 INFO:tasks.workunit.client.0.smithi078.stdout:0/542: symlink d3/d1f/d2e/d4e/d37/d72/lc7 0 2024-09-18T12:49:19.481 INFO:tasks.workunit.client.0.smithi078.stdout:7/349: rename d7/d3c/d47 to d7/d5d/d7a 0 2024-09-18T12:49:19.481 INFO:tasks.workunit.client.0.smithi078.stdout:7/350: stat d7/d9/f20 0 2024-09-18T12:49:19.482 INFO:tasks.workunit.client.1.smithi148.stdout:3/602: symlink d4/ld2 0 2024-09-18T12:49:19.484 INFO:tasks.workunit.client.1.smithi148.stdout:1/627: dwrite dc/d18/f90 [0,4194304] 0 2024-09-18T12:49:19.504 INFO:tasks.workunit.client.0.smithi078.stdout:0/543: fsync d3/d1f/d2e/d68/d30/f59 0 2024-09-18T12:49:19.507 INFO:tasks.workunit.client.1.smithi148.stdout:6/667: creat d5/d1a/fd1 x:0 0 0 2024-09-18T12:49:19.510 INFO:tasks.workunit.client.0.smithi078.stdout:7/351: mkdir d7/d9/d14/d22/d35/d49/d61/d7b 0 2024-09-18T12:49:19.510 INFO:tasks.workunit.client.0.smithi078.stdout:0/544: dwrite d3/d1f/d2e/d4e/d37/f45 [0,4194304] 0 2024-09-18T12:49:19.512 INFO:tasks.workunit.client.1.smithi148.stdout:8/713: read d8/f2d [1018670,59122] 0 2024-09-18T12:49:19.515 INFO:tasks.workunit.client.1.smithi148.stdout:5/655: rename d7/d8/dc/d12/d1f/d39/dc2/fb5 to d7/d8/dc/d12/d1f/d39/fe0 0 2024-09-18T12:49:19.516 INFO:tasks.workunit.client.1.smithi148.stdout:4/633: write d15/d17/d52/f66 [1045072,112716] 0 2024-09-18T12:49:19.517 INFO:tasks.workunit.client.0.smithi078.stdout:7/352: write d7/d5d/d5e/f5f [3729576,107584] 0 2024-09-18T12:49:19.524 INFO:tasks.workunit.client.1.smithi148.stdout:3/603: unlink d4/d8/d20/d2b/f71 0 2024-09-18T12:49:19.525 INFO:tasks.workunit.client.1.smithi148.stdout:6/668: mknod d5/d32/d56/cd2 0 2024-09-18T12:49:19.526 INFO:tasks.workunit.client.1.smithi148.stdout:9/624: link d8/da/dd/d35/d81/f8e d8/da/dd/d77/fbd 0 2024-09-18T12:49:19.527 INFO:tasks.workunit.client.1.smithi148.stdout:0/797: creat de/d27/d53/d89/dbb/dc8/f111 x:0 0 0 2024-09-18T12:49:19.528 INFO:tasks.workunit.client.1.smithi148.stdout:8/714: mkdir d8/df/d3e/d82/d8f/d95/de4/df8 0 2024-09-18T12:49:19.529 INFO:tasks.workunit.client.1.smithi148.stdout:8/715: chown d8/d16/d53/d39/d3b 96867806 1 2024-09-18T12:49:19.532 INFO:tasks.workunit.client.1.smithi148.stdout:6/669: unlink d5/d1a/d29/d5c/f77 0 2024-09-18T12:49:19.534 INFO:tasks.workunit.client.1.smithi148.stdout:4/634: fsync d15/d3f/f6e 0 2024-09-18T12:49:19.535 INFO:tasks.workunit.client.1.smithi148.stdout:2/554: creat d9/d24/d31/fc8 x:0 0 0 2024-09-18T12:49:19.536 INFO:tasks.workunit.client.1.smithi148.stdout:2/555: dread - d9/d3a/d90/f9e zero size 2024-09-18T12:49:19.536 INFO:tasks.workunit.client.1.smithi148.stdout:7/655: getdents db/d52/d4f 0 2024-09-18T12:49:19.538 INFO:tasks.workunit.client.1.smithi148.stdout:2/556: chown d9/d17/d29/d92/d95/d64/l8b 428471136 1 2024-09-18T12:49:19.538 INFO:tasks.workunit.client.1.smithi148.stdout:8/716: dread d8/d12/d46/d7e/f89 [0,4194304] 0 2024-09-18T12:49:19.539 INFO:tasks.workunit.client.1.smithi148.stdout:1/628: link dc/d11/d38/d87/d2b/c2d dc/d18/d31/d4b/d8d/cd0 0 2024-09-18T12:49:19.540 INFO:tasks.workunit.client.1.smithi148.stdout:8/717: fdatasync d8/d16/d53/d39/d3b/d4e/f97 0 2024-09-18T12:49:19.541 INFO:tasks.workunit.client.1.smithi148.stdout:1/629: fdatasync dc/d11/d38/d87/f23 0 2024-09-18T12:49:19.541 INFO:tasks.workunit.client.1.smithi148.stdout:9/625: creat d8/da/dd/d65/db9/fbe x:0 0 0 2024-09-18T12:49:19.542 INFO:tasks.workunit.client.1.smithi148.stdout:0/798: mkdir de/d112 0 2024-09-18T12:49:19.544 INFO:tasks.workunit.client.1.smithi148.stdout:0/799: write de/d27/d53/d89/fc2 [106479,34320] 0 2024-09-18T12:49:19.544 INFO:tasks.workunit.client.1.smithi148.stdout:4/635: creat d15/d17/d52/d68/fd2 x:0 0 0 2024-09-18T12:49:19.545 INFO:tasks.workunit.client.1.smithi148.stdout:2/557: dwrite d9/d24/f79 [0,4194304] 0 2024-09-18T12:49:19.546 INFO:tasks.workunit.client.1.smithi148.stdout:7/656: mkdir db/dc/df/d11/d34/d69/dc3 0 2024-09-18T12:49:19.546 INFO:tasks.workunit.client.1.smithi148.stdout:2/558: fsync d9/d73/f8e 0 2024-09-18T12:49:19.547 INFO:tasks.workunit.client.1.smithi148.stdout:0/800: write de/d14/d43/d57/fda [119508,46044] 0 2024-09-18T12:49:19.547 INFO:tasks.workunit.client.1.smithi148.stdout:7/657: stat db/dc/df/d5f/c99 0 2024-09-18T12:49:19.550 INFO:tasks.workunit.client.1.smithi148.stdout:2/559: write d9/d24/d31/d34/d7b/fad [308995,121498] 0 2024-09-18T12:49:19.554 INFO:tasks.workunit.client.1.smithi148.stdout:6/670: link d5/d1a/d29/fc4 d5/d1a/dc/d2b/d35/fd3 0 2024-09-18T12:49:19.557 INFO:tasks.workunit.client.1.smithi148.stdout:3/604: write d4/d8/d20/d2b/f2c [3804368,20748] 0 2024-09-18T12:49:19.558 INFO:tasks.workunit.client.1.smithi148.stdout:4/636: creat d15/d17/d52/d92/d4c/d4f/d64/da0/da1/fd3 x:0 0 0 2024-09-18T12:49:19.560 INFO:tasks.workunit.client.1.smithi148.stdout:5/656: dwrite d7/d2b/fdd [0,4194304] 0 2024-09-18T12:49:19.561 INFO:tasks.workunit.client.1.smithi148.stdout:1/630: mknod dc/d18/d31/d4b/d8d/d8f/cd1 0 2024-09-18T12:49:19.561 INFO:tasks.workunit.client.1.smithi148.stdout:5/657: fsync d7/f8c 0 2024-09-18T12:49:19.563 INFO:tasks.workunit.client.1.smithi148.stdout:8/718: creat d8/d16/d53/ff9 x:0 0 0 2024-09-18T12:49:19.563 INFO:tasks.workunit.client.1.smithi148.stdout:0/801: truncate de/d14/f83 1706810 0 2024-09-18T12:49:19.565 INFO:tasks.workunit.client.1.smithi148.stdout:0/802: write de/d14/d43/d70/f8d [305061,13783] 0 2024-09-18T12:49:19.567 INFO:tasks.workunit.client.1.smithi148.stdout:2/560: symlink d9/d24/d67/d72/d8f/lc9 0 2024-09-18T12:49:19.570 INFO:tasks.workunit.client.1.smithi148.stdout:9/626: dread d8/da/dd/d4a/f15 [0,4194304] 0 2024-09-18T12:49:19.570 INFO:tasks.workunit.client.1.smithi148.stdout:1/631: mknod dc/d11/d38/d87/d2b/cd2 0 2024-09-18T12:49:19.571 INFO:tasks.workunit.client.1.smithi148.stdout:8/719: dwrite d8/f92 [0,4194304] 0 2024-09-18T12:49:19.572 INFO:tasks.workunit.client.1.smithi148.stdout:4/637: symlink d15/d17/ld4 0 2024-09-18T12:49:19.573 INFO:tasks.workunit.client.1.smithi148.stdout:1/632: write dc/d11/d38/d87/f9c [408612,115994] 0 2024-09-18T12:49:19.573 INFO:tasks.workunit.client.1.smithi148.stdout:7/658: truncate db/dc/df/d2c/d55/daf/d38/f49 1255372 0 2024-09-18T12:49:19.575 INFO:tasks.workunit.client.1.smithi148.stdout:5/658: fdatasync d7/d8/d18/d3f/f70 0 2024-09-18T12:49:19.577 INFO:tasks.workunit.client.1.smithi148.stdout:2/561: rename d9/d3a/d90/d94 to d9/d17/d29/d92/dca 0 2024-09-18T12:49:19.579 INFO:tasks.workunit.client.1.smithi148.stdout:9/627: creat d8/da/dd/d4a/d49/d46/fbf x:0 0 0 2024-09-18T12:49:19.580 INFO:tasks.workunit.client.1.smithi148.stdout:8/720: dread - d8/d16/f7a zero size 2024-09-18T12:49:19.580 INFO:tasks.workunit.client.1.smithi148.stdout:4/638: readlink d15/d17/d52/d92/d4c/d4f/d34/lb4 0 2024-09-18T12:49:19.580 INFO:tasks.workunit.client.1.smithi148.stdout:4/639: fdatasync d15/d5f/fcc 0 2024-09-18T12:49:19.581 INFO:tasks.workunit.client.1.smithi148.stdout:7/659: unlink db/dc/f12 0 2024-09-18T12:49:19.582 INFO:tasks.workunit.client.1.smithi148.stdout:0/803: creat de/d27/d7a/f113 x:0 0 0 2024-09-18T12:49:19.583 INFO:tasks.workunit.client.1.smithi148.stdout:7/660: read db/dc/df/d1d/d68/f87 [1593027,45415] 0 2024-09-18T12:49:19.583 INFO:tasks.workunit.client.1.smithi148.stdout:0/804: dread - de/d27/d53/d89/dc1/f10a zero size 2024-09-18T12:49:19.584 INFO:tasks.workunit.client.1.smithi148.stdout:7/661: dread - db/dc/df/d1d/d68/d7a/f85 zero size 2024-09-18T12:49:19.585 INFO:tasks.workunit.client.1.smithi148.stdout:0/805: dread - de/d27/d53/d89/dbb/db5/df1/f103 zero size 2024-09-18T12:49:19.586 INFO:tasks.workunit.client.1.smithi148.stdout:4/640: mknod d15/d17/d52/d68/cd5 0 2024-09-18T12:49:19.587 INFO:tasks.workunit.client.1.smithi148.stdout:9/628: rename d8/da/dd/d65/l93 to d8/da/dd/d65/lc0 0 2024-09-18T12:49:19.590 INFO:tasks.workunit.client.1.smithi148.stdout:0/806: rename de/d27/d53/d89/dbb/db5/df1 to de/d27/d2e/d114 0 2024-09-18T12:49:19.593 INFO:tasks.workunit.client.1.smithi148.stdout:4/641: unlink d15/d17/d52/d92/d4c/d4f/d64/da0/fb5 0 2024-09-18T12:49:19.595 INFO:tasks.workunit.client.1.smithi148.stdout:5/659: creat d7/d8/dc/d12/d1f/d69/fe1 x:0 0 0 2024-09-18T12:49:19.596 INFO:tasks.workunit.client.1.smithi148.stdout:2/562: link d9/d24/d31/d34/f6e d9/d24/d31/d9d/fcb 0 2024-09-18T12:49:19.597 INFO:tasks.workunit.client.1.smithi148.stdout:2/563: dread - d9/d17/d29/d92/dca/fc3 zero size 2024-09-18T12:49:19.597 INFO:tasks.workunit.client.1.smithi148.stdout:1/633: getdents dc/d11/d38/d87/d2b 0 2024-09-18T12:49:19.598 INFO:tasks.workunit.client.1.smithi148.stdout:2/564: stat d9/d17/d29/d92/d95/cb5 0 2024-09-18T12:49:19.598 INFO:tasks.workunit.client.1.smithi148.stdout:0/807: symlink de/d27/d53/d89/dbb/db5/l115 0 2024-09-18T12:49:19.599 INFO:tasks.workunit.client.1.smithi148.stdout:8/721: link d8/d12/d46/d7e/f89 d8/df/d3e/d82/ded/ffa 0 2024-09-18T12:49:19.599 INFO:tasks.workunit.client.1.smithi148.stdout:8/722: chown l4 7361723 1 2024-09-18T12:49:19.601 INFO:tasks.workunit.client.1.smithi148.stdout:5/660: truncate d7/d8/dc/f5d 138172 0 2024-09-18T12:49:19.602 INFO:tasks.workunit.client.1.smithi148.stdout:7/662: creat db/fc4 x:0 0 0 2024-09-18T12:49:19.603 INFO:tasks.workunit.client.1.smithi148.stdout:5/661: write d7/d8/dc/f28 [1646826,3578] 0 2024-09-18T12:49:19.603 INFO:tasks.workunit.client.1.smithi148.stdout:0/808: stat de/d27/f44 0 2024-09-18T12:49:19.605 INFO:tasks.workunit.client.1.smithi148.stdout:4/642: mkdir d15/d17/d52/d92/d4c/dd0/dd6 0 2024-09-18T12:49:19.605 INFO:tasks.workunit.client.1.smithi148.stdout:9/629: getdents d8/da/dd/d35/d47/d62 0 2024-09-18T12:49:19.606 INFO:tasks.workunit.client.1.smithi148.stdout:2/565: symlink d9/d24/d67/dc7/lcc 0 2024-09-18T12:49:19.606 INFO:tasks.workunit.client.1.smithi148.stdout:1/634: fsync dc/d18/d8a/f92 0 2024-09-18T12:49:19.606 INFO:tasks.workunit.client.1.smithi148.stdout:8/723: dwrite d8/f2f [0,4194304] 0 2024-09-18T12:49:19.607 INFO:tasks.workunit.client.1.smithi148.stdout:0/809: symlink de/d14/d43/d57/d59/l116 0 2024-09-18T12:49:19.610 INFO:tasks.workunit.client.0.smithi078.stdout:0/545: rename d3/d43/d7f/fa7 to d3/d1f/d2e/d68/d30/d7c/da3/fc8 0 2024-09-18T12:49:19.612 INFO:tasks.workunit.client.1.smithi148.stdout:1/635: rmdir dc/d51 39 2024-09-18T12:49:19.612 INFO:tasks.workunit.client.0.smithi078.stdout:0/546: write d3/d1f/d2e/d68/d30/f62 [34933,56856] 0 2024-09-18T12:49:19.615 INFO:tasks.workunit.client.0.smithi078.stdout:7/353: dwrite d7/d5d/d7a/f4a [0,4194304] 0 2024-09-18T12:49:19.617 INFO:tasks.workunit.client.1.smithi148.stdout:2/566: truncate d9/d17/d29/d92/d95/d9b/fc0 947842 0 2024-09-18T12:49:19.619 INFO:tasks.workunit.client.1.smithi148.stdout:7/663: rename db/dc/df/d2c/d55/daf/d38/c3d to db/dc/df/d8e/d75/cc5 0 2024-09-18T12:49:19.619 INFO:tasks.workunit.client.1.smithi148.stdout:4/643: dwrite d15/d17/f36 [0,4194304] 0 2024-09-18T12:49:19.622 INFO:tasks.workunit.client.1.smithi148.stdout:5/662: dwrite d7/d8/dc/d12/d20/f2e [0,4194304] 0 2024-09-18T12:49:19.629 INFO:tasks.workunit.client.0.smithi078.stdout:7/354: creat d7/d9/d14/d22/d35/d49/f7c x:0 0 0 2024-09-18T12:49:19.630 INFO:tasks.workunit.client.0.smithi078.stdout:7/355: chown l1 3875610 1 2024-09-18T12:49:19.630 INFO:tasks.workunit.client.1.smithi148.stdout:2/567: write d9/d17/f5d [26666,126194] 0 2024-09-18T12:49:19.632 INFO:tasks.workunit.client.1.smithi148.stdout:0/810: getdents de/d27/d53/d102 0 2024-09-18T12:49:19.634 INFO:tasks.workunit.client.1.smithi148.stdout:9/630: creat d8/da/dd/d3f/d5d/da0/fc1 x:0 0 0 2024-09-18T12:49:19.634 INFO:tasks.workunit.client.1.smithi148.stdout:4/644: chown d15/d17/d52/l7c 659 1 2024-09-18T12:49:19.635 INFO:tasks.workunit.client.1.smithi148.stdout:1/636: dwrite dc/d18/d63/f98 [0,4194304] 0 2024-09-18T12:49:19.635 INFO:tasks.workunit.client.1.smithi148.stdout:7/664: creat db/dc/df/d1d/d68/d7a/fc6 x:0 0 0 2024-09-18T12:49:19.637 INFO:tasks.workunit.client.1.smithi148.stdout:8/724: dwrite d8/d16/d53/da0/fb7 [0,4194304] 0 2024-09-18T12:49:19.637 INFO:tasks.workunit.client.0.smithi078.stdout:7/356: rename d7/d5d/d7a/d62/d73 to d7/d9/d14/d22/d35/d49/d7d 0 2024-09-18T12:49:19.638 INFO:tasks.workunit.client.1.smithi148.stdout:1/637: chown dc/d11/f16 178 1 2024-09-18T12:49:19.640 INFO:tasks.workunit.client.1.smithi148.stdout:0/811: truncate de/f94 49701 0 2024-09-18T12:49:19.641 INFO:tasks.workunit.client.1.smithi148.stdout:0/812: chown de/d14/d43/c87 2138314 1 2024-09-18T12:49:19.644 INFO:tasks.workunit.client.1.smithi148.stdout:9/631: rmdir d8/da/dd/d3f/d5d 39 2024-09-18T12:49:19.645 INFO:tasks.workunit.client.1.smithi148.stdout:8/725: rmdir d8/d12/d46/d74 39 2024-09-18T12:49:19.646 INFO:tasks.workunit.client.0.smithi078.stdout:7/357: dwrite d7/d9/f20 [4194304,4194304] 0 2024-09-18T12:49:19.649 INFO:tasks.workunit.client.1.smithi148.stdout:7/665: read db/dc/df/d2c/d55/daf/d38/f49 [81673,80899] 0 2024-09-18T12:49:19.651 INFO:tasks.workunit.client.1.smithi148.stdout:5/663: creat d7/d8/dc/d12/d1f/d69/d8b/dad/fe2 x:0 0 0 2024-09-18T12:49:19.653 INFO:tasks.workunit.client.1.smithi148.stdout:1/638: creat dc/d18/d7d/d93/fd3 x:0 0 0 2024-09-18T12:49:19.654 INFO:tasks.workunit.client.1.smithi148.stdout:2/568: mkdir d9/d24/d31/d9d/dcd 0 2024-09-18T12:49:19.656 INFO:tasks.workunit.client.0.smithi078.stdout:0/547: dwrite d3/d1f/d2e/d68/d30/d7c/da3/fb4 [0,4194304] 0 2024-09-18T12:49:19.657 INFO:tasks.workunit.client.1.smithi148.stdout:0/813: fsync de/f24 0 2024-09-18T12:49:19.658 INFO:tasks.workunit.client.0.smithi078.stdout:0/548: read - d3/d1f/d2e/d4e/d37/d72/fae zero size 2024-09-18T12:49:19.659 INFO:tasks.workunit.client.0.smithi078.stdout:0/549: chown d3/d1f/d2e/d4e/f48 958927261 1 2024-09-18T12:49:19.660 INFO:tasks.workunit.client.1.smithi148.stdout:4/645: rename d15/d17/d52/d92/d4c/d4f/c30 to d15/d17/d52/d68/cd7 0 2024-09-18T12:49:19.662 INFO:tasks.workunit.client.1.smithi148.stdout:7/666: creat db/d52/d4f/fc7 x:0 0 0 2024-09-18T12:49:19.663 INFO:tasks.workunit.client.1.smithi148.stdout:8/726: dread d8/f62 [0,4194304] 0 2024-09-18T12:49:19.663 INFO:tasks.workunit.client.1.smithi148.stdout:1/639: dread dc/d11/f6e [0,4194304] 0 2024-09-18T12:49:19.664 INFO:tasks.workunit.client.1.smithi148.stdout:7/667: chown db/dc/df/l17 3096823 1 2024-09-18T12:49:19.666 INFO:tasks.workunit.client.1.smithi148.stdout:1/640: write dc/d11/d38/d87/f9c [2480237,104022] 0 2024-09-18T12:49:19.667 INFO:tasks.workunit.client.1.smithi148.stdout:7/668: stat db/dc/df/d8e/d75/l4e 0 2024-09-18T12:49:19.668 INFO:tasks.workunit.client.1.smithi148.stdout:0/814: chown de/d27/f3a 120460 1 2024-09-18T12:49:19.668 INFO:tasks.workunit.client.1.smithi148.stdout:4/646: creat d15/d17/d52/d92/d4c/d4f/d64/da0/fd8 x:0 0 0 2024-09-18T12:49:19.671 INFO:tasks.workunit.client.1.smithi148.stdout:9/632: write d8/da/dd/d4a/d49/d46/d75/fa3 [720232,45973] 0 2024-09-18T12:49:19.671 INFO:tasks.workunit.client.1.smithi148.stdout:5/664: truncate d7/d8/dc/d12/f24 328130 0 2024-09-18T12:49:19.671 INFO:tasks.workunit.client.1.smithi148.stdout:3/605: sync 2024-09-18T12:49:19.671 INFO:tasks.workunit.client.1.smithi148.stdout:6/671: sync 2024-09-18T12:49:19.674 INFO:tasks.workunit.client.1.smithi148.stdout:8/727: dwrite d8/df/fc8 [0,4194304] 0 2024-09-18T12:49:19.677 INFO:tasks.workunit.client.1.smithi148.stdout:1/641: getdents dc/d5b/da5 0 2024-09-18T12:49:19.678 INFO:tasks.workunit.client.1.smithi148.stdout:6/672: chown d5/d1a/dc/dbf/fc3 3731551 1 2024-09-18T12:49:19.681 INFO:tasks.workunit.client.1.smithi148.stdout:5/665: truncate d7/d8/dc/d22/fc7 532697 0 2024-09-18T12:49:19.682 INFO:tasks.workunit.client.1.smithi148.stdout:1/642: readlink dc/d11/d38/la9 0 2024-09-18T12:49:19.683 INFO:tasks.workunit.client.1.smithi148.stdout:9/633: mknod d8/da/dd/d4a/d49/d46/d54/cc2 0 2024-09-18T12:49:19.685 INFO:tasks.workunit.client.1.smithi148.stdout:7/669: dwrite db/dc/df/d2c/d66/da0/fc1 [0,4194304] 0 2024-09-18T12:49:19.688 INFO:tasks.workunit.client.0.smithi078.stdout:0/550: write d3/d1f/f63 [948536,15834] 0 2024-09-18T12:49:19.688 INFO:tasks.workunit.client.1.smithi148.stdout:3/606: link d4/l5c d4/d8/d1e/d6b/d31/d60/da9/d8b/ld3 0 2024-09-18T12:49:19.693 INFO:tasks.workunit.client.0.smithi078.stdout:0/551: rmdir d3/d1f/d2e/d4e/d37/d72/d96 39 2024-09-18T12:49:19.693 INFO:tasks.workunit.client.1.smithi148.stdout:7/670: unlink db/dc/df/d8e/d75/l45 0 2024-09-18T12:49:19.695 INFO:tasks.workunit.client.1.smithi148.stdout:0/815: write de/d27/d2e/f73 [1232833,34202] 0 2024-09-18T12:49:19.695 INFO:tasks.workunit.client.1.smithi148.stdout:8/728: dwrite d8/d12/d46/d7e/fe3 [0,4194304] 0 2024-09-18T12:49:19.696 INFO:tasks.workunit.client.1.smithi148.stdout:4/647: write d15/d17/d52/d92/d4c/d72/f79 [478823,49947] 0 2024-09-18T12:49:19.697 INFO:tasks.workunit.client.1.smithi148.stdout:2/569: dread d9/d3a/f75 [0,4194304] 0 2024-09-18T12:49:19.699 INFO:tasks.workunit.client.0.smithi078.stdout:0/552: mkdir d3/d1f/d2e/d68/dc9 0 2024-09-18T12:49:19.699 INFO:tasks.workunit.client.1.smithi148.stdout:3/607: write d4/d8/d1e/d6b/d31/d60/faf [492804,91295] 0 2024-09-18T12:49:19.701 INFO:tasks.workunit.client.1.smithi148.stdout:5/666: write d7/d8/d18/d3f/f6f [1738450,59635] 0 2024-09-18T12:49:19.701 INFO:tasks.workunit.client.1.smithi148.stdout:7/671: mkdir db/d52/d4f/dc8 0 2024-09-18T12:49:19.704 INFO:tasks.workunit.client.1.smithi148.stdout:0/816: chown de/d27/d53/d89/dc0/dbd/dd9 416 1 2024-09-18T12:49:19.707 INFO:tasks.workunit.client.1.smithi148.stdout:9/634: truncate d8/da/dd/d65/f6d 3172975 0 2024-09-18T12:49:19.707 INFO:tasks.workunit.client.1.smithi148.stdout:7/672: stat db/dc/df/d11/dac 0 2024-09-18T12:49:19.707 INFO:tasks.workunit.client.1.smithi148.stdout:0/817: write f9 [429309,213] 0 2024-09-18T12:49:19.708 INFO:tasks.workunit.client.1.smithi148.stdout:6/673: link d5/d1a/dc/d2b/d35/d65/c44 d5/d79/d7c/cd4 0 2024-09-18T12:49:19.709 INFO:tasks.workunit.client.1.smithi148.stdout:2/570: mkdir d9/d24/d67/dc7/dce 0 2024-09-18T12:49:19.709 INFO:tasks.workunit.client.1.smithi148.stdout:1/643: dwrite dc/d11/d38/d87/d2b/fa0 [0,4194304] 0 2024-09-18T12:49:19.712 INFO:tasks.workunit.client.1.smithi148.stdout:5/667: read - d7/d8/dc/d12/d31/d5a/fb3 zero size 2024-09-18T12:49:19.712 INFO:tasks.workunit.client.1.smithi148.stdout:4/648: read d15/d17/f1c [6673997,110747] 0 2024-09-18T12:49:19.712 INFO:tasks.workunit.client.1.smithi148.stdout:8/729: link d8/d12/d46/d7e/da1/ff1 d8/d16/d27/ffb 0 2024-09-18T12:49:19.714 INFO:tasks.workunit.client.1.smithi148.stdout:1/644: chown la 183251 1 2024-09-18T12:49:19.714 INFO:tasks.workunit.client.1.smithi148.stdout:6/674: unlink d5/d1a/d29/l70 0 2024-09-18T12:49:19.714 INFO:tasks.workunit.client.1.smithi148.stdout:5/668: stat d7/d8/dc/d12/d31/cce 0 2024-09-18T12:49:19.715 INFO:tasks.workunit.client.1.smithi148.stdout:0/818: truncate de/d27/d53/d89/f107 480929 0 2024-09-18T12:49:19.716 INFO:tasks.workunit.client.1.smithi148.stdout:7/673: readlink db/dc/df/d1d/l20 0 2024-09-18T12:49:19.717 INFO:tasks.workunit.client.1.smithi148.stdout:0/819: write de/d27/f45 [366513,60945] 0 2024-09-18T12:49:19.719 INFO:tasks.workunit.client.1.smithi148.stdout:8/730: chown d8/d12/d51/cbe 22 1 2024-09-18T12:49:19.721 INFO:tasks.workunit.client.1.smithi148.stdout:4/649: dread d15/d5f/f71 [0,4194304] 0 2024-09-18T12:49:19.722 INFO:tasks.workunit.client.1.smithi148.stdout:2/571: mknod d9/d24/d31/ccf 0 2024-09-18T12:49:19.724 INFO:tasks.workunit.client.1.smithi148.stdout:5/669: fsync d7/d8/dc/d12/f45 0 2024-09-18T12:49:19.725 INFO:tasks.workunit.client.1.smithi148.stdout:3/608: link d4/d8/d20/d2b/d43/f21 d4/d8/d1e/d6b/d31/d54/fd4 0 2024-09-18T12:49:19.725 INFO:tasks.workunit.client.1.smithi148.stdout:4/650: chown d15/d17/d52/d92/d4c/d72 3 1 2024-09-18T12:49:19.727 INFO:tasks.workunit.client.1.smithi148.stdout:7/674: unlink db/dc/f28 0 2024-09-18T12:49:19.727 INFO:tasks.workunit.client.1.smithi148.stdout:5/670: readlink d7/d8/dc/d12/d1f/l27 0 2024-09-18T12:49:19.728 INFO:tasks.workunit.client.1.smithi148.stdout:8/731: dwrite d8/fec [0,4194304] 0 2024-09-18T12:49:19.730 INFO:tasks.workunit.client.1.smithi148.stdout:5/671: write d7/d2b/f3c [5452464,97773] 0 2024-09-18T12:49:19.730 INFO:tasks.workunit.client.1.smithi148.stdout:1/645: unlink dc/d51/f83 0 2024-09-18T12:49:19.733 INFO:tasks.workunit.client.1.smithi148.stdout:6/675: dwrite d5/d1a/f47 [0,4194304] 0 2024-09-18T12:49:19.734 INFO:tasks.workunit.client.1.smithi148.stdout:0/820: rename de/d27/d53/d89/dbb/db5/l115 to de/d27/d53/d89/dc0/dbd/l117 0 2024-09-18T12:49:19.737 INFO:tasks.workunit.client.1.smithi148.stdout:2/572: mknod d9/d73/cd0 0 2024-09-18T12:49:19.738 INFO:tasks.workunit.client.1.smithi148.stdout:3/609: rmdir d4/d8/d1e/d6b/d31 39 2024-09-18T12:49:19.743 INFO:tasks.workunit.client.1.smithi148.stdout:0/821: symlink de/d14/d43/l118 0 2024-09-18T12:49:19.744 INFO:tasks.workunit.client.1.smithi148.stdout:6/676: chown d5/d1a/dc/d2b/d35/d65/fb8 114776 1 2024-09-18T12:49:19.745 INFO:tasks.workunit.client.1.smithi148.stdout:5/672: truncate d7/d8/dc/d12/d31/d5a/fcc 876899 0 2024-09-18T12:49:19.748 INFO:tasks.workunit.client.1.smithi148.stdout:8/732: dwrite d8/d16/f9d [0,4194304] 0 2024-09-18T12:49:19.748 INFO:tasks.workunit.client.1.smithi148.stdout:3/610: mknod d4/d8/d6a/db3/db7/cd5 0 2024-09-18T12:49:19.749 INFO:tasks.workunit.client.1.smithi148.stdout:2/573: chown d9/d24/d31/d9d/fcb 42 1 2024-09-18T12:49:19.749 INFO:tasks.workunit.client.1.smithi148.stdout:7/675: dwrite db/dc/df/d2c/d55/f6e [0,4194304] 0 2024-09-18T12:49:19.750 INFO:tasks.workunit.client.1.smithi148.stdout:0/822: chown de/d27/d53/d89/dbb/f9f 3 1 2024-09-18T12:49:19.752 INFO:tasks.workunit.client.1.smithi148.stdout:4/651: truncate d15/d17/d52/d92/d4c/d4f/f3d 1344556 0 2024-09-18T12:49:19.753 INFO:tasks.workunit.client.1.smithi148.stdout:9/635: dwrite d8/da/dd/d65/f6d [0,4194304] 0 2024-09-18T12:49:19.756 INFO:tasks.workunit.client.1.smithi148.stdout:9/636: chown d8/f25 546 1 2024-09-18T12:49:19.757 INFO:tasks.workunit.client.1.smithi148.stdout:5/673: symlink d7/d8/dc/d12/d1f/d25/le3 0 2024-09-18T12:49:19.757 INFO:tasks.workunit.client.1.smithi148.stdout:3/611: chown d4/d8/d20/c64 211729508 1 2024-09-18T12:49:19.758 INFO:tasks.workunit.client.1.smithi148.stdout:0/823: write de/d27/d53/d89/dbb/dc8/f111 [526523,72364] 0 2024-09-18T12:49:19.765 INFO:tasks.workunit.client.1.smithi148.stdout:4/652: rmdir d15/d17/d52/d92/d4c/dd0 39 2024-09-18T12:49:19.766 INFO:tasks.workunit.client.1.smithi148.stdout:8/733: mknod d8/d16/d53/cfc 0 2024-09-18T12:49:19.766 INFO:tasks.workunit.client.1.smithi148.stdout:2/574: rename d9/d24/d47/f87 to d9/d73/fd1 0 2024-09-18T12:49:19.766 INFO:tasks.workunit.client.1.smithi148.stdout:6/677: creat d5/d1a/dc/d2b/d35/d65/d99/fd5 x:0 0 0 2024-09-18T12:49:19.768 INFO:tasks.workunit.client.1.smithi148.stdout:8/734: write d8/df/f10 [3662320,46314] 0 2024-09-18T12:49:19.773 INFO:tasks.workunit.client.1.smithi148.stdout:2/575: dread d9/d24/d47/f63 [0,4194304] 0 2024-09-18T12:49:19.773 INFO:tasks.workunit.client.1.smithi148.stdout:4/653: dwrite d15/d17/d52/d68/fa2 [0,4194304] 0 2024-09-18T12:49:19.785 INFO:tasks.workunit.client.1.smithi148.stdout:9/637: unlink d8/da/dd/f31 0 2024-09-18T12:49:19.786 INFO:tasks.workunit.client.1.smithi148.stdout:0/824: chown de/d27/l98 182584910 1 2024-09-18T12:49:19.786 INFO:tasks.workunit.client.1.smithi148.stdout:9/638: stat d8/da/dd/d35/d47/d62/d72/l92 0 2024-09-18T12:49:19.787 INFO:tasks.workunit.client.1.smithi148.stdout:9/639: chown d8/da/dd/d4a 101761504 1 2024-09-18T12:49:19.788 INFO:tasks.workunit.client.1.smithi148.stdout:9/640: chown d8/da/dd/d35/d47/d62/c3e 767 1 2024-09-18T12:49:19.790 INFO:tasks.workunit.client.1.smithi148.stdout:7/676: mknod db/d52/d4f/dc8/cc9 0 2024-09-18T12:49:19.791 INFO:tasks.workunit.client.1.smithi148.stdout:3/612: symlink d4/d8/d20/ld6 0 2024-09-18T12:49:19.791 INFO:tasks.workunit.client.1.smithi148.stdout:7/677: stat db/dc/df/d5f 0 2024-09-18T12:49:19.793 INFO:tasks.workunit.client.1.smithi148.stdout:9/641: creat d8/da/dd/d65/fc3 x:0 0 0 2024-09-18T12:49:19.794 INFO:tasks.workunit.client.1.smithi148.stdout:4/654: truncate d15/f16 3402089 0 2024-09-18T12:49:19.795 INFO:tasks.workunit.client.1.smithi148.stdout:5/674: symlink d7/d8/d18/d3f/d7c/d7d/dbc/le4 0 2024-09-18T12:49:19.796 INFO:tasks.workunit.client.1.smithi148.stdout:7/678: mknod db/dc/df/cca 0 2024-09-18T12:49:19.798 INFO:tasks.workunit.client.1.smithi148.stdout:9/642: rmdir d8/da/dd/d4a/d49/d46/d54 39 2024-09-18T12:49:19.799 INFO:tasks.workunit.client.1.smithi148.stdout:4/655: write d15/d90/fbe [687489,62323] 0 2024-09-18T12:49:19.803 INFO:tasks.workunit.client.1.smithi148.stdout:9/643: write d8/f22 [2966757,119591] 0 2024-09-18T12:49:19.805 INFO:tasks.workunit.client.1.smithi148.stdout:5/675: fsync d7/d8/f3e 0 2024-09-18T12:49:19.808 INFO:tasks.workunit.client.1.smithi148.stdout:4/656: dwrite d15/fd1 [0,4194304] 0 2024-09-18T12:49:19.810 INFO:tasks.workunit.client.1.smithi148.stdout:4/657: fsync d15/d17/d52/f8b 0 2024-09-18T12:49:19.812 INFO:tasks.workunit.client.1.smithi148.stdout:3/613: rename d4/d8/cbe to d4/d8/d1e/d6b/cd7 0 2024-09-18T12:49:19.815 INFO:tasks.workunit.client.1.smithi148.stdout:5/676: dwrite d7/d8/f87 [0,4194304] 0 2024-09-18T12:49:19.816 INFO:tasks.workunit.client.1.smithi148.stdout:6/678: dread d5/d1a/dc/f20 [0,4194304] 0 2024-09-18T12:49:19.823 INFO:tasks.workunit.client.1.smithi148.stdout:4/658: rename d15/f3a to d15/d17/d52/d92/d4c/fd9 0 2024-09-18T12:49:19.824 INFO:tasks.workunit.client.1.smithi148.stdout:0/825: truncate de/f11 5092022 0 2024-09-18T12:49:19.824 INFO:tasks.workunit.client.1.smithi148.stdout:3/614: creat d4/fd8 x:0 0 0 2024-09-18T12:49:19.827 INFO:tasks.workunit.client.1.smithi148.stdout:9/644: dwrite d8/da/dd/d4a/d49/d46/d54/faa [0,4194304] 0 2024-09-18T12:49:19.831 INFO:tasks.workunit.client.1.smithi148.stdout:3/615: write d4/f89 [3611144,106286] 0 2024-09-18T12:49:19.832 INFO:tasks.workunit.client.1.smithi148.stdout:5/677: dwrite d7/d8/dc/d12/d97/fba [0,4194304] 0 2024-09-18T12:49:19.832 INFO:tasks.workunit.client.1.smithi148.stdout:0/826: chown de/d14/l20 34933079 1 2024-09-18T12:49:19.835 INFO:tasks.workunit.client.1.smithi148.stdout:4/659: rename d15/d17/d52/d92/d4c/f83 to d15/d5f/d69/d7f/d94/fda 0 2024-09-18T12:49:19.840 INFO:tasks.workunit.client.1.smithi148.stdout:8/735: dwrite d8/d16/fde [0,4194304] 0 2024-09-18T12:49:19.843 INFO:tasks.workunit.client.1.smithi148.stdout:4/660: truncate fe 1721059 0 2024-09-18T12:49:19.843 INFO:tasks.workunit.client.1.smithi148.stdout:9/645: rename d8/da/dd/d3f/d5d/cb6 to d8/da/dd/d3f/cc4 0 2024-09-18T12:49:19.845 INFO:tasks.workunit.client.1.smithi148.stdout:3/616: truncate d4/d8/d1e/d63/f86 1239817 0 2024-09-18T12:49:19.848 INFO:tasks.workunit.client.1.smithi148.stdout:6/679: write d5/d79/f8d [81235,112658] 0 2024-09-18T12:49:19.848 INFO:tasks.workunit.client.1.smithi148.stdout:7/679: dwrite db/dc/df/d11/f6b [0,4194304] 0 2024-09-18T12:49:19.852 INFO:tasks.workunit.client.1.smithi148.stdout:5/678: dwrite d7/d2b/fcf [0,4194304] 0 2024-09-18T12:49:19.852 INFO:tasks.workunit.client.1.smithi148.stdout:8/736: creat d8/d12/d46/d74/dd5/ffd x:0 0 0 2024-09-18T12:49:19.852 INFO:tasks.workunit.client.1.smithi148.stdout:6/680: readlink d5/d1a/dc/d2b/l36 0 2024-09-18T12:49:19.854 INFO:tasks.workunit.client.1.smithi148.stdout:5/679: chown d7/d8/dc/d12/d1f/l27 5 1 2024-09-18T12:49:19.856 INFO:tasks.workunit.client.1.smithi148.stdout:9/646: symlink d8/da/dd/d4a/d49/d46/d54/lc5 0 2024-09-18T12:49:19.856 INFO:tasks.workunit.client.1.smithi148.stdout:5/680: read - d7/d8/dc/d12/d1f/d39/fc8 zero size 2024-09-18T12:49:19.857 INFO:tasks.workunit.client.1.smithi148.stdout:7/680: mkdir db/dc/df/d5f/dcb 0 2024-09-18T12:49:19.858 INFO:tasks.workunit.client.1.smithi148.stdout:4/661: mknod d15/d17/d52/d92/d4c/dd0/cdb 0 2024-09-18T12:49:19.860 INFO:tasks.workunit.client.1.smithi148.stdout:9/647: truncate d8/da/dd/d65/fc3 106369 0 2024-09-18T12:49:19.860 INFO:tasks.workunit.client.1.smithi148.stdout:4/662: readlink d15/d5f/l70 0 2024-09-18T12:49:19.860 INFO:tasks.workunit.client.1.smithi148.stdout:7/681: read db/dc/df/d11/f65 [957243,20097] 0 2024-09-18T12:49:19.863 INFO:tasks.workunit.client.1.smithi148.stdout:6/681: rename d5/d32/f33 to d5/d1a/dc/fd6 0 2024-09-18T12:49:19.934 INFO:tasks.workunit.client.0.smithi078.stdout:4/412: sync 2024-09-18T12:49:19.956 INFO:tasks.workunit.client.1.smithi148.stdout:1/646: sync 2024-09-18T12:49:19.956 INFO:tasks.workunit.client.1.smithi148.stdout:2/576: sync 2024-09-18T12:49:19.972 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:19 smithi148 ceph-mon[35352]: from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:19.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:19 smithi148 ceph-mon[35352]: pgmap v17: 65 pgs: 65 active+clean; 2.1 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 74 MiB/s rd, 263 MiB/s wr, 489 op/s 2024-09-18T12:49:19.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:19 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/836873046' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:49:19.977 INFO:tasks.workunit.client.0.smithi078.stdout:4/413: truncate d11/d27/d5a/d84/d40/f58 820738 0 2024-09-18T12:49:19.977 INFO:tasks.workunit.client.0.smithi078.stdout:4/414: dread - d11/d27/d5a/f70 zero size 2024-09-18T12:49:19.978 INFO:tasks.workunit.client.1.smithi148.stdout:7/682: mkdir db/dc/df/d11/dcc 0 2024-09-18T12:49:19.980 INFO:tasks.workunit.client.1.smithi148.stdout:4/663: creat d15/d17/d52/d92/d4c/d4f/d64/d9a/fdc x:0 0 0 2024-09-18T12:49:19.981 INFO:tasks.workunit.client.1.smithi148.stdout:4/664: write d15/d17/d52/d68/f96 [27678,76176] 0 2024-09-18T12:49:19.983 INFO:tasks.workunit.client.1.smithi148.stdout:8/737: rename d8/df/d3e/d82/d8f/d95/de4 to d8/d16/d27/dc5/dee/dfe 0 2024-09-18T12:49:19.986 INFO:tasks.workunit.client.0.smithi078.stdout:4/415: rename d11/d45/f8a to d11/d27/d5a/d84/d40/f8b 0 2024-09-18T12:49:19.991 INFO:tasks.workunit.client.0.smithi078.stdout:4/416: creat d11/d45/f8c x:0 0 0 2024-09-18T12:49:19.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:19 smithi078 ceph-mon[28091]: from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:19.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:19 smithi078 ceph-mon[28091]: pgmap v17: 65 pgs: 65 active+clean; 2.1 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 74 MiB/s rd, 263 MiB/s wr, 489 op/s 2024-09-18T12:49:19.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:19 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/836873046' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:49:19.992 INFO:tasks.workunit.client.1.smithi148.stdout:3/617: getdents d4/d8/d1e/d6b/d31/d60 0 2024-09-18T12:49:19.995 INFO:tasks.workunit.client.1.smithi148.stdout:1/647: creat dc/d18/d7d/d93/fd4 x:0 0 0 2024-09-18T12:49:19.997 INFO:tasks.workunit.client.0.smithi078.stdout:4/417: write d11/f16 [6916342,112018] 0 2024-09-18T12:49:19.998 INFO:tasks.workunit.client.1.smithi148.stdout:5/681: dwrite d7/d8/dc/d12/d31/f48 [0,4194304] 0 2024-09-18T12:49:19.999 INFO:tasks.workunit.client.1.smithi148.stdout:2/577: creat d9/d24/d31/d34/d42/fd2 x:0 0 0 2024-09-18T12:49:20.004 INFO:tasks.workunit.client.0.smithi078.stdout:4/418: mknod d11/d27/d5a/d84/d40/c8d 0 2024-09-18T12:49:20.004 INFO:tasks.workunit.client.1.smithi148.stdout:0/827: sync 2024-09-18T12:49:20.005 INFO:tasks.workunit.client.1.smithi148.stdout:0/828: write de/d27/db3/f104 [20437,48908] 0 2024-09-18T12:49:20.009 INFO:tasks.workunit.client.1.smithi148.stdout:8/738: fdatasync d8/d16/d53/d39/d3b/d4e/fa2 0 2024-09-18T12:49:20.017 INFO:tasks.workunit.client.0.smithi078.stdout:4/419: creat d11/d27/d5a/d5d/f8e x:0 0 0 2024-09-18T12:49:20.019 INFO:tasks.workunit.client.0.smithi078.stdout:4/420: dread d11/d27/d5a/d84/d40/f6c [0,4194304] 0 2024-09-18T12:49:20.019 INFO:tasks.workunit.client.1.smithi148.stdout:3/618: rmdir d4/d8/d20/d99 39 2024-09-18T12:49:20.019 INFO:tasks.workunit.client.1.smithi148.stdout:3/619: chown d4/d8/d1e/d63 17 1 2024-09-18T12:49:20.020 INFO:tasks.workunit.client.0.smithi078.stdout:4/421: write d11/d27/d5a/d84/f2d [666917,110764] 0 2024-09-18T12:49:20.021 INFO:tasks.workunit.client.1.smithi148.stdout:1/648: symlink dc/d5b/ld5 0 2024-09-18T12:49:20.024 INFO:tasks.workunit.client.0.smithi078.stdout:4/422: chown d11/d27/d5a/d84/f3a 374 1 2024-09-18T12:49:20.025 INFO:tasks.workunit.client.0.smithi078.stdout:4/423: truncate d11/d27/d5a/d84/f72 251319 0 2024-09-18T12:49:20.025 INFO:tasks.workunit.client.0.smithi078.stdout:4/424: write d11/d27/d47/f5f [1061806,108335] 0 2024-09-18T12:49:20.030 INFO:tasks.workunit.client.1.smithi148.stdout:5/682: symlink d7/d8/d18/d3f/d7c/d7d/dbc/le5 0 2024-09-18T12:49:20.032 INFO:tasks.workunit.client.1.smithi148.stdout:5/683: write d7/d8/dc/d12/d1f/d25/d4b/dae/fc5 [2491994,128828] 0 2024-09-18T12:49:20.033 INFO:tasks.workunit.client.1.smithi148.stdout:0/829: truncate de/d14/f25 1438221 0 2024-09-18T12:49:20.041 INFO:tasks.workunit.client.1.smithi148.stdout:0/830: dwrite de/d27/db3/f104 [0,4194304] 0 2024-09-18T12:49:20.041 INFO:tasks.workunit.client.1.smithi148.stdout:5/684: dread d7/d8/dc/d12/f51 [0,4194304] 0 2024-09-18T12:49:20.044 INFO:tasks.workunit.client.1.smithi148.stdout:1/649: unlink dc/d4d/l95 0 2024-09-18T12:49:20.047 INFO:tasks.workunit.client.1.smithi148.stdout:0/831: fsync de/d14/f28 0 2024-09-18T12:49:20.050 INFO:tasks.workunit.client.1.smithi148.stdout:1/650: mkdir dc/d51/dd6 0 2024-09-18T12:49:20.054 INFO:tasks.workunit.client.1.smithi148.stdout:0/832: read de/d27/d2e/feb [192492,76299] 0 2024-09-18T12:49:20.055 INFO:tasks.workunit.client.1.smithi148.stdout:1/651: creat dc/d11/d38/d87/d2b/d80/fd7 x:0 0 0 2024-09-18T12:49:20.057 INFO:tasks.workunit.client.1.smithi148.stdout:8/739: mkdir d8/d16/dff 0 2024-09-18T12:49:20.058 INFO:tasks.workunit.client.1.smithi148.stdout:1/652: write dc/d11/d38/d87/f21 [1413000,52381] 0 2024-09-18T12:49:20.059 INFO:tasks.workunit.client.1.smithi148.stdout:0/833: dread de/d27/fae [0,4194304] 0 2024-09-18T12:49:20.059 INFO:tasks.workunit.client.1.smithi148.stdout:1/653: stat dc/d11/d38/d87/d2b 0 2024-09-18T12:49:20.060 INFO:tasks.workunit.client.1.smithi148.stdout:8/740: symlink d8/d16/d53/da0/dba/l100 0 2024-09-18T12:49:20.062 INFO:tasks.workunit.client.1.smithi148.stdout:1/654: read dc/d11/f12 [699659,119598] 0 2024-09-18T12:49:20.063 INFO:tasks.workunit.client.1.smithi148.stdout:8/741: symlink d8/d16/d53/d39/def/l101 0 2024-09-18T12:49:20.067 INFO:tasks.workunit.client.1.smithi148.stdout:0/834: getdents de/d27/d53 0 2024-09-18T12:49:20.068 INFO:tasks.workunit.client.1.smithi148.stdout:8/742: creat d8/df/d3e/d82/d8f/f102 x:0 0 0 2024-09-18T12:49:20.069 INFO:tasks.workunit.client.1.smithi148.stdout:0/835: mkdir de/d27/d2e/d119 0 2024-09-18T12:49:20.070 INFO:tasks.workunit.client.1.smithi148.stdout:4/665: creat d15/d17/d52/fdd x:0 0 0 2024-09-18T12:49:20.072 INFO:tasks.workunit.client.1.smithi148.stdout:3/620: dread d4/d8/d1e/d6b/d31/f65 [0,4194304] 0 2024-09-18T12:49:20.073 INFO:tasks.workunit.client.1.smithi148.stdout:3/621: chown d4/d8/f23 1407795 1 2024-09-18T12:49:20.079 INFO:tasks.workunit.client.1.smithi148.stdout:3/622: dwrite d4/d8/d1e/d6b/d31/f58 [0,4194304] 0 2024-09-18T12:49:20.080 INFO:tasks.workunit.client.1.smithi148.stdout:9/648: write d8/da/dd/d65/f76 [1652966,17247] 0 2024-09-18T12:49:20.081 INFO:tasks.workunit.client.1.smithi148.stdout:3/623: fdatasync d4/d8/d1e/d6b/d31/d54/f67 0 2024-09-18T12:49:20.083 INFO:tasks.workunit.client.1.smithi148.stdout:8/743: mkdir d8/d12/d46/d103 0 2024-09-18T12:49:20.083 INFO:tasks.workunit.client.1.smithi148.stdout:9/649: dread - d8/da/dd/d35/f9b zero size 2024-09-18T12:49:20.085 INFO:tasks.workunit.client.1.smithi148.stdout:3/624: readlink d4/d8/d1e/d6b/d31/l5a 0 2024-09-18T12:49:20.087 INFO:tasks.workunit.client.1.smithi148.stdout:9/650: mkdir d8/da/dd/d35/d81/dc6 0 2024-09-18T12:49:20.087 INFO:tasks.workunit.client.1.smithi148.stdout:3/625: chown d4/d8/d1e/d6b/c4e 26718 1 2024-09-18T12:49:20.089 INFO:tasks.workunit.client.1.smithi148.stdout:3/626: readlink d4/d8/d6a/l75 0 2024-09-18T12:49:20.091 INFO:tasks.workunit.client.1.smithi148.stdout:8/744: dwrite d8/fec [0,4194304] 0 2024-09-18T12:49:20.093 INFO:tasks.workunit.client.1.smithi148.stdout:8/745: stat d8/d12/d46/d7e 0 2024-09-18T12:49:20.097 INFO:tasks.workunit.client.1.smithi148.stdout:6/682: truncate d5/d1a/dc/d2b/d9b/f9e 2382098 0 2024-09-18T12:49:20.098 INFO:tasks.workunit.client.1.smithi148.stdout:9/651: dwrite d8/f22 [0,4194304] 0 2024-09-18T12:49:20.102 INFO:tasks.workunit.client.1.smithi148.stdout:2/578: write d9/d24/f28 [127276,37597] 0 2024-09-18T12:49:20.102 INFO:tasks.workunit.client.1.smithi148.stdout:9/652: symlink d8/d6f/lc7 0 2024-09-18T12:49:20.103 INFO:tasks.workunit.client.0.smithi078.stdout:4/425: write d11/d27/d5a/d84/f63 [3062587,29646] 0 2024-09-18T12:49:20.105 INFO:tasks.workunit.client.0.smithi078.stdout:4/426: write d11/d27/d5a/d84/d40/f6f [661077,114095] 0 2024-09-18T12:49:20.106 INFO:tasks.workunit.client.1.smithi148.stdout:7/683: dwrite db/dc/df/d2c/d55/f73 [4194304,4194304] 0 2024-09-18T12:49:20.110 INFO:tasks.workunit.client.1.smithi148.stdout:6/683: creat d5/d1a/fd7 x:0 0 0 2024-09-18T12:49:20.110 INFO:tasks.workunit.client.1.smithi148.stdout:8/746: dwrite d8/d16/d53/d39/d3b/f6a [0,4194304] 0 2024-09-18T12:49:20.110 INFO:tasks.workunit.client.0.smithi078.stdout:4/427: creat d11/d27/d47/d4e/d76/f8f x:0 0 0 2024-09-18T12:49:20.113 INFO:tasks.workunit.client.0.smithi078.stdout:4/428: stat d11/l2a 0 2024-09-18T12:49:20.115 INFO:tasks.workunit.client.1.smithi148.stdout:6/684: mknod d5/d1a/d29/cd8 0 2024-09-18T12:49:20.116 INFO:tasks.workunit.client.1.smithi148.stdout:6/685: readlink d5/d1a/dc/d2b/d35/d65/lc7 0 2024-09-18T12:49:20.117 INFO:tasks.workunit.client.1.smithi148.stdout:0/836: rename de/d27/f9a to de/d14/d43/d57/d59/f11a 0 2024-09-18T12:49:20.120 INFO:tasks.workunit.client.1.smithi148.stdout:2/579: creat d9/d3a/fd3 x:0 0 0 2024-09-18T12:49:20.122 INFO:tasks.workunit.client.1.smithi148.stdout:7/684: creat db/dc/df/d1d/d68/d7a/fcd x:0 0 0 2024-09-18T12:49:20.123 INFO:tasks.workunit.client.1.smithi148.stdout:7/685: fdatasync db/dc/df/d2c/d55/daf/d38/f3f 0 2024-09-18T12:49:20.125 INFO:tasks.workunit.client.1.smithi148.stdout:2/580: write d9/d24/d67/d72/fb6 [1086765,2226] 0 2024-09-18T12:49:20.127 INFO:tasks.workunit.client.1.smithi148.stdout:7/686: rmdir db/dc/df/d5f 39 2024-09-18T12:49:20.132 INFO:tasks.workunit.client.1.smithi148.stdout:7/687: chown db/dc/df/d1d/d68/d7a 294375 1 2024-09-18T12:49:20.132 INFO:tasks.workunit.client.1.smithi148.stdout:1/655: write dc/d18/d31/d4b/f6d [91638,96098] 0 2024-09-18T12:49:20.133 INFO:tasks.workunit.client.1.smithi148.stdout:0/837: getdents de/d27/d2e 0 2024-09-18T12:49:20.134 INFO:tasks.workunit.client.1.smithi148.stdout:8/747: dread d8/d16/faf [0,4194304] 0 2024-09-18T12:49:20.135 INFO:tasks.workunit.client.1.smithi148.stdout:3/627: mkdir d4/d8/d20/d2b/d7f/dd9 0 2024-09-18T12:49:20.135 INFO:tasks.workunit.client.1.smithi148.stdout:5/685: dwrite d7/d8/dc/f5d [0,4194304] 0 2024-09-18T12:49:20.135 INFO:tasks.workunit.client.1.smithi148.stdout:2/581: read d9/d17/d29/d92/d95/f38 [2825309,84907] 0 2024-09-18T12:49:20.137 INFO:tasks.workunit.client.1.smithi148.stdout:1/656: fdatasync dc/d18/d31/d39/f75 0 2024-09-18T12:49:20.138 INFO:tasks.workunit.client.1.smithi148.stdout:3/628: readlink d4/d8/d1e/d6b/d31/lbd 0 2024-09-18T12:49:20.138 INFO:tasks.workunit.client.1.smithi148.stdout:7/688: mknod db/dc/df/d2c/d55/daf/cce 0 2024-09-18T12:49:20.138 INFO:tasks.workunit.client.1.smithi148.stdout:2/582: stat d9/d24/d31/d34/l6f 0 2024-09-18T12:49:20.140 INFO:tasks.workunit.client.1.smithi148.stdout:3/629: rename d4/d8 to d4/d8/d1e/d79/dda 22 2024-09-18T12:49:20.140 INFO:tasks.workunit.client.1.smithi148.stdout:0/838: creat de/d27/d53/d89/dc0/f11b x:0 0 0 2024-09-18T12:49:20.141 INFO:tasks.workunit.client.1.smithi148.stdout:8/748: rmdir d8/d16/d53/d39/def 39 2024-09-18T12:49:20.142 INFO:tasks.workunit.client.1.smithi148.stdout:8/749: fsync d8/d16/f2a 0 2024-09-18T12:49:20.142 INFO:tasks.workunit.client.0.smithi078.stdout:4/429: dread d11/f38 [0,4194304] 0 2024-09-18T12:49:20.142 INFO:tasks.workunit.client.1.smithi148.stdout:8/750: readlink d8/d16/d27/l91 0 2024-09-18T12:49:20.144 INFO:tasks.workunit.client.1.smithi148.stdout:9/653: dread d8/d33/f42 [0,4194304] 0 2024-09-18T12:49:20.144 INFO:tasks.workunit.client.1.smithi148.stdout:1/657: rmdir dc/d4d 39 2024-09-18T12:49:20.146 INFO:tasks.workunit.client.1.smithi148.stdout:5/686: creat d7/d8/dc/d12/d1f/d69/d8b/dad/fe6 x:0 0 0 2024-09-18T12:49:20.147 INFO:tasks.workunit.client.1.smithi148.stdout:2/583: mknod d9/d17/d29/cd4 0 2024-09-18T12:49:20.148 INFO:tasks.workunit.client.1.smithi148.stdout:3/630: mknod d4/d8/d20/d2b/d43/cdb 0 2024-09-18T12:49:20.148 INFO:tasks.workunit.client.1.smithi148.stdout:2/584: chown d9/d73/cb0 5642619 1 2024-09-18T12:49:20.149 INFO:tasks.workunit.client.1.smithi148.stdout:8/751: dwrite d8/f92 [0,4194304] 0 2024-09-18T12:49:20.152 INFO:tasks.workunit.client.0.smithi078.stdout:4/430: creat d11/d27/d5a/d5d/f90 x:0 0 0 2024-09-18T12:49:20.154 INFO:tasks.workunit.client.0.smithi078.stdout:4/431: write d11/d27/d5a/d84/d4b/f82 [990034,101427] 0 2024-09-18T12:49:20.154 INFO:tasks.workunit.client.1.smithi148.stdout:9/654: rmdir d8/da/dd/d3f/d5d 39 2024-09-18T12:49:20.154 INFO:tasks.workunit.client.1.smithi148.stdout:4/666: sync 2024-09-18T12:49:20.156 INFO:tasks.workunit.client.1.smithi148.stdout:5/687: creat d7/d8/dc/d12/d1f/d39/dd5/fe7 x:0 0 0 2024-09-18T12:49:20.157 INFO:tasks.workunit.client.1.smithi148.stdout:5/688: chown d7/d8/dc/d12/d31/d5a 29330 1 2024-09-18T12:49:20.161 INFO:tasks.workunit.client.1.smithi148.stdout:2/585: creat d9/d24/d31/d34/d7b/fd5 x:0 0 0 2024-09-18T12:49:20.164 INFO:tasks.workunit.client.1.smithi148.stdout:8/752: mknod d8/df/d3e/d82/d8f/d95/c104 0 2024-09-18T12:49:20.167 INFO:tasks.workunit.client.1.smithi148.stdout:4/667: mkdir d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/dde 0 2024-09-18T12:49:20.168 INFO:tasks.workunit.client.1.smithi148.stdout:3/631: creat d4/d8/d20/d2b/d7f/d93/dd1/fdc x:0 0 0 2024-09-18T12:49:20.169 INFO:tasks.workunit.client.1.smithi148.stdout:8/753: symlink d8/d16/d27/dc5/dee/l105 0 2024-09-18T12:49:20.171 INFO:tasks.workunit.client.1.smithi148.stdout:9/655: rename d8/da/dd/d3f/d5d/f83 to d8/d73/fc8 0 2024-09-18T12:49:20.172 INFO:tasks.workunit.client.1.smithi148.stdout:1/658: creat dc/d11/d38/d87/fd8 x:0 0 0 2024-09-18T12:49:20.173 INFO:tasks.workunit.client.1.smithi148.stdout:5/689: symlink d7/le8 0 2024-09-18T12:49:20.175 INFO:tasks.workunit.client.1.smithi148.stdout:2/586: mkdir d9/d17/d29/d92/d95/dd6 0 2024-09-18T12:49:20.175 INFO:tasks.workunit.client.0.smithi078.stdout:4/432: dread d11/d27/d47/d4e/f65 [0,4194304] 0 2024-09-18T12:49:20.176 INFO:tasks.workunit.client.0.smithi078.stdout:4/433: fdatasync d11/d27/d5a/f5e 0 2024-09-18T12:49:20.176 INFO:tasks.workunit.client.1.smithi148.stdout:5/690: write d7/d8/f13 [2391573,58875] 0 2024-09-18T12:49:20.179 INFO:tasks.workunit.client.1.smithi148.stdout:6/686: write d5/d1a/dc/d2b/d9b/f9e [722564,58548] 0 2024-09-18T12:49:20.180 INFO:tasks.workunit.client.0.smithi078.stdout:4/434: read d11/f14 [864966,58046] 0 2024-09-18T12:49:20.182 INFO:tasks.workunit.client.1.smithi148.stdout:6/687: dread - d5/d79/fcc zero size 2024-09-18T12:49:20.182 INFO:tasks.workunit.client.1.smithi148.stdout:3/632: dread d4/d8/d1e/d6b/d31/f34 [0,4194304] 0 2024-09-18T12:49:20.182 INFO:tasks.workunit.client.1.smithi148.stdout:9/656: dread d8/da/dd/f1b [0,4194304] 0 2024-09-18T12:49:20.183 INFO:tasks.workunit.client.1.smithi148.stdout:7/689: truncate db/dc/df/d2c/d66/da0/fc1 96577 0 2024-09-18T12:49:20.186 INFO:tasks.workunit.client.0.smithi078.stdout:4/435: dwrite d11/d27/d5a/f64 [0,4194304] 0 2024-09-18T12:49:20.187 INFO:tasks.workunit.client.0.smithi078.stdout:4/436: write d11/d27/d5a/f5e [217251,12547] 0 2024-09-18T12:49:20.189 INFO:tasks.workunit.client.1.smithi148.stdout:8/754: dread d8/d16/d53/d39/f3d [0,4194304] 0 2024-09-18T12:49:20.189 INFO:tasks.workunit.client.1.smithi148.stdout:9/657: dwrite d8/f5c [4194304,4194304] 0 2024-09-18T12:49:20.190 INFO:tasks.workunit.client.1.smithi148.stdout:7/690: creat db/dc/df/d8e/d75/fcf x:0 0 0 2024-09-18T12:49:20.192 INFO:tasks.workunit.client.1.smithi148.stdout:6/688: mknod d5/d32/d38/cd9 0 2024-09-18T12:49:20.192 INFO:tasks.workunit.client.1.smithi148.stdout:6/689: readlink d5/d1a/l92 0 2024-09-18T12:49:20.194 INFO:tasks.workunit.client.0.smithi078.stdout:4/437: rename d11/d27/d5a/d84/c52 to d11/d27/d89/c91 0 2024-09-18T12:49:20.194 INFO:tasks.workunit.client.0.smithi078.stdout:4/438: chown d11/d45/f75 649815082 1 2024-09-18T12:49:20.195 INFO:tasks.workunit.client.0.smithi078.stdout:4/439: stat d11/d27/d47/d4e/d50/l51 0 2024-09-18T12:49:20.195 INFO:tasks.workunit.client.1.smithi148.stdout:1/659: rename dc/d11/d38/d87 to dc/d18/d7d/d93/dd9 0 2024-09-18T12:49:20.196 INFO:tasks.workunit.client.0.smithi078.stdout:4/440: dread - d11/d27/d5a/d5d/f8e zero size 2024-09-18T12:49:20.197 INFO:tasks.workunit.client.0.smithi078.stdout:4/441: stat d11/d27/d5a/f79 0 2024-09-18T12:49:20.199 INFO:tasks.workunit.client.1.smithi148.stdout:1/660: truncate dc/d18/d7d/d93/dd9/d2b/fce 193669 0 2024-09-18T12:49:20.199 INFO:tasks.workunit.client.1.smithi148.stdout:6/690: mknod d5/d1a/dc/d2b/d35/d65/d99/da4/da6/cda 0 2024-09-18T12:49:20.201 INFO:tasks.workunit.client.1.smithi148.stdout:2/587: rename d9/d3a/d90/fba to d9/d17/d29/d92/d95/d64/fd7 0 2024-09-18T12:49:20.202 INFO:tasks.workunit.client.1.smithi148.stdout:4/668: truncate d15/d17/d52/d92/d4c/d4f/f8a 3090890 0 2024-09-18T12:49:20.206 INFO:tasks.workunit.client.1.smithi148.stdout:5/691: truncate d7/d8/dc/d12/d1f/d69/fc4 634432 0 2024-09-18T12:49:20.206 INFO:tasks.workunit.client.1.smithi148.stdout:1/661: fsync dc/f10 0 2024-09-18T12:49:20.207 INFO:tasks.workunit.client.1.smithi148.stdout:6/691: creat d5/d1a/dc/d2b/d35/d65/d99/da4/da6/fdb x:0 0 0 2024-09-18T12:49:20.208 INFO:tasks.workunit.client.1.smithi148.stdout:9/658: rename d8/da/dd/d4a/d27/l41 to d8/d73/lc9 0 2024-09-18T12:49:20.208 INFO:tasks.workunit.client.1.smithi148.stdout:6/692: fsync d5/d1a/dc/d2b/d35/d65/f5e 0 2024-09-18T12:49:20.209 INFO:tasks.workunit.client.1.smithi148.stdout:2/588: unlink d9/f9f 0 2024-09-18T12:49:20.209 INFO:tasks.workunit.client.1.smithi148.stdout:3/633: link d4/d8/d1e/d79/d92/l7d d4/d8/d1e/d6b/d31/d60/da9/ldd 0 2024-09-18T12:49:20.210 INFO:tasks.workunit.client.1.smithi148.stdout:4/669: truncate d15/d3f/f5a 164330 0 2024-09-18T12:49:20.210 INFO:tasks.workunit.client.1.smithi148.stdout:2/589: read - d9/d3a/d90/f9e zero size 2024-09-18T12:49:20.212 INFO:tasks.workunit.client.1.smithi148.stdout:1/662: creat dc/d11/d96/fda x:0 0 0 2024-09-18T12:49:20.212 INFO:tasks.workunit.client.1.smithi148.stdout:5/692: creat d7/d8/dc/d12/d1f/d39/dc2/fe9 x:0 0 0 2024-09-18T12:49:20.213 INFO:tasks.workunit.client.1.smithi148.stdout:4/670: dread - d15/d17/d52/d92/d4c/d4f/d64/da0/fd8 zero size 2024-09-18T12:49:20.215 INFO:tasks.workunit.client.1.smithi148.stdout:1/663: truncate dc/d9f/fbb 416045 0 2024-09-18T12:49:20.215 INFO:tasks.workunit.client.1.smithi148.stdout:5/693: write d7/d8/dc/d12/d31/d5a/fb3 [343523,36546] 0 2024-09-18T12:49:20.216 INFO:tasks.workunit.client.1.smithi148.stdout:9/659: rmdir d8/da/dd/d4a/d49/d46/d54/d90 39 2024-09-18T12:49:20.217 INFO:tasks.workunit.client.1.smithi148.stdout:8/755: dread d8/df/f10 [0,4194304] 0 2024-09-18T12:49:20.218 INFO:tasks.workunit.client.1.smithi148.stdout:2/590: creat d9/d24/d31/d34/fd8 x:0 0 0 2024-09-18T12:49:20.219 INFO:tasks.workunit.client.1.smithi148.stdout:1/664: chown dc/d18/d7d/d7e/fb9 10104 1 2024-09-18T12:49:20.220 INFO:tasks.workunit.client.1.smithi148.stdout:5/694: fsync d7/d8/f9d 0 2024-09-18T12:49:20.220 INFO:tasks.workunit.client.0.smithi078.stdout:5/570: sync 2024-09-18T12:49:20.222 INFO:tasks.workunit.client.0.smithi078.stdout:5/571: read - d2/d4/d9/da/d2b/d3e/fa9 zero size 2024-09-18T12:49:20.229 INFO:tasks.workunit.client.1.smithi148.stdout:4/671: dwrite d15/d17/d52/d92/f32 [0,4194304] 0 2024-09-18T12:49:20.229 INFO:tasks.workunit.client.1.smithi148.stdout:8/756: creat d8/d16/d27/dc5/f106 x:0 0 0 2024-09-18T12:49:20.230 INFO:tasks.workunit.client.0.smithi078.stdout:4/442: dread d11/d27/d47/f3f [0,4194304] 0 2024-09-18T12:49:20.230 INFO:tasks.workunit.client.0.smithi078.stdout:4/443: dread - d11/d27/d47/d4e/d50/f80 zero size 2024-09-18T12:49:20.230 INFO:tasks.workunit.client.0.smithi078.stdout:5/572: unlink d2/d4/d12/fa4 0 2024-09-18T12:49:20.230 INFO:tasks.workunit.client.0.smithi078.stdout:5/573: chown d2/d4/d9/da/d2b/f69 102099524 1 2024-09-18T12:49:20.231 INFO:tasks.workunit.client.1.smithi148.stdout:0/839: sync 2024-09-18T12:49:20.232 INFO:tasks.workunit.client.1.smithi148.stdout:2/591: dwrite d9/d17/f4e [0,4194304] 0 2024-09-18T12:49:20.236 INFO:tasks.workunit.client.1.smithi148.stdout:2/592: read - d9/fb4 zero size 2024-09-18T12:49:20.237 INFO:tasks.workunit.client.1.smithi148.stdout:9/660: rename d8/da/dd/d4a/d49/d46/d54/fa8 to d8/da/dd/d4a/d49/fca 0 2024-09-18T12:49:20.238 INFO:tasks.workunit.client.1.smithi148.stdout:7/691: dwrite db/dc/df/d8e/f7c [0,4194304] 0 2024-09-18T12:49:20.241 INFO:tasks.workunit.client.1.smithi148.stdout:1/665: dread dc/f57 [0,4194304] 0 2024-09-18T12:49:20.242 INFO:tasks.workunit.client.0.smithi078.stdout:4/444: creat d11/d27/d47/d4e/f92 x:0 0 0 2024-09-18T12:49:20.242 INFO:tasks.workunit.client.1.smithi148.stdout:8/757: dwrite d8/d16/d27/f76 [0,4194304] 0 2024-09-18T12:49:20.243 INFO:tasks.workunit.client.1.smithi148.stdout:7/692: stat db/dc/df/d1d/d41/c74 0 2024-09-18T12:49:20.245 INFO:tasks.workunit.client.1.smithi148.stdout:1/666: dread - dc/d18/d31/d39/fc8 zero size 2024-09-18T12:49:20.247 INFO:tasks.workunit.client.1.smithi148.stdout:8/758: write d8/d16/d53/d39/d3b/f6a [3115322,28745] 0 2024-09-18T12:49:20.248 INFO:tasks.workunit.client.0.smithi078.stdout:5/574: dread d2/d4/d12/f81 [0,4194304] 0 2024-09-18T12:49:20.250 INFO:tasks.workunit.client.1.smithi148.stdout:3/634: write d4/d8/f4f [566984,63031] 0 2024-09-18T12:49:20.251 INFO:tasks.workunit.client.1.smithi148.stdout:5/695: write d7/d8/dc/d12/d1f/d69/fab [2535730,79308] 0 2024-09-18T12:49:20.252 INFO:tasks.workunit.client.0.smithi078.stdout:5/575: truncate d2/d4/d9/da/d2b/d3e/fa9 38535 0 2024-09-18T12:49:20.253 INFO:tasks.workunit.client.1.smithi148.stdout:6/693: dwrite d5/d1a/d29/f83 [0,4194304] 0 2024-09-18T12:49:20.255 INFO:tasks.workunit.client.0.smithi078.stdout:4/445: creat d11/f93 x:0 0 0 2024-09-18T12:49:20.255 INFO:tasks.workunit.client.0.smithi078.stdout:4/446: chown d11/d27/l4d 7 1 2024-09-18T12:49:20.257 INFO:tasks.workunit.client.1.smithi148.stdout:0/840: truncate de/d14/d43/d57/d59/f99 293115 0 2024-09-18T12:49:20.260 INFO:tasks.workunit.client.1.smithi148.stdout:6/694: read - d5/d1a/fd7 zero size 2024-09-18T12:49:20.261 INFO:tasks.workunit.client.1.smithi148.stdout:2/593: truncate d9/d3a/f86 1257987 0 2024-09-18T12:49:20.261 INFO:tasks.workunit.client.1.smithi148.stdout:9/661: fdatasync d8/da/dd/d35/d47/d62/d72/f74 0 2024-09-18T12:49:20.264 INFO:tasks.workunit.client.1.smithi148.stdout:2/594: readlink d9/l68 0 2024-09-18T12:49:20.265 INFO:tasks.workunit.client.1.smithi148.stdout:5/696: chown d7/d8/dc/d12/d31/d5a/fde 1042916065 1 2024-09-18T12:49:20.265 INFO:tasks.workunit.client.0.smithi078.stdout:5/576: rename d2/d4/f7e to d2/d4/fae 0 2024-09-18T12:49:20.265 INFO:tasks.workunit.client.1.smithi148.stdout:9/662: chown f6 5372 1 2024-09-18T12:49:20.266 INFO:tasks.workunit.client.0.smithi078.stdout:4/447: link d11/d27/d5a/d84/l31 d11/d27/d5a/d84/d4b/l94 0 2024-09-18T12:49:20.268 INFO:tasks.workunit.client.1.smithi148.stdout:7/693: dwrite db/dc/df/d1d/d68/d7a/fc6 [0,4194304] 0 2024-09-18T12:49:20.270 INFO:tasks.workunit.client.0.smithi078.stdout:5/577: rmdir d2/d4/d12/d16/d36 39 2024-09-18T12:49:20.271 INFO:tasks.workunit.client.1.smithi148.stdout:2/595: write f5 [4746548,20385] 0 2024-09-18T12:49:20.271 INFO:tasks.workunit.client.0.smithi078.stdout:5/578: stat d2/d4/d9/da/l37 0 2024-09-18T12:49:20.271 INFO:tasks.workunit.client.1.smithi148.stdout:6/695: chown d5/d1a/dc/d2b/f5f 3 1 2024-09-18T12:49:20.272 INFO:tasks.workunit.client.0.smithi078.stdout:4/448: unlink c4 0 2024-09-18T12:49:20.274 INFO:tasks.workunit.client.1.smithi148.stdout:1/667: dwrite dc/d11/d96/fa1 [0,4194304] 0 2024-09-18T12:49:20.274 INFO:tasks.workunit.client.1.smithi148.stdout:8/759: dwrite d8/d16/fcf [0,4194304] 0 2024-09-18T12:49:20.275 INFO:tasks.workunit.client.0.smithi078.stdout:5/579: rename d2/d4/d12/d16/f24 to d2/d4/d9/d2f/faf 0 2024-09-18T12:49:20.276 INFO:tasks.workunit.client.1.smithi148.stdout:4/672: dread fa [0,4194304] 0 2024-09-18T12:49:20.277 INFO:tasks.workunit.client.1.smithi148.stdout:2/596: chown d9/d24/d31/d9d/fcb 11783444 1 2024-09-18T12:49:20.277 INFO:tasks.workunit.client.0.smithi078.stdout:4/449: read d11/d27/d5a/d84/f2b [11821568,1209] 0 2024-09-18T12:49:20.279 INFO:tasks.workunit.client.1.smithi148.stdout:9/663: symlink d8/da/dd/d35/d81/lcb 0 2024-09-18T12:49:20.279 INFO:tasks.workunit.client.1.smithi148.stdout:0/841: dread de/d27/d2e/f73 [0,4194304] 0 2024-09-18T12:49:20.280 INFO:tasks.workunit.client.0.smithi078.stdout:4/450: chown d11/d27/d47/f87 5 1 2024-09-18T12:49:20.282 INFO:tasks.workunit.client.1.smithi148.stdout:5/697: mknod d7/d8/dc/d12/d1f/d25/d4b/cea 0 2024-09-18T12:49:20.283 INFO:tasks.workunit.client.0.smithi078.stdout:5/580: dwrite d2/d4/d9/da/f19 [0,4194304] 0 2024-09-18T12:49:20.284 INFO:tasks.workunit.client.1.smithi148.stdout:6/696: creat d5/d79/d7c/fdc x:0 0 0 2024-09-18T12:49:20.287 INFO:tasks.workunit.client.1.smithi148.stdout:6/697: dread - d5/d1a/dc/d2b/d35/d65/d99/da4/da6/fdb zero size 2024-09-18T12:49:20.289 INFO:tasks.workunit.client.1.smithi148.stdout:5/698: dwrite d7/d8/dc/d12/f45 [0,4194304] 0 2024-09-18T12:49:20.392 INFO:tasks.workunit.client.1.smithi148.stdout:2/597: sync 2024-09-18T12:49:20.392 INFO:tasks.workunit.client.1.smithi148.stdout:3/635: sync 2024-09-18T12:49:20.392 INFO:tasks.workunit.client.1.smithi148.stdout:2/598: stat d9/fb4 0 2024-09-18T12:49:20.393 INFO:tasks.workunit.client.1.smithi148.stdout:2/599: truncate d9/d3a/fd3 298051 0 2024-09-18T12:49:20.405 INFO:tasks.workunit.client.0.smithi078.stdout:4/451: mkdir d11/d27/d47/d78/d95 0 2024-09-18T12:49:20.406 INFO:tasks.workunit.client.1.smithi148.stdout:4/673: rmdir d15/d17/d52/d92/d4c 39 2024-09-18T12:49:20.407 INFO:tasks.workunit.client.1.smithi148.stdout:9/664: rmdir d8/da/dd 39 2024-09-18T12:49:20.410 INFO:tasks.workunit.client.0.smithi078.stdout:5/581: mkdir d2/d4/d12/d16/d36/db0 0 2024-09-18T12:49:20.412 INFO:tasks.workunit.client.0.smithi078.stdout:4/452: dwrite d11/d27/d5a/d5d/f90 [0,4194304] 0 2024-09-18T12:49:20.415 INFO:tasks.workunit.client.0.smithi078.stdout:5/582: mkdir d2/d4/d12/d16/d36/d4c/d97/db1 0 2024-09-18T12:49:20.416 INFO:tasks.workunit.client.1.smithi148.stdout:5/699: mknod d7/d8/dc/da6/ceb 0 2024-09-18T12:49:20.419 INFO:tasks.workunit.client.1.smithi148.stdout:3/636: fsync d4/d8/d1e/d6b/d31/d46/f72 0 2024-09-18T12:49:20.419 INFO:tasks.workunit.client.1.smithi148.stdout:7/694: dwrite db/dc/df/d11/d34/f5a [0,4194304] 0 2024-09-18T12:49:20.419 INFO:tasks.workunit.client.0.smithi078.stdout:5/583: creat d2/d4/d58/fb2 x:0 0 0 2024-09-18T12:49:20.421 INFO:tasks.workunit.client.1.smithi148.stdout:3/637: write d4/d8/d20/d2b/f3a [776412,61644] 0 2024-09-18T12:49:20.421 INFO:tasks.workunit.client.0.smithi078.stdout:4/453: symlink d11/d27/d5a/d5d/l96 0 2024-09-18T12:49:20.422 INFO:tasks.workunit.client.1.smithi148.stdout:6/698: write d5/d1a/dc/d2b/d35/f72 [913960,22911] 0 2024-09-18T12:49:20.427 INFO:tasks.workunit.client.1.smithi148.stdout:2/600: dwrite d9/d73/f8c [0,4194304] 0 2024-09-18T12:49:20.429 INFO:tasks.workunit.client.0.smithi078.stdout:4/454: rename d11/d27/f59 to d11/d27/d60/f97 0 2024-09-18T12:49:20.433 INFO:tasks.workunit.client.0.smithi078.stdout:5/584: dwrite d2/d4/fae [0,4194304] 0 2024-09-18T12:49:20.433 INFO:tasks.workunit.client.1.smithi148.stdout:0/842: mknod de/d27/d53/d102/c11c 0 2024-09-18T12:49:20.433 INFO:tasks.workunit.client.1.smithi148.stdout:0/843: readlink de/d27/l98 0 2024-09-18T12:49:20.435 INFO:tasks.workunit.client.0.smithi078.stdout:4/455: rmdir d11/d27/d89 39 2024-09-18T12:49:20.437 INFO:tasks.workunit.client.1.smithi148.stdout:5/700: creat d7/d8/dc/d12/d1f/d25/d4b/dd6/fec x:0 0 0 2024-09-18T12:49:20.439 INFO:tasks.workunit.client.0.smithi078.stdout:5/585: rename d2/d4/d12 to d2/d4/d9/da/d60/db3 0 2024-09-18T12:49:20.439 INFO:tasks.workunit.client.1.smithi148.stdout:8/760: dwrite d8/df/d3e/d82/ded/ffa [0,4194304] 0 2024-09-18T12:49:20.439 INFO:tasks.workunit.client.1.smithi148.stdout:3/638: rmdir d4/d8/d20/d2b/d7f/d93/dd1 39 2024-09-18T12:49:20.440 INFO:tasks.workunit.client.1.smithi148.stdout:8/761: stat d8/df/db2/fbd 0 2024-09-18T12:49:20.440 INFO:tasks.workunit.client.0.smithi078.stdout:4/456: symlink d11/d27/d47/l98 0 2024-09-18T12:49:20.441 INFO:tasks.workunit.client.1.smithi148.stdout:3/639: stat d4/d8 0 2024-09-18T12:49:20.441 INFO:tasks.workunit.client.0.smithi078.stdout:5/586: mkdir d2/d4/d9/da/d60/db3/d16/d36/d4c/d62/d4d/db4 0 2024-09-18T12:49:20.445 INFO:tasks.workunit.client.1.smithi148.stdout:8/762: write d8/d16/d27/f4a [1678200,52772] 0 2024-09-18T12:49:20.445 INFO:tasks.workunit.client.1.smithi148.stdout:3/640: write d4/d8/d20/d2b/fc4 [577406,88372] 0 2024-09-18T12:49:20.446 INFO:tasks.workunit.client.0.smithi078.stdout:5/587: rename d2/d4/d9/da/f19 to d2/d4/d48/fb5 0 2024-09-18T12:49:20.446 INFO:tasks.workunit.client.1.smithi148.stdout:9/665: write d8/da/dd/f1b [564982,22112] 0 2024-09-18T12:49:20.446 INFO:tasks.workunit.client.1.smithi148.stdout:8/763: fdatasync d8/df/d3e/d82/d8f/f102 0 2024-09-18T12:49:20.447 INFO:tasks.workunit.client.0.smithi078.stdout:5/588: chown d2/d4/d9/d49/f7d 46 1 2024-09-18T12:49:20.448 INFO:tasks.workunit.client.1.smithi148.stdout:1/668: getdents dc/d5b 0 2024-09-18T12:49:20.449 INFO:tasks.workunit.client.1.smithi148.stdout:9/666: truncate d8/da/dd/d65/f76 2678024 0 2024-09-18T12:49:20.449 INFO:tasks.workunit.client.1.smithi148.stdout:0/844: rename de/d14/d43/d57/fda to de/d27/d53/d89/dc0/dbd/f11d 0 2024-09-18T12:49:20.455 INFO:tasks.workunit.client.0.smithi078.stdout:5/589: mkdir d2/d4/d9/da/d60/db3/d16/d36/d68/db6 0 2024-09-18T12:49:20.457 INFO:tasks.workunit.client.1.smithi148.stdout:6/699: mknod d5/d1a/cdd 0 2024-09-18T12:49:20.458 INFO:tasks.workunit.client.1.smithi148.stdout:6/700: fsync d5/d1a/dc/d2b/f55 0 2024-09-18T12:49:20.458 INFO:tasks.workunit.client.1.smithi148.stdout:5/701: creat d7/d8/d18/d3f/d7c/d7d/dbc/fed x:0 0 0 2024-09-18T12:49:20.459 INFO:tasks.workunit.client.1.smithi148.stdout:4/674: symlink d15/d17/d52/d92/d4c/d4f/ldf 0 2024-09-18T12:49:20.459 INFO:tasks.workunit.client.1.smithi148.stdout:4/675: readlink d15/d17/d52/l7b 0 2024-09-18T12:49:20.459 INFO:tasks.workunit.client.0.smithi078.stdout:5/590: mkdir d2/d4/d9/da/d60/db3/d16/d36/d68/db6/db7 0 2024-09-18T12:49:20.460 INFO:tasks.workunit.client.0.smithi078.stdout:5/591: chown d2/d4/d9/da/d60/db3/d16/d36/f79 4 1 2024-09-18T12:49:20.460 INFO:tasks.workunit.client.1.smithi148.stdout:4/676: truncate d15/d17/d52/fdd 485046 0 2024-09-18T12:49:20.461 INFO:tasks.workunit.client.0.smithi078.stdout:5/592: fsync d2/d4/f34 0 2024-09-18T12:49:20.461 INFO:tasks.workunit.client.1.smithi148.stdout:3/641: chown d4/d8/d20/d2b/d7f/d93/dd1 0 1 2024-09-18T12:49:20.462 INFO:tasks.workunit.client.1.smithi148.stdout:1/669: dread dc/d18/d63/f8b [0,4194304] 0 2024-09-18T12:49:20.463 INFO:tasks.workunit.client.1.smithi148.stdout:2/601: rename d9/d24/d67/f76 to d9/d24/d67/d72/d77/fd9 0 2024-09-18T12:49:20.464 INFO:tasks.workunit.client.1.smithi148.stdout:2/602: dread - d9/d17/d29/d92/d95/fac zero size 2024-09-18T12:49:20.464 INFO:tasks.workunit.client.0.smithi078.stdout:5/593: dread - d2/d4/d48/d86/f87 zero size 2024-09-18T12:49:20.465 INFO:tasks.workunit.client.0.smithi078.stdout:5/594: readlink d2/d4/d9/da/d2b/la6 0 2024-09-18T12:49:20.466 INFO:tasks.workunit.client.0.smithi078.stdout:4/457: getdents d11/d27/d47 0 2024-09-18T12:49:20.467 INFO:tasks.workunit.client.0.smithi078.stdout:4/458: chown d11/d27/d47/d4e/d50/l6e 404650 1 2024-09-18T12:49:20.468 INFO:tasks.workunit.client.0.smithi078.stdout:4/459: chown d11/d27/d5a/d84/l6b 154815212 1 2024-09-18T12:49:20.469 INFO:tasks.workunit.client.0.smithi078.stdout:4/460: truncate d11/f61 4509523 0 2024-09-18T12:49:20.470 INFO:tasks.workunit.client.1.smithi148.stdout:8/764: dread d8/d12/f1b [0,4194304] 0 2024-09-18T12:49:20.471 INFO:tasks.workunit.client.1.smithi148.stdout:3/642: chown d4/d8/f24 27326 1 2024-09-18T12:49:20.471 INFO:tasks.workunit.client.1.smithi148.stdout:8/765: write d8/d12/fda [12213,18914] 0 2024-09-18T12:49:20.472 INFO:tasks.workunit.client.0.smithi078.stdout:4/461: mknod d11/d27/d47/c99 0 2024-09-18T12:49:20.473 INFO:tasks.workunit.client.1.smithi148.stdout:1/670: fdatasync f8 0 2024-09-18T12:49:20.474 INFO:tasks.workunit.client.0.smithi078.stdout:5/595: rename d2/d4/d55/d8f to d2/db8 0 2024-09-18T12:49:20.474 INFO:tasks.workunit.client.1.smithi148.stdout:1/671: stat dc/d11/f53 0 2024-09-18T12:49:20.475 INFO:tasks.workunit.client.1.smithi148.stdout:1/672: readlink dc/l28 0 2024-09-18T12:49:20.475 INFO:tasks.workunit.client.1.smithi148.stdout:0/845: symlink de/d14/d6b/df2/l11e 0 2024-09-18T12:49:20.476 INFO:tasks.workunit.client.0.smithi078.stdout:4/462: rmdir d11/d27/d47 39 2024-09-18T12:49:20.476 INFO:tasks.workunit.client.1.smithi148.stdout:8/766: dwrite d8/f2f [0,4194304] 0 2024-09-18T12:49:20.476 INFO:tasks.workunit.client.1.smithi148.stdout:0/846: stat de/d27/d53/d89/dc0/dbd 0 2024-09-18T12:49:20.478 INFO:tasks.workunit.client.1.smithi148.stdout:5/702: rename d7/d8/dc/d12/d1f to d7/d8/dc/da6/dee 0 2024-09-18T12:49:20.479 INFO:tasks.workunit.client.1.smithi148.stdout:2/603: mknod d9/d17/d29/d92/cda 0 2024-09-18T12:49:20.480 INFO:tasks.workunit.client.0.smithi078.stdout:4/463: chown d11/l1e 44 1 2024-09-18T12:49:20.481 INFO:tasks.workunit.client.1.smithi148.stdout:5/703: truncate d7/d8/dc/da6/dee/d39/dd5/fdb 590276 0 2024-09-18T12:49:20.483 INFO:tasks.workunit.client.0.smithi078.stdout:6/594: sync 2024-09-18T12:49:20.483 INFO:tasks.workunit.client.0.smithi078.stdout:3/451: sync 2024-09-18T12:49:20.485 INFO:tasks.workunit.client.1.smithi148.stdout:3/643: rmdir d4/d8/d1e/d6b/d31/d60 39 2024-09-18T12:49:20.486 INFO:tasks.workunit.client.0.smithi078.stdout:6/595: dread - d10/d2b/d43/d53/d63/d70/d7d/fb5 zero size 2024-09-18T12:49:20.487 INFO:tasks.workunit.client.0.smithi078.stdout:4/464: dwrite d11/d27/d5a/f64 [0,4194304] 0 2024-09-18T12:49:20.491 INFO:tasks.workunit.client.0.smithi078.stdout:4/465: rmdir d11/d27/d5a/d5d/d6a 39 2024-09-18T12:49:20.493 INFO:tasks.workunit.client.1.smithi148.stdout:4/677: rename d15/d17/l4e to d15/d17/d52/d92/d4c/d72/db3/le0 0 2024-09-18T12:49:20.494 INFO:tasks.workunit.client.0.smithi078.stdout:3/452: dread d9/d2f/f77 [0,4194304] 0 2024-09-18T12:49:20.498 INFO:tasks.workunit.client.1.smithi148.stdout:3/644: truncate d4/d8/d1e/d6b/d31/d60/fc0 1227792 0 2024-09-18T12:49:20.500 INFO:tasks.workunit.client.0.smithi078.stdout:5/596: truncate d2/d4/d9/da/d60/db3/d16/d36/f41 5646708 0 2024-09-18T12:49:20.501 INFO:tasks.workunit.client.1.smithi148.stdout:6/701: dwrite d5/d1a/dc/fd6 [0,4194304] 0 2024-09-18T12:49:20.502 INFO:tasks.workunit.client.0.smithi078.stdout:3/453: mknod d9/d13/d63/c8a 0 2024-09-18T12:49:20.504 INFO:tasks.workunit.client.0.smithi078.stdout:3/454: dread d9/d54/d6c/f81 [0,4194304] 0 2024-09-18T12:49:20.512 INFO:tasks.workunit.client.0.smithi078.stdout:6/596: dread d10/d2b/d43/d53/f56 [0,4194304] 0 2024-09-18T12:49:20.514 INFO:tasks.workunit.client.0.smithi078.stdout:3/455: symlink d9/d54/l8b 0 2024-09-18T12:49:20.518 INFO:tasks.workunit.client.0.smithi078.stdout:4/466: getdents d11/d27/d47/d4e/d50 0 2024-09-18T12:49:20.519 INFO:tasks.workunit.client.0.smithi078.stdout:5/597: rmdir d2/d4/d9/da/d60/db3/d16/d36/d68/db6/db7 0 2024-09-18T12:49:20.521 INFO:tasks.workunit.client.0.smithi078.stdout:5/598: write d2/d4/f8c [235045,45872] 0 2024-09-18T12:49:20.525 INFO:tasks.workunit.client.0.smithi078.stdout:6/597: creat d10/d2b/fc2 x:0 0 0 2024-09-18T12:49:20.528 INFO:tasks.workunit.client.0.smithi078.stdout:5/599: dwrite d2/d4/d9/da/d60/db3/d2d/fad [0,4194304] 0 2024-09-18T12:49:20.530 INFO:tasks.workunit.client.0.smithi078.stdout:6/598: mkdir d10/d2b/d43/dc3 0 2024-09-18T12:49:20.531 INFO:tasks.workunit.client.0.smithi078.stdout:5/600: readlink d2/d4/d9/d2f/d30/l82 0 2024-09-18T12:49:20.534 INFO:tasks.workunit.client.0.smithi078.stdout:2/405: sync 2024-09-18T12:49:20.534 INFO:tasks.workunit.client.0.smithi078.stdout:8/410: sync 2024-09-18T12:49:20.534 INFO:tasks.workunit.client.0.smithi078.stdout:7/358: sync 2024-09-18T12:49:20.534 INFO:tasks.workunit.client.0.smithi078.stdout:0/553: sync 2024-09-18T12:49:20.534 INFO:tasks.workunit.client.0.smithi078.stdout:9/414: sync 2024-09-18T12:49:20.534 INFO:tasks.workunit.client.0.smithi078.stdout:1/444: sync 2024-09-18T12:49:20.535 INFO:tasks.workunit.client.0.smithi078.stdout:4/467: write d11/d27/d5a/d5d/f88 [990243,1643] 0 2024-09-18T12:49:20.539 INFO:tasks.workunit.client.0.smithi078.stdout:1/445: chown d0/d8/ce 7335 1 2024-09-18T12:49:20.539 INFO:tasks.workunit.client.0.smithi078.stdout:3/456: dread d9/d13/f1d [0,4194304] 0 2024-09-18T12:49:20.541 INFO:tasks.workunit.client.0.smithi078.stdout:0/554: dread - d3/d1f/d2e/d68/f8b zero size 2024-09-18T12:49:20.542 INFO:tasks.workunit.client.0.smithi078.stdout:5/601: dread d2/d4/f89 [0,4194304] 0 2024-09-18T12:49:20.545 INFO:tasks.workunit.client.0.smithi078.stdout:0/555: read d3/d1f/d2e/d8f/d90/f9b [938250,39498] 0 2024-09-18T12:49:20.545 INFO:tasks.workunit.client.0.smithi078.stdout:4/468: mknod d11/d27/d5a/d5d/d6a/c9a 0 2024-09-18T12:49:20.545 INFO:tasks.workunit.client.0.smithi078.stdout:5/602: write d2/d4/f8 [222858,56366] 0 2024-09-18T12:49:20.546 INFO:tasks.workunit.client.1.smithi148.stdout:7/695: sync 2024-09-18T12:49:20.547 INFO:tasks.workunit.client.0.smithi078.stdout:2/406: link d4/db/c51 d4/d20/c84 0 2024-09-18T12:49:20.549 INFO:tasks.workunit.client.0.smithi078.stdout:4/469: fsync d11/f93 0 2024-09-18T12:49:20.550 INFO:tasks.workunit.client.0.smithi078.stdout:9/415: write d5/d7/d8/f27 [3002101,62721] 0 2024-09-18T12:49:20.551 INFO:tasks.workunit.client.0.smithi078.stdout:6/599: dwrite d10/d2b/d43/d53/f56 [0,4194304] 0 2024-09-18T12:49:20.552 INFO:tasks.workunit.client.0.smithi078.stdout:5/603: rmdir d2 39 2024-09-18T12:49:20.554 INFO:tasks.workunit.client.0.smithi078.stdout:7/359: creat d7/d9/d32/d3b/f7e x:0 0 0 2024-09-18T12:49:20.556 INFO:tasks.workunit.client.0.smithi078.stdout:2/407: mkdir d4/d20/d85 0 2024-09-18T12:49:20.561 INFO:tasks.workunit.client.1.smithi148.stdout:2/604: rename d9/d17/d29/d92/d95/d64/l99 to d9/d24/d31/d34/d7b/ldb 0 2024-09-18T12:49:20.561 INFO:tasks.workunit.client.1.smithi148.stdout:9/667: getdents d8/da/dd/d3f/d5d/da0 0 2024-09-18T12:49:20.562 INFO:tasks.workunit.client.0.smithi078.stdout:1/446: dwrite d0/d8/da/d3e/d58/d6e/f51 [0,4194304] 0 2024-09-18T12:49:20.562 INFO:tasks.workunit.client.1.smithi148.stdout:1/673: truncate dc/d5b/da5/fbe 2642178 0 2024-09-18T12:49:20.562 INFO:tasks.workunit.client.1.smithi148.stdout:3/645: mkdir d4/d8/d20/d2b/d7f/d93/d94/dde 0 2024-09-18T12:49:20.563 INFO:tasks.workunit.client.1.smithi148.stdout:7/696: fdatasync db/dc/df/d8e/f7c 0 2024-09-18T12:49:20.563 INFO:tasks.workunit.client.1.smithi148.stdout:0/847: write de/d14/d43/d57/d59/f99 [382840,112568] 0 2024-09-18T12:49:20.564 INFO:tasks.workunit.client.1.smithi148.stdout:8/767: creat d8/df/f107 x:0 0 0 2024-09-18T12:49:20.564 INFO:tasks.workunit.client.0.smithi078.stdout:7/360: write d7/d26/d4f/f50 [697712,65673] 0 2024-09-18T12:49:20.564 INFO:tasks.workunit.client.0.smithi078.stdout:3/457: dwrite d9/d54/f68 [4194304,4194304] 0 2024-09-18T12:49:20.565 INFO:tasks.workunit.client.1.smithi148.stdout:9/668: chown d8/da/l32 7 1 2024-09-18T12:49:20.566 INFO:tasks.workunit.client.1.smithi148.stdout:2/605: chown d9/d24/d31/d34/d42/c6c 250994877 1 2024-09-18T12:49:20.567 INFO:tasks.workunit.client.1.smithi148.stdout:7/697: write db/dc/fb1 [984149,60131] 0 2024-09-18T12:49:20.567 INFO:tasks.workunit.client.1.smithi148.stdout:3/646: chown d4/d8/d1e/d6b/d31/f34 189689760 1 2024-09-18T12:49:20.569 INFO:tasks.workunit.client.0.smithi078.stdout:7/361: chown d7/d26/f79 1224 1 2024-09-18T12:49:20.569 INFO:tasks.workunit.client.1.smithi148.stdout:1/674: creat dc/d9f/fdb x:0 0 0 2024-09-18T12:49:20.569 INFO:tasks.workunit.client.1.smithi148.stdout:2/606: dread - d9/d24/d67/d72/d77/fd9 zero size 2024-09-18T12:49:20.571 INFO:tasks.workunit.client.0.smithi078.stdout:3/458: chown d9/d13/d33 34 1 2024-09-18T12:49:20.572 INFO:tasks.workunit.client.0.smithi078.stdout:0/556: rename d3/d1f/c36 to d3/d1f/d2e/d68/d30/d7c/da3/cca 0 2024-09-18T12:49:20.572 INFO:tasks.workunit.client.0.smithi078.stdout:4/470: chown d11/d27/d47/f49 4272 1 2024-09-18T12:49:20.573 INFO:tasks.workunit.client.1.smithi148.stdout:0/848: write de/f12 [1308056,74629] 0 2024-09-18T12:49:20.574 INFO:tasks.workunit.client.1.smithi148.stdout:8/768: mkdir d8/d16/d27/dc5/dee/d108 0 2024-09-18T12:49:20.574 INFO:tasks.workunit.client.0.smithi078.stdout:6/600: mkdir d10/d2b/d43/dc4 0 2024-09-18T12:49:20.575 INFO:tasks.workunit.client.0.smithi078.stdout:9/416: mknod d5/d7/d32/d81/c87 0 2024-09-18T12:49:20.576 INFO:tasks.workunit.client.1.smithi148.stdout:0/849: fdatasync de/d27/d53/d89/dc0/dbd/fbe 0 2024-09-18T12:49:20.577 INFO:tasks.workunit.client.1.smithi148.stdout:0/850: fsync f9 0 2024-09-18T12:49:20.577 INFO:tasks.workunit.client.0.smithi078.stdout:0/557: fsync d3/f4b 0 2024-09-18T12:49:20.577 INFO:tasks.workunit.client.1.smithi148.stdout:3/647: rename d4/l96 to d4/d8/d20/d2b/d7f/dd9/ldf 0 2024-09-18T12:49:20.578 INFO:tasks.workunit.client.1.smithi148.stdout:2/607: symlink d9/d17/d29/d98/ldc 0 2024-09-18T12:49:20.580 INFO:tasks.workunit.client.1.smithi148.stdout:4/678: dread d15/d17/d52/d92/d4c/f5d [0,4194304] 0 2024-09-18T12:49:20.580 INFO:tasks.workunit.client.1.smithi148.stdout:9/669: mkdir d8/da/dd/d35/d81/dc6/dcc 0 2024-09-18T12:49:20.580 INFO:tasks.workunit.client.0.smithi078.stdout:8/411: dwrite d0/d7/d1e/f54 [0,4194304] 0 2024-09-18T12:49:20.581 INFO:tasks.workunit.client.0.smithi078.stdout:1/447: dread d0/d8/da/d3e/d58/d6e/f7a [0,4194304] 0 2024-09-18T12:49:20.582 INFO:tasks.workunit.client.0.smithi078.stdout:3/459: write d9/d13/d33/d3c/f66 [1122167,56371] 0 2024-09-18T12:49:20.583 INFO:tasks.workunit.client.1.smithi148.stdout:9/670: chown d8/l2a 87239723 1 2024-09-18T12:49:20.583 INFO:tasks.workunit.client.0.smithi078.stdout:5/604: dwrite d2/d4/d9/d2f/d30/f80 [0,4194304] 0 2024-09-18T12:49:20.583 INFO:tasks.workunit.client.0.smithi078.stdout:7/362: truncate d7/d26/d4f/f50 1729224 0 2024-09-18T12:49:20.584 INFO:tasks.workunit.client.1.smithi148.stdout:4/679: chown d15/d17/d52/d92/d4c/d4f/d34/lae 6835 1 2024-09-18T12:49:20.586 INFO:tasks.workunit.client.1.smithi148.stdout:4/680: readlink d15/d5f/d69/d7f/d94/lad 0 2024-09-18T12:49:20.587 INFO:tasks.workunit.client.1.smithi148.stdout:3/648: dwrite d4/d8/d20/fb0 [0,4194304] 0 2024-09-18T12:49:20.588 INFO:tasks.workunit.client.1.smithi148.stdout:2/608: mkdir d9/d24/d67/dc7/ddd 0 2024-09-18T12:49:20.589 INFO:tasks.workunit.client.1.smithi148.stdout:0/851: read - de/d27/d53/d89/dbb/db5/fb7 zero size 2024-09-18T12:49:20.589 INFO:tasks.workunit.client.0.smithi078.stdout:1/448: fsync d0/d8/da/d3e/d58/d6e/f5a 0 2024-09-18T12:49:20.590 INFO:tasks.workunit.client.0.smithi078.stdout:1/449: chown d0/c15 0 1 2024-09-18T12:49:20.590 INFO:tasks.workunit.client.0.smithi078.stdout:7/363: dread d7/d5d/f74 [0,4194304] 0 2024-09-18T12:49:20.593 INFO:tasks.workunit.client.0.smithi078.stdout:7/364: chown d7/d5d/d7a/c58 119 1 2024-09-18T12:49:20.593 INFO:tasks.workunit.client.0.smithi078.stdout:7/365: chown d7 15106 1 2024-09-18T12:49:20.593 INFO:tasks.workunit.client.1.smithi148.stdout:0/852: dread de/d27/fae [0,4194304] 0 2024-09-18T12:49:20.596 INFO:tasks.workunit.client.0.smithi078.stdout:9/417: link d5/d7/d8/f46 d5/d5c/f88 0 2024-09-18T12:49:20.598 INFO:tasks.workunit.client.1.smithi148.stdout:3/649: rmdir d4/d8/d6a 39 2024-09-18T12:49:20.600 INFO:tasks.workunit.client.0.smithi078.stdout:1/450: dwrite d0/d8/da/d3e/d58/d6e/d52/d47/d7d/f64 [0,4194304] 0 2024-09-18T12:49:20.600 INFO:tasks.workunit.client.1.smithi148.stdout:1/675: link dc/d18/d7d/d93/dd9/d2b/l62 dc/d18/d7d/d93/dd9/d2b/d99/ldc 0 2024-09-18T12:49:20.602 INFO:tasks.workunit.client.1.smithi148.stdout:1/676: write dc/d18/d7d/d93/dd9/f3c [1876966,5616] 0 2024-09-18T12:49:20.604 INFO:tasks.workunit.client.1.smithi148.stdout:4/681: creat d15/d17/d52/d92/d4c/d4f/d64/da0/fe1 x:0 0 0 2024-09-18T12:49:20.605 INFO:tasks.workunit.client.0.smithi078.stdout:2/408: dread d4/dd/f40 [0,4194304] 0 2024-09-18T12:49:20.610 INFO:tasks.workunit.client.0.smithi078.stdout:0/558: mkdir d3/d1f/d2e/d8f/d90/dcb 0 2024-09-18T12:49:20.612 INFO:tasks.workunit.client.1.smithi148.stdout:3/650: write d4/d8/d1e/d79/fab [1080860,15867] 0 2024-09-18T12:49:20.613 INFO:tasks.workunit.client.1.smithi148.stdout:7/698: dread db/dc/df/d1d/f5c [4194304,4194304] 0 2024-09-18T12:49:20.616 INFO:tasks.workunit.client.0.smithi078.stdout:7/366: creat d7/d5d/d5e/f7f x:0 0 0 2024-09-18T12:49:20.616 INFO:tasks.workunit.client.0.smithi078.stdout:4/471: dwrite d11/f14 [0,4194304] 0 2024-09-18T12:49:20.619 INFO:tasks.workunit.client.1.smithi148.stdout:8/769: dwrite d8/d12/d46/f7d [0,4194304] 0 2024-09-18T12:49:20.623 INFO:tasks.workunit.client.1.smithi148.stdout:9/671: dread f7 [0,4194304] 0 2024-09-18T12:49:20.625 INFO:tasks.workunit.client.0.smithi078.stdout:9/418: creat d5/d7/d32/f89 x:0 0 0 2024-09-18T12:49:20.626 INFO:tasks.workunit.client.1.smithi148.stdout:1/677: unlink dc/d4d/lb6 0 2024-09-18T12:49:20.629 INFO:tasks.workunit.client.0.smithi078.stdout:1/451: mkdir d0/d8/da/d3e/d58/d6e/d8c 0 2024-09-18T12:49:20.631 INFO:tasks.workunit.client.1.smithi148.stdout:4/682: creat d15/d17/d52/d92/d4c/dd0/dd6/fe2 x:0 0 0 2024-09-18T12:49:20.634 INFO:tasks.workunit.client.0.smithi078.stdout:2/409: rename d4/dd/d18 to d4/d8/d23/d52/d5f/d86 0 2024-09-18T12:49:20.635 INFO:tasks.workunit.client.1.smithi148.stdout:8/770: symlink d8/d12/d46/d74/dd5/l109 0 2024-09-18T12:49:20.636 INFO:tasks.workunit.client.1.smithi148.stdout:2/609: write d9/f18 [2355502,56593] 0 2024-09-18T12:49:20.640 INFO:tasks.workunit.client.0.smithi078.stdout:3/460: creat d9/d2f/f8c x:0 0 0 2024-09-18T12:49:20.641 INFO:tasks.workunit.client.0.smithi078.stdout:4/472: chown cd 77386765 1 2024-09-18T12:49:20.641 INFO:tasks.workunit.client.0.smithi078.stdout:7/367: creat d7/d26/f80 x:0 0 0 2024-09-18T12:49:20.642 INFO:tasks.workunit.client.1.smithi148.stdout:9/672: mknod d8/da/dd/d4a/d27/ccd 0 2024-09-18T12:49:20.642 INFO:tasks.workunit.client.1.smithi148.stdout:3/651: write d4/f18 [3830990,81540] 0 2024-09-18T12:49:20.642 INFO:tasks.workunit.client.1.smithi148.stdout:3/652: read - d4/d8/d20/d2b/d7f/f8e zero size 2024-09-18T12:49:20.642 INFO:tasks.workunit.client.1.smithi148.stdout:7/699: creat db/dc/df/d1d/d68/d82/fd0 x:0 0 0 2024-09-18T12:49:20.642 INFO:tasks.workunit.client.0.smithi078.stdout:7/368: dread - d7/d26/f80 zero size 2024-09-18T12:49:20.644 INFO:tasks.workunit.client.0.smithi078.stdout:6/601: link d10/d2b/d43/f6c d10/d2b/d43/d53/d45/d55/fc5 0 2024-09-18T12:49:20.645 INFO:tasks.workunit.client.1.smithi148.stdout:1/678: truncate dc/d18/d7d/d93/dd9/d2b/f86 85596 0 2024-09-18T12:49:20.646 INFO:tasks.workunit.client.0.smithi078.stdout:4/473: dwrite d11/d27/d5a/f70 [0,4194304] 0 2024-09-18T12:49:20.649 INFO:tasks.workunit.client.0.smithi078.stdout:5/605: creat d2/d4/fb9 x:0 0 0 2024-09-18T12:49:20.650 INFO:tasks.workunit.client.1.smithi148.stdout:2/610: creat d9/d73/fde x:0 0 0 2024-09-18T12:49:20.651 INFO:tasks.workunit.client.0.smithi078.stdout:8/412: creat d0/d7/f7f x:0 0 0 2024-09-18T12:49:20.652 INFO:tasks.workunit.client.0.smithi078.stdout:8/413: chown d0/d7/dc/d1f/d23/d44 22024 1 2024-09-18T12:49:20.653 INFO:tasks.workunit.client.0.smithi078.stdout:3/461: dread d9/d2f/f3d [0,4194304] 0 2024-09-18T12:49:20.654 INFO:tasks.workunit.client.0.smithi078.stdout:0/559: creat d3/d1f/d2e/d8f/d90/dcb/fcc x:0 0 0 2024-09-18T12:49:20.655 INFO:tasks.workunit.client.0.smithi078.stdout:0/560: stat d3/d1f/d2e/d4e/d37/f8a 0 2024-09-18T12:49:20.655 INFO:tasks.workunit.client.1.smithi148.stdout:1/679: rmdir dc/d18/d7d/d93/dd9/d2b/d80 39 2024-09-18T12:49:20.657 INFO:tasks.workunit.client.1.smithi148.stdout:1/680: write dc/d18/d7d/d93/dd9/f3c [5101068,58723] 0 2024-09-18T12:49:20.657 INFO:tasks.workunit.client.1.smithi148.stdout:4/683: mknod d15/ce3 0 2024-09-18T12:49:20.658 INFO:tasks.workunit.client.1.smithi148.stdout:1/681: stat dc/d18/d7d/d93/dd9/d2b/d99 0 2024-09-18T12:49:20.659 INFO:tasks.workunit.client.0.smithi078.stdout:7/369: mknod d7/d9/d14/d22/d35/c81 0 2024-09-18T12:49:20.660 INFO:tasks.workunit.client.0.smithi078.stdout:6/602: truncate d10/d2b/d61/f66 437483 0 2024-09-18T12:49:20.661 INFO:tasks.workunit.client.0.smithi078.stdout:9/419: unlink d5/d7/l6e 0 2024-09-18T12:49:20.662 INFO:tasks.workunit.client.0.smithi078.stdout:6/603: readlink d10/d2b/d43/d53/d63/d70/d7d/lb8 0 2024-09-18T12:49:20.662 INFO:tasks.workunit.client.1.smithi148.stdout:2/611: unlink d9/d17/d29/d98/f9a 0 2024-09-18T12:49:20.662 INFO:tasks.workunit.client.0.smithi078.stdout:3/462: dwrite d9/d29/f7d [0,4194304] 0 2024-09-18T12:49:20.664 INFO:tasks.workunit.client.0.smithi078.stdout:6/604: write d10/f41 [827808,21344] 0 2024-09-18T12:49:20.664 INFO:tasks.workunit.client.0.smithi078.stdout:4/474: mknod d11/d27/d5a/d84/d4b/c9b 0 2024-09-18T12:49:20.669 INFO:tasks.workunit.client.1.smithi148.stdout:2/612: dwrite d9/d3a/d90/fc5 [0,4194304] 0 2024-09-18T12:49:20.669 INFO:tasks.workunit.client.1.smithi148.stdout:9/673: rename d8/da/dd/d3f/f7f to d8/da/dd/d4a/d49/d46/d54/d90/fce 0 2024-09-18T12:49:20.672 INFO:tasks.workunit.client.0.smithi078.stdout:5/606: rmdir d2/d4/d9/da/d60/db3/d16 39 2024-09-18T12:49:20.673 INFO:tasks.workunit.client.0.smithi078.stdout:5/607: dread - d2/d4/d9/d2f/d30/f85 zero size 2024-09-18T12:49:20.673 INFO:tasks.workunit.client.0.smithi078.stdout:5/608: stat d2/d4/d9/d2f 0 2024-09-18T12:49:20.674 INFO:tasks.workunit.client.1.smithi148.stdout:7/700: dread db/dc/df/d2c/f7e [0,4194304] 0 2024-09-18T12:49:20.676 INFO:tasks.workunit.client.0.smithi078.stdout:8/414: dread d0/d7/dc/f64 [0,4194304] 0 2024-09-18T12:49:20.682 INFO:tasks.workunit.client.0.smithi078.stdout:8/415: dwrite d0/f14 [0,4194304] 0 2024-09-18T12:49:20.684 INFO:tasks.workunit.client.0.smithi078.stdout:7/370: mknod d7/d5d/c82 0 2024-09-18T12:49:20.685 INFO:tasks.workunit.client.1.smithi148.stdout:3/653: rmdir d4/d8/d1e/d79/d92/dce 0 2024-09-18T12:49:20.685 INFO:tasks.workunit.client.1.smithi148.stdout:8/771: truncate d8/d12/d46/d7e/fe3 3253877 0 2024-09-18T12:49:20.688 INFO:tasks.workunit.client.1.smithi148.stdout:2/613: creat d9/d24/d67/fdf x:0 0 0 2024-09-18T12:49:20.691 INFO:tasks.workunit.client.1.smithi148.stdout:9/674: mknod d8/da/dd/d35/d59/ccf 0 2024-09-18T12:49:20.692 INFO:tasks.workunit.client.0.smithi078.stdout:1/452: truncate d0/d5b/f63 1384490 0 2024-09-18T12:49:20.692 INFO:tasks.workunit.client.1.smithi148.stdout:9/675: truncate d8/da/dd/d35/f9b 14768 0 2024-09-18T12:49:20.693 INFO:tasks.workunit.client.0.smithi078.stdout:4/475: readlink d11/d27/d5a/d84/l31 0 2024-09-18T12:49:20.693 INFO:tasks.workunit.client.0.smithi078.stdout:4/476: write d11/f16 [13597177,14355] 0 2024-09-18T12:49:20.696 INFO:tasks.workunit.client.1.smithi148.stdout:4/684: mknod d15/d17/d52/d92/d4c/ce4 0 2024-09-18T12:49:20.699 INFO:tasks.workunit.client.0.smithi078.stdout:5/609: read d2/d4/d9/da/f7a [366392,22665] 0 2024-09-18T12:49:20.701 INFO:tasks.workunit.client.0.smithi078.stdout:4/477: dwrite d11/d27/d5a/d84/d40/f6f [0,4194304] 0 2024-09-18T12:49:20.701 INFO:tasks.workunit.client.0.smithi078.stdout:5/610: truncate d2/d4/f8c 891390 0 2024-09-18T12:49:20.703 INFO:tasks.workunit.client.0.smithi078.stdout:0/561: mkdir d3/d1f/d2e/d68/dc9/dcd 0 2024-09-18T12:49:20.708 INFO:tasks.workunit.client.0.smithi078.stdout:7/371: symlink d7/d9/d14/d22/d35/l83 0 2024-09-18T12:49:20.711 INFO:tasks.workunit.client.1.smithi148.stdout:8/772: symlink d8/d12/d51/l10a 0 2024-09-18T12:49:20.712 INFO:tasks.workunit.client.0.smithi078.stdout:9/420: rename d5/d7/d8/d4f/l67 to d5/d40/l8a 0 2024-09-18T12:49:20.713 INFO:tasks.workunit.client.1.smithi148.stdout:8/773: dread d8/d16/faf [0,4194304] 0 2024-09-18T12:49:20.714 INFO:tasks.workunit.client.0.smithi078.stdout:6/605: dwrite d10/d2b/d43/d53/d63/d70/f8c [0,4194304] 0 2024-09-18T12:49:20.714 INFO:tasks.workunit.client.1.smithi148.stdout:2/614: symlink d9/d17/d29/d92/d95/le0 0 2024-09-18T12:49:20.714 INFO:tasks.workunit.client.1.smithi148.stdout:2/615: write d9/d24/d47/fb2 [2057099,90807] 0 2024-09-18T12:49:20.721 INFO:tasks.workunit.client.1.smithi148.stdout:9/676: dwrite d8/da/dd/d4a/d49/d46/d75/f7e [0,4194304] 0 2024-09-18T12:49:20.722 INFO:tasks.workunit.client.1.smithi148.stdout:3/654: creat d4/d8/d6a/db3/db7/dcb/fe0 x:0 0 0 2024-09-18T12:49:20.723 INFO:tasks.workunit.client.1.smithi148.stdout:3/655: fsync d4/d8/f1a 0 2024-09-18T12:49:20.723 INFO:tasks.workunit.client.1.smithi148.stdout:4/685: dwrite d15/d17/d52/d92/d4c/f5d [0,4194304] 0 2024-09-18T12:49:20.725 INFO:tasks.workunit.client.0.smithi078.stdout:2/410: getdents d4/db/d45 0 2024-09-18T12:49:20.726 INFO:tasks.workunit.client.1.smithi148.stdout:8/774: stat d8/d16/d53/d39/def 0 2024-09-18T12:49:20.727 INFO:tasks.workunit.client.1.smithi148.stdout:3/656: fsync d4/d8/d1e/d6b/d31/f58 0 2024-09-18T12:49:20.729 INFO:tasks.workunit.client.1.smithi148.stdout:3/657: readlink d4/d8/d1e/d6b/d31/d60/l74 0 2024-09-18T12:49:20.730 INFO:tasks.workunit.client.0.smithi078.stdout:4/478: mknod d11/d27/d5a/d84/d4b/c9c 0 2024-09-18T12:49:20.732 INFO:tasks.workunit.client.0.smithi078.stdout:5/611: creat d2/d4/d9/da/d60/d7f/fba x:0 0 0 2024-09-18T12:49:20.732 INFO:tasks.workunit.client.0.smithi078.stdout:5/612: chown d2/d4/d9/da/d2b/d3e 138751683 1 2024-09-18T12:49:20.733 INFO:tasks.workunit.client.0.smithi078.stdout:8/416: fsync d0/d7/d1e/d4b/f73 0 2024-09-18T12:49:20.734 INFO:tasks.workunit.client.0.smithi078.stdout:7/372: mkdir d7/d26/d84 0 2024-09-18T12:49:20.736 INFO:tasks.workunit.client.1.smithi148.stdout:8/775: creat d8/d16/d53/d39/d3b/f10b x:0 0 0 2024-09-18T12:49:20.737 INFO:tasks.workunit.client.0.smithi078.stdout:8/417: dread d0/d7/dc/f64 [0,4194304] 0 2024-09-18T12:49:20.739 INFO:tasks.workunit.client.1.smithi148.stdout:9/677: creat d8/da/dd/d4a/d49/d46/d54/dab/fd0 x:0 0 0 2024-09-18T12:49:20.741 INFO:tasks.workunit.client.1.smithi148.stdout:8/776: creat d8/d12/d46/d74/dd5/f10c x:0 0 0 2024-09-18T12:49:20.741 INFO:tasks.workunit.client.1.smithi148.stdout:8/777: stat d8/d12/d46/c8b 0 2024-09-18T12:49:20.742 INFO:tasks.workunit.client.1.smithi148.stdout:8/778: fsync d8/d16/d27/f4a 0 2024-09-18T12:49:20.743 INFO:tasks.workunit.client.1.smithi148.stdout:9/678: read d8/da/dd/d35/d81/f8e [2359127,106845] 0 2024-09-18T12:49:20.743 INFO:tasks.workunit.client.0.smithi078.stdout:4/479: creat d11/d27/d60/f9d x:0 0 0 2024-09-18T12:49:20.743 INFO:tasks.workunit.client.1.smithi148.stdout:8/779: chown d8/d12/d46/d7e/da1/fbb 2040474447 1 2024-09-18T12:49:20.744 INFO:tasks.workunit.client.0.smithi078.stdout:4/480: stat d11/d27/d5a/d84/l32 0 2024-09-18T12:49:20.744 INFO:tasks.workunit.client.1.smithi148.stdout:4/686: creat d15/d17/d52/d92/d4c/fe5 x:0 0 0 2024-09-18T12:49:20.744 INFO:tasks.workunit.client.0.smithi078.stdout:0/562: symlink d3/lce 0 2024-09-18T12:49:20.746 INFO:tasks.workunit.client.1.smithi148.stdout:3/658: link d4/d8/d20/d2b/d7f/l87 d4/d8/d1e/d6b/d31/d60/le1 0 2024-09-18T12:49:20.747 INFO:tasks.workunit.client.0.smithi078.stdout:7/373: creat d7/d9/d14/d22/d35/f85 x:0 0 0 2024-09-18T12:49:20.748 INFO:tasks.workunit.client.0.smithi078.stdout:7/374: chown d7/d9/d14/d22/d3e/c41 1022636 1 2024-09-18T12:49:20.749 INFO:tasks.workunit.client.1.smithi148.stdout:9/679: dread d8/f22 [0,4194304] 0 2024-09-18T12:49:20.750 INFO:tasks.workunit.client.0.smithi078.stdout:9/421: chown d5/d7/d32/d2a/d6b/f57 30473384 1 2024-09-18T12:49:20.754 INFO:tasks.workunit.client.1.smithi148.stdout:4/687: dwrite d15/fc6 [4194304,4194304] 0 2024-09-18T12:49:20.754 INFO:tasks.workunit.client.1.smithi148.stdout:8/780: dwrite d8/df/d3e/d82/d8f/d95/fc2 [0,4194304] 0 2024-09-18T12:49:20.754 INFO:tasks.workunit.client.0.smithi078.stdout:1/453: creat d0/d8/da/f8d x:0 0 0 2024-09-18T12:49:20.755 INFO:tasks.workunit.client.0.smithi078.stdout:7/375: dwrite d7/d5d/d5e/f5f [0,4194304] 0 2024-09-18T12:49:20.756 INFO:tasks.workunit.client.1.smithi148.stdout:4/688: chown d15/fc6 837010872 1 2024-09-18T12:49:20.756 INFO:tasks.workunit.client.1.smithi148.stdout:3/659: rmdir d4/d8/d1e/d6b/d31 39 2024-09-18T12:49:20.756 INFO:tasks.workunit.client.1.smithi148.stdout:8/781: write d8/d16/f9d [2354826,81706] 0 2024-09-18T12:49:20.757 INFO:tasks.workunit.client.0.smithi078.stdout:1/454: stat d0/d8/da/d3e/d58/d6e/d52/f32 0 2024-09-18T12:49:20.759 INFO:tasks.workunit.client.0.smithi078.stdout:4/481: fdatasync d11/f61 0 2024-09-18T12:49:20.760 INFO:tasks.workunit.client.1.smithi148.stdout:2/616: dwrite d9/d17/f6a [0,4194304] 0 2024-09-18T12:49:20.762 INFO:tasks.workunit.client.1.smithi148.stdout:4/689: chown d15/d17/d52/d92/d4c/d4f/d64/l87 42606 1 2024-09-18T12:49:20.767 INFO:tasks.workunit.client.0.smithi078.stdout:4/482: truncate d11/d27/d5a/d84/d40/f8b 274252 0 2024-09-18T12:49:20.769 INFO:tasks.workunit.client.0.smithi078.stdout:2/411: write d4/d8/d23/d52/d5f/d86/f60 [7961290,39010] 0 2024-09-18T12:49:20.769 INFO:tasks.workunit.client.0.smithi078.stdout:7/376: dwrite d7/d26/f29 [0,4194304] 0 2024-09-18T12:49:20.772 INFO:tasks.workunit.client.1.smithi148.stdout:4/690: read d15/d17/f27 [429373,21137] 0 2024-09-18T12:49:20.775 INFO:tasks.workunit.client.1.smithi148.stdout:8/782: dwrite d8/d16/fcf [0,4194304] 0 2024-09-18T12:49:20.776 INFO:tasks.workunit.client.0.smithi078.stdout:8/418: mknod d0/d39/d4c/d77/d7d/d52/d62/c80 0 2024-09-18T12:49:20.776 INFO:tasks.workunit.client.1.smithi148.stdout:8/783: fdatasync d8/d16/d27/f30 0 2024-09-18T12:49:20.777 INFO:tasks.workunit.client.1.smithi148.stdout:8/784: chown d8/df/d3e/l79 5 1 2024-09-18T12:49:20.778 INFO:tasks.workunit.client.0.smithi078.stdout:8/419: dread d0/d7/dc/d1f/d23/d44/f4a [0,4194304] 0 2024-09-18T12:49:20.780 INFO:tasks.workunit.client.1.smithi148.stdout:2/617: rmdir d9/d24 39 2024-09-18T12:49:20.782 INFO:tasks.workunit.client.1.smithi148.stdout:5/704: sync 2024-09-18T12:49:20.782 INFO:tasks.workunit.client.1.smithi148.stdout:0/853: sync 2024-09-18T12:49:20.782 INFO:tasks.workunit.client.1.smithi148.stdout:6/702: sync 2024-09-18T12:49:20.784 INFO:tasks.workunit.client.1.smithi148.stdout:0/854: stat de/d27/d53/d89/dc1/cb2 0 2024-09-18T12:49:20.784 INFO:tasks.workunit.client.0.smithi078.stdout:6/606: truncate d10/d2b/d43/f8f 732238 0 2024-09-18T12:49:20.784 INFO:tasks.workunit.client.1.smithi148.stdout:5/705: chown d7/d8/dc/d12/d31/f7b 244 1 2024-09-18T12:49:20.798 INFO:tasks.workunit.client.0.smithi078.stdout:0/563: creat d3/d1f/d2e/d4e/d37/d72/d96/fcf x:0 0 0 2024-09-18T12:49:20.800 INFO:tasks.workunit.client.0.smithi078.stdout:2/412: fdatasync d4/f5 0 2024-09-18T12:49:20.801 INFO:tasks.workunit.client.1.smithi148.stdout:7/701: sync 2024-09-18T12:49:20.801 INFO:tasks.workunit.client.1.smithi148.stdout:1/682: sync 2024-09-18T12:49:20.801 INFO:tasks.workunit.client.0.smithi078.stdout:7/377: stat d7/d9/d32/l46 0 2024-09-18T12:49:20.802 INFO:tasks.workunit.client.1.smithi148.stdout:8/785: read d8/d12/d46/f58 [1734312,38423] 0 2024-09-18T12:49:20.802 INFO:tasks.workunit.client.1.smithi148.stdout:2/618: mkdir d9/d73/d81/de1 0 2024-09-18T12:49:20.805 INFO:tasks.workunit.client.1.smithi148.stdout:6/703: creat d5/d32/d56/fde x:0 0 0 2024-09-18T12:49:20.806 INFO:tasks.workunit.client.0.smithi078.stdout:7/378: dread d7/d9/d32/d3b/f45 [0,4194304] 0 2024-09-18T12:49:20.807 INFO:tasks.workunit.client.1.smithi148.stdout:0/855: mknod de/d27/db3/c11f 0 2024-09-18T12:49:20.808 INFO:tasks.workunit.client.0.smithi078.stdout:5/613: write d2/d4/f1e [59931,99332] 0 2024-09-18T12:49:20.810 INFO:tasks.workunit.client.1.smithi148.stdout:5/706: creat d7/d8/d18/d3f/d7c/fef x:0 0 0 2024-09-18T12:49:20.811 INFO:tasks.workunit.client.1.smithi148.stdout:3/660: creat d4/d8/d1e/fe2 x:0 0 0 2024-09-18T12:49:20.813 INFO:tasks.workunit.client.1.smithi148.stdout:6/704: dwrite d5/d1a/dc/dbf/fc3 [0,4194304] 0 2024-09-18T12:49:20.815 INFO:tasks.workunit.client.1.smithi148.stdout:9/680: getdents d8/da/dd/d3f 0 2024-09-18T12:49:20.815 INFO:tasks.workunit.client.1.smithi148.stdout:6/705: write d5/f23 [8769093,41903] 0 2024-09-18T12:49:20.817 INFO:tasks.workunit.client.0.smithi078.stdout:2/413: symlink d4/d8/d23/d52/d5f/d86/d3b/l87 0 2024-09-18T12:49:20.820 INFO:tasks.workunit.client.1.smithi148.stdout:5/707: dwrite d7/d2b/f7a [0,4194304] 0 2024-09-18T12:49:20.821 INFO:tasks.workunit.client.1.smithi148.stdout:2/619: read d9/d24/d67/d72/fb6 [131556,26659] 0 2024-09-18T12:49:20.823 INFO:tasks.workunit.client.1.smithi148.stdout:0/856: mknod de/d27/d53/d89/dc1/c120 0 2024-09-18T12:49:20.823 INFO:tasks.workunit.client.1.smithi148.stdout:5/708: chown d7/d8/dc/da6/dee/d25/fa7 37388 1 2024-09-18T12:49:20.833 INFO:tasks.workunit.client.1.smithi148.stdout:9/681: mkdir d8/da/dd/d4a/d49/dd1 0 2024-09-18T12:49:20.836 INFO:tasks.workunit.client.1.smithi148.stdout:2/620: fdatasync d9/d24/f80 0 2024-09-18T12:49:20.839 INFO:tasks.workunit.client.0.smithi078.stdout:2/414: mknod d4/d20/c88 0 2024-09-18T12:49:20.841 INFO:tasks.workunit.client.1.smithi148.stdout:4/691: getdents d15/d17/d52/d92/d4c/d4f/d34 0 2024-09-18T12:49:20.841 INFO:tasks.workunit.client.0.smithi078.stdout:9/422: getdents d5/d7/d8/d4f 0 2024-09-18T12:49:20.841 INFO:tasks.workunit.client.1.smithi148.stdout:8/786: dread d8/d16/f5d [0,4194304] 0 2024-09-18T12:49:20.843 INFO:tasks.workunit.client.1.smithi148.stdout:3/661: fsync d4/d8/d1e/d6b/d31/d46/f80 0 2024-09-18T12:49:20.843 INFO:tasks.workunit.client.1.smithi148.stdout:4/692: write d15/d17/d52/d92/d4c/d4f/f6c [1386685,24745] 0 2024-09-18T12:49:20.845 INFO:tasks.workunit.client.0.smithi078.stdout:5/614: symlink d2/d4/d9/da/d60/db3/d16/d36/d68/db6/lbb 0 2024-09-18T12:49:20.846 INFO:tasks.workunit.client.0.smithi078.stdout:5/615: readlink d2/d4/d9/da/d60/db3/d16/d36/d68/l91 0 2024-09-18T12:49:20.846 INFO:tasks.workunit.client.0.smithi078.stdout:2/415: rmdir d4/db/d45 39 2024-09-18T12:49:20.848 INFO:tasks.workunit.client.0.smithi078.stdout:5/616: write d2/d4/d9/f94 [19832,31178] 0 2024-09-18T12:49:20.850 INFO:tasks.workunit.client.0.smithi078.stdout:9/423: dread d5/d7/d32/f31 [0,4194304] 0 2024-09-18T12:49:20.852 INFO:tasks.workunit.client.0.smithi078.stdout:2/416: symlink d4/d8/d23/d52/l89 0 2024-09-18T12:49:20.853 INFO:tasks.workunit.client.1.smithi148.stdout:5/709: creat d7/d8/dc/da6/dee/d25/d4b/dbd/ff0 x:0 0 0 2024-09-18T12:49:20.853 INFO:tasks.workunit.client.0.smithi078.stdout:8/420: write d0/f1a [4051913,66342] 0 2024-09-18T12:49:20.854 INFO:tasks.workunit.client.0.smithi078.stdout:1/455: write d0/d8/da/d3e/d58/d6e/d52/d47/f8a [441346,86565] 0 2024-09-18T12:49:20.855 INFO:tasks.workunit.client.1.smithi148.stdout:2/621: dwrite d9/d24/d67/d72/d8f/fbf [0,4194304] 0 2024-09-18T12:49:20.857 INFO:tasks.workunit.client.1.smithi148.stdout:9/682: dread d8/da/dd/d77/fbd [0,4194304] 0 2024-09-18T12:49:20.859 INFO:tasks.workunit.client.1.smithi148.stdout:6/706: creat d5/fdf x:0 0 0 2024-09-18T12:49:20.859 INFO:tasks.workunit.client.0.smithi078.stdout:0/564: write d3/f6c [3927712,115001] 0 2024-09-18T12:49:20.859 INFO:tasks.workunit.client.0.smithi078.stdout:7/379: getdents d7/d9/d4d 0 2024-09-18T12:49:20.859 INFO:tasks.workunit.client.0.smithi078.stdout:8/421: dread d0/d7/dc/f64 [0,4194304] 0 2024-09-18T12:49:20.860 INFO:tasks.workunit.client.0.smithi078.stdout:5/617: dread d2/d4/f66 [0,4194304] 0 2024-09-18T12:49:20.860 INFO:tasks.workunit.client.0.smithi078.stdout:7/380: stat d7/d9/d32/l46 0 2024-09-18T12:49:20.861 INFO:tasks.workunit.client.0.smithi078.stdout:2/417: chown d4/dd/l27 3986 1 2024-09-18T12:49:20.861 INFO:tasks.workunit.client.0.smithi078.stdout:7/381: chown d7/f65 12 1 2024-09-18T12:49:20.862 INFO:tasks.workunit.client.1.smithi148.stdout:7/702: write db/dc/df/d11/d34/f61 [36578,25121] 0 2024-09-18T12:49:20.862 INFO:tasks.workunit.client.0.smithi078.stdout:5/618: chown d2/d4/d48/d86/c96 210366 1 2024-09-18T12:49:20.862 INFO:tasks.workunit.client.1.smithi148.stdout:9/683: dread d8/da/dd/d4a/f3a [0,4194304] 0 2024-09-18T12:49:20.863 INFO:tasks.workunit.client.0.smithi078.stdout:1/456: creat d0/d8/da/d45/f8e x:0 0 0 2024-09-18T12:49:20.865 INFO:tasks.workunit.client.1.smithi148.stdout:5/710: dwrite d7/d8/dc/d12/d31/d5a/fb3 [0,4194304] 0 2024-09-18T12:49:20.866 INFO:tasks.workunit.client.1.smithi148.stdout:5/711: dread - d7/d8/fd9 zero size 2024-09-18T12:49:20.899 INFO:tasks.workunit.client.1.smithi148.stdout:1/683: sync 2024-09-18T12:49:20.909 INFO:tasks.workunit.client.0.smithi078.stdout:5/619: write d2/d4/d9/da/d60/db3/d16/d36/d4c/d62/d4d/f9b [108234,73523] 0 2024-09-18T12:49:20.909 INFO:tasks.workunit.client.0.smithi078.stdout:1/457: chown d0/d8/da/d3e/d58/d6e/f4d 20737 1 2024-09-18T12:49:20.911 INFO:tasks.workunit.client.0.smithi078.stdout:1/458: write d0/f19 [1897285,90008] 0 2024-09-18T12:49:20.914 INFO:tasks.workunit.client.0.smithi078.stdout:6/607: truncate d10/d2b/d43/d53/d45/d55/f88 5149419 0 2024-09-18T12:49:20.914 INFO:tasks.workunit.client.0.smithi078.stdout:7/382: dwrite d7/d26/d4f/f50 [0,4194304] 0 2024-09-18T12:49:20.914 INFO:tasks.workunit.client.0.smithi078.stdout:0/565: rmdir d3/d1f/d2e/d4e 39 2024-09-18T12:49:20.917 INFO:tasks.workunit.client.0.smithi078.stdout:6/608: write d10/d2b/d43/d53/d63/d70/d7d/f84 [1267600,110274] 0 2024-09-18T12:49:20.917 INFO:tasks.workunit.client.1.smithi148.stdout:2/622: symlink d9/d24/d67/d72/d77/le2 0 2024-09-18T12:49:20.919 INFO:tasks.workunit.client.0.smithi078.stdout:4/483: truncate d11/f1d 1856366 0 2024-09-18T12:49:20.921 INFO:tasks.workunit.client.1.smithi148.stdout:0/857: write de/d27/d53/d89/dc0/fba [924393,77546] 0 2024-09-18T12:49:20.923 INFO:tasks.workunit.client.1.smithi148.stdout:6/707: rename d5/d32/lc6 to d5/d1a/dc/d2b/d35/d65/d99/da4/da6/le0 0 2024-09-18T12:49:20.924 INFO:tasks.workunit.client.1.smithi148.stdout:2/623: dwrite d9/d73/fa8 [0,4194304] 0 2024-09-18T12:49:20.926 INFO:tasks.workunit.client.1.smithi148.stdout:2/624: dread d9/d3a/fd3 [0,4194304] 0 2024-09-18T12:49:20.926 INFO:tasks.workunit.client.1.smithi148.stdout:7/703: mknod db/dc/df/d11/d34/cd1 0 2024-09-18T12:49:20.927 INFO:tasks.workunit.client.1.smithi148.stdout:4/693: truncate d15/d17/d52/d92/d4c/d4f/f3d 1941335 0 2024-09-18T12:49:20.929 INFO:tasks.workunit.client.1.smithi148.stdout:9/684: truncate d8/da/dd/d4a/f3a 1171766 0 2024-09-18T12:49:20.929 INFO:tasks.workunit.client.1.smithi148.stdout:7/704: fsync db/dc/df/d1d/d68/d7a/f85 0 2024-09-18T12:49:20.930 INFO:tasks.workunit.client.1.smithi148.stdout:5/712: mkdir d7/d8/dc/da6/dee/d69/d8b/df1 0 2024-09-18T12:49:20.931 INFO:tasks.workunit.client.1.smithi148.stdout:9/685: fdatasync d8/da/dd/d65/f76 0 2024-09-18T12:49:20.931 INFO:tasks.workunit.client.1.smithi148.stdout:1/684: mkdir dc/d18/d31/d4b/d8d/ddd 0 2024-09-18T12:49:20.932 INFO:tasks.workunit.client.1.smithi148.stdout:6/708: dread d5/d1a/dc/d2b/d35/d65/d99/da4/da6/fba [0,4194304] 0 2024-09-18T12:49:20.932 INFO:tasks.workunit.client.1.smithi148.stdout:7/705: readlink db/dc/df/d11/d34/d69/lb4 0 2024-09-18T12:49:20.933 INFO:tasks.workunit.client.1.smithi148.stdout:3/662: creat d4/d8/d20/d2b/d7f/d93/d94/dac/fe3 x:0 0 0 2024-09-18T12:49:20.933 INFO:tasks.workunit.client.1.smithi148.stdout:6/709: readlink d5/d32/d56/l51 0 2024-09-18T12:49:20.936 INFO:tasks.workunit.client.0.smithi078.stdout:4/484: mknod d11/d27/d47/c9e 0 2024-09-18T12:49:20.937 INFO:tasks.workunit.client.1.smithi148.stdout:0/858: mkdir de/d14/d43/dd6/d121 0 2024-09-18T12:49:20.938 INFO:tasks.workunit.client.0.smithi078.stdout:2/418: mkdir d4/dd/d8a 0 2024-09-18T12:49:20.938 INFO:tasks.workunit.client.0.smithi078.stdout:4/485: write d11/d27/d5a/d84/f72 [1155166,31991] 0 2024-09-18T12:49:20.940 INFO:tasks.workunit.client.0.smithi078.stdout:9/424: dwrite d5/d5c/f88 [4194304,4194304] 0 2024-09-18T12:49:20.943 INFO:tasks.workunit.client.0.smithi078.stdout:8/422: rename d0/d7/d1e/d50/f5b to d0/d39/d4c/d77/d7d/d52/d62/f81 0 2024-09-18T12:49:20.946 INFO:tasks.workunit.client.1.smithi148.stdout:8/787: truncate d8/df/db2/fc9 4094420 0 2024-09-18T12:49:20.948 INFO:tasks.workunit.client.0.smithi078.stdout:4/486: dwrite d11/d27/d5a/d84/d40/f41 [0,4194304] 0 2024-09-18T12:49:20.948 INFO:tasks.workunit.client.1.smithi148.stdout:8/788: chown d8/d12/d46/d74/f9b 841 1 2024-09-18T12:49:20.949 INFO:tasks.workunit.client.1.smithi148.stdout:4/694: creat d15/d17/d52/d92/d4c/d4f/d64/da0/da1/fe6 x:0 0 0 2024-09-18T12:49:20.950 INFO:tasks.workunit.client.0.smithi078.stdout:0/566: mkdir d3/d43/dd0 0 2024-09-18T12:49:20.950 INFO:tasks.workunit.client.1.smithi148.stdout:4/695: chown d15/d17/d52/d92/d4c/f5b 2917 1 2024-09-18T12:49:20.954 INFO:tasks.workunit.client.1.smithi148.stdout:5/713: chown d7/d8/dc/da6/dee/d69/d8b/dad/laf 57910 1 2024-09-18T12:49:20.955 INFO:tasks.workunit.client.0.smithi078.stdout:5/620: dwrite d2/d4/f4f [0,4194304] 0 2024-09-18T12:49:20.961 INFO:tasks.workunit.client.0.smithi078.stdout:9/425: fsync d5/d7/d32/d2a/f72 0 2024-09-18T12:49:20.961 INFO:tasks.workunit.client.1.smithi148.stdout:1/685: symlink dc/d11/d38/d7b/lde 0 2024-09-18T12:49:20.962 INFO:tasks.workunit.client.1.smithi148.stdout:5/714: dread - d7/d8/dc/da6/dee/d77/fbb zero size 2024-09-18T12:49:20.962 INFO:tasks.workunit.client.1.smithi148.stdout:7/706: unlink db/d52/fae 0 2024-09-18T12:49:20.962 INFO:tasks.workunit.client.0.smithi078.stdout:7/383: dwrite d7/f33 [0,4194304] 0 2024-09-18T12:49:20.963 INFO:tasks.workunit.client.1.smithi148.stdout:5/715: chown d7/d8/dc/d12/d31/d6c 28695 1 2024-09-18T12:49:20.964 INFO:tasks.workunit.client.0.smithi078.stdout:1/459: rename d0/d8/da/d3e/f67 to d0/d8/da/d3e/d58/d6e/d52/d47/f8f 0 2024-09-18T12:49:20.965 INFO:tasks.workunit.client.1.smithi148.stdout:4/696: dwrite d15/d17/d52/d68/da5/dc0/fc2 [0,4194304] 0 2024-09-18T12:49:20.968 INFO:tasks.workunit.client.1.smithi148.stdout:4/697: stat d15/d17/d52/l7c 0 2024-09-18T12:49:20.968 INFO:tasks.workunit.client.1.smithi148.stdout:6/710: mknod d5/d1a/dc/d2b/d35/d65/d99/da4/ce1 0 2024-09-18T12:49:20.971 INFO:tasks.workunit.client.0.smithi078.stdout:1/460: dwrite d0/d5b/d6d/f80 [0,4194304] 0 2024-09-18T12:49:20.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:20 smithi148 ceph-mon[35352]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:20.976 INFO:tasks.workunit.client.1.smithi148.stdout:1/686: dwrite dc/d4d/dad/db1/fc0 [0,4194304] 0 2024-09-18T12:49:20.977 INFO:tasks.workunit.client.1.smithi148.stdout:2/625: fsync d9/f39 0 2024-09-18T12:49:20.979 INFO:tasks.workunit.client.0.smithi078.stdout:5/621: fdatasync d2/d4/d9/da/d60/db3/d16/d36/f79 0 2024-09-18T12:49:20.980 INFO:tasks.workunit.client.1.smithi148.stdout:8/789: dread d8/d12/d51/d94/f64 [0,4194304] 0 2024-09-18T12:49:20.980 INFO:tasks.workunit.client.1.smithi148.stdout:2/626: dread - d9/d24/d31/d34/f6e zero size 2024-09-18T12:49:20.981 INFO:tasks.workunit.client.1.smithi148.stdout:8/790: chown d8/d16/d27/f76 16531303 1 2024-09-18T12:49:20.985 INFO:tasks.workunit.client.0.smithi078.stdout:9/426: write d5/d7/f62 [135356,91083] 0 2024-09-18T12:49:20.987 INFO:tasks.workunit.client.0.smithi078.stdout:9/427: fdatasync d5/d7/d8/d4f/f64 0 2024-09-18T12:49:20.987 INFO:tasks.workunit.client.1.smithi148.stdout:9/686: unlink d8/da/dd/d4a/d49/d46/cae 0 2024-09-18T12:49:20.991 INFO:tasks.workunit.client.1.smithi148.stdout:7/707: fsync db/dc/df/d1d/f57 0 2024-09-18T12:49:20.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:20 smithi078 ceph-mon[28091]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:20.995 INFO:tasks.workunit.client.0.smithi078.stdout:8/423: truncate d0/d7/dc/d5d/f37 2204796 0 2024-09-18T12:49:20.997 INFO:tasks.workunit.client.1.smithi148.stdout:0/859: symlink de/d14/d6b/ddf/l122 0 2024-09-18T12:49:20.997 INFO:tasks.workunit.client.0.smithi078.stdout:0/567: mknod d3/d1f/d2e/d4e/d37/d72/d96/cd1 0 2024-09-18T12:49:20.998 INFO:tasks.workunit.client.0.smithi078.stdout:1/461: symlink d0/l90 0 2024-09-18T12:49:20.998 INFO:tasks.workunit.client.0.smithi078.stdout:0/568: chown d3/d1f/d2e/d4e/d37/d72/d96/fab 0 1 2024-09-18T12:49:20.999 INFO:tasks.workunit.client.1.smithi148.stdout:4/698: mknod d15/d90/ce7 0 2024-09-18T12:49:20.999 INFO:tasks.workunit.client.0.smithi078.stdout:1/462: read d0/d8/da/d3e/d58/d6e/d52/f2e [543004,79886] 0 2024-09-18T12:49:21.000 INFO:tasks.workunit.client.1.smithi148.stdout:6/711: mkdir d5/d1a/dc/d2b/d35/d65/d99/da4/de2 0 2024-09-18T12:49:21.001 INFO:tasks.workunit.client.0.smithi078.stdout:2/419: creat d4/dd/f8b x:0 0 0 2024-09-18T12:49:21.001 INFO:tasks.workunit.client.1.smithi148.stdout:1/687: stat dc/d18/d7d/d93/dd9/d2b/d80 0 2024-09-18T12:49:21.002 INFO:tasks.workunit.client.0.smithi078.stdout:2/420: fdatasync d4/d8/d23/d52/d5f/d86/f60 0 2024-09-18T12:49:21.002 INFO:tasks.workunit.client.1.smithi148.stdout:1/688: chown dc/d11/f53 326770 1 2024-09-18T12:49:21.002 INFO:tasks.workunit.client.1.smithi148.stdout:1/689: stat dc/d18/d7d/d93/dd9/f23 0 2024-09-18T12:49:21.003 INFO:tasks.workunit.client.0.smithi078.stdout:2/421: chown d4/d8/d23/d52/d7c/f82 154 1 2024-09-18T12:49:21.003 INFO:tasks.workunit.client.0.smithi078.stdout:5/622: creat d2/d4/d48/fbc x:0 0 0 2024-09-18T12:49:21.004 INFO:tasks.workunit.client.0.smithi078.stdout:9/428: creat d5/d7/d8/d4f/f8b x:0 0 0 2024-09-18T12:49:21.005 INFO:tasks.workunit.client.0.smithi078.stdout:2/422: chown d4/d8/d23/d52/d5f/d86/d3b/d4f/f61 99450618 1 2024-09-18T12:49:21.009 INFO:tasks.workunit.client.0.smithi078.stdout:2/423: read d4/d8/f4b [1335942,36535] 0 2024-09-18T12:49:21.013 INFO:tasks.workunit.client.0.smithi078.stdout:1/463: chown d0/d8/da/d3e/d58/d6e/c68 1487 1 2024-09-18T12:49:21.013 INFO:tasks.workunit.client.0.smithi078.stdout:8/424: read d0/f1 [126065,20033] 0 2024-09-18T12:49:21.014 INFO:tasks.workunit.client.1.smithi148.stdout:4/699: unlink d15/d5f/d69/f85 0 2024-09-18T12:49:21.015 INFO:tasks.workunit.client.0.smithi078.stdout:1/464: stat d0/d8/da/d3e/d58/d6e/d52/d47/f8a 0 2024-09-18T12:49:21.016 INFO:tasks.workunit.client.1.smithi148.stdout:6/712: creat d5/d1a/dc/d2b/d35/d65/d99/da4/da6/fe3 x:0 0 0 2024-09-18T12:49:21.018 INFO:tasks.workunit.client.0.smithi078.stdout:6/609: rename d10/d2b/d43/l81 to d10/d2b/d43/d53/d63/d70/lc6 0 2024-09-18T12:49:21.019 INFO:tasks.workunit.client.0.smithi078.stdout:6/610: write d10/d2b/d37/f59 [3592475,18731] 0 2024-09-18T12:49:21.020 INFO:tasks.workunit.client.1.smithi148.stdout:2/627: mkdir d9/d24/d67/dc7/dce/de3 0 2024-09-18T12:49:21.026 INFO:tasks.workunit.client.0.smithi078.stdout:4/487: rename d11/d27/d5a/d5d/d6a to d11/d27/d89/d9f 0 2024-09-18T12:49:21.028 INFO:tasks.workunit.client.1.smithi148.stdout:1/690: dread dc/d18/d43/fb2 [0,4194304] 0 2024-09-18T12:49:21.028 INFO:tasks.workunit.client.1.smithi148.stdout:0/860: mknod de/d27/c123 0 2024-09-18T12:49:21.029 INFO:tasks.workunit.client.0.smithi078.stdout:3/463: sync 2024-09-18T12:49:21.029 INFO:tasks.workunit.client.1.smithi148.stdout:0/861: read - de/d27/ffc zero size 2024-09-18T12:49:21.030 INFO:tasks.workunit.client.0.smithi078.stdout:5/623: mkdir d2/d4/d9/da/d60/db3/d16/d36/d4c/d62/dbd 0 2024-09-18T12:49:21.034 INFO:tasks.workunit.client.0.smithi078.stdout:6/611: dread d10/d2b/d61/f66 [0,4194304] 0 2024-09-18T12:49:21.036 INFO:tasks.workunit.client.0.smithi078.stdout:9/429: dread d5/d7/d8/f27 [0,4194304] 0 2024-09-18T12:49:21.037 INFO:tasks.workunit.client.1.smithi148.stdout:8/791: rename d8/df/d3e/d82/dd2 to d8/d16/d53/d39/d10d 0 2024-09-18T12:49:21.038 INFO:tasks.workunit.client.1.smithi148.stdout:8/792: dread - d8/d16/d53/d39/d3b/f10b zero size 2024-09-18T12:49:21.040 INFO:tasks.workunit.client.0.smithi078.stdout:0/569: creat d3/fd2 x:0 0 0 2024-09-18T12:49:21.040 INFO:tasks.workunit.client.1.smithi148.stdout:3/663: link d4/d8/d20/d99/cb5 d4/d8/d1e/d6b/d31/d60/ce4 0 2024-09-18T12:49:21.041 INFO:tasks.workunit.client.0.smithi078.stdout:7/384: dwrite d7/d9/d32/d3b/f45 [0,4194304] 0 2024-09-18T12:49:21.041 INFO:tasks.workunit.client.0.smithi078.stdout:8/425: symlink d0/d7/d53/d57/d67/l82 0 2024-09-18T12:49:21.044 INFO:tasks.workunit.client.1.smithi148.stdout:5/716: getdents d7/d8/dc/d12 0 2024-09-18T12:49:21.044 INFO:tasks.workunit.client.1.smithi148.stdout:5/717: readlink d7/d8/dc/da6/dee/l27 0 2024-09-18T12:49:21.046 INFO:tasks.workunit.client.0.smithi078.stdout:8/426: read d0/f1a [864678,33794] 0 2024-09-18T12:49:21.046 INFO:tasks.workunit.client.0.smithi078.stdout:5/624: dwrite d2/d4/d9/d2f/d30/f59 [0,4194304] 0 2024-09-18T12:49:21.046 INFO:tasks.workunit.client.0.smithi078.stdout:4/488: dread d11/d27/d47/f3d [0,4194304] 0 2024-09-18T12:49:21.047 INFO:tasks.workunit.client.0.smithi078.stdout:1/465: rename d0/d8/da/d3e/d58/d6e/d52/f32 to d0/d8/da/d45/f91 0 2024-09-18T12:49:21.048 INFO:tasks.workunit.client.0.smithi078.stdout:2/424: dread d4/db/f2a [0,4194304] 0 2024-09-18T12:49:21.049 INFO:tasks.workunit.client.0.smithi078.stdout:3/464: rmdir d9/d13/d33/d4e 39 2024-09-18T12:49:21.051 INFO:tasks.workunit.client.0.smithi078.stdout:2/425: write d4/db/f6f [4128568,91544] 0 2024-09-18T12:49:21.052 INFO:tasks.workunit.client.0.smithi078.stdout:5/625: dread - d2/d4/d48/fbc zero size 2024-09-18T12:49:21.052 INFO:tasks.workunit.client.0.smithi078.stdout:4/489: chown d11/d27/d5a/f79 546922 1 2024-09-18T12:49:21.057 INFO:tasks.workunit.client.0.smithi078.stdout:6/612: dread d10/f16 [0,4194304] 0 2024-09-18T12:49:21.060 INFO:tasks.workunit.client.1.smithi148.stdout:9/687: write d8/da/dd/d77/fbd [1985978,78926] 0 2024-09-18T12:49:21.060 INFO:tasks.workunit.client.1.smithi148.stdout:5/718: rmdir d7/d8/dc/da6/dee/d25/d4b/dbd 39 2024-09-18T12:49:21.062 INFO:tasks.workunit.client.1.smithi148.stdout:5/719: write d7/d8/dc/da6/dee/d69/fe1 [896129,53340] 0 2024-09-18T12:49:21.065 INFO:tasks.workunit.client.1.smithi148.stdout:0/862: dread de/d14/f83 [0,4194304] 0 2024-09-18T12:49:21.068 INFO:tasks.workunit.client.1.smithi148.stdout:8/793: symlink d8/df/d3e/d82/de9/l10e 0 2024-09-18T12:49:21.070 INFO:tasks.workunit.client.0.smithi078.stdout:3/465: symlink d9/d29/d4b/d4c/l8d 0 2024-09-18T12:49:21.072 INFO:tasks.workunit.client.1.smithi148.stdout:9/688: creat d8/da/dd/d35/d81/dc6/fd2 x:0 0 0 2024-09-18T12:49:21.073 INFO:tasks.workunit.client.0.smithi078.stdout:1/466: truncate d0/d8/da/d3e/d58/d6e/d52/f2e 566814 0 2024-09-18T12:49:21.074 INFO:tasks.workunit.client.1.smithi148.stdout:9/689: readlink d8/da/dd/d4a/d27/l4f 0 2024-09-18T12:49:21.075 INFO:tasks.workunit.client.1.smithi148.stdout:9/690: readlink d8/d73/lad 0 2024-09-18T12:49:21.075 INFO:tasks.workunit.client.0.smithi078.stdout:2/426: mknod d4/d8/d23/d52/d7c/c8c 0 2024-09-18T12:49:21.077 INFO:tasks.workunit.client.1.smithi148.stdout:1/691: rmdir dc/d51/dd6 0 2024-09-18T12:49:21.077 INFO:tasks.workunit.client.1.smithi148.stdout:2/628: dwrite d9/d17/d29/d92/d95/f6b [0,4194304] 0 2024-09-18T12:49:21.080 INFO:tasks.workunit.client.1.smithi148.stdout:6/713: getdents d5/d32/d56 0 2024-09-18T12:49:21.081 INFO:tasks.workunit.client.0.smithi078.stdout:6/613: dread - d10/d2b/d43/d53/d45/d55/f52 zero size 2024-09-18T12:49:21.082 INFO:tasks.workunit.client.1.smithi148.stdout:6/714: read f3 [3321135,31314] 0 2024-09-18T12:49:21.084 INFO:tasks.workunit.client.1.smithi148.stdout:0/863: unlink de/d14/d43/d70/l95 0 2024-09-18T12:49:21.086 INFO:tasks.workunit.client.0.smithi078.stdout:1/467: dread d0/d8/da/d3e/d58/d6e/d52/d47/d7d/f48 [0,4194304] 0 2024-09-18T12:49:21.087 INFO:tasks.workunit.client.0.smithi078.stdout:3/466: dread d9/d13/d33/d34/f48 [0,4194304] 0 2024-09-18T12:49:21.090 INFO:tasks.workunit.client.0.smithi078.stdout:9/430: rename d5/c20 to d5/d7/d32/d2a/d36/c8c 0 2024-09-18T12:49:21.092 INFO:tasks.workunit.client.0.smithi078.stdout:8/427: symlink d0/d7/dc/d71/l83 0 2024-09-18T12:49:21.094 INFO:tasks.workunit.client.0.smithi078.stdout:8/428: write d0/d7/f24 [1277291,50215] 0 2024-09-18T12:49:21.094 INFO:tasks.workunit.client.1.smithi148.stdout:9/691: read d8/f22 [855452,20304] 0 2024-09-18T12:49:21.096 INFO:tasks.workunit.client.1.smithi148.stdout:9/692: chown d8/da/dd/d4a/d27/cb1 2007458 1 2024-09-18T12:49:21.096 INFO:tasks.workunit.client.1.smithi148.stdout:5/720: dwrite d7/d8/dc/f2a [0,4194304] 0 2024-09-18T12:49:21.097 INFO:tasks.workunit.client.1.smithi148.stdout:1/692: creat dc/d18/d31/d4b/fdf x:0 0 0 2024-09-18T12:49:21.097 INFO:tasks.workunit.client.1.smithi148.stdout:1/693: chown f6 837019 1 2024-09-18T12:49:21.101 INFO:tasks.workunit.client.1.smithi148.stdout:4/700: sync 2024-09-18T12:49:21.101 INFO:tasks.workunit.client.1.smithi148.stdout:7/708: sync 2024-09-18T12:49:21.103 INFO:tasks.workunit.client.0.smithi078.stdout:6/614: creat d10/d2b/d43/d53/d63/d70/d7d/fc7 x:0 0 0 2024-09-18T12:49:21.105 INFO:tasks.workunit.client.1.smithi148.stdout:8/794: truncate d8/d16/d27/f30 377376 0 2024-09-18T12:49:21.106 INFO:tasks.workunit.client.0.smithi078.stdout:0/570: link d3/d1f/d2e/f83 d3/d1f/d2e/d8f/d90/dcb/fd3 0 2024-09-18T12:49:21.107 INFO:tasks.workunit.client.0.smithi078.stdout:0/571: read - d3/d1f/d2e/d4e/d37/d72/fba zero size 2024-09-18T12:49:21.108 INFO:tasks.workunit.client.1.smithi148.stdout:3/664: getdents d4/d8/d20/d2b/d7f/d93/dd1 0 2024-09-18T12:49:21.110 INFO:tasks.workunit.client.0.smithi078.stdout:3/467: creat d9/d54/f8e x:0 0 0 2024-09-18T12:49:21.112 INFO:tasks.workunit.client.0.smithi078.stdout:0/572: dread d3/d1f/d2e/d68/d30/f62 [0,4194304] 0 2024-09-18T12:49:21.112 INFO:tasks.workunit.client.1.smithi148.stdout:5/721: unlink d7/d8/dc/d12/d31/f48 0 2024-09-18T12:49:21.117 INFO:tasks.workunit.client.1.smithi148.stdout:9/693: creat d8/da/dd/d35/d47/d62/d72/fd3 x:0 0 0 2024-09-18T12:49:21.118 INFO:tasks.workunit.client.1.smithi148.stdout:2/629: mknod d9/d17/ce4 0 2024-09-18T12:49:21.119 INFO:tasks.workunit.client.0.smithi078.stdout:8/429: rename d0/d7/d1e/c31 to d0/d39/d4c/c84 0 2024-09-18T12:49:21.120 INFO:tasks.workunit.client.1.smithi148.stdout:4/701: creat d15/d3f/fe8 x:0 0 0 2024-09-18T12:49:21.121 INFO:tasks.workunit.client.0.smithi078.stdout:2/427: mknod d4/dd/c8d 0 2024-09-18T12:49:21.121 INFO:tasks.workunit.client.1.smithi148.stdout:4/702: readlink d15/d5f/d69/d7f/d94/lcd 0 2024-09-18T12:49:21.122 INFO:tasks.workunit.client.1.smithi148.stdout:0/864: symlink de/d27/d2e/d119/l124 0 2024-09-18T12:49:21.123 INFO:tasks.workunit.client.0.smithi078.stdout:6/615: creat d10/d2b/d43/d53/d63/fc8 x:0 0 0 2024-09-18T12:49:21.124 INFO:tasks.workunit.client.0.smithi078.stdout:7/385: getdents d7/d9/d32/d3b 0 2024-09-18T12:49:21.125 INFO:tasks.workunit.client.0.smithi078.stdout:1/468: dread d0/d8/f2b [0,4194304] 0 2024-09-18T12:49:21.126 INFO:tasks.workunit.client.0.smithi078.stdout:1/469: chown d0/f89 5915348 1 2024-09-18T12:49:21.126 INFO:tasks.workunit.client.1.smithi148.stdout:3/665: symlink d4/d8/d20/d2b/d43/le5 0 2024-09-18T12:49:21.127 INFO:tasks.workunit.client.0.smithi078.stdout:1/470: truncate d0/d8/da/d45/f8e 117848 0 2024-09-18T12:49:21.128 INFO:tasks.workunit.client.1.smithi148.stdout:8/795: dwrite d8/d12/d51/d94/f64 [0,4194304] 0 2024-09-18T12:49:21.130 INFO:tasks.workunit.client.0.smithi078.stdout:4/490: getdents d11 0 2024-09-18T12:49:21.131 INFO:tasks.workunit.client.0.smithi078.stdout:8/430: chown d0/d7/f22 14 1 2024-09-18T12:49:21.131 INFO:tasks.workunit.client.0.smithi078.stdout:4/491: read - d11/d27/d60/f9d zero size 2024-09-18T12:49:21.132 INFO:tasks.workunit.client.0.smithi078.stdout:4/492: chown d11/d45/l85 1350739725 1 2024-09-18T12:49:21.132 INFO:tasks.workunit.client.0.smithi078.stdout:2/428: mkdir d4/d8/d23/d52/d5f/d86/d33/d8e 0 2024-09-18T12:49:21.133 INFO:tasks.workunit.client.0.smithi078.stdout:2/429: chown d4/d1a/c83 735 1 2024-09-18T12:49:21.135 INFO:tasks.workunit.client.1.smithi148.stdout:3/666: dwrite d4/d8/d1e/d6b/d31/d54/f8a [4194304,4194304] 0 2024-09-18T12:49:21.135 INFO:tasks.workunit.client.0.smithi078.stdout:6/616: rmdir d10/d2b/d43/d53/d63/d70/d7d 39 2024-09-18T12:49:21.136 INFO:tasks.workunit.client.0.smithi078.stdout:6/617: chown d10/d2b/d43/d53/c5c 171758 1 2024-09-18T12:49:21.143 INFO:tasks.workunit.client.1.smithi148.stdout:6/715: rename d5/d1a/dc/d2b/d35/d65/d99/da4/da6/cda to d5/d1a/dc/d2b/d35/d65/d99/ce4 0 2024-09-18T12:49:21.144 INFO:tasks.workunit.client.0.smithi078.stdout:3/468: symlink d9/d54/d89/l8f 0 2024-09-18T12:49:21.144 INFO:tasks.workunit.client.1.smithi148.stdout:3/667: dwrite d4/d8/d20/d2b/fc4 [0,4194304] 0 2024-09-18T12:49:21.149 INFO:tasks.workunit.client.1.smithi148.stdout:1/694: write dc/f25 [998969,102350] 0 2024-09-18T12:49:21.150 INFO:tasks.workunit.client.0.smithi078.stdout:1/471: creat d0/d8/f92 x:0 0 0 2024-09-18T12:49:21.150 INFO:tasks.workunit.client.1.smithi148.stdout:9/694: creat d8/da/dd/d35/d81/db7/fd4 x:0 0 0 2024-09-18T12:49:21.151 INFO:tasks.workunit.client.0.smithi078.stdout:1/472: chown d0/d8/da/d3e/d58/d6e/c68 15 1 2024-09-18T12:49:21.153 INFO:tasks.workunit.client.0.smithi078.stdout:4/493: unlink d11/d27/d5a/d84/f3a 0 2024-09-18T12:49:21.153 INFO:tasks.workunit.client.0.smithi078.stdout:4/494: chown d11/d27/d89/d9f 7 1 2024-09-18T12:49:21.154 INFO:tasks.workunit.client.1.smithi148.stdout:0/865: link de/d27/fae de/d27/d2e/d114/f125 0 2024-09-18T12:49:21.154 INFO:tasks.workunit.client.1.smithi148.stdout:8/796: dread d8/df/f73 [0,4194304] 0 2024-09-18T12:49:21.156 INFO:tasks.workunit.client.1.smithi148.stdout:6/716: rmdir d5/d32/d56 39 2024-09-18T12:49:21.157 INFO:tasks.workunit.client.0.smithi078.stdout:3/469: mkdir d9/d54/d6c/d90 0 2024-09-18T12:49:21.157 INFO:tasks.workunit.client.1.smithi148.stdout:0/866: chown de/d14/c5d 51 1 2024-09-18T12:49:21.158 INFO:tasks.workunit.client.1.smithi148.stdout:5/722: creat d7/d8/dc/da6/dee/d69/ff2 x:0 0 0 2024-09-18T12:49:21.159 INFO:tasks.workunit.client.1.smithi148.stdout:3/668: dwrite d4/d8/d20/d2b/d7f/d93/d94/f9a [0,4194304] 0 2024-09-18T12:49:21.159 INFO:tasks.workunit.client.1.smithi148.stdout:9/695: truncate d8/da/dd/d4a/d49/d46/d75/d97/fa9 915630 0 2024-09-18T12:49:21.159 INFO:tasks.workunit.client.1.smithi148.stdout:1/695: symlink dc/d11/d38/d72/le0 0 2024-09-18T12:49:21.160 INFO:tasks.workunit.client.1.smithi148.stdout:0/867: truncate de/d14/f81 1073981 0 2024-09-18T12:49:21.161 INFO:tasks.workunit.client.1.smithi148.stdout:2/630: rename d9/d24/d31/d34/d7b/ldb to d9/d24/d67/dc7/ddd/le5 0 2024-09-18T12:49:21.164 INFO:tasks.workunit.client.0.smithi078.stdout:3/470: dwrite d9/d13/f39 [0,4194304] 0 2024-09-18T12:49:21.165 INFO:tasks.workunit.client.1.smithi148.stdout:2/631: fsync d9/d73/f8e 0 2024-09-18T12:49:21.168 INFO:tasks.workunit.client.1.smithi148.stdout:3/669: dread d4/f89 [4194304,4194304] 0 2024-09-18T12:49:21.168 INFO:tasks.workunit.client.0.smithi078.stdout:6/618: creat d10/d2b/d43/d53/d45/d55/fc9 x:0 0 0 2024-09-18T12:49:21.169 INFO:tasks.workunit.client.0.smithi078.stdout:3/471: read d9/d29/f6d [1200347,1943] 0 2024-09-18T12:49:21.169 INFO:tasks.workunit.client.1.smithi148.stdout:5/723: read d7/d8/dc/d22/f5f [539381,74698] 0 2024-09-18T12:49:21.172 INFO:tasks.workunit.client.0.smithi078.stdout:7/386: getdents d7/d9/d32 0 2024-09-18T12:49:21.172 INFO:tasks.workunit.client.0.smithi078.stdout:1/473: dread d0/d8/da/f5f [0,4194304] 0 2024-09-18T12:49:21.173 INFO:tasks.workunit.client.1.smithi148.stdout:1/696: creat dc/d18/d31/d4b/d8d/d8f/fe1 x:0 0 0 2024-09-18T12:49:21.173 INFO:tasks.workunit.client.0.smithi078.stdout:2/430: dread d4/d8/d23/d52/d5f/d86/d3b/d55/f75 [0,4194304] 0 2024-09-18T12:49:21.174 INFO:tasks.workunit.client.1.smithi148.stdout:4/703: dread d15/d17/d52/d92/d4c/f57 [0,4194304] 0 2024-09-18T12:49:21.175 INFO:tasks.workunit.client.0.smithi078.stdout:2/431: fdatasync d4/db/dc/f1b 0 2024-09-18T12:49:21.175 INFO:tasks.workunit.client.0.smithi078.stdout:4/495: link d11/d27/d5a/d84/l37 d11/d27/d60/la0 0 2024-09-18T12:49:21.176 INFO:tasks.workunit.client.0.smithi078.stdout:2/432: fdatasync d4/dd/f4e 0 2024-09-18T12:49:21.176 INFO:tasks.workunit.client.1.smithi148.stdout:4/704: chown d15/d17/d52/d92/d4c/d72/f93 217 1 2024-09-18T12:49:21.178 INFO:tasks.workunit.client.1.smithi148.stdout:7/709: rename db/dc/df/d11/d34/f61 to db/dc/df/d2c/d55/daf/d38/fd2 0 2024-09-18T12:49:21.179 INFO:tasks.workunit.client.0.smithi078.stdout:6/619: truncate d10/f1c 2309710 0 2024-09-18T12:49:21.179 INFO:tasks.workunit.client.1.smithi148.stdout:7/710: chown db/dc/df/d8e/f7c 1 1 2024-09-18T12:49:21.180 INFO:tasks.workunit.client.0.smithi078.stdout:9/431: truncate d5/f5e 2165690 0 2024-09-18T12:49:21.182 INFO:tasks.workunit.client.1.smithi148.stdout:6/717: creat d5/d32/d56/fe5 x:0 0 0 2024-09-18T12:49:21.182 INFO:tasks.workunit.client.0.smithi078.stdout:0/573: truncate d3/d1f/f63 229213 0 2024-09-18T12:49:21.184 INFO:tasks.workunit.client.0.smithi078.stdout:7/387: read d7/d9/f1f [18059,16603] 0 2024-09-18T12:49:21.186 INFO:tasks.workunit.client.1.smithi148.stdout:4/705: dread d15/f53 [4194304,4194304] 0 2024-09-18T12:49:21.186 INFO:tasks.workunit.client.1.smithi148.stdout:3/670: rmdir d4/d8/d20/d2b/d7f/d93/d94/dac 39 2024-09-18T12:49:21.186 INFO:tasks.workunit.client.0.smithi078.stdout:8/431: write d0/d7/fb [1489576,98846] 0 2024-09-18T12:49:21.186 INFO:tasks.workunit.client.1.smithi148.stdout:4/706: chown f9 1 1 2024-09-18T12:49:21.187 INFO:tasks.workunit.client.1.smithi148.stdout:4/707: chown d15/d17/d52/d92/d4c/d4f/f20 396 1 2024-09-18T12:49:21.189 INFO:tasks.workunit.client.1.smithi148.stdout:9/696: dread d8/da/dd/d4a/f15 [4194304,4194304] 0 2024-09-18T12:49:21.192 INFO:tasks.workunit.client.1.smithi148.stdout:1/697: truncate dc/d18/d7d/d93/dd9/d2b/f2e 2663043 0 2024-09-18T12:49:21.194 INFO:tasks.workunit.client.0.smithi078.stdout:4/496: unlink d11/d27/d5a/f5e 0 2024-09-18T12:49:21.197 INFO:tasks.workunit.client.0.smithi078.stdout:1/474: dread d0/d8/da/d3e/d50/d60/f6b [0,4194304] 0 2024-09-18T12:49:21.197 INFO:tasks.workunit.client.1.smithi148.stdout:5/724: rename d7/d8/dc/d22 to d7/d8/dc/d12/d20/df3 0 2024-09-18T12:49:21.199 INFO:tasks.workunit.client.0.smithi078.stdout:6/620: rename d10/d2b/d43/f60 to d10/d2b/d43/d53/d63/d70/d77/fca 0 2024-09-18T12:49:21.199 INFO:tasks.workunit.client.0.smithi078.stdout:6/621: readlink d10/l86 0 2024-09-18T12:49:21.202 INFO:tasks.workunit.client.1.smithi148.stdout:5/725: dwrite d7/d8/dc/da6/dee/d25/d4b/dae/fc5 [0,4194304] 0 2024-09-18T12:49:21.203 INFO:tasks.workunit.client.0.smithi078.stdout:9/432: creat d5/d7/d32/d2a/d68/f8d x:0 0 0 2024-09-18T12:49:21.211 INFO:tasks.workunit.client.1.smithi148.stdout:0/868: link de/l2f de/d14/d6b/l126 0 2024-09-18T12:49:21.214 INFO:tasks.workunit.client.1.smithi148.stdout:4/708: rmdir d15/d17/d52/d92/d4c/d4f/d64/d9a 39 2024-09-18T12:49:21.215 INFO:tasks.workunit.client.1.smithi148.stdout:4/709: stat d15/d17/d52/d92/d4c/d4f/d64 0 2024-09-18T12:49:21.215 INFO:tasks.workunit.client.1.smithi148.stdout:9/697: rmdir d8 39 2024-09-18T12:49:21.218 INFO:tasks.workunit.client.0.smithi078.stdout:2/433: creat d4/db/d45/f8f x:0 0 0 2024-09-18T12:49:21.219 INFO:tasks.workunit.client.0.smithi078.stdout:1/475: rmdir d0/d8/da/d3e/d58 39 2024-09-18T12:49:21.225 INFO:tasks.workunit.client.1.smithi148.stdout:6/718: unlink d5/d1a/d29/d5c/c9d 0 2024-09-18T12:49:21.225 INFO:tasks.workunit.client.1.smithi148.stdout:6/719: chown d5/d1a/d29/cd8 13 1 2024-09-18T12:49:21.226 INFO:tasks.workunit.client.0.smithi078.stdout:3/472: link f7 d9/d29/d4b/d4c/f91 0 2024-09-18T12:49:21.227 INFO:tasks.workunit.client.1.smithi148.stdout:5/726: creat d7/d8/dc/da6/dee/d69/d8b/dad/ff4 x:0 0 0 2024-09-18T12:49:21.229 INFO:tasks.workunit.client.1.smithi148.stdout:5/727: rename d7/d8 to d7/d8/dc/da6/df5 22 2024-09-18T12:49:21.229 INFO:tasks.workunit.client.1.smithi148.stdout:0/869: dread de/d27/db3/f104 [0,4194304] 0 2024-09-18T12:49:21.229 INFO:tasks.workunit.client.0.smithi078.stdout:9/433: chown d5/l75 14 1 2024-09-18T12:49:21.230 INFO:tasks.workunit.client.0.smithi078.stdout:6/622: dwrite d10/d2b/d43/d53/d63/d70/d7d/fb5 [0,4194304] 0 2024-09-18T12:49:21.233 INFO:tasks.workunit.client.0.smithi078.stdout:8/432: write d0/d7/dc/d1f/d23/f48 [3107490,41028] 0 2024-09-18T12:49:21.235 INFO:tasks.workunit.client.0.smithi078.stdout:8/433: fsync d0/d7/f24 0 2024-09-18T12:49:21.238 INFO:tasks.workunit.client.0.smithi078.stdout:0/574: dwrite d3/d1f/d2e/d68/f2b [0,4194304] 0 2024-09-18T12:49:21.238 INFO:tasks.workunit.client.0.smithi078.stdout:3/473: mkdir d9/d54/d89/d92 0 2024-09-18T12:49:21.241 INFO:tasks.workunit.client.0.smithi078.stdout:0/575: readlink d3/d1f/d2e/l33 0 2024-09-18T12:49:21.242 INFO:tasks.workunit.client.0.smithi078.stdout:7/388: link d7/d9/d32/d3b/c59 d7/d9/d32/c86 0 2024-09-18T12:49:21.248 INFO:tasks.workunit.client.0.smithi078.stdout:2/434: symlink d4/dd/d8a/l90 0 2024-09-18T12:49:21.248 INFO:tasks.workunit.client.0.smithi078.stdout:6/623: dwrite d10/d2b/fbc [0,4194304] 0 2024-09-18T12:49:21.248 INFO:tasks.workunit.client.0.smithi078.stdout:8/434: rmdir d0/d7/d53/d57/d67 39 2024-09-18T12:49:21.249 INFO:tasks.workunit.client.0.smithi078.stdout:1/476: creat d0/d8/da/d3e/d58/d6e/d52/d47/f93 x:0 0 0 2024-09-18T12:49:21.251 INFO:tasks.workunit.client.0.smithi078.stdout:7/389: mkdir d7/d5d/d87 0 2024-09-18T12:49:21.251 INFO:tasks.workunit.client.0.smithi078.stdout:8/435: chown d0/d7/f27 34004 1 2024-09-18T12:49:21.254 INFO:tasks.workunit.client.0.smithi078.stdout:9/434: getdents d5/d7 0 2024-09-18T12:49:21.255 INFO:tasks.workunit.client.0.smithi078.stdout:0/576: link d3/d1f/d2e/d4e/d37/d72/d96/fcf d3/d1f/d2e/d8f/d90/fd4 0 2024-09-18T12:49:21.256 INFO:tasks.workunit.client.1.smithi148.stdout:1/698: write dc/d11/f53 [1426026,30747] 0 2024-09-18T12:49:21.257 INFO:tasks.workunit.client.0.smithi078.stdout:7/390: chown d7/d5d/d7a/l48 1194914 1 2024-09-18T12:49:21.257 INFO:tasks.workunit.client.1.smithi148.stdout:2/632: getdents d9/d17 0 2024-09-18T12:49:21.258 INFO:tasks.workunit.client.0.smithi078.stdout:3/474: dwrite d9/d54/f74 [0,4194304] 0 2024-09-18T12:49:21.258 INFO:tasks.workunit.client.1.smithi148.stdout:5/728: chown d7/d8/dc/da6/dee/d39/dd5/fdb 121 1 2024-09-18T12:49:21.259 INFO:tasks.workunit.client.1.smithi148.stdout:2/633: dread - d9/d73/fb3 zero size 2024-09-18T12:49:21.260 INFO:tasks.workunit.client.1.smithi148.stdout:7/711: getdents db/dc/df/d2c/d66/da0 0 2024-09-18T12:49:21.261 INFO:tasks.workunit.client.1.smithi148.stdout:9/698: creat d8/d6f/fd5 x:0 0 0 2024-09-18T12:49:21.263 INFO:tasks.workunit.client.0.smithi078.stdout:2/435: dwrite d4/d8/d23/f56 [4194304,4194304] 0 2024-09-18T12:49:21.265 INFO:tasks.workunit.client.1.smithi148.stdout:2/634: chown d9/d73/cb0 231437 1 2024-09-18T12:49:21.265 INFO:tasks.workunit.client.1.smithi148.stdout:9/699: dread - d8/d6f/fd5 zero size 2024-09-18T12:49:21.266 INFO:tasks.workunit.client.0.smithi078.stdout:3/475: chown d9/d13/d33/d4e/c23 1921137 1 2024-09-18T12:49:21.267 INFO:tasks.workunit.client.1.smithi148.stdout:1/699: fsync dc/d18/d31/d4b/d8d/fb8 0 2024-09-18T12:49:21.267 INFO:tasks.workunit.client.0.smithi078.stdout:7/391: mknod d7/c88 0 2024-09-18T12:49:21.270 INFO:tasks.workunit.client.0.smithi078.stdout:9/435: rename d5/d7/d32/d2a/d36/c51 to d5/d7/d32/d2a/d36/c8e 0 2024-09-18T12:49:21.270 INFO:tasks.workunit.client.1.smithi148.stdout:5/729: truncate d7/d8/f3e 155551 0 2024-09-18T12:49:21.271 INFO:tasks.workunit.client.0.smithi078.stdout:1/477: creat d0/d8/da/d3e/d58/d6e/d52/d47/d7d/d7f/f94 x:0 0 0 2024-09-18T12:49:21.272 INFO:tasks.workunit.client.1.smithi148.stdout:2/635: stat d9/d24/d31/d34/f37 0 2024-09-18T12:49:21.272 INFO:tasks.workunit.client.1.smithi148.stdout:3/671: dread d4/d8/fa6 [0,4194304] 0 2024-09-18T12:49:21.276 INFO:tasks.workunit.client.1.smithi148.stdout:6/720: dread d5/d32/d38/d50/f52 [0,4194304] 0 2024-09-18T12:49:21.276 INFO:tasks.workunit.client.0.smithi078.stdout:3/476: dwrite d9/d13/d33/d3c/d19/f22 [0,4194304] 0 2024-09-18T12:49:21.277 INFO:tasks.workunit.client.1.smithi148.stdout:5/730: read - d7/d8/d18/f88 zero size 2024-09-18T12:49:21.277 INFO:tasks.workunit.client.1.smithi148.stdout:1/700: dread - dc/d18/d31/d39/fc8 zero size 2024-09-18T12:49:21.277 INFO:tasks.workunit.client.1.smithi148.stdout:7/712: dwrite db/dc/fb1 [0,4194304] 0 2024-09-18T12:49:21.279 INFO:tasks.workunit.client.1.smithi148.stdout:9/700: write d8/da/dd/d4a/d49/d46/fbf [879395,125011] 0 2024-09-18T12:49:21.279 INFO:tasks.workunit.client.1.smithi148.stdout:5/731: dread - d7/d8/f9d zero size 2024-09-18T12:49:21.280 INFO:tasks.workunit.client.1.smithi148.stdout:1/701: dread - dc/d18/d8a/fa2 zero size 2024-09-18T12:49:21.281 INFO:tasks.workunit.client.1.smithi148.stdout:6/721: fdatasync d5/d1a/d3d/fb9 0 2024-09-18T12:49:21.284 INFO:tasks.workunit.client.0.smithi078.stdout:2/436: unlink d4/d20/c84 0 2024-09-18T12:49:21.285 INFO:tasks.workunit.client.1.smithi148.stdout:9/701: write d8/da/dd/d4a/d49/d46/d54/dab/fd0 [297031,122133] 0 2024-09-18T12:49:21.286 INFO:tasks.workunit.client.0.smithi078.stdout:2/437: write d4/dd/f64 [873852,117923] 0 2024-09-18T12:49:21.286 INFO:tasks.workunit.client.1.smithi148.stdout:9/702: chown d8/da/dd/d35/f9b 3 1 2024-09-18T12:49:21.286 INFO:tasks.workunit.client.0.smithi078.stdout:1/478: rename d0/d8/da/d3e/f84 to d0/d8/f95 0 2024-09-18T12:49:21.288 INFO:tasks.workunit.client.1.smithi148.stdout:9/703: chown d8/da/dd/d35/d59/ccf 5416 1 2024-09-18T12:49:21.289 INFO:tasks.workunit.client.0.smithi078.stdout:8/436: dread d0/d7/f24 [0,4194304] 0 2024-09-18T12:49:21.289 INFO:tasks.workunit.client.0.smithi078.stdout:0/577: link d3/d1f/f67 d3/d43/fd5 0 2024-09-18T12:49:21.292 INFO:tasks.workunit.client.1.smithi148.stdout:1/702: rmdir dc/d18/d31/d39 39 2024-09-18T12:49:21.295 INFO:tasks.workunit.client.1.smithi148.stdout:6/722: mknod d5/d1a/d29/ce6 0 2024-09-18T12:49:21.298 INFO:tasks.workunit.client.1.smithi148.stdout:8/797: sync 2024-09-18T12:49:21.302 INFO:tasks.workunit.client.0.smithi078.stdout:9/436: creat d5/d7/d8/f8f x:0 0 0 2024-09-18T12:49:21.304 INFO:tasks.workunit.client.0.smithi078.stdout:2/438: link d4/d8/d23/f56 d4/d20/d85/f91 0 2024-09-18T12:49:21.305 INFO:tasks.workunit.client.1.smithi148.stdout:7/713: truncate db/dc/df/d11/f47 3429197 0 2024-09-18T12:49:21.305 INFO:tasks.workunit.client.1.smithi148.stdout:0/870: dwrite de/d14/d43/d57/d59/f11a [0,4194304] 0 2024-09-18T12:49:21.307 INFO:tasks.workunit.client.1.smithi148.stdout:0/871: write de/d14/d93/fc3 [843843,75453] 0 2024-09-18T12:49:21.307 INFO:tasks.workunit.client.0.smithi078.stdout:2/439: dread d4/db/f53 [0,4194304] 0 2024-09-18T12:49:21.309 INFO:tasks.workunit.client.0.smithi078.stdout:1/479: creat d0/d8/da/d3e/f96 x:0 0 0 2024-09-18T12:49:21.310 INFO:tasks.workunit.client.0.smithi078.stdout:0/578: creat d3/d43/fd6 x:0 0 0 2024-09-18T12:49:21.313 INFO:tasks.workunit.client.1.smithi148.stdout:5/732: rename d7/d8/dc/da6/dee/d39/f41 to d7/d8/d18/d3f/ff6 0 2024-09-18T12:49:21.314 INFO:tasks.workunit.client.1.smithi148.stdout:5/733: fsync d7/d8/fd0 0 2024-09-18T12:49:21.314 INFO:tasks.workunit.client.1.smithi148.stdout:8/798: mknod d8/d16/d53/c10f 0 2024-09-18T12:49:21.315 INFO:tasks.workunit.client.0.smithi078.stdout:0/579: mkdir d3/d82/dd7 0 2024-09-18T12:49:21.315 INFO:tasks.workunit.client.1.smithi148.stdout:9/704: getdents d8/da/dd/d35/d47/d62 0 2024-09-18T12:49:21.317 INFO:tasks.workunit.client.0.smithi078.stdout:0/580: truncate d3/d1f/d2e/f83 205624 0 2024-09-18T12:49:21.319 INFO:tasks.workunit.client.1.smithi148.stdout:6/723: rename d5/d79 to d5/d32/d38/d50/de7 0 2024-09-18T12:49:21.320 INFO:tasks.workunit.client.0.smithi078.stdout:0/581: readlink d3/l1c 0 2024-09-18T12:49:21.320 INFO:tasks.workunit.client.1.smithi148.stdout:8/799: rmdir d8/d16/d27 39 2024-09-18T12:49:21.321 INFO:tasks.workunit.client.1.smithi148.stdout:5/734: rmdir d7/d8/dc/da6/dee/d39/dc2 39 2024-09-18T12:49:21.323 INFO:tasks.workunit.client.1.smithi148.stdout:1/703: getdents dc/d18/d31 0 2024-09-18T12:49:21.323 INFO:tasks.workunit.client.1.smithi148.stdout:5/735: fsync d7/d8/d18/d3f/f6f 0 2024-09-18T12:49:21.325 INFO:tasks.workunit.client.1.smithi148.stdout:6/724: fdatasync d5/d1a/dc/d2b/fb7 0 2024-09-18T12:49:21.328 INFO:tasks.workunit.client.1.smithi148.stdout:9/705: symlink d8/da/dd/d35/d47/ld6 0 2024-09-18T12:49:21.329 INFO:tasks.workunit.client.1.smithi148.stdout:0/872: link de/d27/f44 de/d14/dd2/f127 0 2024-09-18T12:49:21.329 INFO:tasks.workunit.client.1.smithi148.stdout:2/636: write d9/d17/d29/f3e [183898,93040] 0 2024-09-18T12:49:21.330 INFO:tasks.workunit.client.1.smithi148.stdout:1/704: fsync fb 0 2024-09-18T12:49:21.332 INFO:tasks.workunit.client.1.smithi148.stdout:5/736: creat d7/d8/dc/da6/ff7 x:0 0 0 2024-09-18T12:49:21.332 INFO:tasks.workunit.client.1.smithi148.stdout:5/737: readlink d7/d8/d18/l6d 0 2024-09-18T12:49:21.332 INFO:tasks.workunit.client.1.smithi148.stdout:6/725: symlink d5/d32/d38/d50/de7/d7c/le8 0 2024-09-18T12:49:21.333 INFO:tasks.workunit.client.1.smithi148.stdout:6/726: dread - d5/d32/d56/fbe zero size 2024-09-18T12:49:21.334 INFO:tasks.workunit.client.1.smithi148.stdout:0/873: unlink de/d14/c3c 0 2024-09-18T12:49:21.334 INFO:tasks.workunit.client.0.smithi078.stdout:7/392: write d7/fa [1562356,67510] 0 2024-09-18T12:49:21.335 INFO:tasks.workunit.client.0.smithi078.stdout:7/393: stat d7/f65 0 2024-09-18T12:49:21.336 INFO:tasks.workunit.client.1.smithi148.stdout:3/672: write d4/d8/d20/d2b/d43/f4b [3896322,13242] 0 2024-09-18T12:49:21.337 INFO:tasks.workunit.client.1.smithi148.stdout:9/706: rename d8/da/dd/d4a/d49/d46/d75/c9f to d8/da/dd/d4a/d27/cd7 0 2024-09-18T12:49:21.338 INFO:tasks.workunit.client.1.smithi148.stdout:3/673: dread - d4/d8/d6a/db3/db7/dcb/fe0 zero size 2024-09-18T12:49:21.339 INFO:tasks.workunit.client.1.smithi148.stdout:1/705: unlink dc/d18/d31/l49 0 2024-09-18T12:49:21.340 INFO:tasks.workunit.client.0.smithi078.stdout:7/394: mkdir d7/d9/d14/d22/d35/d49/d61/d89 0 2024-09-18T12:49:21.342 INFO:tasks.workunit.client.1.smithi148.stdout:5/738: mknod d7/d8/dc/d12/d31/d6c/cf8 0 2024-09-18T12:49:21.344 INFO:tasks.workunit.client.1.smithi148.stdout:4/710: sync 2024-09-18T12:49:21.344 INFO:tasks.workunit.client.1.smithi148.stdout:8/800: dread d8/d16/f9d [0,4194304] 0 2024-09-18T12:49:21.344 INFO:tasks.workunit.client.1.smithi148.stdout:5/739: dread - d7/d8/d18/f88 zero size 2024-09-18T12:49:21.348 INFO:tasks.workunit.client.1.smithi148.stdout:8/801: read d8/d12/d46/d7e/fd0 [306794,112743] 0 2024-09-18T12:49:21.351 INFO:tasks.workunit.client.1.smithi148.stdout:5/740: dwrite d7/d8/dc/da6/dee/d69/d8b/dad/ff4 [0,4194304] 0 2024-09-18T12:49:21.351 INFO:tasks.workunit.client.0.smithi078.stdout:7/395: rmdir d7/d5d/d5e 39 2024-09-18T12:49:21.354 INFO:tasks.workunit.client.1.smithi148.stdout:6/727: dread d5/d1a/dc/f6d [0,4194304] 0 2024-09-18T12:49:21.355 INFO:tasks.workunit.client.0.smithi078.stdout:9/437: truncate d5/d7/d8/f46 5853494 0 2024-09-18T12:49:21.357 INFO:tasks.workunit.client.1.smithi148.stdout:9/707: rename d8/da/dd/d4a/d49/dd1 to d8/da/dd/d77/dd8 0 2024-09-18T12:49:21.359 INFO:tasks.workunit.client.1.smithi148.stdout:7/714: dread db/dc/df/d2c/d55/daf/f48 [0,4194304] 0 2024-09-18T12:49:21.362 INFO:tasks.workunit.client.0.smithi078.stdout:1/480: truncate d0/d8/da/d3e/d50/d60/f6b 1797887 0 2024-09-18T12:49:21.363 INFO:tasks.workunit.client.0.smithi078.stdout:9/438: dwrite d5/d7/d8/d4f/f64 [0,4194304] 0 2024-09-18T12:49:21.363 INFO:tasks.workunit.client.1.smithi148.stdout:2/637: creat d9/fe6 x:0 0 0 2024-09-18T12:49:21.370 INFO:tasks.workunit.client.0.smithi078.stdout:7/396: dwrite d7/d9/d32/f36 [0,4194304] 0 2024-09-18T12:49:21.371 INFO:tasks.workunit.client.0.smithi078.stdout:9/439: creat d5/d7/d8/d4f/f90 x:0 0 0 2024-09-18T12:49:21.373 INFO:tasks.workunit.client.0.smithi078.stdout:9/440: write d5/d7/d8/d4f/f8b [283321,25517] 0 2024-09-18T12:49:21.376 INFO:tasks.workunit.client.1.smithi148.stdout:8/802: mkdir d8/d12/d51/d94/d110 0 2024-09-18T12:49:21.381 INFO:tasks.workunit.client.0.smithi078.stdout:0/582: dwrite d3/d1f/d2e/d4e/f49 [0,4194304] 0 2024-09-18T12:49:21.382 INFO:tasks.workunit.client.0.smithi078.stdout:0/583: readlink d3/d1f/d2e/d4e/d37/d72/l74 0 2024-09-18T12:49:21.383 INFO:tasks.workunit.client.0.smithi078.stdout:0/584: chown d3/d1f/d2e/d4e/d37/d72 0 1 2024-09-18T12:49:21.386 INFO:tasks.workunit.client.0.smithi078.stdout:9/441: readlink d5/l28 0 2024-09-18T12:49:21.391 INFO:tasks.workunit.client.1.smithi148.stdout:6/728: mkdir d5/d1a/dc/d2b/de9 0 2024-09-18T12:49:21.393 INFO:tasks.workunit.client.1.smithi148.stdout:9/708: read - d8/da/f82 zero size 2024-09-18T12:49:21.400 INFO:tasks.workunit.client.1.smithi148.stdout:2/638: fsync d9/d24/d47/f63 0 2024-09-18T12:49:21.405 INFO:tasks.workunit.client.1.smithi148.stdout:0/874: link de/d27/f2b de/d27/d53/d89/f128 0 2024-09-18T12:49:21.405 INFO:tasks.workunit.client.0.smithi078.stdout:0/585: getdents d3/d1f/d2e/d68/d30 0 2024-09-18T12:49:21.406 INFO:tasks.workunit.client.0.smithi078.stdout:1/481: dwrite d0/f49 [0,4194304] 0 2024-09-18T12:49:21.408 INFO:tasks.workunit.client.1.smithi148.stdout:6/729: rmdir d5/d1a/dc/d2b/d35/d65/d99/da4/da6 39 2024-09-18T12:49:21.409 INFO:tasks.workunit.client.1.smithi148.stdout:6/730: write d5/fdf [1026706,67747] 0 2024-09-18T12:49:21.409 INFO:tasks.workunit.client.0.smithi078.stdout:7/397: dread d7/f1d [0,4194304] 0 2024-09-18T12:49:21.410 INFO:tasks.workunit.client.1.smithi148.stdout:6/731: write d5/d1a/dc/fd6 [5680729,55900] 0 2024-09-18T12:49:21.415 INFO:tasks.workunit.client.0.smithi078.stdout:1/482: rmdir d0/d8/da/d3e/d58/d6e/d52/d47/d7d 39 2024-09-18T12:49:21.416 INFO:tasks.workunit.client.0.smithi078.stdout:1/483: truncate d0/d8/f92 168601 0 2024-09-18T12:49:21.419 INFO:tasks.workunit.client.0.smithi078.stdout:0/586: dread d3/d1f/d2e/d4e/d37/d72/f78 [0,4194304] 0 2024-09-18T12:49:21.423 INFO:tasks.workunit.client.1.smithi148.stdout:8/803: creat d8/d16/d27/dc5/dee/dfe/f111 x:0 0 0 2024-09-18T12:49:21.423 INFO:tasks.workunit.client.1.smithi148.stdout:6/732: dread d5/d1a/d29/f5d [0,4194304] 0 2024-09-18T12:49:21.424 INFO:tasks.workunit.client.0.smithi078.stdout:9/442: truncate d5/d7/d8/f33 4044189 0 2024-09-18T12:49:21.425 INFO:tasks.workunit.client.1.smithi148.stdout:0/875: mkdir de/d27/d53/d89/d129 0 2024-09-18T12:49:21.426 INFO:tasks.workunit.client.0.smithi078.stdout:0/587: dread d3/d1f/f52 [0,4194304] 0 2024-09-18T12:49:21.426 INFO:tasks.workunit.client.1.smithi148.stdout:0/876: write de/d27/f45 [900205,56715] 0 2024-09-18T12:49:21.427 INFO:tasks.workunit.client.1.smithi148.stdout:5/741: link d7/d8/dc/da6/dee/d77/l7e d7/d8/d18/lf9 0 2024-09-18T12:49:21.429 INFO:tasks.workunit.client.1.smithi148.stdout:1/706: mknod dc/d18/d31/d4b/d8d/ce2 0 2024-09-18T12:49:21.430 INFO:tasks.workunit.client.1.smithi148.stdout:7/715: truncate db/dc/df/d11/f1b 1946487 0 2024-09-18T12:49:21.431 INFO:tasks.workunit.client.1.smithi148.stdout:9/709: getdents d8/da/dd/d35/d5e 0 2024-09-18T12:49:21.433 INFO:tasks.workunit.client.1.smithi148.stdout:1/707: dread dc/d18/d7d/fb3 [0,4194304] 0 2024-09-18T12:49:21.433 INFO:tasks.workunit.client.1.smithi148.stdout:1/708: readlink dc/d18/d7d/d7e/lc9 0 2024-09-18T12:49:21.434 INFO:tasks.workunit.client.0.smithi078.stdout:1/484: creat d0/d8/da/f97 x:0 0 0 2024-09-18T12:49:21.439 INFO:tasks.workunit.client.1.smithi148.stdout:4/711: getdents d15/d17/d52 0 2024-09-18T12:49:21.440 INFO:tasks.workunit.client.1.smithi148.stdout:4/712: read - d15/d17/d52/d92/d4c/d4f/d64/da0/fe1 zero size 2024-09-18T12:49:21.440 INFO:tasks.workunit.client.0.smithi078.stdout:7/398: getdents d7/d9/d32/d3b 0 2024-09-18T12:49:21.441 INFO:tasks.workunit.client.1.smithi148.stdout:8/804: symlink d8/df/d66/l112 0 2024-09-18T12:49:21.444 INFO:tasks.workunit.client.0.smithi078.stdout:1/485: unlink d0/l90 0 2024-09-18T12:49:21.445 INFO:tasks.workunit.client.1.smithi148.stdout:6/733: rename d5/d32/d38/c90 to d5/d32/d56/cea 0 2024-09-18T12:49:21.445 INFO:tasks.workunit.client.1.smithi148.stdout:4/713: dwrite d15/d17/d52/d92/d4c/f5d [0,4194304] 0 2024-09-18T12:49:21.446 INFO:tasks.workunit.client.1.smithi148.stdout:6/734: truncate d5/d32/d56/fbe 444189 0 2024-09-18T12:49:21.452 INFO:tasks.workunit.client.1.smithi148.stdout:5/742: creat d7/d8/dc/d12/ffa x:0 0 0 2024-09-18T12:49:21.452 INFO:tasks.workunit.client.1.smithi148.stdout:2/639: truncate d9/d3a/f75 3977064 0 2024-09-18T12:49:21.453 INFO:tasks.workunit.client.0.smithi078.stdout:0/588: link d3/d1f/d2e/d8f/d90/dcb/fcc d3/d1f/fd8 0 2024-09-18T12:49:21.454 INFO:tasks.workunit.client.0.smithi078.stdout:0/589: fdatasync d3/d1f/d2e/d4e/d37/f57 0 2024-09-18T12:49:21.457 INFO:tasks.workunit.client.0.smithi078.stdout:1/486: dread d0/f4b [0,4194304] 0 2024-09-18T12:49:21.460 INFO:tasks.workunit.client.0.smithi078.stdout:9/443: write d5/d5c/f88 [2620367,73796] 0 2024-09-18T12:49:21.461 INFO:tasks.workunit.client.1.smithi148.stdout:1/709: mkdir dc/d11/d38/d72/de3 0 2024-09-18T12:49:21.462 INFO:tasks.workunit.client.0.smithi078.stdout:0/590: creat d3/d1f/d2e/d8f/fd9 x:0 0 0 2024-09-18T12:49:21.462 INFO:tasks.workunit.client.1.smithi148.stdout:7/716: dread db/dc/df/d11/f3a [0,4194304] 0 2024-09-18T12:49:21.462 INFO:tasks.workunit.client.1.smithi148.stdout:3/674: link d4/d8/d1e/d6b/d31/d60/da9/ldd d4/d8/d20/d2b/d7f/d93/le6 0 2024-09-18T12:49:21.467 INFO:tasks.workunit.client.0.smithi078.stdout:1/487: dread d0/d8/da/d3e/d58/d6e/d52/f2e [0,4194304] 0 2024-09-18T12:49:21.467 INFO:tasks.workunit.client.0.smithi078.stdout:9/444: mkdir d5/d7/d32/d91 0 2024-09-18T12:49:21.468 INFO:tasks.workunit.client.1.smithi148.stdout:9/710: write d8/da/dd/d35/d59/f69 [810608,20731] 0 2024-09-18T12:49:21.469 INFO:tasks.workunit.client.0.smithi078.stdout:7/399: getdents d7/d9/d14 0 2024-09-18T12:49:21.469 INFO:tasks.workunit.client.1.smithi148.stdout:7/717: dwrite db/dc/df/d1d/d68/d7a/f85 [0,4194304] 0 2024-09-18T12:49:21.470 INFO:tasks.workunit.client.0.smithi078.stdout:1/488: mknod d0/d8/da/d45/c98 0 2024-09-18T12:49:21.471 INFO:tasks.workunit.client.1.smithi148.stdout:6/735: read d5/d1a/dc/d2b/d35/f69 [15397,77070] 0 2024-09-18T12:49:21.474 INFO:tasks.workunit.client.1.smithi148.stdout:0/877: truncate f9 1766776 0 2024-09-18T12:49:21.476 INFO:tasks.workunit.client.1.smithi148.stdout:5/743: fsync d7/d8/dc/d12/ffa 0 2024-09-18T12:49:21.477 INFO:tasks.workunit.client.0.smithi078.stdout:1/489: symlink d0/d8/da/d3e/d50/l99 0 2024-09-18T12:49:21.479 INFO:tasks.workunit.client.1.smithi148.stdout:2/640: mknod d9/d24/d31/d9d/ce7 0 2024-09-18T12:49:21.481 INFO:tasks.workunit.client.1.smithi148.stdout:5/744: dwrite d7/d8/dc/f28 [0,4194304] 0 2024-09-18T12:49:21.483 INFO:tasks.workunit.client.0.smithi078.stdout:7/400: rename d7/d5d/d5e/f5f to d7/d9/d4d/d6f/f8a 0 2024-09-18T12:49:21.487 INFO:tasks.workunit.client.1.smithi148.stdout:1/710: dread dc/d18/d7d/d93/dd9/d2b/f86 [0,4194304] 0 2024-09-18T12:49:21.489 INFO:tasks.workunit.client.1.smithi148.stdout:8/805: symlink d8/d16/d27/dc5/dee/dfe/df3/l113 0 2024-09-18T12:49:21.490 INFO:tasks.workunit.client.1.smithi148.stdout:8/806: write d8/d12/d46/fa8 [477536,744] 0 2024-09-18T12:49:21.490 INFO:tasks.workunit.client.0.smithi078.stdout:1/490: mknod d0/d8/da/d3e/d58/d6e/d52/d47/d7d/d7f/c9a 0 2024-09-18T12:49:21.490 INFO:tasks.workunit.client.0.smithi078.stdout:9/445: dwrite d5/d7/d32/d2a/d36/f43 [0,4194304] 0 2024-09-18T12:49:21.492 INFO:tasks.workunit.client.1.smithi148.stdout:4/714: mkdir d15/de9 0 2024-09-18T12:49:21.494 INFO:tasks.workunit.client.0.smithi078.stdout:7/401: fdatasync d7/d26/f42 0 2024-09-18T12:49:21.494 INFO:tasks.workunit.client.1.smithi148.stdout:9/711: mkdir d8/da/dd/d77/dd9 0 2024-09-18T12:49:21.496 INFO:tasks.workunit.client.0.smithi078.stdout:9/446: read d5/d40/f7c [231347,54940] 0 2024-09-18T12:49:21.498 INFO:tasks.workunit.client.0.smithi078.stdout:1/491: rename d0/d8/f95 to d0/d8/da/d3e/d50/d60/f9b 0 2024-09-18T12:49:21.500 INFO:tasks.workunit.client.0.smithi078.stdout:1/492: readlink d0/d8/da/d45/l4e 0 2024-09-18T12:49:21.500 INFO:tasks.workunit.client.0.smithi078.stdout:7/402: dread d7/d26/d4f/f50 [0,4194304] 0 2024-09-18T12:49:21.501 INFO:tasks.workunit.client.0.smithi078.stdout:1/493: write d0/d5b/d6d/f7e [234664,32034] 0 2024-09-18T12:49:21.504 INFO:tasks.workunit.client.1.smithi148.stdout:6/736: mknod d5/d1a/dc/d2b/d35/ceb 0 2024-09-18T12:49:21.505 INFO:tasks.workunit.client.1.smithi148.stdout:0/878: creat de/d27/d53/d89/d9d/f12a x:0 0 0 2024-09-18T12:49:21.507 INFO:tasks.workunit.client.0.smithi078.stdout:7/403: rmdir d7/d9/d14/d22/d3e 39 2024-09-18T12:49:21.509 INFO:tasks.workunit.client.0.smithi078.stdout:1/494: symlink d0/d8/da/d3e/d58/l9c 0 2024-09-18T12:49:21.510 INFO:tasks.workunit.client.0.smithi078.stdout:1/495: fsync d0/d8/da/f8d 0 2024-09-18T12:49:21.510 INFO:tasks.workunit.client.1.smithi148.stdout:2/641: mknod d9/d24/d31/d34/d42/ce8 0 2024-09-18T12:49:21.512 INFO:tasks.workunit.client.1.smithi148.stdout:1/711: mkdir dc/d18/d8a/de4 0 2024-09-18T12:49:21.513 INFO:tasks.workunit.client.1.smithi148.stdout:1/712: chown dc/d5b/l91 3445660 1 2024-09-18T12:49:21.515 INFO:tasks.workunit.client.0.smithi078.stdout:1/496: unlink d0/d8/da/d45/f91 0 2024-09-18T12:49:21.515 INFO:tasks.workunit.client.1.smithi148.stdout:1/713: truncate dc/d18/d7d/d93/dd9/d2b/d80/fd7 251355 0 2024-09-18T12:49:21.515 INFO:tasks.workunit.client.0.smithi078.stdout:7/404: symlink d7/d26/d84/l8b 0 2024-09-18T12:49:21.517 INFO:tasks.workunit.client.0.smithi078.stdout:7/405: dread - d7/d9/d32/d3b/f7e zero size 2024-09-18T12:49:21.517 INFO:tasks.workunit.client.1.smithi148.stdout:4/715: unlink d15/d90/l9f 0 2024-09-18T12:49:21.517 INFO:tasks.workunit.client.1.smithi148.stdout:9/712: write d8/d33/f42 [3290756,122272] 0 2024-09-18T12:49:21.518 INFO:tasks.workunit.client.1.smithi148.stdout:9/713: dread - d8/da/f82 zero size 2024-09-18T12:49:21.519 INFO:tasks.workunit.client.1.smithi148.stdout:7/718: mknod db/dc/df/d5f/cd3 0 2024-09-18T12:49:21.520 INFO:tasks.workunit.client.1.smithi148.stdout:9/714: write d8/da/dd/d4a/d49/d46/d54/faa [5112583,15055] 0 2024-09-18T12:49:21.520 INFO:tasks.workunit.client.1.smithi148.stdout:7/719: chown db/dc/df/d1d/d68/d7a/fcd 93562307 1 2024-09-18T12:49:21.521 INFO:tasks.workunit.client.0.smithi078.stdout:1/497: mkdir d0/d8/da/d3e/d58/d6e/d8c/d9d 0 2024-09-18T12:49:21.522 INFO:tasks.workunit.client.0.smithi078.stdout:7/406: dread d7/d9/d32/d3b/f45 [0,4194304] 0 2024-09-18T12:49:21.523 INFO:tasks.workunit.client.0.smithi078.stdout:7/407: chown d7/d9/d14/d22/d35/d49/d61 2 1 2024-09-18T12:49:21.524 INFO:tasks.workunit.client.0.smithi078.stdout:7/408: chown d7/d9/d14/d22/d35/c3a 12023 1 2024-09-18T12:49:21.527 INFO:tasks.workunit.client.0.smithi078.stdout:9/447: dread d5/d7/d8/d4f/f54 [0,4194304] 0 2024-09-18T12:49:21.528 INFO:tasks.workunit.client.0.smithi078.stdout:9/448: readlink d5/d7/d32/l48 0 2024-09-18T12:49:21.528 INFO:tasks.workunit.client.1.smithi148.stdout:3/675: creat d4/d8/d20/d2b/fe7 x:0 0 0 2024-09-18T12:49:21.532 INFO:tasks.workunit.client.1.smithi148.stdout:4/716: creat d15/d17/d52/d92/d4c/dd0/fea x:0 0 0 2024-09-18T12:49:21.532 INFO:tasks.workunit.client.1.smithi148.stdout:4/717: stat d15/f53 0 2024-09-18T12:49:21.532 INFO:tasks.workunit.client.0.smithi078.stdout:9/449: rmdir d5/d5c 39 2024-09-18T12:49:21.533 INFO:tasks.workunit.client.1.smithi148.stdout:4/718: readlink d15/d17/d52/d92/d4c/d4f/ldf 0 2024-09-18T12:49:21.534 INFO:tasks.workunit.client.1.smithi148.stdout:9/715: creat d8/d73/fda x:0 0 0 2024-09-18T12:49:21.536 INFO:tasks.workunit.client.1.smithi148.stdout:7/720: mknod db/d52/d1f/cd4 0 2024-09-18T12:49:21.537 INFO:tasks.workunit.client.0.smithi078.stdout:9/450: symlink d5/d7/d32/d81/l92 0 2024-09-18T12:49:21.539 INFO:tasks.workunit.client.0.smithi078.stdout:1/498: rename d0/d8/da/f17 to d0/d8/da/d3e/d58/d6e/d52/d47/f9e 0 2024-09-18T12:49:21.541 INFO:tasks.workunit.client.1.smithi148.stdout:6/737: rename d5/d32/d38/c43 to d5/d1a/dc/d2b/cec 0 2024-09-18T12:49:21.542 INFO:tasks.workunit.client.1.smithi148.stdout:5/745: link d7/d8/d18/f88 d7/d8/dc/da6/dee/d77/dd4/ffb 0 2024-09-18T12:49:21.544 INFO:tasks.workunit.client.0.smithi078.stdout:9/451: dwrite d5/d7/d32/d2a/d68/f80 [0,4194304] 0 2024-09-18T12:49:21.545 INFO:tasks.workunit.client.0.smithi078.stdout:1/499: symlink d0/d8/da/d3e/d58/l9f 0 2024-09-18T12:49:21.546 INFO:tasks.workunit.client.0.smithi078.stdout:9/452: dread - d5/d7/d32/d2a/f7d zero size 2024-09-18T12:49:21.546 INFO:tasks.workunit.client.0.smithi078.stdout:7/409: write d7/d9/f1f [762659,68665] 0 2024-09-18T12:49:21.550 INFO:tasks.workunit.client.1.smithi148.stdout:4/719: dread d15/f28 [4194304,4194304] 0 2024-09-18T12:49:21.550 INFO:tasks.workunit.client.1.smithi148.stdout:8/807: creat d8/d12/d46/d7e/f114 x:0 0 0 2024-09-18T12:49:21.551 INFO:tasks.workunit.client.1.smithi148.stdout:8/808: read - d8/d12/d46/d7e/f114 zero size 2024-09-18T12:49:21.552 INFO:tasks.workunit.client.1.smithi148.stdout:5/746: dread d7/d8/d18/d3f/ff6 [0,4194304] 0 2024-09-18T12:49:21.553 INFO:tasks.workunit.client.0.smithi078.stdout:7/410: creat d7/d5d/d7a/d62/f8c x:0 0 0 2024-09-18T12:49:21.554 INFO:tasks.workunit.client.0.smithi078.stdout:7/411: write d7/d9/d32/f36 [2063292,70440] 0 2024-09-18T12:49:21.558 INFO:tasks.workunit.client.1.smithi148.stdout:2/642: truncate d9/d73/f91 3189196 0 2024-09-18T12:49:21.559 INFO:tasks.workunit.client.1.smithi148.stdout:8/809: dread d8/df/db2/fbd [0,4194304] 0 2024-09-18T12:49:21.560 INFO:tasks.workunit.client.0.smithi078.stdout:1/500: rename d0/d8/da/d3e/d58/d6e/d52/d47/d7d/f57 to d0/d8/da/d3e/d50/fa0 0 2024-09-18T12:49:21.561 INFO:tasks.workunit.client.0.smithi078.stdout:7/412: dwrite d7/d5d/d7a/f4a [0,4194304] 0 2024-09-18T12:49:21.562 INFO:tasks.workunit.client.1.smithi148.stdout:0/879: rename de/d14/d93 to de/d27/d53/d89/dc0/db0/d12b 0 2024-09-18T12:49:21.565 INFO:tasks.workunit.client.1.smithi148.stdout:4/720: unlink c6 0 2024-09-18T12:49:21.567 INFO:tasks.workunit.client.1.smithi148.stdout:9/716: write d8/d6f/f80 [3481609,100662] 0 2024-09-18T12:49:21.571 INFO:tasks.workunit.client.0.smithi078.stdout:1/501: dread d0/d8/da/d3e/d50/d60/f6b [0,4194304] 0 2024-09-18T12:49:21.571 INFO:tasks.workunit.client.0.smithi078.stdout:7/413: mkdir d7/d9/d14/d22/d35/d49/d56/d8d 0 2024-09-18T12:49:21.572 INFO:tasks.workunit.client.0.smithi078.stdout:7/414: dread - d7/d5d/d7a/f5c zero size 2024-09-18T12:49:21.573 INFO:tasks.workunit.client.0.smithi078.stdout:1/502: write d0/d5b/d6d/f7e [400262,121620] 0 2024-09-18T12:49:21.575 INFO:tasks.workunit.client.1.smithi148.stdout:7/721: mkdir db/dc/df/d5f/dcb/dd5 0 2024-09-18T12:49:21.580 INFO:tasks.workunit.client.0.smithi078.stdout:9/453: dread d5/d7/d32/d2a/d6b/f5d [0,4194304] 0 2024-09-18T12:49:21.581 INFO:tasks.workunit.client.1.smithi148.stdout:8/810: creat d8/d12/d51/d94/f115 x:0 0 0 2024-09-18T12:49:21.581 INFO:tasks.workunit.client.1.smithi148.stdout:8/811: write d8/d12/d46/fa8 [2416058,11826] 0 2024-09-18T12:49:21.582 INFO:tasks.workunit.client.0.smithi078.stdout:1/503: dwrite d0/d8/da/d3e/d58/d6e/d52/d47/f69 [0,4194304] 0 2024-09-18T12:49:21.583 INFO:tasks.workunit.client.0.smithi078.stdout:9/454: write d5/d7/d8/d4f/f64 [5127750,41774] 0 2024-09-18T12:49:21.584 INFO:tasks.workunit.client.1.smithi148.stdout:0/880: fsync de/d27/d53/d89/dca/ffb 0 2024-09-18T12:49:21.586 INFO:tasks.workunit.client.0.smithi078.stdout:1/504: fsync d0/d8/f2b 0 2024-09-18T12:49:21.590 INFO:tasks.workunit.client.0.smithi078.stdout:1/505: symlink d0/d8/da/d3e/d50/d60/la1 0 2024-09-18T12:49:21.593 INFO:tasks.workunit.client.1.smithi148.stdout:2/643: fdatasync d9/fe 0 2024-09-18T12:49:21.600 INFO:tasks.workunit.client.1.smithi148.stdout:4/721: mknod d15/d17/d52/d92/dc9/ceb 0 2024-09-18T12:49:21.601 INFO:tasks.workunit.client.1.smithi148.stdout:5/747: symlink d7/d8/dc/d12/d20/df3/db1/lfc 0 2024-09-18T12:49:21.602 INFO:tasks.workunit.client.1.smithi148.stdout:5/748: dread - d7/d8/dc/da6/dee/d69/ff2 zero size 2024-09-18T12:49:21.603 INFO:tasks.workunit.client.1.smithi148.stdout:5/749: chown d7/d8/d18/d3f/d7c/fef 419111833 1 2024-09-18T12:49:21.604 INFO:tasks.workunit.client.1.smithi148.stdout:7/722: write fa [821982,32540] 0 2024-09-18T12:49:21.604 INFO:tasks.workunit.client.1.smithi148.stdout:2/644: read d9/f21 [1187169,21603] 0 2024-09-18T12:49:21.605 INFO:tasks.workunit.client.1.smithi148.stdout:3/676: rename d4/d8/d1e/d6b/c30 to d4/d8/d1e/d6b/d31/ce8 0 2024-09-18T12:49:21.606 INFO:tasks.workunit.client.0.smithi078.stdout:9/455: dread d5/d7/d32/f30 [0,4194304] 0 2024-09-18T12:49:21.606 INFO:tasks.workunit.client.0.smithi078.stdout:1/506: write d0/d8/f3f [531709,9307] 0 2024-09-18T12:49:21.608 INFO:tasks.workunit.client.0.smithi078.stdout:9/456: write d5/d40/f63 [2392745,103256] 0 2024-09-18T12:49:21.610 INFO:tasks.workunit.client.1.smithi148.stdout:5/750: chown d7/d8/l71 0 1 2024-09-18T12:49:21.611 INFO:tasks.workunit.client.1.smithi148.stdout:2/645: readlink d9/l30 0 2024-09-18T12:49:21.614 INFO:tasks.workunit.client.1.smithi148.stdout:9/717: link d8/l2a d8/da/dd/d4a/d49/d46/d54/ldb 0 2024-09-18T12:49:21.615 INFO:tasks.workunit.client.0.smithi078.stdout:9/457: getdents d5 0 2024-09-18T12:49:21.618 INFO:tasks.workunit.client.0.smithi078.stdout:9/458: symlink d5/d7/d8/d4f/l93 0 2024-09-18T12:49:21.619 INFO:tasks.workunit.client.0.smithi078.stdout:9/459: chown d5/d5c/c7e 10386 1 2024-09-18T12:49:21.620 INFO:tasks.workunit.client.1.smithi148.stdout:9/718: write f6 [646806,49901] 0 2024-09-18T12:49:21.620 INFO:tasks.workunit.client.0.smithi078.stdout:9/460: dread - d5/d7/d32/f5b zero size 2024-09-18T12:49:21.621 INFO:tasks.workunit.client.1.smithi148.stdout:9/719: truncate d8/d33/fa5 890174 0 2024-09-18T12:49:21.621 INFO:tasks.workunit.client.1.smithi148.stdout:5/751: creat d7/d8/dc/d12/d31/d5a/ffd x:0 0 0 2024-09-18T12:49:21.622 INFO:tasks.workunit.client.0.smithi078.stdout:9/461: readlink d5/d7/d32/d2a/l69 0 2024-09-18T12:49:21.623 INFO:tasks.workunit.client.1.smithi148.stdout:8/812: link d8/d12/d46/caa d8/d16/c116 0 2024-09-18T12:49:21.625 INFO:tasks.workunit.client.1.smithi148.stdout:3/677: creat d4/d8/d20/d2b/d7f/d93/fe9 x:0 0 0 2024-09-18T12:49:21.626 INFO:tasks.workunit.client.0.smithi078.stdout:9/462: read d5/d7/d32/d2a/d68/f6f [1177748,60757] 0 2024-09-18T12:49:21.627 INFO:tasks.workunit.client.1.smithi148.stdout:0/881: getdents de/d27/d53 0 2024-09-18T12:49:21.629 INFO:tasks.workunit.client.1.smithi148.stdout:8/813: creat d8/d16/d27/dc5/dee/f117 x:0 0 0 2024-09-18T12:49:21.632 INFO:tasks.workunit.client.1.smithi148.stdout:5/752: dread d7/d8/dc/d12/d31/f50 [0,4194304] 0 2024-09-18T12:49:21.632 INFO:tasks.workunit.client.0.smithi078.stdout:9/463: dwrite d5/f4a [0,4194304] 0 2024-09-18T12:49:21.633 INFO:tasks.workunit.client.1.smithi148.stdout:7/723: dread db/dc/df/f29 [0,4194304] 0 2024-09-18T12:49:21.635 INFO:tasks.workunit.client.0.smithi078.stdout:9/464: creat d5/d7/d32/d91/f94 x:0 0 0 2024-09-18T12:49:21.638 INFO:tasks.workunit.client.1.smithi148.stdout:4/722: dwrite d15/d17/d52/d92/f2e [4194304,4194304] 0 2024-09-18T12:49:21.638 INFO:tasks.workunit.client.1.smithi148.stdout:2/646: dwrite d9/f84 [0,4194304] 0 2024-09-18T12:49:21.640 INFO:tasks.workunit.client.1.smithi148.stdout:9/720: dwrite d8/da/dd/d4a/d49/d46/d54/d90/fb2 [0,4194304] 0 2024-09-18T12:49:21.643 INFO:tasks.workunit.client.1.smithi148.stdout:7/724: dread - db/dc/fc2 zero size 2024-09-18T12:49:21.644 INFO:tasks.workunit.client.1.smithi148.stdout:6/738: sync 2024-09-18T12:49:21.644 INFO:tasks.workunit.client.1.smithi148.stdout:1/714: sync 2024-09-18T12:49:21.646 INFO:tasks.workunit.client.1.smithi148.stdout:2/647: chown d9/d17/f5d 27541746 1 2024-09-18T12:49:21.647 INFO:tasks.workunit.client.1.smithi148.stdout:5/753: creat d7/d8/dc/ffe x:0 0 0 2024-09-18T12:49:21.647 INFO:tasks.workunit.client.0.smithi078.stdout:9/465: fsync d5/d7/d32/d91/f94 0 2024-09-18T12:49:21.648 INFO:tasks.workunit.client.1.smithi148.stdout:0/882: truncate de/d27/f8a 5134297 0 2024-09-18T12:49:21.649 INFO:tasks.workunit.client.0.smithi078.stdout:9/466: fsync d5/d7/d32/f5b 0 2024-09-18T12:49:21.653 INFO:tasks.workunit.client.1.smithi148.stdout:8/814: dwrite d8/f8c [0,4194304] 0 2024-09-18T12:49:21.656 INFO:tasks.workunit.client.1.smithi148.stdout:1/715: creat dc/d18/d31/d4b/d8d/fe5 x:0 0 0 2024-09-18T12:49:21.657 INFO:tasks.workunit.client.1.smithi148.stdout:7/725: symlink db/dc/df/d11/db3/ld6 0 2024-09-18T12:49:21.657 INFO:tasks.workunit.client.1.smithi148.stdout:9/721: fsync d8/da/dd/d4a/f18 0 2024-09-18T12:49:21.658 INFO:tasks.workunit.client.1.smithi148.stdout:5/754: dread - d7/d8/dc/da6/dee/d25/fa7 zero size 2024-09-18T12:49:21.659 INFO:tasks.workunit.client.0.smithi078.stdout:9/467: creat d5/d7/d32/d2a/d6b/f95 x:0 0 0 2024-09-18T12:49:21.662 INFO:tasks.workunit.client.0.smithi078.stdout:9/468: symlink d5/d7/d32/d2a/d36/l96 0 2024-09-18T12:49:21.662 INFO:tasks.workunit.client.1.smithi148.stdout:7/726: rmdir db/dc/df/d11/d34 39 2024-09-18T12:49:21.663 INFO:tasks.workunit.client.1.smithi148.stdout:4/723: getdents d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b 0 2024-09-18T12:49:21.665 INFO:tasks.workunit.client.1.smithi148.stdout:9/722: write d8/da/dd/d4a/d49/d46/fbf [1600891,60705] 0 2024-09-18T12:49:21.665 INFO:tasks.workunit.client.1.smithi148.stdout:2/648: getdents d9/d17/d29/d92/d95 0 2024-09-18T12:49:21.666 INFO:tasks.workunit.client.1.smithi148.stdout:1/716: chown dc/d18/d7d/d93/dd9/d2b/d80/lbd 1957914 1 2024-09-18T12:49:21.669 INFO:tasks.workunit.client.0.smithi078.stdout:9/469: dwrite d5/d7/d32/d2a/d68/f80 [0,4194304] 0 2024-09-18T12:49:21.669 INFO:tasks.workunit.client.1.smithi148.stdout:2/649: fdatasync d9/d73/fd1 0 2024-09-18T12:49:21.670 INFO:tasks.workunit.client.1.smithi148.stdout:8/815: dwrite d8/d16/d27/f76 [0,4194304] 0 2024-09-18T12:49:21.671 INFO:tasks.workunit.client.1.smithi148.stdout:7/727: write db/dc/df/d11/d43/fc0 [288991,108148] 0 2024-09-18T12:49:21.671 INFO:tasks.workunit.client.1.smithi148.stdout:1/717: write dc/d18/d63/f98 [1237470,3063] 0 2024-09-18T12:49:21.671 INFO:tasks.workunit.client.1.smithi148.stdout:4/724: read d15/fd1 [1150381,6545] 0 2024-09-18T12:49:21.672 INFO:tasks.workunit.client.0.smithi078.stdout:9/470: mkdir d5/d7/d32/d2a/d68/d97 0 2024-09-18T12:49:21.672 INFO:tasks.workunit.client.0.smithi078.stdout:9/471: write d5/f6c [192693,22136] 0 2024-09-18T12:49:21.673 INFO:tasks.workunit.client.1.smithi148.stdout:9/723: mkdir d8/da/dd/d4a/ddc 0 2024-09-18T12:49:21.681 INFO:tasks.workunit.client.1.smithi148.stdout:1/718: creat dc/d18/d31/d4b/d8d/fe6 x:0 0 0 2024-09-18T12:49:21.682 INFO:tasks.workunit.client.1.smithi148.stdout:3/678: dread d4/d8/d1e/d6b/d31/d54/fbf [0,4194304] 0 2024-09-18T12:49:21.682 INFO:tasks.workunit.client.1.smithi148.stdout:8/816: mknod d8/d16/d53/d39/c118 0 2024-09-18T12:49:21.683 INFO:tasks.workunit.client.0.smithi078.stdout:9/472: dwrite d5/d7/d32/f30 [0,4194304] 0 2024-09-18T12:49:21.684 INFO:tasks.workunit.client.1.smithi148.stdout:9/724: creat d8/da/dd/d4a/fdd x:0 0 0 2024-09-18T12:49:21.684 INFO:tasks.workunit.client.1.smithi148.stdout:7/728: dread db/dc/df/d2c/f7e [0,4194304] 0 2024-09-18T12:49:21.686 INFO:tasks.workunit.client.1.smithi148.stdout:2/650: rename d9/d24/f79 to d9/fe9 0 2024-09-18T12:49:21.687 INFO:tasks.workunit.client.1.smithi148.stdout:6/739: dread d5/d1a/dc/f20 [0,4194304] 0 2024-09-18T12:49:21.687 INFO:tasks.workunit.client.1.smithi148.stdout:7/729: write db/dc/df/d1d/d68/d7a/fc6 [2899689,23967] 0 2024-09-18T12:49:21.689 INFO:tasks.workunit.client.1.smithi148.stdout:8/817: rmdir d8/d12 39 2024-09-18T12:49:21.691 INFO:tasks.workunit.client.1.smithi148.stdout:1/719: rmdir dc/d18/d7d/d93/dd9/d2b/d99 39 2024-09-18T12:49:21.692 INFO:tasks.workunit.client.0.smithi078.stdout:9/473: mkdir d5/d7/d8/d98 0 2024-09-18T12:49:21.693 INFO:tasks.workunit.client.1.smithi148.stdout:0/883: truncate de/d27/f3a 193127 0 2024-09-18T12:49:21.696 INFO:tasks.workunit.client.1.smithi148.stdout:3/679: creat d4/d8/d20/d2b/d7f/dd9/fea x:0 0 0 2024-09-18T12:49:21.699 INFO:tasks.workunit.client.1.smithi148.stdout:2/651: dread d9/d3a/fd3 [0,4194304] 0 2024-09-18T12:49:21.699 INFO:tasks.workunit.client.1.smithi148.stdout:4/725: mknod d15/d17/d52/d92/d4c/d4f/d64/da0/da1/dcf/cec 0 2024-09-18T12:49:21.699 INFO:tasks.workunit.client.1.smithi148.stdout:2/652: fdatasync d9/d24/d31/f83 0 2024-09-18T12:49:21.700 INFO:tasks.workunit.client.1.smithi148.stdout:6/740: rename d5/d1a/f6f to d5/d1a/d29/d5c/da1/fed 0 2024-09-18T12:49:21.703 INFO:tasks.workunit.client.1.smithi148.stdout:3/680: dread d4/d8/d1e/d6b/f81 [0,4194304] 0 2024-09-18T12:49:21.703 INFO:tasks.workunit.client.1.smithi148.stdout:1/720: rename dc to dc/d18/d7d/d93/dd9/d2b/d99/de7 22 2024-09-18T12:49:21.703 INFO:tasks.workunit.client.1.smithi148.stdout:9/725: unlink d8/c44 0 2024-09-18T12:49:21.704 INFO:tasks.workunit.client.1.smithi148.stdout:6/741: truncate d5/d1a/d3d/fb9 763313 0 2024-09-18T12:49:21.704 INFO:tasks.workunit.client.1.smithi148.stdout:5/755: truncate d7/d8/dc/d12/d31/d5a/fb3 2499459 0 2024-09-18T12:49:21.705 INFO:tasks.workunit.client.1.smithi148.stdout:1/721: write dc/d18/d7d/d93/dd9/f21 [447828,18491] 0 2024-09-18T12:49:21.706 INFO:tasks.workunit.client.1.smithi148.stdout:0/884: symlink de/d14/d43/dd6/d121/l12c 0 2024-09-18T12:49:21.708 INFO:tasks.workunit.client.1.smithi148.stdout:8/818: rename d8/d16/d53/da0/dba/fe2 to d8/d12/d46/d74/dd5/f119 0 2024-09-18T12:49:21.709 INFO:tasks.workunit.client.1.smithi148.stdout:7/730: creat db/d52/fd7 x:0 0 0 2024-09-18T12:49:21.710 INFO:tasks.workunit.client.1.smithi148.stdout:2/653: truncate d9/d24/d31/d34/f6e 491772 0 2024-09-18T12:49:21.714 INFO:tasks.workunit.client.1.smithi148.stdout:6/742: unlink d5/ff 0 2024-09-18T12:49:21.714 INFO:tasks.workunit.client.1.smithi148.stdout:9/726: dwrite d8/da/dd/d35/d5e/fa7 [0,4194304] 0 2024-09-18T12:49:21.717 INFO:tasks.workunit.client.1.smithi148.stdout:1/722: creat dc/d18/d7d/d7e/fe8 x:0 0 0 2024-09-18T12:49:21.720 INFO:tasks.workunit.client.0.smithi078.stdout:9/474: dwrite d5/d7/d8/f33 [4194304,4194304] 0 2024-09-18T12:49:21.721 INFO:tasks.workunit.client.1.smithi148.stdout:6/743: chown d5/d1a/l11 3 1 2024-09-18T12:49:21.721 INFO:tasks.workunit.client.1.smithi148.stdout:0/885: dwrite de/f24 [0,4194304] 0 2024-09-18T12:49:21.722 INFO:tasks.workunit.client.0.smithi078.stdout:9/475: fsync d5/d5c/f88 0 2024-09-18T12:49:21.724 INFO:tasks.workunit.client.1.smithi148.stdout:1/723: truncate dc/d18/d7d/d93/dd9/f35 1202660 0 2024-09-18T12:49:21.724 INFO:tasks.workunit.client.1.smithi148.stdout:7/731: mknod db/dc/df/d8e/d75/cd8 0 2024-09-18T12:49:21.726 INFO:tasks.workunit.client.1.smithi148.stdout:4/726: dread d15/d17/d52/d92/d4c/d4f/fb7 [0,4194304] 0 2024-09-18T12:49:21.726 INFO:tasks.workunit.client.1.smithi148.stdout:9/727: read d8/da/dd/f14 [1028846,95766] 0 2024-09-18T12:49:21.727 INFO:tasks.workunit.client.1.smithi148.stdout:9/728: fdatasync d8/d33/f42 0 2024-09-18T12:49:21.728 INFO:tasks.workunit.client.0.smithi078.stdout:9/476: mknod d5/d5c/c99 0 2024-09-18T12:49:21.731 INFO:tasks.workunit.client.0.smithi078.stdout:9/477: truncate d5/d7/d32/d2a/d6b/f57 1428013 0 2024-09-18T12:49:21.733 INFO:tasks.workunit.client.0.smithi078.stdout:9/478: write d5/d7/d32/d2a/d68/f77 [779508,69936] 0 2024-09-18T12:49:21.733 INFO:tasks.workunit.client.0.smithi078.stdout:9/479: chown d5/l42 0 1 2024-09-18T12:49:21.734 INFO:tasks.workunit.client.1.smithi148.stdout:6/744: creat d5/d32/d38/d50/de7/fee x:0 0 0 2024-09-18T12:49:21.734 INFO:tasks.workunit.client.1.smithi148.stdout:3/681: dwrite d4/d8/d1e/d6b/f47 [4194304,4194304] 0 2024-09-18T12:49:21.736 INFO:tasks.workunit.client.1.smithi148.stdout:6/745: chown d5/d1a/dc/d2b/d35/d65/d99/da4 1 1 2024-09-18T12:49:21.736 INFO:tasks.workunit.client.1.smithi148.stdout:3/682: fdatasync d4/d8/d1e/d79/d92/fae 0 2024-09-18T12:49:21.737 INFO:tasks.workunit.client.1.smithi148.stdout:1/724: mknod dc/d18/d8a/ce9 0 2024-09-18T12:49:21.738 INFO:tasks.workunit.client.1.smithi148.stdout:6/746: chown d5/d32/d38/d50/de7/f8e 71 1 2024-09-18T12:49:21.739 INFO:tasks.workunit.client.1.smithi148.stdout:4/727: mknod d15/d5f/d69/d7f/ced 0 2024-09-18T12:49:21.744 INFO:tasks.workunit.client.1.smithi148.stdout:5/756: dwrite d7/d8/dc/da6/dee/d77/f9b [0,4194304] 0 2024-09-18T12:49:21.744 INFO:tasks.workunit.client.0.smithi078.stdout:9/480: dwrite d5/d7/d8/f27 [0,4194304] 0 2024-09-18T12:49:21.747 INFO:tasks.workunit.client.1.smithi148.stdout:0/886: rename f9 to de/d27/d53/d89/dc0/dbd/dd9/f12d 0 2024-09-18T12:49:21.748 INFO:tasks.workunit.client.1.smithi148.stdout:0/887: chown de/d14/d43/d57/d59/f5c 171218143 1 2024-09-18T12:49:21.749 INFO:tasks.workunit.client.1.smithi148.stdout:4/728: dread d15/d17/d52/d92/d4c/d72/f79 [0,4194304] 0 2024-09-18T12:49:21.749 INFO:tasks.workunit.client.1.smithi148.stdout:0/888: write de/d14/f26 [4365873,101922] 0 2024-09-18T12:49:21.752 INFO:tasks.workunit.client.0.smithi078.stdout:9/481: rename d5/d7/c45 to d5/d7/d8/d98/c9a 0 2024-09-18T12:49:21.755 INFO:tasks.workunit.client.1.smithi148.stdout:8/819: getdents d8/d16/d53/d39/d3b 0 2024-09-18T12:49:21.758 INFO:tasks.workunit.client.1.smithi148.stdout:2/654: link d9/d17/d29/d92/d95/f38 d9/d24/d67/dc7/dce/de3/fea 0 2024-09-18T12:49:21.761 INFO:tasks.workunit.client.1.smithi148.stdout:8/820: dwrite d8/d16/d53/da0/ff5 [0,4194304] 0 2024-09-18T12:49:21.762 INFO:tasks.workunit.client.1.smithi148.stdout:6/747: mknod d5/d1a/dc/d2b/d35/d65/d99/cef 0 2024-09-18T12:49:21.844 INFO:tasks.workunit.client.1.smithi148.stdout:9/729: truncate d8/d6f/f80 249282 0 2024-09-18T12:49:21.846 INFO:tasks.workunit.client.0.smithi078.stdout:5/626: sync 2024-09-18T12:49:21.848 INFO:tasks.workunit.client.0.smithi078.stdout:5/627: write d2/d4/d9/da/d60/db3/d16/d36/d4c/d62/f84 [1777734,17364] 0 2024-09-18T12:49:21.852 INFO:tasks.workunit.client.1.smithi148.stdout:1/725: write dc/d18/d7d/d93/dd9/d2b/f2e [1468169,34082] 0 2024-09-18T12:49:21.853 INFO:tasks.workunit.client.1.smithi148.stdout:7/732: getdents db/dc/df/d8e 0 2024-09-18T12:49:21.854 INFO:tasks.workunit.client.0.smithi078.stdout:9/482: dwrite d5/d7/d8/f1d [0,4194304] 0 2024-09-18T12:49:21.860 INFO:tasks.workunit.client.1.smithi148.stdout:4/729: creat d15/d17/d52/d92/d4c/d4f/d64/d9a/fee x:0 0 0 2024-09-18T12:49:21.861 INFO:tasks.workunit.client.1.smithi148.stdout:1/726: dwrite dc/d18/d7d/d7e/fe8 [0,4194304] 0 2024-09-18T12:49:21.862 INFO:tasks.workunit.client.1.smithi148.stdout:8/821: creat d8/df/d3e/d82/d8f/d95/f11a x:0 0 0 2024-09-18T12:49:21.864 INFO:tasks.workunit.client.1.smithi148.stdout:0/889: mkdir de/d27/d53/d89/d129/d12e 0 2024-09-18T12:49:21.865 INFO:tasks.workunit.client.1.smithi148.stdout:0/890: chown de/d14/d6b/ddf/l122 28585670 1 2024-09-18T12:49:21.867 INFO:tasks.workunit.client.1.smithi148.stdout:6/748: truncate d5/fa 4457220 0 2024-09-18T12:49:21.869 INFO:tasks.workunit.client.1.smithi148.stdout:9/730: dread d8/da/dd/d65/f6d [0,4194304] 0 2024-09-18T12:49:21.870 INFO:tasks.workunit.client.1.smithi148.stdout:9/731: chown d8/da/dd/d4a/f15 36 1 2024-09-18T12:49:21.870 INFO:tasks.workunit.client.1.smithi148.stdout:9/732: read - d8/d73/fda zero size 2024-09-18T12:49:21.880 INFO:tasks.workunit.client.0.smithi078.stdout:5/628: mkdir d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/dbe 0 2024-09-18T12:49:21.884 INFO:tasks.workunit.client.0.smithi078.stdout:9/483: write d5/d7/d32/d2a/f59 [2462623,57976] 0 2024-09-18T12:49:21.885 INFO:tasks.workunit.client.0.smithi078.stdout:5/629: creat d2/d4/d48/fbf x:0 0 0 2024-09-18T12:49:21.890 INFO:tasks.workunit.client.0.smithi078.stdout:5/630: mkdir d2/d4/d9/dc0 0 2024-09-18T12:49:21.895 INFO:tasks.workunit.client.0.smithi078.stdout:5/631: getdents d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/d90 0 2024-09-18T12:49:21.896 INFO:tasks.workunit.client.1.smithi148.stdout:5/757: creat d7/fff x:0 0 0 2024-09-18T12:49:21.898 INFO:tasks.workunit.client.0.smithi078.stdout:5/632: write d2/d4/d9/d2f/f99 [1601869,100821] 0 2024-09-18T12:49:21.898 INFO:tasks.workunit.client.1.smithi148.stdout:3/683: getdents d4/d8/d6a/db3/db7 0 2024-09-18T12:49:21.899 INFO:tasks.workunit.client.1.smithi148.stdout:3/684: chown d4/d8/d1e/fba 64 1 2024-09-18T12:49:21.902 INFO:tasks.workunit.client.1.smithi148.stdout:1/727: mkdir dc/d18/d7d/dea 0 2024-09-18T12:49:21.902 INFO:tasks.workunit.client.0.smithi078.stdout:9/484: dread d5/d7/d8/f1a [0,4194304] 0 2024-09-18T12:49:21.903 INFO:tasks.workunit.client.0.smithi078.stdout:9/485: chown d5/d7/d32/d2a/d68/f8d 55780 1 2024-09-18T12:49:21.904 INFO:tasks.workunit.client.1.smithi148.stdout:8/822: truncate f1 1414276 0 2024-09-18T12:49:21.904 INFO:tasks.workunit.client.1.smithi148.stdout:8/823: stat d8/d16/d53/d39/d3b/d4e/fa2 0 2024-09-18T12:49:21.905 INFO:tasks.workunit.client.0.smithi078.stdout:5/633: fdatasync d2/d4/d9/da/d60/db3/d2d/f42 0 2024-09-18T12:49:21.906 INFO:tasks.workunit.client.1.smithi148.stdout:0/891: fsync de/d27/d53/d89/dca/ffe 0 2024-09-18T12:49:21.909 INFO:tasks.workunit.client.1.smithi148.stdout:6/749: unlink d5/d1a/d3d/c71 0 2024-09-18T12:49:21.911 INFO:tasks.workunit.client.1.smithi148.stdout:9/733: creat d8/da/dd/d65/db9/fde x:0 0 0 2024-09-18T12:49:21.911 INFO:tasks.workunit.client.1.smithi148.stdout:9/734: chown d8/da/dd/d4a 23573 1 2024-09-18T12:49:21.911 INFO:tasks.workunit.client.0.smithi078.stdout:5/634: mkdir d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/dc1 0 2024-09-18T12:49:21.912 INFO:tasks.workunit.client.0.smithi078.stdout:5/635: readlink d2/d4/d9/l43 0 2024-09-18T12:49:21.914 INFO:tasks.workunit.client.1.smithi148.stdout:2/655: rename d9/d73/fb8 to d9/d3a/feb 0 2024-09-18T12:49:21.915 INFO:tasks.workunit.client.1.smithi148.stdout:5/758: mkdir d7/d8/dc/d12/d20/d100 0 2024-09-18T12:49:21.916 INFO:tasks.workunit.client.1.smithi148.stdout:0/892: dread de/d14/f1f [0,4194304] 0 2024-09-18T12:49:21.916 INFO:tasks.workunit.client.0.smithi078.stdout:5/636: creat d2/d4/d48/fc2 x:0 0 0 2024-09-18T12:49:21.919 INFO:tasks.workunit.client.1.smithi148.stdout:1/728: dread - dc/d18/d31/d39/fc8 zero size 2024-09-18T12:49:21.919 INFO:tasks.workunit.client.0.smithi078.stdout:9/486: getdents d5/d7/d8/d98 0 2024-09-18T12:49:21.919 INFO:tasks.workunit.client.1.smithi148.stdout:5/759: dread d7/d8/dc/da6/dee/d77/f9b [0,4194304] 0 2024-09-18T12:49:21.920 INFO:tasks.workunit.client.1.smithi148.stdout:8/824: fdatasync d8/df/d3e/fcb 0 2024-09-18T12:49:21.922 INFO:tasks.workunit.client.1.smithi148.stdout:8/825: stat d8/d16/d53/c7b 0 2024-09-18T12:49:21.922 INFO:tasks.workunit.client.0.smithi078.stdout:9/487: dread d5/d5c/f88 [4194304,4194304] 0 2024-09-18T12:49:21.922 INFO:tasks.workunit.client.0.smithi078.stdout:5/637: creat d2/d4/d9/da/d60/db3/d16/d36/d4c/d62/d4d/fc3 x:0 0 0 2024-09-18T12:49:21.922 INFO:tasks.workunit.client.0.smithi078.stdout:9/488: readlink d5/d7/d32/d2a/l69 0 2024-09-18T12:49:21.927 INFO:tasks.workunit.client.1.smithi148.stdout:4/730: rename d15/d5f/fcc to d15/d17/d52/d92/d4c/d72/fef 0 2024-09-18T12:49:21.928 INFO:tasks.workunit.client.0.smithi078.stdout:5/638: dwrite d2/d4/d9/da/d60/d7f/fa8 [0,4194304] 0 2024-09-18T12:49:21.930 INFO:tasks.workunit.client.0.smithi078.stdout:9/489: truncate d5/d7/d8/fb 5101814 0 2024-09-18T12:49:21.933 INFO:tasks.workunit.client.1.smithi148.stdout:3/685: mkdir d4/d8/d20/d2b/deb 0 2024-09-18T12:49:21.937 INFO:tasks.workunit.client.0.smithi078.stdout:5/639: dwrite d2/d4/d9/da/d60/d7f/fba [0,4194304] 0 2024-09-18T12:49:21.942 INFO:tasks.workunit.client.0.smithi078.stdout:9/490: dwrite d5/d7/d32/d2a/d6b/f95 [0,4194304] 0 2024-09-18T12:49:21.942 INFO:tasks.workunit.client.1.smithi148.stdout:6/750: mkdir d5/d32/d38/df0 0 2024-09-18T12:49:21.942 INFO:tasks.workunit.client.1.smithi148.stdout:3/686: dwrite d4/d8/d1e/d6b/d31/d54/fcc [0,4194304] 0 2024-09-18T12:49:21.944 INFO:tasks.workunit.client.0.smithi078.stdout:5/640: creat d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/fc4 x:0 0 0 2024-09-18T12:49:21.946 INFO:tasks.workunit.client.0.smithi078.stdout:9/491: mknod d5/d7/d32/c9b 0 2024-09-18T12:49:21.947 INFO:tasks.workunit.client.0.smithi078.stdout:9/492: fsync f0 0 2024-09-18T12:49:21.949 INFO:tasks.workunit.client.0.smithi078.stdout:5/641: symlink d2/db8/lc5 0 2024-09-18T12:49:21.951 INFO:tasks.workunit.client.1.smithi148.stdout:0/893: rename de/d27/d53/d89/d9d/f10e to de/d27/d53/d89/dbb/dc8/f12f 0 2024-09-18T12:49:21.953 INFO:tasks.workunit.client.1.smithi148.stdout:4/731: rmdir d15/d17/d52/d92/d4c/d4f/d34 39 2024-09-18T12:49:21.954 INFO:tasks.workunit.client.0.smithi078.stdout:9/493: symlink d5/d7/d8/d4f/l9c 0 2024-09-18T12:49:21.955 INFO:tasks.workunit.client.0.smithi078.stdout:5/642: dwrite d2/d4/fae [0,4194304] 0 2024-09-18T12:49:21.957 INFO:tasks.workunit.client.0.smithi078.stdout:5/643: stat d2/d4/d9/f94 0 2024-09-18T12:49:21.959 INFO:tasks.workunit.client.1.smithi148.stdout:7/733: getdents db/dc/df/d1d/d41 0 2024-09-18T12:49:21.961 INFO:tasks.workunit.client.1.smithi148.stdout:7/734: dread - db/dc/df/d1d/d41/fa2 zero size 2024-09-18T12:49:21.963 INFO:tasks.workunit.client.0.smithi078.stdout:5/644: symlink d2/d4/d9/d2f/lc6 0 2024-09-18T12:49:21.964 INFO:tasks.workunit.client.1.smithi148.stdout:5/760: fsync d7/d8/dc/da6/dee/d69/f73 0 2024-09-18T12:49:21.966 INFO:tasks.workunit.client.1.smithi148.stdout:6/751: creat d5/d1a/d3d/ff1 x:0 0 0 2024-09-18T12:49:21.966 INFO:tasks.workunit.client.1.smithi148.stdout:1/729: dwrite dc/d18/d31/d39/f40 [0,4194304] 0 2024-09-18T12:49:21.967 INFO:tasks.workunit.client.0.smithi078.stdout:5/645: creat d2/d4/d9/da/d60/db3/d16/d36/d68/db6/fc7 x:0 0 0 2024-09-18T12:49:21.968 INFO:tasks.workunit.client.1.smithi148.stdout:3/687: symlink d4/d8/d20/d2b/d7f/d93/dd1/lec 0 2024-09-18T12:49:21.968 INFO:tasks.workunit.client.0.smithi078.stdout:5/646: stat d2/d4/d9/da/d2b/d3e/l98 0 2024-09-18T12:49:21.970 INFO:tasks.workunit.client.0.smithi078.stdout:5/647: write d2/d4/d48/fbc [382572,103271] 0 2024-09-18T12:49:21.971 INFO:tasks.workunit.client.0.smithi078.stdout:5/648: chown d2/d74/la0 23781 1 2024-09-18T12:49:21.971 INFO:tasks.workunit.client.1.smithi148.stdout:4/732: symlink d15/d17/d52/d92/d4c/d4f/d64/da0/da1/dcf/lf0 0 2024-09-18T12:49:21.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:21 smithi148 ceph-mon[35352]: pgmap v18: 65 pgs: 65 active+clean; 2.1 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 70 MiB/s rd, 222 MiB/s wr, 411 op/s 2024-09-18T12:49:21.973 INFO:tasks.workunit.client.1.smithi148.stdout:6/752: chown d5/d1a/dc/d2b/d35/d65/d99/da4/da6 215342 1 2024-09-18T12:49:21.975 INFO:tasks.workunit.client.1.smithi148.stdout:1/730: mkdir dc/d18/d7d/d93/dd9/d2b/d80/deb 0 2024-09-18T12:49:21.978 INFO:tasks.workunit.client.1.smithi148.stdout:9/735: getdents d8/da/dd/d4a 0 2024-09-18T12:49:21.980 INFO:tasks.workunit.client.1.smithi148.stdout:7/735: truncate db/dc/df/d11/f47 1749768 0 2024-09-18T12:49:21.982 INFO:tasks.workunit.client.1.smithi148.stdout:8/826: getdents d8/d16/d53/d39 0 2024-09-18T12:49:21.982 INFO:tasks.workunit.client.1.smithi148.stdout:1/731: readlink dc/d18/d7d/d93/dd9/d2b/l62 0 2024-09-18T12:49:21.982 INFO:tasks.workunit.client.1.smithi148.stdout:7/736: fsync db/dc/df/d8e/d75/fcf 0 2024-09-18T12:49:21.983 INFO:tasks.workunit.client.1.smithi148.stdout:6/753: mkdir d5/d32/d38/df0/df2 0 2024-09-18T12:49:21.983 INFO:tasks.workunit.client.1.smithi148.stdout:8/827: chown d8/df/db2/fc3 1 1 2024-09-18T12:49:21.984 INFO:tasks.workunit.client.1.smithi148.stdout:9/736: link d8/da/dd/d35/d47/c9d d8/da/dd/d4a/d49/d46/d54/dab/cdf 0 2024-09-18T12:49:21.985 INFO:tasks.workunit.client.1.smithi148.stdout:1/732: fdatasync dc/d18/d31/d39/f75 0 2024-09-18T12:49:21.986 INFO:tasks.workunit.client.1.smithi148.stdout:4/733: dread d15/d17/d52/d92/d4c/d4f/f3d [0,4194304] 0 2024-09-18T12:49:21.989 INFO:tasks.workunit.client.1.smithi148.stdout:7/737: write db/dc/df/d2c/d55/daf/d38/fd2 [424152,99646] 0 2024-09-18T12:49:21.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:21 smithi078 ceph-mon[28091]: pgmap v18: 65 pgs: 65 active+clean; 2.1 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 70 MiB/s rd, 222 MiB/s wr, 411 op/s 2024-09-18T12:49:21.993 INFO:tasks.workunit.client.1.smithi148.stdout:1/733: symlink dc/d18/d31/d4b/lec 0 2024-09-18T12:49:21.994 INFO:tasks.workunit.client.1.smithi148.stdout:9/737: getdents d8/da/dd/d35/d81 0 2024-09-18T12:49:21.996 INFO:tasks.workunit.client.1.smithi148.stdout:7/738: getdents db/dc/df/d8e/d75 0 2024-09-18T12:49:21.996 INFO:tasks.workunit.client.1.smithi148.stdout:4/734: symlink d15/d17/d52/d92/d4c/dd0/dd6/lf1 0 2024-09-18T12:49:21.997 INFO:tasks.workunit.client.1.smithi148.stdout:1/734: mknod dc/d18/d63/ced 0 2024-09-18T12:49:21.997 INFO:tasks.workunit.client.1.smithi148.stdout:6/754: dwrite d5/d1a/dc/d2b/d35/d65/fb8 [0,4194304] 0 2024-09-18T12:49:21.999 INFO:tasks.workunit.client.1.smithi148.stdout:8/828: dwrite d8/d16/d53/da0/ff5 [0,4194304] 0 2024-09-18T12:49:22.001 INFO:tasks.workunit.client.1.smithi148.stdout:6/755: unlink d5/d1a/fd7 0 2024-09-18T12:49:22.009 INFO:tasks.workunit.client.1.smithi148.stdout:8/829: dwrite d8/d12/d46/d7e/fcc [0,4194304] 0 2024-09-18T12:49:22.010 INFO:tasks.workunit.client.1.smithi148.stdout:1/735: rename dc/d18/d7d/d93/dd9/d2b/d80/lcb to dc/d11/d38/d72/de3/lee 0 2024-09-18T12:49:22.010 INFO:tasks.workunit.client.0.smithi078.stdout:5/649: dread d2/d4/f1e [0,4194304] 0 2024-09-18T12:49:22.011 INFO:tasks.workunit.client.1.smithi148.stdout:4/735: link d15/c51 d15/d17/d52/d92/d4c/d72/db3/cf2 0 2024-09-18T12:49:22.012 INFO:tasks.workunit.client.0.smithi078.stdout:5/650: symlink d2/d4/d9/da/d60/db3/d16/d36/d4c/d97/lc8 0 2024-09-18T12:49:22.013 INFO:tasks.workunit.client.1.smithi148.stdout:1/736: chown dc/d18/d7d/d93/dd9/d2b/f2e 0 1 2024-09-18T12:49:22.013 INFO:tasks.workunit.client.1.smithi148.stdout:4/736: chown d15/d17/d52/d92/d4c/d4f/d64 6 1 2024-09-18T12:49:22.016 INFO:tasks.workunit.client.0.smithi078.stdout:5/651: creat d2/d4/d9/da/d60/db3/d2d/fc9 x:0 0 0 2024-09-18T12:49:22.017 INFO:tasks.workunit.client.1.smithi148.stdout:4/737: symlink d15/lf3 0 2024-09-18T12:49:22.018 INFO:tasks.workunit.client.0.smithi078.stdout:5/652: mkdir d2/d4/d48/d86/dca 0 2024-09-18T12:49:22.020 INFO:tasks.workunit.client.1.smithi148.stdout:4/738: creat d15/d17/d52/d92/d4c/d4f/d64/d9a/ff4 x:0 0 0 2024-09-18T12:49:22.020 INFO:tasks.workunit.client.1.smithi148.stdout:1/737: link dc/d18/d63/f94 dc/d18/d7d/d93/dd9/d2b/fef 0 2024-09-18T12:49:22.022 INFO:tasks.workunit.client.1.smithi148.stdout:4/739: write d15/d17/d52/d92/d4c/d4f/fca [285580,86134] 0 2024-09-18T12:49:22.022 INFO:tasks.workunit.client.0.smithi078.stdout:5/653: rename d2/d4/d9/f13 to d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/d90/fcb 0 2024-09-18T12:49:22.025 INFO:tasks.workunit.client.0.smithi078.stdout:5/654: creat d2/d4/d9/da/d60/db3/d16/d36/fcc x:0 0 0 2024-09-18T12:49:22.025 INFO:tasks.workunit.client.1.smithi148.stdout:1/738: dread dc/d18/d7d/d7e/fe8 [0,4194304] 0 2024-09-18T12:49:22.025 INFO:tasks.workunit.client.1.smithi148.stdout:4/740: creat d15/d5f/d69/d7f/ff5 x:0 0 0 2024-09-18T12:49:22.027 INFO:tasks.workunit.client.1.smithi148.stdout:4/741: truncate d15/d17/d52/d92/d4c/d4f/fca 955716 0 2024-09-18T12:49:22.028 INFO:tasks.workunit.client.1.smithi148.stdout:1/739: rename dc/d18/l44 to dc/d11/d38/lf0 0 2024-09-18T12:49:22.029 INFO:tasks.workunit.client.1.smithi148.stdout:4/742: mknod d15/d17/d52/d92/d4c/cf6 0 2024-09-18T12:49:22.030 INFO:tasks.workunit.client.1.smithi148.stdout:1/740: write dc/d18/d7d/d7e/fe8 [2999228,37353] 0 2024-09-18T12:49:22.030 INFO:tasks.workunit.client.1.smithi148.stdout:4/743: dread - d15/d5f/d69/d7f/ff5 zero size 2024-09-18T12:49:22.031 INFO:tasks.workunit.client.1.smithi148.stdout:4/744: fsync d15/d5f/d69/d7f/d94/fac 0 2024-09-18T12:49:22.032 INFO:tasks.workunit.client.1.smithi148.stdout:4/745: stat d15/d90 0 2024-09-18T12:49:22.032 INFO:tasks.workunit.client.1.smithi148.stdout:1/741: truncate dc/d11/f97 1684786 0 2024-09-18T12:49:22.034 INFO:tasks.workunit.client.1.smithi148.stdout:4/746: creat d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/ff7 x:0 0 0 2024-09-18T12:49:22.034 INFO:tasks.workunit.client.1.smithi148.stdout:1/742: mkdir dc/d18/d8a/df1 0 2024-09-18T12:49:22.036 INFO:tasks.workunit.client.1.smithi148.stdout:1/743: write dc/d18/d31/d4b/f6d [347877,65790] 0 2024-09-18T12:49:22.039 INFO:tasks.workunit.client.1.smithi148.stdout:1/744: rename dc/d18/f3d to dc/d9f/ff2 0 2024-09-18T12:49:22.045 INFO:tasks.workunit.client.0.smithi078.stdout:9/494: write d5/d7/d8/d4f/f76 [1256434,95992] 0 2024-09-18T12:49:22.046 INFO:tasks.workunit.client.0.smithi078.stdout:9/495: write d5/d7/f39 [1959083,13063] 0 2024-09-18T12:49:22.047 INFO:tasks.workunit.client.0.smithi078.stdout:9/496: chown d5/d7/d8/d4f/f54 1006 1 2024-09-18T12:49:22.048 INFO:tasks.workunit.client.1.smithi148.stdout:8/830: fdatasync d8/d12/d46/d7e/fcc 0 2024-09-18T12:49:22.048 INFO:tasks.workunit.client.0.smithi078.stdout:9/497: symlink d5/d7/d8/d98/l9d 0 2024-09-18T12:49:22.049 INFO:tasks.workunit.client.1.smithi148.stdout:0/894: write de/d27/d7a/f84 [508454,100592] 0 2024-09-18T12:49:22.049 INFO:tasks.workunit.client.0.smithi078.stdout:9/498: fsync d5/d7/d32/d2a/d6b/f57 0 2024-09-18T12:49:22.051 INFO:tasks.workunit.client.1.smithi148.stdout:8/831: unlink d8/lc 0 2024-09-18T12:49:22.053 INFO:tasks.workunit.client.0.smithi078.stdout:9/499: rename d5/d7/d8/l70 to d5/d7/d32/d81/l9e 0 2024-09-18T12:49:22.054 INFO:tasks.workunit.client.1.smithi148.stdout:4/747: dread d15/d17/d52/d92/d4c/d4f/d64/f82 [0,4194304] 0 2024-09-18T12:49:22.056 INFO:tasks.workunit.client.1.smithi148.stdout:0/895: dwrite de/d27/d53/d89/f107 [0,4194304] 0 2024-09-18T12:49:22.058 INFO:tasks.workunit.client.1.smithi148.stdout:0/896: chown de/d14/l20 2 1 2024-09-18T12:49:22.059 INFO:tasks.workunit.client.0.smithi078.stdout:9/500: creat d5/d7/d32/d2a/d68/d97/f9f x:0 0 0 2024-09-18T12:49:22.061 INFO:tasks.workunit.client.1.smithi148.stdout:4/748: creat d15/d5f/d69/d7f/ff8 x:0 0 0 2024-09-18T12:49:22.061 INFO:tasks.workunit.client.1.smithi148.stdout:3/688: dwrite d4/d8/d20/f26 [0,4194304] 0 2024-09-18T12:49:22.062 INFO:tasks.workunit.client.0.smithi078.stdout:9/501: symlink d5/d7/d32/d2a/d68/la0 0 2024-09-18T12:49:22.063 INFO:tasks.workunit.client.1.smithi148.stdout:4/749: chown d15/d17/d52/d92/d4c/d4f/d64/da0/fe1 159689328 1 2024-09-18T12:49:22.063 INFO:tasks.workunit.client.1.smithi148.stdout:0/897: stat de/l2f 0 2024-09-18T12:49:22.064 INFO:tasks.workunit.client.1.smithi148.stdout:3/689: mknod d4/d8/d1e/d63/ced 0 2024-09-18T12:49:22.067 INFO:tasks.workunit.client.1.smithi148.stdout:4/750: mknod d15/d17/d52/d68/da5/cf9 0 2024-09-18T12:49:22.068 INFO:tasks.workunit.client.1.smithi148.stdout:0/898: symlink de/d27/d53/d89/d129/l130 0 2024-09-18T12:49:22.069 INFO:tasks.workunit.client.1.smithi148.stdout:0/899: stat de/d27/d53/d89/dbb/f50 0 2024-09-18T12:49:22.071 INFO:tasks.workunit.client.1.smithi148.stdout:3/690: creat d4/d8/d1e/d6b/d31/d60/da9/d8b/fee x:0 0 0 2024-09-18T12:49:22.074 INFO:tasks.workunit.client.1.smithi148.stdout:3/691: fsync d4/d8/d20/d2b/f53 0 2024-09-18T12:49:22.074 INFO:tasks.workunit.client.0.smithi078.stdout:9/502: dread d5/d7/d8/f6a [0,4194304] 0 2024-09-18T12:49:22.077 INFO:tasks.workunit.client.1.smithi148.stdout:7/739: truncate fa 10455021 0 2024-09-18T12:49:22.077 INFO:tasks.workunit.client.0.smithi078.stdout:9/503: symlink d5/d7/d32/d2a/d36/la1 0 2024-09-18T12:49:22.079 INFO:tasks.workunit.client.1.smithi148.stdout:7/740: creat db/d52/d1f/fd9 x:0 0 0 2024-09-18T12:49:22.080 INFO:tasks.workunit.client.1.smithi148.stdout:9/738: truncate d8/da/dd/d77/fbd 3394334 0 2024-09-18T12:49:22.081 INFO:tasks.workunit.client.1.smithi148.stdout:9/739: write d8/da/dd/d3f/f58 [2173986,88861] 0 2024-09-18T12:49:22.081 INFO:tasks.workunit.client.0.smithi078.stdout:9/504: dread d5/d7/d8/d4f/f64 [0,4194304] 0 2024-09-18T12:49:22.082 INFO:tasks.workunit.client.1.smithi148.stdout:3/692: getdents d4/d8/d20 0 2024-09-18T12:49:22.083 INFO:tasks.workunit.client.1.smithi148.stdout:8/832: dread d8/df/d3e/d82/ded/ffa [0,4194304] 0 2024-09-18T12:49:22.083 INFO:tasks.workunit.client.1.smithi148.stdout:7/741: symlink db/dc/df/d1d/d68/lda 0 2024-09-18T12:49:22.084 INFO:tasks.workunit.client.1.smithi148.stdout:3/693: chown d4/d8/d1e/d6b/d31/f65 0 1 2024-09-18T12:49:22.085 INFO:tasks.workunit.client.0.smithi078.stdout:9/505: mknod d5/d7/ca2 0 2024-09-18T12:49:22.087 INFO:tasks.workunit.client.1.smithi148.stdout:7/742: rmdir db/dc/df/d5f/dcb 39 2024-09-18T12:49:22.089 INFO:tasks.workunit.client.0.smithi078.stdout:9/506: fsync d5/d7/d8/d4f/f54 0 2024-09-18T12:49:22.090 INFO:tasks.workunit.client.1.smithi148.stdout:6/756: dwrite d5/d32/d38/d50/de7/fad [0,4194304] 0 2024-09-18T12:49:22.090 INFO:tasks.workunit.client.1.smithi148.stdout:9/740: mkdir d8/da/dd/d35/d81/dc6/dcc/de0 0 2024-09-18T12:49:22.092 INFO:tasks.workunit.client.1.smithi148.stdout:3/694: symlink d4/d8/d20/d2b/d43/lef 0 2024-09-18T12:49:22.093 INFO:tasks.workunit.client.0.smithi078.stdout:9/507: rmdir d5/d7 39 2024-09-18T12:49:22.093 INFO:tasks.workunit.client.1.smithi148.stdout:3/695: readlink d4/d8/d20/d2b/d7f/d93/le6 0 2024-09-18T12:49:22.095 INFO:tasks.workunit.client.1.smithi148.stdout:8/833: mknod d8/df/d3e/d82/da7/c11b 0 2024-09-18T12:49:22.096 INFO:tasks.workunit.client.0.smithi078.stdout:5/655: write d2/d4/d9/da/f7a [2025530,6317] 0 2024-09-18T12:49:22.096 INFO:tasks.workunit.client.1.smithi148.stdout:0/900: dread de/d27/d53/d89/dbb/f71 [0,4194304] 0 2024-09-18T12:49:22.097 INFO:tasks.workunit.client.1.smithi148.stdout:0/901: write de/f24 [591180,107940] 0 2024-09-18T12:49:22.098 INFO:tasks.workunit.client.1.smithi148.stdout:0/902: dread - de/d27/d53/d89/dc1/f100 zero size 2024-09-18T12:49:22.099 INFO:tasks.workunit.client.1.smithi148.stdout:7/743: write db/dc/df/d11/d34/f76 [488091,27592] 0 2024-09-18T12:49:22.100 INFO:tasks.workunit.client.1.smithi148.stdout:6/757: mkdir d5/d1a/dc/dbf/dcb/df3 0 2024-09-18T12:49:22.104 INFO:tasks.workunit.client.0.smithi078.stdout:5/656: stat d2/d4/d9/d2f/d30/f5f 0 2024-09-18T12:49:22.105 INFO:tasks.workunit.client.0.smithi078.stdout:5/657: chown d2/d4/d9/d2f/d30/f5f 11 1 2024-09-18T12:49:22.108 INFO:tasks.workunit.client.1.smithi148.stdout:8/834: symlink d8/df/d3e/d82/de9/l11c 0 2024-09-18T12:49:22.112 INFO:tasks.workunit.client.1.smithi148.stdout:0/903: rename de/d27/d2e/l46 to de/d27/d53/d89/d9d/da4/l131 0 2024-09-18T12:49:22.112 INFO:tasks.workunit.client.0.smithi078.stdout:5/658: dwrite d2/d4/d9/da/d60/db3/d16/d36/d4c/d62/d4d/fc3 [0,4194304] 0 2024-09-18T12:49:22.114 INFO:tasks.workunit.client.1.smithi148.stdout:7/744: write db/dc/df/f29 [1200532,58529] 0 2024-09-18T12:49:22.114 INFO:tasks.workunit.client.1.smithi148.stdout:8/835: dwrite d8/df/d3e/d88/fb1 [0,4194304] 0 2024-09-18T12:49:22.115 INFO:tasks.workunit.client.0.smithi078.stdout:9/508: creat d5/d7/d32/d2a/fa3 x:0 0 0 2024-09-18T12:49:22.118 INFO:tasks.workunit.client.0.smithi078.stdout:5/659: creat d2/d74/fcd x:0 0 0 2024-09-18T12:49:22.122 INFO:tasks.workunit.client.1.smithi148.stdout:8/836: dwrite d8/d16/d53/da0/ff5 [0,4194304] 0 2024-09-18T12:49:22.123 INFO:tasks.workunit.client.1.smithi148.stdout:0/904: rename de/d27/d53/d89/fc2 to de/d14/d10c/f132 0 2024-09-18T12:49:22.125 INFO:tasks.workunit.client.0.smithi078.stdout:5/660: mkdir d2/d4/d9/da/d60/d7f/dce 0 2024-09-18T12:49:22.131 INFO:tasks.workunit.client.1.smithi148.stdout:4/751: write d15/d5f/f78 [513949,92119] 0 2024-09-18T12:49:22.134 INFO:tasks.workunit.client.0.smithi078.stdout:5/661: fdatasync d2/d4/d9/da/d60/db3/f1b 0 2024-09-18T12:49:22.134 INFO:tasks.workunit.client.0.smithi078.stdout:5/662: readlink d2/d4/d48/l5e 0 2024-09-18T12:49:22.137 INFO:tasks.workunit.client.1.smithi148.stdout:8/837: mkdir d8/d16/d53/d39/def/d11d 0 2024-09-18T12:49:22.143 INFO:tasks.workunit.client.1.smithi148.stdout:0/905: dwrite de/f77 [0,4194304] 0 2024-09-18T12:49:22.191 INFO:tasks.workunit.client.0.smithi078.stdout:6/624: sync 2024-09-18T12:49:22.191 INFO:tasks.workunit.client.0.smithi078.stdout:4/497: sync 2024-09-18T12:49:22.196 INFO:tasks.workunit.client.0.smithi078.stdout:4/498: read d11/d27/d60/f68 [448967,68330] 0 2024-09-18T12:49:22.197 INFO:tasks.workunit.client.0.smithi078.stdout:4/499: write d11/d27/d5a/d84/d4b/f82 [1184715,85538] 0 2024-09-18T12:49:22.207 INFO:tasks.workunit.client.1.smithi148.stdout:1/745: sync 2024-09-18T12:49:22.207 INFO:tasks.workunit.client.1.smithi148.stdout:5/761: sync 2024-09-18T12:49:22.207 INFO:tasks.workunit.client.1.smithi148.stdout:2/656: sync 2024-09-18T12:49:22.212 INFO:tasks.workunit.client.1.smithi148.stdout:5/762: dwrite d7/d8/fd9 [0,4194304] 0 2024-09-18T12:49:22.213 INFO:tasks.workunit.client.1.smithi148.stdout:5/763: fdatasync d7/d8/dc/da6/dee/d39/fc8 0 2024-09-18T12:49:22.234 INFO:tasks.workunit.client.0.smithi078.stdout:5/663: symlink d2/d4/d9/dc0/lcf 0 2024-09-18T12:49:22.235 INFO:tasks.workunit.client.1.smithi148.stdout:7/745: creat db/dc/df/d5f/dcb/dd5/fdb x:0 0 0 2024-09-18T12:49:22.237 INFO:tasks.workunit.client.1.smithi148.stdout:6/758: sync 2024-09-18T12:49:22.237 INFO:tasks.workunit.client.1.smithi148.stdout:6/759: readlink d5/d1a/dc/d2b/d9b/lce 0 2024-09-18T12:49:22.239 INFO:tasks.workunit.client.1.smithi148.stdout:0/906: mkdir de/d27/d53/d89/dbb/d133 0 2024-09-18T12:49:22.240 INFO:tasks.workunit.client.0.smithi078.stdout:4/500: symlink d11/d27/d60/la1 0 2024-09-18T12:49:22.241 INFO:tasks.workunit.client.0.smithi078.stdout:4/501: stat d11/d27/d5a/d84/l71 0 2024-09-18T12:49:22.241 INFO:tasks.workunit.client.1.smithi148.stdout:2/657: stat d9/c65 0 2024-09-18T12:49:22.242 INFO:tasks.workunit.client.1.smithi148.stdout:0/907: write de/d14/d43/d57/ff6 [187860,14797] 0 2024-09-18T12:49:22.244 INFO:tasks.workunit.client.0.smithi078.stdout:6/625: mkdir d10/d2b/d43/d53/dcb 0 2024-09-18T12:49:22.246 INFO:tasks.workunit.client.0.smithi078.stdout:4/502: dread d11/d27/f2f [0,4194304] 0 2024-09-18T12:49:22.246 INFO:tasks.workunit.client.1.smithi148.stdout:0/908: write de/d27/d7a/f113 [46274,66053] 0 2024-09-18T12:49:22.247 INFO:tasks.workunit.client.0.smithi078.stdout:4/503: write d11/d27/d47/d4e/d76/f7e [90149,46886] 0 2024-09-18T12:49:22.248 INFO:tasks.workunit.client.1.smithi148.stdout:9/741: dwrite d8/da/f13 [0,4194304] 0 2024-09-18T12:49:22.248 INFO:tasks.workunit.client.1.smithi148.stdout:5/764: rename d7/d8/dc/d12/d31/d6c to d7/d8/d18/d3f/d7c/d7d/d101 0 2024-09-18T12:49:22.249 INFO:tasks.workunit.client.1.smithi148.stdout:3/696: dwrite d4/d8/d1e/d6b/d31/d46/f72 [0,4194304] 0 2024-09-18T12:49:22.251 INFO:tasks.workunit.client.1.smithi148.stdout:0/909: read - de/d27/d53/d89/dbb/db5/fb7 zero size 2024-09-18T12:49:22.253 INFO:tasks.workunit.client.1.smithi148.stdout:0/910: read de/d27/f49 [216592,55496] 0 2024-09-18T12:49:22.254 INFO:tasks.workunit.client.0.smithi078.stdout:6/626: creat d10/d2b/d43/d53/d45/d9c/fcc x:0 0 0 2024-09-18T12:49:22.257 INFO:tasks.workunit.client.0.smithi078.stdout:6/627: write d10/d2b/d43/d53/d63/d6b/f93 [2157496,11430] 0 2024-09-18T12:49:22.259 INFO:tasks.workunit.client.1.smithi148.stdout:9/742: dwrite d8/da/dd/d4a/f98 [0,4194304] 0 2024-09-18T12:49:22.260 INFO:tasks.workunit.client.1.smithi148.stdout:3/697: dwrite d4/d8/d1e/fe2 [0,4194304] 0 2024-09-18T12:49:22.261 INFO:tasks.workunit.client.0.smithi078.stdout:9/509: dwrite d5/d7/d8/d4f/f82 [0,4194304] 0 2024-09-18T12:49:22.264 INFO:tasks.workunit.client.0.smithi078.stdout:4/504: rename d11/d27/d5a/d84/d40/f6c to d11/d27/d89/d9f/fa2 0 2024-09-18T12:49:22.277 INFO:tasks.workunit.client.1.smithi148.stdout:2/658: dread d9/d17/f96 [0,4194304] 0 2024-09-18T12:49:22.278 INFO:tasks.workunit.client.1.smithi148.stdout:0/911: mknod de/d27/db3/c134 0 2024-09-18T12:49:22.281 INFO:tasks.workunit.client.1.smithi148.stdout:0/912: fdatasync de/d14/d43/fc7 0 2024-09-18T12:49:22.281 INFO:tasks.workunit.client.1.smithi148.stdout:1/746: link dc/d18/d31/d4b/c50 dc/d18/d43/cf3 0 2024-09-18T12:49:22.282 INFO:tasks.workunit.client.1.smithi148.stdout:4/752: dwrite d15/d17/d52/d92/d4c/f57 [0,4194304] 0 2024-09-18T12:49:22.283 INFO:tasks.workunit.client.1.smithi148.stdout:9/743: stat d8/da/dd/d4a/d27/cd7 0 2024-09-18T12:49:22.284 INFO:tasks.workunit.client.1.smithi148.stdout:1/747: write dc/d18/d31/d39/fc8 [990918,19503] 0 2024-09-18T12:49:22.285 INFO:tasks.workunit.client.1.smithi148.stdout:0/913: read de/d27/d53/d89/dca/ffb [2870778,61713] 0 2024-09-18T12:49:22.287 INFO:tasks.workunit.client.1.smithi148.stdout:5/765: mkdir d7/d8/dc/da6/dee/d25/d4b/d102 0 2024-09-18T12:49:22.288 INFO:tasks.workunit.client.1.smithi148.stdout:9/744: read - d8/da/dd/d65/db9/fde zero size 2024-09-18T12:49:22.289 INFO:tasks.workunit.client.1.smithi148.stdout:7/746: rename db/dc/df/d8e to db/dc/df/d11/ddc 0 2024-09-18T12:49:22.290 INFO:tasks.workunit.client.1.smithi148.stdout:4/753: chown d15/d17/d52/d92/d4c/d4f/c3b 15 1 2024-09-18T12:49:22.291 INFO:tasks.workunit.client.1.smithi148.stdout:5/766: chown d7/d8/dc/d12/d20/df3/l46 9 1 2024-09-18T12:49:22.292 INFO:tasks.workunit.client.1.smithi148.stdout:0/914: truncate de/d14/d6b/fb8 1295836 0 2024-09-18T12:49:22.292 INFO:tasks.workunit.client.1.smithi148.stdout:6/760: link d5/d1a/dc/d2b/d35/d65/d99/ce4 d5/d1a/dc/d2b/d35/d65/d99/da4/da6/cf4 0 2024-09-18T12:49:22.292 INFO:tasks.workunit.client.1.smithi148.stdout:2/659: creat d9/fec x:0 0 0 2024-09-18T12:49:22.293 INFO:tasks.workunit.client.1.smithi148.stdout:4/754: chown d15/lf3 1507060380 1 2024-09-18T12:49:22.293 INFO:tasks.workunit.client.1.smithi148.stdout:2/660: readlink d9/d17/l2e 0 2024-09-18T12:49:22.295 INFO:tasks.workunit.client.0.smithi078.stdout:5/664: write d2/d4/d9/da/d60/db3/d16/d36/f5c [2681534,68617] 0 2024-09-18T12:49:22.296 INFO:tasks.workunit.client.0.smithi078.stdout:5/665: stat d2/d4/d9/da/c46 0 2024-09-18T12:49:22.299 INFO:tasks.workunit.client.1.smithi148.stdout:9/745: getdents d8/da/dd/d35/d5e 0 2024-09-18T12:49:22.300 INFO:tasks.workunit.client.1.smithi148.stdout:1/748: dwrite dc/d18/d31/faf [0,4194304] 0 2024-09-18T12:49:22.303 INFO:tasks.workunit.client.0.smithi078.stdout:5/666: getdents d2/d4/d48/d86/dca 0 2024-09-18T12:49:22.305 INFO:tasks.workunit.client.0.smithi078.stdout:5/667: write d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/fc4 [136912,56564] 0 2024-09-18T12:49:22.306 INFO:tasks.workunit.client.0.smithi078.stdout:9/510: dread d5/d40/f63 [0,4194304] 0 2024-09-18T12:49:22.306 INFO:tasks.workunit.client.1.smithi148.stdout:3/698: dread d4/f29 [4194304,4194304] 0 2024-09-18T12:49:22.307 INFO:tasks.workunit.client.1.smithi148.stdout:5/767: rename d7/d8/dc/d12/f24 to d7/d8/d18/f103 0 2024-09-18T12:49:22.314 INFO:tasks.workunit.client.1.smithi148.stdout:1/749: mknod dc/cf4 0 2024-09-18T12:49:22.314 INFO:tasks.workunit.client.1.smithi148.stdout:4/755: link d15/d17/f1c d15/d5f/d69/d7f/ffa 0 2024-09-18T12:49:22.314 INFO:tasks.workunit.client.1.smithi148.stdout:5/768: dwrite d7/d8/fd9 [0,4194304] 0 2024-09-18T12:49:22.315 INFO:tasks.workunit.client.0.smithi078.stdout:5/668: dwrite d2/d4/d9/da/d60/d7f/fba [4194304,4194304] 0 2024-09-18T12:49:22.315 INFO:tasks.workunit.client.1.smithi148.stdout:0/915: rename de/d14/le1 to de/d14/d43/d57/d59/l135 0 2024-09-18T12:49:22.315 INFO:tasks.workunit.client.0.smithi078.stdout:5/669: stat d2/d4/d9/d49/f6c 0 2024-09-18T12:49:22.318 INFO:tasks.workunit.client.0.smithi078.stdout:5/670: creat d2/d4/d9/dc0/fd0 x:0 0 0 2024-09-18T12:49:22.319 INFO:tasks.workunit.client.1.smithi148.stdout:4/756: mknod d15/d17/d52/d92/d4c/d4f/d64/d9a/cfb 0 2024-09-18T12:49:22.320 INFO:tasks.workunit.client.0.smithi078.stdout:5/671: chown d2/d4/d9/da/d60/db3/d16/d36/db0 457 1 2024-09-18T12:49:22.321 INFO:tasks.workunit.client.1.smithi148.stdout:8/838: sync 2024-09-18T12:49:22.321 INFO:tasks.workunit.client.1.smithi148.stdout:1/750: rename dc/d18/d7d/d93/dd9/d2b/d80 to dc/d9f/df5 0 2024-09-18T12:49:22.323 INFO:tasks.workunit.client.1.smithi148.stdout:1/751: write dc/d18/d7d/d7e/fb9 [5025182,41162] 0 2024-09-18T12:49:22.324 INFO:tasks.workunit.client.0.smithi078.stdout:5/672: mkdir d2/d4/d9/da/d60/db3/d16/d36/d4c/dd1 0 2024-09-18T12:49:22.325 INFO:tasks.workunit.client.1.smithi148.stdout:4/757: mknod d15/d17/cfc 0 2024-09-18T12:49:22.327 INFO:tasks.workunit.client.0.smithi078.stdout:4/505: dread d11/f55 [0,4194304] 0 2024-09-18T12:49:22.328 INFO:tasks.workunit.client.0.smithi078.stdout:4/506: readlink d11/d27/d5a/d84/l71 0 2024-09-18T12:49:22.330 INFO:tasks.workunit.client.1.smithi148.stdout:4/758: symlink d15/d17/d52/d92/d4c/d4f/d64/da0/da1/lfd 0 2024-09-18T12:49:22.332 INFO:tasks.workunit.client.1.smithi148.stdout:1/752: link dc/d18/f1f dc/d11/d38/d72/ff6 0 2024-09-18T12:49:22.333 INFO:tasks.workunit.client.0.smithi078.stdout:4/507: fdatasync d11/d27/d47/f3d 0 2024-09-18T12:49:22.334 INFO:tasks.workunit.client.1.smithi148.stdout:4/759: creat d15/d17/d52/d92/d4c/d4f/d64/da0/da1/ffe x:0 0 0 2024-09-18T12:49:22.335 INFO:tasks.workunit.client.0.smithi078.stdout:5/673: rmdir d2/d4/d9/da/d60/db3/d16/d36/d4c/d62/d4d/db4 0 2024-09-18T12:49:22.337 INFO:tasks.workunit.client.1.smithi148.stdout:1/753: creat dc/d18/d31/d39/ff7 x:0 0 0 2024-09-18T12:49:22.337 INFO:tasks.workunit.client.1.smithi148.stdout:1/754: chown dc/d18/d7d/d7e/lc9 26938139 1 2024-09-18T12:49:22.338 INFO:tasks.workunit.client.0.smithi078.stdout:4/508: mknod d11/d27/d47/d4e/d50/ca3 0 2024-09-18T12:49:22.338 INFO:tasks.workunit.client.0.smithi078.stdout:8/437: sync 2024-09-18T12:49:22.338 INFO:tasks.workunit.client.0.smithi078.stdout:3/477: sync 2024-09-18T12:49:22.339 INFO:tasks.workunit.client.0.smithi078.stdout:4/509: fsync d11/d27/d5a/d84/d40/f6f 0 2024-09-18T12:49:22.340 INFO:tasks.workunit.client.1.smithi148.stdout:1/755: mkdir dc/d11/d38/d72/df8 0 2024-09-18T12:49:22.342 INFO:tasks.workunit.client.1.smithi148.stdout:5/769: dread d7/d2b/f36 [0,4194304] 0 2024-09-18T12:49:22.343 INFO:tasks.workunit.client.0.smithi078.stdout:8/438: creat d0/d39/d4c/d77/f85 x:0 0 0 2024-09-18T12:49:22.343 INFO:tasks.workunit.client.1.smithi148.stdout:5/770: read - d7/d8/dc/da6/dee/d69/d8b/dad/fe2 zero size 2024-09-18T12:49:22.344 INFO:tasks.workunit.client.1.smithi148.stdout:1/756: creat dc/d11/d38/d72/df8/ff9 x:0 0 0 2024-09-18T12:49:22.346 INFO:tasks.workunit.client.1.smithi148.stdout:1/757: creat dc/d4d/ffa x:0 0 0 2024-09-18T12:49:22.348 INFO:tasks.workunit.client.0.smithi078.stdout:5/674: rmdir d2/d4/d9/da/d60/db3/d2d/d7b 0 2024-09-18T12:49:22.348 INFO:tasks.workunit.client.0.smithi078.stdout:5/675: write d2/d4/fb9 [901932,91520] 0 2024-09-18T12:49:22.349 INFO:tasks.workunit.client.1.smithi148.stdout:5/771: mkdir d7/d8/dc/da6/dee/d25/d4b/dd6/d104 0 2024-09-18T12:49:22.350 INFO:tasks.workunit.client.1.smithi148.stdout:0/916: dread de/d14/d43/d57/fb1 [0,4194304] 0 2024-09-18T12:49:22.353 INFO:tasks.workunit.client.1.smithi148.stdout:1/758: dwrite dc/d11/f16 [0,4194304] 0 2024-09-18T12:49:22.353 INFO:tasks.workunit.client.0.smithi078.stdout:8/439: rename d0/f1 to d0/d7/dc/d5d/f86 0 2024-09-18T12:49:22.354 INFO:tasks.workunit.client.0.smithi078.stdout:5/676: dwrite d2/d4/d9/d49/f56 [0,4194304] 0 2024-09-18T12:49:22.355 INFO:tasks.workunit.client.0.smithi078.stdout:4/510: getdents d11/d27/d47/d4e/d76 0 2024-09-18T12:49:22.356 INFO:tasks.workunit.client.1.smithi148.stdout:0/917: unlink de/d14/f81 0 2024-09-18T12:49:22.357 INFO:tasks.workunit.client.0.smithi078.stdout:5/677: chown d2/d4/d9/d2f/d30/cac 8879831 1 2024-09-18T12:49:22.357 INFO:tasks.workunit.client.1.smithi148.stdout:5/772: creat d7/d8/dc/d12/d31/d5a/f105 x:0 0 0 2024-09-18T12:49:22.360 INFO:tasks.workunit.client.0.smithi078.stdout:4/511: creat d11/d27/d47/fa4 x:0 0 0 2024-09-18T12:49:22.362 INFO:tasks.workunit.client.1.smithi148.stdout:0/918: rmdir de/da3 39 2024-09-18T12:49:22.364 INFO:tasks.workunit.client.0.smithi078.stdout:8/440: mkdir d0/d7/d53/d57/d67/d87 0 2024-09-18T12:49:22.365 INFO:tasks.workunit.client.0.smithi078.stdout:8/441: readlink d0/d7/dc/d1f/d23/d40/l66 0 2024-09-18T12:49:22.365 INFO:tasks.workunit.client.1.smithi148.stdout:5/773: chown d7/d8/f9 2 1 2024-09-18T12:49:22.366 INFO:tasks.workunit.client.0.smithi078.stdout:4/512: symlink d11/d27/d60/la5 0 2024-09-18T12:49:22.366 INFO:tasks.workunit.client.0.smithi078.stdout:4/513: stat d11/c69 0 2024-09-18T12:49:22.367 INFO:tasks.workunit.client.0.smithi078.stdout:4/514: write d11/f44 [1255512,118793] 0 2024-09-18T12:49:22.369 INFO:tasks.workunit.client.0.smithi078.stdout:6/628: write d10/d2b/d43/d53/d63/d70/d7d/fa5 [299878,126677] 0 2024-09-18T12:49:22.371 INFO:tasks.workunit.client.0.smithi078.stdout:5/678: dread d2/d4/d9/d49/f7d [0,4194304] 0 2024-09-18T12:49:22.372 INFO:tasks.workunit.client.1.smithi148.stdout:0/919: dwrite de/d14/d6b/fb8 [0,4194304] 0 2024-09-18T12:49:22.373 INFO:tasks.workunit.client.1.smithi148.stdout:5/774: rename d7/d8/dc/d12/d31/d5a/f96 to d7/d8/dc/d12/d97/f106 0 2024-09-18T12:49:22.375 INFO:tasks.workunit.client.1.smithi148.stdout:0/920: write de/d27/d53/d89/dc1/f10a [596122,60061] 0 2024-09-18T12:49:22.376 INFO:tasks.workunit.client.0.smithi078.stdout:6/629: mknod d10/d2b/d43/d53/d63/d70/dac/da6/ccd 0 2024-09-18T12:49:22.377 INFO:tasks.workunit.client.0.smithi078.stdout:3/478: dread d9/f12 [0,4194304] 0 2024-09-18T12:49:22.377 INFO:tasks.workunit.client.1.smithi148.stdout:4/760: dread d15/d17/f1c [4194304,4194304] 0 2024-09-18T12:49:22.378 INFO:tasks.workunit.client.0.smithi078.stdout:3/479: readlink d9/d13/d33/l58 0 2024-09-18T12:49:22.379 INFO:tasks.workunit.client.0.smithi078.stdout:3/480: chown d9/d54/d89/l8f 37758272 1 2024-09-18T12:49:22.381 INFO:tasks.workunit.client.1.smithi148.stdout:3/699: sync 2024-09-18T12:49:22.385 INFO:tasks.workunit.client.1.smithi148.stdout:5/775: creat d7/d8/dc/da6/dee/d77/dd4/f107 x:0 0 0 2024-09-18T12:49:22.387 INFO:tasks.workunit.client.0.smithi078.stdout:5/679: rename d2/d4/d9/da/d60/db3/d16/d36/d68/db6 to d2/d4/d9/da/d60/db3/d16/dd2 0 2024-09-18T12:49:22.387 INFO:tasks.workunit.client.1.smithi148.stdout:7/747: write db/dc/df/d2c/d55/daf/d38/f3f [2288388,40079] 0 2024-09-18T12:49:22.388 INFO:tasks.workunit.client.1.smithi148.stdout:0/921: dwrite de/d14/d43/d57/fb1 [4194304,4194304] 0 2024-09-18T12:49:22.388 INFO:tasks.workunit.client.1.smithi148.stdout:4/761: mkdir d15/d17/d52/d92/dc9/dff 0 2024-09-18T12:49:22.389 INFO:tasks.workunit.client.0.smithi078.stdout:2/440: sync 2024-09-18T12:49:22.389 INFO:tasks.workunit.client.0.smithi078.stdout:1/507: sync 2024-09-18T12:49:22.389 INFO:tasks.workunit.client.0.smithi078.stdout:0/591: sync 2024-09-18T12:49:22.389 INFO:tasks.workunit.client.0.smithi078.stdout:7/415: sync 2024-09-18T12:49:22.389 INFO:tasks.workunit.client.1.smithi148.stdout:6/761: write d5/d1a/dc/d2b/d35/d65/d99/da4/da6/fba [1505191,59757] 0 2024-09-18T12:49:22.390 INFO:tasks.workunit.client.1.smithi148.stdout:1/759: dread dc/d18/d7d/d93/dd9/f9c [0,4194304] 0 2024-09-18T12:49:22.390 INFO:tasks.workunit.client.0.smithi078.stdout:6/630: symlink d10/d2b/d43/d53/d45/d55/lce 0 2024-09-18T12:49:22.392 INFO:tasks.workunit.client.0.smithi078.stdout:4/515: dread d11/f1d [0,4194304] 0 2024-09-18T12:49:22.393 INFO:tasks.workunit.client.1.smithi148.stdout:9/746: write d8/da/dd/d4a/f18 [1846151,83445] 0 2024-09-18T12:49:22.393 INFO:tasks.workunit.client.0.smithi078.stdout:5/680: truncate d2/d4/d48/d86/f87 8538 0 2024-09-18T12:49:22.394 INFO:tasks.workunit.client.1.smithi148.stdout:0/922: dread - de/d27/d53/d89/dc0/db0/fee zero size 2024-09-18T12:49:22.395 INFO:tasks.workunit.client.1.smithi148.stdout:7/748: rmdir db/dc/df 39 2024-09-18T12:49:22.397 INFO:tasks.workunit.client.1.smithi148.stdout:4/762: chown d15/d17/d52/d92/d4c/d4f/f61 7654477 1 2024-09-18T12:49:22.399 INFO:tasks.workunit.client.1.smithi148.stdout:2/661: dwrite d9/d24/d31/d34/f35 [0,4194304] 0 2024-09-18T12:49:22.401 INFO:tasks.workunit.client.0.smithi078.stdout:7/416: symlink d7/d9/d14/d22/d35/d49/d61/l8e 0 2024-09-18T12:49:22.402 INFO:tasks.workunit.client.0.smithi078.stdout:9/511: dwrite d5/f15 [0,4194304] 0 2024-09-18T12:49:22.404 INFO:tasks.workunit.client.0.smithi078.stdout:3/481: creat d9/d2f/f93 x:0 0 0 2024-09-18T12:49:22.408 INFO:tasks.workunit.client.0.smithi078.stdout:6/631: truncate d10/d2b/d43/d53/f4d 669868 0 2024-09-18T12:49:22.410 INFO:tasks.workunit.client.0.smithi078.stdout:2/441: symlink d4/db/l92 0 2024-09-18T12:49:22.411 INFO:tasks.workunit.client.1.smithi148.stdout:8/839: truncate d8/df/f10 4541934 0 2024-09-18T12:49:22.413 INFO:tasks.workunit.client.0.smithi078.stdout:4/516: creat d11/d27/d47/fa6 x:0 0 0 2024-09-18T12:49:22.414 INFO:tasks.workunit.client.0.smithi078.stdout:2/442: read d4/f9 [2453685,86892] 0 2024-09-18T12:49:22.415 INFO:tasks.workunit.client.1.smithi148.stdout:9/747: symlink d8/le1 0 2024-09-18T12:49:22.415 INFO:tasks.workunit.client.0.smithi078.stdout:4/517: truncate d11/d27/d5a/d5d/f8e 191479 0 2024-09-18T12:49:22.416 INFO:tasks.workunit.client.1.smithi148.stdout:9/748: fsync d8/da/dd/d4a/d49/d46/d54/dab/fd0 0 2024-09-18T12:49:22.417 INFO:tasks.workunit.client.0.smithi078.stdout:7/417: rmdir d7/d9/d32/d3b 39 2024-09-18T12:49:22.417 INFO:tasks.workunit.client.1.smithi148.stdout:9/749: chown d8/da/dd/d35/d47/f94 148 1 2024-09-18T12:49:22.418 INFO:tasks.workunit.client.1.smithi148.stdout:9/750: dread - d8/da/dd/d65/db9/fbe zero size 2024-09-18T12:49:22.421 INFO:tasks.workunit.client.1.smithi148.stdout:4/763: mknod d15/d17/d52/d92/d4c/d4f/d64/da0/da1/c100 0 2024-09-18T12:49:22.422 INFO:tasks.workunit.client.0.smithi078.stdout:7/418: dread - d7/d9/d14/d22/d35/f85 zero size 2024-09-18T12:49:22.423 INFO:tasks.workunit.client.0.smithi078.stdout:3/482: symlink d9/d2f/d43/l94 0 2024-09-18T12:49:22.424 INFO:tasks.workunit.client.0.smithi078.stdout:2/443: dwrite d4/db/f2a [0,4194304] 0 2024-09-18T12:49:22.425 INFO:tasks.workunit.client.1.smithi148.stdout:2/662: creat d9/d24/d67/fed x:0 0 0 2024-09-18T12:49:22.425 INFO:tasks.workunit.client.1.smithi148.stdout:2/663: chown d9/d24/d67/d72/d8f/fbf 11357 1 2024-09-18T12:49:22.428 INFO:tasks.workunit.client.0.smithi078.stdout:4/518: dwrite d11/d27/d47/d4e/d76/f7e [0,4194304] 0 2024-09-18T12:49:22.428 INFO:tasks.workunit.client.0.smithi078.stdout:5/681: mkdir d2/d4/d9/da/d60/db3/d2d/dd3 0 2024-09-18T12:49:22.430 INFO:tasks.workunit.client.0.smithi078.stdout:2/444: write d4/d8/d23/d52/d7c/f82 [817078,29663] 0 2024-09-18T12:49:22.431 INFO:tasks.workunit.client.0.smithi078.stdout:1/508: dread d0/f89 [0,4194304] 0 2024-09-18T12:49:22.432 INFO:tasks.workunit.client.0.smithi078.stdout:0/592: dread d3/d1f/d2e/d8f/d90/f9b [0,4194304] 0 2024-09-18T12:49:22.434 INFO:tasks.workunit.client.0.smithi078.stdout:1/509: write d0/d8/da/d45/f8e [40786,40725] 0 2024-09-18T12:49:22.434 INFO:tasks.workunit.client.1.smithi148.stdout:6/762: creat d5/d1a/ff5 x:0 0 0 2024-09-18T12:49:22.437 INFO:tasks.workunit.client.1.smithi148.stdout:8/840: mkdir d8/d16/d27/dc5/dee/dfe/df3/d11e 0 2024-09-18T12:49:22.438 INFO:tasks.workunit.client.0.smithi078.stdout:6/632: creat d10/d2b/dbd/fcf x:0 0 0 2024-09-18T12:49:22.440 INFO:tasks.workunit.client.0.smithi078.stdout:8/442: getdents d0 0 2024-09-18T12:49:22.442 INFO:tasks.workunit.client.0.smithi078.stdout:7/419: creat d7/d3f/f8f x:0 0 0 2024-09-18T12:49:22.446 INFO:tasks.workunit.client.0.smithi078.stdout:4/519: mkdir d11/d27/d5a/d84/d4b/da7 0 2024-09-18T12:49:22.447 INFO:tasks.workunit.client.1.smithi148.stdout:2/664: rmdir d9/d24/d67/d72/d8f 39 2024-09-18T12:49:22.448 INFO:tasks.workunit.client.1.smithi148.stdout:2/665: write d9/d3a/d90/f9e [422767,21570] 0 2024-09-18T12:49:22.449 INFO:tasks.workunit.client.1.smithi148.stdout:5/776: link d7/d8/dc/d12/fd1 d7/d8/dc/da6/dee/d39/dc2/dd2/f108 0 2024-09-18T12:49:22.451 INFO:tasks.workunit.client.1.smithi148.stdout:5/777: truncate d7/d8/dc/d12/d20/f53 5051313 0 2024-09-18T12:49:22.451 INFO:tasks.workunit.client.1.smithi148.stdout:7/749: mknod db/dc/df/d11/dcc/cdd 0 2024-09-18T12:49:22.452 INFO:tasks.workunit.client.1.smithi148.stdout:7/750: readlink db/dc/df/d11/db3/ld6 0 2024-09-18T12:49:22.452 INFO:tasks.workunit.client.0.smithi078.stdout:0/593: chown d3/d1f/d2e/d68/d30/ca8 51539454 1 2024-09-18T12:49:22.452 INFO:tasks.workunit.client.1.smithi148.stdout:5/778: chown d7/d8/d18/d3f/d7c/d7d/d101/lb6 24 1 2024-09-18T12:49:22.453 INFO:tasks.workunit.client.0.smithi078.stdout:0/594: dread - d3/d1f/d2e/d68/d30/d7c/da3/fc8 zero size 2024-09-18T12:49:22.453 INFO:tasks.workunit.client.1.smithi148.stdout:6/763: unlink d5/d32/d38/d50/de7/f8e 0 2024-09-18T12:49:22.454 INFO:tasks.workunit.client.1.smithi148.stdout:6/764: stat d5/d32/d56 0 2024-09-18T12:49:22.456 INFO:tasks.workunit.client.0.smithi078.stdout:1/510: creat d0/d8/da/d3e/d58/d6e/fa2 x:0 0 0 2024-09-18T12:49:22.457 INFO:tasks.workunit.client.1.smithi148.stdout:8/841: mkdir d8/d16/d27/dc5/dee/d11f 0 2024-09-18T12:49:22.459 INFO:tasks.workunit.client.0.smithi078.stdout:5/682: dread d2/d4/d9/da/f20 [0,4194304] 0 2024-09-18T12:49:22.460 INFO:tasks.workunit.client.1.smithi148.stdout:1/760: rename dc/d18/d7d/d93/dd9/f35 to dc/d18/d31/ffb 0 2024-09-18T12:49:22.460 INFO:tasks.workunit.client.0.smithi078.stdout:1/511: dread d0/d8/da/d3e/d58/d6e/d52/d47/f69 [0,4194304] 0 2024-09-18T12:49:22.461 INFO:tasks.workunit.client.0.smithi078.stdout:6/633: fsync d10/d2b/d43/d53/d63/d70/d77/f91 0 2024-09-18T12:49:22.462 INFO:tasks.workunit.client.1.smithi148.stdout:0/923: link de/d14/d6b/l126 de/d14/d10c/l136 0 2024-09-18T12:49:22.463 INFO:tasks.workunit.client.0.smithi078.stdout:6/634: chown d10/d2b/d43/d53/d63/d70/d7d/c95 8066666 1 2024-09-18T12:49:22.464 INFO:tasks.workunit.client.0.smithi078.stdout:6/635: write d10/d2b/d43/d53/d63/d70/dac/f5f [5196153,26673] 0 2024-09-18T12:49:22.466 INFO:tasks.workunit.client.1.smithi148.stdout:2/666: creat d9/d24/d31/d34/d42/fee x:0 0 0 2024-09-18T12:49:22.467 INFO:tasks.workunit.client.0.smithi078.stdout:3/483: symlink d9/d2f/l95 0 2024-09-18T12:49:22.467 INFO:tasks.workunit.client.0.smithi078.stdout:6/636: truncate d10/d2b/d43/d53/d63/d70/dac/fad 167755 0 2024-09-18T12:49:22.468 INFO:tasks.workunit.client.0.smithi078.stdout:3/484: write d9/d13/d33/d3c/d19/f22 [2305884,117519] 0 2024-09-18T12:49:22.470 INFO:tasks.workunit.client.0.smithi078.stdout:3/485: read d9/d13/f39 [2308896,59805] 0 2024-09-18T12:49:22.470 INFO:tasks.workunit.client.0.smithi078.stdout:4/520: rmdir d11/d27 39 2024-09-18T12:49:22.473 INFO:tasks.workunit.client.1.smithi148.stdout:6/765: mknod d5/d1a/dc/d2b/d35/cf6 0 2024-09-18T12:49:22.477 INFO:tasks.workunit.client.1.smithi148.stdout:8/842: truncate d8/d16/d53/d39/d3b/d4e/fa2 259171 0 2024-09-18T12:49:22.477 INFO:tasks.workunit.client.0.smithi078.stdout:9/512: getdents d5/d40 0 2024-09-18T12:49:22.479 INFO:tasks.workunit.client.1.smithi148.stdout:7/751: rename db/dc/fb1 to db/dc/df/d2c/d66/da0/fde 0 2024-09-18T12:49:22.480 INFO:tasks.workunit.client.1.smithi148.stdout:1/761: mkdir dc/d51/dfc 0 2024-09-18T12:49:22.482 INFO:tasks.workunit.client.1.smithi148.stdout:0/924: mknod de/d27/d53/d89/dbb/c137 0 2024-09-18T12:49:22.483 INFO:tasks.workunit.client.1.smithi148.stdout:0/925: dread - de/d27/d2e/d114/f103 zero size 2024-09-18T12:49:22.484 INFO:tasks.workunit.client.1.smithi148.stdout:9/751: link d8/f10 d8/da/dd/d77/fe2 0 2024-09-18T12:49:22.485 INFO:tasks.workunit.client.1.smithi148.stdout:7/752: dwrite db/dc/df/d2c/d55/f6e [0,4194304] 0 2024-09-18T12:49:22.485 INFO:tasks.workunit.client.1.smithi148.stdout:0/926: write de/d27/d53/d89/f10f [895136,50361] 0 2024-09-18T12:49:22.486 INFO:tasks.workunit.client.1.smithi148.stdout:9/752: stat d8/da/dd/d4a/d27/cb1 0 2024-09-18T12:49:22.487 INFO:tasks.workunit.client.1.smithi148.stdout:7/753: dread - db/dc/df/d11/ddc/f83 zero size 2024-09-18T12:49:22.487 INFO:tasks.workunit.client.0.smithi078.stdout:8/443: mkdir d0/d7/d53/d57/d5c/d88 0 2024-09-18T12:49:22.488 INFO:tasks.workunit.client.0.smithi078.stdout:8/444: fdatasync d0/d39/d4c/d77/f85 0 2024-09-18T12:49:22.489 INFO:tasks.workunit.client.1.smithi148.stdout:5/779: creat d7/d8/dc/d12/d20/d100/f109 x:0 0 0 2024-09-18T12:49:22.492 INFO:tasks.workunit.client.1.smithi148.stdout:5/780: truncate d7/d8/dc/da6/dee/d77/dd4/f107 713262 0 2024-09-18T12:49:22.493 INFO:tasks.workunit.client.1.smithi148.stdout:3/700: sync 2024-09-18T12:49:22.493 INFO:tasks.workunit.client.1.smithi148.stdout:3/701: chown d4/d8/d6a/db3/db7 245 1 2024-09-18T12:49:22.493 INFO:tasks.workunit.client.1.smithi148.stdout:8/843: fdatasync d8/d16/d27/f4a 0 2024-09-18T12:49:22.494 INFO:tasks.workunit.client.0.smithi078.stdout:8/445: dwrite d0/d7/d1e/f54 [0,4194304] 0 2024-09-18T12:49:22.501 INFO:tasks.workunit.client.0.smithi078.stdout:6/637: creat d10/d2b/d43/d53/d63/d70/d7d/fd0 x:0 0 0 2024-09-18T12:49:22.502 INFO:tasks.workunit.client.0.smithi078.stdout:3/486: rmdir d9/d29 39 2024-09-18T12:49:22.503 INFO:tasks.workunit.client.0.smithi078.stdout:0/595: write d3/d1f/f67 [2805752,39654] 0 2024-09-18T12:49:22.507 INFO:tasks.workunit.client.1.smithi148.stdout:9/753: creat d8/da/dd/d4a/d27/fe3 x:0 0 0 2024-09-18T12:49:22.508 INFO:tasks.workunit.client.1.smithi148.stdout:7/754: creat db/dc/df/d1d/d68/d82/fdf x:0 0 0 2024-09-18T12:49:22.510 INFO:tasks.workunit.client.1.smithi148.stdout:4/764: sync 2024-09-18T12:49:22.511 INFO:tasks.workunit.client.1.smithi148.stdout:2/667: write d9/f39 [1117840,68318] 0 2024-09-18T12:49:22.512 INFO:tasks.workunit.client.1.smithi148.stdout:4/765: read d15/d17/d52/d92/f32 [3519588,15487] 0 2024-09-18T12:49:22.513 INFO:tasks.workunit.client.0.smithi078.stdout:9/513: creat d5/d7/d32/fa4 x:0 0 0 2024-09-18T12:49:22.513 INFO:tasks.workunit.client.0.smithi078.stdout:5/683: dwrite d2/d4/d48/f71 [0,4194304] 0 2024-09-18T12:49:22.514 INFO:tasks.workunit.client.0.smithi078.stdout:5/684: dread - d2/d4/d9/d49/f6c zero size 2024-09-18T12:49:22.516 INFO:tasks.workunit.client.0.smithi078.stdout:1/512: fsync d0/d5b/f63 0 2024-09-18T12:49:22.516 INFO:tasks.workunit.client.0.smithi078.stdout:1/513: stat d0/f6c 0 2024-09-18T12:49:22.519 INFO:tasks.workunit.client.1.smithi148.stdout:6/766: dwrite d5/d32/d38/d50/de7/f91 [0,4194304] 0 2024-09-18T12:49:22.519 INFO:tasks.workunit.client.0.smithi078.stdout:7/420: creat d7/f90 x:0 0 0 2024-09-18T12:49:22.523 INFO:tasks.workunit.client.1.smithi148.stdout:1/762: mknod dc/cfd 0 2024-09-18T12:49:22.526 INFO:tasks.workunit.client.1.smithi148.stdout:0/927: mknod de/d14/d43/d57/c138 0 2024-09-18T12:49:22.531 INFO:tasks.workunit.client.0.smithi078.stdout:0/596: dread - d3/f6d zero size 2024-09-18T12:49:22.531 INFO:tasks.workunit.client.1.smithi148.stdout:9/754: symlink d8/da/dd/d4a/d49/d46/d75/d97/le4 0 2024-09-18T12:49:22.531 INFO:tasks.workunit.client.1.smithi148.stdout:9/755: chown d8/cac 53502 1 2024-09-18T12:49:22.531 INFO:tasks.workunit.client.1.smithi148.stdout:7/755: symlink db/dc/df/d11/d34/le0 0 2024-09-18T12:49:22.534 INFO:tasks.workunit.client.0.smithi078.stdout:4/521: symlink d11/d27/d5a/d84/d40/la8 0 2024-09-18T12:49:22.535 INFO:tasks.workunit.client.0.smithi078.stdout:2/445: link d4/d20/l7d d4/dd/l93 0 2024-09-18T12:49:22.536 INFO:tasks.workunit.client.0.smithi078.stdout:3/487: dwrite d9/d13/d33/d34/f48 [4194304,4194304] 0 2024-09-18T12:49:22.537 INFO:tasks.workunit.client.0.smithi078.stdout:6/638: write d10/d2b/d43/d53/d45/d55/f52 [186151,30044] 0 2024-09-18T12:49:22.537 INFO:tasks.workunit.client.0.smithi078.stdout:2/446: write d4/d8/d23/d52/d7c/f82 [1114937,77297] 0 2024-09-18T12:49:22.538 INFO:tasks.workunit.client.1.smithi148.stdout:9/756: dwrite d8/da/dd/d35/d5e/fa7 [4194304,4194304] 0 2024-09-18T12:49:22.538 INFO:tasks.workunit.client.0.smithi078.stdout:9/514: symlink d5/d7/d32/d81/la5 0 2024-09-18T12:49:22.541 INFO:tasks.workunit.client.0.smithi078.stdout:5/685: unlink d2/d4/d9/d49/f6c 0 2024-09-18T12:49:22.543 INFO:tasks.workunit.client.1.smithi148.stdout:8/844: symlink d8/d16/d27/dc5/dee/dfe/df8/l120 0 2024-09-18T12:49:22.547 INFO:tasks.workunit.client.1.smithi148.stdout:4/766: dwrite d15/d5f/f71 [0,4194304] 0 2024-09-18T12:49:22.548 INFO:tasks.workunit.client.1.smithi148.stdout:6/767: chown d5/d1a/dc/c6c 1 1 2024-09-18T12:49:22.549 INFO:tasks.workunit.client.1.smithi148.stdout:4/767: readlink d15/d17/d52/d92/d4c/d4f/d64/l87 0 2024-09-18T12:49:22.549 INFO:tasks.workunit.client.1.smithi148.stdout:0/928: unlink de/d27/d7a/fd4 0 2024-09-18T12:49:22.550 INFO:tasks.workunit.client.0.smithi078.stdout:6/639: dwrite d10/d2b/d43/d53/d45/d55/f52 [0,4194304] 0 2024-09-18T12:49:22.552 INFO:tasks.workunit.client.0.smithi078.stdout:6/640: dread - d10/d2b/d43/d53/d63/d70/d7d/fd0 zero size 2024-09-18T12:49:22.556 INFO:tasks.workunit.client.0.smithi078.stdout:6/641: write d10/d2b/d43/d53/d45/f85 [6027454,106737] 0 2024-09-18T12:49:22.556 INFO:tasks.workunit.client.1.smithi148.stdout:7/756: unlink db/dc/df/d2c/d66/da0/fc1 0 2024-09-18T12:49:22.560 INFO:tasks.workunit.client.0.smithi078.stdout:3/488: rename d9/d2f/l95 to d9/d13/d63/d78/l96 0 2024-09-18T12:49:22.561 INFO:tasks.workunit.client.1.smithi148.stdout:2/668: unlink d9/d24/d67/d72/lbd 0 2024-09-18T12:49:22.562 INFO:tasks.workunit.client.1.smithi148.stdout:7/757: dwrite db/dc/df/d1d/f57 [0,4194304] 0 2024-09-18T12:49:22.564 INFO:tasks.workunit.client.1.smithi148.stdout:5/781: creat d7/d8/dc/da6/dee/d39/f10a x:0 0 0 2024-09-18T12:49:22.571 INFO:tasks.workunit.client.1.smithi148.stdout:8/845: creat d8/d16/d27/dc5/dee/dfe/df3/f121 x:0 0 0 2024-09-18T12:49:22.571 INFO:tasks.workunit.client.1.smithi148.stdout:1/763: dwrite fb [0,4194304] 0 2024-09-18T12:49:22.571 INFO:tasks.workunit.client.0.smithi078.stdout:9/515: dwrite d5/d7/f25 [0,4194304] 0 2024-09-18T12:49:22.573 INFO:tasks.workunit.client.0.smithi078.stdout:8/446: dwrite d0/d7/dc/d5d/f37 [0,4194304] 0 2024-09-18T12:49:22.574 INFO:tasks.workunit.client.0.smithi078.stdout:0/597: creat d3/d1f/d2e/d4e/db2/fda x:0 0 0 2024-09-18T12:49:22.576 INFO:tasks.workunit.client.0.smithi078.stdout:0/598: stat d3/d1f/d2e/d8f/da1 0 2024-09-18T12:49:22.577 INFO:tasks.workunit.client.0.smithi078.stdout:4/522: symlink d11/la9 0 2024-09-18T12:49:22.578 INFO:tasks.workunit.client.0.smithi078.stdout:4/523: fdatasync d11/d27/d47/fa4 0 2024-09-18T12:49:22.582 INFO:tasks.workunit.client.1.smithi148.stdout:2/669: creat d9/d17/d29/d92/d95/d9b/fef x:0 0 0 2024-09-18T12:49:22.584 INFO:tasks.workunit.client.1.smithi148.stdout:7/758: mkdir db/dc/df/d2c/de1 0 2024-09-18T12:49:22.586 INFO:tasks.workunit.client.0.smithi078.stdout:5/686: unlink d2/d4/d9/d2f/faf 0 2024-09-18T12:49:22.587 INFO:tasks.workunit.client.1.smithi148.stdout:3/702: rename d4/d8/d20/d2b/c50 to d4/cf0 0 2024-09-18T12:49:22.588 INFO:tasks.workunit.client.0.smithi078.stdout:2/447: creat d4/d8/d23/d52/d5f/d86/d3b/d4f/f94 x:0 0 0 2024-09-18T12:49:22.589 INFO:tasks.workunit.client.0.smithi078.stdout:2/448: chown d4/db/f1c 1483 1 2024-09-18T12:49:22.590 INFO:tasks.workunit.client.0.smithi078.stdout:9/516: creat d5/d7/d32/d2a/d68/d97/fa6 x:0 0 0 2024-09-18T12:49:22.590 INFO:tasks.workunit.client.1.smithi148.stdout:8/846: chown f1 315190 1 2024-09-18T12:49:22.591 INFO:tasks.workunit.client.1.smithi148.stdout:1/764: mkdir dc/d4d/dfe 0 2024-09-18T12:49:22.592 INFO:tasks.workunit.client.0.smithi078.stdout:9/517: stat d5/d7/d32/d2a/d68/la0 0 2024-09-18T12:49:22.592 INFO:tasks.workunit.client.0.smithi078.stdout:9/518: readlink d5/d7/l2c 0 2024-09-18T12:49:22.593 INFO:tasks.workunit.client.0.smithi078.stdout:0/599: rename d3/c7 to d3/d1f/d2e/d8f/da1/cdb 0 2024-09-18T12:49:22.594 INFO:tasks.workunit.client.0.smithi078.stdout:5/687: dwrite d2/d4/d9/da/d60/db3/d16/d36/f5c [0,4194304] 0 2024-09-18T12:49:22.596 INFO:tasks.workunit.client.0.smithi078.stdout:4/524: unlink d11/d27/d47/d4e/d50/f80 0 2024-09-18T12:49:22.596 INFO:tasks.workunit.client.1.smithi148.stdout:0/929: truncate de/d27/d2e/f33 5224723 0 2024-09-18T12:49:22.598 INFO:tasks.workunit.client.0.smithi078.stdout:4/525: read d11/d27/d47/f5f [849168,17243] 0 2024-09-18T12:49:22.599 INFO:tasks.workunit.client.0.smithi078.stdout:4/526: stat d11/d27/d5a/d84/d4b/c9c 0 2024-09-18T12:49:22.599 INFO:tasks.workunit.client.1.smithi148.stdout:2/670: mkdir d9/d24/d67/df0 0 2024-09-18T12:49:22.600 INFO:tasks.workunit.client.0.smithi078.stdout:8/447: link d0/d7/f22 d0/d39/d4c/d77/d7d/d52/f89 0 2024-09-18T12:49:22.602 INFO:tasks.workunit.client.1.smithi148.stdout:5/782: symlink d7/d8/dc/da6/dee/d25/d4b/dae/l10b 0 2024-09-18T12:49:22.602 INFO:tasks.workunit.client.0.smithi078.stdout:2/449: mkdir d4/d8/d23/d95 0 2024-09-18T12:49:22.603 INFO:tasks.workunit.client.1.smithi148.stdout:3/703: creat d4/d8/d20/d2b/d7f/d93/dd1/ff1 x:0 0 0 2024-09-18T12:49:22.604 INFO:tasks.workunit.client.1.smithi148.stdout:8/847: mkdir d8/d12/d51/d94/d122 0 2024-09-18T12:49:22.605 INFO:tasks.workunit.client.1.smithi148.stdout:3/704: truncate d4/d8/d1e/d63/fb2 510568 0 2024-09-18T12:49:22.606 INFO:tasks.workunit.client.0.smithi078.stdout:0/600: symlink d3/d1f/d2e/d8f/ldc 0 2024-09-18T12:49:22.609 INFO:tasks.workunit.client.1.smithi148.stdout:0/930: dread - de/d27/d7a/f92 zero size 2024-09-18T12:49:22.610 INFO:tasks.workunit.client.1.smithi148.stdout:0/931: truncate de/d27/d53/d89/fce 1086112 0 2024-09-18T12:49:22.611 INFO:tasks.workunit.client.0.smithi078.stdout:6/642: write d10/d2b/d43/f50 [279837,42628] 0 2024-09-18T12:49:22.612 INFO:tasks.workunit.client.0.smithi078.stdout:8/448: rename d0/d7/dc/d1f/d23/d40/l66 to d0/d7/dc/d1f/d6f/l8a 0 2024-09-18T12:49:22.614 INFO:tasks.workunit.client.1.smithi148.stdout:5/783: mkdir d7/d8/dc/d12/d20/d100/d10c 0 2024-09-18T12:49:22.615 INFO:tasks.workunit.client.0.smithi078.stdout:2/450: creat d4/d8/d23/f96 x:0 0 0 2024-09-18T12:49:22.616 INFO:tasks.workunit.client.1.smithi148.stdout:0/932: dwrite de/d27/d53/d89/dbb/fe6 [0,4194304] 0 2024-09-18T12:49:22.616 INFO:tasks.workunit.client.0.smithi078.stdout:2/451: chown d4/d20 243 1 2024-09-18T12:49:22.617 INFO:tasks.workunit.client.1.smithi148.stdout:1/765: rename dc/d18/d63/f8b to dc/d18/d31/dc6/fff 0 2024-09-18T12:49:22.618 INFO:tasks.workunit.client.0.smithi078.stdout:5/688: mkdir d2/d4/d9/da/d60/db3/d16/d36/d4c/d62/dd4 0 2024-09-18T12:49:22.619 INFO:tasks.workunit.client.0.smithi078.stdout:5/689: chown d2/d4/d9/d2f/d30/f5f 1750050 1 2024-09-18T12:49:22.621 INFO:tasks.workunit.client.1.smithi148.stdout:4/768: getdents d15/d17/d52/d68/da5/dc0 0 2024-09-18T12:49:22.624 INFO:tasks.workunit.client.1.smithi148.stdout:8/848: dread d8/d16/d27/f47 [0,4194304] 0 2024-09-18T12:49:22.625 INFO:tasks.workunit.client.1.smithi148.stdout:6/768: dwrite d5/d1a/fca [0,4194304] 0 2024-09-18T12:49:22.626 INFO:tasks.workunit.client.1.smithi148.stdout:7/759: link db/dc/df/d1d/f5c db/fe2 0 2024-09-18T12:49:22.626 INFO:tasks.workunit.client.0.smithi078.stdout:4/527: mkdir d11/d27/d47/d4e/daa 0 2024-09-18T12:49:22.626 INFO:tasks.workunit.client.1.smithi148.stdout:8/849: chown d8/d16/d27/f93 5999443 1 2024-09-18T12:49:22.628 INFO:tasks.workunit.client.0.smithi078.stdout:9/519: creat d5/fa7 x:0 0 0 2024-09-18T12:49:22.628 INFO:tasks.workunit.client.1.smithi148.stdout:7/760: chown db/dc/df/l7f 7 1 2024-09-18T12:49:22.630 INFO:tasks.workunit.client.1.smithi148.stdout:5/784: mkdir d7/d8/dc/d12/d20/d10d 0 2024-09-18T12:49:22.631 INFO:tasks.workunit.client.0.smithi078.stdout:2/452: mknod d4/d8/d23/d52/d5f/d86/d33/c97 0 2024-09-18T12:49:22.632 INFO:tasks.workunit.client.1.smithi148.stdout:0/933: symlink de/d14/d43/dd6/d121/l139 0 2024-09-18T12:49:22.633 INFO:tasks.workunit.client.1.smithi148.stdout:4/769: dwrite d15/d17/d52/d92/d4c/d4f/d64/d9a/ff4 [0,4194304] 0 2024-09-18T12:49:22.633 INFO:tasks.workunit.client.0.smithi078.stdout:0/601: mkdir d3/d1f/d2e/d4e/d37/d72/ddd 0 2024-09-18T12:49:22.634 INFO:tasks.workunit.client.0.smithi078.stdout:0/602: write d3/d1f/d2e/d8f/fbd [226505,82146] 0 2024-09-18T12:49:22.636 INFO:tasks.workunit.client.0.smithi078.stdout:5/690: rename d2/d4/d9/da/d60/db3/d16/d36/d4c/c6d to d2/d4/d9/da/d2b/d3e/cd5 0 2024-09-18T12:49:22.636 INFO:tasks.workunit.client.0.smithi078.stdout:0/603: chown d3/d1f/d2e/lb9 30274919 1 2024-09-18T12:49:22.637 INFO:tasks.workunit.client.0.smithi078.stdout:4/528: fsync d11/d27/d5a/d84/f67 0 2024-09-18T12:49:22.638 INFO:tasks.workunit.client.0.smithi078.stdout:9/520: mknod d5/d40/ca8 0 2024-09-18T12:49:22.640 INFO:tasks.workunit.client.0.smithi078.stdout:9/521: dread - d5/d7/d32/d2a/d68/d97/fa6 zero size 2024-09-18T12:49:22.641 INFO:tasks.workunit.client.1.smithi148.stdout:7/761: creat db/dc/df/d2c/d66/da0/fe3 x:0 0 0 2024-09-18T12:49:22.641 INFO:tasks.workunit.client.0.smithi078.stdout:9/522: write d5/d7/f39 [2574309,74599] 0 2024-09-18T12:49:22.642 INFO:tasks.workunit.client.1.smithi148.stdout:5/785: write d7/d8/dc/d12/d31/d5a/fde [613780,14672] 0 2024-09-18T12:49:22.642 INFO:tasks.workunit.client.1.smithi148.stdout:7/762: write db/dc/df/d2c/d66/da0/fe3 [164037,71360] 0 2024-09-18T12:49:22.643 INFO:tasks.workunit.client.0.smithi078.stdout:9/523: read d5/d40/f63 [3384467,8295] 0 2024-09-18T12:49:22.645 INFO:tasks.workunit.client.0.smithi078.stdout:5/691: creat d2/d4/d9/da/d60/fd6 x:0 0 0 2024-09-18T12:49:22.646 INFO:tasks.workunit.client.1.smithi148.stdout:9/757: sync 2024-09-18T12:49:22.646 INFO:tasks.workunit.client.1.smithi148.stdout:4/770: rename d15/d17/d52/d68/da5/dc0 to d15/d17/d52/d101 0 2024-09-18T12:49:22.647 INFO:tasks.workunit.client.0.smithi078.stdout:2/453: dwrite d4/d20/d85/f91 [4194304,4194304] 0 2024-09-18T12:49:22.647 INFO:tasks.workunit.client.0.smithi078.stdout:5/692: dread - d2/d4/d48/fc2 zero size 2024-09-18T12:49:22.648 INFO:tasks.workunit.client.0.smithi078.stdout:2/454: stat d4 0 2024-09-18T12:49:22.650 INFO:tasks.workunit.client.0.smithi078.stdout:6/643: creat d10/d2b/d43/fd1 x:0 0 0 2024-09-18T12:49:22.651 INFO:tasks.workunit.client.1.smithi148.stdout:6/769: symlink d5/d32/d38/df0/df2/lf7 0 2024-09-18T12:49:22.652 INFO:tasks.workunit.client.0.smithi078.stdout:0/604: symlink d3/d82/dd7/lde 0 2024-09-18T12:49:22.653 INFO:tasks.workunit.client.1.smithi148.stdout:2/671: sync 2024-09-18T12:49:22.653 INFO:tasks.workunit.client.0.smithi078.stdout:9/524: dwrite d5/d7/d32/f5b [0,4194304] 0 2024-09-18T12:49:22.654 INFO:tasks.workunit.client.0.smithi078.stdout:4/529: creat d11/d27/d47/d4e/daa/fab x:0 0 0 2024-09-18T12:49:22.656 INFO:tasks.workunit.client.0.smithi078.stdout:5/693: mknod d2/d4/d9/d2f/cd7 0 2024-09-18T12:49:22.657 INFO:tasks.workunit.client.1.smithi148.stdout:4/771: dwrite d15/d17/d52/d92/d4c/f57 [4194304,4194304] 0 2024-09-18T12:49:22.658 INFO:tasks.workunit.client.0.smithi078.stdout:5/694: write d2/d4/d9/da/d2b/d3e/fa9 [958920,34822] 0 2024-09-18T12:49:22.661 INFO:tasks.workunit.client.0.smithi078.stdout:5/695: write d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/fc4 [848843,78338] 0 2024-09-18T12:49:22.663 INFO:tasks.workunit.client.1.smithi148.stdout:8/850: dread d8/d16/d53/d39/d3b/f63 [0,4194304] 0 2024-09-18T12:49:22.665 INFO:tasks.workunit.client.1.smithi148.stdout:3/705: getdents d4/d8/d1e/d6b/d31/d54 0 2024-09-18T12:49:22.668 INFO:tasks.workunit.client.0.smithi078.stdout:6/644: mkdir d10/d2b/d43/d53/d63/d70/d77/dd2 0 2024-09-18T12:49:22.671 INFO:tasks.workunit.client.0.smithi078.stdout:6/645: fsync d10/d2b/d43/d53/d63/d70/d7d/fb5 0 2024-09-18T12:49:22.673 INFO:tasks.workunit.client.1.smithi148.stdout:2/672: rename d9/f18 to d9/d73/d81/ff1 0 2024-09-18T12:49:22.678 INFO:tasks.workunit.client.0.smithi078.stdout:5/696: mknod d2/d4/d58/cd8 0 2024-09-18T12:49:22.679 INFO:tasks.workunit.client.1.smithi148.stdout:7/763: dread db/dc/df/d1d/f5c [4194304,4194304] 0 2024-09-18T12:49:22.679 INFO:tasks.workunit.client.1.smithi148.stdout:7/764: stat db/dc/df/d2c/d55/daf 0 2024-09-18T12:49:22.680 INFO:tasks.workunit.client.1.smithi148.stdout:4/772: mkdir d15/d17/d52/d68/da5/d102 0 2024-09-18T12:49:22.681 INFO:tasks.workunit.client.0.smithi078.stdout:0/605: fsync d3/d1f/f63 0 2024-09-18T12:49:22.682 INFO:tasks.workunit.client.0.smithi078.stdout:0/606: fdatasync d3/d1f/d2e/d4e/f3d 0 2024-09-18T12:49:22.684 INFO:tasks.workunit.client.1.smithi148.stdout:6/770: readlink d5/d32/d38/d50/de7/d7c/la2 0 2024-09-18T12:49:22.685 INFO:tasks.workunit.client.0.smithi078.stdout:4/530: dread d11/f38 [4194304,4194304] 0 2024-09-18T12:49:22.685 INFO:tasks.workunit.client.0.smithi078.stdout:4/531: read d11/f16 [1350765,51240] 0 2024-09-18T12:49:22.686 INFO:tasks.workunit.client.1.smithi148.stdout:6/771: dread - d5/d1a/dc/d2b/d35/d65/d99/da4/da6/fdb zero size 2024-09-18T12:49:22.686 INFO:tasks.workunit.client.0.smithi078.stdout:4/532: chown d11/d27/d47 15563 1 2024-09-18T12:49:22.686 INFO:tasks.workunit.client.0.smithi078.stdout:9/525: dread d5/d7/f39 [0,4194304] 0 2024-09-18T12:49:22.687 INFO:tasks.workunit.client.1.smithi148.stdout:6/772: dread - d5/d1a/d29/d5c/da1/fbb zero size 2024-09-18T12:49:22.687 INFO:tasks.workunit.client.1.smithi148.stdout:9/758: dread d8/da/dd/d35/d47/f94 [0,4194304] 0 2024-09-18T12:49:22.688 INFO:tasks.workunit.client.0.smithi078.stdout:4/533: dread d11/d27/d5a/d5d/f8e [0,4194304] 0 2024-09-18T12:49:22.689 INFO:tasks.workunit.client.0.smithi078.stdout:9/526: dread - d5/d7/d32/d2a/f2d zero size 2024-09-18T12:49:22.689 INFO:tasks.workunit.client.1.smithi148.stdout:9/759: stat d8/da/dd/d35/d81/dc6/dcc 0 2024-09-18T12:49:22.689 INFO:tasks.workunit.client.1.smithi148.stdout:6/773: dread d5/d1a/d3d/fb9 [0,4194304] 0 2024-09-18T12:49:22.690 INFO:tasks.workunit.client.1.smithi148.stdout:8/851: rename d8/d12/d46/d74/dd5/ffd to d8/df/d3e/f123 0 2024-09-18T12:49:22.690 INFO:tasks.workunit.client.1.smithi148.stdout:8/852: readlink d8/df/d66/l112 0 2024-09-18T12:49:22.691 INFO:tasks.workunit.client.0.smithi078.stdout:5/697: truncate d2/d4/d9/da/f20 576440 0 2024-09-18T12:49:22.691 INFO:tasks.workunit.client.0.smithi078.stdout:4/534: dread d11/f16 [0,4194304] 0 2024-09-18T12:49:22.692 INFO:tasks.workunit.client.0.smithi078.stdout:5/698: chown d2 211911 1 2024-09-18T12:49:22.693 INFO:tasks.workunit.client.0.smithi078.stdout:2/455: dread d4/db/dc/f2f [0,4194304] 0 2024-09-18T12:49:22.693 INFO:tasks.workunit.client.1.smithi148.stdout:2/673: symlink d9/d24/d67/dc7/ddd/lf2 0 2024-09-18T12:49:22.694 INFO:tasks.workunit.client.0.smithi078.stdout:2/456: fdatasync d4/dd/f64 0 2024-09-18T12:49:22.694 INFO:tasks.workunit.client.1.smithi148.stdout:2/674: fdatasync d9/d24/d31/d34/d7b/fd5 0 2024-09-18T12:49:22.695 INFO:tasks.workunit.client.1.smithi148.stdout:7/765: creat db/dc/df/d1d/d41/fe4 x:0 0 0 2024-09-18T12:49:22.697 INFO:tasks.workunit.client.1.smithi148.stdout:4/773: mkdir d15/d5f/d69/d7f/d94/d103 0 2024-09-18T12:49:22.699 INFO:tasks.workunit.client.1.smithi148.stdout:3/706: mkdir d4/d8/d20/d2b/df2 0 2024-09-18T12:49:22.700 INFO:tasks.workunit.client.0.smithi078.stdout:6/646: symlink d10/d2b/d43/dc4/ld3 0 2024-09-18T12:49:22.701 INFO:tasks.workunit.client.1.smithi148.stdout:1/766: truncate dc/d18/d7d/d93/dd9/f3c 3886883 0 2024-09-18T12:49:22.704 INFO:tasks.workunit.client.0.smithi078.stdout:9/527: symlink d5/d7/d32/d2a/d36/la9 0 2024-09-18T12:49:22.705 INFO:tasks.workunit.client.1.smithi148.stdout:9/760: creat d8/da/dd/d35/d47/d62/fe5 x:0 0 0 2024-09-18T12:49:22.711 INFO:tasks.workunit.client.1.smithi148.stdout:0/934: dwrite de/d27/f44 [0,4194304] 0 2024-09-18T12:49:22.712 INFO:tasks.workunit.client.1.smithi148.stdout:0/935: chown de/d14/f26 403473 1 2024-09-18T12:49:22.713 INFO:tasks.workunit.client.1.smithi148.stdout:5/786: dwrite d7/d2b/f81 [0,4194304] 0 2024-09-18T12:49:22.713 INFO:tasks.workunit.client.1.smithi148.stdout:8/853: dread d8/d16/d27/f30 [0,4194304] 0 2024-09-18T12:49:22.713 INFO:tasks.workunit.client.1.smithi148.stdout:0/936: dread - de/d14/d43/fe9 zero size 2024-09-18T12:49:22.714 INFO:tasks.workunit.client.0.smithi078.stdout:9/528: mknod d5/d7/d32/d91/caa 0 2024-09-18T12:49:22.716 INFO:tasks.workunit.client.0.smithi078.stdout:4/535: mknod d11/cac 0 2024-09-18T12:49:22.719 INFO:tasks.workunit.client.1.smithi148.stdout:5/787: dwrite d7/d8/dc/d12/d31/d5a/fde [0,4194304] 0 2024-09-18T12:49:22.720 INFO:tasks.workunit.client.1.smithi148.stdout:6/774: symlink d5/d1a/dc/d2b/d35/d65/lf8 0 2024-09-18T12:49:22.721 INFO:tasks.workunit.client.1.smithi148.stdout:9/761: mknod d8/da/dd/d4a/d49/d46/d54/d90/ce6 0 2024-09-18T12:49:22.725 INFO:tasks.workunit.client.0.smithi078.stdout:0/607: rename d3/d1f/d2e/d68/d30/d7c/fbc to d3/d1f/fdf 0 2024-09-18T12:49:22.726 INFO:tasks.workunit.client.1.smithi148.stdout:2/675: symlink d9/d24/d31/d9d/dcd/lf3 0 2024-09-18T12:49:22.727 INFO:tasks.workunit.client.1.smithi148.stdout:2/676: fsync d9/d73/fde 0 2024-09-18T12:49:22.727 INFO:tasks.workunit.client.0.smithi078.stdout:9/529: symlink d5/d7/d32/d2a/d68/lab 0 2024-09-18T12:49:22.728 INFO:tasks.workunit.client.1.smithi148.stdout:7/766: mkdir db/dc/df/d11/de5 0 2024-09-18T12:49:22.728 INFO:tasks.workunit.client.0.smithi078.stdout:9/530: write d5/d7/d32/f89 [311607,69320] 0 2024-09-18T12:49:22.730 INFO:tasks.workunit.client.0.smithi078.stdout:5/699: creat d2/d4/d9/da/d60/db3/d16/d36/d4c/d62/fd9 x:0 0 0 2024-09-18T12:49:22.732 INFO:tasks.workunit.client.1.smithi148.stdout:4/774: mkdir d15/d17/d52/d92/d4c/d4f/d34/d104 0 2024-09-18T12:49:22.732 INFO:tasks.workunit.client.0.smithi078.stdout:2/457: link d4/dd/l93 d4/d8/d23/d52/l98 0 2024-09-18T12:49:22.734 INFO:tasks.workunit.client.1.smithi148.stdout:2/677: dwrite d9/d24/d31/d34/d42/fee [0,4194304] 0 2024-09-18T12:49:22.734 INFO:tasks.workunit.client.0.smithi078.stdout:6/647: rename d10/d2b/d43/d53/d45/d9c/cba to d10/d2b/d43/dc4/cd4 0 2024-09-18T12:49:22.735 INFO:tasks.workunit.client.1.smithi148.stdout:2/678: write d9/d17/f45 [3042001,36906] 0 2024-09-18T12:49:22.736 INFO:tasks.workunit.client.0.smithi078.stdout:0/608: symlink d3/d1f/d2e/d8f/d90/dcb/le0 0 2024-09-18T12:49:22.736 INFO:tasks.workunit.client.1.smithi148.stdout:0/937: mkdir de/d27/d2e/d114/d13a 0 2024-09-18T12:49:22.738 INFO:tasks.workunit.client.0.smithi078.stdout:5/700: mknod d2/d4/d9/da/d60/db3/d16/d36/d4c/d62/d4d/cda 0 2024-09-18T12:49:22.739 INFO:tasks.workunit.client.1.smithi148.stdout:0/938: write de/d14/d43/d57/fb1 [1378634,118852] 0 2024-09-18T12:49:22.742 INFO:tasks.workunit.client.1.smithi148.stdout:6/775: symlink d5/d32/d38/d50/de7/d7c/lf9 0 2024-09-18T12:49:22.744 INFO:tasks.workunit.client.1.smithi148.stdout:9/762: chown d8/da/dd/d35/d81/f8e 56 1 2024-09-18T12:49:22.750 INFO:tasks.workunit.client.1.smithi148.stdout:7/767: rename db/dc/df/d11/c39 to db/dc/df/d2c/d55/daf/d38/ce6 0 2024-09-18T12:49:22.753 INFO:tasks.workunit.client.1.smithi148.stdout:3/707: creat d4/d8/d20/d2b/ff3 x:0 0 0 2024-09-18T12:49:22.753 INFO:tasks.workunit.client.0.smithi078.stdout:5/701: dwrite d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/d90/fcb [0,4194304] 0 2024-09-18T12:49:22.755 INFO:tasks.workunit.client.1.smithi148.stdout:4/775: dread d15/d17/d52/d92/d4c/d72/f79 [0,4194304] 0 2024-09-18T12:49:22.758 INFO:tasks.workunit.client.0.smithi078.stdout:6/648: creat d10/d2b/d43/d53/fd5 x:0 0 0 2024-09-18T12:49:22.761 INFO:tasks.workunit.client.1.smithi148.stdout:2/679: creat d9/d24/d31/d9d/ff4 x:0 0 0 2024-09-18T12:49:22.762 INFO:tasks.workunit.client.0.smithi078.stdout:5/702: unlink d2/d4/d9/da/d2b/d3e/l98 0 2024-09-18T12:49:22.765 INFO:tasks.workunit.client.0.smithi078.stdout:2/458: dread d4/d8/f1d [0,4194304] 0 2024-09-18T12:49:22.767 INFO:tasks.workunit.client.1.smithi148.stdout:1/767: rmdir dc/d51/dfc 0 2024-09-18T12:49:22.767 INFO:tasks.workunit.client.1.smithi148.stdout:1/768: dread - dc/d18/d7d/d93/fd4 zero size 2024-09-18T12:49:22.768 INFO:tasks.workunit.client.1.smithi148.stdout:1/769: read fb [1648989,23761] 0 2024-09-18T12:49:22.769 INFO:tasks.workunit.client.0.smithi078.stdout:5/703: rename d2/d4/d9/f1c to d2/d74/fdb 0 2024-09-18T12:49:22.770 INFO:tasks.workunit.client.0.smithi078.stdout:6/649: mkdir d10/d2b/d43/d53/d63/d70/d77/dd2/dd6 0 2024-09-18T12:49:22.773 INFO:tasks.workunit.client.0.smithi078.stdout:4/536: getdents d11 0 2024-09-18T12:49:22.775 INFO:tasks.workunit.client.1.smithi148.stdout:6/776: dwrite d5/d1a/dc/f6d [0,4194304] 0 2024-09-18T12:49:22.782 INFO:tasks.workunit.client.1.smithi148.stdout:3/708: mknod d4/d8/d1e/d63/d9b/cf4 0 2024-09-18T12:49:22.784 INFO:tasks.workunit.client.1.smithi148.stdout:3/709: write d4/d8/d20/d2b/d7f/d93/d94/f9a [4165548,7097] 0 2024-09-18T12:49:22.786 INFO:tasks.workunit.client.1.smithi148.stdout:3/710: stat d4/d8/d20/d2b/df2 0 2024-09-18T12:49:22.786 INFO:tasks.workunit.client.1.smithi148.stdout:5/788: write d7/d8/dc/d12/d20/df3/f79 [4955744,116902] 0 2024-09-18T12:49:22.787 INFO:tasks.workunit.client.0.smithi078.stdout:0/609: write d3/d1f/d2e/d68/d30/f59 [2198338,85276] 0 2024-09-18T12:49:22.788 INFO:tasks.workunit.client.1.smithi148.stdout:3/711: write d4/d8/d6a/fc7 [193113,1281] 0 2024-09-18T12:49:22.788 INFO:tasks.workunit.client.1.smithi148.stdout:5/789: stat d7/d2b/l63 0 2024-09-18T12:49:22.792 INFO:tasks.workunit.client.1.smithi148.stdout:8/854: dwrite d8/df/d3e/f123 [0,4194304] 0 2024-09-18T12:49:22.833 INFO:tasks.workunit.client.1.smithi148.stdout:0/939: sync 2024-09-18T12:49:22.895 INFO:tasks.workunit.client.1.smithi148.stdout:9/763: sync 2024-09-18T12:49:22.896 INFO:tasks.workunit.client.1.smithi148.stdout:4/776: sync 2024-09-18T12:49:22.896 INFO:tasks.workunit.client.1.smithi148.stdout:4/777: dread - d15/d17/d52/d92/d4c/fe5 zero size 2024-09-18T12:49:22.897 INFO:tasks.workunit.client.1.smithi148.stdout:9/764: write d8/da/dd/d3f/d5d/da0/fc1 [345193,95785] 0 2024-09-18T12:49:22.913 INFO:tasks.workunit.client.1.smithi148.stdout:0/940: sync 2024-09-18T12:49:22.942 INFO:tasks.workunit.client.0.smithi078.stdout:5/704: symlink d2/d4/d9/da/d60/ldc 0 2024-09-18T12:49:22.943 INFO:tasks.workunit.client.0.smithi078.stdout:5/705: write d2/d4/d48/f88 [1480848,85899] 0 2024-09-18T12:49:22.945 INFO:tasks.workunit.client.0.smithi078.stdout:5/706: write d2/d4/f34 [81622,38953] 0 2024-09-18T12:49:22.948 INFO:tasks.workunit.client.0.smithi078.stdout:4/537: chown d11/d27/d5a/d84/l37 2 1 2024-09-18T12:49:22.949 INFO:tasks.workunit.client.0.smithi078.stdout:4/538: dread - d11/d27/d47/d4e/d76/f8f zero size 2024-09-18T12:49:22.949 INFO:tasks.workunit.client.1.smithi148.stdout:7/768: write db/dc/df/d11/d43/f9a [229968,74915] 0 2024-09-18T12:49:22.950 INFO:tasks.workunit.client.0.smithi078.stdout:4/539: fsync d11/d27/d5a/d84/d4b/f82 0 2024-09-18T12:49:22.953 INFO:tasks.workunit.client.1.smithi148.stdout:2/680: write d9/d3a/fd3 [671645,53014] 0 2024-09-18T12:49:22.954 INFO:tasks.workunit.client.0.smithi078.stdout:2/459: creat d4/f99 x:0 0 0 2024-09-18T12:49:22.955 INFO:tasks.workunit.client.0.smithi078.stdout:5/707: mknod d2/d4/d9/da/d60/d61/cdd 0 2024-09-18T12:49:22.959 INFO:tasks.workunit.client.0.smithi078.stdout:2/460: mknod d4/d8/c9a 0 2024-09-18T12:49:22.961 INFO:tasks.workunit.client.0.smithi078.stdout:5/708: rename d2/d4/d9/da/d60/db3/d16/d36/d4c/d62 to d2/d4/d9/da/d60/db3/d16/d36/db0/dde 0 2024-09-18T12:49:22.962 INFO:tasks.workunit.client.0.smithi078.stdout:5/709: dread - d2/d4/d9/da/d60/fd6 zero size 2024-09-18T12:49:22.964 INFO:tasks.workunit.client.0.smithi078.stdout:4/540: creat d11/d27/d47/d78/d95/fad x:0 0 0 2024-09-18T12:49:22.965 INFO:tasks.workunit.client.0.smithi078.stdout:6/650: getdents d10/d2b/d43/d53/d63/d70/dac/da6 0 2024-09-18T12:49:22.966 INFO:tasks.workunit.client.0.smithi078.stdout:5/710: dread d2/d4/f66 [0,4194304] 0 2024-09-18T12:49:22.969 INFO:tasks.workunit.client.0.smithi078.stdout:2/461: rename d4/d8/d23/d52/d5f/d86/d3b/c4a to d4/db/dc/c9b 0 2024-09-18T12:49:22.970 INFO:tasks.workunit.client.0.smithi078.stdout:6/651: dread d10/d2b/d43/f50 [0,4194304] 0 2024-09-18T12:49:22.971 INFO:tasks.workunit.client.0.smithi078.stdout:6/652: readlink d10/d2b/d43/l4e 0 2024-09-18T12:49:22.972 INFO:tasks.workunit.client.0.smithi078.stdout:6/653: fdatasync d10/d2b/d43/d53/f56 0 2024-09-18T12:49:22.975 INFO:tasks.workunit.client.1.smithi148.stdout:9/765: creat d8/da/dd/d4a/d49/d46/d54/dab/fe7 x:0 0 0 2024-09-18T12:49:22.978 INFO:tasks.workunit.client.0.smithi078.stdout:5/711: symlink d2/d4/d9/d2f/d30/ldf 0 2024-09-18T12:49:22.979 INFO:tasks.workunit.client.1.smithi148.stdout:0/941: sync 2024-09-18T12:49:22.980 INFO:tasks.workunit.client.1.smithi148.stdout:7/769: fdatasync db/dc/df/d1d/f6d 0 2024-09-18T12:49:22.982 INFO:tasks.workunit.client.0.smithi078.stdout:2/462: dread d4/d8/d23/d52/f5a [0,4194304] 0 2024-09-18T12:49:22.983 INFO:tasks.workunit.client.0.smithi078.stdout:2/463: chown d4/d1a 1012712 1 2024-09-18T12:49:22.984 INFO:tasks.workunit.client.1.smithi148.stdout:4/778: dread d15/d17/d52/d92/d4c/fd9 [0,4194304] 0 2024-09-18T12:49:22.985 INFO:tasks.workunit.client.0.smithi078.stdout:6/654: mkdir d10/d2b/d61/dd7 0 2024-09-18T12:49:22.988 INFO:tasks.workunit.client.1.smithi148.stdout:3/712: mkdir d4/df5 0 2024-09-18T12:49:22.989 INFO:tasks.workunit.client.1.smithi148.stdout:5/790: fsync d7/d8/d18/f103 0 2024-09-18T12:49:22.991 INFO:tasks.workunit.client.1.smithi148.stdout:3/713: read d4/d8/d1e/d6b/d31/d54/f8a [3315501,129950] 0 2024-09-18T12:49:22.991 INFO:tasks.workunit.client.1.smithi148.stdout:8/855: mknod d8/d12/d51/d94/d110/c124 0 2024-09-18T12:49:22.992 INFO:tasks.workunit.client.1.smithi148.stdout:8/856: chown d8/df/d66 1508 1 2024-09-18T12:49:22.992 INFO:tasks.workunit.client.0.smithi078.stdout:5/712: dread d2/d74/fdb [0,4194304] 0 2024-09-18T12:49:22.992 INFO:tasks.workunit.client.1.smithi148.stdout:8/857: chown d8/df/l22 185 1 2024-09-18T12:49:22.993 INFO:tasks.workunit.client.0.smithi078.stdout:2/464: symlink d4/d8/d23/d52/d5f/d86/d33/l9c 0 2024-09-18T12:49:22.993 INFO:tasks.workunit.client.0.smithi078.stdout:2/465: fdatasync d4/d1a/f2e 0 2024-09-18T12:49:22.994 INFO:tasks.workunit.client.1.smithi148.stdout:9/766: chown d8/da/dd/d77/lba 1 1 2024-09-18T12:49:22.996 INFO:tasks.workunit.client.0.smithi078.stdout:6/655: unlink d10/d2b/d43/dc4/ld3 0 2024-09-18T12:49:22.999 INFO:tasks.workunit.client.1.smithi148.stdout:7/770: mkdir db/d52/d4f/de7 0 2024-09-18T12:49:23.011 INFO:tasks.workunit.client.0.smithi078.stdout:5/713: dread d2/d4/d48/f4e [0,4194304] 0 2024-09-18T12:49:23.013 INFO:tasks.workunit.client.0.smithi078.stdout:5/714: write d2/d4/d9/da/d60/d7f/fba [4032044,128367] 0 2024-09-18T12:49:23.029 INFO:tasks.workunit.client.1.smithi148.stdout:2/681: symlink d9/d24/d67/d72/lf5 0 2024-09-18T12:49:23.033 INFO:tasks.workunit.client.1.smithi148.stdout:4/779: creat d15/d17/d52/f105 x:0 0 0 2024-09-18T12:49:23.036 INFO:tasks.workunit.client.0.smithi078.stdout:4/541: dwrite d11/d27/d60/f68 [0,4194304] 0 2024-09-18T12:49:23.037 INFO:tasks.workunit.client.0.smithi078.stdout:5/715: unlink d2/d4/d9/da/d60/db3/caa 0 2024-09-18T12:49:23.037 INFO:tasks.workunit.client.0.smithi078.stdout:4/542: stat d11/d27/d47/c99 0 2024-09-18T12:49:23.038 INFO:tasks.workunit.client.0.smithi078.stdout:4/543: chown d11/d27/d47/f87 360 1 2024-09-18T12:49:23.041 INFO:tasks.workunit.client.0.smithi078.stdout:5/716: dread d2/d4/d9/d2f/d30/f5f [0,4194304] 0 2024-09-18T12:49:23.042 INFO:tasks.workunit.client.0.smithi078.stdout:2/466: link d4/d1a/c83 d4/d8/d23/d52/d5f/d86/d33/c9d 0 2024-09-18T12:49:23.043 INFO:tasks.workunit.client.0.smithi078.stdout:2/467: stat d4/d8/d23/d52/l89 0 2024-09-18T12:49:23.043 INFO:tasks.workunit.client.0.smithi078.stdout:2/468: fdatasync d4/d8/d23/f56 0 2024-09-18T12:49:23.044 INFO:tasks.workunit.client.1.smithi148.stdout:8/858: mkdir d8/d16/d53/d39/d3b/d125 0 2024-09-18T12:49:23.048 INFO:tasks.workunit.client.0.smithi078.stdout:2/469: dread d4/d8/d23/d52/f5a [0,4194304] 0 2024-09-18T12:49:23.049 INFO:tasks.workunit.client.0.smithi078.stdout:5/717: read d2/d4/d9/da/d60/db3/f40 [252465,31745] 0 2024-09-18T12:49:23.049 INFO:tasks.workunit.client.1.smithi148.stdout:1/770: getdents dc/d18/d31/d4b/d8d 0 2024-09-18T12:49:23.051 INFO:tasks.workunit.client.1.smithi148.stdout:4/780: symlink d15/d5f/l106 0 2024-09-18T12:49:23.052 INFO:tasks.workunit.client.0.smithi078.stdout:4/544: symlink d11/d27/d5a/d84/d4b/da7/lae 0 2024-09-18T12:49:23.052 INFO:tasks.workunit.client.1.smithi148.stdout:6/777: link d5/d1a/dc/dbf/dcb/cd0 d5/d1a/dc/d2b/d35/d65/d99/da4/cfa 0 2024-09-18T12:49:23.054 INFO:tasks.workunit.client.0.smithi078.stdout:5/718: mkdir d2/d4/d9/d2f/de0 0 2024-09-18T12:49:23.055 INFO:tasks.workunit.client.1.smithi148.stdout:5/791: creat d7/d8/dc/da6/dee/d39/dc2/dd2/f10e x:0 0 0 2024-09-18T12:49:23.055 INFO:tasks.workunit.client.0.smithi078.stdout:2/470: dwrite d4/d8/d23/d52/d5f/d86/f7a [0,4194304] 0 2024-09-18T12:49:23.056 INFO:tasks.workunit.client.0.smithi078.stdout:2/471: fdatasync d4/f9 0 2024-09-18T12:49:23.058 INFO:tasks.workunit.client.0.smithi078.stdout:4/545: symlink d11/d27/d47/d78/laf 0 2024-09-18T12:49:23.062 INFO:tasks.workunit.client.0.smithi078.stdout:2/472: rmdir d4/d8/d23/d52/d7c 39 2024-09-18T12:49:23.065 INFO:tasks.workunit.client.1.smithi148.stdout:1/771: creat dc/d18/d7d/d93/dd9/d2b/d99/f100 x:0 0 0 2024-09-18T12:49:23.067 INFO:tasks.workunit.client.1.smithi148.stdout:4/781: creat d15/d5f/d69/d7f/d94/f107 x:0 0 0 2024-09-18T12:49:23.069 INFO:tasks.workunit.client.0.smithi078.stdout:2/473: creat d4/d8/d23/f9e x:0 0 0 2024-09-18T12:49:23.070 INFO:tasks.workunit.client.0.smithi078.stdout:4/546: dwrite d11/d27/d5a/d84/d40/f8b [0,4194304] 0 2024-09-18T12:49:23.073 INFO:tasks.workunit.client.0.smithi078.stdout:6/656: truncate d10/d2b/d43/d53/d63/d70/d7d/fa5 207739 0 2024-09-18T12:49:23.074 INFO:tasks.workunit.client.0.smithi078.stdout:2/474: read - d4/db/dc/f62 zero size 2024-09-18T12:49:23.076 INFO:tasks.workunit.client.1.smithi148.stdout:7/771: write db/d52/d1f/f4d [5162969,50189] 0 2024-09-18T12:49:23.077 INFO:tasks.workunit.client.1.smithi148.stdout:2/682: write d9/d24/d31/f8a [21902,28235] 0 2024-09-18T12:49:23.077 INFO:tasks.workunit.client.1.smithi148.stdout:1/772: symlink dc/d5b/da5/l101 0 2024-09-18T12:49:23.080 INFO:tasks.workunit.client.1.smithi148.stdout:2/683: fdatasync d9/d24/d67/fdf 0 2024-09-18T12:49:23.080 INFO:tasks.workunit.client.1.smithi148.stdout:4/782: fsync d15/d3f/f6e 0 2024-09-18T12:49:23.080 INFO:tasks.workunit.client.1.smithi148.stdout:3/714: dwrite d4/d8/f24 [0,4194304] 0 2024-09-18T12:49:23.081 INFO:tasks.workunit.client.1.smithi148.stdout:2/684: read - d9/d73/fde zero size 2024-09-18T12:49:23.082 INFO:tasks.workunit.client.1.smithi148.stdout:6/778: fdatasync d5/d32/d38/d50/de7/fa7 0 2024-09-18T12:49:23.084 INFO:tasks.workunit.client.1.smithi148.stdout:4/783: write d15/d5f/d69/d7f/f8e [247616,96769] 0 2024-09-18T12:49:23.084 INFO:tasks.workunit.client.1.smithi148.stdout:4/784: stat d15/d17/d52/d92/d4c/d4f/d34/fb6 0 2024-09-18T12:49:23.085 INFO:tasks.workunit.client.1.smithi148.stdout:4/785: readlink d15/d17/d52/d92/l39 0 2024-09-18T12:49:23.087 INFO:tasks.workunit.client.1.smithi148.stdout:4/786: dread d15/d17/d52/d92/f84 [0,4194304] 0 2024-09-18T12:49:23.087 INFO:tasks.workunit.client.0.smithi078.stdout:5/719: write d2/d4/d9/d2f/d30/f85 [663021,35028] 0 2024-09-18T12:49:23.088 INFO:tasks.workunit.client.1.smithi148.stdout:9/767: link d8/da/dd/d4a/d49/d46/d54/d90/cb4 d8/da/dd/d35/d81/db7/ce8 0 2024-09-18T12:49:23.091 INFO:tasks.workunit.client.0.smithi078.stdout:4/547: getdents d11/d27/d47/d4e/daa 0 2024-09-18T12:49:23.094 INFO:tasks.workunit.client.0.smithi078.stdout:5/720: symlink d2/d4/d9/da/d60/db3/d16/d36/db0/dde/d4d/le1 0 2024-09-18T12:49:23.095 INFO:tasks.workunit.client.1.smithi148.stdout:0/942: sync 2024-09-18T12:49:23.096 INFO:tasks.workunit.client.1.smithi148.stdout:3/715: creat d4/d8/d20/d2b/d7f/dd9/ff6 x:0 0 0 2024-09-18T12:49:23.100 INFO:tasks.workunit.client.0.smithi078.stdout:5/721: creat d2/d4/d48/fe2 x:0 0 0 2024-09-18T12:49:23.101 INFO:tasks.workunit.client.1.smithi148.stdout:5/792: truncate d7/d2b/f7a 1329275 0 2024-09-18T12:49:23.102 INFO:tasks.workunit.client.0.smithi078.stdout:6/657: dwrite d10/d2b/d43/f64 [0,4194304] 0 2024-09-18T12:49:23.103 INFO:tasks.workunit.client.0.smithi078.stdout:2/475: dread d4/d8/f4b [0,4194304] 0 2024-09-18T12:49:23.104 INFO:tasks.workunit.client.0.smithi078.stdout:4/548: mkdir d11/d27/d5a/d84/db0 0 2024-09-18T12:49:23.105 INFO:tasks.workunit.client.1.smithi148.stdout:2/685: creat d9/d73/d81/ff6 x:0 0 0 2024-09-18T12:49:23.106 INFO:tasks.workunit.client.1.smithi148.stdout:6/779: mkdir d5/d32/d56/dfb 0 2024-09-18T12:49:23.108 INFO:tasks.workunit.client.0.smithi078.stdout:6/658: rmdir d10/d2b/d43/d53/d63/d70/dac/da6 39 2024-09-18T12:49:23.110 INFO:tasks.workunit.client.1.smithi148.stdout:4/787: rmdir d15/d17/d52/d92/d4c 39 2024-09-18T12:49:23.112 INFO:tasks.workunit.client.0.smithi078.stdout:5/722: mkdir d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/dbe/de3 0 2024-09-18T12:49:23.115 INFO:tasks.workunit.client.1.smithi148.stdout:9/768: rename d8/da/dd/d35/d59/cbc to d8/da/dd/d35/d81/dc6/ce9 0 2024-09-18T12:49:23.117 INFO:tasks.workunit.client.1.smithi148.stdout:9/769: truncate d8/da/dd/d35/d59/f69 1028559 0 2024-09-18T12:49:23.117 INFO:tasks.workunit.client.0.smithi078.stdout:2/476: dread d4/dd/f5c [0,4194304] 0 2024-09-18T12:49:23.119 INFO:tasks.workunit.client.1.smithi148.stdout:3/716: dread - d4/d8/d20/d2b/d43/fbb zero size 2024-09-18T12:49:23.125 INFO:tasks.workunit.client.0.smithi078.stdout:2/477: dwrite d4/dd/f64 [0,4194304] 0 2024-09-18T12:49:23.127 INFO:tasks.workunit.client.1.smithi148.stdout:6/780: fsync d5/d1a/d29/d5c/fa5 0 2024-09-18T12:49:23.128 INFO:tasks.workunit.client.0.smithi078.stdout:2/478: write d4/d8/d23/d52/d5f/d86/d3b/d55/f59 [10948617,63625] 0 2024-09-18T12:49:23.128 INFO:tasks.workunit.client.0.smithi078.stdout:6/659: dread d10/d2b/d43/d53/d63/d70/dac/f5f [0,4194304] 0 2024-09-18T12:49:23.128 INFO:tasks.workunit.client.1.smithi148.stdout:6/781: dread - d5/d32/fc0 zero size 2024-09-18T12:49:23.134 INFO:tasks.workunit.client.0.smithi078.stdout:4/549: dwrite d11/d27/d5a/f7d [0,4194304] 0 2024-09-18T12:49:23.135 INFO:tasks.workunit.client.1.smithi148.stdout:9/770: truncate d8/da/dd/d4a/d49/d46/f91 1673148 0 2024-09-18T12:49:23.136 INFO:tasks.workunit.client.0.smithi078.stdout:2/479: mknod d4/d20/c9f 0 2024-09-18T12:49:23.136 INFO:tasks.workunit.client.1.smithi148.stdout:0/943: creat de/da3/f13b x:0 0 0 2024-09-18T12:49:23.136 INFO:tasks.workunit.client.1.smithi148.stdout:9/771: chown d8/da/dd/d4a/d49/d46/d54/d90/fce 1 1 2024-09-18T12:49:23.137 INFO:tasks.workunit.client.0.smithi078.stdout:5/723: truncate d2/d4/d9/da/d2b/f63 2725219 0 2024-09-18T12:49:23.138 INFO:tasks.workunit.client.1.smithi148.stdout:8/859: sync 2024-09-18T12:49:23.139 INFO:tasks.workunit.client.1.smithi148.stdout:8/860: stat d8/c2b 0 2024-09-18T12:49:23.139 INFO:tasks.workunit.client.1.smithi148.stdout:3/717: creat d4/d8/d1e/d6b/d31/d46/ff7 x:0 0 0 2024-09-18T12:49:23.141 INFO:tasks.workunit.client.0.smithi078.stdout:6/660: rename d10/d2b/d43/d53/d63/d70/d7d/c9f to d10/d2b/d37/cd8 0 2024-09-18T12:49:23.142 INFO:tasks.workunit.client.0.smithi078.stdout:6/661: chown d10/d2b/d43/d53/d45/d55/f2d 19 1 2024-09-18T12:49:23.142 INFO:tasks.workunit.client.1.smithi148.stdout:0/944: dread de/d14/d43/d57/fb1 [0,4194304] 0 2024-09-18T12:49:23.143 INFO:tasks.workunit.client.1.smithi148.stdout:5/793: mknod d7/d8/dc/da6/dee/d39/c10f 0 2024-09-18T12:49:23.143 INFO:tasks.workunit.client.0.smithi078.stdout:6/662: fsync d10/d2b/d43/d53/f56 0 2024-09-18T12:49:23.144 INFO:tasks.workunit.client.0.smithi078.stdout:4/550: creat d11/d27/d47/d4e/d76/fb1 x:0 0 0 2024-09-18T12:49:23.144 INFO:tasks.workunit.client.1.smithi148.stdout:2/686: mkdir d9/d24/d31/df7 0 2024-09-18T12:49:23.145 INFO:tasks.workunit.client.0.smithi078.stdout:5/724: fdatasync d2/d74/fdb 0 2024-09-18T12:49:23.146 INFO:tasks.workunit.client.0.smithi078.stdout:6/663: fsync d10/d2b/d43/d53/d63/fc8 0 2024-09-18T12:49:23.148 INFO:tasks.workunit.client.1.smithi148.stdout:4/788: mknod d15/d17/d52/d92/d4c/d4f/d64/da0/c108 0 2024-09-18T12:49:23.149 INFO:tasks.workunit.client.1.smithi148.stdout:1/773: link dc/d18/d31/d39/f75 dc/d18/d8a/df1/f102 0 2024-09-18T12:49:23.151 INFO:tasks.workunit.client.0.smithi078.stdout:5/725: write d2/d4/f89 [861166,126272] 0 2024-09-18T12:49:23.153 INFO:tasks.workunit.client.0.smithi078.stdout:5/726: chown d2/d4/d9/da/d60/db3/d16/d36/db0/dde/d4d/fa2 58 1 2024-09-18T12:49:23.153 INFO:tasks.workunit.client.0.smithi078.stdout:4/551: rename d11/d27/d5a/d84/d40/la8 to d11/d27/d47/d78/d95/lb2 0 2024-09-18T12:49:23.154 INFO:tasks.workunit.client.0.smithi078.stdout:4/552: fdatasync d11/d27/d60/f68 0 2024-09-18T12:49:23.157 INFO:tasks.workunit.client.1.smithi148.stdout:9/772: symlink d8/da/dd/d65/db9/lea 0 2024-09-18T12:49:23.159 INFO:tasks.workunit.client.0.smithi078.stdout:6/664: rename d10/l7f to d10/d2b/d43/d53/d63/d70/d7d/ld9 0 2024-09-18T12:49:23.159 INFO:tasks.workunit.client.0.smithi078.stdout:5/727: dread d2/d4/d9/da/d60/db3/d16/d36/db0/dde/d4d/f9b [0,4194304] 0 2024-09-18T12:49:23.162 INFO:tasks.workunit.client.0.smithi078.stdout:2/480: dread d4/d8/d23/d52/d5f/d86/f60 [0,4194304] 0 2024-09-18T12:49:23.162 INFO:tasks.workunit.client.1.smithi148.stdout:3/718: symlink d4/d8/d20/d2b/d7f/lf8 0 2024-09-18T12:49:23.163 INFO:tasks.workunit.client.0.smithi078.stdout:4/553: dwrite d11/d27/d47/d4e/d76/fb1 [0,4194304] 0 2024-09-18T12:49:23.165 INFO:tasks.workunit.client.1.smithi148.stdout:5/794: creat d7/d8/d18/d3f/d7c/d7d/dbc/f110 x:0 0 0 2024-09-18T12:49:23.166 INFO:tasks.workunit.client.1.smithi148.stdout:5/795: stat d7/d2b/f3c 0 2024-09-18T12:49:23.168 INFO:tasks.workunit.client.1.smithi148.stdout:2/687: mknod d9/d24/d67/dc7/cf8 0 2024-09-18T12:49:23.171 INFO:tasks.workunit.client.0.smithi078.stdout:4/554: dwrite d11/d27/d5a/d5d/f90 [0,4194304] 0 2024-09-18T12:49:23.175 INFO:tasks.workunit.client.1.smithi148.stdout:4/789: unlink d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/c9e 0 2024-09-18T12:49:23.180 INFO:tasks.workunit.client.1.smithi148.stdout:8/861: rmdir d8/df/d3e/d82/d8f 39 2024-09-18T12:49:23.181 INFO:tasks.workunit.client.0.smithi078.stdout:2/481: creat d4/d20/d85/fa0 x:0 0 0 2024-09-18T12:49:23.182 INFO:tasks.workunit.client.1.smithi148.stdout:0/945: creat de/d112/f13c x:0 0 0 2024-09-18T12:49:23.184 INFO:tasks.workunit.client.0.smithi078.stdout:4/555: dread d11/d27/d89/d9f/fa2 [0,4194304] 0 2024-09-18T12:49:23.185 INFO:tasks.workunit.client.1.smithi148.stdout:9/773: dread d8/da/dd/d77/fe2 [0,4194304] 0 2024-09-18T12:49:23.185 INFO:tasks.workunit.client.0.smithi078.stdout:5/728: creat d2/d4/d9/da/d60/db3/d2d/dd3/fe4 x:0 0 0 2024-09-18T12:49:23.188 INFO:tasks.workunit.client.0.smithi078.stdout:4/556: creat d11/d27/d60/fb3 x:0 0 0 2024-09-18T12:49:23.188 INFO:tasks.workunit.client.0.smithi078.stdout:2/482: dwrite d4/d8/d23/f56 [4194304,4194304] 0 2024-09-18T12:49:23.189 INFO:tasks.workunit.client.1.smithi148.stdout:2/688: read d9/d3a/f75 [396867,103533] 0 2024-09-18T12:49:23.193 INFO:tasks.workunit.client.1.smithi148.stdout:4/790: creat d15/d17/d52/d92/d4c/d72/f109 x:0 0 0 2024-09-18T12:49:23.195 INFO:tasks.workunit.client.1.smithi148.stdout:7/772: sync 2024-09-18T12:49:23.195 INFO:tasks.workunit.client.0.smithi078.stdout:4/557: symlink d11/d27/d47/d4e/lb4 0 2024-09-18T12:49:23.196 INFO:tasks.workunit.client.0.smithi078.stdout:4/558: fsync d11/f61 0 2024-09-18T12:49:23.196 INFO:tasks.workunit.client.0.smithi078.stdout:4/559: chown d11/d45/c74 0 1 2024-09-18T12:49:23.197 INFO:tasks.workunit.client.1.smithi148.stdout:0/946: rename de/d14/d43/d70/f90 to de/d27/db3/f13d 0 2024-09-18T12:49:23.199 INFO:tasks.workunit.client.1.smithi148.stdout:1/774: dwrite dc/d9f/df5/fa6 [0,4194304] 0 2024-09-18T12:49:23.199 INFO:tasks.workunit.client.0.smithi078.stdout:5/729: truncate d2/d4/d9/da/d2b/f63 672229 0 2024-09-18T12:49:23.201 INFO:tasks.workunit.client.1.smithi148.stdout:9/774: chown d8/l5f 26545 1 2024-09-18T12:49:23.202 INFO:tasks.workunit.client.0.smithi078.stdout:4/560: mknod d11/d27/d5a/cb5 0 2024-09-18T12:49:23.203 INFO:tasks.workunit.client.1.smithi148.stdout:4/791: dwrite d15/d17/d52/d92/f2e [0,4194304] 0 2024-09-18T12:49:23.203 INFO:tasks.workunit.client.1.smithi148.stdout:3/719: write d4/d8/d1e/d6b/d31/f34 [3508186,92707] 0 2024-09-18T12:49:23.204 INFO:tasks.workunit.client.0.smithi078.stdout:5/730: symlink d2/d4/d9/da/d2b/d3e/le5 0 2024-09-18T12:49:23.206 INFO:tasks.workunit.client.0.smithi078.stdout:6/665: dwrite d10/d2b/d43/f8f [0,4194304] 0 2024-09-18T12:49:23.207 INFO:tasks.workunit.client.1.smithi148.stdout:6/782: getdents d5/d32 0 2024-09-18T12:49:23.211 INFO:tasks.workunit.client.1.smithi148.stdout:8/862: creat d8/d16/d27/dc5/dee/dfe/df3/d11e/f126 x:0 0 0 2024-09-18T12:49:23.215 INFO:tasks.workunit.client.0.smithi078.stdout:5/731: dwrite d2/d4/d58/fb2 [0,4194304] 0 2024-09-18T12:49:23.216 INFO:tasks.workunit.client.1.smithi148.stdout:7/773: chown db/dc/df/d2c/d66/c9e 0 1 2024-09-18T12:49:23.217 INFO:tasks.workunit.client.0.smithi078.stdout:2/483: dread d4/d8/d23/d52/d5f/d86/d3b/d4f/f57 [0,4194304] 0 2024-09-18T12:49:23.219 INFO:tasks.workunit.client.1.smithi148.stdout:3/720: mknod d4/d8/d20/d2b/d43/cf9 0 2024-09-18T12:49:23.219 INFO:tasks.workunit.client.1.smithi148.stdout:5/796: dwrite d7/d8/f83 [0,4194304] 0 2024-09-18T12:49:23.219 INFO:tasks.workunit.client.1.smithi148.stdout:4/792: dwrite d15/d17/d52/d92/d4c/dd0/fea [0,4194304] 0 2024-09-18T12:49:23.221 INFO:tasks.workunit.client.0.smithi078.stdout:2/484: stat d4/d8/d23/d52/d5f/d86/d3b/l77 0 2024-09-18T12:49:23.222 INFO:tasks.workunit.client.1.smithi148.stdout:6/783: unlink d5/d1a/fd1 0 2024-09-18T12:49:23.222 INFO:tasks.workunit.client.0.smithi078.stdout:6/666: creat d10/d2b/d43/d53/d63/d70/dac/fda x:0 0 0 2024-09-18T12:49:23.224 INFO:tasks.workunit.client.0.smithi078.stdout:4/561: link d11/d27/d47/d4e/d50/c53 d11/d27/d5a/d84/cb6 0 2024-09-18T12:49:23.227 INFO:tasks.workunit.client.0.smithi078.stdout:5/732: dwrite d2/d4/f89 [0,4194304] 0 2024-09-18T12:49:23.228 INFO:tasks.workunit.client.1.smithi148.stdout:8/863: unlink d8/d12/d51/d94/cdf 0 2024-09-18T12:49:23.232 INFO:tasks.workunit.client.0.smithi078.stdout:2/485: dwrite d4/d1a/f43 [0,4194304] 0 2024-09-18T12:49:23.235 INFO:tasks.workunit.client.1.smithi148.stdout:2/689: write d9/d3a/faf [561986,62860] 0 2024-09-18T12:49:23.236 INFO:tasks.workunit.client.1.smithi148.stdout:7/774: rmdir db/dc/df/d1d 39 2024-09-18T12:49:23.239 INFO:tasks.workunit.client.0.smithi078.stdout:6/667: mkdir d10/d2b/d43/d53/d63/d70/d7d/ddb 0 2024-09-18T12:49:23.240 INFO:tasks.workunit.client.1.smithi148.stdout:3/721: creat d4/d8/d20/d2b/d7f/d93/dd1/ffa x:0 0 0 2024-09-18T12:49:23.240 INFO:tasks.workunit.client.0.smithi078.stdout:4/562: symlink d11/d27/d89/d9f/lb7 0 2024-09-18T12:49:23.244 INFO:tasks.workunit.client.1.smithi148.stdout:8/864: rmdir d8/d12/d46/d74/dd5 39 2024-09-18T12:49:23.244 INFO:tasks.workunit.client.1.smithi148.stdout:8/865: readlink d8/d16/d53/d39/d3b/la3 0 2024-09-18T12:49:23.246 INFO:tasks.workunit.client.0.smithi078.stdout:2/486: dwrite d4/dd/f8b [0,4194304] 0 2024-09-18T12:49:23.247 INFO:tasks.workunit.client.1.smithi148.stdout:5/797: creat d7/d8/dc/da6/dee/d25/d4b/d102/f111 x:0 0 0 2024-09-18T12:49:23.248 INFO:tasks.workunit.client.0.smithi078.stdout:4/563: mknod d11/d27/d47/d4e/d50/cb8 0 2024-09-18T12:49:23.250 INFO:tasks.workunit.client.0.smithi078.stdout:4/564: stat d11/f1d 0 2024-09-18T12:49:23.250 INFO:tasks.workunit.client.0.smithi078.stdout:5/733: dwrite d2/d4/d48/fbf [0,4194304] 0 2024-09-18T12:49:23.254 INFO:tasks.workunit.client.1.smithi148.stdout:6/784: creat d5/d1a/dc/d2b/d35/d65/d99/da3/ffc x:0 0 0 2024-09-18T12:49:23.255 INFO:tasks.workunit.client.1.smithi148.stdout:1/775: dwrite dc/d51/f70 [0,4194304] 0 2024-09-18T12:49:23.257 INFO:tasks.workunit.client.0.smithi078.stdout:6/668: dwrite d10/d2b/dbd/fcf [0,4194304] 0 2024-09-18T12:49:23.259 INFO:tasks.workunit.client.1.smithi148.stdout:7/775: getdents db/dc/df/d11/ddc/d75 0 2024-09-18T12:49:23.261 INFO:tasks.workunit.client.1.smithi148.stdout:7/776: write db/fbe [22389,114649] 0 2024-09-18T12:49:23.263 INFO:tasks.workunit.client.1.smithi148.stdout:9/775: sync 2024-09-18T12:49:23.265 INFO:tasks.workunit.client.0.smithi078.stdout:4/565: dwrite d11/d27/d47/d78/d95/fad [0,4194304] 0 2024-09-18T12:49:23.265 INFO:tasks.workunit.client.0.smithi078.stdout:5/734: creat d2/d4/d9/da/d60/db3/d16/d36/db0/fe6 x:0 0 0 2024-09-18T12:49:23.270 INFO:tasks.workunit.client.1.smithi148.stdout:3/722: mknod d4/d8/d20/d2b/d7f/d93/d94/dac/cfb 0 2024-09-18T12:49:23.270 INFO:tasks.workunit.client.1.smithi148.stdout:8/866: dwrite d8/d12/d46/d74/dd5/f10c [0,4194304] 0 2024-09-18T12:49:23.272 INFO:tasks.workunit.client.1.smithi148.stdout:5/798: read d7/d8/f59 [1143449,122464] 0 2024-09-18T12:49:23.274 INFO:tasks.workunit.client.0.smithi078.stdout:5/735: write d2/d4/d48/f4e [2541650,123653] 0 2024-09-18T12:49:23.276 INFO:tasks.workunit.client.0.smithi078.stdout:5/736: write d2/d4/d9/d2f/d30/fa5 [321960,44429] 0 2024-09-18T12:49:23.276 INFO:tasks.workunit.client.0.smithi078.stdout:2/487: getdents d4/d1a 0 2024-09-18T12:49:23.279 INFO:tasks.workunit.client.0.smithi078.stdout:2/488: chown d4/db/f68 2 1 2024-09-18T12:49:23.281 INFO:tasks.workunit.client.1.smithi148.stdout:9/776: truncate d8/da/dd/d4a/f3a 1588544 0 2024-09-18T12:49:23.282 INFO:tasks.workunit.client.1.smithi148.stdout:8/867: creat d8/d16/d27/dc5/dee/dfe/df8/f127 x:0 0 0 2024-09-18T12:49:23.283 INFO:tasks.workunit.client.1.smithi148.stdout:5/799: readlink d7/d8/dc/da6/dee/d69/d8b/dad/laf 0 2024-09-18T12:49:23.284 INFO:tasks.workunit.client.1.smithi148.stdout:7/777: mknod db/dc/df/d11/dac/ce8 0 2024-09-18T12:49:23.285 INFO:tasks.workunit.client.1.smithi148.stdout:2/690: link d9/d17/d29/d92/d95/f38 d9/d17/d29/d92/d95/d9b/ff9 0 2024-09-18T12:49:23.286 INFO:tasks.workunit.client.0.smithi078.stdout:2/489: dwrite d4/d8/d23/d52/d5f/d86/d3b/d55/f59 [4194304,4194304] 0 2024-09-18T12:49:23.289 INFO:tasks.workunit.client.1.smithi148.stdout:9/777: dwrite d8/d33/fa5 [0,4194304] 0 2024-09-18T12:49:23.292 INFO:tasks.workunit.client.1.smithi148.stdout:3/723: creat d4/ffc x:0 0 0 2024-09-18T12:49:23.293 INFO:tasks.workunit.client.1.smithi148.stdout:0/947: write de/f94 [832186,111991] 0 2024-09-18T12:49:23.294 INFO:tasks.workunit.client.0.smithi078.stdout:2/490: dwrite d4/db/f1c [4194304,4194304] 0 2024-09-18T12:49:23.294 INFO:tasks.workunit.client.1.smithi148.stdout:0/948: fsync de/d27/d53/d89/fce 0 2024-09-18T12:49:23.295 INFO:tasks.workunit.client.1.smithi148.stdout:0/949: stat de/d27/d7a/f92 0 2024-09-18T12:49:23.296 INFO:tasks.workunit.client.0.smithi078.stdout:2/491: write d4/d8/d23/d52/d5f/d86/d33/f73 [2260990,10105] 0 2024-09-18T12:49:23.297 INFO:tasks.workunit.client.1.smithi148.stdout:6/785: dread d5/f23 [4194304,4194304] 0 2024-09-18T12:49:23.301 INFO:tasks.workunit.client.1.smithi148.stdout:2/691: dread d9/d3a/d90/f60 [0,4194304] 0 2024-09-18T12:49:23.303 INFO:tasks.workunit.client.1.smithi148.stdout:9/778: dread d8/da/dd/d35/d81/f9e [0,4194304] 0 2024-09-18T12:49:23.303 INFO:tasks.workunit.client.1.smithi148.stdout:5/800: rename d7/d8/dc/da6/dee/d69/d8b/dad/fe2 to d7/d8/d18/d3f/f112 0 2024-09-18T12:49:23.303 INFO:tasks.workunit.client.1.smithi148.stdout:0/950: symlink de/d27/d2e/d114/l13e 0 2024-09-18T12:49:23.304 INFO:tasks.workunit.client.1.smithi148.stdout:0/951: stat de/d14/d43/d57/fe5 0 2024-09-18T12:49:23.307 INFO:tasks.workunit.client.0.smithi078.stdout:2/492: rename d4/d8/d23/d52/f5a to d4/dd/fa1 0 2024-09-18T12:49:23.308 INFO:tasks.workunit.client.1.smithi148.stdout:9/779: mknod d8/da/dd/d3f/ceb 0 2024-09-18T12:49:23.309 INFO:tasks.workunit.client.1.smithi148.stdout:6/786: mknod d5/d1a/dc/d2b/d35/d65/d99/da4/cfd 0 2024-09-18T12:49:23.309 INFO:tasks.workunit.client.1.smithi148.stdout:2/692: symlink d9/d24/lfa 0 2024-09-18T12:49:23.310 INFO:tasks.workunit.client.1.smithi148.stdout:6/787: read - d5/d32/d56/fde zero size 2024-09-18T12:49:23.311 INFO:tasks.workunit.client.0.smithi078.stdout:2/493: rename d4/d8/d23/d52/d5f/d86/d3b/d55/f59 to d4/d8/fa2 0 2024-09-18T12:49:23.311 INFO:tasks.workunit.client.1.smithi148.stdout:9/780: truncate d8/da/dd/d4a/d49/d46/d54/faa 5820902 0 2024-09-18T12:49:23.312 INFO:tasks.workunit.client.1.smithi148.stdout:0/952: rename de/d112/f13c to de/d27/d53/d89/dc1/f13f 0 2024-09-18T12:49:23.312 INFO:tasks.workunit.client.0.smithi078.stdout:2/494: write d4/d8/d23/f9e [763402,111645] 0 2024-09-18T12:49:23.312 INFO:tasks.workunit.client.1.smithi148.stdout:9/781: read d8/da/f4d [542398,58065] 0 2024-09-18T12:49:23.313 INFO:tasks.workunit.client.0.smithi078.stdout:2/495: chown d4/d8/d23/d52/d5f/d86/d3b/d55 109 1 2024-09-18T12:49:23.316 INFO:tasks.workunit.client.1.smithi148.stdout:9/782: creat d8/da/dd/d77/dd8/fec x:0 0 0 2024-09-18T12:49:23.316 INFO:tasks.workunit.client.0.smithi078.stdout:2/496: creat d4/d8/d6c/d70/fa3 x:0 0 0 2024-09-18T12:49:23.319 INFO:tasks.workunit.client.0.smithi078.stdout:2/497: chown d4/d8/d23/d52/d7c/f82 14477227 1 2024-09-18T12:49:23.320 INFO:tasks.workunit.client.1.smithi148.stdout:4/793: truncate d15/d17/d52/f66 385184 0 2024-09-18T12:49:23.320 INFO:tasks.workunit.client.0.smithi078.stdout:2/498: readlink d4/d8/d23/d52/d5f/d86/d33/l9c 0 2024-09-18T12:49:23.321 INFO:tasks.workunit.client.0.smithi078.stdout:2/499: read - d4/d8/d23/d52/d5f/d86/d33/f72 zero size 2024-09-18T12:49:23.323 INFO:tasks.workunit.client.1.smithi148.stdout:4/794: creat d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/f10a x:0 0 0 2024-09-18T12:49:23.324 INFO:tasks.workunit.client.1.smithi148.stdout:3/724: dread d4/d8/d1e/d79/d92/f5f [0,4194304] 0 2024-09-18T12:49:23.325 INFO:tasks.workunit.client.0.smithi078.stdout:6/669: write d10/d2b/d43/d53/d63/d70/d77/f7e [978801,127896] 0 2024-09-18T12:49:23.325 INFO:tasks.workunit.client.0.smithi078.stdout:2/500: creat d4/fa4 x:0 0 0 2024-09-18T12:49:23.325 INFO:tasks.workunit.client.1.smithi148.stdout:6/788: dread f3 [0,4194304] 0 2024-09-18T12:49:23.327 INFO:tasks.workunit.client.0.smithi078.stdout:6/670: mkdir d10/d2b/d61/dd7/ddc 0 2024-09-18T12:49:23.328 INFO:tasks.workunit.client.1.smithi148.stdout:6/789: mknod d5/d1a/d3d/cfe 0 2024-09-18T12:49:23.329 INFO:tasks.workunit.client.0.smithi078.stdout:6/671: chown d10/d2b/d43/d53/d63/l8e 12988768 1 2024-09-18T12:49:23.329 INFO:tasks.workunit.client.0.smithi078.stdout:2/501: dread d4/d8/d23/d52/d5f/d86/f3c [0,4194304] 0 2024-09-18T12:49:23.330 INFO:tasks.workunit.client.0.smithi078.stdout:6/672: write d10/d2b/d43/d53/d63/d70/d7d/fd0 [978927,40809] 0 2024-09-18T12:49:23.331 INFO:tasks.workunit.client.0.smithi078.stdout:2/502: truncate d4/dd/fa1 4966674 0 2024-09-18T12:49:23.333 INFO:tasks.workunit.client.1.smithi148.stdout:1/776: write dc/f57 [1693388,35395] 0 2024-09-18T12:49:23.334 INFO:tasks.workunit.client.0.smithi078.stdout:4/566: truncate d11/d27/d5a/d84/d40/f8b 3016807 0 2024-09-18T12:49:23.340 INFO:tasks.workunit.client.0.smithi078.stdout:2/503: getdents d4/d8/d23/d52/d5f/d86 0 2024-09-18T12:49:23.340 INFO:tasks.workunit.client.0.smithi078.stdout:5/737: truncate d2/d4/d9/da/d60/d7f/fba 5792839 0 2024-09-18T12:49:23.343 INFO:tasks.workunit.client.1.smithi148.stdout:2/693: dread d9/d24/d47/f5e [0,4194304] 0 2024-09-18T12:49:23.343 INFO:tasks.workunit.client.0.smithi078.stdout:4/567: dwrite d11/f55 [0,4194304] 0 2024-09-18T12:49:23.343 INFO:tasks.workunit.client.0.smithi078.stdout:2/504: fsync d4/d8/d23/d52/d5f/d86/d33/f72 0 2024-09-18T12:49:23.348 INFO:tasks.workunit.client.1.smithi148.stdout:0/953: getdents de/d112 0 2024-09-18T12:49:23.348 INFO:tasks.workunit.client.1.smithi148.stdout:1/777: dread dc/d9f/ff2 [4194304,4194304] 0 2024-09-18T12:49:23.348 INFO:tasks.workunit.client.0.smithi078.stdout:4/568: symlink d11/d27/d5a/lb9 0 2024-09-18T12:49:23.349 INFO:tasks.workunit.client.0.smithi078.stdout:2/505: unlink d4/db/dc/l2c 0 2024-09-18T12:49:23.353 INFO:tasks.workunit.client.1.smithi148.stdout:2/694: dwrite d9/d17/d29/d92/d95/fac [0,4194304] 0 2024-09-18T12:49:23.353 INFO:tasks.workunit.client.1.smithi148.stdout:1/778: write dc/d18/d7d/d7e/fe8 [1447810,117936] 0 2024-09-18T12:49:23.355 INFO:tasks.workunit.client.1.smithi148.stdout:1/779: fdatasync dc/d9f/fbb 0 2024-09-18T12:49:23.357 INFO:tasks.workunit.client.1.smithi148.stdout:9/783: dwrite d8/da/dd/d3f/f58 [0,4194304] 0 2024-09-18T12:49:23.360 INFO:tasks.workunit.client.1.smithi148.stdout:2/695: dread d9/d24/d31/f83 [0,4194304] 0 2024-09-18T12:49:23.378 INFO:tasks.workunit.client.1.smithi148.stdout:8/868: sync 2024-09-18T12:49:23.396 INFO:tasks.workunit.client.0.smithi078.stdout:1/514: sync 2024-09-18T12:49:23.397 INFO:tasks.workunit.client.0.smithi078.stdout:7/421: sync 2024-09-18T12:49:23.402 INFO:tasks.workunit.client.1.smithi148.stdout:0/954: creat de/da3/f140 x:0 0 0 2024-09-18T12:49:23.405 INFO:tasks.workunit.client.0.smithi078.stdout:2/506: rename d4/dd/l6a to d4/d8/d6c/d70/la5 0 2024-09-18T12:49:23.406 INFO:tasks.workunit.client.0.smithi078.stdout:2/507: chown d4/d1a/f2e 1520408819 1 2024-09-18T12:49:23.409 INFO:tasks.workunit.client.1.smithi148.stdout:6/790: dwrite d5/d32/d38/f54 [4194304,4194304] 0 2024-09-18T12:49:23.409 INFO:tasks.workunit.client.1.smithi148.stdout:6/791: chown d5/d32/d56/dfb 247 1 2024-09-18T12:49:23.411 INFO:tasks.workunit.client.1.smithi148.stdout:1/780: chown dc/d18/d7d/d93/dd9/c29 12682 1 2024-09-18T12:49:23.411 INFO:tasks.workunit.client.0.smithi078.stdout:1/515: symlink d0/d8/da/d3e/d50/d60/la3 0 2024-09-18T12:49:23.413 INFO:tasks.workunit.client.0.smithi078.stdout:5/738: getdents d2/d4/d9/da/d60/d61 0 2024-09-18T12:49:23.415 INFO:tasks.workunit.client.0.smithi078.stdout:1/516: symlink d0/d8/da/d3e/d58/d6e/d52/la4 0 2024-09-18T12:49:23.417 INFO:tasks.workunit.client.0.smithi078.stdout:5/739: symlink d2/d4/d9/da/d60/d61/le7 0 2024-09-18T12:49:23.418 INFO:tasks.workunit.client.1.smithi148.stdout:0/955: mknod de/d14/d43/c141 0 2024-09-18T12:49:23.419 INFO:tasks.workunit.client.0.smithi078.stdout:1/517: mknod d0/d8/da/d3e/d58/d6e/ca5 0 2024-09-18T12:49:23.422 INFO:tasks.workunit.client.0.smithi078.stdout:5/740: creat d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/d90/fe8 x:0 0 0 2024-09-18T12:49:23.423 INFO:tasks.workunit.client.0.smithi078.stdout:4/569: write d11/d27/d47/d4e/d76/f7e [4862918,66455] 0 2024-09-18T12:49:23.425 INFO:tasks.workunit.client.0.smithi078.stdout:1/518: read d0/d8/f2b [1405816,33292] 0 2024-09-18T12:49:23.425 INFO:tasks.workunit.client.1.smithi148.stdout:9/784: creat d8/da/dd/d3f/d5d/fed x:0 0 0 2024-09-18T12:49:23.425 INFO:tasks.workunit.client.0.smithi078.stdout:4/570: truncate d11/d27/d5a/d5d/f88 1935525 0 2024-09-18T12:49:23.427 INFO:tasks.workunit.client.1.smithi148.stdout:1/781: dread dc/d18/d7d/d93/dd9/f21 [0,4194304] 0 2024-09-18T12:49:23.428 INFO:tasks.workunit.client.0.smithi078.stdout:1/519: truncate d0/d8/da/d3e/d58/d6e/d52/f78 708208 0 2024-09-18T12:49:23.429 INFO:tasks.workunit.client.0.smithi078.stdout:5/741: rename d2/d4/d9/dc0/lcf to d2/d4/d9/da/d60/d95/le9 0 2024-09-18T12:49:23.430 INFO:tasks.workunit.client.1.smithi148.stdout:8/869: getdents d8/d16/d53/d39/def/d11d 0 2024-09-18T12:49:23.430 INFO:tasks.workunit.client.0.smithi078.stdout:5/742: stat d2/d4/d9/d2f/d30/f5f 0 2024-09-18T12:49:23.431 INFO:tasks.workunit.client.0.smithi078.stdout:5/743: readlink d2/d4/d9/da/d2b/l2e 0 2024-09-18T12:49:23.431 INFO:tasks.workunit.client.1.smithi148.stdout:0/956: creat de/d27/d53/d89/dc0/db0/f142 x:0 0 0 2024-09-18T12:49:23.433 INFO:tasks.workunit.client.1.smithi148.stdout:2/696: write d9/d24/f80 [772681,52173] 0 2024-09-18T12:49:23.434 INFO:tasks.workunit.client.1.smithi148.stdout:6/792: mkdir d5/d1a/dc/d2b/d35/d65/dff 0 2024-09-18T12:49:23.435 INFO:tasks.workunit.client.0.smithi078.stdout:5/744: dread d2/d4/d58/fb2 [0,4194304] 0 2024-09-18T12:49:23.437 INFO:tasks.workunit.client.0.smithi078.stdout:2/508: dread d4/f5 [0,4194304] 0 2024-09-18T12:49:23.437 INFO:tasks.workunit.client.0.smithi078.stdout:4/571: truncate d11/d27/d5a/f79 4091821 0 2024-09-18T12:49:23.439 INFO:tasks.workunit.client.1.smithi148.stdout:9/785: mkdir d8/da/dd/d35/d81/db7/dee 0 2024-09-18T12:49:23.444 INFO:tasks.workunit.client.1.smithi148.stdout:0/957: dread de/d14/d43/f5e [0,4194304] 0 2024-09-18T12:49:23.445 INFO:tasks.workunit.client.0.smithi078.stdout:2/509: dwrite d4/d20/f29 [0,4194304] 0 2024-09-18T12:49:23.446 INFO:tasks.workunit.client.0.smithi078.stdout:4/572: dwrite d11/d27/d5a/d84/f72 [0,4194304] 0 2024-09-18T12:49:23.447 INFO:tasks.workunit.client.0.smithi078.stdout:2/510: write d4/db/d45/f8f [711608,44838] 0 2024-09-18T12:49:23.448 INFO:tasks.workunit.client.1.smithi148.stdout:2/697: write d9/d24/d67/d72/d77/fd9 [1027835,18809] 0 2024-09-18T12:49:23.451 INFO:tasks.workunit.client.0.smithi078.stdout:5/745: rename d2/d74/fdb to d2/d4/d9/da/d60/db3/d16/d36/db0/dde/dbd/fea 0 2024-09-18T12:49:23.453 INFO:tasks.workunit.client.0.smithi078.stdout:5/746: readlink d2/d4/d9/d2f/d30/ldf 0 2024-09-18T12:49:23.453 INFO:tasks.workunit.client.1.smithi148.stdout:9/786: mknod d8/d33/cef 0 2024-09-18T12:49:23.455 INFO:tasks.workunit.client.0.smithi078.stdout:5/747: fsync d2/d4/d9/da/d60/db3/d16/d36/f5c 0 2024-09-18T12:49:23.455 INFO:tasks.workunit.client.1.smithi148.stdout:7/778: sync 2024-09-18T12:49:23.455 INFO:tasks.workunit.client.1.smithi148.stdout:5/801: sync 2024-09-18T12:49:23.456 INFO:tasks.workunit.client.0.smithi078.stdout:2/511: dread d4/d8/d23/d52/d5f/d86/d3b/d4f/f61 [0,4194304] 0 2024-09-18T12:49:23.456 INFO:tasks.workunit.client.0.smithi078.stdout:1/520: link d0/d8/da/f23 d0/d8/da/d45/fa6 0 2024-09-18T12:49:23.456 INFO:tasks.workunit.client.1.smithi148.stdout:1/782: truncate dc/d18/d7d/d93/dd9/d2b/fef 944010 0 2024-09-18T12:49:23.457 INFO:tasks.workunit.client.1.smithi148.stdout:7/779: dread - db/d52/d4f/fc7 zero size 2024-09-18T12:49:23.460 INFO:tasks.workunit.client.1.smithi148.stdout:8/870: rename d8/d16/d27/dc5/dee/dfe/df8/l120 to d8/df/d3e/d82/d8f/d95/l128 0 2024-09-18T12:49:23.462 INFO:tasks.workunit.client.1.smithi148.stdout:0/958: mkdir de/d27/d53/d89/d129/d143 0 2024-09-18T12:49:23.463 INFO:tasks.workunit.client.1.smithi148.stdout:6/793: mknod d5/d1a/c100 0 2024-09-18T12:49:23.464 INFO:tasks.workunit.client.1.smithi148.stdout:7/780: dwrite db/dc/fc2 [0,4194304] 0 2024-09-18T12:49:23.464 INFO:tasks.workunit.client.1.smithi148.stdout:5/802: dread d7/d8/dc/da6/dee/d69/f73 [0,4194304] 0 2024-09-18T12:49:23.465 INFO:tasks.workunit.client.0.smithi078.stdout:2/512: creat d4/d8/d23/fa6 x:0 0 0 2024-09-18T12:49:23.465 INFO:tasks.workunit.client.0.smithi078.stdout:1/521: rmdir d0/d8/da/d3e/d58/d6e/d52 39 2024-09-18T12:49:23.467 INFO:tasks.workunit.client.0.smithi078.stdout:1/522: chown d0/d8/da/d45/f8e 186 1 2024-09-18T12:49:23.468 INFO:tasks.workunit.client.1.smithi148.stdout:8/871: chown d8/d16/c116 14 1 2024-09-18T12:49:23.476 INFO:tasks.workunit.client.0.smithi078.stdout:5/748: getdents d2/d4/d48/d86 0 2024-09-18T12:49:23.477 INFO:tasks.workunit.client.0.smithi078.stdout:5/749: fsync d2/d4/d9/d2f/f99 0 2024-09-18T12:49:23.478 INFO:tasks.workunit.client.0.smithi078.stdout:5/750: readlink d2/d4/d9/da/d60/db3/l3b 0 2024-09-18T12:49:23.479 INFO:tasks.workunit.client.0.smithi078.stdout:5/751: stat d2/d4/d9/da/d60/db3/f81 0 2024-09-18T12:49:23.479 INFO:tasks.workunit.client.1.smithi148.stdout:6/794: truncate d5/d32/f58 385279 0 2024-09-18T12:49:23.481 INFO:tasks.workunit.client.1.smithi148.stdout:7/781: symlink db/dc/df/d11/dac/le9 0 2024-09-18T12:49:23.482 INFO:tasks.workunit.client.0.smithi078.stdout:5/752: rmdir d2/d4/d9/da/d60/db3/d16/d36/d4c 39 2024-09-18T12:49:23.484 INFO:tasks.workunit.client.1.smithi148.stdout:5/803: mknod d7/d8/dc/d12/d20/c113 0 2024-09-18T12:49:23.486 INFO:tasks.workunit.client.0.smithi078.stdout:5/753: creat d2/d4/d9/da/d60/d7f/feb x:0 0 0 2024-09-18T12:49:23.486 INFO:tasks.workunit.client.0.smithi078.stdout:1/523: dread d0/f49 [0,4194304] 0 2024-09-18T12:49:23.486 INFO:tasks.workunit.client.1.smithi148.stdout:0/959: dread de/f24 [0,4194304] 0 2024-09-18T12:49:23.487 INFO:tasks.workunit.client.0.smithi078.stdout:5/754: write d2/d4/f8 [4073622,52061] 0 2024-09-18T12:49:23.487 INFO:tasks.workunit.client.1.smithi148.stdout:7/782: dwrite db/dc/df/d11/d34/f76 [0,4194304] 0 2024-09-18T12:49:23.489 INFO:tasks.workunit.client.1.smithi148.stdout:8/872: creat d8/d16/d53/da0/dba/f129 x:0 0 0 2024-09-18T12:49:23.489 INFO:tasks.workunit.client.1.smithi148.stdout:9/787: truncate d8/d73/fc8 1436031 0 2024-09-18T12:49:23.491 INFO:tasks.workunit.client.1.smithi148.stdout:2/698: creat d9/ffb x:0 0 0 2024-09-18T12:49:23.494 INFO:tasks.workunit.client.1.smithi148.stdout:1/783: rmdir dc/d18/d8a/de4 0 2024-09-18T12:49:23.495 INFO:tasks.workunit.client.1.smithi148.stdout:0/960: rmdir de 39 2024-09-18T12:49:23.496 INFO:tasks.workunit.client.1.smithi148.stdout:1/784: stat dc/d18/d31/d4b/d8d/c9a 0 2024-09-18T12:49:23.497 INFO:tasks.workunit.client.1.smithi148.stdout:2/699: unlink d9/c65 0 2024-09-18T12:49:23.497 INFO:tasks.workunit.client.1.smithi148.stdout:8/873: dwrite d8/d16/d53/da0/dba/f129 [0,4194304] 0 2024-09-18T12:49:23.499 INFO:tasks.workunit.client.1.smithi148.stdout:3/725: sync 2024-09-18T12:49:23.499 INFO:tasks.workunit.client.1.smithi148.stdout:4/795: sync 2024-09-18T12:49:23.500 INFO:tasks.workunit.client.0.smithi078.stdout:5/755: dread d2/d4/d9/da/d60/db3/d16/d36/db0/dde/d4d/fa2 [0,4194304] 0 2024-09-18T12:49:23.500 INFO:tasks.workunit.client.1.smithi148.stdout:9/788: truncate d8/d33/f42 74594 0 2024-09-18T12:49:23.501 INFO:tasks.workunit.client.0.smithi078.stdout:5/756: chown d2/d4/d9/da/d60/db3/f8e 23 1 2024-09-18T12:49:23.503 INFO:tasks.workunit.client.1.smithi148.stdout:6/795: rename d5/d1a/dc/d2b/d35/d65/d99 to d5/d1a/dc/d101 0 2024-09-18T12:49:23.503 INFO:tasks.workunit.client.1.smithi148.stdout:2/700: readlink d9/l14 0 2024-09-18T12:49:23.506 INFO:tasks.workunit.client.1.smithi148.stdout:1/785: creat dc/d11/d38/d72/f103 x:0 0 0 2024-09-18T12:49:23.507 INFO:tasks.workunit.client.1.smithi148.stdout:0/961: dwrite de/d14/d43/d57/d59/f11a [0,4194304] 0 2024-09-18T12:49:23.507 INFO:tasks.workunit.client.1.smithi148.stdout:8/874: mknod d8/d16/d27/c12a 0 2024-09-18T12:49:23.508 INFO:tasks.workunit.client.1.smithi148.stdout:0/962: chown de/d27/d53/d89/dca/ffb 110003923 1 2024-09-18T12:49:23.509 INFO:tasks.workunit.client.0.smithi078.stdout:1/524: dread d0/d5b/d6d/f80 [0,4194304] 0 2024-09-18T12:49:23.509 INFO:tasks.workunit.client.1.smithi148.stdout:0/963: chown de/f55 9565503 1 2024-09-18T12:49:23.516 INFO:tasks.workunit.client.0.smithi078.stdout:1/525: write d0/d8/da/d3e/d58/d6e/d52/d47/f8a [518376,16729] 0 2024-09-18T12:49:23.518 INFO:tasks.workunit.client.0.smithi078.stdout:1/526: dread - d0/d8/da/d3e/d58/d6e/fa2 zero size 2024-09-18T12:49:23.518 INFO:tasks.workunit.client.1.smithi148.stdout:3/726: truncate d4/d8/d1e/d6b/f4a 675312 0 2024-09-18T12:49:23.518 INFO:tasks.workunit.client.1.smithi148.stdout:3/727: stat d4/d8/d1e/c6f 0 2024-09-18T12:49:23.522 INFO:tasks.workunit.client.1.smithi148.stdout:6/796: write d5/d32/d38/d50/de7/f8d [1240482,40112] 0 2024-09-18T12:49:23.522 INFO:tasks.workunit.client.1.smithi148.stdout:2/701: symlink d9/d24/d31/d34/lfc 0 2024-09-18T12:49:23.524 INFO:tasks.workunit.client.1.smithi148.stdout:1/786: mknod dc/d5b/da5/c104 0 2024-09-18T12:49:23.526 INFO:tasks.workunit.client.1.smithi148.stdout:8/875: mknod d8/d16/d53/da0/dba/c12b 0 2024-09-18T12:49:23.528 INFO:tasks.workunit.client.1.smithi148.stdout:3/728: dwrite d4/d8/d6a/db3/db7/dcb/fe0 [0,4194304] 0 2024-09-18T12:49:23.529 INFO:tasks.workunit.client.1.smithi148.stdout:2/702: truncate d9/d73/fde 854194 0 2024-09-18T12:49:23.531 INFO:tasks.workunit.client.1.smithi148.stdout:7/783: rename db/dc/df/d11/f1b to db/dc/df/d11/db3/fea 0 2024-09-18T12:49:23.533 INFO:tasks.workunit.client.0.smithi078.stdout:5/757: truncate d2/d4/d9/da/d60/db3/d16/d36/db0/dde/d4d/fa2 252692 0 2024-09-18T12:49:23.535 INFO:tasks.workunit.client.1.smithi148.stdout:5/804: dwrite d7/d8/f3e [0,4194304] 0 2024-09-18T12:49:23.539 INFO:tasks.workunit.client.1.smithi148.stdout:7/784: chown db/dc/df/d2c/d55/daf/d38/fd2 138479892 1 2024-09-18T12:49:23.541 INFO:tasks.workunit.client.1.smithi148.stdout:8/876: creat d8/d16/d53/da0/f12c x:0 0 0 2024-09-18T12:49:23.542 INFO:tasks.workunit.client.1.smithi148.stdout:6/797: dwrite d5/d32/d38/d50/de7/d7c/fdc [0,4194304] 0 2024-09-18T12:49:23.544 INFO:tasks.workunit.client.0.smithi078.stdout:5/758: symlink d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/dc1/lec 0 2024-09-18T12:49:23.544 INFO:tasks.workunit.client.1.smithi148.stdout:3/729: mkdir d4/d8/d20/d99/dfd 0 2024-09-18T12:49:23.545 INFO:tasks.workunit.client.1.smithi148.stdout:0/964: rename de/d27/d53/d89/dbb/db5/fb7 to de/d27/d53/d89/dc0/db0/d12b/f144 0 2024-09-18T12:49:23.546 INFO:tasks.workunit.client.0.smithi078.stdout:5/759: write d2/d4/f4f [5226181,25244] 0 2024-09-18T12:49:23.546 INFO:tasks.workunit.client.1.smithi148.stdout:2/703: mknod d9/d17/d29/d92/dca/cfd 0 2024-09-18T12:49:23.546 INFO:tasks.workunit.client.1.smithi148.stdout:9/789: write d8/da/dd/d35/d47/fa4 [831168,27965] 0 2024-09-18T12:49:23.547 INFO:tasks.workunit.client.0.smithi078.stdout:1/527: dread d0/d8/da/d3e/d58/d6e/d52/d47/f69 [0,4194304] 0 2024-09-18T12:49:23.548 INFO:tasks.workunit.client.1.smithi148.stdout:1/787: mkdir dc/d18/d7d/d93/dd9/d105 0 2024-09-18T12:49:23.549 INFO:tasks.workunit.client.1.smithi148.stdout:3/730: write d4/d8/d20/d2b/d7f/d93/dd1/ffa [936362,86854] 0 2024-09-18T12:49:23.550 INFO:tasks.workunit.client.1.smithi148.stdout:1/788: chown dc/d18/d31/d4b/d8d 135 1 2024-09-18T12:49:23.551 INFO:tasks.workunit.client.1.smithi148.stdout:2/704: dread - d9/d17/d29/d92/d95/d9b/fef zero size 2024-09-18T12:49:23.552 INFO:tasks.workunit.client.1.smithi148.stdout:5/805: dwrite d7/d8/dc/da6/dee/d39/dd5/fdb [0,4194304] 0 2024-09-18T12:49:23.552 INFO:tasks.workunit.client.1.smithi148.stdout:4/796: truncate d15/d17/d52/d101/fc2 1684368 0 2024-09-18T12:49:23.555 INFO:tasks.workunit.client.0.smithi078.stdout:1/528: mkdir d0/d8/da/d3e/d50/da7 0 2024-09-18T12:49:23.559 INFO:tasks.workunit.client.0.smithi078.stdout:1/529: mknod d0/d8/da/d3e/d58/ca8 0 2024-09-18T12:49:23.565 INFO:tasks.workunit.client.0.smithi078.stdout:1/530: link d0/d8/da/d45/c98 d0/ca9 0 2024-09-18T12:49:23.566 INFO:tasks.workunit.client.0.smithi078.stdout:1/531: mkdir d0/d8/daa 0 2024-09-18T12:49:23.568 INFO:tasks.workunit.client.1.smithi148.stdout:8/877: unlink d8/d16/d53/ldd 0 2024-09-18T12:49:23.569 INFO:tasks.workunit.client.1.smithi148.stdout:7/785: dread - db/dc/df/d1d/d68/d82/fdf zero size 2024-09-18T12:49:23.570 INFO:tasks.workunit.client.0.smithi078.stdout:1/532: creat d0/d8/da/d3e/d58/d6e/fab x:0 0 0 2024-09-18T12:49:23.570 INFO:tasks.workunit.client.1.smithi148.stdout:8/878: stat d8/d16/d53/cfc 0 2024-09-18T12:49:23.571 INFO:tasks.workunit.client.1.smithi148.stdout:7/786: chown db/dc/df/d2c/l9c 1332 1 2024-09-18T12:49:23.572 INFO:tasks.workunit.client.0.smithi078.stdout:1/533: write d0/f49 [5172936,41677] 0 2024-09-18T12:49:23.573 INFO:tasks.workunit.client.0.smithi078.stdout:1/534: chown d0/d8/da/d3e/d58/d6e/f7a 985 1 2024-09-18T12:49:23.574 INFO:tasks.workunit.client.1.smithi148.stdout:4/797: mkdir d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d10b 0 2024-09-18T12:49:23.575 INFO:tasks.workunit.client.0.smithi078.stdout:1/535: write d0/d8/da/f8d [432883,124265] 0 2024-09-18T12:49:23.577 INFO:tasks.workunit.client.1.smithi148.stdout:5/806: creat d7/d8/dc/da6/dee/d77/f114 x:0 0 0 2024-09-18T12:49:23.578 INFO:tasks.workunit.client.1.smithi148.stdout:1/789: truncate dc/d18/d31/d4b/d8d/fb8 267926 0 2024-09-18T12:49:23.579 INFO:tasks.workunit.client.0.smithi078.stdout:1/536: mknod d0/d8/da/d3e/d50/cac 0 2024-09-18T12:49:23.582 INFO:tasks.workunit.client.0.smithi078.stdout:5/760: write d2/d4/d9/da/d2b/f69 [1398621,56315] 0 2024-09-18T12:49:23.583 INFO:tasks.workunit.client.0.smithi078.stdout:1/537: creat d0/fad x:0 0 0 2024-09-18T12:49:23.583 INFO:tasks.workunit.client.1.smithi148.stdout:0/965: dread de/d27/f45 [0,4194304] 0 2024-09-18T12:49:23.584 INFO:tasks.workunit.client.1.smithi148.stdout:8/879: creat d8/df/d3e/d82/d8f/f12d x:0 0 0 2024-09-18T12:49:23.584 INFO:tasks.workunit.client.1.smithi148.stdout:0/966: chown de/d14/d43/d57/c78 98 1 2024-09-18T12:49:23.584 INFO:tasks.workunit.client.1.smithi148.stdout:8/880: fsync d8/d16/f9c 0 2024-09-18T12:49:23.586 INFO:tasks.workunit.client.1.smithi148.stdout:7/787: rename db/dc/df/d2c/d55/daf/d38/f3f to db/dc/df/d2c/feb 0 2024-09-18T12:49:23.586 INFO:tasks.workunit.client.1.smithi148.stdout:7/788: readlink db/dc/df/l7f 0 2024-09-18T12:49:23.589 INFO:tasks.workunit.client.0.smithi078.stdout:5/761: dwrite d2/d4/d9/d2f/d30/f80 [0,4194304] 0 2024-09-18T12:49:23.591 INFO:tasks.workunit.client.1.smithi148.stdout:3/731: creat d4/d8/d20/d2b/d7f/d93/ffe x:0 0 0 2024-09-18T12:49:23.591 INFO:tasks.workunit.client.1.smithi148.stdout:6/798: write d5/f28 [1423124,118158] 0 2024-09-18T12:49:23.593 INFO:tasks.workunit.client.1.smithi148.stdout:7/789: dwrite db/dc/df/d11/d43/fc0 [0,4194304] 0 2024-09-18T12:49:23.593 INFO:tasks.workunit.client.0.smithi078.stdout:1/538: creat d0/d8/da/d3e/d58/d6e/d8c/d9d/fae x:0 0 0 2024-09-18T12:49:23.594 INFO:tasks.workunit.client.1.smithi148.stdout:2/705: link d9/d24/d47/f5e d9/d17/d29/d92/dca/ffe 0 2024-09-18T12:49:23.602 INFO:tasks.workunit.client.0.smithi078.stdout:1/539: symlink d0/d8/da/d3e/laf 0 2024-09-18T12:49:23.606 INFO:tasks.workunit.client.0.smithi078.stdout:1/540: rmdir d0/d8/da/d3e/d50/d74 39 2024-09-18T12:49:23.609 INFO:tasks.workunit.client.1.smithi148.stdout:6/799: creat d5/d32/d38/d50/f102 x:0 0 0 2024-09-18T12:49:23.610 INFO:tasks.workunit.client.0.smithi078.stdout:1/541: dread d0/d8/f3f [0,4194304] 0 2024-09-18T12:49:23.612 INFO:tasks.workunit.client.1.smithi148.stdout:3/732: creat d4/d8/d6a/db3/db7/dcb/fff x:0 0 0 2024-09-18T12:49:23.616 INFO:tasks.workunit.client.0.smithi078.stdout:1/542: mkdir d0/d8/da/db0 0 2024-09-18T12:49:23.617 INFO:tasks.workunit.client.1.smithi148.stdout:0/967: fsync de/f9b 0 2024-09-18T12:49:23.618 INFO:tasks.workunit.client.1.smithi148.stdout:1/790: dwrite dc/d18/d7d/fb3 [0,4194304] 0 2024-09-18T12:49:23.620 INFO:tasks.workunit.client.1.smithi148.stdout:3/733: rmdir d4/d8/d1e/d63 39 2024-09-18T12:49:23.621 INFO:tasks.workunit.client.0.smithi078.stdout:1/543: dread d0/d8/da/d3e/d58/d6e/d52/d47/f8a [0,4194304] 0 2024-09-18T12:49:23.621 INFO:tasks.workunit.client.1.smithi148.stdout:4/798: write d15/d17/d52/f66 [356632,11976] 0 2024-09-18T12:49:23.623 INFO:tasks.workunit.client.0.smithi078.stdout:5/762: dwrite d2/d4/d9/da/d60/db3/d16/d36/db0/dde/d4d/f9b [0,4194304] 0 2024-09-18T12:49:23.625 INFO:tasks.workunit.client.0.smithi078.stdout:1/544: fdatasync d0/d8/da/d3e/d58/d6e/d52/d47/d7d/d7f/f94 0 2024-09-18T12:49:23.627 INFO:tasks.workunit.client.0.smithi078.stdout:1/545: chown d0/d8/da/d3e/d58/d6e/d52/f6f 1946295 1 2024-09-18T12:49:23.628 INFO:tasks.workunit.client.1.smithi148.stdout:8/881: dread d8/fb [0,4194304] 0 2024-09-18T12:49:23.628 INFO:tasks.workunit.client.1.smithi148.stdout:0/968: dwrite de/d27/d2e/f73 [0,4194304] 0 2024-09-18T12:49:23.628 INFO:tasks.workunit.client.0.smithi078.stdout:1/546: dread - d0/d8/da/d3e/d58/d6e/d52/f30 zero size 2024-09-18T12:49:23.630 INFO:tasks.workunit.client.1.smithi148.stdout:5/807: rename d7/d8/dc/da6/dee/l27 to d7/l115 0 2024-09-18T12:49:23.631 INFO:tasks.workunit.client.1.smithi148.stdout:5/808: write d7/d8/f87 [871738,62557] 0 2024-09-18T12:49:23.632 INFO:tasks.workunit.client.0.smithi078.stdout:1/547: mknod d0/d8/da/d3e/d58/d6e/d52/cb1 0 2024-09-18T12:49:23.633 INFO:tasks.workunit.client.0.smithi078.stdout:1/548: dread - d0/fad zero size 2024-09-18T12:49:23.634 INFO:tasks.workunit.client.1.smithi148.stdout:2/706: rmdir d9/d17/d29/d92/d95/dd6 0 2024-09-18T12:49:23.634 INFO:tasks.workunit.client.1.smithi148.stdout:3/734: rmdir d4/d8/d1e 39 2024-09-18T12:49:23.635 INFO:tasks.workunit.client.1.smithi148.stdout:5/809: write d7/d8/dc/f28 [110372,92047] 0 2024-09-18T12:49:23.636 INFO:tasks.workunit.client.1.smithi148.stdout:5/810: chown d7/d8/dc/ffe 1574799 1 2024-09-18T12:49:23.637 INFO:tasks.workunit.client.1.smithi148.stdout:8/882: readlink d8/l23 0 2024-09-18T12:49:23.638 INFO:tasks.workunit.client.0.smithi078.stdout:1/549: mkdir d0/d5b/db2 0 2024-09-18T12:49:23.638 INFO:tasks.workunit.client.1.smithi148.stdout:0/969: fsync de/d27/d53/d89/dca/fec 0 2024-09-18T12:49:23.641 INFO:tasks.workunit.client.1.smithi148.stdout:0/970: chown de/d112 68319434 1 2024-09-18T12:49:23.642 INFO:tasks.workunit.client.0.smithi078.stdout:1/550: rename d0/fad to d0/d5b/db2/fb3 0 2024-09-18T12:49:23.643 INFO:tasks.workunit.client.1.smithi148.stdout:0/971: truncate de/d14/ffd 488289 0 2024-09-18T12:49:23.644 INFO:tasks.workunit.client.1.smithi148.stdout:3/735: dwrite d4/d8/d20/d2b/d43/f97 [4194304,4194304] 0 2024-09-18T12:49:23.647 INFO:tasks.workunit.client.0.smithi078.stdout:5/763: truncate d2/d4/d9/da/d2b/f69 461687 0 2024-09-18T12:49:23.649 INFO:tasks.workunit.client.0.smithi078.stdout:5/764: write d2/d4/d9/d2f/d30/f85 [380093,125383] 0 2024-09-18T12:49:23.654 INFO:tasks.workunit.client.0.smithi078.stdout:5/765: write d2/d4/d9/da/d60/db3/d2d/fc9 [809396,129771] 0 2024-09-18T12:49:23.655 INFO:tasks.workunit.client.1.smithi148.stdout:0/972: creat de/d27/d2e/d114/f145 x:0 0 0 2024-09-18T12:49:23.656 INFO:tasks.workunit.client.0.smithi078.stdout:1/551: dwrite d0/d8/da/d3e/d58/d6e/d52/d47/f8a [0,4194304] 0 2024-09-18T12:49:23.656 INFO:tasks.workunit.client.0.smithi078.stdout:5/766: fdatasync d2/d4/d9/da/f7a 0 2024-09-18T12:49:23.656 INFO:tasks.workunit.client.1.smithi148.stdout:0/973: chown de/c96 0 1 2024-09-18T12:49:23.658 INFO:tasks.workunit.client.1.smithi148.stdout:3/736: mkdir d4/d8/d6a/db3/db7/dcb/d100 0 2024-09-18T12:49:23.659 INFO:tasks.workunit.client.0.smithi078.stdout:5/767: write d2/d4/d9/da/d60/db3/d16/d36/fcc [347944,21209] 0 2024-09-18T12:49:23.659 INFO:tasks.workunit.client.1.smithi148.stdout:6/800: rename d5/d1a/dc/f6d to d5/d1a/dc/d101/f103 0 2024-09-18T12:49:23.660 INFO:tasks.workunit.client.1.smithi148.stdout:5/811: dwrite d7/d8/dc/d12/f51 [0,4194304] 0 2024-09-18T12:49:23.662 INFO:tasks.workunit.client.1.smithi148.stdout:5/812: dread - d7/d8/dc/da6/dee/d77/fbb zero size 2024-09-18T12:49:23.663 INFO:tasks.workunit.client.0.smithi078.stdout:1/552: symlink d0/d8/da/d3e/d58/d6e/d52/d47/d7d/lb4 0 2024-09-18T12:49:23.663 INFO:tasks.workunit.client.1.smithi148.stdout:9/790: sync 2024-09-18T12:49:23.665 INFO:tasks.workunit.client.1.smithi148.stdout:9/791: fsync d8/da/dd/d4a/fdd 0 2024-09-18T12:49:23.668 INFO:tasks.workunit.client.1.smithi148.stdout:0/974: symlink de/d27/d53/d89/d9d/l146 0 2024-09-18T12:49:23.670 INFO:tasks.workunit.client.1.smithi148.stdout:1/791: rename dc/d18/d31/d4b/f6d to dc/d18/d31/dc6/f106 0 2024-09-18T12:49:23.671 INFO:tasks.workunit.client.0.smithi078.stdout:8/449: sync 2024-09-18T12:49:23.672 INFO:tasks.workunit.client.0.smithi078.stdout:1/553: dwrite d0/d8/da/d3e/d58/d6e/f5a [0,4194304] 0 2024-09-18T12:49:23.674 INFO:tasks.workunit.client.0.smithi078.stdout:9/531: sync 2024-09-18T12:49:23.674 INFO:tasks.workunit.client.0.smithi078.stdout:3/489: sync 2024-09-18T12:49:23.674 INFO:tasks.workunit.client.0.smithi078.stdout:0/610: sync 2024-09-18T12:49:23.674 INFO:tasks.workunit.client.0.smithi078.stdout:5/768: getdents d2/d4/d9/da/d60/db3/d16/d36/d68 0 2024-09-18T12:49:23.675 INFO:tasks.workunit.client.0.smithi078.stdout:9/532: write f3 [1030140,45169] 0 2024-09-18T12:49:23.677 INFO:tasks.workunit.client.1.smithi148.stdout:8/883: write d8/d12/d46/d7e/da1/ff1 [866581,46780] 0 2024-09-18T12:49:23.677 INFO:tasks.workunit.client.0.smithi078.stdout:8/450: dread - d0/d7/f4d zero size 2024-09-18T12:49:23.677 INFO:tasks.workunit.client.1.smithi148.stdout:6/801: creat d5/d1a/dc/d101/da4/de2/f104 x:0 0 0 2024-09-18T12:49:23.680 INFO:tasks.workunit.client.1.smithi148.stdout:4/799: rename d15/d17/d52/d92/d4c/d4f/d64/da0/da1/lfd to d15/d17/d52/d92/d4c/d72/db3/l10c 0 2024-09-18T12:49:23.681 INFO:tasks.workunit.client.1.smithi148.stdout:1/792: creat dc/d11/d38/d72/f107 x:0 0 0 2024-09-18T12:49:23.681 INFO:tasks.workunit.client.1.smithi148.stdout:6/802: write d5/d1a/dc/d2b/d35/d65/f5e [4726553,73065] 0 2024-09-18T12:49:23.683 INFO:tasks.workunit.client.1.smithi148.stdout:6/803: fsync d5/d32/f76 0 2024-09-18T12:49:23.683 INFO:tasks.workunit.client.1.smithi148.stdout:3/737: creat d4/d8/d1e/d63/d9b/f101 x:0 0 0 2024-09-18T12:49:23.685 INFO:tasks.workunit.client.1.smithi148.stdout:0/975: rename de/d14/d43/fc7 to de/d27/d53/d89/d9d/f147 0 2024-09-18T12:49:23.686 INFO:tasks.workunit.client.0.smithi078.stdout:1/554: mkdir d0/d8/daa/db5 0 2024-09-18T12:49:23.687 INFO:tasks.workunit.client.0.smithi078.stdout:1/555: chown d0/d8/da/d3e/d58/d6e/d52/d47/d7d/d7f 362 1 2024-09-18T12:49:23.687 INFO:tasks.workunit.client.1.smithi148.stdout:0/976: truncate de/d27/d53/d89/dbb/f50 5254941 0 2024-09-18T12:49:23.687 INFO:tasks.workunit.client.0.smithi078.stdout:8/451: mknod d0/d7/d1e/d50/c8b 0 2024-09-18T12:49:23.688 INFO:tasks.workunit.client.1.smithi148.stdout:0/977: write de/d27/d2e/d114/f103 [992611,4866] 0 2024-09-18T12:49:23.689 INFO:tasks.workunit.client.1.smithi148.stdout:4/800: creat d15/d17/d52/d68/da5/f10d x:0 0 0 2024-09-18T12:49:23.691 INFO:tasks.workunit.client.0.smithi078.stdout:5/769: rename d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/d90/fe8 to d2/d4/d9/da/d60/fed 0 2024-09-18T12:49:23.692 INFO:tasks.workunit.client.0.smithi078.stdout:0/611: mkdir d3/d1f/d2e/d68/de1 0 2024-09-18T12:49:23.693 INFO:tasks.workunit.client.0.smithi078.stdout:1/556: dwrite d0/f19 [0,4194304] 0 2024-09-18T12:49:23.694 INFO:tasks.workunit.client.0.smithi078.stdout:5/770: chown d2/d4/d9/da/d60/db3/d16/d36/db0/dde/d4d/c50 1654770936 1 2024-09-18T12:49:23.695 INFO:tasks.workunit.client.1.smithi148.stdout:4/801: dwrite d15/d17/f19 [0,4194304] 0 2024-09-18T12:49:23.698 INFO:tasks.workunit.client.1.smithi148.stdout:3/738: symlink d4/d8/d20/d2b/d7f/d93/d94/dac/l102 0 2024-09-18T12:49:23.702 INFO:tasks.workunit.client.1.smithi148.stdout:3/739: chown d4/d8/d1e/d6b/d31/d46/ff7 0 1 2024-09-18T12:49:23.706 INFO:tasks.workunit.client.1.smithi148.stdout:3/740: write d4/d8/d20/d2b/fb4 [2932609,109000] 0 2024-09-18T12:49:23.706 INFO:tasks.workunit.client.0.smithi078.stdout:0/612: rename d3/d43/d7f to d3/d1f/d2e/d68/d30/d7c/da3/de2 0 2024-09-18T12:49:23.707 INFO:tasks.workunit.client.1.smithi148.stdout:6/804: symlink d5/d1a/dc/d2b/d35/d65/dff/l105 0 2024-09-18T12:49:23.708 INFO:tasks.workunit.client.0.smithi078.stdout:5/771: write d2/d4/f1e [299720,109106] 0 2024-09-18T12:49:23.709 INFO:tasks.workunit.client.1.smithi148.stdout:4/802: readlink l14 0 2024-09-18T12:49:23.711 INFO:tasks.workunit.client.1.smithi148.stdout:1/793: dread dc/d5b/da5/fbe [0,4194304] 0 2024-09-18T12:49:23.713 INFO:tasks.workunit.client.1.smithi148.stdout:5/813: dwrite d7/d8/dc/da6/dee/d25/fa7 [0,4194304] 0 2024-09-18T12:49:23.713 INFO:tasks.workunit.client.1.smithi148.stdout:4/803: chown d15/d17/d52/d92/d4c/d72/db3 1389 1 2024-09-18T12:49:23.714 INFO:tasks.workunit.client.0.smithi078.stdout:3/490: dread d9/d13/f5f [0,4194304] 0 2024-09-18T12:49:23.715 INFO:tasks.workunit.client.1.smithi148.stdout:6/805: chown d5/d1a/dc/d2b/cec 297 1 2024-09-18T12:49:23.715 INFO:tasks.workunit.client.1.smithi148.stdout:8/884: dread d8/d12/d46/d7e/fcc [0,4194304] 0 2024-09-18T12:49:23.716 INFO:tasks.workunit.client.0.smithi078.stdout:0/613: creat d3/d1f/d2e/d68/d30/fe3 x:0 0 0 2024-09-18T12:49:23.718 INFO:tasks.workunit.client.0.smithi078.stdout:0/614: write d3/d1f/d2e/d4e/d37/d72/fae [150104,85265] 0 2024-09-18T12:49:23.720 INFO:tasks.workunit.client.1.smithi148.stdout:3/741: rename d4/d8/d1e/d79/f84 to d4/d8/d1e/d63/d9b/f103 0 2024-09-18T12:49:23.721 INFO:tasks.workunit.client.0.smithi078.stdout:0/615: dread d3/d1f/d2e/d8f/fbd [0,4194304] 0 2024-09-18T12:49:23.721 INFO:tasks.workunit.client.0.smithi078.stdout:5/772: truncate d2/f26 4641360 0 2024-09-18T12:49:23.722 INFO:tasks.workunit.client.1.smithi148.stdout:3/742: dread - d4/d8/d20/d2b/d43/fbb zero size 2024-09-18T12:49:23.723 INFO:tasks.workunit.client.1.smithi148.stdout:3/743: write d4/d8/d20/d2b/d7f/d93/ffe [1001477,77639] 0 2024-09-18T12:49:23.724 INFO:tasks.workunit.client.1.smithi148.stdout:1/794: mknod dc/d11/c108 0 2024-09-18T12:49:23.725 INFO:tasks.workunit.client.1.smithi148.stdout:5/814: symlink d7/d8/dc/da6/dee/d39/dc2/dd2/l116 0 2024-09-18T12:49:23.726 INFO:tasks.workunit.client.1.smithi148.stdout:5/815: read - d7/d8/dc/da6/dee/d77/fbb zero size 2024-09-18T12:49:23.727 INFO:tasks.workunit.client.1.smithi148.stdout:5/816: fdatasync d7/d8/dc/d12/d31/d5a/fc9 0 2024-09-18T12:49:23.727 INFO:tasks.workunit.client.0.smithi078.stdout:3/491: mkdir d9/d13/d33/d34/d97 0 2024-09-18T12:49:23.728 INFO:tasks.workunit.client.1.smithi148.stdout:0/978: write de/d14/f1f [1321826,125744] 0 2024-09-18T12:49:23.729 INFO:tasks.workunit.client.0.smithi078.stdout:9/533: dwrite d5/f5e [0,4194304] 0 2024-09-18T12:49:23.730 INFO:tasks.workunit.client.1.smithi148.stdout:0/979: readlink de/l40 0 2024-09-18T12:49:23.730 INFO:tasks.workunit.client.1.smithi148.stdout:8/885: mkdir d8/df/d3e/d82/d8f/d95/d12e 0 2024-09-18T12:49:23.730 INFO:tasks.workunit.client.1.smithi148.stdout:8/886: chown d8/d12/d46 1 1 2024-09-18T12:49:23.730 INFO:tasks.workunit.client.1.smithi148.stdout:6/806: dread d5/d1a/dc/d2b/d9b/f9e [0,4194304] 0 2024-09-18T12:49:23.732 INFO:tasks.workunit.client.0.smithi078.stdout:3/492: write d9/d13/d33/d3c/d19/f22 [3303393,47393] 0 2024-09-18T12:49:23.732 INFO:tasks.workunit.client.1.smithi148.stdout:0/980: write de/d27/d53/d89/dbb/f54 [547368,105724] 0 2024-09-18T12:49:23.733 INFO:tasks.workunit.client.1.smithi148.stdout:0/981: chown de/d27/d53/d89/dc0/f11b 30 1 2024-09-18T12:49:23.733 INFO:tasks.workunit.client.0.smithi078.stdout:1/557: getdents d0/d5b/db2 0 2024-09-18T12:49:23.737 INFO:tasks.workunit.client.0.smithi078.stdout:5/773: mknod d2/d4/d9/da/d60/d7f/cee 0 2024-09-18T12:49:23.738 INFO:tasks.workunit.client.0.smithi078.stdout:8/452: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:49:23.741 INFO:tasks.workunit.client.0.smithi078.stdout:5/774: write d2/d4/d9/d2f/d30/f59 [3328989,90086] 0 2024-09-18T12:49:23.743 INFO:tasks.workunit.client.1.smithi148.stdout:8/887: rmdir d8/df/db2 39 2024-09-18T12:49:23.746 INFO:tasks.workunit.client.0.smithi078.stdout:1/558: unlink d0/d8/da/d3e/f96 0 2024-09-18T12:49:23.747 INFO:tasks.workunit.client.0.smithi078.stdout:9/534: dwrite d5/d7/d32/d2a/d68/d97/fa6 [0,4194304] 0 2024-09-18T12:49:23.748 INFO:tasks.workunit.client.1.smithi148.stdout:6/807: creat d5/d1a/dc/d101/da4/de2/f106 x:0 0 0 2024-09-18T12:49:23.750 INFO:tasks.workunit.client.1.smithi148.stdout:0/982: mkdir de/d27/d53/d89/d148 0 2024-09-18T12:49:23.750 INFO:tasks.workunit.client.1.smithi148.stdout:8/888: dwrite d8/d16/fde [0,4194304] 0 2024-09-18T12:49:23.752 INFO:tasks.workunit.client.1.smithi148.stdout:8/889: stat d8/df/d3e/d82/d8f/d95/d12e 0 2024-09-18T12:49:23.753 INFO:tasks.workunit.client.1.smithi148.stdout:1/795: rename dc/d11/d38/d72/fba to dc/d18/d7d/d93/f109 0 2024-09-18T12:49:23.758 INFO:tasks.workunit.client.0.smithi078.stdout:0/616: dread d3/d1f/f67 [0,4194304] 0 2024-09-18T12:49:23.759 INFO:tasks.workunit.client.1.smithi148.stdout:7/790: sync 2024-09-18T12:49:23.761 INFO:tasks.workunit.client.0.smithi078.stdout:5/775: rename d2/d4/d9/da/d60/db3/d16/l76 to d2/d4/d9/d49/lef 0 2024-09-18T12:49:23.764 INFO:tasks.workunit.client.0.smithi078.stdout:1/559: creat d0/fb6 x:0 0 0 2024-09-18T12:49:23.765 INFO:tasks.workunit.client.0.smithi078.stdout:1/560: fdatasync d0/f6c 0 2024-09-18T12:49:23.768 INFO:tasks.workunit.client.1.smithi148.stdout:5/817: write d7/d8/dc/da6/dee/d69/f73 [666365,122834] 0 2024-09-18T12:49:23.768 INFO:tasks.workunit.client.1.smithi148.stdout:3/744: getdents d4/d8/d20/d2b/d7f/dd9 0 2024-09-18T12:49:23.769 INFO:tasks.workunit.client.1.smithi148.stdout:3/745: readlink d4/d8/d20/d2b/d7f/lcf 0 2024-09-18T12:49:23.770 INFO:tasks.workunit.client.1.smithi148.stdout:7/791: creat db/dc/df/d11/dcc/fec x:0 0 0 2024-09-18T12:49:23.770 INFO:tasks.workunit.client.1.smithi148.stdout:3/746: write d4/d8/d1e/d6b/fd0 [570295,88714] 0 2024-09-18T12:49:23.773 INFO:tasks.workunit.client.1.smithi148.stdout:8/890: mkdir d8/d16/dff/d12f 0 2024-09-18T12:49:23.775 INFO:tasks.workunit.client.1.smithi148.stdout:6/808: rename d5/d1a/dc/d2b/d35/d65/lbd to d5/d1a/dc/d2b/de9/l107 0 2024-09-18T12:49:23.776 INFO:tasks.workunit.client.1.smithi148.stdout:6/809: stat d5/d1a/dc/d2b 0 2024-09-18T12:49:23.777 INFO:tasks.workunit.client.1.smithi148.stdout:8/891: fsync d8/d12/d46/f58 0 2024-09-18T12:49:23.779 INFO:tasks.workunit.client.1.smithi148.stdout:0/983: rename de/d14/d10c to de/d27/d53/d89/d148/d149 0 2024-09-18T12:49:23.780 INFO:tasks.workunit.client.1.smithi148.stdout:7/792: unlink fa 0 2024-09-18T12:49:23.781 INFO:tasks.workunit.client.1.smithi148.stdout:8/892: fdatasync d8/d16/f7a 0 2024-09-18T12:49:23.786 INFO:tasks.workunit.client.1.smithi148.stdout:6/810: rename d5/d32/d38/d50/f59 to d5/d1a/d29/d5c/f108 0 2024-09-18T12:49:23.788 INFO:tasks.workunit.client.1.smithi148.stdout:7/793: read db/dc/df/d2c/d55/f8b [3743119,82124] 0 2024-09-18T12:49:23.789 INFO:tasks.workunit.client.1.smithi148.stdout:1/796: dread dc/d9f/df5/f9d [0,4194304] 0 2024-09-18T12:49:23.792 INFO:tasks.workunit.client.1.smithi148.stdout:0/984: dwrite de/d27/d53/d89/dbb/dc8/f111 [0,4194304] 0 2024-09-18T12:49:23.796 INFO:tasks.workunit.client.1.smithi148.stdout:8/893: dwrite d8/d12/d51/d94/f64 [0,4194304] 0 2024-09-18T12:49:23.798 INFO:tasks.workunit.client.1.smithi148.stdout:5/818: dwrite d7/d8/f59 [0,4194304] 0 2024-09-18T12:49:23.807 INFO:tasks.workunit.client.1.smithi148.stdout:3/747: getdents d4/d8/d1e/d6b/d31/d60/da9/d8b 0 2024-09-18T12:49:23.809 INFO:tasks.workunit.client.1.smithi148.stdout:1/797: mknod dc/d18/d63/c10a 0 2024-09-18T12:49:23.811 INFO:tasks.workunit.client.1.smithi148.stdout:0/985: unlink de/d14/f3d 0 2024-09-18T12:49:23.811 INFO:tasks.workunit.client.1.smithi148.stdout:8/894: dread - d8/d16/d53/d39/d3b/d4e/f96 zero size 2024-09-18T12:49:23.812 INFO:tasks.workunit.client.1.smithi148.stdout:6/811: mkdir d5/d32/d56/dfb/d109 0 2024-09-18T12:49:23.814 INFO:tasks.workunit.client.1.smithi148.stdout:5/819: symlink d7/d8/dc/d12/d20/d10d/l117 0 2024-09-18T12:49:23.815 INFO:tasks.workunit.client.1.smithi148.stdout:3/748: rename d4/d8/d1e/d6b/f4a to d4/d8/d6a/db3/db7/dcb/d100/f104 0 2024-09-18T12:49:23.815 INFO:tasks.workunit.client.1.smithi148.stdout:1/798: mkdir dc/d18/d10b 0 2024-09-18T12:49:23.816 INFO:tasks.workunit.client.1.smithi148.stdout:1/799: fdatasync dc/d18/d7d/d93/fd4 0 2024-09-18T12:49:23.816 INFO:tasks.workunit.client.1.smithi148.stdout:5/820: symlink d7/d8/dc/d12/d20/l118 0 2024-09-18T12:49:23.817 INFO:tasks.workunit.client.1.smithi148.stdout:6/812: dread d5/d1a/dc/d2b/d9b/f9e [0,4194304] 0 2024-09-18T12:49:23.818 INFO:tasks.workunit.client.1.smithi148.stdout:6/813: stat d5/c84 0 2024-09-18T12:49:23.819 INFO:tasks.workunit.client.1.smithi148.stdout:0/986: rename de/d27/d53/d89/dbb/f41 to de/f14a 0 2024-09-18T12:49:23.835 INFO:tasks.workunit.client.1.smithi148.stdout:2/707: sync 2024-09-18T12:49:23.837 INFO:tasks.workunit.client.0.smithi078.stdout:0/617: dwrite d3/d1f/d2e/d4e/f98 [0,4194304] 0 2024-09-18T12:49:23.838 INFO:tasks.workunit.client.0.smithi078.stdout:3/493: write d9/d13/d63/d78/f79 [755370,64043] 0 2024-09-18T12:49:23.840 INFO:tasks.workunit.client.0.smithi078.stdout:8/453: dread d0/d7/dc/f3c [0,4194304] 0 2024-09-18T12:49:23.851 INFO:tasks.workunit.client.1.smithi148.stdout:5/821: symlink d7/d8/dc/d12/d20/d10d/l119 0 2024-09-18T12:49:23.852 INFO:tasks.workunit.client.1.smithi148.stdout:6/814: creat d5/d1a/dc/dbf/dcb/f10a x:0 0 0 2024-09-18T12:49:23.854 INFO:tasks.workunit.client.1.smithi148.stdout:7/794: dread db/dc/df/d2c/d55/daf/f48 [0,4194304] 0 2024-09-18T12:49:23.856 INFO:tasks.workunit.client.1.smithi148.stdout:1/800: dwrite dc/d4d/dad/db1/fc0 [4194304,4194304] 0 2024-09-18T12:49:23.857 INFO:tasks.workunit.client.1.smithi148.stdout:5/822: creat d7/d8/dc/f11a x:0 0 0 2024-09-18T12:49:23.858 INFO:tasks.workunit.client.0.smithi078.stdout:3/494: write d9/d29/f24 [6050422,26126] 0 2024-09-18T12:49:23.861 INFO:tasks.workunit.client.0.smithi078.stdout:5/776: symlink d2/d4/d9/da/d60/db3/d16/d36/d4c/d97/lf0 0 2024-09-18T12:49:23.862 INFO:tasks.workunit.client.0.smithi078.stdout:5/777: write d2/d4/fae [484522,10368] 0 2024-09-18T12:49:23.863 INFO:tasks.workunit.client.1.smithi148.stdout:7/795: dwrite db/dc/df/d11/f6b [0,4194304] 0 2024-09-18T12:49:23.871 INFO:tasks.workunit.client.1.smithi148.stdout:8/895: rename d8/d16/d53/d39/d3b/d4e/l75 to d8/df/l130 0 2024-09-18T12:49:23.873 INFO:tasks.workunit.client.1.smithi148.stdout:5/823: dread d7/f15 [0,4194304] 0 2024-09-18T12:49:23.875 INFO:tasks.workunit.client.1.smithi148.stdout:1/801: creat dc/d18/d31/d4b/d8d/ddd/f10c x:0 0 0 2024-09-18T12:49:23.877 INFO:tasks.workunit.client.1.smithi148.stdout:0/987: rename de/f1e to de/d27/d7a/f14b 0 2024-09-18T12:49:23.880 INFO:tasks.workunit.client.0.smithi078.stdout:8/454: dread d0/d7/f2c [0,4194304] 0 2024-09-18T12:49:23.881 INFO:tasks.workunit.client.1.smithi148.stdout:7/796: dwrite db/dc/df/d2c/feb [0,4194304] 0 2024-09-18T12:49:23.881 INFO:tasks.workunit.client.1.smithi148.stdout:5/824: mkdir d7/d8/dc/d12/d20/d10d/d11b 0 2024-09-18T12:49:23.883 INFO:tasks.workunit.client.0.smithi078.stdout:1/561: link d0/c15 d0/d5b/db2/cb7 0 2024-09-18T12:49:23.884 INFO:tasks.workunit.client.0.smithi078.stdout:5/778: symlink d2/d4/d9/da/d60/db3/d16/d36/db0/dde/lf1 0 2024-09-18T12:49:23.888 INFO:tasks.workunit.client.0.smithi078.stdout:5/779: dread d2/d4/d9/d2f/d30/f85 [0,4194304] 0 2024-09-18T12:49:23.891 INFO:tasks.workunit.client.0.smithi078.stdout:1/562: mkdir d0/d8/da/d3e/d58/d6e/d8c/d9d/db8 0 2024-09-18T12:49:23.891 INFO:tasks.workunit.client.1.smithi148.stdout:7/797: dwrite db/dc/df/d11/d43/f9a [0,4194304] 0 2024-09-18T12:49:23.891 INFO:tasks.workunit.client.1.smithi148.stdout:2/708: dread d9/d24/d31/d34/d42/fee [0,4194304] 0 2024-09-18T12:49:23.893 INFO:tasks.workunit.client.1.smithi148.stdout:5/825: creat d7/d8/dc/f11c x:0 0 0 2024-09-18T12:49:23.896 INFO:tasks.workunit.client.1.smithi148.stdout:1/802: mknod dc/d4d/dfe/c10d 0 2024-09-18T12:49:23.899 INFO:tasks.workunit.client.1.smithi148.stdout:0/988: rename de/l2f to de/d27/d2e/d119/l14c 0 2024-09-18T12:49:23.900 INFO:tasks.workunit.client.0.smithi078.stdout:0/618: write d3/f6d [777628,121387] 0 2024-09-18T12:49:23.900 INFO:tasks.workunit.client.1.smithi148.stdout:2/709: dwrite d9/d17/d29/d92/fc2 [0,4194304] 0 2024-09-18T12:49:23.900 INFO:tasks.workunit.client.0.smithi078.stdout:1/563: dread - d0/d8/da/d3e/d58/d6e/d52/d47/f66 zero size 2024-09-18T12:49:23.900 INFO:tasks.workunit.client.0.smithi078.stdout:0/619: readlink d3/d1f/d2e/d8f/d90/dcb/le0 0 2024-09-18T12:49:23.903 INFO:tasks.workunit.client.1.smithi148.stdout:5/826: unlink d7/d8/dc/da6/dee/l85 0 2024-09-18T12:49:23.904 INFO:tasks.workunit.client.1.smithi148.stdout:5/827: stat d7/d8/d18/d3f/d7c/fef 0 2024-09-18T12:49:23.905 INFO:tasks.workunit.client.0.smithi078.stdout:5/780: mkdir d2/d4/d9/da/d60/db3/d2d/df2 0 2024-09-18T12:49:23.905 INFO:tasks.workunit.client.1.smithi148.stdout:5/828: stat d7/fff 0 2024-09-18T12:49:23.906 INFO:tasks.workunit.client.1.smithi148.stdout:5/829: chown d7/d8/dc/da6/dee/d77/f9b 51607467 1 2024-09-18T12:49:23.907 INFO:tasks.workunit.client.1.smithi148.stdout:5/830: write d7/fff [207403,42400] 0 2024-09-18T12:49:23.908 INFO:tasks.workunit.client.0.smithi078.stdout:1/564: symlink d0/d8/da/d3e/d58/lb9 0 2024-09-18T12:49:23.911 INFO:tasks.workunit.client.0.smithi078.stdout:3/495: truncate d9/d54/f68 1148012 0 2024-09-18T12:49:23.913 INFO:tasks.workunit.client.0.smithi078.stdout:3/496: chown d9/d13/d33/d3c/c60 8737667 1 2024-09-18T12:49:23.914 INFO:tasks.workunit.client.0.smithi078.stdout:8/455: write d0/d7/d53/f5e [942688,116444] 0 2024-09-18T12:49:23.914 INFO:tasks.workunit.client.1.smithi148.stdout:2/710: fsync d9/d24/d31/d34/d42/fee 0 2024-09-18T12:49:23.915 INFO:tasks.workunit.client.1.smithi148.stdout:8/896: write d8/d16/d53/d39/d3b/d4e/fa2 [1195380,103948] 0 2024-09-18T12:49:23.916 INFO:tasks.workunit.client.1.smithi148.stdout:1/803: mknod dc/d18/d7d/dea/c10e 0 2024-09-18T12:49:23.916 INFO:tasks.workunit.client.0.smithi078.stdout:1/565: dwrite d0/d8/da/f8d [0,4194304] 0 2024-09-18T12:49:23.917 INFO:tasks.workunit.client.1.smithi148.stdout:1/804: chown dc/d5b/da5/l101 476 1 2024-09-18T12:49:23.917 INFO:tasks.workunit.client.1.smithi148.stdout:5/831: unlink d7/d8/d18/d3f/c91 0 2024-09-18T12:49:23.918 INFO:tasks.workunit.client.0.smithi078.stdout:0/620: creat d3/d43/fe4 x:0 0 0 2024-09-18T12:49:23.919 INFO:tasks.workunit.client.1.smithi148.stdout:1/805: write dc/d18/d7d/d93/dd9/fd8 [362222,130040] 0 2024-09-18T12:49:23.919 INFO:tasks.workunit.client.1.smithi148.stdout:2/711: mkdir d9/d17/d29/d92/dff 0 2024-09-18T12:49:23.922 INFO:tasks.workunit.client.1.smithi148.stdout:2/712: read f5 [1160445,127473] 0 2024-09-18T12:49:23.923 INFO:tasks.workunit.client.1.smithi148.stdout:7/798: rename db/dc/df/d11/ddc/d75/cd8 to db/dc/ced 0 2024-09-18T12:49:23.925 INFO:tasks.workunit.client.1.smithi148.stdout:2/713: truncate d9/d24/fc1 705509 0 2024-09-18T12:49:23.925 INFO:tasks.workunit.client.1.smithi148.stdout:5/832: creat d7/d8/dc/d12/d20/d100/f11d x:0 0 0 2024-09-18T12:49:23.926 INFO:tasks.workunit.client.0.smithi078.stdout:8/456: creat d0/d7/dc/d1f/d23/f8c x:0 0 0 2024-09-18T12:49:23.928 INFO:tasks.workunit.client.0.smithi078.stdout:0/621: symlink d3/d1f/d2e/d4e/d37/d72/le5 0 2024-09-18T12:49:23.931 INFO:tasks.workunit.client.0.smithi078.stdout:8/457: rename d0/d7/f27 to d0/f8d 0 2024-09-18T12:49:23.933 INFO:tasks.workunit.client.1.smithi148.stdout:8/897: creat d8/df/d66/db8/f131 x:0 0 0 2024-09-18T12:49:23.935 INFO:tasks.workunit.client.1.smithi148.stdout:7/799: mknod db/dc/df/d11/dcc/cee 0 2024-09-18T12:49:23.935 INFO:tasks.workunit.client.0.smithi078.stdout:0/622: dwrite d3/f7b [0,4194304] 0 2024-09-18T12:49:23.936 INFO:tasks.workunit.client.1.smithi148.stdout:0/989: dread de/d14/d43/d57/fb1 [4194304,4194304] 0 2024-09-18T12:49:23.936 INFO:tasks.workunit.client.1.smithi148.stdout:4/804: sync 2024-09-18T12:49:23.936 INFO:tasks.workunit.client.1.smithi148.stdout:9/792: sync 2024-09-18T12:49:23.938 INFO:tasks.workunit.client.1.smithi148.stdout:4/805: stat d15/f2d 0 2024-09-18T12:49:23.939 INFO:tasks.workunit.client.0.smithi078.stdout:8/458: dread - d0/d39/d4c/d77/f85 zero size 2024-09-18T12:49:23.939 INFO:tasks.workunit.client.0.smithi078.stdout:0/623: chown d3/d1f/d2e/d8f/d90/cc5 326269544 1 2024-09-18T12:49:23.939 INFO:tasks.workunit.client.1.smithi148.stdout:5/833: creat d7/d8/dc/d12/d31/d5a/d98/f11e x:0 0 0 2024-09-18T12:49:23.940 INFO:tasks.workunit.client.1.smithi148.stdout:0/990: dread - de/d27/d53/d89/dbb/dc8/f12f zero size 2024-09-18T12:49:23.941 INFO:tasks.workunit.client.0.smithi078.stdout:5/781: dwrite d2/d4/d9/d49/f7d [0,4194304] 0 2024-09-18T12:49:23.941 INFO:tasks.workunit.client.1.smithi148.stdout:8/898: creat d8/d12/d51/dc7/f132 x:0 0 0 2024-09-18T12:49:23.946 INFO:tasks.workunit.client.1.smithi148.stdout:9/793: creat d8/da/dd/d77/ff0 x:0 0 0 2024-09-18T12:49:23.949 INFO:tasks.workunit.client.0.smithi078.stdout:5/782: mkdir d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/df3 0 2024-09-18T12:49:23.949 INFO:tasks.workunit.client.1.smithi148.stdout:2/714: dwrite d9/d24/d47/fb2 [0,4194304] 0 2024-09-18T12:49:23.950 INFO:tasks.workunit.client.0.smithi078.stdout:5/783: dread - d2/d4/d9/da/d60/db3/d2d/dd3/fe4 zero size 2024-09-18T12:49:23.953 INFO:tasks.workunit.client.1.smithi148.stdout:7/800: truncate db/dc/df/d11/ddc/d75/fa6 322895 0 2024-09-18T12:49:23.954 INFO:tasks.workunit.client.1.smithi148.stdout:5/834: stat d7/d8/dc/da6/dee/d25/d4b/d102 0 2024-09-18T12:49:23.954 INFO:tasks.workunit.client.1.smithi148.stdout:1/806: dread dc/d18/f1f [0,4194304] 0 2024-09-18T12:49:23.955 INFO:tasks.workunit.client.1.smithi148.stdout:5/835: fdatasync d7/d8/fd9 0 2024-09-18T12:49:23.956 INFO:tasks.workunit.client.1.smithi148.stdout:9/794: mknod d8/da/dd/d65/cf1 0 2024-09-18T12:49:23.958 INFO:tasks.workunit.client.1.smithi148.stdout:1/807: write dc/d18/d7d/d93/dd9/d2b/f2e [3470086,81533] 0 2024-09-18T12:49:23.962 INFO:tasks.workunit.client.1.smithi148.stdout:2/715: fsync d9/d73/d81/ff1 0 2024-09-18T12:49:23.963 INFO:tasks.workunit.client.0.smithi078.stdout:5/784: mkdir d2/d4/d9/da/d60/db3/d2d/df2/df4 0 2024-09-18T12:49:23.963 INFO:tasks.workunit.client.0.smithi078.stdout:0/624: getdents d3/d1f/d2e/d8f/da1 0 2024-09-18T12:49:23.965 INFO:tasks.workunit.client.1.smithi148.stdout:2/716: write d9/d17/d29/d92/d95/fac [5054213,9082] 0 2024-09-18T12:49:23.965 INFO:tasks.workunit.client.0.smithi078.stdout:8/459: getdents d0/d7/dc/d1f 0 2024-09-18T12:49:23.966 INFO:tasks.workunit.client.1.smithi148.stdout:0/991: dread de/d27/d53/d89/f107 [0,4194304] 0 2024-09-18T12:49:23.966 INFO:tasks.workunit.client.0.smithi078.stdout:8/460: dread - d0/d7/d1e/d4b/f61 zero size 2024-09-18T12:49:23.966 INFO:tasks.workunit.client.1.smithi148.stdout:0/992: readlink de/d27/d53/d89/l101 0 2024-09-18T12:49:23.969 INFO:tasks.workunit.client.1.smithi148.stdout:9/795: unlink d8/d33/f42 0 2024-09-18T12:49:23.970 INFO:tasks.workunit.client.1.smithi148.stdout:0/993: dread de/d27/d2e/d114/f103 [0,4194304] 0 2024-09-18T12:49:23.970 INFO:tasks.workunit.client.0.smithi078.stdout:0/625: write d3/d1f/f67 [329237,77038] 0 2024-09-18T12:49:23.971 INFO:tasks.workunit.client.1.smithi148.stdout:9/796: truncate d8/da/dd/d3f/d5d/fed 943853 0 2024-09-18T12:49:23.971 INFO:tasks.workunit.client.1.smithi148.stdout:0/994: fsync de/d27/d53/d89/f10f 0 2024-09-18T12:49:23.972 INFO:tasks.workunit.client.1.smithi148.stdout:9/797: chown d8/d73/lad 86764 1 2024-09-18T12:49:23.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:23 smithi148 ceph-mon[35352]: pgmap v19: 65 pgs: 65 active+clean; 2.6 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 117 MiB/s rd, 321 MiB/s wr, 628 op/s 2024-09-18T12:49:23.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:23 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:23.974 INFO:tasks.workunit.client.1.smithi148.stdout:7/801: mknod db/d52/d4f/de7/cef 0 2024-09-18T12:49:23.975 INFO:tasks.workunit.client.1.smithi148.stdout:2/717: creat d9/d24/d31/d9d/f100 x:0 0 0 2024-09-18T12:49:23.975 INFO:tasks.workunit.client.1.smithi148.stdout:3/749: sync 2024-09-18T12:49:23.979 INFO:tasks.workunit.client.1.smithi148.stdout:4/806: dread d15/d5f/f78 [0,4194304] 0 2024-09-18T12:49:23.980 INFO:tasks.workunit.client.1.smithi148.stdout:0/995: dwrite de/f94 [0,4194304] 0 2024-09-18T12:49:23.982 INFO:tasks.workunit.client.1.smithi148.stdout:8/899: write d8/d12/d46/d7e/fe3 [2528637,77801] 0 2024-09-18T12:49:23.988 INFO:tasks.workunit.client.0.smithi078.stdout:5/785: write d2/d4/d9/da/d60/d7f/fba [3422029,108209] 0 2024-09-18T12:49:23.991 INFO:tasks.workunit.client.1.smithi148.stdout:2/718: fsync d9/d17/d29/d92/d95/d9b/fa9 0 2024-09-18T12:49:23.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:23 smithi078 ceph-mon[28091]: pgmap v19: 65 pgs: 65 active+clean; 2.6 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 117 MiB/s rd, 321 MiB/s wr, 628 op/s 2024-09-18T12:49:23.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:23 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:23.993 INFO:tasks.workunit.client.1.smithi148.stdout:4/807: creat d15/d17/d52/d101/f10e x:0 0 0 2024-09-18T12:49:23.993 INFO:tasks.workunit.client.0.smithi078.stdout:8/461: dwrite d0/d7/dc/d1f/d23/f25 [4194304,4194304] 0 2024-09-18T12:49:23.996 INFO:tasks.workunit.client.1.smithi148.stdout:5/836: truncate d7/d8/dc/d12/d31/d5a/fcc 638112 0 2024-09-18T12:49:24.000 INFO:tasks.workunit.client.1.smithi148.stdout:3/750: truncate d4/d8/f35 970218 0 2024-09-18T12:49:24.002 INFO:tasks.workunit.client.0.smithi078.stdout:8/462: symlink d0/d7/d53/d57/l8e 0 2024-09-18T12:49:24.003 INFO:tasks.workunit.client.0.smithi078.stdout:8/463: write d0/d7/f7f [750761,34961] 0 2024-09-18T12:49:24.003 INFO:tasks.workunit.client.1.smithi148.stdout:7/802: dread db/d52/d1f/f4d [0,4194304] 0 2024-09-18T12:49:24.003 INFO:tasks.workunit.client.1.smithi148.stdout:1/808: getdents dc/d9f/df5 0 2024-09-18T12:49:24.004 INFO:tasks.workunit.client.0.smithi078.stdout:5/786: creat d2/d4/d9/da/d60/db3/d16/d36/db0/dde/ff5 x:0 0 0 2024-09-18T12:49:24.004 INFO:tasks.workunit.client.1.smithi148.stdout:9/798: dread d8/da/dd/d4a/d49/d46/d54/d90/fb2 [0,4194304] 0 2024-09-18T12:49:24.006 INFO:tasks.workunit.client.1.smithi148.stdout:1/809: fsync dc/d18/d7d/d93/fd4 0 2024-09-18T12:49:24.007 INFO:tasks.workunit.client.1.smithi148.stdout:2/719: unlink d9/d24/f80 0 2024-09-18T12:49:24.007 INFO:tasks.workunit.client.1.smithi148.stdout:1/810: chown dc/d18/d31/d4b/d8d/ddd 88 1 2024-09-18T12:49:24.008 INFO:tasks.workunit.client.0.smithi078.stdout:8/464: rename d0/d7/dc/d1f/d6f/f70 to d0/d39/d4c/f8f 0 2024-09-18T12:49:24.009 INFO:tasks.workunit.client.0.smithi078.stdout:8/465: dread - d0/d7/f4d zero size 2024-09-18T12:49:24.010 INFO:tasks.workunit.client.0.smithi078.stdout:8/466: write d0/d7/dc/d5d/f37 [2117880,57481] 0 2024-09-18T12:49:24.011 INFO:tasks.workunit.client.0.smithi078.stdout:5/787: getdents d2/d4/d9/da/d60/db3/d16/d36/db0/dde/dd4 0 2024-09-18T12:49:24.012 INFO:tasks.workunit.client.0.smithi078.stdout:8/467: chown d0/d7/dc/f3c 38318 1 2024-09-18T12:49:24.014 INFO:tasks.workunit.client.1.smithi148.stdout:9/799: mknod d8/da/dd/d77/cf2 0 2024-09-18T12:49:24.015 INFO:tasks.workunit.client.1.smithi148.stdout:7/803: rename db/dc/df/d2c/feb to db/dc/df/d11/dcc/ff0 0 2024-09-18T12:49:24.017 INFO:tasks.workunit.client.0.smithi078.stdout:8/468: rename d0/d7/dc/d1f/d23/l74 to d0/d39/l90 0 2024-09-18T12:49:24.017 INFO:tasks.workunit.client.1.smithi148.stdout:2/720: creat d9/d24/d31/d34/d7b/f101 x:0 0 0 2024-09-18T12:49:24.019 INFO:tasks.workunit.client.1.smithi148.stdout:4/808: creat d15/d5f/d69/d7f/d94/d103/f10f x:0 0 0 2024-09-18T12:49:24.020 INFO:tasks.workunit.client.1.smithi148.stdout:9/800: dwrite d8/da/dd/d35/d5e/fa7 [4194304,4194304] 0 2024-09-18T12:49:24.021 INFO:tasks.workunit.client.1.smithi148.stdout:8/900: creat d8/df/d3e/f133 x:0 0 0 2024-09-18T12:49:24.023 INFO:tasks.workunit.client.0.smithi078.stdout:5/788: getdents d2/d4/d9/da/d60 0 2024-09-18T12:49:24.024 INFO:tasks.workunit.client.1.smithi148.stdout:4/809: truncate d15/d17/d52/d68/da5/f10d 347241 0 2024-09-18T12:49:24.027 INFO:tasks.workunit.client.0.smithi078.stdout:5/789: symlink d2/d4/d9/da/d60/db3/d16/d36/d68/lf6 0 2024-09-18T12:49:24.027 INFO:tasks.workunit.client.1.smithi148.stdout:4/810: stat d15/d17/d52/d92/d4c/d4f/l91 0 2024-09-18T12:49:24.029 INFO:tasks.workunit.client.1.smithi148.stdout:4/811: chown d15/d5f/l106 38958644 1 2024-09-18T12:49:24.032 INFO:tasks.workunit.client.1.smithi148.stdout:2/721: write d9/d73/d81/fae [276647,21256] 0 2024-09-18T12:49:24.032 INFO:tasks.workunit.client.1.smithi148.stdout:9/801: dwrite d8/da/dd/d35/d5e/fa7 [4194304,4194304] 0 2024-09-18T12:49:24.033 INFO:tasks.workunit.client.0.smithi078.stdout:5/790: mkdir d2/d4/d9/da/d60/db3/d16/d36/d4c/df7 0 2024-09-18T12:49:24.033 INFO:tasks.workunit.client.1.smithi148.stdout:4/812: fdatasync d15/d17/d52/d92/d4c/d4f/d64/da0/fe1 0 2024-09-18T12:49:24.034 INFO:tasks.workunit.client.1.smithi148.stdout:3/751: creat d4/d8/d1e/d6b/d31/f105 x:0 0 0 2024-09-18T12:49:24.034 INFO:tasks.workunit.client.1.smithi148.stdout:5/837: dread d7/fd [0,4194304] 0 2024-09-18T12:49:24.035 INFO:tasks.workunit.client.1.smithi148.stdout:8/901: write d8/df/d3e/d82/d8f/f12d [869571,72311] 0 2024-09-18T12:49:24.035 INFO:tasks.workunit.client.1.smithi148.stdout:4/813: readlink d15/d17/d52/d92/l86 0 2024-09-18T12:49:24.043 INFO:tasks.workunit.client.0.smithi078.stdout:8/469: dread d0/d7/f22 [0,4194304] 0 2024-09-18T12:49:24.043 INFO:tasks.workunit.client.1.smithi148.stdout:9/802: unlink d8/da/dd/d4a/d49/d46/d75/f7e 0 2024-09-18T12:49:24.044 INFO:tasks.workunit.client.1.smithi148.stdout:9/803: readlink d8/da/dd/d4a/l24 0 2024-09-18T12:49:24.044 INFO:tasks.workunit.client.1.smithi148.stdout:2/722: read d9/d17/d29/d92/d95/d9b/ff9 [2740524,64104] 0 2024-09-18T12:49:24.046 INFO:tasks.workunit.client.1.smithi148.stdout:1/811: getdents dc/d18/d7d/dea 0 2024-09-18T12:49:24.050 INFO:tasks.workunit.client.1.smithi148.stdout:3/752: mknod d4/d8/c106 0 2024-09-18T12:49:24.053 INFO:tasks.workunit.client.1.smithi148.stdout:7/804: getdents db/dc/df/d11/d43 0 2024-09-18T12:49:24.054 INFO:tasks.workunit.client.0.smithi078.stdout:5/791: dwrite d2/d4/d9/da/d60/db3/d16/d36/db0/dde/f93 [0,4194304] 0 2024-09-18T12:49:24.055 INFO:tasks.workunit.client.1.smithi148.stdout:9/804: truncate f0 9111757 0 2024-09-18T12:49:24.056 INFO:tasks.workunit.client.1.smithi148.stdout:9/805: fdatasync d8/da/dd/d35/fb5 0 2024-09-18T12:49:24.058 INFO:tasks.workunit.client.0.smithi078.stdout:8/470: dwrite d0/d7/dc/f26 [4194304,4194304] 0 2024-09-18T12:49:24.060 INFO:tasks.workunit.client.0.smithi078.stdout:8/471: read d0/d7/d53/f5e [1016449,6740] 0 2024-09-18T12:49:24.062 INFO:tasks.workunit.client.0.smithi078.stdout:5/792: dread d2/d4/d48/fbc [0,4194304] 0 2024-09-18T12:49:24.065 INFO:tasks.workunit.client.1.smithi148.stdout:9/806: dwrite d8/da/dd/d4a/d49/d46/d75/fa3 [0,4194304] 0 2024-09-18T12:49:24.066 INFO:tasks.workunit.client.1.smithi148.stdout:8/902: dread d8/d16/d53/d39/d3b/f6a [0,4194304] 0 2024-09-18T12:49:24.069 INFO:tasks.workunit.client.0.smithi078.stdout:5/793: truncate d2/d4/f34 252210 0 2024-09-18T12:49:24.070 INFO:tasks.workunit.client.1.smithi148.stdout:5/838: truncate d7/f15 3182306 0 2024-09-18T12:49:24.070 INFO:tasks.workunit.client.1.smithi148.stdout:4/814: getdents d15/d17/d52/d92/d4c/d72/db3 0 2024-09-18T12:49:24.071 INFO:tasks.workunit.client.1.smithi148.stdout:7/805: creat db/dc/df/ff1 x:0 0 0 2024-09-18T12:49:24.073 INFO:tasks.workunit.client.1.smithi148.stdout:2/723: getdents d9/d73 0 2024-09-18T12:49:24.074 INFO:tasks.workunit.client.1.smithi148.stdout:5/839: fdatasync d7/d8/dc/da6/dee/d39/f10a 0 2024-09-18T12:49:24.074 INFO:tasks.workunit.client.0.smithi078.stdout:5/794: truncate d2/d4/d9/da/d60/db3/d16/d36/d4c/f65 1031210 0 2024-09-18T12:49:24.076 INFO:tasks.workunit.client.1.smithi148.stdout:3/753: truncate d4/d8/d20/d2b/d7f/d93/d94/f9a 1356220 0 2024-09-18T12:49:24.080 INFO:tasks.workunit.client.0.smithi078.stdout:5/795: mknod d2/d4/d9/d2f/de0/cf8 0 2024-09-18T12:49:24.080 INFO:tasks.workunit.client.0.smithi078.stdout:8/472: write d0/f8d [2878909,74159] 0 2024-09-18T12:49:24.082 INFO:tasks.workunit.client.1.smithi148.stdout:5/840: symlink d7/d8/dc/da6/dee/l11f 0 2024-09-18T12:49:24.082 INFO:tasks.workunit.client.1.smithi148.stdout:8/903: creat d8/df/d3e/f134 x:0 0 0 2024-09-18T12:49:24.083 INFO:tasks.workunit.client.1.smithi148.stdout:3/754: rmdir d4/d8/d6a/db3/db7 39 2024-09-18T12:49:24.084 INFO:tasks.workunit.client.1.smithi148.stdout:7/806: truncate db/dc/df/d11/ddc/d75/fa6 298147 0 2024-09-18T12:49:24.086 INFO:tasks.workunit.client.0.smithi078.stdout:5/796: creat d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/df3/ff9 x:0 0 0 2024-09-18T12:49:24.087 INFO:tasks.workunit.client.1.smithi148.stdout:7/807: write db/dc/df/d11/f47 [2821697,78893] 0 2024-09-18T12:49:24.088 INFO:tasks.workunit.client.1.smithi148.stdout:5/841: fdatasync d7/d2b/f7a 0 2024-09-18T12:49:24.089 INFO:tasks.workunit.client.1.smithi148.stdout:6/815: sync 2024-09-18T12:49:24.090 INFO:tasks.workunit.client.0.smithi078.stdout:5/797: truncate d2/d4/d9/da/d60/db3/d16/d36/db0/dde/ff5 936855 0 2024-09-18T12:49:24.090 INFO:tasks.workunit.client.1.smithi148.stdout:2/724: getdents d9/d24/d47 0 2024-09-18T12:49:24.091 INFO:tasks.workunit.client.1.smithi148.stdout:6/816: chown d5/d32/l63 95233828 1 2024-09-18T12:49:24.091 INFO:tasks.workunit.client.1.smithi148.stdout:2/725: stat d9/d24/d31/f8a 0 2024-09-18T12:49:24.092 INFO:tasks.workunit.client.1.smithi148.stdout:3/755: getdents d4 0 2024-09-18T12:49:24.096 INFO:tasks.workunit.client.0.smithi078.stdout:5/798: dread d2/d4/d9/da/d60/db3/d16/d36/f79 [0,4194304] 0 2024-09-18T12:49:24.098 INFO:tasks.workunit.client.1.smithi148.stdout:5/842: creat d7/d2b/f120 x:0 0 0 2024-09-18T12:49:24.099 INFO:tasks.workunit.client.1.smithi148.stdout:2/726: fdatasync d9/d24/f25 0 2024-09-18T12:49:24.100 INFO:tasks.workunit.client.1.smithi148.stdout:6/817: dread - d5/d32/d38/d50/de7/fcc zero size 2024-09-18T12:49:24.102 INFO:tasks.workunit.client.1.smithi148.stdout:5/843: dread - d7/d8/dc/da6/ff7 zero size 2024-09-18T12:49:24.102 INFO:tasks.workunit.client.1.smithi148.stdout:4/815: dread d15/d17/f42 [0,4194304] 0 2024-09-18T12:49:24.102 INFO:tasks.workunit.client.1.smithi148.stdout:3/756: mkdir d4/d8/d1e/d6b/d31/d60/d107 0 2024-09-18T12:49:24.104 INFO:tasks.workunit.client.0.smithi078.stdout:8/473: truncate d0/f8d 3768830 0 2024-09-18T12:49:24.108 INFO:tasks.workunit.client.1.smithi148.stdout:3/757: write d4/f49 [985883,42696] 0 2024-09-18T12:49:24.108 INFO:tasks.workunit.client.1.smithi148.stdout:9/807: dwrite d8/da/dd/d4a/f3a [0,4194304] 0 2024-09-18T12:49:24.109 INFO:tasks.workunit.client.0.smithi078.stdout:8/474: creat d0/d39/d4c/d77/d7d/d52/d62/f91 x:0 0 0 2024-09-18T12:49:24.112 INFO:tasks.workunit.client.1.smithi148.stdout:6/818: getdents d5/d32/d56/dfb/d109 0 2024-09-18T12:49:24.114 INFO:tasks.workunit.client.1.smithi148.stdout:6/819: truncate d5/d1a/d3d/ff1 459784 0 2024-09-18T12:49:24.115 INFO:tasks.workunit.client.1.smithi148.stdout:9/808: creat d8/da/dd/d4a/d49/ff3 x:0 0 0 2024-09-18T12:49:24.118 INFO:tasks.workunit.client.1.smithi148.stdout:3/758: symlink d4/d8/d20/d2b/d7f/d93/l108 0 2024-09-18T12:49:24.118 INFO:tasks.workunit.client.1.smithi148.stdout:3/759: fdatasync d4/d8/d1e/d6b/f4d 0 2024-09-18T12:49:24.121 INFO:tasks.workunit.client.1.smithi148.stdout:6/820: mknod d5/d1a/dc/d101/da4/de2/c10b 0 2024-09-18T12:49:24.121 INFO:tasks.workunit.client.1.smithi148.stdout:7/808: truncate db/dc/df/d2c/d55/daf/d38/fba 1439409 0 2024-09-18T12:49:24.121 INFO:tasks.workunit.client.1.smithi148.stdout:2/727: dread d9/d17/d29/d92/d95/d9b/ff9 [0,4194304] 0 2024-09-18T12:49:24.121 INFO:tasks.workunit.client.0.smithi078.stdout:5/799: write d2/d4/d9/da/d2b/f63 [1101304,105472] 0 2024-09-18T12:49:24.122 INFO:tasks.workunit.client.1.smithi148.stdout:7/809: dread - db/dc/df/d1d/d68/d82/fdf zero size 2024-09-18T12:49:24.122 INFO:tasks.workunit.client.1.smithi148.stdout:2/728: read d9/d17/d29/d92/d95/d9b/fc0 [269518,16110] 0 2024-09-18T12:49:24.123 INFO:tasks.workunit.client.1.smithi148.stdout:2/729: dread - d9/fec zero size 2024-09-18T12:49:24.123 INFO:tasks.workunit.client.1.smithi148.stdout:6/821: read d5/d1a/dc/d2b/d35/d65/fb8 [2946362,92525] 0 2024-09-18T12:49:24.127 INFO:tasks.workunit.client.0.smithi078.stdout:8/475: write d0/f1a [3671383,86232] 0 2024-09-18T12:49:24.129 INFO:tasks.workunit.client.1.smithi148.stdout:4/816: dread d15/d17/d52/d92/d4c/d4f/fb7 [0,4194304] 0 2024-09-18T12:49:24.129 INFO:tasks.workunit.client.1.smithi148.stdout:2/730: creat d9/d17/d29/d98/f102 x:0 0 0 2024-09-18T12:49:24.130 INFO:tasks.workunit.client.1.smithi148.stdout:5/844: dwrite d7/d8/f9d [0,4194304] 0 2024-09-18T12:49:24.130 INFO:tasks.workunit.client.1.smithi148.stdout:6/822: mknod d5/d1a/dc/d2b/d35/d65/dff/c10c 0 2024-09-18T12:49:24.131 INFO:tasks.workunit.client.0.smithi078.stdout:8/476: fsync d0/d7/f55 0 2024-09-18T12:49:24.131 INFO:tasks.workunit.client.1.smithi148.stdout:2/731: fdatasync d9/d73/d81/ff1 0 2024-09-18T12:49:24.132 INFO:tasks.workunit.client.1.smithi148.stdout:9/809: creat d8/ff4 x:0 0 0 2024-09-18T12:49:24.133 INFO:tasks.workunit.client.1.smithi148.stdout:3/760: creat d4/df5/f109 x:0 0 0 2024-09-18T12:49:24.135 INFO:tasks.workunit.client.1.smithi148.stdout:4/817: write d15/d17/d52/d92/d4c/dd0/dd6/fe2 [636094,96625] 0 2024-09-18T12:49:24.136 INFO:tasks.workunit.client.0.smithi078.stdout:8/477: creat d0/d7/dc/d71/f92 x:0 0 0 2024-09-18T12:49:24.137 INFO:tasks.workunit.client.1.smithi148.stdout:3/761: stat d4/d8/d1e/d6b/f4d 0 2024-09-18T12:49:24.139 INFO:tasks.workunit.client.1.smithi148.stdout:5/845: chown d7/d8/dc/d12/c9c 115932 1 2024-09-18T12:49:24.140 INFO:tasks.workunit.client.1.smithi148.stdout:6/823: rmdir d5/d32/d38/df0 39 2024-09-18T12:49:24.140 INFO:tasks.workunit.client.1.smithi148.stdout:3/762: read d4/f18 [555699,109537] 0 2024-09-18T12:49:24.141 INFO:tasks.workunit.client.0.smithi078.stdout:8/478: mknod d0/d7/dc/d5d/c93 0 2024-09-18T12:49:24.142 INFO:tasks.workunit.client.1.smithi148.stdout:2/732: creat d9/d17/d29/d92/d95/d9b/f103 x:0 0 0 2024-09-18T12:49:24.142 INFO:tasks.workunit.client.1.smithi148.stdout:2/733: chown d9/d24/d31/d9d/f100 0 1 2024-09-18T12:49:24.146 INFO:tasks.workunit.client.1.smithi148.stdout:6/824: creat d5/d1a/dc/d2b/d35/f10d x:0 0 0 2024-09-18T12:49:24.147 INFO:tasks.workunit.client.1.smithi148.stdout:3/763: unlink d4/d8/d1e/d63/d9b/la3 0 2024-09-18T12:49:24.149 INFO:tasks.workunit.client.1.smithi148.stdout:9/810: stat d8/da/dd/d35/d47/d4e 0 2024-09-18T12:49:24.149 INFO:tasks.workunit.client.1.smithi148.stdout:2/734: fdatasync d9/d24/f32 0 2024-09-18T12:49:24.150 INFO:tasks.workunit.client.1.smithi148.stdout:7/810: getdents db/dc/df/d11/dac 0 2024-09-18T12:49:24.152 INFO:tasks.workunit.client.1.smithi148.stdout:9/811: write d8/da/dd/d35/d81/dc6/fd2 [832809,15570] 0 2024-09-18T12:49:24.153 INFO:tasks.workunit.client.1.smithi148.stdout:3/764: symlink d4/d8/d6a/db3/db7/l10a 0 2024-09-18T12:49:24.154 INFO:tasks.workunit.client.1.smithi148.stdout:6/825: dwrite d5/d32/d38/d50/f95 [0,4194304] 0 2024-09-18T12:49:24.155 INFO:tasks.workunit.client.1.smithi148.stdout:7/811: fsync db/dc/df/d2c/fb9 0 2024-09-18T12:49:24.155 INFO:tasks.workunit.client.0.smithi078.stdout:8/479: write d0/d7/d1e/d4b/f73 [2841547,77092] 0 2024-09-18T12:49:24.155 INFO:tasks.workunit.client.0.smithi078.stdout:8/480: chown d0/d7/f7f 24750724 1 2024-09-18T12:49:24.157 INFO:tasks.workunit.client.1.smithi148.stdout:5/846: write d7/d8/d18/d3f/d7c/d7d/d101/f75 [2375192,118024] 0 2024-09-18T12:49:24.160 INFO:tasks.workunit.client.1.smithi148.stdout:3/765: dread - d4/d8/d20/d2b/ff3 zero size 2024-09-18T12:49:24.163 INFO:tasks.workunit.client.1.smithi148.stdout:6/826: symlink d5/d32/d38/d50/l10e 0 2024-09-18T12:49:24.163 INFO:tasks.workunit.client.1.smithi148.stdout:5/847: fdatasync d7/d8/dc/d12/d31/d5a/ffd 0 2024-09-18T12:49:24.165 INFO:tasks.workunit.client.1.smithi148.stdout:7/812: creat db/dc/df/d1d/d68/d82/ff2 x:0 0 0 2024-09-18T12:49:24.166 INFO:tasks.workunit.client.1.smithi148.stdout:3/766: dread - d4/d8/d20/d2b/d7f/d93/dd1/fdc zero size 2024-09-18T12:49:24.167 INFO:tasks.workunit.client.1.smithi148.stdout:4/818: dwrite d15/d17/d52/d92/f46 [0,4194304] 0 2024-09-18T12:49:24.169 INFO:tasks.workunit.client.1.smithi148.stdout:6/827: dread - d5/d1a/dc/d101/da4/da6/fdb zero size 2024-09-18T12:49:24.169 INFO:tasks.workunit.client.1.smithi148.stdout:9/812: dwrite d8/d33/fa5 [0,4194304] 0 2024-09-18T12:49:24.170 INFO:tasks.workunit.client.1.smithi148.stdout:6/828: stat d5/d1a/l6b 0 2024-09-18T12:49:24.170 INFO:tasks.workunit.client.1.smithi148.stdout:7/813: mkdir db/dc/df/d1d/d68/d82/df3 0 2024-09-18T12:49:24.171 INFO:tasks.workunit.client.1.smithi148.stdout:4/819: symlink d15/d17/d52/d68/l110 0 2024-09-18T12:49:24.172 INFO:tasks.workunit.client.1.smithi148.stdout:9/813: fdatasync d8/da/dd/d4a/d49/d46/d54/faa 0 2024-09-18T12:49:24.173 INFO:tasks.workunit.client.1.smithi148.stdout:3/767: mkdir d4/d8/d1e/d63/d10b 0 2024-09-18T12:49:24.174 INFO:tasks.workunit.client.0.smithi078.stdout:8/481: dread d0/f8d [0,4194304] 0 2024-09-18T12:49:24.177 INFO:tasks.workunit.client.1.smithi148.stdout:7/814: dread - db/dc/df/d1d/d68/d82/fdf zero size 2024-09-18T12:49:24.177 INFO:tasks.workunit.client.1.smithi148.stdout:2/735: dread d9/d3a/f75 [0,4194304] 0 2024-09-18T12:49:24.177 INFO:tasks.workunit.client.0.smithi078.stdout:8/482: dread d0/d7/f2c [0,4194304] 0 2024-09-18T12:49:24.178 INFO:tasks.workunit.client.0.smithi078.stdout:8/483: stat d0/d39/d4c/d77/d7d 0 2024-09-18T12:49:24.178 INFO:tasks.workunit.client.1.smithi148.stdout:6/829: fsync d5/d1a/dc/d2b/f30 0 2024-09-18T12:49:24.178 INFO:tasks.workunit.client.1.smithi148.stdout:9/814: write d8/da/dd/d4a/fdd [853081,43033] 0 2024-09-18T12:49:24.179 INFO:tasks.workunit.client.0.smithi078.stdout:8/484: fdatasync d0/d7/dc/f26 0 2024-09-18T12:49:24.179 INFO:tasks.workunit.client.1.smithi148.stdout:3/768: dread - d4/d8/d1e/f91 zero size 2024-09-18T12:49:24.179 INFO:tasks.workunit.client.0.smithi078.stdout:8/485: chown d0/d7/dc 11412 1 2024-09-18T12:49:24.180 INFO:tasks.workunit.client.0.smithi078.stdout:8/486: readlink d0/d7/dc/d71/l83 0 2024-09-18T12:49:24.181 INFO:tasks.workunit.client.1.smithi148.stdout:2/736: chown d9/d17/l22 2949172 1 2024-09-18T12:49:24.181 INFO:tasks.workunit.client.1.smithi148.stdout:9/815: chown d8/da/dd/d65/db9/fde 2595318 1 2024-09-18T12:49:24.182 INFO:tasks.workunit.client.1.smithi148.stdout:4/820: dwrite d15/d17/d52/d92/f2e [4194304,4194304] 0 2024-09-18T12:49:24.184 INFO:tasks.workunit.client.1.smithi148.stdout:7/815: mknod db/dc/df/d1d/d41/cf4 0 2024-09-18T12:49:24.186 INFO:tasks.workunit.client.1.smithi148.stdout:3/769: mkdir d4/d8/d1e/d6b/d31/d46/d10c 0 2024-09-18T12:49:24.188 INFO:tasks.workunit.client.1.smithi148.stdout:9/816: readlink d8/da/dd/l1c 0 2024-09-18T12:49:24.190 INFO:tasks.workunit.client.1.smithi148.stdout:4/821: unlink d15/d17/d52/f7d 0 2024-09-18T12:49:24.191 INFO:tasks.workunit.client.1.smithi148.stdout:4/822: dread - d15/d3f/fe8 zero size 2024-09-18T12:49:24.192 INFO:tasks.workunit.client.0.smithi078.stdout:8/487: dread d0/d7/f24 [0,4194304] 0 2024-09-18T12:49:24.193 INFO:tasks.workunit.client.1.smithi148.stdout:6/830: getdents d5 0 2024-09-18T12:49:24.193 INFO:tasks.workunit.client.1.smithi148.stdout:7/816: dwrite db/dc/df/d11/d34/f76 [0,4194304] 0 2024-09-18T12:49:24.193 INFO:tasks.workunit.client.1.smithi148.stdout:3/770: symlink d4/d8/d20/d2b/deb/l10d 0 2024-09-18T12:49:24.194 INFO:tasks.workunit.client.1.smithi148.stdout:3/771: dread - d4/fb8 zero size 2024-09-18T12:49:24.195 INFO:tasks.workunit.client.0.smithi078.stdout:8/488: getdents d0/d39/d4c/d77/d7d 0 2024-09-18T12:49:24.195 INFO:tasks.workunit.client.1.smithi148.stdout:7/817: chown db/dc/df/d2c/f5e 13132561 1 2024-09-18T12:49:24.196 INFO:tasks.workunit.client.0.smithi078.stdout:8/489: dread - d0/d7/d1e/d4b/f61 zero size 2024-09-18T12:49:24.196 INFO:tasks.workunit.client.1.smithi148.stdout:3/772: chown d4/d8/d1e/d63/d9b/cc2 11149 1 2024-09-18T12:49:24.197 INFO:tasks.workunit.client.1.smithi148.stdout:4/823: mknod d15/d5f/d69/d7f/d94/d103/c111 0 2024-09-18T12:49:24.197 INFO:tasks.workunit.client.0.smithi078.stdout:8/490: write d0/d7/dc/f26 [3888425,76651] 0 2024-09-18T12:49:24.198 INFO:tasks.workunit.client.1.smithi148.stdout:6/831: symlink d5/d1a/dc/d101/da4/da6/l10f 0 2024-09-18T12:49:24.198 INFO:tasks.workunit.client.1.smithi148.stdout:0/996: sync 2024-09-18T12:49:24.199 INFO:tasks.workunit.client.1.smithi148.stdout:7/818: mknod db/dc/df/d11/d34/d69/dc3/cf5 0 2024-09-18T12:49:24.200 INFO:tasks.workunit.client.0.smithi078.stdout:8/491: creat d0/d7/dc/d1f/d23/d40/f94 x:0 0 0 2024-09-18T12:49:24.203 INFO:tasks.workunit.client.1.smithi148.stdout:6/832: mknod d5/d1a/dc/d2b/d35/c110 0 2024-09-18T12:49:24.204 INFO:tasks.workunit.client.1.smithi148.stdout:0/997: creat de/d27/d2e/f14d x:0 0 0 2024-09-18T12:49:24.204 INFO:tasks.workunit.client.1.smithi148.stdout:4/824: rename d15/c1b to d15/d17/d52/d92/d4c/dd0/dd6/c112 0 2024-09-18T12:49:24.205 INFO:tasks.workunit.client.0.smithi078.stdout:8/492: read d0/d7/dc/d5d/d2e/f7a [3533621,58315] 0 2024-09-18T12:49:24.206 INFO:tasks.workunit.client.1.smithi148.stdout:2/737: dread d9/d24/d47/f63 [0,4194304] 0 2024-09-18T12:49:24.208 INFO:tasks.workunit.client.0.smithi078.stdout:8/493: dread d0/d7/f24 [0,4194304] 0 2024-09-18T12:49:24.208 INFO:tasks.workunit.client.1.smithi148.stdout:6/833: mkdir d5/d1a/dc/dbf/dcb/d111 0 2024-09-18T12:49:24.209 INFO:tasks.workunit.client.1.smithi148.stdout:3/773: dwrite d4/fd8 [0,4194304] 0 2024-09-18T12:49:24.209 INFO:tasks.workunit.client.1.smithi148.stdout:4/825: symlink d15/d17/d52/d92/d4c/d72/l113 0 2024-09-18T12:49:24.209 INFO:tasks.workunit.client.0.smithi078.stdout:6/673: sync 2024-09-18T12:49:24.210 INFO:tasks.workunit.client.0.smithi078.stdout:8/494: fdatasync d0/d7/dc/d1f/d23/d40/f94 0 2024-09-18T12:49:24.213 INFO:tasks.workunit.client.0.smithi078.stdout:6/674: mkdir d10/d2b/d43/d53/d63/d70/ddd 0 2024-09-18T12:49:24.214 INFO:tasks.workunit.client.0.smithi078.stdout:6/675: stat d10/d2b/d43/d53/d63/d70/d7d 0 2024-09-18T12:49:24.214 INFO:tasks.workunit.client.0.smithi078.stdout:8/495: read d0/f14 [3270512,10342] 0 2024-09-18T12:49:24.216 INFO:tasks.workunit.client.1.smithi148.stdout:7/819: dwrite db/dc/df/d11/ddc/f7c [4194304,4194304] 0 2024-09-18T12:49:24.216 INFO:tasks.workunit.client.0.smithi078.stdout:6/676: truncate d10/f97 634021 0 2024-09-18T12:49:24.216 INFO:tasks.workunit.client.0.smithi078.stdout:8/496: write d0/d7/dc/d1f/d23/d40/f94 [646014,97761] 0 2024-09-18T12:49:24.218 INFO:tasks.workunit.client.0.smithi078.stdout:8/497: read d0/d39/d4c/d77/d7d/d52/f89 [3694789,126169] 0 2024-09-18T12:49:24.220 INFO:tasks.workunit.client.1.smithi148.stdout:7/820: truncate db/dc/df/ff1 735806 0 2024-09-18T12:49:24.220 INFO:tasks.workunit.client.1.smithi148.stdout:2/738: dwrite d9/d24/d67/fc4 [0,4194304] 0 2024-09-18T12:49:24.222 INFO:tasks.workunit.client.1.smithi148.stdout:4/826: rename d15/d17/d52/d68/cd7 to d15/d5f/d69/d7f/d94/d103/c114 0 2024-09-18T12:49:24.224 INFO:tasks.workunit.client.0.smithi078.stdout:8/498: fdatasync d0/f6a 0 2024-09-18T12:49:24.226 INFO:tasks.workunit.client.0.smithi078.stdout:6/677: creat d10/d2b/d43/d53/d63/d70/fde x:0 0 0 2024-09-18T12:49:24.227 INFO:tasks.workunit.client.0.smithi078.stdout:6/678: chown d10/d2b/f44 6053885 1 2024-09-18T12:49:24.234 INFO:tasks.workunit.client.0.smithi078.stdout:8/499: dread d0/d39/d4c/d77/d7d/f6b [0,4194304] 0 2024-09-18T12:49:24.235 INFO:tasks.workunit.client.1.smithi148.stdout:0/998: write de/f14a [1315190,112044] 0 2024-09-18T12:49:24.237 INFO:tasks.workunit.client.0.smithi078.stdout:8/500: getdents d0/d7/d53/d57/d67/d87 0 2024-09-18T12:49:24.239 INFO:tasks.workunit.client.1.smithi148.stdout:0/999: unlink de/d27/d53/d89/dbb/dc8/f111 0 2024-09-18T12:49:24.240 INFO:tasks.workunit.client.1.smithi148.stdout:3/774: write d4/f7a [394248,51037] 0 2024-09-18T12:49:24.240 INFO:tasks.workunit.client.1.smithi148.stdout:3/775: fsync d4/d8/d1e/fe2 0 2024-09-18T12:49:24.242 INFO:tasks.workunit.client.1.smithi148.stdout:3/776: write d4/f5 [8909013,112294] 0 2024-09-18T12:49:24.242 INFO:tasks.workunit.client.1.smithi148.stdout:3/777: chown d4/c7 6834 1 2024-09-18T12:49:24.244 INFO:tasks.workunit.client.1.smithi148.stdout:6/834: truncate d5/d1a/f37 3286973 0 2024-09-18T12:49:24.244 INFO:tasks.workunit.client.0.smithi078.stdout:8/501: fdatasync d0/d7/dc/d5d/f86 0 2024-09-18T12:49:24.246 INFO:tasks.workunit.client.0.smithi078.stdout:8/502: read d0/d7/d1e/d4b/f73 [3523784,38418] 0 2024-09-18T12:49:24.247 INFO:tasks.workunit.client.1.smithi148.stdout:3/778: mkdir d4/d8/d1e/d79/d10e 0 2024-09-18T12:49:24.248 INFO:tasks.workunit.client.0.smithi078.stdout:8/503: write d0/d7/d1e/d4b/f5a [1859484,64863] 0 2024-09-18T12:49:24.250 INFO:tasks.workunit.client.1.smithi148.stdout:2/739: write d9/d3a/f75 [1804996,6545] 0 2024-09-18T12:49:24.254 INFO:tasks.workunit.client.0.smithi078.stdout:8/504: creat d0/d39/d4c/d77/d7d/d52/f95 x:0 0 0 2024-09-18T12:49:24.254 INFO:tasks.workunit.client.0.smithi078.stdout:6/679: write d10/d2b/d61/fbb [22968,91670] 0 2024-09-18T12:49:24.255 INFO:tasks.workunit.client.1.smithi148.stdout:2/740: mkdir d9/d73/d104 0 2024-09-18T12:49:24.255 INFO:tasks.workunit.client.0.smithi078.stdout:6/680: write d10/d2b/d43/f8f [2517824,65440] 0 2024-09-18T12:49:24.256 INFO:tasks.workunit.client.1.smithi148.stdout:4/827: dread d15/d17/f1a [0,4194304] 0 2024-09-18T12:49:24.261 INFO:tasks.workunit.client.1.smithi148.stdout:2/741: dwrite d9/d17/f5d [0,4194304] 0 2024-09-18T12:49:24.263 INFO:tasks.workunit.client.0.smithi078.stdout:6/681: mknod d10/cdf 0 2024-09-18T12:49:24.264 INFO:tasks.workunit.client.1.smithi148.stdout:2/742: mkdir d9/d17/d29/d92/d95/d9b/d105 0 2024-09-18T12:49:24.265 INFO:tasks.workunit.client.0.smithi078.stdout:6/682: mknod d10/d2b/d43/da7/ce0 0 2024-09-18T12:49:24.269 INFO:tasks.workunit.client.0.smithi078.stdout:6/683: creat d10/d2b/d61/fe1 x:0 0 0 2024-09-18T12:49:24.270 INFO:tasks.workunit.client.0.smithi078.stdout:6/684: fsync d10/d2b/d43/d53/d63/d70/dac/fbf 0 2024-09-18T12:49:24.271 INFO:tasks.workunit.client.1.smithi148.stdout:6/835: dwrite d5/d1a/dc/d2b/f5f [0,4194304] 0 2024-09-18T12:49:24.272 INFO:tasks.workunit.client.0.smithi078.stdout:8/505: dread d0/d7/dc/d5d/f86 [0,4194304] 0 2024-09-18T12:49:24.274 INFO:tasks.workunit.client.0.smithi078.stdout:6/685: symlink d10/d2b/d43/d53/d63/d70/d7d/ddb/le2 0 2024-09-18T12:49:24.274 INFO:tasks.workunit.client.1.smithi148.stdout:3/779: dwrite d4/d8/d1e/d6b/d31/d60/faa [0,4194304] 0 2024-09-18T12:49:24.277 INFO:tasks.workunit.client.0.smithi078.stdout:8/506: creat d0/d7/d53/d57/f96 x:0 0 0 2024-09-18T12:49:24.278 INFO:tasks.workunit.client.1.smithi148.stdout:6/836: dread - d5/d32/d38/d50/f102 zero size 2024-09-18T12:49:24.278 INFO:tasks.workunit.client.1.smithi148.stdout:2/743: dwrite d9/d3a/d90/fc5 [0,4194304] 0 2024-09-18T12:49:24.280 INFO:tasks.workunit.client.0.smithi078.stdout:6/686: dwrite d10/d2b/d43/f64 [0,4194304] 0 2024-09-18T12:49:24.281 INFO:tasks.workunit.client.0.smithi078.stdout:8/507: creat d0/d7/dc/d5d/d2e/d6d/f97 x:0 0 0 2024-09-18T12:49:24.283 INFO:tasks.workunit.client.1.smithi148.stdout:4/828: dwrite d15/d17/d52/d92/d4c/fd9 [0,4194304] 0 2024-09-18T12:49:24.284 INFO:tasks.workunit.client.0.smithi078.stdout:6/687: readlink d10/d2b/d61/la8 0 2024-09-18T12:49:24.286 INFO:tasks.workunit.client.0.smithi078.stdout:8/508: creat d0/d7/d1e/d4b/f98 x:0 0 0 2024-09-18T12:49:24.288 INFO:tasks.workunit.client.1.smithi148.stdout:2/744: read - d9/d24/f2f zero size 2024-09-18T12:49:24.290 INFO:tasks.workunit.client.1.smithi148.stdout:2/745: dread - d9/d24/d67/d72/fc6 zero size 2024-09-18T12:49:24.292 INFO:tasks.workunit.client.1.smithi148.stdout:4/829: unlink d15/d17/d52/d92/d4c/d4f/d34/cb2 0 2024-09-18T12:49:24.293 INFO:tasks.workunit.client.0.smithi078.stdout:8/509: rename d0/c12 to d0/d39/d4c/d77/d7d/c99 0 2024-09-18T12:49:24.293 INFO:tasks.workunit.client.0.smithi078.stdout:6/688: creat d10/d2b/d43/d53/d63/d70/dac/fe3 x:0 0 0 2024-09-18T12:49:24.295 INFO:tasks.workunit.client.1.smithi148.stdout:2/746: fsync d9/d24/d67/d72/fb6 0 2024-09-18T12:49:24.295 INFO:tasks.workunit.client.1.smithi148.stdout:4/830: fsync d15/d17/d52/d92/d4c/d4f/f23 0 2024-09-18T12:49:24.297 INFO:tasks.workunit.client.0.smithi078.stdout:6/689: mknod d10/d2b/d43/dc4/ce4 0 2024-09-18T12:49:24.298 INFO:tasks.workunit.client.0.smithi078.stdout:6/690: chown d10/d2b/d43/d53/d63/d70/d77/f8d 33641 1 2024-09-18T12:49:24.302 INFO:tasks.workunit.client.1.smithi148.stdout:4/831: truncate d15/d17/d52/d92/d4c/d4f/f22 3499121 0 2024-09-18T12:49:24.302 INFO:tasks.workunit.client.0.smithi078.stdout:6/691: mkdir d10/d2b/d43/de5 0 2024-09-18T12:49:24.303 INFO:tasks.workunit.client.1.smithi148.stdout:4/832: write d15/d5f/d69/d7f/ff8 [377151,22333] 0 2024-09-18T12:49:24.303 INFO:tasks.workunit.client.1.smithi148.stdout:6/837: link d5/d32/d38/d50/de7/d7c/cd4 d5/d1a/dc/d2b/d35/d65/c112 0 2024-09-18T12:49:24.306 INFO:tasks.workunit.client.1.smithi148.stdout:2/747: link d9/d24/d31/d34/d42/ce8 d9/d24/d67/d72/d8f/c106 0 2024-09-18T12:49:24.308 INFO:tasks.workunit.client.1.smithi148.stdout:4/833: rename d15/d17/d52/d68/f96 to d15/d17/f115 0 2024-09-18T12:49:24.312 INFO:tasks.workunit.client.1.smithi148.stdout:3/780: dread d4/d8/d1e/d63/f86 [0,4194304] 0 2024-09-18T12:49:24.312 INFO:tasks.workunit.client.1.smithi148.stdout:6/838: link d5/d32/d38/d50/de7/fad d5/d1a/d29/f113 0 2024-09-18T12:49:24.313 INFO:tasks.workunit.client.1.smithi148.stdout:2/748: read d9/d24/d31/f3d [2566741,100286] 0 2024-09-18T12:49:24.313 INFO:tasks.workunit.client.1.smithi148.stdout:6/839: stat d5/d32/d56/l7b 0 2024-09-18T12:49:24.313 INFO:tasks.workunit.client.1.smithi148.stdout:2/749: stat d9/d24/d31/d34/d7b 0 2024-09-18T12:49:24.313 INFO:tasks.workunit.client.1.smithi148.stdout:8/904: sync 2024-09-18T12:49:24.313 INFO:tasks.workunit.client.1.smithi148.stdout:1/812: sync 2024-09-18T12:49:24.314 INFO:tasks.workunit.client.1.smithi148.stdout:2/750: stat d9/d17/c1d 0 2024-09-18T12:49:24.316 INFO:tasks.workunit.client.1.smithi148.stdout:4/834: dwrite d15/d17/d52/d92/d4c/fe5 [0,4194304] 0 2024-09-18T12:49:24.316 INFO:tasks.workunit.client.1.smithi148.stdout:1/813: read dc/d18/d63/f94 [104520,70247] 0 2024-09-18T12:49:24.317 INFO:tasks.workunit.client.1.smithi148.stdout:8/905: creat d8/df/d3e/d82/da7/f135 x:0 0 0 2024-09-18T12:49:24.319 INFO:tasks.workunit.client.1.smithi148.stdout:1/814: creat dc/d9f/df5/deb/f10f x:0 0 0 2024-09-18T12:49:24.320 INFO:tasks.workunit.client.1.smithi148.stdout:8/906: dread - d8/d16/d27/fce zero size 2024-09-18T12:49:24.322 INFO:tasks.workunit.client.1.smithi148.stdout:3/781: dread d4/d8/d1e/d63/fad [0,4194304] 0 2024-09-18T12:49:24.323 INFO:tasks.workunit.client.1.smithi148.stdout:8/907: dread - d8/df/d3e/d82/d8f/f102 zero size 2024-09-18T12:49:24.323 INFO:tasks.workunit.client.1.smithi148.stdout:1/815: mkdir dc/d18/d31/dc6/d110 0 2024-09-18T12:49:24.325 INFO:tasks.workunit.client.1.smithi148.stdout:1/816: fsync fb 0 2024-09-18T12:49:24.327 INFO:tasks.workunit.client.1.smithi148.stdout:4/835: dwrite d15/d5f/d69/d7f/d94/f107 [0,4194304] 0 2024-09-18T12:49:24.330 INFO:tasks.workunit.client.1.smithi148.stdout:4/836: creat d15/d90/f116 x:0 0 0 2024-09-18T12:49:24.332 INFO:tasks.workunit.client.1.smithi148.stdout:1/817: creat dc/d18/d31/f111 x:0 0 0 2024-09-18T12:49:24.333 INFO:tasks.workunit.client.0.smithi078.stdout:8/510: truncate d0/d7/dc/d1f/d23/f25 6915257 0 2024-09-18T12:49:24.335 INFO:tasks.workunit.client.1.smithi148.stdout:1/818: mknod dc/d5b/da5/c112 0 2024-09-18T12:49:24.336 INFO:tasks.workunit.client.1.smithi148.stdout:8/908: dread d8/df/d3e/fcb [0,4194304] 0 2024-09-18T12:49:24.338 INFO:tasks.workunit.client.1.smithi148.stdout:1/819: rmdir dc/d9f/df5 39 2024-09-18T12:49:24.341 INFO:tasks.workunit.client.1.smithi148.stdout:8/909: mkdir d8/d16/d53/d39/d10d/d136 0 2024-09-18T12:49:24.342 INFO:tasks.workunit.client.1.smithi148.stdout:1/820: truncate dc/d4d/dad/fbf 966558 0 2024-09-18T12:49:24.343 INFO:tasks.workunit.client.0.smithi078.stdout:6/692: dwrite d10/f21 [0,4194304] 0 2024-09-18T12:49:24.344 INFO:tasks.workunit.client.0.smithi078.stdout:8/511: creat d0/d7/dc/d1f/d23/f9a x:0 0 0 2024-09-18T12:49:24.347 INFO:tasks.workunit.client.1.smithi148.stdout:6/840: write d5/d1a/dc/f5b [2012061,17094] 0 2024-09-18T12:49:24.349 INFO:tasks.workunit.client.1.smithi148.stdout:8/910: mkdir d8/d16/dff/d12f/d137 0 2024-09-18T12:49:24.351 INFO:tasks.workunit.client.1.smithi148.stdout:1/821: mkdir dc/d9f/df5/d113 0 2024-09-18T12:49:24.351 INFO:tasks.workunit.client.1.smithi148.stdout:8/911: write d8/d12/d46/d74/dd5/f10c [4836468,14985] 0 2024-09-18T12:49:24.351 INFO:tasks.workunit.client.0.smithi078.stdout:6/693: truncate d10/d2b/d43/d53/f4d 233204 0 2024-09-18T12:49:24.352 INFO:tasks.workunit.client.1.smithi148.stdout:3/782: write d4/f76 [358285,59867] 0 2024-09-18T12:49:24.353 INFO:tasks.workunit.client.1.smithi148.stdout:6/841: fdatasync d5/d32/d38/d50/f61 0 2024-09-18T12:49:24.356 INFO:tasks.workunit.client.0.smithi078.stdout:6/694: creat d10/d2b/d43/dc4/fe6 x:0 0 0 2024-09-18T12:49:24.358 INFO:tasks.workunit.client.1.smithi148.stdout:1/822: symlink dc/d4d/l114 0 2024-09-18T12:49:24.359 INFO:tasks.workunit.client.1.smithi148.stdout:8/912: creat d8/df/d66/db8/f138 x:0 0 0 2024-09-18T12:49:24.360 INFO:tasks.workunit.client.1.smithi148.stdout:4/837: write d15/d17/d52/d92/f84 [756217,84307] 0 2024-09-18T12:49:24.360 INFO:tasks.workunit.client.1.smithi148.stdout:1/823: dread dc/d18/d7d/d93/dd9/d2b/fef [0,4194304] 0 2024-09-18T12:49:24.362 INFO:tasks.workunit.client.0.smithi078.stdout:8/512: getdents d0/d7/dc/d1f/d23/d40 0 2024-09-18T12:49:24.362 INFO:tasks.workunit.client.1.smithi148.stdout:1/824: fdatasync dc/d18/d31/d4b/d8d/ddd/f10c 0 2024-09-18T12:49:24.363 INFO:tasks.workunit.client.0.smithi078.stdout:6/695: getdents d10/d2b/d43/dc3 0 2024-09-18T12:49:24.365 INFO:tasks.workunit.client.1.smithi148.stdout:6/842: unlink d5/d1a/dc/d2b/d35/ceb 0 2024-09-18T12:49:24.366 INFO:tasks.workunit.client.1.smithi148.stdout:6/843: dread - d5/d1a/dc/d2b/d35/f10d zero size 2024-09-18T12:49:24.367 INFO:tasks.workunit.client.1.smithi148.stdout:8/913: dwrite d8/d16/d27/dc5/dee/dfe/df3/d11e/f126 [0,4194304] 0 2024-09-18T12:49:24.367 INFO:tasks.workunit.client.1.smithi148.stdout:6/844: chown d5/d1a/dc/c6c 27 1 2024-09-18T12:49:24.368 INFO:tasks.workunit.client.1.smithi148.stdout:4/838: creat d15/d5f/f117 x:0 0 0 2024-09-18T12:49:24.369 INFO:tasks.workunit.client.0.smithi078.stdout:8/513: dwrite d0/d39/d4c/d77/f85 [0,4194304] 0 2024-09-18T12:49:24.369 INFO:tasks.workunit.client.1.smithi148.stdout:6/845: fsync d5/d1a/dc/d101/da4/da6/fba 0 2024-09-18T12:49:24.369 INFO:tasks.workunit.client.1.smithi148.stdout:8/914: write d8/d16/d53/da0/f12c [215792,55372] 0 2024-09-18T12:49:24.371 INFO:tasks.workunit.client.1.smithi148.stdout:6/846: dread - d5/d1a/dc/d101/da4/da6/fdb zero size 2024-09-18T12:49:24.372 INFO:tasks.workunit.client.1.smithi148.stdout:1/825: creat dc/d18/d31/d39/f115 x:0 0 0 2024-09-18T12:49:24.374 INFO:tasks.workunit.client.0.smithi078.stdout:6/696: mkdir d10/d2b/d43/d53/d45/de7 0 2024-09-18T12:49:24.381 INFO:tasks.workunit.client.1.smithi148.stdout:3/783: creat d4/d8/d1e/d6b/d31/f10f x:0 0 0 2024-09-18T12:49:24.382 INFO:tasks.workunit.client.1.smithi148.stdout:3/784: dread - d4/d8/d1e/d6b/d31/d60/da9/d8b/fee zero size 2024-09-18T12:49:24.382 INFO:tasks.workunit.client.1.smithi148.stdout:4/839: mknod d15/d5f/d69/d7f/c118 0 2024-09-18T12:49:24.383 INFO:tasks.workunit.client.0.smithi078.stdout:6/697: mknod d10/d2b/d43/d53/dcb/ce8 0 2024-09-18T12:49:24.383 INFO:tasks.workunit.client.1.smithi148.stdout:7/821: sync 2024-09-18T12:49:24.383 INFO:tasks.workunit.client.1.smithi148.stdout:9/817: sync 2024-09-18T12:49:24.383 INFO:tasks.workunit.client.1.smithi148.stdout:5/848: sync 2024-09-18T12:49:24.385 INFO:tasks.workunit.client.1.smithi148.stdout:8/915: mknod d8/d16/d53/da0/c139 0 2024-09-18T12:49:24.386 INFO:tasks.workunit.client.0.smithi078.stdout:8/514: unlink d0/d39/d4c/d77/d7d/f6b 0 2024-09-18T12:49:24.386 INFO:tasks.workunit.client.1.smithi148.stdout:5/849: truncate d7/d2b/fcf 4460812 0 2024-09-18T12:49:24.387 INFO:tasks.workunit.client.0.smithi078.stdout:6/698: chown d10/d2b/d43/d53/d63/d70/dac/da6/lb6 223720 1 2024-09-18T12:49:24.388 INFO:tasks.workunit.client.1.smithi148.stdout:1/826: truncate dc/d18/d31/d39/f75 1029817 0 2024-09-18T12:49:24.394 INFO:tasks.workunit.client.1.smithi148.stdout:9/818: dread d8/da/dd/d4a/d49/d46/d54/faa [4194304,4194304] 0 2024-09-18T12:49:24.404 INFO:tasks.workunit.client.1.smithi148.stdout:8/916: dread d8/d12/d46/d7e/f89 [0,4194304] 0 2024-09-18T12:49:24.409 INFO:tasks.workunit.client.1.smithi148.stdout:2/751: sync 2024-09-18T12:49:24.438 INFO:tasks.workunit.client.0.smithi078.stdout:7/422: sync 2024-09-18T12:49:24.481 INFO:tasks.workunit.client.1.smithi148.stdout:4/840: mknod d15/d17/d52/d92/d4c/dd0/c119 0 2024-09-18T12:49:24.587 INFO:tasks.workunit.client.1.smithi148.stdout:5/850: creat d7/d8/dc/da6/dee/d25/d4b/dd6/f121 x:0 0 0 2024-09-18T12:49:24.589 INFO:tasks.workunit.client.1.smithi148.stdout:1/827: rename dc/d11/f53 to dc/d18/d63/f116 0 2024-09-18T12:49:24.590 INFO:tasks.workunit.client.1.smithi148.stdout:9/819: truncate d8/da/f4d 501385 0 2024-09-18T12:49:24.591 INFO:tasks.workunit.client.1.smithi148.stdout:9/820: chown d8/da/dd/d4a/d49/d46 2846 1 2024-09-18T12:49:24.592 INFO:tasks.workunit.client.1.smithi148.stdout:9/821: chown d8/da/dd/d65/db9/lea 1471 1 2024-09-18T12:49:24.592 INFO:tasks.workunit.client.1.smithi148.stdout:8/917: mkdir d8/df/d3e/d82/da7/d13a 0 2024-09-18T12:49:24.593 INFO:tasks.workunit.client.1.smithi148.stdout:4/841: symlink d15/d5f/d69/d7f/d94/d103/l11a 0 2024-09-18T12:49:24.595 INFO:tasks.workunit.client.0.smithi078.stdout:7/423: dwrite d7/d9/d14/d22/d3e/f40 [0,4194304] 0 2024-09-18T12:49:24.596 INFO:tasks.workunit.client.0.smithi078.stdout:8/515: write d0/f6a [1551136,82646] 0 2024-09-18T12:49:24.596 INFO:tasks.workunit.client.1.smithi148.stdout:6/847: dwrite d5/fa [0,4194304] 0 2024-09-18T12:49:24.597 INFO:tasks.workunit.client.0.smithi078.stdout:8/516: dread - d0/d7/d1e/d4b/f98 zero size 2024-09-18T12:49:24.597 INFO:tasks.workunit.client.1.smithi148.stdout:6/848: readlink d5/d1a/dc/d2b/d35/d65/l4f 0 2024-09-18T12:49:24.600 INFO:tasks.workunit.client.0.smithi078.stdout:7/424: mknod d7/d9/d14/d22/d3e/c91 0 2024-09-18T12:49:24.604 INFO:tasks.workunit.client.0.smithi078.stdout:8/517: truncate d0/d7/dc/d1f/f28 2684965 0 2024-09-18T12:49:24.604 INFO:tasks.workunit.client.0.smithi078.stdout:6/699: dwrite d10/d2b/d43/d53/d45/d55/f52 [4194304,4194304] 0 2024-09-18T12:49:24.606 INFO:tasks.workunit.client.0.smithi078.stdout:8/518: readlink d0/d7/d53/d57/l4f 0 2024-09-18T12:49:24.611 INFO:tasks.workunit.client.1.smithi148.stdout:3/785: link d4/d8/d6a/l78 d4/d8/d1e/d79/l110 0 2024-09-18T12:49:24.612 INFO:tasks.workunit.client.0.smithi078.stdout:7/425: creat d7/d9/d14/d22/d35/d49/d61/d89/f92 x:0 0 0 2024-09-18T12:49:24.613 INFO:tasks.workunit.client.1.smithi148.stdout:7/822: link db/dc/df/d11/dcc/cdd db/dc/d91/da1/cf6 0 2024-09-18T12:49:24.615 INFO:tasks.workunit.client.1.smithi148.stdout:5/851: mknod d7/d8/d18/d3f/c122 0 2024-09-18T12:49:24.615 INFO:tasks.workunit.client.1.smithi148.stdout:5/852: stat d7/f4f 0 2024-09-18T12:49:24.616 INFO:tasks.workunit.client.0.smithi078.stdout:8/519: mkdir d0/d7/dc/d71/d9b 0 2024-09-18T12:49:24.616 INFO:tasks.workunit.client.1.smithi148.stdout:6/849: fdatasync d5/d1a/dc/d101/f103 0 2024-09-18T12:49:24.618 INFO:tasks.workunit.client.0.smithi078.stdout:7/426: unlink d7/d9/f44 0 2024-09-18T12:49:24.618 INFO:tasks.workunit.client.0.smithi078.stdout:7/427: stat d7/d9/f20 0 2024-09-18T12:49:24.619 INFO:tasks.workunit.client.1.smithi148.stdout:1/828: symlink dc/d18/d10b/l117 0 2024-09-18T12:49:24.619 INFO:tasks.workunit.client.0.smithi078.stdout:7/428: fdatasync d7/d9/d14/f23 0 2024-09-18T12:49:24.620 INFO:tasks.workunit.client.0.smithi078.stdout:8/520: unlink d0/d7/dc/l2d 0 2024-09-18T12:49:24.620 INFO:tasks.workunit.client.0.smithi078.stdout:8/521: readlink d0/d7/dc/d5d/l3d 0 2024-09-18T12:49:24.626 INFO:tasks.workunit.client.0.smithi078.stdout:4/573: sync 2024-09-18T12:49:24.626 INFO:tasks.workunit.client.1.smithi148.stdout:7/823: rmdir db/d52/d4f/dc8 39 2024-09-18T12:49:24.627 INFO:tasks.workunit.client.0.smithi078.stdout:6/700: getdents d10/d2b/d43/d53/d45/d9c 0 2024-09-18T12:49:24.627 INFO:tasks.workunit.client.1.smithi148.stdout:7/824: write db/dc/df/d11/ddc/d75/fcf [392025,25784] 0 2024-09-18T12:49:24.628 INFO:tasks.workunit.client.0.smithi078.stdout:8/522: dwrite d0/d7/dc/d1f/d23/f8c [0,4194304] 0 2024-09-18T12:49:24.630 INFO:tasks.workunit.client.1.smithi148.stdout:6/850: chown d5/d1a/d29/l82 173406209 1 2024-09-18T12:49:24.634 INFO:tasks.workunit.client.1.smithi148.stdout:2/752: rename d9/d17/d29/d92/dca to d9/d24/d67/d72/d107 0 2024-09-18T12:49:24.634 INFO:tasks.workunit.client.1.smithi148.stdout:7/825: dread db/dc/df/d2c/d55/daf/d38/fd2 [0,4194304] 0 2024-09-18T12:49:24.635 INFO:tasks.workunit.client.0.smithi078.stdout:4/574: dwrite d11/f14 [4194304,4194304] 0 2024-09-18T12:49:24.635 INFO:tasks.workunit.client.1.smithi148.stdout:1/829: mkdir dc/d18/d7d/d93/d118 0 2024-09-18T12:49:24.636 INFO:tasks.workunit.client.1.smithi148.stdout:7/826: readlink db/dc/df/d11/ddc/d75/laa 0 2024-09-18T12:49:24.637 INFO:tasks.workunit.client.1.smithi148.stdout:3/786: dread d4/d8/d20/d2b/f3a [0,4194304] 0 2024-09-18T12:49:24.644 INFO:tasks.workunit.client.1.smithi148.stdout:1/830: dread dc/d11/f6e [0,4194304] 0 2024-09-18T12:49:24.644 INFO:tasks.workunit.client.1.smithi148.stdout:5/853: mkdir d7/d8/d18/d3f/d7c/d7d/da8/d123 0 2024-09-18T12:49:24.645 INFO:tasks.workunit.client.0.smithi078.stdout:4/575: dread d11/f16 [0,4194304] 0 2024-09-18T12:49:24.645 INFO:tasks.workunit.client.1.smithi148.stdout:1/831: chown dc/d18/d63/f116 61538 1 2024-09-18T12:49:24.645 INFO:tasks.workunit.client.1.smithi148.stdout:1/832: chown dc/d51 6 1 2024-09-18T12:49:24.646 INFO:tasks.workunit.client.0.smithi078.stdout:7/429: getdents d7/d26 0 2024-09-18T12:49:24.649 INFO:tasks.workunit.client.1.smithi148.stdout:1/833: read dc/d18/d8a/f92 [27657,78574] 0 2024-09-18T12:49:24.649 INFO:tasks.workunit.client.0.smithi078.stdout:8/523: mkdir d0/d7/dc/d1f/d23/d9c 0 2024-09-18T12:49:24.650 INFO:tasks.workunit.client.0.smithi078.stdout:8/524: chown d0/d7/dc/d1f/c35 44150768 1 2024-09-18T12:49:24.650 INFO:tasks.workunit.client.1.smithi148.stdout:5/854: dwrite d7/d8/dc/f5d [4194304,4194304] 0 2024-09-18T12:49:24.652 INFO:tasks.workunit.client.0.smithi078.stdout:4/576: mkdir d11/d27/d5a/d84/d4b/da7/dba 0 2024-09-18T12:49:24.653 INFO:tasks.workunit.client.1.smithi148.stdout:9/822: link d8/da/dd/d3f/l51 d8/d73/lf5 0 2024-09-18T12:49:24.655 INFO:tasks.workunit.client.0.smithi078.stdout:7/430: creat d7/d9/d14/f93 x:0 0 0 2024-09-18T12:49:24.657 INFO:tasks.workunit.client.1.smithi148.stdout:5/855: dwrite d7/d8/fd0 [0,4194304] 0 2024-09-18T12:49:24.657 INFO:tasks.workunit.client.0.smithi078.stdout:8/525: dwrite d0/d7/dc/d5d/d2e/f3a [0,4194304] 0 2024-09-18T12:49:24.661 INFO:tasks.workunit.client.1.smithi148.stdout:7/827: rename db/dc/df/d2c/d55/f8b to db/dc/df/d11/d34/d69/ff7 0 2024-09-18T12:49:24.667 INFO:tasks.workunit.client.0.smithi078.stdout:6/701: write d10/d2b/d43/d53/d45/d55/f2d [1499760,109501] 0 2024-09-18T12:49:24.668 INFO:tasks.workunit.client.0.smithi078.stdout:8/526: creat d0/d7/dc/d1f/d23/d40/f9d x:0 0 0 2024-09-18T12:49:24.672 INFO:tasks.workunit.client.1.smithi148.stdout:2/753: fdatasync d9/d24/d31/d9d/fcb 0 2024-09-18T12:49:24.672 INFO:tasks.workunit.client.0.smithi078.stdout:6/702: read d10/f1e [1349296,105674] 0 2024-09-18T12:49:24.674 INFO:tasks.workunit.client.1.smithi148.stdout:2/754: write d9/d24/d31/d34/d7b/f101 [141960,42071] 0 2024-09-18T12:49:24.675 INFO:tasks.workunit.client.0.smithi078.stdout:6/703: chown d10/d2b/d43/d53/d63/d6b/cb7 45 1 2024-09-18T12:49:24.675 INFO:tasks.workunit.client.1.smithi148.stdout:7/828: rmdir db/dc/df/d11/dcc 39 2024-09-18T12:49:24.676 INFO:tasks.workunit.client.1.smithi148.stdout:8/918: sync 2024-09-18T12:49:24.676 INFO:tasks.workunit.client.1.smithi148.stdout:4/842: sync 2024-09-18T12:49:24.677 INFO:tasks.workunit.client.1.smithi148.stdout:6/851: rmdir d5/d32/d56/dfb/d109 0 2024-09-18T12:49:24.678 INFO:tasks.workunit.client.1.smithi148.stdout:4/843: dread - d15/d17/d52/d92/d4c/d72/fef zero size 2024-09-18T12:49:24.679 INFO:tasks.workunit.client.1.smithi148.stdout:2/755: symlink d9/d24/d31/d34/d42/l108 0 2024-09-18T12:49:24.680 INFO:tasks.workunit.client.1.smithi148.stdout:4/844: fsync d15/d17/d52/d92/d4c/d4f/d64/da0/da1/ffe 0 2024-09-18T12:49:24.681 INFO:tasks.workunit.client.1.smithi148.stdout:3/787: getdents d4/d8/d6a 0 2024-09-18T12:49:24.684 INFO:tasks.workunit.client.1.smithi148.stdout:4/845: write d15/fd1 [666410,87316] 0 2024-09-18T12:49:24.686 INFO:tasks.workunit.client.1.smithi148.stdout:5/856: getdents d7/d8/d18/d3f/d7c 0 2024-09-18T12:49:24.689 INFO:tasks.workunit.client.1.smithi148.stdout:5/857: truncate d7/d8/dc/da6/dee/d39/dc2/dd2/f108 373110 0 2024-09-18T12:49:24.689 INFO:tasks.workunit.client.1.smithi148.stdout:8/919: link d8/d12/d51/d94/c84 d8/d16/dff/d12f/c13b 0 2024-09-18T12:49:24.690 INFO:tasks.workunit.client.1.smithi148.stdout:5/858: stat d7/d8/dc/da6/dee/d25 0 2024-09-18T12:49:24.691 INFO:tasks.workunit.client.0.smithi078.stdout:7/431: dread d7/d5d/f74 [0,4194304] 0 2024-09-18T12:49:24.691 INFO:tasks.workunit.client.1.smithi148.stdout:3/788: rename d4/d8/d20/d2b/f8f to d4/d8/f111 0 2024-09-18T12:49:24.692 INFO:tasks.workunit.client.1.smithi148.stdout:3/789: fdatasync d4/d8/d1e/d6b/d31/f34 0 2024-09-18T12:49:24.694 INFO:tasks.workunit.client.1.smithi148.stdout:5/859: creat d7/d8/dc/d12/d20/d10d/f124 x:0 0 0 2024-09-18T12:49:24.696 INFO:tasks.workunit.client.0.smithi078.stdout:4/577: write d11/f16 [1975372,109067] 0 2024-09-18T12:49:24.696 INFO:tasks.workunit.client.1.smithi148.stdout:1/834: dread dc/fd [0,4194304] 0 2024-09-18T12:49:24.697 INFO:tasks.workunit.client.0.smithi078.stdout:6/704: dread f9 [0,4194304] 0 2024-09-18T12:49:24.697 INFO:tasks.workunit.client.1.smithi148.stdout:4/846: rename d15/d17/d52/d92/d4c/d4f/d34/lb4 to d15/d90/l11b 0 2024-09-18T12:49:24.698 INFO:tasks.workunit.client.0.smithi078.stdout:6/705: readlink d10/d2b/d43/d53/d63/l8e 0 2024-09-18T12:49:24.698 INFO:tasks.workunit.client.0.smithi078.stdout:6/706: stat d10/d2b/d43/l4e 0 2024-09-18T12:49:24.702 INFO:tasks.workunit.client.0.smithi078.stdout:6/707: truncate d10/d2b/d61/f9e 632946 0 2024-09-18T12:49:24.703 INFO:tasks.workunit.client.1.smithi148.stdout:1/835: dread - dc/d11/d38/d7b/fc3 zero size 2024-09-18T12:49:24.704 INFO:tasks.workunit.client.1.smithi148.stdout:9/823: write d8/da/dd/d4a/d49/f85 [760135,13757] 0 2024-09-18T12:49:24.704 INFO:tasks.workunit.client.0.smithi078.stdout:4/578: mknod d11/d27/d5a/d84/cbb 0 2024-09-18T12:49:24.706 INFO:tasks.workunit.client.1.smithi148.stdout:3/790: dwrite d4/d8/d1e/f5e [0,4194304] 0 2024-09-18T12:49:24.707 INFO:tasks.workunit.client.1.smithi148.stdout:7/829: write db/dc/df/d2c/f5e [979667,78166] 0 2024-09-18T12:49:24.708 INFO:tasks.workunit.client.1.smithi148.stdout:6/852: write d5/d1a/d29/d5c/f93 [447890,18654] 0 2024-09-18T12:49:24.709 INFO:tasks.workunit.client.0.smithi078.stdout:6/708: mknod d10/d2b/d43/de5/ce9 0 2024-09-18T12:49:24.710 INFO:tasks.workunit.client.1.smithi148.stdout:2/756: write d9/d3a/f4b [458571,118491] 0 2024-09-18T12:49:24.710 INFO:tasks.workunit.client.1.smithi148.stdout:7/830: chown db/dc/df/d11/d34/d69/dc3 67100930 1 2024-09-18T12:49:24.710 INFO:tasks.workunit.client.1.smithi148.stdout:6/853: stat d5/d1a/dc/d101/cef 0 2024-09-18T12:49:24.711 INFO:tasks.workunit.client.1.smithi148.stdout:9/824: fsync d8/da/f82 0 2024-09-18T12:49:24.712 INFO:tasks.workunit.client.1.smithi148.stdout:2/757: fdatasync d9/d73/d81/ff1 0 2024-09-18T12:49:24.712 INFO:tasks.workunit.client.1.smithi148.stdout:7/831: chown db/dc/df/d1d/d41/fa2 67269199 1 2024-09-18T12:49:24.713 INFO:tasks.workunit.client.1.smithi148.stdout:6/854: chown d5/d1a/dc/d2b/d35/f72 45 1 2024-09-18T12:49:24.713 INFO:tasks.workunit.client.0.smithi078.stdout:4/579: symlink d11/d27/lbc 0 2024-09-18T12:49:24.713 INFO:tasks.workunit.client.0.smithi078.stdout:6/709: read d10/d2b/d43/d53/d63/d70/f8c [2118469,50908] 0 2024-09-18T12:49:24.715 INFO:tasks.workunit.client.0.smithi078.stdout:6/710: chown d10/d2b/d43/d53 11917917 1 2024-09-18T12:49:24.716 INFO:tasks.workunit.client.1.smithi148.stdout:4/847: link d15/d17/d52/d92/f84 d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d10b/f11c 0 2024-09-18T12:49:24.717 INFO:tasks.workunit.client.0.smithi078.stdout:6/711: read d10/d2b/d43/d53/d63/d70/f8c [255403,17721] 0 2024-09-18T12:49:24.719 INFO:tasks.workunit.client.0.smithi078.stdout:4/580: creat d11/d27/d47/d4e/d50/fbd x:0 0 0 2024-09-18T12:49:24.719 INFO:tasks.workunit.client.1.smithi148.stdout:2/758: dwrite d9/d24/d67/fdf [0,4194304] 0 2024-09-18T12:49:24.720 INFO:tasks.workunit.client.1.smithi148.stdout:3/791: dread - d4/d8/d20/d99/fc1 zero size 2024-09-18T12:49:24.722 INFO:tasks.workunit.client.0.smithi078.stdout:6/712: mknod d10/d2b/d43/d53/d63/d70/dac/cea 0 2024-09-18T12:49:24.723 INFO:tasks.workunit.client.0.smithi078.stdout:4/581: truncate d11/d27/d47/d4e/daa/fab 15553 0 2024-09-18T12:49:24.724 INFO:tasks.workunit.client.0.smithi078.stdout:7/432: dwrite d7/f28 [0,4194304] 0 2024-09-18T12:49:24.724 INFO:tasks.workunit.client.1.smithi148.stdout:9/825: truncate d8/da/dd/d77/fe2 1782411 0 2024-09-18T12:49:24.725 INFO:tasks.workunit.client.0.smithi078.stdout:7/433: chown d7/d5d/d7a/f5c 6450 1 2024-09-18T12:49:24.726 INFO:tasks.workunit.client.0.smithi078.stdout:6/713: read d10/d2b/d43/d53/d63/d70/d7d/fd0 [537559,40915] 0 2024-09-18T12:49:24.727 INFO:tasks.workunit.client.0.smithi078.stdout:7/434: write d7/d5d/f6d [404290,83794] 0 2024-09-18T12:49:24.728 INFO:tasks.workunit.client.1.smithi148.stdout:8/920: getdents d8/d16/d53/d39 0 2024-09-18T12:49:24.728 INFO:tasks.workunit.client.1.smithi148.stdout:2/759: dread d9/d24/f28 [0,4194304] 0 2024-09-18T12:49:24.729 INFO:tasks.workunit.client.1.smithi148.stdout:2/760: stat d9/d24/d67/cbc 0 2024-09-18T12:49:24.730 INFO:tasks.workunit.client.0.smithi078.stdout:4/582: creat d11/d27/d47/d78/d95/fbe x:0 0 0 2024-09-18T12:49:24.730 INFO:tasks.workunit.client.1.smithi148.stdout:8/921: write d8/d16/d53/da0/fb7 [2691917,61486] 0 2024-09-18T12:49:24.731 INFO:tasks.workunit.client.1.smithi148.stdout:7/832: dwrite db/dc/df/d11/dcc/fec [0,4194304] 0 2024-09-18T12:49:24.732 INFO:tasks.workunit.client.1.smithi148.stdout:2/761: read - d9/d24/d31/d34/d7b/fd5 zero size 2024-09-18T12:49:24.733 INFO:tasks.workunit.client.1.smithi148.stdout:7/833: stat db/fc4 0 2024-09-18T12:49:24.735 INFO:tasks.workunit.client.0.smithi078.stdout:6/714: symlink d10/d2b/d61/leb 0 2024-09-18T12:49:24.737 INFO:tasks.workunit.client.0.smithi078.stdout:7/435: creat d7/d26/f94 x:0 0 0 2024-09-18T12:49:24.738 INFO:tasks.workunit.client.0.smithi078.stdout:7/436: chown d7/d9/d14/d22/d35/d49/d61/d89/f92 106491504 1 2024-09-18T12:49:24.742 INFO:tasks.workunit.client.1.smithi148.stdout:1/836: dwrite f6 [0,4194304] 0 2024-09-18T12:49:24.744 INFO:tasks.workunit.client.1.smithi148.stdout:9/826: rmdir d8/da/dd/d4a/d49/d46/d75/d97 39 2024-09-18T12:49:24.746 INFO:tasks.workunit.client.1.smithi148.stdout:4/848: creat d15/d17/d52/d68/da5/d102/f11d x:0 0 0 2024-09-18T12:49:24.750 INFO:tasks.workunit.client.0.smithi078.stdout:7/437: read d7/d26/d4f/f50 [3786763,74097] 0 2024-09-18T12:49:24.751 INFO:tasks.workunit.client.1.smithi148.stdout:4/849: dread d15/d5f/d69/d7f/f8e [0,4194304] 0 2024-09-18T12:49:24.751 INFO:tasks.workunit.client.1.smithi148.stdout:3/792: mknod d4/d8/d1e/d6b/c112 0 2024-09-18T12:49:24.754 INFO:tasks.workunit.client.0.smithi078.stdout:7/438: getdents d7/d9/d14/d22/d35/d49/d61/d7b 0 2024-09-18T12:49:24.757 INFO:tasks.workunit.client.0.smithi078.stdout:7/439: mkdir d7/d9/d14/d22/d3e/d95 0 2024-09-18T12:49:24.758 INFO:tasks.workunit.client.0.smithi078.stdout:7/440: write d7/d26/f29 [3855793,15217] 0 2024-09-18T12:49:24.758 INFO:tasks.workunit.client.1.smithi148.stdout:9/827: read d8/da/fb [6922129,120276] 0 2024-09-18T12:49:24.759 INFO:tasks.workunit.client.1.smithi148.stdout:1/837: dread dc/d18/d7d/d93/dd9/d2b/f47 [0,4194304] 0 2024-09-18T12:49:24.759 INFO:tasks.workunit.client.0.smithi078.stdout:7/441: write d7/d26/f79 [1033296,83656] 0 2024-09-18T12:49:24.760 INFO:tasks.workunit.client.1.smithi148.stdout:5/860: sync 2024-09-18T12:49:24.760 INFO:tasks.workunit.client.1.smithi148.stdout:6/855: getdents d5/d32/d56/dfb 0 2024-09-18T12:49:24.760 INFO:tasks.workunit.client.0.smithi078.stdout:2/513: sync 2024-09-18T12:49:24.761 INFO:tasks.workunit.client.1.smithi148.stdout:6/856: write d5/fa [5215206,66729] 0 2024-09-18T12:49:24.763 INFO:tasks.workunit.client.1.smithi148.stdout:4/850: rename d15/d17/d52/d92/d4c/d72 to d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/d11e 0 2024-09-18T12:49:24.765 INFO:tasks.workunit.client.0.smithi078.stdout:4/583: write d11/d27/d47/f57 [1255929,126339] 0 2024-09-18T12:49:24.767 INFO:tasks.workunit.client.1.smithi148.stdout:4/851: write d15/d17/d52/d92/f46 [2298406,50343] 0 2024-09-18T12:49:24.768 INFO:tasks.workunit.client.1.smithi148.stdout:5/861: dwrite d7/d8/dc/da6/dee/d69/f73 [0,4194304] 0 2024-09-18T12:49:24.770 INFO:tasks.workunit.client.0.smithi078.stdout:6/715: write d10/f97 [800738,91735] 0 2024-09-18T12:49:24.772 INFO:tasks.workunit.client.0.smithi078.stdout:4/584: dwrite d11/d27/d5a/f70 [0,4194304] 0 2024-09-18T12:49:24.772 INFO:tasks.workunit.client.1.smithi148.stdout:6/857: dwrite d5/d1a/dc/d2b/fb7 [0,4194304] 0 2024-09-18T12:49:24.773 INFO:tasks.workunit.client.0.smithi078.stdout:4/585: write d11/f93 [116849,50750] 0 2024-09-18T12:49:24.774 INFO:tasks.workunit.client.0.smithi078.stdout:7/442: mknod d7/d9/d32/d3b/d70/c96 0 2024-09-18T12:49:24.775 INFO:tasks.workunit.client.1.smithi148.stdout:7/834: link db/dc/df/d11/f6b db/ff8 0 2024-09-18T12:49:24.776 INFO:tasks.workunit.client.1.smithi148.stdout:5/862: dread - d7/d8/dc/da6/dee/d25/d4b/dd6/fec zero size 2024-09-18T12:49:24.781 INFO:tasks.workunit.client.0.smithi078.stdout:7/443: rename d7/d5d/d5e to d7/d9/d14/d22/d3e/d95/d97 0 2024-09-18T12:49:24.782 INFO:tasks.workunit.client.1.smithi148.stdout:2/762: write d9/d24/d47/f5e [414762,79807] 0 2024-09-18T12:49:24.782 INFO:tasks.workunit.client.1.smithi148.stdout:5/863: stat d7/d8/dc/d12/d20/c30 0 2024-09-18T12:49:24.783 INFO:tasks.workunit.client.1.smithi148.stdout:4/852: dwrite d15/d17/f19 [8388608,4194304] 0 2024-09-18T12:49:24.784 INFO:tasks.workunit.client.0.smithi078.stdout:2/514: getdents d4/d8/d23 0 2024-09-18T12:49:24.785 INFO:tasks.workunit.client.1.smithi148.stdout:3/793: write d4/d8/d1e/d6b/fb9 [38061,26835] 0 2024-09-18T12:49:24.786 INFO:tasks.workunit.client.0.smithi078.stdout:2/515: write d4/d8/d23/d52/d5f/d86/d33/f72 [684017,117149] 0 2024-09-18T12:49:24.787 INFO:tasks.workunit.client.0.smithi078.stdout:5/800: sync 2024-09-18T12:49:24.787 INFO:tasks.workunit.client.0.smithi078.stdout:0/626: sync 2024-09-18T12:49:24.787 INFO:tasks.workunit.client.0.smithi078.stdout:1/566: sync 2024-09-18T12:49:24.787 INFO:tasks.workunit.client.0.smithi078.stdout:3/497: sync 2024-09-18T12:49:24.787 INFO:tasks.workunit.client.0.smithi078.stdout:9/535: sync 2024-09-18T12:49:24.787 INFO:tasks.workunit.client.0.smithi078.stdout:8/527: sync 2024-09-18T12:49:24.789 INFO:tasks.workunit.client.0.smithi078.stdout:6/716: truncate d10/d2b/d43/d53/d63/d70/d7d/fb5 3681590 0 2024-09-18T12:49:24.793 INFO:tasks.workunit.client.1.smithi148.stdout:7/835: chown db/d52/d4f/fc7 3948628 1 2024-09-18T12:49:24.793 INFO:tasks.workunit.client.1.smithi148.stdout:8/922: link d8/d12/d51/d94/c9a d8/d12/d46/c13c 0 2024-09-18T12:49:24.795 INFO:tasks.workunit.client.1.smithi148.stdout:1/838: fsync dc/d18/d7d/d93/dd9/f3c 0 2024-09-18T12:49:24.796 INFO:tasks.workunit.client.0.smithi078.stdout:7/444: symlink d7/d9/d14/d22/d35/d49/d7d/l98 0 2024-09-18T12:49:24.797 INFO:tasks.workunit.client.0.smithi078.stdout:0/627: dread d3/d1f/f52 [0,4194304] 0 2024-09-18T12:49:24.798 INFO:tasks.workunit.client.0.smithi078.stdout:5/801: symlink d2/d74/lfa 0 2024-09-18T12:49:24.798 INFO:tasks.workunit.client.1.smithi148.stdout:7/836: truncate db/dc/df/d11/ddc/d75/fcf 1322266 0 2024-09-18T12:49:24.800 INFO:tasks.workunit.client.0.smithi078.stdout:2/516: symlink d4/d8/d23/d52/d5f/la7 0 2024-09-18T12:49:24.800 INFO:tasks.workunit.client.1.smithi148.stdout:9/828: dwrite d8/da/dd/d35/d81/f8e [0,4194304] 0 2024-09-18T12:49:24.800 INFO:tasks.workunit.client.1.smithi148.stdout:1/839: read dc/d51/f70 [3966226,47355] 0 2024-09-18T12:49:24.801 INFO:tasks.workunit.client.0.smithi078.stdout:6/717: symlink d10/d2b/d61/dd7/lec 0 2024-09-18T12:49:24.807 INFO:tasks.workunit.client.0.smithi078.stdout:7/445: mkdir d7/d3f/d99 0 2024-09-18T12:49:24.810 INFO:tasks.workunit.client.0.smithi078.stdout:0/628: creat d3/d1f/d2e/d4e/d37/fe6 x:0 0 0 2024-09-18T12:49:24.815 INFO:tasks.workunit.client.0.smithi078.stdout:3/498: dread d9/d13/d33/d34/f4f [0,4194304] 0 2024-09-18T12:49:24.817 INFO:tasks.workunit.client.0.smithi078.stdout:2/517: mknod d4/dd/d8a/ca8 0 2024-09-18T12:49:24.817 INFO:tasks.workunit.client.0.smithi078.stdout:7/446: dwrite d7/d9/d14/d22/d3e/d95/d97/f71 [0,4194304] 0 2024-09-18T12:49:24.819 INFO:tasks.workunit.client.0.smithi078.stdout:6/718: symlink d10/d2b/d43/dc4/led 0 2024-09-18T12:49:24.821 INFO:tasks.workunit.client.0.smithi078.stdout:4/586: truncate d11/d27/d5a/d84/d40/f41 2617252 0 2024-09-18T12:49:24.827 INFO:tasks.workunit.client.0.smithi078.stdout:0/629: rmdir d3/d1f/d2e/d68/d30/d7c/da3/de2 39 2024-09-18T12:49:24.827 INFO:tasks.workunit.client.0.smithi078.stdout:0/630: dread - d3/d43/fb7 zero size 2024-09-18T12:49:24.828 INFO:tasks.workunit.client.1.smithi148.stdout:8/923: dread d8/fb [0,4194304] 0 2024-09-18T12:49:24.829 INFO:tasks.workunit.client.0.smithi078.stdout:0/631: write d3/d1f/d2e/d4e/f49 [5101341,101587] 0 2024-09-18T12:49:24.830 INFO:tasks.workunit.client.1.smithi148.stdout:8/924: read d8/f92 [3789268,67297] 0 2024-09-18T12:49:24.830 INFO:tasks.workunit.client.0.smithi078.stdout:0/632: dread - d3/fd2 zero size 2024-09-18T12:49:24.834 INFO:tasks.workunit.client.0.smithi078.stdout:2/518: truncate d4/d8/f37 839585 0 2024-09-18T12:49:24.836 INFO:tasks.workunit.client.0.smithi078.stdout:9/536: dwrite d5/d7/d32/d2a/d6b/f60 [0,4194304] 0 2024-09-18T12:49:24.842 INFO:tasks.workunit.client.0.smithi078.stdout:1/567: rename d0/d5b/db2 to d0/d8/da/d3e/d50/dba 0 2024-09-18T12:49:24.845 INFO:tasks.workunit.client.0.smithi078.stdout:0/633: fsync d3/d1f/d2e/d4e/d37/d72/d96/fcf 0 2024-09-18T12:49:24.847 INFO:tasks.workunit.client.0.smithi078.stdout:1/568: truncate d0/d8/da/d3e/d58/d6e/d52/d47/f8a 4202712 0 2024-09-18T12:49:24.849 INFO:tasks.workunit.client.0.smithi078.stdout:5/802: dwrite d2/d4/d9/d2f/d30/f5f [0,4194304] 0 2024-09-18T12:49:24.857 INFO:tasks.workunit.client.0.smithi078.stdout:6/719: mknod d10/d2b/d43/d53/d45/cee 0 2024-09-18T12:49:24.858 INFO:tasks.workunit.client.0.smithi078.stdout:9/537: mknod d5/d40/cac 0 2024-09-18T12:49:24.865 INFO:tasks.workunit.client.0.smithi078.stdout:4/587: dwrite d11/d27/d5a/d5d/f8e [0,4194304] 0 2024-09-18T12:49:24.877 INFO:tasks.workunit.client.0.smithi078.stdout:2/519: dwrite d4/f5 [0,4194304] 0 2024-09-18T12:49:24.878 INFO:tasks.workunit.client.1.smithi148.stdout:2/763: truncate d9/d24/d31/f62 253910 0 2024-09-18T12:49:24.884 INFO:tasks.workunit.client.1.smithi148.stdout:6/858: truncate d5/d32/f58 747875 0 2024-09-18T12:49:24.888 INFO:tasks.workunit.client.1.smithi148.stdout:7/837: mkdir db/dc/df/d11/ddc/d75/df9 0 2024-09-18T12:49:24.888 INFO:tasks.workunit.client.1.smithi148.stdout:6/859: read d5/d32/d38/d50/de7/f8d [118452,104898] 0 2024-09-18T12:49:24.895 INFO:tasks.workunit.client.1.smithi148.stdout:9/829: dwrite d8/da/dd/d4a/d49/d46/f91 [0,4194304] 0 2024-09-18T12:49:24.896 INFO:tasks.workunit.client.1.smithi148.stdout:2/764: truncate d9/d73/f91 3850184 0 2024-09-18T12:49:24.897 INFO:tasks.workunit.client.1.smithi148.stdout:2/765: dread - d9/d24/d31/d34/d42/fd2 zero size 2024-09-18T12:49:24.898 INFO:tasks.workunit.client.1.smithi148.stdout:3/794: mkdir d4/d8/d20/d99/dfd/d113 0 2024-09-18T12:49:24.899 INFO:tasks.workunit.client.1.smithi148.stdout:3/795: stat d4/d8/d20/d2b/d7f/d93/d94/dac/cfb 0 2024-09-18T12:49:24.900 INFO:tasks.workunit.client.0.smithi078.stdout:2/520: dread d4/f9 [0,4194304] 0 2024-09-18T12:49:24.907 INFO:tasks.workunit.client.1.smithi148.stdout:6/860: creat d5/d1a/d29/d5c/f114 x:0 0 0 2024-09-18T12:49:24.907 INFO:tasks.workunit.client.1.smithi148.stdout:5/864: dwrite d7/d8/f9 [0,4194304] 0 2024-09-18T12:49:24.909 INFO:tasks.workunit.client.1.smithi148.stdout:5/865: chown d7/d8/dc/da6/dee/d69/ff2 2311228 1 2024-09-18T12:49:24.914 INFO:tasks.workunit.client.0.smithi078.stdout:8/528: rename d0/d7/d1e/d4b/f5a to d0/d7/d53/d57/d67/f9e 0 2024-09-18T12:49:24.920 INFO:tasks.workunit.client.1.smithi148.stdout:1/840: dwrite dc/d11/d38/f6f [0,4194304] 0 2024-09-18T12:49:24.922 INFO:tasks.workunit.client.1.smithi148.stdout:1/841: chown dc/d11/d38/la9 102228367 1 2024-09-18T12:49:24.924 INFO:tasks.workunit.client.1.smithi148.stdout:9/830: dread d8/f10 [0,4194304] 0 2024-09-18T12:49:24.931 INFO:tasks.workunit.client.1.smithi148.stdout:9/831: dwrite d8/da/dd/d4a/d49/d46/d54/dab/fd0 [0,4194304] 0 2024-09-18T12:49:24.973 INFO:tasks.workunit.client.0.smithi078.stdout:5/803: symlink d2/d4/d9/da/d60/db3/d16/d36/db0/lfb 0 2024-09-18T12:49:24.974 INFO:tasks.workunit.client.0.smithi078.stdout:5/804: chown d2/d4/d9/l43 247 1 2024-09-18T12:49:24.976 INFO:tasks.workunit.client.0.smithi078.stdout:1/569: truncate d0/d8/da/d3e/d50/f7c 673887 0 2024-09-18T12:49:24.983 INFO:tasks.workunit.client.0.smithi078.stdout:9/538: rmdir d5/d7/d32/d2a/d68/d97 39 2024-09-18T12:49:24.985 INFO:tasks.workunit.client.1.smithi148.stdout:5/866: truncate d7/d8/dc/d12/d31/f50 1146290 0 2024-09-18T12:49:24.987 INFO:tasks.workunit.client.1.smithi148.stdout:5/867: truncate d7/d8/dc/da6/dee/d77/dd4/f107 1228487 0 2024-09-18T12:49:24.988 INFO:tasks.workunit.client.1.smithi148.stdout:5/868: fsync d7/d8/dc/d12/f51 0 2024-09-18T12:49:24.989 INFO:tasks.workunit.client.1.smithi148.stdout:4/853: getdents d15/d17/d52/d68/da5 0 2024-09-18T12:49:24.993 INFO:tasks.workunit.client.0.smithi078.stdout:4/588: dread - d11/d27/d47/f87 zero size 2024-09-18T12:49:24.993 INFO:tasks.workunit.client.0.smithi078.stdout:4/589: chown d11/d27/d5a/c66 19297 1 2024-09-18T12:49:24.993 INFO:tasks.workunit.client.0.smithi078.stdout:4/590: stat d11/d27/d47/f49 0 2024-09-18T12:49:24.994 INFO:tasks.workunit.client.0.smithi078.stdout:4/591: chown d11/d27/d47/d4e/d50/l51 8 1 2024-09-18T12:49:24.994 INFO:tasks.workunit.client.1.smithi148.stdout:2/766: creat d9/d24/d31/df7/f109 x:0 0 0 2024-09-18T12:49:24.996 INFO:tasks.workunit.client.1.smithi148.stdout:3/796: creat d4/d8/d1e/d63/d10b/f114 x:0 0 0 2024-09-18T12:49:24.997 INFO:tasks.workunit.client.1.smithi148.stdout:6/861: dread d5/d1a/dc/d2b/d35/d65/f4b [0,4194304] 0 2024-09-18T12:49:25.006 INFO:tasks.workunit.client.1.smithi148.stdout:7/838: creat db/dc/df/d1d/ffa x:0 0 0 2024-09-18T12:49:25.007 INFO:tasks.workunit.client.0.smithi078.stdout:7/447: getdents d7/d5d 0 2024-09-18T12:49:25.009 INFO:tasks.workunit.client.1.smithi148.stdout:8/925: link d8/d16/f5d d8/df/d3e/f13d 0 2024-09-18T12:49:25.012 INFO:tasks.workunit.client.0.smithi078.stdout:9/539: stat d5/d7/d32/d81/l9e 0 2024-09-18T12:49:25.015 INFO:tasks.workunit.client.0.smithi078.stdout:4/592: unlink d11/d27/d5a/d5d/l96 0 2024-09-18T12:49:25.023 INFO:tasks.workunit.client.1.smithi148.stdout:8/926: dread d8/d12/d46/d74/fc0 [0,4194304] 0 2024-09-18T12:49:25.024 INFO:tasks.workunit.client.0.smithi078.stdout:4/593: mknod d11/d27/d47/d4e/d76/cbf 0 2024-09-18T12:49:25.024 INFO:tasks.workunit.client.0.smithi078.stdout:4/594: readlink d11/d27/d5a/lb9 0 2024-09-18T12:49:25.025 INFO:tasks.workunit.client.0.smithi078.stdout:4/595: dread - d11/d27/d47/fa6 zero size 2024-09-18T12:49:25.027 INFO:tasks.workunit.client.0.smithi078.stdout:9/540: symlink d5/d7/d32/d2a/lad 0 2024-09-18T12:49:25.028 INFO:tasks.workunit.client.1.smithi148.stdout:5/869: truncate d7/d8/fa 2582577 0 2024-09-18T12:49:25.029 INFO:tasks.workunit.client.0.smithi078.stdout:4/596: stat d11/d27/d5a/d84/d40/f8b 0 2024-09-18T12:49:25.032 INFO:tasks.workunit.client.0.smithi078.stdout:4/597: write d11/d27/d47/d4e/f65 [1541938,66869] 0 2024-09-18T12:49:25.036 INFO:tasks.workunit.client.1.smithi148.stdout:5/870: unlink d7/d8/d18/d3f/ff6 0 2024-09-18T12:49:25.036 INFO:tasks.workunit.client.1.smithi148.stdout:5/871: stat d7/d8/dc/d12/ffa 0 2024-09-18T12:49:25.038 INFO:tasks.workunit.client.0.smithi078.stdout:4/598: dwrite d11/d27/d47/d4e/f65 [0,4194304] 0 2024-09-18T12:49:25.039 INFO:tasks.workunit.client.0.smithi078.stdout:4/599: readlink d11/l1e 0 2024-09-18T12:49:25.039 INFO:tasks.workunit.client.1.smithi148.stdout:1/842: getdents dc/d11/d96 0 2024-09-18T12:49:25.043 INFO:tasks.workunit.client.0.smithi078.stdout:4/600: mknod d11/d27/d47/d78/d95/cc0 0 2024-09-18T12:49:25.046 INFO:tasks.workunit.client.1.smithi148.stdout:1/843: creat dc/d18/d7d/dea/f119 x:0 0 0 2024-09-18T12:49:25.057 INFO:tasks.workunit.client.1.smithi148.stdout:5/872: dread d7/d8/f83 [0,4194304] 0 2024-09-18T12:49:25.057 INFO:tasks.workunit.client.1.smithi148.stdout:9/832: link f0 d8/da/dd/d4a/ff6 0 2024-09-18T12:49:25.060 INFO:tasks.workunit.client.1.smithi148.stdout:5/873: dread d7/d8/dc/d12/d20/df3/fc7 [0,4194304] 0 2024-09-18T12:49:25.061 INFO:tasks.workunit.client.1.smithi148.stdout:9/833: dread d8/d6f/f80 [0,4194304] 0 2024-09-18T12:49:25.062 INFO:tasks.workunit.client.1.smithi148.stdout:5/874: chown d7/d8/dc/da6/dee/d25/d4b/dd6/fec 8388 1 2024-09-18T12:49:25.063 INFO:tasks.workunit.client.1.smithi148.stdout:5/875: stat d7/d8/d18/d3f/d7c/d7d/dbc/f110 0 2024-09-18T12:49:25.070 INFO:tasks.workunit.client.1.smithi148.stdout:9/834: link d8/da/dd/d3f/f9c d8/da/dd/d35/d81/ff7 0 2024-09-18T12:49:25.081 INFO:tasks.workunit.client.1.smithi148.stdout:4/854: mkdir d15/d17/d52/d68/da5/d11f 0 2024-09-18T12:49:25.083 INFO:tasks.workunit.client.1.smithi148.stdout:4/855: creat d15/d17/d52/f120 x:0 0 0 2024-09-18T12:49:25.094 INFO:tasks.workunit.client.0.smithi078.stdout:0/634: creat d3/d1f/d2e/d68/d30/d7c/fe7 x:0 0 0 2024-09-18T12:49:25.096 INFO:tasks.workunit.client.0.smithi078.stdout:0/635: unlink d3/c5e 0 2024-09-18T12:49:25.099 INFO:tasks.workunit.client.0.smithi078.stdout:0/636: mknod d3/d43/ce8 0 2024-09-18T12:49:25.100 INFO:tasks.workunit.client.0.smithi078.stdout:6/720: write d10/d2b/d43/d53/d63/d70/d7d/fa5 [1185065,120404] 0 2024-09-18T12:49:25.101 INFO:tasks.workunit.client.0.smithi078.stdout:8/529: dwrite d0/d7/f55 [0,4194304] 0 2024-09-18T12:49:25.106 INFO:tasks.workunit.client.0.smithi078.stdout:8/530: creat d0/d7/dc/d5d/d2e/d6d/f9f x:0 0 0 2024-09-18T12:49:25.107 INFO:tasks.workunit.client.0.smithi078.stdout:8/531: chown d0/d7/d1e/d4b/f98 1 1 2024-09-18T12:49:25.109 INFO:tasks.workunit.client.0.smithi078.stdout:6/721: dwrite d10/d2b/d43/d53/d63/d70/d7d/fc7 [0,4194304] 0 2024-09-18T12:49:25.115 INFO:tasks.workunit.client.0.smithi078.stdout:8/532: dwrite d0/d39/d4c/d77/f85 [0,4194304] 0 2024-09-18T12:49:25.117 INFO:tasks.workunit.client.0.smithi078.stdout:8/533: fdatasync d0/d7/dc/d5d/d2e/d6d/f97 0 2024-09-18T12:49:25.120 INFO:tasks.workunit.client.0.smithi078.stdout:8/534: dread d0/d7/dc/d1f/d23/d44/f4a [0,4194304] 0 2024-09-18T12:49:25.121 INFO:tasks.workunit.client.0.smithi078.stdout:8/535: write d0/d7/dc/f26 [3408448,61387] 0 2024-09-18T12:49:25.125 INFO:tasks.workunit.client.0.smithi078.stdout:8/536: unlink d0/f2 0 2024-09-18T12:49:25.132 INFO:tasks.workunit.client.0.smithi078.stdout:6/722: dread d10/d2b/d43/d53/d45/d55/f88 [0,4194304] 0 2024-09-18T12:49:25.135 INFO:tasks.workunit.client.0.smithi078.stdout:6/723: creat d10/d2b/d43/d53/d63/d70/d7d/fef x:0 0 0 2024-09-18T12:49:25.143 INFO:tasks.workunit.client.0.smithi078.stdout:5/805: dwrite d2/d4/d9/da/f20 [0,4194304] 0 2024-09-18T12:49:25.145 INFO:tasks.workunit.client.0.smithi078.stdout:5/806: write d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/fc4 [961955,105530] 0 2024-09-18T12:49:25.150 INFO:tasks.workunit.client.0.smithi078.stdout:3/499: rename d9/d13/f39 to d9/d54/d7f/f98 0 2024-09-18T12:49:25.150 INFO:tasks.workunit.client.0.smithi078.stdout:6/724: rmdir d10/d2b/d43/da7 39 2024-09-18T12:49:25.153 INFO:tasks.workunit.client.0.smithi078.stdout:2/521: rename d4/db/l92 to d4/d8/d23/d52/d7c/la9 0 2024-09-18T12:49:25.156 INFO:tasks.workunit.client.0.smithi078.stdout:6/725: mknod d10/d2b/d43/d53/d63/d70/ddd/cf0 0 2024-09-18T12:49:25.158 INFO:tasks.workunit.client.1.smithi148.stdout:8/927: write d8/d12/d46/d74/fad [870071,49591] 0 2024-09-18T12:49:25.163 INFO:tasks.workunit.client.1.smithi148.stdout:8/928: rmdir d8/df/d66/db8 39 2024-09-18T12:49:25.164 INFO:tasks.workunit.client.0.smithi078.stdout:6/726: dwrite d10/d2b/d43/fd1 [0,4194304] 0 2024-09-18T12:49:25.167 INFO:tasks.workunit.client.1.smithi148.stdout:8/929: mknod d8/d12/d51/dc7/c13e 0 2024-09-18T12:49:25.168 INFO:tasks.workunit.client.1.smithi148.stdout:8/930: chown d8/d12/d51/l10a 34640 1 2024-09-18T12:49:25.172 INFO:tasks.workunit.client.0.smithi078.stdout:9/541: symlink d5/d7/d32/lae 0 2024-09-18T12:49:25.174 INFO:tasks.workunit.client.0.smithi078.stdout:4/601: write d11/d27/d5a/d84/f39 [305118,13929] 0 2024-09-18T12:49:25.176 INFO:tasks.workunit.client.1.smithi148.stdout:1/844: truncate dc/d18/d31/dc6/fff 321723 0 2024-09-18T12:49:25.179 INFO:tasks.workunit.client.0.smithi078.stdout:1/570: rename d0/d8/da/d3e/d58/d6e/d52/la4 to d0/d8/da/d3e/d58/d6e/d52/d47/lbb 0 2024-09-18T12:49:25.181 INFO:tasks.workunit.client.0.smithi078.stdout:9/542: dwrite d5/d7/d32/f89 [0,4194304] 0 2024-09-18T12:49:25.187 INFO:tasks.workunit.client.0.smithi078.stdout:5/807: rename d2/cd to d2/d4/d9/da/d2b/d3e/cfc 0 2024-09-18T12:49:25.187 INFO:tasks.workunit.client.1.smithi148.stdout:6/862: sync 2024-09-18T12:49:25.187 INFO:tasks.workunit.client.1.smithi148.stdout:7/839: sync 2024-09-18T12:49:25.188 INFO:tasks.workunit.client.1.smithi148.stdout:7/840: truncate db/dc/df/ff1 1432691 0 2024-09-18T12:49:25.189 INFO:tasks.workunit.client.0.smithi078.stdout:4/602: mkdir d11/d27/d5a/d84/d4b/da7/dba/dc1 0 2024-09-18T12:49:25.191 INFO:tasks.workunit.client.0.smithi078.stdout:4/603: fdatasync d11/d27/d47/d78/d95/fbe 0 2024-09-18T12:49:25.191 INFO:tasks.workunit.client.1.smithi148.stdout:6/863: dread d5/fa [0,4194304] 0 2024-09-18T12:49:25.192 INFO:tasks.workunit.client.1.smithi148.stdout:6/864: chown d5/d1a/d29/fcf 512816 1 2024-09-18T12:49:25.193 INFO:tasks.workunit.client.1.smithi148.stdout:6/865: chown d5/d1a/dc/d101/da4/da6/cbc 11 1 2024-09-18T12:49:25.195 INFO:tasks.workunit.client.0.smithi078.stdout:1/571: creat d0/d8/da/d3e/d58/d6e/d52/d47/d7d/d7f/fbc x:0 0 0 2024-09-18T12:49:25.198 INFO:tasks.workunit.client.0.smithi078.stdout:4/604: symlink d11/d27/d5a/d84/d40/lc2 0 2024-09-18T12:49:25.201 INFO:tasks.workunit.client.1.smithi148.stdout:6/866: creat d5/d1a/d29/d5c/da1/f115 x:0 0 0 2024-09-18T12:49:25.203 INFO:tasks.workunit.client.1.smithi148.stdout:5/876: write d7/d8/dc/da6/dee/d69/d8b/f95 [1037963,28993] 0 2024-09-18T12:49:25.205 INFO:tasks.workunit.client.0.smithi078.stdout:5/808: rename d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/dbe/de3 to d2/d4/d9/da/d60/db3/d16/dfd 0 2024-09-18T12:49:25.205 INFO:tasks.workunit.client.0.smithi078.stdout:9/543: dread d5/d7/d32/d2a/f59 [0,4194304] 0 2024-09-18T12:49:25.206 INFO:tasks.workunit.client.0.smithi078.stdout:1/572: mknod d0/d8/da/d3e/d50/da7/cbd 0 2024-09-18T12:49:25.207 INFO:tasks.workunit.client.0.smithi078.stdout:9/544: fdatasync d5/d7/d32/d2a/f7d 0 2024-09-18T12:49:25.208 INFO:tasks.workunit.client.1.smithi148.stdout:6/867: mkdir d5/d32/d56/d116 0 2024-09-18T12:49:25.209 INFO:tasks.workunit.client.1.smithi148.stdout:3/797: rmdir d4/d8/d1e/d6b/d31/d54 39 2024-09-18T12:49:25.210 INFO:tasks.workunit.client.1.smithi148.stdout:5/877: symlink d7/d8/dc/d12/d20/d100/l125 0 2024-09-18T12:49:25.211 INFO:tasks.workunit.client.0.smithi078.stdout:5/809: creat d2/d4/d9/d2f/d30/ffe x:0 0 0 2024-09-18T12:49:25.213 INFO:tasks.workunit.client.1.smithi148.stdout:6/868: symlink d5/d1a/dc/d101/da4/da6/l117 0 2024-09-18T12:49:25.214 INFO:tasks.workunit.client.0.smithi078.stdout:4/605: rename d11/d27/d47/c9e to d11/d27/d5a/d84/d4b/da7/dba/dc1/cc3 0 2024-09-18T12:49:25.215 INFO:tasks.workunit.client.1.smithi148.stdout:6/869: chown d5/d1a/dc/d101/da4/da6/l10f 218 1 2024-09-18T12:49:25.215 INFO:tasks.workunit.client.1.smithi148.stdout:3/798: dwrite d4/d8/d20/d2b/d43/f4b [4194304,4194304] 0 2024-09-18T12:49:25.215 INFO:tasks.workunit.client.0.smithi078.stdout:4/606: fdatasync d11/d27/d5a/d84/f72 0 2024-09-18T12:49:25.216 INFO:tasks.workunit.client.0.smithi078.stdout:4/607: fdatasync d11/d27/d47/fa6 0 2024-09-18T12:49:25.222 INFO:tasks.workunit.client.0.smithi078.stdout:5/810: creat d2/d4/d9/da/d60/db3/d2d/df2/fff x:0 0 0 2024-09-18T12:49:25.230 INFO:tasks.workunit.client.0.smithi078.stdout:5/811: creat d2/d4/d48/d86/f100 x:0 0 0 2024-09-18T12:49:25.232 INFO:tasks.workunit.client.1.smithi148.stdout:6/870: link d5/d1a/dc/dbf/dcb/cd0 d5/d1a/dc/dbf/c118 0 2024-09-18T12:49:25.232 INFO:tasks.workunit.client.0.smithi078.stdout:5/812: write d2/d4/d9/dc0/fd0 [64784,119126] 0 2024-09-18T12:49:25.232 INFO:tasks.workunit.client.0.smithi078.stdout:8/537: creat d0/d39/fa0 x:0 0 0 2024-09-18T12:49:25.234 INFO:tasks.workunit.client.0.smithi078.stdout:8/538: dread - d0/d7/dc/d5d/d2e/d6d/f97 zero size 2024-09-18T12:49:25.235 INFO:tasks.workunit.client.1.smithi148.stdout:2/767: creat d9/f10a x:0 0 0 2024-09-18T12:49:25.235 INFO:tasks.workunit.client.0.smithi078.stdout:8/539: chown d0/d7/d1e/d50/c6e 0 1 2024-09-18T12:49:25.235 INFO:tasks.workunit.client.1.smithi148.stdout:6/871: symlink d5/d1a/dc/dbf/l119 0 2024-09-18T12:49:25.236 INFO:tasks.workunit.client.0.smithi078.stdout:9/545: link d5/l42 d5/d7/d32/d91/laf 0 2024-09-18T12:49:25.237 INFO:tasks.workunit.client.1.smithi148.stdout:2/768: symlink d9/d24/d67/dc7/l10b 0 2024-09-18T12:49:25.241 INFO:tasks.workunit.client.1.smithi148.stdout:9/835: sync 2024-09-18T12:49:25.242 INFO:tasks.workunit.client.0.smithi078.stdout:8/540: creat d0/d39/d4c/d77/d7d/d3e/fa1 x:0 0 0 2024-09-18T12:49:25.243 INFO:tasks.workunit.client.1.smithi148.stdout:5/878: rmdir d7/d8/dc/da6/dee/d77 39 2024-09-18T12:49:25.245 INFO:tasks.workunit.client.0.smithi078.stdout:5/813: creat d2/d4/d9/da/d60/db3/d16/d36/db0/dde/f101 x:0 0 0 2024-09-18T12:49:25.245 INFO:tasks.workunit.client.1.smithi148.stdout:6/872: creat d5/d32/d38/d50/de7/f11a x:0 0 0 2024-09-18T12:49:25.247 INFO:tasks.workunit.client.0.smithi078.stdout:9/546: mkdir d5/d7/d32/d2a/d68/db0 0 2024-09-18T12:49:25.251 INFO:tasks.workunit.client.0.smithi078.stdout:0/637: dwrite d3/d1f/d2e/d8f/fbd [0,4194304] 0 2024-09-18T12:49:25.254 INFO:tasks.workunit.client.0.smithi078.stdout:9/547: mkdir d5/d7/db1 0 2024-09-18T12:49:25.254 INFO:tasks.workunit.client.0.smithi078.stdout:5/814: dwrite d2/d4/fb9 [0,4194304] 0 2024-09-18T12:49:25.254 INFO:tasks.workunit.client.0.smithi078.stdout:0/638: readlink d3/d1f/d2e/d4e/d37/d72/l99 0 2024-09-18T12:49:25.254 INFO:tasks.workunit.client.1.smithi148.stdout:6/873: read - d5/d1a/dc/d2b/d35/d9c/fc5 zero size 2024-09-18T12:49:25.256 INFO:tasks.workunit.client.1.smithi148.stdout:9/836: getdents d8/da/dd/d77/dd9 0 2024-09-18T12:49:25.257 INFO:tasks.workunit.client.1.smithi148.stdout:5/879: mknod d7/d8/dc/da6/dee/d25/d4b/c126 0 2024-09-18T12:49:25.258 INFO:tasks.workunit.client.1.smithi148.stdout:5/880: chown d7/d8/dc/da6/dee/l11f 258715 1 2024-09-18T12:49:25.260 INFO:tasks.workunit.client.0.smithi078.stdout:9/548: write d5/d7/f1e [254212,4435] 0 2024-09-18T12:49:25.264 INFO:tasks.workunit.client.1.smithi148.stdout:9/837: mkdir d8/da/dd/d35/d81/db7/df8 0 2024-09-18T12:49:25.264 INFO:tasks.workunit.client.0.smithi078.stdout:5/815: dwrite d2/d4/d9/d2f/d30/f80 [4194304,4194304] 0 2024-09-18T12:49:25.267 INFO:tasks.workunit.client.1.smithi148.stdout:4/856: rename d15/d17/d52/d92/f32 to d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/d11e/f121 0 2024-09-18T12:49:25.269 INFO:tasks.workunit.client.1.smithi148.stdout:9/838: symlink d8/da/dd/d35/d81/dc6/dcc/lf9 0 2024-09-18T12:49:25.270 INFO:tasks.workunit.client.0.smithi078.stdout:0/639: mknod d3/d1f/d2e/ce9 0 2024-09-18T12:49:25.273 INFO:tasks.workunit.client.0.smithi078.stdout:5/816: readlink d2/d4/d9/d49/lef 0 2024-09-18T12:49:25.273 INFO:tasks.workunit.client.0.smithi078.stdout:6/727: truncate d10/d2b/d43/d53/d45/f85 1838199 0 2024-09-18T12:49:25.274 INFO:tasks.workunit.client.0.smithi078.stdout:6/728: fdatasync d10/d2b/d43/fd1 0 2024-09-18T12:49:25.274 INFO:tasks.workunit.client.1.smithi148.stdout:4/857: creat d15/d17/d52/d68/f122 x:0 0 0 2024-09-18T12:49:25.275 INFO:tasks.workunit.client.0.smithi078.stdout:5/817: write d2/d4/d9/da/d60/db3/d16/dd2/fc7 [599014,118532] 0 2024-09-18T12:49:25.277 INFO:tasks.workunit.client.0.smithi078.stdout:5/818: chown d2/d4/d9/d2f/cd7 12 1 2024-09-18T12:49:25.277 INFO:tasks.workunit.client.0.smithi078.stdout:5/819: chown d2/db8 29598 1 2024-09-18T12:49:25.278 INFO:tasks.workunit.client.0.smithi078.stdout:5/820: stat d2/d4/c5d 0 2024-09-18T12:49:25.278 INFO:tasks.workunit.client.1.smithi148.stdout:9/839: fsync d8/da/dd/d35/d47/d62/d72/fd3 0 2024-09-18T12:49:25.278 INFO:tasks.workunit.client.1.smithi148.stdout:9/840: chown d8/da/dd/d3f/f58 6908889 1 2024-09-18T12:49:25.279 INFO:tasks.workunit.client.0.smithi078.stdout:0/640: rename d3/d1f/d2e/d8f/da1/la6 to d3/d1f/d2e/d68/de1/lea 0 2024-09-18T12:49:25.281 INFO:tasks.workunit.client.1.smithi148.stdout:1/845: write dc/d18/d31/f88 [1337460,66271] 0 2024-09-18T12:49:25.283 INFO:tasks.workunit.client.0.smithi078.stdout:5/821: rmdir d2/d4/d48/d86 39 2024-09-18T12:49:25.285 INFO:tasks.workunit.client.1.smithi148.stdout:8/931: rename d8/d12/f1b to d8/d12/d46/f13f 0 2024-09-18T12:49:25.287 INFO:tasks.workunit.client.1.smithi148.stdout:8/932: read d8/d16/f2a [287963,22208] 0 2024-09-18T12:49:25.287 INFO:tasks.workunit.client.0.smithi078.stdout:6/729: rename d10/f97 to d10/d2b/d43/d53/d63/ff1 0 2024-09-18T12:49:25.290 INFO:tasks.workunit.client.0.smithi078.stdout:0/641: creat d3/d1f/d2e/d68/dc9/feb x:0 0 0 2024-09-18T12:49:25.291 INFO:tasks.workunit.client.1.smithi148.stdout:1/846: dread dc/d18/d7d/d93/dd9/d2b/f2e [0,4194304] 0 2024-09-18T12:49:25.292 INFO:tasks.workunit.client.0.smithi078.stdout:9/549: dread d5/d7/d32/d2a/d36/f43 [0,4194304] 0 2024-09-18T12:49:25.292 INFO:tasks.workunit.client.0.smithi078.stdout:0/642: chown d3/d1f/d2e/d4e/d37/d72/l74 0 1 2024-09-18T12:49:25.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/822: dread d2/d4/d9/da/d60/db3/f1b [0,4194304] 0 2024-09-18T12:49:25.293 INFO:tasks.workunit.client.1.smithi148.stdout:1/847: read dc/d18/d43/fb2 [3859572,91802] 0 2024-09-18T12:49:25.294 INFO:tasks.workunit.client.1.smithi148.stdout:8/933: creat d8/d16/d27/dc5/dee/f140 x:0 0 0 2024-09-18T12:49:25.295 INFO:tasks.workunit.client.0.smithi078.stdout:9/550: chown d5/l28 42423 1 2024-09-18T12:49:25.297 INFO:tasks.workunit.client.1.smithi148.stdout:9/841: creat d8/da/dd/d4a/d49/d46/ffa x:0 0 0 2024-09-18T12:49:25.298 INFO:tasks.workunit.client.0.smithi078.stdout:6/730: mkdir d10/d2b/d43/d53/d63/d6b/da1/df2 0 2024-09-18T12:49:25.299 INFO:tasks.workunit.client.1.smithi148.stdout:7/841: rename db/c90 to db/d52/d1f/cfb 0 2024-09-18T12:49:25.300 INFO:tasks.workunit.client.1.smithi148.stdout:7/842: chown db/dc/df/d5f/dcb/dd5/fdb 831818102 1 2024-09-18T12:49:25.301 INFO:tasks.workunit.client.0.smithi078.stdout:5/823: rename d2/d4/l11 to d2/d4/d9/da/d60/d61/l102 0 2024-09-18T12:49:25.301 INFO:tasks.workunit.client.1.smithi148.stdout:6/874: symlink d5/d32/l11b 0 2024-09-18T12:49:25.302 INFO:tasks.workunit.client.0.smithi078.stdout:6/731: dread d10/d2b/d61/fb2 [0,4194304] 0 2024-09-18T12:49:25.302 INFO:tasks.workunit.client.0.smithi078.stdout:5/824: write d2/d4/f8 [2346204,64507] 0 2024-09-18T12:49:25.304 INFO:tasks.workunit.client.0.smithi078.stdout:9/551: fdatasync d5/d7/f39 0 2024-09-18T12:49:25.305 INFO:tasks.workunit.client.0.smithi078.stdout:9/552: chown d5/d7/d32/f65 204 1 2024-09-18T12:49:25.305 INFO:tasks.workunit.client.1.smithi148.stdout:9/842: creat d8/da/dd/d77/dd8/ffb x:0 0 0 2024-09-18T12:49:25.306 INFO:tasks.workunit.client.0.smithi078.stdout:0/643: symlink d3/d43/lec 0 2024-09-18T12:49:25.306 INFO:tasks.workunit.client.1.smithi148.stdout:3/799: write f2 [2401576,85982] 0 2024-09-18T12:49:25.307 INFO:tasks.workunit.client.0.smithi078.stdout:0/644: chown d3/d43/f6e 5978 1 2024-09-18T12:49:25.309 INFO:tasks.workunit.client.0.smithi078.stdout:2/522: creat d4/d8/d23/d52/faa x:0 0 0 2024-09-18T12:49:25.310 INFO:tasks.workunit.client.0.smithi078.stdout:2/523: truncate d4/d8/d23/f96 170706 0 2024-09-18T12:49:25.312 INFO:tasks.workunit.client.0.smithi078.stdout:1/573: write d0/d8/da/d3e/d58/d6e/d52/d47/f9e [1503040,75935] 0 2024-09-18T12:49:25.312 INFO:tasks.workunit.client.1.smithi148.stdout:1/848: truncate dc/d18/d31/f5d 783642 0 2024-09-18T12:49:25.312 INFO:tasks.workunit.client.1.smithi148.stdout:3/800: dwrite d4/d8/d1e/d63/d9b/f101 [0,4194304] 0 2024-09-18T12:49:25.315 INFO:tasks.workunit.client.1.smithi148.stdout:9/843: symlink d8/da/dd/d35/d81/dc6/dcc/lfc 0 2024-09-18T12:49:25.319 INFO:tasks.workunit.client.1.smithi148.stdout:3/801: dwrite d4/d8/d20/fb0 [0,4194304] 0 2024-09-18T12:49:25.320 INFO:tasks.workunit.client.0.smithi078.stdout:5/825: dread d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/d90/fcb [0,4194304] 0 2024-09-18T12:49:25.322 INFO:tasks.workunit.client.0.smithi078.stdout:6/732: fdatasync d10/f1c 0 2024-09-18T12:49:25.324 INFO:tasks.workunit.client.1.smithi148.stdout:2/769: write d9/d3a/f52 [566049,116336] 0 2024-09-18T12:49:25.326 INFO:tasks.workunit.client.1.smithi148.stdout:1/849: readlink dc/d18/l4f 0 2024-09-18T12:49:25.326 INFO:tasks.workunit.client.1.smithi148.stdout:9/844: dwrite d8/da/dd/d35/d47/d62/d72/f74 [0,4194304] 0 2024-09-18T12:49:25.327 INFO:tasks.workunit.client.0.smithi078.stdout:1/574: fsync d0/d8/da/d3e/d58/d6e/d52/f30 0 2024-09-18T12:49:25.328 INFO:tasks.workunit.client.1.smithi148.stdout:1/850: dread - dc/d18/d31/d39/f115 zero size 2024-09-18T12:49:25.328 INFO:tasks.workunit.client.0.smithi078.stdout:1/575: fdatasync d0/d8/da/f97 0 2024-09-18T12:49:25.334 INFO:tasks.workunit.client.1.smithi148.stdout:5/881: rename d7/d8/dc/da6/dee/d39/dd5/fe7 to d7/d8/d18/d3f/f127 0 2024-09-18T12:49:25.335 INFO:tasks.workunit.client.1.smithi148.stdout:3/802: creat d4/d8/d20/f115 x:0 0 0 2024-09-18T12:49:25.340 INFO:tasks.workunit.client.1.smithi148.stdout:3/803: truncate d4/d8/d1e/d6b/f81 512160 0 2024-09-18T12:49:25.340 INFO:tasks.workunit.client.1.smithi148.stdout:5/882: dwrite d7/d8/dc/d12/f51 [4194304,4194304] 0 2024-09-18T12:49:25.341 INFO:tasks.workunit.client.0.smithi078.stdout:5/826: mknod d2/d4/d9/da/d60/db3/d16/dd2/c103 0 2024-09-18T12:49:25.342 INFO:tasks.workunit.client.1.smithi148.stdout:1/851: mknod dc/d18/d31/dc6/c11a 0 2024-09-18T12:49:25.343 INFO:tasks.workunit.client.0.smithi078.stdout:6/733: readlink d10/d2b/d43/d53/d63/d70/lc6 0 2024-09-18T12:49:25.346 INFO:tasks.workunit.client.1.smithi148.stdout:5/883: truncate d7/d8/dc/da6/dee/d25/d4b/dd6/fec 863784 0 2024-09-18T12:49:25.348 INFO:tasks.workunit.client.1.smithi148.stdout:6/875: rename d5/d1a/dc/ca8 to d5/d1a/d29/c11c 0 2024-09-18T12:49:25.348 INFO:tasks.workunit.client.1.smithi148.stdout:4/858: dread d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/d11e/f121 [4194304,4194304] 0 2024-09-18T12:49:25.351 INFO:tasks.workunit.client.0.smithi078.stdout:1/576: chown d0/d8/da/d3e/d50/fa0 28842 1 2024-09-18T12:49:25.353 INFO:tasks.workunit.client.1.smithi148.stdout:4/859: write d15/d17/d52/f66 [1018363,13248] 0 2024-09-18T12:49:25.353 INFO:tasks.workunit.client.1.smithi148.stdout:9/845: mknod d8/da/dd/d35/d47/cfd 0 2024-09-18T12:49:25.354 INFO:tasks.workunit.client.1.smithi148.stdout:1/852: dwrite dc/d18/d31/d4b/d8d/ddd/f10c [0,4194304] 0 2024-09-18T12:49:25.355 INFO:tasks.workunit.client.0.smithi078.stdout:0/645: rename d3/d1f/d2e/d8f/d90/dcb/le0 to d3/d1f/d2e/d4e/d37/d72/led 0 2024-09-18T12:49:25.358 INFO:tasks.workunit.client.1.smithi148.stdout:3/804: creat d4/d8/d1e/d63/d9b/f116 x:0 0 0 2024-09-18T12:49:25.358 INFO:tasks.workunit.client.1.smithi148.stdout:9/846: write d8/da/dd/d35/f9b [338592,23155] 0 2024-09-18T12:49:25.359 INFO:tasks.workunit.client.1.smithi148.stdout:5/884: dwrite d7/d8/dc/d12/d20/d10d/f124 [0,4194304] 0 2024-09-18T12:49:25.359 INFO:tasks.workunit.client.1.smithi148.stdout:4/860: fdatasync d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/f10a 0 2024-09-18T12:49:25.360 INFO:tasks.workunit.client.0.smithi078.stdout:0/646: dread d3/f6d [0,4194304] 0 2024-09-18T12:49:25.361 INFO:tasks.workunit.client.0.smithi078.stdout:0/647: dread - d3/d1f/d2e/d68/f8b zero size 2024-09-18T12:49:25.362 INFO:tasks.workunit.client.1.smithi148.stdout:2/770: dread d9/d24/d31/d34/f35 [0,4194304] 0 2024-09-18T12:49:25.362 INFO:tasks.workunit.client.0.smithi078.stdout:0/648: chown d3/d1f/d2e/d68/d30/d7c/f85 203338863 1 2024-09-18T12:49:25.363 INFO:tasks.workunit.client.0.smithi078.stdout:0/649: chown d3/caa 423 1 2024-09-18T12:49:25.371 INFO:tasks.workunit.client.1.smithi148.stdout:6/876: rename d5/d1a/d29/d5c/fa5 to d5/d1a/dc/dbf/dcb/d111/f11d 0 2024-09-18T12:49:25.372 INFO:tasks.workunit.client.1.smithi148.stdout:6/877: stat d5/d32/d56/dfb 0 2024-09-18T12:49:25.377 INFO:tasks.workunit.client.1.smithi148.stdout:9/847: mknod d8/da/dd/d77/cfe 0 2024-09-18T12:49:25.377 INFO:tasks.workunit.client.1.smithi148.stdout:7/843: dwrite db/ff8 [0,4194304] 0 2024-09-18T12:49:25.378 INFO:tasks.workunit.client.1.smithi148.stdout:5/885: symlink d7/d2b/l128 0 2024-09-18T12:49:25.380 INFO:tasks.workunit.client.1.smithi148.stdout:2/771: creat d9/d24/d31/d9d/f10c x:0 0 0 2024-09-18T12:49:25.381 INFO:tasks.workunit.client.1.smithi148.stdout:2/772: write d9/d24/d67/fed [963471,107008] 0 2024-09-18T12:49:25.381 INFO:tasks.workunit.client.1.smithi148.stdout:2/773: fsync d9/d24/d67/fc4 0 2024-09-18T12:49:25.383 INFO:tasks.workunit.client.1.smithi148.stdout:1/853: getdents dc/d18/d7d/d93/dd9/d105 0 2024-09-18T12:49:25.383 INFO:tasks.workunit.client.1.smithi148.stdout:2/774: truncate d9/d24/d31/f83 1666049 0 2024-09-18T12:49:25.387 INFO:tasks.workunit.client.1.smithi148.stdout:9/848: rmdir d8/da/dd/d35/d81 39 2024-09-18T12:49:25.388 INFO:tasks.workunit.client.1.smithi148.stdout:4/861: symlink d15/d17/d52/d92/d4c/d4f/l123 0 2024-09-18T12:49:25.389 INFO:tasks.workunit.client.1.smithi148.stdout:9/849: truncate d8/da/dd/d4a/d49/d46/d54/dab/fe7 949965 0 2024-09-18T12:49:25.390 INFO:tasks.workunit.client.1.smithi148.stdout:5/886: mkdir d7/d8/dc/da6/d129 0 2024-09-18T12:49:25.390 INFO:tasks.workunit.client.1.smithi148.stdout:5/887: chown d7/d8/dc/d12 423683 1 2024-09-18T12:49:25.393 INFO:tasks.workunit.client.1.smithi148.stdout:7/844: unlink db/d52/d1f/c42 0 2024-09-18T12:49:25.394 INFO:tasks.workunit.client.1.smithi148.stdout:4/862: truncate d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/ff7 174100 0 2024-09-18T12:49:25.395 INFO:tasks.workunit.client.0.smithi078.stdout:5/827: symlink d2/d4/d9/da/d60/db3/d16/d36/db0/dde/l104 0 2024-09-18T12:49:25.395 INFO:tasks.workunit.client.1.smithi148.stdout:2/775: creat d9/d24/d31/d9d/dcd/f10d x:0 0 0 2024-09-18T12:49:25.396 INFO:tasks.workunit.client.1.smithi148.stdout:3/805: dread - d4/d8/d20/d2b/fe7 zero size 2024-09-18T12:49:25.397 INFO:tasks.workunit.client.1.smithi148.stdout:1/854: dwrite dc/d18/f1f [0,4194304] 0 2024-09-18T12:49:25.399 INFO:tasks.workunit.client.1.smithi148.stdout:9/850: rename d8/da/dd/d4a/d49/d46/d54/d90/fce to d8/da/dd/d77/dd8/fff 0 2024-09-18T12:49:25.402 INFO:tasks.workunit.client.1.smithi148.stdout:5/888: mkdir d7/d8/dc/da6/dee/d25/d4b/d102/d12a 0 2024-09-18T12:49:25.405 INFO:tasks.workunit.client.0.smithi078.stdout:1/577: dwrite d0/d8/f38 [0,4194304] 0 2024-09-18T12:49:25.405 INFO:tasks.workunit.client.0.smithi078.stdout:0/650: symlink d3/d1f/d2e/d68/dc9/dcd/lee 0 2024-09-18T12:49:25.407 INFO:tasks.workunit.client.0.smithi078.stdout:9/553: dwrite d5/d7/d32/f44 [0,4194304] 0 2024-09-18T12:49:25.407 INFO:tasks.workunit.client.0.smithi078.stdout:0/651: chown d3/d1f 1834 1 2024-09-18T12:49:25.408 INFO:tasks.workunit.client.0.smithi078.stdout:2/524: dwrite d4/d8/d23/d52/d5f/d86/d3b/d4f/f61 [0,4194304] 0 2024-09-18T12:49:25.408 INFO:tasks.workunit.client.1.smithi148.stdout:2/776: chown d9/c20 12 1 2024-09-18T12:49:25.409 INFO:tasks.workunit.client.0.smithi078.stdout:1/578: readlink d0/d8/da/d3e/d58/d6e/d52/l31 0 2024-09-18T12:49:25.410 INFO:tasks.workunit.client.1.smithi148.stdout:8/934: sync 2024-09-18T12:49:25.411 INFO:tasks.workunit.client.1.smithi148.stdout:5/889: dwrite d7/d8/fd0 [0,4194304] 0 2024-09-18T12:49:25.417 INFO:tasks.workunit.client.0.smithi078.stdout:6/734: dwrite d10/d2b/d43/d53/d63/f75 [0,4194304] 0 2024-09-18T12:49:25.419 INFO:tasks.workunit.client.0.smithi078.stdout:5/828: mkdir d2/d4/d9/da/d60/db3/d16/d36/db0/d105 0 2024-09-18T12:49:25.420 INFO:tasks.workunit.client.0.smithi078.stdout:6/735: fdatasync fb 0 2024-09-18T12:49:25.423 INFO:tasks.workunit.client.0.smithi078.stdout:2/525: mkdir d4/d8/d23/d52/d5f/dab 0 2024-09-18T12:49:25.425 INFO:tasks.workunit.client.0.smithi078.stdout:2/526: truncate d4/d8/d23/f9e 1597880 0 2024-09-18T12:49:25.427 INFO:tasks.workunit.client.0.smithi078.stdout:0/652: creat d3/d82/fef x:0 0 0 2024-09-18T12:49:25.427 INFO:tasks.workunit.client.0.smithi078.stdout:5/829: read d2/d4/d9/da/d60/db3/d16/d36/db0/dde/f84 [2948254,32026] 0 2024-09-18T12:49:25.428 INFO:tasks.workunit.client.1.smithi148.stdout:6/878: write d5/d1a/dc/d2b/d35/fd3 [499194,34697] 0 2024-09-18T12:49:25.430 INFO:tasks.workunit.client.1.smithi148.stdout:6/879: fdatasync d5/d1a/dc/d2b/d35/d65/f5e 0 2024-09-18T12:49:25.430 INFO:tasks.workunit.client.0.smithi078.stdout:5/830: truncate d2/d4/d9/da/d60/db3/d16/d36/fcc 523384 0 2024-09-18T12:49:25.432 INFO:tasks.workunit.client.0.smithi078.stdout:9/554: rename d5/l28 to d5/d7/d32/d2a/d68/d97/lb2 0 2024-09-18T12:49:25.433 INFO:tasks.workunit.client.0.smithi078.stdout:5/831: fdatasync d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/fc4 0 2024-09-18T12:49:25.435 INFO:tasks.workunit.client.0.smithi078.stdout:6/736: symlink d10/d2b/d43/d53/d63/d70/d77/dd2/lf3 0 2024-09-18T12:49:25.436 INFO:tasks.workunit.client.1.smithi148.stdout:3/806: dread d4/d8/d1e/d6b/d31/d46/f72 [0,4194304] 0 2024-09-18T12:49:25.436 INFO:tasks.workunit.client.1.smithi148.stdout:8/935: readlink d8/df/l130 0 2024-09-18T12:49:25.436 INFO:tasks.workunit.client.1.smithi148.stdout:5/890: rmdir d7/d8/d18/d3f/d7c/d7d/dbc 39 2024-09-18T12:49:25.437 INFO:tasks.workunit.client.1.smithi148.stdout:4/863: mknod d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/dde/c124 0 2024-09-18T12:49:25.438 INFO:tasks.workunit.client.0.smithi078.stdout:9/555: chown d5/d5c/f88 315 1 2024-09-18T12:49:25.440 INFO:tasks.workunit.client.1.smithi148.stdout:9/851: unlink f0 0 2024-09-18T12:49:25.441 INFO:tasks.workunit.client.1.smithi148.stdout:9/852: write d8/da/dd/f1b [2301987,128317] 0 2024-09-18T12:49:25.442 INFO:tasks.workunit.client.0.smithi078.stdout:6/737: creat d10/d2b/d61/dd7/ff4 x:0 0 0 2024-09-18T12:49:25.442 INFO:tasks.workunit.client.1.smithi148.stdout:9/853: stat d8/da/dd/d77/cfe 0 2024-09-18T12:49:25.444 INFO:tasks.workunit.client.1.smithi148.stdout:6/880: creat d5/f11e x:0 0 0 2024-09-18T12:49:25.445 INFO:tasks.workunit.client.0.smithi078.stdout:2/527: mkdir d4/d8/d23/d52/d5f/d81/dac 0 2024-09-18T12:49:25.445 INFO:tasks.workunit.client.0.smithi078.stdout:0/653: mknod d3/d43/dd0/cf0 0 2024-09-18T12:49:25.446 INFO:tasks.workunit.client.0.smithi078.stdout:9/556: rmdir d5/d7/d32/d2a/d68 39 2024-09-18T12:49:25.448 INFO:tasks.workunit.client.1.smithi148.stdout:5/891: creat d7/d8/dc/da6/dee/d25/d4b/dd6/f12b x:0 0 0 2024-09-18T12:49:25.449 INFO:tasks.workunit.client.1.smithi148.stdout:4/864: truncate d15/d17/d52/d92/d4c/f5b 698224 0 2024-09-18T12:49:25.451 INFO:tasks.workunit.client.0.smithi078.stdout:0/654: creat d3/d1f/d2e/d68/dc9/dcd/ff1 x:0 0 0 2024-09-18T12:49:25.452 INFO:tasks.workunit.client.1.smithi148.stdout:9/854: unlink d8/da/dd/d35/d59/ccf 0 2024-09-18T12:49:25.454 INFO:tasks.workunit.client.1.smithi148.stdout:9/855: write d8/da/dd/d35/fb5 [623764,4082] 0 2024-09-18T12:49:25.454 INFO:tasks.workunit.client.1.smithi148.stdout:8/936: symlink d8/d12/d46/l141 0 2024-09-18T12:49:25.455 INFO:tasks.workunit.client.0.smithi078.stdout:6/738: mknod d10/d2b/d43/d53/d63/d6b/da1/df2/cf5 0 2024-09-18T12:49:25.456 INFO:tasks.workunit.client.1.smithi148.stdout:4/865: dwrite d15/d17/d52/d92/d4c/d4f/fca [0,4194304] 0 2024-09-18T12:49:25.457 INFO:tasks.workunit.client.1.smithi148.stdout:3/807: fdatasync d4/d8/d20/d2b/d7f/d93/d94/f9a 0 2024-09-18T12:49:25.459 INFO:tasks.workunit.client.0.smithi078.stdout:0/655: dwrite d3/d43/fd5 [4194304,4194304] 0 2024-09-18T12:49:25.462 INFO:tasks.workunit.client.0.smithi078.stdout:1/579: dread d0/d8/da/d3e/d50/f54 [0,4194304] 0 2024-09-18T12:49:25.464 INFO:tasks.workunit.client.1.smithi148.stdout:8/937: fsync d8/d16/f7a 0 2024-09-18T12:49:25.465 INFO:tasks.workunit.client.0.smithi078.stdout:5/832: getdents d2/d4/d9/da/d60/db3/d2d 0 2024-09-18T12:49:25.466 INFO:tasks.workunit.client.1.smithi148.stdout:4/866: dwrite d15/d17/d52/d101/f10e [0,4194304] 0 2024-09-18T12:49:25.466 INFO:tasks.workunit.client.1.smithi148.stdout:8/938: write d8/df/f19 [6107488,30766] 0 2024-09-18T12:49:25.467 INFO:tasks.workunit.client.1.smithi148.stdout:9/856: write d8/da/dd/d4a/d49/fca [307243,114431] 0 2024-09-18T12:49:25.469 INFO:tasks.workunit.client.0.smithi078.stdout:9/557: dread d5/d7/d8/f27 [0,4194304] 0 2024-09-18T12:49:25.471 INFO:tasks.workunit.client.0.smithi078.stdout:0/656: dwrite d3/d43/fe4 [0,4194304] 0 2024-09-18T12:49:25.472 INFO:tasks.workunit.client.1.smithi148.stdout:7/845: write db/fc4 [840464,91961] 0 2024-09-18T12:49:25.474 INFO:tasks.workunit.client.0.smithi078.stdout:6/739: truncate d10/d2b/d43/d53/d45/f62 3529494 0 2024-09-18T12:49:25.475 INFO:tasks.workunit.client.1.smithi148.stdout:7/846: fdatasync db/dc/df/d2c/d55/f6e 0 2024-09-18T12:49:25.476 INFO:tasks.workunit.client.1.smithi148.stdout:5/892: creat d7/d8/dc/da6/dee/d77/dd4/f12c x:0 0 0 2024-09-18T12:49:25.477 INFO:tasks.workunit.client.1.smithi148.stdout:4/867: dwrite d15/d17/f47 [4194304,4194304] 0 2024-09-18T12:49:25.478 INFO:tasks.workunit.client.0.smithi078.stdout:2/528: rename d4/d1a/c83 to d4/cad 0 2024-09-18T12:49:25.478 INFO:tasks.workunit.client.1.smithi148.stdout:7/847: chown db/dc/df/d11/l54 5 1 2024-09-18T12:49:25.479 INFO:tasks.workunit.client.1.smithi148.stdout:3/808: mknod d4/d8/d6a/db3/db7/dcb/c117 0 2024-09-18T12:49:25.480 INFO:tasks.workunit.client.1.smithi148.stdout:5/893: chown d7/d8/dc/da6/dee/d25/d4b/dd6/fec 30702 1 2024-09-18T12:49:25.481 INFO:tasks.workunit.client.0.smithi078.stdout:1/580: fsync d0/d8/da/d3e/d50/fa0 0 2024-09-18T12:49:25.484 INFO:tasks.workunit.client.0.smithi078.stdout:2/529: dwrite d4/dd/f40 [0,4194304] 0 2024-09-18T12:49:25.490 INFO:tasks.workunit.client.0.smithi078.stdout:5/833: symlink d2/d4/d9/l106 0 2024-09-18T12:49:25.491 INFO:tasks.workunit.client.0.smithi078.stdout:1/581: dwrite d0/d8/da/d3e/d58/d6e/d8c/d9d/fae [0,4194304] 0 2024-09-18T12:49:25.494 INFO:tasks.workunit.client.1.smithi148.stdout:2/777: dwrite d9/f21 [4194304,4194304] 0 2024-09-18T12:49:25.494 INFO:tasks.workunit.client.0.smithi078.stdout:9/558: mkdir d5/d7/db3 0 2024-09-18T12:49:25.495 INFO:tasks.workunit.client.1.smithi148.stdout:2/778: chown d9/d24/d31/f3d 2892646 1 2024-09-18T12:49:25.496 INFO:tasks.workunit.client.1.smithi148.stdout:2/779: chown d9/d24/f25 13230879 1 2024-09-18T12:49:25.496 INFO:tasks.workunit.client.1.smithi148.stdout:2/780: fsync d9/d24/fc1 0 2024-09-18T12:49:25.498 INFO:tasks.workunit.client.1.smithi148.stdout:2/781: truncate d9/d24/d31/d9d/f10c 110620 0 2024-09-18T12:49:25.499 INFO:tasks.workunit.client.1.smithi148.stdout:8/939: rename d8/d12/d51/d94/f64 to d8/d16/d53/d39/d3b/d125/f142 0 2024-09-18T12:49:25.499 INFO:tasks.workunit.client.0.smithi078.stdout:6/740: mknod d10/d2b/d37/cf6 0 2024-09-18T12:49:25.503 INFO:tasks.workunit.client.1.smithi148.stdout:1/855: truncate dc/d18/d7d/d93/dd9/d2b/f2e 3535288 0 2024-09-18T12:49:25.504 INFO:tasks.workunit.client.0.smithi078.stdout:2/530: mkdir d4/d8/d23/d52/d5f/d81/dae 0 2024-09-18T12:49:25.506 INFO:tasks.workunit.client.1.smithi148.stdout:4/868: rmdir d15/d5f/d69/d7f 39 2024-09-18T12:49:25.506 INFO:tasks.workunit.client.1.smithi148.stdout:1/856: chown dc/d11/d38/d7b/l9b 2552966 1 2024-09-18T12:49:25.507 INFO:tasks.workunit.client.0.smithi078.stdout:5/834: mkdir d2/db8/d107 0 2024-09-18T12:49:25.508 INFO:tasks.workunit.client.1.smithi148.stdout:7/848: stat db/dc/df/d2c/d55/daf/f3c 0 2024-09-18T12:49:25.509 INFO:tasks.workunit.client.1.smithi148.stdout:1/857: write dc/d18/d31/f111 [963690,37116] 0 2024-09-18T12:49:25.510 INFO:tasks.workunit.client.1.smithi148.stdout:4/869: chown d15/d17/d52/d68/cd5 168 1 2024-09-18T12:49:25.510 INFO:tasks.workunit.client.0.smithi078.stdout:1/582: mknod d0/d8/da/d3e/d58/cbe 0 2024-09-18T12:49:25.513 INFO:tasks.workunit.client.1.smithi148.stdout:2/782: dwrite d9/d3a/d90/f9e [0,4194304] 0 2024-09-18T12:49:25.516 INFO:tasks.workunit.client.1.smithi148.stdout:3/809: dwrite d4/d8/fa6 [0,4194304] 0 2024-09-18T12:49:25.516 INFO:tasks.workunit.client.0.smithi078.stdout:6/741: symlink d10/d2b/d43/de5/lf7 0 2024-09-18T12:49:25.517 INFO:tasks.workunit.client.0.smithi078.stdout:2/531: fdatasync d4/dd/fa1 0 2024-09-18T12:49:25.518 INFO:tasks.workunit.client.0.smithi078.stdout:2/532: chown d4/dd/f40 7914692 1 2024-09-18T12:49:25.519 INFO:tasks.workunit.client.0.smithi078.stdout:2/533: write d4/fa4 [339521,115717] 0 2024-09-18T12:49:25.520 INFO:tasks.workunit.client.1.smithi148.stdout:9/857: rename d8/da/dd/d77/fe2 to d8/da/dd/d65/db9/f100 0 2024-09-18T12:49:25.521 INFO:tasks.workunit.client.1.smithi148.stdout:4/870: dwrite d15/d17/d52/d92/f2e [0,4194304] 0 2024-09-18T12:49:25.521 INFO:tasks.workunit.client.0.smithi078.stdout:2/534: stat d4/d8/f76 0 2024-09-18T12:49:25.526 INFO:tasks.workunit.client.0.smithi078.stdout:9/559: mknod d5/d7/d32/d2a/cb4 0 2024-09-18T12:49:25.530 INFO:tasks.workunit.client.0.smithi078.stdout:6/742: fdatasync d10/d2b/d43/d53/d63/d70/d77/fca 0 2024-09-18T12:49:25.531 INFO:tasks.workunit.client.1.smithi148.stdout:6/881: truncate d5/d1a/d29/f113 4832890 0 2024-09-18T12:49:25.532 INFO:tasks.workunit.client.1.smithi148.stdout:1/858: symlink dc/d11/d38/d72/l11b 0 2024-09-18T12:49:25.533 INFO:tasks.workunit.client.1.smithi148.stdout:5/894: mknod d7/d8/d18/d3f/c12d 0 2024-09-18T12:49:25.535 INFO:tasks.workunit.client.1.smithi148.stdout:3/810: rmdir d4/d8/d20/d2b/d7f/d93/d94/dac 39 2024-09-18T12:49:25.537 INFO:tasks.workunit.client.0.smithi078.stdout:2/535: mkdir d4/d8/d23/d52/d5f/d81/dac/daf 0 2024-09-18T12:49:25.538 INFO:tasks.workunit.client.0.smithi078.stdout:1/583: creat d0/d8/da/fbf x:0 0 0 2024-09-18T12:49:25.539 INFO:tasks.workunit.client.1.smithi148.stdout:1/859: dwrite dc/d18/d31/d4b/d8d/d8f/fe1 [0,4194304] 0 2024-09-18T12:49:25.540 INFO:tasks.workunit.client.0.smithi078.stdout:6/743: creat d10/d2b/d61/dd7/ddc/ff8 x:0 0 0 2024-09-18T12:49:25.541 INFO:tasks.workunit.client.1.smithi148.stdout:7/849: mknod db/cfc 0 2024-09-18T12:49:25.543 INFO:tasks.workunit.client.1.smithi148.stdout:2/783: symlink d9/d24/d31/l10e 0 2024-09-18T12:49:25.544 INFO:tasks.workunit.client.0.smithi078.stdout:1/584: truncate d0/d8/da/d3e/d50/f54 1028381 0 2024-09-18T12:49:25.545 INFO:tasks.workunit.client.1.smithi148.stdout:5/895: truncate d7/d8/dc/da6/dee/f2c 1583070 0 2024-09-18T12:49:25.546 INFO:tasks.workunit.client.0.smithi078.stdout:6/744: creat d10/d2b/d43/d53/d63/d6b/da1/df2/ff9 x:0 0 0 2024-09-18T12:49:25.547 INFO:tasks.workunit.client.0.smithi078.stdout:9/560: getdents d5/d7/d8/d98 0 2024-09-18T12:49:25.549 INFO:tasks.workunit.client.1.smithi148.stdout:8/940: rmdir d8/d16/d27/dc5/dee/d11f 0 2024-09-18T12:49:25.550 INFO:tasks.workunit.client.1.smithi148.stdout:3/811: truncate d4/d8/d1e/d6b/f3e 421140 0 2024-09-18T12:49:25.551 INFO:tasks.workunit.client.0.smithi078.stdout:9/561: unlink d5/d7/l2c 0 2024-09-18T12:49:25.552 INFO:tasks.workunit.client.0.smithi078.stdout:1/585: rmdir d0/d8/da/d3e/d50/d74 39 2024-09-18T12:49:25.552 INFO:tasks.workunit.client.0.smithi078.stdout:1/586: stat d0/d5b/f63 0 2024-09-18T12:49:25.553 INFO:tasks.workunit.client.0.smithi078.stdout:6/745: truncate d10/d2b/d43/d53/d45/d55/f4f 605048 0 2024-09-18T12:49:25.554 INFO:tasks.workunit.client.1.smithi148.stdout:7/850: rename db/dc/df/d11/d34/c59 to db/dc/df/d11/dac/cfd 0 2024-09-18T12:49:25.555 INFO:tasks.workunit.client.0.smithi078.stdout:9/562: unlink d5/d40/c85 0 2024-09-18T12:49:25.556 INFO:tasks.workunit.client.0.smithi078.stdout:9/563: fsync d5/d7/d8/d4f/f8b 0 2024-09-18T12:49:25.556 INFO:tasks.workunit.client.1.smithi148.stdout:2/784: mkdir d9/d24/d31/d9d/dcd/d10f 0 2024-09-18T12:49:25.558 INFO:tasks.workunit.client.0.smithi078.stdout:6/746: unlink d10/d2b/fb4 0 2024-09-18T12:49:25.559 INFO:tasks.workunit.client.1.smithi148.stdout:9/858: mkdir d8/da/dd/d35/d81/dc6/dcc/de0/d101 0 2024-09-18T12:49:25.559 INFO:tasks.workunit.client.0.smithi078.stdout:1/587: dread d0/d8/da/d3e/d58/d6e/d52/f36 [0,4194304] 0 2024-09-18T12:49:25.561 INFO:tasks.workunit.client.0.smithi078.stdout:9/564: mknod d5/d5c/cb5 0 2024-09-18T12:49:25.561 INFO:tasks.workunit.client.1.smithi148.stdout:1/860: mkdir dc/d18/d31/dc6/d110/d11c 0 2024-09-18T12:49:25.563 INFO:tasks.workunit.client.1.smithi148.stdout:6/882: creat d5/d1a/f11f x:0 0 0 2024-09-18T12:49:25.564 INFO:tasks.workunit.client.1.smithi148.stdout:7/851: mkdir db/dc/df/d1d/d68/d82/dfe 0 2024-09-18T12:49:25.565 INFO:tasks.workunit.client.1.smithi148.stdout:7/852: chown db/dc/df/d11/d34/d69/c8a 5111 1 2024-09-18T12:49:25.566 INFO:tasks.workunit.client.0.smithi078.stdout:1/588: dwrite d0/f49 [0,4194304] 0 2024-09-18T12:49:25.566 INFO:tasks.workunit.client.1.smithi148.stdout:2/785: creat d9/d24/d31/d34/d7b/f110 x:0 0 0 2024-09-18T12:49:25.568 INFO:tasks.workunit.client.1.smithi148.stdout:8/941: mkdir d8/df/db2/d143 0 2024-09-18T12:49:25.568 INFO:tasks.workunit.client.1.smithi148.stdout:3/812: dread d4/d8/d1e/d6b/d31/f34 [0,4194304] 0 2024-09-18T12:49:25.569 INFO:tasks.workunit.client.0.smithi078.stdout:9/565: truncate d5/d7/d8/fb 3624667 0 2024-09-18T12:49:25.573 INFO:tasks.workunit.client.1.smithi148.stdout:7/853: mkdir db/dc/df/d2c/d66/dff 0 2024-09-18T12:49:25.574 INFO:tasks.workunit.client.1.smithi148.stdout:1/861: dwrite dc/d9f/df5/f9d [0,4194304] 0 2024-09-18T12:49:25.575 INFO:tasks.workunit.client.1.smithi148.stdout:8/942: mkdir d8/d16/d27/d144 0 2024-09-18T12:49:25.576 INFO:tasks.workunit.client.0.smithi078.stdout:9/566: creat d5/fb6 x:0 0 0 2024-09-18T12:49:25.576 INFO:tasks.workunit.client.1.smithi148.stdout:6/883: mknod d5/d32/d56/dfb/c120 0 2024-09-18T12:49:25.579 INFO:tasks.workunit.client.1.smithi148.stdout:1/862: dread dc/d18/d31/d4b/d8d/fb8 [0,4194304] 0 2024-09-18T12:49:25.579 INFO:tasks.workunit.client.1.smithi148.stdout:3/813: creat d4/d8/d20/d2b/f118 x:0 0 0 2024-09-18T12:49:25.580 INFO:tasks.workunit.client.1.smithi148.stdout:8/943: symlink d8/d12/d46/d74/dd5/l145 0 2024-09-18T12:49:25.581 INFO:tasks.workunit.client.1.smithi148.stdout:8/944: chown d8/d16/d53/da0/dba/f129 12912 1 2024-09-18T12:49:25.582 INFO:tasks.workunit.client.1.smithi148.stdout:6/884: creat d5/d1a/dc/d2b/de9/f121 x:0 0 0 2024-09-18T12:49:25.583 INFO:tasks.workunit.client.0.smithi078.stdout:9/567: dwrite d5/d7/f62 [0,4194304] 0 2024-09-18T12:49:25.584 INFO:tasks.workunit.client.1.smithi148.stdout:2/786: dread d9/d17/f96 [0,4194304] 0 2024-09-18T12:49:25.587 INFO:tasks.workunit.client.0.smithi078.stdout:1/589: dread d0/d8/da/d3e/d58/d6e/d52/f2d [0,4194304] 0 2024-09-18T12:49:25.589 INFO:tasks.workunit.client.0.smithi078.stdout:9/568: creat d5/d7/d8/d98/fb7 x:0 0 0 2024-09-18T12:49:25.592 INFO:tasks.workunit.client.1.smithi148.stdout:6/885: symlink d5/d32/d38/l122 0 2024-09-18T12:49:25.594 INFO:tasks.workunit.client.0.smithi078.stdout:1/590: rename d0/d8/da/db0 to d0/d8/daa/db5/dc0 0 2024-09-18T12:49:25.595 INFO:tasks.workunit.client.0.smithi078.stdout:1/591: chown d0/d8/da/d3e/d58/d6e/d52/d47/f69 4664472 1 2024-09-18T12:49:25.596 INFO:tasks.workunit.client.1.smithi148.stdout:1/863: getdents dc/d18/d31/d4b 0 2024-09-18T12:49:25.597 INFO:tasks.workunit.client.0.smithi078.stdout:9/569: creat d5/d7/d8/fb8 x:0 0 0 2024-09-18T12:49:25.598 INFO:tasks.workunit.client.1.smithi148.stdout:1/864: symlink dc/d18/d7d/d7e/l11d 0 2024-09-18T12:49:25.599 INFO:tasks.workunit.client.0.smithi078.stdout:9/570: chown d5/d7/d8/d4f/l74 852 1 2024-09-18T12:49:25.600 INFO:tasks.workunit.client.0.smithi078.stdout:1/592: creat d0/d8/da/d3e/fc1 x:0 0 0 2024-09-18T12:49:25.601 INFO:tasks.workunit.client.0.smithi078.stdout:9/571: unlink d5/d7/d32/d2a/lad 0 2024-09-18T12:49:25.603 INFO:tasks.workunit.client.0.smithi078.stdout:1/593: mkdir d0/d5b/d6d/dc2 0 2024-09-18T12:49:25.604 INFO:tasks.workunit.client.1.smithi148.stdout:1/865: dwrite dc/d18/d31/d4b/d8d/ddd/f10c [0,4194304] 0 2024-09-18T12:49:25.605 INFO:tasks.workunit.client.0.smithi078.stdout:9/572: chown d5/d7/d32/d2a/d68/d97/lb2 28 1 2024-09-18T12:49:25.606 INFO:tasks.workunit.client.0.smithi078.stdout:1/594: mkdir d0/d8/da/d3e/d58/d6e/d8c/d9d/dc3 0 2024-09-18T12:49:25.613 INFO:tasks.workunit.client.0.smithi078.stdout:1/595: mknod d0/d8/daa/db5/dc0/cc4 0 2024-09-18T12:49:25.615 INFO:tasks.workunit.client.1.smithi148.stdout:1/866: dread dc/f57 [0,4194304] 0 2024-09-18T12:49:25.616 INFO:tasks.workunit.client.0.smithi078.stdout:0/657: write d3/d1f/d2e/f83 [558585,35412] 0 2024-09-18T12:49:25.618 INFO:tasks.workunit.client.1.smithi148.stdout:1/867: creat dc/d51/f11e x:0 0 0 2024-09-18T12:49:25.619 INFO:tasks.workunit.client.1.smithi148.stdout:1/868: read - dc/d11/d38/d72/df8/ff9 zero size 2024-09-18T12:49:25.619 INFO:tasks.workunit.client.0.smithi078.stdout:1/596: rename d0/d8/da/d3e/fc1 to d0/d8/da/d3e/d58/d6e/fc5 0 2024-09-18T12:49:25.623 INFO:tasks.workunit.client.1.smithi148.stdout:1/869: mkdir dc/d18/d31/d4b/d8d/d8f/d11f 0 2024-09-18T12:49:25.625 INFO:tasks.workunit.client.0.smithi078.stdout:1/597: creat d0/d8/daa/db5/fc6 x:0 0 0 2024-09-18T12:49:25.626 INFO:tasks.workunit.client.0.smithi078.stdout:5/835: truncate d2/d4/d9/da/d2b/d3e/fa9 105583 0 2024-09-18T12:49:25.628 INFO:tasks.workunit.client.1.smithi148.stdout:1/870: rename dc/d11/l46 to dc/d9f/df5/l120 0 2024-09-18T12:49:25.629 INFO:tasks.workunit.client.1.smithi148.stdout:8/945: dread d8/f92 [0,4194304] 0 2024-09-18T12:49:25.630 INFO:tasks.workunit.client.1.smithi148.stdout:1/871: symlink dc/d18/d7d/dea/l121 0 2024-09-18T12:49:25.633 INFO:tasks.workunit.client.0.smithi078.stdout:1/598: truncate d0/d8/da/d45/fa6 1534960 0 2024-09-18T12:49:25.635 INFO:tasks.workunit.client.0.smithi078.stdout:5/836: creat d2/d4/d9/da/d60/db3/d16/d36/d4c/d97/db1/f108 x:0 0 0 2024-09-18T12:49:25.637 INFO:tasks.workunit.client.1.smithi148.stdout:9/859: dwrite d8/da/dd/d4a/d49/d46/fbf [0,4194304] 0 2024-09-18T12:49:25.638 INFO:tasks.workunit.client.0.smithi078.stdout:5/837: fsync d2/d4/d9/da/d60/db3/d2d/fad 0 2024-09-18T12:49:25.639 INFO:tasks.workunit.client.0.smithi078.stdout:1/599: creat d0/d8/da/d45/fc7 x:0 0 0 2024-09-18T12:49:25.640 INFO:tasks.workunit.client.1.smithi148.stdout:8/946: dwrite d8/d12/d46/fa8 [0,4194304] 0 2024-09-18T12:49:25.641 INFO:tasks.workunit.client.0.smithi078.stdout:2/536: dwrite d4/db/f68 [0,4194304] 0 2024-09-18T12:49:25.642 INFO:tasks.workunit.client.1.smithi148.stdout:4/871: dwrite d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d10b/f11c [0,4194304] 0 2024-09-18T12:49:25.642 INFO:tasks.workunit.client.0.smithi078.stdout:2/537: chown d4/db/c79 83265 1 2024-09-18T12:49:25.653 INFO:tasks.workunit.client.0.smithi078.stdout:2/538: chown d4/ca 11 1 2024-09-18T12:49:25.658 INFO:tasks.workunit.client.1.smithi148.stdout:4/872: mkdir d15/d17/d52/d68/d125 0 2024-09-18T12:49:25.658 INFO:tasks.workunit.client.1.smithi148.stdout:5/896: write d7/d8/dc/d12/d31/f7b [474577,82131] 0 2024-09-18T12:49:25.659 INFO:tasks.workunit.client.0.smithi078.stdout:1/600: dread d0/d8/da/d3e/d58/d6e/d52/f2e [0,4194304] 0 2024-09-18T12:49:25.661 INFO:tasks.workunit.client.0.smithi078.stdout:1/601: dread - d0/d8/da/d3e/d58/d6e/fab zero size 2024-09-18T12:49:25.661 INFO:tasks.workunit.client.1.smithi148.stdout:5/897: chown d7/d8/dc/da6/dee/d39/dd5/fdb 17959 1 2024-09-18T12:49:25.662 INFO:tasks.workunit.client.0.smithi078.stdout:1/602: dread - d0/d8/da/d3e/d50/d60/f9b zero size 2024-09-18T12:49:25.662 INFO:tasks.workunit.client.0.smithi078.stdout:2/539: unlink d4/db/f2a 0 2024-09-18T12:49:25.662 INFO:tasks.workunit.client.1.smithi148.stdout:5/898: chown d7/d8/d18/l19 48 1 2024-09-18T12:49:25.662 INFO:tasks.workunit.client.1.smithi148.stdout:8/947: dwrite d8/d16/f9d [4194304,4194304] 0 2024-09-18T12:49:25.663 INFO:tasks.workunit.client.1.smithi148.stdout:8/948: dread - d8/df/f107 zero size 2024-09-18T12:49:25.663 INFO:tasks.workunit.client.1.smithi148.stdout:5/899: write d7/d2b/f120 [369913,108985] 0 2024-09-18T12:49:25.664 INFO:tasks.workunit.client.1.smithi148.stdout:5/900: fsync d7/d8/dc/f11a 0 2024-09-18T12:49:25.665 INFO:tasks.workunit.client.0.smithi078.stdout:6/747: write d10/f1c [2702376,78243] 0 2024-09-18T12:49:25.667 INFO:tasks.workunit.client.1.smithi148.stdout:4/873: unlink d15/d17/d52/d68/da5/cf9 0 2024-09-18T12:49:25.667 INFO:tasks.workunit.client.1.smithi148.stdout:5/901: dread - d7/d8/d18/d3f/f127 zero size 2024-09-18T12:49:25.668 INFO:tasks.workunit.client.0.smithi078.stdout:2/540: rmdir d4/db 39 2024-09-18T12:49:25.669 INFO:tasks.workunit.client.0.smithi078.stdout:2/541: fdatasync d4/d1a/f43 0 2024-09-18T12:49:25.670 INFO:tasks.workunit.client.0.smithi078.stdout:1/603: rename d0/d8/da/d3e/d58/d6e/d52/d47/d7d/f85 to d0/d8/da/d3e/d58/d6e/d8c/d9d/db8/fc8 0 2024-09-18T12:49:25.672 INFO:tasks.workunit.client.1.smithi148.stdout:9/860: dread d8/da/dd/d4a/f18 [0,4194304] 0 2024-09-18T12:49:25.673 INFO:tasks.workunit.client.1.smithi148.stdout:8/949: dwrite d8/d16/d27/f4a [4194304,4194304] 0 2024-09-18T12:49:25.677 INFO:tasks.workunit.client.1.smithi148.stdout:8/950: stat d8/d16/d53/d39/d3b/d4e/fa2 0 2024-09-18T12:49:25.679 INFO:tasks.workunit.client.1.smithi148.stdout:8/951: dread - d8/df/d3e/d82/da7/f135 zero size 2024-09-18T12:49:25.680 INFO:tasks.workunit.client.1.smithi148.stdout:4/874: dwrite d15/d17/d52/d92/d4c/d4f/d64/da0/da1/ffe [0,4194304] 0 2024-09-18T12:49:25.682 INFO:tasks.workunit.client.1.smithi148.stdout:4/875: chown d15/d17/d52/d92/d4c/cbc 4150664 1 2024-09-18T12:49:25.682 INFO:tasks.workunit.client.1.smithi148.stdout:4/876: chown d15/f28 1 1 2024-09-18T12:49:25.684 INFO:tasks.workunit.client.1.smithi148.stdout:4/877: write d15/d17/d52/d68/da5/d102/f11d [109927,62502] 0 2024-09-18T12:49:25.685 INFO:tasks.workunit.client.1.smithi148.stdout:9/861: mkdir d8/da/dd/d3f/d102 0 2024-09-18T12:49:25.685 INFO:tasks.workunit.client.1.smithi148.stdout:3/814: write d4/d8/d20/f3f [1203203,41240] 0 2024-09-18T12:49:25.687 INFO:tasks.workunit.client.1.smithi148.stdout:9/862: rename d8/da/dd/d4a/d49 to d8/da/dd/d4a/d49/d103 22 2024-09-18T12:49:25.688 INFO:tasks.workunit.client.1.smithi148.stdout:2/787: write d9/d24/d31/d9d/fcb [1367733,79062] 0 2024-09-18T12:49:25.690 INFO:tasks.workunit.client.1.smithi148.stdout:2/788: chown d9/d24/d67/d72/d8f/fbf 397 1 2024-09-18T12:49:25.690 INFO:tasks.workunit.client.0.smithi078.stdout:6/748: rename d10/d2b/d43/d53/d63/d70/d77/dd2 to d10/d2b/dfa 0 2024-09-18T12:49:25.692 INFO:tasks.workunit.client.0.smithi078.stdout:1/604: link d0/d8/da/c27 d0/d8/da/d3e/d58/d6e/d8c/cc9 0 2024-09-18T12:49:25.694 INFO:tasks.workunit.client.1.smithi148.stdout:6/886: write d5/d1a/dc/d2b/d35/f69 [288323,73736] 0 2024-09-18T12:49:25.695 INFO:tasks.workunit.client.0.smithi078.stdout:6/749: dread d10/d2b/d43/d53/d63/d70/d7d/fc7 [0,4194304] 0 2024-09-18T12:49:25.696 INFO:tasks.workunit.client.1.smithi148.stdout:3/815: mknod d4/d8/d20/d2b/d7f/d93/c119 0 2024-09-18T12:49:25.697 INFO:tasks.workunit.client.1.smithi148.stdout:6/887: stat d5/d1a/dc/d2b/d35/d65/dff/l105 0 2024-09-18T12:49:25.698 INFO:tasks.workunit.client.1.smithi148.stdout:9/863: mknod d8/da/dd/c104 0 2024-09-18T12:49:25.699 INFO:tasks.workunit.client.0.smithi078.stdout:6/750: rmdir d10/d2b/d61 39 2024-09-18T12:49:25.699 INFO:tasks.workunit.client.1.smithi148.stdout:4/878: dread d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/d11e/f93 [0,4194304] 0 2024-09-18T12:49:25.701 INFO:tasks.workunit.client.1.smithi148.stdout:7/854: dwrite db/dc/df/d2c/d55/daf/d38/fd2 [0,4194304] 0 2024-09-18T12:49:25.703 INFO:tasks.workunit.client.1.smithi148.stdout:3/816: creat d4/d8/d1e/d6b/d31/d60/f11a x:0 0 0 2024-09-18T12:49:25.704 INFO:tasks.workunit.client.1.smithi148.stdout:9/864: mknod d8/d33/c105 0 2024-09-18T12:49:25.707 INFO:tasks.workunit.client.0.smithi078.stdout:9/573: dwrite d5/d7/f62 [4194304,4194304] 0 2024-09-18T12:49:25.708 INFO:tasks.workunit.client.1.smithi148.stdout:6/888: dwrite d5/f11e [0,4194304] 0 2024-09-18T12:49:25.709 INFO:tasks.workunit.client.0.smithi078.stdout:2/542: dread d4/dd/f8b [0,4194304] 0 2024-09-18T12:49:25.711 INFO:tasks.workunit.client.1.smithi148.stdout:4/879: dwrite d15/d17/d52/d92/d4c/dd0/dd6/fe2 [0,4194304] 0 2024-09-18T12:49:25.718 INFO:tasks.workunit.client.0.smithi078.stdout:6/751: link d10/d2b/d61/dd7/ddc/ff8 d10/d2b/d43/d53/d45/ffb 0 2024-09-18T12:49:25.719 INFO:tasks.workunit.client.1.smithi148.stdout:3/817: mknod d4/d8/d20/d2b/d7f/c11b 0 2024-09-18T12:49:25.721 INFO:tasks.workunit.client.0.smithi078.stdout:0/658: dwrite d3/d1f/fd8 [0,4194304] 0 2024-09-18T12:49:25.722 INFO:tasks.workunit.client.1.smithi148.stdout:9/865: dwrite d8/da/dd/d4a/f98 [0,4194304] 0 2024-09-18T12:49:25.724 INFO:tasks.workunit.client.0.smithi078.stdout:6/752: chown d10/d2b/d43/d53/d45/d55/fc5 182 1 2024-09-18T12:49:25.726 INFO:tasks.workunit.client.1.smithi148.stdout:6/889: fsync d5/d1a/dc/d101/fd5 0 2024-09-18T12:49:25.726 INFO:tasks.workunit.client.0.smithi078.stdout:6/753: chown d10/d2b/d43/fd1 89050374 1 2024-09-18T12:49:25.733 INFO:tasks.workunit.client.1.smithi148.stdout:4/880: rename d15/d17/d52/d92/d4c/d4f/c31 to d15/d17/d52/d101/c126 0 2024-09-18T12:49:25.733 INFO:tasks.workunit.client.0.smithi078.stdout:0/659: rmdir d3/d1f/d2e/d4e/d37/d72 39 2024-09-18T12:49:25.736 INFO:tasks.workunit.client.0.smithi078.stdout:6/754: dread - d10/d2b/d43/d53/d63/d70/d77/f82 zero size 2024-09-18T12:49:25.739 INFO:tasks.workunit.client.1.smithi148.stdout:3/818: truncate d4/f11 3592492 0 2024-09-18T12:49:25.739 INFO:tasks.workunit.client.0.smithi078.stdout:9/574: creat d5/fb9 x:0 0 0 2024-09-18T12:49:25.740 INFO:tasks.workunit.client.1.smithi148.stdout:3/819: write d4/fd8 [445684,93253] 0 2024-09-18T12:49:25.741 INFO:tasks.workunit.client.1.smithi148.stdout:1/872: write dc/d18/d31/d39/f75 [97559,13143] 0 2024-09-18T12:49:25.744 INFO:tasks.workunit.client.1.smithi148.stdout:1/873: write dc/d18/d31/d39/f115 [991828,25068] 0 2024-09-18T12:49:25.744 INFO:tasks.workunit.client.1.smithi148.stdout:7/855: creat db/dc/df/d11/f100 x:0 0 0 2024-09-18T12:49:25.746 INFO:tasks.workunit.client.0.smithi078.stdout:6/755: unlink d10/d2b/d43/d53/d63/d70/dac/fda 0 2024-09-18T12:49:25.746 INFO:tasks.workunit.client.1.smithi148.stdout:7/856: chown db/dc/df/d1d/d41/c74 12 1 2024-09-18T12:49:25.746 INFO:tasks.workunit.client.1.smithi148.stdout:4/881: rmdir d15/d5f/d69 39 2024-09-18T12:49:25.747 INFO:tasks.workunit.client.0.smithi078.stdout:6/756: stat d10/d2b/d43/d53/d63/d70/d7d/l98 0 2024-09-18T12:49:25.747 INFO:tasks.workunit.client.0.smithi078.stdout:9/575: rmdir d5 39 2024-09-18T12:49:25.748 INFO:tasks.workunit.client.0.smithi078.stdout:5/838: write d2/d4/d9/da/d60/db3/f67 [437818,46504] 0 2024-09-18T12:49:25.749 INFO:tasks.workunit.client.1.smithi148.stdout:4/882: dread - d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/d11e/f109 zero size 2024-09-18T12:49:25.750 INFO:tasks.workunit.client.1.smithi148.stdout:4/883: write d15/fd1 [1996277,60917] 0 2024-09-18T12:49:25.751 INFO:tasks.workunit.client.1.smithi148.stdout:3/820: creat d4/d8/d1e/d63/f11c x:0 0 0 2024-09-18T12:49:25.753 INFO:tasks.workunit.client.1.smithi148.stdout:7/857: dwrite db/d52/d1f/fd9 [0,4194304] 0 2024-09-18T12:49:25.755 INFO:tasks.workunit.client.1.smithi148.stdout:6/890: mknod d5/d32/d38/df0/c123 0 2024-09-18T12:49:25.760 INFO:tasks.workunit.client.0.smithi078.stdout:6/757: mknod d10/d2b/d43/d53/d63/d70/cfc 0 2024-09-18T12:49:25.761 INFO:tasks.workunit.client.1.smithi148.stdout:6/891: truncate d5/d1a/dc/d101/da4/da6/fe3 869609 0 2024-09-18T12:49:25.762 INFO:tasks.workunit.client.0.smithi078.stdout:2/543: dread d4/d1a/f22 [0,4194304] 0 2024-09-18T12:49:25.763 INFO:tasks.workunit.client.1.smithi148.stdout:3/821: mknod d4/c11d 0 2024-09-18T12:49:25.763 INFO:tasks.workunit.client.0.smithi078.stdout:9/576: mknod d5/d7/d8/d98/cba 0 2024-09-18T12:49:25.763 INFO:tasks.workunit.client.0.smithi078.stdout:2/544: chown d4/d8/d23/d52/d5f/d86/d3b/f58 1675632446 1 2024-09-18T12:49:25.764 INFO:tasks.workunit.client.1.smithi148.stdout:5/902: dwrite d7/d8/dc/da6/dee/d39/dc2/dd2/f108 [0,4194304] 0 2024-09-18T12:49:25.765 INFO:tasks.workunit.client.0.smithi078.stdout:9/577: fdatasync d5/d7/d32/d2a/d68/d97/f9f 0 2024-09-18T12:49:25.766 INFO:tasks.workunit.client.0.smithi078.stdout:5/839: symlink d2/d4/d9/da/d60/d7f/dce/l109 0 2024-09-18T12:49:25.769 INFO:tasks.workunit.client.0.smithi078.stdout:6/758: unlink d10/d2b/d43/d53/d63/d70/d77/f8d 0 2024-09-18T12:49:25.770 INFO:tasks.workunit.client.1.smithi148.stdout:8/952: dwrite d8/d16/f7a [0,4194304] 0 2024-09-18T12:49:25.771 INFO:tasks.workunit.client.0.smithi078.stdout:5/840: truncate d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/df3/ff9 838319 0 2024-09-18T12:49:25.772 INFO:tasks.workunit.client.1.smithi148.stdout:1/874: link dc/d18/d31/f88 dc/d18/d31/d4b/db7/f122 0 2024-09-18T12:49:25.779 INFO:tasks.workunit.client.0.smithi078.stdout:0/660: dread d3/f3f [0,4194304] 0 2024-09-18T12:49:25.779 INFO:tasks.workunit.client.0.smithi078.stdout:6/759: dwrite d10/d2b/d43/d53/d63/d6b/da1/df2/ff9 [0,4194304] 0 2024-09-18T12:49:25.780 INFO:tasks.workunit.client.1.smithi148.stdout:7/858: mkdir db/dc/df/d5f/d101 0 2024-09-18T12:49:25.782 INFO:tasks.workunit.client.0.smithi078.stdout:5/841: creat d2/d4/d9/da/d60/db3/d16/d36/db0/dde/dd4/f10a x:0 0 0 2024-09-18T12:49:25.784 INFO:tasks.workunit.client.0.smithi078.stdout:6/760: mkdir d10/d2b/d43/d53/d63/d70/d7d/dfd 0 2024-09-18T12:49:25.786 INFO:tasks.workunit.client.1.smithi148.stdout:1/875: mknod dc/d18/d7d/c123 0 2024-09-18T12:49:25.787 INFO:tasks.workunit.client.0.smithi078.stdout:5/842: dread d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/df3/ff9 [0,4194304] 0 2024-09-18T12:49:25.793 INFO:tasks.workunit.client.0.smithi078.stdout:6/761: dwrite d10/d2b/d43/fd1 [0,4194304] 0 2024-09-18T12:49:25.796 INFO:tasks.workunit.client.0.smithi078.stdout:5/843: dwrite d2/d4/d48/f71 [0,4194304] 0 2024-09-18T12:49:25.801 INFO:tasks.workunit.client.0.smithi078.stdout:9/578: dread d5/d40/f63 [0,4194304] 0 2024-09-18T12:49:25.803 INFO:tasks.workunit.client.0.smithi078.stdout:2/545: dread d4/d8/d23/f6d [0,4194304] 0 2024-09-18T12:49:25.808 INFO:tasks.workunit.client.0.smithi078.stdout:5/844: dwrite d2/d4/d9/d2f/d30/f80 [8388608,4194304] 0 2024-09-18T12:49:25.810 INFO:tasks.workunit.client.0.smithi078.stdout:5/845: write d2/d4/f8 [1545556,38092] 0 2024-09-18T12:49:25.824 INFO:tasks.workunit.client.0.smithi078.stdout:2/546: dread d4/d8/d23/d52/d5f/d86/d3b/d4f/f57 [0,4194304] 0 2024-09-18T12:49:25.829 INFO:tasks.workunit.client.0.smithi078.stdout:2/547: dwrite d4/d8/d23/f56 [4194304,4194304] 0 2024-09-18T12:49:25.832 INFO:tasks.workunit.client.0.smithi078.stdout:9/579: dread d5/d7/f25 [0,4194304] 0 2024-09-18T12:49:25.862 INFO:tasks.workunit.client.1.smithi148.stdout:9/866: sync 2024-09-18T12:49:25.863 INFO:tasks.workunit.client.1.smithi148.stdout:2/789: sync 2024-09-18T12:49:25.863 INFO:tasks.workunit.client.1.smithi148.stdout:9/867: chown d8/da/f1d 8269325 1 2024-09-18T12:49:25.879 INFO:tasks.workunit.client.1.smithi148.stdout:5/903: truncate d7/f15 2263079 0 2024-09-18T12:49:25.881 INFO:tasks.workunit.client.1.smithi148.stdout:7/859: creat db/dc/df/d2c/d55/f102 x:0 0 0 2024-09-18T12:49:25.895 INFO:tasks.workunit.client.1.smithi148.stdout:6/892: sync 2024-09-18T12:49:25.895 INFO:tasks.workunit.client.1.smithi148.stdout:6/893: chown d5/d1a/dc/d2b/d35/c7d 131478576 1 2024-09-18T12:49:25.896 INFO:tasks.workunit.client.1.smithi148.stdout:6/894: dread - d5/d1a/dc/d101/da3/ffc zero size 2024-09-18T12:49:25.907 INFO:tasks.workunit.client.1.smithi148.stdout:8/953: creat d8/df/d3e/d82/d8f/d95/d12e/f146 x:0 0 0 2024-09-18T12:49:25.908 INFO:tasks.workunit.client.1.smithi148.stdout:1/876: creat dc/d4d/dad/db1/f124 x:0 0 0 2024-09-18T12:49:25.927 INFO:tasks.workunit.client.1.smithi148.stdout:4/884: dwrite d15/d17/d52/d92/d4c/d4f/d64/da0/da1/fd3 [0,4194304] 0 2024-09-18T12:49:25.933 INFO:tasks.workunit.client.0.smithi078.stdout:0/661: write d3/d1f/d2e/d8f/d90/f9b [3795652,53505] 0 2024-09-18T12:49:25.935 INFO:tasks.workunit.client.1.smithi148.stdout:4/885: dwrite d15/d17/d52/d92/d4c/d4f/d64/d9a/ff4 [0,4194304] 0 2024-09-18T12:49:25.951 INFO:tasks.workunit.client.0.smithi078.stdout:6/762: symlink d10/d2b/d43/d53/d63/d70/d7d/dfd/lfe 0 2024-09-18T12:49:25.959 INFO:tasks.workunit.client.0.smithi078.stdout:6/763: creat d10/d2b/d43/d53/d63/d70/dac/da6/fff x:0 0 0 2024-09-18T12:49:25.961 INFO:tasks.workunit.client.0.smithi078.stdout:9/580: creat d5/d7/d32/d2a/fbb x:0 0 0 2024-09-18T12:49:25.962 INFO:tasks.workunit.client.0.smithi078.stdout:9/581: write d5/d7/d32/d91/f94 [225438,87505] 0 2024-09-18T12:49:25.963 INFO:tasks.workunit.client.0.smithi078.stdout:5/846: getdents d2/d4/d9/dc0 0 2024-09-18T12:49:25.965 INFO:tasks.workunit.client.0.smithi078.stdout:6/764: rename d10/d2b/d43/de5/ce9 to d10/d2b/d43/d53/d63/d6b/da1/df2/c100 0 2024-09-18T12:49:25.968 INFO:tasks.workunit.client.0.smithi078.stdout:9/582: creat d5/d7/d8/d4f/fbc x:0 0 0 2024-09-18T12:49:25.969 INFO:tasks.workunit.client.0.smithi078.stdout:9/583: chown d5/d7/d32/d2a/d68/d97/f9f 9873063 1 2024-09-18T12:49:25.970 INFO:tasks.workunit.client.0.smithi078.stdout:5/847: mkdir d2/d4/d9/da/d2b/d3e/d10b 0 2024-09-18T12:49:25.970 INFO:tasks.workunit.client.0.smithi078.stdout:9/584: write d5/d7/d32/f89 [4125406,59034] 0 2024-09-18T12:49:25.972 INFO:tasks.workunit.client.0.smithi078.stdout:5/848: write d2/d4/d9/da/f7a [2209271,95254] 0 2024-09-18T12:49:25.972 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:25 smithi148 ceph-mon[35352]: pgmap v20: 65 pgs: 65 active+clean; 2.6 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 80 MiB/s rd, 208 MiB/s wr, 408 op/s 2024-09-18T12:49:25.974 INFO:tasks.workunit.client.1.smithi148.stdout:2/790: creat d9/d17/d29/d92/f111 x:0 0 0 2024-09-18T12:49:25.974 INFO:tasks.workunit.client.0.smithi078.stdout:5/849: fsync d2/d4/d9/da/d60/db3/d16/d36/db0/dde/dd4/f10a 0 2024-09-18T12:49:25.975 INFO:tasks.workunit.client.1.smithi148.stdout:2/791: write d9/d73/d81/ff6 [39205,58938] 0 2024-09-18T12:49:25.978 INFO:tasks.workunit.client.0.smithi078.stdout:5/850: dread d2/d4/d9/f94 [0,4194304] 0 2024-09-18T12:49:25.980 INFO:tasks.workunit.client.1.smithi148.stdout:7/860: mknod db/dc/df/d11/dcc/c103 0 2024-09-18T12:49:25.981 INFO:tasks.workunit.client.1.smithi148.stdout:2/792: dwrite d9/d3a/fd3 [0,4194304] 0 2024-09-18T12:49:25.984 INFO:tasks.workunit.client.1.smithi148.stdout:8/954: symlink d8/d12/d51/dc7/l147 0 2024-09-18T12:49:25.986 INFO:tasks.workunit.client.1.smithi148.stdout:1/877: creat dc/d9f/df5/f125 x:0 0 0 2024-09-18T12:49:25.987 INFO:tasks.workunit.client.1.smithi148.stdout:2/793: dwrite d9/d3a/f52 [0,4194304] 0 2024-09-18T12:49:25.988 INFO:tasks.workunit.client.1.smithi148.stdout:1/878: write dc/d11/d38/d72/f107 [661554,115236] 0 2024-09-18T12:49:25.989 INFO:tasks.workunit.client.0.smithi078.stdout:9/585: rename d5/c78 to d5/d7/d32/d2a/d68/d97/cbd 0 2024-09-18T12:49:25.989 INFO:tasks.workunit.client.1.smithi148.stdout:1/879: write dc/d11/d38/d72/ff6 [3679081,38560] 0 2024-09-18T12:49:25.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:25 smithi078 ceph-mon[28091]: pgmap v20: 65 pgs: 65 active+clean; 2.6 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 80 MiB/s rd, 208 MiB/s wr, 408 op/s 2024-09-18T12:49:26.003 INFO:tasks.workunit.client.1.smithi148.stdout:6/895: link d5/d1a/dc/d2b/d35/d65/f5e d5/d1a/dc/d101/da4/de2/f124 0 2024-09-18T12:49:26.006 INFO:tasks.workunit.client.0.smithi078.stdout:0/662: write d3/d1f/d2e/d4e/d37/d72/f78 [431504,19161] 0 2024-09-18T12:49:26.007 INFO:tasks.workunit.client.0.smithi078.stdout:0/663: readlink d3/d1f/d2e/l3a 0 2024-09-18T12:49:26.007 INFO:tasks.workunit.client.1.smithi148.stdout:8/955: chown d8/df/d3e/l79 3026886 1 2024-09-18T12:49:26.012 INFO:tasks.workunit.client.0.smithi078.stdout:0/664: fdatasync d3/d1f/f52 0 2024-09-18T12:49:26.013 INFO:tasks.workunit.client.0.smithi078.stdout:0/665: fdatasync d3/d1f/d2e/d68/d30/d7c/fe7 0 2024-09-18T12:49:26.015 INFO:tasks.workunit.client.0.smithi078.stdout:0/666: dread - d3/d1f/d2e/d68/dc9/feb zero size 2024-09-18T12:49:26.016 INFO:tasks.workunit.client.1.smithi148.stdout:6/896: fsync d5/d1a/dc/dbf/dcb/d111/f11d 0 2024-09-18T12:49:26.017 INFO:tasks.workunit.client.1.smithi148.stdout:7/861: truncate db/dc/df/d11/db3/fea 2039563 0 2024-09-18T12:49:26.017 INFO:tasks.workunit.client.1.smithi148.stdout:3/822: dwrite d4/d8/f15 [0,4194304] 0 2024-09-18T12:49:26.019 INFO:tasks.workunit.client.1.smithi148.stdout:7/862: write db/dc/df/d1d/d41/fe4 [54298,2865] 0 2024-09-18T12:49:26.021 INFO:tasks.workunit.client.0.smithi078.stdout:0/667: dread d3/d1f/d2e/d4e/d37/d72/f78 [0,4194304] 0 2024-09-18T12:49:26.022 INFO:tasks.workunit.client.1.smithi148.stdout:1/880: unlink c4 0 2024-09-18T12:49:26.024 INFO:tasks.workunit.client.1.smithi148.stdout:1/881: chown dc/d18/d43/f4e 352442 1 2024-09-18T12:49:26.025 INFO:tasks.workunit.client.0.smithi078.stdout:6/765: dwrite d10/f1e [0,4194304] 0 2024-09-18T12:49:26.025 INFO:tasks.workunit.client.0.smithi078.stdout:5/851: write d2/d4/d9/da/d60/db3/d16/d36/f79 [1575428,117535] 0 2024-09-18T12:49:26.026 INFO:tasks.workunit.client.1.smithi148.stdout:5/904: dwrite d7/fd [0,4194304] 0 2024-09-18T12:49:26.027 INFO:tasks.workunit.client.0.smithi078.stdout:5/852: stat d2/d4/d9/da/d60/db3/d16/c29 0 2024-09-18T12:49:26.028 INFO:tasks.workunit.client.0.smithi078.stdout:5/853: write d2/d4/d48/fe2 [545898,29143] 0 2024-09-18T12:49:26.028 INFO:tasks.workunit.client.1.smithi148.stdout:7/863: dread - db/dc/df/d1d/d68/d82/fd0 zero size 2024-09-18T12:49:26.035 INFO:tasks.workunit.client.1.smithi148.stdout:3/823: unlink d4/cb 0 2024-09-18T12:49:26.036 INFO:tasks.workunit.client.1.smithi148.stdout:2/794: getdents d9/d24/d67/dc7/dce/de3 0 2024-09-18T12:49:26.037 INFO:tasks.workunit.client.1.smithi148.stdout:1/882: rmdir dc/d9f/df5 39 2024-09-18T12:49:26.038 INFO:tasks.workunit.client.0.smithi078.stdout:6/766: rename d10/d2b/d43/d53/dcb to d10/d2b/d43/d101 0 2024-09-18T12:49:26.039 INFO:tasks.workunit.client.0.smithi078.stdout:6/767: fdatasync d10/d2b/d43/d53/d63/d6b/f93 0 2024-09-18T12:49:26.039 INFO:tasks.workunit.client.1.smithi148.stdout:5/905: symlink d7/d8/dc/da6/dee/d25/d4b/d102/l12e 0 2024-09-18T12:49:26.040 INFO:tasks.workunit.client.1.smithi148.stdout:4/886: write d15/d17/d52/d92/d4c/d4f/f61 [2227946,114761] 0 2024-09-18T12:49:26.041 INFO:tasks.workunit.client.1.smithi148.stdout:7/864: truncate db/dc/df/d11/ddc/d75/f56 2864376 0 2024-09-18T12:49:26.042 INFO:tasks.workunit.client.0.smithi078.stdout:9/586: truncate d5/f15 1101775 0 2024-09-18T12:49:26.043 INFO:tasks.workunit.client.0.smithi078.stdout:5/854: getdents d2/d4/d9/da/d60/db3/d16/d36 0 2024-09-18T12:49:26.045 INFO:tasks.workunit.client.0.smithi078.stdout:9/587: mkdir d5/d7/dbe 0 2024-09-18T12:49:26.046 INFO:tasks.workunit.client.0.smithi078.stdout:9/588: read d5/d40/f63 [3618073,20634] 0 2024-09-18T12:49:26.048 INFO:tasks.workunit.client.0.smithi078.stdout:6/768: creat d10/d2b/d43/dc3/f102 x:0 0 0 2024-09-18T12:49:26.049 INFO:tasks.workunit.client.0.smithi078.stdout:6/769: stat d10/d2b/d43/d53/d63/d70/d7d/fa5 0 2024-09-18T12:49:26.049 INFO:tasks.workunit.client.1.smithi148.stdout:4/887: read d15/d3f/fc1 [727585,112887] 0 2024-09-18T12:49:26.050 INFO:tasks.workunit.client.1.smithi148.stdout:9/868: dwrite d8/da/dd/d4a/ff6 [4194304,4194304] 0 2024-09-18T12:49:26.050 INFO:tasks.workunit.client.0.smithi078.stdout:5/855: rename d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/dbe to d2/d74/d10c 0 2024-09-18T12:49:26.050 INFO:tasks.workunit.client.0.smithi078.stdout:6/770: write d10/d2b/d43/d53/d45/d55/f2d [3275115,10131] 0 2024-09-18T12:49:26.051 INFO:tasks.workunit.client.1.smithi148.stdout:5/906: chown d7/d8/dc/da6/dee/f2c 1003034 1 2024-09-18T12:49:26.052 INFO:tasks.workunit.client.0.smithi078.stdout:9/589: creat d5/d7/d8/d4f/fbf x:0 0 0 2024-09-18T12:49:26.061 INFO:tasks.workunit.client.0.smithi078.stdout:9/590: dread d5/d7/d32/f44 [0,4194304] 0 2024-09-18T12:49:26.061 INFO:tasks.workunit.client.0.smithi078.stdout:6/771: dwrite d10/d2b/d43/d53/d63/d70/dac/fe3 [0,4194304] 0 2024-09-18T12:49:26.061 INFO:tasks.workunit.client.1.smithi148.stdout:3/824: rename d4/d8/d20/d2b/d7f/dd9/ff6 to d4/d8/d1e/d63/d9b/f11e 0 2024-09-18T12:49:26.062 INFO:tasks.workunit.client.1.smithi148.stdout:1/883: dread dc/d18/d63/f98 [0,4194304] 0 2024-09-18T12:49:26.065 INFO:tasks.workunit.client.1.smithi148.stdout:1/884: write dc/d18/d7d/d93/dd9/fd8 [341248,95186] 0 2024-09-18T12:49:26.066 INFO:tasks.workunit.client.1.smithi148.stdout:9/869: symlink d8/da/dd/d35/d81/dc6/dcc/l106 0 2024-09-18T12:49:26.067 INFO:tasks.workunit.client.0.smithi078.stdout:5/856: creat d2/d4/d9/da/d60/db3/d16/d36/db0/d105/f10d x:0 0 0 2024-09-18T12:49:26.069 INFO:tasks.workunit.client.1.smithi148.stdout:5/907: symlink d7/d8/dc/d12/d20/l12f 0 2024-09-18T12:49:26.069 INFO:tasks.workunit.client.1.smithi148.stdout:8/956: dwrite d8/d16/fcf [0,4194304] 0 2024-09-18T12:49:26.071 INFO:tasks.workunit.client.0.smithi078.stdout:6/772: write d10/d2b/d43/d53/d63/d70/dac/f5f [2644803,73916] 0 2024-09-18T12:49:26.071 INFO:tasks.workunit.client.1.smithi148.stdout:5/908: chown d7/d8/f87 286 1 2024-09-18T12:49:26.071 INFO:tasks.workunit.client.1.smithi148.stdout:8/957: chown d8/d16/d53/d39/f3d 5993 1 2024-09-18T12:49:26.072 INFO:tasks.workunit.client.1.smithi148.stdout:7/865: getdents db/dc/df/d11/de5 0 2024-09-18T12:49:26.079 INFO:tasks.workunit.client.1.smithi148.stdout:6/897: dwrite d5/d1a/fca [0,4194304] 0 2024-09-18T12:49:26.079 INFO:tasks.workunit.client.1.smithi148.stdout:3/825: unlink d4/d8/d20/d2b/d43/f21 0 2024-09-18T12:49:26.079 INFO:tasks.workunit.client.0.smithi078.stdout:6/773: rename d10/d2b/d43/d53/d63/d70 to d10/d2b/d43/dc3/d103 0 2024-09-18T12:49:26.081 INFO:tasks.workunit.client.1.smithi148.stdout:5/909: dread d7/d8/dc/da6/dee/d39/dc2/dd2/f108 [0,4194304] 0 2024-09-18T12:49:26.082 INFO:tasks.workunit.client.1.smithi148.stdout:9/870: readlink d8/l2a 0 2024-09-18T12:49:26.083 INFO:tasks.workunit.client.1.smithi148.stdout:9/871: write d8/da/dd/f40 [338593,66206] 0 2024-09-18T12:49:26.085 INFO:tasks.workunit.client.0.smithi078.stdout:6/774: write d10/d2b/d61/fb2 [71440,3326] 0 2024-09-18T12:49:26.086 INFO:tasks.workunit.client.1.smithi148.stdout:2/795: getdents d9/d24 0 2024-09-18T12:49:26.087 INFO:tasks.workunit.client.0.smithi078.stdout:5/857: creat d2/d4/d48/f10e x:0 0 0 2024-09-18T12:49:26.090 INFO:tasks.workunit.client.0.smithi078.stdout:6/775: mknod d10/d2b/d61/dd7/c104 0 2024-09-18T12:49:26.090 INFO:tasks.workunit.client.0.smithi078.stdout:6/776: chown d10/d2b/d61/dd7/ddc 7 1 2024-09-18T12:49:26.091 INFO:tasks.workunit.client.1.smithi148.stdout:1/885: dwrite dc/d18/d31/dc6/f106 [0,4194304] 0 2024-09-18T12:49:26.093 INFO:tasks.workunit.client.0.smithi078.stdout:5/858: rename d2/d4/d9/da/d60/db3/d16/dd2/lbb to d2/d4/d9/dc0/l10f 0 2024-09-18T12:49:26.094 INFO:tasks.workunit.client.0.smithi078.stdout:6/777: read - d10/d2b/d43/dc3/d103/d7d/fa2 zero size 2024-09-18T12:49:26.095 INFO:tasks.workunit.client.1.smithi148.stdout:6/898: creat d5/d1a/dc/d101/da3/f125 x:0 0 0 2024-09-18T12:49:26.095 INFO:tasks.workunit.client.0.smithi078.stdout:9/591: write d5/d7/d8/fb [844685,61967] 0 2024-09-18T12:49:26.097 INFO:tasks.workunit.client.0.smithi078.stdout:6/778: symlink d10/d2b/dfa/l105 0 2024-09-18T12:49:26.098 INFO:tasks.workunit.client.0.smithi078.stdout:5/859: symlink d2/d4/d9/da/d60/db3/d2d/df2/df4/l110 0 2024-09-18T12:49:26.098 INFO:tasks.workunit.client.0.smithi078.stdout:7/448: sync 2024-09-18T12:49:26.099 INFO:tasks.workunit.client.0.smithi078.stdout:3/500: sync 2024-09-18T12:49:26.099 INFO:tasks.workunit.client.1.smithi148.stdout:9/872: truncate d8/da/dd/d3f/d5d/da0/fc1 1310158 0 2024-09-18T12:49:26.102 INFO:tasks.workunit.client.0.smithi078.stdout:9/592: mkdir d5/d7/d32/d2a/d68/d97/dc0 0 2024-09-18T12:49:26.105 INFO:tasks.workunit.client.1.smithi148.stdout:5/910: rename d7/d8/dc/d12/d20/df3/db1/lfc to d7/d8/dc/d12/d31/d5a/d98/l130 0 2024-09-18T12:49:26.109 INFO:tasks.workunit.client.0.smithi078.stdout:7/449: mkdir d7/d9/d4d/d9a 0 2024-09-18T12:49:26.109 INFO:tasks.workunit.client.1.smithi148.stdout:2/796: truncate d9/d17/d29/fa4 500594 0 2024-09-18T12:49:26.111 INFO:tasks.workunit.client.0.smithi078.stdout:5/860: mkdir d2/d4/d9/da/d60/db3/d16/d36/d4c/d111 0 2024-09-18T12:49:26.112 INFO:tasks.workunit.client.0.smithi078.stdout:5/861: write d2/d4/d9/da/d60/db3/d16/d36/db0/fe6 [825303,19742] 0 2024-09-18T12:49:26.114 INFO:tasks.workunit.client.1.smithi148.stdout:7/866: dwrite db/dc/df/d11/ddc/f83 [0,4194304] 0 2024-09-18T12:49:26.114 INFO:tasks.workunit.client.1.smithi148.stdout:8/958: mkdir d8/d12/d46/d7e/d148 0 2024-09-18T12:49:26.115 INFO:tasks.workunit.client.1.smithi148.stdout:7/867: dread - db/dc/df/d1d/d68/d82/ff2 zero size 2024-09-18T12:49:26.118 INFO:tasks.workunit.client.0.smithi078.stdout:6/779: symlink d10/d2b/d43/dc3/d103/dac/l106 0 2024-09-18T12:49:26.121 INFO:tasks.workunit.client.0.smithi078.stdout:7/450: symlink d7/d9/d4d/l9b 0 2024-09-18T12:49:26.122 INFO:tasks.workunit.client.1.smithi148.stdout:3/826: unlink d4/d8/d20/f26 0 2024-09-18T12:49:26.123 INFO:tasks.workunit.client.1.smithi148.stdout:3/827: write f2 [2747807,21632] 0 2024-09-18T12:49:26.125 INFO:tasks.workunit.client.0.smithi078.stdout:5/862: creat d2/d4/d9/da/d60/d61/f112 x:0 0 0 2024-09-18T12:49:26.126 INFO:tasks.workunit.client.0.smithi078.stdout:5/863: chown d2/d4/d9/d2f/de0 1021498514 1 2024-09-18T12:49:26.127 INFO:tasks.workunit.client.0.smithi078.stdout:9/593: link d5/d7/d32/d2a/f72 d5/d5c/fc1 0 2024-09-18T12:49:26.128 INFO:tasks.workunit.client.0.smithi078.stdout:5/864: write d2/d4/d9/d2f/d30/f80 [12131708,70332] 0 2024-09-18T12:49:26.129 INFO:tasks.workunit.client.0.smithi078.stdout:6/780: dread - d10/d2b/d43/d53/d45/d55/fab zero size 2024-09-18T12:49:26.132 INFO:tasks.workunit.client.1.smithi148.stdout:2/797: chown d9/d24/d31/f62 9472 1 2024-09-18T12:49:26.133 INFO:tasks.workunit.client.0.smithi078.stdout:3/501: link d9/d13/d63/c69 d9/d13/d33/d4e/c99 0 2024-09-18T12:49:26.133 INFO:tasks.workunit.client.1.smithi148.stdout:8/959: dread d8/d16/d53/d39/d3b/d125/f142 [0,4194304] 0 2024-09-18T12:49:26.133 INFO:tasks.workunit.client.1.smithi148.stdout:2/798: write d9/d17/f5d [3120416,62578] 0 2024-09-18T12:49:26.135 INFO:tasks.workunit.client.1.smithi148.stdout:8/960: chown d8/d16/d53/da0/dba/lbf 90392116 1 2024-09-18T12:49:26.135 INFO:tasks.workunit.client.1.smithi148.stdout:8/961: stat d8/f92 0 2024-09-18T12:49:26.137 INFO:tasks.workunit.client.0.smithi078.stdout:9/594: creat d5/d7/d32/d2a/d36/fc2 x:0 0 0 2024-09-18T12:49:26.140 INFO:tasks.workunit.client.1.smithi148.stdout:7/868: rename db/d52/d1f/cd4 to db/dc/df/d11/db3/c104 0 2024-09-18T12:49:26.142 INFO:tasks.workunit.client.1.smithi148.stdout:6/899: dwrite d5/d1a/dc/d2b/d35/d9c/fc5 [0,4194304] 0 2024-09-18T12:49:26.143 INFO:tasks.workunit.client.1.smithi148.stdout:6/900: dread - d5/d1a/dc/d101/da4/de2/f104 zero size 2024-09-18T12:49:26.144 INFO:tasks.workunit.client.1.smithi148.stdout:1/886: truncate dc/d18/d31/d39/f40 3495485 0 2024-09-18T12:49:26.144 INFO:tasks.workunit.client.1.smithi148.stdout:4/888: sync 2024-09-18T12:49:26.144 INFO:tasks.workunit.client.1.smithi148.stdout:4/889: stat d15/d17/f115 0 2024-09-18T12:49:26.145 INFO:tasks.workunit.client.0.smithi078.stdout:3/502: fsync d9/d13/d33/f51 0 2024-09-18T12:49:26.145 INFO:tasks.workunit.client.1.smithi148.stdout:1/887: read - dc/d18/d7d/d93/fd4 zero size 2024-09-18T12:49:26.147 INFO:tasks.workunit.client.1.smithi148.stdout:3/828: unlink d4/d8/d1e/d63/d9b/f103 0 2024-09-18T12:49:26.148 INFO:tasks.workunit.client.1.smithi148.stdout:3/829: dread - d4/d8/d1e/d6b/d31/f10f zero size 2024-09-18T12:49:26.148 INFO:tasks.workunit.client.0.smithi078.stdout:5/865: mknod d2/d4/d48/c113 0 2024-09-18T12:49:26.151 INFO:tasks.workunit.client.1.smithi148.stdout:9/873: truncate d8/da/dd/d35/d47/fa4 1624792 0 2024-09-18T12:49:26.152 INFO:tasks.workunit.client.1.smithi148.stdout:5/911: mkdir d7/d8/dc/da6/dee/d25/d4b/d102/d12a/d131 0 2024-09-18T12:49:26.152 INFO:tasks.workunit.client.0.smithi078.stdout:6/781: dwrite d10/d2b/d43/dc3/d103/d7d/fd0 [0,4194304] 0 2024-09-18T12:49:26.153 INFO:tasks.workunit.client.0.smithi078.stdout:6/782: stat d10/d2b/d43/dc3/d103/dac/fad 0 2024-09-18T12:49:26.154 INFO:tasks.workunit.client.0.smithi078.stdout:6/783: write d10/d2b/d43/d53/fd5 [882956,85633] 0 2024-09-18T12:49:26.155 INFO:tasks.workunit.client.0.smithi078.stdout:3/503: fdatasync d9/d13/d33/d4e/f75 0 2024-09-18T12:49:26.156 INFO:tasks.workunit.client.1.smithi148.stdout:2/799: creat d9/d73/d81/f112 x:0 0 0 2024-09-18T12:49:26.157 INFO:tasks.workunit.client.0.smithi078.stdout:9/595: mknod d5/d7/d32/d2a/d68/cc3 0 2024-09-18T12:49:26.160 INFO:tasks.workunit.client.0.smithi078.stdout:7/451: getdents d7/d9/d14/d22/d3e/d95/d97 0 2024-09-18T12:49:26.160 INFO:tasks.workunit.client.1.smithi148.stdout:9/874: dwrite d8/da/dd/d65/db9/fde [0,4194304] 0 2024-09-18T12:49:26.162 INFO:tasks.workunit.client.1.smithi148.stdout:6/901: rename d5/d1a/c15 to d5/d32/d56/dfb/c126 0 2024-09-18T12:49:26.165 INFO:tasks.workunit.client.1.smithi148.stdout:3/830: fdatasync d4/d8/d1e/d79/d92/fcd 0 2024-09-18T12:49:26.172 INFO:tasks.workunit.client.1.smithi148.stdout:1/888: dwrite dc/d9f/df5/fd7 [0,4194304] 0 2024-09-18T12:49:26.172 INFO:tasks.workunit.client.1.smithi148.stdout:3/831: dread d4/d8/d1e/d6b/fd0 [0,4194304] 0 2024-09-18T12:49:26.174 INFO:tasks.workunit.client.0.smithi078.stdout:7/452: creat d7/d9/d14/d22/d35/f9c x:0 0 0 2024-09-18T12:49:26.176 INFO:tasks.workunit.client.1.smithi148.stdout:2/800: write d9/d17/d29/d92/d95/d64/fd7 [602093,107338] 0 2024-09-18T12:49:26.177 INFO:tasks.workunit.client.0.smithi078.stdout:3/504: symlink d9/l9a 0 2024-09-18T12:49:26.179 INFO:tasks.workunit.client.0.smithi078.stdout:6/784: link d10/d2b/d61/fbb d10/d2b/d43/d53/d45/de7/f107 0 2024-09-18T12:49:26.180 INFO:tasks.workunit.client.1.smithi148.stdout:7/869: truncate db/dc/df/d2c/d55/daf/d38/f49 1812942 0 2024-09-18T12:49:26.183 INFO:tasks.workunit.client.1.smithi148.stdout:6/902: mknod d5/d1a/d3d/c127 0 2024-09-18T12:49:26.184 INFO:tasks.workunit.client.0.smithi078.stdout:7/453: mkdir d7/d9/d32/d3b/d9d 0 2024-09-18T12:49:26.187 INFO:tasks.workunit.client.0.smithi078.stdout:5/866: getdents d2/d4/d9/da/d60/db3/d16/d36/d4c/d97/db1 0 2024-09-18T12:49:26.187 INFO:tasks.workunit.client.1.smithi148.stdout:5/912: mkdir d7/d8/d132 0 2024-09-18T12:49:26.188 INFO:tasks.workunit.client.0.smithi078.stdout:5/867: fdatasync d2/d4/f4f 0 2024-09-18T12:49:26.188 INFO:tasks.workunit.client.0.smithi078.stdout:6/785: symlink d10/d2b/dfa/dd6/l108 0 2024-09-18T12:49:26.190 INFO:tasks.workunit.client.0.smithi078.stdout:9/596: dwrite d5/d7/d8/f6a [0,4194304] 0 2024-09-18T12:49:26.191 INFO:tasks.workunit.client.0.smithi078.stdout:6/786: readlink d10/d2b/d43/dc3/d103/dac/da6/lb6 0 2024-09-18T12:49:26.196 INFO:tasks.workunit.client.1.smithi148.stdout:8/962: link d8/d16/d53/ff9 d8/df/d3e/d82/ded/f149 0 2024-09-18T12:49:26.199 INFO:tasks.workunit.client.0.smithi078.stdout:3/505: unlink d9/df/c28 0 2024-09-18T12:49:26.200 INFO:tasks.workunit.client.0.smithi078.stdout:5/868: dwrite d2/d4/d9/da/d60/db3/d16/d36/d4c/d97/db1/f108 [0,4194304] 0 2024-09-18T12:49:26.202 INFO:tasks.workunit.client.0.smithi078.stdout:7/454: creat d7/d9/d14/d22/d35/d49/d56/d8d/f9e x:0 0 0 2024-09-18T12:49:26.204 INFO:tasks.workunit.client.0.smithi078.stdout:9/597: fsync d5/d7/d8/f27 0 2024-09-18T12:49:26.205 INFO:tasks.workunit.client.1.smithi148.stdout:9/875: creat d8/da/dd/d4a/d27/f107 x:0 0 0 2024-09-18T12:49:26.207 INFO:tasks.workunit.client.1.smithi148.stdout:9/876: chown d8/da/dd/d65/cf1 35537470 1 2024-09-18T12:49:26.208 INFO:tasks.workunit.client.1.smithi148.stdout:4/890: creat d15/f127 x:0 0 0 2024-09-18T12:49:26.209 INFO:tasks.workunit.client.0.smithi078.stdout:4/608: sync 2024-09-18T12:49:26.209 INFO:tasks.workunit.client.1.smithi148.stdout:9/877: write d8/da/dd/d4a/ff6 [8808726,96699] 0 2024-09-18T12:49:26.211 INFO:tasks.workunit.client.1.smithi148.stdout:4/891: write d15/d17/d52/d92/d4c/d4f/f6c [1871742,79464] 0 2024-09-18T12:49:26.211 INFO:tasks.workunit.client.0.smithi078.stdout:5/869: mknod d2/d4/d9/da/d60/db3/d2d/c114 0 2024-09-18T12:49:26.211 INFO:tasks.workunit.client.0.smithi078.stdout:4/609: dread d11/d27/d5a/d84/f67 [0,4194304] 0 2024-09-18T12:49:26.212 INFO:tasks.workunit.client.1.smithi148.stdout:4/892: readlink d15/d17/d52/d92/d4c/dd0/dd6/lf1 0 2024-09-18T12:49:26.212 INFO:tasks.workunit.client.0.smithi078.stdout:5/870: chown d2/d4/f1e 65677157 1 2024-09-18T12:49:26.212 INFO:tasks.workunit.client.1.smithi148.stdout:4/893: fsync d15/fd1 0 2024-09-18T12:49:26.214 INFO:tasks.workunit.client.0.smithi078.stdout:7/455: rename d7/d9/d32/d3b/d70/c96 to d7/d9/d14/d22/d35/d49/d56/d8d/c9f 0 2024-09-18T12:49:26.215 INFO:tasks.workunit.client.0.smithi078.stdout:7/456: chown d7 2 1 2024-09-18T12:49:26.216 INFO:tasks.workunit.client.0.smithi078.stdout:6/787: dread d10/d2b/d43/d53/d45/d55/fc5 [0,4194304] 0 2024-09-18T12:49:26.216 INFO:tasks.workunit.client.1.smithi148.stdout:5/913: mknod d7/d8/dc/da6/dee/d39/dd5/c133 0 2024-09-18T12:49:26.219 INFO:tasks.workunit.client.0.smithi078.stdout:4/610: rmdir d11/d27/d5a/d84/d4b/da7 39 2024-09-18T12:49:26.221 INFO:tasks.workunit.client.1.smithi148.stdout:2/801: getdents d9/d24/d67/df0 0 2024-09-18T12:49:26.223 INFO:tasks.workunit.client.0.smithi078.stdout:3/506: dwrite d9/d13/d33/d3c/f66 [0,4194304] 0 2024-09-18T12:49:26.225 INFO:tasks.workunit.client.0.smithi078.stdout:3/507: read d9/d13/d33/d3c/f66 [4096068,53679] 0 2024-09-18T12:49:26.225 INFO:tasks.workunit.client.0.smithi078.stdout:4/611: rmdir d11 39 2024-09-18T12:49:26.226 INFO:tasks.workunit.client.0.smithi078.stdout:3/508: stat d9/d2f/f77 0 2024-09-18T12:49:26.227 INFO:tasks.workunit.client.0.smithi078.stdout:6/788: mknod d10/d2b/d43/d53/d45/de7/c109 0 2024-09-18T12:49:26.229 INFO:tasks.workunit.client.0.smithi078.stdout:6/789: dread d10/d2b/d61/fbb [0,4194304] 0 2024-09-18T12:49:26.230 INFO:tasks.workunit.client.1.smithi148.stdout:7/870: dread db/dc/df/d2c/d55/daf/d38/f49 [0,4194304] 0 2024-09-18T12:49:26.230 INFO:tasks.workunit.client.1.smithi148.stdout:4/894: mkdir d15/d17/d52/d92/dc9/d128 0 2024-09-18T12:49:26.231 INFO:tasks.workunit.client.1.smithi148.stdout:5/914: rmdir d7/d8/dc/da6 39 2024-09-18T12:49:26.232 INFO:tasks.workunit.client.1.smithi148.stdout:8/963: creat d8/df/db2/d143/f14a x:0 0 0 2024-09-18T12:49:26.233 INFO:tasks.workunit.client.0.smithi078.stdout:4/612: fdatasync d11/d27/d5a/d84/d4b/f82 0 2024-09-18T12:49:26.235 INFO:tasks.workunit.client.1.smithi148.stdout:1/889: rename dc/d11/d38/d72/f73 to dc/d9f/f126 0 2024-09-18T12:49:26.235 INFO:tasks.workunit.client.0.smithi078.stdout:5/871: dread d2/d4/d9/da/d60/db3/d2d/fc9 [0,4194304] 0 2024-09-18T12:49:26.237 INFO:tasks.workunit.client.0.smithi078.stdout:9/598: getdents d5/d7/d32/d2a 0 2024-09-18T12:49:26.238 INFO:tasks.workunit.client.1.smithi148.stdout:7/871: unlink db/dc/c9f 0 2024-09-18T12:49:26.239 INFO:tasks.workunit.client.1.smithi148.stdout:9/878: dwrite d8/f25 [0,4194304] 0 2024-09-18T12:49:26.243 INFO:tasks.workunit.client.0.smithi078.stdout:5/872: creat d2/d4/d9/da/d60/db3/d16/d36/db0/dde/dbd/f115 x:0 0 0 2024-09-18T12:49:26.245 INFO:tasks.workunit.client.1.smithi148.stdout:1/890: creat dc/d11/f127 x:0 0 0 2024-09-18T12:49:26.245 INFO:tasks.workunit.client.0.smithi078.stdout:9/599: symlink d5/d7/d32/d2a/d36/lc4 0 2024-09-18T12:49:26.246 INFO:tasks.workunit.client.1.smithi148.stdout:8/964: dwrite d8/d12/d46/fa8 [0,4194304] 0 2024-09-18T12:49:26.246 INFO:tasks.workunit.client.1.smithi148.stdout:4/895: dwrite d15/d17/f47 [0,4194304] 0 2024-09-18T12:49:26.246 INFO:tasks.workunit.client.1.smithi148.stdout:9/879: chown d8/da/dd/d4a/d49/d46/d54/faa 63865279 1 2024-09-18T12:49:26.247 INFO:tasks.workunit.client.0.smithi078.stdout:9/600: write d5/d7/d32/d2a/d68/f8d [171652,55679] 0 2024-09-18T12:49:26.252 INFO:tasks.workunit.client.1.smithi148.stdout:2/802: write d9/d17/d29/d92/d95/d9b/fc0 [707632,60756] 0 2024-09-18T12:49:26.253 INFO:tasks.workunit.client.1.smithi148.stdout:1/891: unlink dc/d18/d7d/d93/dd9/c6b 0 2024-09-18T12:49:26.255 INFO:tasks.workunit.client.0.smithi078.stdout:9/601: dread d5/d7/d32/d2a/d36/f55 [0,4194304] 0 2024-09-18T12:49:26.255 INFO:tasks.workunit.client.0.smithi078.stdout:5/873: unlink d2/d4/d9/da/d60/db3/d2d/fad 0 2024-09-18T12:49:26.257 INFO:tasks.workunit.client.0.smithi078.stdout:9/602: chown d5/d40/f7c 5870 1 2024-09-18T12:49:26.259 INFO:tasks.workunit.client.1.smithi148.stdout:4/896: creat d15/d17/d52/d68/da5/d102/f129 x:0 0 0 2024-09-18T12:49:26.260 INFO:tasks.workunit.client.1.smithi148.stdout:4/897: chown d15/lf3 1296010627 1 2024-09-18T12:49:26.263 INFO:tasks.workunit.client.1.smithi148.stdout:6/903: rename d5/d1a/dc/d101/da4/da6/fe3 to d5/d1a/dc/f128 0 2024-09-18T12:49:26.265 INFO:tasks.workunit.client.1.smithi148.stdout:8/965: mkdir d8/d12/d46/d7e/da1/d14b 0 2024-09-18T12:49:26.265 INFO:tasks.workunit.client.0.smithi078.stdout:4/613: write d11/d27/d5a/d84/f2d [404291,68261] 0 2024-09-18T12:49:26.266 INFO:tasks.workunit.client.1.smithi148.stdout:9/880: creat d8/da/dd/d35/d81/dc6/f108 x:0 0 0 2024-09-18T12:49:26.268 INFO:tasks.workunit.client.1.smithi148.stdout:2/803: symlink d9/d17/d29/l113 0 2024-09-18T12:49:26.269 INFO:tasks.workunit.client.0.smithi078.stdout:6/790: dwrite d10/d2b/d61/f7b [0,4194304] 0 2024-09-18T12:49:26.269 INFO:tasks.workunit.client.1.smithi148.stdout:1/892: mknod dc/d11/d38/d72/c128 0 2024-09-18T12:49:26.270 INFO:tasks.workunit.client.1.smithi148.stdout:1/893: write dc/d18/d31/f111 [741410,37245] 0 2024-09-18T12:49:26.271 INFO:tasks.workunit.client.1.smithi148.stdout:1/894: dread dc/d18/d7d/d93/f109 [0,4194304] 0 2024-09-18T12:49:26.272 INFO:tasks.workunit.client.0.smithi078.stdout:5/874: dread d2/d4/d9/d2f/d30/f85 [0,4194304] 0 2024-09-18T12:49:26.274 INFO:tasks.workunit.client.0.smithi078.stdout:5/875: chown d2/d4/d9/da/d60/db3/d16/d36/db0/d105/f10d 31216 1 2024-09-18T12:49:26.276 INFO:tasks.workunit.client.0.smithi078.stdout:4/614: truncate d11/d27/d47/f3d 3643172 0 2024-09-18T12:49:26.277 INFO:tasks.workunit.client.1.smithi148.stdout:3/832: rename d4/d8/d20/d2b/d43/fbb to d4/d8/d1e/d6b/d31/d60/d107/f11f 0 2024-09-18T12:49:26.277 INFO:tasks.workunit.client.1.smithi148.stdout:6/904: fdatasync d5/d1a/d29/d5c/f67 0 2024-09-18T12:49:26.278 INFO:tasks.workunit.client.1.smithi148.stdout:8/966: symlink d8/d16/d53/d39/d3b/d125/l14c 0 2024-09-18T12:49:26.279 INFO:tasks.workunit.client.0.smithi078.stdout:6/791: mknod d10/d2b/d43/dc3/d103/dac/c10a 0 2024-09-18T12:49:26.280 INFO:tasks.workunit.client.0.smithi078.stdout:9/603: dread d5/d7/d32/d2a/d6b/f5d [0,4194304] 0 2024-09-18T12:49:26.280 INFO:tasks.workunit.client.1.smithi148.stdout:2/804: mknod d9/d24/d67/d72/d8f/c114 0 2024-09-18T12:49:26.282 INFO:tasks.workunit.client.0.smithi078.stdout:5/876: mknod d2/d4/d48/d86/c116 0 2024-09-18T12:49:26.282 INFO:tasks.workunit.client.1.smithi148.stdout:2/805: write d9/d73/d81/ff6 [931645,93485] 0 2024-09-18T12:49:26.286 INFO:tasks.workunit.client.1.smithi148.stdout:8/967: dwrite d8/d12/d46/d7e/fcc [0,4194304] 0 2024-09-18T12:49:26.287 INFO:tasks.workunit.client.0.smithi078.stdout:4/615: mkdir d11/d27/d5a/d84/d4b/da7/dba/dc4 0 2024-09-18T12:49:26.287 INFO:tasks.workunit.client.1.smithi148.stdout:8/968: chown d8/df/d3e/d82/da7/f135 0 1 2024-09-18T12:49:26.288 INFO:tasks.workunit.client.0.smithi078.stdout:9/604: creat d5/d7/d8/d98/fc5 x:0 0 0 2024-09-18T12:49:26.289 INFO:tasks.workunit.client.0.smithi078.stdout:4/616: chown d11/d27/d5a/d84/d40/f58 467 1 2024-09-18T12:49:26.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/877: dwrite d2/d4/d48/d86/f100 [0,4194304] 0 2024-09-18T12:49:26.291 INFO:tasks.workunit.client.0.smithi078.stdout:4/617: chown d11/d27/d47/l36 3908 1 2024-09-18T12:49:26.292 INFO:tasks.workunit.client.1.smithi148.stdout:1/895: dwrite dc/d18/d7d/d93/dd9/d2b/f47 [0,4194304] 0 2024-09-18T12:49:26.293 INFO:tasks.workunit.client.0.smithi078.stdout:6/792: symlink d10/d2b/d43/d53/d45/l10b 0 2024-09-18T12:49:26.295 INFO:tasks.workunit.client.1.smithi148.stdout:7/872: rename db/dc/df/d2c/d55/daf/cce to db/dc/df/d11/db3/c105 0 2024-09-18T12:49:26.296 INFO:tasks.workunit.client.1.smithi148.stdout:5/915: dread d7/d8/dc/da6/dee/d77/f9b [0,4194304] 0 2024-09-18T12:49:26.298 INFO:tasks.workunit.client.0.smithi078.stdout:4/618: dwrite d11/d27/d5a/d84/f39 [0,4194304] 0 2024-09-18T12:49:26.299 INFO:tasks.workunit.client.0.smithi078.stdout:9/605: rmdir d5/d7/d8 39 2024-09-18T12:49:26.300 INFO:tasks.workunit.client.1.smithi148.stdout:5/916: chown d7/d8/dc/da6/dee/d39/dc2/dd2 2060606 1 2024-09-18T12:49:26.307 INFO:tasks.workunit.client.0.smithi078.stdout:6/793: symlink d10/d2b/d43/dc3/d103/d77/l10c 0 2024-09-18T12:49:26.309 INFO:tasks.workunit.client.1.smithi148.stdout:4/898: fdatasync d15/d5f/d69/d7f/f8e 0 2024-09-18T12:49:26.311 INFO:tasks.workunit.client.0.smithi078.stdout:4/619: rmdir d11/d27/d47/d4e/d76 39 2024-09-18T12:49:26.311 INFO:tasks.workunit.client.0.smithi078.stdout:5/878: dwrite d2/d4/d9/da/d60/db3/d16/d36/db0/dde/dbd/fea [0,4194304] 0 2024-09-18T12:49:26.313 INFO:tasks.workunit.client.0.smithi078.stdout:4/620: write d11/d27/d5a/d84/d4b/f82 [1643420,10606] 0 2024-09-18T12:49:26.315 INFO:tasks.workunit.client.0.smithi078.stdout:4/621: write d11/f44 [2737378,33093] 0 2024-09-18T12:49:26.318 INFO:tasks.workunit.client.0.smithi078.stdout:6/794: creat d10/d2b/dfa/dd6/f10d x:0 0 0 2024-09-18T12:49:26.319 INFO:tasks.workunit.client.0.smithi078.stdout:6/795: dread - d10/d2b/d43/dc4/fe6 zero size 2024-09-18T12:49:26.324 INFO:tasks.workunit.client.0.smithi078.stdout:9/606: mkdir d5/dc6 0 2024-09-18T12:49:26.325 INFO:tasks.workunit.client.1.smithi148.stdout:6/905: write d5/f23 [9597567,14461] 0 2024-09-18T12:49:26.325 INFO:tasks.workunit.client.1.smithi148.stdout:6/906: readlink d5/d32/d38/d50/l10e 0 2024-09-18T12:49:26.327 INFO:tasks.workunit.client.0.smithi078.stdout:6/796: fdatasync f9 0 2024-09-18T12:49:26.328 INFO:tasks.workunit.client.0.smithi078.stdout:6/797: stat d10/d2b/fbc 0 2024-09-18T12:49:26.328 INFO:tasks.workunit.client.1.smithi148.stdout:5/917: dread - d7/d8/d18/d3f/d7c/d7d/dbc/f110 zero size 2024-09-18T12:49:26.329 INFO:tasks.workunit.client.0.smithi078.stdout:6/798: write d10/d2b/d43/dc3/d103/d7d/fef [971908,100359] 0 2024-09-18T12:49:26.329 INFO:tasks.workunit.client.0.smithi078.stdout:5/879: unlink d2/d4/d9/da/d60/db3/d16/d36/db0/dde/d4d/fa2 0 2024-09-18T12:49:26.332 INFO:tasks.workunit.client.0.smithi078.stdout:9/607: write d5/d7/d8/f46 [2389434,43864] 0 2024-09-18T12:49:26.334 INFO:tasks.workunit.client.0.smithi078.stdout:9/608: write d5/d7/d8/d4f/f90 [62820,130803] 0 2024-09-18T12:49:26.336 INFO:tasks.workunit.client.1.smithi148.stdout:4/899: creat d15/d17/d52/d92/d4c/d4f/d34/f12a x:0 0 0 2024-09-18T12:49:26.337 INFO:tasks.workunit.client.1.smithi148.stdout:1/896: write dc/d18/d7d/d93/dd9/d2b/f86 [153355,105491] 0 2024-09-18T12:49:26.338 INFO:tasks.workunit.client.1.smithi148.stdout:1/897: dread - dc/d51/f11e zero size 2024-09-18T12:49:26.341 INFO:tasks.workunit.client.0.smithi078.stdout:6/799: rename d10/d2b/d43/dc3/d103/d7d/ca4 to d10/d2b/d43/dc3/d103/d7d/ddb/c10e 0 2024-09-18T12:49:26.342 INFO:tasks.workunit.client.1.smithi148.stdout:7/873: creat db/dc/df/d11/d43/d89/f106 x:0 0 0 2024-09-18T12:49:26.342 INFO:tasks.workunit.client.0.smithi078.stdout:9/609: dwrite d5/d7/d8/d98/fc5 [0,4194304] 0 2024-09-18T12:49:26.343 INFO:tasks.workunit.client.1.smithi148.stdout:3/833: creat d4/d8/d20/d2b/d7f/d93/f120 x:0 0 0 2024-09-18T12:49:26.344 INFO:tasks.workunit.client.1.smithi148.stdout:6/907: creat d5/d1a/dc/dbf/f129 x:0 0 0 2024-09-18T12:49:26.345 INFO:tasks.workunit.client.1.smithi148.stdout:6/908: readlink d5/d1a/l2c 0 2024-09-18T12:49:26.345 INFO:tasks.workunit.client.1.smithi148.stdout:9/881: getdents d8/da 0 2024-09-18T12:49:26.345 INFO:tasks.workunit.client.1.smithi148.stdout:8/969: dread d8/d16/d27/f93 [0,4194304] 0 2024-09-18T12:49:26.346 INFO:tasks.workunit.client.1.smithi148.stdout:6/909: readlink d5/d1a/d3d/l53 0 2024-09-18T12:49:26.346 INFO:tasks.workunit.client.0.smithi078.stdout:4/622: dwrite d11/d27/d47/f5f [0,4194304] 0 2024-09-18T12:49:26.347 INFO:tasks.workunit.client.1.smithi148.stdout:8/970: fdatasync d8/d16/d27/dc5/dee/dfe/df3/d11e/f126 0 2024-09-18T12:49:26.348 INFO:tasks.workunit.client.1.smithi148.stdout:8/971: chown d8/d16/c1d 119563729 1 2024-09-18T12:49:26.351 INFO:tasks.workunit.client.1.smithi148.stdout:4/900: fdatasync d15/d5f/d69/f95 0 2024-09-18T12:49:26.352 INFO:tasks.workunit.client.0.smithi078.stdout:9/610: mknod d5/d7/d32/d2a/d68/cc7 0 2024-09-18T12:49:26.353 INFO:tasks.workunit.client.1.smithi148.stdout:4/901: read d15/d17/d52/d92/f2e [5437359,123977] 0 2024-09-18T12:49:26.353 INFO:tasks.workunit.client.0.smithi078.stdout:9/611: write d5/d7/d32/d2a/d68/f8d [147637,61305] 0 2024-09-18T12:49:26.360 INFO:tasks.workunit.client.1.smithi148.stdout:5/918: truncate d7/d8/fd9 2492438 0 2024-09-18T12:49:26.361 INFO:tasks.workunit.client.0.smithi078.stdout:4/623: link d11/d27/d5a/f64 d11/fc5 0 2024-09-18T12:49:26.361 INFO:tasks.workunit.client.1.smithi148.stdout:5/919: readlink d7/d8/d18/d3f/l55 0 2024-09-18T12:49:26.362 INFO:tasks.workunit.client.1.smithi148.stdout:3/834: mknod d4/d8/d20/d2b/d7f/d93/dd1/c121 0 2024-09-18T12:49:26.362 INFO:tasks.workunit.client.0.smithi078.stdout:9/612: unlink d5/l84 0 2024-09-18T12:49:26.363 INFO:tasks.workunit.client.1.smithi148.stdout:3/835: stat d4/d8/d20/d2b/d43/l17 0 2024-09-18T12:49:26.363 INFO:tasks.workunit.client.0.smithi078.stdout:9/613: fsync d5/d7/d8/f46 0 2024-09-18T12:49:26.366 INFO:tasks.workunit.client.0.smithi078.stdout:9/614: readlink d5/d7/lf 0 2024-09-18T12:49:26.369 INFO:tasks.workunit.client.1.smithi148.stdout:2/806: getdents d9/d24/d31/df7 0 2024-09-18T12:49:26.370 INFO:tasks.workunit.client.1.smithi148.stdout:4/902: mknod d15/d17/d52/d92/d4c/d4f/d64/da0/da1/dcf/c12b 0 2024-09-18T12:49:26.372 INFO:tasks.workunit.client.1.smithi148.stdout:1/898: dread dc/d18/f90 [0,4194304] 0 2024-09-18T12:49:26.374 INFO:tasks.workunit.client.0.smithi078.stdout:9/615: dwrite d5/fb9 [0,4194304] 0 2024-09-18T12:49:26.378 INFO:tasks.workunit.client.0.smithi078.stdout:4/624: chown d11/d27/d5a/d84/d4b/c7a 615629895 1 2024-09-18T12:49:26.379 INFO:tasks.workunit.client.1.smithi148.stdout:9/882: write d8/da/dd/f14 [1018282,93620] 0 2024-09-18T12:49:26.381 INFO:tasks.workunit.client.1.smithi148.stdout:6/910: creat d5/d32/d56/d116/f12a x:0 0 0 2024-09-18T12:49:26.382 INFO:tasks.workunit.client.1.smithi148.stdout:6/911: readlink d5/d1a/l1e 0 2024-09-18T12:49:26.382 INFO:tasks.workunit.client.0.smithi078.stdout:9/616: mknod d5/d7/d8/cc8 0 2024-09-18T12:49:26.383 INFO:tasks.workunit.client.1.smithi148.stdout:6/912: chown d5/d1a/dc/d2b/cec 0 1 2024-09-18T12:49:26.384 INFO:tasks.workunit.client.0.smithi078.stdout:4/625: mknod d11/d27/d5a/d84/d4b/da7/cc6 0 2024-09-18T12:49:26.387 INFO:tasks.workunit.client.1.smithi148.stdout:8/972: dwrite d8/d16/d27/f93 [0,4194304] 0 2024-09-18T12:49:26.388 INFO:tasks.workunit.client.0.smithi078.stdout:9/617: fsync d5/f4a 0 2024-09-18T12:49:26.391 INFO:tasks.workunit.client.1.smithi148.stdout:1/899: creat dc/d18/d31/d4b/d8d/d8f/f129 x:0 0 0 2024-09-18T12:49:26.391 INFO:tasks.workunit.client.1.smithi148.stdout:5/920: dwrite d7/d8/d18/f103 [0,4194304] 0 2024-09-18T12:49:26.393 INFO:tasks.workunit.client.0.smithi078.stdout:9/618: symlink d5/d7/d32/d2a/lc9 0 2024-09-18T12:49:26.394 INFO:tasks.workunit.client.0.smithi078.stdout:9/619: fsync d5/d7/d32/d91/f94 0 2024-09-18T12:49:26.396 INFO:tasks.workunit.client.1.smithi148.stdout:9/883: symlink d8/da/dd/d35/d47/d62/l109 0 2024-09-18T12:49:26.398 INFO:tasks.workunit.client.1.smithi148.stdout:2/807: dread d9/d17/d29/d92/d95/fac [0,4194304] 0 2024-09-18T12:49:26.398 INFO:tasks.workunit.client.1.smithi148.stdout:6/913: unlink d5/d1a/dc/dbf/f129 0 2024-09-18T12:49:26.403 INFO:tasks.workunit.client.1.smithi148.stdout:7/874: getdents db/dc/df 0 2024-09-18T12:49:26.405 INFO:tasks.workunit.client.0.smithi078.stdout:4/626: dwrite d11/d27/d47/f87 [0,4194304] 0 2024-09-18T12:49:26.406 INFO:tasks.workunit.client.1.smithi148.stdout:2/808: dwrite d9/d24/d31/d34/d7b/f101 [0,4194304] 0 2024-09-18T12:49:26.407 INFO:tasks.workunit.client.0.smithi078.stdout:4/627: chown d11/d27/d47/d78/d95/fbe 2 1 2024-09-18T12:49:26.410 INFO:tasks.workunit.client.0.smithi078.stdout:4/628: fsync d11/d27/d47/d4e/d76/f7e 0 2024-09-18T12:49:26.410 INFO:tasks.workunit.client.1.smithi148.stdout:6/914: chown d5/l6 2461141 1 2024-09-18T12:49:26.412 INFO:tasks.workunit.client.1.smithi148.stdout:9/884: rename d8/da/dd/d77/cfe to d8/da/dd/d35/d47/d4e/c10a 0 2024-09-18T12:49:26.415 INFO:tasks.workunit.client.0.smithi078.stdout:8/541: sync 2024-09-18T12:49:26.415 INFO:tasks.workunit.client.0.smithi078.stdout:1/605: sync 2024-09-18T12:49:26.416 INFO:tasks.workunit.client.0.smithi078.stdout:0/668: sync 2024-09-18T12:49:26.416 INFO:tasks.workunit.client.0.smithi078.stdout:2/548: sync 2024-09-18T12:49:26.418 INFO:tasks.workunit.client.1.smithi148.stdout:4/903: link d15/d17/d52/d92/d4c/d4f/f3d d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/f12c 0 2024-09-18T12:49:26.423 INFO:tasks.workunit.client.0.smithi078.stdout:9/620: chown d5/d7/d32/d2a/d68/d97/dc0 27 1 2024-09-18T12:49:26.424 INFO:tasks.workunit.client.0.smithi078.stdout:4/629: dwrite d11/f14 [4194304,4194304] 0 2024-09-18T12:49:26.425 INFO:tasks.workunit.client.1.smithi148.stdout:3/836: link d4/d8/d1e/ca5 d4/d8/d20/d2b/c122 0 2024-09-18T12:49:26.428 INFO:tasks.workunit.client.0.smithi078.stdout:2/549: dwrite d4/d8/d23/d52/faa [0,4194304] 0 2024-09-18T12:49:26.428 INFO:tasks.workunit.client.0.smithi078.stdout:9/621: read d5/d7/d8/d98/fc5 [1822060,54573] 0 2024-09-18T12:49:26.431 INFO:tasks.workunit.client.1.smithi148.stdout:1/900: write dc/d18/d7d/d93/dd9/f3c [4416590,76766] 0 2024-09-18T12:49:26.432 INFO:tasks.workunit.client.1.smithi148.stdout:9/885: dread - d8/da/dd/d3f/fb0 zero size 2024-09-18T12:49:26.433 INFO:tasks.workunit.client.1.smithi148.stdout:1/901: write dc/d18/d31/d4b/d8d/ddd/f10c [1952398,105507] 0 2024-09-18T12:49:26.435 INFO:tasks.workunit.client.0.smithi078.stdout:0/669: mkdir d3/d1f/df2 0 2024-09-18T12:49:26.436 INFO:tasks.workunit.client.1.smithi148.stdout:9/886: dread d8/da/dd/d4a/f18 [0,4194304] 0 2024-09-18T12:49:26.437 INFO:tasks.workunit.client.0.smithi078.stdout:0/670: chown d3/d1f/d2e/d4e/d37/d72/d96/cd1 9 1 2024-09-18T12:49:26.440 INFO:tasks.workunit.client.1.smithi148.stdout:8/973: write d8/df/f10 [2742561,100345] 0 2024-09-18T12:49:26.440 INFO:tasks.workunit.client.0.smithi078.stdout:8/542: dread d0/d39/d4c/d77/d7d/d52/f89 [0,4194304] 0 2024-09-18T12:49:26.442 INFO:tasks.workunit.client.1.smithi148.stdout:1/902: dwrite dc/d11/f16 [0,4194304] 0 2024-09-18T12:49:26.443 INFO:tasks.workunit.client.0.smithi078.stdout:4/630: mkdir d11/d27/d5a/d84/d40/dc7 0 2024-09-18T12:49:26.443 INFO:tasks.workunit.client.1.smithi148.stdout:5/921: write d7/d8/dc/d12/f45 [217758,98214] 0 2024-09-18T12:49:26.443 INFO:tasks.workunit.client.1.smithi148.stdout:2/809: write d9/d3a/d90/f60 [281359,70317] 0 2024-09-18T12:49:26.444 INFO:tasks.workunit.client.1.smithi148.stdout:2/810: chown d9/d24/d67/dc7/ddd 5447470 1 2024-09-18T12:49:26.445 INFO:tasks.workunit.client.0.smithi078.stdout:2/550: mknod d4/d8/d23/d52/d5f/cb0 0 2024-09-18T12:49:26.447 INFO:tasks.workunit.client.1.smithi148.stdout:4/904: read fe [336855,72877] 0 2024-09-18T12:49:26.448 INFO:tasks.workunit.client.0.smithi078.stdout:2/551: fdatasync d4/d8/d23/d52/d7c/f82 0 2024-09-18T12:49:26.449 INFO:tasks.workunit.client.0.smithi078.stdout:8/543: dwrite d0/d39/d4c/d77/f85 [0,4194304] 0 2024-09-18T12:49:26.454 INFO:tasks.workunit.client.1.smithi148.stdout:3/837: dwrite d4/d8/d1e/d6b/d31/d46/f72 [0,4194304] 0 2024-09-18T12:49:26.454 INFO:tasks.workunit.client.1.smithi148.stdout:4/905: dwrite d15/d17/d52/d92/f84 [0,4194304] 0 2024-09-18T12:49:26.458 INFO:tasks.workunit.client.0.smithi078.stdout:9/622: creat d5/d7/d32/d2a/d36/fca x:0 0 0 2024-09-18T12:49:26.459 INFO:tasks.workunit.client.0.smithi078.stdout:1/606: dwrite d0/d8/da/d3e/d50/f54 [0,4194304] 0 2024-09-18T12:49:26.461 INFO:tasks.workunit.client.1.smithi148.stdout:8/974: creat d8/d16/d53/d39/d3b/d125/f14d x:0 0 0 2024-09-18T12:49:26.461 INFO:tasks.workunit.client.0.smithi078.stdout:1/607: write d0/d8/f92 [1107018,120286] 0 2024-09-18T12:49:26.463 INFO:tasks.workunit.client.1.smithi148.stdout:8/975: write d8/d16/d27/ffb [841039,97649] 0 2024-09-18T12:49:26.463 INFO:tasks.workunit.client.0.smithi078.stdout:8/544: rename d0/f6a to d0/d39/d4c/d77/fa2 0 2024-09-18T12:49:26.468 INFO:tasks.workunit.client.1.smithi148.stdout:2/811: mkdir d9/d24/d67/d72/d107/d115 0 2024-09-18T12:49:26.473 INFO:tasks.workunit.client.1.smithi148.stdout:9/887: symlink d8/da/dd/d35/l10b 0 2024-09-18T12:49:26.474 INFO:tasks.workunit.client.0.smithi078.stdout:8/545: dwrite d0/d7/d1e/f54 [0,4194304] 0 2024-09-18T12:49:26.475 INFO:tasks.workunit.client.1.smithi148.stdout:3/838: truncate d4/d8/d1e/d63/f86 398715 0 2024-09-18T12:49:26.475 INFO:tasks.workunit.client.0.smithi078.stdout:1/608: fsync d0/d8/da/d3e/d58/d6e/d52/d47/f66 0 2024-09-18T12:49:26.476 INFO:tasks.workunit.client.1.smithi148.stdout:3/839: chown d4/d8/d1e/c6f 2067236156 1 2024-09-18T12:49:26.476 INFO:tasks.workunit.client.1.smithi148.stdout:7/875: getdents db/dc/df/d1d/d68 0 2024-09-18T12:49:26.480 INFO:tasks.workunit.client.0.smithi078.stdout:2/552: truncate d4/d8/d23/d52/d5f/d86/d3b/d4f/f61 169176 0 2024-09-18T12:49:26.482 INFO:tasks.workunit.client.0.smithi078.stdout:4/631: creat d11/d27/d47/d4e/fc8 x:0 0 0 2024-09-18T12:49:26.482 INFO:tasks.workunit.client.0.smithi078.stdout:4/632: fdatasync d11/d27/d5a/d84/f2d 0 2024-09-18T12:49:26.483 INFO:tasks.workunit.client.1.smithi148.stdout:1/903: unlink dc/d18/d31/dc6/fff 0 2024-09-18T12:49:26.484 INFO:tasks.workunit.client.1.smithi148.stdout:1/904: read - dc/d9f/df5/deb/f10f zero size 2024-09-18T12:49:26.485 INFO:tasks.workunit.client.1.smithi148.stdout:2/812: unlink d9/l68 0 2024-09-18T12:49:26.486 INFO:tasks.workunit.client.0.smithi078.stdout:1/609: creat d0/fca x:0 0 0 2024-09-18T12:49:26.487 INFO:tasks.workunit.client.1.smithi148.stdout:6/915: link d5/d1a/d29/f5d d5/d1a/dc/f12b 0 2024-09-18T12:49:26.489 INFO:tasks.workunit.client.1.smithi148.stdout:9/888: rename d8/da/dd/d4a/d49/d46/d54/cc2 to d8/da/dd/d35/d81/db7/dee/c10c 0 2024-09-18T12:49:26.492 INFO:tasks.workunit.client.1.smithi148.stdout:8/976: mkdir d8/d16/d53/d14e 0 2024-09-18T12:49:26.493 INFO:tasks.workunit.client.0.smithi078.stdout:9/623: creat d5/d7/d32/d2a/fcb x:0 0 0 2024-09-18T12:49:26.494 INFO:tasks.workunit.client.0.smithi078.stdout:9/624: write d5/fb9 [3534427,55109] 0 2024-09-18T12:49:26.495 INFO:tasks.workunit.client.1.smithi148.stdout:1/905: unlink dc/d18/d31/d39/cac 0 2024-09-18T12:49:26.495 INFO:tasks.workunit.client.1.smithi148.stdout:1/906: dread - dc/d9f/df5/f125 zero size 2024-09-18T12:49:26.498 INFO:tasks.workunit.client.1.smithi148.stdout:2/813: creat d9/d17/d29/d92/d95/d64/f116 x:0 0 0 2024-09-18T12:49:26.499 INFO:tasks.workunit.client.1.smithi148.stdout:2/814: write d9/d24/d67/fc4 [3473411,130142] 0 2024-09-18T12:49:26.500 INFO:tasks.workunit.client.0.smithi078.stdout:2/553: symlink d4/d8/d23/d52/d5f/dab/lb1 0 2024-09-18T12:49:26.502 INFO:tasks.workunit.client.0.smithi078.stdout:2/554: write d4/dd/f64 [905387,91712] 0 2024-09-18T12:49:26.502 INFO:tasks.workunit.client.0.smithi078.stdout:4/633: truncate d11/d27/d5a/f79 4717172 0 2024-09-18T12:49:26.506 INFO:tasks.workunit.client.0.smithi078.stdout:2/555: dread d4/d8/d23/f6d [0,4194304] 0 2024-09-18T12:49:26.507 INFO:tasks.workunit.client.1.smithi148.stdout:7/876: rename db/dc/df/d1d/d68/d82/dfe to db/dc/df/d11/dac/d107 0 2024-09-18T12:49:26.508 INFO:tasks.workunit.client.1.smithi148.stdout:1/907: dread dc/d18/d7d/d93/dd9/f21 [0,4194304] 0 2024-09-18T12:49:26.510 INFO:tasks.workunit.client.1.smithi148.stdout:9/889: creat d8/da/dd/d3f/d5d/da0/f10d x:0 0 0 2024-09-18T12:49:26.510 INFO:tasks.workunit.client.1.smithi148.stdout:5/922: dwrite d7/d8/dc/d12/d97/fba [0,4194304] 0 2024-09-18T12:49:26.510 INFO:tasks.workunit.client.1.smithi148.stdout:1/908: fsync dc/d18/d43/f4e 0 2024-09-18T12:49:26.511 INFO:tasks.workunit.client.0.smithi078.stdout:8/546: link d0/d39/d4c/d77/d7d/d3e/c65 d0/d7/d1e/d50/ca3 0 2024-09-18T12:49:26.513 INFO:tasks.workunit.client.1.smithi148.stdout:6/916: mkdir d5/d1a/dc/dbf/dcb/df3/d12c 0 2024-09-18T12:49:26.520 INFO:tasks.workunit.client.1.smithi148.stdout:2/815: rename d9/fb to d9/d24/d67/f117 0 2024-09-18T12:49:26.521 INFO:tasks.workunit.client.1.smithi148.stdout:2/816: write d9/d73/d81/fae [4686176,9772] 0 2024-09-18T12:49:26.523 INFO:tasks.workunit.client.1.smithi148.stdout:2/817: dread - d9/d17/d29/d92/d95/d64/f116 zero size 2024-09-18T12:49:26.523 INFO:tasks.workunit.client.1.smithi148.stdout:7/877: creat db/dc/df/d11/d34/f108 x:0 0 0 2024-09-18T12:49:26.524 INFO:tasks.workunit.client.1.smithi148.stdout:7/878: dread - db/dc/df/d5f/dcb/dd5/fdb zero size 2024-09-18T12:49:26.525 INFO:tasks.workunit.client.0.smithi078.stdout:2/556: creat d4/db/dc/fb2 x:0 0 0 2024-09-18T12:49:26.530 INFO:tasks.workunit.client.1.smithi148.stdout:1/909: fdatasync dc/d18/d7d/d93/fd3 0 2024-09-18T12:49:26.531 INFO:tasks.workunit.client.1.smithi148.stdout:4/906: dwrite d15/d17/f42 [0,4194304] 0 2024-09-18T12:49:26.536 INFO:tasks.workunit.client.1.smithi148.stdout:8/977: link d8/d16/d27/dc5/dee/dfe/df3/f121 d8/d16/dff/d12f/d137/f14f 0 2024-09-18T12:49:26.540 INFO:tasks.workunit.client.1.smithi148.stdout:6/917: fdatasync d5/d1a/dc/d2b/f55 0 2024-09-18T12:49:26.541 INFO:tasks.workunit.client.0.smithi078.stdout:1/610: dwrite d0/d5b/f63 [0,4194304] 0 2024-09-18T12:49:26.545 INFO:tasks.workunit.client.1.smithi148.stdout:2/818: fsync d9/d3a/f86 0 2024-09-18T12:49:26.547 INFO:tasks.workunit.client.1.smithi148.stdout:7/879: creat db/dc/df/d2c/d66/da0/f109 x:0 0 0 2024-09-18T12:49:26.549 INFO:tasks.workunit.client.1.smithi148.stdout:7/880: dread - db/dc/df/d2c/d55/f102 zero size 2024-09-18T12:49:26.550 INFO:tasks.workunit.client.0.smithi078.stdout:8/547: rename d0/d39/d4c/c84 to d0/d39/d4c/d77/d7d/ca4 0 2024-09-18T12:49:26.552 INFO:tasks.workunit.client.1.smithi148.stdout:5/923: mkdir d7/d8/dc/d12/d134 0 2024-09-18T12:49:26.553 INFO:tasks.workunit.client.0.smithi078.stdout:1/611: mknod d0/d8/da/d3e/d58/d6e/d52/d47/d7d/ccb 0 2024-09-18T12:49:26.554 INFO:tasks.workunit.client.0.smithi078.stdout:9/625: truncate d5/d7/d32/d2a/d68/d97/fa6 3624346 0 2024-09-18T12:49:26.556 INFO:tasks.workunit.client.1.smithi148.stdout:1/910: creat dc/d11/d38/d7b/f12a x:0 0 0 2024-09-18T12:49:26.557 INFO:tasks.workunit.client.1.smithi148.stdout:4/907: mkdir d15/d17/d52/d92/d4c/dd0/dd6/d12d 0 2024-09-18T12:49:26.557 INFO:tasks.workunit.client.0.smithi078.stdout:8/548: symlink d0/la5 0 2024-09-18T12:49:26.558 INFO:tasks.workunit.client.0.smithi078.stdout:2/557: write d4/db/dc/f62 [749801,74073] 0 2024-09-18T12:49:26.559 INFO:tasks.workunit.client.0.smithi078.stdout:8/549: read - d0/d7/dc/d5d/d2e/d6d/f9f zero size 2024-09-18T12:49:26.559 INFO:tasks.workunit.client.1.smithi148.stdout:1/911: dread dc/d11/d38/d72/f107 [0,4194304] 0 2024-09-18T12:49:26.561 INFO:tasks.workunit.client.0.smithi078.stdout:9/626: rename d5/d7/d8/d4f/l74 to d5/dc6/lcc 0 2024-09-18T12:49:26.563 INFO:tasks.workunit.client.1.smithi148.stdout:8/978: creat d8/d16/d53/d39/def/f150 x:0 0 0 2024-09-18T12:49:26.564 INFO:tasks.workunit.client.0.smithi078.stdout:2/558: fsync d4/d8/f50 0 2024-09-18T12:49:26.568 INFO:tasks.workunit.client.1.smithi148.stdout:6/918: mknod d5/d1a/d29/d5c/da1/c12d 0 2024-09-18T12:49:26.571 INFO:tasks.workunit.client.1.smithi148.stdout:2/819: unlink d9/fe 0 2024-09-18T12:49:26.572 INFO:tasks.workunit.client.1.smithi148.stdout:6/919: dwrite d5/d1a/dc/d101/da4/da6/fba [0,4194304] 0 2024-09-18T12:49:26.574 INFO:tasks.workunit.client.1.smithi148.stdout:7/881: mkdir db/dc/df/d11/ddc/d75/d10a 0 2024-09-18T12:49:26.576 INFO:tasks.workunit.client.1.smithi148.stdout:3/840: getdents d4/d8/d1e/d6b/d31/d54 0 2024-09-18T12:49:26.580 INFO:tasks.workunit.client.0.smithi078.stdout:2/559: mknod d4/d8/d23/d52/cb3 0 2024-09-18T12:49:26.583 INFO:tasks.workunit.client.1.smithi148.stdout:4/908: rmdir d15/d17 39 2024-09-18T12:49:26.583 INFO:tasks.workunit.client.1.smithi148.stdout:9/890: link c3 d8/da/dd/d3f/d5d/c10e 0 2024-09-18T12:49:26.584 INFO:tasks.workunit.client.0.smithi078.stdout:9/627: write d5/d5c/fc1 [1964739,58827] 0 2024-09-18T12:49:26.585 INFO:tasks.workunit.client.1.smithi148.stdout:9/891: write d8/da/dd/d4a/d49/d46/d54/dab/fd0 [4090535,72228] 0 2024-09-18T12:49:26.586 INFO:tasks.workunit.client.1.smithi148.stdout:9/892: chown d8/da/dd/d3f/d5d/l6e 835751 1 2024-09-18T12:49:26.586 INFO:tasks.workunit.client.1.smithi148.stdout:1/912: symlink dc/d11/d96/l12b 0 2024-09-18T12:49:26.588 INFO:tasks.workunit.client.1.smithi148.stdout:1/913: truncate dc/d18/d31/d4b/fdf 900014 0 2024-09-18T12:49:26.588 INFO:tasks.workunit.client.0.smithi078.stdout:2/560: creat d4/d8/d23/d95/fb4 x:0 0 0 2024-09-18T12:49:26.592 INFO:tasks.workunit.client.0.smithi078.stdout:8/550: dwrite d0/d7/d1e/d50/f58 [0,4194304] 0 2024-09-18T12:49:26.595 INFO:tasks.workunit.client.1.smithi148.stdout:2/820: dread d9/d17/d29/fa4 [0,4194304] 0 2024-09-18T12:49:26.605 INFO:tasks.workunit.client.0.smithi078.stdout:2/561: truncate d4/dd/f4e 195493 0 2024-09-18T12:49:26.609 INFO:tasks.workunit.client.0.smithi078.stdout:9/628: write d5/f15 [1725156,126560] 0 2024-09-18T12:49:26.609 INFO:tasks.workunit.client.0.smithi078.stdout:9/629: fdatasync f0 0 2024-09-18T12:49:26.612 INFO:tasks.workunit.client.1.smithi148.stdout:4/909: dwrite d15/d17/d52/d92/d4c/d4f/d64/d9a/ff4 [0,4194304] 0 2024-09-18T12:49:26.613 INFO:tasks.workunit.client.1.smithi148.stdout:4/910: chown d15/d17/ld4 913796 1 2024-09-18T12:49:26.656 INFO:tasks.workunit.client.0.smithi078.stdout:2/562: symlink d4/d8/d23/d52/d5f/d86/lb5 0 2024-09-18T12:49:26.657 INFO:tasks.workunit.client.1.smithi148.stdout:7/882: write db/dc/df/d1d/d68/d82/fd0 [61195,99471] 0 2024-09-18T12:49:26.658 INFO:tasks.workunit.client.0.smithi078.stdout:9/630: chown d5/d7/d32/d2a/d68/d97/fa6 645 1 2024-09-18T12:49:26.658 INFO:tasks.workunit.client.1.smithi148.stdout:7/883: write db/d52/fd7 [806218,107561] 0 2024-09-18T12:49:26.662 INFO:tasks.workunit.client.0.smithi078.stdout:8/551: dwrite d0/d7/dc/d5d/f86 [0,4194304] 0 2024-09-18T12:49:26.663 INFO:tasks.workunit.client.1.smithi148.stdout:3/841: dwrite d4/d8/d1e/d6b/d31/d60/faf [0,4194304] 0 2024-09-18T12:49:26.663 INFO:tasks.workunit.client.0.smithi078.stdout:9/631: unlink d5/d7/d32/d2a/d68/cc7 0 2024-09-18T12:49:26.668 INFO:tasks.workunit.client.0.smithi078.stdout:9/632: dread d5/d7/f62 [4194304,4194304] 0 2024-09-18T12:49:26.668 INFO:tasks.workunit.client.0.smithi078.stdout:2/563: rename d4/d20/d85/f91 to d4/d8/d23/d52/d7c/fb6 0 2024-09-18T12:49:26.669 INFO:tasks.workunit.client.1.smithi148.stdout:1/914: write dc/d11/d96/fda [344822,103286] 0 2024-09-18T12:49:26.669 INFO:tasks.workunit.client.1.smithi148.stdout:6/920: truncate d5/d1a/dc/dbf/fc3 3682297 0 2024-09-18T12:49:26.674 INFO:tasks.workunit.client.0.smithi078.stdout:9/633: creat d5/dc6/fcd x:0 0 0 2024-09-18T12:49:26.674 INFO:tasks.workunit.client.0.smithi078.stdout:2/564: creat d4/d8/d23/fb7 x:0 0 0 2024-09-18T12:49:26.676 INFO:tasks.workunit.client.1.smithi148.stdout:7/884: mkdir db/dc/df/d11/dcc/d10b 0 2024-09-18T12:49:26.679 INFO:tasks.workunit.client.1.smithi148.stdout:2/821: creat d9/d24/d31/d9d/dcd/d10f/f118 x:0 0 0 2024-09-18T12:49:26.681 INFO:tasks.workunit.client.0.smithi078.stdout:8/552: rename d0/d7/dc/d1f/d23/d44/f4a to d0/d39/d4c/d77/d7d/fa6 0 2024-09-18T12:49:26.682 INFO:tasks.workunit.client.1.smithi148.stdout:3/842: truncate d4/d8/d1e/d6b/fd0 595863 0 2024-09-18T12:49:26.683 INFO:tasks.workunit.client.1.smithi148.stdout:1/915: symlink dc/d18/d63/l12c 0 2024-09-18T12:49:26.684 INFO:tasks.workunit.client.1.smithi148.stdout:1/916: chown dc/d18/d31/d4b/d8d/ce2 7 1 2024-09-18T12:49:26.684 INFO:tasks.workunit.client.0.smithi078.stdout:8/553: symlink d0/d7/d1e/d50/la7 0 2024-09-18T12:49:26.685 INFO:tasks.workunit.client.1.smithi148.stdout:5/924: getdents d7/d8/dc/da6/dee/d77/dd4 0 2024-09-18T12:49:26.687 INFO:tasks.workunit.client.1.smithi148.stdout:9/893: creat d8/da/dd/d35/f10f x:0 0 0 2024-09-18T12:49:26.688 INFO:tasks.workunit.client.0.smithi078.stdout:8/554: creat d0/d7/d53/d57/d5c/fa8 x:0 0 0 2024-09-18T12:49:26.690 INFO:tasks.workunit.client.1.smithi148.stdout:8/979: link d8/df/d3e/d88/cf2 d8/d16/d53/d39/d3b/c151 0 2024-09-18T12:49:26.692 INFO:tasks.workunit.client.0.smithi078.stdout:8/555: write d0/d39/d4c/d77/d7d/d52/f89 [191110,101505] 0 2024-09-18T12:49:26.693 INFO:tasks.workunit.client.1.smithi148.stdout:4/911: write d15/d17/d52/d92/d4c/d4f/d64/da0/fd8 [592138,118570] 0 2024-09-18T12:49:26.694 INFO:tasks.workunit.client.1.smithi148.stdout:9/894: dwrite d8/da/dd/d77/dd8/ffb [0,4194304] 0 2024-09-18T12:49:26.696 INFO:tasks.workunit.client.0.smithi078.stdout:8/556: rename d0/d7/dc/d5d/d2e to d0/d7/d1e/da9 0 2024-09-18T12:49:26.698 INFO:tasks.workunit.client.1.smithi148.stdout:1/917: creat dc/d18/d63/f12d x:0 0 0 2024-09-18T12:49:26.699 INFO:tasks.workunit.client.1.smithi148.stdout:9/895: read d8/da/dd/d35/d81/f8e [1437627,1136] 0 2024-09-18T12:49:26.700 INFO:tasks.workunit.client.1.smithi148.stdout:5/925: rename d7/d8/dc/da6/dee/d25/d4b/cea to d7/d8/dc/da6/dee/d25/d4b/dd6/ddf/c135 0 2024-09-18T12:49:26.700 INFO:tasks.workunit.client.1.smithi148.stdout:1/918: dread dc/f57 [0,4194304] 0 2024-09-18T12:49:26.700 INFO:tasks.workunit.client.1.smithi148.stdout:9/896: write f6 [5255620,100888] 0 2024-09-18T12:49:26.702 INFO:tasks.workunit.client.0.smithi078.stdout:8/557: creat d0/d7/d1e/d50/faa x:0 0 0 2024-09-18T12:49:26.702 INFO:tasks.workunit.client.1.smithi148.stdout:9/897: dread - d8/da/dd/d65/db9/fbe zero size 2024-09-18T12:49:26.704 INFO:tasks.workunit.client.1.smithi148.stdout:7/885: mkdir db/d52/d4f/dc8/d10c 0 2024-09-18T12:49:26.705 INFO:tasks.workunit.client.1.smithi148.stdout:8/980: mkdir d8/df/d3e/d82/da7/d152 0 2024-09-18T12:49:26.705 INFO:tasks.workunit.client.1.smithi148.stdout:7/886: chown db/dc/df/d11/c64 14783387 1 2024-09-18T12:49:26.708 INFO:tasks.workunit.client.0.smithi078.stdout:9/634: dwrite d5/d40/f7c [0,4194304] 0 2024-09-18T12:49:26.712 INFO:tasks.workunit.client.1.smithi148.stdout:3/843: mknod d4/d8/c123 0 2024-09-18T12:49:26.717 INFO:tasks.workunit.client.0.smithi078.stdout:9/635: dwrite d5/d7/d32/d2a/fcb [0,4194304] 0 2024-09-18T12:49:26.717 INFO:tasks.workunit.client.1.smithi148.stdout:2/822: write d9/f26 [2624233,110946] 0 2024-09-18T12:49:26.720 INFO:tasks.workunit.client.1.smithi148.stdout:1/919: mkdir dc/d4d/dfe/d12e 0 2024-09-18T12:49:26.721 INFO:tasks.workunit.client.1.smithi148.stdout:6/921: truncate d5/d32/d38/f54 4029243 0 2024-09-18T12:49:26.727 INFO:tasks.workunit.client.1.smithi148.stdout:9/898: mknod d8/da/dd/d35/d81/dc6/dcc/de0/c110 0 2024-09-18T12:49:26.727 INFO:tasks.workunit.client.1.smithi148.stdout:8/981: mknod d8/df/d3e/d82/d8f/d95/d12e/c153 0 2024-09-18T12:49:26.728 INFO:tasks.workunit.client.1.smithi148.stdout:9/899: stat d8/d6f/lc7 0 2024-09-18T12:49:26.729 INFO:tasks.workunit.client.1.smithi148.stdout:8/982: dread - d8/df/d3e/d82/d8f/d95/d12e/f146 zero size 2024-09-18T12:49:26.731 INFO:tasks.workunit.client.1.smithi148.stdout:2/823: mknod d9/d24/d67/dc7/dce/c119 0 2024-09-18T12:49:26.732 INFO:tasks.workunit.client.1.smithi148.stdout:8/983: dread d8/d16/d27/ffb [0,4194304] 0 2024-09-18T12:49:26.733 INFO:tasks.workunit.client.1.smithi148.stdout:1/920: rename dc/d4d/ffa to dc/d18/d31/d4b/d8d/f12f 0 2024-09-18T12:49:26.734 INFO:tasks.workunit.client.1.smithi148.stdout:4/912: write d15/d90/fbe [335791,16869] 0 2024-09-18T12:49:26.734 INFO:tasks.workunit.client.0.smithi078.stdout:8/558: dwrite d0/d7/f4d [0,4194304] 0 2024-09-18T12:49:26.734 INFO:tasks.workunit.client.1.smithi148.stdout:6/922: symlink d5/d1a/dc/d101/da3/l12e 0 2024-09-18T12:49:26.736 INFO:tasks.workunit.client.1.smithi148.stdout:7/887: mknod db/dc/df/d2c/de1/c10d 0 2024-09-18T12:49:26.738 INFO:tasks.workunit.client.1.smithi148.stdout:3/844: symlink d4/df5/l124 0 2024-09-18T12:49:26.739 INFO:tasks.workunit.client.0.smithi078.stdout:8/559: rename d0/d7/dc/c7e to d0/d7/dc/d71/d9b/cab 0 2024-09-18T12:49:26.742 INFO:tasks.workunit.client.1.smithi148.stdout:6/923: dwrite d5/d1a/dc/f5b [0,4194304] 0 2024-09-18T12:49:26.742 INFO:tasks.workunit.client.0.smithi078.stdout:9/636: write d5/d7/f62 [8925783,74539] 0 2024-09-18T12:49:26.745 INFO:tasks.workunit.client.0.smithi078.stdout:8/560: rename d0/d7/d53/d57/d67/f9e to d0/d7/d53/d57/d5c/d88/fac 0 2024-09-18T12:49:26.745 INFO:tasks.workunit.client.1.smithi148.stdout:9/900: mknod d8/da/dd/d35/d47/d62/d72/c111 0 2024-09-18T12:49:26.747 INFO:tasks.workunit.client.1.smithi148.stdout:6/924: write d5/d1a/dc/d2b/d35/f10d [625582,58542] 0 2024-09-18T12:49:26.749 INFO:tasks.workunit.client.1.smithi148.stdout:6/925: chown d5/d32/d38/d50/de7/d7c/fdc 19885116 1 2024-09-18T12:49:26.749 INFO:tasks.workunit.client.1.smithi148.stdout:6/926: chown d5/d32/c89 4112374 1 2024-09-18T12:49:26.750 INFO:tasks.workunit.client.1.smithi148.stdout:8/984: symlink d8/df/d3e/d82/d8f/d95/l154 0 2024-09-18T12:49:26.750 INFO:tasks.workunit.client.1.smithi148.stdout:8/985: readlink d8/df/l22 0 2024-09-18T12:49:26.752 INFO:tasks.workunit.client.1.smithi148.stdout:8/986: write d8/d16/d53/da0/f12c [996407,107601] 0 2024-09-18T12:49:26.752 INFO:tasks.workunit.client.0.smithi078.stdout:8/561: rename d0/d7/d1e/da9/l7c to d0/d7/d53/d57/d5c/d88/lad 0 2024-09-18T12:49:26.754 INFO:tasks.workunit.client.1.smithi148.stdout:1/921: creat dc/d11/d38/d72/f130 x:0 0 0 2024-09-18T12:49:26.755 INFO:tasks.workunit.client.1.smithi148.stdout:1/922: dread - dc/d18/d63/f12d zero size 2024-09-18T12:49:26.755 INFO:tasks.workunit.client.0.smithi078.stdout:9/637: creat d5/fce x:0 0 0 2024-09-18T12:49:26.756 INFO:tasks.workunit.client.1.smithi148.stdout:1/923: chown dc/d18/d31/d39/f115 1249678830 1 2024-09-18T12:49:26.757 INFO:tasks.workunit.client.0.smithi078.stdout:8/562: unlink d0/d7/dc/d1f/d23/f48 0 2024-09-18T12:49:26.758 INFO:tasks.workunit.client.0.smithi078.stdout:9/638: read d5/d7/d8/d4f/f54 [3275529,69721] 0 2024-09-18T12:49:26.759 INFO:tasks.workunit.client.1.smithi148.stdout:5/926: dread d7/d8/dc/da6/dee/d69/fab [0,4194304] 0 2024-09-18T12:49:26.759 INFO:tasks.workunit.client.1.smithi148.stdout:4/913: mkdir d15/d17/d52/d92/d4c/d4f/d64/da0/da1/dcf/d12e 0 2024-09-18T12:49:26.761 INFO:tasks.workunit.client.1.smithi148.stdout:7/888: mknod db/dc/df/d2c/d66/c10e 0 2024-09-18T12:49:26.763 INFO:tasks.workunit.client.0.smithi078.stdout:8/563: link d0/d39/d4c/d77/d7d/d52/f95 d0/d7/d1e/da9/d6d/fae 0 2024-09-18T12:49:26.766 INFO:tasks.workunit.client.1.smithi148.stdout:8/987: rmdir d8/df/d66 39 2024-09-18T12:49:26.768 INFO:tasks.workunit.client.1.smithi148.stdout:1/924: creat dc/d18/d31/d4b/f131 x:0 0 0 2024-09-18T12:49:26.768 INFO:tasks.workunit.client.1.smithi148.stdout:8/988: readlink d8/df/d3e/d82/d8f/d95/l154 0 2024-09-18T12:49:26.769 INFO:tasks.workunit.client.1.smithi148.stdout:6/927: dread d5/f23 [0,4194304] 0 2024-09-18T12:49:26.773 INFO:tasks.workunit.client.0.smithi078.stdout:8/564: dwrite d0/d7/dc/d1f/d23/f9a [0,4194304] 0 2024-09-18T12:49:26.773 INFO:tasks.workunit.client.0.smithi078.stdout:8/565: readlink d0/d7/dc/d71/l83 0 2024-09-18T12:49:26.773 INFO:tasks.workunit.client.1.smithi148.stdout:4/914: symlink d15/d17/d52/d92/dc9/l12f 0 2024-09-18T12:49:26.773 INFO:tasks.workunit.client.1.smithi148.stdout:3/845: mknod d4/d8/d1e/d6b/d31/d46/d10c/c125 0 2024-09-18T12:49:26.773 INFO:tasks.workunit.client.1.smithi148.stdout:4/915: write d15/d17/d52/d92/d4c/fd9 [1511027,36238] 0 2024-09-18T12:49:26.774 INFO:tasks.workunit.client.0.smithi078.stdout:8/566: write d0/d7/dc/d1f/d23/d40/f94 [1612321,62913] 0 2024-09-18T12:49:26.776 INFO:tasks.workunit.client.1.smithi148.stdout:9/901: symlink d8/da/dd/d4a/d49/d46/d54/l112 0 2024-09-18T12:49:26.777 INFO:tasks.workunit.client.1.smithi148.stdout:9/902: chown d8/da/dd/d4a/d27/c7d 25543 1 2024-09-18T12:49:26.778 INFO:tasks.workunit.client.0.smithi078.stdout:8/567: creat d0/d7/dc/d71/d9b/faf x:0 0 0 2024-09-18T12:49:26.781 INFO:tasks.workunit.client.1.smithi148.stdout:8/989: write d8/d16/d53/d39/d3b/d125/f142 [582315,73812] 0 2024-09-18T12:49:26.782 INFO:tasks.workunit.client.0.smithi078.stdout:8/568: mkdir d0/d7/d53/db0 0 2024-09-18T12:49:26.785 INFO:tasks.workunit.client.1.smithi148.stdout:5/927: dread d7/d8/dc/da6/dee/d69/f73 [0,4194304] 0 2024-09-18T12:49:26.786 INFO:tasks.workunit.client.0.smithi078.stdout:8/569: rename d0/d7/dc/d5d/f37 to d0/d7/d53/db0/fb1 0 2024-09-18T12:49:26.786 INFO:tasks.workunit.client.1.smithi148.stdout:1/925: dwrite dc/d9f/ff2 [4194304,4194304] 0 2024-09-18T12:49:26.788 INFO:tasks.workunit.client.1.smithi148.stdout:7/889: link db/dc/df/d1d/d41/fa2 db/dc/df/d5f/dcb/dd5/f10f 0 2024-09-18T12:49:26.791 INFO:tasks.workunit.client.1.smithi148.stdout:6/928: dread d5/d32/f64 [0,4194304] 0 2024-09-18T12:49:26.793 INFO:tasks.workunit.client.1.smithi148.stdout:3/846: mknod d4/d8/d20/d2b/d43/c126 0 2024-09-18T12:49:26.795 INFO:tasks.workunit.client.1.smithi148.stdout:9/903: symlink d8/da/dd/d35/d5e/l113 0 2024-09-18T12:49:26.796 INFO:tasks.workunit.client.1.smithi148.stdout:2/824: dwrite d9/f40 [0,4194304] 0 2024-09-18T12:49:26.798 INFO:tasks.workunit.client.1.smithi148.stdout:5/928: rename d7/d8/d18/f88 to d7/d8/dc/d12/d20/d100/f136 0 2024-09-18T12:49:26.799 INFO:tasks.workunit.client.1.smithi148.stdout:2/825: dread d9/d73/fde [0,4194304] 0 2024-09-18T12:49:26.800 INFO:tasks.workunit.client.1.smithi148.stdout:9/904: dread d8/da/dd/d4a/d49/d46/d54/dab/fe7 [0,4194304] 0 2024-09-18T12:49:26.806 INFO:tasks.workunit.client.1.smithi148.stdout:6/929: mkdir d5/d32/d12f 0 2024-09-18T12:49:26.806 INFO:tasks.workunit.client.1.smithi148.stdout:4/916: mknod d15/d17/d52/d92/d4c/d4f/d64/c130 0 2024-09-18T12:49:26.806 INFO:tasks.workunit.client.1.smithi148.stdout:5/929: readlink d7/d8/dc/d12/d20/df3/l46 0 2024-09-18T12:49:26.806 INFO:tasks.workunit.client.1.smithi148.stdout:3/847: creat d4/d8/d1e/d63/d10b/f127 x:0 0 0 2024-09-18T12:49:26.808 INFO:tasks.workunit.client.1.smithi148.stdout:1/926: rename dc/d18/d7d/d7e to dc/d18/d31/d4b/d8d/d8f/d132 0 2024-09-18T12:49:26.810 INFO:tasks.workunit.client.1.smithi148.stdout:7/890: mknod db/dc/c110 0 2024-09-18T12:49:26.810 INFO:tasks.workunit.client.1.smithi148.stdout:7/891: chown db/dc/df/cca 59106 1 2024-09-18T12:49:26.817 INFO:tasks.workunit.client.0.smithi078.stdout:8/570: creat d0/d7/d53/d57/fb2 x:0 0 0 2024-09-18T12:49:26.820 INFO:tasks.workunit.client.0.smithi078.stdout:8/571: symlink d0/d39/d4c/d77/d7d/lb3 0 2024-09-18T12:49:26.823 INFO:tasks.workunit.client.0.smithi078.stdout:8/572: symlink d0/d7/d53/d57/d5c/d88/lb4 0 2024-09-18T12:49:26.828 INFO:tasks.workunit.client.0.smithi078.stdout:8/573: getdents d0/d7/d53 0 2024-09-18T12:49:26.829 INFO:tasks.workunit.client.0.smithi078.stdout:8/574: write d0/d7/fb [2474754,38354] 0 2024-09-18T12:49:26.832 INFO:tasks.workunit.client.0.smithi078.stdout:8/575: creat d0/d39/d4c/d77/fb5 x:0 0 0 2024-09-18T12:49:26.833 INFO:tasks.workunit.client.0.smithi078.stdout:8/576: read - d0/d7/d53/d57/fb2 zero size 2024-09-18T12:49:26.836 INFO:tasks.workunit.client.0.smithi078.stdout:8/577: chown d0/d7/dc/d1f/d6f/l8a 0 1 2024-09-18T12:49:26.841 INFO:tasks.workunit.client.1.smithi148.stdout:8/990: mknod d8/df/d66/c155 0 2024-09-18T12:49:26.842 INFO:tasks.workunit.client.1.smithi148.stdout:4/917: fsync d15/d17/d52/fdd 0 2024-09-18T12:49:26.842 INFO:tasks.workunit.client.1.smithi148.stdout:8/991: readlink d8/d16/d27/dc5/dee/l105 0 2024-09-18T12:49:26.843 INFO:tasks.workunit.client.0.smithi078.stdout:8/578: dread d0/d7/d53/d57/d5c/d88/fac [0,4194304] 0 2024-09-18T12:49:26.844 INFO:tasks.workunit.client.1.smithi148.stdout:1/927: mknod dc/d5b/da5/c133 0 2024-09-18T12:49:26.844 INFO:tasks.workunit.client.1.smithi148.stdout:4/918: write d15/d17/d52/d92/d4c/d4f/d64/d9a/fee [818408,105022] 0 2024-09-18T12:49:26.847 INFO:tasks.workunit.client.1.smithi148.stdout:5/930: mkdir d7/d8/dc/d137 0 2024-09-18T12:49:26.851 INFO:tasks.workunit.client.1.smithi148.stdout:3/848: fsync d4/d8/d20/d2b/d7f/d93/d94/dac/fe3 0 2024-09-18T12:49:26.852 INFO:tasks.workunit.client.1.smithi148.stdout:5/931: dwrite d7/d8/f9d [0,4194304] 0 2024-09-18T12:49:26.854 INFO:tasks.workunit.client.1.smithi148.stdout:5/932: write d7/d8/f87 [867977,31033] 0 2024-09-18T12:49:26.854 INFO:tasks.workunit.client.0.smithi078.stdout:8/579: dread d0/d39/d4c/d77/d7d/d52/d62/f81 [0,4194304] 0 2024-09-18T12:49:26.856 INFO:tasks.workunit.client.1.smithi148.stdout:8/992: truncate d8/d12/d46/f5a 1949336 0 2024-09-18T12:49:26.860 INFO:tasks.workunit.client.1.smithi148.stdout:7/892: symlink db/d52/d4f/l111 0 2024-09-18T12:49:26.862 INFO:tasks.workunit.client.1.smithi148.stdout:9/905: link d8/da/dd/d77/cf2 d8/da/dd/d77/dd8/c114 0 2024-09-18T12:49:26.863 INFO:tasks.workunit.client.1.smithi148.stdout:7/893: write db/dc/df/d2c/d66/da0/f109 [1023977,22057] 0 2024-09-18T12:49:26.863 INFO:tasks.workunit.client.1.smithi148.stdout:8/993: creat d8/d12/d51/d94/f156 x:0 0 0 2024-09-18T12:49:26.864 INFO:tasks.workunit.client.1.smithi148.stdout:3/849: dwrite d4/d8/d20/d2b/d43/fa4 [4194304,4194304] 0 2024-09-18T12:49:26.864 INFO:tasks.workunit.client.1.smithi148.stdout:5/933: truncate d7/d8/dc/da6/dee/d39/dc2/fe9 1035099 0 2024-09-18T12:49:26.865 INFO:tasks.workunit.client.1.smithi148.stdout:9/906: fdatasync d8/da/dd/d35/d47/d62/d72/f74 0 2024-09-18T12:49:26.867 INFO:tasks.workunit.client.1.smithi148.stdout:3/850: fsync d4/d8/d1e/d63/d9b/f116 0 2024-09-18T12:49:26.870 INFO:tasks.workunit.client.1.smithi148.stdout:9/907: write d8/da/dd/d77/ff0 [349507,1890] 0 2024-09-18T12:49:26.870 INFO:tasks.workunit.client.1.smithi148.stdout:3/851: readlink d4/d8/d1e/d79/d92/l7d 0 2024-09-18T12:49:26.874 INFO:tasks.workunit.client.1.smithi148.stdout:7/894: rename db/dc/df/d1d/d68/f87 to db/dc/df/d11/dcc/d10b/f112 0 2024-09-18T12:49:26.876 INFO:tasks.workunit.client.1.smithi148.stdout:3/852: dread - d4/d8/d20/d2b/d7f/dd9/fea zero size 2024-09-18T12:49:26.880 INFO:tasks.workunit.client.1.smithi148.stdout:7/895: mkdir db/dc/df/d2c/d66/da0/d113 0 2024-09-18T12:49:26.883 INFO:tasks.workunit.client.1.smithi148.stdout:9/908: symlink d8/da/dd/d35/d81/dc6/dcc/de0/d101/l115 0 2024-09-18T12:49:26.883 INFO:tasks.workunit.client.1.smithi148.stdout:6/930: dread d5/fdf [0,4194304] 0 2024-09-18T12:49:26.883 INFO:tasks.workunit.client.1.smithi148.stdout:8/994: truncate d8/d16/d27/dc5/dee/f117 858893 0 2024-09-18T12:49:26.885 INFO:tasks.workunit.client.1.smithi148.stdout:9/909: write d8/da/dd/d4a/d49/fca [907913,88128] 0 2024-09-18T12:49:26.890 INFO:tasks.workunit.client.1.smithi148.stdout:4/919: dread d15/f2d [0,4194304] 0 2024-09-18T12:49:26.891 INFO:tasks.workunit.client.1.smithi148.stdout:3/853: rename d4/lb1 to d4/d8/d1e/d6b/d31/d46/d10c/l128 0 2024-09-18T12:49:26.892 INFO:tasks.workunit.client.1.smithi148.stdout:8/995: symlink d8/df/d3e/d82/de9/l157 0 2024-09-18T12:49:26.893 INFO:tasks.workunit.client.0.smithi078.stdout:8/580: mkdir d0/d7/dc/d71/d9b/db6 0 2024-09-18T12:49:26.897 INFO:tasks.workunit.client.1.smithi148.stdout:4/920: read d15/d17/d52/d92/d4c/f5b [500756,94797] 0 2024-09-18T12:49:26.898 INFO:tasks.workunit.client.1.smithi148.stdout:3/854: dread d4/d8/d20/d2b/d7f/d93/d94/f9a [0,4194304] 0 2024-09-18T12:49:26.900 INFO:tasks.workunit.client.0.smithi078.stdout:8/581: rename d0/d39/d4c/d77/d7d/d52 to d0/db7 0 2024-09-18T12:49:26.900 INFO:tasks.workunit.client.1.smithi148.stdout:3/855: write d4/d8/d1e/d6b/d31/f105 [793786,99430] 0 2024-09-18T12:49:26.901 INFO:tasks.workunit.client.1.smithi148.stdout:3/856: write d4/d8/d20/d2b/fb4 [3199900,32231] 0 2024-09-18T12:49:26.906 INFO:tasks.workunit.client.0.smithi078.stdout:8/582: creat d0/d7/d1e/d4b/fb8 x:0 0 0 2024-09-18T12:49:26.906 INFO:tasks.workunit.client.0.smithi078.stdout:8/583: fdatasync d0/d7/d1e/d4b/fb8 0 2024-09-18T12:49:26.909 INFO:tasks.workunit.client.1.smithi148.stdout:3/857: unlink d4/d8/d20/ld6 0 2024-09-18T12:49:26.909 INFO:tasks.workunit.client.1.smithi148.stdout:8/996: link d8/d12/d51/dc7/lf6 d8/d16/d27/dc5/dee/dfe/df3/l158 0 2024-09-18T12:49:26.910 INFO:tasks.workunit.client.1.smithi148.stdout:3/858: fsync d4/d8/d20/d2b/fe7 0 2024-09-18T12:49:26.911 INFO:tasks.workunit.client.1.smithi148.stdout:3/859: write d4/d8/d20/d2b/d43/fa4 [4620393,91329] 0 2024-09-18T12:49:26.912 INFO:tasks.workunit.client.1.smithi148.stdout:8/997: read d8/df/db2/fc3 [45709,19197] 0 2024-09-18T12:49:26.916 INFO:tasks.workunit.client.1.smithi148.stdout:8/998: creat d8/df/d3e/d82/f159 x:0 0 0 2024-09-18T12:49:26.917 INFO:tasks.workunit.client.1.smithi148.stdout:5/934: write d7/d8/d18/d3f/f70 [144383,112470] 0 2024-09-18T12:49:26.918 INFO:tasks.workunit.client.1.smithi148.stdout:3/860: link d4/d8/c6d d4/d8/d1e/d6b/d31/d60/da9/d8b/c129 0 2024-09-18T12:49:26.918 INFO:tasks.workunit.client.1.smithi148.stdout:8/999: write d8/d16/d27/dc5/dee/dfe/df3/d11e/f126 [259275,3966] 0 2024-09-18T12:49:26.919 INFO:tasks.workunit.client.1.smithi148.stdout:5/935: chown d7/d8/dc/da6/dee/d69/fe1 36578727 1 2024-09-18T12:49:26.919 INFO:tasks.workunit.client.1.smithi148.stdout:3/861: write d4/ffc [167742,92724] 0 2024-09-18T12:49:26.921 INFO:tasks.workunit.client.1.smithi148.stdout:5/936: write d7/d8/dc/da6/dee/d39/dc2/dd2/f10e [203821,93590] 0 2024-09-18T12:49:26.923 INFO:tasks.workunit.client.1.smithi148.stdout:3/862: mkdir d4/d8/d20/d2b/d7f/d93/d94/d12a 0 2024-09-18T12:49:26.924 INFO:tasks.workunit.client.1.smithi148.stdout:5/937: unlink d7/d8/dc/da6/dee/d25/d4b/dae/l10b 0 2024-09-18T12:49:26.929 INFO:tasks.workunit.client.1.smithi148.stdout:3/863: dwrite d4/d8/d20/f115 [0,4194304] 0 2024-09-18T12:49:26.931 INFO:tasks.workunit.client.1.smithi148.stdout:3/864: fdatasync d4/d8/d20/d2b/d43/fa4 0 2024-09-18T12:49:26.931 INFO:tasks.workunit.client.1.smithi148.stdout:5/938: link d7/d8/f68 d7/d8/dc/d12/d134/f138 0 2024-09-18T12:49:26.932 INFO:tasks.workunit.client.1.smithi148.stdout:7/896: dwrite db/dc/df/d2c/d55/f73 [4194304,4194304] 0 2024-09-18T12:49:26.932 INFO:tasks.workunit.client.1.smithi148.stdout:9/910: write d8/da/dd/d35/d81/db7/fd4 [634449,119480] 0 2024-09-18T12:49:26.934 INFO:tasks.workunit.client.1.smithi148.stdout:6/931: write d5/d1a/d29/f83 [1903619,102524] 0 2024-09-18T12:49:26.937 INFO:tasks.workunit.client.1.smithi148.stdout:3/865: write d4/f29 [4196577,96709] 0 2024-09-18T12:49:26.940 INFO:tasks.workunit.client.0.smithi078.stdout:7/457: sync 2024-09-18T12:49:26.941 INFO:tasks.workunit.client.1.smithi148.stdout:5/939: mkdir d7/d8/dc/da6/dee/d39/d139 0 2024-09-18T12:49:26.942 INFO:tasks.workunit.client.1.smithi148.stdout:4/921: dwrite d15/f53 [0,4194304] 0 2024-09-18T12:49:26.943 INFO:tasks.workunit.client.1.smithi148.stdout:6/932: fdatasync d5/d32/d56/fbe 0 2024-09-18T12:49:26.944 INFO:tasks.workunit.client.1.smithi148.stdout:3/866: dread d4/d8/d1e/d6b/d31/d60/f6e [0,4194304] 0 2024-09-18T12:49:26.945 INFO:tasks.workunit.client.1.smithi148.stdout:4/922: fsync d15/d5f/d69/d7f/d94/f107 0 2024-09-18T12:49:26.946 INFO:tasks.workunit.client.1.smithi148.stdout:4/923: fsync d15/d17/d52/d92/d4c/dd0/fea 0 2024-09-18T12:49:26.947 INFO:tasks.workunit.client.0.smithi078.stdout:8/584: truncate d0/d7/dc/d1f/d23/f9a 2366354 0 2024-09-18T12:49:26.950 INFO:tasks.workunit.client.0.smithi078.stdout:8/585: read d0/d7/dc/f26 [6593472,21187] 0 2024-09-18T12:49:26.950 INFO:tasks.workunit.client.1.smithi148.stdout:7/897: symlink db/dc/df/d1d/d68/d82/df3/l114 0 2024-09-18T12:49:26.950 INFO:tasks.workunit.client.1.smithi148.stdout:7/898: fsync db/fc4 0 2024-09-18T12:49:26.956 INFO:tasks.workunit.client.0.smithi078.stdout:8/586: mknod d0/d7/dc/d71/cb9 0 2024-09-18T12:49:26.957 INFO:tasks.workunit.client.1.smithi148.stdout:5/940: truncate d7/d8/dc/da6/dee/d69/d8b/dad/fe6 908549 0 2024-09-18T12:49:26.958 INFO:tasks.workunit.client.0.smithi078.stdout:7/458: creat d7/d9/d32/fa0 x:0 0 0 2024-09-18T12:49:26.958 INFO:tasks.workunit.client.0.smithi078.stdout:8/587: read d0/d7/d1e/da9/f7a [3432877,80076] 0 2024-09-18T12:49:26.959 INFO:tasks.workunit.client.1.smithi148.stdout:7/899: chown db/lbf 0 1 2024-09-18T12:49:26.960 INFO:tasks.workunit.client.1.smithi148.stdout:9/911: dread d8/d73/fc8 [0,4194304] 0 2024-09-18T12:49:26.960 INFO:tasks.workunit.client.0.smithi078.stdout:8/588: chown d0/d7/d1e/d50/c6e 22597183 1 2024-09-18T12:49:26.961 INFO:tasks.workunit.client.1.smithi148.stdout:4/924: unlink lf 0 2024-09-18T12:49:26.963 INFO:tasks.workunit.client.0.smithi078.stdout:8/589: write d0/f8d [3052462,127969] 0 2024-09-18T12:49:26.966 INFO:tasks.workunit.client.1.smithi148.stdout:3/867: mknod d4/d8/d20/d99/dfd/d113/c12b 0 2024-09-18T12:49:26.967 INFO:tasks.workunit.client.1.smithi148.stdout:9/912: dwrite d8/d73/fda [0,4194304] 0 2024-09-18T12:49:26.967 INFO:tasks.workunit.client.1.smithi148.stdout:3/868: chown d4/d8/d1e/d63 7301 1 2024-09-18T12:49:26.967 INFO:tasks.workunit.client.1.smithi148.stdout:4/925: unlink d15/d17/d52/d92/d4c/dd0/c119 0 2024-09-18T12:49:26.969 INFO:tasks.workunit.client.1.smithi148.stdout:3/869: readlink d4/d8/d20/d2b/d7f/d93/lb6 0 2024-09-18T12:49:26.970 INFO:tasks.workunit.client.0.smithi078.stdout:8/590: dread d0/d39/d4c/d77/d7d/fa6 [0,4194304] 0 2024-09-18T12:49:26.970 INFO:tasks.workunit.client.1.smithi148.stdout:3/870: stat d4/d8/d1e/d79/l85 0 2024-09-18T12:49:26.971 INFO:tasks.workunit.client.0.smithi078.stdout:8/591: truncate d0/db7/d62/f91 365962 0 2024-09-18T12:49:26.972 INFO:tasks.workunit.client.1.smithi148.stdout:5/941: dread d7/d8/dc/da6/dee/f2c [0,4194304] 0 2024-09-18T12:49:26.973 INFO:tasks.workunit.client.1.smithi148.stdout:9/913: rename d8/da/dd/d35/d81/dc6/f108 to d8/da/dd/d35/d81/dc6/dcc/f116 0 2024-09-18T12:49:26.976 INFO:tasks.workunit.client.1.smithi148.stdout:4/926: symlink d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d10b/l131 0 2024-09-18T12:49:26.976 INFO:tasks.workunit.client.1.smithi148.stdout:5/942: chown d7/d8/d18/d3f/d7c/d7d/la2 95570092 1 2024-09-18T12:49:26.977 INFO:tasks.workunit.client.1.smithi148.stdout:5/943: chown d7/d8/d18/f103 29102 1 2024-09-18T12:49:26.977 INFO:tasks.workunit.client.1.smithi148.stdout:3/871: mkdir d4/d8/d20/d2b/d7f/d93/dd1/d12c 0 2024-09-18T12:49:26.977 INFO:tasks.workunit.client.1.smithi148.stdout:9/914: mknod d8/da/dd/d65/db9/c117 0 2024-09-18T12:49:26.980 INFO:tasks.workunit.client.0.smithi078.stdout:8/592: dwrite d0/d39/d4c/d77/fb5 [0,4194304] 0 2024-09-18T12:49:26.988 INFO:tasks.workunit.client.1.smithi148.stdout:9/915: mknod d8/da/dd/d35/d81/dc6/dcc/c118 0 2024-09-18T12:49:26.990 INFO:tasks.workunit.client.1.smithi148.stdout:5/944: unlink d7/l115 0 2024-09-18T12:49:26.991 INFO:tasks.workunit.client.0.smithi078.stdout:8/593: mknod d0/d7/d53/d57/cba 0 2024-09-18T12:49:26.994 INFO:tasks.workunit.client.0.smithi078.stdout:8/594: symlink d0/d7/d1e/lbb 0 2024-09-18T12:49:26.999 INFO:tasks.workunit.client.1.smithi148.stdout:3/872: creat d4/d8/d20/f12d x:0 0 0 2024-09-18T12:49:27.003 INFO:tasks.workunit.client.1.smithi148.stdout:5/945: mknod d7/d8/dc/da6/dee/d39/d139/c13a 0 2024-09-18T12:49:27.005 INFO:tasks.workunit.client.1.smithi148.stdout:4/927: link d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/f12c d15/d17/d52/d92/d4c/dd0/dd6/f132 0 2024-09-18T12:49:27.006 INFO:tasks.workunit.client.1.smithi148.stdout:3/873: mkdir d4/d8/d1e/d6b/d31/d60/da9/d12e 0 2024-09-18T12:49:27.010 INFO:tasks.workunit.client.1.smithi148.stdout:6/933: truncate d5/d1a/d29/f113 567669 0 2024-09-18T12:49:27.012 INFO:tasks.workunit.client.0.smithi078.stdout:7/459: write d7/d9/d14/d22/d3e/d95/d97/f7f [962624,52801] 0 2024-09-18T12:49:27.012 INFO:tasks.workunit.client.1.smithi148.stdout:7/900: write db/dc/df/d1d/d68/d7a/f9d [1046226,71292] 0 2024-09-18T12:49:27.013 INFO:tasks.workunit.client.1.smithi148.stdout:6/934: fdatasync d5/d1a/dc/d2b/d35/f72 0 2024-09-18T12:49:27.019 INFO:tasks.workunit.client.1.smithi148.stdout:6/935: mkdir d5/d32/d38/df0/d130 0 2024-09-18T12:49:27.023 INFO:tasks.workunit.client.1.smithi148.stdout:7/901: getdents db/dc/df/d2c 0 2024-09-18T12:49:27.024 INFO:tasks.workunit.client.1.smithi148.stdout:6/936: dread d5/d1a/dc/d2b/d35/f10d [0,4194304] 0 2024-09-18T12:49:27.024 INFO:tasks.workunit.client.1.smithi148.stdout:4/928: dread d15/d17/d52/d92/d4c/fd9 [0,4194304] 0 2024-09-18T12:49:27.025 INFO:tasks.workunit.client.1.smithi148.stdout:7/902: stat db/dc/df/d2c/f7e 0 2024-09-18T12:49:27.025 INFO:tasks.workunit.client.1.smithi148.stdout:3/874: dread d4/d8/d1e/d6b/d31/d54/f67 [0,4194304] 0 2024-09-18T12:49:27.027 INFO:tasks.workunit.client.1.smithi148.stdout:6/937: chown d5/d1a/dc/f12b 1137708 1 2024-09-18T12:49:27.027 INFO:tasks.workunit.client.1.smithi148.stdout:4/929: fdatasync d15/d3f/f8f 0 2024-09-18T12:49:27.028 INFO:tasks.workunit.client.1.smithi148.stdout:7/903: rmdir db/dc 39 2024-09-18T12:49:27.029 INFO:tasks.workunit.client.1.smithi148.stdout:9/916: truncate d8/da/dd/d4a/f98 2406861 0 2024-09-18T12:49:27.030 INFO:tasks.workunit.client.1.smithi148.stdout:3/875: symlink d4/d8/d1e/d63/l12f 0 2024-09-18T12:49:27.030 INFO:tasks.workunit.client.1.smithi148.stdout:9/917: chown d8/da/dd/d4a/d49/d46/d54/l112 32227 1 2024-09-18T12:49:27.030 INFO:tasks.workunit.client.1.smithi148.stdout:6/938: rmdir d5/d32/d38 39 2024-09-18T12:49:27.034 INFO:tasks.workunit.client.1.smithi148.stdout:5/946: truncate d7/fd 1402753 0 2024-09-18T12:49:27.034 INFO:tasks.workunit.client.1.smithi148.stdout:5/947: readlink d7/d8/l71 0 2024-09-18T12:49:27.037 INFO:tasks.workunit.client.1.smithi148.stdout:2/826: sync 2024-09-18T12:49:27.037 INFO:tasks.workunit.client.1.smithi148.stdout:6/939: fsync d5/d1a/dc/d2b/d9b/f9e 0 2024-09-18T12:49:27.039 INFO:tasks.workunit.client.1.smithi148.stdout:7/904: mkdir db/dc/df/d11/d34/d69/d115 0 2024-09-18T12:49:27.040 INFO:tasks.workunit.client.1.smithi148.stdout:6/940: dread - d5/d1a/dc/d101/da3/ffc zero size 2024-09-18T12:49:27.040 INFO:tasks.workunit.client.1.smithi148.stdout:3/876: mknod d4/d8/d6a/db3/c130 0 2024-09-18T12:49:27.041 INFO:tasks.workunit.client.0.smithi078.stdout:7/460: write d7/d26/f80 [432139,13050] 0 2024-09-18T12:49:27.042 INFO:tasks.workunit.client.1.smithi148.stdout:5/948: dwrite d7/d8/d18/d3f/f70 [0,4194304] 0 2024-09-18T12:49:27.045 INFO:tasks.workunit.client.1.smithi148.stdout:3/877: write d4/d8/d20/d2b/fe7 [625526,118396] 0 2024-09-18T12:49:27.045 INFO:tasks.workunit.client.1.smithi148.stdout:2/827: mkdir d9/d24/d67/dc7/dce/d11a 0 2024-09-18T12:49:27.045 INFO:tasks.workunit.client.0.smithi078.stdout:7/461: readlink d7/d5d/d7a/l72 0 2024-09-18T12:49:27.046 INFO:tasks.workunit.client.1.smithi148.stdout:5/949: fdatasync d7/d8/f59 0 2024-09-18T12:49:27.049 INFO:tasks.workunit.client.1.smithi148.stdout:4/930: write d15/d17/d52/d92/f46 [3012456,44739] 0 2024-09-18T12:49:27.051 INFO:tasks.workunit.client.0.smithi078.stdout:7/462: unlink d7/d9/d14/c37 0 2024-09-18T12:49:27.051 INFO:tasks.workunit.client.1.smithi148.stdout:6/941: dwrite d5/d32/d56/fde [0,4194304] 0 2024-09-18T12:49:27.051 INFO:tasks.workunit.client.0.smithi078.stdout:7/463: readlink d7/d9/l43 0 2024-09-18T12:49:27.054 INFO:tasks.workunit.client.1.smithi148.stdout:4/931: dread d15/d17/f115 [0,4194304] 0 2024-09-18T12:49:27.055 INFO:tasks.workunit.client.0.smithi078.stdout:7/464: fdatasync d7/d26/d4f/f50 0 2024-09-18T12:49:27.060 INFO:tasks.workunit.client.1.smithi148.stdout:9/918: write d8/da/dd/d3f/f9c [109394,30399] 0 2024-09-18T12:49:27.061 INFO:tasks.workunit.client.1.smithi148.stdout:2/828: creat d9/d24/d67/d72/d107/f11b x:0 0 0 2024-09-18T12:49:27.062 INFO:tasks.workunit.client.1.smithi148.stdout:2/829: fdatasync d9/d17/d29/d92/d95/f38 0 2024-09-18T12:49:27.063 INFO:tasks.workunit.client.0.smithi078.stdout:7/465: rename d7/d26/f80 to d7/d26/d84/fa1 0 2024-09-18T12:49:27.065 INFO:tasks.workunit.client.1.smithi148.stdout:7/905: dread db/dc/df/d11/f47 [0,4194304] 0 2024-09-18T12:49:27.071 INFO:tasks.workunit.client.1.smithi148.stdout:3/878: fsync d4/d8/d1e/d6b/d31/d60/d107/f11f 0 2024-09-18T12:49:27.072 INFO:tasks.workunit.client.0.smithi078.stdout:7/466: link d7/d5d/c82 d7/d5d/d87/ca2 0 2024-09-18T12:49:27.075 INFO:tasks.workunit.client.0.smithi078.stdout:7/467: symlink d7/d3f/la3 0 2024-09-18T12:49:27.076 INFO:tasks.workunit.client.1.smithi148.stdout:2/830: fsync d9/d73/fa8 0 2024-09-18T12:49:27.076 INFO:tasks.workunit.client.1.smithi148.stdout:6/942: write d5/d1a/dc/d2b/d35/f72 [1601217,37473] 0 2024-09-18T12:49:27.079 INFO:tasks.workunit.client.1.smithi148.stdout:7/906: creat db/dc/df/d2c/de1/f116 x:0 0 0 2024-09-18T12:49:27.079 INFO:tasks.workunit.client.1.smithi148.stdout:7/907: chown db/dc 0 1 2024-09-18T12:49:27.080 INFO:tasks.workunit.client.1.smithi148.stdout:4/932: mknod d15/c133 0 2024-09-18T12:49:27.082 INFO:tasks.workunit.client.1.smithi148.stdout:5/950: creat d7/d8/f13b x:0 0 0 2024-09-18T12:49:27.084 INFO:tasks.workunit.client.1.smithi148.stdout:9/919: rename d8/da/dd/d35/d59/l66 to d8/d73/l119 0 2024-09-18T12:49:27.085 INFO:tasks.workunit.client.1.smithi148.stdout:2/831: creat d9/d17/d29/d92/d95/f11c x:0 0 0 2024-09-18T12:49:27.085 INFO:tasks.workunit.client.1.smithi148.stdout:1/928: sync 2024-09-18T12:49:27.087 INFO:tasks.workunit.client.0.smithi078.stdout:7/468: dwrite d7/f1b [0,4194304] 0 2024-09-18T12:49:27.087 INFO:tasks.workunit.client.1.smithi148.stdout:3/879: symlink d4/d8/d1e/l131 0 2024-09-18T12:49:27.088 INFO:tasks.workunit.client.1.smithi148.stdout:4/933: dread d15/d17/d52/d92/d4c/d4f/f29 [4194304,4194304] 0 2024-09-18T12:49:27.089 INFO:tasks.workunit.client.1.smithi148.stdout:6/943: rename d5/d1a/dc/dbf/l119 to d5/d32/d56/dfb/l131 0 2024-09-18T12:49:27.091 INFO:tasks.workunit.client.0.smithi078.stdout:7/469: read d7/d9/f1f [173540,38464] 0 2024-09-18T12:49:27.092 INFO:tasks.workunit.client.1.smithi148.stdout:2/832: creat d9/d24/d31/d9d/f11d x:0 0 0 2024-09-18T12:49:27.094 INFO:tasks.workunit.client.1.smithi148.stdout:9/920: dwrite d8/da/dd/d35/d81/f9e [0,4194304] 0 2024-09-18T12:49:27.095 INFO:tasks.workunit.client.1.smithi148.stdout:1/929: dwrite dc/d51/f11e [0,4194304] 0 2024-09-18T12:49:27.095 INFO:tasks.workunit.client.0.smithi078.stdout:7/470: truncate d7/f33 2888391 0 2024-09-18T12:49:27.096 INFO:tasks.workunit.client.1.smithi148.stdout:3/880: rmdir d4/d8/d6a/db3/db7/dcb 39 2024-09-18T12:49:27.098 INFO:tasks.workunit.client.0.smithi078.stdout:7/471: unlink d7/d9/lf 0 2024-09-18T12:49:27.102 INFO:tasks.workunit.client.1.smithi148.stdout:4/934: symlink d15/d5f/l134 0 2024-09-18T12:49:27.103 INFO:tasks.workunit.client.1.smithi148.stdout:9/921: creat d8/da/dd/d35/d47/d62/f11a x:0 0 0 2024-09-18T12:49:27.103 INFO:tasks.workunit.client.1.smithi148.stdout:1/930: dwrite f6 [0,4194304] 0 2024-09-18T12:49:27.105 INFO:tasks.workunit.client.1.smithi148.stdout:4/935: stat d15/d17/d52/d92/d4c/d4f/d64/d9a/fee 0 2024-09-18T12:49:27.105 INFO:tasks.workunit.client.1.smithi148.stdout:3/881: mknod d4/d8/d20/d2b/d7f/c132 0 2024-09-18T12:49:27.108 INFO:tasks.workunit.client.0.smithi078.stdout:7/472: unlink d7/d9/d14/d22/d35/d49/d56/f68 0 2024-09-18T12:49:27.111 INFO:tasks.workunit.client.1.smithi148.stdout:4/936: symlink d15/d17/d52/d92/d4c/d4f/d34/l135 0 2024-09-18T12:49:27.112 INFO:tasks.workunit.client.1.smithi148.stdout:4/937: stat d15/d17/d52/d92/d4c/d4f/d34/f12a 0 2024-09-18T12:49:27.113 INFO:tasks.workunit.client.0.smithi078.stdout:7/473: chown d7/d9/d14/f23 1528757 1 2024-09-18T12:49:27.114 INFO:tasks.workunit.client.1.smithi148.stdout:3/882: rmdir d4/d8/d6a/db3 39 2024-09-18T12:49:27.115 INFO:tasks.workunit.client.1.smithi148.stdout:3/883: readlink d4/d8/d1e/d6b/d31/d60/da9/la7 0 2024-09-18T12:49:27.120 INFO:tasks.workunit.client.1.smithi148.stdout:9/922: getdents d8/da/dd/d35/d47 0 2024-09-18T12:49:27.123 INFO:tasks.workunit.client.1.smithi148.stdout:5/951: write d7/d8/dc/da6/dee/d25/d4b/dbd/ff0 [130517,130060] 0 2024-09-18T12:49:27.123 INFO:tasks.workunit.client.1.smithi148.stdout:9/923: write f6 [7508483,85255] 0 2024-09-18T12:49:27.126 INFO:tasks.workunit.client.1.smithi148.stdout:2/833: write d9/d24/f28 [468784,63203] 0 2024-09-18T12:49:27.127 INFO:tasks.workunit.client.1.smithi148.stdout:9/924: stat d8/d73/lad 0 2024-09-18T12:49:27.129 INFO:tasks.workunit.client.1.smithi148.stdout:7/908: dwrite db/dc/df/d11/ddc/d75/f56 [0,4194304] 0 2024-09-18T12:49:27.130 INFO:tasks.workunit.client.1.smithi148.stdout:4/938: dwrite d15/d17/d52/d92/d4c/d4f/f9c [0,4194304] 0 2024-09-18T12:49:27.137 INFO:tasks.workunit.client.1.smithi148.stdout:7/909: chown db/dc/df/l7f 204183774 1 2024-09-18T12:49:27.137 INFO:tasks.workunit.client.1.smithi148.stdout:9/925: creat d8/da/dd/d4a/d49/f11b x:0 0 0 2024-09-18T12:49:27.142 INFO:tasks.workunit.client.1.smithi148.stdout:6/944: dwrite d5/d32/f58 [0,4194304] 0 2024-09-18T12:49:27.142 INFO:tasks.workunit.client.1.smithi148.stdout:4/939: mkdir d15/de9/d136 0 2024-09-18T12:49:27.143 INFO:tasks.workunit.client.0.smithi078.stdout:7/474: dread d7/d9/d14/f25 [0,4194304] 0 2024-09-18T12:49:27.144 INFO:tasks.workunit.client.1.smithi148.stdout:2/834: dread d9/d17/d29/d92/d95/f38 [0,4194304] 0 2024-09-18T12:49:27.146 INFO:tasks.workunit.client.1.smithi148.stdout:5/952: getdents d7/d8/dc/da6/dee/d25/d4b/d102/d12a/d131 0 2024-09-18T12:49:27.147 INFO:tasks.workunit.client.0.smithi078.stdout:7/475: creat d7/d9/d14/d22/d35/d49/d61/d89/fa4 x:0 0 0 2024-09-18T12:49:27.147 INFO:tasks.workunit.client.1.smithi148.stdout:5/953: read d7/d2b/f120 [379318,65300] 0 2024-09-18T12:49:27.148 INFO:tasks.workunit.client.1.smithi148.stdout:2/835: write d9/d24/f28 [1754681,9688] 0 2024-09-18T12:49:27.148 INFO:tasks.workunit.client.0.smithi078.stdout:7/476: stat d7/d5d/d7a/f5c 0 2024-09-18T12:49:27.148 INFO:tasks.workunit.client.1.smithi148.stdout:9/926: chown d8/da/dd/d65/la2 1762594 1 2024-09-18T12:49:27.150 INFO:tasks.workunit.client.1.smithi148.stdout:5/954: readlink d7/d8/dc/da6/dee/l42 0 2024-09-18T12:49:27.150 INFO:tasks.workunit.client.1.smithi148.stdout:4/940: dread d15/d90/fbe [0,4194304] 0 2024-09-18T12:49:27.153 INFO:tasks.workunit.client.1.smithi148.stdout:6/945: creat d5/d1a/dc/d2b/d35/d65/f132 x:0 0 0 2024-09-18T12:49:27.160 INFO:tasks.workunit.client.1.smithi148.stdout:2/836: rename d9/f16 to d9/d24/d67/df0/f11e 0 2024-09-18T12:49:27.161 INFO:tasks.workunit.client.1.smithi148.stdout:4/941: dwrite d15/d17/d52/d92/d4c/dd0/dd6/fe2 [0,4194304] 0 2024-09-18T12:49:27.163 INFO:tasks.workunit.client.1.smithi148.stdout:6/946: dwrite d5/d32/d56/d116/f12a [0,4194304] 0 2024-09-18T12:49:27.165 INFO:tasks.workunit.client.1.smithi148.stdout:2/837: write d9/d24/d31/d9d/f100 [1033389,121707] 0 2024-09-18T12:49:27.169 INFO:tasks.workunit.client.1.smithi148.stdout:6/947: truncate f3 2138995 0 2024-09-18T12:49:27.170 INFO:tasks.workunit.client.1.smithi148.stdout:7/910: dwrite db/dc/df/d1d/f5c [4194304,4194304] 0 2024-09-18T12:49:27.173 INFO:tasks.workunit.client.1.smithi148.stdout:4/942: rmdir d15/d17/d52/d92/dc9/d128 0 2024-09-18T12:49:27.174 INFO:tasks.workunit.client.1.smithi148.stdout:7/911: dread - db/dc/df/d1d/d68/d82/ff2 zero size 2024-09-18T12:49:27.175 INFO:tasks.workunit.client.0.smithi078.stdout:7/477: dread d7/d9/d32/d3b/f45 [0,4194304] 0 2024-09-18T12:49:27.175 INFO:tasks.workunit.client.1.smithi148.stdout:5/955: dwrite d7/d8/dc/da6/dee/d69/fab [4194304,4194304] 0 2024-09-18T12:49:27.179 INFO:tasks.workunit.client.0.smithi078.stdout:7/478: mknod d7/d9/d14/d22/d3e/d95/ca5 0 2024-09-18T12:49:27.182 INFO:tasks.workunit.client.1.smithi148.stdout:5/956: getdents d7/d8/dc/da6 0 2024-09-18T12:49:27.183 INFO:tasks.workunit.client.1.smithi148.stdout:5/957: stat d7/d8/dc/d12 0 2024-09-18T12:49:27.184 INFO:tasks.workunit.client.0.smithi078.stdout:7/479: truncate d7/d3f/f64 105060 0 2024-09-18T12:49:27.186 INFO:tasks.workunit.client.0.smithi078.stdout:7/480: dread - d7/d5d/d7a/d62/f8c zero size 2024-09-18T12:49:27.188 INFO:tasks.workunit.client.1.smithi148.stdout:5/958: getdents d7/d8/dc/da6/dee/d25/d4b/d102/d12a/d131 0 2024-09-18T12:49:27.192 INFO:tasks.workunit.client.1.smithi148.stdout:9/927: dread d8/da/dd/d4a/d49/d46/d54/dab/fd0 [0,4194304] 0 2024-09-18T12:49:27.194 INFO:tasks.workunit.client.1.smithi148.stdout:9/928: readlink d8/d73/l119 0 2024-09-18T12:49:27.194 INFO:tasks.workunit.client.0.smithi078.stdout:7/481: getdents d7/d5d 0 2024-09-18T12:49:27.195 INFO:tasks.workunit.client.0.smithi078.stdout:7/482: chown d7/d5d/f6d 34739 1 2024-09-18T12:49:27.195 INFO:tasks.workunit.client.1.smithi148.stdout:5/959: getdents d7/d8/dc/d12/d20 0 2024-09-18T12:49:27.196 INFO:tasks.workunit.client.1.smithi148.stdout:5/960: chown d7/d8/f13 19252 1 2024-09-18T12:49:27.198 INFO:tasks.workunit.client.1.smithi148.stdout:9/929: rename d8/da/dd/d3f/fb0 to d8/f11c 0 2024-09-18T12:49:27.199 INFO:tasks.workunit.client.1.smithi148.stdout:9/930: chown d8/da/dd/d4a/d49/d46/d54/d90/ce6 96 1 2024-09-18T12:49:27.200 INFO:tasks.workunit.client.1.smithi148.stdout:9/931: dread d8/da/dd/d3f/d5d/fed [0,4194304] 0 2024-09-18T12:49:27.201 INFO:tasks.workunit.client.0.smithi078.stdout:7/483: rename d7/f1b to d7/d9/d32/fa6 0 2024-09-18T12:49:27.227 INFO:tasks.workunit.client.1.smithi148.stdout:1/931: sync 2024-09-18T12:49:27.231 INFO:tasks.workunit.client.1.smithi148.stdout:5/961: link d7/d8/dc/da6/dee/d39/dd5/fdb d7/d8/dc/da6/dee/d25/d4b/d102/d12a/f13c 0 2024-09-18T12:49:27.232 INFO:tasks.workunit.client.0.smithi078.stdout:7/484: rename d7/d9/d14/f25 to d7/d5d/d7a/d62/fa7 0 2024-09-18T12:49:27.232 INFO:tasks.workunit.client.1.smithi148.stdout:4/943: dread d15/d5f/f71 [0,4194304] 0 2024-09-18T12:49:27.233 INFO:tasks.workunit.client.1.smithi148.stdout:9/932: mknod d8/da/dd/d77/dd8/c11d 0 2024-09-18T12:49:27.234 INFO:tasks.workunit.client.1.smithi148.stdout:1/932: truncate dc/d18/d7d/d93/f109 468317 0 2024-09-18T12:49:27.234 INFO:tasks.workunit.client.1.smithi148.stdout:9/933: dread - d8/da/dd/d4a/d49/ff3 zero size 2024-09-18T12:49:27.236 INFO:tasks.workunit.client.1.smithi148.stdout:1/933: mkdir dc/d18/d31/d4b/d8d/d134 0 2024-09-18T12:49:27.237 INFO:tasks.workunit.client.1.smithi148.stdout:1/934: write dc/d9f/ff2 [7659252,80372] 0 2024-09-18T12:49:27.239 INFO:tasks.workunit.client.1.smithi148.stdout:9/934: symlink d8/da/dd/d4a/d49/d46/d75/d97/l11e 0 2024-09-18T12:49:27.240 INFO:tasks.workunit.client.1.smithi148.stdout:1/935: creat dc/d18/d31/d4b/d8d/f135 x:0 0 0 2024-09-18T12:49:27.242 INFO:tasks.workunit.client.1.smithi148.stdout:5/962: rename d7/d8/dc/da6/dee/d25 to d7/d2b/d13d 0 2024-09-18T12:49:27.244 INFO:tasks.workunit.client.1.smithi148.stdout:9/935: creat d8/da/dd/d4a/f11f x:0 0 0 2024-09-18T12:49:27.244 INFO:tasks.workunit.client.1.smithi148.stdout:1/936: read dc/d18/d7d/d93/dd9/d2b/fce [12404,64585] 0 2024-09-18T12:49:27.247 INFO:tasks.workunit.client.1.smithi148.stdout:1/937: rename dc/d5b/da5 to dc/d18/d31/dc6/d110/d11c/d136 0 2024-09-18T12:49:27.248 INFO:tasks.workunit.client.1.smithi148.stdout:5/963: link d7/d2b/cda d7/d8/dc/da6/dee/d77/c13e 0 2024-09-18T12:49:27.249 INFO:tasks.workunit.client.1.smithi148.stdout:1/938: mknod dc/d18/d63/c137 0 2024-09-18T12:49:27.250 INFO:tasks.workunit.client.1.smithi148.stdout:1/939: readlink dc/d18/d7d/d93/dd9/l74 0 2024-09-18T12:49:27.250 INFO:tasks.workunit.client.1.smithi148.stdout:1/940: fdatasync dc/d51/f11e 0 2024-09-18T12:49:27.250 INFO:tasks.workunit.client.1.smithi148.stdout:5/964: mkdir d7/d8/dc/da6/dee/d77/dd4/d13f 0 2024-09-18T12:49:27.256 INFO:tasks.workunit.client.1.smithi148.stdout:1/941: getdents dc/d51 0 2024-09-18T12:49:27.256 INFO:tasks.workunit.client.1.smithi148.stdout:9/936: write d8/f11c [479957,117571] 0 2024-09-18T12:49:27.259 INFO:tasks.workunit.client.1.smithi148.stdout:1/942: write dc/f57 [2433698,116223] 0 2024-09-18T12:49:27.260 INFO:tasks.workunit.client.1.smithi148.stdout:9/937: mkdir d8/da/dd/d35/d81/dc6/dcc/d120 0 2024-09-18T12:49:27.262 INFO:tasks.workunit.client.1.smithi148.stdout:1/943: creat dc/d18/d7d/d93/dd9/d2b/d99/f138 x:0 0 0 2024-09-18T12:49:27.263 INFO:tasks.workunit.client.1.smithi148.stdout:5/965: dread d7/d8/dc/d12/d20/f53 [0,4194304] 0 2024-09-18T12:49:27.265 INFO:tasks.workunit.client.1.smithi148.stdout:1/944: read dc/f25 [1053357,89539] 0 2024-09-18T12:49:27.266 INFO:tasks.workunit.client.1.smithi148.stdout:9/938: rename d8/da/dd/d4a/d49/d46/d54/d90/cb4 to d8/da/dd/d4a/d49/d46/d54/dab/c121 0 2024-09-18T12:49:27.268 INFO:tasks.workunit.client.1.smithi148.stdout:1/945: creat dc/d18/d7d/d93/dd9/f139 x:0 0 0 2024-09-18T12:49:27.270 INFO:tasks.workunit.client.1.smithi148.stdout:5/966: dwrite d7/d8/dc/d12/d20/df3/f79 [0,4194304] 0 2024-09-18T12:49:27.284 INFO:tasks.workunit.client.1.smithi148.stdout:3/884: sync 2024-09-18T12:49:27.289 INFO:tasks.workunit.client.1.smithi148.stdout:9/939: dwrite d8/da/dd/d3f/d5d/f99 [0,4194304] 0 2024-09-18T12:49:27.291 INFO:tasks.workunit.client.1.smithi148.stdout:1/946: dwrite dc/d18/d31/d4b/db7/f122 [0,4194304] 0 2024-09-18T12:49:27.291 INFO:tasks.workunit.client.1.smithi148.stdout:5/967: dwrite d7/d8/dc/d12/d20/df3/f5f [0,4194304] 0 2024-09-18T12:49:27.292 INFO:tasks.workunit.client.1.smithi148.stdout:5/968: stat d7/d2b/fdd 0 2024-09-18T12:49:27.299 INFO:tasks.workunit.client.1.smithi148.stdout:1/947: creat dc/d18/d31/d4b/d8d/d8f/d132/f13a x:0 0 0 2024-09-18T12:49:27.300 INFO:tasks.workunit.client.1.smithi148.stdout:9/940: write d8/da/dd/d4a/f15 [2988986,96202] 0 2024-09-18T12:49:27.302 INFO:tasks.workunit.client.1.smithi148.stdout:3/885: dwrite d4/f11 [0,4194304] 0 2024-09-18T12:49:27.303 INFO:tasks.workunit.client.1.smithi148.stdout:1/948: write dc/d4d/f56 [3792578,33250] 0 2024-09-18T12:49:27.304 INFO:tasks.workunit.client.1.smithi148.stdout:1/949: stat dc/d11/d38/d72/df8 0 2024-09-18T12:49:27.305 INFO:tasks.workunit.client.1.smithi148.stdout:9/941: mkdir d8/da/dd/d35/d47/d4e/d122 0 2024-09-18T12:49:27.307 INFO:tasks.workunit.client.1.smithi148.stdout:1/950: write dc/d9f/df5/fd7 [3098736,26505] 0 2024-09-18T12:49:27.311 INFO:tasks.workunit.client.1.smithi148.stdout:5/969: dread d7/d8/f68 [0,4194304] 0 2024-09-18T12:49:27.312 INFO:tasks.workunit.client.1.smithi148.stdout:1/951: chown dc/d18/d31/dc6/d110/d11c/d136/l101 667015 1 2024-09-18T12:49:27.314 INFO:tasks.workunit.client.1.smithi148.stdout:2/838: sync 2024-09-18T12:49:27.314 INFO:tasks.workunit.client.1.smithi148.stdout:6/948: sync 2024-09-18T12:49:27.314 INFO:tasks.workunit.client.1.smithi148.stdout:5/970: mkdir d7/d2b/d13d/d4b/dbd/d140 0 2024-09-18T12:49:27.317 INFO:tasks.workunit.client.1.smithi148.stdout:1/952: unlink dc/d11/d96/fda 0 2024-09-18T12:49:27.319 INFO:tasks.workunit.client.1.smithi148.stdout:9/942: dwrite d8/da/dd/d35/d81/dc6/dcc/f116 [0,4194304] 0 2024-09-18T12:49:27.320 INFO:tasks.workunit.client.1.smithi148.stdout:2/839: symlink d9/d24/d47/l11f 0 2024-09-18T12:49:27.322 INFO:tasks.workunit.client.1.smithi148.stdout:5/971: mkdir d7/d8/dc/d12/d20/d141 0 2024-09-18T12:49:27.322 INFO:tasks.workunit.client.1.smithi148.stdout:1/953: creat dc/d4d/f13b x:0 0 0 2024-09-18T12:49:27.323 INFO:tasks.workunit.client.1.smithi148.stdout:6/949: creat d5/d32/d38/df0/df2/f133 x:0 0 0 2024-09-18T12:49:27.327 INFO:tasks.workunit.client.1.smithi148.stdout:3/886: dwrite d4/d8/d1e/d6b/d31/d60/f6e [0,4194304] 0 2024-09-18T12:49:27.328 INFO:tasks.workunit.client.1.smithi148.stdout:5/972: mkdir d7/d8/dc/da6/dee/d77/dd4/d142 0 2024-09-18T12:49:27.331 INFO:tasks.workunit.client.1.smithi148.stdout:6/950: creat d5/d32/d56/d116/f134 x:0 0 0 2024-09-18T12:49:27.332 INFO:tasks.workunit.client.1.smithi148.stdout:3/887: stat d4/d8/d1e/c27 0 2024-09-18T12:49:27.332 INFO:tasks.workunit.client.1.smithi148.stdout:9/943: write d8/da/f4d [213744,12654] 0 2024-09-18T12:49:27.333 INFO:tasks.workunit.client.1.smithi148.stdout:2/840: getdents d9/d24/d31/d9d/dcd 0 2024-09-18T12:49:27.335 INFO:tasks.workunit.client.1.smithi148.stdout:1/954: unlink dc/d18/c67 0 2024-09-18T12:49:27.335 INFO:tasks.workunit.client.1.smithi148.stdout:9/944: chown d8/da/dd/d3f/d5d/da0 12289090 1 2024-09-18T12:49:27.335 INFO:tasks.workunit.client.1.smithi148.stdout:3/888: stat d4/d8/d20/d2b/d7f/d93/dd1/lec 0 2024-09-18T12:49:27.338 INFO:tasks.workunit.client.1.smithi148.stdout:1/955: read - dc/d18/d31/d4b/d8d/d8f/d132/f13a zero size 2024-09-18T12:49:27.341 INFO:tasks.workunit.client.1.smithi148.stdout:3/889: read d4/f89 [4542303,100058] 0 2024-09-18T12:49:27.341 INFO:tasks.workunit.client.1.smithi148.stdout:5/973: dwrite d7/d8/d18/d3f/f112 [0,4194304] 0 2024-09-18T12:49:27.342 INFO:tasks.workunit.client.1.smithi148.stdout:1/956: creat dc/d11/d38/d72/de3/f13c x:0 0 0 2024-09-18T12:49:27.345 INFO:tasks.workunit.client.1.smithi148.stdout:3/890: creat d4/d8/d20/d2b/d7f/d93/d94/dac/f133 x:0 0 0 2024-09-18T12:49:27.345 INFO:tasks.workunit.client.1.smithi148.stdout:6/951: dread d5/d32/d56/f4d [4194304,4194304] 0 2024-09-18T12:49:27.347 INFO:tasks.workunit.client.1.smithi148.stdout:3/891: write d4/d8/d20/d2b/d7f/d93/ffe [90214,41039] 0 2024-09-18T12:49:27.347 INFO:tasks.workunit.client.1.smithi148.stdout:5/974: creat d7/d8/d18/d3f/d7c/d7d/d101/dcd/f143 x:0 0 0 2024-09-18T12:49:27.353 INFO:tasks.workunit.client.1.smithi148.stdout:3/892: creat d4/d8/d20/d99/dfd/f134 x:0 0 0 2024-09-18T12:49:27.353 INFO:tasks.workunit.client.1.smithi148.stdout:2/841: truncate d9/d17/d29/d92/d95/d9b/fc0 251319 0 2024-09-18T12:49:27.354 INFO:tasks.workunit.client.1.smithi148.stdout:1/957: link dc/d18/d7d/d93/dd9/f23 dc/d18/d7d/dea/f13d 0 2024-09-18T12:49:27.356 INFO:tasks.workunit.client.1.smithi148.stdout:6/952: creat d5/d32/d12f/f135 x:0 0 0 2024-09-18T12:49:27.358 INFO:tasks.workunit.client.1.smithi148.stdout:1/958: dread f6 [0,4194304] 0 2024-09-18T12:49:27.358 INFO:tasks.workunit.client.1.smithi148.stdout:2/842: creat d9/d24/d31/d9d/dcd/d10f/f120 x:0 0 0 2024-09-18T12:49:27.359 INFO:tasks.workunit.client.1.smithi148.stdout:6/953: fdatasync d5/d1a/f47 0 2024-09-18T12:49:27.364 INFO:tasks.workunit.client.1.smithi148.stdout:2/843: rename d9/d24/d67/dc7/dce/c119 to d9/d24/d31/d34/c121 0 2024-09-18T12:49:27.367 INFO:tasks.workunit.client.1.smithi148.stdout:5/975: getdents d7/d8/dc/da6/dee/d69 0 2024-09-18T12:49:27.369 INFO:tasks.workunit.client.1.smithi148.stdout:2/844: mknod d9/d24/d31/d34/d42/c122 0 2024-09-18T12:49:27.371 INFO:tasks.workunit.client.1.smithi148.stdout:2/845: truncate d9/d17/d29/d92/f111 982977 0 2024-09-18T12:49:27.371 INFO:tasks.workunit.client.1.smithi148.stdout:5/976: read - d7/d8/dc/da6/dee/d77/dd4/ffb zero size 2024-09-18T12:49:27.374 INFO:tasks.workunit.client.1.smithi148.stdout:3/893: link d4/ld d4/d8/d6a/db3/l135 0 2024-09-18T12:49:27.375 INFO:tasks.workunit.client.1.smithi148.stdout:2/846: dread d9/d24/d67/dc7/dce/de3/fea [0,4194304] 0 2024-09-18T12:49:27.376 INFO:tasks.workunit.client.1.smithi148.stdout:2/847: readlink d9/d24/d31/d34/lfc 0 2024-09-18T12:49:27.377 INFO:tasks.workunit.client.1.smithi148.stdout:3/894: symlink d4/d8/d1e/d63/d9b/l136 0 2024-09-18T12:49:27.378 INFO:tasks.workunit.client.1.smithi148.stdout:5/977: write d7/d2b/fdd [205079,104553] 0 2024-09-18T12:49:27.380 INFO:tasks.workunit.client.1.smithi148.stdout:3/895: readlink d4/d8/d6a/l78 0 2024-09-18T12:49:27.380 INFO:tasks.workunit.client.1.smithi148.stdout:1/959: dwrite dc/d18/d8a/f92 [0,4194304] 0 2024-09-18T12:49:27.383 INFO:tasks.workunit.client.1.smithi148.stdout:2/848: link d9/d24/d67/d72/d77/le2 d9/d17/d29/l123 0 2024-09-18T12:49:27.386 INFO:tasks.workunit.client.1.smithi148.stdout:5/978: rename d7/d8/d18/d3f/f6f to d7/d8/dc/d12/d20/d100/d10c/f144 0 2024-09-18T12:49:27.389 INFO:tasks.workunit.client.0.smithi078.stdout:3/509: sync 2024-09-18T12:49:27.390 INFO:tasks.workunit.client.1.smithi148.stdout:1/960: link dc/d18/d7d/d93/dd9/d2b/fce dc/d18/d31/f13e 0 2024-09-18T12:49:27.391 INFO:tasks.workunit.client.1.smithi148.stdout:3/896: dwrite d4/d8/d20/d2b/d7f/d93/d94/dac/fe3 [0,4194304] 0 2024-09-18T12:49:27.392 INFO:tasks.workunit.client.1.smithi148.stdout:5/979: rename d7/d8/dc/d12/d31/d5a/ca5 to d7/d8/dc/da6/d129/c145 0 2024-09-18T12:49:27.393 INFO:tasks.workunit.client.1.smithi148.stdout:3/897: chown d4/d8/d20/d2b/d7f/d93/ffe 170370144 1 2024-09-18T12:49:27.393 INFO:tasks.workunit.client.1.smithi148.stdout:5/980: chown d7/d8/dc/d12/d20/d100/f109 77 1 2024-09-18T12:49:27.394 INFO:tasks.workunit.client.1.smithi148.stdout:2/849: getdents d9/d24/d47 0 2024-09-18T12:49:27.395 INFO:tasks.workunit.client.1.smithi148.stdout:5/981: write d7/d8/dc/f11c [495887,28374] 0 2024-09-18T12:49:27.399 INFO:tasks.workunit.client.1.smithi148.stdout:1/961: mkdir dc/d18/d31/dc6/d110/d13f 0 2024-09-18T12:49:27.401 INFO:tasks.workunit.client.1.smithi148.stdout:3/898: dwrite d4/d8/d1e/d63/f11c [0,4194304] 0 2024-09-18T12:49:27.401 INFO:tasks.workunit.client.0.smithi078.stdout:3/510: write d9/d54/f74 [2346299,54575] 0 2024-09-18T12:49:27.406 INFO:tasks.workunit.client.1.smithi148.stdout:5/982: creat d7/d8/dc/f146 x:0 0 0 2024-09-18T12:49:27.408 INFO:tasks.workunit.client.0.smithi078.stdout:3/511: creat d9/d13/d33/d34/d97/f9b x:0 0 0 2024-09-18T12:49:27.409 INFO:tasks.workunit.client.1.smithi148.stdout:1/962: mkdir dc/d18/d7d/d93/d118/d140 0 2024-09-18T12:49:27.409 INFO:tasks.workunit.client.1.smithi148.stdout:2/850: link d9/d73/fb3 d9/d17/d29/d98/f124 0 2024-09-18T12:49:27.410 INFO:tasks.workunit.client.0.smithi078.stdout:3/512: mkdir d9/d54/d7f/d9c 0 2024-09-18T12:49:27.411 INFO:tasks.workunit.client.1.smithi148.stdout:5/983: fdatasync d7/d8/f13 0 2024-09-18T12:49:27.414 INFO:tasks.workunit.client.0.smithi078.stdout:3/513: symlink d9/d54/d7f/d9c/l9d 0 2024-09-18T12:49:27.415 INFO:tasks.workunit.client.1.smithi148.stdout:1/963: mknod dc/d18/c141 0 2024-09-18T12:49:27.417 INFO:tasks.workunit.client.0.smithi078.stdout:3/514: mkdir d9/d13/d33/d34/d9e 0 2024-09-18T12:49:27.418 INFO:tasks.workunit.client.1.smithi148.stdout:1/964: mkdir dc/d11/d142 0 2024-09-18T12:49:27.419 INFO:tasks.workunit.client.1.smithi148.stdout:4/944: sync 2024-09-18T12:49:27.419 INFO:tasks.workunit.client.1.smithi148.stdout:7/912: sync 2024-09-18T12:49:27.420 INFO:tasks.workunit.client.0.smithi078.stdout:3/515: mkdir d9/d54/d6c/d9f 0 2024-09-18T12:49:27.420 INFO:tasks.workunit.client.1.smithi148.stdout:7/913: chown db/dc/df/d11/d43/c94 229 1 2024-09-18T12:49:27.420 INFO:tasks.workunit.client.1.smithi148.stdout:5/984: dread d7/f4f [0,4194304] 0 2024-09-18T12:49:27.421 INFO:tasks.workunit.client.1.smithi148.stdout:7/914: stat db/dc/df/d11/f47 0 2024-09-18T12:49:27.421 INFO:tasks.workunit.client.1.smithi148.stdout:5/985: chown d7/d8/f59 3994 1 2024-09-18T12:49:27.422 INFO:tasks.workunit.client.1.smithi148.stdout:2/851: getdents d9 0 2024-09-18T12:49:27.423 INFO:tasks.workunit.client.0.smithi078.stdout:3/516: mknod d9/d13/d33/d4e/ca0 0 2024-09-18T12:49:27.424 INFO:tasks.workunit.client.1.smithi148.stdout:1/965: mknod dc/d18/d31/c143 0 2024-09-18T12:49:27.425 INFO:tasks.workunit.client.1.smithi148.stdout:3/899: truncate d4/d8/d6a/db3/db7/dcb/fe0 203637 0 2024-09-18T12:49:27.426 INFO:tasks.workunit.client.1.smithi148.stdout:2/852: symlink d9/d24/d67/dc7/ddd/l125 0 2024-09-18T12:49:27.427 INFO:tasks.workunit.client.1.smithi148.stdout:7/915: mknod db/d52/c117 0 2024-09-18T12:49:27.428 INFO:tasks.workunit.client.1.smithi148.stdout:4/945: dwrite d15/d90/fbe [0,4194304] 0 2024-09-18T12:49:27.428 INFO:tasks.workunit.client.1.smithi148.stdout:1/966: creat dc/d11/d38/d7b/f144 x:0 0 0 2024-09-18T12:49:27.429 INFO:tasks.workunit.client.1.smithi148.stdout:2/853: read d9/fe9 [4588956,60743] 0 2024-09-18T12:49:27.429 INFO:tasks.workunit.client.1.smithi148.stdout:3/900: creat d4/d8/d20/d99/dfd/d113/f137 x:0 0 0 2024-09-18T12:49:27.430 INFO:tasks.workunit.client.1.smithi148.stdout:1/967: chown dc/d4d/dfe/c10d 161143 1 2024-09-18T12:49:27.430 INFO:tasks.workunit.client.1.smithi148.stdout:2/854: dread - d9/d24/f2f zero size 2024-09-18T12:49:27.432 INFO:tasks.workunit.client.1.smithi148.stdout:2/855: fsync d9/f21 0 2024-09-18T12:49:27.433 INFO:tasks.workunit.client.1.smithi148.stdout:1/968: write dc/d9f/df5/fa6 [769758,111032] 0 2024-09-18T12:49:27.434 INFO:tasks.workunit.client.1.smithi148.stdout:4/946: chown d15/d17/d52/f8b 1214262 1 2024-09-18T12:49:27.436 INFO:tasks.workunit.client.1.smithi148.stdout:2/856: creat d9/d17/d29/d92/d95/d9b/f126 x:0 0 0 2024-09-18T12:49:27.438 INFO:tasks.workunit.client.1.smithi148.stdout:1/969: creat dc/d18/d31/dc6/d110/f145 x:0 0 0 2024-09-18T12:49:27.438 INFO:tasks.workunit.client.1.smithi148.stdout:1/970: fdatasync dc/d18/d31/d39/fc8 0 2024-09-18T12:49:27.439 INFO:tasks.workunit.client.0.smithi078.stdout:3/517: dread d9/d54/d7f/f98 [0,4194304] 0 2024-09-18T12:49:27.439 INFO:tasks.workunit.client.1.smithi148.stdout:4/947: symlink d15/d5f/d69/d7f/l137 0 2024-09-18T12:49:27.441 INFO:tasks.workunit.client.0.smithi078.stdout:5/880: sync 2024-09-18T12:49:27.441 INFO:tasks.workunit.client.0.smithi078.stdout:6/800: sync 2024-09-18T12:49:27.442 INFO:tasks.workunit.client.1.smithi148.stdout:1/971: unlink dc/d18/c141 0 2024-09-18T12:49:27.443 INFO:tasks.workunit.client.0.smithi078.stdout:6/801: stat d10/d2b/d43/dc3/d103/dac/da6/lb6 0 2024-09-18T12:49:27.444 INFO:tasks.workunit.client.0.smithi078.stdout:3/518: symlink d9/d13/d37/la1 0 2024-09-18T12:49:27.445 INFO:tasks.workunit.client.1.smithi148.stdout:4/948: rename d15/de9/d136 to d15/d17/d52/d92/d4c/dd0/d138 0 2024-09-18T12:49:27.447 INFO:tasks.workunit.client.0.smithi078.stdout:5/881: mkdir d2/d4/d9/da/d60/db3/d16/d36/d4c/d97/db1/d117 0 2024-09-18T12:49:27.448 INFO:tasks.workunit.client.0.smithi078.stdout:6/802: rmdir d10/d2b/d43/dc3 39 2024-09-18T12:49:27.449 INFO:tasks.workunit.client.0.smithi078.stdout:5/882: chown d2/d4/d9/da/d60/db3/f1b 4 1 2024-09-18T12:49:27.450 INFO:tasks.workunit.client.1.smithi148.stdout:7/916: write db/dc/df/d11/ddc/d75/f81 [560212,35522] 0 2024-09-18T12:49:27.452 INFO:tasks.workunit.client.0.smithi078.stdout:6/803: fdatasync d10/d2b/d43/d53/d45/d55/f88 0 2024-09-18T12:49:27.453 INFO:tasks.workunit.client.0.smithi078.stdout:6/804: chown d10/d2b/d61/dd7/c104 3 1 2024-09-18T12:49:27.454 INFO:tasks.workunit.client.0.smithi078.stdout:5/883: creat d2/d4/d9/da/d60/db3/d16/d36/d4c/f118 x:0 0 0 2024-09-18T12:49:27.455 INFO:tasks.workunit.client.0.smithi078.stdout:5/884: chown d2/c5b 5288 1 2024-09-18T12:49:27.459 INFO:tasks.workunit.client.0.smithi078.stdout:6/805: readlink d10/d2b/d43/d53/lc0 0 2024-09-18T12:49:27.460 INFO:tasks.workunit.client.0.smithi078.stdout:3/519: rename d9/d2f/l5c to d9/df/la2 0 2024-09-18T12:49:27.463 INFO:tasks.workunit.client.0.smithi078.stdout:6/806: truncate d10/d2b/d43/f6f 4430179 0 2024-09-18T12:49:27.463 INFO:tasks.workunit.client.0.smithi078.stdout:3/520: dread - d9/f61 zero size 2024-09-18T12:49:27.465 INFO:tasks.workunit.client.0.smithi078.stdout:5/885: rename d2/d4/d9/da/d60/db3/d2d/df2/df4/l110 to d2/d4/d9/da/d60/db3/d16/d36/db0/dde/dbd/l119 0 2024-09-18T12:49:27.467 INFO:tasks.workunit.client.0.smithi078.stdout:5/886: write d2/d4/d9/da/d60/db3/d16/dd2/fc7 [1581191,73707] 0 2024-09-18T12:49:27.472 INFO:tasks.workunit.client.0.smithi078.stdout:6/807: dwrite d10/d2b/d43/dc3/d103/fde [0,4194304] 0 2024-09-18T12:49:27.474 INFO:tasks.workunit.client.0.smithi078.stdout:5/887: mkdir d2/d4/d9/da/d60/db3/d16/d36/db0/dde/d4d/d11a 0 2024-09-18T12:49:27.475 INFO:tasks.workunit.client.0.smithi078.stdout:6/808: rmdir d10/d2b/dbd 39 2024-09-18T12:49:27.475 INFO:tasks.workunit.client.0.smithi078.stdout:3/521: write d9/f59 [800293,48287] 0 2024-09-18T12:49:27.477 INFO:tasks.workunit.client.0.smithi078.stdout:3/522: creat d9/d13/d37/fa3 x:0 0 0 2024-09-18T12:49:27.478 INFO:tasks.workunit.client.0.smithi078.stdout:5/888: creat d2/d4/d9/da/d60/d7f/f11b x:0 0 0 2024-09-18T12:49:27.479 INFO:tasks.workunit.client.0.smithi078.stdout:6/809: mkdir d10/d2b/d43/d53/d63/d6b/d10f 0 2024-09-18T12:49:27.480 INFO:tasks.workunit.client.0.smithi078.stdout:3/523: truncate d9/d13/d33/d4e/f25 3851008 0 2024-09-18T12:49:27.480 INFO:tasks.workunit.client.0.smithi078.stdout:6/810: chown d10/c31 206292 1 2024-09-18T12:49:27.481 INFO:tasks.workunit.client.0.smithi078.stdout:3/524: truncate d9/f59 1033884 0 2024-09-18T12:49:27.482 INFO:tasks.workunit.client.0.smithi078.stdout:6/811: fdatasync d10/d2b/d61/fbb 0 2024-09-18T12:49:27.488 INFO:tasks.workunit.client.1.smithi148.stdout:1/972: symlink dc/l146 0 2024-09-18T12:49:27.488 INFO:tasks.workunit.client.1.smithi148.stdout:7/917: mkdir db/d52/d4f/de7/d118 0 2024-09-18T12:49:27.489 INFO:tasks.workunit.client.1.smithi148.stdout:4/949: symlink d15/d17/d52/d68/d125/l139 0 2024-09-18T12:49:27.490 INFO:tasks.workunit.client.1.smithi148.stdout:1/973: creat dc/d18/d31/d4b/f147 x:0 0 0 2024-09-18T12:49:27.492 INFO:tasks.workunit.client.0.smithi078.stdout:5/889: dread d2/d4/d9/d2f/d30/f59 [0,4194304] 0 2024-09-18T12:49:27.492 INFO:tasks.workunit.client.1.smithi148.stdout:4/950: fdatasync d15/d17/d52/d92/d4c/d4f/d64/d9a/fdc 0 2024-09-18T12:49:27.492 INFO:tasks.workunit.client.0.smithi078.stdout:5/890: fdatasync d2/d4/d9/da/d60/d7f/f11b 0 2024-09-18T12:49:27.496 INFO:tasks.workunit.client.1.smithi148.stdout:7/918: dwrite db/dc/df/d11/ddc/d75/f56 [4194304,4194304] 0 2024-09-18T12:49:27.496 INFO:tasks.workunit.client.1.smithi148.stdout:4/951: write d15/d17/d52/d92/d4c/d4f/d64/da0/fd8 [1659985,126824] 0 2024-09-18T12:49:27.497 INFO:tasks.workunit.client.0.smithi078.stdout:5/891: link d2/d4/d9/da/d60/db3/f8e d2/d4/d9/d2f/d30/f11c 0 2024-09-18T12:49:27.498 INFO:tasks.workunit.client.1.smithi148.stdout:4/952: chown d15/d17/d52/d92/l86 3 1 2024-09-18T12:49:27.502 INFO:tasks.workunit.client.1.smithi148.stdout:1/974: dwrite dc/d18/d31/d4b/d8d/d8f/fe1 [0,4194304] 0 2024-09-18T12:49:27.507 INFO:tasks.workunit.client.1.smithi148.stdout:1/975: rename dc/d11/f6e to dc/d18/d7d/f148 0 2024-09-18T12:49:27.507 INFO:tasks.workunit.client.0.smithi078.stdout:5/892: dwrite d2/d4/d9/d49/f4b [4194304,4194304] 0 2024-09-18T12:49:27.509 INFO:tasks.workunit.client.0.smithi078.stdout:3/525: dwrite d9/d2f/f77 [0,4194304] 0 2024-09-18T12:49:27.516 INFO:tasks.workunit.client.0.smithi078.stdout:5/893: fsync d2/d4/d9/da/d60/db3/d16/f27 0 2024-09-18T12:49:27.519 INFO:tasks.workunit.client.1.smithi148.stdout:9/945: sync 2024-09-18T12:49:27.519 INFO:tasks.workunit.client.0.smithi078.stdout:3/526: symlink d9/d13/d63/d78/la4 0 2024-09-18T12:49:27.520 INFO:tasks.workunit.client.1.smithi148.stdout:1/976: symlink dc/d18/l149 0 2024-09-18T12:49:27.521 INFO:tasks.workunit.client.1.smithi148.stdout:9/946: readlink d8/da/dd/d4a/d49/d46/d54/ldb 0 2024-09-18T12:49:27.522 INFO:tasks.workunit.client.1.smithi148.stdout:4/953: link d15/d5f/d69/d7f/ced d15/d17/d52/d92/d4c/c13a 0 2024-09-18T12:49:27.524 INFO:tasks.workunit.client.1.smithi148.stdout:7/919: dwrite db/dc/df/d1d/f21 [0,4194304] 0 2024-09-18T12:49:27.525 INFO:tasks.workunit.client.0.smithi078.stdout:5/894: mknod d2/d4/d9/da/d60/db3/d16/d36/db0/dde/c11d 0 2024-09-18T12:49:27.525 INFO:tasks.workunit.client.1.smithi148.stdout:1/977: truncate dc/d18/d31/d39/ff7 563360 0 2024-09-18T12:49:27.526 INFO:tasks.workunit.client.0.smithi078.stdout:5/895: write d2/d4/d9/da/d60/db3/d16/dd2/fc7 [476783,128089] 0 2024-09-18T12:49:27.530 INFO:tasks.workunit.client.1.smithi148.stdout:9/947: rename d8/da/f1d to d8/da/dd/d35/d47/d62/d72/f123 0 2024-09-18T12:49:27.530 INFO:tasks.workunit.client.0.smithi078.stdout:5/896: truncate d2/d4/d9/f2a 2943814 0 2024-09-18T12:49:27.532 INFO:tasks.workunit.client.1.smithi148.stdout:4/954: creat d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/d11e/db3/f13b x:0 0 0 2024-09-18T12:49:27.533 INFO:tasks.workunit.client.1.smithi148.stdout:7/920: mkdir db/dc/df/d1d/d68/d82/d119 0 2024-09-18T12:49:27.534 INFO:tasks.workunit.client.0.smithi078.stdout:5/897: creat d2/d4/d9/da/d60/d7f/dce/f11e x:0 0 0 2024-09-18T12:49:27.536 INFO:tasks.workunit.client.1.smithi148.stdout:4/955: write d15/d17/d52/d92/d4c/d4f/fb7 [4329409,127491] 0 2024-09-18T12:49:27.537 INFO:tasks.workunit.client.0.smithi078.stdout:5/898: rename d2/d4/d9/da/d60/db3/d16/d36/db0/dde/d4d to d2/d4/d9/da/d60/db3/d16/d36/db0/dde/d4d/d11a/d11f 22 2024-09-18T12:49:27.538 INFO:tasks.workunit.client.1.smithi148.stdout:7/921: creat db/d52/d4f/f11a x:0 0 0 2024-09-18T12:49:27.539 INFO:tasks.workunit.client.1.smithi148.stdout:4/956: unlink d15/d90/lb8 0 2024-09-18T12:49:27.540 INFO:tasks.workunit.client.0.smithi078.stdout:5/899: mknod d2/d4/d9/da/d60/db3/d16/d36/d4c/d97/db1/c120 0 2024-09-18T12:49:27.541 INFO:tasks.workunit.client.0.smithi078.stdout:5/900: stat d2/db8/d107 0 2024-09-18T12:49:27.542 INFO:tasks.workunit.client.1.smithi148.stdout:7/922: getdents db/dc/df/d11/dac 0 2024-09-18T12:49:27.544 INFO:tasks.workunit.client.0.smithi078.stdout:5/901: dread d2/d4/d9/da/d2b/d3e/fa9 [0,4194304] 0 2024-09-18T12:49:27.546 INFO:tasks.workunit.client.1.smithi148.stdout:7/923: truncate db/dc/df/d11/f53 3345770 0 2024-09-18T12:49:27.546 INFO:tasks.workunit.client.1.smithi148.stdout:4/957: dwrite d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/d11e/db3/f13b [0,4194304] 0 2024-09-18T12:49:27.547 INFO:tasks.workunit.client.1.smithi148.stdout:6/954: sync 2024-09-18T12:49:27.547 INFO:tasks.workunit.client.1.smithi148.stdout:5/986: sync 2024-09-18T12:49:27.547 INFO:tasks.workunit.client.1.smithi148.stdout:3/901: sync 2024-09-18T12:49:27.548 INFO:tasks.workunit.client.0.smithi078.stdout:5/902: read d2/d4/d9/d49/f56 [3871537,5864] 0 2024-09-18T12:49:27.550 INFO:tasks.workunit.client.1.smithi148.stdout:7/924: stat db/dc/df/d1d/d68/d7a/fcd 0 2024-09-18T12:49:27.550 INFO:tasks.workunit.client.1.smithi148.stdout:6/955: chown d5/d1a/dc/dbf/dcb 24 1 2024-09-18T12:49:27.551 INFO:tasks.workunit.client.1.smithi148.stdout:4/958: read fa [129617,37050] 0 2024-09-18T12:49:27.553 INFO:tasks.workunit.client.1.smithi148.stdout:6/956: write d5/d1a/dc/d2b/d35/d9c/fc5 [2430365,101844] 0 2024-09-18T12:49:27.553 INFO:tasks.workunit.client.1.smithi148.stdout:5/987: mknod d7/d8/dc/da6/dee/d69/d8b/dad/c147 0 2024-09-18T12:49:27.553 INFO:tasks.workunit.client.1.smithi148.stdout:1/978: dread dc/d18/d63/f98 [0,4194304] 0 2024-09-18T12:49:27.555 INFO:tasks.workunit.client.1.smithi148.stdout:5/988: chown d7/fff 153259483 1 2024-09-18T12:49:27.555 INFO:tasks.workunit.client.1.smithi148.stdout:7/925: creat db/dc/df/d11/d34/d69/f11b x:0 0 0 2024-09-18T12:49:27.557 INFO:tasks.workunit.client.0.smithi078.stdout:3/527: dread d9/d54/f74 [0,4194304] 0 2024-09-18T12:49:27.557 INFO:tasks.workunit.client.1.smithi148.stdout:3/902: rename d4/d8/d1e/d6b/d31/d60/f11a to d4/d8/d1e/d6b/d31/d46/f138 0 2024-09-18T12:49:27.557 INFO:tasks.workunit.client.0.smithi078.stdout:3/528: stat d9/d54/d89/l8f 0 2024-09-18T12:49:27.558 INFO:tasks.workunit.client.1.smithi148.stdout:3/903: write f2 [1289110,41108] 0 2024-09-18T12:49:27.563 INFO:tasks.workunit.client.1.smithi148.stdout:7/926: truncate db/dc/df/d11/d34/d69/f71 1689279 0 2024-09-18T12:49:27.566 INFO:tasks.workunit.client.1.smithi148.stdout:4/959: mknod d15/d17/d52/d92/dc9/dff/c13c 0 2024-09-18T12:49:27.567 INFO:tasks.workunit.client.1.smithi148.stdout:6/957: fsync d5/d1a/d29/f113 0 2024-09-18T12:49:27.568 INFO:tasks.workunit.client.1.smithi148.stdout:3/904: creat d4/d8/d1e/d6b/d31/d60/da9/d8b/f139 x:0 0 0 2024-09-18T12:49:27.569 INFO:tasks.workunit.client.1.smithi148.stdout:9/948: truncate d8/da/f13 4848157 0 2024-09-18T12:49:27.570 INFO:tasks.workunit.client.1.smithi148.stdout:7/927: creat db/d52/d4f/de7/f11c x:0 0 0 2024-09-18T12:49:27.576 INFO:tasks.workunit.client.1.smithi148.stdout:7/928: truncate db/dc/df/d2c/f7e 484531 0 2024-09-18T12:49:27.576 INFO:tasks.workunit.client.1.smithi148.stdout:9/949: read d8/da/dd/f14 [2540906,127845] 0 2024-09-18T12:49:27.577 INFO:tasks.workunit.client.0.smithi078.stdout:5/903: dwrite d2/d4/f8c [0,4194304] 0 2024-09-18T12:49:27.578 INFO:tasks.workunit.client.1.smithi148.stdout:4/960: rename d15/d17/d52/d92/d4c/d4f/c62 to d15/d17/d52/d92/d4c/d4f/d34/c13d 0 2024-09-18T12:49:27.579 INFO:tasks.workunit.client.1.smithi148.stdout:3/905: dwrite d4/fd8 [0,4194304] 0 2024-09-18T12:49:27.579 INFO:tasks.workunit.client.1.smithi148.stdout:1/979: write dc/d18/d7d/d93/dd9/f41 [2264783,15650] 0 2024-09-18T12:49:27.580 INFO:tasks.workunit.client.1.smithi148.stdout:4/961: stat d15/d5f/d69/d7f/ff8 0 2024-09-18T12:49:27.582 INFO:tasks.workunit.client.1.smithi148.stdout:6/958: mkdir d5/d1a/dc/d101/da4/d136 0 2024-09-18T12:49:27.583 INFO:tasks.workunit.client.0.smithi078.stdout:5/904: write d2/d4/d9/da/d60/db3/f81 [5080749,63303] 0 2024-09-18T12:49:27.583 INFO:tasks.workunit.client.1.smithi148.stdout:3/906: write d4/d8/d1e/d6b/d31/d60/da9/d8b/fee [903904,128855] 0 2024-09-18T12:49:27.584 INFO:tasks.workunit.client.0.smithi078.stdout:5/905: chown d2/d4/d9/da/d2b 366082 1 2024-09-18T12:49:27.591 INFO:tasks.workunit.client.1.smithi148.stdout:7/929: rename db/dc/df/d11/d34/f108 to db/dc/df/f11d 0 2024-09-18T12:49:27.592 INFO:tasks.workunit.client.1.smithi148.stdout:6/959: write d5/d1a/dc/f128 [205391,40816] 0 2024-09-18T12:49:27.594 INFO:tasks.workunit.client.1.smithi148.stdout:9/950: dwrite d8/da/dd/d4a/d49/d46/d54/d90/fb2 [0,4194304] 0 2024-09-18T12:49:27.599 INFO:tasks.workunit.client.1.smithi148.stdout:6/960: creat d5/d1a/d29/d5c/f137 x:0 0 0 2024-09-18T12:49:27.600 INFO:tasks.workunit.client.1.smithi148.stdout:3/907: link d4/d8/d20/d2b/d7f/d93/l9f d4/d8/d1e/d79/l13a 0 2024-09-18T12:49:27.601 INFO:tasks.workunit.client.1.smithi148.stdout:9/951: chown d8/da/dd/d4a/d27/l36 76556558 1 2024-09-18T12:49:27.604 INFO:tasks.workunit.client.1.smithi148.stdout:9/952: stat d8/da/dd/d35/d81/db7/ce8 0 2024-09-18T12:49:27.608 INFO:tasks.workunit.client.1.smithi148.stdout:9/953: read d8/da/dd/d4a/ff6 [2405649,7650] 0 2024-09-18T12:49:27.608 INFO:tasks.workunit.client.1.smithi148.stdout:1/980: dread dc/d51/f70 [0,4194304] 0 2024-09-18T12:49:27.609 INFO:tasks.workunit.client.1.smithi148.stdout:1/981: stat dc/d18/d31/d4b 0 2024-09-18T12:49:27.609 INFO:tasks.workunit.client.1.smithi148.stdout:9/954: read - d8/da/dd/d3f/d5d/da0/f10d zero size 2024-09-18T12:49:27.613 INFO:tasks.workunit.client.1.smithi148.stdout:6/961: write d5/fdf [300092,31302] 0 2024-09-18T12:49:27.615 INFO:tasks.workunit.client.1.smithi148.stdout:1/982: getdents dc/d4d/dfe 0 2024-09-18T12:49:27.617 INFO:tasks.workunit.client.1.smithi148.stdout:9/955: getdents d8/da/dd 0 2024-09-18T12:49:27.617 INFO:tasks.workunit.client.0.smithi078.stdout:5/906: dread d2/d4/d9/da/f20 [0,4194304] 0 2024-09-18T12:49:27.618 INFO:tasks.workunit.client.1.smithi148.stdout:1/983: symlink dc/d11/d38/d7b/l14a 0 2024-09-18T12:49:27.619 INFO:tasks.workunit.client.1.smithi148.stdout:1/984: stat dc/fd 0 2024-09-18T12:49:27.620 INFO:tasks.workunit.client.1.smithi148.stdout:3/908: dwrite d4/d8/d1e/f25 [0,4194304] 0 2024-09-18T12:49:27.622 INFO:tasks.workunit.client.1.smithi148.stdout:9/956: truncate d8/da/dd/d35/d81/ff7 238024 0 2024-09-18T12:49:27.623 INFO:tasks.workunit.client.1.smithi148.stdout:1/985: rmdir dc/d18/d31/d39 39 2024-09-18T12:49:27.625 INFO:tasks.workunit.client.0.smithi078.stdout:5/907: truncate d2/d4/d48/f4e 1051815 0 2024-09-18T12:49:27.626 INFO:tasks.workunit.client.1.smithi148.stdout:6/962: dwrite d5/d1a/d29/d5c/da1/f115 [0,4194304] 0 2024-09-18T12:49:27.628 INFO:tasks.workunit.client.0.smithi078.stdout:5/908: truncate d2/d4/d9/da/d60/db3/d16/d36/db0/fe6 1082069 0 2024-09-18T12:49:27.629 INFO:tasks.workunit.client.0.smithi078.stdout:5/909: stat d2/d4/d9/da/d60/db3/d16/d36/db0/dde/d4d 0 2024-09-18T12:49:27.632 INFO:tasks.workunit.client.1.smithi148.stdout:6/963: creat d5/d1a/d3d/f138 x:0 0 0 2024-09-18T12:49:27.632 INFO:tasks.workunit.client.1.smithi148.stdout:9/957: mkdir d8/da/dd/d35/d124 0 2024-09-18T12:49:27.634 INFO:tasks.workunit.client.1.smithi148.stdout:6/964: creat d5/d32/d38/df0/df2/f139 x:0 0 0 2024-09-18T12:49:27.634 INFO:tasks.workunit.client.1.smithi148.stdout:3/909: dread d4/d8/d20/d2b/d7f/d93/ffe [0,4194304] 0 2024-09-18T12:49:27.634 INFO:tasks.workunit.client.1.smithi148.stdout:9/958: creat d8/da/dd/d77/dd9/f125 x:0 0 0 2024-09-18T12:49:27.637 INFO:tasks.workunit.client.1.smithi148.stdout:9/959: fsync d8/da/dd/d65/fc3 0 2024-09-18T12:49:27.638 INFO:tasks.workunit.client.1.smithi148.stdout:3/910: mknod d4/d8/d20/d2b/d7f/d93/d94/dde/c13b 0 2024-09-18T12:49:27.639 INFO:tasks.workunit.client.1.smithi148.stdout:1/986: dwrite dc/d18/d31/d39/fc8 [0,4194304] 0 2024-09-18T12:49:27.639 INFO:tasks.workunit.client.1.smithi148.stdout:9/960: readlink d8/da/dd/d4a/d49/d46/d54/ldb 0 2024-09-18T12:49:27.640 INFO:tasks.workunit.client.1.smithi148.stdout:3/911: creat d4/d8/d1e/d63/f13c x:0 0 0 2024-09-18T12:49:27.641 INFO:tasks.workunit.client.1.smithi148.stdout:1/987: symlink dc/d5b/l14b 0 2024-09-18T12:49:27.641 INFO:tasks.workunit.client.1.smithi148.stdout:9/961: fdatasync d8/da/dd/d4a/d49/d46/fbf 0 2024-09-18T12:49:27.644 INFO:tasks.workunit.client.1.smithi148.stdout:1/988: fsync dc/d18/d43/f4e 0 2024-09-18T12:49:27.645 INFO:tasks.workunit.client.1.smithi148.stdout:2/857: sync 2024-09-18T12:49:27.645 INFO:tasks.workunit.client.1.smithi148.stdout:2/858: stat d9/d24/d31/d9d/f10c 0 2024-09-18T12:49:27.647 INFO:tasks.workunit.client.1.smithi148.stdout:1/989: creat dc/d18/d31/dc6/f14c x:0 0 0 2024-09-18T12:49:27.648 INFO:tasks.workunit.client.1.smithi148.stdout:2/859: fdatasync d9/d24/fa0 0 2024-09-18T12:49:27.649 INFO:tasks.workunit.client.1.smithi148.stdout:2/860: fsync d9/d24/d47/f5e 0 2024-09-18T12:49:27.650 INFO:tasks.workunit.client.1.smithi148.stdout:1/990: write dc/d18/d31/faf [4106546,10980] 0 2024-09-18T12:49:27.650 INFO:tasks.workunit.client.1.smithi148.stdout:2/861: chown d9/d24/d47/f63 23 1 2024-09-18T12:49:27.653 INFO:tasks.workunit.client.1.smithi148.stdout:1/991: rename dc/d4d/l114 to dc/d18/d8a/l14d 0 2024-09-18T12:49:27.653 INFO:tasks.workunit.client.1.smithi148.stdout:2/862: mknod d9/d24/d67/dc7/ddd/c127 0 2024-09-18T12:49:27.654 INFO:tasks.workunit.client.1.smithi148.stdout:2/863: write d9/d24/fc1 [162155,88363] 0 2024-09-18T12:49:27.655 INFO:tasks.workunit.client.1.smithi148.stdout:1/992: creat dc/d11/d38/d7b/f14e x:0 0 0 2024-09-18T12:49:27.657 INFO:tasks.workunit.client.1.smithi148.stdout:1/993: stat dc/d18/d7d/c123 0 2024-09-18T12:49:27.660 INFO:tasks.workunit.client.1.smithi148.stdout:2/864: getdents d9/d17/d29/d92 0 2024-09-18T12:49:27.661 INFO:tasks.workunit.client.1.smithi148.stdout:2/865: fdatasync d9/d3a/f8d 0 2024-09-18T12:49:27.663 INFO:tasks.workunit.client.0.smithi078.stdout:5/910: dwrite d2/d4/f66 [0,4194304] 0 2024-09-18T12:49:27.664 INFO:tasks.workunit.client.1.smithi148.stdout:2/866: mknod d9/d24/d67/c128 0 2024-09-18T12:49:27.665 INFO:tasks.workunit.client.1.smithi148.stdout:3/912: getdents d4/d8/d1e/d63 0 2024-09-18T12:49:27.666 INFO:tasks.workunit.client.0.smithi078.stdout:5/911: write d2/d4/d9/da/d60/db3/d16/d36/db0/dde/ff5 [426945,90936] 0 2024-09-18T12:49:27.667 INFO:tasks.workunit.client.0.smithi078.stdout:1/612: sync 2024-09-18T12:49:27.668 INFO:tasks.workunit.client.0.smithi078.stdout:7/485: sync 2024-09-18T12:49:27.668 INFO:tasks.workunit.client.0.smithi078.stdout:8/595: sync 2024-09-18T12:49:27.668 INFO:tasks.workunit.client.0.smithi078.stdout:4/634: sync 2024-09-18T12:49:27.668 INFO:tasks.workunit.client.0.smithi078.stdout:0/671: sync 2024-09-18T12:49:27.668 INFO:tasks.workunit.client.0.smithi078.stdout:9/639: sync 2024-09-18T12:49:27.668 INFO:tasks.workunit.client.0.smithi078.stdout:2/565: sync 2024-09-18T12:49:27.669 INFO:tasks.workunit.client.1.smithi148.stdout:3/913: symlink d4/d8/d20/d2b/d7f/l13d 0 2024-09-18T12:49:27.670 INFO:tasks.workunit.client.1.smithi148.stdout:9/962: write d8/da/dd/d35/d47/fa4 [2173280,20516] 0 2024-09-18T12:49:27.671 INFO:tasks.workunit.client.0.smithi078.stdout:2/566: stat d4/f9 0 2024-09-18T12:49:27.672 INFO:tasks.workunit.client.0.smithi078.stdout:4/635: truncate d11/d27/d47/d4e/d50/fbd 984706 0 2024-09-18T12:49:27.674 INFO:tasks.workunit.client.0.smithi078.stdout:8/596: mkdir d0/d39/dbc 0 2024-09-18T12:49:27.678 INFO:tasks.workunit.client.0.smithi078.stdout:7/486: readlink d7/d9/d14/d22/d3e/l6b 0 2024-09-18T12:49:27.683 INFO:tasks.workunit.client.1.smithi148.stdout:3/914: dread d4/d8/f51 [0,4194304] 0 2024-09-18T12:49:27.684 INFO:tasks.workunit.client.1.smithi148.stdout:2/867: dwrite d9/d24/d31/fc8 [0,4194304] 0 2024-09-18T12:49:27.685 INFO:tasks.workunit.client.1.smithi148.stdout:9/963: truncate d8/da/dd/d35/d59/f69 219014 0 2024-09-18T12:49:27.687 INFO:tasks.workunit.client.1.smithi148.stdout:3/915: dread d4/d8/d1e/d6b/fb9 [0,4194304] 0 2024-09-18T12:49:27.688 INFO:tasks.workunit.client.0.smithi078.stdout:2/567: mknod d4/cb8 0 2024-09-18T12:49:27.689 INFO:tasks.workunit.client.0.smithi078.stdout:5/912: dread d2/d4/f89 [0,4194304] 0 2024-09-18T12:49:27.698 INFO:tasks.workunit.client.1.smithi148.stdout:3/916: unlink d4/d8/d20/d2b/f3a 0 2024-09-18T12:49:27.698 INFO:tasks.workunit.client.0.smithi078.stdout:2/568: dwrite d4/f99 [0,4194304] 0 2024-09-18T12:49:27.700 INFO:tasks.workunit.client.0.smithi078.stdout:7/487: dwrite d7/d9/f2f [0,4194304] 0 2024-09-18T12:49:27.700 INFO:tasks.workunit.client.0.smithi078.stdout:0/672: truncate d3/d1f/f67 4699652 0 2024-09-18T12:49:27.700 INFO:tasks.workunit.client.1.smithi148.stdout:9/964: symlink d8/da/dd/d4a/l126 0 2024-09-18T12:49:27.703 INFO:tasks.workunit.client.0.smithi078.stdout:7/488: fdatasync d7/d9/d14/d22/d35/d49/d56/d8d/f9e 0 2024-09-18T12:49:27.707 INFO:tasks.workunit.client.0.smithi078.stdout:4/636: creat d11/fc9 x:0 0 0 2024-09-18T12:49:27.707 INFO:tasks.workunit.client.1.smithi148.stdout:2/868: link d9/d24/d67/d72/d77/ca7 d9/d24/d67/dc7/dce/d11a/c129 0 2024-09-18T12:49:27.708 INFO:tasks.workunit.client.1.smithi148.stdout:2/869: dread - d9/d24/d31/df7/f109 zero size 2024-09-18T12:49:27.709 INFO:tasks.workunit.client.1.smithi148.stdout:2/870: stat d9/d73/cd0 0 2024-09-18T12:49:27.709 INFO:tasks.workunit.client.1.smithi148.stdout:2/871: stat d9/fe6 0 2024-09-18T12:49:27.710 INFO:tasks.workunit.client.1.smithi148.stdout:9/965: dread d8/da/f4d [0,4194304] 0 2024-09-18T12:49:27.710 INFO:tasks.workunit.client.1.smithi148.stdout:2/872: chown d9/d3a/d90/fc5 10062920 1 2024-09-18T12:49:27.711 INFO:tasks.workunit.client.0.smithi078.stdout:2/569: dwrite d4/d8/d23/d52/d5f/d86/d33/f73 [0,4194304] 0 2024-09-18T12:49:27.711 INFO:tasks.workunit.client.1.smithi148.stdout:9/966: stat d8/da/dd/d35/d81/dc6/dcc/c118 0 2024-09-18T12:49:27.715 INFO:tasks.workunit.client.0.smithi078.stdout:8/597: rename d0/d7/dc/lf to d0/d39/d4c/d77/d7d/lbd 0 2024-09-18T12:49:27.716 INFO:tasks.workunit.client.1.smithi148.stdout:3/917: creat d4/d8/d1e/d6b/f13e x:0 0 0 2024-09-18T12:49:27.717 INFO:tasks.workunit.client.0.smithi078.stdout:5/913: truncate d2/d4/d9/d2f/d30/f11c 2830010 0 2024-09-18T12:49:27.720 INFO:tasks.workunit.client.1.smithi148.stdout:2/873: dwrite d9/d17/d29/d92/d95/d64/f116 [0,4194304] 0 2024-09-18T12:49:27.721 INFO:tasks.workunit.client.0.smithi078.stdout:1/613: dwrite d0/d8/da/d3e/d58/d6e/d8c/d9d/db8/fc8 [0,4194304] 0 2024-09-18T12:49:27.722 INFO:tasks.workunit.client.1.smithi148.stdout:9/967: mkdir d8/da/dd/d35/d81/dc6/dcc/de0/d127 0 2024-09-18T12:49:27.726 INFO:tasks.workunit.client.1.smithi148.stdout:3/918: rmdir d4/d8/d1e/d6b 39 2024-09-18T12:49:27.730 INFO:tasks.workunit.client.0.smithi078.stdout:5/914: symlink d2/d4/d9/da/d60/d61/l121 0 2024-09-18T12:49:27.734 INFO:tasks.workunit.client.1.smithi148.stdout:9/968: mkdir d8/da/dd/d3f/d128 0 2024-09-18T12:49:27.734 INFO:tasks.workunit.client.1.smithi148.stdout:9/969: chown d8/da/dd/d4a/f11f 24227 1 2024-09-18T12:49:27.734 INFO:tasks.workunit.client.0.smithi078.stdout:8/598: dwrite d0/d7/dc/d71/d9b/faf [0,4194304] 0 2024-09-18T12:49:27.735 INFO:tasks.workunit.client.0.smithi078.stdout:1/614: mknod d0/d5b/ccc 0 2024-09-18T12:49:27.736 INFO:tasks.workunit.client.1.smithi148.stdout:2/874: creat d9/d24/d31/f12a x:0 0 0 2024-09-18T12:49:27.736 INFO:tasks.workunit.client.0.smithi078.stdout:7/489: dwrite d7/d9/d32/fa6 [4194304,4194304] 0 2024-09-18T12:49:27.738 INFO:tasks.workunit.client.1.smithi148.stdout:3/919: truncate d4/d8/f1a 3491218 0 2024-09-18T12:49:27.738 INFO:tasks.workunit.client.0.smithi078.stdout:7/490: fdatasync d7/d26/f29 0 2024-09-18T12:49:27.739 INFO:tasks.workunit.client.0.smithi078.stdout:1/615: chown d0/d5b/l6a 2 1 2024-09-18T12:49:27.739 INFO:tasks.workunit.client.0.smithi078.stdout:7/491: readlink l3 0 2024-09-18T12:49:27.741 INFO:tasks.workunit.client.0.smithi078.stdout:9/640: rename d5/d7/d32/d2a/d6b/f83 to d5/fcf 0 2024-09-18T12:49:27.744 INFO:tasks.workunit.client.0.smithi078.stdout:5/915: truncate d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/fc4 1086041 0 2024-09-18T12:49:27.745 INFO:tasks.workunit.client.0.smithi078.stdout:2/570: getdents d4/d1a 0 2024-09-18T12:49:27.747 INFO:tasks.workunit.client.0.smithi078.stdout:9/641: write d5/d7/d8/d4f/f90 [713453,34370] 0 2024-09-18T12:49:27.748 INFO:tasks.workunit.client.0.smithi078.stdout:8/599: dread d0/d39/d4c/d77/fb5 [0,4194304] 0 2024-09-18T12:49:27.760 INFO:tasks.workunit.client.0.smithi078.stdout:9/642: mknod d5/d7/d32/d2a/d6b/cd0 0 2024-09-18T12:49:27.761 INFO:tasks.workunit.client.0.smithi078.stdout:5/916: dwrite d2/d4/f66 [0,4194304] 0 2024-09-18T12:49:27.762 INFO:tasks.workunit.client.0.smithi078.stdout:2/571: dwrite d4/d8/d23/d52/d5f/d86/d33/f72 [0,4194304] 0 2024-09-18T12:49:27.763 INFO:tasks.workunit.client.0.smithi078.stdout:7/492: creat d7/d9/d14/d22/d35/d49/fa8 x:0 0 0 2024-09-18T12:49:27.764 INFO:tasks.workunit.client.0.smithi078.stdout:9/643: fsync d5/d7/d8/fb8 0 2024-09-18T12:49:27.766 INFO:tasks.workunit.client.0.smithi078.stdout:0/673: rename d3/d1f/d2e/d68/d30/ca8 to d3/d1f/d2e/d4e/cf3 0 2024-09-18T12:49:27.767 INFO:tasks.workunit.client.0.smithi078.stdout:8/600: dwrite d0/d7/fb [4194304,4194304] 0 2024-09-18T12:49:27.767 INFO:tasks.workunit.client.0.smithi078.stdout:6/812: sync 2024-09-18T12:49:27.769 INFO:tasks.workunit.client.0.smithi078.stdout:5/917: write d2/d4/f34 [1813359,54191] 0 2024-09-18T12:49:27.769 INFO:tasks.workunit.client.0.smithi078.stdout:7/493: truncate d7/d5d/f6d 873020 0 2024-09-18T12:49:27.779 INFO:tasks.workunit.client.1.smithi148.stdout:2/875: dwrite d9/d73/f8c [4194304,4194304] 0 2024-09-18T12:49:27.780 INFO:tasks.workunit.client.0.smithi078.stdout:0/674: mkdir d3/d1f/d2e/d8f/df4 0 2024-09-18T12:49:27.784 INFO:tasks.workunit.client.1.smithi148.stdout:2/876: mknod d9/d17/d29/d98/c12b 0 2024-09-18T12:49:27.785 INFO:tasks.workunit.client.0.smithi078.stdout:5/918: mknod d2/d4/d9/da/d60/db3/d16/d36/d68/c122 0 2024-09-18T12:49:27.785 INFO:tasks.workunit.client.0.smithi078.stdout:4/637: dwrite d11/d27/d89/d9f/fa2 [0,4194304] 0 2024-09-18T12:49:27.788 INFO:tasks.workunit.client.0.smithi078.stdout:9/644: rename d5/d7/d8/d98/cba to d5/d7/d32/d2a/d36/cd1 0 2024-09-18T12:49:27.789 INFO:tasks.workunit.client.0.smithi078.stdout:7/494: creat d7/d9/d14/fa9 x:0 0 0 2024-09-18T12:49:27.790 INFO:tasks.workunit.client.0.smithi078.stdout:1/616: dwrite d0/d8/da/d3e/d58/d6e/f4d [0,4194304] 0 2024-09-18T12:49:27.791 INFO:tasks.workunit.client.0.smithi078.stdout:8/601: dwrite d0/db7/d62/f81 [0,4194304] 0 2024-09-18T12:49:27.791 INFO:tasks.workunit.client.0.smithi078.stdout:0/675: mkdir d3/d82/dd7/df5 0 2024-09-18T12:49:27.794 INFO:tasks.workunit.client.0.smithi078.stdout:0/676: readlink d3/d1f/d2e/l33 0 2024-09-18T12:49:27.797 INFO:tasks.workunit.client.0.smithi078.stdout:9/645: dread - d5/d7/d32/d2a/fa3 zero size 2024-09-18T12:49:27.799 INFO:tasks.workunit.client.0.smithi078.stdout:2/572: write d4/d1a/f22 [1877459,107911] 0 2024-09-18T12:49:27.800 INFO:tasks.workunit.client.0.smithi078.stdout:9/646: truncate d5/fb9 4755772 0 2024-09-18T12:49:27.800 INFO:tasks.workunit.client.0.smithi078.stdout:2/573: chown d4/l46 438 1 2024-09-18T12:49:27.800 INFO:tasks.workunit.client.0.smithi078.stdout:7/495: mknod d7/d9/d14/d22/d35/d49/d7d/caa 0 2024-09-18T12:49:27.803 INFO:tasks.workunit.client.1.smithi148.stdout:2/877: link d9/d3a/lb9 d9/d73/d81/l12c 0 2024-09-18T12:49:27.804 INFO:tasks.workunit.client.0.smithi078.stdout:8/602: creat d0/d39/d4c/d77/fbe x:0 0 0 2024-09-18T12:49:27.806 INFO:tasks.workunit.client.0.smithi078.stdout:4/638: mkdir d11/d27/d5a/d5d/dca 0 2024-09-18T12:49:27.807 INFO:tasks.workunit.client.0.smithi078.stdout:1/617: creat d0/d5b/d6d/dc2/fcd x:0 0 0 2024-09-18T12:49:27.810 INFO:tasks.workunit.client.0.smithi078.stdout:2/574: creat d4/d8/d23/d52/d5f/d86/d3b/d4f/fb9 x:0 0 0 2024-09-18T12:49:27.810 INFO:tasks.workunit.client.0.smithi078.stdout:2/575: chown d4/db/c13 69860 1 2024-09-18T12:49:27.817 INFO:tasks.workunit.client.1.smithi148.stdout:2/878: dwrite d9/d17/d29/d92/d95/d9b/f103 [0,4194304] 0 2024-09-18T12:49:27.821 INFO:tasks.workunit.client.1.smithi148.stdout:3/920: dread d4/d8/d20/d2b/d43/fa4 [0,4194304] 0 2024-09-18T12:49:27.822 INFO:tasks.workunit.client.0.smithi078.stdout:2/576: dread - d4/d8/d23/d52/d5f/d86/d3b/f63 zero size 2024-09-18T12:49:27.824 INFO:tasks.workunit.client.1.smithi148.stdout:3/921: read f2 [4389521,52061] 0 2024-09-18T12:49:27.824 INFO:tasks.workunit.client.0.smithi078.stdout:7/496: dread d7/d26/f30 [0,4194304] 0 2024-09-18T12:49:27.825 INFO:tasks.workunit.client.0.smithi078.stdout:5/919: dwrite d2/d4/d9/da/d60/d95/f9a [0,4194304] 0 2024-09-18T12:49:27.828 INFO:tasks.workunit.client.0.smithi078.stdout:0/677: dwrite d3/d1f/d2e/d68/f2b [0,4194304] 0 2024-09-18T12:49:27.830 INFO:tasks.workunit.client.0.smithi078.stdout:7/497: write d7/d26/f29 [3585582,95468] 0 2024-09-18T12:49:27.830 INFO:tasks.workunit.client.0.smithi078.stdout:9/647: rename d5/d7/d32/d2a/d6b/l86 to d5/d7/d8/ld2 0 2024-09-18T12:49:27.833 INFO:tasks.workunit.client.0.smithi078.stdout:0/678: fsync d3/d1f/d2e/d4e/f48 0 2024-09-18T12:49:27.834 INFO:tasks.workunit.client.0.smithi078.stdout:5/920: fsync d2/d4/f89 0 2024-09-18T12:49:27.835 INFO:tasks.workunit.client.0.smithi078.stdout:1/618: link d0/d8/da/d3e/d58/lb9 d0/d8/da/d3e/d58/d6e/d8c/d9d/lce 0 2024-09-18T12:49:27.837 INFO:tasks.workunit.client.0.smithi078.stdout:8/603: link d0/db7/f89 d0/d39/dbc/fbf 0 2024-09-18T12:49:27.838 INFO:tasks.workunit.client.0.smithi078.stdout:8/604: chown d0/d7/d53/f5e 29077 1 2024-09-18T12:49:27.843 INFO:tasks.workunit.client.0.smithi078.stdout:7/498: rename d7/d3c/l63 to d7/d5d/lab 0 2024-09-18T12:49:27.843 INFO:tasks.workunit.client.0.smithi078.stdout:7/499: fdatasync d7/f90 0 2024-09-18T12:49:27.845 INFO:tasks.workunit.client.0.smithi078.stdout:0/679: unlink d3/d1f/d2e/d68/d30/c4a 0 2024-09-18T12:49:27.847 INFO:tasks.workunit.client.0.smithi078.stdout:5/921: creat d2/d4/d9/da/d60/d95/f123 x:0 0 0 2024-09-18T12:49:27.847 INFO:tasks.workunit.client.1.smithi148.stdout:4/962: sync 2024-09-18T12:49:27.847 INFO:tasks.workunit.client.1.smithi148.stdout:5/989: sync 2024-09-18T12:49:27.847 INFO:tasks.workunit.client.1.smithi148.stdout:7/930: sync 2024-09-18T12:49:27.848 INFO:tasks.workunit.client.1.smithi148.stdout:6/965: sync 2024-09-18T12:49:27.848 INFO:tasks.workunit.client.1.smithi148.stdout:1/994: sync 2024-09-18T12:49:27.849 INFO:tasks.workunit.client.1.smithi148.stdout:7/931: fsync db/d52/d4f/fc7 0 2024-09-18T12:49:27.850 INFO:tasks.workunit.client.1.smithi148.stdout:7/932: dread - db/dc/df/d5f/dcb/dd5/fdb zero size 2024-09-18T12:49:27.850 INFO:tasks.workunit.client.1.smithi148.stdout:4/963: write d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/f10a [906813,103614] 0 2024-09-18T12:49:27.852 INFO:tasks.workunit.client.0.smithi078.stdout:1/619: mkdir d0/d8/daa/db5/dc0/dcf 0 2024-09-18T12:49:27.853 INFO:tasks.workunit.client.0.smithi078.stdout:8/605: creat d0/d7/d53/d57/d67/fc0 x:0 0 0 2024-09-18T12:49:27.854 INFO:tasks.workunit.client.1.smithi148.stdout:1/995: dwrite dc/d18/d8a/df1/f102 [0,4194304] 0 2024-09-18T12:49:27.855 INFO:tasks.workunit.client.0.smithi078.stdout:1/620: chown d0/d8/da/d3e/d58/l9c 958 1 2024-09-18T12:49:27.858 INFO:tasks.workunit.client.0.smithi078.stdout:7/500: symlink d7/d9/d32/d3b/lac 0 2024-09-18T12:49:27.858 INFO:tasks.workunit.client.0.smithi078.stdout:4/639: dwrite d11/d27/d5a/f79 [0,4194304] 0 2024-09-18T12:49:27.860 INFO:tasks.workunit.client.0.smithi078.stdout:4/640: chown c0 1428 1 2024-09-18T12:49:27.867 INFO:tasks.workunit.client.0.smithi078.stdout:1/621: dwrite d0/d8/da/d3e/d58/d6e/d52/f78 [0,4194304] 0 2024-09-18T12:49:27.867 INFO:tasks.workunit.client.0.smithi078.stdout:9/648: write d5/d7/f25 [702687,89239] 0 2024-09-18T12:49:27.870 INFO:tasks.workunit.client.0.smithi078.stdout:1/622: chown d0/d5b/d6d/f7e 21871835 1 2024-09-18T12:49:27.870 INFO:tasks.workunit.client.0.smithi078.stdout:0/680: dread d3/d1f/d2e/d4e/d37/f5c [0,4194304] 0 2024-09-18T12:49:27.870 INFO:tasks.workunit.client.0.smithi078.stdout:1/623: readlink d0/d5b/l6a 0 2024-09-18T12:49:27.881 INFO:tasks.workunit.client.1.smithi148.stdout:5/990: mknod d7/d2b/d13d/d4b/dd6/c148 0 2024-09-18T12:49:27.885 INFO:tasks.workunit.client.1.smithi148.stdout:2/879: creat d9/d17/d29/d92/dff/f12d x:0 0 0 2024-09-18T12:49:27.889 INFO:tasks.workunit.client.1.smithi148.stdout:5/991: mknod d7/d8/dc/da6/dee/d39/d139/c149 0 2024-09-18T12:49:27.890 INFO:tasks.workunit.client.1.smithi148.stdout:4/964: creat d15/d17/d52/d92/d4c/dd0/dd6/d12d/f13e x:0 0 0 2024-09-18T12:49:27.892 INFO:tasks.workunit.client.1.smithi148.stdout:1/996: creat dc/d18/d7d/d93/dd9/d105/f14f x:0 0 0 2024-09-18T12:49:27.892 INFO:tasks.workunit.client.1.smithi148.stdout:1/997: chown dc/d18/d31/dc6/d110/d13f 3 1 2024-09-18T12:49:27.894 INFO:tasks.workunit.client.0.smithi078.stdout:1/624: dread d0/d8/da/d3e/d58/d6e/f5a [0,4194304] 0 2024-09-18T12:49:27.897 INFO:tasks.workunit.client.0.smithi078.stdout:5/922: mknod d2/d4/d9/da/d60/db3/d16/d36/db0/d105/c124 0 2024-09-18T12:49:27.898 INFO:tasks.workunit.client.0.smithi078.stdout:8/606: rmdir d0 39 2024-09-18T12:49:27.898 INFO:tasks.workunit.client.0.smithi078.stdout:5/923: write d2/d4/d9/da/d60/d61/f112 [1009723,111134] 0 2024-09-18T12:49:27.899 INFO:tasks.workunit.client.1.smithi148.stdout:5/992: dread - d7/d8/d18/d3f/d7c/fef zero size 2024-09-18T12:49:27.900 INFO:tasks.workunit.client.1.smithi148.stdout:5/993: fdatasync d7/d2b/d13d/d4b/dd6/fec 0 2024-09-18T12:49:27.901 INFO:tasks.workunit.client.1.smithi148.stdout:4/965: unlink d15/d5f/d69/d7f/l137 0 2024-09-18T12:49:27.901 INFO:tasks.workunit.client.0.smithi078.stdout:7/501: symlink d7/d26/d84/lad 0 2024-09-18T12:49:27.903 INFO:tasks.workunit.client.1.smithi148.stdout:1/998: mknod dc/d18/d31/dc6/d110/d11c/c150 0 2024-09-18T12:49:27.903 INFO:tasks.workunit.client.0.smithi078.stdout:4/641: dread - d11/d27/d47/fa4 zero size 2024-09-18T12:49:27.904 INFO:tasks.workunit.client.0.smithi078.stdout:4/642: stat d11/d27/d5a/d5d 0 2024-09-18T12:49:27.906 INFO:tasks.workunit.client.1.smithi148.stdout:6/966: getdents d5/d1a/dc/d2b/d35 0 2024-09-18T12:49:27.906 INFO:tasks.workunit.client.0.smithi078.stdout:9/649: mknod d5/d7/d32/cd3 0 2024-09-18T12:49:27.907 INFO:tasks.workunit.client.1.smithi148.stdout:6/967: truncate d5/d32/d38/d50/de7/f11a 511463 0 2024-09-18T12:49:27.912 INFO:tasks.workunit.client.0.smithi078.stdout:1/625: truncate d0/d5b/d6d/f7e 1405023 0 2024-09-18T12:49:27.914 INFO:tasks.workunit.client.1.smithi148.stdout:5/994: dread d7/d2b/fdd [0,4194304] 0 2024-09-18T12:49:27.915 INFO:tasks.workunit.client.0.smithi078.stdout:5/924: rmdir d2/d4/d9/da/d60/db3/d16/d36/d68/d8b 39 2024-09-18T12:49:27.917 INFO:tasks.workunit.client.1.smithi148.stdout:1/999: dread dc/d18/d31/faf [0,4194304] 0 2024-09-18T12:49:27.917 INFO:tasks.workunit.client.0.smithi078.stdout:7/502: unlink d7/d9/d14/d22/d3e/c91 0 2024-09-18T12:49:27.917 INFO:tasks.workunit.client.0.smithi078.stdout:5/925: read d2/d4/d9/da/d60/db3/f1b [597171,22258] 0 2024-09-18T12:49:27.918 INFO:tasks.workunit.client.0.smithi078.stdout:1/626: dwrite d0/fca [0,4194304] 0 2024-09-18T12:49:27.921 INFO:tasks.workunit.client.0.smithi078.stdout:4/643: rename d11/d27/d47/d78/d95/fad to d11/d27/d89/fcb 0 2024-09-18T12:49:27.922 INFO:tasks.workunit.client.0.smithi078.stdout:5/926: truncate d2/d4/d9/da/d60/db3/d16/d36/fcc 1276381 0 2024-09-18T12:49:27.923 INFO:tasks.workunit.client.1.smithi148.stdout:6/968: mknod d5/d32/d38/c13a 0 2024-09-18T12:49:27.924 INFO:tasks.workunit.client.0.smithi078.stdout:9/650: write d5/d7/d32/d2a/f72 [1841966,77474] 0 2024-09-18T12:49:27.925 INFO:tasks.workunit.client.1.smithi148.stdout:5/995: rmdir d7/d8/dc/da6/d129 39 2024-09-18T12:49:27.925 INFO:tasks.workunit.client.0.smithi078.stdout:9/651: chown d5/d7/d32/c9b 226 1 2024-09-18T12:49:27.926 INFO:tasks.workunit.client.0.smithi078.stdout:0/681: creat d3/d1f/d2e/d68/d30/d7c/da3/de2/ff6 x:0 0 0 2024-09-18T12:49:27.928 INFO:tasks.workunit.client.0.smithi078.stdout:8/607: rmdir d0/d7/dc 39 2024-09-18T12:49:27.931 INFO:tasks.workunit.client.0.smithi078.stdout:7/503: creat d7/d26/fae x:0 0 0 2024-09-18T12:49:27.932 INFO:tasks.workunit.client.1.smithi148.stdout:6/969: creat d5/d1a/dc/f13b x:0 0 0 2024-09-18T12:49:27.933 INFO:tasks.workunit.client.1.smithi148.stdout:5/996: dread d7/d2b/d13d/d4b/f4c [0,4194304] 0 2024-09-18T12:49:27.934 INFO:tasks.workunit.client.0.smithi078.stdout:1/627: mknod d0/d5b/d6d/cd0 0 2024-09-18T12:49:27.935 INFO:tasks.workunit.client.0.smithi078.stdout:1/628: chown d0/d8/da/d3e/d58/d6e/d52/d47/f69 496787317 1 2024-09-18T12:49:27.936 INFO:tasks.workunit.client.0.smithi078.stdout:1/629: stat d0/d8/daa/db5/fc6 0 2024-09-18T12:49:27.936 INFO:tasks.workunit.client.0.smithi078.stdout:1/630: fdatasync d0/f6c 0 2024-09-18T12:49:27.936 INFO:tasks.workunit.client.1.smithi148.stdout:9/970: sync 2024-09-18T12:49:27.938 INFO:tasks.workunit.client.1.smithi148.stdout:6/970: rename d5/d32/d56/f78 to d5/d1a/dc/d101/da3/f13c 0 2024-09-18T12:49:27.938 INFO:tasks.workunit.client.1.smithi148.stdout:3/922: write d4/d8/d20/f2f [715943,103615] 0 2024-09-18T12:49:27.940 INFO:tasks.workunit.client.1.smithi148.stdout:6/971: mkdir d5/d1a/dc/d2b/d13d 0 2024-09-18T12:49:27.941 INFO:tasks.workunit.client.0.smithi078.stdout:7/504: mkdir d7/d9/d14/d22/d35/d49/d56/d8d/daf 0 2024-09-18T12:49:27.946 INFO:tasks.workunit.client.1.smithi148.stdout:2/880: write d9/d73/d81/fae [2340325,4686] 0 2024-09-18T12:49:27.948 INFO:tasks.workunit.client.1.smithi148.stdout:6/972: creat d5/d1a/dc/d101/da4/d136/f13e x:0 0 0 2024-09-18T12:49:27.950 INFO:tasks.workunit.client.1.smithi148.stdout:6/973: fsync d5/d32/d38/d50/de7/f11a 0 2024-09-18T12:49:27.950 INFO:tasks.workunit.client.1.smithi148.stdout:9/971: link d8/da/dd/d4a/d27/lbb d8/da/dd/d35/l129 0 2024-09-18T12:49:27.951 INFO:tasks.workunit.client.1.smithi148.stdout:6/974: write d5/d32/d56/f4d [2358045,86911] 0 2024-09-18T12:49:27.952 INFO:tasks.workunit.client.0.smithi078.stdout:4/644: link d11/d27/d47/d4e/d76/c83 d11/d27/d5a/d84/db0/ccc 0 2024-09-18T12:49:27.953 INFO:tasks.workunit.client.1.smithi148.stdout:6/975: write d5/d32/d38/d50/de7/d7c/fdc [3720797,38160] 0 2024-09-18T12:49:27.955 INFO:tasks.workunit.client.1.smithi148.stdout:9/972: mkdir d8/da/dd/d4a/d49/d12a 0 2024-09-18T12:49:27.956 INFO:tasks.workunit.client.1.smithi148.stdout:3/923: dread d4/d8/d1e/d6b/d31/d54/f8a [0,4194304] 0 2024-09-18T12:49:27.956 INFO:tasks.workunit.client.1.smithi148.stdout:4/966: write d15/d17/d52/d68/fd2 [345676,67660] 0 2024-09-18T12:49:27.957 INFO:tasks.workunit.client.1.smithi148.stdout:2/881: creat d9/d24/d67/d72/d107/d115/f12e x:0 0 0 2024-09-18T12:49:27.958 INFO:tasks.workunit.client.0.smithi078.stdout:9/652: creat d5/d7/d32/d2a/fd4 x:0 0 0 2024-09-18T12:49:27.958 INFO:tasks.workunit.client.0.smithi078.stdout:9/653: stat d5/dc6 0 2024-09-18T12:49:27.960 INFO:tasks.workunit.client.0.smithi078.stdout:8/608: creat d0/d7/dc/d1f/d23/d40/fc1 x:0 0 0 2024-09-18T12:49:27.962 INFO:tasks.workunit.client.1.smithi148.stdout:6/976: rename d5/d1a/dc/d2b/d35/d65/f4b to d5/d1a/dc/d2b/d35/d9c/f13f 0 2024-09-18T12:49:27.963 INFO:tasks.workunit.client.1.smithi148.stdout:9/973: dwrite d8/da/dd/d77/ff0 [0,4194304] 0 2024-09-18T12:49:27.964 INFO:tasks.workunit.client.0.smithi078.stdout:4/645: mknod d11/d27/d5a/ccd 0 2024-09-18T12:49:27.968 INFO:tasks.workunit.client.1.smithi148.stdout:2/882: symlink d9/d17/d29/d92/d95/l12f 0 2024-09-18T12:49:27.971 INFO:tasks.workunit.client.0.smithi078.stdout:8/609: mkdir d0/d7/dc/d71/d9b/dc2 0 2024-09-18T12:49:27.972 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:27 smithi148 ceph-mon[35352]: pgmap v21: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 118 MiB/s rd, 289 MiB/s wr, 536 op/s 2024-09-18T12:49:27.973 INFO:tasks.workunit.client.0.smithi078.stdout:5/927: getdents d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/df3 0 2024-09-18T12:49:27.974 INFO:tasks.workunit.client.0.smithi078.stdout:1/631: write d0/f89 [2771542,92546] 0 2024-09-18T12:49:27.974 INFO:tasks.workunit.client.0.smithi078.stdout:1/632: chown d0/d8/f38 2831291 1 2024-09-18T12:49:27.975 INFO:tasks.workunit.client.0.smithi078.stdout:3/529: sync 2024-09-18T12:49:27.977 INFO:tasks.workunit.client.1.smithi148.stdout:2/883: mknod d9/d24/d47/c130 0 2024-09-18T12:49:27.978 INFO:tasks.workunit.client.1.smithi148.stdout:2/884: write d9/d24/d31/fc8 [2669646,29017] 0 2024-09-18T12:49:27.980 INFO:tasks.workunit.client.0.smithi078.stdout:8/610: chown d0/d7/d53/d57/l8e 674 1 2024-09-18T12:49:27.980 INFO:tasks.workunit.client.1.smithi148.stdout:6/977: mknod d5/d1a/dc/d101/c140 0 2024-09-18T12:49:27.982 INFO:tasks.workunit.client.0.smithi078.stdout:7/505: dwrite d7/f65 [0,4194304] 0 2024-09-18T12:49:27.982 INFO:tasks.workunit.client.0.smithi078.stdout:5/928: chown d2/d4/d9/da/d2b/d3e/cd5 41142 1 2024-09-18T12:49:27.982 INFO:tasks.workunit.client.0.smithi078.stdout:7/506: chown d7/d26/d84/l8b 596487 1 2024-09-18T12:49:27.984 INFO:tasks.workunit.client.1.smithi148.stdout:9/974: creat d8/da/dd/d35/d124/f12b x:0 0 0 2024-09-18T12:49:27.990 INFO:tasks.workunit.client.0.smithi078.stdout:3/530: stat c4 0 2024-09-18T12:49:27.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:27 smithi078 ceph-mon[28091]: pgmap v21: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 118 MiB/s rd, 289 MiB/s wr, 536 op/s 2024-09-18T12:49:27.992 INFO:tasks.workunit.client.1.smithi148.stdout:2/885: mkdir d9/d24/d67/dc7/d131 0 2024-09-18T12:49:27.993 INFO:tasks.workunit.client.1.smithi148.stdout:6/978: creat d5/d1a/dc/d101/da4/de2/f141 x:0 0 0 2024-09-18T12:49:27.994 INFO:tasks.workunit.client.0.smithi078.stdout:9/654: creat d5/d7/d32/d2a/d6b/fd5 x:0 0 0 2024-09-18T12:49:27.995 INFO:tasks.workunit.client.0.smithi078.stdout:9/655: stat d5/d7/d8/f6a 0 2024-09-18T12:49:27.995 INFO:tasks.workunit.client.1.smithi148.stdout:3/924: link d4/d8/c19 d4/d8/d1e/d6b/d31/d46/c13f 0 2024-09-18T12:49:27.995 INFO:tasks.workunit.client.1.smithi148.stdout:4/967: dwrite d15/fc6 [4194304,4194304] 0 2024-09-18T12:49:27.996 INFO:tasks.workunit.client.0.smithi078.stdout:7/507: symlink d7/d9/d14/d22/d35/d49/d7d/lb0 0 2024-09-18T12:49:27.997 INFO:tasks.workunit.client.1.smithi148.stdout:7/933: sync 2024-09-18T12:49:28.000 INFO:tasks.workunit.client.1.smithi148.stdout:2/886: creat d9/d24/d67/dc7/ddd/f132 x:0 0 0 2024-09-18T12:49:28.000 INFO:tasks.workunit.client.1.smithi148.stdout:2/887: stat d9/ffb 0 2024-09-18T12:49:28.001 INFO:tasks.workunit.client.0.smithi078.stdout:5/929: mknod d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/c125 0 2024-09-18T12:49:28.001 INFO:tasks.workunit.client.0.smithi078.stdout:5/930: chown d2/d4/d9/da/d60/db3/d16/d36/db0/dde/l6b 6972 1 2024-09-18T12:49:28.002 INFO:tasks.workunit.client.0.smithi078.stdout:3/531: fdatasync d9/d13/d33/f51 0 2024-09-18T12:49:28.004 INFO:tasks.workunit.client.0.smithi078.stdout:4/646: truncate d11/d27/d5a/d5d/f90 2986343 0 2024-09-18T12:49:28.006 INFO:tasks.workunit.client.0.smithi078.stdout:3/532: read f7 [5266828,26305] 0 2024-09-18T12:49:28.006 INFO:tasks.workunit.client.0.smithi078.stdout:3/533: stat d9/d54/d6c 0 2024-09-18T12:49:28.007 INFO:tasks.workunit.client.0.smithi078.stdout:3/534: chown d9/d13/d33/d3c/d19 77162 1 2024-09-18T12:49:28.010 INFO:tasks.workunit.client.0.smithi078.stdout:1/633: rename d0/ca9 to d0/d8/da/d3e/d58/d6e/d52/cd1 0 2024-09-18T12:49:28.012 INFO:tasks.workunit.client.1.smithi148.stdout:6/979: mknod d5/d1a/d3d/c142 0 2024-09-18T12:49:28.014 INFO:tasks.workunit.client.0.smithi078.stdout:9/656: unlink d5/d7/f62 0 2024-09-18T12:49:28.015 INFO:tasks.workunit.client.0.smithi078.stdout:1/634: dread d0/d8/f3f [0,4194304] 0 2024-09-18T12:49:28.015 INFO:tasks.workunit.client.0.smithi078.stdout:9/657: dread - d5/d7/d8/d4f/fbc zero size 2024-09-18T12:49:28.015 INFO:tasks.workunit.client.1.smithi148.stdout:4/968: write d15/d17/f115 [748116,58925] 0 2024-09-18T12:49:28.018 INFO:tasks.workunit.client.1.smithi148.stdout:3/925: read d4/d8/d6a/db3/db7/dcb/fe0 [104291,7899] 0 2024-09-18T12:49:28.018 INFO:tasks.workunit.client.0.smithi078.stdout:5/931: rmdir d2/d4/d9/da/d60/db3/d16/d36/d4c/d97/db1 39 2024-09-18T12:49:28.020 INFO:tasks.workunit.client.0.smithi078.stdout:5/932: write d2/d4/d9/da/d60/db3/d16/dd2/fc7 [92978,54063] 0 2024-09-18T12:49:28.021 INFO:tasks.workunit.client.0.smithi078.stdout:5/933: stat d2/d4/d9/da/d2b/d3e/fa9 0 2024-09-18T12:49:28.021 INFO:tasks.workunit.client.0.smithi078.stdout:5/934: fsync d2/d4/f4f 0 2024-09-18T12:49:28.028 INFO:tasks.workunit.client.0.smithi078.stdout:3/535: symlink d9/d2f/d43/la5 0 2024-09-18T12:49:28.029 INFO:tasks.workunit.client.1.smithi148.stdout:9/975: truncate d8/da/dd/d77/ff0 464403 0 2024-09-18T12:49:28.030 INFO:tasks.workunit.client.1.smithi148.stdout:9/976: fsync d8/da/dd/d4a/f15 0 2024-09-18T12:49:28.031 INFO:tasks.workunit.client.1.smithi148.stdout:4/969: rename d15/d17/d52/d92/d4c/d4f/d64/l87 to d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/dde/l13f 0 2024-09-18T12:49:28.032 INFO:tasks.workunit.client.1.smithi148.stdout:3/926: rmdir d4/d8/d20/d2b/d7f/dd9 39 2024-09-18T12:49:28.033 INFO:tasks.workunit.client.0.smithi078.stdout:1/635: mknod d0/cd2 0 2024-09-18T12:49:28.034 INFO:tasks.workunit.client.1.smithi148.stdout:2/888: mkdir d9/d73/d81/de1/d133 0 2024-09-18T12:49:28.035 INFO:tasks.workunit.client.1.smithi148.stdout:2/889: chown d9/d24/d47/lb7 0 1 2024-09-18T12:49:28.038 INFO:tasks.workunit.client.0.smithi078.stdout:4/647: fsync d11/d27/d5a/f64 0 2024-09-18T12:49:28.040 INFO:tasks.workunit.client.0.smithi078.stdout:3/536: creat d9/d13/d33/d3c/d19/fa6 x:0 0 0 2024-09-18T12:49:28.040 INFO:tasks.workunit.client.1.smithi148.stdout:9/977: chown d8/da/dd/d77/cf2 39 1 2024-09-18T12:49:28.041 INFO:tasks.workunit.client.0.smithi078.stdout:1/636: mkdir d0/d8/da/d3e/d58/d6e/d8c/dd3 0 2024-09-18T12:49:28.045 INFO:tasks.workunit.client.0.smithi078.stdout:4/648: dwrite d11/d27/d47/f5f [0,4194304] 0 2024-09-18T12:49:28.046 INFO:tasks.workunit.client.0.smithi078.stdout:4/649: chown d11/d27/d5a/d84/l6b 33518490 1 2024-09-18T12:49:28.046 INFO:tasks.workunit.client.0.smithi078.stdout:7/508: creat d7/d9/d14/d22/fb1 x:0 0 0 2024-09-18T12:49:28.048 INFO:tasks.workunit.client.1.smithi148.stdout:5/997: sync 2024-09-18T12:49:28.051 INFO:tasks.workunit.client.1.smithi148.stdout:7/934: link db/dc/df/d11/l54 db/dc/df/d2c/l11e 0 2024-09-18T12:49:28.052 INFO:tasks.workunit.client.1.smithi148.stdout:3/927: dread d4/d8/f24 [0,4194304] 0 2024-09-18T12:49:28.053 INFO:tasks.workunit.client.0.smithi078.stdout:3/537: creat d9/d54/fa7 x:0 0 0 2024-09-18T12:49:28.053 INFO:tasks.workunit.client.0.smithi078.stdout:4/650: dwrite d11/fc9 [0,4194304] 0 2024-09-18T12:49:28.055 INFO:tasks.workunit.client.0.smithi078.stdout:7/509: mkdir d7/d9/d14/d22/d3e/d95/db2 0 2024-09-18T12:49:28.056 INFO:tasks.workunit.client.1.smithi148.stdout:9/978: symlink d8/da/dd/d35/d47/l12c 0 2024-09-18T12:49:28.058 INFO:tasks.workunit.client.1.smithi148.stdout:4/970: creat d15/d17/d52/d92/d4c/d4f/d64/da0/da1/dcf/d12e/f140 x:0 0 0 2024-09-18T12:49:28.065 INFO:tasks.workunit.client.0.smithi078.stdout:4/651: creat d11/d27/d5a/d84/d40/dc7/fce x:0 0 0 2024-09-18T12:49:28.068 INFO:tasks.workunit.client.1.smithi148.stdout:7/935: symlink db/dc/df/d2c/d55/l11f 0 2024-09-18T12:49:28.068 INFO:tasks.workunit.client.1.smithi148.stdout:6/980: write d5/f2e [2319895,68596] 0 2024-09-18T12:49:28.070 INFO:tasks.workunit.client.1.smithi148.stdout:6/981: dread - d5/d1a/dc/d101/da4/de2/f104 zero size 2024-09-18T12:49:28.074 INFO:tasks.workunit.client.0.smithi078.stdout:4/652: link d11/d27/d5a/d84/d40/f6f d11/d27/d60/fcf 0 2024-09-18T12:49:28.075 INFO:tasks.workunit.client.0.smithi078.stdout:4/653: truncate d11/d27/d47/d4e/fc8 768376 0 2024-09-18T12:49:28.078 INFO:tasks.workunit.client.1.smithi148.stdout:9/979: symlink d8/da/dd/d4a/d49/d46/l12d 0 2024-09-18T12:49:28.079 INFO:tasks.workunit.client.1.smithi148.stdout:9/980: truncate d8/f11c 1335802 0 2024-09-18T12:49:28.080 INFO:tasks.workunit.client.1.smithi148.stdout:6/982: truncate d5/d32/d38/d50/f97 6662 0 2024-09-18T12:49:28.081 INFO:tasks.workunit.client.0.smithi078.stdout:4/654: mkdir d11/d27/d5a/d84/d4b/da7/dba/dc4/dd0 0 2024-09-18T12:49:28.082 INFO:tasks.workunit.client.1.smithi148.stdout:4/971: mkdir d15/d17/d52/d92/d141 0 2024-09-18T12:49:28.083 INFO:tasks.workunit.client.0.smithi078.stdout:3/538: dread d9/d13/d33/d34/f82 [0,4194304] 0 2024-09-18T12:49:28.083 INFO:tasks.workunit.client.0.smithi078.stdout:4/655: write d11/d27/d47/d4e/d76/f8f [423036,33634] 0 2024-09-18T12:49:28.083 INFO:tasks.workunit.client.1.smithi148.stdout:4/972: write d15/d17/d52/d68/f122 [186722,24982] 0 2024-09-18T12:49:28.084 INFO:tasks.workunit.client.0.smithi078.stdout:4/656: fdatasync d11/d27/d47/d4e/fc8 0 2024-09-18T12:49:28.085 INFO:tasks.workunit.client.1.smithi148.stdout:4/973: fdatasync d15/d17/d52/d92/d4c/d4f/d64/da0/da1/dcf/d12e/f140 0 2024-09-18T12:49:28.086 INFO:tasks.workunit.client.1.smithi148.stdout:2/890: getdents d9/d24/d67/d72/d77 0 2024-09-18T12:49:28.087 INFO:tasks.workunit.client.1.smithi148.stdout:3/928: creat d4/d8/d20/d2b/d7f/d93/d94/f140 x:0 0 0 2024-09-18T12:49:28.087 INFO:tasks.workunit.client.1.smithi148.stdout:5/998: write d7/d8/dc/da6/dee/d77/f9b [4006725,20359] 0 2024-09-18T12:49:28.089 INFO:tasks.workunit.client.1.smithi148.stdout:9/981: mknod d8/da/dd/d35/d81/dc6/dcc/c12e 0 2024-09-18T12:49:28.091 INFO:tasks.workunit.client.1.smithi148.stdout:6/983: rmdir d5/d32/d56/d116 39 2024-09-18T12:49:28.092 INFO:tasks.workunit.client.1.smithi148.stdout:9/982: truncate d8/ff4 391158 0 2024-09-18T12:49:28.094 INFO:tasks.workunit.client.1.smithi148.stdout:2/891: symlink d9/d24/d67/d72/d107/l134 0 2024-09-18T12:49:28.095 INFO:tasks.workunit.client.0.smithi078.stdout:7/510: dwrite d7/d9/d14/d22/f57 [0,4194304] 0 2024-09-18T12:49:28.095 INFO:tasks.workunit.client.1.smithi148.stdout:5/999: dwrite d7/d8/dc/da6/dee/d39/f10a [0,4194304] 0 2024-09-18T12:49:28.099 INFO:tasks.workunit.client.1.smithi148.stdout:9/983: dwrite d8/da/dd/d4a/f15 [4194304,4194304] 0 2024-09-18T12:49:28.101 INFO:tasks.workunit.client.1.smithi148.stdout:7/936: dread db/dc/df/f29 [0,4194304] 0 2024-09-18T12:49:28.101 INFO:tasks.workunit.client.1.smithi148.stdout:9/984: stat d8/d73/l119 0 2024-09-18T12:49:28.101 INFO:tasks.workunit.client.0.smithi078.stdout:7/511: mknod d7/d5d/d7a/cb3 0 2024-09-18T12:49:28.103 INFO:tasks.workunit.client.1.smithi148.stdout:9/985: stat d8/da/dd/d35/d81/dc6/dcc/de0/d127 0 2024-09-18T12:49:28.105 INFO:tasks.workunit.client.0.smithi078.stdout:4/657: link d11/d27/f48 d11/d27/d47/fd1 0 2024-09-18T12:49:28.109 INFO:tasks.workunit.client.1.smithi148.stdout:2/892: mkdir d9/d24/d31/d34/d7b/d135 0 2024-09-18T12:49:28.110 INFO:tasks.workunit.client.0.smithi078.stdout:4/658: mknod d11/d27/d47/d4e/d50/cd2 0 2024-09-18T12:49:28.112 INFO:tasks.workunit.client.1.smithi148.stdout:7/937: rmdir db/dc/df/d11/ddc/d75 39 2024-09-18T12:49:28.113 INFO:tasks.workunit.client.1.smithi148.stdout:9/986: stat d8/da/fb 0 2024-09-18T12:49:28.117 INFO:tasks.workunit.client.0.smithi078.stdout:4/659: creat d11/d27/d89/fd3 x:0 0 0 2024-09-18T12:49:28.117 INFO:tasks.workunit.client.0.smithi078.stdout:3/539: dwrite d9/d13/d33/d3c/f87 [0,4194304] 0 2024-09-18T12:49:28.119 INFO:tasks.workunit.client.1.smithi148.stdout:3/929: dwrite d4/d8/d6a/db3/db7/dcb/fe0 [0,4194304] 0 2024-09-18T12:49:28.120 INFO:tasks.workunit.client.1.smithi148.stdout:3/930: readlink d4/d8/d1e/d6b/d31/l52 0 2024-09-18T12:49:28.120 INFO:tasks.workunit.client.1.smithi148.stdout:2/893: creat d9/d24/d47/f136 x:0 0 0 2024-09-18T12:49:28.121 INFO:tasks.workunit.client.1.smithi148.stdout:7/938: creat db/dc/df/d11/d43/d89/f120 x:0 0 0 2024-09-18T12:49:28.124 INFO:tasks.workunit.client.0.smithi078.stdout:4/660: dwrite d11/d27/d5a/d84/f2d [0,4194304] 0 2024-09-18T12:49:28.125 INFO:tasks.workunit.client.1.smithi148.stdout:9/987: mkdir d8/da/dd/d35/d124/d12f 0 2024-09-18T12:49:28.125 INFO:tasks.workunit.client.1.smithi148.stdout:2/894: write d9/d17/d29/d92/d95/f11c [172759,115671] 0 2024-09-18T12:49:28.127 INFO:tasks.workunit.client.1.smithi148.stdout:3/931: truncate d4/d8/d1e/d6b/d31/d54/fcc 1880443 0 2024-09-18T12:49:28.131 INFO:tasks.workunit.client.1.smithi148.stdout:9/988: symlink d8/da/dd/d35/d47/d4e/l130 0 2024-09-18T12:49:28.136 INFO:tasks.workunit.client.1.smithi148.stdout:2/895: rename d9/d24/d67/fdf to d9/d73/d104/f137 0 2024-09-18T12:49:28.137 INFO:tasks.workunit.client.0.smithi078.stdout:7/512: dread d7/d9/d4d/d6f/f8a [0,4194304] 0 2024-09-18T12:49:28.139 INFO:tasks.workunit.client.1.smithi148.stdout:3/932: creat d4/d8/d1e/d63/d9b/f141 x:0 0 0 2024-09-18T12:49:28.140 INFO:tasks.workunit.client.0.smithi078.stdout:4/661: truncate d11/d27/d5a/d84/f72 3720918 0 2024-09-18T12:49:28.142 INFO:tasks.workunit.client.1.smithi148.stdout:6/984: write d5/d32/d38/d50/f97 [65918,76819] 0 2024-09-18T12:49:28.145 INFO:tasks.workunit.client.1.smithi148.stdout:4/974: dwrite d15/d17/d52/f65 [0,4194304] 0 2024-09-18T12:49:28.147 INFO:tasks.workunit.client.0.smithi078.stdout:3/540: write d9/d54/f68 [96974,66007] 0 2024-09-18T12:49:28.149 INFO:tasks.workunit.client.1.smithi148.stdout:9/989: dwrite d8/da/dd/d4a/ff6 [8388608,4194304] 0 2024-09-18T12:49:28.149 INFO:tasks.workunit.client.1.smithi148.stdout:2/896: mkdir d9/d24/d31/d34/d138 0 2024-09-18T12:49:28.150 INFO:tasks.workunit.client.0.smithi078.stdout:4/662: unlink d11/cac 0 2024-09-18T12:49:28.151 INFO:tasks.workunit.client.1.smithi148.stdout:3/933: chown d4/d8/d20/d99/cb5 119 1 2024-09-18T12:49:28.151 INFO:tasks.workunit.client.0.smithi078.stdout:3/541: mknod d9/d54/d7f/d9c/ca8 0 2024-09-18T12:49:28.152 INFO:tasks.workunit.client.1.smithi148.stdout:3/934: write d4/d8/d1e/d63/d10b/f127 [203262,32511] 0 2024-09-18T12:49:28.153 INFO:tasks.workunit.client.0.smithi078.stdout:4/663: write d11/f1d [407142,65916] 0 2024-09-18T12:49:28.154 INFO:tasks.workunit.client.0.smithi078.stdout:7/513: getdents d7/d9/d14/d22 0 2024-09-18T12:49:28.155 INFO:tasks.workunit.client.1.smithi148.stdout:9/990: rmdir d8/d6f 39 2024-09-18T12:49:28.156 INFO:tasks.workunit.client.1.smithi148.stdout:2/897: dread d9/d24/f3f [0,4194304] 0 2024-09-18T12:49:28.157 INFO:tasks.workunit.client.0.smithi078.stdout:7/514: fdatasync d7/d9/d14/d22/fb1 0 2024-09-18T12:49:28.157 INFO:tasks.workunit.client.1.smithi148.stdout:4/975: symlink d15/d17/d52/d92/d4c/d4f/l142 0 2024-09-18T12:49:28.158 INFO:tasks.workunit.client.0.smithi078.stdout:3/542: creat d9/df/fa9 x:0 0 0 2024-09-18T12:49:28.160 INFO:tasks.workunit.client.0.smithi078.stdout:3/543: write d9/d13/d33/d3c/d19/f22 [4786562,42481] 0 2024-09-18T12:49:28.160 INFO:tasks.workunit.client.0.smithi078.stdout:4/664: rename d11/d27/d47/d78/d95/fbe to d11/d27/d5a/d84/d40/dc7/fd4 0 2024-09-18T12:49:28.162 INFO:tasks.workunit.client.0.smithi078.stdout:7/515: creat d7/d26/d84/fb4 x:0 0 0 2024-09-18T12:49:28.165 INFO:tasks.workunit.client.1.smithi148.stdout:9/991: mkdir d8/d131 0 2024-09-18T12:49:28.167 INFO:tasks.workunit.client.1.smithi148.stdout:3/935: creat d4/d8/d1e/d6b/f142 x:0 0 0 2024-09-18T12:49:28.168 INFO:tasks.workunit.client.1.smithi148.stdout:4/976: dwrite d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/d11e/f109 [0,4194304] 0 2024-09-18T12:49:28.168 INFO:tasks.workunit.client.1.smithi148.stdout:9/992: chown d8/da/dd/d4a/d49/d46/d54/d90/fb2 4830888 1 2024-09-18T12:49:28.168 INFO:tasks.workunit.client.1.smithi148.stdout:7/939: truncate db/dc/df/d11/f6b 3434775 0 2024-09-18T12:49:28.171 INFO:tasks.workunit.client.0.smithi078.stdout:3/544: mknod d9/d13/caa 0 2024-09-18T12:49:28.176 INFO:tasks.workunit.client.1.smithi148.stdout:9/993: read d8/da/dd/d4a/fdd [112314,84207] 0 2024-09-18T12:49:28.183 INFO:tasks.workunit.client.1.smithi148.stdout:6/985: dread d5/d32/d38/d50/f95 [0,4194304] 0 2024-09-18T12:49:28.184 INFO:tasks.workunit.client.0.smithi078.stdout:3/545: mknod d9/d54/d89/d92/cab 0 2024-09-18T12:49:28.185 INFO:tasks.workunit.client.0.smithi078.stdout:4/665: link d11/d27/d5a/d84/d40/c8d d11/cd5 0 2024-09-18T12:49:28.186 INFO:tasks.workunit.client.1.smithi148.stdout:9/994: truncate d8/da/dd/d3f/f58 4616500 0 2024-09-18T12:49:28.187 INFO:tasks.workunit.client.1.smithi148.stdout:9/995: stat d8/da/dd/d4a/fdd 0 2024-09-18T12:49:28.187 INFO:tasks.workunit.client.0.smithi078.stdout:4/666: truncate d11/d27/d5a/f7d 4994382 0 2024-09-18T12:49:28.188 INFO:tasks.workunit.client.0.smithi078.stdout:4/667: readlink d11/d27/d60/la0 0 2024-09-18T12:49:28.188 INFO:tasks.workunit.client.0.smithi078.stdout:3/546: rename d9/df/c7e to d9/d54/d6c/d9f/cac 0 2024-09-18T12:49:28.190 INFO:tasks.workunit.client.1.smithi148.stdout:6/986: dwrite d5/d1a/dc/f128 [0,4194304] 0 2024-09-18T12:49:28.190 INFO:tasks.workunit.client.0.smithi078.stdout:4/668: write d11/d27/d47/d4e/d76/fb1 [3966976,67710] 0 2024-09-18T12:49:28.190 INFO:tasks.workunit.client.1.smithi148.stdout:6/987: chown d5/d32/d12f 461 1 2024-09-18T12:49:28.195 INFO:tasks.workunit.client.0.smithi078.stdout:3/547: truncate d9/d54/d6c/f81 1165810 0 2024-09-18T12:49:28.198 INFO:tasks.workunit.client.1.smithi148.stdout:9/996: unlink d8/f11c 0 2024-09-18T12:49:28.198 INFO:tasks.workunit.client.0.smithi078.stdout:4/669: dwrite d11/d27/d47/f57 [0,4194304] 0 2024-09-18T12:49:28.201 INFO:tasks.workunit.client.1.smithi148.stdout:6/988: rmdir d5/d1a 39 2024-09-18T12:49:28.205 INFO:tasks.workunit.client.0.smithi078.stdout:3/548: creat d9/d2f/d43/d62/fad x:0 0 0 2024-09-18T12:49:28.206 INFO:tasks.workunit.client.1.smithi148.stdout:7/940: dread db/dc/df/d11/dac/fbd [4194304,4194304] 0 2024-09-18T12:49:28.206 INFO:tasks.workunit.client.0.smithi078.stdout:3/549: readlink d9/d29/d4b/d4c/l5a 0 2024-09-18T12:49:28.207 INFO:tasks.workunit.client.0.smithi078.stdout:3/550: chown d9/d13/d33/l67 2 1 2024-09-18T12:49:28.209 INFO:tasks.workunit.client.1.smithi148.stdout:3/936: getdents d4/d8/d1e/d6b/d31/d46/d10c 0 2024-09-18T12:49:28.210 INFO:tasks.workunit.client.1.smithi148.stdout:4/977: dwrite d15/d17/d52/d92/d4c/d4f/f8a [0,4194304] 0 2024-09-18T12:49:28.211 INFO:tasks.workunit.client.1.smithi148.stdout:2/898: dread d9/d3a/fd3 [0,4194304] 0 2024-09-18T12:49:28.212 INFO:tasks.workunit.client.1.smithi148.stdout:2/899: chown d9/d24/fa0 838614 1 2024-09-18T12:49:28.214 INFO:tasks.workunit.client.1.smithi148.stdout:4/978: readlink d15/d17/d52/l7b 0 2024-09-18T12:49:28.214 INFO:tasks.workunit.client.1.smithi148.stdout:4/979: readlink d15/d5f/l134 0 2024-09-18T12:49:28.217 INFO:tasks.workunit.client.1.smithi148.stdout:7/941: symlink db/dc/df/d2c/d66/da0/d113/l121 0 2024-09-18T12:49:28.221 INFO:tasks.workunit.client.1.smithi148.stdout:6/989: dread - d5/d1a/ff5 zero size 2024-09-18T12:49:28.222 INFO:tasks.workunit.client.1.smithi148.stdout:7/942: write db/dc/df/d11/ddc/d75/f56 [6617750,23087] 0 2024-09-18T12:49:28.223 INFO:tasks.workunit.client.1.smithi148.stdout:2/900: link d9/d17/d29/d92/d95/d9b/fef d9/d24/d67/dc7/ddd/f139 0 2024-09-18T12:49:28.229 INFO:tasks.workunit.client.0.smithi078.stdout:3/551: dwrite d9/d13/f1d [4194304,4194304] 0 2024-09-18T12:49:28.229 INFO:tasks.workunit.client.1.smithi148.stdout:3/937: creat d4/d8/d20/d2b/d7f/d93/d94/f143 x:0 0 0 2024-09-18T12:49:28.229 INFO:tasks.workunit.client.1.smithi148.stdout:2/901: write d9/d17/d29/d92/d95/d9b/f126 [76939,66163] 0 2024-09-18T12:49:28.230 INFO:tasks.workunit.client.0.smithi078.stdout:3/552: chown d9/d13/d63/d78 1930 1 2024-09-18T12:49:28.231 INFO:tasks.workunit.client.0.smithi078.stdout:3/553: read - d9/d13/d33/d3c/d19/fa6 zero size 2024-09-18T12:49:28.231 INFO:tasks.workunit.client.1.smithi148.stdout:2/902: stat d9/d24/d47/f136 0 2024-09-18T12:49:28.232 INFO:tasks.workunit.client.1.smithi148.stdout:9/997: dwrite d8/da/dd/d4a/d49/f63 [0,4194304] 0 2024-09-18T12:49:28.233 INFO:tasks.workunit.client.0.smithi078.stdout:4/670: dread d11/d27/d5a/f70 [0,4194304] 0 2024-09-18T12:49:28.234 INFO:tasks.workunit.client.1.smithi148.stdout:7/943: creat db/dc/df/d1d/d68/d7a/da7/f122 x:0 0 0 2024-09-18T12:49:28.237 INFO:tasks.workunit.client.0.smithi078.stdout:3/554: write d9/d54/f74 [3466592,112596] 0 2024-09-18T12:49:28.237 INFO:tasks.workunit.client.1.smithi148.stdout:9/998: dread d8/da/dd/d35/d81/ff7 [0,4194304] 0 2024-09-18T12:49:28.239 INFO:tasks.workunit.client.0.smithi078.stdout:4/671: creat d11/d27/d5a/d84/d4b/da7/dba/dc1/fd6 x:0 0 0 2024-09-18T12:49:28.242 INFO:tasks.workunit.client.1.smithi148.stdout:3/938: link d4/d8/d1e/d63/d10b/f127 d4/d8/d1e/d6b/d31/d46/d10c/f144 0 2024-09-18T12:49:28.243 INFO:tasks.workunit.client.0.smithi078.stdout:3/555: mkdir d9/d54/d7f/dae 0 2024-09-18T12:49:28.244 INFO:tasks.workunit.client.1.smithi148.stdout:7/944: dwrite db/dc/df/d2c/de1/f116 [0,4194304] 0 2024-09-18T12:49:28.245 INFO:tasks.workunit.client.0.smithi078.stdout:4/672: mkdir d11/d27/d5a/d84/d4b/da7/dba/dd7 0 2024-09-18T12:49:28.247 INFO:tasks.workunit.client.1.smithi148.stdout:9/999: symlink d8/da/dd/d4a/d49/d46/d75/d97/l132 0 2024-09-18T12:49:28.249 INFO:tasks.workunit.client.1.smithi148.stdout:7/945: unlink db/dc/df/d11/c64 0 2024-09-18T12:49:28.249 INFO:tasks.workunit.client.0.smithi078.stdout:4/673: mknod d11/d27/d47/d78/cd8 0 2024-09-18T12:49:28.250 INFO:tasks.workunit.client.1.smithi148.stdout:3/939: symlink d4/d8/d20/d2b/d7f/d93/d94/d12a/l145 0 2024-09-18T12:49:28.251 INFO:tasks.workunit.client.1.smithi148.stdout:3/940: stat d4/d8/d6a/db3/db7/dcb/fff 0 2024-09-18T12:49:28.252 INFO:tasks.workunit.client.0.smithi078.stdout:3/556: getdents d9/df 0 2024-09-18T12:49:28.253 INFO:tasks.workunit.client.0.smithi078.stdout:4/674: symlink d11/d27/d5a/d84/d40/ld9 0 2024-09-18T12:49:28.256 INFO:tasks.workunit.client.1.smithi148.stdout:7/946: mknod db/dc/df/d11/ddc/c123 0 2024-09-18T12:49:28.257 INFO:tasks.workunit.client.1.smithi148.stdout:3/941: getdents d4/d8/d20/d2b/deb 0 2024-09-18T12:49:28.258 INFO:tasks.workunit.client.1.smithi148.stdout:6/990: dread d5/d1a/fca [0,4194304] 0 2024-09-18T12:49:28.259 INFO:tasks.workunit.client.0.smithi078.stdout:4/675: getdents d11/d27/d5a/d84 0 2024-09-18T12:49:28.259 INFO:tasks.workunit.client.1.smithi148.stdout:2/903: dread d9/f43 [0,4194304] 0 2024-09-18T12:49:28.260 INFO:tasks.workunit.client.1.smithi148.stdout:2/904: write d9/d24/d47/f5e [1512445,24589] 0 2024-09-18T12:49:28.261 INFO:tasks.workunit.client.1.smithi148.stdout:6/991: truncate d5/d32/f58 4472472 0 2024-09-18T12:49:28.261 INFO:tasks.workunit.client.1.smithi148.stdout:3/942: write d4/f5 [3825165,5799] 0 2024-09-18T12:49:28.262 INFO:tasks.workunit.client.1.smithi148.stdout:6/992: chown d5/d1a/l92 11 1 2024-09-18T12:49:28.264 INFO:tasks.workunit.client.1.smithi148.stdout:3/943: dread - d4/d8/d20/d2b/d7f/d93/d94/f140 zero size 2024-09-18T12:49:28.264 INFO:tasks.workunit.client.0.smithi078.stdout:4/676: read d11/f38 [7930180,92669] 0 2024-09-18T12:49:28.264 INFO:tasks.workunit.client.1.smithi148.stdout:6/993: write d5/d32/d38/d50/de7/fcc [354178,65061] 0 2024-09-18T12:49:28.265 INFO:tasks.workunit.client.1.smithi148.stdout:2/905: truncate d9/d24/d31/d34/d42/f69 1010397 0 2024-09-18T12:49:28.267 INFO:tasks.workunit.client.1.smithi148.stdout:6/994: creat d5/d1a/d29/d5c/f143 x:0 0 0 2024-09-18T12:49:28.268 INFO:tasks.workunit.client.1.smithi148.stdout:6/995: write d5/d1a/dc/d2b/de9/f121 [805457,52837] 0 2024-09-18T12:49:28.269 INFO:tasks.workunit.client.1.smithi148.stdout:3/944: symlink d4/d8/d1e/d6b/d31/d60/da9/d8b/l146 0 2024-09-18T12:49:28.269 INFO:tasks.workunit.client.1.smithi148.stdout:6/996: readlink d5/d1a/dc/d2b/l36 0 2024-09-18T12:49:28.270 INFO:tasks.workunit.client.0.smithi078.stdout:4/677: dwrite d11/d27/d47/d4e/f65 [0,4194304] 0 2024-09-18T12:49:28.271 INFO:tasks.workunit.client.1.smithi148.stdout:2/906: unlink d9/cbb 0 2024-09-18T12:49:28.272 INFO:tasks.workunit.client.1.smithi148.stdout:3/945: fsync d4/d8/d1e/d63/fad 0 2024-09-18T12:49:28.274 INFO:tasks.workunit.client.0.smithi078.stdout:4/678: mknod d11/d27/d5a/cda 0 2024-09-18T12:49:28.275 INFO:tasks.workunit.client.0.smithi078.stdout:4/679: chown d11/d27/d47/d4e/d76/f7e 3388466 1 2024-09-18T12:49:28.276 INFO:tasks.workunit.client.1.smithi148.stdout:6/997: mkdir d5/d1a/dc/dbf/dcb/df3/d144 0 2024-09-18T12:49:28.276 INFO:tasks.workunit.client.0.smithi078.stdout:4/680: chown d11/d27/d5a/ccd 3 1 2024-09-18T12:49:28.278 INFO:tasks.workunit.client.1.smithi148.stdout:7/947: write db/dc/df/d1d/d68/d7a/fc6 [5063495,35137] 0 2024-09-18T12:49:28.279 INFO:tasks.workunit.client.1.smithi148.stdout:6/998: fsync d5/d1a/d29/d5c/f67 0 2024-09-18T12:49:28.280 INFO:tasks.workunit.client.0.smithi078.stdout:4/681: symlink d11/d27/d47/d4e/d76/ldb 0 2024-09-18T12:49:28.281 INFO:tasks.workunit.client.1.smithi148.stdout:3/946: mknod d4/c147 0 2024-09-18T12:49:28.281 INFO:tasks.workunit.client.0.smithi078.stdout:3/557: dwrite d9/f27 [4194304,4194304] 0 2024-09-18T12:49:28.282 INFO:tasks.workunit.client.1.smithi148.stdout:3/947: write d4/d8/d20/f2f [1612880,24009] 0 2024-09-18T12:49:28.283 INFO:tasks.workunit.client.1.smithi148.stdout:7/948: fdatasync db/dc/df/d2c/d66/da0/fe3 0 2024-09-18T12:49:28.285 INFO:tasks.workunit.client.1.smithi148.stdout:7/949: chown db/dc/df/d11/d34/d69/f96 6018169 1 2024-09-18T12:49:28.293 INFO:tasks.workunit.client.1.smithi148.stdout:6/999: unlink d5/l26 0 2024-09-18T12:49:28.293 INFO:tasks.workunit.client.1.smithi148.stdout:7/950: mkdir db/dc/df/d11/db3/d124 0 2024-09-18T12:49:28.295 INFO:tasks.workunit.client.1.smithi148.stdout:3/948: mkdir d4/d8/d148 0 2024-09-18T12:49:28.297 INFO:tasks.workunit.client.1.smithi148.stdout:7/951: rename db/dc/df/d11/d43/d89 to db/dc/df/d1d/d68/d7a/da7/d125 0 2024-09-18T12:49:28.298 INFO:tasks.workunit.client.0.smithi078.stdout:4/682: write d11/d27/d5a/d5d/f90 [2619965,20110] 0 2024-09-18T12:49:28.299 INFO:tasks.workunit.client.0.smithi078.stdout:4/683: creat d11/d27/d47/fdc x:0 0 0 2024-09-18T12:49:28.300 INFO:tasks.workunit.client.1.smithi148.stdout:7/952: rmdir db/dc 39 2024-09-18T12:49:28.303 INFO:tasks.workunit.client.1.smithi148.stdout:2/907: dwrite d9/d17/d29/d92/d95/fac [4194304,4194304] 0 2024-09-18T12:49:28.303 INFO:tasks.workunit.client.1.smithi148.stdout:3/949: dwrite d4/d8/d20/d2b/f118 [0,4194304] 0 2024-09-18T12:49:28.304 INFO:tasks.workunit.client.1.smithi148.stdout:7/953: stat db/dc/df/d11/dac/d107 0 2024-09-18T12:49:28.306 INFO:tasks.workunit.client.1.smithi148.stdout:2/908: readlink d9/d24/d31/d34/l6f 0 2024-09-18T12:49:28.312 INFO:tasks.workunit.client.0.smithi078.stdout:4/684: dwrite d11/d27/d5a/d5d/f86 [0,4194304] 0 2024-09-18T12:49:28.314 INFO:tasks.workunit.client.0.smithi078.stdout:4/685: chown d11/f14 581469 1 2024-09-18T12:49:28.318 INFO:tasks.workunit.client.0.smithi078.stdout:4/686: symlink d11/d27/d47/d78/d95/ldd 0 2024-09-18T12:49:28.319 INFO:tasks.workunit.client.1.smithi148.stdout:2/909: write d9/d24/d31/d34/d42/f69 [578904,19073] 0 2024-09-18T12:49:28.320 INFO:tasks.workunit.client.0.smithi078.stdout:4/687: fsync d11/d27/d60/f9d 0 2024-09-18T12:49:28.322 INFO:tasks.workunit.client.1.smithi148.stdout:3/950: dread d4/d8/d1e/f82 [0,4194304] 0 2024-09-18T12:49:28.323 INFO:tasks.workunit.client.0.smithi078.stdout:4/688: rename d11/d27/d89/d9f/lb7 to d11/d27/d5a/lde 0 2024-09-18T12:49:28.323 INFO:tasks.workunit.client.1.smithi148.stdout:4/980: sync 2024-09-18T12:49:28.324 INFO:tasks.workunit.client.0.smithi078.stdout:4/689: rmdir d11/d27/d47 39 2024-09-18T12:49:28.326 INFO:tasks.workunit.client.0.smithi078.stdout:4/690: mknod d11/d27/d89/d9f/cdf 0 2024-09-18T12:49:28.328 INFO:tasks.workunit.client.1.smithi148.stdout:4/981: unlink d15/d17/d52/d92/d4c/dd0/fea 0 2024-09-18T12:49:28.330 INFO:tasks.workunit.client.1.smithi148.stdout:4/982: chown d15/d5f/d69/d7f/d94/fda 34639 1 2024-09-18T12:49:28.335 INFO:tasks.workunit.client.1.smithi148.stdout:4/983: dwrite d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/f10a [0,4194304] 0 2024-09-18T12:49:28.338 INFO:tasks.workunit.client.1.smithi148.stdout:4/984: rmdir d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d10b 39 2024-09-18T12:49:28.338 INFO:tasks.workunit.client.1.smithi148.stdout:7/954: dread db/dc/df/d11/d34/f8d [0,4194304] 0 2024-09-18T12:49:28.340 INFO:tasks.workunit.client.0.smithi078.stdout:4/691: write d11/d27/d47/fd1 [66950,15083] 0 2024-09-18T12:49:28.345 INFO:tasks.workunit.client.1.smithi148.stdout:7/955: symlink db/dc/df/d11/ddc/l126 0 2024-09-18T12:49:28.346 INFO:tasks.workunit.client.1.smithi148.stdout:3/951: dwrite d4/d8/f51 [0,4194304] 0 2024-09-18T12:49:28.346 INFO:tasks.workunit.client.1.smithi148.stdout:2/910: dwrite d9/d17/d29/fa4 [0,4194304] 0 2024-09-18T12:49:28.348 INFO:tasks.workunit.client.0.smithi078.stdout:4/692: dwrite d11/d27/d89/fcb [0,4194304] 0 2024-09-18T12:49:28.354 INFO:tasks.workunit.client.1.smithi148.stdout:2/911: rmdir d9/d17/d29/d92 39 2024-09-18T12:49:28.358 INFO:tasks.workunit.client.1.smithi148.stdout:3/952: link d4/d8/d1e/fe2 d4/d8/d6a/db3/db7/dcb/d100/f149 0 2024-09-18T12:49:28.359 INFO:tasks.workunit.client.1.smithi148.stdout:2/912: rename d9/d17/d29/d92/d95/le0 to d9/d24/d67/dc7/dce/l13a 0 2024-09-18T12:49:28.365 INFO:tasks.workunit.client.1.smithi148.stdout:4/985: dwrite d15/d5f/d69/d7f/d94/fda [0,4194304] 0 2024-09-18T12:49:28.384 INFO:tasks.workunit.client.0.smithi078.stdout:4/693: dread d11/d27/d5a/d84/d40/f6f [0,4194304] 0 2024-09-18T12:49:28.384 INFO:tasks.workunit.client.0.smithi078.stdout:6/813: sync 2024-09-18T12:49:28.385 INFO:tasks.workunit.client.1.smithi148.stdout:7/956: dread db/dc/df/d1d/f57 [4194304,4194304] 0 2024-09-18T12:49:28.385 INFO:tasks.workunit.client.0.smithi078.stdout:4/694: write d11/d27/d5a/d5d/f86 [4742132,98014] 0 2024-09-18T12:49:28.390 INFO:tasks.workunit.client.0.smithi078.stdout:6/814: creat d10/d2b/d43/f110 x:0 0 0 2024-09-18T12:49:28.393 INFO:tasks.workunit.client.0.smithi078.stdout:6/815: dread d10/d2b/d43/dc3/d103/dac/fad [0,4194304] 0 2024-09-18T12:49:28.394 INFO:tasks.workunit.client.1.smithi148.stdout:3/953: write d4/d8/d1e/d6b/d31/d46/d10c/f144 [201245,37938] 0 2024-09-18T12:49:28.394 INFO:tasks.workunit.client.0.smithi078.stdout:4/695: write d11/d27/d60/fcf [86990,51912] 0 2024-09-18T12:49:28.395 INFO:tasks.workunit.client.0.smithi078.stdout:6/816: creat d10/d2b/d43/dc3/d103/d7d/f111 x:0 0 0 2024-09-18T12:49:28.397 INFO:tasks.workunit.client.0.smithi078.stdout:4/696: fsync d11/d27/d5a/d84/d40/f8b 0 2024-09-18T12:49:28.398 INFO:tasks.workunit.client.1.smithi148.stdout:3/954: symlink d4/d8/d1e/l14a 0 2024-09-18T12:49:28.398 INFO:tasks.workunit.client.1.smithi148.stdout:7/957: dwrite db/dc/df/d11/d34/d69/ff7 [0,4194304] 0 2024-09-18T12:49:28.399 INFO:tasks.workunit.client.0.smithi078.stdout:6/817: creat d10/d2b/d43/d53/d63/f112 x:0 0 0 2024-09-18T12:49:28.400 INFO:tasks.workunit.client.1.smithi148.stdout:7/958: fdatasync db/dc/df/d1d/d68/d7a/da7/d125/f120 0 2024-09-18T12:49:28.402 INFO:tasks.workunit.client.0.smithi078.stdout:4/697: unlink d11/d27/d47/fdc 0 2024-09-18T12:49:28.404 INFO:tasks.workunit.client.1.smithi148.stdout:3/955: creat d4/d8/d6a/db3/db7/dcb/f14b x:0 0 0 2024-09-18T12:49:28.404 INFO:tasks.workunit.client.1.smithi148.stdout:7/959: dread - db/dc/df/d11/f97 zero size 2024-09-18T12:49:28.405 INFO:tasks.workunit.client.1.smithi148.stdout:3/956: write d4/ffc [1049183,36476] 0 2024-09-18T12:49:28.406 INFO:tasks.workunit.client.0.smithi078.stdout:4/698: mkdir d11/d27/d5a/d84/d4b/da7/de0 0 2024-09-18T12:49:28.408 INFO:tasks.workunit.client.0.smithi078.stdout:6/818: creat d10/d2b/d43/dc3/d103/dac/f113 x:0 0 0 2024-09-18T12:49:28.410 INFO:tasks.workunit.client.0.smithi078.stdout:4/699: write d11/d27/d5a/d84/d40/f8b [836696,8437] 0 2024-09-18T12:49:28.411 INFO:tasks.workunit.client.1.smithi148.stdout:3/957: dwrite d4/d8/d6a/db3/db7/dcb/f14b [0,4194304] 0 2024-09-18T12:49:28.412 INFO:tasks.workunit.client.1.smithi148.stdout:7/960: link db/dc/df/d11/d34/f8d db/dc/df/d2c/d55/f127 0 2024-09-18T12:49:28.413 INFO:tasks.workunit.client.1.smithi148.stdout:3/958: stat d4/d8/d1e/d63/d9b 0 2024-09-18T12:49:28.413 INFO:tasks.workunit.client.0.smithi078.stdout:4/700: mknod d11/d27/d5a/d5d/dca/ce1 0 2024-09-18T12:49:28.414 INFO:tasks.workunit.client.1.smithi148.stdout:3/959: readlink d4/d8/d20/d2b/d43/l2a 0 2024-09-18T12:49:28.415 INFO:tasks.workunit.client.0.smithi078.stdout:4/701: mknod d11/d27/d5a/ce2 0 2024-09-18T12:49:28.417 INFO:tasks.workunit.client.1.smithi148.stdout:7/961: rename db/dc/df/d1d/c63 to db/dc/df/d2c/d66/c128 0 2024-09-18T12:49:28.417 INFO:tasks.workunit.client.1.smithi148.stdout:7/962: stat db/dc/df/d11 0 2024-09-18T12:49:28.419 INFO:tasks.workunit.client.1.smithi148.stdout:3/960: mknod d4/d8/d20/d2b/d7f/d93/d94/d12a/c14c 0 2024-09-18T12:49:28.421 INFO:tasks.workunit.client.0.smithi078.stdout:4/702: rename d11/d27/c46 to d11/d27/d89/ce3 0 2024-09-18T12:49:28.423 INFO:tasks.workunit.client.1.smithi148.stdout:7/963: dwrite db/dc/df/d2c/f5e [0,4194304] 0 2024-09-18T12:49:28.423 INFO:tasks.workunit.client.1.smithi148.stdout:3/961: write d4/d8/d1e/d79/d92/f5f [1469140,36287] 0 2024-09-18T12:49:28.425 INFO:tasks.workunit.client.0.smithi078.stdout:4/703: rename d11/d27/d47/c7b to d11/d27/d5a/d5d/dca/ce4 0 2024-09-18T12:49:28.426 INFO:tasks.workunit.client.0.smithi078.stdout:4/704: readlink d11/d27/d47/d4e/d50/l6e 0 2024-09-18T12:49:28.427 INFO:tasks.workunit.client.1.smithi148.stdout:7/964: symlink db/dc/df/d2c/d66/da0/l129 0 2024-09-18T12:49:28.428 INFO:tasks.workunit.client.1.smithi148.stdout:7/965: write db/d52/fd7 [689778,105402] 0 2024-09-18T12:49:28.433 INFO:tasks.workunit.client.0.smithi078.stdout:4/705: dwrite d11/d27/d89/d9f/fa2 [0,4194304] 0 2024-09-18T12:49:28.435 INFO:tasks.workunit.client.0.smithi078.stdout:6/819: write d10/d2b/d43/dc3/d103/d7d/f84 [4928142,123589] 0 2024-09-18T12:49:28.439 INFO:tasks.workunit.client.0.smithi078.stdout:6/820: unlink d10/d2b/d43/dc3/d103/d7d/fc7 0 2024-09-18T12:49:28.441 INFO:tasks.workunit.client.0.smithi078.stdout:4/706: dwrite d11/d27/d47/d4e/fc8 [0,4194304] 0 2024-09-18T12:49:28.443 INFO:tasks.workunit.client.0.smithi078.stdout:6/821: symlink d10/d2b/d43/d53/d45/de7/l114 0 2024-09-18T12:49:28.446 INFO:tasks.workunit.client.1.smithi148.stdout:3/962: write d4/d8/d1e/d6b/d31/d60/da9/fa1 [669531,65982] 0 2024-09-18T12:49:28.449 INFO:tasks.workunit.client.0.smithi078.stdout:4/707: creat d11/d27/d5a/d5d/fe5 x:0 0 0 2024-09-18T12:49:28.451 INFO:tasks.workunit.client.0.smithi078.stdout:4/708: read - d11/d27/d47/fa4 zero size 2024-09-18T12:49:28.453 INFO:tasks.workunit.client.0.smithi078.stdout:6/822: link d10/d2b/d43/dc3/d103/d77/f91 d10/d2b/d43/dc3/d103/d7d/ddb/f115 0 2024-09-18T12:49:28.453 INFO:tasks.workunit.client.1.smithi148.stdout:3/963: dwrite d4/d8/d6a/db3/db7/dcb/fe0 [4194304,4194304] 0 2024-09-18T12:49:28.456 INFO:tasks.workunit.client.0.smithi078.stdout:6/823: mknod d10/d2b/d43/dc3/d103/d77/c116 0 2024-09-18T12:49:28.458 INFO:tasks.workunit.client.0.smithi078.stdout:6/824: stat d10/d2b/d43/dc3/d103/fde 0 2024-09-18T12:49:28.458 INFO:tasks.workunit.client.0.smithi078.stdout:4/709: dwrite d11/d27/d47/fa6 [0,4194304] 0 2024-09-18T12:49:28.461 INFO:tasks.workunit.client.1.smithi148.stdout:3/964: dread d4/f76 [0,4194304] 0 2024-09-18T12:49:28.467 INFO:tasks.workunit.client.1.smithi148.stdout:3/965: rename d4/d8/d1e/d6b/f142 to d4/d8/f14d 0 2024-09-18T12:49:28.468 INFO:tasks.workunit.client.1.smithi148.stdout:3/966: write d4/d8/d6a/db3/db7/dcb/fff [803539,119006] 0 2024-09-18T12:49:28.469 INFO:tasks.workunit.client.1.smithi148.stdout:3/967: dread - d4/d8/d20/d2b/ff3 zero size 2024-09-18T12:49:28.470 INFO:tasks.workunit.client.0.smithi078.stdout:6/825: write d10/d2b/d43/f50 [639888,83122] 0 2024-09-18T12:49:28.474 INFO:tasks.workunit.client.1.smithi148.stdout:3/968: rename d4/d8/d20/d2b/d7f/dd9/fea to d4/d8/d20/d2b/d43/f14e 0 2024-09-18T12:49:28.475 INFO:tasks.workunit.client.1.smithi148.stdout:2/913: sync 2024-09-18T12:49:28.476 INFO:tasks.workunit.client.1.smithi148.stdout:2/914: stat d9/d17/d29/d92/cda 0 2024-09-18T12:49:28.477 INFO:tasks.workunit.client.1.smithi148.stdout:2/915: read - d9/d24/d67/dc7/ddd/f139 zero size 2024-09-18T12:49:28.477 INFO:tasks.workunit.client.1.smithi148.stdout:3/969: rmdir d4/d8/d20/d2b/d7f/d93/dd1/d12c 0 2024-09-18T12:49:28.478 INFO:tasks.workunit.client.1.smithi148.stdout:3/970: chown d4/d8/d20/d2b/fc4 1598123596 1 2024-09-18T12:49:28.479 INFO:tasks.workunit.client.1.smithi148.stdout:2/916: creat d9/d24/d67/d72/d107/d115/f13b x:0 0 0 2024-09-18T12:49:28.481 INFO:tasks.workunit.client.1.smithi148.stdout:3/971: mkdir d4/d8/d1e/d14f 0 2024-09-18T12:49:28.482 INFO:tasks.workunit.client.1.smithi148.stdout:3/972: chown d4/d8/d1e/d63/f11c 1 1 2024-09-18T12:49:28.482 INFO:tasks.workunit.client.1.smithi148.stdout:2/917: rmdir d9/d17/d29/d92/d95/d9b 39 2024-09-18T12:49:28.484 INFO:tasks.workunit.client.1.smithi148.stdout:3/973: fsync d4/d8/d1e/d6b/d31/d60/fc0 0 2024-09-18T12:49:28.485 INFO:tasks.workunit.client.1.smithi148.stdout:2/918: fdatasync d9/d24/d47/f63 0 2024-09-18T12:49:28.486 INFO:tasks.workunit.client.0.smithi078.stdout:6/826: dread d10/d2b/d43/dc3/d103/d77/f78 [0,4194304] 0 2024-09-18T12:49:28.487 INFO:tasks.workunit.client.0.smithi078.stdout:6/827: chown d10/d2b/d43/dc3/f102 3735580 1 2024-09-18T12:49:28.488 INFO:tasks.workunit.client.1.smithi148.stdout:3/974: mkdir d4/d8/d148/d150 0 2024-09-18T12:49:28.488 INFO:tasks.workunit.client.0.smithi078.stdout:6/828: chown d10/d2b/d43/d53/d45/fa0 367827991 1 2024-09-18T12:49:28.489 INFO:tasks.workunit.client.1.smithi148.stdout:2/919: creat d9/d24/d31/d34/d7b/f13c x:0 0 0 2024-09-18T12:49:28.490 INFO:tasks.workunit.client.1.smithi148.stdout:3/975: mknod d4/d8/d20/d2b/deb/c151 0 2024-09-18T12:49:28.491 INFO:tasks.workunit.client.1.smithi148.stdout:3/976: truncate d4/d8/d20/d99/dfd/f134 801438 0 2024-09-18T12:49:28.492 INFO:tasks.workunit.client.0.smithi078.stdout:6/829: rename d10/d2b/d43/f6c to d10/d2b/d61/dd7/ddc/f117 0 2024-09-18T12:49:28.492 INFO:tasks.workunit.client.1.smithi148.stdout:2/920: mkdir d9/d17/d29/d92/d95/d9b/d13d 0 2024-09-18T12:49:28.494 INFO:tasks.workunit.client.1.smithi148.stdout:2/921: truncate d9/d73/d81/f112 648410 0 2024-09-18T12:49:28.495 INFO:tasks.workunit.client.0.smithi078.stdout:6/830: creat d10/d2b/f118 x:0 0 0 2024-09-18T12:49:28.496 INFO:tasks.workunit.client.1.smithi148.stdout:2/922: creat d9/d17/d29/d92/d95/f13e x:0 0 0 2024-09-18T12:49:28.499 INFO:tasks.workunit.client.1.smithi148.stdout:2/923: creat d9/d24/d67/dc7/ddd/f13f x:0 0 0 2024-09-18T12:49:28.501 INFO:tasks.workunit.client.1.smithi148.stdout:2/924: fdatasync d9/d17/f4e 0 2024-09-18T12:49:28.502 INFO:tasks.workunit.client.0.smithi078.stdout:6/831: dwrite d10/d2b/d43/d53/d63/ff1 [0,4194304] 0 2024-09-18T12:49:28.503 INFO:tasks.workunit.client.1.smithi148.stdout:3/977: truncate d4/d8/d20/d2b/d7f/d93/dd1/ffa 203171 0 2024-09-18T12:49:28.504 INFO:tasks.workunit.client.1.smithi148.stdout:2/925: mkdir d9/d17/d29/d92/d140 0 2024-09-18T12:49:28.505 INFO:tasks.workunit.client.0.smithi078.stdout:6/832: write d10/d2b/d43/dc3/d103/d7d/fd0 [38055,50225] 0 2024-09-18T12:49:28.506 INFO:tasks.workunit.client.1.smithi148.stdout:2/926: readlink d9/d24/d31/d34/d7b/lb1 0 2024-09-18T12:49:28.507 INFO:tasks.workunit.client.1.smithi148.stdout:2/927: write d9/d24/d31/d9d/f100 [167728,106308] 0 2024-09-18T12:49:28.508 INFO:tasks.workunit.client.0.smithi078.stdout:6/833: unlink d10/d2b/d61/lb9 0 2024-09-18T12:49:28.510 INFO:tasks.workunit.client.1.smithi148.stdout:3/978: truncate d4/d8/f111 356756 0 2024-09-18T12:49:28.511 INFO:tasks.workunit.client.1.smithi148.stdout:2/928: mkdir d9/d17/d29/d92/d95/d64/d141 0 2024-09-18T12:49:28.514 INFO:tasks.workunit.client.0.smithi078.stdout:6/834: rename d10/d2b/d43/dc3/d103/dac/fbf to d10/d2b/d43/dc3/f119 0 2024-09-18T12:49:28.515 INFO:tasks.workunit.client.0.smithi078.stdout:6/835: readlink d10/d2b/d61/la8 0 2024-09-18T12:49:28.518 INFO:tasks.workunit.client.0.smithi078.stdout:6/836: unlink d10/d2b/d43/de5/lf7 0 2024-09-18T12:49:28.523 INFO:tasks.workunit.client.1.smithi148.stdout:7/966: sync 2024-09-18T12:49:28.523 INFO:tasks.workunit.client.1.smithi148.stdout:4/986: sync 2024-09-18T12:49:28.524 INFO:tasks.workunit.client.0.smithi078.stdout:6/837: rename fb to d10/d2b/d43/dc3/d103/dac/f11a 0 2024-09-18T12:49:28.526 INFO:tasks.workunit.client.1.smithi148.stdout:4/987: mkdir d15/d17/d52/d92/d4c/dd0/d143 0 2024-09-18T12:49:28.527 INFO:tasks.workunit.client.0.smithi078.stdout:6/838: rename d10/d2b/dfa/dd6/f10d to d10/d2b/d43/d53/d63/f11b 0 2024-09-18T12:49:28.528 INFO:tasks.workunit.client.0.smithi078.stdout:6/839: fsync d10/d2b/d43/dc3/d103/d7d/f111 0 2024-09-18T12:49:28.529 INFO:tasks.workunit.client.0.smithi078.stdout:6/840: chown d10/d2b/d61/dd7/ddc/ff8 0 1 2024-09-18T12:49:28.532 INFO:tasks.workunit.client.1.smithi148.stdout:4/988: rename d15/d3f/f5a to d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/d11e/db3/f144 0 2024-09-18T12:49:28.534 INFO:tasks.workunit.client.1.smithi148.stdout:4/989: chown d15/d17/d52/d92/f2e 159 1 2024-09-18T12:49:28.535 INFO:tasks.workunit.client.1.smithi148.stdout:3/979: dread d4/d8/d1e/d79/fab [0,4194304] 0 2024-09-18T12:49:28.535 INFO:tasks.workunit.client.1.smithi148.stdout:2/929: dwrite d9/d24/d67/d72/d8f/fbf [0,4194304] 0 2024-09-18T12:49:28.539 INFO:tasks.workunit.client.1.smithi148.stdout:2/930: creat d9/d24/d47/f142 x:0 0 0 2024-09-18T12:49:28.540 INFO:tasks.workunit.client.1.smithi148.stdout:4/990: write d15/d17/d52/d101/f10e [193860,68414] 0 2024-09-18T12:49:28.541 INFO:tasks.workunit.client.1.smithi148.stdout:3/980: dread d4/fd8 [0,4194304] 0 2024-09-18T12:49:28.544 INFO:tasks.workunit.client.1.smithi148.stdout:4/991: creat d15/d17/d52/d68/da5/d102/f145 x:0 0 0 2024-09-18T12:49:28.545 INFO:tasks.workunit.client.1.smithi148.stdout:3/981: creat d4/d8/d1e/d63/d10b/f152 x:0 0 0 2024-09-18T12:49:28.546 INFO:tasks.workunit.client.1.smithi148.stdout:2/931: rename d9/d73/d81/de1/d133 to d9/d24/d67/dc7/dce/d11a/d143 0 2024-09-18T12:49:28.547 INFO:tasks.workunit.client.0.smithi078.stdout:6/841: dread d10/f17 [0,4194304] 0 2024-09-18T12:49:28.548 INFO:tasks.workunit.client.1.smithi148.stdout:3/982: dread d4/d8/f1a [0,4194304] 0 2024-09-18T12:49:28.550 INFO:tasks.workunit.client.1.smithi148.stdout:3/983: fdatasync d4/d8/d6a/db3/db7/dcb/f14b 0 2024-09-18T12:49:28.551 INFO:tasks.workunit.client.0.smithi078.stdout:6/842: dread d10/d2b/d43/d53/d45/d55/f4f [0,4194304] 0 2024-09-18T12:49:28.552 INFO:tasks.workunit.client.1.smithi148.stdout:2/932: dread d9/d24/d31/d9d/fcb [0,4194304] 0 2024-09-18T12:49:28.555 INFO:tasks.workunit.client.0.smithi078.stdout:6/843: rename d10/d2b/d43/d53/lc0 to d10/d2b/d43/dc3/d103/d7d/l11c 0 2024-09-18T12:49:28.556 INFO:tasks.workunit.client.1.smithi148.stdout:3/984: dwrite d4/d8/d1e/d6b/d31/d60/da9/d8b/fee [0,4194304] 0 2024-09-18T12:49:28.559 INFO:tasks.workunit.client.1.smithi148.stdout:2/933: rmdir d9/d24/d31/d34/d42 39 2024-09-18T12:49:28.561 INFO:tasks.workunit.client.1.smithi148.stdout:4/992: link d15/d17/d52/d101/c126 d15/d17/d52/d92/d141/c146 0 2024-09-18T12:49:28.561 INFO:tasks.workunit.client.0.smithi078.stdout:6/844: creat d10/d2b/d43/da7/f11d x:0 0 0 2024-09-18T12:49:28.563 INFO:tasks.workunit.client.1.smithi148.stdout:3/985: dwrite d4/f29 [4194304,4194304] 0 2024-09-18T12:49:28.564 INFO:tasks.workunit.client.1.smithi148.stdout:2/934: symlink d9/d17/d29/d92/d95/d9b/l144 0 2024-09-18T12:49:28.564 INFO:tasks.workunit.client.0.smithi078.stdout:6/845: mkdir d10/d2b/dbd/d11e 0 2024-09-18T12:49:28.565 INFO:tasks.workunit.client.1.smithi148.stdout:2/935: write d9/d24/f28 [116360,90882] 0 2024-09-18T12:49:28.565 INFO:tasks.workunit.client.1.smithi148.stdout:4/993: symlink d15/d5f/l147 0 2024-09-18T12:49:28.567 INFO:tasks.workunit.client.0.smithi078.stdout:6/846: mkdir d10/d2b/d61/d11f 0 2024-09-18T12:49:28.568 INFO:tasks.workunit.client.1.smithi148.stdout:4/994: dread d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/ff7 [0,4194304] 0 2024-09-18T12:49:28.568 INFO:tasks.workunit.client.0.smithi078.stdout:6/847: fsync d10/d2b/d43/dc3/d103/d7d/f111 0 2024-09-18T12:49:28.572 INFO:tasks.workunit.client.1.smithi148.stdout:4/995: write d15/d17/d52/f120 [1032185,33261] 0 2024-09-18T12:49:28.573 INFO:tasks.workunit.client.0.smithi078.stdout:6/848: creat d10/d2b/d61/d11f/f120 x:0 0 0 2024-09-18T12:49:28.574 INFO:tasks.workunit.client.1.smithi148.stdout:2/936: dwrite d9/d24/d31/d34/d7b/f13c [0,4194304] 0 2024-09-18T12:49:28.575 INFO:tasks.workunit.client.0.smithi078.stdout:6/849: rmdir d10/d2b/d43/dc3 39 2024-09-18T12:49:28.577 INFO:tasks.workunit.client.0.smithi078.stdout:6/850: dread - d10/d2b/d43/dc3/f119 zero size 2024-09-18T12:49:28.578 INFO:tasks.workunit.client.0.smithi078.stdout:6/851: chown d10/d2b/d43/dc3/d103/fde 32 1 2024-09-18T12:49:28.578 INFO:tasks.workunit.client.1.smithi148.stdout:2/937: truncate d9/d24/d31/d34/f37 1258572 0 2024-09-18T12:49:28.579 INFO:tasks.workunit.client.0.smithi078.stdout:6/852: chown d10/d2b/d61/fb2 3183 1 2024-09-18T12:49:28.580 INFO:tasks.workunit.client.1.smithi148.stdout:4/996: creat d15/d17/d52/d92/d4c/f148 x:0 0 0 2024-09-18T12:49:28.583 INFO:tasks.workunit.client.1.smithi148.stdout:4/997: mkdir d15/d17/d52/d92/d4c/d4f/d64/da0/da1/d9b/dde/d149 0 2024-09-18T12:49:28.585 INFO:tasks.workunit.client.1.smithi148.stdout:2/938: link d9/d17/d29/d92/d95/d64/fd7 d9/d24/d67/d72/d107/f145 0 2024-09-18T12:49:28.587 INFO:tasks.workunit.client.1.smithi148.stdout:3/986: dwrite d4/d8/d20/f33 [0,4194304] 0 2024-09-18T12:49:28.588 INFO:tasks.workunit.client.1.smithi148.stdout:4/998: getdents d15/d90 0 2024-09-18T12:49:28.590 INFO:tasks.workunit.client.1.smithi148.stdout:3/987: symlink d4/d8/d6a/db3/db7/l153 0 2024-09-18T12:49:28.591 INFO:tasks.workunit.client.0.smithi078.stdout:6/853: read d10/d2b/d43/d53/d63/d6b/fa9 [3051096,128673] 0 2024-09-18T12:49:28.591 INFO:tasks.workunit.client.1.smithi148.stdout:3/988: chown d4/d8/d1e/d79/d92/c8c 12071429 1 2024-09-18T12:49:28.592 INFO:tasks.workunit.client.1.smithi148.stdout:7/967: sync 2024-09-18T12:49:28.595 INFO:tasks.workunit.client.1.smithi148.stdout:3/989: read d4/d8/f111 [227112,108566] 0 2024-09-18T12:49:28.596 INFO:tasks.workunit.client.0.smithi078.stdout:6/854: mknod d10/d2b/d43/d53/d63/d6b/da1/df2/c121 0 2024-09-18T12:49:28.601 INFO:tasks.workunit.client.1.smithi148.stdout:7/968: symlink db/d52/l12a 0 2024-09-18T12:49:28.602 INFO:tasks.workunit.client.0.smithi078.stdout:6/855: rename d10/d2b/d61/d11f/f120 to d10/d2b/f122 0 2024-09-18T12:49:28.603 INFO:tasks.workunit.client.1.smithi148.stdout:7/969: rmdir db/dc/df/d2c/d55/daf/d38 39 2024-09-18T12:49:28.606 INFO:tasks.workunit.client.1.smithi148.stdout:7/970: mknod db/dc/df/d11/dac/c12b 0 2024-09-18T12:49:28.611 INFO:tasks.workunit.client.1.smithi148.stdout:3/990: dwrite d4/d8/d20/d2b/f2c [0,4194304] 0 2024-09-18T12:49:28.614 INFO:tasks.workunit.client.0.smithi078.stdout:6/856: dwrite d10/d2b/d43/dc3/d103/d77/f78 [0,4194304] 0 2024-09-18T12:49:28.617 INFO:tasks.workunit.client.1.smithi148.stdout:7/971: dwrite db/dc/df/d11/d34/d69/f96 [4194304,4194304] 0 2024-09-18T12:49:28.617 INFO:tasks.workunit.client.1.smithi148.stdout:3/991: creat d4/d8/d6a/f154 x:0 0 0 2024-09-18T12:49:28.617 INFO:tasks.workunit.client.0.smithi078.stdout:6/857: creat d10/d2b/d43/d53/d63/d6b/d10f/f123 x:0 0 0 2024-09-18T12:49:28.619 INFO:tasks.workunit.client.1.smithi148.stdout:4/999: dread d15/d5f/f78 [0,4194304] 0 2024-09-18T12:49:28.620 INFO:tasks.workunit.client.1.smithi148.stdout:7/972: write db/d52/d1f/fd9 [4741801,92025] 0 2024-09-18T12:49:28.624 INFO:tasks.workunit.client.1.smithi148.stdout:3/992: truncate d4/d8/d20/f42 936879 0 2024-09-18T12:49:28.627 INFO:tasks.workunit.client.0.smithi078.stdout:6/858: dwrite d10/d2b/d43/dc3/d103/d77/f78 [0,4194304] 0 2024-09-18T12:49:28.628 INFO:tasks.workunit.client.0.smithi078.stdout:6/859: stat d10/d2b/d43/d53/d45/l65 0 2024-09-18T12:49:28.629 INFO:tasks.workunit.client.1.smithi148.stdout:3/993: dread d4/d8/d6a/db3/db7/dcb/fe0 [0,4194304] 0 2024-09-18T12:49:28.634 INFO:tasks.workunit.client.1.smithi148.stdout:3/994: dwrite d4/d8/d1e/d63/f11c [0,4194304] 0 2024-09-18T12:49:28.659 INFO:tasks.workunit.client.1.smithi148.stdout:7/973: write db/dc/df/d2c/d55/daf/d38/fba [2383965,95280] 0 2024-09-18T12:49:28.659 INFO:tasks.workunit.client.1.smithi148.stdout:3/995: write d4/d8/d20/d2b/d43/fa4 [528767,103577] 0 2024-09-18T12:49:28.660 INFO:tasks.workunit.client.1.smithi148.stdout:3/996: dread - d4/d8/d20/d99/fc1 zero size 2024-09-18T12:49:28.662 INFO:tasks.workunit.client.1.smithi148.stdout:3/997: rmdir d4/d8/d6a/db3/db7/dcb 39 2024-09-18T12:49:28.665 INFO:tasks.workunit.client.0.smithi078.stdout:6/860: dread d10/d2b/d37/f59 [0,4194304] 0 2024-09-18T12:49:28.666 INFO:tasks.workunit.client.1.smithi148.stdout:2/939: sync 2024-09-18T12:49:28.666 INFO:tasks.workunit.client.0.smithi078.stdout:6/861: rmdir d10/d2b/d43/d101 39 2024-09-18T12:49:28.667 INFO:tasks.workunit.client.1.smithi148.stdout:3/998: dwrite d4/d8/d1e/d6b/d31/d54/f67 [0,4194304] 0 2024-09-18T12:49:28.668 INFO:tasks.workunit.client.0.smithi078.stdout:6/862: write d10/d2b/d43/dc3/d103/d77/f78 [91076,23350] 0 2024-09-18T12:49:28.669 INFO:tasks.workunit.client.0.smithi078.stdout:6/863: stat d10/l11 0 2024-09-18T12:49:28.670 INFO:tasks.workunit.client.1.smithi148.stdout:3/999: read d4/d8/d20/d2b/d7f/d93/ffe [434002,114891] 0 2024-09-18T12:49:28.671 INFO:tasks.workunit.client.1.smithi148.stdout:2/940: creat d9/d24/d31/d34/f146 x:0 0 0 2024-09-18T12:49:28.671 INFO:tasks.workunit.client.0.smithi078.stdout:6/864: creat d10/d2b/dbd/d11e/f124 x:0 0 0 2024-09-18T12:49:28.673 INFO:tasks.workunit.client.0.smithi078.stdout:6/865: dread - d10/d2b/d43/dc3/d103/d7d/fa2 zero size 2024-09-18T12:49:28.673 INFO:tasks.workunit.client.1.smithi148.stdout:2/941: fsync d9/d3a/faf 0 2024-09-18T12:49:28.674 INFO:tasks.workunit.client.1.smithi148.stdout:7/974: dread db/dc/df/d11/dcc/fec [0,4194304] 0 2024-09-18T12:49:28.675 INFO:tasks.workunit.client.1.smithi148.stdout:2/942: dread - d9/fb4 zero size 2024-09-18T12:49:28.676 INFO:tasks.workunit.client.0.smithi078.stdout:6/866: mknod d10/d2b/d61/dd7/ddc/c125 0 2024-09-18T12:49:28.676 INFO:tasks.workunit.client.1.smithi148.stdout:2/943: write d9/d24/d67/d72/fc6 [12883,123334] 0 2024-09-18T12:49:28.677 INFO:tasks.workunit.client.0.smithi078.stdout:6/867: symlink d10/d2b/d43/dc3/d103/d7d/dfd/l126 0 2024-09-18T12:49:28.678 INFO:tasks.workunit.client.1.smithi148.stdout:7/975: dread db/dc/df/f29 [0,4194304] 0 2024-09-18T12:49:28.683 INFO:tasks.workunit.client.1.smithi148.stdout:2/944: dwrite d9/d17/d29/d92/d95/d9b/f103 [0,4194304] 0 2024-09-18T12:49:28.686 INFO:tasks.workunit.client.1.smithi148.stdout:2/945: symlink d9/d73/d81/l147 0 2024-09-18T12:49:28.687 INFO:tasks.workunit.client.1.smithi148.stdout:2/946: chown d9/d24/d47/fb2 91441242 1 2024-09-18T12:49:28.688 INFO:tasks.workunit.client.0.smithi078.stdout:6/868: dwrite d10/d2b/d43/dc3/d103/d7d/fa2 [0,4194304] 0 2024-09-18T12:49:28.688 INFO:tasks.workunit.client.1.smithi148.stdout:7/976: dwrite db/dc/df/d11/d34/d69/ff7 [0,4194304] 0 2024-09-18T12:49:28.689 INFO:tasks.workunit.client.0.smithi078.stdout:6/869: chown d10/d2b/l57 2069 1 2024-09-18T12:49:28.689 INFO:tasks.workunit.client.1.smithi148.stdout:7/977: readlink db/dc/df/d11/dac/le9 0 2024-09-18T12:49:28.692 INFO:tasks.workunit.client.0.smithi078.stdout:6/870: creat d10/d2b/d43/d53/d45/d55/f127 x:0 0 0 2024-09-18T12:49:28.695 INFO:tasks.workunit.client.0.smithi078.stdout:6/871: creat d10/d2b/d43/de5/f128 x:0 0 0 2024-09-18T12:49:28.695 INFO:tasks.workunit.client.1.smithi148.stdout:2/947: mknod d9/d17/d29/d92/d95/d64/d141/c148 0 2024-09-18T12:49:28.695 INFO:tasks.workunit.client.0.smithi078.stdout:6/872: dread - d10/d2b/d43/f110 zero size 2024-09-18T12:49:28.696 INFO:tasks.workunit.client.0.smithi078.stdout:6/873: stat d10/d2b/d43/fd1 0 2024-09-18T12:49:28.701 INFO:tasks.workunit.client.1.smithi148.stdout:2/948: link d9/d24/d31/d9d/f10c d9/d24/d67/d72/d107/d115/f149 0 2024-09-18T12:49:28.701 INFO:tasks.workunit.client.1.smithi148.stdout:2/949: dread - d9/d24/d67/dc7/ddd/f139 zero size 2024-09-18T12:49:28.702 INFO:tasks.workunit.client.0.smithi078.stdout:6/874: dwrite d10/f1e [0,4194304] 0 2024-09-18T12:49:28.702 INFO:tasks.workunit.client.1.smithi148.stdout:2/950: write d9/d24/d31/d34/d7b/f110 [121410,22525] 0 2024-09-18T12:49:28.705 INFO:tasks.workunit.client.1.smithi148.stdout:2/951: creat d9/d24/d31/d9d/dcd/d10f/f14a x:0 0 0 2024-09-18T12:49:28.712 INFO:tasks.workunit.client.1.smithi148.stdout:7/978: dwrite db/dc/df/d1d/d68/d7a/fcd [0,4194304] 0 2024-09-18T12:49:28.715 INFO:tasks.workunit.client.0.smithi078.stdout:6/875: dread d10/d2b/d43/dc3/d103/d7d/fa5 [0,4194304] 0 2024-09-18T12:49:28.716 INFO:tasks.workunit.client.1.smithi148.stdout:7/979: dread db/dc/df/d11/d34/d69/f96 [4194304,4194304] 0 2024-09-18T12:49:28.717 INFO:tasks.workunit.client.0.smithi078.stdout:6/876: write d10/d2b/d43/d53/f56 [4421249,117632] 0 2024-09-18T12:49:28.720 INFO:tasks.workunit.client.0.smithi078.stdout:6/877: unlink d10/d2b/d61/dd7/lec 0 2024-09-18T12:49:28.732 INFO:tasks.workunit.client.1.smithi148.stdout:2/952: write d9/d73/fde [142912,76282] 0 2024-09-18T12:49:28.733 INFO:tasks.workunit.client.1.smithi148.stdout:7/980: write db/dc/df/d2c/fb9 [516264,44680] 0 2024-09-18T12:49:28.734 INFO:tasks.workunit.client.0.smithi078.stdout:6/878: truncate d10/d2b/d43/dc3/d103/d77/f78 2556388 0 2024-09-18T12:49:28.736 INFO:tasks.workunit.client.1.smithi148.stdout:2/953: creat d9/d24/d67/d72/d8f/f14b x:0 0 0 2024-09-18T12:49:28.737 INFO:tasks.workunit.client.1.smithi148.stdout:7/981: symlink db/dc/df/d1d/d41/db7/l12c 0 2024-09-18T12:49:28.738 INFO:tasks.workunit.client.1.smithi148.stdout:2/954: chown d9/d24/d67/df0/f11e 50353191 1 2024-09-18T12:49:28.739 INFO:tasks.workunit.client.1.smithi148.stdout:7/982: mknod db/dc/df/d2c/de1/c12d 0 2024-09-18T12:49:28.739 INFO:tasks.workunit.client.1.smithi148.stdout:2/955: write d9/d17/d29/d98/f102 [340203,109379] 0 2024-09-18T12:49:28.741 INFO:tasks.workunit.client.1.smithi148.stdout:2/956: creat d9/d24/d47/f14c x:0 0 0 2024-09-18T12:49:28.742 INFO:tasks.workunit.client.0.smithi078.stdout:2/577: sync 2024-09-18T12:49:28.742 INFO:tasks.workunit.client.1.smithi148.stdout:7/983: mkdir db/dc/df/d11/d12e 0 2024-09-18T12:49:28.743 INFO:tasks.workunit.client.1.smithi148.stdout:7/984: dread - db/dc/df/d2c/d55/f102 zero size 2024-09-18T12:49:28.747 INFO:tasks.workunit.client.0.smithi078.stdout:6/879: dread d10/d2b/d43/f6f [0,4194304] 0 2024-09-18T12:49:28.747 INFO:tasks.workunit.client.1.smithi148.stdout:2/957: dwrite d9/d24/d31/d9d/fcb [0,4194304] 0 2024-09-18T12:49:28.748 INFO:tasks.workunit.client.1.smithi148.stdout:7/985: creat db/dc/df/d11/ddc/f12f x:0 0 0 2024-09-18T12:49:28.752 INFO:tasks.workunit.client.1.smithi148.stdout:7/986: read db/dc/df/d2c/d55/f6e [2793934,95193] 0 2024-09-18T12:49:28.753 INFO:tasks.workunit.client.1.smithi148.stdout:2/958: getdents d9/d3a 0 2024-09-18T12:49:28.755 INFO:tasks.workunit.client.1.smithi148.stdout:7/987: truncate db/dc/df/d2c/d55/daf/d38/fd2 4663716 0 2024-09-18T12:49:28.755 INFO:tasks.workunit.client.1.smithi148.stdout:7/988: readlink db/lbf 0 2024-09-18T12:49:28.756 INFO:tasks.workunit.client.1.smithi148.stdout:2/959: symlink d9/d17/d29/d92/d95/d9b/d105/l14d 0 2024-09-18T12:49:28.759 INFO:tasks.workunit.client.1.smithi148.stdout:7/989: creat db/d52/d4f/de7/d118/f130 x:0 0 0 2024-09-18T12:49:28.759 INFO:tasks.workunit.client.0.smithi078.stdout:2/578: dwrite d4/d8/d23/d52/d5f/d86/d3b/d4f/f61 [0,4194304] 0 2024-09-18T12:49:28.761 INFO:tasks.workunit.client.1.smithi148.stdout:7/990: mkdir db/dc/df/d2c/d131 0 2024-09-18T12:49:28.761 INFO:tasks.workunit.client.1.smithi148.stdout:7/991: stat db/d52/d4f 0 2024-09-18T12:49:28.763 INFO:tasks.workunit.client.1.smithi148.stdout:7/992: write db/dc/df/d1d/d68/d7a/da7/d125/f120 [458199,73751] 0 2024-09-18T12:49:28.764 INFO:tasks.workunit.client.0.smithi078.stdout:2/579: creat d4/d8/d23/d52/d5f/d81/dac/fba x:0 0 0 2024-09-18T12:49:28.765 INFO:tasks.workunit.client.0.smithi078.stdout:2/580: write d4/d8/d6c/d70/fa3 [205327,5102] 0 2024-09-18T12:49:28.767 INFO:tasks.workunit.client.0.smithi078.stdout:2/581: fsync d4/d8/d23/f6d 0 2024-09-18T12:49:28.769 INFO:tasks.workunit.client.0.smithi078.stdout:2/582: truncate d4/d8/f78 814327 0 2024-09-18T12:49:28.771 INFO:tasks.workunit.client.1.smithi148.stdout:7/993: dwrite db/dc/df/d11/ddc/f7c [0,4194304] 0 2024-09-18T12:49:28.774 INFO:tasks.workunit.client.1.smithi148.stdout:7/994: creat db/dc/df/d11/d43/f132 x:0 0 0 2024-09-18T12:49:28.779 INFO:tasks.workunit.client.1.smithi148.stdout:7/995: dwrite db/dc/df/d1d/d68/d7a/da7/f122 [0,4194304] 0 2024-09-18T12:49:28.782 INFO:tasks.workunit.client.0.smithi078.stdout:2/583: truncate d4/f99 3700153 0 2024-09-18T12:49:28.784 INFO:tasks.workunit.client.1.smithi148.stdout:7/996: mknod db/dc/df/d11/db3/d124/c133 0 2024-09-18T12:49:28.785 INFO:tasks.workunit.client.0.smithi078.stdout:2/584: truncate d4/d8/d23/d52/d5f/d86/d3b/d55/f75 4759861 0 2024-09-18T12:49:28.792 INFO:tasks.workunit.client.0.smithi078.stdout:2/585: dwrite d4/d8/d23/d52/d5f/d86/d3b/d4f/fb9 [0,4194304] 0 2024-09-18T12:49:28.798 INFO:tasks.workunit.client.0.smithi078.stdout:2/586: rename d4/db/dc/c9b to d4/cbb 0 2024-09-18T12:49:28.803 INFO:tasks.workunit.client.0.smithi078.stdout:2/587: dread d4/d8/d23/f9e [0,4194304] 0 2024-09-18T12:49:28.805 INFO:tasks.workunit.client.0.smithi078.stdout:2/588: mkdir d4/db/d45/dbc 0 2024-09-18T12:49:28.805 INFO:tasks.workunit.client.1.smithi148.stdout:7/997: dread db/dc/df/d11/d34/d69/f71 [0,4194304] 0 2024-09-18T12:49:28.805 INFO:tasks.workunit.client.0.smithi078.stdout:2/589: fdatasync d4/d8/d23/d52/d7c/f82 0 2024-09-18T12:49:28.808 INFO:tasks.workunit.client.0.smithi078.stdout:2/590: mkdir d4/d8/d23/d52/d5f/d81/dae/dbd 0 2024-09-18T12:49:28.811 INFO:tasks.workunit.client.0.smithi078.stdout:2/591: read d4/db/dc/f1b [4190367,106235] 0 2024-09-18T12:49:28.812 INFO:tasks.workunit.client.0.smithi078.stdout:2/592: rmdir d4/d8/d23/d52/d5f/d86/d33 39 2024-09-18T12:49:28.814 INFO:tasks.workunit.client.0.smithi078.stdout:2/593: creat d4/db/d45/dbc/fbe x:0 0 0 2024-09-18T12:49:28.815 INFO:tasks.workunit.client.0.smithi078.stdout:2/594: readlink d4/db/d45/l54 0 2024-09-18T12:49:28.817 INFO:tasks.workunit.client.0.smithi078.stdout:2/595: unlink d4/d8/d23/d52/d5f/d86/d3b/d4f/f94 0 2024-09-18T12:49:28.820 INFO:tasks.workunit.client.0.smithi078.stdout:2/596: rename d4/db/c47 to d4/db/d45/cbf 0 2024-09-18T12:49:28.820 INFO:tasks.workunit.client.1.smithi148.stdout:7/998: dwrite db/dc/df/d11/f3a [0,4194304] 0 2024-09-18T12:49:28.821 INFO:tasks.workunit.client.1.smithi148.stdout:7/999: write db/dc/df/d2c/fb9 [502228,94925] 0 2024-09-18T12:49:28.826 INFO:tasks.workunit.client.0.smithi078.stdout:2/597: dwrite d4/db/f68 [0,4194304] 0 2024-09-18T12:49:28.828 INFO:tasks.workunit.client.0.smithi078.stdout:2/598: truncate d4/db/d45/dbc/fbe 212820 0 2024-09-18T12:49:28.834 INFO:tasks.workunit.client.0.smithi078.stdout:2/599: dread d4/d8/d23/d52/d5f/d86/d3b/d4f/fb9 [0,4194304] 0 2024-09-18T12:49:28.839 INFO:tasks.workunit.client.0.smithi078.stdout:2/600: mkdir d4/db/dc/dc0 0 2024-09-18T12:49:28.843 INFO:tasks.workunit.client.0.smithi078.stdout:2/601: creat d4/db/dc/fc1 x:0 0 0 2024-09-18T12:49:28.848 INFO:tasks.workunit.client.0.smithi078.stdout:2/602: link d4/dd/f8b d4/d20/fc2 0 2024-09-18T12:49:28.850 INFO:tasks.workunit.client.1.smithi148.stdout:2/960: sync 2024-09-18T12:49:28.850 INFO:tasks.workunit.client.0.smithi078.stdout:2/603: truncate d4/d8/d23/d52/d5f/d81/dac/fba 768320 0 2024-09-18T12:49:28.857 INFO:tasks.workunit.client.0.smithi078.stdout:2/604: creat d4/d8/d23/d52/d5f/d81/dac/fc3 x:0 0 0 2024-09-18T12:49:28.861 INFO:tasks.workunit.client.1.smithi148.stdout:2/961: creat d9/d17/d29/d98/f14e x:0 0 0 2024-09-18T12:49:28.863 INFO:tasks.workunit.client.1.smithi148.stdout:2/962: write d9/fe9 [5661067,28253] 0 2024-09-18T12:49:28.864 INFO:tasks.workunit.client.1.smithi148.stdout:2/963: truncate d9/d17/d29/d92/f111 1562600 0 2024-09-18T12:49:28.866 INFO:tasks.workunit.client.1.smithi148.stdout:2/964: fdatasync d9/f40 0 2024-09-18T12:49:28.893 INFO:tasks.workunit.client.1.smithi148.stdout:2/965: dwrite d9/d17/d29/f3e [0,4194304] 0 2024-09-18T12:49:28.974 INFO:tasks.workunit.client.0.smithi078.stdout:2/605: dread d4/d8/d23/d52/d5f/d86/d3b/d55/f75 [4194304,4194304] 0 2024-09-18T12:49:28.976 INFO:tasks.workunit.client.0.smithi078.stdout:2/606: creat d4/d8/d23/d52/d5f/d86/fc4 x:0 0 0 2024-09-18T12:49:28.977 INFO:tasks.workunit.client.0.smithi078.stdout:2/607: readlink d4/d8/d23/d52/d5f/d86/d33/l9c 0 2024-09-18T12:49:28.978 INFO:tasks.workunit.client.0.smithi078.stdout:2/608: chown d4/d8/d23/d52 24366929 1 2024-09-18T12:49:28.979 INFO:tasks.workunit.client.0.smithi078.stdout:2/609: mknod d4/d8/cc5 0 2024-09-18T12:49:28.984 INFO:tasks.workunit.client.1.smithi148.stdout:2/966: sync 2024-09-18T12:49:29.059 INFO:tasks.workunit.client.1.smithi148.stdout:2/967: symlink d9/l14f 0 2024-09-18T12:49:29.060 INFO:tasks.workunit.client.0.smithi078.stdout:2/610: rename d4/dd/l27 to d4/db/lc6 0 2024-09-18T12:49:29.105 INFO:tasks.workunit.client.0.smithi078.stdout:0/682: sync 2024-09-18T12:49:29.105 INFO:tasks.workunit.client.0.smithi078.stdout:8/611: sync 2024-09-18T12:49:29.108 INFO:tasks.workunit.client.0.smithi078.stdout:8/612: mknod d0/d7/d53/d57/d67/cc3 0 2024-09-18T12:49:29.110 INFO:tasks.workunit.client.0.smithi078.stdout:2/611: creat d4/dd/fc7 x:0 0 0 2024-09-18T12:49:29.112 INFO:tasks.workunit.client.0.smithi078.stdout:0/683: unlink d3/d1f/d2e/d4e/d37/d72/lc7 0 2024-09-18T12:49:29.117 INFO:tasks.workunit.client.0.smithi078.stdout:2/612: dread d4/d8/f50 [0,4194304] 0 2024-09-18T12:49:29.118 INFO:tasks.workunit.client.0.smithi078.stdout:8/613: link d0/f14 d0/d7/d1e/da9/d6d/fc4 0 2024-09-18T12:49:29.119 INFO:tasks.workunit.client.0.smithi078.stdout:8/614: chown d0/d7/dc/d1f/d23/d9c 11101 1 2024-09-18T12:49:29.123 INFO:tasks.workunit.client.1.smithi148.stdout:2/968: write d9/d17/d29/d92/d95/d9b/fc0 [980508,58456] 0 2024-09-18T12:49:29.124 INFO:tasks.workunit.client.0.smithi078.stdout:8/615: dread d0/d39/d4c/d77/fa2 [0,4194304] 0 2024-09-18T12:49:29.124 INFO:tasks.workunit.client.0.smithi078.stdout:0/684: write d3/d1f/d2e/d8f/f9a [238672,57325] 0 2024-09-18T12:49:29.127 INFO:tasks.workunit.client.0.smithi078.stdout:2/613: truncate d4/d8/d23/d52/d5f/d86/f60 4332275 0 2024-09-18T12:49:29.130 INFO:tasks.workunit.client.0.smithi078.stdout:0/685: read d3/f17 [634577,129487] 0 2024-09-18T12:49:29.134 INFO:tasks.workunit.client.1.smithi148.stdout:2/969: link d9/d17/d29/d92/d95/f13e d9/d24/d31/d34/d42/f150 0 2024-09-18T12:49:29.137 INFO:tasks.workunit.client.0.smithi078.stdout:8/616: dwrite d0/d7/d1e/da9/d6d/fae [0,4194304] 0 2024-09-18T12:49:29.141 INFO:tasks.workunit.client.0.smithi078.stdout:2/614: truncate d4/d8/d23/d52/d5f/d86/d3b/d4f/f61 2117416 0 2024-09-18T12:49:29.142 INFO:tasks.workunit.client.0.smithi078.stdout:8/617: dread d0/db7/d62/f81 [0,4194304] 0 2024-09-18T12:49:29.144 INFO:tasks.workunit.client.0.smithi078.stdout:8/618: write d0/d39/d4c/d77/fbe [471042,123196] 0 2024-09-18T12:49:29.145 INFO:tasks.workunit.client.0.smithi078.stdout:2/615: link d4/l17 d4/dd/lc8 0 2024-09-18T12:49:29.145 INFO:tasks.workunit.client.0.smithi078.stdout:0/686: dread d3/d1f/d2e/d4e/f3d [0,4194304] 0 2024-09-18T12:49:29.147 INFO:tasks.workunit.client.0.smithi078.stdout:2/616: mknod d4/d1a/cc9 0 2024-09-18T12:49:29.148 INFO:tasks.workunit.client.1.smithi148.stdout:2/970: dwrite d9/d17/d29/d92/d95/d9b/fef [0,4194304] 0 2024-09-18T12:49:29.153 INFO:tasks.workunit.client.1.smithi148.stdout:2/971: creat d9/d24/d31/d9d/dcd/f151 x:0 0 0 2024-09-18T12:49:29.154 INFO:tasks.workunit.client.0.smithi078.stdout:0/687: dwrite d3/d1f/d2e/d8f/f9a [0,4194304] 0 2024-09-18T12:49:29.155 INFO:tasks.workunit.client.0.smithi078.stdout:2/617: write d4/d8/d23/fa6 [706182,87688] 0 2024-09-18T12:49:29.157 INFO:tasks.workunit.client.0.smithi078.stdout:2/618: dread d4/d8/f50 [0,4194304] 0 2024-09-18T12:49:29.160 INFO:tasks.workunit.client.0.smithi078.stdout:2/619: creat d4/d8/d23/d52/d5f/d86/d3b/d4f/fca x:0 0 0 2024-09-18T12:49:29.163 INFO:tasks.workunit.client.0.smithi078.stdout:2/620: creat d4/d8/d23/d52/d5f/d81/dac/daf/fcb x:0 0 0 2024-09-18T12:49:29.166 INFO:tasks.workunit.client.0.smithi078.stdout:2/621: creat d4/d8/d23/d52/fcc x:0 0 0 2024-09-18T12:49:29.167 INFO:tasks.workunit.client.0.smithi078.stdout:2/622: readlink d4/d8/d23/d52/d5f/dab/lb1 0 2024-09-18T12:49:29.168 INFO:tasks.workunit.client.0.smithi078.stdout:2/623: write d4/db/dc/fc1 [893541,128605] 0 2024-09-18T12:49:29.170 INFO:tasks.workunit.client.0.smithi078.stdout:2/624: creat d4/d1a/fcd x:0 0 0 2024-09-18T12:49:29.176 INFO:tasks.workunit.client.0.smithi078.stdout:2/625: dread d4/d8/d23/d52/d5f/d86/d3b/f58 [0,4194304] 0 2024-09-18T12:49:29.182 INFO:tasks.workunit.client.0.smithi078.stdout:2/626: write d4/d8/d23/d52/d5f/d86/d3b/f63 [714040,42394] 0 2024-09-18T12:49:29.183 INFO:tasks.workunit.client.0.smithi078.stdout:2/627: read d4/db/dc/f62 [442206,16376] 0 2024-09-18T12:49:29.185 INFO:tasks.workunit.client.0.smithi078.stdout:0/688: dread d3/d1f/d2e/d4e/f9c [0,4194304] 0 2024-09-18T12:49:29.188 INFO:tasks.workunit.client.0.smithi078.stdout:0/689: mknod d3/d1f/d2e/d4e/d37/cf7 0 2024-09-18T12:49:29.189 INFO:tasks.workunit.client.0.smithi078.stdout:0/690: write d3/d1f/fd8 [3568340,80352] 0 2024-09-18T12:49:29.190 INFO:tasks.workunit.client.0.smithi078.stdout:0/691: write d3/d1f/fdf [777162,57846] 0 2024-09-18T12:49:29.193 INFO:tasks.workunit.client.0.smithi078.stdout:0/692: chown d3/d1f/d2e/d4e/d37/d72/cbf 0 1 2024-09-18T12:49:29.195 INFO:tasks.workunit.client.0.smithi078.stdout:0/693: mknod d3/d1f/d2e/d4e/cf8 0 2024-09-18T12:49:29.198 INFO:tasks.workunit.client.0.smithi078.stdout:0/694: write d3/f47 [4115124,25025] 0 2024-09-18T12:49:29.199 INFO:tasks.workunit.client.0.smithi078.stdout:0/695: fdatasync d3/d1f/fdf 0 2024-09-18T12:49:29.201 INFO:tasks.workunit.client.0.smithi078.stdout:0/696: creat d3/d1f/d2e/ff9 x:0 0 0 2024-09-18T12:49:29.203 INFO:tasks.workunit.client.0.smithi078.stdout:0/697: creat d3/d1f/d2e/d4e/d37/d72/d96/ffa x:0 0 0 2024-09-18T12:49:29.203 INFO:tasks.workunit.client.0.smithi078.stdout:0/698: read d3/d1f/d2e/f35 [3476736,100679] 0 2024-09-18T12:49:29.206 INFO:tasks.workunit.client.0.smithi078.stdout:0/699: link d3/d1f/d2e/d4e/la5 d3/d1f/d2e/d68/dc9/lfb 0 2024-09-18T12:49:29.206 INFO:tasks.workunit.client.0.smithi078.stdout:0/700: stat d3/d82/dd7 0 2024-09-18T12:49:29.207 INFO:tasks.workunit.client.0.smithi078.stdout:0/701: truncate d3/d1f/fb8 682455 0 2024-09-18T12:49:29.209 INFO:tasks.workunit.client.0.smithi078.stdout:0/702: fdatasync d3/d1f/d2e/d8f/d90/fd4 0 2024-09-18T12:49:29.210 INFO:tasks.workunit.client.0.smithi078.stdout:0/703: stat d3/d1f/d2e/d4e/c86 0 2024-09-18T12:49:29.211 INFO:tasks.workunit.client.0.smithi078.stdout:0/704: chown d3/c7d 15 1 2024-09-18T12:49:29.215 INFO:tasks.workunit.client.0.smithi078.stdout:0/705: write d3/d1f/d2e/d4e/d37/d72/d96/f9d [205571,35379] 0 2024-09-18T12:49:29.217 INFO:tasks.workunit.client.1.smithi148.stdout:2/972: sync 2024-09-18T12:49:29.218 INFO:tasks.workunit.client.0.smithi078.stdout:0/706: mknod d3/d1f/d2e/d68/cfc 0 2024-09-18T12:49:29.218 INFO:tasks.workunit.client.1.smithi148.stdout:2/973: dread - d9/d24/d67/d72/d8f/f14b zero size 2024-09-18T12:49:29.218 INFO:tasks.workunit.client.0.smithi078.stdout:0/707: chown d3/c1b 869735789 1 2024-09-18T12:49:29.220 INFO:tasks.workunit.client.1.smithi148.stdout:2/974: creat d9/d24/d31/d9d/dcd/f152 x:0 0 0 2024-09-18T12:49:29.221 INFO:tasks.workunit.client.0.smithi078.stdout:0/708: creat d3/d1f/df2/ffd x:0 0 0 2024-09-18T12:49:29.227 INFO:tasks.workunit.client.1.smithi148.stdout:2/975: write d9/d3a/f8d [2046055,38363] 0 2024-09-18T12:49:29.229 INFO:tasks.workunit.client.1.smithi148.stdout:2/976: mkdir d9/d17/d29/d92/d95/d64/d141/d153 0 2024-09-18T12:49:29.234 INFO:tasks.workunit.client.0.smithi078.stdout:0/709: dread d3/d1f/d2e/d68/d30/f59 [0,4194304] 0 2024-09-18T12:49:29.234 INFO:tasks.workunit.client.1.smithi148.stdout:2/977: dwrite d9/d24/d31/d34/d7b/f13c [0,4194304] 0 2024-09-18T12:49:29.235 INFO:tasks.workunit.client.0.smithi078.stdout:0/710: chown d3/cf 0 1 2024-09-18T12:49:29.236 INFO:tasks.workunit.client.0.smithi078.stdout:0/711: chown d3/c12 2302050 1 2024-09-18T12:49:29.238 INFO:tasks.workunit.client.0.smithi078.stdout:0/712: write d3/d1f/d2e/d68/d30/d7c/da3/de2/ff6 [468907,118288] 0 2024-09-18T12:49:29.238 INFO:tasks.workunit.client.1.smithi148.stdout:2/978: fdatasync d9/d24/d67/d72/d107/f145 0 2024-09-18T12:49:29.244 INFO:tasks.workunit.client.1.smithi148.stdout:2/979: rename d9/d24/d31/fc8 to d9/d24/d31/d34/f154 0 2024-09-18T12:49:29.246 INFO:tasks.workunit.client.1.smithi148.stdout:2/980: getdents d9/d17/d29/d92/d95/d64/d141/d153 0 2024-09-18T12:49:29.248 INFO:tasks.workunit.client.1.smithi148.stdout:2/981: symlink d9/d24/d47/l155 0 2024-09-18T12:49:29.251 INFO:tasks.workunit.client.1.smithi148.stdout:2/982: getdents d9/d17/d29/d92/d95/d64/d141 0 2024-09-18T12:49:29.251 INFO:tasks.workunit.client.0.smithi078.stdout:0/713: dwrite d3/d1f/d2e/d8f/d90/fd4 [0,4194304] 0 2024-09-18T12:49:29.252 INFO:tasks.workunit.client.1.smithi148.stdout:2/983: write d9/d17/d29/d92/d95/d64/f116 [3013781,83484] 0 2024-09-18T12:49:29.255 INFO:tasks.workunit.client.1.smithi148.stdout:2/984: creat d9/d3a/d90/f156 x:0 0 0 2024-09-18T12:49:29.256 INFO:tasks.workunit.client.0.smithi078.stdout:5/935: sync 2024-09-18T12:49:29.256 INFO:tasks.workunit.client.0.smithi078.stdout:1/637: sync 2024-09-18T12:49:29.256 INFO:tasks.workunit.client.0.smithi078.stdout:9/658: sync 2024-09-18T12:49:29.258 INFO:tasks.workunit.client.0.smithi078.stdout:9/659: chown d5/d7/d32/f89 4244318 1 2024-09-18T12:49:29.258 INFO:tasks.workunit.client.1.smithi148.stdout:2/985: mkdir d9/d24/d157 0 2024-09-18T12:49:29.259 INFO:tasks.workunit.client.0.smithi078.stdout:9/660: stat d5/d7/d32/d2a/d36 0 2024-09-18T12:49:29.261 INFO:tasks.workunit.client.0.smithi078.stdout:1/638: mkdir d0/d8/daa/db5/dc0/dcf/dd4 0 2024-09-18T12:49:29.264 INFO:tasks.workunit.client.0.smithi078.stdout:0/714: dwrite d3/d1f/f97 [0,4194304] 0 2024-09-18T12:49:29.266 INFO:tasks.workunit.client.0.smithi078.stdout:1/639: write d0/d8/da/d3e/d58/d6e/d52/f78 [4126804,79136] 0 2024-09-18T12:49:29.269 INFO:tasks.workunit.client.0.smithi078.stdout:1/640: fdatasync d0/d8/f3a 0 2024-09-18T12:49:29.271 INFO:tasks.workunit.client.0.smithi078.stdout:0/715: symlink d3/d1f/d2e/d4e/d37/lfe 0 2024-09-18T12:49:29.273 INFO:tasks.workunit.client.0.smithi078.stdout:1/641: creat d0/d5b/d6d/dc2/fd5 x:0 0 0 2024-09-18T12:49:29.274 INFO:tasks.workunit.client.0.smithi078.stdout:9/661: dwrite d5/d7/d32/d2a/d36/f43 [0,4194304] 0 2024-09-18T12:49:29.279 INFO:tasks.workunit.client.0.smithi078.stdout:9/662: creat d5/d7/d32/d81/fd6 x:0 0 0 2024-09-18T12:49:29.281 INFO:tasks.workunit.client.0.smithi078.stdout:9/663: mknod d5/d7/d32/d2a/d36/cd7 0 2024-09-18T12:49:29.282 INFO:tasks.workunit.client.0.smithi078.stdout:9/664: dread - d5/d7/d32/d2a/f7d zero size 2024-09-18T12:49:29.283 INFO:tasks.workunit.client.0.smithi078.stdout:0/716: write d3/d1f/d2e/d4e/d37/d72/f9f [361693,40380] 0 2024-09-18T12:49:29.285 INFO:tasks.workunit.client.0.smithi078.stdout:1/642: dread d0/d8/da/d3e/d50/fa0 [0,4194304] 0 2024-09-18T12:49:29.285 INFO:tasks.workunit.client.0.smithi078.stdout:0/717: truncate d3/d82/fef 531579 0 2024-09-18T12:49:29.286 INFO:tasks.workunit.client.1.smithi148.stdout:2/986: dwrite d9/d73/fb3 [0,4194304] 0 2024-09-18T12:49:29.287 INFO:tasks.workunit.client.0.smithi078.stdout:9/665: truncate d5/d7/d32/f65 5003046 0 2024-09-18T12:49:29.289 INFO:tasks.workunit.client.0.smithi078.stdout:5/936: dread d2/d4/d9/d49/f7d [0,4194304] 0 2024-09-18T12:49:29.292 INFO:tasks.workunit.client.0.smithi078.stdout:1/643: getdents d0/d8 0 2024-09-18T12:49:29.292 INFO:tasks.workunit.client.1.smithi148.stdout:2/987: read d9/ff [976378,116119] 0 2024-09-18T12:49:29.293 INFO:tasks.workunit.client.1.smithi148.stdout:2/988: chown d9/d24/d47/c50 575612 1 2024-09-18T12:49:29.293 INFO:tasks.workunit.client.1.smithi148.stdout:2/989: truncate d9/d24/d47/f14c 402521 0 2024-09-18T12:49:29.294 INFO:tasks.workunit.client.0.smithi078.stdout:5/937: creat d2/d4/d9/da/d2b/d3e/d10b/f126 x:0 0 0 2024-09-18T12:49:29.295 INFO:tasks.workunit.client.0.smithi078.stdout:5/938: fdatasync d2/d4/fb9 0 2024-09-18T12:49:29.296 INFO:tasks.workunit.client.0.smithi078.stdout:1/644: mknod d0/d8/daa/db5/cd6 0 2024-09-18T12:49:29.297 INFO:tasks.workunit.client.0.smithi078.stdout:9/666: dread d5/d7/d8/d4f/f76 [0,4194304] 0 2024-09-18T12:49:29.298 INFO:tasks.workunit.client.1.smithi148.stdout:2/990: mkdir d9/d24/d67/dc7/dce/d158 0 2024-09-18T12:49:29.301 INFO:tasks.workunit.client.1.smithi148.stdout:2/991: symlink d9/d24/d31/df7/l159 0 2024-09-18T12:49:29.303 INFO:tasks.workunit.client.0.smithi078.stdout:1/645: rename d0/d8/da/d45/fc7 to d0/d8/da/d3e/d50/da7/fd7 0 2024-09-18T12:49:29.304 INFO:tasks.workunit.client.1.smithi148.stdout:2/992: symlink d9/d17/d29/d92/d95/d9b/l15a 0 2024-09-18T12:49:29.304 INFO:tasks.workunit.client.0.smithi078.stdout:0/718: dwrite d3/f6d [0,4194304] 0 2024-09-18T12:49:29.305 INFO:tasks.workunit.client.0.smithi078.stdout:5/939: fsync d2/d4/d9/f2a 0 2024-09-18T12:49:29.307 INFO:tasks.workunit.client.0.smithi078.stdout:0/719: write d3/d1f/d2e/d4e/f48 [2681209,48922] 0 2024-09-18T12:49:29.310 INFO:tasks.workunit.client.1.smithi148.stdout:2/993: dwrite d9/d24/d31/d9d/dcd/f152 [0,4194304] 0 2024-09-18T12:49:29.311 INFO:tasks.workunit.client.0.smithi078.stdout:9/667: write d5/d7/d32/fa4 [727337,80579] 0 2024-09-18T12:49:29.311 INFO:tasks.workunit.client.0.smithi078.stdout:9/668: fsync d5/fce 0 2024-09-18T12:49:29.313 INFO:tasks.workunit.client.0.smithi078.stdout:0/720: dread - d3/d1f/d2e/d4e/d37/d72/fba zero size 2024-09-18T12:49:29.313 INFO:tasks.workunit.client.0.smithi078.stdout:9/669: chown d5/d7/d8/d4f/l9c 2419266 1 2024-09-18T12:49:29.314 INFO:tasks.workunit.client.0.smithi078.stdout:9/670: dread - d5/d7/d8/fb8 zero size 2024-09-18T12:49:29.315 INFO:tasks.workunit.client.0.smithi078.stdout:1/646: mkdir d0/d8/da/d3e/dd8 0 2024-09-18T12:49:29.318 INFO:tasks.workunit.client.1.smithi148.stdout:2/994: rename d9/d24/d31/f8a to d9/d24/d31/d34/d42/f15b 0 2024-09-18T12:49:29.321 INFO:tasks.workunit.client.0.smithi078.stdout:9/671: fsync d5/d7/d32/d2a/d68/f6f 0 2024-09-18T12:49:29.323 INFO:tasks.workunit.client.0.smithi078.stdout:1/647: rename d0/fb6 to d0/d8/da/d3e/d58/d6e/d8c/dd3/fd9 0 2024-09-18T12:49:29.324 INFO:tasks.workunit.client.0.smithi078.stdout:9/672: read f3 [3594938,112469] 0 2024-09-18T12:49:29.325 INFO:tasks.workunit.client.1.smithi148.stdout:2/995: dread d9/d24/d31/f62 [0,4194304] 0 2024-09-18T12:49:29.326 INFO:tasks.workunit.client.0.smithi078.stdout:0/721: getdents d3/d1f/d2e/d4e 0 2024-09-18T12:49:29.329 INFO:tasks.workunit.client.0.smithi078.stdout:0/722: symlink d3/d1f/d2e/d8f/lff 0 2024-09-18T12:49:29.330 INFO:tasks.workunit.client.0.smithi078.stdout:5/940: truncate d2/d4/d9/d2f/d30/f80 2678502 0 2024-09-18T12:49:29.331 INFO:tasks.workunit.client.0.smithi078.stdout:9/673: dwrite d5/d7/d8/d4f/f90 [0,4194304] 0 2024-09-18T12:49:29.331 INFO:tasks.workunit.client.1.smithi148.stdout:2/996: creat d9/d17/d29/f15c x:0 0 0 2024-09-18T12:49:29.332 INFO:tasks.workunit.client.1.smithi148.stdout:2/997: chown d9/d24/d31/d34/f146 5337456 1 2024-09-18T12:49:29.333 INFO:tasks.workunit.client.0.smithi078.stdout:0/723: chown d3/d1f/d2e/d4e/d37/d72/d96/ffa 932979828 1 2024-09-18T12:49:29.333 INFO:tasks.workunit.client.0.smithi078.stdout:5/941: fsync d2/d4/d48/fbf 0 2024-09-18T12:49:29.334 INFO:tasks.workunit.client.1.smithi148.stdout:2/998: creat d9/d17/d29/d92/d95/d64/d141/f15d x:0 0 0 2024-09-18T12:49:29.336 INFO:tasks.workunit.client.0.smithi078.stdout:9/674: dread d5/d7/d32/d91/f94 [0,4194304] 0 2024-09-18T12:49:29.339 INFO:tasks.workunit.client.0.smithi078.stdout:5/942: rename d2/d4/d9/da/c18 to d2/d4/d9/d2f/c127 0 2024-09-18T12:49:29.340 INFO:tasks.workunit.client.1.smithi148.stdout:2/999: unlink d9/d17/d29/d92/d95/d64/f116 0 2024-09-18T12:49:29.341 INFO:tasks.workunit.client.0.smithi078.stdout:0/724: getdents d3/d1f/d2e/d4e/d37/d72/ddd 0 2024-09-18T12:49:29.343 INFO:tasks.workunit.client.0.smithi078.stdout:1/648: dread d0/d8/da/d3e/d58/d6e/d52/d47/d7d/f48 [0,4194304] 0 2024-09-18T12:49:29.344 INFO:tasks.workunit.client.1.smithi148.stderr:+ rm -rf -- ./tmp.Os10ZdscgQ 2024-09-18T12:49:29.345 INFO:tasks.workunit.client.0.smithi078.stdout:9/675: dread - d5/d7/d32/d2a/f2d zero size 2024-09-18T12:49:29.348 INFO:tasks.workunit.client.0.smithi078.stdout:5/943: mknod d2/d4/d9/da/d60/db3/c128 0 2024-09-18T12:49:29.352 INFO:tasks.workunit.client.0.smithi078.stdout:5/944: unlink d2/d4/d9/da/d2b/d3e/le5 0 2024-09-18T12:49:29.353 INFO:tasks.workunit.client.0.smithi078.stdout:5/945: chown d2/d4/d48/d86/dca 0 1 2024-09-18T12:49:29.355 INFO:tasks.workunit.client.0.smithi078.stdout:9/676: link d5/d7/d32/f89 d5/d7/d32/d2a/fd8 0 2024-09-18T12:49:29.357 INFO:tasks.workunit.client.0.smithi078.stdout:5/946: rename d2/d4/d9/da/d2b/l2e to d2/d4/d9/da/d2b/d3e/d10b/l129 0 2024-09-18T12:49:29.360 INFO:tasks.workunit.client.0.smithi078.stdout:9/677: rename d5/d7/d32/d2a/fd8 to d5/d7/d32/d2a/fd9 0 2024-09-18T12:49:29.361 INFO:tasks.workunit.client.0.smithi078.stdout:9/678: fdatasync d5/d7/d32/d2a/d36/fca 0 2024-09-18T12:49:29.361 INFO:tasks.workunit.client.0.smithi078.stdout:5/947: unlink d2/d4/d9/da/d60/db3/d16/d36/d4c/f118 0 2024-09-18T12:49:29.368 INFO:tasks.workunit.client.0.smithi078.stdout:5/948: rename d2/d4/d9/da/d2b/l44 to d2/d4/d9/da/d60/db3/d2d/l12a 0 2024-09-18T12:49:29.369 INFO:tasks.workunit.client.0.smithi078.stdout:0/725: dread d3/d43/fd5 [0,4194304] 0 2024-09-18T12:49:29.370 INFO:tasks.workunit.client.0.smithi078.stdout:9/679: dwrite d5/d7/d32/d2a/f59 [4194304,4194304] 0 2024-09-18T12:49:29.385 INFO:tasks.workunit.client.0.smithi078.stdout:9/680: write d5/d7/d32/d2a/f2e [3232106,130123] 0 2024-09-18T12:49:29.389 INFO:tasks.workunit.client.0.smithi078.stdout:9/681: creat d5/d7/db3/fda x:0 0 0 2024-09-18T12:49:29.390 INFO:tasks.workunit.client.0.smithi078.stdout:0/726: dwrite d3/d1f/d2e/d8f/da1/fa2 [4194304,4194304] 0 2024-09-18T12:49:29.391 INFO:tasks.workunit.client.0.smithi078.stdout:0/727: chown d3/d1f/lbe 180 1 2024-09-18T12:49:29.392 INFO:tasks.workunit.client.0.smithi078.stdout:9/682: fdatasync d5/d40/f63 0 2024-09-18T12:49:29.397 INFO:tasks.workunit.client.0.smithi078.stdout:9/683: truncate d5/d7/d32/f65 269635 0 2024-09-18T12:49:29.400 INFO:tasks.workunit.client.0.smithi078.stdout:0/728: getdents d3/d1f/d2e/d68/dc9 0 2024-09-18T12:49:29.403 INFO:tasks.workunit.client.0.smithi078.stdout:0/729: fdatasync d3/d1f/d2e/d68/f44 0 2024-09-18T12:49:29.403 INFO:tasks.workunit.client.0.smithi078.stdout:0/730: chown d3/f47 250087426 1 2024-09-18T12:49:29.410 INFO:tasks.workunit.client.0.smithi078.stdout:0/731: dwrite d3/d1f/d2e/d68/f2b [0,4194304] 0 2024-09-18T12:49:29.424 INFO:tasks.workunit.client.0.smithi078.stdout:9/684: dread d5/d7/d32/f44 [0,4194304] 0 2024-09-18T12:49:29.424 INFO:tasks.workunit.client.0.smithi078.stdout:0/732: dwrite d3/d1f/d2e/d4e/d37/d72/d96/fab [0,4194304] 0 2024-09-18T12:49:29.427 INFO:tasks.workunit.client.0.smithi078.stdout:9/685: creat d5/d7/d32/fdb x:0 0 0 2024-09-18T12:49:29.430 INFO:tasks.workunit.client.0.smithi078.stdout:9/686: unlink d5/fcf 0 2024-09-18T12:49:29.432 INFO:tasks.workunit.client.0.smithi078.stdout:0/733: write d3/d1f/d2e/d4e/d37/f45 [1795101,69344] 0 2024-09-18T12:49:29.434 INFO:tasks.workunit.client.0.smithi078.stdout:9/687: unlink d5/d5c/fc1 0 2024-09-18T12:49:29.437 INFO:tasks.workunit.client.0.smithi078.stdout:9/688: unlink d5/fb9 0 2024-09-18T12:49:29.437 INFO:tasks.workunit.client.0.smithi078.stdout:0/734: truncate d3/d1f/d2e/d4e/d37/d72/fba 243563 0 2024-09-18T12:49:29.441 INFO:tasks.workunit.client.0.smithi078.stdout:9/689: rename d5/d7/d32/d2a/d68/lab to d5/d7/d8/d98/ldc 0 2024-09-18T12:49:29.445 INFO:tasks.workunit.client.0.smithi078.stdout:0/735: getdents d3/d1f/d2e/d68/dc9/dcd 0 2024-09-18T12:49:29.453 INFO:tasks.workunit.client.0.smithi078.stdout:0/736: dwrite d3/d1f/d2e/d68/d30/f59 [0,4194304] 0 2024-09-18T12:49:29.471 INFO:tasks.workunit.client.0.smithi078.stdout:7/516: sync 2024-09-18T12:49:29.472 INFO:tasks.workunit.client.0.smithi078.stdout:3/558: sync 2024-09-18T12:49:29.473 INFO:tasks.workunit.client.0.smithi078.stdout:0/737: dread d3/d1f/fd8 [0,4194304] 0 2024-09-18T12:49:29.474 INFO:tasks.workunit.client.0.smithi078.stdout:3/559: chown d9/d13/d63/c69 22581 1 2024-09-18T12:49:29.476 INFO:tasks.workunit.client.0.smithi078.stdout:7/517: truncate d7/f33 2906541 0 2024-09-18T12:49:29.477 INFO:tasks.workunit.client.0.smithi078.stdout:3/560: truncate d9/d54/d7f/f98 5054036 0 2024-09-18T12:49:29.478 INFO:tasks.workunit.client.0.smithi078.stdout:7/518: fsync d7/d3f/f8f 0 2024-09-18T12:49:29.482 INFO:tasks.workunit.client.0.smithi078.stdout:3/561: read d9/d13/d63/d78/f79 [81409,59049] 0 2024-09-18T12:49:29.489 INFO:tasks.workunit.client.0.smithi078.stdout:0/738: dread d3/f28 [0,4194304] 0 2024-09-18T12:49:29.495 INFO:tasks.workunit.client.0.smithi078.stdout:0/739: write d3/d1f/d2e/d8f/fd9 [427041,121049] 0 2024-09-18T12:49:29.498 INFO:tasks.workunit.client.0.smithi078.stdout:0/740: write d3/d1f/d2e/d4e/f49 [4543389,26353] 0 2024-09-18T12:49:29.499 INFO:tasks.workunit.client.0.smithi078.stdout:7/519: dwrite d7/d5d/d7a/f5c [0,4194304] 0 2024-09-18T12:49:29.503 INFO:tasks.workunit.client.0.smithi078.stdout:0/741: fdatasync d3/d1f/d2e/d4e/d37/f51 0 2024-09-18T12:49:29.506 INFO:tasks.workunit.client.0.smithi078.stdout:7/520: read d7/d9/f20 [6175066,126124] 0 2024-09-18T12:49:29.507 INFO:tasks.workunit.client.0.smithi078.stdout:0/742: dread d3/d1f/d2e/d8f/d90/dcb/fcc [0,4194304] 0 2024-09-18T12:49:29.510 INFO:tasks.workunit.client.0.smithi078.stdout:7/521: mknod d7/d26/cb5 0 2024-09-18T12:49:29.518 INFO:tasks.workunit.client.0.smithi078.stdout:7/522: write d7/d26/f2a [896879,59005] 0 2024-09-18T12:49:29.519 INFO:tasks.workunit.client.0.smithi078.stdout:7/523: dread - d7/d3f/f8f zero size 2024-09-18T12:49:29.523 INFO:tasks.workunit.client.0.smithi078.stdout:7/524: truncate d7/d9/f1f 563257 0 2024-09-18T12:49:29.523 INFO:tasks.workunit.client.0.smithi078.stdout:0/743: dwrite d3/d1f/d2e/d8f/d90/fa4 [0,4194304] 0 2024-09-18T12:49:29.524 INFO:tasks.workunit.client.0.smithi078.stdout:7/525: dread - d7/d9/d14/fa9 zero size 2024-09-18T12:49:29.528 INFO:tasks.workunit.client.0.smithi078.stdout:7/526: fsync d7/d9/fe 0 2024-09-18T12:49:29.537 INFO:tasks.workunit.client.0.smithi078.stdout:0/744: dwrite d3/d1f/d2e/d68/d30/fe3 [0,4194304] 0 2024-09-18T12:49:29.545 INFO:tasks.workunit.client.0.smithi078.stdout:7/527: write d7/d9/d14/d22/d35/d49/f7c [883439,78126] 0 2024-09-18T12:49:29.549 INFO:tasks.workunit.client.0.smithi078.stdout:0/745: write d3/f17 [1361151,47905] 0 2024-09-18T12:49:29.550 INFO:tasks.workunit.client.0.smithi078.stdout:0/746: chown d3/d1f/d2e/d4e/d37/d72/la9 606018 1 2024-09-18T12:49:29.558 INFO:tasks.workunit.client.0.smithi078.stdout:7/528: dwrite d7/d3f/f8f [0,4194304] 0 2024-09-18T12:49:29.565 INFO:tasks.workunit.client.0.smithi078.stdout:0/747: dread d3/f47 [0,4194304] 0 2024-09-18T12:49:29.570 INFO:tasks.workunit.client.0.smithi078.stdout:6/880: sync 2024-09-18T12:49:29.570 INFO:tasks.workunit.client.0.smithi078.stdout:2/628: sync 2024-09-18T12:49:29.570 INFO:tasks.workunit.client.0.smithi078.stdout:4/710: sync 2024-09-18T12:49:29.570 INFO:tasks.workunit.client.0.smithi078.stdout:8/619: sync 2024-09-18T12:49:29.571 INFO:tasks.workunit.client.0.smithi078.stdout:6/881: dread - d10/d2b/d43/da7/f11d zero size 2024-09-18T12:49:29.572 INFO:tasks.workunit.client.0.smithi078.stdout:0/748: link d3/d1f/d2e/d4e/l71 d3/d1f/d2e/d68/d30/d7c/l100 0 2024-09-18T12:49:29.572 INFO:tasks.workunit.client.0.smithi078.stdout:6/882: readlink d10/d2b/d37/l49 0 2024-09-18T12:49:29.588 INFO:tasks.workunit.client.0.smithi078.stdout:8/620: mkdir d0/d39/dc5 0 2024-09-18T12:49:29.588 INFO:tasks.workunit.client.0.smithi078.stdout:2/629: unlink d4/d8/d23/d52/d5f/d81/dac/fba 0 2024-09-18T12:49:29.591 INFO:tasks.workunit.client.0.smithi078.stdout:6/883: write d10/d2b/d43/dc3/d103/d7d/f84 [22112,17974] 0 2024-09-18T12:49:29.591 INFO:tasks.workunit.client.0.smithi078.stdout:0/749: mknod d3/d1f/d2e/d8f/d90/c101 0 2024-09-18T12:49:29.595 INFO:tasks.workunit.client.0.smithi078.stdout:8/621: mkdir d0/d7/d1e/d4b/dc6 0 2024-09-18T12:49:29.595 INFO:tasks.workunit.client.0.smithi078.stdout:4/711: dwrite d11/f1d [0,4194304] 0 2024-09-18T12:49:29.596 INFO:tasks.workunit.client.0.smithi078.stdout:7/529: dwrite d7/d3f/f64 [0,4194304] 0 2024-09-18T12:49:29.596 INFO:tasks.workunit.client.0.smithi078.stdout:6/884: dread - d10/d2b/d37/f4a zero size 2024-09-18T12:49:29.599 INFO:tasks.workunit.client.0.smithi078.stdout:2/630: rename d4/db/dc/l21 to d4/d8/d23/d95/lce 0 2024-09-18T12:49:29.602 INFO:tasks.workunit.client.0.smithi078.stdout:0/750: creat d3/d1f/d2e/d68/dc9/f102 x:0 0 0 2024-09-18T12:49:29.603 INFO:tasks.workunit.client.0.smithi078.stdout:4/712: dread d11/d27/d47/f57 [0,4194304] 0 2024-09-18T12:49:29.611 INFO:tasks.workunit.client.0.smithi078.stdout:6/885: creat d10/d2b/d43/d53/d63/f129 x:0 0 0 2024-09-18T12:49:29.612 INFO:tasks.workunit.client.0.smithi078.stdout:2/631: chown d4/db/f1c 73 1 2024-09-18T12:49:29.616 INFO:tasks.workunit.client.0.smithi078.stdout:7/530: creat d7/d5d/d87/fb6 x:0 0 0 2024-09-18T12:49:29.620 INFO:tasks.workunit.client.0.smithi078.stdout:0/751: mkdir d3/d1f/d2e/d4e/d37/d103 0 2024-09-18T12:49:29.628 INFO:tasks.workunit.client.0.smithi078.stdout:8/622: write d0/d39/d4c/d77/d7d/f76 [897282,130893] 0 2024-09-18T12:49:29.633 INFO:tasks.workunit.client.0.smithi078.stdout:0/752: unlink d3/d1f/d2e/d4e/c86 0 2024-09-18T12:49:29.636 INFO:tasks.workunit.client.0.smithi078.stdout:8/623: dwrite d0/d7/d1e/d50/f58 [0,4194304] 0 2024-09-18T12:49:29.640 INFO:tasks.workunit.client.0.smithi078.stdout:6/886: dwrite d10/d2b/dbd/fcf [0,4194304] 0 2024-09-18T12:49:29.640 INFO:tasks.workunit.client.0.smithi078.stdout:4/713: truncate d11/d27/d47/f57 1354477 0 2024-09-18T12:49:29.641 INFO:tasks.workunit.client.0.smithi078.stdout:7/531: getdents d7/d9/d14/d22/d35/d49/d61/d7b 0 2024-09-18T12:49:29.641 INFO:tasks.workunit.client.0.smithi078.stdout:7/532: stat d7/d9/d14/d22/d35/d49/f66 0 2024-09-18T12:49:29.642 INFO:tasks.workunit.client.0.smithi078.stdout:7/533: dread - d7/d5d/d7a/d62/f8c zero size 2024-09-18T12:49:29.644 INFO:tasks.workunit.client.0.smithi078.stdout:2/632: write d4/dd/f40 [3713453,82291] 0 2024-09-18T12:49:29.646 INFO:tasks.workunit.client.0.smithi078.stdout:2/633: chown d4/d8/d23/d52/d5f/d86/fc4 311151 1 2024-09-18T12:49:29.647 INFO:tasks.workunit.client.0.smithi078.stdout:2/634: dread - d4/dd/fc7 zero size 2024-09-18T12:49:29.648 INFO:tasks.workunit.client.0.smithi078.stdout:2/635: dread - d4/d8/d23/d52/d5f/d81/dac/daf/fcb zero size 2024-09-18T12:49:29.650 INFO:tasks.workunit.client.0.smithi078.stdout:2/636: dread d4/d8/d23/f96 [0,4194304] 0 2024-09-18T12:49:29.652 INFO:tasks.workunit.client.0.smithi078.stdout:6/887: fdatasync d10/f16 0 2024-09-18T12:49:29.654 INFO:tasks.workunit.client.0.smithi078.stdout:8/624: symlink d0/d7/dc/d1f/lc7 0 2024-09-18T12:49:29.666 INFO:tasks.workunit.client.0.smithi078.stdout:8/625: mknod d0/d39/d4c/cc8 0 2024-09-18T12:49:29.733 INFO:tasks.workunit.client.0.smithi078.stdout:0/753: link d3/d1f/d2e/l8d d3/d1f/d2e/d68/dc9/l104 0 2024-09-18T12:49:29.734 INFO:tasks.workunit.client.0.smithi078.stdout:2/637: mknod d4/db/dc/dc0/ccf 0 2024-09-18T12:49:29.735 INFO:tasks.workunit.client.0.smithi078.stdout:6/888: truncate d10/d2b/d43/d53/f4d 664087 0 2024-09-18T12:49:29.737 INFO:tasks.workunit.client.0.smithi078.stdout:8/626: mknod d0/d39/d4c/cc9 0 2024-09-18T12:49:29.740 INFO:tasks.workunit.client.0.smithi078.stdout:4/714: dwrite d11/d27/d5a/d84/d40/f41 [0,4194304] 0 2024-09-18T12:49:29.740 INFO:tasks.workunit.client.0.smithi078.stdout:2/638: chown d4/d8/f78 114 1 2024-09-18T12:49:29.741 INFO:tasks.workunit.client.0.smithi078.stdout:2/639: dread - d4/dd/fc7 zero size 2024-09-18T12:49:29.742 INFO:tasks.workunit.client.0.smithi078.stdout:7/534: getdents d7/d9/d14/d22 0 2024-09-18T12:49:29.744 INFO:tasks.workunit.client.0.smithi078.stdout:4/715: mknod d11/d27/d47/d78/ce6 0 2024-09-18T12:49:29.745 INFO:tasks.workunit.client.0.smithi078.stdout:4/716: readlink d11/d27/d5a/lb9 0 2024-09-18T12:49:29.745 INFO:tasks.workunit.client.0.smithi078.stdout:4/717: stat d11/d27/d5a/d5d 0 2024-09-18T12:49:29.746 INFO:tasks.workunit.client.0.smithi078.stdout:8/627: chown d0/d7/dc/d1f/d23/d40/fc1 402 1 2024-09-18T12:49:29.746 INFO:tasks.workunit.client.0.smithi078.stdout:4/718: write d11/f1d [2886642,58476] 0 2024-09-18T12:49:29.747 INFO:tasks.workunit.client.0.smithi078.stdout:2/640: symlink d4/db/d45/dbc/ld0 0 2024-09-18T12:49:29.750 INFO:tasks.workunit.client.0.smithi078.stdout:0/754: dread - d3/d1f/d2e/d4e/db2/fda zero size 2024-09-18T12:49:29.751 INFO:tasks.workunit.client.0.smithi078.stdout:8/628: mknod d0/d7/d53/d57/d5c/cca 0 2024-09-18T12:49:29.755 INFO:tasks.workunit.client.0.smithi078.stdout:8/629: mkdir d0/d7/d53/db0/dcb 0 2024-09-18T12:49:29.809 INFO:tasks.workunit.client.0.smithi078.stdout:7/535: creat d7/d9/fb7 x:0 0 0 2024-09-18T12:49:29.810 INFO:tasks.workunit.client.0.smithi078.stdout:0/755: write d3/d1f/d2e/d68/d30/d7c/f85 [4361083,97587] 0 2024-09-18T12:49:29.812 INFO:tasks.workunit.client.0.smithi078.stdout:2/641: link d4/db/dc/dc0/ccf d4/d8/d23/d52/d5f/d81/cd1 0 2024-09-18T12:49:29.813 INFO:tasks.workunit.client.0.smithi078.stdout:8/630: creat d0/d7/dc/d71/d9b/dc2/fcc x:0 0 0 2024-09-18T12:49:29.815 INFO:tasks.workunit.client.0.smithi078.stdout:7/536: dread d7/d5d/d7a/f5c [0,4194304] 0 2024-09-18T12:49:29.817 INFO:tasks.workunit.client.0.smithi078.stdout:0/756: write d3/d1f/d2e/d4e/f48 [2077463,91597] 0 2024-09-18T12:49:29.817 INFO:tasks.workunit.client.0.smithi078.stdout:2/642: unlink d4/d8/d23/d52/d5f/d86/d3b/l87 0 2024-09-18T12:49:29.818 INFO:tasks.workunit.client.0.smithi078.stdout:4/719: dread d11/d27/d5a/d5d/f90 [0,4194304] 0 2024-09-18T12:49:29.820 INFO:tasks.workunit.client.0.smithi078.stdout:8/631: symlink d0/d7/d1e/d50/lcd 0 2024-09-18T12:49:29.823 INFO:tasks.workunit.client.0.smithi078.stdout:4/720: symlink d11/d27/d5a/d84/le7 0 2024-09-18T12:49:29.825 INFO:tasks.workunit.client.0.smithi078.stdout:8/632: rename d0/d7/d53/d57/d5c/fa8 to d0/d7/d53/d57/d5c/fce 0 2024-09-18T12:49:29.828 INFO:tasks.workunit.client.0.smithi078.stdout:7/537: dwrite d7/d26/d84/fa1 [0,4194304] 0 2024-09-18T12:49:29.829 INFO:tasks.workunit.client.0.smithi078.stdout:8/633: creat d0/d7/d53/fcf x:0 0 0 2024-09-18T12:49:29.837 INFO:tasks.workunit.client.0.smithi078.stdout:8/634: unlink d0/d7/d1e/f54 0 2024-09-18T12:49:29.838 INFO:tasks.workunit.client.0.smithi078.stdout:8/635: dread d0/d39/d4c/d77/d7d/fa6 [0,4194304] 0 2024-09-18T12:49:29.844 INFO:tasks.workunit.client.0.smithi078.stdout:4/721: dread d11/d27/d47/d4e/d76/f7e [0,4194304] 0 2024-09-18T12:49:29.844 INFO:tasks.workunit.client.0.smithi078.stdout:8/636: mkdir d0/d7/dc/d71/d9b/db6/dd0 0 2024-09-18T12:49:29.846 INFO:tasks.workunit.client.0.smithi078.stdout:4/722: dread - d11/d27/d47/d4e/f92 zero size 2024-09-18T12:49:29.846 INFO:tasks.workunit.client.0.smithi078.stdout:8/637: read d0/d7/d53/d57/d5c/d88/fac [952176,17763] 0 2024-09-18T12:49:29.848 INFO:tasks.workunit.client.0.smithi078.stdout:7/538: write d7/d9/fe [4142640,125225] 0 2024-09-18T12:49:29.850 INFO:tasks.workunit.client.0.smithi078.stdout:8/638: symlink d0/d39/d4c/d77/d7d/d3e/ld1 0 2024-09-18T12:49:29.851 INFO:tasks.workunit.client.0.smithi078.stdout:8/639: chown d0/d7/d1e/d4b/f61 155576 1 2024-09-18T12:49:29.853 INFO:tasks.workunit.client.0.smithi078.stdout:8/640: readlink d0/d7/d53/d57/d67/l82 0 2024-09-18T12:49:29.854 INFO:tasks.workunit.client.0.smithi078.stdout:4/723: write d11/d27/d5a/d84/d4b/da7/dba/dc1/fd6 [818805,117693] 0 2024-09-18T12:49:29.855 INFO:tasks.workunit.client.0.smithi078.stdout:7/539: dwrite d7/f65 [0,4194304] 0 2024-09-18T12:49:29.856 INFO:tasks.workunit.client.0.smithi078.stdout:4/724: stat d11/d27/d5a/c66 0 2024-09-18T12:49:29.861 INFO:tasks.workunit.client.0.smithi078.stdout:1/649: sync 2024-09-18T12:49:29.862 INFO:tasks.workunit.client.0.smithi078.stdout:8/641: creat d0/db7/d62/fd2 x:0 0 0 2024-09-18T12:49:29.863 INFO:tasks.workunit.client.0.smithi078.stdout:4/725: fdatasync d11/fc5 0 2024-09-18T12:49:29.863 INFO:tasks.workunit.client.0.smithi078.stdout:7/540: fsync d7/d9/d14/d22/d35/d49/d56/d8d/f9e 0 2024-09-18T12:49:29.865 INFO:tasks.workunit.client.0.smithi078.stdout:8/642: write d0/d39/d4c/d77/d7d/d3e/fa1 [327217,34702] 0 2024-09-18T12:49:29.871 INFO:tasks.workunit.client.0.smithi078.stdout:8/643: dwrite d0/d7/d1e/da9/d6d/f97 [0,4194304] 0 2024-09-18T12:49:29.906 INFO:tasks.workunit.client.0.smithi078.stdout:1/650: write d0/d8/da/d3e/d58/d6e/d52/d47/f8a [4367370,48641] 0 2024-09-18T12:49:29.907 INFO:tasks.workunit.client.0.smithi078.stdout:7/541: unlink d7/d9/d14/d22/c77 0 2024-09-18T12:49:29.914 INFO:tasks.workunit.client.0.smithi078.stdout:7/542: creat d7/d9/d14/d22/d35/d49/d56/d8d/fb8 x:0 0 0 2024-09-18T12:49:29.916 INFO:tasks.workunit.client.0.smithi078.stdout:7/543: chown d7/d9/d14/d22/d35/d49/d7d/l98 6155592 1 2024-09-18T12:49:29.918 INFO:tasks.workunit.client.0.smithi078.stdout:4/726: dread d11/d27/d5a/d84/f72 [0,4194304] 0 2024-09-18T12:49:29.918 INFO:tasks.workunit.client.0.smithi078.stdout:7/544: read d7/d9/d14/d22/f57 [2989288,44045] 0 2024-09-18T12:49:29.926 INFO:tasks.workunit.client.0.smithi078.stdout:7/545: dwrite d7/d9/d14/d22/d35/d49/d61/d89/fa4 [0,4194304] 0 2024-09-18T12:49:29.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:29 smithi148 ceph-mon[35352]: pgmap v22: 65 pgs: 65 active+clean; 3.3 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 109 MiB/s rd, 256 MiB/s wr, 502 op/s 2024-09-18T12:49:29.980 INFO:tasks.workunit.client.0.smithi078.stdout:7/546: getdents d7/d5d/d7a 0 2024-09-18T12:49:29.981 INFO:tasks.workunit.client.0.smithi078.stdout:7/547: write d7/d9/d32/fa6 [8113706,108952] 0 2024-09-18T12:49:29.985 INFO:tasks.workunit.client.0.smithi078.stdout:7/548: symlink d7/d9/d14/d22/d35/d49/d7d/lb9 0 2024-09-18T12:49:29.989 INFO:tasks.workunit.client.0.smithi078.stdout:7/549: rename d7/f90 to d7/d9/d4d/d9a/fba 0 2024-09-18T12:49:29.991 INFO:tasks.workunit.client.0.smithi078.stdout:7/550: mkdir d7/d3f/d99/dbb 0 2024-09-18T12:49:29.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:29 smithi078 ceph-mon[28091]: pgmap v22: 65 pgs: 65 active+clean; 3.3 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 109 MiB/s rd, 256 MiB/s wr, 502 op/s 2024-09-18T12:49:29.992 INFO:tasks.workunit.client.0.smithi078.stdout:7/551: readlink d7/d9/d14/d22/d35/d49/d61/l8e 0 2024-09-18T12:49:29.995 INFO:tasks.workunit.client.0.smithi078.stdout:7/552: mknod d7/d9/d4d/d6f/cbc 0 2024-09-18T12:49:29.998 INFO:tasks.workunit.client.0.smithi078.stdout:5/949: sync 2024-09-18T12:49:30.000 INFO:tasks.workunit.client.0.smithi078.stdout:5/950: chown d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/dc1 5497 1 2024-09-18T12:49:30.003 INFO:tasks.workunit.client.0.smithi078.stdout:5/951: mknod d2/d4/d9/da/d60/db3/d16/d36/d4c/df7/c12b 0 2024-09-18T12:49:30.034 INFO:tasks.workunit.client.0.smithi078.stdout:1/651: dwrite d0/d8/da/d3e/d58/d6e/d52/d47/d7d/f64 [0,4194304] 0 2024-09-18T12:49:30.034 INFO:tasks.workunit.client.0.smithi078.stdout:1/652: fsync d0/f49 0 2024-09-18T12:49:30.063 INFO:tasks.workunit.client.0.smithi078.stdout:9/690: sync 2024-09-18T12:49:30.063 INFO:tasks.workunit.client.0.smithi078.stdout:0/757: sync 2024-09-18T12:49:30.063 INFO:tasks.workunit.client.0.smithi078.stdout:6/889: sync 2024-09-18T12:49:30.063 INFO:tasks.workunit.client.0.smithi078.stdout:2/643: sync 2024-09-18T12:49:30.063 INFO:tasks.workunit.client.0.smithi078.stdout:3/562: sync 2024-09-18T12:49:30.069 INFO:tasks.workunit.client.0.smithi078.stdout:6/890: creat d10/d2b/d43/d53/d63/f12a x:0 0 0 2024-09-18T12:49:30.070 INFO:tasks.workunit.client.0.smithi078.stdout:6/891: readlink d10/d2b/d43/dc3/d103/dac/l106 0 2024-09-18T12:49:30.071 INFO:tasks.workunit.client.0.smithi078.stdout:9/691: mkdir d5/d7/dbe/ddd 0 2024-09-18T12:49:30.072 INFO:tasks.workunit.client.0.smithi078.stdout:6/892: chown d10/d2b/d43/de5 31025 1 2024-09-18T12:49:30.072 INFO:tasks.workunit.client.0.smithi078.stdout:2/644: truncate d4/dd/f5c 310549 0 2024-09-18T12:49:30.075 INFO:tasks.workunit.client.0.smithi078.stdout:0/758: dread d3/d1f/d2e/d4e/d37/d72/fba [0,4194304] 0 2024-09-18T12:49:30.076 INFO:tasks.workunit.client.0.smithi078.stdout:9/692: mknod d5/d7/d32/d2a/d36/cde 0 2024-09-18T12:49:30.078 INFO:tasks.workunit.client.0.smithi078.stdout:6/893: creat d10/d2b/d43/dc3/d103/ddd/f12b x:0 0 0 2024-09-18T12:49:30.080 INFO:tasks.workunit.client.0.smithi078.stdout:2/645: fdatasync d4/d20/fc2 0 2024-09-18T12:49:30.080 INFO:tasks.workunit.client.0.smithi078.stdout:1/653: link d0/d8/ce d0/d8/da/d3e/d50/cda 0 2024-09-18T12:49:30.090 INFO:tasks.workunit.client.0.smithi078.stdout:2/646: creat d4/db/dc/fd2 x:0 0 0 2024-09-18T12:49:30.091 INFO:tasks.workunit.client.0.smithi078.stdout:3/563: getdents d9/d2f/d43/d62 0 2024-09-18T12:49:30.092 INFO:tasks.workunit.client.0.smithi078.stdout:2/647: read d4/db/f1c [619313,97958] 0 2024-09-18T12:49:30.094 INFO:tasks.workunit.client.0.smithi078.stdout:6/894: creat d10/d2b/d43/d101/f12c x:0 0 0 2024-09-18T12:49:30.096 INFO:tasks.workunit.client.0.smithi078.stdout:9/693: creat d5/d7/d32/d2a/d68/fdf x:0 0 0 2024-09-18T12:49:30.097 INFO:tasks.workunit.client.0.smithi078.stdout:2/648: mkdir d4/dd/d8a/dd3 0 2024-09-18T12:49:30.098 INFO:tasks.workunit.client.0.smithi078.stdout:3/564: symlink d9/d13/d63/laf 0 2024-09-18T12:49:30.099 INFO:tasks.workunit.client.0.smithi078.stdout:6/895: mkdir d10/d2b/d43/dc3/d103/d7d/d12d 0 2024-09-18T12:49:30.099 INFO:tasks.workunit.client.0.smithi078.stdout:1/654: link d0/d8/da/d3e/d58/d6e/d52/d47/f69 d0/d8/daa/db5/dc0/fdb 0 2024-09-18T12:49:30.102 INFO:tasks.workunit.client.0.smithi078.stdout:6/896: fsync d10/d2b/d61/fbb 0 2024-09-18T12:49:30.105 INFO:tasks.workunit.client.0.smithi078.stdout:1/655: mknod d0/d8/da/d3e/d58/d6e/d8c/d9d/db8/cdc 0 2024-09-18T12:49:30.107 INFO:tasks.workunit.client.0.smithi078.stdout:9/694: link d5/d7/d8/f1a d5/d7/dbe/ddd/fe0 0 2024-09-18T12:49:30.109 INFO:tasks.workunit.client.0.smithi078.stdout:3/565: dwrite d9/d13/d33/d3c/f66 [0,4194304] 0 2024-09-18T12:49:30.109 INFO:tasks.workunit.client.0.smithi078.stdout:6/897: mknod d10/d2b/d43/d53/d63/d6b/d10f/c12e 0 2024-09-18T12:49:30.110 INFO:tasks.workunit.client.0.smithi078.stdout:2/649: dread d4/d1a/f2e [0,4194304] 0 2024-09-18T12:49:30.111 INFO:tasks.workunit.client.0.smithi078.stdout:6/898: chown d10/f16 12 1 2024-09-18T12:49:30.112 INFO:tasks.workunit.client.0.smithi078.stdout:1/656: creat d0/d8/da/d3e/d58/d6e/d8c/dd3/fdd x:0 0 0 2024-09-18T12:49:30.112 INFO:tasks.workunit.client.0.smithi078.stdout:3/566: chown d9/d13/d63/d78 18669 1 2024-09-18T12:49:30.116 INFO:tasks.workunit.client.0.smithi078.stdout:1/657: creat d0/d8/da/d45/fde x:0 0 0 2024-09-18T12:49:30.117 INFO:tasks.workunit.client.0.smithi078.stdout:3/567: chown d9/d13/c56 859 1 2024-09-18T12:49:30.118 INFO:tasks.workunit.client.0.smithi078.stdout:9/695: dwrite d5/d5c/f88 [4194304,4194304] 0 2024-09-18T12:49:30.119 INFO:tasks.workunit.client.0.smithi078.stdout:9/696: stat d5/d7/d32/d81/l92 0 2024-09-18T12:49:30.120 INFO:tasks.workunit.client.0.smithi078.stdout:2/650: unlink d4/dd/c2b 0 2024-09-18T12:49:30.122 INFO:tasks.workunit.client.0.smithi078.stdout:1/658: creat d0/d8/daa/db5/dc0/dcf/fdf x:0 0 0 2024-09-18T12:49:30.123 INFO:tasks.workunit.client.0.smithi078.stdout:3/568: mknod d9/d13/d63/d78/cb0 0 2024-09-18T12:49:30.125 INFO:tasks.workunit.client.0.smithi078.stdout:2/651: mknod d4/d8/d23/d52/d5f/dab/cd4 0 2024-09-18T12:49:30.131 INFO:tasks.workunit.client.0.smithi078.stdout:9/697: creat d5/d7/d32/d2a/d6b/fe1 x:0 0 0 2024-09-18T12:49:30.132 INFO:tasks.workunit.client.0.smithi078.stdout:1/659: getdents d0/d8/da/d3e/d58/d6e/d8c/d9d/dc3 0 2024-09-18T12:49:30.133 INFO:tasks.workunit.client.0.smithi078.stdout:1/660: chown d0/d8/da/d3e/d58/d6e/d52/d47/d7d/d7f/c9a 532794 1 2024-09-18T12:49:30.133 INFO:tasks.workunit.client.0.smithi078.stdout:2/652: creat d4/d8/d23/d52/d5f/d81/dae/dbd/fd5 x:0 0 0 2024-09-18T12:49:30.134 INFO:tasks.workunit.client.0.smithi078.stdout:2/653: chown d4/d1a/l4d 40917 1 2024-09-18T12:49:30.135 INFO:tasks.workunit.client.0.smithi078.stdout:9/698: creat d5/d5c/fe2 x:0 0 0 2024-09-18T12:49:30.136 INFO:tasks.workunit.client.0.smithi078.stdout:9/699: chown d5/d7/d32/d81/fd6 17 1 2024-09-18T12:49:30.136 INFO:tasks.workunit.client.0.smithi078.stdout:1/661: mkdir d0/d8/da/d3e/d50/da7/de0 0 2024-09-18T12:49:30.137 INFO:tasks.workunit.client.0.smithi078.stdout:2/654: write d4/d8/d23/d52/d5f/d86/d33/f72 [1073761,28782] 0 2024-09-18T12:49:30.140 INFO:tasks.workunit.client.0.smithi078.stdout:9/700: mkdir d5/d7/d32/d2a/d68/d97/de3 0 2024-09-18T12:49:30.141 INFO:tasks.workunit.client.0.smithi078.stdout:9/701: chown d5/d7/d32/d2a/d36/l96 124057 1 2024-09-18T12:49:30.149 INFO:tasks.workunit.client.0.smithi078.stdout:7/553: write d7/d5d/d7a/d62/fa7 [3628396,96185] 0 2024-09-18T12:49:30.152 INFO:tasks.workunit.client.0.smithi078.stdout:6/899: mknod d10/d2b/d43/d53/d45/c12f 0 2024-09-18T12:49:30.153 INFO:tasks.workunit.client.0.smithi078.stdout:8/644: dwrite d0/d7/f24 [0,4194304] 0 2024-09-18T12:49:30.156 INFO:tasks.workunit.client.0.smithi078.stdout:3/569: dread d9/d13/d33/d4e/f25 [0,4194304] 0 2024-09-18T12:49:30.156 INFO:tasks.workunit.client.0.smithi078.stdout:8/645: read d0/f14 [3045007,32575] 0 2024-09-18T12:49:30.157 INFO:tasks.workunit.client.0.smithi078.stdout:5/952: write d2/f26 [256252,37107] 0 2024-09-18T12:49:30.162 INFO:tasks.workunit.client.0.smithi078.stdout:6/900: creat d10/d2b/d43/f130 x:0 0 0 2024-09-18T12:49:30.163 INFO:tasks.workunit.client.0.smithi078.stdout:3/570: dread d9/d54/d6c/f81 [0,4194304] 0 2024-09-18T12:49:30.164 INFO:tasks.workunit.client.0.smithi078.stdout:5/953: mkdir d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/dc1/d12c 0 2024-09-18T12:49:30.164 INFO:tasks.workunit.client.0.smithi078.stdout:9/702: dread d5/d7/d8/d98/fc5 [0,4194304] 0 2024-09-18T12:49:30.165 INFO:tasks.workunit.client.0.smithi078.stdout:6/901: chown d10/d2b/d43/d53/d63/f75 2 1 2024-09-18T12:49:30.165 INFO:tasks.workunit.client.0.smithi078.stdout:8/646: creat d0/d7/d1e/d4b/dc6/fd3 x:0 0 0 2024-09-18T12:49:30.168 INFO:tasks.workunit.client.0.smithi078.stdout:8/647: write d0/d7/d1e/d50/f58 [4299139,73005] 0 2024-09-18T12:49:30.170 INFO:tasks.workunit.client.0.smithi078.stdout:8/648: chown d0/d39 11 1 2024-09-18T12:49:30.171 INFO:tasks.workunit.client.0.smithi078.stdout:5/954: creat d2/d4/d48/d86/f12d x:0 0 0 2024-09-18T12:49:30.173 INFO:tasks.workunit.client.0.smithi078.stdout:6/902: creat d10/d2b/d61/d11f/f131 x:0 0 0 2024-09-18T12:49:30.174 INFO:tasks.workunit.client.0.smithi078.stdout:9/703: rename d5/d7/db3/fda to d5/d7/d8/d98/fe4 0 2024-09-18T12:49:30.175 INFO:tasks.workunit.client.0.smithi078.stdout:9/704: dread - d5/d7/d8/fb8 zero size 2024-09-18T12:49:30.179 INFO:tasks.workunit.client.0.smithi078.stdout:6/903: mknod d10/d2b/d43/d53/d63/d6b/c132 0 2024-09-18T12:49:30.181 INFO:tasks.workunit.client.0.smithi078.stdout:6/904: write d10/d2b/d43/d53/f56 [4521274,39541] 0 2024-09-18T12:49:30.191 INFO:tasks.workunit.client.0.smithi078.stdout:6/905: dread d10/d2b/d43/dc3/d103/d77/f7e [0,4194304] 0 2024-09-18T12:49:30.191 INFO:tasks.workunit.client.0.smithi078.stdout:9/705: rmdir d5/d7 39 2024-09-18T12:49:30.195 INFO:tasks.workunit.client.0.smithi078.stdout:9/706: mkdir d5/d7/db3/de5 0 2024-09-18T12:49:30.196 INFO:tasks.workunit.client.0.smithi078.stdout:8/649: dread d0/d7/f4d [0,4194304] 0 2024-09-18T12:49:30.196 INFO:tasks.workunit.client.0.smithi078.stdout:5/955: dread d2/d4/d9/da/d60/db3/d2d/f9c [0,4194304] 0 2024-09-18T12:49:30.199 INFO:tasks.workunit.client.0.smithi078.stdout:5/956: chown d2/d4/d9/da/d60/db3/d16/d36/db0/dde/d4d/l51 2011592 1 2024-09-18T12:49:30.200 INFO:tasks.workunit.client.0.smithi078.stdout:9/707: rename d5/d7/d8/fb to d5/d7/d32/d2a/d68/d97/fe6 0 2024-09-18T12:49:30.202 INFO:tasks.workunit.client.0.smithi078.stdout:8/650: dread d0/d7/d1e/da9/d6d/f97 [0,4194304] 0 2024-09-18T12:49:30.206 INFO:tasks.workunit.client.0.smithi078.stdout:5/957: symlink d2/d4/d9/da/d60/db3/d16/d36/d68/l12e 0 2024-09-18T12:49:30.207 INFO:tasks.workunit.client.0.smithi078.stdout:9/708: link d5/f15 d5/d7/d32/d2a/d68/d97/fe7 0 2024-09-18T12:49:30.209 INFO:tasks.workunit.client.0.smithi078.stdout:9/709: fdatasync d5/d7/d8/d4f/f90 0 2024-09-18T12:49:30.209 INFO:tasks.workunit.client.0.smithi078.stdout:8/651: dwrite d0/d7/d53/d57/d67/fc0 [0,4194304] 0 2024-09-18T12:49:30.209 INFO:tasks.workunit.client.0.smithi078.stdout:5/958: rmdir d2/d4/d9/dc0 39 2024-09-18T12:49:30.212 INFO:tasks.workunit.client.0.smithi078.stdout:0/759: symlink d3/d1f/d2e/d68/l105 0 2024-09-18T12:49:30.212 INFO:tasks.workunit.client.0.smithi078.stdout:8/652: dread d0/db7/d62/f91 [0,4194304] 0 2024-09-18T12:49:30.213 INFO:tasks.workunit.client.0.smithi078.stdout:5/959: write d2/d4/d9/da/d60/db3/d2d/df2/fff [803074,99898] 0 2024-09-18T12:49:30.214 INFO:tasks.workunit.client.0.smithi078.stdout:0/760: write d3/d1f/d2e/d8f/d90/fa4 [4190073,94811] 0 2024-09-18T12:49:30.215 INFO:tasks.workunit.client.0.smithi078.stdout:0/761: chown d3/d1f/d2e/d68/l7a 80186275 1 2024-09-18T12:49:30.217 INFO:tasks.workunit.client.0.smithi078.stdout:9/710: rename d5/d7/d32/d81 to d5/d7/dbe/de8 0 2024-09-18T12:49:30.224 INFO:tasks.workunit.client.0.smithi078.stdout:9/711: unlink d5/d7/d32/d2a/d68/f77 0 2024-09-18T12:49:30.226 INFO:tasks.workunit.client.0.smithi078.stdout:5/960: dread d2/d4/d9/d2f/d30/f85 [0,4194304] 0 2024-09-18T12:49:30.226 INFO:tasks.workunit.client.0.smithi078.stdout:0/762: mknod d3/d1f/d2e/d68/d30/d7c/da3/c106 0 2024-09-18T12:49:30.227 INFO:tasks.workunit.client.0.smithi078.stdout:9/712: fsync d5/d7/dbe/de8/fd6 0 2024-09-18T12:49:30.228 INFO:tasks.workunit.client.0.smithi078.stdout:5/961: write d2/d4/d9/da/d2b/d3e/d10b/f126 [992447,68696] 0 2024-09-18T12:49:30.229 INFO:tasks.workunit.client.0.smithi078.stdout:0/763: fdatasync d3/d1f/d2e/d68/d30/f64 0 2024-09-18T12:49:30.232 INFO:tasks.workunit.client.0.smithi078.stdout:9/713: creat d5/d7/db3/de5/fe9 x:0 0 0 2024-09-18T12:49:30.235 INFO:tasks.workunit.client.0.smithi078.stdout:5/962: truncate d2/d4/d9/da/d60/db3/f40 240998 0 2024-09-18T12:49:30.237 INFO:tasks.workunit.client.0.smithi078.stdout:0/764: dwrite d3/d1f/d2e/d8f/da1/fa2 [0,4194304] 0 2024-09-18T12:49:30.239 INFO:tasks.workunit.client.0.smithi078.stdout:9/714: read d5/d7/d32/f5b [1887933,38912] 0 2024-09-18T12:49:30.246 INFO:tasks.workunit.client.0.smithi078.stdout:5/963: dwrite d2/d4/d9/da/d60/fed [0,4194304] 0 2024-09-18T12:49:30.248 INFO:tasks.workunit.client.0.smithi078.stdout:9/715: creat d5/d7/fea x:0 0 0 2024-09-18T12:49:30.250 INFO:tasks.workunit.client.0.smithi078.stdout:9/716: creat d5/dc6/feb x:0 0 0 2024-09-18T12:49:30.252 INFO:tasks.workunit.client.0.smithi078.stdout:5/964: truncate d2/d4/d9/da/d60/db3/d16/d36/db0/dde/f84 3511243 0 2024-09-18T12:49:30.258 INFO:tasks.workunit.client.0.smithi078.stdout:9/717: rename d5/l75 to d5/lec 0 2024-09-18T12:49:30.259 INFO:tasks.workunit.client.0.smithi078.stdout:9/718: dread - d5/d7/dbe/de8/fd6 zero size 2024-09-18T12:49:30.261 INFO:tasks.workunit.client.0.smithi078.stdout:9/719: fsync d5/d7/f5a 0 2024-09-18T12:49:30.262 INFO:tasks.workunit.client.0.smithi078.stdout:9/720: dread - d5/d7/d8/d4f/fbf zero size 2024-09-18T12:49:30.268 INFO:tasks.workunit.client.0.smithi078.stdout:6/906: mkdir d10/d2b/d61/d133 0 2024-09-18T12:49:30.270 INFO:tasks.workunit.client.0.smithi078.stdout:6/907: mkdir d10/d2b/d43/de5/d134 0 2024-09-18T12:49:30.270 INFO:tasks.workunit.client.0.smithi078.stdout:7/554: write d7/d26/f30 [658817,6825] 0 2024-09-18T12:49:30.271 INFO:tasks.workunit.client.0.smithi078.stdout:1/662: dwrite d0/d8/da/d3e/d58/d6e/f51 [0,4194304] 0 2024-09-18T12:49:30.276 INFO:tasks.workunit.client.0.smithi078.stdout:6/908: rename d10/d2b/fbe to d10/d2b/d43/dc3/d103/ddd/f135 0 2024-09-18T12:49:30.279 INFO:tasks.workunit.client.0.smithi078.stdout:4/727: creat d11/d27/d47/fe8 x:0 0 0 2024-09-18T12:49:30.281 INFO:tasks.workunit.client.0.smithi078.stdout:1/663: link d0/fca d0/d8/fe1 0 2024-09-18T12:49:30.282 INFO:tasks.workunit.client.0.smithi078.stdout:3/571: dwrite d9/d13/d33/d3c/d19/f49 [4194304,4194304] 0 2024-09-18T12:49:30.283 INFO:tasks.workunit.client.0.smithi078.stdout:4/728: creat d11/d27/d5a/fe9 x:0 0 0 2024-09-18T12:49:30.283 INFO:tasks.workunit.client.0.smithi078.stdout:1/664: fdatasync d0/d8/da/fbf 0 2024-09-18T12:49:30.284 INFO:tasks.workunit.client.0.smithi078.stdout:7/555: getdents d7/d9/d14 0 2024-09-18T12:49:30.285 INFO:tasks.workunit.client.0.smithi078.stdout:1/665: read - d0/d8/daa/db5/fc6 zero size 2024-09-18T12:49:30.285 INFO:tasks.workunit.client.0.smithi078.stdout:7/556: chown d7/f28 3 1 2024-09-18T12:49:30.287 INFO:tasks.workunit.client.0.smithi078.stdout:1/666: chown d0/d8/da/d3e/d58/d6e/d52/f2d 42048784 1 2024-09-18T12:49:30.288 INFO:tasks.workunit.client.0.smithi078.stdout:3/572: symlink d9/d2f/d43/lb1 0 2024-09-18T12:49:30.290 INFO:tasks.workunit.client.0.smithi078.stdout:4/729: write d11/d27/d5a/d84/d40/f41 [1814966,124463] 0 2024-09-18T12:49:30.291 INFO:tasks.workunit.client.0.smithi078.stdout:1/667: mkdir d0/d8/de2 0 2024-09-18T12:49:30.292 INFO:tasks.workunit.client.0.smithi078.stdout:7/557: symlink d7/d9/d14/d22/d35/d49/d7d/lbd 0 2024-09-18T12:49:30.293 INFO:tasks.workunit.client.0.smithi078.stdout:1/668: read d0/d8/da/d3e/d58/d6e/d52/d47/d7d/f59 [1949407,93926] 0 2024-09-18T12:49:30.294 INFO:tasks.workunit.client.0.smithi078.stdout:1/669: stat d0/d5b/ccc 0 2024-09-18T12:49:30.294 INFO:tasks.workunit.client.0.smithi078.stdout:4/730: readlink d11/d27/d5a/d84/l37 0 2024-09-18T12:49:30.296 INFO:tasks.workunit.client.0.smithi078.stdout:7/558: mknod d7/d9/d32/d3b/cbe 0 2024-09-18T12:49:30.299 INFO:tasks.workunit.client.0.smithi078.stdout:4/731: mknod d11/d27/d5a/d84/d4b/da7/dba/cea 0 2024-09-18T12:49:30.300 INFO:tasks.workunit.client.0.smithi078.stdout:1/670: truncate d0/d8/da/d3e/d58/d6e/d52/f30 248286 0 2024-09-18T12:49:30.301 INFO:tasks.workunit.client.0.smithi078.stdout:7/559: write d7/d5d/d7a/f5c [4108822,71457] 0 2024-09-18T12:49:30.306 INFO:tasks.workunit.client.0.smithi078.stdout:4/732: link d11/fc5 d11/d27/d5a/d84/d4b/da7/dba/feb 0 2024-09-18T12:49:30.308 INFO:tasks.workunit.client.0.smithi078.stdout:7/560: mknod d7/d9/d32/d3b/d9d/cbf 0 2024-09-18T12:49:30.311 INFO:tasks.workunit.client.0.smithi078.stdout:7/561: mkdir d7/d9/d32/d3b/dc0 0 2024-09-18T12:49:30.313 INFO:tasks.workunit.client.0.smithi078.stdout:9/721: truncate d5/f15 373161 0 2024-09-18T12:49:30.313 INFO:tasks.workunit.client.0.smithi078.stdout:3/573: dread d9/d13/d33/d3c/d19/f22 [0,4194304] 0 2024-09-18T12:49:30.314 INFO:tasks.workunit.client.0.smithi078.stdout:3/574: readlink d9/d13/d33/d3c/l2c 0 2024-09-18T12:49:30.314 INFO:tasks.workunit.client.0.smithi078.stdout:4/733: creat d11/d27/d47/d4e/fec x:0 0 0 2024-09-18T12:49:30.322 INFO:tasks.workunit.client.0.smithi078.stdout:9/722: dwrite d5/d7/fea [0,4194304] 0 2024-09-18T12:49:30.324 INFO:tasks.workunit.client.0.smithi078.stdout:1/671: dread d0/d5b/d6d/f80 [0,4194304] 0 2024-09-18T12:49:30.335 INFO:tasks.workunit.client.0.smithi078.stdout:8/653: dwrite d0/d7/f38 [4194304,4194304] 0 2024-09-18T12:49:30.336 INFO:tasks.workunit.client.0.smithi078.stdout:1/672: rename d0/d8/da/d3e/d50/cac to d0/d8/da/d3e/d58/d6e/d52/d47/d7d/ce3 0 2024-09-18T12:49:30.338 INFO:tasks.workunit.client.0.smithi078.stdout:3/575: dread d9/f27 [4194304,4194304] 0 2024-09-18T12:49:30.338 INFO:tasks.workunit.client.0.smithi078.stdout:7/562: dread d7/d9/d14/d22/d3e/f40 [0,4194304] 0 2024-09-18T12:49:30.340 INFO:tasks.workunit.client.0.smithi078.stdout:9/723: symlink d5/led 0 2024-09-18T12:49:30.340 INFO:tasks.workunit.client.0.smithi078.stdout:8/654: chown d0/d7/d1e/da9/d6d/f9f 20656 1 2024-09-18T12:49:30.344 INFO:tasks.workunit.client.0.smithi078.stdout:4/734: dread d11/d27/d47/d4e/fc8 [0,4194304] 0 2024-09-18T12:49:30.350 INFO:tasks.workunit.client.0.smithi078.stdout:0/765: dwrite d3/d1f/d2e/d4e/d37/f51 [0,4194304] 0 2024-09-18T12:49:30.352 INFO:tasks.workunit.client.0.smithi078.stdout:7/563: mkdir d7/d26/dc1 0 2024-09-18T12:49:30.353 INFO:tasks.workunit.client.0.smithi078.stdout:5/965: write d2/d4/d9/da/d60/db3/d2d/f42 [439374,99346] 0 2024-09-18T12:49:30.356 INFO:tasks.workunit.client.0.smithi078.stdout:5/966: fsync d2/d4/d9/da/d60/db3/d16/d36/db0/dde/ff5 0 2024-09-18T12:49:30.356 INFO:tasks.workunit.client.0.smithi078.stdout:0/766: dread d3/d1f/f67 [0,4194304] 0 2024-09-18T12:49:30.356 INFO:tasks.workunit.client.0.smithi078.stdout:1/673: symlink d0/d8/da/d3e/d50/d74/le4 0 2024-09-18T12:49:30.358 INFO:tasks.workunit.client.0.smithi078.stdout:5/967: chown d2/d4/d9/da/d60/db3/d16/d36/f41 110930935 1 2024-09-18T12:49:30.358 INFO:tasks.workunit.client.0.smithi078.stdout:8/655: rename d0/d7/dc/d71/d9b/db6/dd0 to d0/d7/d1e/da9/dd4 0 2024-09-18T12:49:30.361 INFO:tasks.workunit.client.0.smithi078.stdout:4/735: creat d11/d27/d5a/d84/d4b/da7/dba/dc1/fed x:0 0 0 2024-09-18T12:49:30.373 INFO:tasks.workunit.client.0.smithi078.stdout:5/968: creat d2/d4/d9/d49/f12f x:0 0 0 2024-09-18T12:49:30.376 INFO:tasks.workunit.client.0.smithi078.stdout:9/724: creat d5/d7/d8/fee x:0 0 0 2024-09-18T12:49:30.378 INFO:tasks.workunit.client.0.smithi078.stdout:9/725: stat d5/d7/d32/d2a/d68/d97/fe7 0 2024-09-18T12:49:30.378 INFO:tasks.workunit.client.0.smithi078.stdout:5/969: dwrite d2/d4/f4f [4194304,4194304] 0 2024-09-18T12:49:30.407 INFO:tasks.workunit.client.0.smithi078.stdout:4/736: symlink d11/d27/d5a/d84/d4b/da7/dba/dc4/dd0/lee 0 2024-09-18T12:49:30.407 INFO:tasks.workunit.client.0.smithi078.stdout:4/737: chown d11/d27/f73 0 1 2024-09-18T12:49:30.413 INFO:tasks.workunit.client.0.smithi078.stdout:0/767: rename d3/d1f/d2e/c77 to d3/d1f/d2e/d4e/c107 0 2024-09-18T12:49:30.419 INFO:tasks.workunit.client.0.smithi078.stdout:0/768: mknod d3/d1f/d2e/d68/d30/d7c/da3/de2/c108 0 2024-09-18T12:49:30.421 INFO:tasks.workunit.client.0.smithi078.stdout:0/769: read d3/d1f/d2e/d4e/d37/f5c [685235,52644] 0 2024-09-18T12:49:30.423 INFO:tasks.workunit.client.0.smithi078.stdout:5/970: creat d2/d4/d9/da/d60/db3/f130 x:0 0 0 2024-09-18T12:49:30.427 INFO:tasks.workunit.client.0.smithi078.stdout:0/770: mknod d3/d1f/d2e/d68/c109 0 2024-09-18T12:49:30.429 INFO:tasks.workunit.client.0.smithi078.stdout:5/971: mknod d2/d4/d9/da/d60/db3/d16/d36/d68/d8b/d90/c131 0 2024-09-18T12:49:30.429 INFO:tasks.workunit.client.0.smithi078.stdout:3/576: dwrite d9/d13/d63/d78/f79 [0,4194304] 0 2024-09-18T12:49:30.434 INFO:tasks.workunit.client.0.smithi078.stdout:3/577: mkdir d9/d54/d6c/d9f/db2 0 2024-09-18T12:49:30.439 INFO:tasks.workunit.client.0.smithi078.stdout:3/578: getdents d9/d54/d7f/dae 0 2024-09-18T12:49:30.442 INFO:tasks.workunit.client.0.smithi078.stdout:0/771: getdents d3/d1f/d2e/d4e/db2 0 2024-09-18T12:49:30.443 INFO:tasks.workunit.client.0.smithi078.stdout:5/972: getdents d2/d74/d10c 0 2024-09-18T12:49:30.444 INFO:tasks.workunit.client.0.smithi078.stdout:8/656: truncate d0/d7/d1e/da9/d6d/f97 3489014 0 2024-09-18T12:49:30.448 INFO:tasks.workunit.client.0.smithi078.stdout:9/726: write d5/d7/d32/d2a/d68/d97/fe7 [441356,104017] 0 2024-09-18T12:49:30.448 INFO:tasks.workunit.client.0.smithi078.stdout:3/579: link d9/d13/d33/l67 d9/d54/d6c/lb3 0 2024-09-18T12:49:30.451 INFO:tasks.workunit.client.0.smithi078.stdout:7/564: dwrite d7/d9/f1f [0,4194304] 0 2024-09-18T12:49:30.453 INFO:tasks.workunit.client.0.smithi078.stdout:1/674: dwrite d0/d8/da/d3e/d50/f7c [0,4194304] 0 2024-09-18T12:49:30.453 INFO:tasks.workunit.client.0.smithi078.stdout:5/973: write d2/d4/d9/da/d60/db3/d16/d36/db0/dde/dd4/f10a [716992,67809] 0 2024-09-18T12:49:30.455 INFO:tasks.workunit.client.0.smithi078.stdout:3/580: creat d9/d54/fb4 x:0 0 0 2024-09-18T12:49:30.462 INFO:tasks.workunit.client.0.smithi078.stdout:3/581: symlink d9/d54/d7f/lb5 0 2024-09-18T12:49:30.469 INFO:tasks.workunit.client.0.smithi078.stdout:3/582: truncate d9/d2f/f3d 2251460 0 2024-09-18T12:49:30.469 INFO:tasks.workunit.client.0.smithi078.stdout:0/772: link d3/d1f/d2e/d68/d30/c66 d3/d1f/d2e/c10a 0 2024-09-18T12:49:30.471 INFO:tasks.workunit.client.0.smithi078.stdout:0/773: unlink d3/c7d 0 2024-09-18T12:49:30.472 INFO:tasks.workunit.client.0.smithi078.stdout:3/583: mkdir d9/d54/d89/d92/db6 0 2024-09-18T12:49:30.473 INFO:tasks.workunit.client.0.smithi078.stdout:7/565: link d7/d9/d14/c24 d7/d9/d14/d22/d35/d49/cc2 0 2024-09-18T12:49:30.475 INFO:tasks.workunit.client.0.smithi078.stdout:0/774: mkdir d3/d1f/d2e/d68/d30/d7c/d10b 0 2024-09-18T12:49:30.479 INFO:tasks.workunit.client.0.smithi078.stdout:0/775: symlink d3/d43/l10c 0 2024-09-18T12:49:30.484 INFO:tasks.workunit.client.0.smithi078.stdout:3/584: dread d9/f59 [0,4194304] 0 2024-09-18T12:49:30.487 INFO:tasks.workunit.client.0.smithi078.stdout:9/727: dread f3 [0,4194304] 0 2024-09-18T12:49:30.490 INFO:tasks.workunit.client.0.smithi078.stdout:5/974: dwrite d2/d4/d9/da/d60/d7f/fa8 [4194304,4194304] 0 2024-09-18T12:49:30.490 INFO:tasks.workunit.client.0.smithi078.stdout:0/776: dwrite d3/d1f/d2e/d68/d30/f62 [0,4194304] 0 2024-09-18T12:49:30.494 INFO:tasks.workunit.client.0.smithi078.stdout:0/777: fsync d3/d1f/d2e/d4e/d37/d72/d96/f9d 0 2024-09-18T12:49:30.494 INFO:tasks.workunit.client.0.smithi078.stdout:3/585: creat d9/d54/d6c/d9f/fb7 x:0 0 0 2024-09-18T12:49:30.498 INFO:tasks.workunit.client.0.smithi078.stdout:3/586: read d9/d54/d6c/f81 [586987,105605] 0 2024-09-18T12:49:30.505 INFO:tasks.workunit.client.0.smithi078.stdout:5/975: readlink d2/d4/d9/d2f/d30/l3f 0 2024-09-18T12:49:30.505 INFO:tasks.workunit.client.0.smithi078.stdout:7/566: write d7/f1e [1890638,55129] 0 2024-09-18T12:49:30.509 INFO:tasks.workunit.client.0.smithi078.stdout:0/778: rename d3/d1f/d2e/d68/d30 to d3/d82/d10d 0 2024-09-18T12:49:30.518 INFO:tasks.workunit.client.0.smithi078.stdout:9/728: dread d5/d7/d32/d2a/d36/f43 [0,4194304] 0 2024-09-18T12:49:30.521 INFO:tasks.workunit.client.0.smithi078.stdout:3/587: mkdir d9/d54/d6c/d9f/db2/db8 0 2024-09-18T12:49:30.526 INFO:tasks.workunit.client.0.smithi078.stdout:5/976: dread d2/d4/f66 [0,4194304] 0 2024-09-18T12:49:30.527 INFO:tasks.workunit.client.0.smithi078.stdout:7/567: link d7/d9/d32/fa6 d7/d9/d14/d22/d3e/fc3 0 2024-09-18T12:49:30.527 INFO:tasks.workunit.client.0.smithi078.stdout:5/977: stat d2/d4/d9/d49 0 2024-09-18T12:49:30.538 INFO:tasks.workunit.client.0.smithi078.stdout:0/779: write d3/d82/d10d/d7c/da3/fc8 [705116,73900] 0 2024-09-18T12:49:30.540 INFO:tasks.workunit.client.0.smithi078.stdout:5/978: symlink d2/d4/d9/da/d60/db3/d16/d36/d4c/d97/l132 0 2024-09-18T12:49:30.541 INFO:tasks.workunit.client.0.smithi078.stdout:3/588: write d9/d54/f8e [361199,104655] 0 2024-09-18T12:49:30.542 INFO:tasks.workunit.client.0.smithi078.stdout:3/589: write d9/d2f/f77 [1294432,86831] 0 2024-09-18T12:49:30.543 INFO:tasks.workunit.client.0.smithi078.stdout:3/590: readlink d9/d13/l73 0 2024-09-18T12:49:30.543 INFO:tasks.workunit.client.0.smithi078.stdout:7/568: rename d7/d26/f2a to d7/fc4 0 2024-09-18T12:49:30.548 INFO:tasks.workunit.client.0.smithi078.stdout:9/729: getdents d5/d7/d32/d2a/d36 0 2024-09-18T12:49:30.552 INFO:tasks.workunit.client.0.smithi078.stdout:5/979: dwrite d2/d4/d9/da/f20 [0,4194304] 0 2024-09-18T12:49:30.556 INFO:tasks.workunit.client.0.smithi078.stdout:9/730: link d5/d7/d8/d98/fb7 d5/d7/dbe/fef 0 2024-09-18T12:49:30.557 INFO:tasks.workunit.client.0.smithi078.stdout:0/780: dwrite d3/f6c [4194304,4194304] 0 2024-09-18T12:49:30.560 INFO:tasks.workunit.client.0.smithi078.stdout:0/781: creat d3/d82/d10d/d7c/f10e x:0 0 0 2024-09-18T12:49:30.561 INFO:tasks.workunit.client.0.smithi078.stdout:0/782: chown d3/d1f/d2e/d4e/d37/d72/ddd 77588490 1 2024-09-18T12:49:30.567 INFO:tasks.workunit.client.0.smithi078.stdout:0/783: rename d3/cf to d3/d1f/d2e/d8f/d90/c10f 0 2024-09-18T12:49:30.568 INFO:tasks.workunit.client.0.smithi078.stdout:5/980: dread d2/d4/d48/fbf [0,4194304] 0 2024-09-18T12:49:30.569 INFO:tasks.workunit.client.0.smithi078.stdout:5/981: chown d2/d4/d9/da/d60/d7f/dce/l109 0 1 2024-09-18T12:49:30.570 INFO:tasks.workunit.client.0.smithi078.stdout:5/982: fsync d2/f26 0 2024-09-18T12:49:30.570 INFO:tasks.workunit.client.0.smithi078.stdout:0/784: creat d3/d1f/d2e/d4e/d37/d103/f110 x:0 0 0 2024-09-18T12:49:30.574 INFO:tasks.workunit.client.0.smithi078.stdout:5/983: creat d2/d4/d48/f133 x:0 0 0 2024-09-18T12:49:30.577 INFO:tasks.workunit.client.0.smithi078.stdout:5/984: symlink d2/d4/d9/da/d60/db3/d2d/df2/df4/l134 0 2024-09-18T12:49:30.594 INFO:tasks.workunit.client.0.smithi078.stdout:0/785: write d3/f18 [4559173,5678] 0 2024-09-18T12:49:30.597 INFO:tasks.workunit.client.0.smithi078.stdout:5/985: write d2/d4/d9/da/d60/d7f/fba [5312493,81410] 0 2024-09-18T12:49:30.598 INFO:tasks.workunit.client.0.smithi078.stdout:5/986: fdatasync d2/d4/d9/da/d60/d7f/f11b 0 2024-09-18T12:49:30.601 INFO:tasks.workunit.client.0.smithi078.stdout:0/786: creat d3/d1f/d2e/d4e/d37/d72/f111 x:0 0 0 2024-09-18T12:49:30.610 INFO:tasks.workunit.client.0.smithi078.stdout:5/987: truncate d2/d4/d48/fb5 3246440 0 2024-09-18T12:49:30.612 INFO:tasks.workunit.client.0.smithi078.stdout:5/988: fdatasync d2/d4/d9/f94 0 2024-09-18T12:49:30.616 INFO:tasks.workunit.client.0.smithi078.stdout:0/787: dread d3/d1f/d2e/d4e/d37/f57 [0,4194304] 0 2024-09-18T12:49:30.616 INFO:tasks.workunit.client.0.smithi078.stdout:0/788: chown d3/f93 28 1 2024-09-18T12:49:30.619 INFO:tasks.workunit.client.0.smithi078.stdout:0/789: creat d3/d1f/d2e/d8f/da1/f112 x:0 0 0 2024-09-18T12:49:30.623 INFO:tasks.workunit.client.0.smithi078.stdout:0/790: getdents d3/d82/d10d/d7c/da3 0 2024-09-18T12:49:30.624 INFO:tasks.workunit.client.0.smithi078.stdout:0/791: rmdir d3/d82/d10d/d7c 39 2024-09-18T12:49:30.625 INFO:tasks.workunit.client.0.smithi078.stdout:0/792: chown d3/d1f/d2e/d8f/da1 144 1 2024-09-18T12:49:30.627 INFO:tasks.workunit.client.0.smithi078.stdout:0/793: mknod d3/d1f/d2e/d4e/d37/d72/ddd/c113 0 2024-09-18T12:49:30.629 INFO:tasks.workunit.client.0.smithi078.stdout:5/989: dread d2/d4/d9/d49/f56 [0,4194304] 0 2024-09-18T12:49:30.633 INFO:tasks.workunit.client.0.smithi078.stdout:5/990: creat d2/d4/d9/da/d60/db3/d16/d36/d68/f135 x:0 0 0 2024-09-18T12:49:30.635 INFO:tasks.workunit.client.0.smithi078.stdout:5/991: dread - d2/d4/d48/fc2 zero size 2024-09-18T12:49:30.637 INFO:tasks.workunit.client.0.smithi078.stdout:5/992: unlink d2/d4/d9/da/d60/db3/d2d/df2/fff 0 2024-09-18T12:49:30.638 INFO:tasks.workunit.client.0.smithi078.stdout:0/794: truncate d3/d1f/d2e/d4e/d37/d72/f78 1573256 0 2024-09-18T12:49:30.642 INFO:tasks.workunit.client.0.smithi078.stdout:0/795: unlink d3/d1f/d2e/d4e/d37/l81 0 2024-09-18T12:49:30.646 INFO:tasks.workunit.client.0.smithi078.stdout:5/993: rename d2/d4/d48/d86/dca to d2/d4/d48/d136 0 2024-09-18T12:49:30.648 INFO:tasks.workunit.client.0.smithi078.stdout:0/796: mknod d3/d43/c114 0 2024-09-18T12:49:30.650 INFO:tasks.workunit.client.0.smithi078.stdout:0/797: creat d3/d1f/d2e/d4e/d37/d72/d96/f115 x:0 0 0 2024-09-18T12:49:30.651 INFO:tasks.workunit.client.0.smithi078.stdout:0/798: stat d3/d1f/d2e/d4e/d37/d72/l74 0 2024-09-18T12:49:30.659 INFO:tasks.workunit.client.0.smithi078.stdout:5/994: rmdir d2/d4/d48/d136 0 2024-09-18T12:49:30.664 INFO:tasks.workunit.client.0.smithi078.stdout:5/995: rename d2/d4/d9/da/d60/db3/l3b to d2/d4/d9/da/d60/db3/d16/d36/db0/dde/dbd/l137 0 2024-09-18T12:49:30.669 INFO:tasks.workunit.client.0.smithi078.stdout:5/996: rename d2/d4/d9/d2f/d30/ldf to d2/d4/d9/da/d60/db3/d16/d36/l138 0 2024-09-18T12:49:30.670 INFO:tasks.workunit.client.0.smithi078.stdout:5/997: stat d2/d4/d9/d2f/d30/l3f 0 2024-09-18T12:49:30.672 INFO:tasks.workunit.client.0.smithi078.stdout:5/998: read d2/d4/d9/d2f/d30/fa5 [158639,126284] 0 2024-09-18T12:49:30.672 INFO:tasks.workunit.client.0.smithi078.stdout:0/799: dread d3/d1f/d2e/d4e/d37/d72/f78 [0,4194304] 0 2024-09-18T12:49:30.676 INFO:tasks.workunit.client.0.smithi078.stdout:0/800: mkdir d3/d1f/d2e/d4e/db2/d116 0 2024-09-18T12:49:30.676 INFO:tasks.workunit.client.0.smithi078.stdout:0/801: chown d3/d1f/f41 20731320 1 2024-09-18T12:49:30.678 INFO:tasks.workunit.client.0.smithi078.stdout:5/999: dread - d2/d4/d9/da/d60/db3/d16/d36/db0/dde/fd9 zero size 2024-09-18T12:49:30.680 INFO:tasks.workunit.client.0.smithi078.stdout:0/802: mkdir d3/d82/d10d/d7c/d10b/d117 0 2024-09-18T12:49:30.680 INFO:tasks.workunit.client.0.smithi078.stdout:0/803: chown d3/c1b 165581 1 2024-09-18T12:49:30.681 INFO:tasks.workunit.client.0.smithi078.stdout:0/804: readlink d3/d82/d10d/d7c/da3/de2/lc4 0 2024-09-18T12:49:30.754 INFO:tasks.workunit.client.0.smithi078.stdout:2/655: sync 2024-09-18T12:49:30.755 INFO:tasks.workunit.client.0.smithi078.stdout:2/656: chown d4/l17 2 1 2024-09-18T12:49:30.756 INFO:tasks.workunit.client.0.smithi078.stdout:2/657: write d4/fa4 [870985,82829] 0 2024-09-18T12:49:30.763 INFO:tasks.workunit.client.0.smithi078.stdout:2/658: dwrite d4/d8/d23/fb7 [0,4194304] 0 2024-09-18T12:49:30.768 INFO:tasks.workunit.client.0.smithi078.stdout:2/659: fdatasync d4/d8/d23/f6d 0 2024-09-18T12:49:30.773 INFO:tasks.workunit.client.0.smithi078.stdout:2/660: truncate d4/dd/f8b 916311 0 2024-09-18T12:49:30.777 INFO:tasks.workunit.client.0.smithi078.stdout:2/661: symlink d4/ld6 0 2024-09-18T12:49:30.777 INFO:tasks.workunit.client.0.smithi078.stdout:2/662: chown d4/db/dc 20100 1 2024-09-18T12:49:30.862 INFO:tasks.workunit.client.0.smithi078.stdout:6/909: sync 2024-09-18T12:49:30.897 INFO:tasks.workunit.client.0.smithi078.stdout:6/910: write d10/f21 [1256301,78698] 0 2024-09-18T12:49:30.900 INFO:tasks.workunit.client.0.smithi078.stdout:6/911: mknod d10/d2b/d43/d53/d45/d55/c136 0 2024-09-18T12:49:30.906 INFO:tasks.workunit.client.0.smithi078.stdout:6/912: dwrite d10/d2b/d43/d53/fd5 [0,4194304] 0 2024-09-18T12:49:30.907 INFO:tasks.workunit.client.0.smithi078.stdout:6/913: chown d10/l96 1738 1 2024-09-18T12:49:30.926 INFO:tasks.workunit.client.0.smithi078.stdout:6/914: dread d10/d2b/d43/d53/d63/d6b/da1/df2/ff9 [0,4194304] 0 2024-09-18T12:49:31.044 INFO:tasks.workunit.client.0.smithi078.stdout:6/915: dread d10/d2b/d43/d53/d45/f62 [0,4194304] 0 2024-09-18T12:49:31.056 INFO:tasks.workunit.client.0.smithi078.stdout:6/916: rename d10/d2b/d43/dc3/d103/d7d/dfd/lfe to d10/d2b/d43/d53/d45/l137 0 2024-09-18T12:49:31.063 INFO:tasks.workunit.client.0.smithi078.stdout:6/917: getdents d10/d2b/d43/dc3/d103 0 2024-09-18T12:49:31.066 INFO:tasks.workunit.client.0.smithi078.stdout:6/918: fdatasync d10/d2b/d43/dc3/d103/dac/fad 0 2024-09-18T12:49:31.071 INFO:tasks.workunit.client.0.smithi078.stdout:6/919: creat d10/d2b/d43/d53/d45/f138 x:0 0 0 2024-09-18T12:49:31.072 INFO:tasks.workunit.client.0.smithi078.stdout:6/920: dread - d10/d2b/d43/da7/f11d zero size 2024-09-18T12:49:31.074 INFO:tasks.workunit.client.0.smithi078.stdout:6/921: truncate d10/d2b/fbc 608847 0 2024-09-18T12:49:31.075 INFO:tasks.workunit.client.0.smithi078.stdout:6/922: dread d10/d2b/d43/dc3/d103/dac/fad [0,4194304] 0 2024-09-18T12:49:31.077 INFO:tasks.workunit.client.0.smithi078.stdout:6/923: creat d10/d2b/d43/d53/d45/d9c/f139 x:0 0 0 2024-09-18T12:49:31.080 INFO:tasks.workunit.client.0.smithi078.stdout:6/924: unlink d10/d2b/d43/f6f 0 2024-09-18T12:49:31.082 INFO:tasks.workunit.client.0.smithi078.stdout:6/925: rmdir d10/d2b/d43/dc3/d103/d77 39 2024-09-18T12:49:31.084 INFO:tasks.workunit.client.0.smithi078.stdout:6/926: symlink d10/d2b/d43/d101/l13a 0 2024-09-18T12:49:31.086 INFO:tasks.workunit.client.0.smithi078.stdout:6/927: write d10/d2b/d43/dc4/fe6 [404273,25692] 0 2024-09-18T12:49:31.094 INFO:tasks.workunit.client.0.smithi078.stdout:6/928: getdents d10/d2b/d43/de5 0 2024-09-18T12:49:31.098 INFO:tasks.workunit.client.0.smithi078.stdout:6/929: creat d10/d2b/d43/de5/d134/f13b x:0 0 0 2024-09-18T12:49:31.114 INFO:tasks.workunit.client.0.smithi078.stdout:6/930: dwrite d10/d2b/d43/d53/f4d [0,4194304] 0 2024-09-18T12:49:31.121 INFO:tasks.workunit.client.0.smithi078.stdout:6/931: getdents d10/d2b/d43/d53/d63/d6b/da1 0 2024-09-18T12:49:31.124 INFO:tasks.workunit.client.0.smithi078.stdout:6/932: rename d10/d2b/d61/dd7/ddc to d10/d2b/d61/d133/d13c 0 2024-09-18T12:49:31.126 INFO:tasks.workunit.client.0.smithi078.stdout:6/933: dread - d10/d2b/fc2 zero size 2024-09-18T12:49:31.127 INFO:tasks.workunit.client.0.smithi078.stdout:6/934: dread - d10/d2b/d61/dd7/ff4 zero size 2024-09-18T12:49:31.128 INFO:tasks.workunit.client.0.smithi078.stdout:6/935: dread - d10/d2b/d43/f130 zero size 2024-09-18T12:49:31.140 INFO:tasks.workunit.client.0.smithi078.stdout:6/936: dwrite d10/d2b/d43/dc3/d103/dac/fad [0,4194304] 0 2024-09-18T12:49:31.144 INFO:tasks.workunit.client.0.smithi078.stdout:6/937: creat d10/d2b/d43/d53/d63/d6b/da1/f13d x:0 0 0 2024-09-18T12:49:31.146 INFO:tasks.workunit.client.0.smithi078.stdout:6/938: mknod d10/d2b/d43/da7/c13e 0 2024-09-18T12:49:31.148 INFO:tasks.workunit.client.0.smithi078.stdout:6/939: fsync d10/d2b/d43/d53/d45/d9c/fcc 0 2024-09-18T12:49:31.168 INFO:tasks.workunit.client.0.smithi078.stdout:6/940: dread d10/d2b/d43/dc3/d103/d7d/fd0 [0,4194304] 0 2024-09-18T12:49:31.170 INFO:tasks.workunit.client.0.smithi078.stdout:6/941: fsync d10/d2b/d61/d133/d13c/f117 0 2024-09-18T12:49:31.171 INFO:tasks.workunit.client.0.smithi078.stdout:6/942: write d10/d2b/d43/dc4/fe6 [1078305,4764] 0 2024-09-18T12:49:31.171 INFO:tasks.workunit.client.0.smithi078.stdout:6/943: dread - d10/d2b/d43/d101/f12c zero size 2024-09-18T12:49:31.172 INFO:tasks.workunit.client.0.smithi078.stdout:6/944: dread - d10/d2b/d43/d53/d45/ffb zero size 2024-09-18T12:49:31.174 INFO:tasks.workunit.client.0.smithi078.stdout:6/945: truncate d10/d2b/d43/de5/d134/f13b 701316 0 2024-09-18T12:49:31.181 INFO:tasks.workunit.client.0.smithi078.stdout:6/946: getdents d10/d2b 0 2024-09-18T12:49:31.248 INFO:tasks.workunit.client.0.smithi078.stdout:6/947: creat d10/d2b/d43/da7/f13f x:0 0 0 2024-09-18T12:49:31.250 INFO:tasks.workunit.client.0.smithi078.stdout:6/948: unlink d10/d2b/d43/dc3/d103/dac/l106 0 2024-09-18T12:49:31.251 INFO:tasks.workunit.client.0.smithi078.stdout:6/949: stat d10/d2b/d43/dc3/d103/d7d/c95 0 2024-09-18T12:49:31.252 INFO:tasks.workunit.client.0.smithi078.stdout:6/950: chown d10/d2b/d43/dc3/d103/d7d/l98 0 1 2024-09-18T12:49:31.256 INFO:tasks.workunit.client.0.smithi078.stdout:6/951: truncate d10/d2b/d43/dc3/d103/d77/fa3 2920068 0 2024-09-18T12:49:31.403 INFO:tasks.workunit.client.0.smithi078.stdout:8/657: sync 2024-09-18T12:49:31.404 INFO:tasks.workunit.client.0.smithi078.stdout:4/738: sync 2024-09-18T12:49:31.406 INFO:tasks.workunit.client.0.smithi078.stdout:4/739: mkdir d11/d27/d89/def 0 2024-09-18T12:49:31.406 INFO:tasks.workunit.client.0.smithi078.stdout:4/740: chown d11/d27/d47/d78/laf 14810049 1 2024-09-18T12:49:31.411 INFO:tasks.workunit.client.0.smithi078.stdout:8/658: dwrite d0/d39/d4c/d77/fb5 [0,4194304] 0 2024-09-18T12:49:31.420 INFO:tasks.workunit.client.0.smithi078.stdout:8/659: creat d0/d39/d4c/d77/d7d/fd5 x:0 0 0 2024-09-18T12:49:31.423 INFO:tasks.workunit.client.0.smithi078.stdout:4/741: write d11/fc5 [1438365,68549] 0 2024-09-18T12:49:31.432 INFO:tasks.workunit.client.0.smithi078.stdout:8/660: write d0/d7/f22 [2783131,3384] 0 2024-09-18T12:49:31.434 INFO:tasks.workunit.client.0.smithi078.stdout:4/742: write d11/d27/d60/f68 [86033,55019] 0 2024-09-18T12:49:31.436 INFO:tasks.workunit.client.0.smithi078.stdout:8/661: symlink d0/d7/dc/d1f/d6f/ld6 0 2024-09-18T12:49:31.437 INFO:tasks.workunit.client.0.smithi078.stdout:8/662: chown d0/d7/d1e/d4b/f98 517349 1 2024-09-18T12:49:31.438 INFO:tasks.workunit.client.0.smithi078.stdout:8/663: rmdir d0/d7/d1e/da9 39 2024-09-18T12:49:31.439 INFO:tasks.workunit.client.0.smithi078.stdout:8/664: mkdir d0/d39/d4c/d77/dd7 0 2024-09-18T12:49:31.440 INFO:tasks.workunit.client.0.smithi078.stdout:8/665: symlink d0/d7/d53/ld8 0 2024-09-18T12:49:31.445 INFO:tasks.workunit.client.0.smithi078.stdout:8/666: dwrite d0/d7/f38 [4194304,4194304] 0 2024-09-18T12:49:31.450 INFO:tasks.workunit.client.0.smithi078.stdout:8/667: mknod d0/d7/d53/d57/cd9 0 2024-09-18T12:49:31.459 INFO:tasks.workunit.client.0.smithi078.stdout:1/675: sync 2024-09-18T12:49:31.459 INFO:tasks.workunit.client.0.smithi078.stdout:3/591: sync 2024-09-18T12:49:31.459 INFO:tasks.workunit.client.0.smithi078.stdout:7/569: sync 2024-09-18T12:49:31.460 INFO:tasks.workunit.client.0.smithi078.stdout:3/592: stat d9/d13/d33/d34 0 2024-09-18T12:49:31.462 INFO:tasks.workunit.client.0.smithi078.stdout:1/676: read d0/d8/da/d3e/d58/d6e/d52/d47/d7d/f59 [3026563,33919] 0 2024-09-18T12:49:31.462 INFO:tasks.workunit.client.0.smithi078.stdout:3/593: read d9/f27 [967481,99687] 0 2024-09-18T12:49:31.466 INFO:tasks.workunit.client.0.smithi078.stdout:7/570: rmdir d7/d3f/d99/dbb 0 2024-09-18T12:49:31.466 INFO:tasks.workunit.client.0.smithi078.stdout:7/571: stat d7/d3f 0 2024-09-18T12:49:31.469 INFO:tasks.workunit.client.0.smithi078.stdout:7/572: symlink d7/d26/d84/lc5 0 2024-09-18T12:49:31.469 INFO:tasks.workunit.client.0.smithi078.stdout:7/573: readlink d7/d9/d4d/l9b 0 2024-09-18T12:49:31.470 INFO:tasks.workunit.client.0.smithi078.stdout:3/594: link d9/l9a d9/df/lb9 0 2024-09-18T12:49:31.471 INFO:tasks.workunit.client.0.smithi078.stdout:8/668: write d0/d7/dc/d71/f92 [222542,100741] 0 2024-09-18T12:49:31.480 INFO:tasks.workunit.client.0.smithi078.stdout:8/669: fsync d0/d7/dc/d1f/f28 0 2024-09-18T12:49:31.481 INFO:tasks.workunit.client.0.smithi078.stdout:7/574: write d7/d9/d32/f38 [243732,64702] 0 2024-09-18T12:49:31.481 INFO:tasks.workunit.client.0.smithi078.stdout:1/677: dread d0/d8/da/d3e/d58/d6e/d52/d47/f9e [0,4194304] 0 2024-09-18T12:49:31.481 INFO:tasks.workunit.client.0.smithi078.stdout:8/670: chown d0/d39/d4c/d77/d7d/lbd 7162038 1 2024-09-18T12:49:31.482 INFO:tasks.workunit.client.0.smithi078.stdout:7/575: fdatasync d7/d9/d14/d22/d35/d49/d56/d8d/fb8 0 2024-09-18T12:49:31.485 INFO:tasks.workunit.client.0.smithi078.stdout:8/671: fsync d0/d7/d1e/d4b/f73 0 2024-09-18T12:49:31.486 INFO:tasks.workunit.client.0.smithi078.stdout:7/576: mknod d7/d9/d14/d22/d35/cc6 0 2024-09-18T12:49:31.493 INFO:tasks.workunit.client.0.smithi078.stdout:7/577: dwrite d7/d26/fae [0,4194304] 0 2024-09-18T12:49:31.494 INFO:tasks.workunit.client.0.smithi078.stdout:1/678: rename d0/d8/da/d3e/d50/dba/cb7 to d0/d8/da/d3e/d58/d6e/d8c/d9d/ce5 0 2024-09-18T12:49:31.498 INFO:tasks.workunit.client.0.smithi078.stdout:8/672: dwrite d0/d7/d53/db0/fb1 [4194304,4194304] 0 2024-09-18T12:49:31.498 INFO:tasks.workunit.client.0.smithi078.stdout:1/679: mknod d0/d8/daa/ce6 0 2024-09-18T12:49:31.504 INFO:tasks.workunit.client.0.smithi078.stdout:1/680: fsync d0/d8/f2b 0 2024-09-18T12:49:31.506 INFO:tasks.workunit.client.0.smithi078.stdout:8/673: symlink d0/d7/d1e/d4b/lda 0 2024-09-18T12:49:31.513 INFO:tasks.workunit.client.0.smithi078.stdout:7/578: write d7/d9/d14/d22/d3e/f5b [949588,25589] 0 2024-09-18T12:49:31.522 INFO:tasks.workunit.client.0.smithi078.stdout:8/674: dread d0/f16 [0,4194304] 0 2024-09-18T12:49:31.527 INFO:tasks.workunit.client.0.smithi078.stdout:8/675: getdents d0/d7/dc/d1f/d6f 0 2024-09-18T12:49:31.528 INFO:tasks.workunit.client.0.smithi078.stdout:1/681: write d0/d8/da/d3e/d58/d6e/f5a [3330940,47335] 0 2024-09-18T12:49:31.528 INFO:tasks.workunit.client.0.smithi078.stdout:8/676: fsync d0/d7/d1e/d50/faa 0 2024-09-18T12:49:31.531 INFO:tasks.workunit.client.0.smithi078.stdout:8/677: symlink d0/d7/d53/ldb 0 2024-09-18T12:49:31.531 INFO:tasks.workunit.client.0.smithi078.stdout:1/682: fsync d0/d8/da/d3e/d58/d6e/d52/f6f 0 2024-09-18T12:49:31.535 INFO:tasks.workunit.client.0.smithi078.stdout:8/678: dread d0/d39/d4c/d77/d7d/d3e/fa1 [0,4194304] 0 2024-09-18T12:49:31.539 INFO:tasks.workunit.client.0.smithi078.stdout:8/679: creat d0/d7/d1e/da9/dd4/fdc x:0 0 0 2024-09-18T12:49:31.541 INFO:tasks.workunit.client.0.smithi078.stdout:1/683: write d0/d8/da/d3e/d58/d6e/d52/d47/d7d/f59 [1764987,49305] 0 2024-09-18T12:49:31.544 INFO:tasks.workunit.client.0.smithi078.stdout:8/680: rename d0/f14 to d0/d7/dc/d1f/fdd 0 2024-09-18T12:49:31.546 INFO:tasks.workunit.client.0.smithi078.stdout:1/684: unlink d0/d8/da/d3e/d58/d6e/d8c/d9d/lce 0 2024-09-18T12:49:31.548 INFO:tasks.workunit.client.0.smithi078.stdout:1/685: stat d0/d8/da/d3e/d50/c55 0 2024-09-18T12:49:31.550 INFO:tasks.workunit.client.0.smithi078.stdout:8/681: dwrite d0/d7/d53/db0/fb1 [0,4194304] 0 2024-09-18T12:49:31.562 INFO:tasks.workunit.client.0.smithi078.stdout:1/686: write d0/d5b/d6d/f7e [853312,39021] 0 2024-09-18T12:49:31.569 INFO:tasks.workunit.client.0.smithi078.stdout:8/682: dwrite d0/d7/dc/d1f/d23/d44/f75 [0,4194304] 0 2024-09-18T12:49:31.571 INFO:tasks.workunit.client.0.smithi078.stdout:8/683: stat d0/d7/d1e/d4b/fb8 0 2024-09-18T12:49:31.572 INFO:tasks.workunit.client.0.smithi078.stdout:1/687: dwrite d0/d8/da/d3e/d50/dba/fb3 [0,4194304] 0 2024-09-18T12:49:31.582 INFO:tasks.workunit.client.0.smithi078.stdout:1/688: creat d0/d8/de2/fe7 x:0 0 0 2024-09-18T12:49:31.584 INFO:tasks.workunit.client.0.smithi078.stdout:1/689: chown d0/d8/da/d3e/d50/dba/fb3 0 1 2024-09-18T12:49:31.585 INFO:tasks.workunit.client.0.smithi078.stdout:1/690: chown d0/d8/da/d3e/d58/d6e/d52/d47/d7d/d7f/f94 8796 1 2024-09-18T12:49:31.589 INFO:tasks.workunit.client.0.smithi078.stdout:1/691: rename d0/d8/da/d3e/d58/d6e/d52/d47/d7d to d0/d8/da/d3e/d58/d6e/d52/d47/de8 0 2024-09-18T12:49:31.592 INFO:tasks.workunit.client.0.smithi078.stdout:1/692: rename d0/d5b/f63 to d0/fe9 0 2024-09-18T12:49:31.594 INFO:tasks.workunit.client.0.smithi078.stdout:8/684: dread d0/db7/f89 [0,4194304] 0 2024-09-18T12:49:31.596 INFO:tasks.workunit.client.0.smithi078.stdout:1/693: mkdir d0/d8/da/d3e/d58/d6e/d8c/d9d/dc3/dea 0 2024-09-18T12:49:31.599 INFO:tasks.workunit.client.0.smithi078.stdout:1/694: creat d0/d8/da/d3e/d58/d6e/d8c/dd3/feb x:0 0 0 2024-09-18T12:49:31.599 INFO:tasks.workunit.client.0.smithi078.stdout:8/685: read d0/f1a [2161748,110258] 0 2024-09-18T12:49:31.600 INFO:tasks.workunit.client.0.smithi078.stdout:1/695: truncate d0/d5b/d6d/dc2/fcd 1024306 0 2024-09-18T12:49:31.601 INFO:tasks.workunit.client.0.smithi078.stdout:1/696: chown d0/d8/da/d3e/d58/l9c 3 1 2024-09-18T12:49:31.601 INFO:tasks.workunit.client.0.smithi078.stdout:1/697: chown d0/fca 23010 1 2024-09-18T12:49:31.603 INFO:tasks.workunit.client.0.smithi078.stdout:8/686: creat d0/d39/d4c/d77/dd7/fde x:0 0 0 2024-09-18T12:49:31.604 INFO:tasks.workunit.client.0.smithi078.stdout:1/698: creat d0/d8/da/d3e/d50/d74/fec x:0 0 0 2024-09-18T12:49:31.608 INFO:tasks.workunit.client.0.smithi078.stdout:1/699: symlink d0/d8/da/d3e/dd8/led 0 2024-09-18T12:49:31.611 INFO:tasks.workunit.client.0.smithi078.stdout:1/700: mkdir d0/d8/da/d3e/d58/d6e/d52/d47/de8/dee 0 2024-09-18T12:49:31.612 INFO:tasks.workunit.client.0.smithi078.stdout:8/687: write d0/d7/d1e/d4b/f73 [2769679,24804] 0 2024-09-18T12:49:31.615 INFO:tasks.workunit.client.0.smithi078.stdout:8/688: unlink d0/d7/dc/d1f/d23/d40/fc1 0 2024-09-18T12:49:31.618 INFO:tasks.workunit.client.0.smithi078.stdout:8/689: mkdir d0/d39/d4c/d77/d7d/d3e/ddf 0 2024-09-18T12:49:31.618 INFO:tasks.workunit.client.0.smithi078.stdout:1/701: getdents d0/d8/da/d3e/dd8 0 2024-09-18T12:49:31.620 INFO:tasks.workunit.client.0.smithi078.stdout:8/690: write d0/d7/d53/d57/d5c/fce [885795,124007] 0 2024-09-18T12:49:31.622 INFO:tasks.workunit.client.0.smithi078.stdout:1/702: truncate d0/d8/da/d3e/d50/fa0 762676 0 2024-09-18T12:49:31.623 INFO:tasks.workunit.client.0.smithi078.stdout:8/691: mkdir d0/d7/d1e/da9/de0 0 2024-09-18T12:49:31.625 INFO:tasks.workunit.client.0.smithi078.stdout:1/703: creat d0/d8/da/d3e/dd8/fef x:0 0 0 2024-09-18T12:49:31.625 INFO:tasks.workunit.client.0.smithi078.stdout:8/692: symlink d0/d7/dc/d1f/d23/d44/le1 0 2024-09-18T12:49:31.626 INFO:tasks.workunit.client.0.smithi078.stdout:1/704: stat d0/d8/da/d3e/d58/d6e/d52/d47/de8/f64 0 2024-09-18T12:49:31.627 INFO:tasks.workunit.client.0.smithi078.stdout:8/693: rmdir d0/d7/d1e/d4b 39 2024-09-18T12:49:31.627 INFO:tasks.workunit.client.0.smithi078.stdout:1/705: read d0/f49 [3712103,986] 0 2024-09-18T12:49:31.627 INFO:tasks.workunit.client.0.smithi078.stdout:8/694: readlink d0/d7/d53/ld8 0 2024-09-18T12:49:31.628 INFO:tasks.workunit.client.0.smithi078.stdout:8/695: fdatasync d0/d39/d4c/d77/dd7/fde 0 2024-09-18T12:49:31.628 INFO:tasks.workunit.client.0.smithi078.stdout:1/706: readlink d0/d8/da/d3e/d50/d74/l87 0 2024-09-18T12:49:31.631 INFO:tasks.workunit.client.0.smithi078.stdout:8/696: mkdir d0/d7/dc/d5d/de2 0 2024-09-18T12:49:31.632 INFO:tasks.workunit.client.0.smithi078.stdout:1/707: truncate d0/d8/da/d3e/d58/d6e/d52/f2e 676624 0 2024-09-18T12:49:31.633 INFO:tasks.workunit.client.0.smithi078.stdout:8/697: write d0/d7/d1e/da9/d6d/fae [362847,66523] 0 2024-09-18T12:49:31.633 INFO:tasks.workunit.client.0.smithi078.stdout:1/708: chown d0/d8/da/d3e/dd8 2923 1 2024-09-18T12:49:31.635 INFO:tasks.workunit.client.0.smithi078.stdout:0/805: sync 2024-09-18T12:49:31.635 INFO:tasks.workunit.client.0.smithi078.stdout:2/663: sync 2024-09-18T12:49:31.635 INFO:tasks.workunit.client.0.smithi078.stdout:9/731: sync 2024-09-18T12:49:31.635 INFO:tasks.workunit.client.0.smithi078.stdout:6/952: sync 2024-09-18T12:49:31.636 INFO:tasks.workunit.client.0.smithi078.stdout:1/709: unlink d0/d8/da/d3e/d58/d6e/d52/cd1 0 2024-09-18T12:49:31.637 INFO:tasks.workunit.client.0.smithi078.stdout:0/806: write d3/d82/d10d/d7c/da3/fc8 [624425,74171] 0 2024-09-18T12:49:31.644 INFO:tasks.workunit.client.0.smithi078.stdout:9/732: fsync d5/d7/d32/d2a/d68/d97/f9f 0 2024-09-18T12:49:31.647 INFO:tasks.workunit.client.0.smithi078.stdout:2/664: mkdir d4/d8/d23/d52/d5f/d86/d3b/d4f/dd7 0 2024-09-18T12:49:31.650 INFO:tasks.workunit.client.0.smithi078.stdout:1/710: unlink d0/d8/daa/db5/cd6 0 2024-09-18T12:49:31.659 INFO:tasks.workunit.client.0.smithi078.stdout:8/698: link d0/d39/d4c/d77/d7d/d3e/ld1 d0/d7/dc/d1f/d6f/le3 0 2024-09-18T12:49:31.661 INFO:tasks.workunit.client.0.smithi078.stdout:2/665: unlink d4/d8/d6c/d70/la5 0 2024-09-18T12:49:31.662 INFO:tasks.workunit.client.0.smithi078.stdout:2/666: write d4/d8/d23/d52/d5f/d81/dae/dbd/fd5 [284769,83972] 0 2024-09-18T12:49:31.665 INFO:tasks.workunit.client.0.smithi078.stdout:9/733: dread d5/d7/f5a [0,4194304] 0 2024-09-18T12:49:31.667 INFO:tasks.workunit.client.0.smithi078.stdout:9/734: write d5/d7/d32/fa4 [532259,100742] 0 2024-09-18T12:49:31.668 INFO:tasks.workunit.client.0.smithi078.stdout:2/667: rmdir d4/d8/d23 39 2024-09-18T12:49:31.669 INFO:tasks.workunit.client.0.smithi078.stdout:0/807: dwrite d3/d1f/d2e/d4e/d37/f8c [0,4194304] 0 2024-09-18T12:49:31.674 INFO:tasks.workunit.client.0.smithi078.stdout:2/668: chown d4/db/lc6 49820484 1 2024-09-18T12:49:31.676 INFO:tasks.workunit.client.0.smithi078.stdout:1/711: dwrite d0/d8/da/d3e/f4f [0,4194304] 0 2024-09-18T12:49:31.677 INFO:tasks.workunit.client.0.smithi078.stdout:1/712: stat d0/d8/da/d3e/d58/d6e/d8c/dd3/fdd 0 2024-09-18T12:49:31.685 INFO:tasks.workunit.client.0.smithi078.stdout:2/669: unlink d4/d1a/l65 0 2024-09-18T12:49:31.685 INFO:tasks.workunit.client.0.smithi078.stdout:8/699: write d0/d7/dc/d1f/d23/f25 [7090707,1454] 0 2024-09-18T12:49:31.685 INFO:tasks.workunit.client.0.smithi078.stdout:1/713: mknod d0/d8/da/d3e/d50/d60/cf0 0 2024-09-18T12:49:31.686 INFO:tasks.workunit.client.0.smithi078.stdout:8/700: write d0/d7/d53/d57/d67/fc0 [2919210,29771] 0 2024-09-18T12:49:31.691 INFO:tasks.workunit.client.0.smithi078.stdout:1/714: fdatasync d0/d8/da/d3e/d50/d60/f6b 0 2024-09-18T12:49:31.692 INFO:tasks.workunit.client.0.smithi078.stdout:0/808: dread d3/d43/f6e [0,4194304] 0 2024-09-18T12:49:31.692 INFO:tasks.workunit.client.0.smithi078.stdout:8/701: fsync d0/d7/dc/d1f/d23/f8c 0 2024-09-18T12:49:31.697 INFO:tasks.workunit.client.0.smithi078.stdout:1/715: symlink d0/d8/da/d3e/d58/d6e/d52/d47/de8/lf1 0 2024-09-18T12:49:31.705 INFO:tasks.workunit.client.0.smithi078.stdout:9/735: dread d5/d7/d8/d4f/f90 [0,4194304] 0 2024-09-18T12:49:31.705 INFO:tasks.workunit.client.0.smithi078.stdout:0/809: rename d3/d1f/d2e/d8f/fd9 to d3/d82/d10d/f118 0 2024-09-18T12:49:31.710 INFO:tasks.workunit.client.0.smithi078.stdout:9/736: symlink d5/d7/db3/de5/lf0 0 2024-09-18T12:49:31.712 INFO:tasks.workunit.client.0.smithi078.stdout:0/810: symlink d3/d1f/d2e/d4e/db2/l119 0 2024-09-18T12:49:31.713 INFO:tasks.workunit.client.0.smithi078.stdout:8/702: dread d0/d7/dc/d1f/d23/f8c [0,4194304] 0 2024-09-18T12:49:31.713 INFO:tasks.workunit.client.0.smithi078.stdout:2/670: write d4/f99 [2513996,99610] 0 2024-09-18T12:49:31.713 INFO:tasks.workunit.client.0.smithi078.stdout:1/716: link d0/d8/daa/db5/dc0/cc4 d0/d8/da/d3e/d58/cf2 0 2024-09-18T12:49:31.715 INFO:tasks.workunit.client.0.smithi078.stdout:9/737: read d5/d7/d8/f35 [439009,124773] 0 2024-09-18T12:49:31.715 INFO:tasks.workunit.client.0.smithi078.stdout:0/811: chown d3/d1f/d2e/d4e/d37/l79 30 1 2024-09-18T12:49:31.719 INFO:tasks.workunit.client.0.smithi078.stdout:9/738: mkdir d5/d7/dbe/de8/df1 0 2024-09-18T12:49:31.721 INFO:tasks.workunit.client.0.smithi078.stdout:0/812: creat d3/d82/d10d/d7c/da3/f11a x:0 0 0 2024-09-18T12:49:31.721 INFO:tasks.workunit.client.0.smithi078.stdout:9/739: chown d5/d7/d32/d2a/f7d 203 1 2024-09-18T12:49:31.722 INFO:tasks.workunit.client.0.smithi078.stdout:1/717: creat d0/d8/da/d3e/d58/d6e/d8c/dd3/ff3 x:0 0 0 2024-09-18T12:49:31.722 INFO:tasks.workunit.client.0.smithi078.stdout:8/703: dwrite d0/d7/dc/d1f/d23/d44/f75 [0,4194304] 0 2024-09-18T12:49:31.723 INFO:tasks.workunit.client.0.smithi078.stdout:8/704: readlink d0/d7/d53/ldb 0 2024-09-18T12:49:31.728 INFO:tasks.workunit.client.0.smithi078.stdout:1/718: mknod d0/cf4 0 2024-09-18T12:49:31.729 INFO:tasks.workunit.client.0.smithi078.stdout:8/705: creat d0/d7/dc/d1f/d23/d40/fe4 x:0 0 0 2024-09-18T12:49:31.732 INFO:tasks.workunit.client.0.smithi078.stdout:2/671: write d4/dd/fa1 [5794725,72799] 0 2024-09-18T12:49:31.733 INFO:tasks.workunit.client.0.smithi078.stdout:9/740: creat d5/d7/dbe/de8/df1/ff2 x:0 0 0 2024-09-18T12:49:31.735 INFO:tasks.workunit.client.0.smithi078.stdout:1/719: rename d0/d8/daa/db5/fc6 to d0/d8/da/d3e/d58/d6e/d8c/d9d/db8/ff5 0 2024-09-18T12:49:31.738 INFO:tasks.workunit.client.0.smithi078.stdout:2/672: fsync d4/d1a/f2e 0 2024-09-18T12:49:31.740 INFO:tasks.workunit.client.0.smithi078.stdout:9/741: fsync d5/d7/f6d 0 2024-09-18T12:49:31.742 INFO:tasks.workunit.client.0.smithi078.stdout:0/813: stat d3/d82/d10d/d7c/da3/de2 0 2024-09-18T12:49:31.743 INFO:tasks.workunit.client.0.smithi078.stdout:8/706: mknod d0/d7/dc/d5d/ce5 0 2024-09-18T12:49:31.747 INFO:tasks.workunit.client.0.smithi078.stdout:9/742: creat d5/d7/d8/d4f/ff3 x:0 0 0 2024-09-18T12:49:31.747 INFO:tasks.workunit.client.0.smithi078.stdout:8/707: dread d0/d7/dc/d1f/d23/d44/f75 [0,4194304] 0 2024-09-18T12:49:31.748 INFO:tasks.workunit.client.0.smithi078.stdout:0/814: creat d3/d1f/d2e/d68/dc9/dcd/f11b x:0 0 0 2024-09-18T12:49:31.749 INFO:tasks.workunit.client.0.smithi078.stdout:0/815: chown d3/f4b 9 1 2024-09-18T12:49:31.751 INFO:tasks.workunit.client.0.smithi078.stdout:2/673: mkdir d4/db/dd8 0 2024-09-18T12:49:31.753 INFO:tasks.workunit.client.0.smithi078.stdout:8/708: creat d0/d7/d1e/d50/fe6 x:0 0 0 2024-09-18T12:49:31.758 INFO:tasks.workunit.client.0.smithi078.stdout:8/709: fdatasync d0/d7/d1e/d4b/fb8 0 2024-09-18T12:49:31.760 INFO:tasks.workunit.client.0.smithi078.stdout:2/674: mknod d4/d8/d23/d52/d5f/d86/d3b/d55/cd9 0 2024-09-18T12:49:31.762 INFO:tasks.workunit.client.0.smithi078.stdout:9/743: dread d5/d7/d8/d4f/f54 [0,4194304] 0 2024-09-18T12:49:31.762 INFO:tasks.workunit.client.0.smithi078.stdout:0/816: creat d3/d1f/d2e/d4e/d37/d72/f11c x:0 0 0 2024-09-18T12:49:31.762 INFO:tasks.workunit.client.0.smithi078.stdout:9/744: stat d5/d7/d8/f6a 0 2024-09-18T12:49:31.764 INFO:tasks.workunit.client.0.smithi078.stdout:9/745: truncate d5/d7/d32/d2a/d68/d97/fe7 873694 0 2024-09-18T12:49:31.766 INFO:tasks.workunit.client.0.smithi078.stdout:9/746: write d5/d7/d32/d2a/f2e [5874734,114573] 0 2024-09-18T12:49:31.766 INFO:tasks.workunit.client.0.smithi078.stdout:8/710: link d0/db7/d62/fd2 d0/d7/dc/d5d/de2/fe7 0 2024-09-18T12:49:31.768 INFO:tasks.workunit.client.0.smithi078.stdout:8/711: dread - d0/d39/d4c/d77/dd7/fde zero size 2024-09-18T12:49:31.769 INFO:tasks.workunit.client.0.smithi078.stdout:8/712: chown d0/d7/d53/d57/l4f 36544687 1 2024-09-18T12:49:31.770 INFO:tasks.workunit.client.0.smithi078.stdout:9/747: unlink d5/d7/d32/d2a/d68/d97/fa6 0 2024-09-18T12:49:31.775 INFO:tasks.workunit.client.0.smithi078.stdout:2/675: dread d4/d1a/f43 [0,4194304] 0 2024-09-18T12:49:31.777 INFO:tasks.workunit.client.0.smithi078.stdout:9/748: rename d5/d5c/fe2 to d5/d7/d32/d2a/ff4 0 2024-09-18T12:49:31.778 INFO:tasks.workunit.client.0.smithi078.stdout:2/676: fdatasync d4/dd/f4e 0 2024-09-18T12:49:31.780 INFO:tasks.workunit.client.0.smithi078.stdout:2/677: stat d4/d8/d23/d52/d5f/d86/d3b/d55 0 2024-09-18T12:49:31.782 INFO:tasks.workunit.client.0.smithi078.stdout:9/749: link d5/dc6/fcd d5/d7/db1/ff5 0 2024-09-18T12:49:31.784 INFO:tasks.workunit.client.0.smithi078.stdout:2/678: creat d4/d1a/fda x:0 0 0 2024-09-18T12:49:31.786 INFO:tasks.workunit.client.0.smithi078.stdout:2/679: dread d4/db/d45/dbc/fbe [0,4194304] 0 2024-09-18T12:49:31.786 INFO:tasks.workunit.client.0.smithi078.stdout:9/750: rename d5/d7/f6d to d5/d7/db3/ff6 0 2024-09-18T12:49:31.788 INFO:tasks.workunit.client.0.smithi078.stdout:8/713: dread d0/d7/d1e/da9/d6d/fc4 [0,4194304] 0 2024-09-18T12:49:31.788 INFO:tasks.workunit.client.0.smithi078.stdout:2/680: write d4/d8/d23/fa6 [1480535,62866] 0 2024-09-18T12:49:31.790 INFO:tasks.workunit.client.0.smithi078.stdout:2/681: write d4/d8/d23/d52/d5f/d86/f60 [3336080,47600] 0 2024-09-18T12:49:31.796 INFO:tasks.workunit.client.0.smithi078.stdout:9/751: creat d5/d7/dbe/ddd/ff7 x:0 0 0 2024-09-18T12:49:31.796 INFO:tasks.workunit.client.0.smithi078.stdout:2/682: symlink d4/d8/d23/d95/ldb 0 2024-09-18T12:49:31.797 INFO:tasks.workunit.client.0.smithi078.stdout:8/714: creat d0/d39/dc5/fe8 x:0 0 0 2024-09-18T12:49:31.798 INFO:tasks.workunit.client.0.smithi078.stdout:9/752: creat d5/d7/d32/d2a/d68/d97/ff8 x:0 0 0 2024-09-18T12:49:31.798 INFO:tasks.workunit.client.0.smithi078.stdout:8/715: stat d0/d7/d53/d57/d5c/d88 0 2024-09-18T12:49:31.800 INFO:tasks.workunit.client.0.smithi078.stdout:9/753: write d5/d7/d32/d2a/fd4 [409863,12581] 0 2024-09-18T12:49:31.919 INFO:tasks.workunit.client.0.smithi078.stdout:4/743: sync 2024-09-18T12:49:31.952 INFO:tasks.workunit.client.0.smithi078.stdout:2/683: dwrite d4/d8/d23/fa6 [0,4194304] 0 2024-09-18T12:49:31.952 INFO:tasks.workunit.client.0.smithi078.stdout:9/754: rename d5/d40/f7c to d5/d5c/ff9 0 2024-09-18T12:49:31.957 INFO:tasks.workunit.client.0.smithi078.stdout:8/716: dwrite d0/d39/d4c/d77/fbe [0,4194304] 0 2024-09-18T12:49:31.957 INFO:tasks.workunit.client.0.smithi078.stdout:4/744: dread d11/d27/d47/d4e/daa/fab [0,4194304] 0 2024-09-18T12:49:31.964 INFO:tasks.workunit.client.0.smithi078.stdout:8/717: dwrite d0/d7/f38 [4194304,4194304] 0 2024-09-18T12:49:31.965 INFO:tasks.workunit.client.0.smithi078.stdout:8/718: fdatasync d0/d7/dc/d1f/d23/f25 0 2024-09-18T12:49:31.966 INFO:tasks.workunit.client.0.smithi078.stdout:8/719: chown d0/d39/d4c/d77/dd7/fde 216309423 1 2024-09-18T12:49:31.972 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:31 smithi148 ceph-mon[35352]: pgmap v23: 65 pgs: 65 active+clean; 3.3 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 93 MiB/s rd, 202 MiB/s wr, 443 op/s 2024-09-18T12:49:31.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:31 smithi078 ceph-mon[28091]: pgmap v23: 65 pgs: 65 active+clean; 3.3 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 93 MiB/s rd, 202 MiB/s wr, 443 op/s 2024-09-18T12:49:32.008 INFO:tasks.workunit.client.0.smithi078.stdout:9/755: creat d5/d7/d8/d98/ffa x:0 0 0 2024-09-18T12:49:32.010 INFO:tasks.workunit.client.0.smithi078.stdout:9/756: write d5/d7/d32/fa4 [1328240,98860] 0 2024-09-18T12:49:32.011 INFO:tasks.workunit.client.0.smithi078.stdout:4/745: unlink d11/d27/d47/d4e/d76/f7e 0 2024-09-18T12:49:32.015 INFO:tasks.workunit.client.0.smithi078.stdout:9/757: creat d5/d7/d8/d4f/ffb x:0 0 0 2024-09-18T12:49:32.016 INFO:tasks.workunit.client.0.smithi078.stdout:9/758: dread - d5/d7/d32/d2a/d36/fca zero size 2024-09-18T12:49:32.018 INFO:tasks.workunit.client.0.smithi078.stdout:8/720: truncate d0/d7/f60 53109 0 2024-09-18T12:49:32.020 INFO:tasks.workunit.client.0.smithi078.stdout:2/684: getdents d4/d8 0 2024-09-18T12:49:32.022 INFO:tasks.workunit.client.0.smithi078.stdout:8/721: rename d0/d7/dc/d71/f92 to d0/d7/d53/db0/fe9 0 2024-09-18T12:49:32.023 INFO:tasks.workunit.client.0.smithi078.stdout:2/685: chown d4/cbb 0 1 2024-09-18T12:49:32.024 INFO:tasks.workunit.client.0.smithi078.stdout:2/686: chown d4/db/f6f 2048020 1 2024-09-18T12:49:32.024 INFO:tasks.workunit.client.0.smithi078.stdout:4/746: link d11/d27/d89/c91 d11/d27/d47/cf0 0 2024-09-18T12:49:32.026 INFO:tasks.workunit.client.0.smithi078.stdout:2/687: truncate d4/d8/d23/d52/d7c/f82 1269734 0 2024-09-18T12:49:32.027 INFO:tasks.workunit.client.0.smithi078.stdout:8/722: rmdir d0/d7/d1e/d4b/dc6 39 2024-09-18T12:49:32.030 INFO:tasks.workunit.client.0.smithi078.stdout:9/759: getdents d5/d5c 0 2024-09-18T12:49:32.031 INFO:tasks.workunit.client.0.smithi078.stdout:4/747: dwrite d11/d27/d5a/d84/d4b/da7/dba/feb [0,4194304] 0 2024-09-18T12:49:32.032 INFO:tasks.workunit.client.0.smithi078.stdout:9/760: stat d5/d7/d32/d2a/d36/la9 0 2024-09-18T12:49:32.032 INFO:tasks.workunit.client.0.smithi078.stdout:2/688: chown d4/d8/d23/d52/d5f/d86/d33/c9d 43 1 2024-09-18T12:49:32.033 INFO:tasks.workunit.client.0.smithi078.stdout:8/723: truncate d0/d39/d4c/d77/f85 3599527 0 2024-09-18T12:49:32.033 INFO:tasks.workunit.client.0.smithi078.stdout:9/761: write d5/d7/d8/d4f/fbc [664470,99026] 0 2024-09-18T12:49:32.038 INFO:tasks.workunit.client.0.smithi078.stdout:9/762: mknod d5/d7/d8/d98/cfc 0 2024-09-18T12:49:32.039 INFO:tasks.workunit.client.0.smithi078.stdout:8/724: mkdir d0/d7/dc/d5d/dea 0 2024-09-18T12:49:32.040 INFO:tasks.workunit.client.0.smithi078.stdout:9/763: mknod d5/dc6/cfd 0 2024-09-18T12:49:32.059 INFO:tasks.workunit.client.0.smithi078.stdout:4/748: dread d11/f55 [0,4194304] 0 2024-09-18T12:49:32.063 INFO:tasks.workunit.client.0.smithi078.stdout:9/764: dwrite d5/d7/d32/d2a/d36/fc2 [0,4194304] 0 2024-09-18T12:49:32.064 INFO:tasks.workunit.client.0.smithi078.stdout:8/725: dwrite d0/d7/d1e/d4b/f98 [0,4194304] 0 2024-09-18T12:49:32.065 INFO:tasks.workunit.client.0.smithi078.stdout:9/765: stat d5/d7/d32/d2a 0 2024-09-18T12:49:32.068 INFO:tasks.workunit.client.0.smithi078.stdout:4/749: unlink d11/d27/d5a/d5d/f90 0 2024-09-18T12:49:32.074 INFO:tasks.workunit.client.0.smithi078.stdout:4/750: creat d11/d27/d5a/d84/d4b/da7/dba/dc4/dd0/ff1 x:0 0 0 2024-09-18T12:49:32.078 INFO:tasks.workunit.client.0.smithi078.stdout:8/726: link d0/d7/f4d d0/d7/dc/d1f/feb 0 2024-09-18T12:49:32.080 INFO:tasks.workunit.client.0.smithi078.stdout:8/727: creat d0/d39/d4c/d77/fec x:0 0 0 2024-09-18T12:49:32.082 INFO:tasks.workunit.client.0.smithi078.stdout:8/728: write d0/d7/d1e/d50/fe6 [66126,73315] 0 2024-09-18T12:49:32.083 INFO:tasks.workunit.client.0.smithi078.stdout:8/729: read d0/d7/d53/db0/fb1 [8001721,93470] 0 2024-09-18T12:49:32.086 INFO:tasks.workunit.client.0.smithi078.stdout:8/730: symlink d0/d7/dc/led 0 2024-09-18T12:49:32.088 INFO:tasks.workunit.client.0.smithi078.stdout:8/731: creat d0/d7/dc/d71/d9b/dc2/fee x:0 0 0 2024-09-18T12:49:32.091 INFO:tasks.workunit.client.0.smithi078.stdout:8/732: link d0/d7/d1e/d50/fe6 d0/d7/dc/d71/d9b/dc2/fef 0 2024-09-18T12:49:32.093 INFO:tasks.workunit.client.0.smithi078.stdout:8/733: dread d0/d7/d53/db0/fe9 [0,4194304] 0 2024-09-18T12:49:32.098 INFO:tasks.workunit.client.0.smithi078.stdout:8/734: rename d0/d7/dc/d1f/d23/f25 to d0/d7/dc/d71/d9b/ff0 0 2024-09-18T12:49:32.106 INFO:tasks.workunit.client.0.smithi078.stdout:8/735: truncate d0/d7/d1e/da9/d6d/f97 3764066 0 2024-09-18T12:49:32.107 INFO:tasks.workunit.client.0.smithi078.stdout:9/766: dwrite d5/d7/d32/d2a/f72 [0,4194304] 0 2024-09-18T12:49:32.112 INFO:tasks.workunit.client.0.smithi078.stdout:4/751: dwrite d11/d27/d5a/d84/f2b [8388608,4194304] 0 2024-09-18T12:49:32.113 INFO:tasks.workunit.client.0.smithi078.stdout:4/752: dread - d11/d27/d47/fe8 zero size 2024-09-18T12:49:32.115 INFO:tasks.workunit.client.0.smithi078.stdout:8/736: mknod d0/d7/dc/cf1 0 2024-09-18T12:49:32.118 INFO:tasks.workunit.client.0.smithi078.stdout:9/767: rename d5/d7/dbe/fef to d5/d7/d32/d2a/d68/d97/dc0/ffe 0 2024-09-18T12:49:32.122 INFO:tasks.workunit.client.0.smithi078.stdout:8/737: rename d0/d7/d1e/da9/de0 to d0/db7/d62/df2 0 2024-09-18T12:49:32.125 INFO:tasks.workunit.client.0.smithi078.stdout:9/768: rmdir d5/d7/d32/d2a/d6b 39 2024-09-18T12:49:32.126 INFO:tasks.workunit.client.0.smithi078.stdout:4/753: dwrite d11/d27/d5a/d84/f2d [0,4194304] 0 2024-09-18T12:49:32.129 INFO:tasks.workunit.client.0.smithi078.stdout:9/769: read d5/d5c/ff9 [3028449,59626] 0 2024-09-18T12:49:32.131 INFO:tasks.workunit.client.0.smithi078.stdout:8/738: dread d0/d39/d4c/d77/fbe [0,4194304] 0 2024-09-18T12:49:32.132 INFO:tasks.workunit.client.0.smithi078.stdout:4/754: creat d11/d27/d5a/d84/d40/dc7/ff2 x:0 0 0 2024-09-18T12:49:32.135 INFO:tasks.workunit.client.0.smithi078.stdout:9/770: dread - d5/d7/d32/d2a/d6b/fd5 zero size 2024-09-18T12:49:32.136 INFO:tasks.workunit.client.0.smithi078.stdout:9/771: write d5/d7/d32/d2a/d68/fdf [586406,9339] 0 2024-09-18T12:49:32.137 INFO:tasks.workunit.client.0.smithi078.stdout:8/739: creat d0/d7/dc/d1f/d23/d40/ff3 x:0 0 0 2024-09-18T12:49:32.146 INFO:tasks.workunit.client.0.smithi078.stdout:8/740: dread d0/d39/d4c/d77/d7d/f76 [0,4194304] 0 2024-09-18T12:49:32.152 INFO:tasks.workunit.client.0.smithi078.stdout:9/772: write d5/d7/d8/f35 [973729,46679] 0 2024-09-18T12:49:32.157 INFO:tasks.workunit.client.0.smithi078.stdout:4/755: dwrite d11/f14 [0,4194304] 0 2024-09-18T12:49:32.157 INFO:tasks.workunit.client.0.smithi078.stdout:9/773: unlink d5/d7/d32/d2a/d36/cd7 0 2024-09-18T12:49:32.161 INFO:tasks.workunit.client.0.smithi078.stdout:8/741: truncate d0/d7/fb 991924 0 2024-09-18T12:49:32.162 INFO:tasks.workunit.client.0.smithi078.stdout:4/756: write d11/d27/d5a/d84/d40/dc7/fd4 [179191,105761] 0 2024-09-18T12:49:32.163 INFO:tasks.workunit.client.0.smithi078.stdout:4/757: fsync d11/d27/d47/fd1 0 2024-09-18T12:49:32.165 INFO:tasks.workunit.client.0.smithi078.stdout:9/774: creat d5/d7/d32/d2a/d68/d97/de3/fff x:0 0 0 2024-09-18T12:49:32.165 INFO:tasks.workunit.client.0.smithi078.stdout:8/742: symlink d0/d39/d4c/d77/dd7/lf4 0 2024-09-18T12:49:32.167 INFO:tasks.workunit.client.0.smithi078.stdout:9/775: readlink d5/d7/d8/l3e 0 2024-09-18T12:49:32.168 INFO:tasks.workunit.client.0.smithi078.stdout:8/743: creat d0/d39/d4c/d77/d7d/d3e/ff5 x:0 0 0 2024-09-18T12:49:32.172 INFO:tasks.workunit.client.0.smithi078.stdout:8/744: rename d0/d7/d1e/da9/d6d/fc4 to d0/d7/d1e/da9/dd4/ff6 0 2024-09-18T12:49:32.172 INFO:tasks.workunit.client.0.smithi078.stdout:4/758: link d11/f12 d11/d27/d5a/d84/d4b/da7/dba/dc4/dd0/ff3 0 2024-09-18T12:49:32.173 INFO:tasks.workunit.client.0.smithi078.stdout:4/759: read d11/d27/d47/d4e/d50/fbd [434352,76317] 0 2024-09-18T12:49:32.174 INFO:tasks.workunit.client.0.smithi078.stdout:8/745: mknod d0/d7/d53/d57/d67/d87/cf7 0 2024-09-18T12:49:32.176 INFO:tasks.workunit.client.0.smithi078.stdout:8/746: write d0/d7/d53/db0/fe9 [1306649,117501] 0 2024-09-18T12:49:32.192 INFO:tasks.workunit.client.0.smithi078.stdout:4/760: dread - d11/d45/f8c zero size 2024-09-18T12:49:32.196 INFO:tasks.workunit.client.0.smithi078.stdout:4/761: dread d11/d27/d5a/d84/d40/f58 [0,4194304] 0 2024-09-18T12:49:32.200 INFO:tasks.workunit.client.0.smithi078.stdout:8/747: dread d0/d7/dc/d1f/d23/d40/f6c [0,4194304] 0 2024-09-18T12:49:32.200 INFO:tasks.workunit.client.0.smithi078.stdout:4/762: truncate d11/d27/d47/d4e/f92 691525 0 2024-09-18T12:49:32.202 INFO:tasks.workunit.client.0.smithi078.stdout:8/748: dread - d0/d39/fa0 zero size 2024-09-18T12:49:32.203 INFO:tasks.workunit.client.0.smithi078.stdout:8/749: stat d0/d7/d1e/d50/fe6 0 2024-09-18T12:49:32.205 INFO:tasks.workunit.client.0.smithi078.stdout:4/763: dread d11/d27/f48 [0,4194304] 0 2024-09-18T12:49:32.206 INFO:tasks.workunit.client.0.smithi078.stdout:4/764: write d11/d27/d47/fe8 [528871,78491] 0 2024-09-18T12:49:32.208 INFO:tasks.workunit.client.0.smithi078.stdout:4/765: rename d11/d27/d5a/d84 to d11/d27/d5a/d84/d4b/da7/df4 22 2024-09-18T12:49:32.211 INFO:tasks.workunit.client.0.smithi078.stdout:4/766: rename d11/fc9 to d11/d27/d60/ff5 0 2024-09-18T12:49:32.216 INFO:tasks.workunit.client.0.smithi078.stdout:4/767: dread d11/fc5 [0,4194304] 0 2024-09-18T12:49:32.219 INFO:tasks.workunit.client.0.smithi078.stdout:8/750: dread d0/d7/f4d [0,4194304] 0 2024-09-18T12:49:32.219 INFO:tasks.workunit.client.0.smithi078.stdout:4/768: creat d11/d27/d5a/d84/d4b/da7/dba/dd7/ff6 x:0 0 0 2024-09-18T12:49:32.221 INFO:tasks.workunit.client.0.smithi078.stdout:8/751: symlink d0/d39/d4c/d77/dd7/lf8 0 2024-09-18T12:49:32.222 INFO:tasks.workunit.client.0.smithi078.stdout:4/769: chown d11/d27/d47/cf0 0 1 2024-09-18T12:49:32.223 INFO:tasks.workunit.client.0.smithi078.stdout:4/770: dread - d11/d27/d5a/d84/d4b/da7/dba/dc4/dd0/ff1 zero size 2024-09-18T12:49:32.224 INFO:tasks.workunit.client.0.smithi078.stdout:8/752: creat d0/d39/d4c/d77/d7d/d3e/ff9 x:0 0 0 2024-09-18T12:49:32.224 INFO:tasks.workunit.client.0.smithi078.stdout:8/753: stat d0/d7/dc/c10 0 2024-09-18T12:49:32.225 INFO:tasks.workunit.client.0.smithi078.stdout:8/754: stat d0/d39/d4c/d77/d7d/fa6 0 2024-09-18T12:49:32.228 INFO:tasks.workunit.client.0.smithi078.stdout:8/755: symlink d0/d7/dc/d71/d9b/lfa 0 2024-09-18T12:49:32.232 INFO:tasks.workunit.client.0.smithi078.stdout:8/756: rename d0/d7/dc/d5d/l3d to d0/d7/d1e/da9/d6d/lfb 0 2024-09-18T12:49:32.233 INFO:tasks.workunit.client.0.smithi078.stdout:8/757: write d0/d7/d1e/d50/faa [162401,2309] 0 2024-09-18T12:49:32.236 INFO:tasks.workunit.client.0.smithi078.stdout:4/771: truncate d11/f16 1065424 0 2024-09-18T12:49:32.239 INFO:tasks.workunit.client.0.smithi078.stdout:4/772: fdatasync d11/d27/d5a/f70 0 2024-09-18T12:49:32.240 INFO:tasks.workunit.client.0.smithi078.stdout:8/758: dwrite d0/d7/d53/d57/d5c/fce [0,4194304] 0 2024-09-18T12:49:32.245 INFO:tasks.workunit.client.0.smithi078.stdout:4/773: dread d11/d27/f73 [0,4194304] 0 2024-09-18T12:49:32.247 INFO:tasks.workunit.client.0.smithi078.stdout:4/774: chown d11/d27/d89/fcb 219621549 1 2024-09-18T12:49:32.249 INFO:tasks.workunit.client.0.smithi078.stdout:8/759: dwrite d0/d7/d1e/d50/faa [0,4194304] 0 2024-09-18T12:49:32.252 INFO:tasks.workunit.client.0.smithi078.stdout:4/775: link d11/d27/d5a/f70 d11/d27/d47/d78/d95/ff7 0 2024-09-18T12:49:32.253 INFO:tasks.workunit.client.0.smithi078.stdout:8/760: mknod d0/d7/dc/d1f/cfc 0 2024-09-18T12:49:32.253 INFO:tasks.workunit.client.0.smithi078.stdout:4/776: stat d11/d27/d60/fb3 0 2024-09-18T12:49:32.256 INFO:tasks.workunit.client.0.smithi078.stdout:8/761: symlink d0/d7/dc/d71/lfd 0 2024-09-18T12:49:32.258 INFO:tasks.workunit.client.0.smithi078.stdout:8/762: truncate d0/f16 56555 0 2024-09-18T12:49:32.259 INFO:tasks.workunit.client.0.smithi078.stdout:4/777: creat d11/d27/d5a/d84/d4b/ff8 x:0 0 0 2024-09-18T12:49:32.263 INFO:tasks.workunit.client.0.smithi078.stdout:4/778: rename d11/d27/d47/d4e/d76/ldb to d11/d27/lf9 0 2024-09-18T12:49:32.265 INFO:tasks.workunit.client.0.smithi078.stdout:4/779: fdatasync d11/d27/d89/d9f/fa2 0 2024-09-18T12:49:32.282 INFO:tasks.workunit.client.0.smithi078.stdout:8/763: dwrite d0/d7/d1e/da9/d6d/f78 [0,4194304] 0 2024-09-18T12:49:32.286 INFO:tasks.workunit.client.0.smithi078.stdout:4/780: dwrite d11/f38 [0,4194304] 0 2024-09-18T12:49:32.287 INFO:tasks.workunit.client.0.smithi078.stdout:4/781: fdatasync d11/d27/d5a/d84/d40/f6f 0 2024-09-18T12:49:32.289 INFO:tasks.workunit.client.0.smithi078.stdout:8/764: truncate d0/d7/d1e/da9/d6d/f9f 289756 0 2024-09-18T12:49:32.309 INFO:tasks.workunit.client.0.smithi078.stdout:8/765: truncate d0/d7/d53/d57/d67/fc0 3879071 0 2024-09-18T12:49:32.311 INFO:tasks.workunit.client.0.smithi078.stdout:4/782: dwrite d11/d27/d5a/d84/f63 [0,4194304] 0 2024-09-18T12:49:32.316 INFO:tasks.workunit.client.0.smithi078.stdout:4/783: creat d11/d27/d89/def/ffa x:0 0 0 2024-09-18T12:49:32.317 INFO:tasks.workunit.client.0.smithi078.stdout:8/766: dwrite d0/d7/d1e/da9/d6d/fae [0,4194304] 0 2024-09-18T12:49:32.325 INFO:tasks.workunit.client.0.smithi078.stdout:8/767: dwrite d0/d39/d4c/d77/d7d/fd5 [0,4194304] 0 2024-09-18T12:49:32.329 INFO:tasks.workunit.client.0.smithi078.stdout:8/768: fdatasync d0/d7/d1e/da9/f7a 0 2024-09-18T12:49:32.333 INFO:tasks.workunit.client.0.smithi078.stdout:8/769: mkdir d0/d7/d1e/da9/d6d/dfe 0 2024-09-18T12:49:32.337 INFO:tasks.workunit.client.0.smithi078.stdout:4/784: write d11/d27/d5a/d84/d40/f58 [884602,112188] 0 2024-09-18T12:49:32.338 INFO:tasks.workunit.client.0.smithi078.stdout:4/785: chown d11/d27/d5a/d84/d40/dc7/fd4 1519041340 1 2024-09-18T12:49:32.339 INFO:tasks.workunit.client.0.smithi078.stdout:8/770: rename d0/d7/dc/d5d/de2 to d0/d7/dc/d1f/dff 0 2024-09-18T12:49:32.343 INFO:tasks.workunit.client.0.smithi078.stdout:4/786: mknod d11/d27/d47/d4e/cfb 0 2024-09-18T12:49:32.348 INFO:tasks.workunit.client.0.smithi078.stdout:8/771: write d0/d7/dc/d1f/f28 [3306298,121183] 0 2024-09-18T12:49:32.356 INFO:tasks.workunit.client.0.smithi078.stdout:4/787: getdents d11/d27/d47/d4e 0 2024-09-18T12:49:32.357 INFO:tasks.workunit.client.0.smithi078.stdout:4/788: rmdir d11/d27/d5a/d84/d4b/da7/dba 39 2024-09-18T12:49:32.357 INFO:tasks.workunit.client.0.smithi078.stdout:8/772: write d0/d7/d1e/da9/dd4/ff6 [1334753,53626] 0 2024-09-18T12:49:32.360 INFO:tasks.workunit.client.0.smithi078.stdout:6/953: sync 2024-09-18T12:49:32.360 INFO:tasks.workunit.client.0.smithi078.stdout:3/595: sync 2024-09-18T12:49:32.360 INFO:tasks.workunit.client.0.smithi078.stdout:7/579: sync 2024-09-18T12:49:32.365 INFO:tasks.workunit.client.0.smithi078.stdout:4/789: dwrite d11/d27/d5a/d84/d40/dc7/fd4 [0,4194304] 0 2024-09-18T12:49:32.366 INFO:tasks.workunit.client.0.smithi078.stdout:6/954: mknod d10/d2b/d43/dc3/c140 0 2024-09-18T12:49:32.369 INFO:tasks.workunit.client.0.smithi078.stdout:6/955: symlink d10/d2b/d43/d53/d63/d6b/d10f/l141 0 2024-09-18T12:49:32.371 INFO:tasks.workunit.client.0.smithi078.stdout:6/956: chown d10/d2b/d43/dc3/d103/d7d/l9a 228900155 1 2024-09-18T12:49:32.372 INFO:tasks.workunit.client.0.smithi078.stdout:4/790: getdents d11/d27/d5a/d5d 0 2024-09-18T12:49:32.375 INFO:tasks.workunit.client.0.smithi078.stdout:6/957: chown d10/d2b/d43/dc3/d103/d7d/ld9 59741 1 2024-09-18T12:49:32.375 INFO:tasks.workunit.client.0.smithi078.stdout:7/580: dread d7/f65 [0,4194304] 0 2024-09-18T12:49:32.377 INFO:tasks.workunit.client.0.smithi078.stdout:4/791: creat d11/d27/d5a/d84/d4b/da7/dba/dc1/ffc x:0 0 0 2024-09-18T12:49:32.382 INFO:tasks.workunit.client.0.smithi078.stdout:6/958: creat d10/d2b/d43/dc3/d103/ddd/f142 x:0 0 0 2024-09-18T12:49:32.382 INFO:tasks.workunit.client.0.smithi078.stdout:4/792: symlink d11/d27/d5a/d5d/dca/lfd 0 2024-09-18T12:49:32.384 INFO:tasks.workunit.client.0.smithi078.stdout:3/596: dread d9/d13/d33/d3c/f66 [0,4194304] 0 2024-09-18T12:49:32.384 INFO:tasks.workunit.client.0.smithi078.stdout:6/959: dread - d10/d2b/d43/d53/d63/fc8 zero size 2024-09-18T12:49:32.385 INFO:tasks.workunit.client.0.smithi078.stdout:6/960: stat d10/d2b/l3b 0 2024-09-18T12:49:32.386 INFO:tasks.workunit.client.0.smithi078.stdout:4/793: creat d11/d27/d5a/d5d/ffe x:0 0 0 2024-09-18T12:49:32.389 INFO:tasks.workunit.client.0.smithi078.stdout:6/961: creat d10/d2b/d43/dc3/d103/ddd/f143 x:0 0 0 2024-09-18T12:49:32.390 INFO:tasks.workunit.client.0.smithi078.stdout:3/597: truncate d9/d13/d33/d4e/f25 4460127 0 2024-09-18T12:49:32.396 INFO:tasks.workunit.client.0.smithi078.stdout:6/962: rename d10/d2b/dfa/dd6 to d10/d2b/d43/d53/d63/d6b/d144 0 2024-09-18T12:49:32.400 INFO:tasks.workunit.client.0.smithi078.stdout:3/598: unlink d9/d13/d33/d3c/d19/c84 0 2024-09-18T12:49:32.400 INFO:tasks.workunit.client.0.smithi078.stdout:7/581: write d7/d9/d14/d22/d3e/d95/d97/f71 [508927,61988] 0 2024-09-18T12:49:32.403 INFO:tasks.workunit.client.0.smithi078.stdout:6/963: dwrite d10/d2b/d43/d53/f56 [4194304,4194304] 0 2024-09-18T12:49:32.404 INFO:tasks.workunit.client.0.smithi078.stdout:6/964: chown d10/d2b/d61 14560228 1 2024-09-18T12:49:32.404 INFO:tasks.workunit.client.0.smithi078.stdout:6/965: chown d10/d2b/d61/dd7 54 1 2024-09-18T12:49:32.409 INFO:tasks.workunit.client.0.smithi078.stdout:7/582: rmdir d7/d26 39 2024-09-18T12:49:32.411 INFO:tasks.workunit.client.0.smithi078.stdout:4/794: creat d11/d27/fff x:0 0 0 2024-09-18T12:49:32.415 INFO:tasks.workunit.client.0.smithi078.stdout:3/599: unlink d9/d54/d6c/lb3 0 2024-09-18T12:49:32.416 INFO:tasks.workunit.client.0.smithi078.stdout:7/583: chown d7/d26/d84 83985 1 2024-09-18T12:49:32.422 INFO:tasks.workunit.client.0.smithi078.stdout:3/600: creat d9/d54/d6c/fba x:0 0 0 2024-09-18T12:49:32.423 INFO:tasks.workunit.client.0.smithi078.stdout:7/584: rmdir d7/d9/d4d/d6f 39 2024-09-18T12:49:32.423 INFO:tasks.workunit.client.0.smithi078.stdout:7/585: fsync d7/d9/fb7 0 2024-09-18T12:49:32.425 INFO:tasks.workunit.client.0.smithi078.stdout:4/795: rename d11/d27/d5a/lde to d11/d27/d47/d4e/d50/l100 0 2024-09-18T12:49:32.425 INFO:tasks.workunit.client.0.smithi078.stdout:4/796: stat d11/d27/d5a/cb5 0 2024-09-18T12:49:32.428 INFO:tasks.workunit.client.0.smithi078.stdout:7/586: fdatasync d7/fa 0 2024-09-18T12:49:32.429 INFO:tasks.workunit.client.0.smithi078.stdout:6/966: getdents d10/d2b/d43/d53/d63/d6b 0 2024-09-18T12:49:32.430 INFO:tasks.workunit.client.0.smithi078.stdout:4/797: creat d11/d27/d47/d78/f101 x:0 0 0 2024-09-18T12:49:32.432 INFO:tasks.workunit.client.0.smithi078.stdout:3/601: readlink d9/df/l3a 0 2024-09-18T12:49:32.438 INFO:tasks.workunit.client.0.smithi078.stdout:6/967: rename d10/d2b/f44 to d10/d2b/d43/d101/f145 0 2024-09-18T12:49:32.441 INFO:tasks.workunit.client.0.smithi078.stdout:4/798: creat d11/d27/d89/d9f/f102 x:0 0 0 2024-09-18T12:49:32.442 INFO:tasks.workunit.client.0.smithi078.stdout:3/602: creat d9/d2f/d43/fbb x:0 0 0 2024-09-18T12:49:32.443 INFO:tasks.workunit.client.0.smithi078.stdout:7/587: getdents d7/d9/d14/d22/d35/d49/d61/d7b 0 2024-09-18T12:49:32.446 INFO:tasks.workunit.client.0.smithi078.stdout:3/603: symlink d9/d54/d6c/d9f/lbc 0 2024-09-18T12:49:32.448 INFO:tasks.workunit.client.0.smithi078.stdout:7/588: truncate d7/d26/d4f/f50 4121891 0 2024-09-18T12:49:32.449 INFO:tasks.workunit.client.0.smithi078.stdout:7/589: chown d7/d9/d14/d22/d3e/fc3 1685963 1 2024-09-18T12:49:32.450 INFO:tasks.workunit.client.0.smithi078.stdout:7/590: chown d7/d9/fe 113 1 2024-09-18T12:49:32.450 INFO:tasks.workunit.client.0.smithi078.stdout:7/591: chown d7/d9/d32/f36 16985 1 2024-09-18T12:49:32.451 INFO:tasks.workunit.client.0.smithi078.stdout:7/592: chown d7/d5d/f6d 7332 1 2024-09-18T12:49:32.452 INFO:tasks.workunit.client.0.smithi078.stdout:4/799: truncate d11/d27/d60/fcf 3167129 0 2024-09-18T12:49:32.458 INFO:tasks.workunit.client.0.smithi078.stdout:7/593: creat d7/d9/d14/d22/d35/fc7 x:0 0 0 2024-09-18T12:49:32.459 INFO:tasks.workunit.client.0.smithi078.stdout:4/800: dwrite d11/d27/d5a/f79 [0,4194304] 0 2024-09-18T12:49:32.465 INFO:tasks.workunit.client.0.smithi078.stdout:3/604: creat d9/d2f/fbd x:0 0 0 2024-09-18T12:49:32.466 INFO:tasks.workunit.client.0.smithi078.stdout:3/605: stat d9/d13/d63/laf 0 2024-09-18T12:49:32.467 INFO:tasks.workunit.client.0.smithi078.stdout:3/606: readlink d9/d2f/d43/la5 0 2024-09-18T12:49:32.468 INFO:tasks.workunit.client.0.smithi078.stdout:7/594: rename d7/fc4 to d7/d9/d14/d22/d35/fc8 0 2024-09-18T12:49:32.469 INFO:tasks.workunit.client.0.smithi078.stdout:7/595: chown d7/d5d/d87/fb6 15003783 1 2024-09-18T12:49:32.470 INFO:tasks.workunit.client.0.smithi078.stdout:7/596: fdatasync d7/d9/d14/d22/d35/d49/d56/d8d/fb8 0 2024-09-18T12:49:32.471 INFO:tasks.workunit.client.0.smithi078.stdout:4/801: unlink d11/f44 0 2024-09-18T12:49:32.472 INFO:tasks.workunit.client.0.smithi078.stdout:6/968: write d10/d2b/d61/f7b [2526524,98715] 0 2024-09-18T12:49:32.473 INFO:tasks.workunit.client.0.smithi078.stdout:3/607: rmdir d9/d2f 39 2024-09-18T12:49:32.474 INFO:tasks.workunit.client.0.smithi078.stdout:3/608: chown d9/d13 12074731 1 2024-09-18T12:49:32.474 INFO:tasks.workunit.client.0.smithi078.stdout:7/597: mkdir d7/d9/d14/d22/d3e/dc9 0 2024-09-18T12:49:32.474 INFO:tasks.workunit.client.0.smithi078.stdout:3/609: stat d9/d13/d63/d78/la4 0 2024-09-18T12:49:32.476 INFO:tasks.workunit.client.0.smithi078.stdout:4/802: creat d11/d45/f103 x:0 0 0 2024-09-18T12:49:32.477 INFO:tasks.workunit.client.0.smithi078.stdout:4/803: stat d11/d27/d47/f3f 0 2024-09-18T12:49:32.478 INFO:tasks.workunit.client.0.smithi078.stdout:4/804: chown d11/d27/d47/f49 0 1 2024-09-18T12:49:32.479 INFO:tasks.workunit.client.0.smithi078.stdout:4/805: chown d11/d27/d47/d4e/daa/fab 427215971 1 2024-09-18T12:49:32.480 INFO:tasks.workunit.client.0.smithi078.stdout:3/610: symlink d9/d54/d89/d92/db6/lbe 0 2024-09-18T12:49:32.480 INFO:tasks.workunit.client.0.smithi078.stdout:4/806: write d11/d27/d89/fcb [1274047,39266] 0 2024-09-18T12:49:32.481 INFO:tasks.workunit.client.0.smithi078.stdout:4/807: fsync d11/d27/d89/def/ffa 0 2024-09-18T12:49:32.489 INFO:tasks.workunit.client.0.smithi078.stdout:7/598: write f5 [3725249,67132] 0 2024-09-18T12:49:32.489 INFO:tasks.workunit.client.0.smithi078.stdout:4/808: dwrite d11/d27/d5a/d84/d4b/da7/dba/dc1/fed [0,4194304] 0 2024-09-18T12:49:32.491 INFO:tasks.workunit.client.0.smithi078.stdout:6/969: write d10/d2b/d43/dc3/d103/d77/f91 [3614982,18794] 0 2024-09-18T12:49:32.500 INFO:tasks.workunit.client.0.smithi078.stdout:3/611: getdents d9/d2f/d43 0 2024-09-18T12:49:32.504 INFO:tasks.workunit.client.0.smithi078.stdout:3/612: symlink d9/d54/d6c/lbf 0 2024-09-18T12:49:32.505 INFO:tasks.workunit.client.0.smithi078.stdout:4/809: getdents d11/d27 0 2024-09-18T12:49:32.508 INFO:tasks.workunit.client.0.smithi078.stdout:3/613: truncate d9/d13/d33/d4e/f25 5296300 0 2024-09-18T12:49:32.511 INFO:tasks.workunit.client.0.smithi078.stdout:7/599: truncate d7/d3f/f8f 3079410 0 2024-09-18T12:49:32.518 INFO:tasks.workunit.client.0.smithi078.stdout:6/970: dwrite d10/d2b/d43/dc3/d103/d77/fa3 [0,4194304] 0 2024-09-18T12:49:32.522 INFO:tasks.workunit.client.0.smithi078.stdout:4/810: dwrite d11/f1d [0,4194304] 0 2024-09-18T12:49:32.523 INFO:tasks.workunit.client.0.smithi078.stdout:3/614: truncate d9/d13/d33/d4e/f25 3865527 0 2024-09-18T12:49:32.531 INFO:tasks.workunit.client.0.smithi078.stdout:7/600: dread d7/d9/fe [0,4194304] 0 2024-09-18T12:49:32.531 INFO:tasks.workunit.client.0.smithi078.stdout:4/811: fsync d11/d27/d47/f3d 0 2024-09-18T12:49:32.533 INFO:tasks.workunit.client.0.smithi078.stdout:4/812: dread - d11/d45/f103 zero size 2024-09-18T12:49:32.535 INFO:tasks.workunit.client.0.smithi078.stdout:4/813: dread d11/d27/f48 [0,4194304] 0 2024-09-18T12:49:32.539 INFO:tasks.workunit.client.0.smithi078.stdout:6/971: rename d10/d2b/d43/dc3/d103/ddd to d10/d2b/d43/d53/d45/d55/d146 0 2024-09-18T12:49:32.542 INFO:tasks.workunit.client.0.smithi078.stdout:7/601: mkdir d7/d9/d32/d3b/dca 0 2024-09-18T12:49:32.544 INFO:tasks.workunit.client.0.smithi078.stdout:3/615: rename d9/d54/d7f/d9c/l9d to d9/d13/d33/d34/d97/lc0 0 2024-09-18T12:49:32.545 INFO:tasks.workunit.client.0.smithi078.stdout:6/972: fsync d10/d2b/d43/d53/d63/f11b 0 2024-09-18T12:49:32.549 INFO:tasks.workunit.client.0.smithi078.stdout:7/602: mkdir d7/d9/d14/d22/d3e/d95/db2/dcb 0 2024-09-18T12:49:32.549 INFO:tasks.workunit.client.0.smithi078.stdout:6/973: symlink d10/d2b/d43/d53/d63/d6b/da1/l147 0 2024-09-18T12:49:32.553 INFO:tasks.workunit.client.0.smithi078.stdout:3/616: creat d9/d13/d63/fc1 x:0 0 0 2024-09-18T12:49:32.556 INFO:tasks.workunit.client.0.smithi078.stdout:6/974: unlink d10/d2b/d37/f4a 0 2024-09-18T12:49:32.557 INFO:tasks.workunit.client.0.smithi078.stdout:6/975: chown d10/d2b/d61/lb0 7 1 2024-09-18T12:49:32.558 INFO:tasks.workunit.client.0.smithi078.stdout:3/617: mkdir d9/d13/d33/d34/d97/dc2 0 2024-09-18T12:49:32.563 INFO:tasks.workunit.client.0.smithi078.stdout:7/603: write d7/d9/d32/d3b/f7e [573206,61026] 0 2024-09-18T12:49:32.563 INFO:tasks.workunit.client.0.smithi078.stdout:7/604: stat d7/d5d/f74 0 2024-09-18T12:49:32.568 INFO:tasks.workunit.client.0.smithi078.stdout:7/605: mknod d7/d9/d14/d22/d35/d49/d61/d89/ccc 0 2024-09-18T12:49:32.570 INFO:tasks.workunit.client.0.smithi078.stdout:3/618: getdents d9/d29/d4b 0 2024-09-18T12:49:32.573 INFO:tasks.workunit.client.0.smithi078.stdout:6/976: dread d10/d2b/d43/dc3/d103/dac/f11a [0,4194304] 0 2024-09-18T12:49:32.574 INFO:tasks.workunit.client.0.smithi078.stdout:3/619: rename d9/d54/d6c/f81 to d9/d54/d7f/d9c/fc3 0 2024-09-18T12:49:32.575 INFO:tasks.workunit.client.0.smithi078.stdout:6/977: creat d10/d2b/d61/d133/f148 x:0 0 0 2024-09-18T12:49:32.576 INFO:tasks.workunit.client.0.smithi078.stdout:3/620: read d9/d13/d33/d3c/d19/f22 [4508195,12649] 0 2024-09-18T12:49:32.577 INFO:tasks.workunit.client.0.smithi078.stdout:6/978: chown d10/d2b/d43/d53/d63/d6b/cb7 64593801 1 2024-09-18T12:49:32.579 INFO:tasks.workunit.client.0.smithi078.stdout:6/979: mknod d10/d2b/d43/dc3/c149 0 2024-09-18T12:49:32.582 INFO:tasks.workunit.client.0.smithi078.stdout:7/606: dread d7/f33 [0,4194304] 0 2024-09-18T12:49:32.593 INFO:tasks.workunit.client.0.smithi078.stdout:7/607: dread d7/fa [0,4194304] 0 2024-09-18T12:49:32.596 INFO:tasks.workunit.client.0.smithi078.stdout:3/621: dread d9/d29/f6d [0,4194304] 0 2024-09-18T12:49:32.596 INFO:tasks.workunit.client.0.smithi078.stdout:7/608: chown d7/d9/d14/d22/d35/d49/d61/d89 329 1 2024-09-18T12:49:32.598 INFO:tasks.workunit.client.0.smithi078.stdout:1/720: sync 2024-09-18T12:49:32.599 INFO:tasks.workunit.client.0.smithi078.stdout:6/980: dwrite d10/d2b/d61/dd7/ff4 [0,4194304] 0 2024-09-18T12:49:32.602 INFO:tasks.workunit.client.0.smithi078.stdout:6/981: dread - d10/d2b/d43/d53/d45/d55/d146/f12b zero size 2024-09-18T12:49:32.605 INFO:tasks.workunit.client.0.smithi078.stdout:3/622: dread d9/d13/d33/d34/f4f [0,4194304] 0 2024-09-18T12:49:32.607 INFO:tasks.workunit.client.0.smithi078.stdout:3/623: chown d9/d13/d63/d78/la4 24632342 1 2024-09-18T12:49:32.610 INFO:tasks.workunit.client.0.smithi078.stdout:7/609: dwrite d7/f17 [0,4194304] 0 2024-09-18T12:49:32.613 INFO:tasks.workunit.client.0.smithi078.stdout:1/721: dread d0/d8/da/d3e/d50/d60/f6b [0,4194304] 0 2024-09-18T12:49:32.614 INFO:tasks.workunit.client.0.smithi078.stdout:7/610: symlink d7/d3f/lcd 0 2024-09-18T12:49:32.614 INFO:tasks.workunit.client.0.smithi078.stdout:3/624: dread d9/d13/d33/d4e/f75 [0,4194304] 0 2024-09-18T12:49:32.616 INFO:tasks.workunit.client.0.smithi078.stdout:6/982: link d10/d2b/d43/dc3/d103/dac/c10a d10/d2b/d43/dc3/d103/dac/c14a 0 2024-09-18T12:49:32.618 INFO:tasks.workunit.client.0.smithi078.stdout:6/983: read - d10/d2b/d43/d53/d45/d55/d146/f143 zero size 2024-09-18T12:49:32.618 INFO:tasks.workunit.client.0.smithi078.stdout:3/625: creat d9/d2f/d43/fc4 x:0 0 0 2024-09-18T12:49:32.619 INFO:tasks.workunit.client.0.smithi078.stdout:1/722: creat d0/d8/da/d3e/d58/d6e/d52/d47/de8/dee/ff6 x:0 0 0 2024-09-18T12:49:32.621 INFO:tasks.workunit.client.0.smithi078.stdout:7/611: rename d7/d9/d14/d22/d35/f85 to d7/d9/d14/d22/fce 0 2024-09-18T12:49:32.622 INFO:tasks.workunit.client.0.smithi078.stdout:3/626: symlink d9/d54/d7f/lc5 0 2024-09-18T12:49:32.624 INFO:tasks.workunit.client.0.smithi078.stdout:6/984: symlink d10/l14b 0 2024-09-18T12:49:32.627 INFO:tasks.workunit.client.0.smithi078.stdout:7/612: mknod d7/d26/dc1/ccf 0 2024-09-18T12:49:32.631 INFO:tasks.workunit.client.0.smithi078.stdout:7/613: mknod d7/d26/d4f/cd0 0 2024-09-18T12:49:32.634 INFO:tasks.workunit.client.0.smithi078.stdout:3/627: write d9/d13/d33/d4e/f25 [326729,85211] 0 2024-09-18T12:49:32.635 INFO:tasks.workunit.client.0.smithi078.stdout:7/614: getdents d7/d9/d14/d22/d3e/dc9 0 2024-09-18T12:49:32.635 INFO:tasks.workunit.client.0.smithi078.stdout:3/628: chown d9/d29/f6d 0 1 2024-09-18T12:49:32.636 INFO:tasks.workunit.client.0.smithi078.stdout:3/629: write d9/d54/fb4 [638060,127886] 0 2024-09-18T12:49:32.638 INFO:tasks.workunit.client.0.smithi078.stdout:3/630: chown d9/d54/d7f/d9c/ca8 26333 1 2024-09-18T12:49:32.639 INFO:tasks.workunit.client.0.smithi078.stdout:3/631: fsync d9/d13/d63/d78/f79 0 2024-09-18T12:49:32.642 INFO:tasks.workunit.client.0.smithi078.stdout:7/615: dwrite d7/d9/d14/d22/d3e/d95/d97/f71 [0,4194304] 0 2024-09-18T12:49:32.643 INFO:tasks.workunit.client.0.smithi078.stdout:3/632: truncate d9/f3f 3042140 0 2024-09-18T12:49:32.644 INFO:tasks.workunit.client.0.smithi078.stdout:3/633: chown d9/d13/d33/d4e/c99 17 1 2024-09-18T12:49:32.645 INFO:tasks.workunit.client.0.smithi078.stdout:7/616: chown d7/d26/d4f/f50 36976751 1 2024-09-18T12:49:32.646 INFO:tasks.workunit.client.0.smithi078.stdout:3/634: read d9/d29/d4b/d4c/f91 [7133405,74704] 0 2024-09-18T12:49:32.648 INFO:tasks.workunit.client.0.smithi078.stdout:7/617: creat d7/fd1 x:0 0 0 2024-09-18T12:49:32.650 INFO:tasks.workunit.client.0.smithi078.stdout:3/635: creat d9/d54/d7f/d9c/fc6 x:0 0 0 2024-09-18T12:49:32.652 INFO:tasks.workunit.client.0.smithi078.stdout:3/636: rmdir d9/d54/d6c 39 2024-09-18T12:49:32.656 INFO:tasks.workunit.client.0.smithi078.stdout:3/637: getdents d9/d2f/d43 0 2024-09-18T12:49:32.662 INFO:tasks.workunit.client.0.smithi078.stdout:3/638: getdents d9/d13/d33/d3c 0 2024-09-18T12:49:32.669 INFO:tasks.workunit.client.0.smithi078.stdout:7/618: dread d7/d9/d32/fa6 [4194304,4194304] 0 2024-09-18T12:49:32.671 INFO:tasks.workunit.client.0.smithi078.stdout:3/639: dwrite d9/df/fa9 [0,4194304] 0 2024-09-18T12:49:32.676 INFO:tasks.workunit.client.0.smithi078.stdout:7/619: mknod d7/d9/d14/d22/d3e/d95/db2/dcb/cd2 0 2024-09-18T12:49:32.681 INFO:tasks.workunit.client.0.smithi078.stdout:3/640: dread d9/d54/f68 [0,4194304] 0 2024-09-18T12:49:32.681 INFO:tasks.workunit.client.0.smithi078.stdout:3/641: stat d9/d29/d4b/d4c/l8d 0 2024-09-18T12:49:32.697 INFO:tasks.workunit.client.0.smithi078.stdout:7/620: dread f5 [0,4194304] 0 2024-09-18T12:49:32.700 INFO:tasks.workunit.client.0.smithi078.stdout:7/621: fdatasync d7/d3f/f8f 0 2024-09-18T12:49:32.700 INFO:tasks.workunit.client.0.smithi078.stdout:3/642: dread d9/d13/d33/d3c/f87 [0,4194304] 0 2024-09-18T12:49:32.705 INFO:tasks.workunit.client.0.smithi078.stdout:7/622: dread d7/f33 [0,4194304] 0 2024-09-18T12:49:32.708 INFO:tasks.workunit.client.0.smithi078.stdout:7/623: rename d7/d9/d14/d22/d35/d49/f51 to d7/d9/d4d/d9a/fd3 0 2024-09-18T12:49:32.710 INFO:tasks.workunit.client.0.smithi078.stdout:3/643: getdents d9/df 0 2024-09-18T12:49:32.711 INFO:tasks.workunit.client.0.smithi078.stdout:3/644: truncate d9/d2f/fbd 943969 0 2024-09-18T12:49:32.713 INFO:tasks.workunit.client.0.smithi078.stdout:3/645: read d9/d2f/f77 [3476526,31285] 0 2024-09-18T12:49:32.719 INFO:tasks.workunit.client.0.smithi078.stdout:3/646: write f7 [9392847,125447] 0 2024-09-18T12:49:32.722 INFO:tasks.workunit.client.0.smithi078.stdout:7/624: dread d7/d3f/f64 [0,4194304] 0 2024-09-18T12:49:32.722 INFO:tasks.workunit.client.0.smithi078.stdout:3/647: creat d9/d54/d89/d92/fc7 x:0 0 0 2024-09-18T12:49:32.722 INFO:tasks.workunit.client.0.smithi078.stdout:7/625: readlink d7/d5d/d7a/l72 0 2024-09-18T12:49:32.725 INFO:tasks.workunit.client.0.smithi078.stdout:7/626: rename d7/d9/d14/d22/d35/d49/d7d/caa to d7/d26/d4f/cd4 0 2024-09-18T12:49:32.728 INFO:tasks.workunit.client.0.smithi078.stdout:3/648: write d9/d13/d33/d34/f4f [97703,83605] 0 2024-09-18T12:49:32.732 INFO:tasks.workunit.client.0.smithi078.stdout:3/649: symlink d9/d54/d6c/d9f/db2/db8/lc8 0 2024-09-18T12:49:32.732 INFO:tasks.workunit.client.0.smithi078.stdout:7/627: dread d7/d26/f79 [0,4194304] 0 2024-09-18T12:49:32.735 INFO:tasks.workunit.client.0.smithi078.stdout:3/650: rename d9/d13/d63/d78/c7a to d9/d13/d33/d34/d97/dc2/cc9 0 2024-09-18T12:49:32.737 INFO:tasks.workunit.client.0.smithi078.stdout:7/628: rename d7/d9/d14/d22/d35/f9c to d7/d9/d14/d22/d35/d49/d7d/fd5 0 2024-09-18T12:49:32.739 INFO:tasks.workunit.client.0.smithi078.stdout:7/629: read d7/d9/f1f [1353790,99146] 0 2024-09-18T12:49:32.740 INFO:tasks.workunit.client.0.smithi078.stdout:3/651: fsync d9/d54/d7f/f98 0 2024-09-18T12:49:32.746 INFO:tasks.workunit.client.0.smithi078.stdout:3/652: creat d9/d13/d63/d78/fca x:0 0 0 2024-09-18T12:49:32.746 INFO:tasks.workunit.client.0.smithi078.stdout:7/630: dwrite d7/d9/d14/d22/d35/d49/d56/d8d/fb8 [0,4194304] 0 2024-09-18T12:49:32.752 INFO:tasks.workunit.client.0.smithi078.stdout:7/631: read d7/d9/d4d/d6f/f8a [3573842,74239] 0 2024-09-18T12:49:32.758 INFO:tasks.workunit.client.0.smithi078.stdout:3/653: link d9/d13/d63/c69 d9/d13/d63/d78/ccb 0 2024-09-18T12:49:32.759 INFO:tasks.workunit.client.0.smithi078.stdout:3/654: chown d9/d2f/d43/la5 11 1 2024-09-18T12:49:32.761 INFO:tasks.workunit.client.0.smithi078.stdout:3/655: fdatasync d9/d54/d7f/f98 0 2024-09-18T12:49:32.762 INFO:tasks.workunit.client.0.smithi078.stdout:3/656: write d9/d54/fb4 [1071606,76709] 0 2024-09-18T12:49:32.766 INFO:tasks.workunit.client.0.smithi078.stdout:7/632: dread d7/d26/f30 [0,4194304] 0 2024-09-18T12:49:32.769 INFO:tasks.workunit.client.0.smithi078.stdout:3/657: dwrite d9/d13/d33/d34/d97/f9b [0,4194304] 0 2024-09-18T12:49:32.770 INFO:tasks.workunit.client.0.smithi078.stdout:3/658: fsync d9/d13/f1d 0 2024-09-18T12:49:32.770 INFO:tasks.workunit.client.0.smithi078.stdout:7/633: mknod d7/d9/d32/d3b/dc0/cd6 0 2024-09-18T12:49:32.778 INFO:tasks.workunit.client.0.smithi078.stdout:7/634: dwrite d7/d9/d14/d22/d35/d49/d61/d89/fa4 [0,4194304] 0 2024-09-18T12:49:32.784 INFO:tasks.workunit.client.0.smithi078.stdout:3/659: write d9/d13/d33/d34/f48 [938621,67532] 0 2024-09-18T12:49:32.786 INFO:tasks.workunit.client.0.smithi078.stdout:3/660: symlink d9/d29/d4b/d4c/lcc 0 2024-09-18T12:49:32.787 INFO:tasks.workunit.client.0.smithi078.stdout:3/661: truncate d9/d2f/d43/fbb 843666 0 2024-09-18T12:49:32.795 INFO:tasks.workunit.client.0.smithi078.stdout:3/662: write d9/d2f/f3d [3011757,74356] 0 2024-09-18T12:49:32.798 INFO:tasks.workunit.client.0.smithi078.stdout:3/663: link d9/d54/c65 d9/d2f/d43/d62/ccd 0 2024-09-18T12:49:32.869 INFO:tasks.workunit.client.0.smithi078.stdout:3/664: link d9/d13/d33/f51 d9/d13/d33/d34/d9e/fce 0 2024-09-18T12:49:32.872 INFO:tasks.workunit.client.0.smithi078.stdout:0/817: sync 2024-09-18T12:49:32.875 INFO:tasks.workunit.client.0.smithi078.stdout:3/665: creat d9/d29/d4b/d4c/fcf x:0 0 0 2024-09-18T12:49:32.886 INFO:tasks.workunit.client.0.smithi078.stdout:7/635: dread d7/d9/d32/f36 [0,4194304] 0 2024-09-18T12:49:32.955 INFO:tasks.workunit.client.0.smithi078.stdout:0/818: creat d3/d82/dd7/f11d x:0 0 0 2024-09-18T12:49:32.955 INFO:tasks.workunit.client.0.smithi078.stdout:3/666: mknod d9/d13/d33/cd0 0 2024-09-18T12:49:32.956 INFO:tasks.workunit.client.0.smithi078.stdout:7/636: write d7/d9/d14/d22/d35/d49/f66 [335931,50728] 0 2024-09-18T12:49:32.959 INFO:tasks.workunit.client.0.smithi078.stdout:3/667: rename d9/d13/d63/d78/cb0 to d9/d13/d33/d34/d9e/cd1 0 2024-09-18T12:49:32.963 INFO:tasks.workunit.client.0.smithi078.stdout:7/637: dwrite d7/d9/d14/d22/d3e/d95/d97/f71 [0,4194304] 0 2024-09-18T12:49:32.968 INFO:tasks.workunit.client.0.smithi078.stdout:3/668: dwrite d9/d2f/d43/d62/fad [0,4194304] 0 2024-09-18T12:49:32.969 INFO:tasks.workunit.client.0.smithi078.stdout:3/669: stat d9/d13/l73 0 2024-09-18T12:49:32.974 INFO:tasks.workunit.client.0.smithi078.stdout:3/670: rmdir d9/d13/d33/d3c 39 2024-09-18T12:49:32.978 INFO:tasks.workunit.client.0.smithi078.stdout:3/671: dread - d9/d13/d33/d3c/d19/fa6 zero size 2024-09-18T12:49:32.980 INFO:tasks.workunit.client.0.smithi078.stdout:3/672: mknod d9/d54/d89/cd2 0 2024-09-18T12:49:32.985 INFO:tasks.workunit.client.0.smithi078.stdout:3/673: mknod d9/d2f/cd3 0 2024-09-18T12:49:32.988 INFO:tasks.workunit.client.0.smithi078.stdout:3/674: mkdir d9/d54/d7f/dae/dd4 0 2024-09-18T12:49:32.998 INFO:tasks.workunit.client.0.smithi078.stdout:3/675: dread d9/d2f/f3d [0,4194304] 0 2024-09-18T12:49:33.001 INFO:tasks.workunit.client.0.smithi078.stdout:3/676: write d9/d13/d33/d3c/d19/f22 [1518497,7102] 0 2024-09-18T12:49:33.001 INFO:tasks.workunit.client.0.smithi078.stdout:0/819: write d3/f3f [2290572,2036] 0 2024-09-18T12:49:33.002 INFO:tasks.workunit.client.0.smithi078.stdout:3/677: readlink d9/d2f/d43/l94 0 2024-09-18T12:49:33.002 INFO:tasks.workunit.client.0.smithi078.stdout:0/820: readlink d3/d82/d10d/l40 0 2024-09-18T12:49:33.005 INFO:tasks.workunit.client.0.smithi078.stdout:3/678: unlink d9/d54/c65 0 2024-09-18T12:49:33.006 INFO:tasks.workunit.client.0.smithi078.stdout:3/679: readlink d9/d13/d37/l55 0 2024-09-18T12:49:33.006 INFO:tasks.workunit.client.0.smithi078.stdout:0/821: symlink d3/d1f/d2e/d4e/db2/l11e 0 2024-09-18T12:49:33.007 INFO:tasks.workunit.client.0.smithi078.stdout:3/680: fdatasync d9/f61 0 2024-09-18T12:49:33.012 INFO:tasks.workunit.client.0.smithi078.stdout:3/681: dread d9/d29/d4b/d4c/f91 [8388608,4194304] 0 2024-09-18T12:49:33.015 INFO:tasks.workunit.client.0.smithi078.stdout:3/682: fsync d9/d13/d33/d4e/f75 0 2024-09-18T12:49:33.015 INFO:tasks.workunit.client.0.smithi078.stdout:7/638: dwrite d7/d9/f2f [0,4194304] 0 2024-09-18T12:49:33.020 INFO:tasks.workunit.client.0.smithi078.stdout:3/683: rename d9/d2f/l64 to d9/d2f/ld5 0 2024-09-18T12:49:33.020 INFO:tasks.workunit.client.0.smithi078.stdout:7/639: dread d7/d9/fe [0,4194304] 0 2024-09-18T12:49:33.023 INFO:tasks.workunit.client.0.smithi078.stdout:3/684: rmdir d9/d13/d33/d3c/d19 39 2024-09-18T12:49:33.027 INFO:tasks.workunit.client.0.smithi078.stdout:3/685: chown d9/d13/d33/d3c/d19/fa6 0 1 2024-09-18T12:49:33.029 INFO:tasks.workunit.client.0.smithi078.stdout:0/822: truncate d3/d1f/d2e/d4e/f49 2541988 0 2024-09-18T12:49:33.033 INFO:tasks.workunit.client.0.smithi078.stdout:7/640: rename d7/d9/d32 to d7/d9/dd7 0 2024-09-18T12:49:33.035 INFO:tasks.workunit.client.0.smithi078.stdout:3/686: creat d9/d13/d63/fd6 x:0 0 0 2024-09-18T12:49:33.041 INFO:tasks.workunit.client.0.smithi078.stdout:3/687: truncate d9/d2f/f77 91379 0 2024-09-18T12:49:33.041 INFO:tasks.workunit.client.0.smithi078.stdout:7/641: dwrite d7/d9/d14/d22/fb1 [0,4194304] 0 2024-09-18T12:49:33.045 INFO:tasks.workunit.client.0.smithi078.stdout:7/642: dread - d7/d9/dd7/fa0 zero size 2024-09-18T12:49:33.047 INFO:tasks.workunit.client.0.smithi078.stdout:0/823: dread d3/d1f/d2e/d8f/d90/dcb/fcc [0,4194304] 0 2024-09-18T12:49:33.057 INFO:tasks.workunit.client.0.smithi078.stdout:0/824: creat d3/d1f/d2e/d4e/d37/d72/f11f x:0 0 0 2024-09-18T12:49:33.059 INFO:tasks.workunit.client.0.smithi078.stdout:0/825: truncate d3/d43/fb7 199702 0 2024-09-18T12:49:33.061 INFO:tasks.workunit.client.0.smithi078.stdout:0/826: fdatasync d3/d1f/d2e/d8f/d90/fa4 0 2024-09-18T12:49:33.062 INFO:tasks.workunit.client.0.smithi078.stdout:7/643: dwrite d7/d5d/f6d [0,4194304] 0 2024-09-18T12:49:33.063 INFO:tasks.workunit.client.0.smithi078.stdout:0/827: readlink d3/d1f/d2e/d8f/lb1 0 2024-09-18T12:49:33.063 INFO:tasks.workunit.client.0.smithi078.stdout:7/644: read - d7/d9/d14/d22/d35/fc7 zero size 2024-09-18T12:49:33.068 INFO:tasks.workunit.client.0.smithi078.stdout:7/645: creat d7/d9/d4d/d9a/fd8 x:0 0 0 2024-09-18T12:49:33.069 INFO:tasks.workunit.client.0.smithi078.stdout:7/646: fsync d7/d9/d14/d22/d35/fc7 0 2024-09-18T12:49:33.078 INFO:tasks.workunit.client.0.smithi078.stdout:0/828: mkdir d3/d1f/d2e/d4e/d37/d72/d120 0 2024-09-18T12:49:33.080 INFO:tasks.workunit.client.0.smithi078.stdout:7/647: symlink d7/d26/ld9 0 2024-09-18T12:49:33.081 INFO:tasks.workunit.client.0.smithi078.stdout:0/829: creat d3/d1f/d2e/d4e/d37/d72/ddd/f121 x:0 0 0 2024-09-18T12:49:33.082 INFO:tasks.workunit.client.0.smithi078.stdout:0/830: chown d3/d1f/d2e/d8f/d90/fd4 240073767 1 2024-09-18T12:49:33.083 INFO:tasks.workunit.client.0.smithi078.stdout:7/648: mkdir d7/d9/d14/d22/d35/d49/dda 0 2024-09-18T12:49:33.084 INFO:tasks.workunit.client.0.smithi078.stdout:7/649: read d7/d26/f79 [562524,40700] 0 2024-09-18T12:49:33.089 INFO:tasks.workunit.client.0.smithi078.stdout:7/650: mkdir d7/d9/dd7/d3b/d9d/ddb 0 2024-09-18T12:49:33.094 INFO:tasks.workunit.client.0.smithi078.stdout:0/831: dread d3/f6c [0,4194304] 0 2024-09-18T12:49:33.095 INFO:tasks.workunit.client.0.smithi078.stdout:7/651: dwrite d7/f17 [0,4194304] 0 2024-09-18T12:49:33.097 INFO:tasks.workunit.client.0.smithi078.stdout:7/652: mknod d7/d3f/cdc 0 2024-09-18T12:49:33.101 INFO:tasks.workunit.client.0.smithi078.stdout:7/653: creat d7/d9/d14/d22/d35/fdd x:0 0 0 2024-09-18T12:49:33.102 INFO:tasks.workunit.client.0.smithi078.stdout:7/654: fsync d7/d9/d14/d22/fb1 0 2024-09-18T12:49:33.103 INFO:tasks.workunit.client.0.smithi078.stdout:0/832: rename d3/d43/l54 to d3/d1f/l122 0 2024-09-18T12:49:33.108 INFO:tasks.workunit.client.0.smithi078.stdout:0/833: unlink d3/d1f/d2e/d8f/f9a 0 2024-09-18T12:49:33.109 INFO:tasks.workunit.client.0.smithi078.stdout:7/655: dwrite d7/d9/d14/d22/d35/d49/f7c [0,4194304] 0 2024-09-18T12:49:33.110 INFO:tasks.workunit.client.0.smithi078.stdout:7/656: fdatasync d7/d9/d14/d22/d35/d49/d56/d8d/f9e 0 2024-09-18T12:49:33.114 INFO:tasks.workunit.client.0.smithi078.stdout:7/657: mkdir d7/d9/d14/dde 0 2024-09-18T12:49:33.144 INFO:tasks.workunit.client.0.smithi078.stdout:0/834: write d3/f28 [1650952,66770] 0 2024-09-18T12:49:33.146 INFO:tasks.workunit.client.0.smithi078.stdout:7/658: readlink d7/d9/d14/d22/d35/d49/d7d/lbd 0 2024-09-18T12:49:33.147 INFO:tasks.workunit.client.0.smithi078.stdout:0/835: creat d3/f123 x:0 0 0 2024-09-18T12:49:33.148 INFO:tasks.workunit.client.0.smithi078.stdout:0/836: chown d3/d1f/f97 153102560 1 2024-09-18T12:49:33.149 INFO:tasks.workunit.client.0.smithi078.stdout:0/837: chown d3/d82/d10d/d7c/da3/de2/c87 3 1 2024-09-18T12:49:33.149 INFO:tasks.workunit.client.0.smithi078.stdout:7/659: rename d7/d9/d4d/d6f/cbc to d7/d9/cdf 0 2024-09-18T12:49:33.151 INFO:tasks.workunit.client.0.smithi078.stdout:7/660: symlink d7/d9/d14/d22/d35/d49/d61/le0 0 2024-09-18T12:49:33.154 INFO:tasks.workunit.client.0.smithi078.stdout:7/661: creat d7/d9/d4d/d6f/fe1 x:0 0 0 2024-09-18T12:49:33.180 INFO:tasks.workunit.client.0.smithi078.stdout:7/662: write d7/d9/f13 [17067,28679] 0 2024-09-18T12:49:33.188 INFO:tasks.workunit.client.0.smithi078.stdout:7/663: dwrite d7/d9/fb7 [0,4194304] 0 2024-09-18T12:49:33.193 INFO:tasks.workunit.client.0.smithi078.stdout:7/664: mkdir d7/d9/d4d/de2 0 2024-09-18T12:49:33.202 INFO:tasks.workunit.client.0.smithi078.stdout:7/665: dwrite d7/d9/dd7/fa6 [8388608,4194304] 0 2024-09-18T12:49:33.208 INFO:tasks.workunit.client.0.smithi078.stdout:7/666: symlink d7/d9/d14/d22/d3e/d95/d97/le3 0 2024-09-18T12:49:33.208 INFO:tasks.workunit.client.0.smithi078.stdout:7/667: readlink l1 0 2024-09-18T12:49:33.210 INFO:tasks.workunit.client.0.smithi078.stdout:7/668: symlink d7/d9/d4d/de2/le4 0 2024-09-18T12:49:33.211 INFO:tasks.workunit.client.0.smithi078.stdout:7/669: write d7/d9/f2f [2101625,95238] 0 2024-09-18T12:49:33.216 INFO:tasks.workunit.client.0.smithi078.stdout:7/670: dread d7/d9/d14/d22/d3e/d95/d97/f71 [0,4194304] 0 2024-09-18T12:49:33.219 INFO:tasks.workunit.client.0.smithi078.stdout:9/776: sync 2024-09-18T12:49:33.219 INFO:tasks.workunit.client.0.smithi078.stdout:2/689: sync 2024-09-18T12:49:33.220 INFO:tasks.workunit.client.0.smithi078.stdout:9/777: write d5/fce [334284,72988] 0 2024-09-18T12:49:33.220 INFO:tasks.workunit.client.0.smithi078.stdout:7/671: mknod d7/d9/d4d/ce5 0 2024-09-18T12:49:33.221 INFO:tasks.workunit.client.0.smithi078.stdout:9/778: stat d5/d7/d32/c66 0 2024-09-18T12:49:33.222 INFO:tasks.workunit.client.0.smithi078.stdout:2/690: write d4/d8/d23/d52/d5f/d86/fc4 [195436,72178] 0 2024-09-18T12:49:33.226 INFO:tasks.workunit.client.0.smithi078.stdout:2/691: mknod d4/d8/d23/d52/d5f/d81/dac/daf/cdc 0 2024-09-18T12:49:33.240 INFO:tasks.workunit.client.0.smithi078.stdout:9/779: getdents d5/d7/db3 0 2024-09-18T12:49:33.241 INFO:tasks.workunit.client.0.smithi078.stdout:9/780: chown d5/d7/d8/d4f/f64 679 1 2024-09-18T12:49:33.254 INFO:tasks.workunit.client.0.smithi078.stdout:9/781: creat d5/d7/d32/d2a/d68/db0/f100 x:0 0 0 2024-09-18T12:49:33.255 INFO:tasks.workunit.client.0.smithi078.stdout:7/672: dwrite d7/d5d/d7a/f4a [0,4194304] 0 2024-09-18T12:49:33.257 INFO:tasks.workunit.client.0.smithi078.stdout:7/673: write d7/d5d/d7a/d62/fa7 [6101809,94049] 0 2024-09-18T12:49:33.258 INFO:tasks.workunit.client.0.smithi078.stdout:9/782: write d5/d7/d32/fa4 [1790537,30280] 0 2024-09-18T12:49:33.259 INFO:tasks.workunit.client.0.smithi078.stdout:2/692: write d4/d8/d23/d95/fb4 [608106,76806] 0 2024-09-18T12:49:33.265 INFO:tasks.workunit.client.0.smithi078.stdout:7/674: rename d7/d9/d14/d22/d35/d49/d56/l75 to d7/d9/dd7/d3b/dc0/le6 0 2024-09-18T12:49:33.267 INFO:tasks.workunit.client.0.smithi078.stdout:7/675: mknod d7/d3f/ce7 0 2024-09-18T12:49:33.269 INFO:tasks.workunit.client.0.smithi078.stdout:9/783: truncate d5/d7/d32/f89 1045873 0 2024-09-18T12:49:33.269 INFO:tasks.workunit.client.0.smithi078.stdout:2/693: dwrite d4/d8/d23/fa6 [0,4194304] 0 2024-09-18T12:49:33.278 INFO:tasks.workunit.client.0.smithi078.stdout:9/784: dwrite d5/d7/d32/d2a/d68/d97/fe7 [0,4194304] 0 2024-09-18T12:49:33.280 INFO:tasks.workunit.client.0.smithi078.stdout:9/785: readlink d5/d7/d32/l7b 0 2024-09-18T12:49:33.281 INFO:tasks.workunit.client.0.smithi078.stdout:9/786: dread - d5/dc6/feb zero size 2024-09-18T12:49:33.284 INFO:tasks.workunit.client.0.smithi078.stdout:7/676: symlink d7/d9/d14/dde/le8 0 2024-09-18T12:49:33.288 INFO:tasks.workunit.client.0.smithi078.stdout:9/787: rename d5/c1b to d5/d7/d32/c101 0 2024-09-18T12:49:33.289 INFO:tasks.workunit.client.0.smithi078.stdout:7/677: creat d7/d9/d14/dde/fe9 x:0 0 0 2024-09-18T12:49:33.300 INFO:tasks.workunit.client.0.smithi078.stdout:7/678: link d7/d9/dd7/d3b/d9d/cbf d7/d3f/cea 0 2024-09-18T12:49:33.303 INFO:tasks.workunit.client.0.smithi078.stdout:2/694: dwrite d4/db/f53 [4194304,4194304] 0 2024-09-18T12:49:33.304 INFO:tasks.workunit.client.0.smithi078.stdout:2/695: readlink d4/ld6 0 2024-09-18T12:49:33.305 INFO:tasks.workunit.client.0.smithi078.stdout:2/696: stat d4/cad 0 2024-09-18T12:49:33.306 INFO:tasks.workunit.client.0.smithi078.stdout:7/679: creat d7/d9/d14/d22/d35/d49/d61/feb x:0 0 0 2024-09-18T12:49:33.307 INFO:tasks.workunit.client.0.smithi078.stdout:2/697: rmdir d4 39 2024-09-18T12:49:33.315 INFO:tasks.workunit.client.0.smithi078.stdout:9/788: dwrite d5/d7/d32/d2a/d68/d97/dc0/ffe [0,4194304] 0 2024-09-18T12:49:33.320 INFO:tasks.workunit.client.0.smithi078.stdout:7/680: mknod d7/d9/d14/d22/d35/d49/d56/d8d/daf/cec 0 2024-09-18T12:49:33.321 INFO:tasks.workunit.client.0.smithi078.stdout:9/789: creat d5/dc6/f102 x:0 0 0 2024-09-18T12:49:33.323 INFO:tasks.workunit.client.0.smithi078.stdout:7/681: symlink d7/d9/d14/d22/d35/d49/d56/d8d/led 0 2024-09-18T12:49:33.330 INFO:tasks.workunit.client.0.smithi078.stdout:2/698: write d4/db/d45/dbc/fbe [1174501,19177] 0 2024-09-18T12:49:33.332 INFO:tasks.workunit.client.0.smithi078.stdout:2/699: creat d4/dd/d8a/dd3/fdd x:0 0 0 2024-09-18T12:49:33.341 INFO:tasks.workunit.client.0.smithi078.stdout:7/682: write d7/d9/d14/f93 [595239,74216] 0 2024-09-18T12:49:33.343 INFO:tasks.workunit.client.0.smithi078.stdout:9/790: dread d5/d7/d32/d2a/d68/d97/fe6 [0,4194304] 0 2024-09-18T12:49:33.345 INFO:tasks.workunit.client.0.smithi078.stdout:9/791: fsync d5/d7/d32/f31 0 2024-09-18T12:49:33.348 INFO:tasks.workunit.client.0.smithi078.stdout:7/683: dwrite d7/f17 [0,4194304] 0 2024-09-18T12:49:33.354 INFO:tasks.workunit.client.0.smithi078.stdout:9/792: dwrite d5/d7/d8/d4f/ffb [0,4194304] 0 2024-09-18T12:49:33.356 INFO:tasks.workunit.client.0.smithi078.stdout:9/793: mkdir d5/d7/dbe/de8/df1/d103 0 2024-09-18T12:49:33.358 INFO:tasks.workunit.client.0.smithi078.stdout:9/794: truncate d5/d7/d32/d2a/d6b/f5d 1563146 0 2024-09-18T12:49:33.360 INFO:tasks.workunit.client.0.smithi078.stdout:9/795: mknod d5/d7/d8/d4f/c104 0 2024-09-18T12:49:33.361 INFO:tasks.workunit.client.0.smithi078.stdout:9/796: rmdir d5/d7/d32/d2a/d68 39 2024-09-18T12:49:33.363 INFO:tasks.workunit.client.0.smithi078.stdout:9/797: creat d5/d7/db1/f105 x:0 0 0 2024-09-18T12:49:33.388 INFO:tasks.workunit.client.0.smithi078.stdout:9/798: dread d5/d7/d32/d2a/d68/f6f [0,4194304] 0 2024-09-18T12:49:33.391 INFO:tasks.workunit.client.0.smithi078.stdout:9/799: getdents d5/d7/d32 0 2024-09-18T12:49:33.392 INFO:tasks.workunit.client.0.smithi078.stdout:9/800: read d5/fce [178466,80563] 0 2024-09-18T12:49:33.446 INFO:tasks.workunit.client.0.smithi078.stdout:9/801: dwrite d5/d7/d8/d98/fc5 [0,4194304] 0 2024-09-18T12:49:33.448 INFO:tasks.workunit.client.0.smithi078.stdout:9/802: chown d5/l79 908706139 1 2024-09-18T12:49:33.449 INFO:tasks.workunit.client.0.smithi078.stdout:9/803: write d5/d7/d32/fa4 [2716288,102209] 0 2024-09-18T12:49:33.460 INFO:tasks.workunit.client.0.smithi078.stdout:9/804: write d5/f6c [249277,1745] 0 2024-09-18T12:49:33.462 INFO:tasks.workunit.client.0.smithi078.stdout:9/805: symlink d5/l106 0 2024-09-18T12:49:33.465 INFO:tasks.workunit.client.0.smithi078.stdout:9/806: truncate d5/d7/d32/d2a/f2d 24644 0 2024-09-18T12:49:33.466 INFO:tasks.workunit.client.0.smithi078.stdout:9/807: read d5/d7/fea [3731784,85657] 0 2024-09-18T12:49:33.469 INFO:tasks.workunit.client.0.smithi078.stdout:4/814: sync 2024-09-18T12:49:33.469 INFO:tasks.workunit.client.0.smithi078.stdout:1/723: sync 2024-09-18T12:49:33.469 INFO:tasks.workunit.client.0.smithi078.stdout:3/688: sync 2024-09-18T12:49:33.469 INFO:tasks.workunit.client.0.smithi078.stdout:6/985: sync 2024-09-18T12:49:33.469 INFO:tasks.workunit.client.0.smithi078.stdout:8/773: sync 2024-09-18T12:49:33.471 INFO:tasks.workunit.client.0.smithi078.stdout:3/689: chown d9/d54/d89/d92/fc7 3715 1 2024-09-18T12:49:33.474 INFO:tasks.workunit.client.0.smithi078.stdout:4/815: creat d11/d27/f104 x:0 0 0 2024-09-18T12:49:33.476 INFO:tasks.workunit.client.0.smithi078.stdout:1/724: dread - d0/d8/da/d3e/f72 zero size 2024-09-18T12:49:33.477 INFO:tasks.workunit.client.0.smithi078.stdout:9/808: dread d5/d7/d32/d2a/fd9 [0,4194304] 0 2024-09-18T12:49:33.477 INFO:tasks.workunit.client.0.smithi078.stdout:9/809: stat d5/d7/d8/d4f/ff3 0 2024-09-18T12:49:33.478 INFO:tasks.workunit.client.0.smithi078.stdout:1/725: write d0/d8/da/fbf [264693,116422] 0 2024-09-18T12:49:33.481 INFO:tasks.workunit.client.0.smithi078.stdout:3/690: rename d9/d54/f74 to d9/d13/d33/d3c/d19/fd7 0 2024-09-18T12:49:33.485 INFO:tasks.workunit.client.0.smithi078.stdout:8/774: link d0/d7/d1e/da9/f7a d0/db7/d62/f100 0 2024-09-18T12:49:33.486 INFO:tasks.workunit.client.0.smithi078.stdout:8/775: stat d0/d7/d1e/da9/f7a 0 2024-09-18T12:49:33.490 INFO:tasks.workunit.client.0.smithi078.stdout:1/726: truncate d0/d8/da/d3e/d50/d60/f9b 706131 0 2024-09-18T12:49:33.490 INFO:tasks.workunit.client.0.smithi078.stdout:6/986: dread d10/d2b/d43/dc3/d103/f8c [0,4194304] 0 2024-09-18T12:49:33.491 INFO:tasks.workunit.client.0.smithi078.stdout:1/727: write d0/d8/da/d3e/d58/d6e/f51 [2417817,77697] 0 2024-09-18T12:49:33.492 INFO:tasks.workunit.client.0.smithi078.stdout:3/691: rename d9/d13/d33/d4e/c88 to d9/d13/d33/d34/cd8 0 2024-09-18T12:49:33.492 INFO:tasks.workunit.client.0.smithi078.stdout:6/987: dread - d10/d2b/d43/d53/d63/f12a zero size 2024-09-18T12:49:33.496 INFO:tasks.workunit.client.0.smithi078.stdout:8/776: mkdir d0/d7/d53/d57/d67/d87/d101 0 2024-09-18T12:49:33.502 INFO:tasks.workunit.client.0.smithi078.stdout:9/810: truncate d5/d5c/f88 7648106 0 2024-09-18T12:49:33.505 INFO:tasks.workunit.client.0.smithi078.stdout:9/811: truncate d5/d7/d8/d4f/fbf 773561 0 2024-09-18T12:49:33.506 INFO:tasks.workunit.client.0.smithi078.stdout:8/777: creat d0/db7/d62/df2/f102 x:0 0 0 2024-09-18T12:49:33.509 INFO:tasks.workunit.client.0.smithi078.stdout:9/812: truncate d5/d7/d32/d2a/fd4 562915 0 2024-09-18T12:49:33.510 INFO:tasks.workunit.client.0.smithi078.stdout:3/692: dwrite d9/f27 [0,4194304] 0 2024-09-18T12:49:33.511 INFO:tasks.workunit.client.0.smithi078.stdout:9/813: stat d5/dc6/cfd 0 2024-09-18T12:49:33.515 INFO:tasks.workunit.client.0.smithi078.stdout:4/816: link d11/d27/d89/d9f/fa2 d11/d27/d47/d4e/d50/f105 0 2024-09-18T12:49:33.515 INFO:tasks.workunit.client.0.smithi078.stdout:1/728: getdents d0/d5b 0 2024-09-18T12:49:33.517 INFO:tasks.workunit.client.0.smithi078.stdout:8/778: rename d0/d7/dc/d71/d9b/faf to d0/d7/dc/d71/d9b/db6/f103 0 2024-09-18T12:49:33.517 INFO:tasks.workunit.client.0.smithi078.stdout:1/729: read d0/d8/da/d3e/d58/d6e/f5a [3113616,20238] 0 2024-09-18T12:49:33.520 INFO:tasks.workunit.client.0.smithi078.stdout:3/693: mkdir d9/d54/d7f/d9c/dd9 0 2024-09-18T12:49:33.525 INFO:tasks.workunit.client.0.smithi078.stdout:9/814: creat d5/d7/d8/d4f/f107 x:0 0 0 2024-09-18T12:49:33.525 INFO:tasks.workunit.client.0.smithi078.stdout:6/988: dread d10/d2b/d43/dc3/d103/d7d/fb5 [0,4194304] 0 2024-09-18T12:49:33.528 INFO:tasks.workunit.client.0.smithi078.stdout:1/730: dread d0/f19 [4194304,4194304] 0 2024-09-18T12:49:33.528 INFO:tasks.workunit.client.0.smithi078.stdout:8/779: symlink d0/d39/d4c/d77/d7d/d3e/l104 0 2024-09-18T12:49:33.531 INFO:tasks.workunit.client.0.smithi078.stdout:4/817: dwrite d11/d27/d5a/d84/f2b [8388608,4194304] 0 2024-09-18T12:49:33.533 INFO:tasks.workunit.client.0.smithi078.stdout:9/815: write d5/d7/d32/d2a/ff4 [322252,14738] 0 2024-09-18T12:49:33.542 INFO:tasks.workunit.client.0.smithi078.stdout:4/818: rmdir d11/d27/d47/d78/d95 39 2024-09-18T12:49:33.544 INFO:tasks.workunit.client.0.smithi078.stdout:9/816: creat d5/d40/f108 x:0 0 0 2024-09-18T12:49:33.545 INFO:tasks.workunit.client.0.smithi078.stdout:9/817: truncate d5/d7/d8/d98/fe4 599721 0 2024-09-18T12:49:33.546 INFO:tasks.workunit.client.0.smithi078.stdout:9/818: write d5/d7/d32/d2a/d68/d97/dc0/ffe [3465111,95323] 0 2024-09-18T12:49:33.547 INFO:tasks.workunit.client.0.smithi078.stdout:6/989: rename d10/d2b/d43/d53/d63/d6b/cb7 to d10/d2b/dfa/c14c 0 2024-09-18T12:49:33.549 INFO:tasks.workunit.client.0.smithi078.stdout:3/694: rmdir d9/d54/d6c/d90 0 2024-09-18T12:49:33.552 INFO:tasks.workunit.client.0.smithi078.stdout:0/838: sync 2024-09-18T12:49:33.554 INFO:tasks.workunit.client.0.smithi078.stdout:0/839: write d3/d1f/d2e/d4e/d37/d72/d96/ffa [140181,89165] 0 2024-09-18T12:49:33.555 INFO:tasks.workunit.client.0.smithi078.stdout:0/840: chown d3/d1f/d2e/d8f 129958 1 2024-09-18T12:49:33.559 INFO:tasks.workunit.client.0.smithi078.stdout:0/841: dread d3/f6c [4194304,4194304] 0 2024-09-18T12:49:33.559 INFO:tasks.workunit.client.0.smithi078.stdout:3/695: truncate d9/d29/f7d 526097 0 2024-09-18T12:49:33.561 INFO:tasks.workunit.client.0.smithi078.stdout:1/731: write d0/d8/f3f [358718,11458] 0 2024-09-18T12:49:33.566 INFO:tasks.workunit.client.0.smithi078.stdout:8/780: getdents d0/d7/dc 0 2024-09-18T12:49:33.567 INFO:tasks.workunit.client.0.smithi078.stdout:4/819: dread d11/d27/d47/f3d [0,4194304] 0 2024-09-18T12:49:33.568 INFO:tasks.workunit.client.0.smithi078.stdout:9/819: truncate d5/d7/d32/d2a/d68/d97/dc0/ffe 2225695 0 2024-09-18T12:49:33.569 INFO:tasks.workunit.client.0.smithi078.stdout:8/781: chown d0/d39/d4c/d77/dd7/lf4 255 1 2024-09-18T12:49:33.569 INFO:tasks.workunit.client.0.smithi078.stdout:6/990: dwrite d10/d2b/d43/dc3/d103/dac/fe3 [0,4194304] 0 2024-09-18T12:49:33.571 INFO:tasks.workunit.client.0.smithi078.stdout:8/782: chown d0/d7/f24 0 1 2024-09-18T12:49:33.572 INFO:tasks.workunit.client.0.smithi078.stdout:8/783: dread - d0/db7/d62/fd2 zero size 2024-09-18T12:49:33.572 INFO:tasks.workunit.client.0.smithi078.stdout:1/732: creat d0/d8/da/d3e/d58/ff7 x:0 0 0 2024-09-18T12:49:33.573 INFO:tasks.workunit.client.0.smithi078.stdout:8/784: dread - d0/d39/d4c/d77/fec zero size 2024-09-18T12:49:33.575 INFO:tasks.workunit.client.0.smithi078.stdout:3/696: creat d9/d54/d7f/d9c/dd9/fda x:0 0 0 2024-09-18T12:49:33.576 INFO:tasks.workunit.client.0.smithi078.stdout:9/820: symlink d5/d7/db3/de5/l109 0 2024-09-18T12:49:33.578 INFO:tasks.workunit.client.0.smithi078.stdout:4/820: creat d11/d27/d5a/d84/d4b/da7/dba/f106 x:0 0 0 2024-09-18T12:49:33.581 INFO:tasks.workunit.client.0.smithi078.stdout:0/842: dwrite d3/f5 [4194304,4194304] 0 2024-09-18T12:49:33.584 INFO:tasks.workunit.client.0.smithi078.stdout:3/697: dread d9/d29/f6d [0,4194304] 0 2024-09-18T12:49:33.585 INFO:tasks.workunit.client.0.smithi078.stdout:1/733: creat d0/d8/daa/db5/dc0/dcf/ff8 x:0 0 0 2024-09-18T12:49:33.587 INFO:tasks.workunit.client.0.smithi078.stdout:3/698: chown d9/d13/d33/d34/d97/f9b 11796384 1 2024-09-18T12:49:33.590 INFO:tasks.workunit.client.0.smithi078.stdout:8/785: truncate d0/d7/f2c 2769317 0 2024-09-18T12:49:33.592 INFO:tasks.workunit.client.0.smithi078.stdout:0/843: dwrite d3/d1f/d2e/d4e/d37/d72/d96/f9d [0,4194304] 0 2024-09-18T12:49:33.599 INFO:tasks.workunit.client.0.smithi078.stdout:8/786: creat d0/d39/f105 x:0 0 0 2024-09-18T12:49:33.602 INFO:tasks.workunit.client.0.smithi078.stdout:4/821: rename d11/d45/f103 to d11/d27/d5a/d84/d4b/f107 0 2024-09-18T12:49:33.604 INFO:tasks.workunit.client.0.smithi078.stdout:0/844: mkdir d3/d1f/d2e/d4e/d37/d72/ddd/d124 0 2024-09-18T12:49:33.604 INFO:tasks.workunit.client.0.smithi078.stdout:0/845: fsync d3/f123 0 2024-09-18T12:49:33.611 INFO:tasks.workunit.client.0.smithi078.stdout:6/991: dwrite d10/d2b/d43/f8f [0,4194304] 0 2024-09-18T12:49:33.615 INFO:tasks.workunit.client.0.smithi078.stdout:0/846: read d3/d1f/d2e/d4e/d37/d72/fae [8510,44589] 0 2024-09-18T12:49:33.617 INFO:tasks.workunit.client.0.smithi078.stdout:6/992: symlink d10/d2b/d43/dc3/d103/d7d/l14d 0 2024-09-18T12:49:33.621 INFO:tasks.workunit.client.0.smithi078.stdout:0/847: write d3/d1f/d2e/d8f/da1/fa2 [4628163,17898] 0 2024-09-18T12:49:33.622 INFO:tasks.workunit.client.0.smithi078.stdout:9/821: dwrite d5/d7/d8/f8f [0,4194304] 0 2024-09-18T12:49:33.628 INFO:tasks.workunit.client.0.smithi078.stdout:4/822: write d11/d45/f75 [446566,85477] 0 2024-09-18T12:49:33.628 INFO:tasks.workunit.client.0.smithi078.stdout:8/787: write d0/d7/dc/d1f/d23/f9a [1779454,128708] 0 2024-09-18T12:49:33.631 INFO:tasks.workunit.client.0.smithi078.stdout:0/848: truncate d3/f93 1712595 0 2024-09-18T12:49:33.631 INFO:tasks.workunit.client.0.smithi078.stdout:1/734: dwrite d0/d8/da/d3e/d58/d6e/d8c/d9d/db8/fc8 [4194304,4194304] 0 2024-09-18T12:49:33.634 INFO:tasks.workunit.client.0.smithi078.stdout:9/822: dread d5/d7/d32/d2a/f2d [0,4194304] 0 2024-09-18T12:49:33.634 INFO:tasks.workunit.client.0.smithi078.stdout:6/993: mkdir d10/d2b/d43/dc3/d103/d14e 0 2024-09-18T12:49:33.634 INFO:tasks.workunit.client.0.smithi078.stdout:3/699: dwrite d9/d13/d33/d4e/f75 [0,4194304] 0 2024-09-18T12:49:33.644 INFO:tasks.workunit.client.0.smithi078.stdout:4/823: mknod d11/d27/d5a/d84/d4b/da7/dba/dc1/c108 0 2024-09-18T12:49:33.644 INFO:tasks.workunit.client.0.smithi078.stdout:9/823: mkdir d5/dc6/d10a 0 2024-09-18T12:49:33.645 INFO:tasks.workunit.client.0.smithi078.stdout:3/700: creat d9/d13/d33/d34/d97/dc2/fdb x:0 0 0 2024-09-18T12:49:33.647 INFO:tasks.workunit.client.0.smithi078.stdout:6/994: truncate d10/d2b/d43/dc3/d103/d77/f91 4579161 0 2024-09-18T12:49:33.649 INFO:tasks.workunit.client.0.smithi078.stdout:0/849: creat d3/d1f/d2e/d4e/d37/f125 x:0 0 0 2024-09-18T12:49:33.650 INFO:tasks.workunit.client.0.smithi078.stdout:3/701: symlink d9/d29/ldc 0 2024-09-18T12:49:33.650 INFO:tasks.workunit.client.0.smithi078.stdout:1/735: dread d0/d5b/d6d/f7e [0,4194304] 0 2024-09-18T12:49:33.651 INFO:tasks.workunit.client.0.smithi078.stdout:6/995: chown d10/d2b/d43/d53/d63/d6b/da1/df2/c121 196 1 2024-09-18T12:49:33.651 INFO:tasks.workunit.client.0.smithi078.stdout:3/702: chown d9/d54/d6c 11 1 2024-09-18T12:49:33.652 INFO:tasks.workunit.client.0.smithi078.stdout:1/736: chown d0/d8/f3f 87820 1 2024-09-18T12:49:33.652 INFO:tasks.workunit.client.0.smithi078.stdout:3/703: stat d9/d13/f5f 0 2024-09-18T12:49:33.653 INFO:tasks.workunit.client.0.smithi078.stdout:4/824: link d11/d27/d5a/d84/l32 d11/d27/l109 0 2024-09-18T12:49:33.654 INFO:tasks.workunit.client.0.smithi078.stdout:3/704: rename d9/d13 to d9/d13/d33/d34/d97/ddd 22 2024-09-18T12:49:33.656 INFO:tasks.workunit.client.0.smithi078.stdout:6/996: symlink d10/d2b/d43/d53/l14f 0 2024-09-18T12:49:33.659 INFO:tasks.workunit.client.0.smithi078.stdout:6/997: chown d10/d2b/d43/da7/ce0 2992766 1 2024-09-18T12:49:33.660 INFO:tasks.workunit.client.0.smithi078.stdout:0/850: dwrite d3/d82/d10d/d7c/f10e [0,4194304] 0 2024-09-18T12:49:33.661 INFO:tasks.workunit.client.0.smithi078.stdout:4/825: write d11/d27/d5a/d84/d4b/da7/dba/dc1/fd6 [1668426,55442] 0 2024-09-18T12:49:33.661 INFO:tasks.workunit.client.0.smithi078.stdout:6/998: stat d10/d2b/d43/d101/f145 0 2024-09-18T12:49:33.665 INFO:tasks.workunit.client.0.smithi078.stdout:0/851: mknod d3/d1f/d2e/d4e/d37/d72/ddd/d124/c126 0 2024-09-18T12:49:33.667 INFO:tasks.workunit.client.0.smithi078.stdout:6/999: rename d10/d2b/d43/d53/fb3 to d10/d2b/d43/dc3/d103/d7d/dfd/f150 0 2024-09-18T12:49:33.673 INFO:tasks.workunit.client.0.smithi078.stdout:4/826: getdents d11/d27/d5a/d84/d4b/da7/dba/dd7 0 2024-09-18T12:49:33.676 INFO:tasks.workunit.client.0.smithi078.stdout:8/788: dwrite d0/d7/d53/f5e [0,4194304] 0 2024-09-18T12:49:33.679 INFO:tasks.workunit.client.0.smithi078.stdout:4/827: unlink d11/d27/d5a/d84/d4b/c9b 0 2024-09-18T12:49:33.682 INFO:tasks.workunit.client.0.smithi078.stdout:9/824: dwrite d5/d7/fea [0,4194304] 0 2024-09-18T12:49:33.684 INFO:tasks.workunit.client.0.smithi078.stdout:4/828: chown d11/d27/d5a/d84/d4b/da7/dba/dc1/cc3 2861 1 2024-09-18T12:49:33.691 INFO:tasks.workunit.client.0.smithi078.stdout:1/737: dwrite d0/d8/da/d3e/d58/d6e/d52/f2d [0,4194304] 0 2024-09-18T12:49:33.691 INFO:tasks.workunit.client.0.smithi078.stdout:0/852: truncate d3/d82/d10d/d7c/f10e 706019 0 2024-09-18T12:49:33.692 INFO:tasks.workunit.client.0.smithi078.stdout:3/705: dwrite d9/d13/f5f [0,4194304] 0 2024-09-18T12:49:33.700 INFO:tasks.workunit.client.0.smithi078.stdout:9/825: creat d5/d7/dbe/de8/df1/d103/f10b x:0 0 0 2024-09-18T12:49:33.704 INFO:tasks.workunit.client.0.smithi078.stdout:4/829: dwrite d11/d27/d47/d4e/fec [0,4194304] 0 2024-09-18T12:49:33.704 INFO:tasks.workunit.client.0.smithi078.stdout:1/738: write d0/d8/da/d3e/d58/d6e/d8c/dd3/ff3 [587270,70472] 0 2024-09-18T12:49:33.710 INFO:tasks.workunit.client.0.smithi078.stdout:3/706: rename d9/d54/d7f/d9c/dd9 to d9/d54/d89/d92/db6/dde 0 2024-09-18T12:49:33.714 INFO:tasks.workunit.client.0.smithi078.stdout:9/826: dwrite d5/dc6/feb [0,4194304] 0 2024-09-18T12:49:33.714 INFO:tasks.workunit.client.0.smithi078.stdout:8/789: dread d0/d7/d1e/d4b/f98 [0,4194304] 0 2024-09-18T12:49:33.729 INFO:tasks.workunit.client.0.smithi078.stdout:4/830: rename d11/d27/d5a/d84/d40/f58 to d11/d27/d47/d4e/daa/f10a 0 2024-09-18T12:49:33.731 INFO:tasks.workunit.client.0.smithi078.stdout:3/707: rmdir d9/d13/d33/d34/d97/dc2 39 2024-09-18T12:49:33.734 INFO:tasks.workunit.client.0.smithi078.stdout:1/739: fdatasync d0/d8/daa/db5/dc0/fdb 0 2024-09-18T12:49:33.742 INFO:tasks.workunit.client.0.smithi078.stdout:3/708: unlink d9/d13/d37/c57 0 2024-09-18T12:49:33.743 INFO:tasks.workunit.client.0.smithi078.stdout:3/709: dread - d9/d54/d7f/d9c/fc6 zero size 2024-09-18T12:49:33.748 INFO:tasks.workunit.client.0.smithi078.stdout:3/710: unlink d9/d13/d33/d4e/c99 0 2024-09-18T12:49:33.748 INFO:tasks.workunit.client.0.smithi078.stdout:8/790: write d0/d7/d53/d57/f96 [645411,36156] 0 2024-09-18T12:49:33.754 INFO:tasks.workunit.client.0.smithi078.stdout:9/827: dwrite d5/d7/d32/d2a/d6b/f95 [0,4194304] 0 2024-09-18T12:49:33.756 INFO:tasks.workunit.client.0.smithi078.stdout:8/791: mknod d0/d7/d1e/c106 0 2024-09-18T12:49:33.760 INFO:tasks.workunit.client.0.smithi078.stdout:3/711: dread d9/d54/d7f/d9c/fc3 [0,4194304] 0 2024-09-18T12:49:33.760 INFO:tasks.workunit.client.0.smithi078.stdout:4/831: dwrite d11/d27/d5a/d84/d4b/f82 [0,4194304] 0 2024-09-18T12:49:33.762 INFO:tasks.workunit.client.0.smithi078.stdout:8/792: chown d0/d7/d53/d57/d67/d87/cf7 30781 1 2024-09-18T12:49:33.763 INFO:tasks.workunit.client.0.smithi078.stdout:1/740: dwrite d0/d8/daa/db5/dc0/fdb [4194304,4194304] 0 2024-09-18T12:49:33.766 INFO:tasks.workunit.client.0.smithi078.stdout:1/741: chown d0/d8/f38 0 1 2024-09-18T12:49:33.773 INFO:tasks.workunit.client.0.smithi078.stdout:1/742: creat d0/d8/da/d3e/d58/d6e/d52/d47/de8/d7f/ff9 x:0 0 0 2024-09-18T12:49:33.775 INFO:tasks.workunit.client.0.smithi078.stdout:9/828: dwrite f0 [4194304,4194304] 0 2024-09-18T12:49:33.777 INFO:tasks.workunit.client.0.smithi078.stdout:3/712: mknod d9/d2f/d43/d62/cdf 0 2024-09-18T12:49:33.778 INFO:tasks.workunit.client.0.smithi078.stdout:8/793: link d0/d39/d4c/f8f d0/f107 0 2024-09-18T12:49:33.779 INFO:tasks.workunit.client.0.smithi078.stdout:1/743: creat d0/d8/da/d3e/d58/d6e/d52/d47/de8/d7f/ffa x:0 0 0 2024-09-18T12:49:33.781 INFO:tasks.workunit.client.0.smithi078.stdout:1/744: readlink d0/d8/da/d3e/d58/d6e/d52/d47/de8/lb4 0 2024-09-18T12:49:33.782 INFO:tasks.workunit.client.0.smithi078.stdout:8/794: mknod d0/d7/dc/d71/d9b/dc2/c108 0 2024-09-18T12:49:33.786 INFO:tasks.workunit.client.0.smithi078.stdout:4/832: write d11/d27/d47/f57 [1192752,41454] 0 2024-09-18T12:49:33.786 INFO:tasks.workunit.client.0.smithi078.stdout:8/795: symlink d0/d7/d53/l109 0 2024-09-18T12:49:33.788 INFO:tasks.workunit.client.0.smithi078.stdout:8/796: read - d0/d7/dc/d1f/d23/d40/ff3 zero size 2024-09-18T12:49:33.789 INFO:tasks.workunit.client.0.smithi078.stdout:8/797: write d0/d7/dc/d1f/d23/d40/ff3 [873249,33886] 0 2024-09-18T12:49:33.793 INFO:tasks.workunit.client.0.smithi078.stdout:9/829: truncate d5/f6c 104862 0 2024-09-18T12:49:33.795 INFO:tasks.workunit.client.0.smithi078.stdout:9/830: read d5/d7/d8/f27 [1947051,33945] 0 2024-09-18T12:49:33.796 INFO:tasks.workunit.client.0.smithi078.stdout:8/798: rename d0/d7/f4d to d0/d7/dc/d71/d9b/db6/f10a 0 2024-09-18T12:49:33.799 INFO:tasks.workunit.client.0.smithi078.stdout:4/833: creat d11/d27/d5a/d84/db0/f10b x:0 0 0 2024-09-18T12:49:33.800 INFO:tasks.workunit.client.0.smithi078.stdout:1/745: write d0/d8/da/d3e/d58/d6e/fa2 [882477,33620] 0 2024-09-18T12:49:33.802 INFO:tasks.workunit.client.0.smithi078.stdout:8/799: readlink d0/d39/d4c/d77/d7d/d3e/ld1 0 2024-09-18T12:49:33.802 INFO:tasks.workunit.client.0.smithi078.stdout:4/834: chown d11/d27/d47/c99 26301 1 2024-09-18T12:49:33.802 INFO:tasks.workunit.client.0.smithi078.stdout:9/831: dwrite d5/d7/d32/d2a/d36/fc2 [0,4194304] 0 2024-09-18T12:49:33.809 INFO:tasks.workunit.client.0.smithi078.stdout:8/800: rename d0/d7/dc/d1f/d23/d44 to d0/d39/d4c/d77/dd7/d10b 0 2024-09-18T12:49:33.812 INFO:tasks.workunit.client.0.smithi078.stdout:1/746: dread d0/d8/da/d45/fa6 [0,4194304] 0 2024-09-18T12:49:33.814 INFO:tasks.workunit.client.0.smithi078.stdout:4/835: rmdir d11/d27/d5a/d5d/dca 39 2024-09-18T12:49:33.816 INFO:tasks.workunit.client.0.smithi078.stdout:1/747: mknod d0/d8/da/d3e/d58/d6e/d52/d47/de8/dee/cfb 0 2024-09-18T12:49:33.818 INFO:tasks.workunit.client.0.smithi078.stdout:1/748: creat d0/d8/daa/ffc x:0 0 0 2024-09-18T12:49:33.818 INFO:tasks.workunit.client.0.smithi078.stdout:4/836: rmdir d11/d27/d5a/d5d/dca 39 2024-09-18T12:49:33.820 INFO:tasks.workunit.client.0.smithi078.stdout:1/749: rmdir d0/d8/da/d3e/d58/d6e/d8c/dd3 39 2024-09-18T12:49:33.823 INFO:tasks.workunit.client.0.smithi078.stdout:1/750: write d0/d8/da/d3e/d58/d6e/d52/d47/de8/f48 [2605983,19355] 0 2024-09-18T12:49:33.834 INFO:tasks.workunit.client.0.smithi078.stdout:1/751: dwrite d0/f19 [0,4194304] 0 2024-09-18T12:49:33.841 INFO:tasks.workunit.client.0.smithi078.stdout:4/837: dread d11/f1d [0,4194304] 0 2024-09-18T12:49:33.841 INFO:tasks.workunit.client.0.smithi078.stdout:1/752: dread d0/d8/daa/db5/dc0/fdb [4194304,4194304] 0 2024-09-18T12:49:33.847 INFO:tasks.workunit.client.0.smithi078.stdout:4/838: chown d11/d27/d60/la0 68703 1 2024-09-18T12:49:33.850 INFO:tasks.workunit.client.0.smithi078.stdout:4/839: creat d11/d45/f10c x:0 0 0 2024-09-18T12:49:33.851 INFO:tasks.workunit.client.0.smithi078.stdout:4/840: rmdir d11/d27/d47 39 2024-09-18T12:49:33.858 INFO:tasks.workunit.client.0.smithi078.stdout:1/753: write d0/d5b/d6d/f80 [4179292,56028] 0 2024-09-18T12:49:33.861 INFO:tasks.workunit.client.0.smithi078.stdout:1/754: creat d0/ffd x:0 0 0 2024-09-18T12:49:33.863 INFO:tasks.workunit.client.0.smithi078.stdout:1/755: truncate d0/d5b/d6d/dc2/fd5 1015382 0 2024-09-18T12:49:33.866 INFO:tasks.workunit.client.0.smithi078.stdout:1/756: mkdir d0/d8/da/d3e/d58/d6e/d52/d47/de8/dfe 0 2024-09-18T12:49:33.867 INFO:tasks.workunit.client.0.smithi078.stdout:1/757: stat d0/d8/da/d45/fde 0 2024-09-18T12:49:33.868 INFO:tasks.workunit.client.0.smithi078.stdout:4/841: truncate d11/f1d 1205480 0 2024-09-18T12:49:33.872 INFO:tasks.workunit.client.0.smithi078.stdout:4/842: mkdir d11/d10d 0 2024-09-18T12:49:33.880 INFO:tasks.workunit.client.0.smithi078.stdout:4/843: fsync d11/d27/d60/fcf 0 2024-09-18T12:49:33.893 INFO:tasks.workunit.client.0.smithi078.stdout:1/758: dwrite d0/d8/f2b [4194304,4194304] 0 2024-09-18T12:49:33.893 INFO:tasks.workunit.client.0.smithi078.stdout:4/844: dread d11/d27/d5a/d84/d40/f6f [0,4194304] 0 2024-09-18T12:49:33.921 INFO:tasks.workunit.client.0.smithi078.stdout:4/845: stat d11/d27/d47/d4e/d50/fbd 0 2024-09-18T12:49:33.928 INFO:tasks.workunit.client.0.smithi078.stdout:4/846: fdatasync d11/d27/d89/d9f/fa2 0 2024-09-18T12:49:33.957 INFO:tasks.workunit.client.0.smithi078.stdout:4/847: write d11/d27/d47/f49 [382653,17124] 0 2024-09-18T12:49:33.961 INFO:tasks.workunit.client.0.smithi078.stdout:4/848: mknod d11/d27/d5a/d5d/dca/c10e 0 2024-09-18T12:49:33.962 INFO:tasks.workunit.client.0.smithi078.stdout:4/849: write d11/d27/d5a/fe9 [702248,46081] 0 2024-09-18T12:49:33.963 INFO:tasks.workunit.client.0.smithi078.stdout:4/850: chown d11/d27/d5a/d84/d4b/da7/lae 610 1 2024-09-18T12:49:33.964 INFO:tasks.workunit.client.0.smithi078.stdout:4/851: chown d11/d27/d47/d78/laf 1 1 2024-09-18T12:49:33.967 INFO:tasks.workunit.client.0.smithi078.stdout:4/852: mknod d11/d27/d5a/d84/d4b/da7/dba/dd7/c10f 0 2024-09-18T12:49:33.972 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:33 smithi148 ceph-mon[35352]: pgmap v24: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 126 MiB/s rd, 278 MiB/s wr, 625 op/s 2024-09-18T12:49:33.978 INFO:tasks.workunit.client.0.smithi078.stdout:4/853: dwrite d11/f29 [0,4194304] 0 2024-09-18T12:49:33.980 INFO:tasks.workunit.client.0.smithi078.stdout:4/854: chown d11/d27/d5a/d84/d4b/l94 179226 1 2024-09-18T12:49:33.983 INFO:tasks.workunit.client.0.smithi078.stdout:4/855: rename d11/l30 to d11/d27/d47/d4e/l110 0 2024-09-18T12:49:33.984 INFO:tasks.workunit.client.0.smithi078.stdout:4/856: read d11/d27/d5a/d84/d4b/f82 [2016614,49505] 0 2024-09-18T12:49:33.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:33 smithi078 ceph-mon[28091]: pgmap v24: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 126 MiB/s rd, 278 MiB/s wr, 625 op/s 2024-09-18T12:49:34.003 INFO:tasks.workunit.client.0.smithi078.stdout:4/857: dwrite d11/d45/f8c [0,4194304] 0 2024-09-18T12:49:34.010 INFO:tasks.workunit.client.0.smithi078.stdout:4/858: fsync d11/d27/f2f 0 2024-09-18T12:49:34.016 INFO:tasks.workunit.client.0.smithi078.stdout:4/859: unlink d11/d27/d47/d4e/d50/cb8 0 2024-09-18T12:49:34.017 INFO:tasks.workunit.client.0.smithi078.stdout:4/860: dread - d11/d27/d5a/d84/db0/f10b zero size 2024-09-18T12:49:34.032 INFO:tasks.workunit.client.0.smithi078.stdout:4/861: dread d11/d27/d47/d4e/fc8 [0,4194304] 0 2024-09-18T12:49:34.036 INFO:tasks.workunit.client.0.smithi078.stdout:4/862: creat d11/d27/d47/d4e/d76/f111 x:0 0 0 2024-09-18T12:49:34.038 INFO:tasks.workunit.client.0.smithi078.stdout:4/863: write d11/f23 [86527,12112] 0 2024-09-18T12:49:34.039 INFO:tasks.workunit.client.0.smithi078.stdout:4/864: stat d11/d27/d47/c99 0 2024-09-18T12:49:34.040 INFO:tasks.workunit.client.0.smithi078.stdout:4/865: write d11/d27/d47/fe8 [352973,46668] 0 2024-09-18T12:49:34.041 INFO:tasks.workunit.client.0.smithi078.stdout:4/866: read - d11/d27/d5a/d84/d40/dc7/ff2 zero size 2024-09-18T12:49:34.048 INFO:tasks.workunit.client.0.smithi078.stdout:4/867: getdents d11/d27/d5a/d84/d4b/da7/dba/dd7 0 2024-09-18T12:49:34.060 INFO:tasks.workunit.client.0.smithi078.stdout:4/868: write d11/d27/d5a/d84/d4b/f82 [305934,15404] 0 2024-09-18T12:49:34.063 INFO:tasks.workunit.client.0.smithi078.stdout:4/869: fdatasync d11/d27/d5a/d84/d40/f8b 0 2024-09-18T12:49:34.067 INFO:tasks.workunit.client.0.smithi078.stdout:4/870: rmdir d11/d27/d47/d78 39 2024-09-18T12:49:34.069 INFO:tasks.workunit.client.0.smithi078.stdout:4/871: write d11/d27/d47/d4e/fc8 [3213326,27081] 0 2024-09-18T12:49:34.073 INFO:tasks.workunit.client.0.smithi078.stdout:4/872: mkdir d11/d27/d47/d4e/d112 0 2024-09-18T12:49:34.080 INFO:tasks.workunit.client.0.smithi078.stdout:4/873: rename d11/d27/d5a/d84/d4b/ff8 to d11/d27/d47/d4e/daa/f113 0 2024-09-18T12:49:34.080 INFO:tasks.workunit.client.0.smithi078.stdout:4/874: stat d11/d27/d89 0 2024-09-18T12:49:34.091 INFO:tasks.workunit.client.0.smithi078.stdout:4/875: dwrite d11/d27/d47/d4e/daa/f113 [0,4194304] 0 2024-09-18T12:49:34.091 INFO:tasks.workunit.client.0.smithi078.stdout:4/876: readlink d11/d27/d47/d4e/d50/l51 0 2024-09-18T12:49:34.092 INFO:tasks.workunit.client.0.smithi078.stdout:4/877: chown d11/d27/d5a/d84/d4b/f82 171 1 2024-09-18T12:49:34.097 INFO:tasks.workunit.client.0.smithi078.stdout:4/878: mkdir d11/d27/d5a/d84/d40/dc7/d114 0 2024-09-18T12:49:34.099 INFO:tasks.workunit.client.0.smithi078.stdout:4/879: mkdir d11/d27/d89/d9f/d115 0 2024-09-18T12:49:34.114 INFO:tasks.workunit.client.0.smithi078.stdout:4/880: write d11/d27/d47/d4e/f92 [602135,31722] 0 2024-09-18T12:49:34.119 INFO:tasks.workunit.client.0.smithi078.stdout:4/881: link d11/d27/d5a/d84/d40/f6f d11/d27/d5a/d84/d4b/da7/dba/dc4/f116 0 2024-09-18T12:49:34.132 INFO:tasks.workunit.client.0.smithi078.stdout:4/882: dread d11/d27/d5a/d84/d4b/da7/dba/dc4/dd0/ff3 [0,4194304] 0 2024-09-18T12:49:34.134 INFO:tasks.workunit.client.0.smithi078.stdout:4/883: symlink d11/d27/d5a/d84/d40/dc7/l117 0 2024-09-18T12:49:34.138 INFO:tasks.workunit.client.0.smithi078.stdout:4/884: symlink d11/d27/d5a/d5d/l118 0 2024-09-18T12:49:34.140 INFO:tasks.workunit.client.0.smithi078.stdout:4/885: unlink d11/d27/d60/la5 0 2024-09-18T12:49:34.143 INFO:tasks.workunit.client.0.smithi078.stdout:4/886: truncate d11/d27/d47/d4e/daa/fab 350963 0 2024-09-18T12:49:34.147 INFO:tasks.workunit.client.0.smithi078.stdout:4/887: creat d11/d27/d5a/d84/f119 x:0 0 0 2024-09-18T12:49:34.149 INFO:tasks.workunit.client.0.smithi078.stdout:7/684: sync 2024-09-18T12:49:34.149 INFO:tasks.workunit.client.0.smithi078.stdout:2/700: sync 2024-09-18T12:49:34.149 INFO:tasks.workunit.client.0.smithi078.stdout:4/888: truncate d11/d27/d47/f3d 4689629 0 2024-09-18T12:49:34.155 INFO:tasks.workunit.client.0.smithi078.stdout:4/889: mkdir d11/d27/d47/d78/d11a 0 2024-09-18T12:49:34.156 INFO:tasks.workunit.client.0.smithi078.stdout:4/890: write d11/d27/d47/f49 [189470,24423] 0 2024-09-18T12:49:34.162 INFO:tasks.workunit.client.0.smithi078.stdout:4/891: fdatasync d11/d27/d5a/d84/d40/f6f 0 2024-09-18T12:49:34.163 INFO:tasks.workunit.client.0.smithi078.stdout:4/892: write d11/d27/d89/def/ffa [325004,13692] 0 2024-09-18T12:49:34.164 INFO:tasks.workunit.client.0.smithi078.stdout:4/893: write d11/d27/d60/f68 [27397,100958] 0 2024-09-18T12:49:34.165 INFO:tasks.workunit.client.0.smithi078.stdout:4/894: read - d11/d45/f10c zero size 2024-09-18T12:49:34.170 INFO:tasks.workunit.client.0.smithi078.stdout:7/685: write d7/d9/d14/d22/d3e/d95/d97/f7f [1624903,59169] 0 2024-09-18T12:49:34.172 INFO:tasks.workunit.client.0.smithi078.stdout:7/686: write d7/d9/dd7/fa6 [11133878,78953] 0 2024-09-18T12:49:34.177 INFO:tasks.workunit.client.0.smithi078.stdout:2/701: dwrite d4/d8/d23/d52/d5f/d86/d3b/f58 [0,4194304] 0 2024-09-18T12:49:34.180 INFO:tasks.workunit.client.0.smithi078.stdout:7/687: write d7/d9/d14/fa9 [883749,125351] 0 2024-09-18T12:49:34.183 INFO:tasks.workunit.client.0.smithi078.stdout:2/702: fsync d4/db/dc/f1b 0 2024-09-18T12:49:34.189 INFO:tasks.workunit.client.0.smithi078.stdout:4/895: dwrite d11/d27/d5a/d84/f72 [4194304,4194304] 0 2024-09-18T12:49:34.191 INFO:tasks.workunit.client.0.smithi078.stdout:7/688: creat d7/d9/dd7/fee x:0 0 0 2024-09-18T12:49:34.193 INFO:tasks.workunit.client.0.smithi078.stdout:7/689: truncate d7/fd1 167601 0 2024-09-18T12:49:34.197 INFO:tasks.workunit.client.0.smithi078.stdout:2/703: dwrite d4/d8/d23/d52/fcc [0,4194304] 0 2024-09-18T12:49:34.200 INFO:tasks.workunit.client.0.smithi078.stdout:7/690: rename d7/fa to d7/d9/dd7/d3b/fef 0 2024-09-18T12:49:34.201 INFO:tasks.workunit.client.0.smithi078.stdout:4/896: link d11/d27/d60/la1 d11/d27/d5a/d84/d4b/da7/dba/l11b 0 2024-09-18T12:49:34.207 INFO:tasks.workunit.client.0.smithi078.stdout:7/691: rename d7/d5d/d7a/l72 to d7/d26/d84/lf0 0 2024-09-18T12:49:34.208 INFO:tasks.workunit.client.0.smithi078.stdout:4/897: mkdir d11/d27/d89/d9f/d115/d11c 0 2024-09-18T12:49:34.211 INFO:tasks.workunit.client.0.smithi078.stdout:7/692: rename d7/d9/d14/d22/d3e/c6e to d7/d9/d14/d22/d35/cf1 0 2024-09-18T12:49:34.213 INFO:tasks.workunit.client.0.smithi078.stdout:7/693: chown d7/d9/d14/d22/d35/d49/d61/d7b 0 1 2024-09-18T12:49:34.213 INFO:tasks.workunit.client.0.smithi078.stdout:7/694: readlink l1 0 2024-09-18T12:49:34.213 INFO:tasks.workunit.client.0.smithi078.stdout:4/898: creat d11/d27/d5a/d84/d40/dc7/d114/f11d x:0 0 0 2024-09-18T12:49:34.214 INFO:tasks.workunit.client.0.smithi078.stdout:7/695: read d7/d9/d14/d22/d3e/d95/d97/f71 [2298774,74783] 0 2024-09-18T12:49:34.216 INFO:tasks.workunit.client.0.smithi078.stdout:7/696: read - d7/d9/d4d/d9a/fd3 zero size 2024-09-18T12:49:34.219 INFO:tasks.workunit.client.0.smithi078.stdout:7/697: readlink d7/d9/d14/d22/d35/d49/d56/d8d/led 0 2024-09-18T12:49:34.221 INFO:tasks.workunit.client.0.smithi078.stdout:4/899: dwrite d11/d27/d89/d9f/f102 [0,4194304] 0 2024-09-18T12:49:34.227 INFO:tasks.workunit.client.0.smithi078.stdout:4/900: mknod d11/d27/d5a/d84/d4b/da7/dba/dc4/c11e 0 2024-09-18T12:49:34.229 INFO:tasks.workunit.client.0.smithi078.stdout:2/704: dwrite d4/db/f6f [0,4194304] 0 2024-09-18T12:49:34.236 INFO:tasks.workunit.client.0.smithi078.stdout:7/698: dread f5 [0,4194304] 0 2024-09-18T12:49:34.242 INFO:tasks.workunit.client.0.smithi078.stdout:4/901: rename d11/d27/l4d to d11/d27/d47/d4e/daa/l11f 0 2024-09-18T12:49:34.244 INFO:tasks.workunit.client.0.smithi078.stdout:7/699: truncate d7/d9/d4d/d9a/fd3 393265 0 2024-09-18T12:49:34.245 INFO:tasks.workunit.client.0.smithi078.stdout:4/902: symlink d11/d27/d5a/d84/d40/dc7/d114/l120 0 2024-09-18T12:49:34.251 INFO:tasks.workunit.client.0.smithi078.stdout:4/903: dwrite d11/d27/d5a/fe9 [0,4194304] 0 2024-09-18T12:49:34.259 INFO:tasks.workunit.client.0.smithi078.stdout:4/904: link d11/d27/d47/fa4 d11/d27/d47/f121 0 2024-09-18T12:49:34.263 INFO:tasks.workunit.client.0.smithi078.stdout:4/905: creat d11/d10d/f122 x:0 0 0 2024-09-18T12:49:34.265 INFO:tasks.workunit.client.0.smithi078.stdout:2/705: truncate d4/db/dc/fc1 31422 0 2024-09-18T12:49:34.270 INFO:tasks.workunit.client.0.smithi078.stdout:2/706: symlink d4/d8/d23/d52/d5f/d86/lde 0 2024-09-18T12:49:34.272 INFO:tasks.workunit.client.0.smithi078.stdout:4/906: getdents d11/d27/d47/d4e/daa 0 2024-09-18T12:49:34.273 INFO:tasks.workunit.client.0.smithi078.stdout:7/700: dwrite d7/d5d/f74 [0,4194304] 0 2024-09-18T12:49:34.275 INFO:tasks.workunit.client.0.smithi078.stdout:2/707: creat d4/db/dd8/fdf x:0 0 0 2024-09-18T12:49:34.277 INFO:tasks.workunit.client.0.smithi078.stdout:4/907: dread d11/d27/d60/fcf [0,4194304] 0 2024-09-18T12:49:34.279 INFO:tasks.workunit.client.0.smithi078.stdout:2/708: unlink d4/cbb 0 2024-09-18T12:49:34.282 INFO:tasks.workunit.client.0.smithi078.stdout:2/709: write d4/db/dc/f62 [758460,3933] 0 2024-09-18T12:49:34.287 INFO:tasks.workunit.client.0.smithi078.stdout:2/710: symlink d4/db/dc/le0 0 2024-09-18T12:49:34.290 INFO:tasks.workunit.client.0.smithi078.stdout:4/908: getdents d11/d27/d5a/d84/d4b/da7/dba/dc4/dd0 0 2024-09-18T12:49:34.292 INFO:tasks.workunit.client.0.smithi078.stdout:2/711: unlink d4/dd/fa1 0 2024-09-18T12:49:34.293 INFO:tasks.workunit.client.0.smithi078.stdout:7/701: write d7/d9/d14/f23 [544512,28557] 0 2024-09-18T12:49:34.302 INFO:tasks.workunit.client.0.smithi078.stdout:7/702: creat d7/d9/d14/d22/d35/d49/d61/d7b/ff2 x:0 0 0 2024-09-18T12:49:34.304 INFO:tasks.workunit.client.0.smithi078.stdout:4/909: link d11/d27/d5a/d84/d4b/da7/dba/dc4/f116 d11/d27/d5a/d84/d40/dc7/f123 0 2024-09-18T12:49:34.304 INFO:tasks.workunit.client.0.smithi078.stdout:2/712: write d4/f5 [711698,119139] 0 2024-09-18T12:49:34.306 INFO:tasks.workunit.client.0.smithi078.stdout:4/910: mkdir d11/d45/d124 0 2024-09-18T12:49:34.307 INFO:tasks.workunit.client.0.smithi078.stdout:7/703: mknod d7/cf3 0 2024-09-18T12:49:34.312 INFO:tasks.workunit.client.0.smithi078.stdout:4/911: dread d11/d27/d47/d4e/daa/f113 [0,4194304] 0 2024-09-18T12:49:34.314 INFO:tasks.workunit.client.0.smithi078.stdout:7/704: rename d7/d5d/d87/fb6 to d7/d9/d14/dde/ff4 0 2024-09-18T12:49:34.320 INFO:tasks.workunit.client.0.smithi078.stdout:4/912: dwrite d11/d27/d5a/d84/d4b/da7/dba/f106 [0,4194304] 0 2024-09-18T12:49:34.325 INFO:tasks.workunit.client.0.smithi078.stdout:4/913: unlink d11/f12 0 2024-09-18T12:49:34.326 INFO:tasks.workunit.client.0.smithi078.stdout:2/713: dwrite d4/d8/d23/d52/d5f/d86/f7a [0,4194304] 0 2024-09-18T12:49:34.332 INFO:tasks.workunit.client.0.smithi078.stdout:7/705: dwrite d7/d3f/f6a [0,4194304] 0 2024-09-18T12:49:34.338 INFO:tasks.workunit.client.0.smithi078.stdout:7/706: unlink d7/d9/d14/d22/d35/d49/d56/d8d/led 0 2024-09-18T12:49:34.339 INFO:tasks.workunit.client.0.smithi078.stdout:7/707: write d7/d5d/d7a/f4a [5118876,21033] 0 2024-09-18T12:49:34.341 INFO:tasks.workunit.client.0.smithi078.stdout:7/708: rmdir d7/d9/dd7/d3b/dc0 39 2024-09-18T12:49:34.345 INFO:tasks.workunit.client.0.smithi078.stdout:7/709: mkdir d7/d9/d14/d22/d35/d49/df5 0 2024-09-18T12:49:34.350 INFO:tasks.workunit.client.0.smithi078.stdout:7/710: symlink d7/d9/d14/d22/d3e/d95/db2/dcb/lf6 0 2024-09-18T12:49:34.354 INFO:tasks.workunit.client.0.smithi078.stdout:2/714: dwrite d4/d8/f37 [0,4194304] 0 2024-09-18T12:49:34.358 INFO:tasks.workunit.client.0.smithi078.stdout:4/914: dread d11/d27/d5a/d84/d4b/da7/dba/dc1/fed [0,4194304] 0 2024-09-18T12:49:34.362 INFO:tasks.workunit.client.0.smithi078.stdout:2/715: rename d4/d1a/fcd to d4/db/dd8/fe1 0 2024-09-18T12:49:34.363 INFO:tasks.workunit.client.0.smithi078.stdout:7/711: getdents d7/d9/d14/d22/d35/d49/d61/d89 0 2024-09-18T12:49:34.371 INFO:tasks.workunit.client.0.smithi078.stdout:2/716: dread d4/d8/d6c/d70/fa3 [0,4194304] 0 2024-09-18T12:49:34.371 INFO:tasks.workunit.client.0.smithi078.stdout:4/915: rmdir d11/d27/d89/def 39 2024-09-18T12:49:34.372 INFO:tasks.workunit.client.0.smithi078.stdout:4/916: chown d11/d27/d60/f68 267045 1 2024-09-18T12:49:34.374 INFO:tasks.workunit.client.0.smithi078.stdout:7/712: getdents d7/d9/d14/d22/d3e/d95/d97 0 2024-09-18T12:49:34.374 INFO:tasks.workunit.client.0.smithi078.stdout:4/917: read d11/fc5 [135865,122875] 0 2024-09-18T12:49:34.375 INFO:tasks.workunit.client.0.smithi078.stdout:7/713: chown d7/d5d/d7a/c58 7 1 2024-09-18T12:49:34.376 INFO:tasks.workunit.client.0.smithi078.stdout:2/717: rename d4/d8/d23/d52/d5f/d86/d3b/l3e to d4/d8/d6c/d70/le2 0 2024-09-18T12:49:34.377 INFO:tasks.workunit.client.0.smithi078.stdout:4/918: dread - d11/d27/fff zero size 2024-09-18T12:49:34.380 INFO:tasks.workunit.client.0.smithi078.stdout:2/718: creat d4/d8/d23/d52/d5f/d81/dac/fe3 x:0 0 0 2024-09-18T12:49:34.382 INFO:tasks.workunit.client.0.smithi078.stdout:7/714: rename d7/d9/d4d/d9a/fd3 to d7/d9/d14/d22/d35/d49/d56/ff7 0 2024-09-18T12:49:34.390 INFO:tasks.workunit.client.0.smithi078.stdout:2/719: link d4/d8/d23/d52/l89 d4/db/dc/le4 0 2024-09-18T12:49:34.414 INFO:tasks.workunit.client.0.smithi078.stdout:7/715: rename d7/d5d/d87/ca2 to d7/d9/d4d/cf8 0 2024-09-18T12:49:34.415 INFO:tasks.workunit.client.0.smithi078.stdout:7/716: chown d7/d9/l43 75 1 2024-09-18T12:49:34.415 INFO:tasks.workunit.client.0.smithi078.stdout:2/720: creat d4/fe5 x:0 0 0 2024-09-18T12:49:34.415 INFO:tasks.workunit.client.0.smithi078.stdout:4/919: dwrite d11/f93 [0,4194304] 0 2024-09-18T12:49:34.418 INFO:tasks.workunit.client.0.smithi078.stdout:7/717: write d7/d9/f13 [4021417,130238] 0 2024-09-18T12:49:34.421 INFO:tasks.workunit.client.0.smithi078.stdout:4/920: unlink d11/d27/d5a/d84/d4b/da7/dba/dc1/c108 0 2024-09-18T12:49:34.426 INFO:tasks.workunit.client.0.smithi078.stdout:2/721: dwrite d4/d8/d23/d52/d5f/d86/d33/f72 [4194304,4194304] 0 2024-09-18T12:49:34.427 INFO:tasks.workunit.client.0.smithi078.stdout:7/718: creat d7/d9/d14/d22/d3e/d95/ff9 x:0 0 0 2024-09-18T12:49:34.428 INFO:tasks.workunit.client.0.smithi078.stdout:4/921: readlink d11/d27/l7f 0 2024-09-18T12:49:34.429 INFO:tasks.workunit.client.0.smithi078.stdout:2/722: mknod d4/db/d45/ce6 0 2024-09-18T12:49:34.430 INFO:tasks.workunit.client.0.smithi078.stdout:7/719: write d7/d26/f30 [1978879,33534] 0 2024-09-18T12:49:34.431 INFO:tasks.workunit.client.0.smithi078.stdout:7/720: stat d7/d9/d14/d22/d35/fc8 0 2024-09-18T12:49:34.432 INFO:tasks.workunit.client.0.smithi078.stdout:2/723: dread - d4/d8/d23/d52/d5f/d86/d3b/d4f/fca zero size 2024-09-18T12:49:34.444 INFO:tasks.workunit.client.0.smithi078.stdout:7/721: write d7/d9/d14/d22/d35/d49/d56/f78 [103221,64391] 0 2024-09-18T12:49:34.447 INFO:tasks.workunit.client.0.smithi078.stdout:7/722: fsync d7/d9/d14/d22/d3e/f5b 0 2024-09-18T12:49:34.451 INFO:tasks.workunit.client.0.smithi078.stdout:4/922: dwrite d11/d27/d5a/d84/d40/f6f [0,4194304] 0 2024-09-18T12:49:34.452 INFO:tasks.workunit.client.0.smithi078.stdout:2/724: dwrite d4/d8/f78 [0,4194304] 0 2024-09-18T12:49:34.455 INFO:tasks.workunit.client.0.smithi078.stdout:7/723: symlink d7/d9/d14/d22/d35/lfa 0 2024-09-18T12:49:34.458 INFO:tasks.workunit.client.0.smithi078.stdout:4/923: readlink d11/l1b 0 2024-09-18T12:49:34.461 INFO:tasks.workunit.client.0.smithi078.stdout:7/724: creat d7/d5d/d87/ffb x:0 0 0 2024-09-18T12:49:34.461 INFO:tasks.workunit.client.0.smithi078.stdout:4/924: chown d11/d27/d5a/d84/d4b/da7/dba/dc4/dd0/lee 3663995 1 2024-09-18T12:49:34.462 INFO:tasks.workunit.client.0.smithi078.stdout:7/725: dread - d7/d9/d4d/d9a/fba zero size 2024-09-18T12:49:34.462 INFO:tasks.workunit.client.0.smithi078.stdout:2/725: creat d4/d1a/fe7 x:0 0 0 2024-09-18T12:49:34.463 INFO:tasks.workunit.client.0.smithi078.stdout:4/925: fsync d11/d27/d5a/d84/d40/dc7/ff2 0 2024-09-18T12:49:34.464 INFO:tasks.workunit.client.0.smithi078.stdout:7/726: stat d7/d9/d4d/de2/le4 0 2024-09-18T12:49:34.465 INFO:tasks.workunit.client.0.smithi078.stdout:2/726: symlink d4/d8/d23/d52/d5f/le8 0 2024-09-18T12:49:34.467 INFO:tasks.workunit.client.0.smithi078.stdout:7/727: mknod d7/d9/d4d/de2/cfc 0 2024-09-18T12:49:34.469 INFO:tasks.workunit.client.0.smithi078.stdout:2/727: read d4/d8/d23/d52/d5f/d86/d3b/d4f/f61 [1085599,94639] 0 2024-09-18T12:49:34.469 INFO:tasks.workunit.client.0.smithi078.stdout:4/926: rename d11/d27/d60/fcf to d11/d27/d47/d4e/d112/f125 0 2024-09-18T12:49:34.471 INFO:tasks.workunit.client.0.smithi078.stdout:7/728: mknod d7/d26/d4f/cfd 0 2024-09-18T12:49:34.473 INFO:tasks.workunit.client.0.smithi078.stdout:4/927: rmdir d11/d27/d5a/d84/d4b/da7/dba/dc4 39 2024-09-18T12:49:34.473 INFO:tasks.workunit.client.0.smithi078.stdout:7/729: write d7/d5d/f6d [3212672,91983] 0 2024-09-18T12:49:34.477 INFO:tasks.workunit.client.0.smithi078.stdout:2/728: unlink d4/dd/l93 0 2024-09-18T12:49:34.483 INFO:tasks.workunit.client.0.smithi078.stdout:4/928: truncate d11/f55 4587167 0 2024-09-18T12:49:34.486 INFO:tasks.workunit.client.0.smithi078.stdout:2/729: dwrite d4/db/d45/dbc/fbe [0,4194304] 0 2024-09-18T12:49:34.487 INFO:tasks.workunit.client.0.smithi078.stdout:7/730: dwrite d7/f65 [4194304,4194304] 0 2024-09-18T12:49:34.490 INFO:tasks.workunit.client.0.smithi078.stdout:2/730: truncate d4/d8/f50 938511 0 2024-09-18T12:49:34.492 INFO:tasks.workunit.client.0.smithi078.stdout:4/929: creat d11/f126 x:0 0 0 2024-09-18T12:49:34.497 INFO:tasks.workunit.client.0.smithi078.stdout:4/930: creat d11/d10d/f127 x:0 0 0 2024-09-18T12:49:34.500 INFO:tasks.workunit.client.0.smithi078.stdout:4/931: rmdir d11/d27/d89/d9f 39 2024-09-18T12:49:34.504 INFO:tasks.workunit.client.0.smithi078.stdout:4/932: rename d11/d27/d5a/c66 to d11/d27/d5a/d84/d4b/da7/dba/dc1/c128 0 2024-09-18T12:49:34.507 INFO:tasks.workunit.client.0.smithi078.stdout:4/933: write d11/d27/d5a/d84/d4b/da7/dba/dc1/fed [483668,19296] 0 2024-09-18T12:49:34.511 INFO:tasks.workunit.client.0.smithi078.stdout:2/731: write d4/f69 [475186,94905] 0 2024-09-18T12:49:34.514 INFO:tasks.workunit.client.0.smithi078.stdout:7/731: truncate d7/d5d/d7a/d62/fa7 5002823 0 2024-09-18T12:49:34.514 INFO:tasks.workunit.client.0.smithi078.stdout:4/934: dwrite d11/d27/d89/fcb [0,4194304] 0 2024-09-18T12:49:34.517 INFO:tasks.workunit.client.0.smithi078.stdout:2/732: creat d4/d8/d23/d52/d5f/d81/dac/fe9 x:0 0 0 2024-09-18T12:49:34.523 INFO:tasks.workunit.client.0.smithi078.stdout:4/935: symlink d11/d27/d5a/d84/d4b/da7/dba/dc1/l129 0 2024-09-18T12:49:34.524 INFO:tasks.workunit.client.0.smithi078.stdout:7/732: mknod d7/d9/d4d/cfe 0 2024-09-18T12:49:34.527 INFO:tasks.workunit.client.0.smithi078.stdout:4/936: fsync d11/d27/f2f 0 2024-09-18T12:49:34.543 INFO:tasks.workunit.client.0.smithi078.stdout:4/937: write d11/d27/d47/f3f [8966635,54384] 0 2024-09-18T12:49:34.548 INFO:tasks.workunit.client.0.smithi078.stdout:7/733: dwrite d7/d9/dd7/fa0 [0,4194304] 0 2024-09-18T12:49:34.550 INFO:tasks.workunit.client.0.smithi078.stdout:4/938: dread d11/f29 [0,4194304] 0 2024-09-18T12:49:34.554 INFO:tasks.workunit.client.0.smithi078.stdout:4/939: symlink d11/d27/d5a/d84/d4b/da7/dba/dd7/l12a 0 2024-09-18T12:49:34.557 INFO:tasks.workunit.client.0.smithi078.stdout:7/734: mkdir d7/d9/d4d/dff 0 2024-09-18T12:49:34.560 INFO:tasks.workunit.client.0.smithi078.stdout:4/940: fsync d11/f23 0 2024-09-18T12:49:34.563 INFO:tasks.workunit.client.0.smithi078.stdout:4/941: rmdir d11/d27/d5a/d84/d4b/da7/dba 39 2024-09-18T12:49:34.564 INFO:tasks.workunit.client.0.smithi078.stdout:4/942: truncate d11/d27/d47/fd1 1136304 0 2024-09-18T12:49:34.566 INFO:tasks.workunit.client.0.smithi078.stdout:7/735: link d7/cf3 d7/d9/d14/d22/d3e/dc9/c100 0 2024-09-18T12:49:34.581 INFO:tasks.workunit.client.0.smithi078.stdout:7/736: truncate d7/d9/f1f 2651550 0 2024-09-18T12:49:34.582 INFO:tasks.workunit.client.0.smithi078.stdout:4/943: truncate d11/d27/d5a/d84/d4b/da7/dba/dc4/f116 2833123 0 2024-09-18T12:49:34.583 INFO:tasks.workunit.client.0.smithi078.stdout:4/944: dread - d11/d10d/f127 zero size 2024-09-18T12:49:34.584 INFO:tasks.workunit.client.0.smithi078.stdout:4/945: dread - d11/d27/d5a/d84/d40/dc7/fce zero size 2024-09-18T12:49:34.770 INFO:tasks.workunit.client.0.smithi078.stdout:0/853: sync 2024-09-18T12:49:34.771 INFO:tasks.workunit.client.0.smithi078.stdout:0/854: stat d3/d1f/d2e/d8f/d90/c10f 0 2024-09-18T12:49:34.777 INFO:tasks.workunit.client.0.smithi078.stdout:0/855: getdents d3/d1f/d2e/d68 0 2024-09-18T12:49:34.780 INFO:tasks.workunit.client.0.smithi078.stdout:0/856: symlink d3/d43/l127 0 2024-09-18T12:49:34.783 INFO:tasks.workunit.client.0.smithi078.stdout:0/857: fsync d3/d1f/fb8 0 2024-09-18T12:49:34.795 INFO:tasks.workunit.client.0.smithi078.stdout:0/858: dwrite d3/fd2 [0,4194304] 0 2024-09-18T12:49:34.797 INFO:tasks.workunit.client.0.smithi078.stdout:0/859: truncate d3/d82/d10d/d7c/da3/de2/ff6 1459450 0 2024-09-18T12:49:34.802 INFO:tasks.workunit.client.0.smithi078.stdout:0/860: rename d3/d1f/d2e/d8f/d90 to d3/d1f/d2e/d68/dc9/dcd/d128 0 2024-09-18T12:49:34.821 INFO:tasks.workunit.client.0.smithi078.stdout:0/861: dread d3/f47 [0,4194304] 0 2024-09-18T12:49:34.940 INFO:tasks.workunit.client.0.smithi078.stdout:9/832: sync 2024-09-18T12:49:34.940 INFO:tasks.workunit.client.0.smithi078.stdout:3/713: sync 2024-09-18T12:49:34.947 INFO:tasks.workunit.client.0.smithi078.stdout:3/714: dwrite d9/d54/f8e [0,4194304] 0 2024-09-18T12:49:35.043 INFO:tasks.workunit.client.0.smithi078.stdout:9/833: creat d5/d7/d8/f10c x:0 0 0 2024-09-18T12:49:35.045 INFO:tasks.workunit.client.0.smithi078.stdout:9/834: symlink d5/d7/d32/d2a/l10d 0 2024-09-18T12:49:35.048 INFO:tasks.workunit.client.0.smithi078.stdout:9/835: creat d5/d7/d32/d2a/d68/db0/f10e x:0 0 0 2024-09-18T12:49:35.051 INFO:tasks.workunit.client.0.smithi078.stdout:9/836: truncate d5/d7/d8/d4f/f76 1350003 0 2024-09-18T12:49:35.094 INFO:tasks.workunit.client.0.smithi078.stdout:8/801: sync 2024-09-18T12:49:35.114 INFO:tasks.workunit.client.0.smithi078.stdout:8/802: dread d0/d39/d4c/d77/fb5 [0,4194304] 0 2024-09-18T12:49:35.121 INFO:tasks.workunit.client.0.smithi078.stdout:8/803: link d0/d39/d4c/d77/d7d/lb3 d0/d7/d53/d57/d67/d87/d101/l10c 0 2024-09-18T12:49:35.125 INFO:tasks.workunit.client.0.smithi078.stdout:3/715: rename d9/d2f/d43/fbb to d9/d54/d7f/dae/dd4/fe0 0 2024-09-18T12:49:35.129 INFO:tasks.workunit.client.0.smithi078.stdout:3/716: chown d9/d13/d33/d34/d97/lc0 130652 1 2024-09-18T12:49:35.130 INFO:tasks.workunit.client.0.smithi078.stdout:3/717: fdatasync d9/d13/d33/d34/f4f 0 2024-09-18T12:49:35.133 INFO:tasks.workunit.client.0.smithi078.stdout:9/837: rename d5/d7/d32/d2a/d6b/f5d to d5/d7/d8/d98/f10f 0 2024-09-18T12:49:35.134 INFO:tasks.workunit.client.0.smithi078.stdout:9/838: readlink d5/d7/d32/d2a/l10d 0 2024-09-18T12:49:35.136 INFO:tasks.workunit.client.0.smithi078.stdout:3/718: creat d9/d13/d33/d34/fe1 x:0 0 0 2024-09-18T12:49:35.138 INFO:tasks.workunit.client.0.smithi078.stdout:9/839: mkdir d5/d7/db3/de5/d110 0 2024-09-18T12:49:35.145 INFO:tasks.workunit.client.0.smithi078.stdout:8/804: dread d0/d7/dc/d1f/d23/f9a [0,4194304] 0 2024-09-18T12:49:35.146 INFO:tasks.workunit.client.0.smithi078.stdout:3/719: link d9/d13/d63/fc1 d9/d13/d33/d34/d9e/fe2 0 2024-09-18T12:49:35.154 INFO:tasks.workunit.client.0.smithi078.stdout:8/805: rename d0/d39/d4c/d77/d7d/d3e/c65 to d0/d7/d1e/d50/c10d 0 2024-09-18T12:49:35.155 INFO:tasks.workunit.client.0.smithi078.stdout:8/806: readlink d0/d7/dc/d1f/lc7 0 2024-09-18T12:49:35.163 INFO:tasks.workunit.client.0.smithi078.stdout:8/807: link d0/d7/dc/d1f/l59 d0/d7/d53/db0/l10e 0 2024-09-18T12:49:35.165 INFO:tasks.workunit.client.0.smithi078.stdout:8/808: creat d0/db7/f10f x:0 0 0 2024-09-18T12:49:35.168 INFO:tasks.workunit.client.0.smithi078.stdout:3/720: dread d9/df/fa9 [0,4194304] 0 2024-09-18T12:49:35.172 INFO:tasks.workunit.client.0.smithi078.stdout:8/809: link d0/d7/d53/d57/d5c/cca d0/d7/d1e/da9/d6d/c110 0 2024-09-18T12:49:35.178 INFO:tasks.workunit.client.0.smithi078.stdout:8/810: creat d0/d7/dc/d5d/f111 x:0 0 0 2024-09-18T12:49:35.181 INFO:tasks.workunit.client.0.smithi078.stdout:9/840: dwrite d5/d7/db1/ff5 [0,4194304] 0 2024-09-18T12:49:35.182 INFO:tasks.workunit.client.0.smithi078.stdout:9/841: chown d5/d7/d32/fdb 1 1 2024-09-18T12:49:35.185 INFO:tasks.workunit.client.0.smithi078.stdout:9/842: symlink d5/d7/d32/l111 0 2024-09-18T12:49:35.190 INFO:tasks.workunit.client.0.smithi078.stdout:3/721: truncate d9/d2f/fbd 118177 0 2024-09-18T12:49:35.191 INFO:tasks.workunit.client.0.smithi078.stdout:3/722: readlink d9/d2f/d43/l94 0 2024-09-18T12:49:35.196 INFO:tasks.workunit.client.0.smithi078.stdout:9/843: getdents d5/d7/d32/d2a/d36 0 2024-09-18T12:49:35.197 INFO:tasks.workunit.client.0.smithi078.stdout:3/723: creat d9/d13/d33/d34/d97/dc2/fe3 x:0 0 0 2024-09-18T12:49:35.197 INFO:tasks.workunit.client.0.smithi078.stdout:3/724: stat d9/d54/fb4 0 2024-09-18T12:49:35.199 INFO:tasks.workunit.client.0.smithi078.stdout:9/844: rename d5/d7/d32/d2a/f2e to d5/d7/d32/d2a/d68/db0/f112 0 2024-09-18T12:49:35.202 INFO:tasks.workunit.client.0.smithi078.stdout:3/725: rename d9/df/fa9 to d9/d13/d33/d34/d97/dc2/fe4 0 2024-09-18T12:49:35.203 INFO:tasks.workunit.client.0.smithi078.stdout:9/845: unlink d5/d7/d8/f27 0 2024-09-18T12:49:35.208 INFO:tasks.workunit.client.0.smithi078.stdout:9/846: rename d5/d7/d32/d2a/d36/l53 to d5/d7/d32/d2a/d68/d97/l113 0 2024-09-18T12:49:35.209 INFO:tasks.workunit.client.0.smithi078.stdout:3/726: link d9/d2f/f70 d9/d54/d89/fe5 0 2024-09-18T12:49:35.209 INFO:tasks.workunit.client.0.smithi078.stdout:9/847: chown d5/d7/d8/d98/fe4 2048275 1 2024-09-18T12:49:35.211 INFO:tasks.workunit.client.0.smithi078.stdout:9/848: mknod d5/d40/c114 0 2024-09-18T12:49:35.212 INFO:tasks.workunit.client.0.smithi078.stdout:3/727: mknod d9/d13/d33/d34/d97/dc2/ce6 0 2024-09-18T12:49:35.214 INFO:tasks.workunit.client.0.smithi078.stdout:9/849: creat d5/d7/dbe/de8/f115 x:0 0 0 2024-09-18T12:49:35.215 INFO:tasks.workunit.client.0.smithi078.stdout:9/850: mkdir d5/d7/db3/de5/d116 0 2024-09-18T12:49:35.248 INFO:tasks.workunit.client.0.smithi078.stdout:9/851: read d5/d7/d32/d2a/d68/f8d [138980,31109] 0 2024-09-18T12:49:35.249 INFO:tasks.workunit.client.0.smithi078.stdout:3/728: getdents d9/d13/d33/d4e 0 2024-09-18T12:49:35.254 INFO:tasks.workunit.client.0.smithi078.stdout:9/852: dwrite d5/d7/d8/d4f/ff3 [0,4194304] 0 2024-09-18T12:49:35.258 INFO:tasks.workunit.client.0.smithi078.stdout:1/759: sync 2024-09-18T12:49:35.260 INFO:tasks.workunit.client.0.smithi078.stdout:1/760: readlink d0/d8/da/d3e/d50/d74/le4 0 2024-09-18T12:49:35.266 INFO:tasks.workunit.client.0.smithi078.stdout:1/761: creat d0/d8/da/d3e/d58/d6e/d52/d47/de8/d7f/fff x:0 0 0 2024-09-18T12:49:35.269 INFO:tasks.workunit.client.0.smithi078.stdout:3/729: link d9/d13/d33/d3c/f66 d9/d29/d4b/fe7 0 2024-09-18T12:49:35.271 INFO:tasks.workunit.client.0.smithi078.stdout:1/762: symlink d0/d8/da/d3e/d58/d6e/d52/d47/de8/l100 0 2024-09-18T12:49:35.278 INFO:tasks.workunit.client.0.smithi078.stdout:1/763: dwrite d0/d5b/d6d/dc2/fcd [0,4194304] 0 2024-09-18T12:49:35.281 INFO:tasks.workunit.client.0.smithi078.stdout:3/730: rename d9/d29/ldc to d9/df/le8 0 2024-09-18T12:49:35.282 INFO:tasks.workunit.client.0.smithi078.stdout:9/853: dread d5/d7/f39 [0,4194304] 0 2024-09-18T12:49:35.283 INFO:tasks.workunit.client.0.smithi078.stdout:1/764: creat d0/d5b/d6d/f101 x:0 0 0 2024-09-18T12:49:35.286 INFO:tasks.workunit.client.0.smithi078.stdout:3/731: mknod d9/d54/d7f/d9c/ce9 0 2024-09-18T12:49:35.291 INFO:tasks.workunit.client.0.smithi078.stdout:3/732: mknod d9/d54/d89/d92/db6/dde/cea 0 2024-09-18T12:49:35.293 INFO:tasks.workunit.client.0.smithi078.stdout:9/854: fsync d5/d7/d32/d2a/fbb 0 2024-09-18T12:49:35.295 INFO:tasks.workunit.client.0.smithi078.stdout:1/765: rename d0/d8/da/d3e/d58/d6e/d8c/cc9 to d0/d8/da/d45/c102 0 2024-09-18T12:49:35.297 INFO:tasks.workunit.client.0.smithi078.stdout:3/733: symlink d9/d54/d6c/d9f/leb 0 2024-09-18T12:49:35.298 INFO:tasks.workunit.client.0.smithi078.stdout:3/734: chown d9/d54/d89/d92/db6/dde/cea 9 1 2024-09-18T12:49:35.301 INFO:tasks.workunit.client.0.smithi078.stdout:3/735: creat d9/d54/d7f/fec x:0 0 0 2024-09-18T12:49:35.306 INFO:tasks.workunit.client.0.smithi078.stdout:9/855: dwrite d5/d7/d32/d2a/d68/d97/fe6 [0,4194304] 0 2024-09-18T12:49:35.310 INFO:tasks.workunit.client.0.smithi078.stdout:1/766: truncate d0/d8/da/d3e/d58/d6e/d52/d47/f8a 2063774 0 2024-09-18T12:49:35.314 INFO:tasks.workunit.client.0.smithi078.stdout:1/767: symlink d0/d8/da/l103 0 2024-09-18T12:49:35.315 INFO:tasks.workunit.client.0.smithi078.stdout:9/856: link d5/d7/d32/d91/caa d5/d7/db3/c117 0 2024-09-18T12:49:35.315 INFO:tasks.workunit.client.0.smithi078.stdout:9/857: stat d5/d7/dbe/de8 0 2024-09-18T12:49:35.316 INFO:tasks.workunit.client.0.smithi078.stdout:1/768: chown d0/d8/da/d3e/d58/d6e/d52/f2d 7 1 2024-09-18T12:49:35.317 INFO:tasks.workunit.client.0.smithi078.stdout:9/858: fsync d5/d7/d32/f44 0 2024-09-18T12:49:35.319 INFO:tasks.workunit.client.0.smithi078.stdout:1/769: chown d0/d8/c1d 94 1 2024-09-18T12:49:35.320 INFO:tasks.workunit.client.0.smithi078.stdout:1/770: readlink d0/d8/da/d3e/d50/d74/l87 0 2024-09-18T12:49:35.321 INFO:tasks.workunit.client.0.smithi078.stdout:3/736: dread d9/d13/d33/d4e/f75 [0,4194304] 0 2024-09-18T12:49:35.327 INFO:tasks.workunit.client.0.smithi078.stdout:3/737: rename d9/d29/f7d to d9/d2f/d43/fed 0 2024-09-18T12:49:35.327 INFO:tasks.workunit.client.0.smithi078.stdout:1/771: dwrite d0/d8/da/d3e/d58/d6e/d52/d47/de8/f48 [0,4194304] 0 2024-09-18T12:49:35.328 INFO:tasks.workunit.client.0.smithi078.stdout:3/738: write d9/d54/fb4 [48909,42210] 0 2024-09-18T12:49:35.335 INFO:tasks.workunit.client.0.smithi078.stdout:1/772: chown d0/d8/da/l8b 813988974 1 2024-09-18T12:49:35.336 INFO:tasks.workunit.client.0.smithi078.stdout:3/739: mknod d9/d54/d6c/cee 0 2024-09-18T12:49:35.336 INFO:tasks.workunit.client.0.smithi078.stdout:9/859: write d5/d7/d8/d4f/f8b [331989,123400] 0 2024-09-18T12:49:35.338 INFO:tasks.workunit.client.0.smithi078.stdout:9/860: chown d5/d7/d32/d2a/ff4 24235975 1 2024-09-18T12:49:35.339 INFO:tasks.workunit.client.0.smithi078.stdout:1/773: rmdir d0/d5b/d6d 39 2024-09-18T12:49:35.346 INFO:tasks.workunit.client.0.smithi078.stdout:9/861: dread d5/d7/f39 [0,4194304] 0 2024-09-18T12:49:35.346 INFO:tasks.workunit.client.0.smithi078.stdout:3/740: dwrite d9/d29/d4b/d4c/fcf [0,4194304] 0 2024-09-18T12:49:35.348 INFO:tasks.workunit.client.0.smithi078.stdout:3/741: write d9/d54/d6c/fba [247820,111198] 0 2024-09-18T12:49:35.349 INFO:tasks.workunit.client.0.smithi078.stdout:1/774: dread d0/d8/da/d3e/d58/d6e/d52/d47/de8/f48 [0,4194304] 0 2024-09-18T12:49:35.351 INFO:tasks.workunit.client.0.smithi078.stdout:3/742: symlink d9/d54/d6c/lef 0 2024-09-18T12:49:35.359 INFO:tasks.workunit.client.0.smithi078.stdout:1/775: dwrite d0/d8/da/d3e/d58/d6e/d52/d47/de8/d7f/fff [0,4194304] 0 2024-09-18T12:49:35.364 INFO:tasks.workunit.client.0.smithi078.stdout:3/743: write d9/d54/d89/fe5 [2044931,46050] 0 2024-09-18T12:49:35.366 INFO:tasks.workunit.client.0.smithi078.stdout:3/744: write d9/d2f/d43/fc4 [25558,120374] 0 2024-09-18T12:49:35.372 INFO:tasks.workunit.client.0.smithi078.stdout:3/745: dread d9/d54/fb4 [0,4194304] 0 2024-09-18T12:49:35.378 INFO:tasks.workunit.client.0.smithi078.stdout:3/746: dwrite d9/d2f/d43/fc4 [0,4194304] 0 2024-09-18T12:49:35.552 INFO:tasks.workunit.client.0.smithi078.stdout:2/733: sync 2024-09-18T12:49:35.552 INFO:tasks.workunit.client.0.smithi078.stdout:7/737: sync 2024-09-18T12:49:35.555 INFO:tasks.workunit.client.0.smithi078.stdout:7/738: creat d7/d9/d14/d22/d3e/d95/db2/f101 x:0 0 0 2024-09-18T12:49:35.555 INFO:tasks.workunit.client.0.smithi078.stdout:2/734: truncate d4/d8/f50 1717687 0 2024-09-18T12:49:35.689 INFO:tasks.workunit.client.0.smithi078.stdout:2/735: readlink d4/db/dc/le4 0 2024-09-18T12:49:35.692 INFO:tasks.workunit.client.0.smithi078.stdout:7/739: rename d7/d5d/d7a/l48 to d7/d9/d14/d22/d35/d49/l102 0 2024-09-18T12:49:35.693 INFO:tasks.workunit.client.0.smithi078.stdout:7/740: chown d7/d9/d14/d22/d35/d49/d56/d8d/daf/cec 3974378 1 2024-09-18T12:49:35.700 INFO:tasks.workunit.client.0.smithi078.stdout:2/736: write d4/d8/f76 [995477,37215] 0 2024-09-18T12:49:35.702 INFO:tasks.workunit.client.0.smithi078.stdout:2/737: rmdir d4/db/dc/dc0 39 2024-09-18T12:49:35.705 INFO:tasks.workunit.client.0.smithi078.stdout:2/738: mkdir d4/d8/d23/d52/d5f/d86/d33/dea 0 2024-09-18T12:49:35.707 INFO:tasks.workunit.client.0.smithi078.stdout:2/739: symlink d4/dd/d8a/leb 0 2024-09-18T12:49:35.709 INFO:tasks.workunit.client.0.smithi078.stdout:7/741: dwrite d7/d26/f42 [0,4194304] 0 2024-09-18T12:49:35.709 INFO:tasks.workunit.client.0.smithi078.stdout:4/946: sync 2024-09-18T12:49:35.709 INFO:tasks.workunit.client.0.smithi078.stdout:0/862: sync 2024-09-18T12:49:35.710 INFO:tasks.workunit.client.0.smithi078.stdout:2/740: read d4/d8/d23/f56 [6480656,26107] 0 2024-09-18T12:49:35.711 INFO:tasks.workunit.client.0.smithi078.stdout:7/742: fsync d7/d9/d14/d22/d35/d49/f66 0 2024-09-18T12:49:35.714 INFO:tasks.workunit.client.0.smithi078.stdout:0/863: symlink d3/d82/dd7/l129 0 2024-09-18T12:49:35.715 INFO:tasks.workunit.client.0.smithi078.stdout:4/947: creat d11/d27/d47/d4e/daa/f12b x:0 0 0 2024-09-18T12:49:35.719 INFO:tasks.workunit.client.0.smithi078.stdout:7/743: creat d7/d26/d4f/f103 x:0 0 0 2024-09-18T12:49:35.721 INFO:tasks.workunit.client.0.smithi078.stdout:2/741: truncate d4/dd/fc7 625950 0 2024-09-18T12:49:35.724 INFO:tasks.workunit.client.0.smithi078.stdout:7/744: dread d7/d9/d14/d22/d35/d49/f66 [0,4194304] 0 2024-09-18T12:49:35.725 INFO:tasks.workunit.client.0.smithi078.stdout:7/745: stat d7/d9/dd7/d3b/d70 0 2024-09-18T12:49:35.727 INFO:tasks.workunit.client.0.smithi078.stdout:4/948: unlink d11/d27/d5a/d84/d40/c77 0 2024-09-18T12:49:35.727 INFO:tasks.workunit.client.0.smithi078.stdout:2/742: readlink d4/d8/d23/d52/l98 0 2024-09-18T12:49:35.731 INFO:tasks.workunit.client.0.smithi078.stdout:2/743: chown d4/db/d45/cbf 43 1 2024-09-18T12:49:35.732 INFO:tasks.workunit.client.0.smithi078.stdout:0/864: dread d3/f5 [0,4194304] 0 2024-09-18T12:49:35.734 INFO:tasks.workunit.client.0.smithi078.stdout:0/865: truncate d3/d1f/d2e/d8f/da1/fa2 8856733 0 2024-09-18T12:49:35.737 INFO:tasks.workunit.client.0.smithi078.stdout:0/866: rename d3/d1f/d2e/d4e/d37/d72/f11f to d3/d82/d10d/d7c/d10b/f12a 0 2024-09-18T12:49:35.740 INFO:tasks.workunit.client.0.smithi078.stdout:7/746: getdents d7/d26/d4f 0 2024-09-18T12:49:35.741 INFO:tasks.workunit.client.0.smithi078.stdout:7/747: fdatasync d7/d9/d4d/d6f/fe1 0 2024-09-18T12:49:35.819 INFO:tasks.workunit.client.0.smithi078.stdout:4/949: write d11/d27/d5a/d84/d40/f8b [379111,16130] 0 2024-09-18T12:49:35.820 INFO:tasks.workunit.client.0.smithi078.stdout:0/867: read d3/d1f/d2e/d4e/d37/d72/d96/fab [3037967,34840] 0 2024-09-18T12:49:35.822 INFO:tasks.workunit.client.0.smithi078.stdout:4/950: mknod d11/d27/d5a/d5d/dca/c12c 0 2024-09-18T12:49:35.823 INFO:tasks.workunit.client.0.smithi078.stdout:7/748: dread d7/f65 [4194304,4194304] 0 2024-09-18T12:49:35.823 INFO:tasks.workunit.client.0.smithi078.stdout:4/951: fsync d11/d27/d5a/d84/f63 0 2024-09-18T12:49:35.824 INFO:tasks.workunit.client.0.smithi078.stdout:0/868: dread - d3/d82/d10d/d7c/fe7 zero size 2024-09-18T12:49:35.825 INFO:tasks.workunit.client.0.smithi078.stdout:0/869: dread - d3/d1f/d2e/d4e/d37/f125 zero size 2024-09-18T12:49:35.828 INFO:tasks.workunit.client.0.smithi078.stdout:0/870: symlink d3/d82/d10d/d7c/da3/l12b 0 2024-09-18T12:49:35.830 INFO:tasks.workunit.client.0.smithi078.stdout:0/871: creat d3/d1f/d2e/d4e/d37/d103/f12c x:0 0 0 2024-09-18T12:49:35.834 INFO:tasks.workunit.client.0.smithi078.stdout:0/872: rename d3/d82/d10d/d7c/fe7 to d3/d1f/d2e/d4e/d37/d72/ddd/f12d 0 2024-09-18T12:49:35.835 INFO:tasks.workunit.client.0.smithi078.stdout:0/873: rmdir d3/d1f/d2e/d4e 39 2024-09-18T12:49:35.836 INFO:tasks.workunit.client.0.smithi078.stdout:4/952: dread d11/f23 [0,4194304] 0 2024-09-18T12:49:35.839 INFO:tasks.workunit.client.0.smithi078.stdout:0/874: symlink d3/d82/d10d/d7c/da3/l12e 0 2024-09-18T12:49:35.840 INFO:tasks.workunit.client.0.smithi078.stdout:4/953: truncate d11/d27/d5a/d84/d40/dc7/f123 1181781 0 2024-09-18T12:49:35.853 INFO:tasks.workunit.client.0.smithi078.stdout:4/954: creat d11/d27/d89/d9f/d115/d11c/f12d x:0 0 0 2024-09-18T12:49:35.857 INFO:tasks.workunit.client.0.smithi078.stdout:4/955: rename d11/d27/d5a/d5d/dca to d11/d27/d47/d78/d11a/d12e 0 2024-09-18T12:49:35.859 INFO:tasks.workunit.client.0.smithi078.stdout:0/875: dwrite d3/f93 [0,4194304] 0 2024-09-18T12:49:35.863 INFO:tasks.workunit.client.0.smithi078.stdout:4/956: write d11/d27/d60/ff5 [1211723,104785] 0 2024-09-18T12:49:35.870 INFO:tasks.workunit.client.0.smithi078.stdout:4/957: creat d11/d27/d47/d78/d95/f12f x:0 0 0 2024-09-18T12:49:35.871 INFO:tasks.workunit.client.0.smithi078.stdout:4/958: chown c0 0 1 2024-09-18T12:49:35.872 INFO:tasks.workunit.client.0.smithi078.stdout:0/876: rmdir d3/d1f/d2e/d8f/df4 0 2024-09-18T12:49:35.877 INFO:tasks.workunit.client.0.smithi078.stdout:4/959: creat d11/d27/d5a/d84/d4b/da7/dba/f130 x:0 0 0 2024-09-18T12:49:35.882 INFO:tasks.workunit.client.0.smithi078.stdout:4/960: creat d11/d45/f131 x:0 0 0 2024-09-18T12:49:35.882 INFO:tasks.workunit.client.0.smithi078.stdout:4/961: stat d11/d27/d47/c99 0 2024-09-18T12:49:35.890 INFO:tasks.workunit.client.0.smithi078.stdout:4/962: write d11/d27/d5a/d84/d4b/da7/dba/dd7/ff6 [667270,109647] 0 2024-09-18T12:49:35.890 INFO:tasks.workunit.client.0.smithi078.stdout:0/877: dread d3/f18 [0,4194304] 0 2024-09-18T12:49:35.891 INFO:tasks.workunit.client.0.smithi078.stdout:4/963: write d11/d27/d5a/d5d/ffe [245030,45189] 0 2024-09-18T12:49:35.912 INFO:tasks.workunit.client.0.smithi078.stdout:4/964: stat d11/d27/d47/d78/d95/lb2 0 2024-09-18T12:49:35.914 INFO:tasks.workunit.client.0.smithi078.stdout:0/878: mkdir d3/d82/d10d/d7c/da3/de2/d12f 0 2024-09-18T12:49:35.916 INFO:tasks.workunit.client.0.smithi078.stdout:4/965: getdents d11/d27/d5a/d84/d40/dc7 0 2024-09-18T12:49:35.922 INFO:tasks.workunit.client.0.smithi078.stdout:4/966: dwrite d11/d27/d5a/d84/d4b/da7/dba/feb [0,4194304] 0 2024-09-18T12:49:35.948 INFO:tasks.workunit.client.0.smithi078.stdout:0/879: write d3/d1f/d2e/d68/f61 [817879,87449] 0 2024-09-18T12:49:35.949 INFO:tasks.workunit.client.0.smithi078.stdout:4/967: write d11/f16 [951422,45834] 0 2024-09-18T12:49:35.949 INFO:tasks.workunit.client.0.smithi078.stdout:0/880: chown d3/d43/l10c 8 1 2024-09-18T12:49:35.950 INFO:tasks.workunit.client.0.smithi078.stdout:4/968: fdatasync d11/d27/d89/fcb 0 2024-09-18T12:49:35.952 INFO:tasks.workunit.client.0.smithi078.stdout:0/881: fdatasync d3/d1f/d2e/d68/dc9/dcd/d128/dcb/fd3 0 2024-09-18T12:49:35.953 INFO:tasks.workunit.client.0.smithi078.stdout:0/882: chown d3/d1f/d2e/d68/dc9/dcd/f11b 0 1 2024-09-18T12:49:35.956 INFO:tasks.workunit.client.0.smithi078.stdout:4/969: mknod d11/d27/d5a/d84/d4b/da7/de0/c132 0 2024-09-18T12:49:35.958 INFO:tasks.workunit.client.0.smithi078.stdout:0/883: mkdir d3/d43/d130 0 2024-09-18T12:49:35.960 INFO:tasks.workunit.client.0.smithi078.stdout:4/970: symlink d11/d27/d5a/d84/d4b/l133 0 2024-09-18T12:49:35.962 INFO:tasks.workunit.client.0.smithi078.stdout:0/884: truncate d3/d43/fb7 283711 0 2024-09-18T12:49:35.962 INFO:tasks.workunit.client.0.smithi078.stdout:4/971: symlink d11/d27/d5a/d84/d4b/da7/dba/dc4/l134 0 2024-09-18T12:49:35.964 INFO:tasks.workunit.client.0.smithi078.stdout:0/885: stat d3/d1f/d2e/d4e/d37/d72/d96/cd1 0 2024-09-18T12:49:35.964 INFO:tasks.workunit.client.0.smithi078.stdout:4/972: mkdir d11/d27/d89/d9f/d135 0 2024-09-18T12:49:35.964 INFO:tasks.workunit.client.0.smithi078.stdout:4/973: chown d11/f126 144 1 2024-09-18T12:49:35.967 INFO:tasks.workunit.client.0.smithi078.stdout:4/974: unlink d11/d27/d5a/d84/d4b/da7/dba/dc1/l129 0 2024-09-18T12:49:35.967 INFO:tasks.workunit.client.0.smithi078.stdout:4/975: truncate d11/d45/f10c 893300 0 2024-09-18T12:49:35.968 INFO:tasks.workunit.client.0.smithi078.stdout:4/976: fsync d11/d27/d60/ff5 0 2024-09-18T12:49:35.971 INFO:tasks.workunit.client.0.smithi078.stdout:0/886: link d3/d1f/lbe d3/d1f/d2e/d4e/d37/d72/l131 0 2024-09-18T12:49:35.972 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:35 smithi148 ceph-mon[35352]: pgmap v25: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 80 MiB/s rd, 179 MiB/s wr, 408 op/s 2024-09-18T12:49:35.985 INFO:tasks.workunit.client.0.smithi078.stdout:4/977: truncate d11/d27/d5a/d84/f2b 7526371 0 2024-09-18T12:49:35.986 INFO:tasks.workunit.client.0.smithi078.stdout:4/978: chown d11/d27/d47/d78/cd8 625389 1 2024-09-18T12:49:35.987 INFO:tasks.workunit.client.0.smithi078.stdout:4/979: write d11/d27/d47/d78/d95/f12f [111706,10342] 0 2024-09-18T12:49:35.988 INFO:tasks.workunit.client.0.smithi078.stdout:4/980: truncate d11/d27/d5a/d84/db0/f10b 726295 0 2024-09-18T12:49:35.991 INFO:tasks.workunit.client.0.smithi078.stdout:4/981: rename d11/d27/d47/d4e/d50/l6e to d11/d27/d5a/d84/d4b/da7/dba/dc1/l136 0 2024-09-18T12:49:35.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:35 smithi078 ceph-mon[28091]: pgmap v25: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 80 MiB/s rd, 179 MiB/s wr, 408 op/s 2024-09-18T12:49:35.993 INFO:tasks.workunit.client.0.smithi078.stdout:4/982: creat d11/d45/f137 x:0 0 0 2024-09-18T12:49:35.996 INFO:tasks.workunit.client.0.smithi078.stdout:4/983: creat d11/d27/d5a/d84/d4b/f138 x:0 0 0 2024-09-18T12:49:36.001 INFO:tasks.workunit.client.0.smithi078.stdout:4/984: dwrite d11/d45/f75 [0,4194304] 0 2024-09-18T12:49:36.003 INFO:tasks.workunit.client.0.smithi078.stdout:4/985: write d11/d45/f10c [1426810,42853] 0 2024-09-18T12:49:36.006 INFO:tasks.workunit.client.0.smithi078.stdout:4/986: symlink d11/d27/d5a/d84/d4b/da7/dba/dc4/l139 0 2024-09-18T12:49:36.008 INFO:tasks.workunit.client.0.smithi078.stdout:4/987: creat d11/d27/d5a/d84/d4b/f13a x:0 0 0 2024-09-18T12:49:36.009 INFO:tasks.workunit.client.0.smithi078.stdout:4/988: chown d11/f1d 15811 1 2024-09-18T12:49:36.011 INFO:tasks.workunit.client.0.smithi078.stdout:4/989: rmdir d11/d27/d47/d78/d11a 39 2024-09-18T12:49:36.017 INFO:tasks.workunit.client.0.smithi078.stdout:4/990: dwrite d11/f14 [0,4194304] 0 2024-09-18T12:49:36.019 INFO:tasks.workunit.client.0.smithi078.stdout:4/991: dread d11/d27/d47/d78/d95/f12f [0,4194304] 0 2024-09-18T12:49:36.024 INFO:tasks.workunit.client.0.smithi078.stdout:4/992: symlink d11/d27/d47/d78/l13b 0 2024-09-18T12:49:36.062 INFO:tasks.workunit.client.0.smithi078.stdout:4/993: dread d11/d27/d5a/d84/f2b [0,4194304] 0 2024-09-18T12:49:36.065 INFO:tasks.workunit.client.0.smithi078.stdout:4/994: symlink d11/d27/d5a/d84/d4b/da7/dba/dc4/l13c 0 2024-09-18T12:49:36.066 INFO:tasks.workunit.client.0.smithi078.stdout:4/995: readlink d11/d27/d5a/d84/d40/dc7/l117 0 2024-09-18T12:49:36.081 INFO:tasks.workunit.client.0.smithi078.stdout:4/996: dread d11/d27/d60/ff5 [0,4194304] 0 2024-09-18T12:49:36.088 INFO:tasks.workunit.client.0.smithi078.stdout:4/997: fsync d11/d27/d47/d4e/daa/fab 0 2024-09-18T12:49:36.095 INFO:tasks.workunit.client.0.smithi078.stdout:4/998: getdents d11/d27/d5a/d84/d40 0 2024-09-18T12:49:36.099 INFO:tasks.workunit.client.0.smithi078.stdout:4/999: creat d11/d27/d47/d78/f13d x:0 0 0 2024-09-18T12:49:36.150 INFO:tasks.workunit.client.0.smithi078.stdout:1/776: sync 2024-09-18T12:49:36.151 INFO:tasks.workunit.client.0.smithi078.stdout:3/747: sync 2024-09-18T12:49:36.151 INFO:tasks.workunit.client.0.smithi078.stdout:8/811: sync 2024-09-18T12:49:36.151 INFO:tasks.workunit.client.0.smithi078.stdout:2/744: sync 2024-09-18T12:49:36.151 INFO:tasks.workunit.client.0.smithi078.stdout:9/862: sync 2024-09-18T12:49:36.160 INFO:tasks.workunit.client.0.smithi078.stdout:1/777: creat d0/d8/da/d3e/d58/d6e/d8c/d9d/dc3/f104 x:0 0 0 2024-09-18T12:49:36.166 INFO:tasks.workunit.client.0.smithi078.stdout:8/812: dwrite d0/d7/dc/d71/d9b/db6/f10a [4194304,4194304] 0 2024-09-18T12:49:36.166 INFO:tasks.workunit.client.0.smithi078.stdout:8/813: readlink d0/la5 0 2024-09-18T12:49:36.172 INFO:tasks.workunit.client.0.smithi078.stdout:1/778: rename d0/d8/da/d3e/d58/d6e/d8c/dd3/ff3 to d0/d8/de2/f105 0 2024-09-18T12:49:36.185 INFO:tasks.workunit.client.0.smithi078.stdout:8/814: link d0/d7/dc/d71/d9b/db6/f103 d0/d39/d4c/d77/d7d/d3e/f112 0 2024-09-18T12:49:36.187 INFO:tasks.workunit.client.0.smithi078.stdout:3/748: dread d9/d13/f1d [4194304,4194304] 0 2024-09-18T12:49:36.190 INFO:tasks.workunit.client.0.smithi078.stdout:8/815: mknod d0/d7/dc/c113 0 2024-09-18T12:49:36.194 INFO:tasks.workunit.client.0.smithi078.stdout:9/863: write d5/d40/f63 [1513549,23184] 0 2024-09-18T12:49:36.197 INFO:tasks.workunit.client.0.smithi078.stdout:8/816: fdatasync d0/d7/d1e/da9/d6d/f97 0 2024-09-18T12:49:36.198 INFO:tasks.workunit.client.0.smithi078.stdout:2/745: dwrite d4/fa4 [0,4194304] 0 2024-09-18T12:49:36.198 INFO:tasks.workunit.client.0.smithi078.stdout:2/746: chown d4/dd/d8a 15438473 1 2024-09-18T12:49:36.200 INFO:tasks.workunit.client.0.smithi078.stdout:9/864: truncate d5/d7/d8/f6a 4336768 0 2024-09-18T12:49:36.201 INFO:tasks.workunit.client.0.smithi078.stdout:9/865: chown d5/d7/d32/lae 78620 1 2024-09-18T12:49:36.201 INFO:tasks.workunit.client.0.smithi078.stdout:9/866: readlink d5/l79 0 2024-09-18T12:49:36.203 INFO:tasks.workunit.client.0.smithi078.stdout:9/867: chown d5/d7/d32/d2a/d68/d97/fe7 30347 1 2024-09-18T12:49:36.203 INFO:tasks.workunit.client.0.smithi078.stdout:2/747: dread - d4/d8/d23/d52/d5f/d81/dac/daf/fcb zero size 2024-09-18T12:49:36.208 INFO:tasks.workunit.client.0.smithi078.stdout:9/868: symlink d5/d7/db1/l118 0 2024-09-18T12:49:36.208 INFO:tasks.workunit.client.0.smithi078.stdout:1/779: dwrite d0/d8/da/d3e/d58/d6e/d52/d47/f93 [0,4194304] 0 2024-09-18T12:49:36.209 INFO:tasks.workunit.client.0.smithi078.stdout:3/749: truncate d9/d2f/f70 1889279 0 2024-09-18T12:49:36.212 INFO:tasks.workunit.client.0.smithi078.stdout:2/748: mkdir d4/db/dc/dec 0 2024-09-18T12:49:36.217 INFO:tasks.workunit.client.0.smithi078.stdout:2/749: dread d4/d8/d23/d95/fb4 [0,4194304] 0 2024-09-18T12:49:36.218 INFO:tasks.workunit.client.0.smithi078.stdout:1/780: mknod d0/d8/da/d3e/d50/dba/c106 0 2024-09-18T12:49:36.225 INFO:tasks.workunit.client.0.smithi078.stdout:2/750: creat d4/d8/d23/d52/d5f/d86/d3b/d55/fed x:0 0 0 2024-09-18T12:49:36.226 INFO:tasks.workunit.client.0.smithi078.stdout:2/751: truncate d4/db/dc/f62 1208424 0 2024-09-18T12:49:36.227 INFO:tasks.workunit.client.0.smithi078.stdout:3/750: link d9/d13/f5f d9/d13/d33/d34/d97/dc2/ff0 0 2024-09-18T12:49:36.232 INFO:tasks.workunit.client.0.smithi078.stdout:3/751: fsync d9/d54/d7f/dae/dd4/fe0 0 2024-09-18T12:49:36.236 INFO:tasks.workunit.client.0.smithi078.stdout:1/781: creat d0/d8/da/d3e/d58/d6e/f107 x:0 0 0 2024-09-18T12:49:36.240 INFO:tasks.workunit.client.0.smithi078.stdout:9/869: dread d5/dc6/feb [0,4194304] 0 2024-09-18T12:49:36.240 INFO:tasks.workunit.client.0.smithi078.stdout:3/752: mkdir d9/d13/d33/d34/d9e/df1 0 2024-09-18T12:49:36.240 INFO:tasks.workunit.client.0.smithi078.stdout:2/752: write d4/d8/d23/d52/faa [2791258,68176] 0 2024-09-18T12:49:36.242 INFO:tasks.workunit.client.0.smithi078.stdout:2/753: truncate d4/dd/d8a/dd3/fdd 945363 0 2024-09-18T12:49:36.243 INFO:tasks.workunit.client.0.smithi078.stdout:8/817: getdents d0/d7/dc/d1f/d23/d40 0 2024-09-18T12:49:36.244 INFO:tasks.workunit.client.0.smithi078.stdout:1/782: creat d0/f108 x:0 0 0 2024-09-18T12:49:36.245 INFO:tasks.workunit.client.0.smithi078.stdout:9/870: dread d5/dc6/feb [0,4194304] 0 2024-09-18T12:49:36.247 INFO:tasks.workunit.client.0.smithi078.stdout:8/818: mkdir d0/d7/dc/d114 0 2024-09-18T12:49:36.248 INFO:tasks.workunit.client.0.smithi078.stdout:1/783: write d0/d8/da/d3e/d58/d6e/d52/d47/de8/f59 [3841264,8334] 0 2024-09-18T12:49:36.248 INFO:tasks.workunit.client.0.smithi078.stdout:9/871: rmdir d5/d7/db3 39 2024-09-18T12:49:36.249 INFO:tasks.workunit.client.0.smithi078.stdout:3/753: mkdir d9/d2f/d43/d62/df2 0 2024-09-18T12:49:36.252 INFO:tasks.workunit.client.0.smithi078.stdout:8/819: rmdir d0/d7/d1e/d4b 39 2024-09-18T12:49:36.252 INFO:tasks.workunit.client.0.smithi078.stdout:2/754: dwrite d4/d8/d23/d52/d5f/d81/dac/fe3 [0,4194304] 0 2024-09-18T12:49:36.254 INFO:tasks.workunit.client.0.smithi078.stdout:3/754: dread d9/d2f/fbd [0,4194304] 0 2024-09-18T12:49:36.255 INFO:tasks.workunit.client.0.smithi078.stdout:9/872: mkdir d5/d7/dbe/ddd/d119 0 2024-09-18T12:49:36.257 INFO:tasks.workunit.client.0.smithi078.stdout:1/784: truncate d0/f4b 2622283 0 2024-09-18T12:49:36.261 INFO:tasks.workunit.client.0.smithi078.stdout:2/755: mkdir d4/db/d45/dbc/dee 0 2024-09-18T12:49:36.261 INFO:tasks.workunit.client.0.smithi078.stdout:1/785: truncate d0/d8/da/d3e/d58/d6e/d52/d47/de8/d7f/ff9 734510 0 2024-09-18T12:49:36.266 INFO:tasks.workunit.client.0.smithi078.stdout:8/820: creat d0/d39/dbc/f115 x:0 0 0 2024-09-18T12:49:36.269 INFO:tasks.workunit.client.0.smithi078.stdout:1/786: creat d0/d8/da/d3e/d50/d74/f109 x:0 0 0 2024-09-18T12:49:36.274 INFO:tasks.workunit.client.0.smithi078.stdout:9/873: getdents d5/d7/dbe/ddd/d119 0 2024-09-18T12:49:36.277 INFO:tasks.workunit.client.0.smithi078.stdout:2/756: truncate d4/d8/f50 351151 0 2024-09-18T12:49:36.279 INFO:tasks.workunit.client.0.smithi078.stdout:1/787: symlink d0/d8/da/d3e/d58/d6e/d52/d47/de8/d7f/l10a 0 2024-09-18T12:49:36.280 INFO:tasks.workunit.client.0.smithi078.stdout:9/874: dwrite d5/d7/db1/f105 [0,4194304] 0 2024-09-18T12:49:36.280 INFO:tasks.workunit.client.0.smithi078.stdout:1/788: stat d0/d8/f92 0 2024-09-18T12:49:36.283 INFO:tasks.workunit.client.0.smithi078.stdout:3/755: getdents d9/d54/d7f/dae 0 2024-09-18T12:49:36.284 INFO:tasks.workunit.client.0.smithi078.stdout:3/756: readlink d9/d54/d6c/d9f/leb 0 2024-09-18T12:49:36.285 INFO:tasks.workunit.client.0.smithi078.stdout:7/749: sync 2024-09-18T12:49:36.287 INFO:tasks.workunit.client.0.smithi078.stdout:2/757: unlink d4/fe5 0 2024-09-18T12:49:36.289 INFO:tasks.workunit.client.0.smithi078.stdout:8/821: truncate d0/d7/d1e/da9/d6d/f78 3167018 0 2024-09-18T12:49:36.292 INFO:tasks.workunit.client.0.smithi078.stdout:9/875: creat d5/d7/dbe/de8/df1/d103/f11a x:0 0 0 2024-09-18T12:49:36.293 INFO:tasks.workunit.client.0.smithi078.stdout:7/750: symlink d7/d9/d4d/d9a/l104 0 2024-09-18T12:49:36.294 INFO:tasks.workunit.client.0.smithi078.stdout:9/876: truncate d5/d7/dbe/de8/df1/d103/f10b 882134 0 2024-09-18T12:49:36.297 INFO:tasks.workunit.client.0.smithi078.stdout:3/757: dread d9/d54/f68 [0,4194304] 0 2024-09-18T12:49:36.297 INFO:tasks.workunit.client.0.smithi078.stdout:1/789: mkdir d0/d8/da/d3e/d50/d10b 0 2024-09-18T12:49:36.299 INFO:tasks.workunit.client.0.smithi078.stdout:1/790: chown d0/d8/da/d3e/d58/d6e/f7a 0 1 2024-09-18T12:49:36.300 INFO:tasks.workunit.client.0.smithi078.stdout:3/758: truncate d9/d13/d33/d34/d9e/fe2 1029086 0 2024-09-18T12:49:36.305 INFO:tasks.workunit.client.0.smithi078.stdout:2/758: getdents d4/db/dc 0 2024-09-18T12:49:36.306 INFO:tasks.workunit.client.0.smithi078.stdout:7/751: dwrite d7/f65 [0,4194304] 0 2024-09-18T12:49:36.309 INFO:tasks.workunit.client.0.smithi078.stdout:2/759: mknod d4/dd/d8a/cef 0 2024-09-18T12:49:36.313 INFO:tasks.workunit.client.0.smithi078.stdout:3/759: link d9/d13/d33/d34/d9e/cd1 d9/d2f/cf3 0 2024-09-18T12:49:36.315 INFO:tasks.workunit.client.0.smithi078.stdout:7/752: getdents d7/d9/d14/d22/d35 0 2024-09-18T12:49:36.319 INFO:tasks.workunit.client.0.smithi078.stdout:2/760: rename d4/db/dc/f2f to d4/ff0 0 2024-09-18T12:49:36.320 INFO:tasks.workunit.client.0.smithi078.stdout:1/791: dread d0/d8/da/d3e/d58/d6e/d52/f6f [0,4194304] 0 2024-09-18T12:49:36.324 INFO:tasks.workunit.client.0.smithi078.stdout:3/760: write d9/d2f/d43/d62/fad [2611204,44492] 0 2024-09-18T12:49:36.328 INFO:tasks.workunit.client.0.smithi078.stdout:2/761: dwrite d4/d8/f76 [0,4194304] 0 2024-09-18T12:49:36.336 INFO:tasks.workunit.client.0.smithi078.stdout:1/792: dwrite d0/d8/da/d3e/d58/d6e/d52/d47/de8/f48 [4194304,4194304] 0 2024-09-18T12:49:36.337 INFO:tasks.workunit.client.0.smithi078.stdout:2/762: rename d4/dd/l11 to d4/d8/d23/d52/d5f/lf1 0 2024-09-18T12:49:36.343 INFO:tasks.workunit.client.0.smithi078.stdout:1/793: mknod d0/d8/da/d3e/d50/da7/de0/c10c 0 2024-09-18T12:49:36.345 INFO:tasks.workunit.client.0.smithi078.stdout:1/794: readlink d0/d8/da/d3e/d58/d6e/d52/d47/de8/d7f/l10a 0 2024-09-18T12:49:36.348 INFO:tasks.workunit.client.0.smithi078.stdout:1/795: mknod d0/d8/da/d3e/d50/da7/c10d 0 2024-09-18T12:49:36.350 INFO:tasks.workunit.client.0.smithi078.stdout:2/763: rename d4/dd/d8a to d4/db/dc/dc0/df2 0 2024-09-18T12:49:36.351 INFO:tasks.workunit.client.0.smithi078.stdout:7/753: write d7/d9/d14/d22/d35/d49/d56/ff7 [1117441,121386] 0 2024-09-18T12:49:36.352 INFO:tasks.workunit.client.0.smithi078.stdout:1/796: fsync d0/d8/da/d3e/d58/d6e/d52/f6f 0 2024-09-18T12:49:36.354 INFO:tasks.workunit.client.0.smithi078.stdout:2/764: stat d4/dd/f8b 0 2024-09-18T12:49:36.359 INFO:tasks.workunit.client.0.smithi078.stdout:3/761: dwrite d9/d13/d33/d34/d9e/fe2 [0,4194304] 0 2024-09-18T12:49:36.364 INFO:tasks.workunit.client.0.smithi078.stdout:2/765: rmdir d4/db/d45 39 2024-09-18T12:49:36.371 INFO:tasks.workunit.client.0.smithi078.stdout:7/754: truncate d7/d9/d14/d22/fb1 1928215 0 2024-09-18T12:49:36.372 INFO:tasks.workunit.client.0.smithi078.stdout:7/755: dread - d7/d9/d14/d22/d35/d49/d61/feb zero size 2024-09-18T12:49:36.376 INFO:tasks.workunit.client.0.smithi078.stdout:2/766: mknod d4/d20/d85/cf3 0 2024-09-18T12:49:36.377 INFO:tasks.workunit.client.0.smithi078.stdout:7/756: rmdir d7/d9/dd7/d3b/d9d 39 2024-09-18T12:49:36.379 INFO:tasks.workunit.client.0.smithi078.stdout:2/767: stat d4/db/d45/l54 0 2024-09-18T12:49:36.380 INFO:tasks.workunit.client.0.smithi078.stdout:7/757: mkdir d7/d26/d105 0 2024-09-18T12:49:36.381 INFO:tasks.workunit.client.0.smithi078.stdout:2/768: read - d4/d8/d23/d52/d5f/d81/dac/fe9 zero size 2024-09-18T12:49:36.382 INFO:tasks.workunit.client.0.smithi078.stdout:3/762: rename d9/d13/d33/d4e/f25 to d9/d13/ff4 0 2024-09-18T12:49:36.383 INFO:tasks.workunit.client.0.smithi078.stdout:2/769: read d4/d8/d23/d52/d5f/d86/f7a [3249249,87228] 0 2024-09-18T12:49:36.389 INFO:tasks.workunit.client.0.smithi078.stdout:2/770: creat d4/d8/d23/ff4 x:0 0 0 2024-09-18T12:49:36.389 INFO:tasks.workunit.client.0.smithi078.stdout:7/758: link d7/d9/d14/d22/f57 d7/d9/d14/d22/d3e/f106 0 2024-09-18T12:49:36.391 INFO:tasks.workunit.client.0.smithi078.stdout:2/771: creat d4/d8/d23/d52/d5f/d81/dae/dbd/ff5 x:0 0 0 2024-09-18T12:49:36.393 INFO:tasks.workunit.client.0.smithi078.stdout:3/763: dread d9/f3f [0,4194304] 0 2024-09-18T12:49:36.394 INFO:tasks.workunit.client.0.smithi078.stdout:2/772: symlink d4/d1a/lf6 0 2024-09-18T12:49:36.394 INFO:tasks.workunit.client.0.smithi078.stdout:3/764: write d9/d54/d6c/fba [792258,21676] 0 2024-09-18T12:49:36.396 INFO:tasks.workunit.client.0.smithi078.stdout:3/765: write d9/d2f/d43/d62/fad [933985,100787] 0 2024-09-18T12:49:36.396 INFO:tasks.workunit.client.0.smithi078.stdout:2/773: readlink d4/db/dc/le4 0 2024-09-18T12:49:36.401 INFO:tasks.workunit.client.0.smithi078.stdout:3/766: creat d9/d13/d33/d3c/ff5 x:0 0 0 2024-09-18T12:49:36.412 INFO:tasks.workunit.client.0.smithi078.stdout:7/759: dread d7/d9/dd7/f36 [0,4194304] 0 2024-09-18T12:49:36.421 INFO:tasks.workunit.client.0.smithi078.stdout:7/760: dwrite d7/d9/d14/d22/d35/d49/f7c [0,4194304] 0 2024-09-18T12:49:36.421 INFO:tasks.workunit.client.0.smithi078.stdout:3/767: dread d9/d2f/f3d [0,4194304] 0 2024-09-18T12:49:36.422 INFO:tasks.workunit.client.0.smithi078.stdout:1/797: dread d0/d8/da/d3e/d58/d6e/f51 [0,4194304] 0 2024-09-18T12:49:36.428 INFO:tasks.workunit.client.0.smithi078.stdout:2/774: truncate d4/d8/d23/d52/d5f/d86/d3b/d55/f75 7938701 0 2024-09-18T12:49:36.430 INFO:tasks.workunit.client.0.smithi078.stdout:7/761: mknod d7/d9/c107 0 2024-09-18T12:49:36.434 INFO:tasks.workunit.client.0.smithi078.stdout:1/798: dwrite d0/d5b/d6d/dc2/fd5 [0,4194304] 0 2024-09-18T12:49:36.436 INFO:tasks.workunit.client.0.smithi078.stdout:7/762: mkdir d7/d5d/d87/d108 0 2024-09-18T12:49:36.438 INFO:tasks.workunit.client.0.smithi078.stdout:7/763: write d7/d9/d14/d22/d35/d49/f7c [4700886,122393] 0 2024-09-18T12:49:36.440 INFO:tasks.workunit.client.0.smithi078.stdout:7/764: write d7/d9/f13 [2689785,22899] 0 2024-09-18T12:49:36.441 INFO:tasks.workunit.client.0.smithi078.stdout:1/799: mkdir d0/d8/da/d3e/d58/d6e/d8c/d9d/d10e 0 2024-09-18T12:49:36.447 INFO:tasks.workunit.client.0.smithi078.stdout:2/775: rename d4/l46 to d4/db/lf7 0 2024-09-18T12:49:36.447 INFO:tasks.workunit.client.0.smithi078.stdout:7/765: dwrite d7/d5d/f6d [0,4194304] 0 2024-09-18T12:49:36.449 INFO:tasks.workunit.client.0.smithi078.stdout:2/776: fsync d4/d8/d23/d52/d5f/d81/dae/dbd/fd5 0 2024-09-18T12:49:36.449 INFO:tasks.workunit.client.0.smithi078.stdout:7/766: chown d7/d26/d4f/l53 15378626 1 2024-09-18T12:49:36.451 INFO:tasks.workunit.client.0.smithi078.stdout:3/768: truncate d9/d54/fb4 255199 0 2024-09-18T12:49:36.452 INFO:tasks.workunit.client.0.smithi078.stdout:1/800: mkdir d0/d8/da/d3e/d58/d6e/d8c/dd3/d10f 0 2024-09-18T12:49:36.453 INFO:tasks.workunit.client.0.smithi078.stdout:1/801: stat d0/d8/da/d3e/d58/d6e/fc5 0 2024-09-18T12:49:36.454 INFO:tasks.workunit.client.0.smithi078.stdout:3/769: dread d9/d54/d7f/dae/dd4/fe0 [0,4194304] 0 2024-09-18T12:49:36.463 INFO:tasks.workunit.client.0.smithi078.stdout:3/770: read d9/d2f/d43/fed [253926,104142] 0 2024-09-18T12:49:36.465 INFO:tasks.workunit.client.0.smithi078.stdout:1/802: symlink d0/d8/da/d3e/l110 0 2024-09-18T12:49:36.472 INFO:tasks.workunit.client.0.smithi078.stdout:1/803: creat d0/d8/da/d3e/d58/d6e/d8c/d9d/f111 x:0 0 0 2024-09-18T12:49:36.473 INFO:tasks.workunit.client.0.smithi078.stdout:2/777: getdents d4/d8 0 2024-09-18T12:49:36.474 INFO:tasks.workunit.client.0.smithi078.stdout:3/771: truncate d9/d13/d33/f51 8961141 0 2024-09-18T12:49:36.476 INFO:tasks.workunit.client.0.smithi078.stdout:2/778: chown d4/d8/d23/d52/d5f/cb0 9 1 2024-09-18T12:49:36.478 INFO:tasks.workunit.client.0.smithi078.stdout:7/767: dwrite d7/d26/f29 [4194304,4194304] 0 2024-09-18T12:49:36.479 INFO:tasks.workunit.client.0.smithi078.stdout:3/772: fdatasync d9/d54/d6c/d9f/fb7 0 2024-09-18T12:49:36.482 INFO:tasks.workunit.client.0.smithi078.stdout:2/779: write d4/db/dc/f62 [849701,116709] 0 2024-09-18T12:49:36.482 INFO:tasks.workunit.client.0.smithi078.stdout:1/804: creat d0/d8/da/d3e/d50/f112 x:0 0 0 2024-09-18T12:49:36.486 INFO:tasks.workunit.client.0.smithi078.stdout:2/780: dread d4/db/dc/dc0/df2/dd3/fdd [0,4194304] 0 2024-09-18T12:49:36.488 INFO:tasks.workunit.client.0.smithi078.stdout:7/768: symlink d7/d9/d14/d22/d3e/d95/d97/l109 0 2024-09-18T12:49:36.495 INFO:tasks.workunit.client.0.smithi078.stdout:1/805: write d0/d8/da/d3e/d58/d6e/d52/d47/f69 [6296001,129028] 0 2024-09-18T12:49:36.504 INFO:tasks.workunit.client.0.smithi078.stdout:3/773: dread d9/d13/d33/d3c/f66 [0,4194304] 0 2024-09-18T12:49:36.505 INFO:tasks.workunit.client.0.smithi078.stdout:3/774: fsync d9/d13/d33/d3c/ff5 0 2024-09-18T12:49:36.506 INFO:tasks.workunit.client.0.smithi078.stdout:3/775: chown d9/d54/d6c/fba 0 1 2024-09-18T12:49:36.506 INFO:tasks.workunit.client.0.smithi078.stdout:1/806: symlink d0/d8/da/d3e/d58/d6e/d8c/l113 0 2024-09-18T12:49:36.509 INFO:tasks.workunit.client.0.smithi078.stdout:1/807: rmdir d0/d8/da/d3e/d58/d6e/d8c/d9d/db8 39 2024-09-18T12:49:36.510 INFO:tasks.workunit.client.0.smithi078.stdout:3/776: dread d9/d54/d6c/fba [0,4194304] 0 2024-09-18T12:49:36.513 INFO:tasks.workunit.client.0.smithi078.stdout:7/769: dwrite d7/d26/f79 [0,4194304] 0 2024-09-18T12:49:36.514 INFO:tasks.workunit.client.0.smithi078.stdout:1/808: rmdir d0/d8/da/d45 39 2024-09-18T12:49:36.521 INFO:tasks.workunit.client.0.smithi078.stdout:1/809: rename d0/d8/da to d0/d8/daa/db5/d114 0 2024-09-18T12:49:36.522 INFO:tasks.workunit.client.0.smithi078.stdout:7/770: write d7/d26/d84/fa1 [2270964,103254] 0 2024-09-18T12:49:36.527 INFO:tasks.workunit.client.0.smithi078.stdout:7/771: stat d7/d5d/lab 0 2024-09-18T12:49:36.529 INFO:tasks.workunit.client.0.smithi078.stdout:3/777: getdents d9/d54/d7f/dae/dd4 0 2024-09-18T12:49:36.530 INFO:tasks.workunit.client.0.smithi078.stdout:1/810: dwrite d0/d8/f3f [0,4194304] 0 2024-09-18T12:49:36.531 INFO:tasks.workunit.client.0.smithi078.stdout:3/778: dread - d9/d13/d63/fd6 zero size 2024-09-18T12:49:36.532 INFO:tasks.workunit.client.0.smithi078.stdout:1/811: stat d0/d8/daa/db5/d114/d3e/d50/d74 0 2024-09-18T12:49:36.534 INFO:tasks.workunit.client.0.smithi078.stdout:7/772: creat d7/d9/d14/d22/d35/d49/d61/d7b/f10a x:0 0 0 2024-09-18T12:49:36.535 INFO:tasks.workunit.client.0.smithi078.stdout:3/779: fsync d9/d13/ff4 0 2024-09-18T12:49:36.543 INFO:tasks.workunit.client.0.smithi078.stdout:7/773: dwrite d7/d9/d4d/d6f/f8a [0,4194304] 0 2024-09-18T12:49:36.552 INFO:tasks.workunit.client.0.smithi078.stdout:3/780: truncate d9/d2f/d43/d62/fad 1810155 0 2024-09-18T12:49:36.561 INFO:tasks.workunit.client.0.smithi078.stdout:1/812: dwrite d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/f9e [0,4194304] 0 2024-09-18T12:49:36.564 INFO:tasks.workunit.client.0.smithi078.stdout:1/813: dread - d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d9d/f111 zero size 2024-09-18T12:49:36.565 INFO:tasks.workunit.client.0.smithi078.stdout:3/781: dwrite d9/d13/d33/d34/fe1 [0,4194304] 0 2024-09-18T12:49:36.577 INFO:tasks.workunit.client.0.smithi078.stdout:7/774: dread d7/d9/d14/f23 [0,4194304] 0 2024-09-18T12:49:36.583 INFO:tasks.workunit.client.0.smithi078.stdout:7/775: dwrite d7/d5d/d87/ffb [0,4194304] 0 2024-09-18T12:49:36.584 INFO:tasks.workunit.client.0.smithi078.stdout:7/776: chown d7/d9/d14/d22/d3e/f40 1003856444 1 2024-09-18T12:49:36.585 INFO:tasks.workunit.client.0.smithi078.stdout:7/777: chown d7/d26/d4f/cfd 77636624 1 2024-09-18T12:49:36.623 INFO:tasks.workunit.client.0.smithi078.stdout:1/814: fdatasync d0/d8/daa/db5/d114/f23 0 2024-09-18T12:49:36.632 INFO:tasks.workunit.client.0.smithi078.stdout:7/778: write d7/d26/d84/fb4 [469047,26329] 0 2024-09-18T12:49:36.633 INFO:tasks.workunit.client.0.smithi078.stdout:1/815: creat d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/f115 x:0 0 0 2024-09-18T12:49:36.635 INFO:tasks.workunit.client.0.smithi078.stdout:3/782: dwrite d9/d54/d6c/d9f/fb7 [0,4194304] 0 2024-09-18T12:49:36.636 INFO:tasks.workunit.client.0.smithi078.stdout:7/779: mkdir d7/d9/d4d/de2/d10b 0 2024-09-18T12:49:36.639 INFO:tasks.workunit.client.0.smithi078.stdout:1/816: stat d0/d8/daa/db5/d114/c73 0 2024-09-18T12:49:36.640 INFO:tasks.workunit.client.0.smithi078.stdout:3/783: creat d9/d13/d33/d34/d97/dc2/ff6 x:0 0 0 2024-09-18T12:49:36.643 INFO:tasks.workunit.client.0.smithi078.stdout:7/780: rename d7/d9/d14/d22/d3e/d95/d97/f7f to d7/d26/d4f/f10c 0 2024-09-18T12:49:36.644 INFO:tasks.workunit.client.0.smithi078.stdout:3/784: creat d9/d13/d33/d4e/ff7 x:0 0 0 2024-09-18T12:49:36.645 INFO:tasks.workunit.client.0.smithi078.stdout:7/781: truncate d7/d9/d14/d22/d3e/d95/db2/f101 949506 0 2024-09-18T12:49:36.645 INFO:tasks.workunit.client.0.smithi078.stdout:1/817: creat d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f/f116 x:0 0 0 2024-09-18T12:49:36.648 INFO:tasks.workunit.client.0.smithi078.stdout:3/785: mkdir d9/d54/d6c/df8 0 2024-09-18T12:49:36.648 INFO:tasks.workunit.client.0.smithi078.stdout:7/782: rmdir d7/d9/d14/d22/d3e/d95 39 2024-09-18T12:49:36.653 INFO:tasks.workunit.client.0.smithi078.stdout:3/786: rename d9/d2f/d43/fc4 to d9/d13/d33/d34/d9e/df1/ff9 0 2024-09-18T12:49:36.660 INFO:tasks.workunit.client.0.smithi078.stdout:3/787: truncate d9/d2f/f77 608306 0 2024-09-18T12:49:36.663 INFO:tasks.workunit.client.0.smithi078.stdout:1/818: dread d0/d8/ff [4194304,4194304] 0 2024-09-18T12:49:36.666 INFO:tasks.workunit.client.0.smithi078.stdout:7/783: dwrite d7/d9/dd7/f36 [0,4194304] 0 2024-09-18T12:49:36.668 INFO:tasks.workunit.client.0.smithi078.stdout:1/819: mknod d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d9d/dc3/c117 0 2024-09-18T12:49:36.671 INFO:tasks.workunit.client.0.smithi078.stdout:7/784: unlink d7/d9/dd7/f38 0 2024-09-18T12:49:36.675 INFO:tasks.workunit.client.0.smithi078.stdout:3/788: write d9/d13/d37/fa3 [618904,119287] 0 2024-09-18T12:49:36.676 INFO:tasks.workunit.client.0.smithi078.stdout:7/785: dread d7/d9/dd7/d3b/f7e [0,4194304] 0 2024-09-18T12:49:36.676 INFO:tasks.workunit.client.0.smithi078.stdout:1/820: fdatasync d0/fca 0 2024-09-18T12:49:36.677 INFO:tasks.workunit.client.0.smithi078.stdout:7/786: dread - d7/d9/d14/dde/ff4 zero size 2024-09-18T12:49:36.679 INFO:tasks.workunit.client.0.smithi078.stdout:3/789: creat d9/d54/d7f/ffa x:0 0 0 2024-09-18T12:49:36.680 INFO:tasks.workunit.client.0.smithi078.stdout:3/790: readlink d9/d13/d63/laf 0 2024-09-18T12:49:36.681 INFO:tasks.workunit.client.0.smithi078.stdout:7/787: unlink d7/d9/dd7/d3b/f7e 0 2024-09-18T12:49:36.688 INFO:tasks.workunit.client.0.smithi078.stdout:7/788: getdents d7/d9/d14/d22/d35/d49/d56/d8d 0 2024-09-18T12:49:36.695 INFO:tasks.workunit.client.0.smithi078.stdout:7/789: dwrite d7/d5d/f6d [0,4194304] 0 2024-09-18T12:49:36.698 INFO:tasks.workunit.client.0.smithi078.stdout:7/790: write d7/d9/d14/d22/d35/fdd [340753,126973] 0 2024-09-18T12:49:36.701 INFO:tasks.workunit.client.0.smithi078.stdout:7/791: chown d7/d9/d14/d22/d35/d49/d61/d89/f92 1 1 2024-09-18T12:49:36.701 INFO:tasks.workunit.client.0.smithi078.stdout:1/821: dread d0/d8/daa/db5/d114/d3e/d58/d6e/d52/f78 [0,4194304] 0 2024-09-18T12:49:36.703 INFO:tasks.workunit.client.0.smithi078.stdout:3/791: dread d9/d13/d63/d78/f79 [0,4194304] 0 2024-09-18T12:49:36.704 INFO:tasks.workunit.client.0.smithi078.stdout:7/792: mknod d7/d5d/d7a/c10d 0 2024-09-18T12:49:36.707 INFO:tasks.workunit.client.0.smithi078.stdout:1/822: symlink d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/l118 0 2024-09-18T12:49:36.710 INFO:tasks.workunit.client.0.smithi078.stdout:3/792: dwrite d9/d13/d63/fd6 [0,4194304] 0 2024-09-18T12:49:36.712 INFO:tasks.workunit.client.0.smithi078.stdout:0/887: sync 2024-09-18T12:49:36.713 INFO:tasks.workunit.client.0.smithi078.stdout:8/822: sync 2024-09-18T12:49:36.726 INFO:tasks.workunit.client.0.smithi078.stdout:7/793: dread d7/d9/dd7/fa6 [8388608,4194304] 0 2024-09-18T12:49:36.727 INFO:tasks.workunit.client.0.smithi078.stdout:7/794: fdatasync d7/d5d/d7a/f4a 0 2024-09-18T12:49:36.737 INFO:tasks.workunit.client.0.smithi078.stdout:3/793: rename d9/d2f/d43/l7c to d9/d13/d33/d34/lfb 0 2024-09-18T12:49:36.739 INFO:tasks.workunit.client.0.smithi078.stdout:0/888: read d3/d82/d10d/f62 [3682806,25002] 0 2024-09-18T12:49:36.739 INFO:tasks.workunit.client.0.smithi078.stdout:8/823: mkdir d0/d39/dbc/d116 0 2024-09-18T12:49:36.740 INFO:tasks.workunit.client.0.smithi078.stdout:0/889: readlink d3/d1f/d2e/d4e/db2/l119 0 2024-09-18T12:49:36.745 INFO:tasks.workunit.client.0.smithi078.stdout:8/824: creat d0/db7/f117 x:0 0 0 2024-09-18T12:49:36.746 INFO:tasks.workunit.client.0.smithi078.stdout:8/825: stat d0/d39/d4c/d77/d7d/d3e/ff5 0 2024-09-18T12:49:36.747 INFO:tasks.workunit.client.0.smithi078.stdout:0/890: read - d3/d82/d10d/d7c/da3/fb6 zero size 2024-09-18T12:49:36.749 INFO:tasks.workunit.client.0.smithi078.stdout:3/794: dread d9/d54/f8e [0,4194304] 0 2024-09-18T12:49:36.749 INFO:tasks.workunit.client.0.smithi078.stdout:7/795: creat d7/d9/d4d/dff/f10e x:0 0 0 2024-09-18T12:49:36.751 INFO:tasks.workunit.client.0.smithi078.stdout:1/823: creat d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d9d/f119 x:0 0 0 2024-09-18T12:49:36.752 INFO:tasks.workunit.client.0.smithi078.stdout:1/824: chown d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/dd3/fdd 4 1 2024-09-18T12:49:36.753 INFO:tasks.workunit.client.0.smithi078.stdout:1/825: chown d0/d8/daa/db5/d114/d3e/d58/d6e/c68 625029 1 2024-09-18T12:49:36.753 INFO:tasks.workunit.client.0.smithi078.stdout:8/826: fsync d0/d39/dbc/fbf 0 2024-09-18T12:49:36.755 INFO:tasks.workunit.client.0.smithi078.stdout:7/796: symlink d7/d9/d14/d22/d35/d49/d61/d89/l10f 0 2024-09-18T12:49:36.758 INFO:tasks.workunit.client.0.smithi078.stdout:0/891: unlink d3/d1f/d2e/d4e/la5 0 2024-09-18T12:49:36.761 INFO:tasks.workunit.client.0.smithi078.stdout:8/827: stat d0/d7/d1e/d4b/dc6/fd3 0 2024-09-18T12:49:36.763 INFO:tasks.workunit.client.0.smithi078.stdout:7/797: rename d7/d3c to d7/d9/d14/d22/d35/d49/d61/d110 0 2024-09-18T12:49:36.765 INFO:tasks.workunit.client.0.smithi078.stdout:1/826: write d0/d8/daa/db5/d114/d3e/d58/d6e/d52/f36 [827946,106381] 0 2024-09-18T12:49:36.766 INFO:tasks.workunit.client.0.smithi078.stdout:0/892: creat d3/d1f/d2e/d68/dc9/dcd/d128/f132 x:0 0 0 2024-09-18T12:49:36.767 INFO:tasks.workunit.client.0.smithi078.stdout:3/795: truncate d9/d13/d33/d3c/f87 1704257 0 2024-09-18T12:49:36.769 INFO:tasks.workunit.client.0.smithi078.stdout:7/798: chown d7/d9/dd7/d3b/fef 14179 1 2024-09-18T12:49:36.769 INFO:tasks.workunit.client.0.smithi078.stdout:8/828: dread d0/f16 [0,4194304] 0 2024-09-18T12:49:36.769 INFO:tasks.workunit.client.0.smithi078.stdout:1/827: rmdir d0/d8/daa/db5/d114/d3e/d50 39 2024-09-18T12:49:36.770 INFO:tasks.workunit.client.0.smithi078.stdout:7/799: chown d7/d9/d14/d22/d35/d49/d61/d7b 1347 1 2024-09-18T12:49:36.771 INFO:tasks.workunit.client.0.smithi078.stdout:8/829: write d0/d39/dbc/fbf [1392052,73139] 0 2024-09-18T12:49:36.772 INFO:tasks.workunit.client.0.smithi078.stdout:7/800: chown d7/d9/f2f 10 1 2024-09-18T12:49:36.772 INFO:tasks.workunit.client.0.smithi078.stdout:3/796: fdatasync d9/d2f/f8c 0 2024-09-18T12:49:36.779 INFO:tasks.workunit.client.0.smithi078.stdout:0/893: write d3/d1f/d2e/d4e/d37/fe6 [80814,33621] 0 2024-09-18T12:49:36.783 INFO:tasks.workunit.client.0.smithi078.stdout:8/830: symlink d0/d39/d4c/d77/d7d/d3e/l118 0 2024-09-18T12:49:36.783 INFO:tasks.workunit.client.0.smithi078.stdout:8/831: readlink d0/d39/d4c/d77/dd7/d10b/l51 0 2024-09-18T12:49:36.785 INFO:tasks.workunit.client.0.smithi078.stdout:3/797: creat d9/d54/d89/ffc x:0 0 0 2024-09-18T12:49:36.787 INFO:tasks.workunit.client.0.smithi078.stdout:7/801: mkdir d7/d9/d14/d22/d35/d49/d61/d7b/d111 0 2024-09-18T12:49:36.790 INFO:tasks.workunit.client.0.smithi078.stdout:8/832: stat d0/d7/l2b 0 2024-09-18T12:49:36.791 INFO:tasks.workunit.client.0.smithi078.stdout:3/798: dwrite d9/d54/d89/ffc [0,4194304] 0 2024-09-18T12:49:36.792 INFO:tasks.workunit.client.0.smithi078.stdout:3/799: chown d9/d29/d4b/d4c/fcf 6346 1 2024-09-18T12:49:36.794 INFO:tasks.workunit.client.0.smithi078.stdout:0/894: readlink d3/d1f/d2e/d68/dc9/l104 0 2024-09-18T12:49:36.797 INFO:tasks.workunit.client.0.smithi078.stdout:8/833: fsync d0/d7/dc/d1f/f28 0 2024-09-18T12:49:36.797 INFO:tasks.workunit.client.0.smithi078.stdout:1/828: creat d0/d8/daa/db5/d114/d3e/d50/f11a x:0 0 0 2024-09-18T12:49:36.798 INFO:tasks.workunit.client.0.smithi078.stdout:3/800: truncate d9/f12 111372 0 2024-09-18T12:49:36.802 INFO:tasks.workunit.client.0.smithi078.stdout:3/801: fsync d9/f61 0 2024-09-18T12:49:36.803 INFO:tasks.workunit.client.0.smithi078.stdout:0/895: dread d3/d1f/d2e/d4e/d37/d72/f78 [0,4194304] 0 2024-09-18T12:49:36.803 INFO:tasks.workunit.client.0.smithi078.stdout:1/829: mknod d0/d8/daa/db5/d114/d3e/d58/d6e/d52/c11b 0 2024-09-18T12:49:36.805 INFO:tasks.workunit.client.0.smithi078.stdout:8/834: symlink d0/d7/dc/d1f/l119 0 2024-09-18T12:49:36.809 INFO:tasks.workunit.client.0.smithi078.stdout:7/802: dwrite d7/d5d/d7a/d62/f8c [0,4194304] 0 2024-09-18T12:49:36.814 INFO:tasks.workunit.client.0.smithi078.stdout:1/830: rename d0/d8/daa/db5/d114/d3e/d50/d10b to d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f/d11c 0 2024-09-18T12:49:36.820 INFO:tasks.workunit.client.0.smithi078.stdout:0/896: write d3/d1f/f63 [1047842,98155] 0 2024-09-18T12:49:36.824 INFO:tasks.workunit.client.0.smithi078.stdout:7/803: dread d7/f33 [0,4194304] 0 2024-09-18T12:49:36.825 INFO:tasks.workunit.client.0.smithi078.stdout:1/831: dread d0/d8/daa/db5/d114/d3e/d58/d6e/d52/f36 [0,4194304] 0 2024-09-18T12:49:36.827 INFO:tasks.workunit.client.0.smithi078.stdout:1/832: write d0/f108 [154245,67545] 0 2024-09-18T12:49:36.832 INFO:tasks.workunit.client.0.smithi078.stdout:0/897: link d3/d82/d10d/d7c/da3/cca d3/d82/dd7/df5/c133 0 2024-09-18T12:49:36.832 INFO:tasks.workunit.client.0.smithi078.stdout:7/804: dread d7/d9/d14/d22/d3e/d95/db2/f101 [0,4194304] 0 2024-09-18T12:49:36.834 INFO:tasks.workunit.client.0.smithi078.stdout:3/802: dwrite d9/d13/d33/f51 [0,4194304] 0 2024-09-18T12:49:36.836 INFO:tasks.workunit.client.0.smithi078.stdout:1/833: dread d0/d8/daa/db5/d114/d3e/d50/d60/f9b [0,4194304] 0 2024-09-18T12:49:36.838 INFO:tasks.workunit.client.0.smithi078.stdout:0/898: rename d3/d1f/d2e/d4e/d37/d72/d120 to d3/d82/dd7/d134 0 2024-09-18T12:49:36.839 INFO:tasks.workunit.client.0.smithi078.stdout:1/834: write d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f/ffa [898600,68427] 0 2024-09-18T12:49:36.841 INFO:tasks.workunit.client.0.smithi078.stdout:3/803: truncate d9/d13/f1d 2673170 0 2024-09-18T12:49:36.844 INFO:tasks.workunit.client.0.smithi078.stdout:1/835: symlink d0/d5b/d6d/l11d 0 2024-09-18T12:49:36.845 INFO:tasks.workunit.client.0.smithi078.stdout:1/836: chown d0/c4c 493690 1 2024-09-18T12:49:36.846 INFO:tasks.workunit.client.0.smithi078.stdout:3/804: mkdir d9/d54/d6c/d9f/dfd 0 2024-09-18T12:49:36.851 INFO:tasks.workunit.client.0.smithi078.stdout:0/899: dwrite d3/d1f/d2e/d68/dc9/dcd/f11b [0,4194304] 0 2024-09-18T12:49:36.852 INFO:tasks.workunit.client.0.smithi078.stdout:0/900: chown d3/d1f/d2e/d4e/d37/d72 468 1 2024-09-18T12:49:36.858 INFO:tasks.workunit.client.0.smithi078.stdout:3/805: dwrite d9/d54/d7f/fec [0,4194304] 0 2024-09-18T12:49:36.860 INFO:tasks.workunit.client.0.smithi078.stdout:7/805: dread d7/d9/d14/d22/d3e/f40 [0,4194304] 0 2024-09-18T12:49:36.861 INFO:tasks.workunit.client.0.smithi078.stdout:3/806: chown d9/d13/d33/d34/d97/dc2/fe3 28 1 2024-09-18T12:49:36.865 INFO:tasks.workunit.client.0.smithi078.stdout:7/806: fdatasync d7/d9/d14/f23 0 2024-09-18T12:49:36.866 INFO:tasks.workunit.client.0.smithi078.stdout:7/807: chown d7/d26/f42 82485798 1 2024-09-18T12:49:36.867 INFO:tasks.workunit.client.0.smithi078.stdout:3/807: mkdir d9/d13/d63/d78/dfe 0 2024-09-18T12:49:36.868 INFO:tasks.workunit.client.0.smithi078.stdout:7/808: chown d7/d5d/d87/d108 0 1 2024-09-18T12:49:36.872 INFO:tasks.workunit.client.0.smithi078.stdout:1/837: write d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/f64 [3955946,114385] 0 2024-09-18T12:49:36.875 INFO:tasks.workunit.client.0.smithi078.stdout:1/838: stat d0/d8/daa/db5/d114/d3e/d58/d6e/d8c 0 2024-09-18T12:49:36.875 INFO:tasks.workunit.client.0.smithi078.stdout:0/901: rename d3/d1f/d2e/d8f/lb1 to d3/d1f/d2e/d4e/l135 0 2024-09-18T12:49:36.877 INFO:tasks.workunit.client.0.smithi078.stdout:3/808: symlink d9/d13/lff 0 2024-09-18T12:49:36.879 INFO:tasks.workunit.client.0.smithi078.stdout:0/902: chown d3/d1f/d2e/d4e/cf3 3667 1 2024-09-18T12:49:36.881 INFO:tasks.workunit.client.0.smithi078.stdout:7/809: dwrite d7/d26/d4f/f10c [0,4194304] 0 2024-09-18T12:49:36.897 INFO:tasks.workunit.client.0.smithi078.stdout:3/809: dwrite d9/d54/d89/ffc [4194304,4194304] 0 2024-09-18T12:49:36.897 INFO:tasks.workunit.client.0.smithi078.stdout:0/903: dwrite d3/f93 [0,4194304] 0 2024-09-18T12:49:36.897 INFO:tasks.workunit.client.0.smithi078.stdout:1/839: write d0/d8/daa/db5/d114/d3e/d58/d6e/d52/f78 [1416608,107515] 0 2024-09-18T12:49:36.898 INFO:tasks.workunit.client.0.smithi078.stdout:7/810: dwrite d7/d26/f42 [0,4194304] 0 2024-09-18T12:49:37.045 INFO:tasks.workunit.client.0.smithi078.stdout:1/840: mknod d0/d5b/d6d/dc2/c11e 0 2024-09-18T12:49:37.046 INFO:tasks.workunit.client.0.smithi078.stdout:3/810: symlink d9/d13/d33/d34/d97/l100 0 2024-09-18T12:49:37.047 INFO:tasks.workunit.client.0.smithi078.stdout:0/904: creat d3/d1f/d2e/d4e/db2/d116/f136 x:0 0 0 2024-09-18T12:49:37.048 INFO:tasks.workunit.client.0.smithi078.stdout:3/811: readlink d9/d2f/ld5 0 2024-09-18T12:49:37.049 INFO:tasks.workunit.client.0.smithi078.stdout:1/841: mkdir d0/d8/daa/db5/d114/d3e/d50/d11f 0 2024-09-18T12:49:37.049 INFO:tasks.workunit.client.0.smithi078.stdout:3/812: chown d9/d54/f8e 275 1 2024-09-18T12:49:37.051 INFO:tasks.workunit.client.0.smithi078.stdout:3/813: read d9/d13/ff4 [981811,64455] 0 2024-09-18T12:49:37.053 INFO:tasks.workunit.client.0.smithi078.stdout:1/842: creat d0/d8/daa/db5/d114/d3e/d50/da7/f120 x:0 0 0 2024-09-18T12:49:37.054 INFO:tasks.workunit.client.0.smithi078.stdout:1/843: fsync d0/d8/f3f 0 2024-09-18T12:49:37.055 INFO:tasks.workunit.client.0.smithi078.stdout:0/905: dwrite d3/d1f/d2e/d68/dc9/dcd/f11b [4194304,4194304] 0 2024-09-18T12:49:37.060 INFO:tasks.workunit.client.0.smithi078.stdout:3/814: creat d9/d2f/d43/d62/f101 x:0 0 0 2024-09-18T12:49:37.062 INFO:tasks.workunit.client.0.smithi078.stdout:3/815: write d9/d54/f8e [3484323,95057] 0 2024-09-18T12:49:37.065 INFO:tasks.workunit.client.0.smithi078.stdout:3/816: read d9/d2f/f77 [189392,64716] 0 2024-09-18T12:49:37.066 INFO:tasks.workunit.client.0.smithi078.stdout:3/817: chown d9/d2f/d43/fed 90391805 1 2024-09-18T12:49:37.071 INFO:tasks.workunit.client.0.smithi078.stdout:3/818: link d9/d54/d6c/d9f/lbc d9/d29/d4b/l102 0 2024-09-18T12:49:37.073 INFO:tasks.workunit.client.0.smithi078.stdout:9/877: sync 2024-09-18T12:49:37.077 INFO:tasks.workunit.client.0.smithi078.stdout:9/878: rename d5/d7/d32/d2a/d6b to d5/d7/d32/d2a/d36/d11b 0 2024-09-18T12:49:37.080 INFO:tasks.workunit.client.0.smithi078.stdout:3/819: dread d9/d54/d89/fe5 [0,4194304] 0 2024-09-18T12:49:37.082 INFO:tasks.workunit.client.0.smithi078.stdout:3/820: fsync d9/d29/f24 0 2024-09-18T12:49:37.084 INFO:tasks.workunit.client.0.smithi078.stdout:3/821: fdatasync d9/d2f/f77 0 2024-09-18T12:49:37.085 INFO:tasks.workunit.client.0.smithi078.stdout:3/822: chown d9/d54/d89/d92/db6/dde 15 1 2024-09-18T12:49:37.087 INFO:tasks.workunit.client.0.smithi078.stdout:3/823: write d9/d13/d33/d4e/ff7 [28526,114714] 0 2024-09-18T12:49:37.092 INFO:tasks.workunit.client.0.smithi078.stdout:9/879: dread d5/d5c/f88 [4194304,4194304] 0 2024-09-18T12:49:37.094 INFO:tasks.workunit.client.0.smithi078.stdout:3/824: rmdir d9/d2f/d43 39 2024-09-18T12:49:37.107 INFO:tasks.workunit.client.0.smithi078.stdout:0/906: dwrite d3/d1f/df2/ffd [0,4194304] 0 2024-09-18T12:49:37.111 INFO:tasks.workunit.client.0.smithi078.stdout:3/825: dread d9/d13/f1d [0,4194304] 0 2024-09-18T12:49:37.111 INFO:tasks.workunit.client.0.smithi078.stdout:3/826: chown d9/f27 0 1 2024-09-18T12:49:37.119 INFO:tasks.workunit.client.0.smithi078.stdout:0/907: symlink d3/d82/d10d/d7c/da3/de2/d12f/l137 0 2024-09-18T12:49:37.122 INFO:tasks.workunit.client.0.smithi078.stdout:9/880: write d5/d7/d32/d2a/f7d [668200,86460] 0 2024-09-18T12:49:37.123 INFO:tasks.workunit.client.0.smithi078.stdout:0/908: mkdir d3/d1f/d2e/d4e/db2/d116/d138 0 2024-09-18T12:49:37.123 INFO:tasks.workunit.client.0.smithi078.stdout:9/881: chown d5/d7/d32/d2a/d36/d11b/f57 47 1 2024-09-18T12:49:37.124 INFO:tasks.workunit.client.0.smithi078.stdout:0/909: chown d3/d1f/d2e/d4e/db2/fda 238827 1 2024-09-18T12:49:37.136 INFO:tasks.workunit.client.0.smithi078.stdout:3/827: truncate d9/d54/d6c/d9f/fb7 1768032 0 2024-09-18T12:49:37.138 INFO:tasks.workunit.client.0.smithi078.stdout:3/828: chown d9/d29/c85 7260 1 2024-09-18T12:49:37.142 INFO:tasks.workunit.client.0.smithi078.stdout:3/829: unlink d9/d13/d33/l67 0 2024-09-18T12:49:37.145 INFO:tasks.workunit.client.0.smithi078.stdout:3/830: mknod d9/d2f/c103 0 2024-09-18T12:49:37.149 INFO:tasks.workunit.client.0.smithi078.stdout:9/882: write d5/d5c/ff9 [4555838,98241] 0 2024-09-18T12:49:37.152 INFO:tasks.workunit.client.0.smithi078.stdout:0/910: write d3/d1f/d2e/d4e/d37/f8c [6344853,53559] 0 2024-09-18T12:49:37.154 INFO:tasks.workunit.client.0.smithi078.stdout:0/911: truncate d3/d1f/d2e/d4e/d37/f125 82004 0 2024-09-18T12:49:37.155 INFO:tasks.workunit.client.0.smithi078.stdout:0/912: chown d3/d43/c114 1178 1 2024-09-18T12:49:37.158 INFO:tasks.workunit.client.0.smithi078.stdout:9/883: rename d5/d7/d8 to d5/d7/d11c 0 2024-09-18T12:49:37.160 INFO:tasks.workunit.client.0.smithi078.stdout:9/884: dread - d5/d7/d32/d2a/d68/d97/de3/fff zero size 2024-09-18T12:49:37.162 INFO:tasks.workunit.client.0.smithi078.stdout:9/885: truncate d5/d7/d32/d2a/f2d 877319 0 2024-09-18T12:49:37.165 INFO:tasks.workunit.client.0.smithi078.stdout:9/886: creat d5/d7/db1/f11d x:0 0 0 2024-09-18T12:49:37.173 INFO:tasks.workunit.client.0.smithi078.stdout:3/831: fsync d9/d54/d6c/d9f/fb7 0 2024-09-18T12:49:37.175 INFO:tasks.workunit.client.0.smithi078.stdout:0/913: dread d3/d1f/d2e/d8f/fbd [0,4194304] 0 2024-09-18T12:49:37.176 INFO:tasks.workunit.client.0.smithi078.stdout:0/914: chown d3/d1f/d2e/d8f/f95 42178442 1 2024-09-18T12:49:37.179 INFO:tasks.workunit.client.0.smithi078.stdout:3/832: mkdir d9/d54/d89/d92/db6/d104 0 2024-09-18T12:49:37.180 INFO:tasks.workunit.client.0.smithi078.stdout:0/915: write d3/f18 [1144636,80467] 0 2024-09-18T12:49:37.182 INFO:tasks.workunit.client.0.smithi078.stdout:3/833: truncate d9/d13/d33/d34/d97/dc2/fe3 868597 0 2024-09-18T12:49:37.183 INFO:tasks.workunit.client.0.smithi078.stdout:3/834: chown d9/d29/d4b/d4c 7 1 2024-09-18T12:49:37.184 INFO:tasks.workunit.client.0.smithi078.stdout:3/835: fsync d9/d54/d89/d92/fc7 0 2024-09-18T12:49:37.186 INFO:tasks.workunit.client.0.smithi078.stdout:3/836: creat d9/d13/d63/d78/f105 x:0 0 0 2024-09-18T12:49:37.187 INFO:tasks.workunit.client.0.smithi078.stdout:3/837: chown d9/d54/d89/fe5 1907 1 2024-09-18T12:49:37.193 INFO:tasks.workunit.client.0.smithi078.stdout:3/838: dread d9/d13/d33/d3c/f66 [0,4194304] 0 2024-09-18T12:49:37.200 INFO:tasks.workunit.client.0.smithi078.stdout:0/916: write d3/d1f/d2e/f76 [1950614,59523] 0 2024-09-18T12:49:37.202 INFO:tasks.workunit.client.0.smithi078.stdout:3/839: dwrite d9/d13/d37/fa3 [0,4194304] 0 2024-09-18T12:49:37.203 INFO:tasks.workunit.client.0.smithi078.stdout:9/887: dread d5/d7/d32/d2a/d36/f43 [0,4194304] 0 2024-09-18T12:49:37.204 INFO:tasks.workunit.client.0.smithi078.stdout:3/840: write d9/d13/d33/f51 [7313113,52381] 0 2024-09-18T12:49:37.206 INFO:tasks.workunit.client.0.smithi078.stdout:9/888: chown d5/d7/d11c/ld2 13290 1 2024-09-18T12:49:37.207 INFO:tasks.workunit.client.0.smithi078.stdout:0/917: symlink d3/d1f/d2e/d4e/db2/d116/l139 0 2024-09-18T12:49:37.210 INFO:tasks.workunit.client.0.smithi078.stdout:3/841: fsync d9/d2f/d43/d62/f101 0 2024-09-18T12:49:37.210 INFO:tasks.workunit.client.0.smithi078.stdout:0/918: dread - d3/d1f/d2e/d68/f8b zero size 2024-09-18T12:49:37.212 INFO:tasks.workunit.client.0.smithi078.stdout:3/842: write d9/f27 [8234413,17896] 0 2024-09-18T12:49:37.213 INFO:tasks.workunit.client.0.smithi078.stdout:1/844: sync 2024-09-18T12:49:37.213 INFO:tasks.workunit.client.0.smithi078.stdout:8/835: sync 2024-09-18T12:49:37.214 INFO:tasks.workunit.client.0.smithi078.stdout:3/843: chown d9/d13/d33/d34/d9e/fce 3 1 2024-09-18T12:49:37.216 INFO:tasks.workunit.client.0.smithi078.stdout:1/845: fdatasync d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d9d/dc3/f104 0 2024-09-18T12:49:37.217 INFO:tasks.workunit.client.0.smithi078.stdout:9/889: mknod d5/d7/db3/de5/d116/c11e 0 2024-09-18T12:49:37.217 INFO:tasks.workunit.client.0.smithi078.stdout:7/811: sync 2024-09-18T12:49:37.217 INFO:tasks.workunit.client.0.smithi078.stdout:2/781: sync 2024-09-18T12:49:37.219 INFO:tasks.workunit.client.0.smithi078.stdout:7/812: stat d7/d26/dc1/ccf 0 2024-09-18T12:49:37.220 INFO:tasks.workunit.client.0.smithi078.stdout:8/836: mkdir d0/d7/dc/d1f/dff/d11a 0 2024-09-18T12:49:37.225 INFO:tasks.workunit.client.0.smithi078.stdout:0/919: write d3/d1f/d2e/d4e/d37/d72/fae [982706,87990] 0 2024-09-18T12:49:37.227 INFO:tasks.workunit.client.0.smithi078.stdout:7/813: truncate d7/d9/d14/d22/d35/d49/d56/f78 1098267 0 2024-09-18T12:49:37.227 INFO:tasks.workunit.client.0.smithi078.stdout:0/920: chown d3/d1f/d2e/d68/c109 82512349 1 2024-09-18T12:49:37.227 INFO:tasks.workunit.client.0.smithi078.stdout:1/846: truncate d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/dee/ff6 789379 0 2024-09-18T12:49:37.227 INFO:tasks.workunit.client.0.smithi078.stdout:9/890: creat d5/d7/d11c/d98/f11f x:0 0 0 2024-09-18T12:49:37.228 INFO:tasks.workunit.client.0.smithi078.stdout:7/814: chown d7/c3d 2497766 1 2024-09-18T12:49:37.229 INFO:tasks.workunit.client.0.smithi078.stdout:2/782: creat d4/d8/d6c/ff8 x:0 0 0 2024-09-18T12:49:37.230 INFO:tasks.workunit.client.0.smithi078.stdout:8/837: readlink d0/d7/dc/led 0 2024-09-18T12:49:37.232 INFO:tasks.workunit.client.0.smithi078.stdout:8/838: readlink d0/d7/dc/d1f/d6f/l8a 0 2024-09-18T12:49:37.232 INFO:tasks.workunit.client.0.smithi078.stdout:0/921: chown d3/d1f/d2e/d4e/d37/d72/ddd/d124/c126 109 1 2024-09-18T12:49:37.233 INFO:tasks.workunit.client.0.smithi078.stdout:1/847: mkdir d0/d8/daa/d121 0 2024-09-18T12:49:37.234 INFO:tasks.workunit.client.0.smithi078.stdout:2/783: fdatasync d4/d20/f29 0 2024-09-18T12:49:37.236 INFO:tasks.workunit.client.0.smithi078.stdout:9/891: creat d5/d7/d32/d2a/d68/d97/de3/f120 x:0 0 0 2024-09-18T12:49:37.239 INFO:tasks.workunit.client.0.smithi078.stdout:3/844: link d9/d54/d7f/dae/dd4/fe0 d9/d54/f106 0 2024-09-18T12:49:37.241 INFO:tasks.workunit.client.0.smithi078.stdout:7/815: dwrite d7/d9/d14/d22/d35/d49/d56/d8d/f9e [0,4194304] 0 2024-09-18T12:49:37.242 INFO:tasks.workunit.client.0.smithi078.stdout:8/839: unlink d0/d7/f7f 0 2024-09-18T12:49:37.244 INFO:tasks.workunit.client.0.smithi078.stdout:7/816: chown d7/d26/d4f/cd0 589 1 2024-09-18T12:49:37.245 INFO:tasks.workunit.client.0.smithi078.stdout:8/840: truncate d0/d39/d4c/d77/d7d/d3e/ff9 896700 0 2024-09-18T12:49:37.245 INFO:tasks.workunit.client.0.smithi078.stdout:0/922: mkdir d3/d82/d10d/d7c/da3/de2/d13a 0 2024-09-18T12:49:37.246 INFO:tasks.workunit.client.0.smithi078.stdout:7/817: truncate d7/d26/d4f/f103 228984 0 2024-09-18T12:49:37.247 INFO:tasks.workunit.client.0.smithi078.stdout:3/845: dread d9/d13/d33/d4e/ff7 [0,4194304] 0 2024-09-18T12:49:37.247 INFO:tasks.workunit.client.0.smithi078.stdout:7/818: readlink d7/d9/d14/d22/d35/l83 0 2024-09-18T12:49:37.249 INFO:tasks.workunit.client.0.smithi078.stdout:1/848: creat d0/d8/daa/db5/d114/d45/f122 x:0 0 0 2024-09-18T12:49:37.251 INFO:tasks.workunit.client.0.smithi078.stdout:1/849: chown d0/d8/daa/db5/dc0/dcf 360169826 1 2024-09-18T12:49:37.251 INFO:tasks.workunit.client.0.smithi078.stdout:2/784: truncate d4/db/dc/fb2 39777 0 2024-09-18T12:49:37.252 INFO:tasks.workunit.client.0.smithi078.stdout:9/892: mkdir d5/dc6/d10a/d121 0 2024-09-18T12:49:37.253 INFO:tasks.workunit.client.0.smithi078.stdout:1/850: write d0/d8/daa/db5/d114/d3e/d58/d6e/fa2 [1685395,123249] 0 2024-09-18T12:49:37.255 INFO:tasks.workunit.client.0.smithi078.stdout:8/841: creat d0/d39/d4c/f11b x:0 0 0 2024-09-18T12:49:37.257 INFO:tasks.workunit.client.0.smithi078.stdout:7/819: mkdir d7/d9/d4d/de2/d112 0 2024-09-18T12:49:37.259 INFO:tasks.workunit.client.0.smithi078.stdout:9/893: creat d5/d7/dbe/de8/f122 x:0 0 0 2024-09-18T12:49:37.262 INFO:tasks.workunit.client.0.smithi078.stdout:0/923: mknod d3/d82/d10d/d7c/d10b/d117/c13b 0 2024-09-18T12:49:37.267 INFO:tasks.workunit.client.0.smithi078.stdout:8/842: symlink d0/d39/d4c/d77/d7d/l11c 0 2024-09-18T12:49:37.274 INFO:tasks.workunit.client.0.smithi078.stdout:1/851: dwrite d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f/f94 [0,4194304] 0 2024-09-18T12:49:37.274 INFO:tasks.workunit.client.0.smithi078.stdout:3/846: link d9/d13/d33/d4e/c23 d9/d13/d33/d3c/c107 0 2024-09-18T12:49:37.275 INFO:tasks.workunit.client.0.smithi078.stdout:9/894: creat d5/d7/d11c/f123 x:0 0 0 2024-09-18T12:49:37.276 INFO:tasks.workunit.client.0.smithi078.stdout:3/847: truncate d9/d13/d63/d78/f105 927221 0 2024-09-18T12:49:37.279 INFO:tasks.workunit.client.0.smithi078.stdout:7/820: link d7/d9/d14/d22/d35/cc6 d7/d9/d14/d22/d35/d49/d56/d8d/daf/c113 0 2024-09-18T12:49:37.282 INFO:tasks.workunit.client.0.smithi078.stdout:0/924: write d3/d1f/d2e/d68/dc9/f102 [80315,52845] 0 2024-09-18T12:49:37.283 INFO:tasks.workunit.client.0.smithi078.stdout:8/843: mkdir d0/d7/d1e/d4b/d11d 0 2024-09-18T12:49:37.284 INFO:tasks.workunit.client.0.smithi078.stdout:9/895: mkdir d5/d7/dbe/ddd/d124 0 2024-09-18T12:49:37.290 INFO:tasks.workunit.client.0.smithi078.stdout:7/821: mknod d7/d3f/c114 0 2024-09-18T12:49:37.298 INFO:tasks.workunit.client.0.smithi078.stdout:8/844: mkdir d0/d7/d1e/d4b/d11d/d11e 0 2024-09-18T12:49:37.300 INFO:tasks.workunit.client.0.smithi078.stdout:9/896: write d5/d7/d32/f65 [776925,64115] 0 2024-09-18T12:49:37.302 INFO:tasks.workunit.client.0.smithi078.stdout:7/822: write d7/d5d/d7a/f5c [1840096,105956] 0 2024-09-18T12:49:37.304 INFO:tasks.workunit.client.0.smithi078.stdout:7/823: truncate d7/d26/d4f/f103 278800 0 2024-09-18T12:49:37.304 INFO:tasks.workunit.client.0.smithi078.stdout:8/845: truncate d0/d7/d1e/da9/d6d/f97 1458 0 2024-09-18T12:49:37.305 INFO:tasks.workunit.client.0.smithi078.stdout:3/848: link d9/d13/f5f d9/d29/f108 0 2024-09-18T12:49:37.306 INFO:tasks.workunit.client.0.smithi078.stdout:3/849: readlink d9/d13/d33/d34/d97/lc0 0 2024-09-18T12:49:37.306 INFO:tasks.workunit.client.0.smithi078.stdout:9/897: truncate d5/d5c/f88 5906525 0 2024-09-18T12:49:37.307 INFO:tasks.workunit.client.0.smithi078.stdout:1/852: getdents d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f 0 2024-09-18T12:49:37.307 INFO:tasks.workunit.client.0.smithi078.stdout:9/898: write d5/f4a [4112742,59702] 0 2024-09-18T12:49:37.307 INFO:tasks.workunit.client.0.smithi078.stdout:0/925: link d3/d1f/d2e/d4e/d37/d72/f111 d3/d1f/d2e/d68/dc9/f13c 0 2024-09-18T12:49:37.315 INFO:tasks.workunit.client.0.smithi078.stdout:1/853: dread d0/d8/daa/db5/d114/d3e/d58/d6e/fa2 [0,4194304] 0 2024-09-18T12:49:37.317 INFO:tasks.workunit.client.0.smithi078.stdout:7/824: write d7/d26/d4f/f50 [3320203,105033] 0 2024-09-18T12:49:37.317 INFO:tasks.workunit.client.0.smithi078.stdout:7/825: chown d7/d9/d14/d22 26774 1 2024-09-18T12:49:37.319 INFO:tasks.workunit.client.0.smithi078.stdout:0/926: creat d3/d1f/d2e/d4e/d37/d72/ddd/d124/f13d x:0 0 0 2024-09-18T12:49:37.322 INFO:tasks.workunit.client.0.smithi078.stdout:3/850: link d9/d54/d7f/ffa d9/d54/d89/d92/db6/dde/f109 0 2024-09-18T12:49:37.325 INFO:tasks.workunit.client.0.smithi078.stdout:7/826: dwrite d7/d9/d4d/d9a/fd8 [0,4194304] 0 2024-09-18T12:49:37.325 INFO:tasks.workunit.client.0.smithi078.stdout:1/854: symlink d0/d8/l123 0 2024-09-18T12:49:37.326 INFO:tasks.workunit.client.0.smithi078.stdout:7/827: chown d7/f17 25 1 2024-09-18T12:49:37.330 INFO:tasks.workunit.client.0.smithi078.stdout:8/846: link d0/d39/dbc/f115 d0/d7/d1e/d4b/f11f 0 2024-09-18T12:49:37.334 INFO:tasks.workunit.client.0.smithi078.stdout:1/855: dwrite d0/d8/daa/db5/d114/d3e/d58/d6e/d52/f2e [0,4194304] 0 2024-09-18T12:49:37.335 INFO:tasks.workunit.client.0.smithi078.stdout:9/899: write d5/d7/d11c/d4f/f76 [1689618,31479] 0 2024-09-18T12:49:37.336 INFO:tasks.workunit.client.0.smithi078.stdout:3/851: mkdir d9/d54/d6c/d9f/db2/d10a 0 2024-09-18T12:49:37.347 INFO:tasks.workunit.client.0.smithi078.stdout:3/852: fdatasync d9/d54/d7f/f98 0 2024-09-18T12:49:37.350 INFO:tasks.workunit.client.0.smithi078.stdout:0/927: link d3/d1f/d2e/d4e/d37/cf7 d3/d1f/d2e/d8f/da1/c13e 0 2024-09-18T12:49:37.351 INFO:tasks.workunit.client.0.smithi078.stdout:0/928: fsync d3/d1f/d2e/d68/dc9/f102 0 2024-09-18T12:49:37.352 INFO:tasks.workunit.client.0.smithi078.stdout:0/929: readlink d3/d1f/d2e/d4e/d37/l3c 0 2024-09-18T12:49:37.353 INFO:tasks.workunit.client.0.smithi078.stdout:3/853: mkdir d9/d54/d7f/dae/d10b 0 2024-09-18T12:49:37.354 INFO:tasks.workunit.client.0.smithi078.stdout:8/847: link d0/d39/d4c/d77/d7d/l11c d0/d7/d53/db0/l120 0 2024-09-18T12:49:37.358 INFO:tasks.workunit.client.0.smithi078.stdout:0/930: read - d3/d1f/d2e/d4e/d37/d103/f110 zero size 2024-09-18T12:49:37.359 INFO:tasks.workunit.client.0.smithi078.stdout:7/828: truncate d7/d26/f79 3251908 0 2024-09-18T12:49:37.360 INFO:tasks.workunit.client.0.smithi078.stdout:1/856: dwrite d0/f6c [0,4194304] 0 2024-09-18T12:49:37.360 INFO:tasks.workunit.client.0.smithi078.stdout:3/854: write f7 [3459068,724] 0 2024-09-18T12:49:37.362 INFO:tasks.workunit.client.0.smithi078.stdout:3/855: chown d9/d29/f6d 44 1 2024-09-18T12:49:37.363 INFO:tasks.workunit.client.0.smithi078.stdout:8/848: rmdir d0/d7/dc/d71/d9b 39 2024-09-18T12:49:37.364 INFO:tasks.workunit.client.0.smithi078.stdout:9/900: dwrite d5/d7/f5a [0,4194304] 0 2024-09-18T12:49:37.365 INFO:tasks.workunit.client.0.smithi078.stdout:7/829: stat d7/d9/d14/d22/d35/c81 0 2024-09-18T12:49:37.367 INFO:tasks.workunit.client.0.smithi078.stdout:9/901: fdatasync d5/d7/d32/d2a/d36/fca 0 2024-09-18T12:49:37.375 INFO:tasks.workunit.client.0.smithi078.stdout:9/902: creat d5/d7/db3/de5/d116/f125 x:0 0 0 2024-09-18T12:49:37.378 INFO:tasks.workunit.client.0.smithi078.stdout:3/856: dwrite d9/d29/d4b/d4c/fcf [0,4194304] 0 2024-09-18T12:49:37.379 INFO:tasks.workunit.client.0.smithi078.stdout:0/931: write d3/d1f/d2e/d4e/d37/f8a [495471,125822] 0 2024-09-18T12:49:37.379 INFO:tasks.workunit.client.0.smithi078.stdout:7/830: dwrite d7/fd1 [0,4194304] 0 2024-09-18T12:49:37.384 INFO:tasks.workunit.client.0.smithi078.stdout:9/903: unlink d5/d7/d11c/d4f/f54 0 2024-09-18T12:49:37.391 INFO:tasks.workunit.client.0.smithi078.stdout:8/849: link d0/d7/dc/d71/d9b/dc2/fcc d0/d7/dc/d71/d9b/db6/f121 0 2024-09-18T12:49:37.392 INFO:tasks.workunit.client.0.smithi078.stdout:9/904: mkdir d5/d7/d32/d91/d126 0 2024-09-18T12:49:37.394 INFO:tasks.workunit.client.0.smithi078.stdout:8/850: mknod d0/d39/dc5/c122 0 2024-09-18T12:49:37.397 INFO:tasks.workunit.client.0.smithi078.stdout:7/831: creat d7/d9/d14/d22/d35/d49/f115 x:0 0 0 2024-09-18T12:49:37.398 INFO:tasks.workunit.client.0.smithi078.stdout:7/832: readlink d7/d9/d14/d22/d35/lfa 0 2024-09-18T12:49:37.402 INFO:tasks.workunit.client.0.smithi078.stdout:8/851: creat d0/d39/d4c/d77/d7d/f123 x:0 0 0 2024-09-18T12:49:37.403 INFO:tasks.workunit.client.0.smithi078.stdout:7/833: creat d7/d9/dd7/d3b/f116 x:0 0 0 2024-09-18T12:49:37.409 INFO:tasks.workunit.client.0.smithi078.stdout:7/834: dread d7/d5d/d87/ffb [0,4194304] 0 2024-09-18T12:49:37.409 INFO:tasks.workunit.client.0.smithi078.stdout:7/835: fdatasync d7/d26/f30 0 2024-09-18T12:49:37.409 INFO:tasks.workunit.client.0.smithi078.stdout:8/852: fsync d0/d7/d1e/da9/d6d/f97 0 2024-09-18T12:49:37.412 INFO:tasks.workunit.client.0.smithi078.stdout:7/836: creat d7/d9/dd7/d3b/d70/f117 x:0 0 0 2024-09-18T12:49:37.417 INFO:tasks.workunit.client.0.smithi078.stdout:3/857: dwrite d9/d13/ff4 [0,4194304] 0 2024-09-18T12:49:37.418 INFO:tasks.workunit.client.0.smithi078.stdout:0/932: dwrite d3/d1f/f52 [0,4194304] 0 2024-09-18T12:49:37.421 INFO:tasks.workunit.client.0.smithi078.stdout:7/837: creat d7/d9/d14/d22/d3e/d95/db2/dcb/f118 x:0 0 0 2024-09-18T12:49:37.423 INFO:tasks.workunit.client.0.smithi078.stdout:7/838: write d7/d9/dd7/fa0 [4963832,126210] 0 2024-09-18T12:49:37.425 INFO:tasks.workunit.client.0.smithi078.stdout:9/905: dwrite d5/fa7 [0,4194304] 0 2024-09-18T12:49:37.435 INFO:tasks.workunit.client.0.smithi078.stdout:3/858: mkdir d9/d29/d4b/d4c/d10c 0 2024-09-18T12:49:37.435 INFO:tasks.workunit.client.0.smithi078.stdout:7/839: chown d7/d9/d14/d22/d35/d49/d56/d8d/daf/cec 583 1 2024-09-18T12:49:37.435 INFO:tasks.workunit.client.0.smithi078.stdout:0/933: mknod d3/d1f/d2e/d4e/d37/d72/ddd/d124/c13f 0 2024-09-18T12:49:37.436 INFO:tasks.workunit.client.0.smithi078.stdout:7/840: chown d7/d26/d4f/cd0 154043442 1 2024-09-18T12:49:37.437 INFO:tasks.workunit.client.0.smithi078.stdout:8/853: creat d0/d7/d1e/f124 x:0 0 0 2024-09-18T12:49:37.440 INFO:tasks.workunit.client.0.smithi078.stdout:0/934: fdatasync d3/d82/d10d/f64 0 2024-09-18T12:49:37.443 INFO:tasks.workunit.client.0.smithi078.stdout:3/859: dread d9/d54/d89/ffc [0,4194304] 0 2024-09-18T12:49:37.452 INFO:tasks.workunit.client.0.smithi078.stdout:0/935: creat d3/d1f/d2e/d68/dc9/dcd/f140 x:0 0 0 2024-09-18T12:49:37.455 INFO:tasks.workunit.client.0.smithi078.stdout:3/860: rmdir d9/d29/d4b/d4c 39 2024-09-18T12:49:37.458 INFO:tasks.workunit.client.0.smithi078.stdout:9/906: mkdir d5/d7/d32/d2a/d36/d11b/d127 0 2024-09-18T12:49:37.462 INFO:tasks.workunit.client.0.smithi078.stdout:8/854: dwrite d0/d39/d4c/d77/dd7/fde [0,4194304] 0 2024-09-18T12:49:37.463 INFO:tasks.workunit.client.0.smithi078.stdout:7/841: dread d7/d9/d14/d22/f57 [0,4194304] 0 2024-09-18T12:49:37.467 INFO:tasks.workunit.client.0.smithi078.stdout:3/861: mkdir d9/d54/d89/d92/db6/dde/d10d 0 2024-09-18T12:49:37.468 INFO:tasks.workunit.client.0.smithi078.stdout:0/936: write d3/d1f/d2e/f35 [2095869,69275] 0 2024-09-18T12:49:37.470 INFO:tasks.workunit.client.0.smithi078.stdout:7/842: readlink d7/d9/dd7/l46 0 2024-09-18T12:49:37.473 INFO:tasks.workunit.client.0.smithi078.stdout:0/937: creat d3/d1f/d2e/d4e/db2/d116/f141 x:0 0 0 2024-09-18T12:49:37.474 INFO:tasks.workunit.client.0.smithi078.stdout:0/938: fdatasync d3/d82/d10d/f39 0 2024-09-18T12:49:37.475 INFO:tasks.workunit.client.0.smithi078.stdout:0/939: write d3/d1f/d2e/d68/dc9/dcd/f140 [909251,85243] 0 2024-09-18T12:49:37.477 INFO:tasks.workunit.client.0.smithi078.stdout:7/843: mkdir d7/d26/d119 0 2024-09-18T12:49:37.477 INFO:tasks.workunit.client.0.smithi078.stdout:0/940: chown d3/d82/d10d/d7c/d10b/d117 4 1 2024-09-18T12:49:37.484 INFO:tasks.workunit.client.0.smithi078.stdout:9/907: write d5/d7/d11c/fee [679035,101084] 0 2024-09-18T12:49:37.486 INFO:tasks.workunit.client.0.smithi078.stdout:8/855: write d0/db7/d62/f91 [470024,40070] 0 2024-09-18T12:49:37.487 INFO:tasks.workunit.client.0.smithi078.stdout:8/856: fdatasync d0/db7/f95 0 2024-09-18T12:49:37.492 INFO:tasks.workunit.client.0.smithi078.stdout:9/908: dwrite d5/d5c/ff9 [0,4194304] 0 2024-09-18T12:49:37.495 INFO:tasks.workunit.client.0.smithi078.stdout:3/862: dread d9/d13/f5f [0,4194304] 0 2024-09-18T12:49:37.497 INFO:tasks.workunit.client.0.smithi078.stdout:3/863: chown d9/d13/d33/d3c/ff5 2031884 1 2024-09-18T12:49:37.498 INFO:tasks.workunit.client.0.smithi078.stdout:7/844: dread d7/d9/d14/d22/d35/d49/d56/d8d/fb8 [0,4194304] 0 2024-09-18T12:49:37.499 INFO:tasks.workunit.client.0.smithi078.stdout:9/909: unlink d5/d7/d11c/f1d 0 2024-09-18T12:49:37.501 INFO:tasks.workunit.client.0.smithi078.stdout:3/864: rmdir d9/d54/d6c/d9f/db2 39 2024-09-18T12:49:37.503 INFO:tasks.workunit.client.0.smithi078.stdout:8/857: truncate d0/d39/d4c/d77/d7d/d3e/ff9 458260 0 2024-09-18T12:49:37.504 INFO:tasks.workunit.client.0.smithi078.stdout:9/910: creat d5/d7/dbe/f128 x:0 0 0 2024-09-18T12:49:37.505 INFO:tasks.workunit.client.0.smithi078.stdout:3/865: dread d9/d13/d33/d34/d9e/fce [0,4194304] 0 2024-09-18T12:49:37.509 INFO:tasks.workunit.client.0.smithi078.stdout:7/845: rename d7/d9/d4d/de2/le4 to d7/d9/d14/l11a 0 2024-09-18T12:49:37.511 INFO:tasks.workunit.client.0.smithi078.stdout:8/858: rename d0/d7/dc/d5d/c93 to d0/db7/d62/c125 0 2024-09-18T12:49:37.513 INFO:tasks.workunit.client.0.smithi078.stdout:7/846: symlink d7/d9/d4d/dff/l11b 0 2024-09-18T12:49:37.513 INFO:tasks.workunit.client.0.smithi078.stdout:8/859: read d0/d7/d1e/d4b/f98 [1144247,37254] 0 2024-09-18T12:49:37.515 INFO:tasks.workunit.client.0.smithi078.stdout:8/860: stat d0/d7/f60 0 2024-09-18T12:49:37.516 INFO:tasks.workunit.client.0.smithi078.stdout:7/847: symlink d7/d9/d4d/l11c 0 2024-09-18T12:49:37.520 INFO:tasks.workunit.client.0.smithi078.stdout:7/848: mkdir d7/d9/d4d/d6f/d11d 0 2024-09-18T12:49:37.521 INFO:tasks.workunit.client.0.smithi078.stdout:7/849: dread - d7/d9/d14/d22/d3e/d95/db2/dcb/f118 zero size 2024-09-18T12:49:37.524 INFO:tasks.workunit.client.0.smithi078.stdout:9/911: write d5/f6c [3394,8729] 0 2024-09-18T12:49:37.527 INFO:tasks.workunit.client.0.smithi078.stdout:7/850: dread d7/d9/d14/d22/d35/d49/f7c [4194304,4194304] 0 2024-09-18T12:49:37.529 INFO:tasks.workunit.client.0.smithi078.stdout:3/866: dread d9/d13/d33/d34/d97/f9b [0,4194304] 0 2024-09-18T12:49:37.535 INFO:tasks.workunit.client.0.smithi078.stdout:3/867: creat d9/d54/d7f/d9c/f10e x:0 0 0 2024-09-18T12:49:37.537 INFO:tasks.workunit.client.0.smithi078.stdout:7/851: dwrite d7/d9/d14/dde/ff4 [0,4194304] 0 2024-09-18T12:49:37.537 INFO:tasks.workunit.client.0.smithi078.stdout:9/912: write d5/d7/f39 [2757549,21505] 0 2024-09-18T12:49:37.538 INFO:tasks.workunit.client.0.smithi078.stdout:9/913: readlink d5/d7/d32/d2a/d36/la9 0 2024-09-18T12:49:37.544 INFO:tasks.workunit.client.0.smithi078.stdout:9/914: unlink d5/d7/d32/d2a/d36/d11b/fe1 0 2024-09-18T12:49:37.544 INFO:tasks.workunit.client.0.smithi078.stdout:7/852: creat d7/d9/d4d/de2/d112/f11e x:0 0 0 2024-09-18T12:49:37.546 INFO:tasks.workunit.client.0.smithi078.stdout:9/915: mknod d5/d40/c129 0 2024-09-18T12:49:37.547 INFO:tasks.workunit.client.0.smithi078.stdout:9/916: write d5/d7/f5a [3322369,16715] 0 2024-09-18T12:49:37.548 INFO:tasks.workunit.client.0.smithi078.stdout:7/853: unlink d7/c88 0 2024-09-18T12:49:37.551 INFO:tasks.workunit.client.0.smithi078.stdout:3/868: rename d9/d54/d89/d92/db6/dde/cea to d9/df/c10f 0 2024-09-18T12:49:37.553 INFO:tasks.workunit.client.0.smithi078.stdout:7/854: creat d7/d9/d14/d22/d35/d49/d61/f11f x:0 0 0 2024-09-18T12:49:37.553 INFO:tasks.workunit.client.0.smithi078.stdout:3/869: mknod d9/d13/d33/d34/d97/dc2/c110 0 2024-09-18T12:49:37.708 INFO:tasks.workunit.client.0.smithi078.stdout:3/870: unlink d9/d13/d33/d34/fe1 0 2024-09-18T12:49:37.709 INFO:tasks.workunit.client.0.smithi078.stdout:3/871: chown d9/d54/d7f/lb5 6 1 2024-09-18T12:49:37.709 INFO:tasks.workunit.client.0.smithi078.stdout:3/872: stat d9/d2f/d43/l94 0 2024-09-18T12:49:37.765 INFO:tasks.workunit.client.0.smithi078.stdout:7/855: rename d7/d3f/f8f to d7/d9/d14/d22/d35/f120 0 2024-09-18T12:49:37.769 INFO:tasks.workunit.client.0.smithi078.stdout:7/856: symlink d7/d9/d4d/dff/l121 0 2024-09-18T12:49:37.769 INFO:tasks.workunit.client.0.smithi078.stdout:9/917: link d5/d7/d32/d2a/d36/d11b/c61 d5/d7/d32/d91/c12a 0 2024-09-18T12:49:37.770 INFO:tasks.workunit.client.0.smithi078.stdout:7/857: chown d7/d9/d14/d22/d3e/d95/db2/dcb/f118 275 1 2024-09-18T12:49:37.771 INFO:tasks.workunit.client.0.smithi078.stdout:9/918: dread d5/f6c [0,4194304] 0 2024-09-18T12:49:37.771 INFO:tasks.workunit.client.0.smithi078.stdout:7/858: write d7/d9/f2f [4442777,14075] 0 2024-09-18T12:49:37.775 INFO:tasks.workunit.client.0.smithi078.stdout:3/873: getdents d9/d54/d7f 0 2024-09-18T12:49:37.776 INFO:tasks.workunit.client.0.smithi078.stdout:7/859: creat d7/d9/d14/d22/d3e/d95/d97/f122 x:0 0 0 2024-09-18T12:49:37.778 INFO:tasks.workunit.client.0.smithi078.stdout:7/860: chown d7/d9/d14/d22/d3e/d95/db2/f101 778065 1 2024-09-18T12:49:37.778 INFO:tasks.workunit.client.0.smithi078.stdout:3/874: mknod d9/d54/d7f/dae/d10b/c111 0 2024-09-18T12:49:37.780 INFO:tasks.workunit.client.0.smithi078.stdout:7/861: fdatasync d7/d9/d14/d22/d35/d49/f7c 0 2024-09-18T12:49:37.781 INFO:tasks.workunit.client.0.smithi078.stdout:3/875: symlink d9/d54/d6c/d9f/db2/l112 0 2024-09-18T12:49:37.782 INFO:tasks.workunit.client.0.smithi078.stdout:7/862: creat d7/d3f/d99/f123 x:0 0 0 2024-09-18T12:49:37.782 INFO:tasks.workunit.client.0.smithi078.stdout:3/876: rmdir d9/d13/d33/d4e 39 2024-09-18T12:49:37.786 INFO:tasks.workunit.client.0.smithi078.stdout:7/863: rename d7/d9/d14/d22/d35/d49/df5 to d7/d9/d4d/d124 0 2024-09-18T12:49:37.791 INFO:tasks.workunit.client.0.smithi078.stdout:7/864: symlink d7/d5d/d87/d108/l125 0 2024-09-18T12:49:37.796 INFO:tasks.workunit.client.0.smithi078.stdout:3/877: rmdir d9/df 39 2024-09-18T12:49:37.798 INFO:tasks.workunit.client.0.smithi078.stdout:7/865: creat d7/d9/d14/d22/d35/d49/d61/d7b/d111/f126 x:0 0 0 2024-09-18T12:49:37.799 INFO:tasks.workunit.client.0.smithi078.stdout:7/866: chown d7/d9/d14/d22/d35/d49/d56/d8d/f9e 273101500 1 2024-09-18T12:49:37.800 INFO:tasks.workunit.client.0.smithi078.stdout:3/878: rmdir d9/d13/d33/d34/d97/dc2 39 2024-09-18T12:49:37.801 INFO:tasks.workunit.client.0.smithi078.stdout:3/879: dread - d9/d54/d89/d92/db6/dde/f109 zero size 2024-09-18T12:49:37.804 INFO:tasks.workunit.client.0.smithi078.stdout:7/867: write d7/d9/d14/f93 [111324,69107] 0 2024-09-18T12:49:37.807 INFO:tasks.workunit.client.0.smithi078.stdout:3/880: dwrite d9/d13/d63/fd6 [0,4194304] 0 2024-09-18T12:49:37.812 INFO:tasks.workunit.client.0.smithi078.stdout:7/868: fsync d7/d9/d14/d22/d35/d49/d56/d8d/fb8 0 2024-09-18T12:49:37.818 INFO:tasks.workunit.client.0.smithi078.stdout:3/881: mkdir d9/d54/d113 0 2024-09-18T12:49:37.832 INFO:tasks.workunit.client.0.smithi078.stdout:3/882: fdatasync d9/d13/d63/fd6 0 2024-09-18T12:49:37.934 INFO:tasks.workunit.client.0.smithi078.stdout:7/869: getdents d7/d9/d4d/d6f 0 2024-09-18T12:49:37.934 INFO:tasks.workunit.client.0.smithi078.stdout:3/883: mkdir d9/d54/d6c/d9f/db2/d10a/d114 0 2024-09-18T12:49:37.935 INFO:tasks.workunit.client.0.smithi078.stdout:7/870: write d7/d3f/d99/f123 [421494,5286] 0 2024-09-18T12:49:37.935 INFO:tasks.workunit.client.0.smithi078.stdout:7/871: chown d7/d26/f94 14645780 1 2024-09-18T12:49:37.938 INFO:tasks.workunit.client.0.smithi078.stdout:7/872: read - d7/d9/d14/d22/d35/d49/d7d/fd5 zero size 2024-09-18T12:49:37.939 INFO:tasks.workunit.client.0.smithi078.stdout:7/873: write d7/d26/f29 [6353503,36447] 0 2024-09-18T12:49:37.939 INFO:tasks.workunit.client.0.smithi078.stdout:3/884: rmdir d9/d54/d89/d92/db6/dde/d10d 0 2024-09-18T12:49:37.941 INFO:tasks.workunit.client.0.smithi078.stdout:7/874: mknod d7/d9/d4d/d6f/d11d/c127 0 2024-09-18T12:49:37.942 INFO:tasks.workunit.client.0.smithi078.stdout:7/875: dread - d7/d9/d4d/de2/d112/f11e zero size 2024-09-18T12:49:37.954 INFO:tasks.workunit.client.0.smithi078.stdout:7/876: dread d7/f1d [0,4194304] 0 2024-09-18T12:49:37.957 INFO:tasks.workunit.client.0.smithi078.stdout:7/877: unlink d7/d26/d4f/cd4 0 2024-09-18T12:49:37.959 INFO:tasks.workunit.client.0.smithi078.stdout:7/878: symlink d7/d9/d4d/l128 0 2024-09-18T12:49:37.964 INFO:tasks.workunit.client.0.smithi078.stdout:7/879: dwrite d7/d9/dd7/f36 [0,4194304] 0 2024-09-18T12:49:37.965 INFO:tasks.workunit.client.0.smithi078.stdout:7/880: dread - d7/d9/dd7/fee zero size 2024-09-18T12:49:37.966 INFO:tasks.workunit.client.0.smithi078.stdout:7/881: read d7/d9/d14/d22/d3e/f106 [717847,60410] 0 2024-09-18T12:49:37.967 INFO:tasks.workunit.client.0.smithi078.stdout:7/882: write d7/d9/d4d/d6f/f8a [3555257,126224] 0 2024-09-18T12:49:37.969 INFO:tasks.workunit.client.0.smithi078.stdout:7/883: write d7/d26/d4f/f50 [2090191,11494] 0 2024-09-18T12:49:37.972 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:37 smithi148 ceph-mon[35352]: pgmap v26: 65 pgs: 65 active+clean; 3.5 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 96 MiB/s rd, 212 MiB/s wr, 498 op/s 2024-09-18T12:49:37.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:37 smithi078 ceph-mon[28091]: pgmap v26: 65 pgs: 65 active+clean; 3.5 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 96 MiB/s rd, 212 MiB/s wr, 498 op/s 2024-09-18T12:49:38.068 INFO:tasks.workunit.client.0.smithi078.stdout:2/785: sync 2024-09-18T12:49:38.073 INFO:tasks.workunit.client.0.smithi078.stdout:2/786: chown d4/db/c51 263591 1 2024-09-18T12:49:38.074 INFO:tasks.workunit.client.0.smithi078.stdout:2/787: write d4/db/d45/dbc/fbe [483111,108581] 0 2024-09-18T12:49:38.089 INFO:tasks.workunit.client.0.smithi078.stdout:2/788: mknod d4/d8/d23/d52/d5f/d81/cf9 0 2024-09-18T12:49:38.091 INFO:tasks.workunit.client.0.smithi078.stdout:2/789: symlink d4/db/d45/dbc/dee/lfa 0 2024-09-18T12:49:38.092 INFO:tasks.workunit.client.0.smithi078.stdout:2/790: rmdir d4/dd 39 2024-09-18T12:49:38.101 INFO:tasks.workunit.client.0.smithi078.stdout:2/791: symlink d4/db/dc/dec/lfb 0 2024-09-18T12:49:38.103 INFO:tasks.workunit.client.0.smithi078.stdout:2/792: mknod d4/d8/d23/d52/d5f/d81/cfc 0 2024-09-18T12:49:38.115 INFO:tasks.workunit.client.0.smithi078.stdout:2/793: dwrite d4/d8/d23/d52/d5f/d81/dac/fc3 [0,4194304] 0 2024-09-18T12:49:38.116 INFO:tasks.workunit.client.0.smithi078.stdout:2/794: fsync d4/d8/d6c/ff8 0 2024-09-18T12:49:38.118 INFO:tasks.workunit.client.0.smithi078.stdout:2/795: rmdir d4/db/d45/dbc 39 2024-09-18T12:49:38.123 INFO:tasks.workunit.client.0.smithi078.stdout:2/796: getdents d4/d8 0 2024-09-18T12:49:38.126 INFO:tasks.workunit.client.0.smithi078.stdout:2/797: creat d4/d8/ffd x:0 0 0 2024-09-18T12:49:38.148 INFO:tasks.workunit.client.0.smithi078.stdout:2/798: write d4/db/dc/dc0/df2/dd3/fdd [447094,49423] 0 2024-09-18T12:49:38.152 INFO:tasks.workunit.client.0.smithi078.stdout:2/799: mkdir d4/d8/d23/d52/d5f/d81/dac/dfe 0 2024-09-18T12:49:38.154 INFO:tasks.workunit.client.0.smithi078.stdout:2/800: write d4/d8/d23/d52/d5f/d86/d3b/f58 [2045932,34958] 0 2024-09-18T12:49:38.170 INFO:tasks.workunit.client.0.smithi078.stdout:2/801: write d4/d8/d23/d52/d5f/d86/d33/f48 [1592125,101941] 0 2024-09-18T12:49:38.180 INFO:tasks.workunit.client.0.smithi078.stdout:2/802: dwrite d4/ff0 [0,4194304] 0 2024-09-18T12:49:38.182 INFO:tasks.workunit.client.0.smithi078.stdout:2/803: symlink d4/d20/d85/lff 0 2024-09-18T12:49:38.204 INFO:tasks.workunit.client.0.smithi078.stdout:2/804: dread d4/f99 [0,4194304] 0 2024-09-18T12:49:38.208 INFO:tasks.workunit.client.0.smithi078.stdout:2/805: rename d4/d20/d85/lff to d4/dd/l100 0 2024-09-18T12:49:38.209 INFO:tasks.workunit.client.0.smithi078.stdout:2/806: creat d4/d8/d23/d95/f101 x:0 0 0 2024-09-18T12:49:38.214 INFO:tasks.workunit.client.0.smithi078.stdout:2/807: link d4/d8/d23/d52/d5f/d81/dac/fe3 d4/db/dc/f102 0 2024-09-18T12:49:38.217 INFO:tasks.workunit.client.0.smithi078.stdout:2/808: creat d4/db/dc/dec/f103 x:0 0 0 2024-09-18T12:49:38.218 INFO:tasks.workunit.client.0.smithi078.stdout:2/809: fdatasync d4/d8/d23/d52/d5f/d86/f7a 0 2024-09-18T12:49:38.220 INFO:tasks.workunit.client.0.smithi078.stdout:2/810: fdatasync d4/db/f1c 0 2024-09-18T12:49:38.266 INFO:tasks.workunit.client.0.smithi078.stdout:1/857: sync 2024-09-18T12:49:38.266 INFO:tasks.workunit.client.0.smithi078.stdout:0/941: sync 2024-09-18T12:49:38.266 INFO:tasks.workunit.client.0.smithi078.stdout:8/861: sync 2024-09-18T12:49:38.267 INFO:tasks.workunit.client.0.smithi078.stdout:1/858: dread - d0/d8/daa/db5/d114/d45/f122 zero size 2024-09-18T12:49:38.270 INFO:tasks.workunit.client.0.smithi078.stdout:0/942: creat d3/d82/d10d/d7c/f142 x:0 0 0 2024-09-18T12:49:38.271 INFO:tasks.workunit.client.0.smithi078.stdout:8/862: mknod d0/d7/dc/d71/d9b/dc2/c126 0 2024-09-18T12:49:38.276 INFO:tasks.workunit.client.0.smithi078.stdout:8/863: fsync d0/d7/d53/db0/fe9 0 2024-09-18T12:49:38.280 INFO:tasks.workunit.client.0.smithi078.stdout:0/943: unlink d3/d1f/d2e/d4e/d37/d72/ddd/f12d 0 2024-09-18T12:49:38.280 INFO:tasks.workunit.client.0.smithi078.stdout:2/811: dwrite d4/f99 [0,4194304] 0 2024-09-18T12:49:38.285 INFO:tasks.workunit.client.0.smithi078.stdout:8/864: unlink d0/d7/d53/d57/cd9 0 2024-09-18T12:49:38.288 INFO:tasks.workunit.client.0.smithi078.stdout:1/859: getdents d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/dee 0 2024-09-18T12:49:38.288 INFO:tasks.workunit.client.0.smithi078.stdout:1/860: chown d0/l25 20 1 2024-09-18T12:49:38.291 INFO:tasks.workunit.client.0.smithi078.stdout:2/812: mknod d4/db/c104 0 2024-09-18T12:49:38.291 INFO:tasks.workunit.client.0.smithi078.stdout:0/944: getdents d3/d82/d10d/d7c/da3/de2/d13a 0 2024-09-18T12:49:38.296 INFO:tasks.workunit.client.0.smithi078.stdout:2/813: mkdir d4/d105 0 2024-09-18T12:49:38.300 INFO:tasks.workunit.client.0.smithi078.stdout:1/861: getdents d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d9d 0 2024-09-18T12:49:38.302 INFO:tasks.workunit.client.0.smithi078.stdout:0/945: getdents d3/d82/d10d/d7c/d10b 0 2024-09-18T12:49:38.304 INFO:tasks.workunit.client.0.smithi078.stdout:1/862: rmdir d0/d8/daa/db5/d114 39 2024-09-18T12:49:38.304 INFO:tasks.workunit.client.0.smithi078.stdout:2/814: dwrite d4/d8/d23/d52/d5f/d86/d33/f72 [4194304,4194304] 0 2024-09-18T12:49:38.306 INFO:tasks.workunit.client.0.smithi078.stdout:1/863: truncate d0/f108 1216680 0 2024-09-18T12:49:38.306 INFO:tasks.workunit.client.0.smithi078.stdout:8/865: dread d0/d7/dc/d1f/d23/d40/f6c [0,4194304] 0 2024-09-18T12:49:38.310 INFO:tasks.workunit.client.0.smithi078.stdout:2/815: unlink d4/d1a/f43 0 2024-09-18T12:49:38.311 INFO:tasks.workunit.client.0.smithi078.stdout:8/866: creat d0/db7/d62/df2/f127 x:0 0 0 2024-09-18T12:49:38.313 INFO:tasks.workunit.client.0.smithi078.stdout:0/946: write d3/f17 [2750166,71292] 0 2024-09-18T12:49:38.314 INFO:tasks.workunit.client.0.smithi078.stdout:2/816: fsync d4/d1a/f22 0 2024-09-18T12:49:38.315 INFO:tasks.workunit.client.0.smithi078.stdout:1/864: mknod d0/d8/daa/db5/d114/d3e/d58/d6e/d52/c124 0 2024-09-18T12:49:38.316 INFO:tasks.workunit.client.0.smithi078.stdout:8/867: creat d0/d7/dc/d1f/d23/d40/f128 x:0 0 0 2024-09-18T12:49:38.320 INFO:tasks.workunit.client.0.smithi078.stdout:1/865: creat d0/d8/daa/db5/d114/d3e/d50/d74/f125 x:0 0 0 2024-09-18T12:49:38.322 INFO:tasks.workunit.client.0.smithi078.stdout:0/947: dread d3/d1f/d2e/d4e/d37/d72/fae [0,4194304] 0 2024-09-18T12:49:38.323 INFO:tasks.workunit.client.0.smithi078.stdout:1/866: symlink d0/d8/daa/db5/d114/d3e/d58/d6e/d52/l126 0 2024-09-18T12:49:38.324 INFO:tasks.workunit.client.0.smithi078.stdout:1/867: chown d0/d5b/d6d/cd0 580197307 1 2024-09-18T12:49:38.326 INFO:tasks.workunit.client.0.smithi078.stdout:0/948: mkdir d3/d1f/d2e/d68/dc9/dcd/d128/d143 0 2024-09-18T12:49:38.332 INFO:tasks.workunit.client.0.smithi078.stdout:1/868: mkdir d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d127 0 2024-09-18T12:49:38.334 INFO:tasks.workunit.client.0.smithi078.stdout:2/817: dwrite d4/db/f1c [0,4194304] 0 2024-09-18T12:49:38.337 INFO:tasks.workunit.client.0.smithi078.stdout:0/949: dread d3/d1f/f53 [0,4194304] 0 2024-09-18T12:49:38.339 INFO:tasks.workunit.client.0.smithi078.stdout:0/950: stat d3/d1f/d2e/d4e/d37/d72/f11c 0 2024-09-18T12:49:38.339 INFO:tasks.workunit.client.0.smithi078.stdout:8/868: dwrite d0/d7/dc/d5d/f86 [0,4194304] 0 2024-09-18T12:49:38.341 INFO:tasks.workunit.client.0.smithi078.stdout:1/869: creat d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d9d/dc3/dea/f128 x:0 0 0 2024-09-18T12:49:38.345 INFO:tasks.workunit.client.0.smithi078.stdout:2/818: truncate d4/f69 325538 0 2024-09-18T12:49:38.349 INFO:tasks.workunit.client.0.smithi078.stdout:1/870: creat d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/f129 x:0 0 0 2024-09-18T12:49:38.350 INFO:tasks.workunit.client.0.smithi078.stdout:1/871: write d0/d8/daa/db5/d114/d3e/d50/da7/f120 [777144,91184] 0 2024-09-18T12:49:38.350 INFO:tasks.workunit.client.0.smithi078.stdout:2/819: rename d4/d8/d23/d95 to d4/d8/d23/d52/d5f/d81/dac/d106 0 2024-09-18T12:49:38.351 INFO:tasks.workunit.client.0.smithi078.stdout:1/872: chown d0/c4c 3544 1 2024-09-18T12:49:38.351 INFO:tasks.workunit.client.0.smithi078.stdout:2/820: stat d4/d8/d23/d52/d5f/d86/d33/l9c 0 2024-09-18T12:49:38.353 INFO:tasks.workunit.client.0.smithi078.stdout:1/873: fdatasync d0/d8/ff 0 2024-09-18T12:49:38.355 INFO:tasks.workunit.client.0.smithi078.stdout:2/821: creat d4/d8/d23/d52/d5f/d86/d33/d8e/f107 x:0 0 0 2024-09-18T12:49:38.355 INFO:tasks.workunit.client.0.smithi078.stdout:1/874: dread - d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f/fbc zero size 2024-09-18T12:49:38.357 INFO:tasks.workunit.client.0.smithi078.stdout:1/875: chown d0/d8/daa/db5/d114/d3e/d58/cf2 7343 1 2024-09-18T12:49:38.358 INFO:tasks.workunit.client.0.smithi078.stdout:2/822: creat d4/db/d45/dbc/f108 x:0 0 0 2024-09-18T12:49:38.358 INFO:tasks.workunit.client.0.smithi078.stdout:8/869: dread d0/d7/d53/d57/d5c/d88/fac [0,4194304] 0 2024-09-18T12:49:38.361 INFO:tasks.workunit.client.0.smithi078.stdout:2/823: creat d4/d8/d23/d52/d5f/d86/d3b/d55/f109 x:0 0 0 2024-09-18T12:49:38.376 INFO:tasks.workunit.client.0.smithi078.stdout:1/876: dwrite d0/d8/daa/db5/d114/d45/f8e [0,4194304] 0 2024-09-18T12:49:38.378 INFO:tasks.workunit.client.0.smithi078.stdout:2/824: dread d4/d8/d23/d52/d7c/fb6 [0,4194304] 0 2024-09-18T12:49:38.380 INFO:tasks.workunit.client.0.smithi078.stdout:1/877: chown d0/d8/daa/db5/d114/d3e/d58/d6e/f51 0 1 2024-09-18T12:49:38.380 INFO:tasks.workunit.client.0.smithi078.stdout:8/870: dwrite d0/d39/d4c/d77/d7d/d3e/ff5 [0,4194304] 0 2024-09-18T12:49:38.384 INFO:tasks.workunit.client.0.smithi078.stdout:2/825: mknod d4/d8/d23/d52/d5f/d81/dae/dbd/c10a 0 2024-09-18T12:49:38.385 INFO:tasks.workunit.client.0.smithi078.stdout:1/878: creat d0/f12a x:0 0 0 2024-09-18T12:49:38.386 INFO:tasks.workunit.client.0.smithi078.stdout:1/879: chown d0/f89 4314 1 2024-09-18T12:49:38.388 INFO:tasks.workunit.client.0.smithi078.stdout:2/826: symlink d4/d8/d23/d52/d5f/d81/dac/l10b 0 2024-09-18T12:49:38.389 INFO:tasks.workunit.client.0.smithi078.stdout:2/827: chown d4/d8/d23/d52/d5f/d86/f60 1 1 2024-09-18T12:49:38.391 INFO:tasks.workunit.client.0.smithi078.stdout:2/828: symlink d4/d8/d23/d52/d5f/d86/d33/d8e/l10c 0 2024-09-18T12:49:38.392 INFO:tasks.workunit.client.0.smithi078.stdout:2/829: chown d4/db/l1e 3 1 2024-09-18T12:49:38.394 INFO:tasks.workunit.client.0.smithi078.stdout:2/830: creat d4/db/dc/dec/f10d x:0 0 0 2024-09-18T12:49:38.397 INFO:tasks.workunit.client.0.smithi078.stdout:2/831: creat d4/dd/f10e x:0 0 0 2024-09-18T12:49:38.400 INFO:tasks.workunit.client.0.smithi078.stdout:8/871: dwrite d0/d7/d53/d57/d5c/fce [0,4194304] 0 2024-09-18T12:49:38.401 INFO:tasks.workunit.client.0.smithi078.stdout:2/832: chown d4/d8/d23/d52/d5f/d86/d3b/d4f/fca 3668259 1 2024-09-18T12:49:38.403 INFO:tasks.workunit.client.0.smithi078.stdout:8/872: mknod d0/d7/d1e/d4b/dc6/c129 0 2024-09-18T12:49:38.404 INFO:tasks.workunit.client.0.smithi078.stdout:8/873: fsync d0/d7/dc/d1f/f28 0 2024-09-18T12:49:38.405 INFO:tasks.workunit.client.0.smithi078.stdout:2/833: mknod d4/db/d45/c10f 0 2024-09-18T12:49:38.406 INFO:tasks.workunit.client.0.smithi078.stdout:8/874: chown d0/d39/d4c/d77/d7d/d3e/l104 33439578 1 2024-09-18T12:49:38.406 INFO:tasks.workunit.client.0.smithi078.stdout:8/875: chown d0/d7/d1e/da9 0 1 2024-09-18T12:49:38.408 INFO:tasks.workunit.client.0.smithi078.stdout:2/834: rmdir d4/d8/d23/d52/d5f/d86/d3b/d4f 39 2024-09-18T12:49:38.409 INFO:tasks.workunit.client.0.smithi078.stdout:8/876: fdatasync d0/d7/d1e/d4b/dc6/fd3 0 2024-09-18T12:49:38.411 INFO:tasks.workunit.client.0.smithi078.stdout:2/835: fdatasync d4/d8/f4b 0 2024-09-18T12:49:38.412 INFO:tasks.workunit.client.0.smithi078.stdout:8/877: dread d0/d7/d53/d57/d5c/d88/fac [0,4194304] 0 2024-09-18T12:49:38.422 INFO:tasks.workunit.client.0.smithi078.stdout:2/836: dread d4/f5 [0,4194304] 0 2024-09-18T12:49:38.470 INFO:tasks.workunit.client.0.smithi078.stdout:9/919: sync 2024-09-18T12:49:38.489 INFO:tasks.workunit.client.0.smithi078.stdout:2/837: dread d4/dd/fc7 [0,4194304] 0 2024-09-18T12:49:38.490 INFO:tasks.workunit.client.0.smithi078.stdout:9/920: unlink d5/d7/d32/cd3 0 2024-09-18T12:49:38.494 INFO:tasks.workunit.client.0.smithi078.stdout:9/921: truncate f3 1950664 0 2024-09-18T12:49:38.496 INFO:tasks.workunit.client.0.smithi078.stdout:9/922: getdents d5/dc6 0 2024-09-18T12:49:38.498 INFO:tasks.workunit.client.0.smithi078.stdout:9/923: dread - d5/d7/db3/de5/fe9 zero size 2024-09-18T12:49:38.499 INFO:tasks.workunit.client.0.smithi078.stdout:9/924: read - d5/d7/dbe/de8/df1/ff2 zero size 2024-09-18T12:49:38.509 INFO:tasks.workunit.client.0.smithi078.stdout:9/925: dwrite d5/d7/d11c/f46 [4194304,4194304] 0 2024-09-18T12:49:38.514 INFO:tasks.workunit.client.0.smithi078.stdout:9/926: symlink d5/d7/db3/de5/d116/l12b 0 2024-09-18T12:49:38.518 INFO:tasks.workunit.client.0.smithi078.stdout:9/927: rmdir d5/d7/dbe/ddd/d124 0 2024-09-18T12:49:38.521 INFO:tasks.workunit.client.0.smithi078.stdout:9/928: fdatasync d5/d7/d32/f30 0 2024-09-18T12:49:38.524 INFO:tasks.workunit.client.0.smithi078.stdout:9/929: truncate d5/d7/db3/de5/fe9 804235 0 2024-09-18T12:49:38.539 INFO:tasks.workunit.client.0.smithi078.stdout:9/930: dwrite d5/f6c [0,4194304] 0 2024-09-18T12:49:38.545 INFO:tasks.workunit.client.0.smithi078.stdout:9/931: write d5/d7/d11c/d4f/fbc [139196,107535] 0 2024-09-18T12:49:38.547 INFO:tasks.workunit.client.0.smithi078.stdout:9/932: write d5/d7/d11c/d4f/fbf [1613326,124565] 0 2024-09-18T12:49:38.549 INFO:tasks.workunit.client.0.smithi078.stdout:9/933: mkdir d5/d7/dbe/de8/d12c 0 2024-09-18T12:49:38.555 INFO:tasks.workunit.client.0.smithi078.stdout:9/934: dwrite d5/d7/db1/f11d [0,4194304] 0 2024-09-18T12:49:38.558 INFO:tasks.workunit.client.0.smithi078.stdout:9/935: truncate d5/d7/dbe/ddd/ff7 971737 0 2024-09-18T12:49:38.559 INFO:tasks.workunit.client.0.smithi078.stdout:9/936: chown d5/d7/ca2 9 1 2024-09-18T12:49:38.561 INFO:tasks.workunit.client.0.smithi078.stdout:9/937: fdatasync d5/d7/d32/f24 0 2024-09-18T12:49:38.562 INFO:tasks.workunit.client.0.smithi078.stdout:9/938: dread - d5/d7/d32/fdb zero size 2024-09-18T12:49:38.563 INFO:tasks.workunit.client.0.smithi078.stdout:9/939: readlink d5/d7/d11c/d4f/l93 0 2024-09-18T12:49:38.634 INFO:tasks.workunit.client.0.smithi078.stdout:3/885: sync 2024-09-18T12:49:38.634 INFO:tasks.workunit.client.0.smithi078.stdout:7/884: sync 2024-09-18T12:49:38.636 INFO:tasks.workunit.client.0.smithi078.stdout:3/886: dread d9/d54/d7f/d9c/fc3 [0,4194304] 0 2024-09-18T12:49:38.638 INFO:tasks.workunit.client.0.smithi078.stdout:3/887: write d9/d13/d63/fd6 [4175160,105000] 0 2024-09-18T12:49:38.639 INFO:tasks.workunit.client.0.smithi078.stdout:3/888: readlink d9/d54/d7f/lb5 0 2024-09-18T12:49:38.641 INFO:tasks.workunit.client.0.smithi078.stdout:7/885: dwrite d7/d9/d14/d22/d3e/d95/db2/dcb/f118 [0,4194304] 0 2024-09-18T12:49:38.649 INFO:tasks.workunit.client.0.smithi078.stdout:7/886: dwrite d7/d9/d14/d22/d35/fc8 [0,4194304] 0 2024-09-18T12:49:38.662 INFO:tasks.workunit.client.0.smithi078.stdout:7/887: write d7/d9/d14/d22/d35/f120 [2683522,113176] 0 2024-09-18T12:49:38.668 INFO:tasks.workunit.client.0.smithi078.stdout:7/888: dwrite d7/d9/d4d/d9a/fd8 [0,4194304] 0 2024-09-18T12:49:38.765 INFO:tasks.workunit.client.0.smithi078.stdout:7/889: readlink d7/d9/d14/d22/d35/d49/l102 0 2024-09-18T12:49:38.769 INFO:tasks.workunit.client.0.smithi078.stdout:7/890: symlink d7/d9/dd7/d3b/d9d/ddb/l129 0 2024-09-18T12:49:38.770 INFO:tasks.workunit.client.0.smithi078.stdout:7/891: fdatasync d7/d9/dd7/d3b/f45 0 2024-09-18T12:49:38.772 INFO:tasks.workunit.client.0.smithi078.stdout:7/892: read d7/d9/d14/d22/d3e/fc3 [1586073,31000] 0 2024-09-18T12:49:38.772 INFO:tasks.workunit.client.0.smithi078.stdout:7/893: readlink l1 0 2024-09-18T12:49:38.776 INFO:tasks.workunit.client.0.smithi078.stdout:7/894: rename d7/d9/d14/d22/d35/d49/d61/d89 to d7/d9/dd7/d3b/d9d/d12a 0 2024-09-18T12:49:38.778 INFO:tasks.workunit.client.0.smithi078.stdout:7/895: dread - d7/d9/d14/d22/d35/d49/d61/d7b/d111/f126 zero size 2024-09-18T12:49:38.780 INFO:tasks.workunit.client.0.smithi078.stdout:7/896: mknod d7/d26/d119/c12b 0 2024-09-18T12:49:38.781 INFO:tasks.workunit.client.0.smithi078.stdout:7/897: stat d7/d26/c2d 0 2024-09-18T12:49:38.784 INFO:tasks.workunit.client.0.smithi078.stdout:7/898: truncate d7/d5d/d7a/d62/fa7 3026064 0 2024-09-18T12:49:38.785 INFO:tasks.workunit.client.0.smithi078.stdout:7/899: unlink d7/d9/dd7/d3b/cbe 0 2024-09-18T12:49:38.787 INFO:tasks.workunit.client.0.smithi078.stdout:7/900: dread - d7/d9/d14/d22/fce zero size 2024-09-18T12:49:38.789 INFO:tasks.workunit.client.0.smithi078.stdout:7/901: creat d7/d9/d14/d22/d3e/d95/db2/dcb/f12c x:0 0 0 2024-09-18T12:49:38.794 INFO:tasks.workunit.client.0.smithi078.stdout:7/902: dread d7/d9/d14/fa9 [0,4194304] 0 2024-09-18T12:49:38.809 INFO:tasks.workunit.client.0.smithi078.stdout:7/903: dread d7/d9/f13 [0,4194304] 0 2024-09-18T12:49:38.809 INFO:tasks.workunit.client.0.smithi078.stdout:0/951: sync 2024-09-18T12:49:38.809 INFO:tasks.workunit.client.0.smithi078.stdout:8/878: sync 2024-09-18T12:49:38.809 INFO:tasks.workunit.client.0.smithi078.stdout:1/880: sync 2024-09-18T12:49:38.810 INFO:tasks.workunit.client.0.smithi078.stdout:7/904: write d7/d26/f29 [4573518,77198] 0 2024-09-18T12:49:38.813 INFO:tasks.workunit.client.0.smithi078.stdout:1/881: dread - d0/d8/de2/fe7 zero size 2024-09-18T12:49:38.818 INFO:tasks.workunit.client.0.smithi078.stdout:8/879: creat d0/d39/d4c/d77/d7d/d3e/ddf/f12a x:0 0 0 2024-09-18T12:49:38.823 INFO:tasks.workunit.client.0.smithi078.stdout:8/880: rename d0/d7/dc/d71/d9b/dc2/fee to d0/d7/d53/d57/d67/d87/d101/f12b 0 2024-09-18T12:49:38.824 INFO:tasks.workunit.client.0.smithi078.stdout:8/881: write d0/db7/d62/f91 [1410230,4876] 0 2024-09-18T12:49:38.824 INFO:tasks.workunit.client.0.smithi078.stdout:7/905: creat d7/d9/d14/f12d x:0 0 0 2024-09-18T12:49:38.828 INFO:tasks.workunit.client.0.smithi078.stdout:1/882: getdents d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47 0 2024-09-18T12:49:38.829 INFO:tasks.workunit.client.0.smithi078.stdout:1/883: stat d0/l3 0 2024-09-18T12:49:38.830 INFO:tasks.workunit.client.0.smithi078.stdout:7/906: creat d7/d3f/d99/f12e x:0 0 0 2024-09-18T12:49:38.833 INFO:tasks.workunit.client.0.smithi078.stdout:1/884: rename d0/d8/daa/db5/d114/d3e/f4f to d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d9d/dc3/f12b 0 2024-09-18T12:49:38.836 INFO:tasks.workunit.client.0.smithi078.stdout:0/952: dwrite d3/f6d [0,4194304] 0 2024-09-18T12:49:38.844 INFO:tasks.workunit.client.0.smithi078.stdout:1/885: getdents d0/d5b/d6d 0 2024-09-18T12:49:38.847 INFO:tasks.workunit.client.0.smithi078.stdout:7/907: dread d7/d26/f79 [0,4194304] 0 2024-09-18T12:49:38.847 INFO:tasks.workunit.client.0.smithi078.stdout:0/953: getdents d3/d1f/d2e/d4e 0 2024-09-18T12:49:38.847 INFO:tasks.workunit.client.0.smithi078.stdout:8/882: dwrite d0/d7/d1e/d4b/f61 [0,4194304] 0 2024-09-18T12:49:38.849 INFO:tasks.workunit.client.0.smithi078.stdout:9/940: sync 2024-09-18T12:49:38.849 INFO:tasks.workunit.client.0.smithi078.stdout:2/838: sync 2024-09-18T12:49:38.849 INFO:tasks.workunit.client.0.smithi078.stdout:1/886: stat d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/f66 0 2024-09-18T12:49:38.851 INFO:tasks.workunit.client.0.smithi078.stdout:0/954: chown d3/d1f/d2e/d4e/d37/d72/d96/ffa 242519193 1 2024-09-18T12:49:38.851 INFO:tasks.workunit.client.0.smithi078.stdout:8/883: truncate d0/db7/d62/df2/f102 472559 0 2024-09-18T12:49:38.852 INFO:tasks.workunit.client.0.smithi078.stdout:1/887: fdatasync d0/d8/daa/db5/d114/d3e/d58/d6e/d52/f2e 0 2024-09-18T12:49:38.853 INFO:tasks.workunit.client.0.smithi078.stdout:0/955: read - d3/d1f/d2e/d4e/db2/d116/f136 zero size 2024-09-18T12:49:38.855 INFO:tasks.workunit.client.0.smithi078.stdout:7/908: mknod d7/d9/d14/d22/d3e/dc9/c12f 0 2024-09-18T12:49:38.857 INFO:tasks.workunit.client.0.smithi078.stdout:9/941: mkdir d5/d7/d32/d2a/d36/d12d 0 2024-09-18T12:49:38.860 INFO:tasks.workunit.client.0.smithi078.stdout:8/884: unlink d0/d39/d4c/d77/dd7/lf8 0 2024-09-18T12:49:38.864 INFO:tasks.workunit.client.0.smithi078.stdout:9/942: symlink d5/d7/d32/d2a/d68/d97/l12e 0 2024-09-18T12:49:38.864 INFO:tasks.workunit.client.0.smithi078.stdout:9/943: chown d5/d40/c47 1366759006 1 2024-09-18T12:49:38.871 INFO:tasks.workunit.client.0.smithi078.stdout:7/909: link d7/d9/d14/d22/d35/f120 d7/d9/d14/d22/d3e/d95/db2/dcb/f130 0 2024-09-18T12:49:38.871 INFO:tasks.workunit.client.0.smithi078.stdout:0/956: write d3/d1f/f41 [977958,73754] 0 2024-09-18T12:49:38.873 INFO:tasks.workunit.client.0.smithi078.stdout:0/957: fsync d3/d1f/d2e/d4e/db2/d116/f136 0 2024-09-18T12:49:38.873 INFO:tasks.workunit.client.0.smithi078.stdout:1/888: truncate d0/d8/daa/db5/d114/d3e/d58/d6e/d52/f2d 2424701 0 2024-09-18T12:49:38.875 INFO:tasks.workunit.client.0.smithi078.stdout:2/839: mknod d4/d8/d23/d52/d5f/d86/d3b/d4f/dd7/c110 0 2024-09-18T12:49:38.878 INFO:tasks.workunit.client.0.smithi078.stdout:9/944: symlink d5/d7/db3/de5/d110/l12f 0 2024-09-18T12:49:38.878 INFO:tasks.workunit.client.0.smithi078.stdout:9/945: stat d5/d7/d32/d2a/d68/cc3 0 2024-09-18T12:49:38.880 INFO:tasks.workunit.client.0.smithi078.stdout:8/885: write d0/d7/dc/f64 [5079217,36433] 0 2024-09-18T12:49:38.881 INFO:tasks.workunit.client.0.smithi078.stdout:8/886: write d0/d7/dc/d1f/f28 [282760,77569] 0 2024-09-18T12:49:38.882 INFO:tasks.workunit.client.0.smithi078.stdout:8/887: chown d0/d39/dc5/c122 184 1 2024-09-18T12:49:38.884 INFO:tasks.workunit.client.0.smithi078.stdout:2/840: stat d4/db/dc/dc0/df2/l90 0 2024-09-18T12:49:38.884 INFO:tasks.workunit.client.0.smithi078.stdout:7/910: mknod d7/d9/dd7/d3b/dc0/c131 0 2024-09-18T12:49:38.885 INFO:tasks.workunit.client.0.smithi078.stdout:7/911: stat d7/d9/f13 0 2024-09-18T12:49:38.885 INFO:tasks.workunit.client.0.smithi078.stdout:0/958: mkdir d3/d1f/d2e/d68/dc9/d144 0 2024-09-18T12:49:38.889 INFO:tasks.workunit.client.0.smithi078.stdout:2/841: dread d4/dd/f8b [0,4194304] 0 2024-09-18T12:49:38.892 INFO:tasks.workunit.client.0.smithi078.stdout:1/889: truncate d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/f69 2961917 0 2024-09-18T12:49:38.897 INFO:tasks.workunit.client.0.smithi078.stdout:9/946: link d5/d7/d32/d2a/l10d d5/d7/dbe/de8/l130 0 2024-09-18T12:49:38.904 INFO:tasks.workunit.client.0.smithi078.stdout:2/842: mkdir d4/d8/d23/d52/d5f/d86/d3b/d4f/dd7/d111 0 2024-09-18T12:49:38.905 INFO:tasks.workunit.client.0.smithi078.stdout:1/890: mknod d0/d8/daa/c12c 0 2024-09-18T12:49:38.906 INFO:tasks.workunit.client.0.smithi078.stdout:7/912: dwrite d7/d9/d14/d22/f57 [0,4194304] 0 2024-09-18T12:49:38.908 INFO:tasks.workunit.client.0.smithi078.stdout:2/843: readlink d4/db/d45/dbc/ld0 0 2024-09-18T12:49:38.911 INFO:tasks.workunit.client.0.smithi078.stdout:0/959: dwrite d3/d1f/d2e/f83 [0,4194304] 0 2024-09-18T12:49:38.914 INFO:tasks.workunit.client.0.smithi078.stdout:1/891: truncate d0/d8/daa/db5/d114/d3e/d50/d74/f125 673168 0 2024-09-18T12:49:38.920 INFO:tasks.workunit.client.0.smithi078.stdout:1/892: dwrite d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f/f94 [0,4194304] 0 2024-09-18T12:49:38.922 INFO:tasks.workunit.client.0.smithi078.stdout:3/889: sync 2024-09-18T12:49:38.940 INFO:tasks.workunit.client.0.smithi078.stdout:8/888: link d0/d7/dc/f26 d0/d39/dc5/f12c 0 2024-09-18T12:49:38.941 INFO:tasks.workunit.client.0.smithi078.stdout:2/844: creat d4/d1a/f112 x:0 0 0 2024-09-18T12:49:38.943 INFO:tasks.workunit.client.0.smithi078.stdout:7/913: unlink d7/d9/d14/d22/d35/d49/d56/ff7 0 2024-09-18T12:49:38.944 INFO:tasks.workunit.client.0.smithi078.stdout:7/914: write d7/d9/dd7/fee [318840,37198] 0 2024-09-18T12:49:38.944 INFO:tasks.workunit.client.0.smithi078.stdout:0/960: symlink d3/d1f/d2e/d4e/d37/d72/d96/l145 0 2024-09-18T12:49:38.945 INFO:tasks.workunit.client.0.smithi078.stdout:0/961: chown d3/d1f/d2e/d4e/d37/f55 20538560 1 2024-09-18T12:49:38.949 INFO:tasks.workunit.client.0.smithi078.stdout:3/890: mknod d9/d54/d89/d92/db6/d104/c115 0 2024-09-18T12:49:38.950 INFO:tasks.workunit.client.0.smithi078.stdout:0/962: mkdir d3/d1f/d2e/d4e/d37/d72/ddd/d146 0 2024-09-18T12:49:38.952 INFO:tasks.workunit.client.0.smithi078.stdout:8/889: mkdir d0/d7/d1e/da9/d6d/dfe/d12d 0 2024-09-18T12:49:38.955 INFO:tasks.workunit.client.0.smithi078.stdout:7/915: rename d7/d9/d14/d22/d35/c81 to d7/c132 0 2024-09-18T12:49:38.958 INFO:tasks.workunit.client.0.smithi078.stdout:0/963: dread d3/d82/d10d/d7c/da3/fc8 [0,4194304] 0 2024-09-18T12:49:38.958 INFO:tasks.workunit.client.0.smithi078.stdout:3/891: truncate d9/d54/fb4 1051606 0 2024-09-18T12:49:38.959 INFO:tasks.workunit.client.0.smithi078.stdout:2/845: getdents d4/d20/d85 0 2024-09-18T12:49:38.960 INFO:tasks.workunit.client.0.smithi078.stdout:2/846: chown d4/d8/ffd 179302 1 2024-09-18T12:49:38.962 INFO:tasks.workunit.client.0.smithi078.stdout:3/892: write d9/d2f/f3d [1148817,65987] 0 2024-09-18T12:49:38.963 INFO:tasks.workunit.client.0.smithi078.stdout:7/916: mknod d7/d9/c133 0 2024-09-18T12:49:38.965 INFO:tasks.workunit.client.0.smithi078.stdout:2/847: rmdir d4/d1a 39 2024-09-18T12:49:38.967 INFO:tasks.workunit.client.0.smithi078.stdout:3/893: mknod d9/d13/d33/d3c/d19/c116 0 2024-09-18T12:49:38.967 INFO:tasks.workunit.client.0.smithi078.stdout:7/917: dread d7/d26/d84/fb4 [0,4194304] 0 2024-09-18T12:49:38.968 INFO:tasks.workunit.client.0.smithi078.stdout:3/894: truncate d9/d13/d33/f51 9347342 0 2024-09-18T12:49:38.970 INFO:tasks.workunit.client.0.smithi078.stdout:7/918: write d7/d5d/d87/ffb [2015202,19674] 0 2024-09-18T12:49:38.971 INFO:tasks.workunit.client.0.smithi078.stdout:3/895: rmdir d9/d13/d37 39 2024-09-18T12:49:38.972 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:38 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:38.977 INFO:tasks.workunit.client.0.smithi078.stdout:7/919: rename d7/d9/dd7/d3b/d9d/ddb/l129 to d7/d9/l134 0 2024-09-18T12:49:38.978 INFO:tasks.workunit.client.0.smithi078.stdout:3/896: creat d9/d13/f117 x:0 0 0 2024-09-18T12:49:38.978 INFO:tasks.workunit.client.0.smithi078.stdout:7/920: stat d7/d9/d14/d22/d3e/l5a 0 2024-09-18T12:49:38.984 INFO:tasks.workunit.client.0.smithi078.stdout:7/921: mkdir d7/d9/d14/d22/d35/d49/d56/d135 0 2024-09-18T12:49:38.985 INFO:tasks.workunit.client.0.smithi078.stdout:7/922: write d7/d3f/d99/f123 [383146,82729] 0 2024-09-18T12:49:38.987 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:38 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:38.991 INFO:tasks.workunit.client.0.smithi078.stdout:7/923: truncate d7/d3f/f64 1649148 0 2024-09-18T12:49:38.992 INFO:tasks.workunit.client.0.smithi078.stdout:3/897: link d9/d29/d4b/d4c/l5a d9/d13/d63/d78/l118 0 2024-09-18T12:49:38.995 INFO:tasks.workunit.client.0.smithi078.stdout:7/924: unlink d7/f1d 0 2024-09-18T12:49:38.996 INFO:tasks.workunit.client.0.smithi078.stdout:3/898: creat d9/d54/d89/d92/f119 x:0 0 0 2024-09-18T12:49:38.997 INFO:tasks.workunit.client.0.smithi078.stdout:3/899: fsync d9/d54/d89/d92/fc7 0 2024-09-18T12:49:38.998 INFO:tasks.workunit.client.0.smithi078.stdout:7/925: creat d7/d5d/d7a/d62/f136 x:0 0 0 2024-09-18T12:49:39.007 INFO:tasks.workunit.client.0.smithi078.stdout:3/900: link d9/d54/d7f/ffa d9/f11a 0 2024-09-18T12:49:39.009 INFO:tasks.workunit.client.0.smithi078.stdout:7/926: rename d7/d9/d14/d22/d35/d49/d61/d7b/ff2 to d7/d9/d14/f137 0 2024-09-18T12:49:39.011 INFO:tasks.workunit.client.0.smithi078.stdout:7/927: chown d7/d9/d14/d22/d35/d49/d7d/lb9 106 1 2024-09-18T12:49:39.012 INFO:tasks.workunit.client.0.smithi078.stdout:3/901: symlink d9/d54/d6c/d9f/dfd/l11b 0 2024-09-18T12:49:39.013 INFO:tasks.workunit.client.0.smithi078.stdout:7/928: creat d7/d9/dd7/d3b/d9d/d12a/f138 x:0 0 0 2024-09-18T12:49:39.014 INFO:tasks.workunit.client.0.smithi078.stdout:3/902: dread d9/d13/d63/d78/f105 [0,4194304] 0 2024-09-18T12:49:39.019 INFO:tasks.workunit.client.0.smithi078.stdout:3/903: fsync d9/d2f/d43/d62/fad 0 2024-09-18T12:49:39.019 INFO:tasks.workunit.client.0.smithi078.stdout:3/904: write d9/d2f/d43/d62/f101 [200473,39987] 0 2024-09-18T12:49:39.021 INFO:tasks.workunit.client.0.smithi078.stdout:1/893: write d0/d8/de2/fe7 [555835,84681] 0 2024-09-18T12:49:39.026 INFO:tasks.workunit.client.0.smithi078.stdout:8/890: write d0/d7/dc/d1f/d23/f8c [4827506,21363] 0 2024-09-18T12:49:39.030 INFO:tasks.workunit.client.0.smithi078.stdout:7/929: getdents d7/d9/dd7/d3b/d9d/ddb 0 2024-09-18T12:49:39.033 INFO:tasks.workunit.client.0.smithi078.stdout:3/905: dwrite d9/d2f/d43/d62/f101 [0,4194304] 0 2024-09-18T12:49:39.033 INFO:tasks.workunit.client.0.smithi078.stdout:9/947: dwrite d5/d7/dbe/ddd/ff7 [0,4194304] 0 2024-09-18T12:49:39.036 INFO:tasks.workunit.client.0.smithi078.stdout:7/930: stat d7/d9/d4d/de2/d112 0 2024-09-18T12:49:39.040 INFO:tasks.workunit.client.0.smithi078.stdout:8/891: write d0/d7/dc/d1f/d23/d40/f6c [858058,19097] 0 2024-09-18T12:49:39.040 INFO:tasks.workunit.client.0.smithi078.stdout:0/964: dwrite d3/d1f/d2e/d4e/d37/f5c [0,4194304] 0 2024-09-18T12:49:39.043 INFO:tasks.workunit.client.0.smithi078.stdout:2/848: dwrite d4/dd/f8b [0,4194304] 0 2024-09-18T12:49:39.047 INFO:tasks.workunit.client.0.smithi078.stdout:1/894: rename d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/c88 to d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/c12d 0 2024-09-18T12:49:39.052 INFO:tasks.workunit.client.0.smithi078.stdout:7/931: mkdir d7/d9/d14/d22/d35/d49/d56/d8d/d139 0 2024-09-18T12:49:39.054 INFO:tasks.workunit.client.0.smithi078.stdout:2/849: read d4/d8/d23/d52/faa [292141,23421] 0 2024-09-18T12:49:39.058 INFO:tasks.workunit.client.0.smithi078.stdout:0/965: truncate d3/d1f/d2e/ff9 1001252 0 2024-09-18T12:49:39.059 INFO:tasks.workunit.client.0.smithi078.stdout:1/895: fdatasync d0/d8/f3a 0 2024-09-18T12:49:39.059 INFO:tasks.workunit.client.0.smithi078.stdout:9/948: getdents d5/dc6 0 2024-09-18T12:49:39.061 INFO:tasks.workunit.client.0.smithi078.stdout:1/896: fsync d0/d8/daa/db5/d114/d45/f122 0 2024-09-18T12:49:39.062 INFO:tasks.workunit.client.0.smithi078.stdout:9/949: dread - d5/d7/dbe/f128 zero size 2024-09-18T12:49:39.062 INFO:tasks.workunit.client.0.smithi078.stdout:0/966: mkdir d3/d82/dd7/d134/d147 0 2024-09-18T12:49:39.064 INFO:tasks.workunit.client.0.smithi078.stdout:3/906: creat d9/df/f11c x:0 0 0 2024-09-18T12:49:39.065 INFO:tasks.workunit.client.0.smithi078.stdout:9/950: creat d5/d5c/f131 x:0 0 0 2024-09-18T12:49:39.066 INFO:tasks.workunit.client.0.smithi078.stdout:7/932: creat d7/d9/dd7/d3b/f13a x:0 0 0 2024-09-18T12:49:39.067 INFO:tasks.workunit.client.0.smithi078.stdout:1/897: rmdir d0/d8/daa/db5/d114/d3e/d58/d6e/d52 39 2024-09-18T12:49:39.068 INFO:tasks.workunit.client.0.smithi078.stdout:8/892: read d0/d7/d53/d57/d67/fc0 [3143642,38404] 0 2024-09-18T12:49:39.068 INFO:tasks.workunit.client.0.smithi078.stdout:9/951: write d5/d7/d32/d2a/f72 [2446660,1412] 0 2024-09-18T12:49:39.086 INFO:tasks.workunit.client.0.smithi078.stdout:9/952: creat d5/d40/f132 x:0 0 0 2024-09-18T12:49:39.087 INFO:tasks.workunit.client.0.smithi078.stdout:0/967: dwrite d3/fd2 [0,4194304] 0 2024-09-18T12:49:39.090 INFO:tasks.workunit.client.0.smithi078.stdout:7/933: truncate d7/d9/dd7/d3b/f45 4835233 0 2024-09-18T12:49:39.091 INFO:tasks.workunit.client.0.smithi078.stdout:0/968: chown d3/d1f/d2e/d4e/d37/f51 3 1 2024-09-18T12:49:39.094 INFO:tasks.workunit.client.0.smithi078.stdout:0/969: write d3/d1f/f52 [2090862,80428] 0 2024-09-18T12:49:39.096 INFO:tasks.workunit.client.0.smithi078.stdout:2/850: dwrite d4/db/dc/fb2 [0,4194304] 0 2024-09-18T12:49:39.097 INFO:tasks.workunit.client.0.smithi078.stdout:9/953: dread d5/d7/d32/d2a/fd4 [0,4194304] 0 2024-09-18T12:49:39.098 INFO:tasks.workunit.client.0.smithi078.stdout:7/934: unlink d7/d26/cb5 0 2024-09-18T12:49:39.100 INFO:tasks.workunit.client.0.smithi078.stdout:8/893: getdents d0/d7/dc/d71/d9b/db6 0 2024-09-18T12:49:39.108 INFO:tasks.workunit.client.0.smithi078.stdout:0/970: rename d3/d1f/d2e/d4e/d37/fe6 to d3/d82/d10d/d7c/f148 0 2024-09-18T12:49:39.112 INFO:tasks.workunit.client.0.smithi078.stdout:9/954: creat d5/d7/dbe/ddd/f133 x:0 0 0 2024-09-18T12:49:39.112 INFO:tasks.workunit.client.0.smithi078.stdout:7/935: rmdir d7/d5d/d7a/d62 39 2024-09-18T12:49:39.113 INFO:tasks.workunit.client.0.smithi078.stdout:8/894: unlink d0/d39/dbc/fbf 0 2024-09-18T12:49:39.113 INFO:tasks.workunit.client.0.smithi078.stdout:1/898: link d0/c15 d0/d8/daa/db5/d114/d3e/d58/d6e/c12e 0 2024-09-18T12:49:39.116 INFO:tasks.workunit.client.0.smithi078.stdout:0/971: dwrite d3/d1f/d2e/f35 [4194304,4194304] 0 2024-09-18T12:49:39.119 INFO:tasks.workunit.client.0.smithi078.stdout:9/955: creat d5/d7/dbe/f134 x:0 0 0 2024-09-18T12:49:39.120 INFO:tasks.workunit.client.0.smithi078.stdout:8/895: rmdir d0/d7/d1e/da9/d6d/dfe 39 2024-09-18T12:49:39.121 INFO:tasks.workunit.client.0.smithi078.stdout:2/851: link d4/d20/f29 d4/d8/d23/d52/d7c/f113 0 2024-09-18T12:49:39.121 INFO:tasks.workunit.client.0.smithi078.stdout:2/852: chown d4/db/dc/dc0 29 1 2024-09-18T12:49:39.124 INFO:tasks.workunit.client.0.smithi078.stdout:9/956: fsync d5/fce 0 2024-09-18T12:49:39.125 INFO:tasks.workunit.client.0.smithi078.stdout:9/957: truncate d5/d5c/ff9 5546285 0 2024-09-18T12:49:39.133 INFO:tasks.workunit.client.0.smithi078.stdout:1/899: write d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f/ff9 [431420,71749] 0 2024-09-18T12:49:39.136 INFO:tasks.workunit.client.0.smithi078.stdout:7/936: link d7/d26/d84/lf0 d7/d9/d14/d22/d35/d49/d56/d135/l13b 0 2024-09-18T12:49:39.136 INFO:tasks.workunit.client.0.smithi078.stdout:7/937: fdatasync d7/d5d/f6d 0 2024-09-18T12:49:39.138 INFO:tasks.workunit.client.0.smithi078.stdout:9/958: mknod d5/d7/d32/d2a/d36/d12d/c135 0 2024-09-18T12:49:39.146 INFO:tasks.workunit.client.0.smithi078.stdout:7/938: mknod d7/c13c 0 2024-09-18T12:49:39.148 INFO:tasks.workunit.client.0.smithi078.stdout:1/900: getdents d0/d8/daa/db5/d114 0 2024-09-18T12:49:39.149 INFO:tasks.workunit.client.0.smithi078.stdout:1/901: chown d0/d8/daa/db5/d114/d3e/l110 20 1 2024-09-18T12:49:39.159 INFO:tasks.workunit.client.0.smithi078.stdout:8/896: write d0/d39/fa0 [360292,113514] 0 2024-09-18T12:49:39.163 INFO:tasks.workunit.client.0.smithi078.stdout:0/972: truncate d3/d1f/d2e/d4e/d37/f5c 4906983 0 2024-09-18T12:49:39.165 INFO:tasks.workunit.client.0.smithi078.stdout:8/897: unlink d0/d39/d4c/d77/dd7/lf4 0 2024-09-18T12:49:39.166 INFO:tasks.workunit.client.0.smithi078.stdout:8/898: stat d0/d7/dc/d1f/d23/d40/f94 0 2024-09-18T12:49:39.169 INFO:tasks.workunit.client.0.smithi078.stdout:2/853: write d4/d8/d6c/d70/fa3 [158361,40964] 0 2024-09-18T12:49:39.175 INFO:tasks.workunit.client.0.smithi078.stdout:0/973: link d3/d82/d10d/d7c/da3/de2/lc4 d3/d1f/d2e/d4e/db2/d116/l149 0 2024-09-18T12:49:39.177 INFO:tasks.workunit.client.0.smithi078.stdout:0/974: write d3/d1f/d2e/d68/dc9/dcd/f140 [510704,45559] 0 2024-09-18T12:49:39.181 INFO:tasks.workunit.client.0.smithi078.stdout:8/899: getdents d0/d7 0 2024-09-18T12:49:39.182 INFO:tasks.workunit.client.0.smithi078.stdout:0/975: mknod d3/d1f/d2e/d4e/d37/d72/d96/c14a 0 2024-09-18T12:49:39.185 INFO:tasks.workunit.client.0.smithi078.stdout:8/900: unlink d0/d7/d1e/d4b/f98 0 2024-09-18T12:49:39.188 INFO:tasks.workunit.client.0.smithi078.stdout:9/959: dwrite d5/f5e [0,4194304] 0 2024-09-18T12:49:39.192 INFO:tasks.workunit.client.0.smithi078.stdout:9/960: chown d5/d7/d11c/f1a 172 1 2024-09-18T12:49:39.193 INFO:tasks.workunit.client.0.smithi078.stdout:8/901: creat d0/d7/dc/d1f/d23/d9c/f12e x:0 0 0 2024-09-18T12:49:39.194 INFO:tasks.workunit.client.0.smithi078.stdout:9/961: write d5/d7/d32/d2a/d68/db0/f10e [458967,115674] 0 2024-09-18T12:49:39.195 INFO:tasks.workunit.client.0.smithi078.stdout:1/902: write d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f/fbc [396129,36070] 0 2024-09-18T12:49:39.196 INFO:tasks.workunit.client.0.smithi078.stdout:7/939: write d7/d9/d14/d22/d3e/f40 [617853,23669] 0 2024-09-18T12:49:39.203 INFO:tasks.workunit.client.0.smithi078.stdout:9/962: truncate d5/d7/dbe/de8/fd6 451398 0 2024-09-18T12:49:39.205 INFO:tasks.workunit.client.0.smithi078.stdout:7/940: mknod d7/d9/d14/d22/d3e/d95/c13d 0 2024-09-18T12:49:39.207 INFO:tasks.workunit.client.0.smithi078.stdout:8/902: link d0/d39/dbc/f115 d0/d7/dc/d71/d9b/db6/f12f 0 2024-09-18T12:49:39.208 INFO:tasks.workunit.client.0.smithi078.stdout:1/903: creat d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d127/f12f x:0 0 0 2024-09-18T12:49:39.210 INFO:tasks.workunit.client.0.smithi078.stdout:8/903: stat d0/d7/dc/d1f/d6f/le3 0 2024-09-18T12:49:39.211 INFO:tasks.workunit.client.0.smithi078.stdout:2/854: dwrite d4/d8/d23/d52/d5f/d86/d3b/d4f/f61 [0,4194304] 0 2024-09-18T12:49:39.213 INFO:tasks.workunit.client.0.smithi078.stdout:1/904: readlink d0/d8/daa/db5/d114/d3e/d58/l9c 0 2024-09-18T12:49:39.214 INFO:tasks.workunit.client.0.smithi078.stdout:7/941: rename d7/d5d/d7a/c58 to d7/d9/d14/d22/d35/d49/dda/c13e 0 2024-09-18T12:49:39.222 INFO:tasks.workunit.client.0.smithi078.stdout:0/976: dwrite d3/d1f/d2e/d4e/d37/d72/fba [0,4194304] 0 2024-09-18T12:49:39.222 INFO:tasks.workunit.client.0.smithi078.stdout:9/963: dwrite d5/d7/d11c/d4f/f64 [0,4194304] 0 2024-09-18T12:49:39.226 INFO:tasks.workunit.client.0.smithi078.stdout:8/904: dread - d0/d7/d1e/d4b/f11f zero size 2024-09-18T12:49:39.229 INFO:tasks.workunit.client.0.smithi078.stdout:2/855: rename d4/d8/d23/d52/d5f/d86/d33 to d4/d8/d23/d52/d5f/d81/dae/d114 0 2024-09-18T12:49:39.235 INFO:tasks.workunit.client.0.smithi078.stdout:0/977: truncate d3/d43/fd5 5283188 0 2024-09-18T12:49:39.237 INFO:tasks.workunit.client.0.smithi078.stdout:9/964: truncate d5/d7/d32/d2a/d68/fdf 1560038 0 2024-09-18T12:49:39.239 INFO:tasks.workunit.client.0.smithi078.stdout:8/905: fdatasync d0/d39/d4c/d77/d7d/d3e/fa1 0 2024-09-18T12:49:39.241 INFO:tasks.workunit.client.0.smithi078.stdout:1/905: dread d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f/fff [0,4194304] 0 2024-09-18T12:49:39.245 INFO:tasks.workunit.client.0.smithi078.stdout:8/906: fdatasync d0/d7/d53/f5e 0 2024-09-18T12:49:39.245 INFO:tasks.workunit.client.0.smithi078.stdout:0/978: chown d3/d1f/d2e/d4e/d37/f5c 699302 1 2024-09-18T12:49:39.245 INFO:tasks.workunit.client.0.smithi078.stdout:7/942: dwrite d7/f33 [0,4194304] 0 2024-09-18T12:49:39.246 INFO:tasks.workunit.client.0.smithi078.stdout:8/907: mknod d0/d7/c130 0 2024-09-18T12:49:39.247 INFO:tasks.workunit.client.0.smithi078.stdout:2/856: truncate d4/d8/d23/d52/d7c/f113 1905992 0 2024-09-18T12:49:39.247 INFO:tasks.workunit.client.0.smithi078.stdout:1/906: creat d0/d8/daa/db5/d114/f130 x:0 0 0 2024-09-18T12:49:39.248 INFO:tasks.workunit.client.0.smithi078.stdout:2/857: chown d4/d20/l7d 2994388 1 2024-09-18T12:49:39.249 INFO:tasks.workunit.client.0.smithi078.stdout:2/858: dread d4/dd/fc7 [0,4194304] 0 2024-09-18T12:49:39.250 INFO:tasks.workunit.client.0.smithi078.stdout:1/907: rmdir d0 39 2024-09-18T12:49:39.251 INFO:tasks.workunit.client.0.smithi078.stdout:0/979: rename d3/d1f/d2e/d8f/da1/c13e to d3/d1f/d2e/d8f/da1/c14b 0 2024-09-18T12:49:39.254 INFO:tasks.workunit.client.0.smithi078.stdout:2/859: rename d4/dd/f8b to d4/db/d45/dbc/dee/f115 0 2024-09-18T12:49:39.255 INFO:tasks.workunit.client.0.smithi078.stdout:7/943: dwrite d7/d9/d14/fa9 [0,4194304] 0 2024-09-18T12:49:39.256 INFO:tasks.workunit.client.0.smithi078.stdout:7/944: dread - d7/d26/d4f/f76 zero size 2024-09-18T12:49:39.258 INFO:tasks.workunit.client.0.smithi078.stdout:2/860: symlink d4/db/dd8/l116 0 2024-09-18T12:49:39.263 INFO:tasks.workunit.client.0.smithi078.stdout:0/980: creat d3/d1f/d2e/d4e/d37/d72/ddd/d146/f14c x:0 0 0 2024-09-18T12:49:39.265 INFO:tasks.workunit.client.0.smithi078.stdout:9/965: write d5/d7/d11c/f6a [68922,88850] 0 2024-09-18T12:49:39.267 INFO:tasks.workunit.client.0.smithi078.stdout:2/861: dwrite d4/d8/d23/d52/d5f/d86/d3b/d55/f109 [0,4194304] 0 2024-09-18T12:49:39.271 INFO:tasks.workunit.client.0.smithi078.stdout:9/966: fsync d5/d7/d32/d2a/fd9 0 2024-09-18T12:49:39.275 INFO:tasks.workunit.client.0.smithi078.stdout:7/945: fdatasync d7/d5d/d7a/d62/fa7 0 2024-09-18T12:49:39.281 INFO:tasks.workunit.client.0.smithi078.stdout:9/967: unlink d5/d7/d32/d2a/l10d 0 2024-09-18T12:49:39.281 INFO:tasks.workunit.client.0.smithi078.stdout:7/946: dwrite d7/d26/d84/fa1 [0,4194304] 0 2024-09-18T12:49:39.283 INFO:tasks.workunit.client.0.smithi078.stdout:9/968: truncate d5/d7/dbe/f134 526232 0 2024-09-18T12:49:39.288 INFO:tasks.workunit.client.0.smithi078.stdout:2/862: symlink d4/d8/d23/d52/d5f/d86/l117 0 2024-09-18T12:49:39.290 INFO:tasks.workunit.client.0.smithi078.stdout:9/969: dread d5/d7/d32/d2a/d68/db0/f10e [0,4194304] 0 2024-09-18T12:49:39.291 INFO:tasks.workunit.client.0.smithi078.stdout:9/970: fdatasync d5/d7/dbe/de8/f122 0 2024-09-18T12:49:39.293 INFO:tasks.workunit.client.0.smithi078.stdout:7/947: creat d7/d9/d14/d22/d3e/d95/db2/f13f x:0 0 0 2024-09-18T12:49:39.295 INFO:tasks.workunit.client.0.smithi078.stdout:0/981: dread d3/f7b [0,4194304] 0 2024-09-18T12:49:39.298 INFO:tasks.workunit.client.0.smithi078.stdout:8/908: dwrite d0/d7/d1e/da9/dd4/ff6 [4194304,4194304] 0 2024-09-18T12:49:39.302 INFO:tasks.workunit.client.0.smithi078.stdout:7/948: truncate d7/d9/f20 2946577 0 2024-09-18T12:49:39.303 INFO:tasks.workunit.client.0.smithi078.stdout:7/949: chown d7/d9/d14/d22/d3e/f106 572 1 2024-09-18T12:49:39.304 INFO:tasks.workunit.client.0.smithi078.stdout:7/950: chown d7/d9/d14/d22/d3e/dc9 33236 1 2024-09-18T12:49:39.306 INFO:tasks.workunit.client.0.smithi078.stdout:7/951: fdatasync d7/d9/d14/d22/d35/d49/d56/d8d/f9e 0 2024-09-18T12:49:39.313 INFO:tasks.workunit.client.0.smithi078.stdout:1/908: dread d0/d8/daa/db5/d114/d3e/d50/dba/fb3 [0,4194304] 0 2024-09-18T12:49:39.313 INFO:tasks.workunit.client.0.smithi078.stdout:2/863: creat d4/d8/d23/d52/f118 x:0 0 0 2024-09-18T12:49:39.318 INFO:tasks.workunit.client.0.smithi078.stdout:2/864: mknod d4/d8/d23/d52/d5f/d81/c119 0 2024-09-18T12:49:39.319 INFO:tasks.workunit.client.0.smithi078.stdout:0/982: dread d3/d1f/d2e/d68/f2b [0,4194304] 0 2024-09-18T12:49:39.321 INFO:tasks.workunit.client.0.smithi078.stdout:0/983: read d3/d1f/d2e/d4e/d37/d72/fae [615935,44041] 0 2024-09-18T12:49:39.322 INFO:tasks.workunit.client.0.smithi078.stdout:2/865: fdatasync d4/d8/d23/d52/d5f/d86/d3b/d4f/f57 0 2024-09-18T12:49:39.324 INFO:tasks.workunit.client.0.smithi078.stdout:2/866: chown d4/dd/f64 0 1 2024-09-18T12:49:39.324 INFO:tasks.workunit.client.0.smithi078.stdout:1/909: link d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f/f94 d0/d8/de2/f131 0 2024-09-18T12:49:39.324 INFO:tasks.workunit.client.0.smithi078.stdout:8/909: write d0/d39/d4c/d77/fa2 [3041412,85197] 0 2024-09-18T12:49:39.325 INFO:tasks.workunit.client.0.smithi078.stdout:0/984: mknod d3/d82/c14d 0 2024-09-18T12:49:39.331 INFO:tasks.workunit.client.0.smithi078.stdout:0/985: dwrite d3/d1f/d2e/f83 [0,4194304] 0 2024-09-18T12:49:39.333 INFO:tasks.workunit.client.0.smithi078.stdout:0/986: stat d3/d1f/d2e/d4e/d37/f5a 0 2024-09-18T12:49:39.334 INFO:tasks.workunit.client.0.smithi078.stdout:0/987: stat d3/d43/dd0 0 2024-09-18T12:49:39.335 INFO:tasks.workunit.client.0.smithi078.stdout:8/910: mkdir d0/d7/d1e/da9/d6d/dfe/d131 0 2024-09-18T12:49:39.339 INFO:tasks.workunit.client.0.smithi078.stdout:2/867: write d4/d8/d23/d52/d5f/d81/dac/daf/fcb [400755,14795] 0 2024-09-18T12:49:39.343 INFO:tasks.workunit.client.0.smithi078.stdout:1/910: write d0/d8/daa/db5/d114/d3e/d50/dba/fb3 [1237498,14304] 0 2024-09-18T12:49:39.345 INFO:tasks.workunit.client.0.smithi078.stdout:2/868: creat d4/d8/d23/d52/d7c/f11a x:0 0 0 2024-09-18T12:49:39.346 INFO:tasks.workunit.client.0.smithi078.stdout:0/988: link d3/d1f/d2e/d68/dc9/dcd/d128/c10f d3/d82/d10d/d7c/c14e 0 2024-09-18T12:49:39.349 INFO:tasks.workunit.client.0.smithi078.stdout:2/869: symlink d4/d20/d85/l11b 0 2024-09-18T12:49:39.349 INFO:tasks.workunit.client.0.smithi078.stdout:8/911: write d0/f16 [889674,78995] 0 2024-09-18T12:49:39.350 INFO:tasks.workunit.client.0.smithi078.stdout:0/989: readlink d3/d1f/d2e/d4e/l71 0 2024-09-18T12:49:39.350 INFO:tasks.workunit.client.0.smithi078.stdout:8/912: stat d0/d7/d1e 0 2024-09-18T12:49:39.352 INFO:tasks.workunit.client.0.smithi078.stdout:1/911: creat d0/d8/daa/db5/f132 x:0 0 0 2024-09-18T12:49:39.354 INFO:tasks.workunit.client.0.smithi078.stdout:0/990: creat d3/d82/d10d/d7c/da3/de2/d12f/f14f x:0 0 0 2024-09-18T12:49:39.357 INFO:tasks.workunit.client.0.smithi078.stdout:1/912: unlink d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f/f116 0 2024-09-18T12:49:39.359 INFO:tasks.workunit.client.0.smithi078.stdout:8/913: link d0/d7/d1e/da9/f3a d0/d7/f132 0 2024-09-18T12:49:39.360 INFO:tasks.workunit.client.0.smithi078.stdout:0/991: creat d3/d82/d10d/d7c/d10b/f150 x:0 0 0 2024-09-18T12:49:39.361 INFO:tasks.workunit.client.0.smithi078.stdout:2/870: dread d4/d1a/f2e [0,4194304] 0 2024-09-18T12:49:39.363 INFO:tasks.workunit.client.0.smithi078.stdout:1/913: fdatasync d0/d8/daa/db5/d114/d3e/d58/d6e/f7a 0 2024-09-18T12:49:39.364 INFO:tasks.workunit.client.0.smithi078.stdout:8/914: stat d0/d7/d53/f5e 0 2024-09-18T12:49:39.365 INFO:tasks.workunit.client.0.smithi078.stdout:2/871: mknod d4/d8/d6c/c11c 0 2024-09-18T12:49:39.370 INFO:tasks.workunit.client.0.smithi078.stdout:1/914: fsync d0/d8/daa/db5/d114/d3e/d58/d6e/fab 0 2024-09-18T12:49:39.375 INFO:tasks.workunit.client.0.smithi078.stdout:0/992: dread d3/d1f/d2e/d68/f44 [4194304,4194304] 0 2024-09-18T12:49:39.375 INFO:tasks.workunit.client.0.smithi078.stdout:0/993: chown d3/d1f/d2e/d4e/db2/d116/l139 232 1 2024-09-18T12:49:39.380 INFO:tasks.workunit.client.0.smithi078.stdout:2/872: mkdir d4/d8/d23/d52/d11d 0 2024-09-18T12:49:39.381 INFO:tasks.workunit.client.0.smithi078.stdout:2/873: chown d4/db/d45/dbc/dee/f115 1 1 2024-09-18T12:49:39.383 INFO:tasks.workunit.client.0.smithi078.stdout:1/915: creat d0/d8/daa/d121/f133 x:0 0 0 2024-09-18T12:49:39.384 INFO:tasks.workunit.client.0.smithi078.stdout:0/994: symlink d3/d1f/d2e/d4e/db2/d116/d138/l151 0 2024-09-18T12:49:39.385 INFO:tasks.workunit.client.0.smithi078.stdout:0/995: chown d3/d1f/d2e/d68/dc9 69049718 1 2024-09-18T12:49:39.386 INFO:tasks.workunit.client.0.smithi078.stdout:2/874: mkdir d4/d8/d23/d52/d5f/d81/dae/d11e 0 2024-09-18T12:49:39.387 INFO:tasks.workunit.client.0.smithi078.stdout:2/875: rename d4/db/dc/dc0/df2 to d4/db/dc/dc0/df2/d11f 22 2024-09-18T12:49:39.390 INFO:tasks.workunit.client.0.smithi078.stdout:0/996: dwrite d3/fd2 [0,4194304] 0 2024-09-18T12:49:39.396 INFO:tasks.workunit.client.0.smithi078.stdout:8/915: truncate d0/d7/dc/f64 4324607 0 2024-09-18T12:49:39.398 INFO:tasks.workunit.client.0.smithi078.stdout:0/997: rename d3/d1f/d2e/d4e/d37/d72/ddd/d124 to d3/d82/d10d/d7c/da3/de2/d12f/d152 0 2024-09-18T12:49:39.403 INFO:tasks.workunit.client.0.smithi078.stdout:0/998: dread d3/d1f/d2e/d4e/d37/d72/fae [0,4194304] 0 2024-09-18T12:49:39.404 INFO:tasks.workunit.client.0.smithi078.stdout:8/916: dwrite d0/d39/d4c/d77/d7d/d3e/ddf/f12a [0,4194304] 0 2024-09-18T12:49:39.405 INFO:tasks.workunit.client.0.smithi078.stdout:8/917: chown d0/d39/dc5 18958 1 2024-09-18T12:49:39.407 INFO:tasks.workunit.client.0.smithi078.stdout:0/999: getdents d3/d1f/d2e/d68/dc9/d144 0 2024-09-18T12:49:39.409 INFO:tasks.workunit.client.0.smithi078.stdout:2/876: write d4/dd/f5c [1176326,14169] 0 2024-09-18T12:49:39.412 INFO:tasks.workunit.client.0.smithi078.stdout:1/916: dwrite d0/d8/f38 [4194304,4194304] 0 2024-09-18T12:49:39.414 INFO:tasks.workunit.client.0.smithi078.stdout:1/917: stat d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d9d/db8/cdc 0 2024-09-18T12:49:39.415 INFO:tasks.workunit.client.0.smithi078.stdout:2/877: creat d4/dd/f120 x:0 0 0 2024-09-18T12:49:39.416 INFO:tasks.workunit.client.0.smithi078.stdout:2/878: chown d4/d1a/lf6 2 1 2024-09-18T12:49:39.420 INFO:tasks.workunit.client.0.smithi078.stdout:1/918: creat d0/d8/daa/db5/d114/d3e/d58/d6e/f134 x:0 0 0 2024-09-18T12:49:39.422 INFO:tasks.workunit.client.0.smithi078.stdout:2/879: symlink d4/db/d45/l121 0 2024-09-18T12:49:39.422 INFO:tasks.workunit.client.0.smithi078.stdout:1/919: chown d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/l100 1 1 2024-09-18T12:49:39.425 INFO:tasks.workunit.client.0.smithi078.stdout:1/920: mknod d0/c135 0 2024-09-18T12:49:39.428 INFO:tasks.workunit.client.0.smithi078.stdout:2/880: rename d4/db/dc/f62 to d4/db/d45/f122 0 2024-09-18T12:49:39.432 INFO:tasks.workunit.client.0.smithi078.stdout:1/921: dwrite d0/d5b/d6d/dc2/fcd [0,4194304] 0 2024-09-18T12:49:39.434 INFO:tasks.workunit.client.0.smithi078.stdout:2/881: creat d4/d8/d23/d52/d5f/d81/dae/d114/dea/f123 x:0 0 0 2024-09-18T12:49:39.438 INFO:tasks.workunit.client.0.smithi078.stdout:8/918: dread d0/db7/f95 [0,4194304] 0 2024-09-18T12:49:39.438 INFO:tasks.workunit.client.0.smithi078.stdout:2/882: mkdir d4/db/dd8/d124 0 2024-09-18T12:49:39.439 INFO:tasks.workunit.client.0.smithi078.stdout:8/919: fsync d0/db7/d62/df2/f127 0 2024-09-18T12:49:39.449 INFO:tasks.workunit.client.0.smithi078.stdout:2/883: fdatasync d4/d8/d23/d52/d7c/f113 0 2024-09-18T12:49:39.449 INFO:tasks.workunit.client.0.smithi078.stdout:8/920: dwrite d0/d7/d53/d57/d5c/fce [0,4194304] 0 2024-09-18T12:49:39.452 INFO:tasks.workunit.client.0.smithi078.stdout:8/921: write d0/d7/d1e/da9/dd4/ff6 [5407597,10375] 0 2024-09-18T12:49:39.454 INFO:tasks.workunit.client.0.smithi078.stdout:1/922: dwrite d0/d8/daa/db5/d114/d3e/d58/d6e/fab [0,4194304] 0 2024-09-18T12:49:39.459 INFO:tasks.workunit.client.0.smithi078.stdout:2/884: dwrite d4/d8/d23/d52/f118 [0,4194304] 0 2024-09-18T12:49:39.460 INFO:tasks.workunit.client.0.smithi078.stdout:2/885: dread - d4/d1a/f112 zero size 2024-09-18T12:49:39.460 INFO:tasks.workunit.client.0.smithi078.stdout:1/923: unlink d0/d5b/d6d/dc2/c11e 0 2024-09-18T12:49:39.465 INFO:tasks.workunit.client.0.smithi078.stdout:8/922: fsync d0/d7/dc/d1f/d23/d40/ff3 0 2024-09-18T12:49:39.465 INFO:tasks.workunit.client.0.smithi078.stdout:8/923: read d0/db7/f95 [4141563,45033] 0 2024-09-18T12:49:39.467 INFO:tasks.workunit.client.0.smithi078.stdout:1/924: getdents d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f/d11c 0 2024-09-18T12:49:39.470 INFO:tasks.workunit.client.0.smithi078.stdout:8/924: truncate d0/d7/d53/f5e 3867199 0 2024-09-18T12:49:39.473 INFO:tasks.workunit.client.0.smithi078.stdout:8/925: getdents d0/d7/dc/d5d/dea 0 2024-09-18T12:49:39.474 INFO:tasks.workunit.client.0.smithi078.stdout:8/926: dread - d0/d7/d1e/d4b/f11f zero size 2024-09-18T12:49:39.477 INFO:tasks.workunit.client.0.smithi078.stdout:1/925: link d0/d8/daa/db5/d114/d3e/d50/d60/f6b d0/d8/daa/db5/d114/d3e/d50/f136 0 2024-09-18T12:49:39.479 INFO:tasks.workunit.client.0.smithi078.stdout:1/926: dread - d0/d8/daa/db5/d114/d3e/d58/ff7 zero size 2024-09-18T12:49:39.481 INFO:tasks.workunit.client.0.smithi078.stdout:1/927: truncate d0/d8/daa/ffc 556023 0 2024-09-18T12:49:39.482 INFO:tasks.workunit.client.0.smithi078.stdout:1/928: write d0/d5b/d6d/dc2/fd5 [4054702,4098] 0 2024-09-18T12:49:39.485 INFO:tasks.workunit.client.0.smithi078.stdout:1/929: dread - d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/dd3/feb zero size 2024-09-18T12:49:39.487 INFO:tasks.workunit.client.0.smithi078.stdout:1/930: chown d0/d8/daa/db5/d114/d3e/d50/fa0 1 1 2024-09-18T12:49:39.489 INFO:tasks.workunit.client.0.smithi078.stdout:8/927: write d0/d39/d4c/d77/d7d/f76 [856701,130665] 0 2024-09-18T12:49:39.495 INFO:tasks.workunit.client.0.smithi078.stdout:8/928: truncate d0/d39/d4c/d77/dd7/d10b/f75 2170292 0 2024-09-18T12:49:39.500 INFO:tasks.workunit.client.0.smithi078.stdout:8/929: dwrite d0/db7/d62/df2/f102 [0,4194304] 0 2024-09-18T12:49:39.502 INFO:tasks.workunit.client.0.smithi078.stdout:1/931: write d0/d8/daa/db5/d114/fbf [1361117,48167] 0 2024-09-18T12:49:39.503 INFO:tasks.workunit.client.0.smithi078.stdout:1/932: stat d0/d8/daa/db5/d114/d3e/d58/d6e/d52/f36 0 2024-09-18T12:49:39.522 INFO:tasks.workunit.client.0.smithi078.stdout:1/933: dwrite d0/d8/daa/db5/d114/d3e/d58/d6e/fa2 [0,4194304] 0 2024-09-18T12:49:39.524 INFO:tasks.workunit.client.0.smithi078.stdout:1/934: truncate d0/d8/daa/db5/d114/d3e/d50/dba/fb3 4267352 0 2024-09-18T12:49:39.528 INFO:tasks.workunit.client.0.smithi078.stdout:8/930: dread d0/d7/f22 [0,4194304] 0 2024-09-18T12:49:39.529 INFO:tasks.workunit.client.0.smithi078.stdout:1/935: dread d0/d8/f38 [4194304,4194304] 0 2024-09-18T12:49:39.531 INFO:tasks.workunit.client.0.smithi078.stdout:8/931: unlink d0/d7/d53/d57/d67/d87/cf7 0 2024-09-18T12:49:39.531 INFO:tasks.workunit.client.0.smithi078.stdout:1/936: read d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f/fff [3026596,15340] 0 2024-09-18T12:49:39.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/932: rmdir d0/d7/d1e/da9/dd4 39 2024-09-18T12:49:39.540 INFO:tasks.workunit.client.0.smithi078.stdout:8/933: dwrite d0/d7/dc/d5d/f111 [0,4194304] 0 2024-09-18T12:49:39.543 INFO:tasks.workunit.client.0.smithi078.stdout:8/934: mknod d0/d39/dbc/c133 0 2024-09-18T12:49:39.549 INFO:tasks.workunit.client.0.smithi078.stdout:8/935: truncate d0/db7/d62/f100 2578919 0 2024-09-18T12:49:39.552 INFO:tasks.workunit.client.0.smithi078.stdout:1/937: dwrite d0/d8/daa/db5/d114/d3e/d58/d6e/d52/f30 [0,4194304] 0 2024-09-18T12:49:39.555 INFO:tasks.workunit.client.0.smithi078.stdout:8/936: rename d0/d7/d53/d57/fb2 to d0/d7/dc/d1f/f134 0 2024-09-18T12:49:39.556 INFO:tasks.workunit.client.0.smithi078.stdout:8/937: write d0/db7/d62/f81 [489573,117997] 0 2024-09-18T12:49:39.557 INFO:tasks.workunit.client.0.smithi078.stdout:1/938: mkdir d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/dd3/d137 0 2024-09-18T12:49:39.561 INFO:tasks.workunit.client.0.smithi078.stdout:1/939: readlink d0/d8/daa/db5/d114/l1e 0 2024-09-18T12:49:39.564 INFO:tasks.workunit.client.0.smithi078.stdout:1/940: rmdir d0/d8/daa/db5/d114/d3e/d58/d6e/d8c 39 2024-09-18T12:49:39.566 INFO:tasks.workunit.client.0.smithi078.stdout:1/941: readlink d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/lf1 0 2024-09-18T12:49:39.574 INFO:tasks.workunit.client.0.smithi078.stdout:1/942: dwrite d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d127/f12f [0,4194304] 0 2024-09-18T12:49:39.576 INFO:tasks.workunit.client.0.smithi078.stdout:1/943: chown d0/d8/ff 91109 1 2024-09-18T12:49:39.576 INFO:tasks.workunit.client.0.smithi078.stdout:8/938: dread d0/d39/d4c/d77/d7d/d3e/f112 [0,4194304] 0 2024-09-18T12:49:39.577 INFO:tasks.workunit.client.0.smithi078.stdout:8/939: stat d0/d7/dc/d71 0 2024-09-18T12:49:39.581 INFO:tasks.workunit.client.0.smithi078.stdout:8/940: mkdir d0/d39/d4c/d77/dd7/d135 0 2024-09-18T12:49:39.584 INFO:tasks.workunit.client.0.smithi078.stdout:8/941: chown d0/d7/f132 14660 1 2024-09-18T12:49:39.585 INFO:tasks.workunit.client.0.smithi078.stdout:1/944: dwrite d0/d8/daa/db5/d114/d3e/d50/d74/f125 [0,4194304] 0 2024-09-18T12:49:39.586 INFO:tasks.workunit.client.0.smithi078.stdout:8/942: fsync d0/d7/d1e/d50/fe6 0 2024-09-18T12:49:39.586 INFO:tasks.workunit.client.0.smithi078.stdout:1/945: write d0/d8/daa/db5/d114/fbf [1707681,52271] 0 2024-09-18T12:49:39.589 INFO:tasks.workunit.client.0.smithi078.stdout:1/946: stat d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d127/f12f 0 2024-09-18T12:49:39.590 INFO:tasks.workunit.client.0.smithi078.stdout:1/947: readlink d0/d8/daa/db5/d114/d3e/d50/d60/la1 0 2024-09-18T12:49:39.593 INFO:tasks.workunit.client.0.smithi078.stdout:1/948: mkdir d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f/d138 0 2024-09-18T12:49:39.596 INFO:tasks.workunit.client.0.smithi078.stdout:1/949: creat d0/d8/daa/db5/dc0/dcf/f139 x:0 0 0 2024-09-18T12:49:39.600 INFO:tasks.workunit.client.0.smithi078.stdout:1/950: mknod d0/d8/daa/db5/d114/d3e/c13a 0 2024-09-18T12:49:39.602 INFO:tasks.workunit.client.0.smithi078.stdout:8/943: write d0/db7/d62/fd2 [162055,71978] 0 2024-09-18T12:49:39.604 INFO:tasks.workunit.client.0.smithi078.stdout:8/944: mknod d0/d7/dc/d1f/d6f/c136 0 2024-09-18T12:49:39.607 INFO:tasks.workunit.client.0.smithi078.stdout:1/951: write d0/d8/daa/db5/d114/d3e/d50/f7c [5138196,77425] 0 2024-09-18T12:49:39.608 INFO:tasks.workunit.client.0.smithi078.stdout:1/952: dread - d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d9d/dc3/f104 zero size 2024-09-18T12:49:39.611 INFO:tasks.workunit.client.0.smithi078.stdout:1/953: mkdir d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d127/d13b 0 2024-09-18T12:49:39.618 INFO:tasks.workunit.client.0.smithi078.stdout:1/954: write d0/d8/daa/db5/d114/d3e/d58/d6e/f5a [898160,91037] 0 2024-09-18T12:49:39.620 INFO:tasks.workunit.client.0.smithi078.stdout:1/955: read - d0/d8/daa/db5/d114/d3e/d50/d74/f109 zero size 2024-09-18T12:49:39.629 INFO:tasks.workunit.client.0.smithi078.stdout:1/956: truncate d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/f8f 60555 0 2024-09-18T12:49:39.630 INFO:tasks.workunit.client.0.smithi078.stdout:1/957: fsync d0/d8/daa/db5/d114/d3e/d58/d6e/d52/f78 0 2024-09-18T12:49:39.632 INFO:tasks.workunit.client.0.smithi078.stdout:1/958: chown d0/d8/daa/db5/d114/c28 92117 1 2024-09-18T12:49:39.633 INFO:tasks.workunit.client.0.smithi078.stdout:1/959: unlink d0/c20 0 2024-09-18T12:49:39.636 INFO:tasks.workunit.client.0.smithi078.stdout:1/960: mknod d0/d8/daa/db5/d114/c13c 0 2024-09-18T12:49:39.652 INFO:tasks.workunit.client.0.smithi078.stdout:1/961: dread d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d9d/dc3/f12b [0,4194304] 0 2024-09-18T12:49:39.658 INFO:tasks.workunit.client.0.smithi078.stdout:1/962: write d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/f8a [978468,110851] 0 2024-09-18T12:49:39.661 INFO:tasks.workunit.client.0.smithi078.stdout:1/963: write d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/dee/ff6 [708340,8869] 0 2024-09-18T12:49:39.664 INFO:tasks.workunit.client.0.smithi078.stdout:1/964: read d0/d8/daa/db5/d114/d45/f8e [1197434,6797] 0 2024-09-18T12:49:39.665 INFO:tasks.workunit.client.0.smithi078.stdout:1/965: chown d0/d8/ce 27296 1 2024-09-18T12:49:39.667 INFO:tasks.workunit.client.0.smithi078.stdout:1/966: creat d0/d8/daa/db5/d114/d3e/dd8/f13d x:0 0 0 2024-09-18T12:49:39.669 INFO:tasks.workunit.client.0.smithi078.stdout:1/967: creat d0/d8/daa/db5/d114/d3e/dd8/f13e x:0 0 0 2024-09-18T12:49:39.671 INFO:tasks.workunit.client.0.smithi078.stdout:1/968: unlink d0/d8/daa/db5/d114/d3e/laf 0 2024-09-18T12:49:39.674 INFO:tasks.workunit.client.0.smithi078.stdout:1/969: truncate d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/d7f/ffa 1655667 0 2024-09-18T12:49:39.677 INFO:tasks.workunit.client.0.smithi078.stdout:1/970: fdatasync d0/d8/daa/db5/dc0/fdb 0 2024-09-18T12:49:39.678 INFO:tasks.workunit.client.0.smithi078.stdout:1/971: chown d0/d5b/d6d/cd0 25182 1 2024-09-18T12:49:39.681 INFO:tasks.workunit.client.0.smithi078.stdout:1/972: unlink d0/d8/daa/db5/d114/d3e/d58/d6e/d52/c11b 0 2024-09-18T12:49:39.682 INFO:tasks.workunit.client.0.smithi078.stdout:1/973: write d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d9d/dc3/dea/f128 [799163,115193] 0 2024-09-18T12:49:39.683 INFO:tasks.workunit.client.0.smithi078.stdout:1/974: chown d0/d8/daa/db5/d114/d3e/d50/f112 2 1 2024-09-18T12:49:39.688 INFO:tasks.workunit.client.0.smithi078.stdout:1/975: dread d0/d8/daa/db5/d114/d3e/d50/fa0 [0,4194304] 0 2024-09-18T12:49:39.695 INFO:tasks.workunit.client.0.smithi078.stdout:1/976: dwrite d0/d8/daa/db5/d114/d3e/d58/d6e/f107 [0,4194304] 0 2024-09-18T12:49:39.701 INFO:tasks.workunit.client.0.smithi078.stdout:1/977: truncate d0/d8/daa/db5/d114/d3e/d50/f136 167584 0 2024-09-18T12:49:39.705 INFO:tasks.workunit.client.0.smithi078.stdout:1/978: truncate d0/d8/f3a 2973404 0 2024-09-18T12:49:39.720 INFO:tasks.workunit.client.0.smithi078.stdout:1/979: write d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/f66 [179574,29508] 0 2024-09-18T12:49:39.732 INFO:tasks.workunit.client.0.smithi078.stdout:1/980: write d0/d8/daa/db5/d114/d3e/d50/d74/fec [389882,51013] 0 2024-09-18T12:49:39.734 INFO:tasks.workunit.client.0.smithi078.stdout:1/981: chown d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d9d/dc3 104 1 2024-09-18T12:49:39.738 INFO:tasks.workunit.client.0.smithi078.stdout:1/982: link d0/d8/daa/db5/d114/d3e/d58/d6e/f5a d0/d8/daa/f13f 0 2024-09-18T12:49:39.740 INFO:tasks.workunit.client.0.smithi078.stdout:1/983: symlink d0/d5b/l140 0 2024-09-18T12:49:39.745 INFO:tasks.workunit.client.0.smithi078.stdout:1/984: link d0/d8/daa/db5/d114/d3e/d50/dba/c106 d0/d8/daa/d121/c141 0 2024-09-18T12:49:39.750 INFO:tasks.workunit.client.0.smithi078.stdout:1/985: dwrite d0/d8/daa/db5/d114/d3e/d58/d6e/d52/d47/de8/dee/ff6 [0,4194304] 0 2024-09-18T12:49:39.751 INFO:tasks.workunit.client.0.smithi078.stdout:1/986: dread - d0/d8/daa/d121/f133 zero size 2024-09-18T12:49:39.757 INFO:tasks.workunit.client.0.smithi078.stdout:1/987: mkdir d0/d8/daa/db5/d114/d3e/d58/d6e/d142 0 2024-09-18T12:49:39.761 INFO:tasks.workunit.client.0.smithi078.stdout:1/988: dread d0/d8/daa/db5/d114/d3e/d58/d6e/fab [0,4194304] 0 2024-09-18T12:49:39.764 INFO:tasks.workunit.client.0.smithi078.stdout:1/989: read - d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/dd3/fd9 zero size 2024-09-18T12:49:39.766 INFO:tasks.workunit.client.0.smithi078.stdout:1/990: truncate d0/d8/daa/db5/f132 907061 0 2024-09-18T12:49:39.767 INFO:tasks.workunit.client.0.smithi078.stdout:1/991: fdatasync d0/d8/daa/ffc 0 2024-09-18T12:49:39.785 INFO:tasks.workunit.client.0.smithi078.stdout:1/992: dread d0/d8/daa/db5/d114/d45/f8e [0,4194304] 0 2024-09-18T12:49:39.787 INFO:tasks.workunit.client.0.smithi078.stdout:1/993: creat d0/d8/daa/db5/d114/d45/f143 x:0 0 0 2024-09-18T12:49:39.789 INFO:tasks.workunit.client.0.smithi078.stdout:1/994: read d0/d8/daa/db5/d114/d3e/d58/d6e/f51 [376418,75963] 0 2024-09-18T12:49:39.795 INFO:tasks.workunit.client.0.smithi078.stdout:1/995: getdents d0/d8/daa/db5/d114/d45 0 2024-09-18T12:49:39.797 INFO:tasks.workunit.client.0.smithi078.stdout:1/996: creat d0/d8/de2/f144 x:0 0 0 2024-09-18T12:49:39.799 INFO:tasks.workunit.client.0.smithi078.stdout:1/997: creat d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d9d/d10e/f145 x:0 0 0 2024-09-18T12:49:39.807 INFO:tasks.workunit.client.0.smithi078.stdout:1/998: link d0/d8/daa/db5/d114/d3e/d58/c5d d0/d8/daa/db5/d114/d3e/d50/d60/c146 0 2024-09-18T12:49:39.809 INFO:tasks.workunit.client.0.smithi078.stdout:1/999: fsync d0/d8/daa/db5/d114/d3e/d58/d6e/d8c/d9d/fae 0 2024-09-18T12:49:39.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:39 smithi148 ceph-mon[35352]: pgmap v27: 65 pgs: 65 active+clean; 3.5 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 61 MiB/s rd, 140 MiB/s wr, 416 op/s 2024-09-18T12:49:39.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:39 smithi078 ceph-mon[28091]: pgmap v27: 65 pgs: 65 active+clean; 3.5 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 61 MiB/s rd, 140 MiB/s wr, 416 op/s 2024-09-18T12:49:40.218 INFO:tasks.workunit.client.0.smithi078.stdout:9/971: sync 2024-09-18T12:49:40.218 INFO:tasks.workunit.client.0.smithi078.stdout:7/952: sync 2024-09-18T12:49:40.219 INFO:tasks.workunit.client.0.smithi078.stdout:3/907: sync 2024-09-18T12:49:40.219 INFO:tasks.workunit.client.0.smithi078.stdout:3/908: readlink d9/d54/d89/l8f 0 2024-09-18T12:49:40.219 INFO:tasks.workunit.client.0.smithi078.stdout:3/909: chown d9/d54/d6c/d9f 229 1 2024-09-18T12:49:40.220 INFO:tasks.workunit.client.0.smithi078.stdout:9/972: chown d5/d7/d32/d2a/d36/la1 25530688 1 2024-09-18T12:49:40.220 INFO:tasks.workunit.client.0.smithi078.stdout:9/973: readlink d5/d7/d11c/l3e 0 2024-09-18T12:49:40.220 INFO:tasks.workunit.client.0.smithi078.stdout:3/910: chown d9/d13/d33/d34/d9e/df1 41489921 1 2024-09-18T12:49:40.221 INFO:tasks.workunit.client.0.smithi078.stdout:7/953: creat d7/d9/d14/d22/d3e/d95/f140 x:0 0 0 2024-09-18T12:49:40.222 INFO:tasks.workunit.client.0.smithi078.stdout:7/954: chown d7/d9/d14/d22/d35/f120 0 1 2024-09-18T12:49:40.223 INFO:tasks.workunit.client.0.smithi078.stdout:9/974: mkdir d5/d7/d32/d91/d136 0 2024-09-18T12:49:40.225 INFO:tasks.workunit.client.0.smithi078.stdout:9/975: rmdir d5/d7/db3/de5/d110 39 2024-09-18T12:49:40.234 INFO:tasks.workunit.client.0.smithi078.stdout:2/886: sync 2024-09-18T12:49:40.235 INFO:tasks.workunit.client.0.smithi078.stdout:8/945: sync 2024-09-18T12:49:40.236 INFO:tasks.workunit.client.0.smithi078.stdout:9/976: write d5/d7/d32/d2a/d36/f55 [1311677,7947] 0 2024-09-18T12:49:40.237 INFO:tasks.workunit.client.0.smithi078.stdout:8/946: symlink d0/d7/d1e/da9/l137 0 2024-09-18T12:49:40.238 INFO:tasks.workunit.client.0.smithi078.stdout:7/955: dread d7/f28 [0,4194304] 0 2024-09-18T12:49:40.240 INFO:tasks.workunit.client.0.smithi078.stdout:7/956: chown d7/d9/d4d/l11c 71170 1 2024-09-18T12:49:40.240 INFO:tasks.workunit.client.0.smithi078.stdout:9/977: mknod d5/d7/d32/d2a/d68/db0/c137 0 2024-09-18T12:49:40.241 INFO:tasks.workunit.client.0.smithi078.stdout:3/911: dwrite d9/d54/d6c/d9f/fb7 [0,4194304] 0 2024-09-18T12:49:40.241 INFO:tasks.workunit.client.0.smithi078.stdout:7/957: read - d7/d9/d14/f137 zero size 2024-09-18T12:49:40.249 INFO:tasks.workunit.client.0.smithi078.stdout:8/947: write d0/d39/d4c/d77/d7d/d3e/f112 [3402805,61093] 0 2024-09-18T12:49:40.250 INFO:tasks.workunit.client.0.smithi078.stdout:3/912: creat d9/d54/d6c/d9f/db2/d10a/f11d x:0 0 0 2024-09-18T12:49:40.251 INFO:tasks.workunit.client.0.smithi078.stdout:9/978: stat d5/d7/dbe/de8/l9e 0 2024-09-18T12:49:40.253 INFO:tasks.workunit.client.0.smithi078.stdout:8/948: dread - d0/d7/dc/d1f/f134 zero size 2024-09-18T12:49:40.257 INFO:tasks.workunit.client.0.smithi078.stdout:9/979: rename d5/d7/db3/de5/d116/f125 to d5/d7/d32/d91/f138 0 2024-09-18T12:49:40.258 INFO:tasks.workunit.client.0.smithi078.stdout:3/913: getdents d9/d54/d6c/d9f/db2/d10a/d114 0 2024-09-18T12:49:40.260 INFO:tasks.workunit.client.0.smithi078.stdout:8/949: mkdir d0/d7/dc/d71/d9b/d138 0 2024-09-18T12:49:40.260 INFO:tasks.workunit.client.0.smithi078.stdout:8/950: chown d0/d7/d1e/c106 10588 1 2024-09-18T12:49:40.261 INFO:tasks.workunit.client.0.smithi078.stdout:8/951: truncate d0/db7/f117 792520 0 2024-09-18T12:49:40.262 INFO:tasks.workunit.client.0.smithi078.stdout:8/952: chown d0/d7/dc/d114 11 1 2024-09-18T12:49:40.262 INFO:tasks.workunit.client.0.smithi078.stdout:7/958: link d7/d9/dd7/d3b/dc0/le6 d7/d9/d4d/dff/l141 0 2024-09-18T12:49:40.265 INFO:tasks.workunit.client.0.smithi078.stdout:8/953: mkdir d0/d7/dc/d71/d9b/db6/d139 0 2024-09-18T12:49:40.266 INFO:tasks.workunit.client.0.smithi078.stdout:8/954: write d0/d39/d4c/d77/dd7/fde [3583,85674] 0 2024-09-18T12:49:40.267 INFO:tasks.workunit.client.0.smithi078.stdout:9/980: rename d5/d7/dbe/de8/df1/d103 to d5/d7/d11c/d4f/d139 0 2024-09-18T12:49:40.269 INFO:tasks.workunit.client.0.smithi078.stdout:7/959: mkdir d7/d9/d4d/d124/d142 0 2024-09-18T12:49:40.273 INFO:tasks.workunit.client.0.smithi078.stdout:7/960: truncate d7/d5d/f74 2718712 0 2024-09-18T12:49:40.275 INFO:tasks.workunit.client.0.smithi078.stdout:8/955: fsync d0/d7/f2c 0 2024-09-18T12:49:40.278 INFO:tasks.workunit.client.0.smithi078.stdout:3/914: getdents d9/d13/d33/d34/d97 0 2024-09-18T12:49:40.279 INFO:tasks.workunit.client.0.smithi078.stdout:7/961: fsync d7/d9/d14/f137 0 2024-09-18T12:49:40.283 INFO:tasks.workunit.client.0.smithi078.stdout:9/981: creat d5/d7/f13a x:0 0 0 2024-09-18T12:49:40.284 INFO:tasks.workunit.client.0.smithi078.stdout:7/962: creat d7/d9/d14/d22/d35/f143 x:0 0 0 2024-09-18T12:49:40.286 INFO:tasks.workunit.client.0.smithi078.stdout:9/982: mknod d5/d7/d32/d91/c13b 0 2024-09-18T12:49:40.288 INFO:tasks.workunit.client.0.smithi078.stdout:8/956: rename d0/d7/dc/d71/d9b/ff0 to d0/d7/f13a 0 2024-09-18T12:49:40.292 INFO:tasks.workunit.client.0.smithi078.stdout:7/963: dwrite d7/d9/dd7/d3b/f116 [0,4194304] 0 2024-09-18T12:49:40.293 INFO:tasks.workunit.client.0.smithi078.stdout:3/915: dread d9/d13/d33/d3c/f66 [0,4194304] 0 2024-09-18T12:49:40.297 INFO:tasks.workunit.client.0.smithi078.stdout:7/964: fdatasync d7/d9/dd7/d3b/fef 0 2024-09-18T12:49:40.298 INFO:tasks.workunit.client.0.smithi078.stdout:3/916: chown d9/d54/d6c/d9f/cac 336 1 2024-09-18T12:49:40.304 INFO:tasks.workunit.client.0.smithi078.stdout:3/917: mknod d9/d54/d7f/dae/c11e 0 2024-09-18T12:49:40.309 INFO:tasks.workunit.client.0.smithi078.stdout:9/983: dwrite d5/fce [0,4194304] 0 2024-09-18T12:49:40.311 INFO:tasks.workunit.client.0.smithi078.stdout:3/918: dread d9/d13/d33/d3c/f66 [0,4194304] 0 2024-09-18T12:49:40.312 INFO:tasks.workunit.client.0.smithi078.stdout:7/965: truncate f5 308298 0 2024-09-18T12:49:40.314 INFO:tasks.workunit.client.0.smithi078.stdout:7/966: write d7/d5d/d7a/d62/f136 [306979,120717] 0 2024-09-18T12:49:40.315 INFO:tasks.workunit.client.0.smithi078.stdout:9/984: unlink d5/d7/d11c/d4f/l93 0 2024-09-18T12:49:40.317 INFO:tasks.workunit.client.0.smithi078.stdout:8/957: dread d0/d7/d53/db0/fb1 [0,4194304] 0 2024-09-18T12:49:40.318 INFO:tasks.workunit.client.0.smithi078.stdout:3/919: fsync d9/d2f/f8c 0 2024-09-18T12:49:40.319 INFO:tasks.workunit.client.0.smithi078.stdout:7/967: creat d7/d26/f144 x:0 0 0 2024-09-18T12:49:40.320 INFO:tasks.workunit.client.0.smithi078.stdout:9/985: symlink d5/d7/d11c/d4f/d139/l13c 0 2024-09-18T12:49:40.328 INFO:tasks.workunit.client.0.smithi078.stdout:8/958: creat d0/d39/d4c/d77/dd7/f13b x:0 0 0 2024-09-18T12:49:40.329 INFO:tasks.workunit.client.0.smithi078.stdout:7/968: unlink d7/d9/d14/d22/d3e/d95/d97/f71 0 2024-09-18T12:49:40.330 INFO:tasks.workunit.client.0.smithi078.stdout:7/969: stat d7/d9/d14/d22 0 2024-09-18T12:49:40.331 INFO:tasks.workunit.client.0.smithi078.stdout:7/970: write d7/d9/d14/d22/d35/d49/d56/f78 [617130,85148] 0 2024-09-18T12:49:40.332 INFO:tasks.workunit.client.0.smithi078.stdout:7/971: stat d7/d9/d4d/d9a/fba 0 2024-09-18T12:49:40.333 INFO:tasks.workunit.client.0.smithi078.stdout:3/920: mkdir d9/d11f 0 2024-09-18T12:49:40.336 INFO:tasks.workunit.client.0.smithi078.stdout:8/959: mknod d0/d39/dbc/d116/c13c 0 2024-09-18T12:49:40.338 INFO:tasks.workunit.client.0.smithi078.stdout:8/960: write d0/d39/d4c/d77/dd7/f13b [822435,95321] 0 2024-09-18T12:49:40.338 INFO:tasks.workunit.client.0.smithi078.stdout:9/986: creat d5/d7/d32/d2a/d68/f13d x:0 0 0 2024-09-18T12:49:40.339 INFO:tasks.workunit.client.0.smithi078.stdout:9/987: stat d5/d7/dbe/de8/l9e 0 2024-09-18T12:49:40.343 INFO:tasks.workunit.client.0.smithi078.stdout:8/961: getdents d0/d7/dc/d71/d9b/db6 0 2024-09-18T12:49:40.344 INFO:tasks.workunit.client.0.smithi078.stdout:8/962: write d0/db7/d62/f91 [2461055,110962] 0 2024-09-18T12:49:40.345 INFO:tasks.workunit.client.0.smithi078.stdout:8/963: dread - d0/d7/d1e/f124 zero size 2024-09-18T12:49:40.348 INFO:tasks.workunit.client.0.smithi078.stdout:8/964: truncate d0/d7/fb 1785803 0 2024-09-18T12:49:40.351 INFO:tasks.workunit.client.0.smithi078.stdout:3/921: dread d9/d29/d4b/d4c/f91 [0,4194304] 0 2024-09-18T12:49:40.351 INFO:tasks.workunit.client.0.smithi078.stdout:3/922: stat d9/d54/d89/d92/cab 0 2024-09-18T12:49:40.352 INFO:tasks.workunit.client.0.smithi078.stdout:8/965: symlink d0/d7/dc/d71/d9b/db6/d139/l13d 0 2024-09-18T12:49:40.356 INFO:tasks.workunit.client.0.smithi078.stdout:8/966: rename d0/d7/dc/led to d0/d7/d1e/d4b/dc6/l13e 0 2024-09-18T12:49:40.357 INFO:tasks.workunit.client.0.smithi078.stdout:3/923: creat d9/d29/f120 x:0 0 0 2024-09-18T12:49:40.359 INFO:tasks.workunit.client.0.smithi078.stdout:3/924: mknod d9/d54/d6c/c121 0 2024-09-18T12:49:40.361 INFO:tasks.workunit.client.0.smithi078.stdout:9/988: dread d5/d7/d32/d2a/d36/f43 [0,4194304] 0 2024-09-18T12:49:40.368 INFO:tasks.workunit.client.0.smithi078.stdout:9/989: write d5/d7/d32/d2a/d68/fdf [1150921,68152] 0 2024-09-18T12:49:40.370 INFO:tasks.workunit.client.0.smithi078.stdout:3/925: getdents d9/df 0 2024-09-18T12:49:40.371 INFO:tasks.workunit.client.0.smithi078.stdout:8/967: dwrite d0/d7/f24 [0,4194304] 0 2024-09-18T12:49:40.373 INFO:tasks.workunit.client.0.smithi078.stdout:9/990: creat d5/f13e x:0 0 0 2024-09-18T12:49:40.374 INFO:tasks.workunit.client.0.smithi078.stdout:3/926: mkdir d9/d54/d6c/d9f/db2/d10a/d122 0 2024-09-18T12:49:40.375 INFO:tasks.workunit.client.0.smithi078.stdout:8/968: symlink d0/d7/dc/d71/d9b/db6/l13f 0 2024-09-18T12:49:40.375 INFO:tasks.workunit.client.0.smithi078.stdout:9/991: creat d5/d7/d32/d91/f13f x:0 0 0 2024-09-18T12:49:40.379 INFO:tasks.workunit.client.0.smithi078.stdout:3/927: symlink d9/d13/d37/l123 0 2024-09-18T12:49:40.379 INFO:tasks.workunit.client.0.smithi078.stdout:3/928: chown d9/d54/d6c/d9f/db2/db8 9 1 2024-09-18T12:49:40.382 INFO:tasks.workunit.client.0.smithi078.stdout:8/969: creat d0/d7/d1e/f140 x:0 0 0 2024-09-18T12:49:40.383 INFO:tasks.workunit.client.0.smithi078.stdout:3/929: creat d9/d54/d6c/d9f/db2/db8/f124 x:0 0 0 2024-09-18T12:49:40.384 INFO:tasks.workunit.client.0.smithi078.stdout:3/930: chown d9/d54/d6c/d9f/leb 233540697 1 2024-09-18T12:49:40.387 INFO:tasks.workunit.client.0.smithi078.stdout:8/970: symlink d0/d7/d53/d57/d5c/d88/l141 0 2024-09-18T12:49:40.388 INFO:tasks.workunit.client.0.smithi078.stdout:9/992: write d5/d40/f108 [879279,50160] 0 2024-09-18T12:49:40.389 INFO:tasks.workunit.client.0.smithi078.stdout:9/993: stat d5/d7/db1 0 2024-09-18T12:49:40.391 INFO:tasks.workunit.client.0.smithi078.stdout:8/971: unlink d0/d39/d4c/d77/d7d/f76 0 2024-09-18T12:49:40.391 INFO:tasks.workunit.client.0.smithi078.stdout:8/972: dread - d0/db7/f10f zero size 2024-09-18T12:49:40.392 INFO:tasks.workunit.client.0.smithi078.stdout:8/973: readlink d0/d7/d53/ld8 0 2024-09-18T12:49:40.392 INFO:tasks.workunit.client.0.smithi078.stdout:8/974: chown d0/d7/dc/d71 2 1 2024-09-18T12:49:40.397 INFO:tasks.workunit.client.0.smithi078.stdout:3/931: write d9/d13/f1d [3211187,99650] 0 2024-09-18T12:49:40.398 INFO:tasks.workunit.client.0.smithi078.stdout:8/975: mkdir d0/d39/dbc/d142 0 2024-09-18T12:49:40.399 INFO:tasks.workunit.client.0.smithi078.stdout:9/994: creat d5/f140 x:0 0 0 2024-09-18T12:49:40.400 INFO:tasks.workunit.client.0.smithi078.stdout:9/995: chown d5/d7/d11c/d98/fc5 156 1 2024-09-18T12:49:40.400 INFO:tasks.workunit.client.0.smithi078.stdout:3/932: creat d9/d13/d33/d3c/d19/f125 x:0 0 0 2024-09-18T12:49:40.406 INFO:tasks.workunit.client.0.smithi078.stdout:3/933: dwrite d9/d13/d63/fc1 [0,4194304] 0 2024-09-18T12:49:40.408 INFO:tasks.workunit.client.0.smithi078.stdout:9/996: symlink d5/d7/dbe/de8/l141 0 2024-09-18T12:49:40.413 INFO:tasks.workunit.client.0.smithi078.stdout:3/934: dwrite d9/d54/d6c/d9f/fb7 [0,4194304] 0 2024-09-18T12:49:40.413 INFO:tasks.workunit.client.0.smithi078.stdout:9/997: symlink d5/d7/d32/d2a/d68/l142 0 2024-09-18T12:49:40.414 INFO:tasks.workunit.client.0.smithi078.stdout:9/998: chown d5/d7/db3 0 1 2024-09-18T12:49:40.418 INFO:tasks.workunit.client.0.smithi078.stdout:9/999: creat d5/d7/d32/d2a/d68/d97/de3/f143 x:0 0 0 2024-09-18T12:49:40.423 INFO:tasks.workunit.client.0.smithi078.stdout:3/935: getdents d9/d13/d37 0 2024-09-18T12:49:40.424 INFO:tasks.workunit.client.0.smithi078.stdout:3/936: rmdir d9/d54/d6c/d9f/dfd 39 2024-09-18T12:49:40.425 INFO:tasks.workunit.client.0.smithi078.stdout:3/937: write d9/d2f/f3d [3492739,113311] 0 2024-09-18T12:49:40.429 INFO:tasks.workunit.client.0.smithi078.stdout:3/938: mkdir d9/d54/d6c/d9f/db2/d10a/d126 0 2024-09-18T12:49:40.430 INFO:tasks.workunit.client.0.smithi078.stdout:8/976: dread d0/d7/f55 [0,4194304] 0 2024-09-18T12:49:40.430 INFO:tasks.workunit.client.0.smithi078.stdout:3/939: stat d9/d13/d63/d78/l80 0 2024-09-18T12:49:40.447 INFO:tasks.workunit.client.0.smithi078.stdout:8/977: dread d0/db7/d62/f81 [0,4194304] 0 2024-09-18T12:49:40.451 INFO:tasks.workunit.client.0.smithi078.stdout:8/978: getdents d0/d7/dc/d71 0 2024-09-18T12:49:40.467 INFO:tasks.workunit.client.0.smithi078.stdout:8/979: write d0/d7/dc/f3c [9375287,125807] 0 2024-09-18T12:49:40.469 INFO:tasks.workunit.client.0.smithi078.stdout:8/980: dread - d0/d7/dc/d71/d9b/db6/f121 zero size 2024-09-18T12:49:40.470 INFO:tasks.workunit.client.0.smithi078.stdout:8/981: write d0/d7/d1e/d50/fe6 [27769,54717] 0 2024-09-18T12:49:40.474 INFO:tasks.workunit.client.0.smithi078.stdout:8/982: getdents d0/d7/d1e/d4b/d11d 0 2024-09-18T12:49:40.475 INFO:tasks.workunit.client.0.smithi078.stdout:8/983: readlink d0/d7/d1e/d50/la7 0 2024-09-18T12:49:40.478 INFO:tasks.workunit.client.0.smithi078.stdout:8/984: mkdir d0/d7/d1e/da9/d6d/dfe/d143 0 2024-09-18T12:49:40.479 INFO:tasks.workunit.client.0.smithi078.stdout:8/985: write d0/d7/dc/d5d/f111 [3705417,11823] 0 2024-09-18T12:49:40.480 INFO:tasks.workunit.client.0.smithi078.stdout:8/986: readlink d0/d7/d1e/d4b/lda 0 2024-09-18T12:49:40.482 INFO:tasks.workunit.client.0.smithi078.stdout:8/987: write d0/d7/d1e/da9/dd4/ff6 [6065476,101586] 0 2024-09-18T12:49:40.499 INFO:tasks.workunit.client.0.smithi078.stdout:8/988: dread d0/d7/dc/d1f/d23/f8c [0,4194304] 0 2024-09-18T12:49:40.502 INFO:tasks.workunit.client.0.smithi078.stdout:8/989: link d0/d7/d53/d57/l4f d0/d7/dc/d71/d9b/d138/l144 0 2024-09-18T12:49:40.507 INFO:tasks.workunit.client.0.smithi078.stdout:8/990: getdents d0/d7/d1e/d50 0 2024-09-18T12:49:40.508 INFO:tasks.workunit.client.0.smithi078.stdout:8/991: dread - d0/d7/dc/d71/d9b/db6/f121 zero size 2024-09-18T12:49:40.510 INFO:tasks.workunit.client.0.smithi078.stdout:8/992: chown d0/d39/d4c/d77/dd7/d10b/f75 447 1 2024-09-18T12:49:40.513 INFO:tasks.workunit.client.0.smithi078.stdout:8/993: creat d0/d7/f145 x:0 0 0 2024-09-18T12:49:40.517 INFO:tasks.workunit.client.0.smithi078.stdout:8/994: dread d0/d7/d53/db0/fb1 [0,4194304] 0 2024-09-18T12:49:40.517 INFO:tasks.workunit.client.0.smithi078.stdout:8/995: fsync d0/d7/d1e/d50/fe6 0 2024-09-18T12:49:40.524 INFO:tasks.workunit.client.0.smithi078.stdout:8/996: rename d0/d7/f24 to d0/d7/d1e/f146 0 2024-09-18T12:49:40.530 INFO:tasks.workunit.client.0.smithi078.stdout:8/997: rename d0/d7/d1e/da9/d6d/f9f to d0/d7/dc/d5d/f147 0 2024-09-18T12:49:40.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/998: unlink d0/d7/d1e/da9/c49 0 2024-09-18T12:49:40.542 INFO:tasks.workunit.client.0.smithi078.stdout:8/999: write d0/d7/d1e/da9/f7a [3052456,21940] 0 2024-09-18T12:49:40.738 INFO:tasks.workunit.client.0.smithi078.stdout:2/887: sync 2024-09-18T12:49:40.739 INFO:tasks.workunit.client.0.smithi078.stdout:2/888: chown d4/d1a/cc9 6 1 2024-09-18T12:49:40.743 INFO:tasks.workunit.client.0.smithi078.stdout:2/889: getdents d4/d8/d23/d52/d5f/d86 0 2024-09-18T12:49:40.744 INFO:tasks.workunit.client.0.smithi078.stdout:2/890: mknod d4/db/c125 0 2024-09-18T12:49:40.745 INFO:tasks.workunit.client.0.smithi078.stdout:2/891: rmdir d4/d8/d23/d52/d5f/d86 39 2024-09-18T12:49:40.750 INFO:tasks.workunit.client.0.smithi078.stdout:2/892: link d4/d8/d23/d52/d5f/d81/dae/d114/c97 d4/d8/d23/d52/d5f/d81/dac/daf/c126 0 2024-09-18T12:49:40.751 INFO:tasks.workunit.client.0.smithi078.stdout:2/893: mkdir d4/d1a/d127 0 2024-09-18T12:49:40.754 INFO:tasks.workunit.client.0.smithi078.stdout:2/894: creat d4/db/dc/dc0/f128 x:0 0 0 2024-09-18T12:49:40.755 INFO:tasks.workunit.client.0.smithi078.stdout:2/895: readlink d4/db/dc/l1f 0 2024-09-18T12:49:40.757 INFO:tasks.workunit.client.0.smithi078.stdout:2/896: write d4/d8/d23/d52/d5f/d81/dac/daf/fcb [1121709,29815] 0 2024-09-18T12:49:40.760 INFO:tasks.workunit.client.0.smithi078.stdout:2/897: mkdir d4/d8/d23/d52/d5f/d81/dae/dbd/d129 0 2024-09-18T12:49:40.763 INFO:tasks.workunit.client.0.smithi078.stdout:2/898: rename d4/dd/f120 to d4/d8/d23/d52/d7c/f12a 0 2024-09-18T12:49:40.766 INFO:tasks.workunit.client.0.smithi078.stdout:2/899: link d4/db/c79 d4/db/dc/dc0/df2/c12b 0 2024-09-18T12:49:40.768 INFO:tasks.workunit.client.0.smithi078.stdout:2/900: unlink d4/db/dc/dc0/df2/c12b 0 2024-09-18T12:49:40.772 INFO:tasks.workunit.client.0.smithi078.stdout:2/901: getdents d4/d8/d23/d52/d5f/dab 0 2024-09-18T12:49:40.773 INFO:tasks.workunit.client.0.smithi078.stdout:2/902: chown d4/db/lf7 660386000 1 2024-09-18T12:49:40.777 INFO:tasks.workunit.client.0.smithi078.stdout:2/903: rmdir d4/d8/d23/d52/d5f/d81/dac/dfe 0 2024-09-18T12:49:40.779 INFO:tasks.workunit.client.0.smithi078.stdout:2/904: mkdir d4/db/d45/d12c 0 2024-09-18T12:49:40.780 INFO:tasks.workunit.client.0.smithi078.stdout:2/905: fsync d4/db/dc/f102 0 2024-09-18T12:49:40.808 INFO:tasks.workunit.client.0.smithi078.stdout:2/906: dread d4/dd/f40 [0,4194304] 0 2024-09-18T12:49:40.809 INFO:tasks.workunit.client.0.smithi078.stdout:2/907: symlink d4/db/dc/dc0/df2/l12d 0 2024-09-18T12:49:40.815 INFO:tasks.workunit.client.0.smithi078.stdout:2/908: write d4/d1a/fe7 [561721,83279] 0 2024-09-18T12:49:40.820 INFO:tasks.workunit.client.0.smithi078.stdout:2/909: creat d4/db/f12e x:0 0 0 2024-09-18T12:49:40.821 INFO:tasks.workunit.client.0.smithi078.stdout:2/910: truncate d4/d1a/fe7 1042211 0 2024-09-18T12:49:40.823 INFO:tasks.workunit.client.0.smithi078.stdout:2/911: write d4/d8/d23/d52/d5f/d86/d3b/d4f/f57 [804958,9663] 0 2024-09-18T12:49:40.826 INFO:tasks.workunit.client.0.smithi078.stdout:2/912: creat d4/d8/d23/d52/d5f/d86/d3b/d4f/dd7/f12f x:0 0 0 2024-09-18T12:49:40.832 INFO:tasks.workunit.client.0.smithi078.stdout:2/913: rename d4/db/f53 to d4/d8/d23/d52/d5f/d86/d3b/d4f/dd7/d111/f130 0 2024-09-18T12:49:40.835 INFO:tasks.workunit.client.0.smithi078.stdout:2/914: symlink d4/d8/d23/d52/d5f/d81/dae/d114/d8e/l131 0 2024-09-18T12:49:40.837 INFO:tasks.workunit.client.0.smithi078.stdout:2/915: readlink d4/db/dc/le0 0 2024-09-18T12:49:40.841 INFO:tasks.workunit.client.0.smithi078.stdout:2/916: rename d4/d8/d23/d52/d5f/d81/dae/d114/d8e/l10c to d4/d8/d23/d52/d5f/d81/dae/d114/dea/l132 0 2024-09-18T12:49:40.855 INFO:tasks.workunit.client.0.smithi078.stdout:2/917: dread d4/d8/f37 [0,4194304] 0 2024-09-18T12:49:40.860 INFO:tasks.workunit.client.0.smithi078.stdout:2/918: rename d4/d8/d6c/d70/le2 to d4/d8/d23/d52/d5f/d81/dae/d114/d8e/l133 0 2024-09-18T12:49:40.863 INFO:tasks.workunit.client.0.smithi078.stdout:2/919: mkdir d4/d8/d23/d52/d5f/d81/dae/dbd/d129/d134 0 2024-09-18T12:49:40.865 INFO:tasks.workunit.client.0.smithi078.stdout:2/920: chown d4/d8/d23/d52/d5f/d81/dac/daf/c126 139112 1 2024-09-18T12:49:40.866 INFO:tasks.workunit.client.0.smithi078.stdout:2/921: rmdir d4/d8/d23/d52/d5f/d86 39 2024-09-18T12:49:40.875 INFO:tasks.workunit.client.0.smithi078.stdout:2/922: dwrite d4/db/f68 [0,4194304] 0 2024-09-18T12:49:40.880 INFO:tasks.workunit.client.0.smithi078.stdout:7/972: sync 2024-09-18T12:49:40.881 INFO:tasks.workunit.client.0.smithi078.stdout:2/923: dwrite d4/db/f1c [0,4194304] 0 2024-09-18T12:49:40.885 INFO:tasks.workunit.client.0.smithi078.stdout:7/973: getdents d7/d9/d4d 0 2024-09-18T12:49:40.886 INFO:tasks.workunit.client.0.smithi078.stdout:7/974: chown d7/d5d/d7a/f4a 2 1 2024-09-18T12:49:40.886 INFO:tasks.workunit.client.0.smithi078.stdout:2/924: rename d4/d8/d23/d52/d5f/d81 to d4/db/dc/dc0/df2/dd3/d135 0 2024-09-18T12:49:40.892 INFO:tasks.workunit.client.0.smithi078.stdout:7/975: dwrite d7/d9/f2f [0,4194304] 0 2024-09-18T12:49:40.893 INFO:tasks.workunit.client.0.smithi078.stdout:7/976: chown d7/d9/d4d/l128 170090123 1 2024-09-18T12:49:40.897 INFO:tasks.workunit.client.0.smithi078.stdout:7/977: mkdir d7/d9/d14/d22/d35/d49/d7d/d145 0 2024-09-18T12:49:40.902 INFO:tasks.workunit.client.0.smithi078.stdout:7/978: dread d7/d9/dd7/d3b/f116 [0,4194304] 0 2024-09-18T12:49:40.902 INFO:tasks.workunit.client.0.smithi078.stdout:7/979: stat d7/d3f/f6a 0 2024-09-18T12:49:40.905 INFO:tasks.workunit.client.0.smithi078.stdout:7/980: mkdir d7/d9/dd7/d3b/d70/d146 0 2024-09-18T12:49:40.905 INFO:tasks.workunit.client.0.smithi078.stdout:2/925: truncate d4/d8/fa2 4515884 0 2024-09-18T12:49:40.907 INFO:tasks.workunit.client.0.smithi078.stdout:7/981: truncate d7/d26/f94 21084 0 2024-09-18T12:49:40.910 INFO:tasks.workunit.client.0.smithi078.stdout:2/926: creat d4/f136 x:0 0 0 2024-09-18T12:49:40.914 INFO:tasks.workunit.client.0.smithi078.stdout:2/927: fsync d4/db/dc/dc0/f128 0 2024-09-18T12:49:40.921 INFO:tasks.workunit.client.0.smithi078.stdout:7/982: write f5 [781764,97466] 0 2024-09-18T12:49:40.926 INFO:tasks.workunit.client.0.smithi078.stdout:7/983: dwrite d7/d9/d14/d22/d35/fc8 [0,4194304] 0 2024-09-18T12:49:40.928 INFO:tasks.workunit.client.0.smithi078.stdout:7/984: dread - d7/d9/dd7/d3b/d70/f117 zero size 2024-09-18T12:49:40.939 INFO:tasks.workunit.client.0.smithi078.stdout:2/928: mknod d4/d8/d23/d52/d5f/c137 0 2024-09-18T12:49:40.942 INFO:tasks.workunit.client.0.smithi078.stdout:2/929: write d4/d8/d23/d52/d5f/d86/d3b/d55/f109 [826683,73181] 0 2024-09-18T12:49:40.943 INFO:tasks.workunit.client.0.smithi078.stdout:2/930: chown d4/d8/d6c/ff8 944 1 2024-09-18T12:49:40.945 INFO:tasks.workunit.client.0.smithi078.stdout:2/931: dread d4/d8/d23/f96 [0,4194304] 0 2024-09-18T12:49:40.948 INFO:tasks.workunit.client.0.smithi078.stdout:2/932: creat d4/db/dc/dc0/df2/dd3/f138 x:0 0 0 2024-09-18T12:49:40.952 INFO:tasks.workunit.client.0.smithi078.stdout:2/933: creat d4/d8/d23/d52/d5f/d86/d3b/d4f/f139 x:0 0 0 2024-09-18T12:49:40.957 INFO:tasks.workunit.client.0.smithi078.stdout:2/934: creat d4/db/d45/f13a x:0 0 0 2024-09-18T12:49:40.959 INFO:tasks.workunit.client.0.smithi078.stdout:2/935: truncate d4/d8/d23/d52/d7c/f82 1661844 0 2024-09-18T12:49:40.965 INFO:tasks.workunit.client.0.smithi078.stdout:2/936: rename d4/c5d to d4/d8/d23/d52/d5f/d86/c13b 0 2024-09-18T12:49:40.968 INFO:tasks.workunit.client.0.smithi078.stdout:2/937: creat d4/db/dc/dc0/df2/dd3/d135/dae/dbd/d129/f13c x:0 0 0 2024-09-18T12:49:40.971 INFO:tasks.workunit.client.0.smithi078.stdout:2/938: mkdir d4/d1a/d127/d13d 0 2024-09-18T12:49:40.974 INFO:tasks.workunit.client.0.smithi078.stdout:2/939: creat d4/db/dc/dec/f13e x:0 0 0 2024-09-18T12:49:40.978 INFO:tasks.workunit.client.0.smithi078.stdout:2/940: unlink d4/d8/d23/d52/l98 0 2024-09-18T12:49:40.978 INFO:tasks.workunit.client.0.smithi078.stdout:2/941: chown d4/db/dc/f102 51 1 2024-09-18T12:49:40.984 INFO:tasks.workunit.client.0.smithi078.stdout:2/942: dwrite d4/db/dc/dec/f10d [0,4194304] 0 2024-09-18T12:49:40.986 INFO:tasks.workunit.client.0.smithi078.stdout:2/943: stat d4/c5b 0 2024-09-18T12:49:40.989 INFO:tasks.workunit.client.0.smithi078.stdout:2/944: creat d4/db/dc/dc0/f13f x:0 0 0 2024-09-18T12:49:40.991 INFO:tasks.workunit.client.0.smithi078.stdout:2/945: chown d4/db/dc/dc0/df2/dd3/d135/dac/daf/c126 3694 1 2024-09-18T12:49:41.002 INFO:tasks.workunit.client.0.smithi078.stdout:2/946: getdents d4/d1a 0 2024-09-18T12:49:41.010 INFO:tasks.workunit.client.0.smithi078.stdout:2/947: write d4/db/dc/f102 [546899,50310] 0 2024-09-18T12:49:41.010 INFO:tasks.workunit.client.0.smithi078.stdout:2/948: dread - d4/d8/d23/ff4 zero size 2024-09-18T12:49:41.015 INFO:tasks.workunit.client.0.smithi078.stdout:2/949: creat d4/db/dc/dc0/df2/dd3/d135/dae/d11e/f140 x:0 0 0 2024-09-18T12:49:41.016 INFO:tasks.workunit.client.0.smithi078.stdout:2/950: write d4/db/dc/dec/f10d [4782766,85376] 0 2024-09-18T12:49:41.022 INFO:tasks.workunit.client.0.smithi078.stdout:2/951: mknod d4/d8/d23/d52/d5f/d86/d3b/d4f/dd7/d111/c141 0 2024-09-18T12:49:41.027 INFO:tasks.workunit.client.0.smithi078.stdout:2/952: write d4/db/d45/f8f [859750,14344] 0 2024-09-18T12:49:41.035 INFO:tasks.workunit.client.0.smithi078.stdout:2/953: getdents d4/db/dc/dc0/df2/dd3/d135/dae/d114/dea 0 2024-09-18T12:49:41.037 INFO:tasks.workunit.client.0.smithi078.stdout:2/954: symlink d4/db/dc/dc0/df2/l142 0 2024-09-18T12:49:41.040 INFO:tasks.workunit.client.0.smithi078.stdout:2/955: mkdir d4/d8/d23/d52/d5f/d86/d3b/d4f/d143 0 2024-09-18T12:49:41.045 INFO:tasks.workunit.client.0.smithi078.stdout:2/956: getdents d4/db/dc/dc0/df2/dd3/d135/dac/daf 0 2024-09-18T12:49:41.047 INFO:tasks.workunit.client.0.smithi078.stdout:2/957: unlink d4/db/dc/dc0/df2/dd3/d135/dac/d106/f101 0 2024-09-18T12:49:41.051 INFO:tasks.workunit.client.0.smithi078.stdout:2/958: link d4/d8/d23/d52/d5f/le8 d4/db/d45/d12c/l144 0 2024-09-18T12:49:41.052 INFO:tasks.workunit.client.0.smithi078.stdout:2/959: creat d4/db/dd8/f145 x:0 0 0 2024-09-18T12:49:41.053 INFO:tasks.workunit.client.0.smithi078.stdout:2/960: fdatasync d4/db/dc/dec/f13e 0 2024-09-18T12:49:41.055 INFO:tasks.workunit.client.0.smithi078.stdout:2/961: mkdir d4/d8/d23/d52/d146 0 2024-09-18T12:49:41.062 INFO:tasks.workunit.client.0.smithi078.stdout:2/962: write d4/d8/d23/d52/d5f/d86/d3b/d55/f7f [101112,98507] 0 2024-09-18T12:49:41.071 INFO:tasks.workunit.client.0.smithi078.stdout:2/963: dwrite d4/d8/d23/f9e [0,4194304] 0 2024-09-18T12:49:41.072 INFO:tasks.workunit.client.0.smithi078.stdout:2/964: fdatasync d4/db/dc/dc0/df2/dd3/d135/dae/d114/f48 0 2024-09-18T12:49:41.077 INFO:tasks.workunit.client.0.smithi078.stdout:2/965: symlink d4/db/dc/dc0/l147 0 2024-09-18T12:49:41.078 INFO:tasks.workunit.client.0.smithi078.stdout:2/966: read - d4/db/dc/dec/f103 zero size 2024-09-18T12:49:41.081 INFO:tasks.workunit.client.0.smithi078.stdout:2/967: readlink d4/d8/d23/d52/d5f/le8 0 2024-09-18T12:49:41.082 INFO:tasks.workunit.client.0.smithi078.stdout:2/968: dread - d4/d8/d23/d52/d5f/d86/d3b/d4f/dd7/f12f zero size 2024-09-18T12:49:41.086 INFO:tasks.workunit.client.0.smithi078.stdout:2/969: creat d4/db/dc/dc0/df2/dd3/d135/dae/dbd/f148 x:0 0 0 2024-09-18T12:49:41.094 INFO:tasks.workunit.client.0.smithi078.stdout:2/970: write d4/d8/d23/d52/d5f/d86/d3b/d4f/fb9 [2383117,26737] 0 2024-09-18T12:49:41.097 INFO:tasks.workunit.client.0.smithi078.stdout:2/971: mkdir d4/db/dc/dc0/df2/dd3/d135/dae/d114/d149 0 2024-09-18T12:49:41.099 INFO:tasks.workunit.client.0.smithi078.stdout:2/972: mknod d4/d8/d23/d52/d5f/c14a 0 2024-09-18T12:49:41.105 INFO:tasks.workunit.client.0.smithi078.stdout:2/973: write d4/f9 [5157366,56924] 0 2024-09-18T12:49:41.106 INFO:tasks.workunit.client.0.smithi078.stdout:2/974: dread - d4/d8/ffd zero size 2024-09-18T12:49:41.108 INFO:tasks.workunit.client.0.smithi078.stdout:2/975: fdatasync d4/d20/f29 0 2024-09-18T12:49:41.112 INFO:tasks.workunit.client.0.smithi078.stdout:2/976: creat d4/db/d45/dbc/dee/f14b x:0 0 0 2024-09-18T12:49:41.123 INFO:tasks.workunit.client.0.smithi078.stdout:2/977: dwrite d4/d8/d23/d52/d5f/d86/f60 [4194304,4194304] 0 2024-09-18T12:49:41.126 INFO:tasks.workunit.client.0.smithi078.stdout:3/940: sync 2024-09-18T12:49:41.127 INFO:tasks.workunit.client.0.smithi078.stdout:3/941: fdatasync d9/d13/d33/d3c/ff5 0 2024-09-18T12:49:41.128 INFO:tasks.workunit.client.0.smithi078.stdout:2/978: rename d4/db/dc/dc0/df2/dd3/d135/dae/d11e/f140 to d4/d8/d23/d52/d7c/f14c 0 2024-09-18T12:49:41.130 INFO:tasks.workunit.client.0.smithi078.stdout:2/979: truncate d4/d8/d23/d52/d7c/f12a 978328 0 2024-09-18T12:49:41.132 INFO:tasks.workunit.client.0.smithi078.stdout:2/980: write d4/db/dc/dc0/f128 [125529,106179] 0 2024-09-18T12:49:41.135 INFO:tasks.workunit.client.0.smithi078.stdout:2/981: write d4/db/dc/dc0/df2/dd3/d135/dae/d114/d8e/f107 [341407,73026] 0 2024-09-18T12:49:41.139 INFO:tasks.workunit.client.0.smithi078.stdout:2/982: dread - d4/d8/d23/d52/d5f/d86/d3b/d4f/fca zero size 2024-09-18T12:49:41.141 INFO:tasks.workunit.client.0.smithi078.stdout:2/983: write d4/d8/d23/d52/d5f/d86/d3b/d4f/f61 [3104582,33297] 0 2024-09-18T12:49:41.142 INFO:tasks.workunit.client.0.smithi078.stdout:2/984: readlink d4/db/dc/dc0/l147 0 2024-09-18T12:49:41.149 INFO:tasks.workunit.client.0.smithi078.stdout:2/985: dwrite d4/db/dc/dc0/df2/dd3/fdd [0,4194304] 0 2024-09-18T12:49:41.152 INFO:tasks.workunit.client.0.smithi078.stdout:2/986: mknod d4/db/dc/dc0/df2/dd3/d135/dac/c14d 0 2024-09-18T12:49:41.153 INFO:tasks.workunit.client.0.smithi078.stdout:2/987: write d4/d8/d6c/d70/fa3 [550056,50264] 0 2024-09-18T12:49:41.154 INFO:tasks.workunit.client.0.smithi078.stdout:7/985: sync 2024-09-18T12:49:41.155 INFO:tasks.workunit.client.0.smithi078.stdout:2/988: write d4/db/dc/dc0/df2/dd3/f138 [370155,111458] 0 2024-09-18T12:49:41.155 INFO:tasks.workunit.client.0.smithi078.stdout:7/986: chown d7/d26/f30 5 1 2024-09-18T12:49:41.161 INFO:tasks.workunit.client.0.smithi078.stdout:7/987: read d7/d9/d14/d22/d3e/f106 [3900409,92590] 0 2024-09-18T12:49:41.161 INFO:tasks.workunit.client.0.smithi078.stdout:2/989: getdents d4/db/dd8/d124 0 2024-09-18T12:49:41.163 INFO:tasks.workunit.client.0.smithi078.stdout:7/988: stat d7/d26/d4f/f50 0 2024-09-18T12:49:41.163 INFO:tasks.workunit.client.0.smithi078.stdout:3/942: dwrite d9/d13/d33/d4e/ff7 [0,4194304] 0 2024-09-18T12:49:41.165 INFO:tasks.workunit.client.0.smithi078.stdout:3/943: read f7 [7520639,35935] 0 2024-09-18T12:49:41.169 INFO:tasks.workunit.client.0.smithi078.stdout:3/944: write d9/d29/f120 [80961,84809] 0 2024-09-18T12:49:41.169 INFO:tasks.workunit.client.0.smithi078.stdout:7/989: fdatasync d7/d9/d14/d22/fb1 0 2024-09-18T12:49:41.172 INFO:tasks.workunit.client.0.smithi078.stdout:2/990: rename d4/db/dc/dc0/df2/dd3/d135/dae/d114/d8e/l131 to d4/db/dc/dc0/df2/dd3/d135/dac/l14e 0 2024-09-18T12:49:41.175 INFO:tasks.workunit.client.0.smithi078.stdout:2/991: read - d4/db/dc/dc0/df2/dd3/d135/dae/d114/dea/f123 zero size 2024-09-18T12:49:41.182 INFO:tasks.workunit.client.0.smithi078.stdout:2/992: creat d4/db/dc/dc0/df2/dd3/d135/dac/f14f x:0 0 0 2024-09-18T12:49:41.187 INFO:tasks.workunit.client.0.smithi078.stdout:2/993: creat d4/d105/f150 x:0 0 0 2024-09-18T12:49:41.191 INFO:tasks.workunit.client.0.smithi078.stdout:2/994: truncate d4/d20/f29 2143037 0 2024-09-18T12:49:41.192 INFO:tasks.workunit.client.0.smithi078.stdout:2/995: chown d4/d8/d23/d52/d7c/f14c 732 1 2024-09-18T12:49:41.201 INFO:tasks.workunit.client.0.smithi078.stdout:2/996: mknod d4/d8/d23/d52/c151 0 2024-09-18T12:49:41.207 INFO:tasks.workunit.client.0.smithi078.stdout:7/990: dread d7/d26/d84/fa1 [0,4194304] 0 2024-09-18T12:49:41.211 INFO:tasks.workunit.client.0.smithi078.stdout:3/945: dwrite d9/d54/f106 [0,4194304] 0 2024-09-18T12:49:41.215 INFO:tasks.workunit.client.0.smithi078.stdout:2/997: truncate d4/d8/d23/d52/d5f/d86/d3b/d4f/dd7/d111/f130 7650540 0 2024-09-18T12:49:41.217 INFO:tasks.workunit.client.0.smithi078.stdout:3/946: creat d9/d54/d7f/dae/dd4/f127 x:0 0 0 2024-09-18T12:49:41.220 INFO:tasks.workunit.client.0.smithi078.stdout:7/991: rename d7/d9/f13 to d7/d9/dd7/d3b/f147 0 2024-09-18T12:49:41.223 INFO:tasks.workunit.client.0.smithi078.stdout:2/998: dread d4/db/dc/f1b [4194304,4194304] 0 2024-09-18T12:49:41.223 INFO:tasks.workunit.client.0.smithi078.stdout:2/999: fsync d4/db/dc/f102 0 2024-09-18T12:49:41.224 INFO:tasks.workunit.client.0.smithi078.stdout:3/947: creat d9/d54/d89/d92/db6/d104/f128 x:0 0 0 2024-09-18T12:49:41.226 INFO:tasks.workunit.client.0.smithi078.stdout:7/992: creat d7/d9/d14/d22/d3e/d95/f148 x:0 0 0 2024-09-18T12:49:41.227 INFO:tasks.workunit.client.0.smithi078.stdout:7/993: stat d7/d9/d4d/d6f/d11d/c127 0 2024-09-18T12:49:41.228 INFO:tasks.workunit.client.0.smithi078.stdout:7/994: chown d7/d9/d14/d22/d3e/d95/db2/dcb/lf6 85 1 2024-09-18T12:49:41.230 INFO:tasks.workunit.client.0.smithi078.stdout:3/948: mknod d9/d2f/c129 0 2024-09-18T12:49:41.231 INFO:tasks.workunit.client.0.smithi078.stdout:3/949: chown d9/d13/d37/l123 1 1 2024-09-18T12:49:41.236 INFO:tasks.workunit.client.0.smithi078.stdout:3/950: symlink d9/d13/d63/d78/dfe/l12a 0 2024-09-18T12:49:41.237 INFO:tasks.workunit.client.0.smithi078.stdout:7/995: dwrite d7/d9/d14/d22/d3e/fc3 [8388608,4194304] 0 2024-09-18T12:49:41.239 INFO:tasks.workunit.client.0.smithi078.stdout:7/996: truncate d7/d9/d14/dde/ff4 4721646 0 2024-09-18T12:49:41.241 INFO:tasks.workunit.client.0.smithi078.stdout:3/951: mknod d9/d54/d6c/c12b 0 2024-09-18T12:49:41.244 INFO:tasks.workunit.client.0.smithi078.stdout:7/997: unlink d7/d9/d14/d22/d35/f120 0 2024-09-18T12:49:41.246 INFO:tasks.workunit.client.0.smithi078.stdout:7/998: mknod d7/d9/d4d/dff/c149 0 2024-09-18T12:49:41.248 INFO:tasks.workunit.client.0.smithi078.stdout:3/952: creat d9/d29/f12c x:0 0 0 2024-09-18T12:49:41.248 INFO:tasks.workunit.client.0.smithi078.stdout:7/999: chown d7/d9/d14/d22/d35/d49/d61/le0 2883 1 2024-09-18T12:49:41.251 INFO:tasks.workunit.client.0.smithi078.stdout:3/953: creat d9/d29/d4b/d4c/d10c/f12d x:0 0 0 2024-09-18T12:49:41.253 INFO:tasks.workunit.client.0.smithi078.stdout:3/954: mkdir d9/d29/d4b/d4c/d10c/d12e 0 2024-09-18T12:49:41.254 INFO:tasks.workunit.client.0.smithi078.stdout:3/955: write d9/d29/f120 [890471,3882] 0 2024-09-18T12:49:41.277 INFO:tasks.workunit.client.0.smithi078.stdout:3/956: write d9/d2f/f77 [128862,77518] 0 2024-09-18T12:49:41.292 INFO:tasks.workunit.client.0.smithi078.stdout:3/957: dread d9/d13/d33/d34/d97/f9b [0,4194304] 0 2024-09-18T12:49:41.298 INFO:tasks.workunit.client.0.smithi078.stdout:3/958: dwrite d9/d13/d33/d34/d9e/fe2 [0,4194304] 0 2024-09-18T12:49:41.299 INFO:tasks.workunit.client.0.smithi078.stdout:3/959: read d9/d2f/f3d [1462345,96861] 0 2024-09-18T12:49:41.300 INFO:tasks.workunit.client.0.smithi078.stdout:3/960: fsync d9/d54/d7f/fec 0 2024-09-18T12:49:41.301 INFO:tasks.workunit.client.0.smithi078.stdout:3/961: write d9/d13/d33/d3c/d19/f125 [734230,10690] 0 2024-09-18T12:49:41.308 INFO:tasks.workunit.client.0.smithi078.stdout:3/962: dread d9/d54/fb4 [0,4194304] 0 2024-09-18T12:49:41.310 INFO:tasks.workunit.client.0.smithi078.stdout:3/963: mkdir d9/d13/d63/d78/d12f 0 2024-09-18T12:49:41.312 INFO:tasks.workunit.client.0.smithi078.stdout:3/964: creat d9/f130 x:0 0 0 2024-09-18T12:49:41.313 INFO:tasks.workunit.client.0.smithi078.stdout:3/965: write d9/d54/d89/d92/f119 [99136,122182] 0 2024-09-18T12:49:41.320 INFO:tasks.workunit.client.0.smithi078.stdout:3/966: dwrite d9/d54/d7f/dae/dd4/f127 [0,4194304] 0 2024-09-18T12:49:41.338 INFO:tasks.workunit.client.0.smithi078.stdout:3/967: dread d9/d13/d33/d3c/f87 [0,4194304] 0 2024-09-18T12:49:41.343 INFO:tasks.workunit.client.0.smithi078.stdout:3/968: mknod d9/d54/d6c/d9f/dfd/c131 0 2024-09-18T12:49:41.346 INFO:tasks.workunit.client.0.smithi078.stdout:3/969: unlink d9/d29/d4b/d4c/lcc 0 2024-09-18T12:49:41.348 INFO:tasks.workunit.client.0.smithi078.stdout:3/970: truncate d9/d54/d89/d92/db6/d104/f128 922317 0 2024-09-18T12:49:41.349 INFO:tasks.workunit.client.0.smithi078.stdout:3/971: rmdir d9/d13/d63 39 2024-09-18T12:49:41.351 INFO:tasks.workunit.client.0.smithi078.stdout:3/972: mknod d9/d13/d37/c132 0 2024-09-18T12:49:41.360 INFO:tasks.workunit.client.0.smithi078.stdout:3/973: dwrite d9/d29/f24 [4194304,4194304] 0 2024-09-18T12:49:41.362 INFO:tasks.workunit.client.0.smithi078.stdout:3/974: truncate d9/d29/d4b/d4c/fcf 4564013 0 2024-09-18T12:49:41.366 INFO:tasks.workunit.client.0.smithi078.stdout:3/975: mkdir d9/d54/d89/d92/db6/d104/d133 0 2024-09-18T12:49:41.367 INFO:tasks.workunit.client.0.smithi078.stdout:3/976: dread - d9/d54/d7f/d9c/f10e zero size 2024-09-18T12:49:41.373 INFO:tasks.workunit.client.0.smithi078.stdout:3/977: link d9/f3f d9/d54/d89/d92/db6/f134 0 2024-09-18T12:49:41.389 INFO:tasks.workunit.client.0.smithi078.stdout:3/978: dwrite d9/d54/d89/fe5 [0,4194304] 0 2024-09-18T12:49:41.393 INFO:tasks.workunit.client.0.smithi078.stdout:3/979: rename d9/d54/d6c/d9f/db2 to d9/d54/d6c/d9f/dfd/d135 0 2024-09-18T12:49:41.398 INFO:tasks.workunit.client.0.smithi078.stdout:3/980: link d9/df/lb9 d9/d54/d89/d92/db6/d104/d133/l136 0 2024-09-18T12:49:41.401 INFO:tasks.workunit.client.0.smithi078.stdout:3/981: unlink d9/d54/f8e 0 2024-09-18T12:49:41.403 INFO:tasks.workunit.client.0.smithi078.stdout:3/982: mkdir d9/d13/d63/d78/d137 0 2024-09-18T12:49:41.404 INFO:tasks.workunit.client.0.smithi078.stdout:3/983: write d9/d13/d33/d4e/ff7 [2424807,43945] 0 2024-09-18T12:49:41.407 INFO:tasks.workunit.client.0.smithi078.stdout:3/984: mknod d9/d13/d33/d34/d9e/df1/c138 0 2024-09-18T12:49:41.411 INFO:tasks.workunit.client.0.smithi078.stdout:3/985: rename d9/d54/d89/d92/db6/dde to d9/d11f/d139 0 2024-09-18T12:49:41.415 INFO:tasks.workunit.client.0.smithi078.stdout:3/986: dwrite d9/d13/d63/fd6 [0,4194304] 0 2024-09-18T12:49:41.420 INFO:tasks.workunit.client.0.smithi078.stdout:3/987: dread d9/d13/d33/d34/d9e/fe2 [0,4194304] 0 2024-09-18T12:49:41.424 INFO:tasks.workunit.client.0.smithi078.stdout:3/988: creat d9/d2f/d43/d62/f13a x:0 0 0 2024-09-18T12:49:41.427 INFO:tasks.workunit.client.0.smithi078.stdout:3/989: rename d9/d13/d33/d3c/d19/c116 to d9/d13/d63/d78/c13b 0 2024-09-18T12:49:41.430 INFO:tasks.workunit.client.0.smithi078.stdout:3/990: symlink d9/d54/d6c/d9f/dfd/l13c 0 2024-09-18T12:49:41.436 INFO:tasks.workunit.client.0.smithi078.stdout:3/991: dwrite d9/d29/f12c [0,4194304] 0 2024-09-18T12:49:41.437 INFO:tasks.workunit.client.0.smithi078.stdout:3/992: read - d9/d54/d6c/d9f/dfd/d135/d10a/f11d zero size 2024-09-18T12:49:41.460 INFO:tasks.workunit.client.0.smithi078.stdout:3/993: dwrite d9/d13/d63/d78/fca [0,4194304] 0 2024-09-18T12:49:41.462 INFO:tasks.workunit.client.0.smithi078.stdout:3/994: write d9/d54/d89/d92/fc7 [406193,96217] 0 2024-09-18T12:49:41.466 INFO:tasks.workunit.client.0.smithi078.stdout:3/995: creat d9/d29/d4b/d4c/f13d x:0 0 0 2024-09-18T12:49:41.470 INFO:tasks.workunit.client.0.smithi078.stdout:3/996: creat d9/d54/d6c/d9f/dfd/d135/d10a/d122/f13e x:0 0 0 2024-09-18T12:49:41.475 INFO:tasks.workunit.client.0.smithi078.stdout:3/997: fdatasync d9/d54/d7f/ffa 0 2024-09-18T12:49:41.485 INFO:tasks.workunit.client.0.smithi078.stdout:3/998: write d9/f61 [468051,14489] 0 2024-09-18T12:49:41.487 INFO:tasks.workunit.client.0.smithi078.stdout:3/999: rmdir d9/d29/d4b 39 2024-09-18T12:49:41.491 INFO:tasks.workunit.client.0.smithi078.stderr:+ rm -rf -- ./tmp.yAeSTZ1uBq 2024-09-18T12:49:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:41 smithi148 ceph-mon[35352]: pgmap v28: 65 pgs: 65 active+clean; 3.5 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 52 MiB/s rd, 117 MiB/s wr, 317 op/s 2024-09-18T12:49:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:41 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:41 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:41.986 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:41 smithi078 ceph-mon[28091]: pgmap v28: 65 pgs: 65 active+clean; 3.5 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 52 MiB/s rd, 117 MiB/s wr, 317 op/s 2024-09-18T12:49:41.987 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:41 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:41.987 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:41 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:42.990 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:42 smithi078 ceph-mon[28091]: Reconfiguring prometheus.smithi078 (dependencies changed)... 2024-09-18T12:49:42.990 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:42 smithi078 ceph-mon[28091]: Reconfiguring daemon prometheus.smithi078 on smithi078 2024-09-18T12:49:43.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:42 smithi148 ceph-mon[35352]: Reconfiguring prometheus.smithi078 (dependencies changed)... 2024-09-18T12:49:43.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:42 smithi148 ceph-mon[35352]: Reconfiguring daemon prometheus.smithi078 on smithi078 2024-09-18T12:49:43.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:43 smithi078 ceph-mon[28091]: pgmap v29: 65 pgs: 65 active+clean; 3.3 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 71 MiB/s rd, 157 MiB/s wr, 444 op/s 2024-09-18T12:49:44.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:43 smithi148 ceph-mon[35352]: pgmap v29: 65 pgs: 65 active+clean; 3.3 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 71 MiB/s rd, 157 MiB/s wr, 444 op/s 2024-09-18T12:49:45.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:45 smithi078 ceph-mon[28091]: pgmap v30: 65 pgs: 65 active+clean; 3.3 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 38 MiB/s rd, 81 MiB/s wr, 262 op/s 2024-09-18T12:49:46.106 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:45 smithi148 ceph-mon[35352]: pgmap v30: 65 pgs: 65 active+clean; 3.3 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 38 MiB/s rd, 81 MiB/s wr, 262 op/s 2024-09-18T12:49:47.952 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:47 smithi148 ceph-mon[35352]: pgmap v31: 65 pgs: 65 active+clean; 2.7 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 38 MiB/s rd, 84 MiB/s wr, 302 op/s 2024-09-18T12:49:47.952 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:47 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:47.952 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:47 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:47.952 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:47 smithi148 ceph-mon[35352]: Reconfiguring ceph-exporter.smithi148 (dependencies changed)... 2024-09-18T12:49:47.952 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:47 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi148", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:49:47.953 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:47 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi148", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:49:47.953 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:47 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:47.953 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:47 smithi148 ceph-mon[35352]: Deploying daemon ceph-exporter.smithi148 on smithi148 2024-09-18T12:49:47.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:47 smithi078 ceph-mon[28091]: pgmap v31: 65 pgs: 65 active+clean; 2.7 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 38 MiB/s rd, 84 MiB/s wr, 302 op/s 2024-09-18T12:49:47.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:47 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:47.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:47 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:47.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:47 smithi078 ceph-mon[28091]: Reconfiguring ceph-exporter.smithi148 (dependencies changed)... 2024-09-18T12:49:47.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:47 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi148", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:49:47.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:47 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi148", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:49:47.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:47 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:47.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:47 smithi078 ceph-mon[28091]: Deploying daemon ceph-exporter.smithi148 on smithi148 2024-09-18T12:49:48.124 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-18T12:49:48.125 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-18T12:49:49.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.308+0000 7fe57173b640 1 -- 172.21.15.78:0/3769366362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe56c101a60 msgr2=0x7fe56c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:49.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.308+0000 7fe57173b640 1 --2- 172.21.15.78:0/3769366362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe56c101a60 0x7fe56c101ee0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe560009880 tx=0x7fe56002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.309+0000 7fe57173b640 1 -- 172.21.15.78:0/3769366362 shutdown_connections 2024-09-18T12:49:49.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.309+0000 7fe57173b640 1 --2- 172.21.15.78:0/3769366362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe56c101a60 0x7fe56c101ee0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.309+0000 7fe57173b640 1 --2- 172.21.15.78:0/3769366362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe56c100860 0x7fe56c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.309+0000 7fe57173b640 1 -- 172.21.15.78:0/3769366362 >> 172.21.15.78:0/3769366362 conn(0x7fe56c0fc010 msgr2=0x7fe56c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:49.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.309+0000 7fe57173b640 1 -- 172.21.15.78:0/3769366362 shutdown_connections 2024-09-18T12:49:49.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.309+0000 7fe57173b640 1 -- 172.21.15.78:0/3769366362 wait complete. 2024-09-18T12:49:49.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.310+0000 7fe57173b640 1 Processor -- start 2024-09-18T12:49:49.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.310+0000 7fe57173b640 1 -- start start 2024-09-18T12:49:49.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.310+0000 7fe57173b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe56c100860 0x7fe56c19d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:49.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.310+0000 7fe57173b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe56c101a60 0x7fe56c19dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:49.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.311+0000 7fe57173b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c1085d0 con 0x7fe56c101a60 2024-09-18T12:49:49.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.311+0000 7fe57173b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c108450 con 0x7fe56c100860 2024-09-18T12:49:49.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.311+0000 7fe56a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe56c101a60 0x7fe56c19dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:49.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.311+0000 7fe56a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe56c101a60 0x7fe56c19dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48290/0 (socket says 172.21.15.78:48290) 2024-09-18T12:49:49.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.311+0000 7fe56a7fc640 1 -- 172.21.15.78:0/3753217159 learned_addr learned my addr 172.21.15.78:0/3753217159 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:49:49.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.311+0000 7fe56affd640 1 --2- 172.21.15.78:0/3753217159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe56c100860 0x7fe56c19d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:49.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.311+0000 7fe56a7fc640 1 -- 172.21.15.78:0/3753217159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe56c100860 msgr2=0x7fe56c19d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:49.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.311+0000 7fe56a7fc640 1 --2- 172.21.15.78:0/3753217159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe56c100860 0x7fe56c19d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.311+0000 7fe56a7fc640 1 -- 172.21.15.78:0/3753217159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56c19e460 con 0x7fe56c101a60 2024-09-18T12:49:49.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.312+0000 7fe56a7fc640 1 --2- 172.21.15.78:0/3753217159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe56c101a60 0x7fe56c19dde0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe56002aa90 tx=0x7fe5600048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:49.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.313+0000 7fe553fff640 1 -- 172.21.15.78:0/3753217159 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe56003f070 con 0x7fe56c101a60 2024-09-18T12:49:49.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.313+0000 7fe57173b640 1 -- 172.21.15.78:0/3753217159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe56c1a2e40 con 0x7fe56c101a60 2024-09-18T12:49:49.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.313+0000 7fe57173b640 1 -- 172.21.15.78:0/3753217159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe56c1a32f0 con 0x7fe56c101a60 2024-09-18T12:49:49.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.313+0000 7fe553fff640 1 -- 172.21.15.78:0/3753217159 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe5600054a0 con 0x7fe56c101a60 2024-09-18T12:49:49.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.313+0000 7fe553fff640 1 -- 172.21.15.78:0/3753217159 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe560035030 con 0x7fe56c101a60 2024-09-18T12:49:49.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.314+0000 7fe57173b640 1 -- 172.21.15.78:0/3753217159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5580052c0 con 0x7fe56c101a60 2024-09-18T12:49:49.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.315+0000 7fe553fff640 1 -- 172.21.15.78:0/3753217159 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fe560042070 con 0x7fe56c101a60 2024-09-18T12:49:49.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.316+0000 7fe553fff640 1 --2- 172.21.15.78:0/3753217159 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fe554074b20 0x7fe554076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:49.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.316+0000 7fe553fff640 1 -- 172.21.15.78:0/3753217159 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fe5600b70f0 con 0x7fe56c101a60 2024-09-18T12:49:49.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.316+0000 7fe56affd640 1 --2- 172.21.15.78:0/3753217159 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fe554074b20 0x7fe554076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:49.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.317+0000 7fe56affd640 1 --2- 172.21.15.78:0/3753217159 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fe554074b20 0x7fe554076fe0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe55c005fd0 tx=0x7fe55c00b390 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:49.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.323+0000 7fe553fff640 1 -- 172.21.15.78:0/3753217159 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fe560049020 con 0x7fe56c101a60 2024-09-18T12:49:49.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.625+0000 7fe57173b640 1 -- 172.21.15.78:0/3753217159 --> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe558000bf0 con 0x7fe554074b20 2024-09-18T12:49:49.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.626+0000 7fe553fff640 1 -- 172.21.15.78:0/3753217159 <== mgr.24355 v2:172.21.15.148:6828/2591325460 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7fe558000bf0 con 0x7fe554074b20 2024-09-18T12:49:49.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.630+0000 7fe57173b640 1 -- 172.21.15.78:0/3753217159 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fe554074b20 msgr2=0x7fe554076fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:49.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.630+0000 7fe57173b640 1 --2- 172.21.15.78:0/3753217159 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fe554074b20 0x7fe554076fe0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe55c005fd0 tx=0x7fe55c00b390 comp rx=0 tx=0).stop 2024-09-18T12:49:49.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.630+0000 7fe57173b640 1 -- 172.21.15.78:0/3753217159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe56c101a60 msgr2=0x7fe56c19dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:49.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.630+0000 7fe57173b640 1 --2- 172.21.15.78:0/3753217159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe56c101a60 0x7fe56c19dde0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe56002aa90 tx=0x7fe5600048f0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.630+0000 7fe57173b640 1 -- 172.21.15.78:0/3753217159 shutdown_connections 2024-09-18T12:49:49.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.630+0000 7fe57173b640 1 --2- 172.21.15.78:0/3753217159 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fe554074b20 0x7fe554076fe0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.630+0000 7fe57173b640 1 --2- 172.21.15.78:0/3753217159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe56c101a60 0x7fe56c19dde0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.630+0000 7fe57173b640 1 --2- 172.21.15.78:0/3753217159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe56c100860 0x7fe56c19d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.630+0000 7fe57173b640 1 -- 172.21.15.78:0/3753217159 >> 172.21.15.78:0/3753217159 conn(0x7fe56c0fc010 msgr2=0x7fe56c0fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:49.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.630+0000 7fe57173b640 1 -- 172.21.15.78:0/3753217159 shutdown_connections 2024-09-18T12:49:49.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.630+0000 7fe57173b640 1 -- 172.21.15.78:0/3753217159 wait complete. 2024-09-18T12:49:49.640 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:49:49.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.736+0000 7f6620312640 1 -- 172.21.15.78:0/2660335432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6618102b70 msgr2=0x7f6618102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:49.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.736+0000 7f6620312640 1 --2- 172.21.15.78:0/2660335432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6618102b70 0x7f6618102ff0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6608009880 tx=0x7f660802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.736+0000 7f6620312640 1 -- 172.21.15.78:0/2660335432 shutdown_connections 2024-09-18T12:49:49.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.736+0000 7f6620312640 1 --2- 172.21.15.78:0/2660335432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6618102b70 0x7f6618102ff0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.736+0000 7f6620312640 1 --2- 172.21.15.78:0/2660335432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6618101970 0x7f6618101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.736+0000 7f6620312640 1 -- 172.21.15.78:0/2660335432 >> 172.21.15.78:0/2660335432 conn(0x7f66180fd140 msgr2=0x7f66180ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:49.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.736+0000 7f6620312640 1 -- 172.21.15.78:0/2660335432 shutdown_connections 2024-09-18T12:49:49.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.736+0000 7f6620312640 1 -- 172.21.15.78:0/2660335432 wait complete. 2024-09-18T12:49:49.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.737+0000 7f6620312640 1 Processor -- start 2024-09-18T12:49:49.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.737+0000 7f6620312640 1 -- start start 2024-09-18T12:49:49.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.737+0000 7f6620312640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6618101970 0x7f66181974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:49.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.737+0000 7f6620312640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6618102b70 0x7f6618197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:49.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.737+0000 7f6620312640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f661810a7b0 con 0x7f6618102b70 2024-09-18T12:49:49.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.737+0000 7f6620312640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f661810a630 con 0x7f6618101970 2024-09-18T12:49:49.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.737+0000 7f661d8ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6618102b70 0x7f6618197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:49.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.737+0000 7f661d8ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6618102b70 0x7f6618197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48310/0 (socket says 172.21.15.78:48310) 2024-09-18T12:49:49.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.737+0000 7f661e0ae640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6618101970 0x7f66181974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:49.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.737+0000 7f661d8ad640 1 -- 172.21.15.78:0/1427536319 learned_addr learned my addr 172.21.15.78:0/1427536319 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:49:49.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.738+0000 7f661e0ae640 1 -- 172.21.15.78:0/1427536319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6618102b70 msgr2=0x7f6618197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:49.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.738+0000 7f661e0ae640 1 --2- 172.21.15.78:0/1427536319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6618102b70 0x7f6618197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.738+0000 7f661e0ae640 1 -- 172.21.15.78:0/1427536319 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6618198090 con 0x7f6618101970 2024-09-18T12:49:49.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.738+0000 7f661e0ae640 1 --2- 172.21.15.78:0/1427536319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6618101970 0x7f66181974d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f661400e940 tx=0x7f661400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:49.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.738+0000 7f660f7fe640 1 -- 172.21.15.78:0/1427536319 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f661400cac0 con 0x7f6618101970 2024-09-18T12:49:49.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.738+0000 7f660f7fe640 1 -- 172.21.15.78:0/1427536319 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f661400cc60 con 0x7f6618101970 2024-09-18T12:49:49.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.738+0000 7f6620312640 1 -- 172.21.15.78:0/1427536319 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f661819cad0 con 0x7f6618101970 2024-09-18T12:49:49.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.738+0000 7f660f7fe640 1 -- 172.21.15.78:0/1427536319 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6614003df0 con 0x7f6618101970 2024-09-18T12:49:49.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.738+0000 7f6620312640 1 -- 172.21.15.78:0/1427536319 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f661819d060 con 0x7f6618101970 2024-09-18T12:49:49.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.739+0000 7f6620312640 1 -- 172.21.15.78:0/1427536319 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6618101d70 con 0x7f6618101970 2024-09-18T12:49:49.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.740+0000 7f660f7fe640 1 -- 172.21.15.78:0/1427536319 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f6614004000 con 0x7f6618101970 2024-09-18T12:49:49.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.741+0000 7f660f7fe640 1 --2- 172.21.15.78:0/1427536319 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f6604074a10 0x7f6604076ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:49.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.741+0000 7f660f7fe640 1 -- 172.21.15.78:0/1427536319 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f66140968c0 con 0x7f6618101970 2024-09-18T12:49:49.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.741+0000 7f661d8ad640 1 --2- 172.21.15.78:0/1427536319 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f6604074a10 0x7f6604076ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:49.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.742+0000 7f661d8ad640 1 --2- 172.21.15.78:0/1427536319 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f6604074a10 0x7f6604076ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f66080096c0 tx=0x7f6608005a20 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:49.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:49.746+0000 7f660f7fe640 1 -- 172.21.15.78:0/1427536319 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f6614061d90 con 0x7f6618101970 2024-09-18T12:49:49.858 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:49 smithi148 ceph-mon[35352]: pgmap v32: 65 pgs: 65 active+clean; 2.5 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 22 MiB/s rd, 52 MiB/s wr, 244 op/s 2024-09-18T12:49:49.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:49 smithi078 ceph-mon[28091]: pgmap v32: 65 pgs: 65 active+clean; 2.5 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 22 MiB/s rd, 52 MiB/s wr, 244 op/s 2024-09-18T12:49:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.052+0000 7f6620312640 1 -- 172.21.15.78:0/1427536319 --> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6618062630 con 0x7f6604074a10 2024-09-18T12:49:50.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.053+0000 7f660f7fe640 1 -- 172.21.15.78:0/1427536319 <== mgr.24355 v2:172.21.15.148:6828/2591325460 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f6618062630 con 0x7f6604074a10 2024-09-18T12:49:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.056+0000 7f6620312640 1 -- 172.21.15.78:0/1427536319 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f6604074a10 msgr2=0x7f6604076ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.056+0000 7f6620312640 1 --2- 172.21.15.78:0/1427536319 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f6604074a10 0x7f6604076ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f66080096c0 tx=0x7f6608005a20 comp rx=0 tx=0).stop 2024-09-18T12:49:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.056+0000 7f6620312640 1 -- 172.21.15.78:0/1427536319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6618101970 msgr2=0x7f66181974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.056+0000 7f6620312640 1 --2- 172.21.15.78:0/1427536319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6618101970 0x7f66181974d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f661400e940 tx=0x7f661400ee00 comp rx=0 tx=0).stop 2024-09-18T12:49:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.056+0000 7f6620312640 1 -- 172.21.15.78:0/1427536319 shutdown_connections 2024-09-18T12:49:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.056+0000 7f6620312640 1 --2- 172.21.15.78:0/1427536319 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f6604074a10 0x7f6604076ed0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.056+0000 7f6620312640 1 --2- 172.21.15.78:0/1427536319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6618102b70 0x7f6618197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.056+0000 7f6620312640 1 --2- 172.21.15.78:0/1427536319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6618101970 0x7f66181974d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.056+0000 7f6620312640 1 -- 172.21.15.78:0/1427536319 >> 172.21.15.78:0/1427536319 conn(0x7f66180fd140 msgr2=0x7f6618106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.056+0000 7f6620312640 1 -- 172.21.15.78:0/1427536319 shutdown_connections 2024-09-18T12:49:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.056+0000 7f6620312640 1 -- 172.21.15.78:0/1427536319 wait complete. 2024-09-18T12:49:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.164+0000 7f0673a78640 1 -- 172.21.15.78:0/2195928270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f066c101a60 msgr2=0x7f066c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.164+0000 7f0673a78640 1 --2- 172.21.15.78:0/2195928270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f066c101a60 0x7f066c101ee0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f065c009880 tx=0x7f065c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.164+0000 7f0673a78640 1 -- 172.21.15.78:0/2195928270 shutdown_connections 2024-09-18T12:49:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.164+0000 7f0673a78640 1 --2- 172.21.15.78:0/2195928270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f066c101a60 0x7f066c101ee0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.164+0000 7f0673a78640 1 --2- 172.21.15.78:0/2195928270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f066c100860 0x7f066c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.164+0000 7f0673a78640 1 -- 172.21.15.78:0/2195928270 >> 172.21.15.78:0/2195928270 conn(0x7f066c0fbff0 msgr2=0x7f066c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:50.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.164+0000 7f0673a78640 1 -- 172.21.15.78:0/2195928270 shutdown_connections 2024-09-18T12:49:50.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.164+0000 7f0673a78640 1 -- 172.21.15.78:0/2195928270 wait complete. 2024-09-18T12:49:50.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.165+0000 7f0673a78640 1 Processor -- start 2024-09-18T12:49:50.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.165+0000 7f0673a78640 1 -- start start 2024-09-18T12:49:50.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.165+0000 7f0673a78640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f066c100860 0x7f066c06afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:50.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.165+0000 7f0673a78640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f066c101a60 0x7f066c19e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:50.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.165+0000 7f0673a78640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f066c109720 con 0x7f066c101a60 2024-09-18T12:49:50.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.165+0000 7f0673a78640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f066c1095a0 con 0x7f066c100860 2024-09-18T12:49:50.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.166+0000 7f0671013640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f066c101a60 0x7f066c19e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:50.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.166+0000 7f0671013640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f066c101a60 0x7f066c19e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48320/0 (socket says 172.21.15.78:48320) 2024-09-18T12:49:50.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.166+0000 7f0671013640 1 -- 172.21.15.78:0/3610552798 learned_addr learned my addr 172.21.15.78:0/3610552798 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:49:50.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.166+0000 7f0671814640 1 --2- 172.21.15.78:0/3610552798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f066c100860 0x7f066c06afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:50.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.166+0000 7f0671013640 1 -- 172.21.15.78:0/3610552798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f066c100860 msgr2=0x7f066c06afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:50.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.166+0000 7f0671013640 1 --2- 172.21.15.78:0/3610552798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f066c100860 0x7f066c06afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.166+0000 7f0671013640 1 -- 172.21.15.78:0/3610552798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066c19ec10 con 0x7f066c101a60 2024-09-18T12:49:50.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.167+0000 7f0671013640 1 --2- 172.21.15.78:0/3610552798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f066c101a60 0x7f066c19e6d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f065c006010 tx=0x7f065c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:50.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.167+0000 7f0662ffd640 1 -- 172.21.15.78:0/3610552798 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f065c03f070 con 0x7f066c101a60 2024-09-18T12:49:50.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.167+0000 7f0662ffd640 1 -- 172.21.15.78:0/3610552798 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f065c0044d0 con 0x7f066c101a60 2024-09-18T12:49:50.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.167+0000 7f0662ffd640 1 -- 172.21.15.78:0/3610552798 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f065c035030 con 0x7f066c101a60 2024-09-18T12:49:50.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.167+0000 7f0673a78640 1 -- 172.21.15.78:0/3610552798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f066c19ede0 con 0x7f066c101a60 2024-09-18T12:49:50.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.167+0000 7f0673a78640 1 -- 172.21.15.78:0/3610552798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f066c19f310 con 0x7f066c101a60 2024-09-18T12:49:50.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.168+0000 7f0673a78640 1 -- 172.21.15.78:0/3610552798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f066c100c40 con 0x7f066c101a60 2024-09-18T12:49:50.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.170+0000 7f0662ffd640 1 -- 172.21.15.78:0/3610552798 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f065c042070 con 0x7f066c101a60 2024-09-18T12:49:50.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.170+0000 7f0662ffd640 1 --2- 172.21.15.78:0/3610552798 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f0658074a80 0x7f0658076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:50.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.170+0000 7f0662ffd640 1 -- 172.21.15.78:0/3610552798 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f065c0b6fb0 con 0x7f066c101a60 2024-09-18T12:49:50.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.171+0000 7f0671814640 1 --2- 172.21.15.78:0/3610552798 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f0658074a80 0x7f0658076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:50.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.171+0000 7f0671814640 1 --2- 172.21.15.78:0/3610552798 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f0658074a80 0x7f0658076f40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f066c1018c0 tx=0x7f0668009110 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:50.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.175+0000 7f0662ffd640 1 -- 172.21.15.78:0/3610552798 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f065c0824d0 con 0x7f066c101a60 2024-09-18T12:49:50.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.478+0000 7f0673a78640 1 -- 172.21.15.78:0/3610552798 --> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f066c062630 con 0x7f0658074a80 2024-09-18T12:49:50.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.496+0000 7f0662ffd640 1 -- 172.21.15.78:0/3610552798 <== mgr.24355 v2:172.21.15.148:6828/2591325460 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f066c062630 con 0x7f0658074a80 2024-09-18T12:49:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:49:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (7m) 36s ago 8m 26.3M - 0.25.0 c8568f914cd2 47a8b8bee5f5 2024-09-18T12:49:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 starting - - - - 2024-09-18T12:49:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (7m) 53s ago 7m 5272k - 19.1.1-330-gc2ddf972 ebb0615149de dad72664a205 2024-09-18T12:49:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (8m) 36s ago 8m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de bb77146b81c7 2024-09-18T12:49:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (7m) 53s ago 7m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de f82fdd264dc6 2024-09-18T12:49:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (6m) 36s ago 8m 78.7M - 9.4.12 2bacad6d85d8 0367cad8b635 2024-09-18T12:49:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (3m) 36s ago 3m 179M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:49:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (3m) 36s ago 3m 22.7M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:49:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (3m) 53s ago 3m 12.4M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:49:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (3m) 53s ago 3m 13.2M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:49:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:9283,8765,8443 running (9m) 36s ago 9m 343M - 19.1.1-330-gc2ddf972 ebb0615149de 284f2d8afd38 2024-09-18T12:49:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (79s) 53s ago 7m 494M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1c064b119458 2024-09-18T12:49:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (9m) 36s ago 10m 52.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1cb11a5bcd72 2024-09-18T12:49:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (7m) 53s ago 7m 39.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 02dfe1551226 2024-09-18T12:49:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (8m) 36s ago 8m 15.6M - 1.5.0 0da6a335fe13 3c6ba926bb86 2024-09-18T12:49:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (7m) 53s ago 7m 16.5M - 1.5.0 0da6a335fe13 4b7db3027dc5 2024-09-18T12:49:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (6m) 36s ago 6m 88.4M 1216M 19.1.1-330-gc2ddf972 ebb0615149de f634ad9ddb36 2024-09-18T12:49:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (6m) 36s ago 6m 98.7M 1216M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:49:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (5m) 36s ago 5m 88.2M 1216M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:49:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (5m) 53s ago 5m 102M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:49:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (4m) 53s ago 4m 95.0M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:49:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (4m) 53s ago 4m 90.5M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:49:50.500 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 starting - - - - 2024-09-18T12:49:50.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.500+0000 7f0673a78640 1 -- 172.21.15.78:0/3610552798 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f0658074a80 msgr2=0x7f0658076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:50.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.500+0000 7f0673a78640 1 --2- 172.21.15.78:0/3610552798 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f0658074a80 0x7f0658076f40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f066c1018c0 tx=0x7f0668009110 comp rx=0 tx=0).stop 2024-09-18T12:49:50.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.500+0000 7f0673a78640 1 -- 172.21.15.78:0/3610552798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f066c101a60 msgr2=0x7f066c19e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:50.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.500+0000 7f0673a78640 1 --2- 172.21.15.78:0/3610552798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f066c101a60 0x7f066c19e6d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f065c006010 tx=0x7f065c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.500+0000 7f0673a78640 1 -- 172.21.15.78:0/3610552798 shutdown_connections 2024-09-18T12:49:50.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.500+0000 7f0673a78640 1 --2- 172.21.15.78:0/3610552798 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f0658074a80 0x7f0658076f40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.500+0000 7f0673a78640 1 --2- 172.21.15.78:0/3610552798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f066c101a60 0x7f066c19e6d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.500+0000 7f0673a78640 1 --2- 172.21.15.78:0/3610552798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f066c100860 0x7f066c06afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.500+0000 7f0673a78640 1 -- 172.21.15.78:0/3610552798 >> 172.21.15.78:0/3610552798 conn(0x7f066c0fbff0 msgr2=0x7f066c104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:50.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.500+0000 7f0673a78640 1 -- 172.21.15.78:0/3610552798 shutdown_connections 2024-09-18T12:49:50.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.500+0000 7f0673a78640 1 -- 172.21.15.78:0/3610552798 wait complete. 2024-09-18T12:49:50.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.593+0000 7f94b5f98640 1 -- 172.21.15.78:0/369576930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0101a60 msgr2=0x7f94b0101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:50.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.593+0000 7f94b5f98640 1 --2- 172.21.15.78:0/369576930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0101a60 0x7f94b0101ee0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009880 tx=0x7f94a402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.593+0000 7f94b5f98640 1 -- 172.21.15.78:0/369576930 shutdown_connections 2024-09-18T12:49:50.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.593+0000 7f94b5f98640 1 --2- 172.21.15.78:0/369576930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0101a60 0x7f94b0101ee0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.593+0000 7f94b5f98640 1 --2- 172.21.15.78:0/369576930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b0100860 0x7f94b0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.594+0000 7f94b5f98640 1 -- 172.21.15.78:0/369576930 >> 172.21.15.78:0/369576930 conn(0x7f94b00fc010 msgr2=0x7f94b00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:50.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.594+0000 7f94b5f98640 1 -- 172.21.15.78:0/369576930 shutdown_connections 2024-09-18T12:49:50.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.594+0000 7f94b5f98640 1 -- 172.21.15.78:0/369576930 wait complete. 2024-09-18T12:49:50.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.594+0000 7f94b5f98640 1 Processor -- start 2024-09-18T12:49:50.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.594+0000 7f94b5f98640 1 -- start start 2024-09-18T12:49:50.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.595+0000 7f94b5f98640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0100860 0x7f94b0104a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:50.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.595+0000 7f94b5f98640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b0101a60 0x7f94b0103140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:50.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.595+0000 7f94b5f98640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f94b0109680 con 0x7f94b0100860 2024-09-18T12:49:50.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.595+0000 7f94b5f98640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f94b0109500 con 0x7f94b0101a60 2024-09-18T12:49:50.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.595+0000 7f94af7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0100860 0x7f94b0104a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:50.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.595+0000 7f94af7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0100860 0x7f94b0104a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48338/0 (socket says 172.21.15.78:48338) 2024-09-18T12:49:50.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.595+0000 7f94af7fe640 1 -- 172.21.15.78:0/3629304779 learned_addr learned my addr 172.21.15.78:0/3629304779 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:49:50.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.595+0000 7f94aeffd640 1 --2- 172.21.15.78:0/3629304779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b0101a60 0x7f94b0103140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:50.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.595+0000 7f94af7fe640 1 -- 172.21.15.78:0/3629304779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b0101a60 msgr2=0x7f94b0103140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:50.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.595+0000 7f94af7fe640 1 --2- 172.21.15.78:0/3629304779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b0101a60 0x7f94b0103140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.595+0000 7f94af7fe640 1 -- 172.21.15.78:0/3629304779 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b0103680 con 0x7f94b0100860 2024-09-18T12:49:50.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.595+0000 7f94af7fe640 1 --2- 172.21.15.78:0/3629304779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0100860 0x7f94b0104a80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f94a000d8d0 tx=0x7f94a000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:50.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.596+0000 7f94acff9640 1 -- 172.21.15.78:0/3629304779 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94a0017020 con 0x7f94b0100860 2024-09-18T12:49:50.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.596+0000 7f94b5f98640 1 -- 172.21.15.78:0/3629304779 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b0103970 con 0x7f94b0100860 2024-09-18T12:49:50.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.596+0000 7f94acff9640 1 -- 172.21.15.78:0/3629304779 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94a0010460 con 0x7f94b0100860 2024-09-18T12:49:50.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.596+0000 7f94acff9640 1 -- 172.21.15.78:0/3629304779 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94a000f5b0 con 0x7f94b0100860 2024-09-18T12:49:50.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.596+0000 7f94b5f98640 1 -- 172.21.15.78:0/3629304779 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b0103ed0 con 0x7f94b0100860 2024-09-18T12:49:50.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.597+0000 7f94b5f98640 1 -- 172.21.15.78:0/3629304779 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b0100c60 con 0x7f94b0100860 2024-09-18T12:49:50.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.598+0000 7f94acff9640 1 -- 172.21.15.78:0/3629304779 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f94a001a020 con 0x7f94b0100860 2024-09-18T12:49:50.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.599+0000 7f94acff9640 1 --2- 172.21.15.78:0/3629304779 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9498074a80 0x7f9498076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:50.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.599+0000 7f94acff9640 1 -- 172.21.15.78:0/3629304779 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f94a00960a0 con 0x7f94b0100860 2024-09-18T12:49:50.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.599+0000 7f94aeffd640 1 --2- 172.21.15.78:0/3629304779 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9498074a80 0x7f9498076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:50.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.600+0000 7f94aeffd640 1 --2- 172.21.15.78:0/3629304779 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9498074a80 0x7f9498076f40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f94a4000c00 tx=0x7f94a40058d0 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:50.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.604+0000 7f94acff9640 1 -- 172.21.15.78:0/3629304779 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f94a0021030 con 0x7f94b0100860 2024-09-18T12:49:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:50 smithi078 ceph-mon[28091]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:50.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:50 smithi148 ceph-mon[35352]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:50.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.975+0000 7f94b5f98640 1 -- 172.21.15.78:0/3629304779 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f94b002db70 con 0x7f94b0100860 2024-09-18T12:49:50.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.976+0000 7f94acff9640 1 -- 172.21.15.78:0/3629304779 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f94b002db70 con 0x7f94b0100860 2024-09-18T12:49:50.978 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:49:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:49:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:49:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:49:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:49:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-18T12:49:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:49:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:49:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:49:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:49:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:49:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:49:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:49:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:49:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:49:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 13, 2024-09-18T12:49:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:49:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:49:50.979 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:49:50.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.979+0000 7f94b5f98640 1 -- 172.21.15.78:0/3629304779 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9498074a80 msgr2=0x7f9498076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:50.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.979+0000 7f94b5f98640 1 --2- 172.21.15.78:0/3629304779 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9498074a80 0x7f9498076f40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f94a4000c00 tx=0x7f94a40058d0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.979+0000 7f94b5f98640 1 -- 172.21.15.78:0/3629304779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0100860 msgr2=0x7f94b0104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:50.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.979+0000 7f94b5f98640 1 --2- 172.21.15.78:0/3629304779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0100860 0x7f94b0104a80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f94a000d8d0 tx=0x7f94a000dd90 comp rx=0 tx=0).stop 2024-09-18T12:49:50.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.980+0000 7f94b5f98640 1 -- 172.21.15.78:0/3629304779 shutdown_connections 2024-09-18T12:49:50.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.980+0000 7f94b5f98640 1 --2- 172.21.15.78:0/3629304779 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9498074a80 0x7f9498076f40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.980+0000 7f94b5f98640 1 --2- 172.21.15.78:0/3629304779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b0101a60 0x7f94b0103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.980+0000 7f94b5f98640 1 --2- 172.21.15.78:0/3629304779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0100860 0x7f94b0104a80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:50.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.980+0000 7f94b5f98640 1 -- 172.21.15.78:0/3629304779 >> 172.21.15.78:0/3629304779 conn(0x7f94b00fc010 msgr2=0x7f94b00fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:50.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.980+0000 7f94b5f98640 1 -- 172.21.15.78:0/3629304779 shutdown_connections 2024-09-18T12:49:50.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:50.980+0000 7f94b5f98640 1 -- 172.21.15.78:0/3629304779 wait complete. 2024-09-18T12:49:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.085+0000 7f9350c1c640 1 -- 172.21.15.78:0/3267666181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934c100860 msgr2=0x7f934c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.085+0000 7f9350c1c640 1 --2- 172.21.15.78:0/3267666181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934c100860 0x7f934c100c60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f933c009880 tx=0x7f933c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.085+0000 7f9350c1c640 1 -- 172.21.15.78:0/3267666181 shutdown_connections 2024-09-18T12:49:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.085+0000 7f9350c1c640 1 --2- 172.21.15.78:0/3267666181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f934c101a60 0x7f934c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.085+0000 7f9350c1c640 1 --2- 172.21.15.78:0/3267666181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934c100860 0x7f934c100c60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.085+0000 7f9350c1c640 1 -- 172.21.15.78:0/3267666181 >> 172.21.15.78:0/3267666181 conn(0x7f934c0fc010 msgr2=0x7f934c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.085+0000 7f9350c1c640 1 -- 172.21.15.78:0/3267666181 shutdown_connections 2024-09-18T12:49:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.085+0000 7f9350c1c640 1 -- 172.21.15.78:0/3267666181 wait complete. 2024-09-18T12:49:51.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.086+0000 7f9350c1c640 1 Processor -- start 2024-09-18T12:49:51.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.086+0000 7f9350c1c640 1 -- start start 2024-09-18T12:49:51.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.086+0000 7f9350c1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934c100860 0x7f934c1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:51.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.086+0000 7f9350c1c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f934c101a60 0x7f934c197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:51.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.086+0000 7f9350c1c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f934c109680 con 0x7f934c100860 2024-09-18T12:49:51.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.086+0000 7f9350c1c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f934c109500 con 0x7f934c101a60 2024-09-18T12:49:51.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.087+0000 7f934a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934c100860 0x7f934c1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:51.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.087+0000 7f9343fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f934c101a60 0x7f934c197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:51.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.087+0000 7f934a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934c100860 0x7f934c1974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48362/0 (socket says 172.21.15.78:48362) 2024-09-18T12:49:51.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.087+0000 7f934a59c640 1 -- 172.21.15.78:0/4218228133 learned_addr learned my addr 172.21.15.78:0/4218228133 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:49:51.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.087+0000 7f9343fff640 1 -- 172.21.15.78:0/4218228133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934c100860 msgr2=0x7f934c1974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:51.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.087+0000 7f9343fff640 1 --2- 172.21.15.78:0/4218228133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934c100860 0x7f934c1974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:51.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.087+0000 7f9343fff640 1 -- 172.21.15.78:0/4218228133 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c198080 con 0x7f934c101a60 2024-09-18T12:49:51.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.087+0000 7f9343fff640 1 --2- 172.21.15.78:0/4218228133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f934c101a60 0x7f934c197a00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f933400e970 tx=0x7f933400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:51.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.087+0000 7f93437fe640 1 -- 172.21.15.78:0/4218228133 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f933400cac0 con 0x7f934c101a60 2024-09-18T12:49:51.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.087+0000 7f93437fe640 1 -- 172.21.15.78:0/4218228133 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f933400cc60 con 0x7f934c101a60 2024-09-18T12:49:51.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.088+0000 7f9350c1c640 1 -- 172.21.15.78:0/4218228133 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934c19cac0 con 0x7f934c101a60 2024-09-18T12:49:51.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.088+0000 7f93437fe640 1 -- 172.21.15.78:0/4218228133 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9334018720 con 0x7f934c101a60 2024-09-18T12:49:51.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.088+0000 7f9350c1c640 1 -- 172.21.15.78:0/4218228133 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934c19cff0 con 0x7f934c101a60 2024-09-18T12:49:51.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.089+0000 7f9350c1c640 1 -- 172.21.15.78:0/4218228133 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f934c100c60 con 0x7f934c101a60 2024-09-18T12:49:51.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.089+0000 7f93437fe640 1 -- 172.21.15.78:0/4218228133 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f93340188c0 con 0x7f934c101a60 2024-09-18T12:49:51.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.090+0000 7f93437fe640 1 --2- 172.21.15.78:0/4218228133 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9338074a80 0x7f9338076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:51.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.090+0000 7f93437fe640 1 -- 172.21.15.78:0/4218228133 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f93340967d0 con 0x7f934c101a60 2024-09-18T12:49:51.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.090+0000 7f934a59c640 1 --2- 172.21.15.78:0/4218228133 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9338074a80 0x7f9338076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:51.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.091+0000 7f934a59c640 1 --2- 172.21.15.78:0/4218228133 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9338074a80 0x7f9338076f40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f933c000c00 tx=0x7f933c005a20 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:51.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.095+0000 7f93437fe640 1 -- 172.21.15.78:0/4218228133 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f9334066c30 con 0x7f934c101a60 2024-09-18T12:49:51.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.373+0000 7f9350c1c640 1 -- 172.21.15.78:0/4218228133 --> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f934c06a3e0 con 0x7f9338074a80 2024-09-18T12:49:51.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.375+0000 7f93437fe640 1 -- 172.21.15.78:0/4218228133 <== mgr.24355 v2:172.21.15.148:6828/2591325460 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f934c06a3e0 con 0x7f9338074a80 2024-09-18T12:49:51.376 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:49:51.376 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:49:51.377 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:49:51.377 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:49:51.377 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [], 2024-09-18T12:49:51.377 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "1/2 daemons upgraded", 2024-09-18T12:49:51.377 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mgr daemons", 2024-09-18T12:49:51.377 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:49:51.377 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:49:51.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.379+0000 7f9350c1c640 1 -- 172.21.15.78:0/4218228133 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9338074a80 msgr2=0x7f9338076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:51.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.379+0000 7f9350c1c640 1 --2- 172.21.15.78:0/4218228133 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9338074a80 0x7f9338076f40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f933c000c00 tx=0x7f933c005a20 comp rx=0 tx=0).stop 2024-09-18T12:49:51.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.379+0000 7f9350c1c640 1 -- 172.21.15.78:0/4218228133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f934c101a60 msgr2=0x7f934c197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:51.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.379+0000 7f9350c1c640 1 --2- 172.21.15.78:0/4218228133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f934c101a60 0x7f934c197a00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f933400e970 tx=0x7f933400ee30 comp rx=0 tx=0).stop 2024-09-18T12:49:51.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.379+0000 7f9350c1c640 1 -- 172.21.15.78:0/4218228133 shutdown_connections 2024-09-18T12:49:51.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.379+0000 7f9350c1c640 1 --2- 172.21.15.78:0/4218228133 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f9338074a80 0x7f9338076f40 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f933c000c00 tx=0x7f933c005a20 comp rx=0 tx=0).stop 2024-09-18T12:49:51.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.379+0000 7f9350c1c640 1 --2- 172.21.15.78:0/4218228133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f934c101a60 0x7f934c197a00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:51.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.379+0000 7f9350c1c640 1 --2- 172.21.15.78:0/4218228133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934c100860 0x7f934c1974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:51.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.379+0000 7f9350c1c640 1 -- 172.21.15.78:0/4218228133 >> 172.21.15.78:0/4218228133 conn(0x7f934c0fc010 msgr2=0x7f934c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:51.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.380+0000 7f9350c1c640 1 -- 172.21.15.78:0/4218228133 shutdown_connections 2024-09-18T12:49:51.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:49:51.380+0000 7f9350c1c640 1 -- 172.21.15.78:0/4218228133 wait complete. 2024-09-18T12:49:51.884 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:51 smithi148 ceph-mon[35352]: from='client.24423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:51.884 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:51 smithi148 ceph-mon[35352]: pgmap v33: 65 pgs: 65 active+clean; 2.5 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 20 MiB/s rd, 43 MiB/s wr, 199 op/s 2024-09-18T12:49:51.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:51 smithi148 ceph-mon[35352]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:51.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:51 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:51.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:51 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:51.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:49:51.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:51 smithi148 ceph-mon[35352]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:49:51.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:51 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:51.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:51 smithi148 ceph-mon[35352]: Upgrade: Need to upgrade myself (mgr.smithi148.bfgshs) 2024-09-18T12:49:51.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:51 smithi148 ceph-mon[35352]: Upgrade: Need to upgrade myself (mgr.smithi148.bfgshs) 2024-09-18T12:49:51.885 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:51 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/3629304779' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:49:51.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:51 smithi078 ceph-mon[28091]: from='client.24423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:51.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:51 smithi078 ceph-mon[28091]: pgmap v33: 65 pgs: 65 active+clean; 2.5 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 20 MiB/s rd, 43 MiB/s wr, 199 op/s 2024-09-18T12:49:51.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:51 smithi078 ceph-mon[28091]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:51.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:51 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:51.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:51 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:51.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:49:51.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:51 smithi078 ceph-mon[28091]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:49:51.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:51 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:51.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:51 smithi078 ceph-mon[28091]: Upgrade: Need to upgrade myself (mgr.smithi148.bfgshs) 2024-09-18T12:49:51.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:51 smithi078 ceph-mon[28091]: Upgrade: Need to upgrade myself (mgr.smithi148.bfgshs) 2024-09-18T12:49:51.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:51 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3629304779' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:49:52.912 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:52 smithi078 ceph-mon[28091]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:52.912 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:52 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:52.912 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:52 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi078.ohifux", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:49:52.912 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:52 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi078.ohifux", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:49:52.912 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:52 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:49:52.913 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:52 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:52 smithi148 ceph-mon[35352]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:52 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:52 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi078.ohifux", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:49:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:52 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi078.ohifux", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:49:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:52 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:49:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:52 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:53.825 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:53 smithi078 ceph-mon[28091]: pgmap v34: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 20 MiB/s rd, 44 MiB/s wr, 272 op/s 2024-09-18T12:49:53.825 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:53 smithi078 ceph-mon[28091]: Upgrade: Updating mgr.smithi078.ohifux 2024-09-18T12:49:53.825 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:53 smithi078 ceph-mon[28091]: Deploying daemon mgr.smithi078.ohifux on smithi078 2024-09-18T12:49:53.825 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:53 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:53.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:53 smithi148 ceph-mon[35352]: pgmap v34: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 20 MiB/s rd, 44 MiB/s wr, 272 op/s 2024-09-18T12:49:53.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:53 smithi148 ceph-mon[35352]: Upgrade: Updating mgr.smithi078.ohifux 2024-09-18T12:49:53.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:53 smithi148 ceph-mon[35352]: Deploying daemon mgr.smithi078.ohifux on smithi078 2024-09-18T12:49:53.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:53 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:55.732 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:55 smithi078 ceph-mon[28091]: pgmap v35: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 533 KiB/s rd, 4.0 MiB/s wr, 145 op/s 2024-09-18T12:49:55.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:55 smithi148 ceph-mon[35352]: pgmap v35: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 533 KiB/s rd, 4.0 MiB/s wr, 145 op/s 2024-09-18T12:49:56.690 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-18T12:49:56.691 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-18T12:49:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:57 smithi148 ceph-mon[35352]: pgmap v36: 65 pgs: 65 active+clean; 728 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 545 KiB/s rd, 4.4 MiB/s wr, 187 op/s 2024-09-18T12:49:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:57 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:57 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:57 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:57.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:57 smithi078 ceph-mon[28091]: pgmap v36: 65 pgs: 65 active+clean; 728 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 545 KiB/s rd, 4.4 MiB/s wr, 187 op/s 2024-09-18T12:49:57.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:57 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:57.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:57 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:57.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:57 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:59 smithi148 ceph-mon[35352]: pgmap v37: 65 pgs: 65 active+clean; 597 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 367 KiB/s rd, 2.0 MiB/s wr, 163 op/s 2024-09-18T12:49:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:59 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:49:59 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:59.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:59 smithi078 ceph-mon[28091]: pgmap v37: 65 pgs: 65 active+clean; 597 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 367 KiB/s rd, 2.0 MiB/s wr, 163 op/s 2024-09-18T12:49:59.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:59 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:49:59.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:49:59 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:50:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:00 smithi148 ceph-mon[35352]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:50:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:00 smithi148 ceph-mon[35352]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:50:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:00 smithi148 ceph-mon[35352]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:50:00.736 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:00 smithi078 ceph-mon[28091]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:50:00.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:00 smithi078 ceph-mon[28091]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:50:00.737 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:00 smithi078 ceph-mon[28091]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:50:01.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:01 smithi078 ceph-mon[28091]: pgmap v38: 65 pgs: 65 active+clean; 597 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 131 op/s 2024-09-18T12:50:01.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:01 smithi148 ceph-mon[35352]: pgmap v38: 65 pgs: 65 active+clean; 597 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 131 op/s 2024-09-18T12:50:03.444 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:03 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:50:03.444 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:03 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:50:03.444 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:03 smithi078 ceph-mon[28091]: pgmap v39: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 177 op/s 2024-09-18T12:50:03.444 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:03 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:50:03.444 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:03 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:50:03.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:03 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:50:03.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:03 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:50:03.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:03 smithi148 ceph-mon[35352]: pgmap v39: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 177 op/s 2024-09-18T12:50:03.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:03 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:50:03.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:03 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:50:04.460 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:04 smithi078 ceph-mon[28091]: Standby manager daemon smithi078.ohifux restarted 2024-09-18T12:50:04.460 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:04 smithi078 ceph-mon[28091]: Standby manager daemon smithi078.ohifux started 2024-09-18T12:50:04.460 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:04 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi078.ohifux/crt"}]: dispatch 2024-09-18T12:50:04.460 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:04 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:50:04.460 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:04 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi078.ohifux/key"}]: dispatch 2024-09-18T12:50:04.460 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:04 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:50:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:04 smithi148 ceph-mon[35352]: Standby manager daemon smithi078.ohifux restarted 2024-09-18T12:50:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:04 smithi148 ceph-mon[35352]: Standby manager daemon smithi078.ohifux started 2024-09-18T12:50:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:04 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi078.ohifux/crt"}]: dispatch 2024-09-18T12:50:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:04 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:50:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:04 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi078.ohifux/key"}]: dispatch 2024-09-18T12:50:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:04 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:50:05.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:05 smithi148 ceph-mon[35352]: mgrmap e26: smithi148.bfgshs(active, since 73s), standbys: smithi078.ohifux 2024-09-18T12:50:05.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:05 smithi148 ceph-mon[35352]: pgmap v40: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 104 op/s 2024-09-18T12:50:05.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:05 smithi078 ceph-mon[28091]: mgrmap e26: smithi148.bfgshs(active, since 73s), standbys: smithi078.ohifux 2024-09-18T12:50:05.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:05 smithi078 ceph-mon[28091]: pgmap v40: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 104 op/s 2024-09-18T12:50:07.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:07 smithi148 ceph-mon[35352]: pgmap v41: 65 pgs: 65 active+clean; 292 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.2 MiB/s wr, 138 op/s 2024-09-18T12:50:07.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:07 smithi078 ceph-mon[28091]: pgmap v41: 65 pgs: 65 active+clean; 292 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.2 MiB/s wr, 138 op/s 2024-09-18T12:50:08.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:08 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:08.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:08 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:09.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:09 smithi148 ceph-mon[35352]: pgmap v42: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.8 MiB/s wr, 100 op/s 2024-09-18T12:50:09.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:09 smithi078 ceph-mon[28091]: pgmap v42: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.8 MiB/s wr, 100 op/s 2024-09-18T12:50:11.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:11 smithi078 ceph-mon[28091]: pgmap v43: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 84 op/s 2024-09-18T12:50:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:11 smithi148 ceph-mon[35352]: pgmap v43: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 84 op/s 2024-09-18T12:50:13.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:13 smithi148 ceph-mon[35352]: pgmap v44: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.2 MiB/s wr, 117 op/s 2024-09-18T12:50:13.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:13 smithi078 ceph-mon[28091]: pgmap v44: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.2 MiB/s wr, 117 op/s 2024-09-18T12:50:15.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:15 smithi148 ceph-mon[35352]: pgmap v45: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 70 op/s 2024-09-18T12:50:15.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:15 smithi078 ceph-mon[28091]: pgmap v45: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 70 op/s 2024-09-18T12:50:17.651 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:17 smithi078 ceph-mon[28091]: pgmap v46: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.1 MiB/s wr, 105 op/s 2024-09-18T12:50:17.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:17 smithi148 ceph-mon[35352]: pgmap v46: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.1 MiB/s wr, 105 op/s 2024-09-18T12:50:19.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:19 smithi148 ceph-mon[35352]: pgmap v47: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 81 op/s 2024-09-18T12:50:19.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:19 smithi078 ceph-mon[28091]: pgmap v47: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 81 op/s 2024-09-18T12:50:21.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.490+0000 7f08b9682640 1 -- 172.21.15.78:0/3043580288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08b4101a60 msgr2=0x7f08b4101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:21.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.490+0000 7f08b9682640 1 --2- 172.21.15.78:0/3043580288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08b4101a60 0x7f08b4101ee0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f08a800b9f0 tx=0x7f08a802c1e0 comp rx=0 tx=0).stop 2024-09-18T12:50:21.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.491+0000 7f08b9682640 1 -- 172.21.15.78:0/3043580288 shutdown_connections 2024-09-18T12:50:21.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.491+0000 7f08b9682640 1 --2- 172.21.15.78:0/3043580288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08b4101a60 0x7f08b4101ee0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:21.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.491+0000 7f08b9682640 1 --2- 172.21.15.78:0/3043580288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08b4100860 0x7f08b4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.491+0000 7f08b9682640 1 -- 172.21.15.78:0/3043580288 >> 172.21.15.78:0/3043580288 conn(0x7f08b40fc010 msgr2=0x7f08b40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.491+0000 7f08b9682640 1 -- 172.21.15.78:0/3043580288 shutdown_connections 2024-09-18T12:50:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.491+0000 7f08b9682640 1 -- 172.21.15.78:0/3043580288 wait complete. 2024-09-18T12:50:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.491+0000 7f08b9682640 1 Processor -- start 2024-09-18T12:50:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.492+0000 7f08b9682640 1 -- start start 2024-09-18T12:50:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.492+0000 7f08b9682640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08b4100860 0x7f08b4073280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.492+0000 7f08b9682640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08b4101a60 0x7f08b40737c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.492+0000 7f08b9682640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f08b4108570 con 0x7f08b4100860 2024-09-18T12:50:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.492+0000 7f08b9682640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f08b41083f0 con 0x7f08b4101a60 2024-09-18T12:50:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.492+0000 7f08b2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08b4100860 0x7f08b4073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.492+0000 7f08b2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08b4100860 0x7f08b4073280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39216/0 (socket says 172.21.15.78:39216) 2024-09-18T12:50:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.492+0000 7f08b2ffd640 1 -- 172.21.15.78:0/4024118197 learned_addr learned my addr 172.21.15.78:0/4024118197 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:50:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.492+0000 7f08b27fc640 1 --2- 172.21.15.78:0/4024118197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08b4101a60 0x7f08b40737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:21.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.492+0000 7f08b2ffd640 1 -- 172.21.15.78:0/4024118197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08b4101a60 msgr2=0x7f08b40737c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:21.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.492+0000 7f08b2ffd640 1 --2- 172.21.15.78:0/4024118197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08b4101a60 0x7f08b40737c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:21.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.492+0000 7f08b2ffd640 1 -- 172.21.15.78:0/4024118197 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b4073e40 con 0x7f08b4100860 2024-09-18T12:50:21.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.492+0000 7f08b2ffd640 1 --2- 172.21.15.78:0/4024118197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08b4100860 0x7f08b4073280 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f08a400e920 tx=0x7f08a400ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:21.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.493+0000 7f089bfff640 1 -- 172.21.15.78:0/4024118197 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08a400cb80 con 0x7f08b4100860 2024-09-18T12:50:21.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.493+0000 7f08b9682640 1 -- 172.21.15.78:0/4024118197 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b41a3090 con 0x7f08b4100860 2024-09-18T12:50:21.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.493+0000 7f08b9682640 1 -- 172.21.15.78:0/4024118197 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b41a3670 con 0x7f08b4100860 2024-09-18T12:50:21.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.493+0000 7f089bfff640 1 -- 172.21.15.78:0/4024118197 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08a400cd20 con 0x7f08b4100860 2024-09-18T12:50:21.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.493+0000 7f089bfff640 1 -- 172.21.15.78:0/4024118197 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08a4018750 con 0x7f08b4100860 2024-09-18T12:50:21.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.494+0000 7f08b9682640 1 -- 172.21.15.78:0/4024118197 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a00052c0 con 0x7f08b4100860 2024-09-18T12:50:21.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.495+0000 7f089bfff640 1 -- 172.21.15.78:0/4024118197 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 26) ==== 103424+0+0 (secure 0 0 0) 0x7f08a4009400 con 0x7f08b4100860 2024-09-18T12:50:21.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.496+0000 7f089bfff640 1 --2- 172.21.15.78:0/4024118197 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f089c07b0b0 0x7f089c07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:21.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.496+0000 7f089bfff640 1 -- 172.21.15.78:0/4024118197 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f08a409e750 con 0x7f08b4100860 2024-09-18T12:50:21.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.496+0000 7f08b27fc640 1 --2- 172.21.15.78:0/4024118197 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f089c07b0b0 0x7f089c07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:21.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.497+0000 7f08b27fc640 1 --2- 172.21.15.78:0/4024118197 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f089c07b0b0 0x7f089c07d570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f08a8000c00 tx=0x7f08a802e040 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:21.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.502+0000 7f089bfff640 1 -- 172.21.15.78:0/4024118197 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f08a4069d00 con 0x7f08b4100860 2024-09-18T12:50:21.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:21 smithi148 ceph-mon[35352]: pgmap v48: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 78 op/s 2024-09-18T12:50:21.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:21 smithi078 ceph-mon[28091]: pgmap v48: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 78 op/s 2024-09-18T12:50:21.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.763+0000 7f08b9682640 1 -- 172.21.15.78:0/4024118197 --> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f08a0000bf0 con 0x7f089c07b0b0 2024-09-18T12:50:21.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.765+0000 7f089bfff640 1 -- 172.21.15.78:0/4024118197 <== mgr.24355 v2:172.21.15.148:6828/2591325460 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f08a0000bf0 con 0x7f089c07b0b0 2024-09-18T12:50:21.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.768+0000 7f08b9682640 1 -- 172.21.15.78:0/4024118197 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f089c07b0b0 msgr2=0x7f089c07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:21.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.768+0000 7f08b9682640 1 --2- 172.21.15.78:0/4024118197 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f089c07b0b0 0x7f089c07d570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f08a8000c00 tx=0x7f08a802e040 comp rx=0 tx=0).stop 2024-09-18T12:50:21.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.768+0000 7f08b9682640 1 -- 172.21.15.78:0/4024118197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08b4100860 msgr2=0x7f08b4073280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:21.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.768+0000 7f08b9682640 1 --2- 172.21.15.78:0/4024118197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08b4100860 0x7f08b4073280 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f08a400e920 tx=0x7f08a400ede0 comp rx=0 tx=0).stop 2024-09-18T12:50:21.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.768+0000 7f08b9682640 1 -- 172.21.15.78:0/4024118197 shutdown_connections 2024-09-18T12:50:21.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.768+0000 7f08b9682640 1 --2- 172.21.15.78:0/4024118197 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f089c07b0b0 0x7f089c07d570 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:21.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.768+0000 7f08b9682640 1 --2- 172.21.15.78:0/4024118197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08b4101a60 0x7f08b40737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:21.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.768+0000 7f08b9682640 1 --2- 172.21.15.78:0/4024118197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08b4100860 0x7f08b4073280 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:21.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.768+0000 7f08b9682640 1 -- 172.21.15.78:0/4024118197 >> 172.21.15.78:0/4024118197 conn(0x7f08b40fc010 msgr2=0x7f08b4104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:21.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.768+0000 7f08b9682640 1 -- 172.21.15.78:0/4024118197 shutdown_connections 2024-09-18T12:50:21.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.768+0000 7f08b9682640 1 -- 172.21.15.78:0/4024118197 wait complete. 2024-09-18T12:50:21.780 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:50:21.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.893+0000 7feef3ad6640 1 -- 172.21.15.78:0/2366964815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeec1001e0 msgr2=0x7feeec1025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:21.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.893+0000 7feef3ad6640 1 --2- 172.21.15.78:0/2366964815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeec1001e0 0x7feeec1025f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feee4009c20 tx=0x7feee402a980 comp rx=0 tx=0).stop 2024-09-18T12:50:21.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.893+0000 7feef3ad6640 1 -- 172.21.15.78:0/2366964815 shutdown_connections 2024-09-18T12:50:21.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.893+0000 7feef3ad6640 1 --2- 172.21.15.78:0/2366964815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeec102b30 0x7feeec104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:21.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.893+0000 7feef3ad6640 1 --2- 172.21.15.78:0/2366964815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeec1001e0 0x7feeec1025f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:21.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.894+0000 7feef3ad6640 1 -- 172.21.15.78:0/2366964815 >> 172.21.15.78:0/2366964815 conn(0x7feeec0fc010 msgr2=0x7feeec0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:21.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.894+0000 7feef3ad6640 1 -- 172.21.15.78:0/2366964815 shutdown_connections 2024-09-18T12:50:21.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.894+0000 7feef3ad6640 1 -- 172.21.15.78:0/2366964815 wait complete. 2024-09-18T12:50:21.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.894+0000 7feef3ad6640 1 Processor -- start 2024-09-18T12:50:21.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.895+0000 7feef3ad6640 1 -- start start 2024-09-18T12:50:21.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.895+0000 7feef3ad6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeec1001e0 0x7feeec19dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:21.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.895+0000 7feef3ad6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeec102b30 0x7feeec19e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:21.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.895+0000 7feef3ad6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feeec110df0 con 0x7feeec102b30 2024-09-18T12:50:21.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.895+0000 7feef3ad6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feeec110c70 con 0x7feeec1001e0 2024-09-18T12:50:21.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.896+0000 7feef1872640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeec1001e0 0x7feeec19dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:21.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.896+0000 7feef1872640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeec1001e0 0x7feeec19dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.78:33924/0 (socket says 172.21.15.78:33924) 2024-09-18T12:50:21.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.896+0000 7feef1872640 1 -- 172.21.15.78:0/1712352736 learned_addr learned my addr 172.21.15.78:0/1712352736 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:50:21.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.896+0000 7feef1071640 1 --2- 172.21.15.78:0/1712352736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeec102b30 0x7feeec19e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:21.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.897+0000 7feef1872640 1 -- 172.21.15.78:0/1712352736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeec102b30 msgr2=0x7feeec19e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:21.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.897+0000 7feef1872640 1 --2- 172.21.15.78:0/1712352736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeec102b30 0x7feeec19e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:21.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.897+0000 7feef1872640 1 -- 172.21.15.78:0/1712352736 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeec19e840 con 0x7feeec1001e0 2024-09-18T12:50:21.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.897+0000 7feef1872640 1 --2- 172.21.15.78:0/1712352736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeec1001e0 0x7feeec19dc80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feee402fd90 tx=0x7feee402fdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:21.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.897+0000 7feee2ffd640 1 -- 172.21.15.78:0/1712352736 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feee4034040 con 0x7feeec1001e0 2024-09-18T12:50:21.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.897+0000 7feef3ad6640 1 -- 172.21.15.78:0/1712352736 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeec1a3240 con 0x7feeec1001e0 2024-09-18T12:50:21.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.897+0000 7feee2ffd640 1 -- 172.21.15.78:0/1712352736 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feee4003b80 con 0x7feeec1001e0 2024-09-18T12:50:21.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.898+0000 7feef3ad6640 1 -- 172.21.15.78:0/1712352736 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeec1a3720 con 0x7feeec1001e0 2024-09-18T12:50:21.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.898+0000 7feee2ffd640 1 -- 172.21.15.78:0/1712352736 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feee4045480 con 0x7feeec1001e0 2024-09-18T12:50:21.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.899+0000 7feef3ad6640 1 -- 172.21.15.78:0/1712352736 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeec100660 con 0x7feeec1001e0 2024-09-18T12:50:21.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.900+0000 7feee2ffd640 1 -- 172.21.15.78:0/1712352736 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 26) ==== 103424+0+0 (secure 0 0 0) 0x7feee4037020 con 0x7feeec1001e0 2024-09-18T12:50:21.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.901+0000 7feee2ffd640 1 --2- 172.21.15.78:0/1712352736 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7feed807b140 0x7feed807d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:21.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.901+0000 7feee2ffd640 1 -- 172.21.15.78:0/1712352736 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7feee40bf510 con 0x7feeec1001e0 2024-09-18T12:50:21.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.901+0000 7feef1071640 1 --2- 172.21.15.78:0/1712352736 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7feed807b140 0x7feed807d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:21.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.902+0000 7feef1071640 1 --2- 172.21.15.78:0/1712352736 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7feed807b140 0x7feed807d600 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7feee8009990 tx=0x7feee8009110 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:21.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:21.908+0000 7feee2ffd640 1 -- 172.21.15.78:0/1712352736 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7feee408aae0 con 0x7feeec1001e0 2024-09-18T12:50:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.231+0000 7feef3ad6640 1 -- 172.21.15.78:0/1712352736 --> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7feeec103630 con 0x7feed807b140 2024-09-18T12:50:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.233+0000 7feee2ffd640 1 -- 172.21.15.78:0/1712352736 <== mgr.24355 v2:172.21.15.148:6828/2591325460 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7feeec103630 con 0x7feed807b140 2024-09-18T12:50:22.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.235+0000 7feef3ad6640 1 -- 172.21.15.78:0/1712352736 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7feed807b140 msgr2=0x7feed807d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:22.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.235+0000 7feef3ad6640 1 --2- 172.21.15.78:0/1712352736 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7feed807b140 0x7feed807d600 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7feee8009990 tx=0x7feee8009110 comp rx=0 tx=0).stop 2024-09-18T12:50:22.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.235+0000 7feef3ad6640 1 -- 172.21.15.78:0/1712352736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeec1001e0 msgr2=0x7feeec19dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:22.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.235+0000 7feef3ad6640 1 --2- 172.21.15.78:0/1712352736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeec1001e0 0x7feeec19dc80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feee402fd90 tx=0x7feee402fdc0 comp rx=0 tx=0).stop 2024-09-18T12:50:22.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.235+0000 7feef3ad6640 1 -- 172.21.15.78:0/1712352736 shutdown_connections 2024-09-18T12:50:22.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.235+0000 7feef3ad6640 1 --2- 172.21.15.78:0/1712352736 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7feed807b140 0x7feed807d600 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.235+0000 7feef3ad6640 1 --2- 172.21.15.78:0/1712352736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeec102b30 0x7feeec19e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.235+0000 7feef3ad6640 1 --2- 172.21.15.78:0/1712352736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeec1001e0 0x7feeec19dc80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.235+0000 7feef3ad6640 1 -- 172.21.15.78:0/1712352736 >> 172.21.15.78:0/1712352736 conn(0x7feeec0fc010 msgr2=0x7feeec0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.235+0000 7feef3ad6640 1 -- 172.21.15.78:0/1712352736 shutdown_connections 2024-09-18T12:50:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.235+0000 7feef3ad6640 1 -- 172.21.15.78:0/1712352736 wait complete. 2024-09-18T12:50:22.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.339+0000 7f1cc3021640 1 -- 172.21.15.78:0/541565399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc101a90 msgr2=0x7f1cbc101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:22.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.339+0000 7f1cc3021640 1 --2- 172.21.15.78:0/541565399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc101a90 0x7f1cbc101f10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009880 tx=0x7f1ca802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:50:22.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.339+0000 7f1cc3021640 1 -- 172.21.15.78:0/541565399 shutdown_connections 2024-09-18T12:50:22.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.339+0000 7f1cc3021640 1 --2- 172.21.15.78:0/541565399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc101a90 0x7f1cbc101f10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:22.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.339+0000 7f1cc3021640 1 --2- 172.21.15.78:0/541565399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cbc100d70 0x7f1cbc101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:22.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.339+0000 7f1cc3021640 1 -- 172.21.15.78:0/541565399 >> 172.21.15.78:0/541565399 conn(0x7f1cbc0fb760 msgr2=0x7f1cbc0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:22.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.339+0000 7f1cc3021640 1 -- 172.21.15.78:0/541565399 shutdown_connections 2024-09-18T12:50:22.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.339+0000 7f1cc3021640 1 -- 172.21.15.78:0/541565399 wait complete. 2024-09-18T12:50:22.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.339+0000 7f1cc3021640 1 Processor -- start 2024-09-18T12:50:22.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.340+0000 7f1cc3021640 1 -- start start 2024-09-18T12:50:22.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.340+0000 7f1cc3021640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc100d70 0x7f1cbc1003c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:22.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.340+0000 7f1cc3021640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cbc101a90 0x7f1cbc19c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:22.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.340+0000 7f1cc3021640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc1096a0 con 0x7f1cbc100d70 2024-09-18T12:50:22.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.340+0000 7f1cc3021640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc109520 con 0x7f1cbc101a90 2024-09-18T12:50:22.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.340+0000 7f1cbbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cbc101a90 0x7f1cbc19c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:22.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.340+0000 7f1cc0dbd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc100d70 0x7f1cbc1003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:22.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.340+0000 7f1cbbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cbc101a90 0x7f1cbc19c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.78:33948/0 (socket says 172.21.15.78:33948) 2024-09-18T12:50:22.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.340+0000 7f1cbbfff640 1 -- 172.21.15.78:0/97649097 learned_addr learned my addr 172.21.15.78:0/97649097 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:50:22.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.340+0000 7f1cc0dbd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc100d70 0x7f1cbc1003c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39246/0 (socket says 172.21.15.78:39246) 2024-09-18T12:50:22.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.340+0000 7f1cc0dbd640 1 -- 172.21.15.78:0/97649097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cbc101a90 msgr2=0x7f1cbc19c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:22.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.340+0000 7f1cc0dbd640 1 --2- 172.21.15.78:0/97649097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cbc101a90 0x7f1cbc19c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:22.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.340+0000 7f1cc0dbd640 1 -- 172.21.15.78:0/97649097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cbc19c7c0 con 0x7f1cbc100d70 2024-09-18T12:50:22.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.341+0000 7f1cc0dbd640 1 --2- 172.21.15.78:0/97649097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc100d70 0x7f1cbc1003c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000e940 tx=0x7f1cb000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:22.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.341+0000 7f1cb9ffb640 1 -- 172.21.15.78:0/97649097 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cb000cac0 con 0x7f1cbc100d70 2024-09-18T12:50:22.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.341+0000 7f1cc3021640 1 -- 172.21.15.78:0/97649097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cbc19cab0 con 0x7f1cbc100d70 2024-09-18T12:50:22.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.341+0000 7f1cb9ffb640 1 -- 172.21.15.78:0/97649097 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1cb000cc60 con 0x7f1cbc100d70 2024-09-18T12:50:22.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.341+0000 7f1cb9ffb640 1 -- 172.21.15.78:0/97649097 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cb0003e20 con 0x7f1cbc100d70 2024-09-18T12:50:22.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.341+0000 7f1cc3021640 1 -- 172.21.15.78:0/97649097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cbc19d040 con 0x7f1cbc100d70 2024-09-18T12:50:22.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.342+0000 7f1cc3021640 1 -- 172.21.15.78:0/97649097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cbc101170 con 0x7f1cbc100d70 2024-09-18T12:50:22.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.343+0000 7f1cb9ffb640 1 -- 172.21.15.78:0/97649097 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 26) ==== 103424+0+0 (secure 0 0 0) 0x7f1cb0004000 con 0x7f1cbc100d70 2024-09-18T12:50:22.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.343+0000 7f1cb9ffb640 1 --2- 172.21.15.78:0/97649097 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f1cac07b040 0x7f1cac07d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:22.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.344+0000 7f1cb9ffb640 1 -- 172.21.15.78:0/97649097 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f1cb009e6c0 con 0x7f1cbc100d70 2024-09-18T12:50:22.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.344+0000 7f1cbbfff640 1 --2- 172.21.15.78:0/97649097 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f1cac07b040 0x7f1cac07d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:22.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.344+0000 7f1cbbfff640 1 --2- 172.21.15.78:0/97649097 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f1cac07b040 0x7f1cac07d500 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005ab0 tx=0x7f1ca8005a20 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:22.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.348+0000 7f1cb9ffb640 1 -- 172.21.15.78:0/97649097 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f1cb0069b60 con 0x7f1cbc100d70 2024-09-18T12:50:22.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:22 smithi078 ceph-mon[28091]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:22.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.654+0000 7f1cc3021640 1 -- 172.21.15.78:0/97649097 --> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1cbc106030 con 0x7f1cac07b040 2024-09-18T12:50:22.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.664+0000 7f1cb9ffb640 1 -- 172.21.15.78:0/97649097 <== mgr.24355 v2:172.21.15.148:6828/2591325460 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f1cbc106030 con 0x7f1cac07b040 2024-09-18T12:50:22.665 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:50:22.665 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (7m) 20s ago 9m 26.3M - 0.25.0 c8568f914cd2 47a8b8bee5f5 2024-09-18T12:50:22.665 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (45s) 20s ago 9m 8451k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:50:22.665 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (32s) 23s ago 8m 7596k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:50:22.665 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (9m) 20s ago 9m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de bb77146b81c7 2024-09-18T12:50:22.665 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (8m) 23s ago 8m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de f82fdd264dc6 2024-09-18T12:50:22.666 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (7m) 20s ago 8m 77.9M - 9.4.12 2bacad6d85d8 0367cad8b635 2024-09-18T12:50:22.666 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (3m) 20s ago 3m 248M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:50:22.666 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (3m) 20s ago 3m 25.3M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:50:22.666 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (3m) 23s ago 3m 13.7M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:50:22.666 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (3m) 23s ago 3m 14.5M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:50:22.666 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (26s) 20s ago 10m 62.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:50:22.666 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (111s) 23s ago 8m 510M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1c064b119458 2024-09-18T12:50:22.666 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (10m) 20s ago 10m 54.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1cb11a5bcd72 2024-09-18T12:50:22.666 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (8m) 23s ago 8m 42.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 02dfe1551226 2024-09-18T12:50:22.666 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (9m) 20s ago 9m 15.7M - 1.5.0 0da6a335fe13 3c6ba926bb86 2024-09-18T12:50:22.666 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (8m) 23s ago 8m 16.4M - 1.5.0 0da6a335fe13 4b7db3027dc5 2024-09-18T12:50:22.666 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (7m) 20s ago 7m 175M 1216M 19.1.1-330-gc2ddf972 ebb0615149de f634ad9ddb36 2024-09-18T12:50:22.666 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (6m) 20s ago 6m 183M 1216M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:50:22.667 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (6m) 20s ago 6m 149M 1216M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:50:22.667 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (5m) 23s ago 5m 204M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:50:22.667 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (5m) 23s ago 5m 174M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:50:22.667 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (4m) 23s ago 4m 161M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:50:22.667 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (36s) 20s ago 8m 41.5M - 2.43.0 a07b618ecd1d d913428c200a 2024-09-18T12:50:22.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.666+0000 7f1cc3021640 1 -- 172.21.15.78:0/97649097 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f1cac07b040 msgr2=0x7f1cac07d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:22.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.666+0000 7f1cc3021640 1 --2- 172.21.15.78:0/97649097 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f1cac07b040 0x7f1cac07d500 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005ab0 tx=0x7f1ca8005a20 comp rx=0 tx=0).stop 2024-09-18T12:50:22.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.666+0000 7f1cc3021640 1 -- 172.21.15.78:0/97649097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc100d70 msgr2=0x7f1cbc1003c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:22.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.666+0000 7f1cc3021640 1 --2- 172.21.15.78:0/97649097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc100d70 0x7f1cbc1003c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000e940 tx=0x7f1cb000ee00 comp rx=0 tx=0).stop 2024-09-18T12:50:22.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.666+0000 7f1cc3021640 1 -- 172.21.15.78:0/97649097 shutdown_connections 2024-09-18T12:50:22.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.666+0000 7f1cc3021640 1 --2- 172.21.15.78:0/97649097 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f1cac07b040 0x7f1cac07d500 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:22.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.666+0000 7f1cc3021640 1 --2- 172.21.15.78:0/97649097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cbc101a90 0x7f1cbc19c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:22.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.666+0000 7f1cc3021640 1 --2- 172.21.15.78:0/97649097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc100d70 0x7f1cbc1003c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:22.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.666+0000 7f1cc3021640 1 -- 172.21.15.78:0/97649097 >> 172.21.15.78:0/97649097 conn(0x7f1cbc0fb760 msgr2=0x7f1cbc0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:22.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.667+0000 7f1cc3021640 1 -- 172.21.15.78:0/97649097 shutdown_connections 2024-09-18T12:50:22.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.667+0000 7f1cc3021640 1 -- 172.21.15.78:0/97649097 wait complete. 2024-09-18T12:50:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:22 smithi148 ceph-mon[35352]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:22.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.771+0000 7f0f9d913640 1 -- 172.21.15.78:0/710838990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f98100240 msgr2=0x7f0f98100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:22.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.771+0000 7f0f9d913640 1 --2- 172.21.15.78:0/710838990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f98100240 0x7f0f98100640 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009880 tx=0x7f0f8802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:50:22.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.771+0000 7f0f9d913640 1 -- 172.21.15.78:0/710838990 shutdown_connections 2024-09-18T12:50:22.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.771+0000 7f0f9d913640 1 --2- 172.21.15.78:0/710838990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f98100b80 0x7f0f98100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:22.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.771+0000 7f0f9d913640 1 --2- 172.21.15.78:0/710838990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f98100240 0x7f0f98100640 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:22.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.771+0000 7f0f9d913640 1 -- 172.21.15.78:0/710838990 >> 172.21.15.78:0/710838990 conn(0x7f0f980fc010 msgr2=0x7f0f980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:22.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.771+0000 7f0f9d913640 1 -- 172.21.15.78:0/710838990 shutdown_connections 2024-09-18T12:50:22.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.772+0000 7f0f9d913640 1 -- 172.21.15.78:0/710838990 wait complete. 2024-09-18T12:50:22.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.772+0000 7f0f9d913640 1 Processor -- start 2024-09-18T12:50:22.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.772+0000 7f0f9d913640 1 -- start start 2024-09-18T12:50:22.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.773+0000 7f0f9d913640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f98100240 0x7f0f98199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:22.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.773+0000 7f0f9d913640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f98100b80 0x7f0f98199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:22.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.773+0000 7f0f9d913640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9810c970 con 0x7f0f98100b80 2024-09-18T12:50:22.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.773+0000 7f0f9d913640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9810c7f0 con 0x7f0f98100240 2024-09-18T12:50:22.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.773+0000 7f0f967fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f98100b80 0x7f0f98199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:22.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.773+0000 7f0f967fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f98100b80 0x7f0f98199bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39266/0 (socket says 172.21.15.78:39266) 2024-09-18T12:50:22.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.773+0000 7f0f967fc640 1 -- 172.21.15.78:0/2673344012 learned_addr learned my addr 172.21.15.78:0/2673344012 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:50:22.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.773+0000 7f0f96ffd640 1 --2- 172.21.15.78:0/2673344012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f98100240 0x7f0f98199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:22.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.773+0000 7f0f96ffd640 1 -- 172.21.15.78:0/2673344012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f98100b80 msgr2=0x7f0f98199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:22.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.773+0000 7f0f96ffd640 1 --2- 172.21.15.78:0/2673344012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f98100b80 0x7f0f98199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:22.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.773+0000 7f0f96ffd640 1 -- 172.21.15.78:0/2673344012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9819a230 con 0x7f0f98100240 2024-09-18T12:50:22.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.773+0000 7f0f967fc640 1 --2- 172.21.15.78:0/2673344012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f98100b80 0x7f0f98199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:50:22.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.773+0000 7f0f96ffd640 1 --2- 172.21.15.78:0/2673344012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f98100240 0x7f0f98199670 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f88006010 tx=0x7f0f880045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:22.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.774+0000 7f0f9c911640 1 -- 172.21.15.78:0/2673344012 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f8803f070 con 0x7f0f98100240 2024-09-18T12:50:22.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.774+0000 7f0f9d913640 1 -- 172.21.15.78:0/2673344012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9819ec10 con 0x7f0f98100240 2024-09-18T12:50:22.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.774+0000 7f0f9c911640 1 -- 172.21.15.78:0/2673344012 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f880049d0 con 0x7f0f98100240 2024-09-18T12:50:22.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.774+0000 7f0f9d913640 1 -- 172.21.15.78:0/2673344012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f9819f1a0 con 0x7f0f98100240 2024-09-18T12:50:22.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.774+0000 7f0f9c911640 1 -- 172.21.15.78:0/2673344012 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f88035030 con 0x7f0f98100240 2024-09-18T12:50:22.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.775+0000 7f0f9d913640 1 -- 172.21.15.78:0/2673344012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f98100640 con 0x7f0f98100240 2024-09-18T12:50:22.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.776+0000 7f0f9c911640 1 -- 172.21.15.78:0/2673344012 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 26) ==== 103424+0+0 (secure 0 0 0) 0x7f0f88042070 con 0x7f0f98100240 2024-09-18T12:50:22.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.776+0000 7f0f9c911640 1 --2- 172.21.15.78:0/2673344012 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f0f8007b100 0x7f0f8007d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:22.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.776+0000 7f0f9c911640 1 -- 172.21.15.78:0/2673344012 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f0f880beb30 con 0x7f0f98100240 2024-09-18T12:50:22.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.777+0000 7f0f967fc640 1 --2- 172.21.15.78:0/2673344012 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f0f8007b100 0x7f0f8007d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:22.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.777+0000 7f0f967fc640 1 --2- 172.21.15.78:0/2673344012 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f0f8007b100 0x7f0f8007d5c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0f9819ab20 tx=0x7f0f8c005f90 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:22.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:22.781+0000 7f0f9c911640 1 -- 172.21.15.78:0/2673344012 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f0f8808a040 con 0x7f0f98100240 2024-09-18T12:50:23.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.170+0000 7f0f9d913640 1 -- 172.21.15.78:0/2673344012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0f98062df0 con 0x7f0f98100240 2024-09-18T12:50:23.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.171+0000 7f0f9c911640 1 -- 172.21.15.78:0/2673344012 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f0f8808eef0 con 0x7f0f98100240 2024-09-18T12:50:23.172 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:50:23.172 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:50:23.173 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:50:23.173 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:50:23.173 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:50:23.173 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:50:23.173 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:50:23.173 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:50:23.173 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:50:23.173 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:50:23.173 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:50:23.173 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:50:23.173 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:50:23.173 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:50:23.174 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-18T12:50:23.174 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:50:23.174 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:50:23.174 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:50:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.173+0000 7f0f9d913640 1 -- 172.21.15.78:0/2673344012 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f0f8007b100 msgr2=0x7f0f8007d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.173+0000 7f0f9d913640 1 --2- 172.21.15.78:0/2673344012 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f0f8007b100 0x7f0f8007d5c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0f9819ab20 tx=0x7f0f8c005f90 comp rx=0 tx=0).stop 2024-09-18T12:50:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.173+0000 7f0f9d913640 1 -- 172.21.15.78:0/2673344012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f98100240 msgr2=0x7f0f98199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.173+0000 7f0f9d913640 1 --2- 172.21.15.78:0/2673344012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f98100240 0x7f0f98199670 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f88006010 tx=0x7f0f880045e0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.174+0000 7f0f9d913640 1 -- 172.21.15.78:0/2673344012 shutdown_connections 2024-09-18T12:50:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.174+0000 7f0f9d913640 1 --2- 172.21.15.78:0/2673344012 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7f0f8007b100 0x7f0f8007d5c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.174+0000 7f0f9d913640 1 --2- 172.21.15.78:0/2673344012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f98100b80 0x7f0f98199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.174+0000 7f0f9d913640 1 --2- 172.21.15.78:0/2673344012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f98100240 0x7f0f98199670 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.174+0000 7f0f9d913640 1 -- 172.21.15.78:0/2673344012 >> 172.21.15.78:0/2673344012 conn(0x7f0f980fc010 msgr2=0x7f0f98108b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:23.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.174+0000 7f0f9d913640 1 -- 172.21.15.78:0/2673344012 shutdown_connections 2024-09-18T12:50:23.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.174+0000 7f0f9d913640 1 -- 172.21.15.78:0/2673344012 wait complete. 2024-09-18T12:50:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.259+0000 7fe7a1b88640 1 -- 172.21.15.78:0/3315675418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe79c101a60 msgr2=0x7fe79c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.259+0000 7fe7a1b88640 1 --2- 172.21.15.78:0/3315675418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe79c101a60 0x7fe79c101ee0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe790009880 tx=0x7fe79002c6b0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.259+0000 7fe7a1b88640 1 -- 172.21.15.78:0/3315675418 shutdown_connections 2024-09-18T12:50:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.259+0000 7fe7a1b88640 1 --2- 172.21.15.78:0/3315675418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe79c101a60 0x7fe79c101ee0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.259+0000 7fe7a1b88640 1 --2- 172.21.15.78:0/3315675418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe79c100860 0x7fe79c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.259+0000 7fe7a1b88640 1 -- 172.21.15.78:0/3315675418 >> 172.21.15.78:0/3315675418 conn(0x7fe79c0fc010 msgr2=0x7fe79c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.259+0000 7fe7a1b88640 1 -- 172.21.15.78:0/3315675418 shutdown_connections 2024-09-18T12:50:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.259+0000 7fe7a1b88640 1 -- 172.21.15.78:0/3315675418 wait complete. 2024-09-18T12:50:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.260+0000 7fe7a1b88640 1 Processor -- start 2024-09-18T12:50:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.260+0000 7fe7a1b88640 1 -- start start 2024-09-18T12:50:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.260+0000 7fe7a1b88640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe79c100860 0x7fe79c195270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.260+0000 7fe7a1b88640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe79c101a60 0x7fe79c1957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.261+0000 7fe7a1b88640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c108570 con 0x7fe79c100860 2024-09-18T12:50:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.261+0000 7fe7a1b88640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1083f0 con 0x7fe79c101a60 2024-09-18T12:50:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.261+0000 7fe79b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe79c100860 0x7fe79c195270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.261+0000 7fe79b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe79c100860 0x7fe79c195270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39280/0 (socket says 172.21.15.78:39280) 2024-09-18T12:50:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.261+0000 7fe79b7fe640 1 -- 172.21.15.78:0/478468416 learned_addr learned my addr 172.21.15.78:0/478468416 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:50:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.261+0000 7fe79affd640 1 --2- 172.21.15.78:0/478468416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe79c101a60 0x7fe79c1957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.261+0000 7fe79b7fe640 1 -- 172.21.15.78:0/478468416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe79c101a60 msgr2=0x7fe79c1957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.261+0000 7fe79b7fe640 1 --2- 172.21.15.78:0/478468416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe79c101a60 0x7fe79c1957b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.261+0000 7fe79b7fe640 1 -- 172.21.15.78:0/478468416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79c195e30 con 0x7fe79c100860 2024-09-18T12:50:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.261+0000 7fe79b7fe640 1 --2- 172.21.15.78:0/478468416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe79c100860 0x7fe79c195270 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00e940 tx=0x7fe78c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.261+0000 7fe79affd640 1 --2- 172.21.15.78:0/478468416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe79c101a60 0x7fe79c1957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:50:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.261+0000 7fe798ff9640 1 -- 172.21.15.78:0/478468416 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe78c00cac0 con 0x7fe79c100860 2024-09-18T12:50:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.261+0000 7fe7a1b88640 1 -- 172.21.15.78:0/478468416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe79c19a870 con 0x7fe79c100860 2024-09-18T12:50:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.262+0000 7fe7a1b88640 1 -- 172.21.15.78:0/478468416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe79c19add0 con 0x7fe79c100860 2024-09-18T12:50:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.262+0000 7fe798ff9640 1 -- 172.21.15.78:0/478468416 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe78c00cc60 con 0x7fe79c100860 2024-09-18T12:50:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.262+0000 7fe798ff9640 1 -- 172.21.15.78:0/478468416 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe78c017450 con 0x7fe79c100860 2024-09-18T12:50:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.263+0000 7fe7827fc640 1 -- 172.21.15.78:0/478468416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe77c005290 con 0x7fe79c100860 2024-09-18T12:50:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.264+0000 7fe798ff9640 1 -- 172.21.15.78:0/478468416 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 26) ==== 103424+0+0 (secure 0 0 0) 0x7fe78c0040b0 con 0x7fe79c100860 2024-09-18T12:50:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.264+0000 7fe798ff9640 1 --2- 172.21.15.78:0/478468416 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fe78407b0b0 0x7fe78407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.264+0000 7fe798ff9640 1 -- 172.21.15.78:0/478468416 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fe78c09e3f0 con 0x7fe79c100860 2024-09-18T12:50:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.264+0000 7fe79affd640 1 --2- 172.21.15.78:0/478468416 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fe78407b0b0 0x7fe78407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.265+0000 7fe79affd640 1 --2- 172.21.15.78:0/478468416 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fe78407b0b0 0x7fe78407d570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe790000c00 tx=0x7fe7900058d0 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:23.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.273+0000 7fe798ff9640 1 -- 172.21.15.78:0/478468416 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fe78c0699a0 con 0x7fe79c100860 2024-09-18T12:50:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:23 smithi078 ceph-mon[28091]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:23 smithi078 ceph-mon[28091]: pgmap v49: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.3 MiB/s wr, 113 op/s 2024-09-18T12:50:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:23 smithi078 ceph-mon[28091]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:23 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:23 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2673344012' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:50:23.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.539+0000 7fe7827fc640 1 -- 172.21.15.78:0/478468416 --> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe77c000bc0 con 0x7fe78407b0b0 2024-09-18T12:50:23.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.540+0000 7fe798ff9640 1 -- 172.21.15.78:0/478468416 <== mgr.24355 v2:172.21.15.148:6828/2591325460 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7fe77c000bc0 con 0x7fe78407b0b0 2024-09-18T12:50:23.542 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:50:23.542 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:50:23.542 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:50:23.542 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:50:23.542 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:50:23.542 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr" 2024-09-18T12:50:23.542 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:50:23.542 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "2/2 daemons upgraded", 2024-09-18T12:50:23.542 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mgr daemons", 2024-09-18T12:50:23.542 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:50:23.542 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:50:23.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.543+0000 7fe7827fc640 1 -- 172.21.15.78:0/478468416 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fe78407b0b0 msgr2=0x7fe78407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:23.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.543+0000 7fe7827fc640 1 --2- 172.21.15.78:0/478468416 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fe78407b0b0 0x7fe78407d570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe790000c00 tx=0x7fe7900058d0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.543+0000 7fe7827fc640 1 -- 172.21.15.78:0/478468416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe79c100860 msgr2=0x7fe79c195270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:23.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.543+0000 7fe7827fc640 1 --2- 172.21.15.78:0/478468416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe79c100860 0x7fe79c195270 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00e940 tx=0x7fe78c00ee00 comp rx=0 tx=0).stop 2024-09-18T12:50:23.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.543+0000 7fe7827fc640 1 -- 172.21.15.78:0/478468416 shutdown_connections 2024-09-18T12:50:23.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.543+0000 7fe7827fc640 1 --2- 172.21.15.78:0/478468416 >> [v2:172.21.15.148:6828/2591325460,v1:172.21.15.148:6829/2591325460] conn(0x7fe78407b0b0 0x7fe78407d570 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.543+0000 7fe7827fc640 1 --2- 172.21.15.78:0/478468416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe79c101a60 0x7fe79c1957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.543+0000 7fe7827fc640 1 --2- 172.21.15.78:0/478468416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe79c100860 0x7fe79c195270 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.543+0000 7fe7827fc640 1 -- 172.21.15.78:0/478468416 >> 172.21.15.78:0/478468416 conn(0x7fe79c0fc010 msgr2=0x7fe79c104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:23.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.543+0000 7fe7827fc640 1 -- 172.21.15.78:0/478468416 shutdown_connections 2024-09-18T12:50:23.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:23.543+0000 7fe7827fc640 1 -- 172.21.15.78:0/478468416 wait complete. 2024-09-18T12:50:23.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:23 smithi148 ceph-mon[35352]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:23.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:23 smithi148 ceph-mon[35352]: pgmap v49: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.3 MiB/s wr, 113 op/s 2024-09-18T12:50:23.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:23 smithi148 ceph-mon[35352]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:23.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:23 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:23.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:23 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2673344012' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:50:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:24 smithi148 ceph-mon[35352]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:24.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:24 smithi078 ceph-mon[28091]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:25.331 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: pgmap v50: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 80 op/s 2024-09-18T12:50:25.331 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: mgrmap e27: smithi148.bfgshs(active, since 94s), standbys: smithi078.ohifux 2024-09-18T12:50:25.331 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:50:25.331 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:50:25.331 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:50:25.331 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:50:25.331 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:50:25.331 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:50:25.331 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mgr fail", "who": "smithi148.bfgshs"}]: dispatch 2024-09-18T12:50:25.332 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mgr fail", "who": "smithi148.bfgshs"}]: dispatch 2024-09-18T12:50:25.332 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: Activating manager daemon smithi078.ohifux 2024-09-18T12:50:25.332 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd='[{"prefix": "mgr fail", "who": "smithi148.bfgshs"}]': finished 2024-09-18T12:50:25.332 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: osdmap e47: 6 total, 6 up, 6 in 2024-09-18T12:50:25.332 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: mgrmap e28: smithi078.ohifux(active, starting, since 0.00829947s) 2024-09-18T12:50:25.332 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:50:25.332 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:50:25.332 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi078.eakgoe"}]: dispatch 2024-09-18T12:50:25.332 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi078.furyab"}]: dispatch 2024-09-18T12:50:25.332 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.tvvouo"}]: dispatch 2024-09-18T12:50:25.332 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.fqecmm"}]: dispatch 2024-09-18T12:50:25.332 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr metadata", "who": "smithi078.ohifux", "id": "smithi078.ohifux"}]: dispatch 2024-09-18T12:50:25.332 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:50:25.332 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:50:25.333 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:50:25.333 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:50:25.333 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:50:25.333 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:50:25.333 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:50:25.333 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:50:25.333 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:50:25.333 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:25 smithi078 ceph-mon[28091]: Manager daemon smithi078.ohifux is now available 2024-09-18T12:50:25.691 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: pgmap v50: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 80 op/s 2024-09-18T12:50:25.691 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: mgrmap e27: smithi148.bfgshs(active, since 94s), standbys: smithi078.ohifux 2024-09-18T12:50:25.691 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:50:25.692 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:50:25.692 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:50:25.692 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:50:25.692 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' 2024-09-18T12:50:25.692 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:50:25.692 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.24355 172.21.15.148:0/1712639252' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mgr fail", "who": "smithi148.bfgshs"}]: dispatch 2024-09-18T12:50:25.692 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "mgr fail", "who": "smithi148.bfgshs"}]: dispatch 2024-09-18T12:50:25.692 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: Activating manager daemon smithi078.ohifux 2024-09-18T12:50:25.692 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.24355 ' entity='mgr.smithi148.bfgshs' cmd='[{"prefix": "mgr fail", "who": "smithi148.bfgshs"}]': finished 2024-09-18T12:50:25.692 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: osdmap e47: 6 total, 6 up, 6 in 2024-09-18T12:50:25.692 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: mgrmap e28: smithi078.ohifux(active, starting, since 0.00829947s) 2024-09-18T12:50:25.692 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:50:25.692 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:50:25.693 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi078.eakgoe"}]: dispatch 2024-09-18T12:50:25.693 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi078.furyab"}]: dispatch 2024-09-18T12:50:25.693 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.tvvouo"}]: dispatch 2024-09-18T12:50:25.693 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.fqecmm"}]: dispatch 2024-09-18T12:50:25.693 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr metadata", "who": "smithi078.ohifux", "id": "smithi078.ohifux"}]: dispatch 2024-09-18T12:50:25.693 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:50:25.693 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:50:25.693 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:50:25.693 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:50:25.693 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:50:25.693 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:50:25.693 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:50:25.694 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:50:25.694 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:50:25.694 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:25 smithi148 ceph-mon[35352]: Manager daemon smithi078.ohifux is now available 2024-09-18T12:50:26.625 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:26 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:50:26.625 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:26 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:50:26.626 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:26 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:26.626 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:26 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi078.ohifux/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:50:26.626 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:26 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi078.ohifux/trash_purge_schedule"}]: dispatch 2024-09-18T12:50:26.626 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:26 smithi078 ceph-mon[28091]: mgrmap e29: smithi078.ohifux(active, since 1.01197s) 2024-09-18T12:50:26.626 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:26 smithi078 ceph-mon[28091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:50:26.626 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:26 smithi078 ceph-mon[28091]: pgmap v3: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:50:26.664 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:26 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:50:26.664 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:26 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:50:26.664 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:26 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:26.664 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:26 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi078.ohifux/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:50:26.664 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:26 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi078.ohifux/trash_purge_schedule"}]: dispatch 2024-09-18T12:50:26.664 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:26 smithi148 ceph-mon[35352]: mgrmap e29: smithi078.ohifux(active, since 1.01197s) 2024-09-18T12:50:26.664 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:26 smithi148 ceph-mon[35352]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:50:26.664 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:26 smithi148 ceph-mon[35352]: pgmap v3: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:50:28.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:28 smithi148 ceph-mon[35352]: [18/Sep/2024:12:50:26] ENGINE Bus STARTING 2024-09-18T12:50:28.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:28 smithi148 ceph-mon[35352]: [18/Sep/2024:12:50:26] ENGINE Serving on https://172.21.15.78:7150 2024-09-18T12:50:28.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:28 smithi148 ceph-mon[35352]: [18/Sep/2024:12:50:26] ENGINE Error in HTTPServer.serve 2024-09-18T12:50:28.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Traceback (most recent call last): 2024-09-18T12:50:28.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:50:28.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:50:28.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:50:28.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: self._run(expiration_interval) 2024-09-18T12:50:28.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:50:28.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:50:28.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:50:28.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:50:28.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:50:28.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: s = self.context.wrap_socket( 2024-09-18T12:50:28.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:50:28.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: return self.sslsocket_class._create( 2024-09-18T12:50:28.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:50:28.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: self.do_handshake() 2024-09-18T12:50:28.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:50:28.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: self._sslobj.do_handshake() 2024-09-18T12:50:28.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:50:28.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:28 smithi148 ceph-mon[35352]: [18/Sep/2024:12:50:26] ENGINE Serving on http://172.21.15.78:8765 2024-09-18T12:50:28.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:28 smithi148 ceph-mon[35352]: [18/Sep/2024:12:50:26] ENGINE Bus STARTED 2024-09-18T12:50:28.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:28 smithi148 ceph-mon[35352]: pgmap v4: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:50:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:28 smithi078 ceph-mon[28091]: [18/Sep/2024:12:50:26] ENGINE Bus STARTING 2024-09-18T12:50:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:28 smithi078 ceph-mon[28091]: [18/Sep/2024:12:50:26] ENGINE Serving on https://172.21.15.78:7150 2024-09-18T12:50:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:28 smithi078 ceph-mon[28091]: [18/Sep/2024:12:50:26] ENGINE Error in HTTPServer.serve 2024-09-18T12:50:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Traceback (most recent call last): 2024-09-18T12:50:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:50:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:50:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:50:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self._run(expiration_interval) 2024-09-18T12:50:28.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:50:28.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:50:28.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:50:28.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:50:28.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:50:28.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: s = self.context.wrap_socket( 2024-09-18T12:50:28.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:50:28.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: return self.sslsocket_class._create( 2024-09-18T12:50:28.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:50:28.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self.do_handshake() 2024-09-18T12:50:28.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:50:28.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: self._sslobj.do_handshake() 2024-09-18T12:50:28.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:50:28.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:28 smithi078 ceph-mon[28091]: [18/Sep/2024:12:50:26] ENGINE Serving on http://172.21.15.78:8765 2024-09-18T12:50:28.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:28 smithi078 ceph-mon[28091]: [18/Sep/2024:12:50:26] ENGINE Bus STARTED 2024-09-18T12:50:28.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:28 smithi078 ceph-mon[28091]: pgmap v4: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:50:29.357 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:29 smithi078 ceph-mon[28091]: mgrmap e30: smithi078.ohifux(active, since 3s) 2024-09-18T12:50:29.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:29 smithi148 ceph-mon[35352]: mgrmap e30: smithi078.ohifux(active, since 3s) 2024-09-18T12:50:30.397 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:30 smithi148 ceph-mon[35352]: pgmap v5: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:50:30.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:30 smithi078 ceph-mon[28091]: pgmap v5: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:50:31.308 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:31 smithi078 ceph-mon[28091]: mgrmap e31: smithi078.ohifux(active, since 5s) 2024-09-18T12:50:31.308 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:31 smithi078 ceph-mon[28091]: Standby manager daemon smithi148.bfgshs started 2024-09-18T12:50:31.308 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:31 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/3533448423' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/crt"}]: dispatch 2024-09-18T12:50:31.308 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:31 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/3533448423' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:50:31.309 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:31 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/3533448423' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/key"}]: dispatch 2024-09-18T12:50:31.309 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:31 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/3533448423' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:50:31.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:31 smithi148 ceph-mon[35352]: mgrmap e31: smithi078.ohifux(active, since 5s) 2024-09-18T12:50:31.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:31 smithi148 ceph-mon[35352]: Standby manager daemon smithi148.bfgshs started 2024-09-18T12:50:31.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:31 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/3533448423' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/crt"}]: dispatch 2024-09-18T12:50:31.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:31 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/3533448423' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:50:31.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:31 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/3533448423' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/key"}]: dispatch 2024-09-18T12:50:31.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:31 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/3533448423' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:50:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:32 smithi148 ceph-mon[35352]: pgmap v6: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 979 KiB/s wr, 126 op/s 2024-09-18T12:50:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:32 smithi148 ceph-mon[35352]: mgrmap e32: smithi078.ohifux(active, since 6s), standbys: smithi148.bfgshs 2024-09-18T12:50:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:32 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr metadata", "who": "smithi148.bfgshs", "id": "smithi148.bfgshs"}]: dispatch 2024-09-18T12:50:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:32 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:32 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:32 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:32 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:32 smithi078 ceph-mon[28091]: pgmap v6: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 979 KiB/s wr, 126 op/s 2024-09-18T12:50:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:32 smithi078 ceph-mon[28091]: mgrmap e32: smithi078.ohifux(active, since 6s), standbys: smithi148.bfgshs 2024-09-18T12:50:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:32 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr metadata", "who": "smithi148.bfgshs", "id": "smithi148.bfgshs"}]: dispatch 2024-09-18T12:50:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:32 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:32 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:32 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:32 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:34.066 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:34 smithi078 ceph-mon[28091]: pgmap v7: 65 pgs: 65 active+clean; 302 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 53 KiB/s rd, 1.8 MiB/s wr, 630 op/s 2024-09-18T12:50:34.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:34 smithi148 ceph-mon[35352]: pgmap v7: 65 pgs: 65 active+clean; 302 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 53 KiB/s rd, 1.8 MiB/s wr, 630 op/s 2024-09-18T12:50:36.304 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:36 smithi148 ceph-mon[35352]: pgmap v8: 65 pgs: 65 active+clean; 302 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.4 MiB/s wr, 490 op/s 2024-09-18T12:50:36.472 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:36 smithi078 ceph-mon[28091]: pgmap v8: 65 pgs: 65 active+clean; 302 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.4 MiB/s wr, 490 op/s 2024-09-18T12:50:38.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:38 smithi148 ceph-mon[35352]: pgmap v9: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.0 MiB/s wr, 542 op/s 2024-09-18T12:50:38.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:38 smithi078 ceph-mon[28091]: pgmap v9: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.0 MiB/s wr, 542 op/s 2024-09-18T12:50:40.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:40 smithi148 ceph-mon[35352]: pgmap v10: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.8 MiB/s wr, 496 op/s 2024-09-18T12:50:40.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:40 smithi078 ceph-mon[28091]: pgmap v10: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.8 MiB/s wr, 496 op/s 2024-09-18T12:50:41.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:41 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:41.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:41 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:42.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:42 smithi148 ceph-mon[35352]: pgmap v11: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 56 KiB/s rd, 1.8 MiB/s wr, 510 op/s 2024-09-18T12:50:42.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:42 smithi078 ceph-mon[28091]: pgmap v11: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 56 KiB/s rd, 1.8 MiB/s wr, 510 op/s 2024-09-18T12:50:44.441 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:44 smithi078 ceph-mon[28091]: pgmap v12: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 558 op/s 2024-09-18T12:50:44.441 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:44 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:44.442 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:44 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:44.442 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:44 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:44.442 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:44 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:44.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:44 smithi148 ceph-mon[35352]: pgmap v12: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 558 op/s 2024-09-18T12:50:44.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:44 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:44.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:44 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:44.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:44 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:44.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:44 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:46 smithi148 ceph-mon[35352]: pgmap v13: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 243 op/s 2024-09-18T12:50:46.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:46 smithi078 ceph-mon[28091]: pgmap v13: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 243 op/s 2024-09-18T12:50:48.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:48 smithi148 ceph-mon[35352]: pgmap v14: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 340 op/s 2024-09-18T12:50:48.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:48 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:48.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:48 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:48.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:48 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:50:48.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:48 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:50:48.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:48 smithi078 ceph-mon[28091]: pgmap v14: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 340 op/s 2024-09-18T12:50:48.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:48 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:48.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:48 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:48.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:48 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:50:48.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:48 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:50:49.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:49 smithi078 ceph-mon[28091]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-18T12:50:49.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:49 smithi078 ceph-mon[28091]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-18T12:50:49.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:49 smithi078 ceph-mon[28091]: Updating smithi148:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:50:49.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:49 smithi078 ceph-mon[28091]: Updating smithi078:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:50:49.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:49 smithi078 ceph-mon[28091]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:50:49.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:49 smithi078 ceph-mon[28091]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:50:49.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:49 smithi078 ceph-mon[28091]: Updating smithi148:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:50:49.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:49 smithi078 ceph-mon[28091]: Updating smithi078:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:50:49.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:49 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:49.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:49 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:49.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:49 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:49.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:49 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:49.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:49 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:49 smithi148 ceph-mon[35352]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-18T12:50:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:49 smithi148 ceph-mon[35352]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-18T12:50:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:49 smithi148 ceph-mon[35352]: Updating smithi148:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:50:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:49 smithi148 ceph-mon[35352]: Updating smithi078:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:50:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:49 smithi148 ceph-mon[35352]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:50:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:49 smithi148 ceph-mon[35352]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:50:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:49 smithi148 ceph-mon[35352]: Updating smithi148:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:50:49.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:49 smithi148 ceph-mon[35352]: Updating smithi078:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:50:49.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:49 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:49.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:49 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:49.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:49 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:49.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:49 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:49.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:49 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:50:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:50 smithi148 ceph-mon[35352]: Reconfiguring prometheus.smithi078 (dependencies changed)... 2024-09-18T12:50:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:50 smithi148 ceph-mon[35352]: Reconfiguring daemon prometheus.smithi078 on smithi078 2024-09-18T12:50:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:50 smithi148 ceph-mon[35352]: pgmap v15: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 211 op/s 2024-09-18T12:50:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:50 smithi078 ceph-mon[28091]: Reconfiguring prometheus.smithi078 (dependencies changed)... 2024-09-18T12:50:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:50 smithi078 ceph-mon[28091]: Reconfiguring daemon prometheus.smithi078 on smithi078 2024-09-18T12:50:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:50 smithi078 ceph-mon[28091]: pgmap v15: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 211 op/s 2024-09-18T12:50:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:52 smithi148 ceph-mon[35352]: pgmap v16: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 1.6 MiB/s wr, 232 op/s 2024-09-18T12:50:52.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:52 smithi078 ceph-mon[28091]: pgmap v16: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 1.6 MiB/s wr, 232 op/s 2024-09-18T12:50:53.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.654+0000 7f8700927640 1 -- 172.21.15.78:0/3947661992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86fc101970 msgr2=0x7f86fc101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:53.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.654+0000 7f8700927640 1 --2- 172.21.15.78:0/3947661992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86fc101970 0x7f86fc101d70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009880 tx=0x7f86ec02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:50:53.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.654+0000 7f8700927640 1 -- 172.21.15.78:0/3947661992 shutdown_connections 2024-09-18T12:50:53.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.654+0000 7f8700927640 1 --2- 172.21.15.78:0/3947661992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc102b70 0x7f86fc102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:53.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.654+0000 7f8700927640 1 --2- 172.21.15.78:0/3947661992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86fc101970 0x7f86fc101d70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:53.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.654+0000 7f8700927640 1 -- 172.21.15.78:0/3947661992 >> 172.21.15.78:0/3947661992 conn(0x7f86fc0fd140 msgr2=0x7f86fc0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:53.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.654+0000 7f8700927640 1 -- 172.21.15.78:0/3947661992 shutdown_connections 2024-09-18T12:50:53.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.654+0000 7f8700927640 1 -- 172.21.15.78:0/3947661992 wait complete. 2024-09-18T12:50:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.655+0000 7f8700927640 1 Processor -- start 2024-09-18T12:50:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.655+0000 7f8700927640 1 -- start start 2024-09-18T12:50:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.655+0000 7f8700927640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86fc101970 0x7f86fc19dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.655+0000 7f8700927640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc102b70 0x7f86fc19dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.655+0000 7f8700927640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc10a790 con 0x7f86fc101970 2024-09-18T12:50:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.655+0000 7f8700927640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc10a610 con 0x7f86fc102b70 2024-09-18T12:50:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.656+0000 7f86fa59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86fc101970 0x7f86fc19dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.656+0000 7f86fa59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86fc101970 0x7f86fc19dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58592/0 (socket says 172.21.15.78:58592) 2024-09-18T12:50:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.656+0000 7f86f9d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc102b70 0x7f86fc19dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:53.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.656+0000 7f86fa59c640 1 -- 172.21.15.78:0/247885588 learned_addr learned my addr 172.21.15.78:0/247885588 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:50:53.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.656+0000 7f86f9d9b640 1 -- 172.21.15.78:0/247885588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86fc101970 msgr2=0x7f86fc19dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:53.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.656+0000 7f86f9d9b640 1 --2- 172.21.15.78:0/247885588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86fc101970 0x7f86fc19dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:53.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.656+0000 7f86f9d9b640 1 -- 172.21.15.78:0/247885588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86fc19e670 con 0x7f86fc102b70 2024-09-18T12:50:53.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.656+0000 7f86f9d9b640 1 --2- 172.21.15.78:0/247885588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc102b70 0x7f86fc19dff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f86f000e970 tx=0x7f86f000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:53.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.656+0000 7f86eb7fe640 1 -- 172.21.15.78:0/247885588 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86f000cac0 con 0x7f86fc102b70 2024-09-18T12:50:53.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.657+0000 7f8700927640 1 -- 172.21.15.78:0/247885588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86fc1a30b0 con 0x7f86fc102b70 2024-09-18T12:50:53.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.657+0000 7f86eb7fe640 1 -- 172.21.15.78:0/247885588 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f86f000cc60 con 0x7f86fc102b70 2024-09-18T12:50:53.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.657+0000 7f86eb7fe640 1 -- 172.21.15.78:0/247885588 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86f0018720 con 0x7f86fc102b70 2024-09-18T12:50:53.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.657+0000 7f8700927640 1 -- 172.21.15.78:0/247885588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86fc1a3640 con 0x7f86fc102b70 2024-09-18T12:50:53.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.658+0000 7f8700927640 1 -- 172.21.15.78:0/247885588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86fc101d70 con 0x7f86fc102b70 2024-09-18T12:50:53.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.658+0000 7f86eb7fe640 1 -- 172.21.15.78:0/247885588 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f86f0010430 con 0x7f86fc102b70 2024-09-18T12:50:53.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.659+0000 7f86eb7fe640 1 --2- 172.21.15.78:0/247885588 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f86e407b050 0x7f86e407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:53.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.659+0000 7f86eb7fe640 1 -- 172.21.15.78:0/247885588 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f86f009e720 con 0x7f86fc102b70 2024-09-18T12:50:53.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.659+0000 7f86fa59c640 1 --2- 172.21.15.78:0/247885588 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f86e407b050 0x7f86e407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:53.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.660+0000 7f86fa59c640 1 --2- 172.21.15.78:0/247885588 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f86e407b050 0x7f86e407d510 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f86ec000c00 tx=0x7f86ec0058d0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:53.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.664+0000 7f86eb7fe640 1 -- 172.21.15.78:0/247885588 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f86f0069b50 con 0x7f86fc102b70 2024-09-18T12:50:53.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.931+0000 7f8700927640 1 -- 172.21.15.78:0/247885588 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f86fc062630 con 0x7f86e407b050 2024-09-18T12:50:53.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.932+0000 7f86eb7fe640 1 -- 172.21.15.78:0/247885588 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f86fc062630 con 0x7f86e407b050 2024-09-18T12:50:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.934+0000 7f8700927640 1 -- 172.21.15.78:0/247885588 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f86e407b050 msgr2=0x7f86e407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.934+0000 7f8700927640 1 --2- 172.21.15.78:0/247885588 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f86e407b050 0x7f86e407d510 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f86ec000c00 tx=0x7f86ec0058d0 comp rx=0 tx=0).stop 2024-09-18T12:50:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.934+0000 7f8700927640 1 -- 172.21.15.78:0/247885588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc102b70 msgr2=0x7f86fc19dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:53.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.934+0000 7f8700927640 1 --2- 172.21.15.78:0/247885588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc102b70 0x7f86fc19dff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f86f000e970 tx=0x7f86f000ee30 comp rx=0 tx=0).stop 2024-09-18T12:50:53.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.934+0000 7f8700927640 1 -- 172.21.15.78:0/247885588 shutdown_connections 2024-09-18T12:50:53.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.934+0000 7f8700927640 1 --2- 172.21.15.78:0/247885588 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f86e407b050 0x7f86e407d510 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:53.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.934+0000 7f8700927640 1 --2- 172.21.15.78:0/247885588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc102b70 0x7f86fc19dff0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:53.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.934+0000 7f8700927640 1 --2- 172.21.15.78:0/247885588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86fc101970 0x7f86fc19dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:53.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.934+0000 7f8700927640 1 -- 172.21.15.78:0/247885588 >> 172.21.15.78:0/247885588 conn(0x7f86fc0fd140 msgr2=0x7f86fc104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:53.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.935+0000 7f8700927640 1 -- 172.21.15.78:0/247885588 shutdown_connections 2024-09-18T12:50:53.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:53.935+0000 7f8700927640 1 -- 172.21.15.78:0/247885588 wait complete. 2024-09-18T12:50:53.945 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:50:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.029+0000 7f07ddc5a640 1 -- 172.21.15.78:0/514784262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8101a60 msgr2=0x7f07d8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.029+0000 7f07ddc5a640 1 --2- 172.21.15.78:0/514784262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8101a60 0x7f07d8101ee0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009880 tx=0x7f07cc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.029+0000 7f07ddc5a640 1 -- 172.21.15.78:0/514784262 shutdown_connections 2024-09-18T12:50:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.029+0000 7f07ddc5a640 1 --2- 172.21.15.78:0/514784262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8101a60 0x7f07d8101ee0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.029+0000 7f07ddc5a640 1 --2- 172.21.15.78:0/514784262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d8100860 0x7f07d8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.029+0000 7f07ddc5a640 1 -- 172.21.15.78:0/514784262 >> 172.21.15.78:0/514784262 conn(0x7f07d80fc010 msgr2=0x7f07d80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.029+0000 7f07ddc5a640 1 -- 172.21.15.78:0/514784262 shutdown_connections 2024-09-18T12:50:54.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.029+0000 7f07ddc5a640 1 -- 172.21.15.78:0/514784262 wait complete. 2024-09-18T12:50:54.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.030+0000 7f07ddc5a640 1 Processor -- start 2024-09-18T12:50:54.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.030+0000 7f07ddc5a640 1 -- start start 2024-09-18T12:50:54.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.030+0000 7f07ddc5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8100860 0x7f07d8197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:54.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.030+0000 7f07ddc5a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d8101a60 0x7f07d8197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:54.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.030+0000 7f07ddc5a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f07d81096a0 con 0x7f07d8100860 2024-09-18T12:50:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.030+0000 7f07ddc5a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f07d8109520 con 0x7f07d8101a60 2024-09-18T12:50:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.030+0000 7f07d77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8100860 0x7f07d8197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.030+0000 7f07d77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8100860 0x7f07d8197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58610/0 (socket says 172.21.15.78:58610) 2024-09-18T12:50:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.030+0000 7f07d77fe640 1 -- 172.21.15.78:0/3946610784 learned_addr learned my addr 172.21.15.78:0/3946610784 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:50:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.030+0000 7f07d6ffd640 1 --2- 172.21.15.78:0/3946610784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d8101a60 0x7f07d8197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.031+0000 7f07d6ffd640 1 -- 172.21.15.78:0/3946610784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8100860 msgr2=0x7f07d8197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.031+0000 7f07d6ffd640 1 --2- 172.21.15.78:0/3946610784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8100860 0x7f07d8197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.031+0000 7f07d6ffd640 1 -- 172.21.15.78:0/3946610784 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d8198100 con 0x7f07d8101a60 2024-09-18T12:50:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.031+0000 7f07d77fe640 1 --2- 172.21.15.78:0/3946610784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8100860 0x7f07d8197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:50:54.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.031+0000 7f07d6ffd640 1 --2- 172.21.15.78:0/3946610784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d8101a60 0x7f07d8197a80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f07cc006010 tx=0x7f07cc0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:54.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.031+0000 7f07d4ff9640 1 -- 172.21.15.78:0/3946610784 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07cc03f070 con 0x7f07d8101a60 2024-09-18T12:50:54.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.031+0000 7f07ddc5a640 1 -- 172.21.15.78:0/3946610784 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d819cae0 con 0x7f07d8101a60 2024-09-18T12:50:54.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.031+0000 7f07d4ff9640 1 -- 172.21.15.78:0/3946610784 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07cc0049d0 con 0x7f07d8101a60 2024-09-18T12:50:54.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.031+0000 7f07ddc5a640 1 -- 172.21.15.78:0/3946610784 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d819d070 con 0x7f07d8101a60 2024-09-18T12:50:54.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.031+0000 7f07d4ff9640 1 -- 172.21.15.78:0/3946610784 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07cc035030 con 0x7f07d8101a60 2024-09-18T12:50:54.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.033+0000 7f07ddc5a640 1 -- 172.21.15.78:0/3946610784 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c4005290 con 0x7f07d8101a60 2024-09-18T12:50:54.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.033+0000 7f07d4ff9640 1 -- 172.21.15.78:0/3946610784 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f07cc042070 con 0x7f07d8101a60 2024-09-18T12:50:54.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.034+0000 7f07d4ff9640 1 --2- 172.21.15.78:0/3946610784 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f07c007b0b0 0x7f07c007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:54.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.034+0000 7f07d4ff9640 1 -- 172.21.15.78:0/3946610784 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f07cc0beb70 con 0x7f07d8101a60 2024-09-18T12:50:54.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.034+0000 7f07d77fe640 1 --2- 172.21.15.78:0/3946610784 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f07c007b0b0 0x7f07c007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:54.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.034+0000 7f07d77fe640 1 --2- 172.21.15.78:0/3946610784 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f07c007b0b0 0x7f07c007d570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f07c80058c0 tx=0x7f07c8005f90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:54.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.038+0000 7f07d4ff9640 1 -- 172.21.15.78:0/3946610784 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f07cc089fc0 con 0x7f07d8101a60 2024-09-18T12:50:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.294+0000 7f07ddc5a640 1 -- 172.21.15.78:0/3946610784 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f07c4000bc0 con 0x7f07c007b0b0 2024-09-18T12:50:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.295+0000 7f07d4ff9640 1 -- 172.21.15.78:0/3946610784 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f07c4000bc0 con 0x7f07c007b0b0 2024-09-18T12:50:54.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.297+0000 7f07ddc5a640 1 -- 172.21.15.78:0/3946610784 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f07c007b0b0 msgr2=0x7f07c007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:54.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.298+0000 7f07ddc5a640 1 --2- 172.21.15.78:0/3946610784 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f07c007b0b0 0x7f07c007d570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f07c80058c0 tx=0x7f07c8005f90 comp rx=0 tx=0).stop 2024-09-18T12:50:54.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.298+0000 7f07ddc5a640 1 -- 172.21.15.78:0/3946610784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d8101a60 msgr2=0x7f07d8197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:54.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.298+0000 7f07ddc5a640 1 --2- 172.21.15.78:0/3946610784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d8101a60 0x7f07d8197a80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f07cc006010 tx=0x7f07cc0045e0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.298+0000 7f07ddc5a640 1 -- 172.21.15.78:0/3946610784 shutdown_connections 2024-09-18T12:50:54.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.298+0000 7f07ddc5a640 1 --2- 172.21.15.78:0/3946610784 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f07c007b0b0 0x7f07c007d570 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.298+0000 7f07ddc5a640 1 --2- 172.21.15.78:0/3946610784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d8101a60 0x7f07d8197a80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.298+0000 7f07ddc5a640 1 --2- 172.21.15.78:0/3946610784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8100860 0x7f07d8197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.298+0000 7f07ddc5a640 1 -- 172.21.15.78:0/3946610784 >> 172.21.15.78:0/3946610784 conn(0x7f07d80fc010 msgr2=0x7f07d8069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:54.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.298+0000 7f07ddc5a640 1 -- 172.21.15.78:0/3946610784 shutdown_connections 2024-09-18T12:50:54.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.298+0000 7f07ddc5a640 1 -- 172.21.15.78:0/3946610784 wait complete. 2024-09-18T12:50:54.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.402+0000 7fb02d8c8640 1 -- 172.21.15.78:0/1239467636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028102410 msgr2=0x7fb028104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:54.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.402+0000 7fb02d8c8640 1 --2- 172.21.15.78:0/1239467636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028102410 0x7fb028104800 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb0180098b0 tx=0x7fb01802a4d0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.402+0000 7fb02d8c8640 1 -- 172.21.15.78:0/1239467636 shutdown_connections 2024-09-18T12:50:54.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.402+0000 7fb02d8c8640 1 --2- 172.21.15.78:0/1239467636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb028104d40 0x7fb028107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.402+0000 7fb02d8c8640 1 --2- 172.21.15.78:0/1239467636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028102410 0x7fb028104800 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.402+0000 7fb02d8c8640 1 -- 172.21.15.78:0/1239467636 >> 172.21.15.78:0/1239467636 conn(0x7fb0280fc010 msgr2=0x7fb0280fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:54.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.402+0000 7fb02d8c8640 1 -- 172.21.15.78:0/1239467636 shutdown_connections 2024-09-18T12:50:54.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.402+0000 7fb02d8c8640 1 -- 172.21.15.78:0/1239467636 wait complete. 2024-09-18T12:50:54.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.403+0000 7fb02d8c8640 1 Processor -- start 2024-09-18T12:50:54.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.403+0000 7fb02d8c8640 1 -- start start 2024-09-18T12:50:54.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.403+0000 7fb02d8c8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb028102410 0x7fb028197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:54.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.403+0000 7fb02d8c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028104d40 0x7fb028197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:54.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.403+0000 7fb02d8c8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb02810a7e0 con 0x7fb028104d40 2024-09-18T12:50:54.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.403+0000 7fb02d8c8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb02810a660 con 0x7fb028102410 2024-09-18T12:50:54.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.403+0000 7fb0267fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028104d40 0x7fb028197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:54.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.403+0000 7fb0267fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028104d40 0x7fb028197ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58638/0 (socket says 172.21.15.78:58638) 2024-09-18T12:50:54.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.403+0000 7fb0267fc640 1 -- 172.21.15.78:0/4163724952 learned_addr learned my addr 172.21.15.78:0/4163724952 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:50:54.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.403+0000 7fb026ffd640 1 --2- 172.21.15.78:0/4163724952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb028102410 0x7fb028197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:54.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.404+0000 7fb0267fc640 1 -- 172.21.15.78:0/4163724952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb028102410 msgr2=0x7fb028197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:54.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.404+0000 7fb0267fc640 1 --2- 172.21.15.78:0/4163724952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb028102410 0x7fb028197580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.404+0000 7fb0267fc640 1 -- 172.21.15.78:0/4163724952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb028198140 con 0x7fb028104d40 2024-09-18T12:50:54.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.404+0000 7fb026ffd640 1 --2- 172.21.15.78:0/4163724952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb028102410 0x7fb028197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:50:54.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.404+0000 7fb0267fc640 1 --2- 172.21.15.78:0/4163724952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028104d40 0x7fb028197ac0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00e940 tx=0x7fb01c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:54.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.404+0000 7fb02c8c6640 1 -- 172.21.15.78:0/4163724952 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb01c00cac0 con 0x7fb028104d40 2024-09-18T12:50:54.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.404+0000 7fb02c8c6640 1 -- 172.21.15.78:0/4163724952 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb01c0054e0 con 0x7fb028104d40 2024-09-18T12:50:54.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.404+0000 7fb02d8c8640 1 -- 172.21.15.78:0/4163724952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb02819cb80 con 0x7fb028104d40 2024-09-18T12:50:54.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.404+0000 7fb02c8c6640 1 -- 172.21.15.78:0/4163724952 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb01c004e40 con 0x7fb028104d40 2024-09-18T12:50:54.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.404+0000 7fb02d8c8640 1 -- 172.21.15.78:0/4163724952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb02819d110 con 0x7fb028104d40 2024-09-18T12:50:54.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.405+0000 7fb02d8c8640 1 -- 172.21.15.78:0/4163724952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0281027f0 con 0x7fb028104d40 2024-09-18T12:50:54.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.406+0000 7fb02c8c6640 1 -- 172.21.15.78:0/4163724952 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7fb01c004fe0 con 0x7fb028104d40 2024-09-18T12:50:54.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.407+0000 7fb02c8c6640 1 --2- 172.21.15.78:0/4163724952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb01007b050 0x7fb01007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:54.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.407+0000 7fb02c8c6640 1 -- 172.21.15.78:0/4163724952 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fb01c09e870 con 0x7fb028104d40 2024-09-18T12:50:54.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.407+0000 7fb026ffd640 1 --2- 172.21.15.78:0/4163724952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb01007b050 0x7fb01007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:54.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.407+0000 7fb026ffd640 1 --2- 172.21.15.78:0/4163724952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb01007b050 0x7fb01007d510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb018006010 tx=0x7fb0180058d0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:54.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.411+0000 7fb02c8c6640 1 -- 172.21.15.78:0/4163724952 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fb01c069ca0 con 0x7fb028104d40 2024-09-18T12:50:54.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:54 smithi078 ceph-mon[28091]: pgmap v17: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.9 MiB/s wr, 268 op/s 2024-09-18T12:50:54.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.696+0000 7fb02d8c8640 1 -- 172.21.15.78:0/4163724952 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb028105740 con 0x7fb01007b050 2024-09-18T12:50:54.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.707+0000 7fb02c8c6640 1 -- 172.21.15.78:0/4163724952 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb028105740 con 0x7fb01007b050 2024-09-18T12:50:54.708 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:50:54.708 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (8m) 11s ago 9m 26.3M - 0.25.0 c8568f914cd2 47a8b8bee5f5 2024-09-18T12:50:54.708 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (77s) 11s ago 9m 8497k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:50:54.708 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (64s) 23s ago 9m 7964k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:50:54.708 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (9m) 11s ago 9m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de bb77146b81c7 2024-09-18T12:50:54.708 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (9m) 23s ago 9m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de f82fdd264dc6 2024-09-18T12:50:54.708 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (8m) 11s ago 9m 81.9M - 9.4.12 2bacad6d85d8 0367cad8b635 2024-09-18T12:50:54.709 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (4m) 11s ago 4m 225M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:50:54.709 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (4m) 11s ago 4m 27.0M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:50:54.709 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (4m) 23s ago 4m 14.3M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:50:54.709 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (4m) 23s ago 4m 15.1M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:50:54.709 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (58s) 11s ago 10m 488M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:50:54.709 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (2m) 23s ago 8m 119M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1c064b119458 2024-09-18T12:50:54.709 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (10m) 11s ago 11m 56.7M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1cb11a5bcd72 2024-09-18T12:50:54.709 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (8m) 23s ago 8m 45.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 02dfe1551226 2024-09-18T12:50:54.709 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (9m) 11s ago 9m 15.6M - 1.5.0 0da6a335fe13 3c6ba926bb86 2024-09-18T12:50:54.709 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (8m) 23s ago 8m 16.5M - 1.5.0 0da6a335fe13 4b7db3027dc5 2024-09-18T12:50:54.709 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (7m) 11s ago 7m 180M 1216M 19.1.1-330-gc2ddf972 ebb0615149de f634ad9ddb36 2024-09-18T12:50:54.709 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (7m) 11s ago 7m 195M 1216M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:50:54.709 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (6m) 11s ago 6m 163M 1216M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:50:54.710 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (6m) 23s ago 6m 208M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:50:54.710 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (5m) 23s ago 5m 185M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:50:54.710 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (5m) 23s ago 5m 173M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:50:54.710 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (68s) 11s ago 9m 49.1M - 2.43.0 a07b618ecd1d d913428c200a 2024-09-18T12:50:54.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.710+0000 7fb02d8c8640 1 -- 172.21.15.78:0/4163724952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb01007b050 msgr2=0x7fb01007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:54.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.710+0000 7fb02d8c8640 1 --2- 172.21.15.78:0/4163724952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb01007b050 0x7fb01007d510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb018006010 tx=0x7fb0180058d0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.710+0000 7fb02d8c8640 1 -- 172.21.15.78:0/4163724952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028104d40 msgr2=0x7fb028197ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:54.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.710+0000 7fb02d8c8640 1 --2- 172.21.15.78:0/4163724952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028104d40 0x7fb028197ac0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00e940 tx=0x7fb01c00ee00 comp rx=0 tx=0).stop 2024-09-18T12:50:54.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.710+0000 7fb02d8c8640 1 -- 172.21.15.78:0/4163724952 shutdown_connections 2024-09-18T12:50:54.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.710+0000 7fb02d8c8640 1 --2- 172.21.15.78:0/4163724952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb01007b050 0x7fb01007d510 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.710+0000 7fb02d8c8640 1 --2- 172.21.15.78:0/4163724952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028104d40 0x7fb028197ac0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.710+0000 7fb02d8c8640 1 --2- 172.21.15.78:0/4163724952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb028102410 0x7fb028197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.710+0000 7fb02d8c8640 1 -- 172.21.15.78:0/4163724952 >> 172.21.15.78:0/4163724952 conn(0x7fb0280fc010 msgr2=0x7fb0280fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:54.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.710+0000 7fb02d8c8640 1 -- 172.21.15.78:0/4163724952 shutdown_connections 2024-09-18T12:50:54.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.710+0000 7fb02d8c8640 1 -- 172.21.15.78:0/4163724952 wait complete. 2024-09-18T12:50:54.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:54 smithi148 ceph-mon[35352]: pgmap v17: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.9 MiB/s wr, 268 op/s 2024-09-18T12:50:54.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.799+0000 7fea62a55640 1 -- 172.21.15.78:0/214879584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea5c101960 msgr2=0x7fea5c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:54.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.799+0000 7fea62a55640 1 --2- 172.21.15.78:0/214879584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea5c101960 0x7fea5c101d60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fea4c009880 tx=0x7fea4c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.799+0000 7fea62a55640 1 -- 172.21.15.78:0/214879584 shutdown_connections 2024-09-18T12:50:54.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.799+0000 7fea62a55640 1 --2- 172.21.15.78:0/214879584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea5c102b60 0x7fea5c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.799+0000 7fea62a55640 1 --2- 172.21.15.78:0/214879584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea5c101960 0x7fea5c101d60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.799+0000 7fea62a55640 1 -- 172.21.15.78:0/214879584 >> 172.21.15.78:0/214879584 conn(0x7fea5c0fd110 msgr2=0x7fea5c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:54.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.799+0000 7fea62a55640 1 -- 172.21.15.78:0/214879584 shutdown_connections 2024-09-18T12:50:54.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.799+0000 7fea62a55640 1 -- 172.21.15.78:0/214879584 wait complete. 2024-09-18T12:50:54.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.800+0000 7fea62a55640 1 Processor -- start 2024-09-18T12:50:54.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.800+0000 7fea62a55640 1 -- start start 2024-09-18T12:50:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.800+0000 7fea62a55640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea5c101960 0x7fea5c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.800+0000 7fea62a55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea5c102b60 0x7fea5c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.800+0000 7fea62a55640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c10a7a0 con 0x7fea5c102b60 2024-09-18T12:50:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.800+0000 7fea62a55640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c10a620 con 0x7fea5c101960 2024-09-18T12:50:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.801+0000 7fea5bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea5c101960 0x7fea5c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.801+0000 7fea5b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea5c102b60 0x7fea5c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.801+0000 7fea5bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea5c101960 0x7fea5c075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.78:42966/0 (socket says 172.21.15.78:42966) 2024-09-18T12:50:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.801+0000 7fea5bfff640 1 -- 172.21.15.78:0/3175238232 learned_addr learned my addr 172.21.15.78:0/3175238232 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:50:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.801+0000 7fea5bfff640 1 -- 172.21.15.78:0/3175238232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea5c102b60 msgr2=0x7fea5c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:54.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.801+0000 7fea5bfff640 1 --2- 172.21.15.78:0/3175238232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea5c102b60 0x7fea5c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:54.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.801+0000 7fea5bfff640 1 -- 172.21.15.78:0/3175238232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5c074b20 con 0x7fea5c101960 2024-09-18T12:50:54.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.801+0000 7fea5bfff640 1 --2- 172.21.15.78:0/3175238232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea5c101960 0x7fea5c075f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea4c009230 tx=0x7fea4c0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:54.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.801+0000 7fea597fa640 1 -- 172.21.15.78:0/3175238232 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea4c03f070 con 0x7fea5c101960 2024-09-18T12:50:54.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.801+0000 7fea62a55640 1 -- 172.21.15.78:0/3175238232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5c074db0 con 0x7fea5c101960 2024-09-18T12:50:54.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.801+0000 7fea597fa640 1 -- 172.21.15.78:0/3175238232 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea4c0049d0 con 0x7fea5c101960 2024-09-18T12:50:54.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.801+0000 7fea597fa640 1 -- 172.21.15.78:0/3175238232 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea4c035030 con 0x7fea5c101960 2024-09-18T12:50:54.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.802+0000 7fea62a55640 1 -- 172.21.15.78:0/3175238232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea5c0752e0 con 0x7fea5c101960 2024-09-18T12:50:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.803+0000 7fea62a55640 1 -- 172.21.15.78:0/3175238232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea5c101d60 con 0x7fea5c101960 2024-09-18T12:50:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.804+0000 7fea597fa640 1 -- 172.21.15.78:0/3175238232 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7fea4c042070 con 0x7fea5c101960 2024-09-18T12:50:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.805+0000 7fea597fa640 1 --2- 172.21.15.78:0/3175238232 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fea4407b050 0x7fea4407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.805+0000 7fea597fa640 1 -- 172.21.15.78:0/3175238232 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fea4c0beda0 con 0x7fea5c101960 2024-09-18T12:50:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.805+0000 7fea5b7fe640 1 --2- 172.21.15.78:0/3175238232 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fea4407b050 0x7fea4407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.805+0000 7fea5b7fe640 1 --2- 172.21.15.78:0/3175238232 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fea4407b050 0x7fea4407d510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fea5c075ca0 tx=0x7fea50005f90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:54.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:54.809+0000 7fea597fa640 1 -- 172.21.15.78:0/3175238232 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fea4c08a130 con 0x7fea5c101960 2024-09-18T12:50:55.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.150+0000 7fea62a55640 1 -- 172.21.15.78:0/3175238232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fea5c062df0 con 0x7fea5c101960 2024-09-18T12:50:55.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.150+0000 7fea597fa640 1 -- 172.21.15.78:0/3175238232 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fea4c08efe0 con 0x7fea5c101960 2024-09-18T12:50:55.152 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:50:55.152 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:50:55.152 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:50:55.152 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:50:55.152 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:50:55.152 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:50:55.152 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:50:55.153 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:50:55.153 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:50:55.153 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:50:55.153 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:50:55.153 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:50:55.153 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:50:55.153 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:50:55.153 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-18T12:50:55.153 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:50:55.153 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:50:55.153 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:50:55.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.153+0000 7fea62a55640 1 -- 172.21.15.78:0/3175238232 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fea4407b050 msgr2=0x7fea4407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:55.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.153+0000 7fea62a55640 1 --2- 172.21.15.78:0/3175238232 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fea4407b050 0x7fea4407d510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fea5c075ca0 tx=0x7fea50005f90 comp rx=0 tx=0).stop 2024-09-18T12:50:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.153+0000 7fea62a55640 1 -- 172.21.15.78:0/3175238232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea5c101960 msgr2=0x7fea5c075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.153+0000 7fea62a55640 1 --2- 172.21.15.78:0/3175238232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea5c101960 0x7fea5c075f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea4c009230 tx=0x7fea4c0045e0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.153+0000 7fea62a55640 1 -- 172.21.15.78:0/3175238232 shutdown_connections 2024-09-18T12:50:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.153+0000 7fea62a55640 1 --2- 172.21.15.78:0/3175238232 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fea4407b050 0x7fea4407d510 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.153+0000 7fea62a55640 1 --2- 172.21.15.78:0/3175238232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea5c102b60 0x7fea5c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.153+0000 7fea62a55640 1 --2- 172.21.15.78:0/3175238232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea5c101960 0x7fea5c075f20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.153+0000 7fea62a55640 1 -- 172.21.15.78:0/3175238232 >> 172.21.15.78:0/3175238232 conn(0x7fea5c0fd110 msgr2=0x7fea5c106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.153+0000 7fea62a55640 1 -- 172.21.15.78:0/3175238232 shutdown_connections 2024-09-18T12:50:55.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.153+0000 7fea62a55640 1 -- 172.21.15.78:0/3175238232 wait complete. 2024-09-18T12:50:55.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.246+0000 7fc971ba1640 1 -- 172.21.15.78:0/2594582335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc96c101a60 msgr2=0x7fc96c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:55.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.246+0000 7fc971ba1640 1 --2- 172.21.15.78:0/2594582335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc96c101a60 0x7fc96c101ee0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc960009880 tx=0x7fc96002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.246+0000 7fc971ba1640 1 -- 172.21.15.78:0/2594582335 shutdown_connections 2024-09-18T12:50:55.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.247+0000 7fc971ba1640 1 --2- 172.21.15.78:0/2594582335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc96c101a60 0x7fc96c101ee0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.247+0000 7fc971ba1640 1 --2- 172.21.15.78:0/2594582335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc96c100860 0x7fc96c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.247+0000 7fc971ba1640 1 -- 172.21.15.78:0/2594582335 >> 172.21.15.78:0/2594582335 conn(0x7fc96c0fc010 msgr2=0x7fc96c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:55.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.247+0000 7fc971ba1640 1 -- 172.21.15.78:0/2594582335 shutdown_connections 2024-09-18T12:50:55.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.247+0000 7fc971ba1640 1 -- 172.21.15.78:0/2594582335 wait complete. 2024-09-18T12:50:55.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.247+0000 7fc971ba1640 1 Processor -- start 2024-09-18T12:50:55.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.248+0000 7fc971ba1640 1 -- start start 2024-09-18T12:50:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.248+0000 7fc971ba1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc96c100860 0x7fc96c104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.248+0000 7fc971ba1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc96c101a60 0x7fc96c102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.248+0000 7fc971ba1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc96c1096a0 con 0x7fc96c101a60 2024-09-18T12:50:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.248+0000 7fc971ba1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc96c109520 con 0x7fc96c100860 2024-09-18T12:50:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.248+0000 7fc96affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc96c101a60 0x7fc96c102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.248+0000 7fc96affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc96c101a60 0x7fc96c102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58674/0 (socket says 172.21.15.78:58674) 2024-09-18T12:50:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.248+0000 7fc96affd640 1 -- 172.21.15.78:0/4053500147 learned_addr learned my addr 172.21.15.78:0/4053500147 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:50:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.248+0000 7fc96b7fe640 1 --2- 172.21.15.78:0/4053500147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc96c100860 0x7fc96c104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.249+0000 7fc96b7fe640 1 -- 172.21.15.78:0/4053500147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc96c101a60 msgr2=0x7fc96c102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.249+0000 7fc96b7fe640 1 --2- 172.21.15.78:0/4053500147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc96c101a60 0x7fc96c102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.249+0000 7fc96b7fe640 1 -- 172.21.15.78:0/4053500147 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc96c19b160 con 0x7fc96c100860 2024-09-18T12:50:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.249+0000 7fc96b7fe640 1 --2- 172.21.15.78:0/4053500147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc96c100860 0x7fc96c104780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc96c1018c0 tx=0x7fc95c00db30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.249+0000 7fc968ff9640 1 -- 172.21.15.78:0/4053500147 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc95c017070 con 0x7fc96c100860 2024-09-18T12:50:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.249+0000 7fc968ff9640 1 -- 172.21.15.78:0/4053500147 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc95c009c80 con 0x7fc96c100860 2024-09-18T12:50:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.249+0000 7fc971ba1640 1 -- 172.21.15.78:0/4053500147 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc96c103380 con 0x7fc96c100860 2024-09-18T12:50:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.249+0000 7fc968ff9640 1 -- 172.21.15.78:0/4053500147 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc95c00f3c0 con 0x7fc96c100860 2024-09-18T12:50:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.249+0000 7fc971ba1640 1 -- 172.21.15.78:0/4053500147 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc96c103910 con 0x7fc96c100860 2024-09-18T12:50:55.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.251+0000 7fc971ba1640 1 -- 172.21.15.78:0/4053500147 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc96c109e80 con 0x7fc96c100860 2024-09-18T12:50:55.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.251+0000 7fc968ff9640 1 -- 172.21.15.78:0/4053500147 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7fc95c01a070 con 0x7fc96c100860 2024-09-18T12:50:55.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.252+0000 7fc968ff9640 1 --2- 172.21.15.78:0/4053500147 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc95407b0b0 0x7fc95407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:55.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.252+0000 7fc968ff9640 1 -- 172.21.15.78:0/4053500147 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fc95c09dd00 con 0x7fc96c100860 2024-09-18T12:50:55.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.252+0000 7fc96affd640 1 --2- 172.21.15.78:0/4053500147 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc95407b0b0 0x7fc95407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:55.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.253+0000 7fc96affd640 1 --2- 172.21.15.78:0/4053500147 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc95407b0b0 0x7fc95407d570 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc9600096c0 tx=0x7fc960005a20 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:55.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.257+0000 7fc968ff9640 1 -- 172.21.15.78:0/4053500147 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fc95c0a1030 con 0x7fc96c100860 2024-09-18T12:50:55.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:55 smithi078 ceph-mon[28091]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:55.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:55 smithi078 ceph-mon[28091]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:55.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:55 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/3175238232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:50:55.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.525+0000 7fc971ba1640 1 -- 172.21.15.78:0/4053500147 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc96c06a400 con 0x7fc95407b0b0 2024-09-18T12:50:55.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.527+0000 7fc968ff9640 1 -- 172.21.15.78:0/4053500147 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7fc96c06a400 con 0x7fc95407b0b0 2024-09-18T12:50:55.529 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:50:55.529 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:50:55.529 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:50:55.529 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:50:55.529 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:50:55.529 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr" 2024-09-18T12:50:55.529 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:50:55.529 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "2/2 daemons upgraded", 2024-09-18T12:50:55.530 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-18T12:50:55.530 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:50:55.531 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:50:55.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.532+0000 7fc971ba1640 1 -- 172.21.15.78:0/4053500147 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc95407b0b0 msgr2=0x7fc95407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:55.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.532+0000 7fc971ba1640 1 --2- 172.21.15.78:0/4053500147 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc95407b0b0 0x7fc95407d570 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc9600096c0 tx=0x7fc960005a20 comp rx=0 tx=0).stop 2024-09-18T12:50:55.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.532+0000 7fc971ba1640 1 -- 172.21.15.78:0/4053500147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc96c100860 msgr2=0x7fc96c104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:55.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.532+0000 7fc971ba1640 1 --2- 172.21.15.78:0/4053500147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc96c100860 0x7fc96c104780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc96c1018c0 tx=0x7fc95c00db30 comp rx=0 tx=0).stop 2024-09-18T12:50:55.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.532+0000 7fc971ba1640 1 -- 172.21.15.78:0/4053500147 shutdown_connections 2024-09-18T12:50:55.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.532+0000 7fc971ba1640 1 --2- 172.21.15.78:0/4053500147 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc95407b0b0 0x7fc95407d570 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc9600096c0 tx=0x7fc960005a20 comp rx=0 tx=0).stop 2024-09-18T12:50:55.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.532+0000 7fc971ba1640 1 --2- 172.21.15.78:0/4053500147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc96c101a60 0x7fc96c102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.532+0000 7fc971ba1640 1 --2- 172.21.15.78:0/4053500147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc96c100860 0x7fc96c104780 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.532+0000 7fc971ba1640 1 -- 172.21.15.78:0/4053500147 >> 172.21.15.78:0/4053500147 conn(0x7fc96c0fc010 msgr2=0x7fc96c069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:55.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.532+0000 7fc971ba1640 1 -- 172.21.15.78:0/4053500147 shutdown_connections 2024-09-18T12:50:55.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:50:55.533+0000 7fc971ba1640 1 -- 172.21.15.78:0/4053500147 wait complete. 2024-09-18T12:50:55.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:55 smithi148 ceph-mon[35352]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:55.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:55 smithi148 ceph-mon[35352]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:55.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:55 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/3175238232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:50:56.617 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:56 smithi078 ceph-mon[28091]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:56.617 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:56 smithi078 ceph-mon[28091]: pgmap v18: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.3 MiB/s wr, 168 op/s 2024-09-18T12:50:56.617 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:56 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:56.685 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:56 smithi148 ceph-mon[35352]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:56.685 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:56 smithi148 ceph-mon[35352]: pgmap v18: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.3 MiB/s wr, 168 op/s 2024-09-18T12:50:56.685 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:56 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:57.617 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:57 smithi078 ceph-mon[28091]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:57 smithi148 ceph-mon[35352]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:58.309 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-18T12:50:58.309 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-18T12:50:58.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:50:58 smithi078 ceph-mon[28091]: pgmap v19: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1.9 MiB/s wr, 255 op/s 2024-09-18T12:50:58.659 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:50:58 smithi148 ceph-mon[35352]: pgmap v19: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1.9 MiB/s wr, 255 op/s 2024-09-18T12:50:58.660 DEBUG:teuthology.parallel:result is None 2024-09-18T12:51:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:00 smithi148 ceph-mon[35352]: pgmap v20: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 158 op/s 2024-09-18T12:51:00.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:00 smithi078 ceph-mon[28091]: pgmap v20: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 158 op/s 2024-09-18T12:51:02.421 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:02 smithi078 ceph-mon[28091]: pgmap v21: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1.4 MiB/s wr, 214 op/s 2024-09-18T12:51:02.421 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:02 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:02.421 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:02 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:02.421 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:02 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:51:02.421 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:02 smithi078 ceph-mon[28091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:51:02.421 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:02 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:02.422 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-18T12:51:02.423 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-18T12:51:02.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:02 smithi148 ceph-mon[35352]: pgmap v21: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1.4 MiB/s wr, 214 op/s 2024-09-18T12:51:02.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:02 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:02.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:02 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:02.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:02 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:51:02.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:02 smithi148 ceph-mon[35352]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:51:02.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:02 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:02.747 DEBUG:teuthology.parallel:result is None 2024-09-18T12:51:02.748 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T12:51:02.778 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T12:51:02.778 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-18T12:51:02.815 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-18T12:51:02.815 DEBUG:teuthology.parallel:result is None 2024-09-18T12:51:04.464 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:04 smithi148 ceph-mon[35352]: pgmap v22: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 226 op/s 2024-09-18T12:51:04.464 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:04 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.bfgshs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:51:04.464 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:04 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:51:04.464 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:04 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:04 smithi078 ceph-mon[28091]: pgmap v22: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 226 op/s 2024-09-18T12:51:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:04 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.bfgshs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:51:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:04 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:51:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:04 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:05.429 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:05 smithi148 ceph-mon[35352]: Upgrade: Updating mgr.smithi148.bfgshs 2024-09-18T12:51:05.429 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:05 smithi148 ceph-mon[35352]: Deploying daemon mgr.smithi148.bfgshs on smithi148 2024-09-18T12:51:05.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:05 smithi078 ceph-mon[28091]: Upgrade: Updating mgr.smithi148.bfgshs 2024-09-18T12:51:05.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:05 smithi078 ceph-mon[28091]: Deploying daemon mgr.smithi148.bfgshs on smithi148 2024-09-18T12:51:06.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:06 smithi078 ceph-mon[28091]: pgmap v23: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 177 op/s 2024-09-18T12:51:06.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:06 smithi148 ceph-mon[35352]: pgmap v23: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 177 op/s 2024-09-18T12:51:08.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:08 smithi148 ceph-mon[35352]: pgmap v24: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 1.4 MiB/s wr, 216 op/s 2024-09-18T12:51:08.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:08 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:08.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:08 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:08.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:08 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:08.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:08 smithi078 ceph-mon[28091]: pgmap v24: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 1.4 MiB/s wr, 216 op/s 2024-09-18T12:51:08.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:08 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:08.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:08 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:08.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:08 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:09.339 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:09 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:09.339 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:09 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:09.339 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:09 smithi148 ceph-mon[35352]: pgmap v25: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 802 KiB/s wr, 128 op/s 2024-09-18T12:51:09.566 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:09 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:09.566 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:09 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:09.566 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:09 smithi078 ceph-mon[28091]: pgmap v25: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 802 KiB/s wr, 128 op/s 2024-09-18T12:51:10.888 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:10 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:10.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:10 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:12.085 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:11 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:12.085 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:11 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:12.085 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:11 smithi078 ceph-mon[28091]: pgmap v26: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 802 KiB/s wr, 129 op/s 2024-09-18T12:51:12.085 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:11 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:12.085 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:11 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:12.131 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:11 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:12.131 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:11 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:12.131 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:11 smithi148 ceph-mon[35352]: pgmap v26: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 802 KiB/s wr, 129 op/s 2024-09-18T12:51:12.131 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:11 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:12.131 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:11 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:13.324 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:13 smithi148 ceph-mon[35352]: Standby manager daemon smithi148.bfgshs restarted 2024-09-18T12:51:13.324 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:13 smithi148 ceph-mon[35352]: Standby manager daemon smithi148.bfgshs started 2024-09-18T12:51:13.324 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:13 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/74882318' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/crt"}]: dispatch 2024-09-18T12:51:13.324 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:13 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/74882318' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:51:13.325 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:13 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/74882318' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/key"}]: dispatch 2024-09-18T12:51:13.325 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:13 smithi148 ceph-mon[35352]: from='mgr.? 172.21.15.148:0/74882318' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:51:13.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:13 smithi078 ceph-mon[28091]: Standby manager daemon smithi148.bfgshs restarted 2024-09-18T12:51:13.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:13 smithi078 ceph-mon[28091]: Standby manager daemon smithi148.bfgshs started 2024-09-18T12:51:13.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:13 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/74882318' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/crt"}]: dispatch 2024-09-18T12:51:13.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:13 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/74882318' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:51:13.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:13 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/74882318' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.bfgshs/key"}]: dispatch 2024-09-18T12:51:13.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:13 smithi078 ceph-mon[28091]: from='mgr.? 172.21.15.148:0/74882318' entity='mgr.smithi148.bfgshs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:51:14.168 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:14 smithi148 ceph-mon[35352]: pgmap v27: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7.8 KiB/s rd, 570 KiB/s wr, 73 op/s 2024-09-18T12:51:14.168 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:14 smithi148 ceph-mon[35352]: mgrmap e33: smithi078.ohifux(active, since 48s), standbys: smithi148.bfgshs 2024-09-18T12:51:14.168 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:14 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:14.168 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:14 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:14.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:14 smithi078 ceph-mon[28091]: pgmap v27: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7.8 KiB/s rd, 570 KiB/s wr, 73 op/s 2024-09-18T12:51:14.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:14 smithi078 ceph-mon[28091]: mgrmap e33: smithi078.ohifux(active, since 48s), standbys: smithi148.bfgshs 2024-09-18T12:51:14.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:14 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:14.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:14 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.674 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.674 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.674 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:15.674 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:51:15.674 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.675 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:15.675 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:15.675 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: Upgrade: Setting container_image for all mgr 2024-09-18T12:51:15.675 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.675 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi078.ohifux"}]: dispatch 2024-09-18T12:51:15.675 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi078.ohifux"}]': finished 2024-09-18T12:51:15.675 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi148.bfgshs"}]: dispatch 2024-09-18T12:51:15.675 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi148.bfgshs"}]': finished 2024-09-18T12:51:15.675 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:15.675 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: Upgrade: Setting container_image for all rgw 2024-09-18T12:51:15.675 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.675 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:15.675 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: Upgrade: Setting container_image for all rbd-mirror 2024-09-18T12:51:15.676 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.676 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:15.676 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-18T12:51:15.676 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.676 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:15.676 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: Upgrade: Setting container_image for all iscsi 2024-09-18T12:51:15.676 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.676 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:15.676 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: Upgrade: Setting container_image for all nfs 2024-09-18T12:51:15.676 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.676 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:15.676 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: Upgrade: Setting container_image for all nvmeof 2024-09-18T12:51:15.676 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.677 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:15 smithi078 ceph-mon[28091]: pgmap v28: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7.8 KiB/s rd, 221 KiB/s wr, 39 op/s 2024-09-18T12:51:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:15.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:51:15.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:15.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:15.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: Upgrade: Setting container_image for all mgr 2024-09-18T12:51:15.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi078.ohifux"}]: dispatch 2024-09-18T12:51:15.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi078.ohifux"}]': finished 2024-09-18T12:51:15.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi148.bfgshs"}]: dispatch 2024-09-18T12:51:15.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi148.bfgshs"}]': finished 2024-09-18T12:51:15.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:15.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: Upgrade: Setting container_image for all rgw 2024-09-18T12:51:15.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:15.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: Upgrade: Setting container_image for all rbd-mirror 2024-09-18T12:51:15.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:15.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-18T12:51:15.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:15.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: Upgrade: Setting container_image for all iscsi 2024-09-18T12:51:15.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:15.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: Upgrade: Setting container_image for all nfs 2024-09-18T12:51:15.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:15.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: Upgrade: Setting container_image for all nvmeof 2024-09-18T12:51:15.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:15.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:15 smithi148 ceph-mon[35352]: pgmap v28: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7.8 KiB/s rd, 221 KiB/s wr, 39 op/s 2024-09-18T12:51:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:16 smithi078 ceph-mon[28091]: Upgrade: Updating node-exporter.smithi078 (1/2) 2024-09-18T12:51:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:16 smithi078 ceph-mon[28091]: Deploying daemon node-exporter.smithi078 on smithi078 2024-09-18T12:51:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:16 smithi148 ceph-mon[35352]: Upgrade: Updating node-exporter.smithi078 (1/2) 2024-09-18T12:51:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:16 smithi148 ceph-mon[35352]: Deploying daemon node-exporter.smithi078 on smithi078 2024-09-18T12:51:17.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:17 smithi078 ceph-mon[28091]: pgmap v29: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7.8 KiB/s rd, 221 KiB/s wr, 39 op/s 2024-09-18T12:51:17.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:17 smithi148 ceph-mon[35352]: pgmap v29: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7.8 KiB/s rd, 221 KiB/s wr, 39 op/s 2024-09-18T12:51:20.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:20 smithi148 ceph-mon[35352]: pgmap v30: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 426 B/s wr, 0 op/s 2024-09-18T12:51:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:20 smithi078 ceph-mon[28091]: pgmap v30: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 426 B/s wr, 0 op/s 2024-09-18T12:51:22.343 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:22 smithi148 ceph-mon[35352]: pgmap v31: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 426 B/s wr, 0 op/s 2024-09-18T12:51:22.344 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:22 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:22.344 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:22 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:22.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:22 smithi078 ceph-mon[28091]: pgmap v31: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 426 B/s wr, 0 op/s 2024-09-18T12:51:22.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:22 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:22.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:22 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:24.331 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:24 smithi148 ceph-mon[35352]: Upgrade: Updating node-exporter.smithi148 (2/2) 2024-09-18T12:51:24.331 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:24 smithi148 ceph-mon[35352]: Deploying daemon node-exporter.smithi148 on smithi148 2024-09-18T12:51:24.332 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:24 smithi148 ceph-mon[35352]: pgmap v32: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-18T12:51:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:24 smithi078 ceph-mon[28091]: Upgrade: Updating node-exporter.smithi148 (2/2) 2024-09-18T12:51:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:24 smithi078 ceph-mon[28091]: Deploying daemon node-exporter.smithi148 on smithi148 2024-09-18T12:51:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:24 smithi078 ceph-mon[28091]: pgmap v32: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-18T12:51:25.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.633+0000 7f8ecd2af640 1 -- 172.21.15.78:0/3956589764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec81023f0 msgr2=0x7f8ec81047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:25.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.633+0000 7f8ecd2af640 1 --2- 172.21.15.78:0/3956589764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec81023f0 0x7f8ec81047e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80098b0 tx=0x7f8eb802a4d0 comp rx=0 tx=0).stop 2024-09-18T12:51:25.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.633+0000 7f8ecd2af640 1 -- 172.21.15.78:0/3956589764 shutdown_connections 2024-09-18T12:51:25.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.633+0000 7f8ecd2af640 1 --2- 172.21.15.78:0/3956589764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ec8104d20 0x7f8ec8107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:25.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.633+0000 7f8ecd2af640 1 --2- 172.21.15.78:0/3956589764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec81023f0 0x7f8ec81047e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:25.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.633+0000 7f8ecd2af640 1 -- 172.21.15.78:0/3956589764 >> 172.21.15.78:0/3956589764 conn(0x7f8ec80fc010 msgr2=0x7f8ec80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:25.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.633+0000 7f8ecd2af640 1 -- 172.21.15.78:0/3956589764 shutdown_connections 2024-09-18T12:51:25.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.633+0000 7f8ecd2af640 1 -- 172.21.15.78:0/3956589764 wait complete. 2024-09-18T12:51:25.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.634+0000 7f8ecd2af640 1 Processor -- start 2024-09-18T12:51:25.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.634+0000 7f8ecd2af640 1 -- start start 2024-09-18T12:51:25.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.634+0000 7f8ecd2af640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ec81023f0 0x7f8ec8197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:25.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.634+0000 7f8ecd2af640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec8104d20 0x7f8ec8197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:25.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.634+0000 7f8ecd2af640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec810a7c0 con 0x7f8ec8104d20 2024-09-18T12:51:25.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.634+0000 7f8ecd2af640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec810a640 con 0x7f8ec81023f0 2024-09-18T12:51:25.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.635+0000 7f8ec67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec8104d20 0x7f8ec8197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:25.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.635+0000 7f8ec67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec8104d20 0x7f8ec8197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36916/0 (socket says 172.21.15.78:36916) 2024-09-18T12:51:25.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.635+0000 7f8ec67fc640 1 -- 172.21.15.78:0/234359050 learned_addr learned my addr 172.21.15.78:0/234359050 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:51:25.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.635+0000 7f8ec6ffd640 1 --2- 172.21.15.78:0/234359050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ec81023f0 0x7f8ec8197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:25.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.635+0000 7f8ec67fc640 1 -- 172.21.15.78:0/234359050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ec81023f0 msgr2=0x7f8ec8197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.635+0000 7f8ec67fc640 1 --2- 172.21.15.78:0/234359050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ec81023f0 0x7f8ec8197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.635+0000 7f8ec67fc640 1 -- 172.21.15.78:0/234359050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec8198110 con 0x7f8ec8104d20 2024-09-18T12:51:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.635+0000 7f8ec67fc640 1 --2- 172.21.15.78:0/234359050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec8104d20 0x7f8ec8197a90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00d6f0 tx=0x7f8ebc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.635+0000 7f8eaffff640 1 -- 172.21.15.78:0/234359050 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ebc017070 con 0x7f8ec8104d20 2024-09-18T12:51:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.635+0000 7f8ecd2af640 1 -- 172.21.15.78:0/234359050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec819cb50 con 0x7f8ec8104d20 2024-09-18T12:51:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.635+0000 7f8eaffff640 1 -- 172.21.15.78:0/234359050 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ebc00de00 con 0x7f8ec8104d20 2024-09-18T12:51:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.635+0000 7f8eaffff640 1 -- 172.21.15.78:0/234359050 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ebc00f3c0 con 0x7f8ec8104d20 2024-09-18T12:51:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.636+0000 7f8ecd2af640 1 -- 172.21.15.78:0/234359050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec819d0e0 con 0x7f8ec8104d20 2024-09-18T12:51:25.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.637+0000 7f8ecd2af640 1 -- 172.21.15.78:0/234359050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ec81027d0 con 0x7f8ec8104d20 2024-09-18T12:51:25.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.637+0000 7f8eaffff640 1 -- 172.21.15.78:0/234359050 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f8ebc01a070 con 0x7f8ec8104d20 2024-09-18T12:51:25.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.638+0000 7f8eaffff640 1 --2- 172.21.15.78:0/234359050 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8eb007b0b0 0x7f8eb007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:25.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.638+0000 7f8eaffff640 1 -- 172.21.15.78:0/234359050 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f8ebc09dd70 con 0x7f8ec8104d20 2024-09-18T12:51:25.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.638+0000 7f8ec6ffd640 1 --2- 172.21.15.78:0/234359050 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8eb007b0b0 0x7f8eb007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:25.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.638+0000 7f8ec6ffd640 1 --2- 172.21.15.78:0/234359050 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8eb007b0b0 0x7f8eb007d570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8006010 tx=0x7f8eb80058d0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.642+0000 7f8eaffff640 1 -- 172.21.15.78:0/234359050 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f8ebc021030 con 0x7f8ec8104d20 2024-09-18T12:51:25.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.832+0000 7f8ecd2af640 1 -- 172.21.15.78:0/234359050 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8ec8105700 con 0x7f8eb007b0b0 2024-09-18T12:51:25.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.834+0000 7f8eaffff640 1 -- 172.21.15.78:0/234359050 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f8ec8105700 con 0x7f8eb007b0b0 2024-09-18T12:51:25.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.837+0000 7f8ecd2af640 1 -- 172.21.15.78:0/234359050 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8eb007b0b0 msgr2=0x7f8eb007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:25.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.837+0000 7f8ecd2af640 1 --2- 172.21.15.78:0/234359050 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8eb007b0b0 0x7f8eb007d570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8006010 tx=0x7f8eb80058d0 comp rx=0 tx=0).stop 2024-09-18T12:51:25.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.837+0000 7f8ecd2af640 1 -- 172.21.15.78:0/234359050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec8104d20 msgr2=0x7f8ec8197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:25.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.837+0000 7f8ecd2af640 1 --2- 172.21.15.78:0/234359050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec8104d20 0x7f8ec8197a90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00d6f0 tx=0x7f8ebc00dbb0 comp rx=0 tx=0).stop 2024-09-18T12:51:25.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.837+0000 7f8ecd2af640 1 -- 172.21.15.78:0/234359050 shutdown_connections 2024-09-18T12:51:25.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.837+0000 7f8ecd2af640 1 --2- 172.21.15.78:0/234359050 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8eb007b0b0 0x7f8eb007d570 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:25.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.837+0000 7f8ecd2af640 1 --2- 172.21.15.78:0/234359050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec8104d20 0x7f8ec8197a90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:25.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.837+0000 7f8ecd2af640 1 --2- 172.21.15.78:0/234359050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ec81023f0 0x7f8ec8197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:25.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.837+0000 7f8ecd2af640 1 -- 172.21.15.78:0/234359050 >> 172.21.15.78:0/234359050 conn(0x7f8ec80fc010 msgr2=0x7f8ec80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:25.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.837+0000 7f8ecd2af640 1 -- 172.21.15.78:0/234359050 shutdown_connections 2024-09-18T12:51:25.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.837+0000 7f8ecd2af640 1 -- 172.21.15.78:0/234359050 wait complete. 2024-09-18T12:51:25.847 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:51:25.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.918+0000 7fe4dd8b6640 1 -- 172.21.15.78:0/1418334559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d8102b60 msgr2=0x7fe4d8102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:25.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.918+0000 7fe4dd8b6640 1 --2- 172.21.15.78:0/1418334559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d8102b60 0x7fe4d8102fe0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009880 tx=0x7fe4c002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:51:25.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.918+0000 7fe4dd8b6640 1 -- 172.21.15.78:0/1418334559 shutdown_connections 2024-09-18T12:51:25.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.918+0000 7fe4dd8b6640 1 --2- 172.21.15.78:0/1418334559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d8102b60 0x7fe4d8102fe0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:25.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.918+0000 7fe4dd8b6640 1 --2- 172.21.15.78:0/1418334559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4d8101960 0x7fe4d8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:25.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.918+0000 7fe4dd8b6640 1 -- 172.21.15.78:0/1418334559 >> 172.21.15.78:0/1418334559 conn(0x7fe4d80fd0f0 msgr2=0x7fe4d80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:25.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.918+0000 7fe4dd8b6640 1 -- 172.21.15.78:0/1418334559 shutdown_connections 2024-09-18T12:51:25.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.918+0000 7fe4dd8b6640 1 -- 172.21.15.78:0/1418334559 wait complete. 2024-09-18T12:51:25.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.919+0000 7fe4dd8b6640 1 Processor -- start 2024-09-18T12:51:25.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.919+0000 7fe4dd8b6640 1 -- start start 2024-09-18T12:51:25.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.919+0000 7fe4dd8b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d8101960 0x7fe4d8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:25.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.919+0000 7fe4dd8b6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4d8102b60 0x7fe4d80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:25.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.919+0000 7fe4dd8b6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d810a780 con 0x7fe4d8101960 2024-09-18T12:51:25.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.919+0000 7fe4dd8b6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d810a600 con 0x7fe4d8102b60 2024-09-18T12:51:25.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.919+0000 7fe4d6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d8101960 0x7fe4d8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:25.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.919+0000 7fe4d6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d8101960 0x7fe4d8075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36936/0 (socket says 172.21.15.78:36936) 2024-09-18T12:51:25.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.919+0000 7fe4d6ffd640 1 -- 172.21.15.78:0/2409233610 learned_addr learned my addr 172.21.15.78:0/2409233610 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:51:25.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.919+0000 7fe4ce7fc640 1 --2- 172.21.15.78:0/2409233610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4d8102b60 0x7fe4d80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:25.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.919+0000 7fe4d6ffd640 1 -- 172.21.15.78:0/2409233610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4d8102b60 msgr2=0x7fe4d80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:25.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.919+0000 7fe4d6ffd640 1 --2- 172.21.15.78:0/2409233610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4d8102b60 0x7fe4d80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:25.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.920+0000 7fe4d6ffd640 1 -- 172.21.15.78:0/2409233610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d8074b20 con 0x7fe4d8101960 2024-09-18T12:51:25.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.920+0000 7fe4d6ffd640 1 --2- 172.21.15.78:0/2409233610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d8101960 0x7fe4d8075f20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800d8d0 tx=0x7fe4c800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:25.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.920+0000 7fe4dc8b4640 1 -- 172.21.15.78:0/2409233610 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4c8017020 con 0x7fe4d8101960 2024-09-18T12:51:25.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.920+0000 7fe4dd8b6640 1 -- 172.21.15.78:0/2409233610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d8074e10 con 0x7fe4d8101960 2024-09-18T12:51:25.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.920+0000 7fe4dc8b4640 1 -- 172.21.15.78:0/2409233610 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe4c8010460 con 0x7fe4d8101960 2024-09-18T12:51:25.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.920+0000 7fe4dc8b4640 1 -- 172.21.15.78:0/2409233610 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4c800f5b0 con 0x7fe4d8101960 2024-09-18T12:51:25.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.920+0000 7fe4dd8b6640 1 -- 172.21.15.78:0/2409233610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d8075370 con 0x7fe4d8101960 2024-09-18T12:51:25.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.921+0000 7fe4dd8b6640 1 -- 172.21.15.78:0/2409233610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d8101d60 con 0x7fe4d8101960 2024-09-18T12:51:25.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.922+0000 7fe4dc8b4640 1 -- 172.21.15.78:0/2409233610 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7fe4c801a020 con 0x7fe4d8101960 2024-09-18T12:51:25.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.922+0000 7fe4dc8b4640 1 --2- 172.21.15.78:0/2409233610 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe4c407b050 0x7fe4c407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:25.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.922+0000 7fe4dc8b4640 1 -- 172.21.15.78:0/2409233610 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fe4c809e410 con 0x7fe4d8101960 2024-09-18T12:51:25.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.923+0000 7fe4ce7fc640 1 --2- 172.21.15.78:0/2409233610 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe4c407b050 0x7fe4c407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:25.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.923+0000 7fe4ce7fc640 1 --2- 172.21.15.78:0/2409233610 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe4c407b050 0x7fe4c407d510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0000c00 tx=0x7fe4c00058d0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:25.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:25.926+0000 7fe4dc8b4640 1 -- 172.21.15.78:0/2409233610 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fe4c8021030 con 0x7fe4d8101960 2024-09-18T12:51:26.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.121+0000 7fe4dd8b6640 1 -- 172.21.15.78:0/2409233610 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe4d8062630 con 0x7fe4c407b050 2024-09-18T12:51:26.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.123+0000 7fe4dc8b4640 1 -- 172.21.15.78:0/2409233610 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7fe4d8062630 con 0x7fe4c407b050 2024-09-18T12:51:26.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.125+0000 7fe4dd8b6640 1 -- 172.21.15.78:0/2409233610 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe4c407b050 msgr2=0x7fe4c407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:26.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.125+0000 7fe4dd8b6640 1 --2- 172.21.15.78:0/2409233610 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe4c407b050 0x7fe4c407d510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0000c00 tx=0x7fe4c00058d0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.125+0000 7fe4dd8b6640 1 -- 172.21.15.78:0/2409233610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d8101960 msgr2=0x7fe4d8075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:26.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.125+0000 7fe4dd8b6640 1 --2- 172.21.15.78:0/2409233610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d8101960 0x7fe4d8075f20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800d8d0 tx=0x7fe4c800dd90 comp rx=0 tx=0).stop 2024-09-18T12:51:26.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.125+0000 7fe4dd8b6640 1 -- 172.21.15.78:0/2409233610 shutdown_connections 2024-09-18T12:51:26.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.125+0000 7fe4dd8b6640 1 --2- 172.21.15.78:0/2409233610 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe4c407b050 0x7fe4c407d510 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.125+0000 7fe4dd8b6640 1 --2- 172.21.15.78:0/2409233610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4d8102b60 0x7fe4d80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.125+0000 7fe4dd8b6640 1 --2- 172.21.15.78:0/2409233610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d8101960 0x7fe4d8075f20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.125+0000 7fe4dd8b6640 1 -- 172.21.15.78:0/2409233610 >> 172.21.15.78:0/2409233610 conn(0x7fe4d80fd0f0 msgr2=0x7fe4d8105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:26.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.125+0000 7fe4dd8b6640 1 -- 172.21.15.78:0/2409233610 shutdown_connections 2024-09-18T12:51:26.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.125+0000 7fe4dd8b6640 1 -- 172.21.15.78:0/2409233610 wait complete. 2024-09-18T12:51:26.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.206+0000 7f7d74459640 1 -- 172.21.15.78:0/2168036749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d6c101960 msgr2=0x7f7d6c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:26.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.206+0000 7f7d74459640 1 --2- 172.21.15.78:0/2168036749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d6c101960 0x7f7d6c101d60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009880 tx=0x7f7d6802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.208 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:26 smithi078 ceph-mon[28091]: pgmap v33: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:26.208 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:26 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.206+0000 7f7d74459640 1 -- 172.21.15.78:0/2168036749 shutdown_connections 2024-09-18T12:51:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.206+0000 7f7d74459640 1 --2- 172.21.15.78:0/2168036749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d6c102b60 0x7f7d6c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.206+0000 7f7d74459640 1 --2- 172.21.15.78:0/2168036749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d6c101960 0x7f7d6c101d60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.206+0000 7f7d74459640 1 -- 172.21.15.78:0/2168036749 >> 172.21.15.78:0/2168036749 conn(0x7f7d6c0fd0f0 msgr2=0x7f7d6c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.206+0000 7f7d74459640 1 -- 172.21.15.78:0/2168036749 shutdown_connections 2024-09-18T12:51:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.206+0000 7f7d74459640 1 -- 172.21.15.78:0/2168036749 wait complete. 2024-09-18T12:51:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.207+0000 7f7d74459640 1 Processor -- start 2024-09-18T12:51:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.207+0000 7f7d74459640 1 -- start start 2024-09-18T12:51:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.207+0000 7f7d74459640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d6c101960 0x7f7d6c1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:26.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.207+0000 7f7d74459640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d6c102b60 0x7f7d6c197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.207+0000 7f7d74459640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c10a7a0 con 0x7f7d6c102b60 2024-09-18T12:51:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.207+0000 7f7d74459640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c10a620 con 0x7f7d6c101960 2024-09-18T12:51:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.207+0000 7f7d719f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d6c102b60 0x7f7d6c197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.207+0000 7f7d721f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d6c101960 0x7f7d6c1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.207+0000 7f7d719f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d6c102b60 0x7f7d6c197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36942/0 (socket says 172.21.15.78:36942) 2024-09-18T12:51:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.207+0000 7f7d721f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d6c101960 0x7f7d6c1974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.78:55248/0 (socket says 172.21.15.78:55248) 2024-09-18T12:51:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.208+0000 7f7d719f4640 1 -- 172.21.15.78:0/4133342418 learned_addr learned my addr 172.21.15.78:0/4133342418 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:51:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.208+0000 7f7d719f4640 1 -- 172.21.15.78:0/4133342418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d6c101960 msgr2=0x7f7d6c1974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.208+0000 7f7d719f4640 1 --2- 172.21.15.78:0/4133342418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d6c101960 0x7f7d6c1974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.208+0000 7f7d719f4640 1 -- 172.21.15.78:0/4133342418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6c198090 con 0x7f7d6c102b60 2024-09-18T12:51:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.208+0000 7f7d719f4640 1 --2- 172.21.15.78:0/4133342418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d6c102b60 0x7f7d6c197a10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c00d6f0 tx=0x7f7d5c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.208+0000 7f7d637fe640 1 -- 172.21.15.78:0/4133342418 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d5c017070 con 0x7f7d6c102b60 2024-09-18T12:51:26.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.208+0000 7f7d637fe640 1 -- 172.21.15.78:0/4133342418 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d5c00de00 con 0x7f7d6c102b60 2024-09-18T12:51:26.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.208+0000 7f7d637fe640 1 -- 172.21.15.78:0/4133342418 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d5c004bb0 con 0x7f7d6c102b60 2024-09-18T12:51:26.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.208+0000 7f7d74459640 1 -- 172.21.15.78:0/4133342418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d6c19cad0 con 0x7f7d6c102b60 2024-09-18T12:51:26.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.208+0000 7f7d74459640 1 -- 172.21.15.78:0/4133342418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d6c19d060 con 0x7f7d6c102b60 2024-09-18T12:51:26.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.209+0000 7f7d74459640 1 -- 172.21.15.78:0/4133342418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d6c101d60 con 0x7f7d6c102b60 2024-09-18T12:51:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.210+0000 7f7d637fe640 1 -- 172.21.15.78:0/4133342418 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f7d5c004e60 con 0x7f7d6c102b60 2024-09-18T12:51:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.211+0000 7f7d637fe640 1 --2- 172.21.15.78:0/4133342418 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7d5807b050 0x7f7d5807d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.211+0000 7f7d721f5640 1 --2- 172.21.15.78:0/4133342418 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7d5807b050 0x7f7d5807d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.211+0000 7f7d637fe640 1 -- 172.21.15.78:0/4133342418 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f7d5c09ddd0 con 0x7f7d6c102b60 2024-09-18T12:51:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.212+0000 7f7d721f5640 1 --2- 172.21.15.78:0/4133342418 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7d5807b050 0x7f7d5807d510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009230 tx=0x7f7d680058d0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:26.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.216+0000 7f7d637fe640 1 -- 172.21.15.78:0/4133342418 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f7d5c069200 con 0x7f7d6c102b60 2024-09-18T12:51:26.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.398+0000 7f7d74459640 1 -- 172.21.15.78:0/4133342418 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7d6c062630 con 0x7f7d5807b050 2024-09-18T12:51:26.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.407+0000 7f7d637fe640 1 -- 172.21.15.78:0/4133342418 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f7d6c062630 con 0x7f7d5807b050 2024-09-18T12:51:26.409 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:51:26.409 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (8m) 12s ago 10m 26.3M - 0.25.0 c8568f914cd2 47a8b8bee5f5 2024-09-18T12:51:26.409 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (109s) 12s ago 10m 8568k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:51:26.409 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (96s) 15s ago 9m 8066k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:51:26.409 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (10m) 12s ago 10m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de bb77146b81c7 2024-09-18T12:51:26.409 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (9m) 15s ago 9m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de f82fdd264dc6 2024-09-18T12:51:26.409 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (8m) 12s ago 10m 80.3M - 9.4.12 2bacad6d85d8 0367cad8b635 2024-09-18T12:51:26.409 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (4m) 12s ago 4m 162M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:51:26.409 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (4m) 12s ago 4m 27.7M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:51:26.409 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (4m) 15s ago 4m 14.6M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:51:26.409 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (4m) 15s ago 4m 15.4M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:51:26.409 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (90s) 12s ago 11m 505M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:51:26.410 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (18s) 15s ago 9m 76.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:51:26.410 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (11m) 12s ago 11m 59.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1cb11a5bcd72 2024-09-18T12:51:26.410 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (9m) 15s ago 9m 46.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 02dfe1551226 2024-09-18T12:51:26.410 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 starting - - - - 2024-09-18T12:51:26.410 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (9m) 15s ago 9m 17.0M - 1.5.0 0da6a335fe13 4b7db3027dc5 2024-09-18T12:51:26.410 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (8m) 12s ago 8m 204M 1216M 19.1.1-330-gc2ddf972 ebb0615149de f634ad9ddb36 2024-09-18T12:51:26.410 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (7m) 12s ago 7m 220M 1216M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:51:26.410 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (7m) 12s ago 7m 178M 1216M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:51:26.410 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (6m) 15s ago 6m 234M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:51:26.410 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (6m) 15s ago 6m 207M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:51:26.410 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (5m) 15s ago 5m 194M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:51:26.410 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (27s) 12s ago 9m 43.2M - 2.43.0 a07b618ecd1d 0582d205e5bd 2024-09-18T12:51:26.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.409+0000 7f7d74459640 1 -- 172.21.15.78:0/4133342418 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7d5807b050 msgr2=0x7f7d5807d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:26.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.409+0000 7f7d74459640 1 --2- 172.21.15.78:0/4133342418 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7d5807b050 0x7f7d5807d510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009230 tx=0x7f7d680058d0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.409+0000 7f7d74459640 1 -- 172.21.15.78:0/4133342418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d6c102b60 msgr2=0x7f7d6c197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:26.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.409+0000 7f7d74459640 1 --2- 172.21.15.78:0/4133342418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d6c102b60 0x7f7d6c197a10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c00d6f0 tx=0x7f7d5c00dbb0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.410+0000 7f7d74459640 1 -- 172.21.15.78:0/4133342418 shutdown_connections 2024-09-18T12:51:26.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.410+0000 7f7d74459640 1 --2- 172.21.15.78:0/4133342418 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7d5807b050 0x7f7d5807d510 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.410+0000 7f7d74459640 1 --2- 172.21.15.78:0/4133342418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d6c102b60 0x7f7d6c197a10 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.410+0000 7f7d74459640 1 --2- 172.21.15.78:0/4133342418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d6c101960 0x7f7d6c1974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.410+0000 7f7d74459640 1 -- 172.21.15.78:0/4133342418 >> 172.21.15.78:0/4133342418 conn(0x7f7d6c0fd0f0 msgr2=0x7f7d6c106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:26.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.410+0000 7f7d74459640 1 -- 172.21.15.78:0/4133342418 shutdown_connections 2024-09-18T12:51:26.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.410+0000 7f7d74459640 1 -- 172.21.15.78:0/4133342418 wait complete. 2024-09-18T12:51:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:26 smithi148 ceph-mon[35352]: pgmap v33: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:26 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:26.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.489+0000 7f46e8966640 1 -- 172.21.15.78:0/761508123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e4102b60 msgr2=0x7f46e4102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:26.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.489+0000 7f46e8966640 1 --2- 172.21.15.78:0/761508123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e4102b60 0x7f46e4102fe0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009880 tx=0x7f46d802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.489+0000 7f46e8966640 1 -- 172.21.15.78:0/761508123 shutdown_connections 2024-09-18T12:51:26.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.489+0000 7f46e8966640 1 --2- 172.21.15.78:0/761508123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e4102b60 0x7f46e4102fe0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.489+0000 7f46e8966640 1 --2- 172.21.15.78:0/761508123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46e4101960 0x7f46e4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.489+0000 7f46e8966640 1 -- 172.21.15.78:0/761508123 >> 172.21.15.78:0/761508123 conn(0x7f46e40fd0f0 msgr2=0x7f46e40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:26.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.489+0000 7f46e8966640 1 -- 172.21.15.78:0/761508123 shutdown_connections 2024-09-18T12:51:26.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.489+0000 7f46e8966640 1 -- 172.21.15.78:0/761508123 wait complete. 2024-09-18T12:51:26.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.490+0000 7f46e8966640 1 Processor -- start 2024-09-18T12:51:26.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.490+0000 7f46e8966640 1 -- start start 2024-09-18T12:51:26.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.490+0000 7f46e8966640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e4101960 0x7f46e4197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:26.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.490+0000 7f46e8966640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46e4102b60 0x7f46e4197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:26.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.490+0000 7f46e8966640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f46e410a820 con 0x7f46e4101960 2024-09-18T12:51:26.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.490+0000 7f46e8966640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f46e410a6a0 con 0x7f46e4102b60 2024-09-18T12:51:26.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.490+0000 7f46e259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e4101960 0x7f46e4197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:26.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.490+0000 7f46e259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e4101960 0x7f46e4197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36962/0 (socket says 172.21.15.78:36962) 2024-09-18T12:51:26.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.490+0000 7f46e259c640 1 -- 172.21.15.78:0/2362056054 learned_addr learned my addr 172.21.15.78:0/2362056054 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:51:26.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.490+0000 7f46e1d9b640 1 --2- 172.21.15.78:0/2362056054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46e4102b60 0x7f46e4197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:26.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.491+0000 7f46e259c640 1 -- 172.21.15.78:0/2362056054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46e4102b60 msgr2=0x7f46e4197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:26.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.491+0000 7f46e259c640 1 --2- 172.21.15.78:0/2362056054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46e4102b60 0x7f46e4197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.491+0000 7f46e259c640 1 -- 172.21.15.78:0/2362056054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e41980d0 con 0x7f46e4101960 2024-09-18T12:51:26.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.491+0000 7f46e1d9b640 1 --2- 172.21.15.78:0/2362056054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46e4102b60 0x7f46e4197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:51:26.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.491+0000 7f46e259c640 1 --2- 172.21.15.78:0/2362056054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e4101960 0x7f46e4197510 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f46d400b3d0 tx=0x7f46d400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:26.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.491+0000 7f46d37fe640 1 -- 172.21.15.78:0/2362056054 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46d4015020 con 0x7f46e4101960 2024-09-18T12:51:26.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.491+0000 7f46e8966640 1 -- 172.21.15.78:0/2362056054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e419cb10 con 0x7f46e4101960 2024-09-18T12:51:26.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.491+0000 7f46d37fe640 1 -- 172.21.15.78:0/2362056054 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f46d4011af0 con 0x7f46e4101960 2024-09-18T12:51:26.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.491+0000 7f46d37fe640 1 -- 172.21.15.78:0/2362056054 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46d4010da0 con 0x7f46e4101960 2024-09-18T12:51:26.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.491+0000 7f46e8966640 1 -- 172.21.15.78:0/2362056054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e419d070 con 0x7f46e4101960 2024-09-18T12:51:26.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.492+0000 7f46e8966640 1 -- 172.21.15.78:0/2362056054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e4101d60 con 0x7f46e4101960 2024-09-18T12:51:26.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.493+0000 7f46d37fe640 1 -- 172.21.15.78:0/2362056054 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f46d4018020 con 0x7f46e4101960 2024-09-18T12:51:26.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.493+0000 7f46d37fe640 1 --2- 172.21.15.78:0/2362056054 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f46cc07b0b0 0x7f46cc07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:26.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.494+0000 7f46d37fe640 1 -- 172.21.15.78:0/2362056054 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f46d409db90 con 0x7f46e4101960 2024-09-18T12:51:26.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.494+0000 7f46e1d9b640 1 --2- 172.21.15.78:0/2362056054 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f46cc07b0b0 0x7f46cc07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:26.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.494+0000 7f46e1d9b640 1 --2- 172.21.15.78:0/2362056054 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f46cc07b0b0 0x7f46cc07d570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f46d8000c00 tx=0x7f46d80058d0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:26.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.498+0000 7f46d37fe640 1 -- 172.21.15.78:0/2362056054 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f46d401f020 con 0x7f46e4101960 2024-09-18T12:51:26.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.741+0000 7f46e8966640 1 -- 172.21.15.78:0/2362056054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f46e4062df0 con 0x7f46e4101960 2024-09-18T12:51:26.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.741+0000 7f46d37fe640 1 -- 172.21.15.78:0/2362056054 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f46d4069040 con 0x7f46e4101960 2024-09-18T12:51:26.742 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:51:26.743 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:51:26.743 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:51:26.743 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:51:26.743 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:51:26.743 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:51:26.743 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:51:26.743 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:51:26.743 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:51:26.743 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:51:26.743 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:51:26.744 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:51:26.744 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:51:26.744 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:51:26.744 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-18T12:51:26.744 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:51:26.744 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:51:26.744 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:51:26.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.743+0000 7f46e8966640 1 -- 172.21.15.78:0/2362056054 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f46cc07b0b0 msgr2=0x7f46cc07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:26.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.743+0000 7f46e8966640 1 --2- 172.21.15.78:0/2362056054 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f46cc07b0b0 0x7f46cc07d570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f46d8000c00 tx=0x7f46d80058d0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.743+0000 7f46e8966640 1 -- 172.21.15.78:0/2362056054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e4101960 msgr2=0x7f46e4197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:26.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.743+0000 7f46e8966640 1 --2- 172.21.15.78:0/2362056054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e4101960 0x7f46e4197510 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f46d400b3d0 tx=0x7f46d400b890 comp rx=0 tx=0).stop 2024-09-18T12:51:26.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.743+0000 7f46e8966640 1 -- 172.21.15.78:0/2362056054 shutdown_connections 2024-09-18T12:51:26.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.743+0000 7f46e8966640 1 --2- 172.21.15.78:0/2362056054 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f46cc07b0b0 0x7f46cc07d570 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.743+0000 7f46e8966640 1 --2- 172.21.15.78:0/2362056054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46e4102b60 0x7f46e4197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.743+0000 7f46e8966640 1 --2- 172.21.15.78:0/2362056054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e4101960 0x7f46e4197510 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.743+0000 7f46e8966640 1 -- 172.21.15.78:0/2362056054 >> 172.21.15.78:0/2362056054 conn(0x7f46e40fd0f0 msgr2=0x7f46e4106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:26.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.743+0000 7f46e8966640 1 -- 172.21.15.78:0/2362056054 shutdown_connections 2024-09-18T12:51:26.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.743+0000 7f46e8966640 1 -- 172.21.15.78:0/2362056054 wait complete. 2024-09-18T12:51:26.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.826+0000 7f28c8293640 1 -- 172.21.15.78:0/3460467359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c01023f0 msgr2=0x7f28c01047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:26.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.826+0000 7f28c8293640 1 --2- 172.21.15.78:0/3460467359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c01023f0 0x7f28c01047e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f28b00098b0 tx=0x7f28b002a4d0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.826+0000 7f28c8293640 1 -- 172.21.15.78:0/3460467359 shutdown_connections 2024-09-18T12:51:26.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.826+0000 7f28c8293640 1 --2- 172.21.15.78:0/3460467359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28c0104d20 0x7f28c0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.826+0000 7f28c8293640 1 --2- 172.21.15.78:0/3460467359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c01023f0 0x7f28c01047e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.826+0000 7f28c8293640 1 -- 172.21.15.78:0/3460467359 >> 172.21.15.78:0/3460467359 conn(0x7f28c00fc010 msgr2=0x7f28c00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:26.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.826+0000 7f28c8293640 1 -- 172.21.15.78:0/3460467359 shutdown_connections 2024-09-18T12:51:26.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.826+0000 7f28c8293640 1 -- 172.21.15.78:0/3460467359 wait complete. 2024-09-18T12:51:26.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.827+0000 7f28c8293640 1 Processor -- start 2024-09-18T12:51:26.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.827+0000 7f28c8293640 1 -- start start 2024-09-18T12:51:26.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.827+0000 7f28c8293640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c01023f0 0x7f28c0197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:26.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.827+0000 7f28c8293640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28c0104d20 0x7f28c0197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:26.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.827+0000 7f28c8293640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f28c010a7c0 con 0x7f28c01023f0 2024-09-18T12:51:26.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.827+0000 7f28c8293640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f28c010a640 con 0x7f28c0104d20 2024-09-18T12:51:26.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.827+0000 7f28c602f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c01023f0 0x7f28c0197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:26.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.827+0000 7f28c602f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c01023f0 0x7f28c0197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36978/0 (socket says 172.21.15.78:36978) 2024-09-18T12:51:26.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.827+0000 7f28c602f640 1 -- 172.21.15.78:0/973569147 learned_addr learned my addr 172.21.15.78:0/973569147 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:51:26.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.827+0000 7f28c582e640 1 --2- 172.21.15.78:0/973569147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28c0104d20 0x7f28c0197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:26.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.828+0000 7f28c602f640 1 -- 172.21.15.78:0/973569147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28c0104d20 msgr2=0x7f28c0197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:26.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.828+0000 7f28c602f640 1 --2- 172.21.15.78:0/973569147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28c0104d20 0x7f28c0197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:26.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.828+0000 7f28c602f640 1 -- 172.21.15.78:0/973569147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c0198110 con 0x7f28c01023f0 2024-09-18T12:51:26.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.828+0000 7f28c602f640 1 --2- 172.21.15.78:0/973569147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c01023f0 0x7f28c0197550 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f28b00099d0 tx=0x7f28b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:26.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.828+0000 7f28b77fe640 1 -- 172.21.15.78:0/973569147 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f28b003f070 con 0x7f28c01023f0 2024-09-18T12:51:26.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.828+0000 7f28b77fe640 1 -- 172.21.15.78:0/973569147 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f28b0004a40 con 0x7f28c01023f0 2024-09-18T12:51:26.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.828+0000 7f28c8293640 1 -- 172.21.15.78:0/973569147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c019caf0 con 0x7f28c01023f0 2024-09-18T12:51:26.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.828+0000 7f28b77fe640 1 -- 172.21.15.78:0/973569147 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f28b0035030 con 0x7f28c01023f0 2024-09-18T12:51:26.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.828+0000 7f28c8293640 1 -- 172.21.15.78:0/973569147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c019d080 con 0x7f28c01023f0 2024-09-18T12:51:26.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.829+0000 7f28c8293640 1 -- 172.21.15.78:0/973569147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28c01027d0 con 0x7f28c01023f0 2024-09-18T12:51:26.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.830+0000 7f28b77fe640 1 -- 172.21.15.78:0/973569147 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f28b0042070 con 0x7f28c01023f0 2024-09-18T12:51:26.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.830+0000 7f28b77fe640 1 --2- 172.21.15.78:0/973569147 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28ac07b050 0x7f28ac07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:26.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.830+0000 7f28b77fe640 1 -- 172.21.15.78:0/973569147 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f28b00bedc0 con 0x7f28c01023f0 2024-09-18T12:51:26.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.830+0000 7f28c582e640 1 --2- 172.21.15.78:0/973569147 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28ac07b050 0x7f28ac07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:26.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.831+0000 7f28c582e640 1 --2- 172.21.15.78:0/973569147 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28ac07b050 0x7f28ac07d510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f28c0198a00 tx=0x7f28bc00b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:26.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:26.835+0000 7f28b77fe640 1 -- 172.21.15.78:0/973569147 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f28b008a1f0 con 0x7f28c01023f0 2024-09-18T12:51:27.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:27.031+0000 7f28c8293640 1 -- 172.21.15.78:0/973569147 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f28c0105700 con 0x7f28ac07b050 2024-09-18T12:51:27.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:27.032+0000 7f28b77fe640 1 -- 172.21.15.78:0/973569147 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f28c0105700 con 0x7f28ac07b050 2024-09-18T12:51:27.033 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:51:27.033 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:51:27.033 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:51:27.033 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:51:27.033 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:51:27.034 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr" 2024-09-18T12:51:27.034 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:51:27.034 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "2/2 daemons upgraded", 2024-09-18T12:51:27.034 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-18T12:51:27.034 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:51:27.034 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:51:27.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:27.035+0000 7f28c8293640 1 -- 172.21.15.78:0/973569147 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28ac07b050 msgr2=0x7f28ac07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:27.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:27.035+0000 7f28c8293640 1 --2- 172.21.15.78:0/973569147 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28ac07b050 0x7f28ac07d510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f28c0198a00 tx=0x7f28bc00b390 comp rx=0 tx=0).stop 2024-09-18T12:51:27.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:27.035+0000 7f28c8293640 1 -- 172.21.15.78:0/973569147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c01023f0 msgr2=0x7f28c0197550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:27.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:27.035+0000 7f28c8293640 1 --2- 172.21.15.78:0/973569147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c01023f0 0x7f28c0197550 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f28b00099d0 tx=0x7f28b00046c0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:27.035+0000 7f28c8293640 1 -- 172.21.15.78:0/973569147 shutdown_connections 2024-09-18T12:51:27.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:27.035+0000 7f28c8293640 1 --2- 172.21.15.78:0/973569147 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28ac07b050 0x7f28ac07d510 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:27.035+0000 7f28c8293640 1 --2- 172.21.15.78:0/973569147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28c0104d20 0x7f28c0197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:27.035+0000 7f28c8293640 1 --2- 172.21.15.78:0/973569147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c01023f0 0x7f28c0197550 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:27.035+0000 7f28c8293640 1 -- 172.21.15.78:0/973569147 >> 172.21.15.78:0/973569147 conn(0x7f28c00fc010 msgr2=0x7f28c00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:27.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:27.035+0000 7f28c8293640 1 -- 172.21.15.78:0/973569147 shutdown_connections 2024-09-18T12:51:27.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:27.035+0000 7f28c8293640 1 -- 172.21.15.78:0/973569147 wait complete. 2024-09-18T12:51:27.161 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:27 smithi148 ceph-mon[35352]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:27.161 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:27 smithi148 ceph-mon[35352]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:27.162 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:27 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2362056054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:27.162 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:27 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:27.162 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:27 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:27.162 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:27 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:27.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:27 smithi078 ceph-mon[28091]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:27.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:27 smithi078 ceph-mon[28091]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:27.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:27 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2362056054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:27.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:27 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:27.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:27 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:27.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:27 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:28.410 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:28 smithi148 ceph-mon[35352]: from='client.14848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:28.411 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:28 smithi148 ceph-mon[35352]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:28.411 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:28 smithi148 ceph-mon[35352]: pgmap v34: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:28.484 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:28 smithi078 ceph-mon[28091]: from='client.14848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:28.485 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:28 smithi078 ceph-mon[28091]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:28.485 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:28 smithi078 ceph-mon[28091]: pgmap v34: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:30.397 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:30 smithi148 ceph-mon[35352]: pgmap v35: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:30.397 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:30 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:30.397 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:30 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:30.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:30 smithi078 ceph-mon[28091]: pgmap v35: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:30.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:30 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:30.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:30 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:31.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:31 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:31.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:31 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:31.650 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:31 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:31.650 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:31 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:32.260 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:32 smithi148 ceph-mon[35352]: pgmap v36: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:32.260 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:32 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:32.260 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:32 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:32 smithi078 ceph-mon[28091]: pgmap v36: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:32 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:32 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:34.137 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:33 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:34.137 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:33 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:34.137 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:33 smithi078 ceph-mon[28091]: pgmap v37: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:34.138 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:33 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:34.138 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:33 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:34.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:33 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:34.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:33 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:34.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:33 smithi148 ceph-mon[35352]: pgmap v37: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:34.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:33 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:34.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:33 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:36.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:36 smithi078 ceph-mon[28091]: pgmap v38: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:36.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:36 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:36.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:36 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:36.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:36 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:36.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:36 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:51:36.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:36 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:36 smithi148 ceph-mon[35352]: pgmap v38: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:36 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:36 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:36 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:36 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:51:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:36 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:37.350 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:37 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:37.350 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:37 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:37.350 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:37 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:37.351 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:37 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:37.351 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:37 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:37.351 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:37 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:37.351 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:37 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:37.351 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:37 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:37.351 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:37 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:37.481 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:37 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:37.481 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:37 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:37.481 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:37 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:37.481 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:37 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:37.482 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:37 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:37.482 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:37 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:37.482 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:37 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:37.482 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:37 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:37.482 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:37 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:38.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:38 smithi148 ceph-mon[35352]: pgmap v39: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:38.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:38 smithi078 ceph-mon[28091]: pgmap v39: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:39.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:39 smithi148 ceph-mon[35352]: Upgrade: Updating prometheus.smithi078 2024-09-18T12:51:39.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:39 smithi148 ceph-mon[35352]: Deploying daemon prometheus.smithi078 on smithi078 2024-09-18T12:51:39.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:39 smithi078 ceph-mon[28091]: Upgrade: Updating prometheus.smithi078 2024-09-18T12:51:39.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:39 smithi078 ceph-mon[28091]: Deploying daemon prometheus.smithi078 on smithi078 2024-09-18T12:51:40.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:40 smithi148 ceph-mon[35352]: pgmap v40: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:40.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:40 smithi078 ceph-mon[28091]: pgmap v40: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:41.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:41 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:41.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:41 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:42.428 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:42 smithi148 ceph-mon[35352]: pgmap v41: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:42.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:42 smithi078 ceph-mon[28091]: pgmap v41: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:44.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:44 smithi148 ceph-mon[35352]: pgmap v42: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:44.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:44 smithi078 ceph-mon[28091]: pgmap v42: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:46.453 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:46 smithi078 ceph-mon[28091]: pgmap v43: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:46 smithi148 ceph-mon[35352]: pgmap v43: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:48.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:48 smithi078 ceph-mon[28091]: pgmap v44: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:48.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:48 smithi148 ceph-mon[35352]: pgmap v44: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:50.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:50 smithi148 ceph-mon[35352]: pgmap v45: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:50.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:50 smithi078 ceph-mon[28091]: pgmap v45: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:52 smithi148 ceph-mon[35352]: pgmap v46: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:52 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:52 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:52 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:52 smithi078 ceph-mon[28091]: pgmap v46: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:52 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:52 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:52 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:53.398 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:53 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:53.399 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:53 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:53.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:53 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:53.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:53 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:54.400 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:54 smithi078 ceph-mon[28091]: pgmap v47: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:54.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:54 smithi148 ceph-mon[35352]: pgmap v47: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:56 smithi148 ceph-mon[35352]: pgmap v48: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:56 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:56 smithi078 ceph-mon[28091]: pgmap v48: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:51:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:56 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.122+0000 7f502582a640 1 -- 172.21.15.78:0/1320066760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5020102b60 msgr2=0x7f5020102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.122+0000 7f502582a640 1 --2- 172.21.15.78:0/1320066760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5020102b60 0x7f5020102fe0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5008009880 tx=0x7f500802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.122+0000 7f502582a640 1 -- 172.21.15.78:0/1320066760 shutdown_connections 2024-09-18T12:51:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.122+0000 7f502582a640 1 --2- 172.21.15.78:0/1320066760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5020102b60 0x7f5020102fe0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.122+0000 7f502582a640 1 --2- 172.21.15.78:0/1320066760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5020101960 0x7f5020101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.122+0000 7f502582a640 1 -- 172.21.15.78:0/1320066760 >> 172.21.15.78:0/1320066760 conn(0x7f50200fd0f0 msgr2=0x7f50200ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.122+0000 7f502582a640 1 -- 172.21.15.78:0/1320066760 shutdown_connections 2024-09-18T12:51:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.122+0000 7f502582a640 1 -- 172.21.15.78:0/1320066760 wait complete. 2024-09-18T12:51:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.123+0000 7f502582a640 1 Processor -- start 2024-09-18T12:51:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.123+0000 7f502582a640 1 -- start start 2024-09-18T12:51:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.123+0000 7f502582a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5020101960 0x7f5020197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.123+0000 7f502582a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5020102b60 0x7f5020197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.123+0000 7f502582a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f502010a820 con 0x7f5020102b60 2024-09-18T12:51:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.123+0000 7f502582a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f502010a6a0 con 0x7f5020101960 2024-09-18T12:51:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.123+0000 7f5017fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5020102b60 0x7f5020197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.123+0000 7f5017fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5020102b60 0x7f5020197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54786/0 (socket says 172.21.15.78:54786) 2024-09-18T12:51:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.123+0000 7f5017fff640 1 -- 172.21.15.78:0/2522592717 learned_addr learned my addr 172.21.15.78:0/2522592717 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:51:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.123+0000 7f501effd640 1 --2- 172.21.15.78:0/2522592717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5020101960 0x7f5020197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.123+0000 7f5017fff640 1 -- 172.21.15.78:0/2522592717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5020101960 msgr2=0x7f5020197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.123+0000 7f5017fff640 1 --2- 172.21.15.78:0/2522592717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5020101960 0x7f5020197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.123+0000 7f5017fff640 1 -- 172.21.15.78:0/2522592717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50201980d0 con 0x7f5020102b60 2024-09-18T12:51:57.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.124+0000 7f5017fff640 1 --2- 172.21.15.78:0/2522592717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5020102b60 0x7f5020197a50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5008006010 tx=0x7f50080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:57.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.124+0000 7f5024828640 1 -- 172.21.15.78:0/2522592717 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f500803f070 con 0x7f5020102b60 2024-09-18T12:51:57.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.124+0000 7f5024828640 1 -- 172.21.15.78:0/2522592717 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f50080044d0 con 0x7f5020102b60 2024-09-18T12:51:57.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.124+0000 7f502582a640 1 -- 172.21.15.78:0/2522592717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502019cab0 con 0x7f5020102b60 2024-09-18T12:51:57.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.124+0000 7f5024828640 1 -- 172.21.15.78:0/2522592717 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5008035030 con 0x7f5020102b60 2024-09-18T12:51:57.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.124+0000 7f502582a640 1 -- 172.21.15.78:0/2522592717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f502019d0c0 con 0x7f5020102b60 2024-09-18T12:51:57.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.125+0000 7f502582a640 1 -- 172.21.15.78:0/2522592717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5020101d40 con 0x7f5020102b60 2024-09-18T12:51:57.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.126+0000 7f5024828640 1 -- 172.21.15.78:0/2522592717 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f5008042070 con 0x7f5020102b60 2024-09-18T12:51:57.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.126+0000 7f5024828640 1 --2- 172.21.15.78:0/2522592717 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f500c07b050 0x7f500c07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:57.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.126+0000 7f5024828640 1 -- 172.21.15.78:0/2522592717 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f50080bf570 con 0x7f5020102b60 2024-09-18T12:51:57.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.126+0000 7f501effd640 1 --2- 172.21.15.78:0/2522592717 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f500c07b050 0x7f500c07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:57.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.127+0000 7f501effd640 1 --2- 172.21.15.78:0/2522592717 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f500c07b050 0x7f500c07d510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f50201029c0 tx=0x7f5010008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:57.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.130+0000 7f5024828640 1 -- 172.21.15.78:0/2522592717 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f500808aa20 con 0x7f5020102b60 2024-09-18T12:51:57.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.336+0000 7f502582a640 1 -- 172.21.15.78:0/2522592717 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f50200626f0 con 0x7f500c07b050 2024-09-18T12:51:57.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.337+0000 7f5024828640 1 -- 172.21.15.78:0/2522592717 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7f50200626f0 con 0x7f500c07b050 2024-09-18T12:51:57.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.340+0000 7f502582a640 1 -- 172.21.15.78:0/2522592717 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f500c07b050 msgr2=0x7f500c07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.340+0000 7f502582a640 1 --2- 172.21.15.78:0/2522592717 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f500c07b050 0x7f500c07d510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f50201029c0 tx=0x7f5010008040 comp rx=0 tx=0).stop 2024-09-18T12:51:57.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.340+0000 7f502582a640 1 -- 172.21.15.78:0/2522592717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5020102b60 msgr2=0x7f5020197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.340+0000 7f502582a640 1 --2- 172.21.15.78:0/2522592717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5020102b60 0x7f5020197a50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5008006010 tx=0x7f50080048f0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.340+0000 7f502582a640 1 -- 172.21.15.78:0/2522592717 shutdown_connections 2024-09-18T12:51:57.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.340+0000 7f502582a640 1 --2- 172.21.15.78:0/2522592717 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f500c07b050 0x7f500c07d510 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.340+0000 7f502582a640 1 --2- 172.21.15.78:0/2522592717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5020102b60 0x7f5020197a50 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.340+0000 7f502582a640 1 --2- 172.21.15.78:0/2522592717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5020101960 0x7f5020197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.340+0000 7f502582a640 1 -- 172.21.15.78:0/2522592717 >> 172.21.15.78:0/2522592717 conn(0x7f50200fd0f0 msgr2=0x7f5020106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:57.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.340+0000 7f502582a640 1 -- 172.21.15.78:0/2522592717 shutdown_connections 2024-09-18T12:51:57.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.340+0000 7f502582a640 1 -- 172.21.15.78:0/2522592717 wait complete. 2024-09-18T12:51:57.350 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:51:57.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.425+0000 7f38b148f640 1 -- 172.21.15.78:0/2926668170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38ac100860 msgr2=0x7f38ac100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.425+0000 7f38b148f640 1 --2- 172.21.15.78:0/2926668170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38ac100860 0x7f38ac100c60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f389c009880 tx=0x7f389c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.425+0000 7f38b148f640 1 -- 172.21.15.78:0/2926668170 shutdown_connections 2024-09-18T12:51:57.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.425+0000 7f38b148f640 1 --2- 172.21.15.78:0/2926668170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ac101a60 0x7f38ac101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.425+0000 7f38b148f640 1 --2- 172.21.15.78:0/2926668170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38ac100860 0x7f38ac100c60 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.425+0000 7f38b148f640 1 -- 172.21.15.78:0/2926668170 >> 172.21.15.78:0/2926668170 conn(0x7f38ac0fc010 msgr2=0x7f38ac0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:57.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.425+0000 7f38b148f640 1 -- 172.21.15.78:0/2926668170 shutdown_connections 2024-09-18T12:51:57.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.425+0000 7f38b148f640 1 -- 172.21.15.78:0/2926668170 wait complete. 2024-09-18T12:51:57.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.426+0000 7f38b148f640 1 Processor -- start 2024-09-18T12:51:57.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.426+0000 7f38b148f640 1 -- start start 2024-09-18T12:51:57.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.426+0000 7f38b148f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38ac100860 0x7f38ac197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:57.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.426+0000 7f38b148f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ac101a60 0x7f38ac197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:57.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.426+0000 7f38b148f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac109680 con 0x7f38ac100860 2024-09-18T12:51:57.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.426+0000 7f38b148f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac109500 con 0x7f38ac101a60 2024-09-18T12:51:57.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.426+0000 7f38aaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38ac100860 0x7f38ac197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:57.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.427+0000 7f38aaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38ac100860 0x7f38ac197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54800/0 (socket says 172.21.15.78:54800) 2024-09-18T12:51:57.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.427+0000 7f38aaffd640 1 -- 172.21.15.78:0/513548678 learned_addr learned my addr 172.21.15.78:0/513548678 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:51:57.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.427+0000 7f38aa7fc640 1 --2- 172.21.15.78:0/513548678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ac101a60 0x7f38ac197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:57.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.427+0000 7f38aaffd640 1 -- 172.21.15.78:0/513548678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ac101a60 msgr2=0x7f38ac197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.427+0000 7f38aaffd640 1 --2- 172.21.15.78:0/513548678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ac101a60 0x7f38ac197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.427+0000 7f38aaffd640 1 -- 172.21.15.78:0/513548678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ac1980e0 con 0x7f38ac100860 2024-09-18T12:51:57.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.427+0000 7f38aaffd640 1 --2- 172.21.15.78:0/513548678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38ac100860 0x7f38ac197520 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f389c006010 tx=0x7f389c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:57.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.427+0000 7f3893fff640 1 -- 172.21.15.78:0/513548678 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f389c03f070 con 0x7f38ac100860 2024-09-18T12:51:57.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.427+0000 7f38b148f640 1 -- 172.21.15.78:0/513548678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ac19cac0 con 0x7f38ac100860 2024-09-18T12:51:57.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.427+0000 7f3893fff640 1 -- 172.21.15.78:0/513548678 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f389c004a50 con 0x7f38ac100860 2024-09-18T12:51:57.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.427+0000 7f3893fff640 1 -- 172.21.15.78:0/513548678 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f389c035030 con 0x7f38ac100860 2024-09-18T12:51:57.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.427+0000 7f38b148f640 1 -- 172.21.15.78:0/513548678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ac19d050 con 0x7f38ac100860 2024-09-18T12:51:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.429+0000 7f38b148f640 1 -- 172.21.15.78:0/513548678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38ac100c60 con 0x7f38ac100860 2024-09-18T12:51:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.429+0000 7f3893fff640 1 -- 172.21.15.78:0/513548678 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f389c042070 con 0x7f38ac100860 2024-09-18T12:51:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.430+0000 7f3893fff640 1 --2- 172.21.15.78:0/513548678 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f389407b050 0x7f389407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.430+0000 7f3893fff640 1 -- 172.21.15.78:0/513548678 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f389c0becf0 con 0x7f38ac100860 2024-09-18T12:51:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.430+0000 7f38aa7fc640 1 --2- 172.21.15.78:0/513548678 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f389407b050 0x7f389407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.431+0000 7f38aa7fc640 1 --2- 172.21.15.78:0/513548678 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f389407b050 0x7f389407d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f38ac1989d0 tx=0x7f38a000b410 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:57.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.435+0000 7f3893fff640 1 -- 172.21.15.78:0/513548678 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f389c004c00 con 0x7f38ac100860 2024-09-18T12:51:57.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.640+0000 7f38b148f640 1 -- 172.21.15.78:0/513548678 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f38ac06a910 con 0x7f389407b050 2024-09-18T12:51:57.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.642+0000 7f3893fff640 1 -- 172.21.15.78:0/513548678 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7f38ac06a910 con 0x7f389407b050 2024-09-18T12:51:57.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.644+0000 7f38b148f640 1 -- 172.21.15.78:0/513548678 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f389407b050 msgr2=0x7f389407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.644+0000 7f38b148f640 1 --2- 172.21.15.78:0/513548678 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f389407b050 0x7f389407d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f38ac1989d0 tx=0x7f38a000b410 comp rx=0 tx=0).stop 2024-09-18T12:51:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.644+0000 7f38b148f640 1 -- 172.21.15.78:0/513548678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38ac100860 msgr2=0x7f38ac197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.644+0000 7f38b148f640 1 --2- 172.21.15.78:0/513548678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38ac100860 0x7f38ac197520 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f389c006010 tx=0x7f389c0045e0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.644+0000 7f38b148f640 1 -- 172.21.15.78:0/513548678 shutdown_connections 2024-09-18T12:51:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.644+0000 7f38b148f640 1 --2- 172.21.15.78:0/513548678 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f389407b050 0x7f389407d510 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.644+0000 7f38b148f640 1 --2- 172.21.15.78:0/513548678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ac101a60 0x7f38ac197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.644+0000 7f38b148f640 1 --2- 172.21.15.78:0/513548678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38ac100860 0x7f38ac197520 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.644+0000 7f38b148f640 1 -- 172.21.15.78:0/513548678 >> 172.21.15.78:0/513548678 conn(0x7f38ac0fc010 msgr2=0x7f38ac06a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.644+0000 7f38b148f640 1 -- 172.21.15.78:0/513548678 shutdown_connections 2024-09-18T12:51:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.644+0000 7f38b148f640 1 -- 172.21.15.78:0/513548678 wait complete. 2024-09-18T12:51:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.728+0000 7f41bbcc7640 1 -- 172.21.15.78:0/4020923015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4101a60 msgr2=0x7f41b4101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.728+0000 7f41bbcc7640 1 --2- 172.21.15.78:0/4020923015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4101a60 0x7f41b4101ee0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009880 tx=0x7f41a402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.728+0000 7f41bbcc7640 1 -- 172.21.15.78:0/4020923015 shutdown_connections 2024-09-18T12:51:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.728+0000 7f41bbcc7640 1 --2- 172.21.15.78:0/4020923015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4101a60 0x7f41b4101ee0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.728+0000 7f41bbcc7640 1 --2- 172.21.15.78:0/4020923015 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b4100860 0x7f41b4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.728+0000 7f41bbcc7640 1 -- 172.21.15.78:0/4020923015 >> 172.21.15.78:0/4020923015 conn(0x7f41b40fbff0 msgr2=0x7f41b40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.729+0000 7f41bbcc7640 1 -- 172.21.15.78:0/4020923015 shutdown_connections 2024-09-18T12:51:57.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.729+0000 7f41bbcc7640 1 -- 172.21.15.78:0/4020923015 wait complete. 2024-09-18T12:51:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.729+0000 7f41bbcc7640 1 Processor -- start 2024-09-18T12:51:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.729+0000 7f41bbcc7640 1 -- start start 2024-09-18T12:51:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.729+0000 7f41bbcc7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b4100860 0x7f41b4197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.729+0000 7f41bbcc7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4101a60 0x7f41b4197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.729+0000 7f41bbcc7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f41b4109680 con 0x7f41b4101a60 2024-09-18T12:51:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.729+0000 7f41bbcc7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f41b4109500 con 0x7f41b4100860 2024-09-18T12:51:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.730+0000 7f41b9262640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4101a60 0x7f41b4197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.730+0000 7f41b9262640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4101a60 0x7f41b4197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54814/0 (socket says 172.21.15.78:54814) 2024-09-18T12:51:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.730+0000 7f41b9262640 1 -- 172.21.15.78:0/3178575138 learned_addr learned my addr 172.21.15.78:0/3178575138 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:51:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.730+0000 7f41b9a63640 1 --2- 172.21.15.78:0/3178575138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b4100860 0x7f41b4197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.730+0000 7f41b9262640 1 -- 172.21.15.78:0/3178575138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b4100860 msgr2=0x7f41b4197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.730+0000 7f41b9262640 1 --2- 172.21.15.78:0/3178575138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b4100860 0x7f41b4197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.730+0000 7f41b9262640 1 -- 172.21.15.78:0/3178575138 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b41980e0 con 0x7f41b4101a60 2024-09-18T12:51:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.730+0000 7f41b9262640 1 --2- 172.21.15.78:0/3178575138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4101a60 0x7f41b4197a60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f41a4006010 tx=0x7f41a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.730+0000 7f41aaffd640 1 -- 172.21.15.78:0/3178575138 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41a403f070 con 0x7f41b4101a60 2024-09-18T12:51:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.731+0000 7f41aaffd640 1 -- 172.21.15.78:0/3178575138 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f41a4004ac0 con 0x7f41b4101a60 2024-09-18T12:51:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.731+0000 7f41bbcc7640 1 -- 172.21.15.78:0/3178575138 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b419cac0 con 0x7f41b4101a60 2024-09-18T12:51:57.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.731+0000 7f41aaffd640 1 -- 172.21.15.78:0/3178575138 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41a4035030 con 0x7f41b4101a60 2024-09-18T12:51:57.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.731+0000 7f41bbcc7640 1 -- 172.21.15.78:0/3178575138 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b419d050 con 0x7f41b4101a60 2024-09-18T12:51:57.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.732+0000 7f41bbcc7640 1 -- 172.21.15.78:0/3178575138 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b4100c60 con 0x7f41b4101a60 2024-09-18T12:51:57.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.732+0000 7f41aaffd640 1 -- 172.21.15.78:0/3178575138 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f41a4042070 con 0x7f41b4101a60 2024-09-18T12:51:57.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.733+0000 7f41aaffd640 1 --2- 172.21.15.78:0/3178575138 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f41a007b050 0x7f41a007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:57.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.733+0000 7f41aaffd640 1 -- 172.21.15.78:0/3178575138 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f41a40bee20 con 0x7f41b4101a60 2024-09-18T12:51:57.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.733+0000 7f41b9a63640 1 --2- 172.21.15.78:0/3178575138 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f41a007b050 0x7f41a007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:57.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.734+0000 7f41b9a63640 1 --2- 172.21.15.78:0/3178575138 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f41a007b050 0x7f41a007d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f41b41018c0 tx=0x7f41b000b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:57.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.738+0000 7f41aaffd640 1 -- 172.21.15.78:0/3178575138 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f41a408a250 con 0x7f41b4101a60 2024-09-18T12:51:57.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.932+0000 7f41bbcc7640 1 -- 172.21.15.78:0/3178575138 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f41b406ac40 con 0x7f41a007b050 2024-09-18T12:51:57.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.942+0000 7f41aaffd640 1 -- 172.21.15.78:0/3178575138 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f41b406ac40 con 0x7f41a007b050 2024-09-18T12:51:57.943 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:51:57.944 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (9m) 1s ago 10m 26.3M - 0.25.0 c8568f914cd2 47a8b8bee5f5 2024-09-18T12:51:57.944 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (2m) 1s ago 10m 8619k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:51:57.944 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (2m) 28s ago 10m 8086k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:51:57.944 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (10m) 1s ago 10m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de bb77146b81c7 2024-09-18T12:51:57.944 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (10m) 28s ago 10m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de f82fdd264dc6 2024-09-18T12:51:57.944 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (9m) 1s ago 10m 78.4M - 9.4.12 2bacad6d85d8 0367cad8b635 2024-09-18T12:51:57.944 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (5m) 1s ago 5m 152M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:51:57.944 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (5m) 1s ago 5m 27.5M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:51:57.944 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (5m) 28s ago 5m 14.7M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:51:57.944 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (5m) 28s ago 5m 15.6M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:51:57.944 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (2m) 1s ago 12m 511M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:51:57.944 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (50s) 28s ago 9m 452M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:51:57.944 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (12m) 1s ago 12m 59.7M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1cb11a5bcd72 2024-09-18T12:51:57.944 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (9m) 28s ago 9m 44.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 02dfe1551226 2024-09-18T12:51:57.945 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (37s) 1s ago 10m 9.92M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:51:57.945 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (31s) 28s ago 9m 7335k - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:51:57.945 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (8m) 1s ago 8m 204M 1216M 19.1.1-330-gc2ddf972 ebb0615149de f634ad9ddb36 2024-09-18T12:51:57.945 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (8m) 1s ago 8m 221M 1216M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:51:57.945 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (7m) 1s ago 7m 179M 1216M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:51:57.945 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (7m) 28s ago 7m 236M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:51:57.945 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (6m) 28s ago 6m 208M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:51:57.945 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (6m) 28s ago 6m 194M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:51:57.945 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (8s) 1s ago 10m 41.0M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:51:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.945+0000 7f41bbcc7640 1 -- 172.21.15.78:0/3178575138 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f41a007b050 msgr2=0x7f41a007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.945+0000 7f41bbcc7640 1 --2- 172.21.15.78:0/3178575138 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f41a007b050 0x7f41a007d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f41b41018c0 tx=0x7f41b000b390 comp rx=0 tx=0).stop 2024-09-18T12:51:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.945+0000 7f41bbcc7640 1 -- 172.21.15.78:0/3178575138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4101a60 msgr2=0x7f41b4197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.945+0000 7f41bbcc7640 1 --2- 172.21.15.78:0/3178575138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4101a60 0x7f41b4197a60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f41a4006010 tx=0x7f41a40046c0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.945+0000 7f41bbcc7640 1 -- 172.21.15.78:0/3178575138 shutdown_connections 2024-09-18T12:51:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.945+0000 7f41bbcc7640 1 --2- 172.21.15.78:0/3178575138 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f41a007b050 0x7f41a007d510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.945+0000 7f41bbcc7640 1 --2- 172.21.15.78:0/3178575138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4101a60 0x7f41b4197a60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.945+0000 7f41bbcc7640 1 --2- 172.21.15.78:0/3178575138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b4100860 0x7f41b4197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.945+0000 7f41bbcc7640 1 -- 172.21.15.78:0/3178575138 >> 172.21.15.78:0/3178575138 conn(0x7f41b40fbff0 msgr2=0x7f41b406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.945+0000 7f41bbcc7640 1 -- 172.21.15.78:0/3178575138 shutdown_connections 2024-09-18T12:51:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:57.945+0000 7f41bbcc7640 1 -- 172.21.15.78:0/3178575138 wait complete. 2024-09-18T12:51:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:57 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:57 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:57 smithi078 ceph-mon[28091]: pgmap v49: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:51:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:57 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:57 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.036+0000 7f3f4f395640 1 -- 172.21.15.78:0/4091988842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f48100860 msgr2=0x7f3f48100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.036+0000 7f3f4f395640 1 --2- 172.21.15.78:0/4091988842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f48100860 0x7f3f48100c60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009880 tx=0x7f3f4002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.036+0000 7f3f4f395640 1 -- 172.21.15.78:0/4091988842 shutdown_connections 2024-09-18T12:51:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.036+0000 7f3f4f395640 1 --2- 172.21.15.78:0/4091988842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f48101a60 0x7f3f48101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.036+0000 7f3f4f395640 1 --2- 172.21.15.78:0/4091988842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f48100860 0x7f3f48100c60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.036+0000 7f3f4f395640 1 -- 172.21.15.78:0/4091988842 >> 172.21.15.78:0/4091988842 conn(0x7f3f480fc010 msgr2=0x7f3f480fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.036+0000 7f3f4f395640 1 -- 172.21.15.78:0/4091988842 shutdown_connections 2024-09-18T12:51:58.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.036+0000 7f3f4f395640 1 -- 172.21.15.78:0/4091988842 wait complete. 2024-09-18T12:51:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.036+0000 7f3f4f395640 1 Processor -- start 2024-09-18T12:51:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.036+0000 7f3f4f395640 1 -- start start 2024-09-18T12:51:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.036+0000 7f3f4f395640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f48100860 0x7f3f4806aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f4f395640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f48101a60 0x7f3f4819e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f4f395640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3f481096a0 con 0x7f3f48101a60 2024-09-18T12:51:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f4f395640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3f48109520 con 0x7f3f48100860 2024-09-18T12:51:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f4c930640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f48101a60 0x7f3f4819e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f4c930640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f48101a60 0x7f3f4819e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54824/0 (socket says 172.21.15.78:54824) 2024-09-18T12:51:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f4c930640 1 -- 172.21.15.78:0/2897998284 learned_addr learned my addr 172.21.15.78:0/2897998284 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:51:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f4d131640 1 --2- 172.21.15.78:0/2897998284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f48100860 0x7f3f4806aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f4c930640 1 -- 172.21.15.78:0/2897998284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f48100860 msgr2=0x7f3f4806aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f4c930640 1 --2- 172.21.15.78:0/2897998284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f48100860 0x7f3f4806aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f4c930640 1 -- 172.21.15.78:0/2897998284 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4819eb80 con 0x7f3f48101a60 2024-09-18T12:51:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f4c930640 1 --2- 172.21.15.78:0/2897998284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f48101a60 0x7f3f4819e640 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00d6f0 tx=0x7f3f3c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f467fc640 1 -- 172.21.15.78:0/2897998284 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f3c017070 con 0x7f3f48101a60 2024-09-18T12:51:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f467fc640 1 -- 172.21.15.78:0/2897998284 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f3c00de00 con 0x7f3f48101a60 2024-09-18T12:51:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f467fc640 1 -- 172.21.15.78:0/2897998284 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f3c004bb0 con 0x7f3f48101a60 2024-09-18T12:51:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f4f395640 1 -- 172.21.15.78:0/2897998284 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4819ed50 con 0x7f3f48101a60 2024-09-18T12:51:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.037+0000 7f3f4f395640 1 -- 172.21.15.78:0/2897998284 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4819f280 con 0x7f3f48101a60 2024-09-18T12:51:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.038+0000 7f3f4f395640 1 -- 172.21.15.78:0/2897998284 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f48100c60 con 0x7f3f48101a60 2024-09-18T12:51:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.039+0000 7f3f467fc640 1 -- 172.21.15.78:0/2897998284 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3f3c009a30 con 0x7f3f48101a60 2024-09-18T12:51:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.040+0000 7f3f467fc640 1 --2- 172.21.15.78:0/2897998284 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3f3007af80 0x7f3f3007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.040+0000 7f3f467fc640 1 -- 172.21.15.78:0/2897998284 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f3f3c09db00 con 0x7f3f48101a60 2024-09-18T12:51:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.040+0000 7f3f4d131640 1 --2- 172.21.15.78:0/2897998284 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3f3007af80 0x7f3f3007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.040+0000 7f3f4d131640 1 --2- 172.21.15.78:0/2897998284 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3f3007af80 0x7f3f3007d440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009230 tx=0x7f3f400058d0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.044+0000 7f3f467fc640 1 -- 172.21.15.78:0/2897998284 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f3f3c069140 con 0x7f3f48101a60 2024-09-18T12:51:58.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:57 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:58.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:57 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:58.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:57 smithi148 ceph-mon[35352]: pgmap v49: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:51:58.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:57 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:58.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:57 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:51:58.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.298+0000 7f3f4f395640 1 -- 172.21.15.78:0/2897998284 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3f481904b0 con 0x7f3f48101a60 2024-09-18T12:51:58.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.298+0000 7f3f467fc640 1 -- 172.21.15.78:0/2897998284 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f3f3c06dff0 con 0x7f3f48101a60 2024-09-18T12:51:58.300 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:51:58.300 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:51:58.300 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:51:58.300 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:51:58.300 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:51:58.300 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:51:58.300 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:51:58.300 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:51:58.300 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:51:58.300 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:51:58.301 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:51:58.301 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:51:58.301 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:51:58.301 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:51:58.301 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-18T12:51:58.301 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:51:58.301 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:51:58.301 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:51:58.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.300+0000 7f3f4f395640 1 -- 172.21.15.78:0/2897998284 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3f3007af80 msgr2=0x7f3f3007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:58.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.300+0000 7f3f4f395640 1 --2- 172.21.15.78:0/2897998284 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3f3007af80 0x7f3f3007d440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009230 tx=0x7f3f400058d0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.300+0000 7f3f4f395640 1 -- 172.21.15.78:0/2897998284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f48101a60 msgr2=0x7f3f4819e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:58.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.300+0000 7f3f4f395640 1 --2- 172.21.15.78:0/2897998284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f48101a60 0x7f3f4819e640 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00d6f0 tx=0x7f3f3c00dbb0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.300+0000 7f3f4f395640 1 -- 172.21.15.78:0/2897998284 shutdown_connections 2024-09-18T12:51:58.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.300+0000 7f3f4f395640 1 --2- 172.21.15.78:0/2897998284 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3f3007af80 0x7f3f3007d440 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.300+0000 7f3f4f395640 1 --2- 172.21.15.78:0/2897998284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f48101a60 0x7f3f4819e640 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.300+0000 7f3f4f395640 1 --2- 172.21.15.78:0/2897998284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f48100860 0x7f3f4806aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.300+0000 7f3f4f395640 1 -- 172.21.15.78:0/2897998284 >> 172.21.15.78:0/2897998284 conn(0x7f3f480fc010 msgr2=0x7f3f48104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:58.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.300+0000 7f3f4f395640 1 -- 172.21.15.78:0/2897998284 shutdown_connections 2024-09-18T12:51:58.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.301+0000 7f3f4f395640 1 -- 172.21.15.78:0/2897998284 wait complete. 2024-09-18T12:51:58.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.387+0000 7fe331e5b640 1 -- 172.21.15.78:0/1627104834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe32c101970 msgr2=0x7fe32c101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:58.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.387+0000 7fe331e5b640 1 --2- 172.21.15.78:0/1627104834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe32c101970 0x7fe32c101d70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009880 tx=0x7fe31c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.387+0000 7fe331e5b640 1 -- 172.21.15.78:0/1627104834 shutdown_connections 2024-09-18T12:51:58.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.387+0000 7fe331e5b640 1 --2- 172.21.15.78:0/1627104834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c102b70 0x7fe32c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.387+0000 7fe331e5b640 1 --2- 172.21.15.78:0/1627104834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe32c101970 0x7fe32c101d70 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.387+0000 7fe331e5b640 1 -- 172.21.15.78:0/1627104834 >> 172.21.15.78:0/1627104834 conn(0x7fe32c0fd100 msgr2=0x7fe32c0ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:58.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.387+0000 7fe331e5b640 1 -- 172.21.15.78:0/1627104834 shutdown_connections 2024-09-18T12:51:58.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.387+0000 7fe331e5b640 1 -- 172.21.15.78:0/1627104834 wait complete. 2024-09-18T12:51:58.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.388+0000 7fe331e5b640 1 Processor -- start 2024-09-18T12:51:58.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.388+0000 7fe331e5b640 1 -- start start 2024-09-18T12:51:58.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.388+0000 7fe331e5b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe32c101970 0x7fe32c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:58.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.388+0000 7fe331e5b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c102b70 0x7fe32c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:58.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.388+0000 7fe331e5b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c10a7b0 con 0x7fe32c101970 2024-09-18T12:51:58.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.388+0000 7fe331e5b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c10a630 con 0x7fe32c102b70 2024-09-18T12:51:58.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.388+0000 7fe32b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe32c101970 0x7fe32c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:58.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.388+0000 7fe32b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe32c101970 0x7fe32c075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54848/0 (socket says 172.21.15.78:54848) 2024-09-18T12:51:58.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.388+0000 7fe32b7fe640 1 -- 172.21.15.78:0/856110743 learned_addr learned my addr 172.21.15.78:0/856110743 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:51:58.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.389+0000 7fe32affd640 1 --2- 172.21.15.78:0/856110743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c102b70 0x7fe32c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:58.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.389+0000 7fe32b7fe640 1 -- 172.21.15.78:0/856110743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c102b70 msgr2=0x7fe32c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:58.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.389+0000 7fe32b7fe640 1 --2- 172.21.15.78:0/856110743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c102b70 0x7fe32c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.389+0000 7fe32b7fe640 1 -- 172.21.15.78:0/856110743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c074b20 con 0x7fe32c101970 2024-09-18T12:51:58.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.389+0000 7fe32b7fe640 1 --2- 172.21.15.78:0/856110743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe32c101970 0x7fe32c075f20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe31c006010 tx=0x7fe31c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:58.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.389+0000 7fe328ff9640 1 -- 172.21.15.78:0/856110743 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe31c03f070 con 0x7fe32c101970 2024-09-18T12:51:58.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.389+0000 7fe328ff9640 1 -- 172.21.15.78:0/856110743 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe31c004a50 con 0x7fe32c101970 2024-09-18T12:51:58.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.389+0000 7fe331e5b640 1 -- 172.21.15.78:0/856110743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32c074db0 con 0x7fe32c101970 2024-09-18T12:51:58.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.389+0000 7fe328ff9640 1 -- 172.21.15.78:0/856110743 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe31c035030 con 0x7fe32c101970 2024-09-18T12:51:58.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.389+0000 7fe331e5b640 1 -- 172.21.15.78:0/856110743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe32c0752e0 con 0x7fe32c101970 2024-09-18T12:51:58.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.390+0000 7fe331e5b640 1 -- 172.21.15.78:0/856110743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe32c101d70 con 0x7fe32c101970 2024-09-18T12:51:58.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.391+0000 7fe328ff9640 1 -- 172.21.15.78:0/856110743 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe31c042070 con 0x7fe32c101970 2024-09-18T12:51:58.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.392+0000 7fe328ff9640 1 --2- 172.21.15.78:0/856110743 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe31807af30 0x7fe31807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:58.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.392+0000 7fe328ff9640 1 -- 172.21.15.78:0/856110743 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fe31c0beb30 con 0x7fe32c101970 2024-09-18T12:51:58.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.392+0000 7fe32affd640 1 --2- 172.21.15.78:0/856110743 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe31807af30 0x7fe31807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:58.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.393+0000 7fe32affd640 1 --2- 172.21.15.78:0/856110743 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe31807af30 0x7fe31807d3f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe314005fd0 tx=0x7fe314005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:58.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.397+0000 7fe328ff9640 1 -- 172.21.15.78:0/856110743 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fe31c004c00 con 0x7fe32c101970 2024-09-18T12:51:58.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.587+0000 7fe331e5b640 1 -- 172.21.15.78:0/856110743 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe32c062630 con 0x7fe31807af30 2024-09-18T12:51:58.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.588+0000 7fe328ff9640 1 -- 172.21.15.78:0/856110743 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7fe32c062630 con 0x7fe31807af30 2024-09-18T12:51:58.589 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:51:58.590 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:51:58.590 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:51:58.590 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:51:58.590 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:51:58.590 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr" 2024-09-18T12:51:58.590 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:51:58.590 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "2/2 daemons upgraded", 2024-09-18T12:51:58.590 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-18T12:51:58.590 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:51:58.590 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:51:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.591+0000 7fe331e5b640 1 -- 172.21.15.78:0/856110743 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe31807af30 msgr2=0x7fe31807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.591+0000 7fe331e5b640 1 --2- 172.21.15.78:0/856110743 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe31807af30 0x7fe31807d3f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe314005fd0 tx=0x7fe314005850 comp rx=0 tx=0).stop 2024-09-18T12:51:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.591+0000 7fe331e5b640 1 -- 172.21.15.78:0/856110743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe32c101970 msgr2=0x7fe32c075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.591+0000 7fe331e5b640 1 --2- 172.21.15.78:0/856110743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe32c101970 0x7fe32c075f20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe31c006010 tx=0x7fe31c0045e0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.591+0000 7fe331e5b640 1 -- 172.21.15.78:0/856110743 shutdown_connections 2024-09-18T12:51:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.591+0000 7fe331e5b640 1 --2- 172.21.15.78:0/856110743 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe31807af30 0x7fe31807d3f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.591+0000 7fe331e5b640 1 --2- 172.21.15.78:0/856110743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32c102b70 0x7fe32c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.591+0000 7fe331e5b640 1 --2- 172.21.15.78:0/856110743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe32c101970 0x7fe32c075f20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.591+0000 7fe331e5b640 1 -- 172.21.15.78:0/856110743 >> 172.21.15.78:0/856110743 conn(0x7fe32c0fd100 msgr2=0x7fe32c106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.592+0000 7fe331e5b640 1 -- 172.21.15.78:0/856110743 shutdown_connections 2024-09-18T12:51:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:51:58.592+0000 7fe331e5b640 1 -- 172.21.15.78:0/856110743 wait complete. 2024-09-18T12:51:59.216 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:58 smithi078 ceph-mon[28091]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:59.216 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:58 smithi078 ceph-mon[28091]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:59.216 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:58 smithi078 ceph-mon[28091]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:59.216 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:58 smithi078 ceph-mon[28091]: mgrmap e34: smithi078.ohifux(active, since 92s), standbys: smithi148.bfgshs 2024-09-18T12:51:59.216 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:58 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2897998284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:59.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:58 smithi148 ceph-mon[35352]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:59.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:58 smithi148 ceph-mon[35352]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:59.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:58 smithi148 ceph-mon[35352]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:59.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:58 smithi148 ceph-mon[35352]: mgrmap e34: smithi078.ohifux(active, since 92s), standbys: smithi148.bfgshs 2024-09-18T12:51:59.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:58 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2897998284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:00.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:59 smithi148 ceph-mon[35352]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:00.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:51:59 smithi148 ceph-mon[35352]: pgmap v50: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:52:00.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:59 smithi078 ceph-mon[28091]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:00.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:51:59 smithi078 ceph-mon[28091]: pgmap v50: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:52:02.089 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:02.089 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:02.089 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:02.089 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:52:02.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:02.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:52:02.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:52:02.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:02.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.091 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.091 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.091 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.091 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.091 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:01 smithi148 ceph-mon[35352]: pgmap v51: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:52:02.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:02.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:02.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:02.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:52:02.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:02.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:52:02.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:52:02.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:02.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:01 smithi078 ceph-mon[28091]: pgmap v51: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:52:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:04 smithi148 ceph-mon[35352]: Upgrade: Updating alertmanager.smithi078 2024-09-18T12:52:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:04 smithi148 ceph-mon[35352]: Deploying daemon alertmanager.smithi078 on smithi078 2024-09-18T12:52:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:04 smithi148 ceph-mon[35352]: pgmap v52: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:52:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:04 smithi078 ceph-mon[28091]: Upgrade: Updating alertmanager.smithi078 2024-09-18T12:52:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:04 smithi078 ceph-mon[28091]: Deploying daemon alertmanager.smithi078 on smithi078 2024-09-18T12:52:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:04 smithi078 ceph-mon[28091]: pgmap v52: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:52:06.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:06 smithi078 ceph-mon[28091]: pgmap v53: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:52:06.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:06 smithi148 ceph-mon[35352]: pgmap v53: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:52:08.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:08 smithi148 ceph-mon[35352]: pgmap v54: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:52:08.483 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:08 smithi078 ceph-mon[28091]: pgmap v54: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T12:52:10.411 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:10 smithi078 ceph-mon[28091]: pgmap v55: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:10.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:10 smithi148 ceph-mon[35352]: pgmap v55: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:11.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:11 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:11.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:11 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:12.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:12 smithi078 ceph-mon[28091]: pgmap v56: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:12.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:12 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:12.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:12 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:12.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:12 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:12.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:12 smithi148 ceph-mon[35352]: pgmap v56: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:12.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:12 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:12.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:12 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:12.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:12 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:14.381 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:14 smithi078 ceph-mon[28091]: pgmap v57: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:14.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:14 smithi148 ceph-mon[35352]: pgmap v57: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:16.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:16 smithi148 ceph-mon[35352]: pgmap v58: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:16.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:16 smithi078 ceph-mon[28091]: pgmap v58: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:17.588 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:17 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:17.588 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:17 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:17.588 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:17 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:17.588 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:17 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:17.588 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:17 smithi078 ceph-mon[28091]: pgmap v59: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:17.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:17 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:17.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:17 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:17.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:17 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:17.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:17 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:17.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:17 smithi148 ceph-mon[35352]: pgmap v59: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:20.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:20 smithi148 ceph-mon[35352]: pgmap v60: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:20.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:20 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:20.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:20 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:20.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:20 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:20.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:20 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:52:20.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:20 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:20 smithi078 ceph-mon[28091]: pgmap v60: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:20 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:20 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:20 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:20 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:52:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:20 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:21.415 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:21 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:52:21.415 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:21 smithi078 ceph-mon[28091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:52:21.415 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:21 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:21.415 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:21 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.416 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:21 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.416 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:21 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.416 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:21 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.416 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:21 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.416 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:21 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.416 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:21 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.416 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:21 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.416 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:21 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.416 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:21 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:21 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:52:21.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:21 smithi148 ceph-mon[35352]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:52:21.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:21 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:21.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:21 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:21 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:21 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:21 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:21 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:21 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:21 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:21 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:21 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:21.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:21 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:22.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:22 smithi148 ceph-mon[35352]: pgmap v61: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:22.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:22 smithi078 ceph-mon[28091]: pgmap v61: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:23.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:23 smithi148 ceph-mon[35352]: Upgrade: Updating grafana.smithi078 2024-09-18T12:52:23.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:23 smithi148 ceph-mon[35352]: Deploying daemon grafana.smithi078 on smithi078 2024-09-18T12:52:23.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:23 smithi078 ceph-mon[28091]: Upgrade: Updating grafana.smithi078 2024-09-18T12:52:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:23 smithi078 ceph-mon[28091]: Deploying daemon grafana.smithi078 on smithi078 2024-09-18T12:52:24.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:24 smithi148 ceph-mon[35352]: pgmap v62: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:24 smithi078 ceph-mon[28091]: pgmap v62: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:26 smithi148 ceph-mon[35352]: pgmap v63: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:26 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:26.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:26 smithi078 ceph-mon[28091]: pgmap v63: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:26.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:26 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:28.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:28 smithi148 ceph-mon[35352]: pgmap v64: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:28 smithi078 ceph-mon[28091]: pgmap v64: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:28.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.677+0000 7f06aa647640 1 -- 172.21.15.78:0/3600988701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06a4100860 msgr2=0x7f06a4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:28.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.677+0000 7f06aa647640 1 --2- 172.21.15.78:0/3600988701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06a4100860 0x7f06a4100c60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0694009880 tx=0x7f069402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.677+0000 7f06aa647640 1 -- 172.21.15.78:0/3600988701 shutdown_connections 2024-09-18T12:52:28.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.677+0000 7f06aa647640 1 --2- 172.21.15.78:0/3600988701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06a4101a60 0x7f06a4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.677+0000 7f06aa647640 1 --2- 172.21.15.78:0/3600988701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06a4100860 0x7f06a4100c60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.677+0000 7f06aa647640 1 -- 172.21.15.78:0/3600988701 >> 172.21.15.78:0/3600988701 conn(0x7f06a40fc010 msgr2=0x7f06a40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.677+0000 7f06aa647640 1 -- 172.21.15.78:0/3600988701 shutdown_connections 2024-09-18T12:52:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.677+0000 7f06aa647640 1 -- 172.21.15.78:0/3600988701 wait complete. 2024-09-18T12:52:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.677+0000 7f06aa647640 1 Processor -- start 2024-09-18T12:52:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.678+0000 7f06aa647640 1 -- start start 2024-09-18T12:52:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.678+0000 7f06aa647640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06a4100860 0x7f06a41963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.678+0000 7f06aa647640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06a4101a60 0x7f06a41968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.678+0000 7f06aa647640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f06a4109680 con 0x7f06a4101a60 2024-09-18T12:52:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.678+0000 7f06aa647640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f06a4109500 con 0x7f06a4100860 2024-09-18T12:52:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.678+0000 7f06a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06a4101a60 0x7f06a41968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.678+0000 7f06a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06a4101a60 0x7f06a41968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37854/0 (socket says 172.21.15.78:37854) 2024-09-18T12:52:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.678+0000 7f06a37fe640 1 -- 172.21.15.78:0/227949455 learned_addr learned my addr 172.21.15.78:0/227949455 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:52:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.678+0000 7f06a3fff640 1 --2- 172.21.15.78:0/227949455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06a4100860 0x7f06a41963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.678+0000 7f06a37fe640 1 -- 172.21.15.78:0/227949455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06a4100860 msgr2=0x7f06a41963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.678+0000 7f06a37fe640 1 --2- 172.21.15.78:0/227949455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06a4100860 0x7f06a41963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.678+0000 7f06a37fe640 1 -- 172.21.15.78:0/227949455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a4196f60 con 0x7f06a4101a60 2024-09-18T12:52:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.678+0000 7f06a3fff640 1 --2- 172.21.15.78:0/227949455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06a4100860 0x7f06a41963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:52:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.678+0000 7f06a37fe640 1 --2- 172.21.15.78:0/227949455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06a4101a60 0x7f06a41968e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f069800c810 tx=0x7f069800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.679+0000 7f06a17fa640 1 -- 172.21.15.78:0/227949455 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0698004020 con 0x7f06a4101a60 2024-09-18T12:52:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.679+0000 7f06a17fa640 1 -- 172.21.15.78:0/227949455 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06980041c0 con 0x7f06a4101a60 2024-09-18T12:52:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.679+0000 7f06aa647640 1 -- 172.21.15.78:0/227949455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a419b9a0 con 0x7f06a4101a60 2024-09-18T12:52:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.679+0000 7f06a17fa640 1 -- 172.21.15.78:0/227949455 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06980047a0 con 0x7f06a4101a60 2024-09-18T12:52:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.679+0000 7f06aa647640 1 -- 172.21.15.78:0/227949455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a419bf30 con 0x7f06a4101a60 2024-09-18T12:52:28.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.680+0000 7f06aa647640 1 -- 172.21.15.78:0/227949455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a4100c60 con 0x7f06a4101a60 2024-09-18T12:52:28.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.680+0000 7f06a17fa640 1 -- 172.21.15.78:0/227949455 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f06980079b0 con 0x7f06a4101a60 2024-09-18T12:52:28.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.681+0000 7f06a17fa640 1 --2- 172.21.15.78:0/227949455 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f068c07af30 0x7f068c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.681+0000 7f06a17fa640 1 -- 172.21.15.78:0/227949455 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f069809def0 con 0x7f06a4101a60 2024-09-18T12:52:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.681+0000 7f06a3fff640 1 --2- 172.21.15.78:0/227949455 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f068c07af30 0x7f068c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.681+0000 7f06a3fff640 1 --2- 172.21.15.78:0/227949455 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f068c07af30 0x7f068c07d3f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06940096c0 tx=0x7f0694009650 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.685+0000 7f06a17fa640 1 -- 172.21.15.78:0/227949455 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f0698014030 con 0x7f06a4101a60 2024-09-18T12:52:28.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.875+0000 7f06aa647640 1 -- 172.21.15.78:0/227949455 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f06a4106010 con 0x7f068c07af30 2024-09-18T12:52:28.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.876+0000 7f06a17fa640 1 -- 172.21.15.78:0/227949455 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f06a4106010 con 0x7f068c07af30 2024-09-18T12:52:28.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.878+0000 7f06aa647640 1 -- 172.21.15.78:0/227949455 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f068c07af30 msgr2=0x7f068c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:28.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.878+0000 7f06aa647640 1 --2- 172.21.15.78:0/227949455 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f068c07af30 0x7f068c07d3f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06940096c0 tx=0x7f0694009650 comp rx=0 tx=0).stop 2024-09-18T12:52:28.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.878+0000 7f06aa647640 1 -- 172.21.15.78:0/227949455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06a4101a60 msgr2=0x7f06a41968e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:28.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.878+0000 7f06aa647640 1 --2- 172.21.15.78:0/227949455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06a4101a60 0x7f06a41968e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f069800c810 tx=0x7f069800ccd0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.878+0000 7f06aa647640 1 -- 172.21.15.78:0/227949455 shutdown_connections 2024-09-18T12:52:28.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.878+0000 7f06aa647640 1 --2- 172.21.15.78:0/227949455 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f068c07af30 0x7f068c07d3f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.878+0000 7f06aa647640 1 --2- 172.21.15.78:0/227949455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06a4101a60 0x7f06a41968e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.878+0000 7f06aa647640 1 --2- 172.21.15.78:0/227949455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06a4100860 0x7f06a41963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.878+0000 7f06aa647640 1 -- 172.21.15.78:0/227949455 >> 172.21.15.78:0/227949455 conn(0x7f06a40fc010 msgr2=0x7f06a40fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:28.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.878+0000 7f06aa647640 1 -- 172.21.15.78:0/227949455 shutdown_connections 2024-09-18T12:52:28.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.878+0000 7f06aa647640 1 -- 172.21.15.78:0/227949455 wait complete. 2024-09-18T12:52:28.889 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:52:28.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.962+0000 7f7ab78dc640 1 -- 172.21.15.78:0/679746574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ab01023f0 msgr2=0x7f7ab01047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:28.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.962+0000 7f7ab78dc640 1 --2- 172.21.15.78:0/679746574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ab01023f0 0x7f7ab01047e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0098b0 tx=0x7f7aac02a4d0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.962+0000 7f7ab78dc640 1 -- 172.21.15.78:0/679746574 shutdown_connections 2024-09-18T12:52:28.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.962+0000 7f7ab78dc640 1 --2- 172.21.15.78:0/679746574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ab0104d20 0x7f7ab0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.962+0000 7f7ab78dc640 1 --2- 172.21.15.78:0/679746574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ab01023f0 0x7f7ab01047e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.962+0000 7f7ab78dc640 1 -- 172.21.15.78:0/679746574 >> 172.21.15.78:0/679746574 conn(0x7f7ab00fc010 msgr2=0x7f7ab00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:28.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.962+0000 7f7ab78dc640 1 -- 172.21.15.78:0/679746574 shutdown_connections 2024-09-18T12:52:28.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.962+0000 7f7ab78dc640 1 -- 172.21.15.78:0/679746574 wait complete. 2024-09-18T12:52:28.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.963+0000 7f7ab78dc640 1 Processor -- start 2024-09-18T12:52:28.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.963+0000 7f7ab78dc640 1 -- start start 2024-09-18T12:52:28.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.963+0000 7f7ab78dc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ab01023f0 0x7f7ab01974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:28.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.963+0000 7f7ab78dc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ab0104d20 0x7f7ab0197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:28.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.963+0000 7f7ab78dc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab010a7c0 con 0x7f7ab01023f0 2024-09-18T12:52:28.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.963+0000 7f7ab78dc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab010a640 con 0x7f7ab0104d20 2024-09-18T12:52:28.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.963+0000 7f7ab5678640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ab01023f0 0x7f7ab01974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:28.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.963+0000 7f7ab5678640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ab01023f0 0x7f7ab01974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37872/0 (socket says 172.21.15.78:37872) 2024-09-18T12:52:28.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.963+0000 7f7ab5678640 1 -- 172.21.15.78:0/1555122114 learned_addr learned my addr 172.21.15.78:0/1555122114 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:52:28.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.963+0000 7f7ab4e77640 1 --2- 172.21.15.78:0/1555122114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ab0104d20 0x7f7ab0197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:28.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.963+0000 7f7ab5678640 1 -- 172.21.15.78:0/1555122114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ab0104d20 msgr2=0x7f7ab0197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:28.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.963+0000 7f7ab5678640 1 --2- 172.21.15.78:0/1555122114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ab0104d20 0x7f7ab0197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:28.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.963+0000 7f7ab5678640 1 -- 172.21.15.78:0/1555122114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab01980a0 con 0x7f7ab01023f0 2024-09-18T12:52:28.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.963+0000 7f7ab5678640 1 --2- 172.21.15.78:0/1555122114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ab01023f0 0x7f7ab01974e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009880 tx=0x7f7aac0045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:28.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.964+0000 7f7aa67fc640 1 -- 172.21.15.78:0/1555122114 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7aac03f070 con 0x7f7ab01023f0 2024-09-18T12:52:28.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.964+0000 7f7ab78dc640 1 -- 172.21.15.78:0/1555122114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab019ca80 con 0x7f7ab01023f0 2024-09-18T12:52:28.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.964+0000 7f7ab78dc640 1 -- 172.21.15.78:0/1555122114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab019d010 con 0x7f7ab01023f0 2024-09-18T12:52:28.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.964+0000 7f7aa67fc640 1 -- 172.21.15.78:0/1555122114 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7aac004a50 con 0x7f7ab01023f0 2024-09-18T12:52:28.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.964+0000 7f7aa67fc640 1 -- 172.21.15.78:0/1555122114 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7aac035030 con 0x7f7ab01023f0 2024-09-18T12:52:28.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.965+0000 7f7ab78dc640 1 -- 172.21.15.78:0/1555122114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a940052c0 con 0x7f7ab01023f0 2024-09-18T12:52:28.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.966+0000 7f7aa67fc640 1 -- 172.21.15.78:0/1555122114 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7aac042070 con 0x7f7ab01023f0 2024-09-18T12:52:28.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.966+0000 7f7aa67fc640 1 --2- 172.21.15.78:0/1555122114 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7a9c07af90 0x7f7a9c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:28.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.966+0000 7f7aa67fc640 1 -- 172.21.15.78:0/1555122114 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f7aac0beb80 con 0x7f7ab01023f0 2024-09-18T12:52:28.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.966+0000 7f7ab4e77640 1 --2- 172.21.15.78:0/1555122114 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7a9c07af90 0x7f7a9c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:28.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.967+0000 7f7ab4e77640 1 --2- 172.21.15.78:0/1555122114 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7a9c07af90 0x7f7a9c07d450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0005fd0 tx=0x7f7aa0005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:28.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:28.972+0000 7f7aa67fc640 1 -- 172.21.15.78:0/1555122114 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f7aac08a250 con 0x7f7ab01023f0 2024-09-18T12:52:29.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.171+0000 7f7ab78dc640 1 -- 172.21.15.78:0/1555122114 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7a94000bf0 con 0x7f7a9c07af90 2024-09-18T12:52:29.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.172+0000 7f7aa67fc640 1 -- 172.21.15.78:0/1555122114 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f7a94000bf0 con 0x7f7a9c07af90 2024-09-18T12:52:29.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.174+0000 7f7ab78dc640 1 -- 172.21.15.78:0/1555122114 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7a9c07af90 msgr2=0x7f7a9c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.174+0000 7f7ab78dc640 1 --2- 172.21.15.78:0/1555122114 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7a9c07af90 0x7f7a9c07d450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0005fd0 tx=0x7f7aa0005850 comp rx=0 tx=0).stop 2024-09-18T12:52:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.174+0000 7f7ab78dc640 1 -- 172.21.15.78:0/1555122114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ab01023f0 msgr2=0x7f7ab01974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.174+0000 7f7ab78dc640 1 --2- 172.21.15.78:0/1555122114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ab01023f0 0x7f7ab01974e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009880 tx=0x7f7aac0045c0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.174+0000 7f7ab78dc640 1 -- 172.21.15.78:0/1555122114 shutdown_connections 2024-09-18T12:52:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.174+0000 7f7ab78dc640 1 --2- 172.21.15.78:0/1555122114 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7a9c07af90 0x7f7a9c07d450 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.174+0000 7f7ab78dc640 1 --2- 172.21.15.78:0/1555122114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ab0104d20 0x7f7ab0197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.174+0000 7f7ab78dc640 1 --2- 172.21.15.78:0/1555122114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ab01023f0 0x7f7ab01974e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.174+0000 7f7ab78dc640 1 -- 172.21.15.78:0/1555122114 >> 172.21.15.78:0/1555122114 conn(0x7f7ab00fc010 msgr2=0x7f7ab00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.174+0000 7f7ab78dc640 1 -- 172.21.15.78:0/1555122114 shutdown_connections 2024-09-18T12:52:29.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.174+0000 7f7ab78dc640 1 -- 172.21.15.78:0/1555122114 wait complete. 2024-09-18T12:52:29.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.257+0000 7fdaff2da640 1 -- 172.21.15.78:0/235762399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf8101a60 msgr2=0x7fdaf8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.257+0000 7fdaff2da640 1 --2- 172.21.15.78:0/235762399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf8101a60 0x7fdaf8101ee0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009880 tx=0x7fdae802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.257+0000 7fdaff2da640 1 -- 172.21.15.78:0/235762399 shutdown_connections 2024-09-18T12:52:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.257+0000 7fdaff2da640 1 --2- 172.21.15.78:0/235762399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf8101a60 0x7fdaf8101ee0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.257+0000 7fdaff2da640 1 --2- 172.21.15.78:0/235762399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaf8100860 0x7fdaf8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.257+0000 7fdaff2da640 1 -- 172.21.15.78:0/235762399 >> 172.21.15.78:0/235762399 conn(0x7fdaf80fc010 msgr2=0x7fdaf80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.257+0000 7fdaff2da640 1 -- 172.21.15.78:0/235762399 shutdown_connections 2024-09-18T12:52:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.257+0000 7fdaff2da640 1 -- 172.21.15.78:0/235762399 wait complete. 2024-09-18T12:52:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.258+0000 7fdaff2da640 1 Processor -- start 2024-09-18T12:52:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.258+0000 7fdaff2da640 1 -- start start 2024-09-18T12:52:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.258+0000 7fdaff2da640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaf8100860 0x7fdaf8104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.258+0000 7fdaff2da640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf8101a60 0x7fdaf8102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.258+0000 7fdaff2da640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf81096a0 con 0x7fdaf8101a60 2024-09-18T12:52:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.258+0000 7fdaff2da640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf8109520 con 0x7fdaf8100860 2024-09-18T12:52:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.258+0000 7fdafc875640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf8101a60 0x7fdaf8102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.258+0000 7fdafc875640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf8101a60 0x7fdaf8102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37892/0 (socket says 172.21.15.78:37892) 2024-09-18T12:52:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.258+0000 7fdafc875640 1 -- 172.21.15.78:0/1411801032 learned_addr learned my addr 172.21.15.78:0/1411801032 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:52:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.258+0000 7fdafd076640 1 --2- 172.21.15.78:0/1411801032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaf8100860 0x7fdaf8104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.258+0000 7fdafc875640 1 -- 172.21.15.78:0/1411801032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaf8100860 msgr2=0x7fdaf8104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.258+0000 7fdafc875640 1 --2- 172.21.15.78:0/1411801032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaf8100860 0x7fdaf8104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.258+0000 7fdafc875640 1 -- 172.21.15.78:0/1411801032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf8103380 con 0x7fdaf8101a60 2024-09-18T12:52:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.258+0000 7fdafd076640 1 --2- 172.21.15.78:0/1411801032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaf8100860 0x7fdaf8104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:52:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.259+0000 7fdafc875640 1 --2- 172.21.15.78:0/1411801032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf8101a60 0x7fdaf8102e40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdae8006010 tx=0x7fdae80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.259+0000 7fdaee7fc640 1 -- 172.21.15.78:0/1411801032 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdae803f070 con 0x7fdaf8101a60 2024-09-18T12:52:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.259+0000 7fdaee7fc640 1 -- 172.21.15.78:0/1411801032 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdae8004ac0 con 0x7fdaf8101a60 2024-09-18T12:52:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.259+0000 7fdaff2da640 1 -- 172.21.15.78:0/1411801032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf8103610 con 0x7fdaf8101a60 2024-09-18T12:52:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.259+0000 7fdaee7fc640 1 -- 172.21.15.78:0/1411801032 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdae8035030 con 0x7fdaf8101a60 2024-09-18T12:52:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.259+0000 7fdaff2da640 1 -- 172.21.15.78:0/1411801032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf8103b40 con 0x7fdaf8101a60 2024-09-18T12:52:29.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.260+0000 7fdaff2da640 1 -- 172.21.15.78:0/1411801032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf8100c60 con 0x7fdaf8101a60 2024-09-18T12:52:29.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.261+0000 7fdaee7fc640 1 -- 172.21.15.78:0/1411801032 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fdae8042070 con 0x7fdaf8101a60 2024-09-18T12:52:29.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.261+0000 7fdaee7fc640 1 --2- 172.21.15.78:0/1411801032 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdae407af80 0x7fdae407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:29.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.261+0000 7fdafd076640 1 --2- 172.21.15.78:0/1411801032 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdae407af80 0x7fdae407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:29.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.261+0000 7fdaee7fc640 1 -- 172.21.15.78:0/1411801032 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fdae80beb80 con 0x7fdaf8101a60 2024-09-18T12:52:29.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.262+0000 7fdafd076640 1 --2- 172.21.15.78:0/1411801032 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdae407af80 0x7fdae407d440 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdaf81018c0 tx=0x7fdaf4005e70 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:29.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.266+0000 7fdaee7fc640 1 -- 172.21.15.78:0/1411801032 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fdae808a250 con 0x7fdaf8101a60 2024-09-18T12:52:29.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.452+0000 7fdaff2da640 1 -- 172.21.15.78:0/1411801032 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdaf806a420 con 0x7fdae407af80 2024-09-18T12:52:29.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.462+0000 7fdaee7fc640 1 -- 172.21.15.78:0/1411801032 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fdaf806a420 con 0x7fdae407af80 2024-09-18T12:52:29.464 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:52:29.464 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (18s) 13s ago 11m 17.6M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T12:52:29.464 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (2m) 13s ago 11m 8648k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:52:29.464 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (2m) 59s ago 10m 8086k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:52:29.464 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (11m) 13s ago 11m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de bb77146b81c7 2024-09-18T12:52:29.465 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (10m) 59s ago 10m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de f82fdd264dc6 2024-09-18T12:52:29.465 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (9m) 13s ago 11m 79.3M - 9.4.12 2bacad6d85d8 0367cad8b635 2024-09-18T12:52:29.465 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (6m) 13s ago 5m 152M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:52:29.465 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (5m) 13s ago 5m 27.5M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:52:29.465 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (5m) 59s ago 5m 14.7M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:52:29.465 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (5m) 59s ago 5m 15.6M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:52:29.465 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (2m) 13s ago 12m 511M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:52:29.465 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (82s) 59s ago 10m 452M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:52:29.465 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (12m) 13s ago 12m 62.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1cb11a5bcd72 2024-09-18T12:52:29.465 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (10m) 59s ago 10m 44.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 02dfe1551226 2024-09-18T12:52:29.465 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (68s) 13s ago 11m 12.1M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:52:29.466 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (62s) 59s ago 10m 7335k - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:52:29.466 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (9m) 13s ago 9m 205M 1216M 19.1.1-330-gc2ddf972 ebb0615149de f634ad9ddb36 2024-09-18T12:52:29.466 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (8m) 13s ago 8m 221M 1216M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:52:29.466 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (8m) 13s ago 8m 179M 1216M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:52:29.466 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (7m) 59s ago 7m 236M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:52:29.466 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (7m) 59s ago 7m 208M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:52:29.466 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (6m) 59s ago 6m 194M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:52:29.466 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (39s) 13s ago 10m 42.1M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:52:29.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.464+0000 7fdaff2da640 1 -- 172.21.15.78:0/1411801032 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdae407af80 msgr2=0x7fdae407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.464+0000 7fdaff2da640 1 --2- 172.21.15.78:0/1411801032 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdae407af80 0x7fdae407d440 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdaf81018c0 tx=0x7fdaf4005e70 comp rx=0 tx=0).stop 2024-09-18T12:52:29.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.464+0000 7fdaff2da640 1 -- 172.21.15.78:0/1411801032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf8101a60 msgr2=0x7fdaf8102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.464+0000 7fdaff2da640 1 --2- 172.21.15.78:0/1411801032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf8101a60 0x7fdaf8102e40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdae8006010 tx=0x7fdae80046c0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.464+0000 7fdaff2da640 1 -- 172.21.15.78:0/1411801032 shutdown_connections 2024-09-18T12:52:29.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.464+0000 7fdaff2da640 1 --2- 172.21.15.78:0/1411801032 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdae407af80 0x7fdae407d440 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.464+0000 7fdaff2da640 1 --2- 172.21.15.78:0/1411801032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf8101a60 0x7fdaf8102e40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.464+0000 7fdaff2da640 1 --2- 172.21.15.78:0/1411801032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdaf8100860 0x7fdaf8104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.464+0000 7fdaff2da640 1 -- 172.21.15.78:0/1411801032 >> 172.21.15.78:0/1411801032 conn(0x7fdaf80fc010 msgr2=0x7fdaf8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:29.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.464+0000 7fdaff2da640 1 -- 172.21.15.78:0/1411801032 shutdown_connections 2024-09-18T12:52:29.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.464+0000 7fdaff2da640 1 -- 172.21.15.78:0/1411801032 wait complete. 2024-09-18T12:52:29.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.545+0000 7f11720fe640 1 -- 172.21.15.78:0/1597634772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c104d20 msgr2=0x7f116c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.545+0000 7f11720fe640 1 --2- 172.21.15.78:0/1597634772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c104d20 0x7f116c107110 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f11600098b0 tx=0x7f116002a4d0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.545+0000 7f11720fe640 1 -- 172.21.15.78:0/1597634772 shutdown_connections 2024-09-18T12:52:29.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.545+0000 7f11720fe640 1 --2- 172.21.15.78:0/1597634772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c104d20 0x7f116c107110 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.545+0000 7f11720fe640 1 --2- 172.21.15.78:0/1597634772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f116c1023f0 0x7f116c1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.545+0000 7f11720fe640 1 -- 172.21.15.78:0/1597634772 >> 172.21.15.78:0/1597634772 conn(0x7f116c0fc010 msgr2=0x7f116c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:29.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.545+0000 7f11720fe640 1 -- 172.21.15.78:0/1597634772 shutdown_connections 2024-09-18T12:52:29.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.545+0000 7f11720fe640 1 -- 172.21.15.78:0/1597634772 wait complete. 2024-09-18T12:52:29.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.546+0000 7f11720fe640 1 Processor -- start 2024-09-18T12:52:29.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.546+0000 7f11720fe640 1 -- start start 2024-09-18T12:52:29.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.546+0000 7f11720fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c1023f0 0x7f116c101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:29.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.546+0000 7f11720fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f116c104d20 0x7f116c1003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:29.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.546+0000 7f11720fe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f116c10a810 con 0x7f116c1023f0 2024-09-18T12:52:29.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.546+0000 7f11720fe640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f116c10a690 con 0x7f116c104d20 2024-09-18T12:52:29.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.546+0000 7f116b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c1023f0 0x7f116c101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:29.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.546+0000 7f116b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c1023f0 0x7f116c101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37914/0 (socket says 172.21.15.78:37914) 2024-09-18T12:52:29.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.546+0000 7f116b7fe640 1 -- 172.21.15.78:0/1890971627 learned_addr learned my addr 172.21.15.78:0/1890971627 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:52:29.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.547+0000 7f116affd640 1 --2- 172.21.15.78:0/1890971627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f116c104d20 0x7f116c1003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:29.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.547+0000 7f116b7fe640 1 -- 172.21.15.78:0/1890971627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f116c104d20 msgr2=0x7f116c1003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.547+0000 7f116b7fe640 1 --2- 172.21.15.78:0/1890971627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f116c104d20 0x7f116c1003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.547+0000 7f116b7fe640 1 -- 172.21.15.78:0/1890971627 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c1008e0 con 0x7f116c1023f0 2024-09-18T12:52:29.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.547+0000 7f116b7fe640 1 --2- 172.21.15.78:0/1890971627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c1023f0 0x7f116c101ce0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f115c00ba50 tx=0x7f115c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:29.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.547+0000 7f1168ff9640 1 -- 172.21.15.78:0/1890971627 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f115c019070 con 0x7f116c1023f0 2024-09-18T12:52:29.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.547+0000 7f1168ff9640 1 -- 172.21.15.78:0/1890971627 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f115c00ce20 con 0x7f116c1023f0 2024-09-18T12:52:29.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.547+0000 7f11720fe640 1 -- 172.21.15.78:0/1890971627 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116c100bd0 con 0x7f116c1023f0 2024-09-18T12:52:29.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.547+0000 7f1168ff9640 1 -- 172.21.15.78:0/1890971627 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f115c0075a0 con 0x7f116c1023f0 2024-09-18T12:52:29.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.547+0000 7f11720fe640 1 -- 172.21.15.78:0/1890971627 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116c1011b0 con 0x7f116c1023f0 2024-09-18T12:52:29.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.548+0000 7f11720fe640 1 -- 172.21.15.78:0/1890971627 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f116c1027d0 con 0x7f116c1023f0 2024-09-18T12:52:29.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.550+0000 7f1168ff9640 1 -- 172.21.15.78:0/1890971627 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f115c01c020 con 0x7f116c1023f0 2024-09-18T12:52:29.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.550+0000 7f1168ff9640 1 --2- 172.21.15.78:0/1890971627 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f115407af30 0x7f115407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:29.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.551+0000 7f1168ff9640 1 -- 172.21.15.78:0/1890971627 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f115c09dff0 con 0x7f116c1023f0 2024-09-18T12:52:29.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.551+0000 7f116affd640 1 --2- 172.21.15.78:0/1890971627 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f115407af30 0x7f115407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:29.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.551+0000 7f116affd640 1 --2- 172.21.15.78:0/1890971627 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f115407af30 0x7f115407d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1160006010 tx=0x7f1160009580 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:29.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.554+0000 7f1168ff9640 1 -- 172.21.15.78:0/1890971627 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f115c023070 con 0x7f116c1023f0 2024-09-18T12:52:29.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.801+0000 7f11720fe640 1 -- 172.21.15.78:0/1890971627 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f116c19f7a0 con 0x7f116c1023f0 2024-09-18T12:52:29.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.802+0000 7f1168ff9640 1 -- 172.21.15.78:0/1890971627 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f115c069640 con 0x7f116c1023f0 2024-09-18T12:52:29.804 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:52:29.804 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:52:29.804 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:52:29.804 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:52:29.804 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:52:29.804 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:52:29.805 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:52:29.805 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:52:29.805 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:52:29.805 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:52:29.805 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:52:29.805 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:52:29.805 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:52:29.805 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:52:29.805 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-18T12:52:29.805 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:52:29.805 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:52:29.806 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:52:29.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.804+0000 7f11720fe640 1 -- 172.21.15.78:0/1890971627 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f115407af30 msgr2=0x7f115407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.804+0000 7f11720fe640 1 --2- 172.21.15.78:0/1890971627 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f115407af30 0x7f115407d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1160006010 tx=0x7f1160009580 comp rx=0 tx=0).stop 2024-09-18T12:52:29.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.804+0000 7f11720fe640 1 -- 172.21.15.78:0/1890971627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c1023f0 msgr2=0x7f116c101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.804+0000 7f11720fe640 1 --2- 172.21.15.78:0/1890971627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c1023f0 0x7f116c101ce0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f115c00ba50 tx=0x7f115c00bf10 comp rx=0 tx=0).stop 2024-09-18T12:52:29.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.804+0000 7f11720fe640 1 -- 172.21.15.78:0/1890971627 shutdown_connections 2024-09-18T12:52:29.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.804+0000 7f11720fe640 1 --2- 172.21.15.78:0/1890971627 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f115407af30 0x7f115407d3f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.804+0000 7f11720fe640 1 --2- 172.21.15.78:0/1890971627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f116c104d20 0x7f116c1003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.804+0000 7f11720fe640 1 --2- 172.21.15.78:0/1890971627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f116c1023f0 0x7f116c101ce0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.804+0000 7f11720fe640 1 -- 172.21.15.78:0/1890971627 >> 172.21.15.78:0/1890971627 conn(0x7f116c0fc010 msgr2=0x7f116c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:29.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.804+0000 7f11720fe640 1 -- 172.21.15.78:0/1890971627 shutdown_connections 2024-09-18T12:52:29.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.804+0000 7f11720fe640 1 -- 172.21.15.78:0/1890971627 wait complete. 2024-09-18T12:52:29.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.886+0000 7f1846119640 1 -- 172.21.15.78:0/2083988167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1840101a60 msgr2=0x7f1840101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.886+0000 7f1846119640 1 --2- 172.21.15.78:0/2083988167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1840101a60 0x7f1840101ee0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1828009880 tx=0x7f182802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.886+0000 7f1846119640 1 -- 172.21.15.78:0/2083988167 shutdown_connections 2024-09-18T12:52:29.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.886+0000 7f1846119640 1 --2- 172.21.15.78:0/2083988167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1840101a60 0x7f1840101ee0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.886+0000 7f1846119640 1 --2- 172.21.15.78:0/2083988167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1840100860 0x7f1840100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.886+0000 7f1846119640 1 -- 172.21.15.78:0/2083988167 >> 172.21.15.78:0/2083988167 conn(0x7f18400fc010 msgr2=0x7f18400fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:29.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.886+0000 7f1846119640 1 -- 172.21.15.78:0/2083988167 shutdown_connections 2024-09-18T12:52:29.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.886+0000 7f1846119640 1 -- 172.21.15.78:0/2083988167 wait complete. 2024-09-18T12:52:29.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.887+0000 7f1846119640 1 Processor -- start 2024-09-18T12:52:29.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.887+0000 7f1846119640 1 -- start start 2024-09-18T12:52:29.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.887+0000 7f1846119640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1840100860 0x7f1840197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:29.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.887+0000 7f1846119640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1840101a60 0x7f1840197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:29.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.887+0000 7f1846119640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f18401096a0 con 0x7f1840100860 2024-09-18T12:52:29.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.887+0000 7f1846119640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1840109520 con 0x7f1840101a60 2024-09-18T12:52:29.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.887+0000 7f183f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1840100860 0x7f1840197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:29.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.887+0000 7f183f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1840100860 0x7f1840197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37934/0 (socket says 172.21.15.78:37934) 2024-09-18T12:52:29.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.887+0000 7f183f7fe640 1 -- 172.21.15.78:0/1762264790 learned_addr learned my addr 172.21.15.78:0/1762264790 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:52:29.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.888+0000 7f1836ffd640 1 --2- 172.21.15.78:0/1762264790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1840101a60 0x7f1840197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:29.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.888+0000 7f183f7fe640 1 -- 172.21.15.78:0/1762264790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1840101a60 msgr2=0x7f1840197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:29.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.888+0000 7f183f7fe640 1 --2- 172.21.15.78:0/1762264790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1840101a60 0x7f1840197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:29.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.888+0000 7f183f7fe640 1 -- 172.21.15.78:0/1762264790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18401980e0 con 0x7f1840100860 2024-09-18T12:52:29.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.888+0000 7f183f7fe640 1 --2- 172.21.15.78:0/1762264790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1840100860 0x7f1840197520 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f183000d8d0 tx=0x7f183000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:29.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.888+0000 7f183d7fa640 1 -- 172.21.15.78:0/1762264790 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1830017070 con 0x7f1840100860 2024-09-18T12:52:29.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.888+0000 7f183d7fa640 1 -- 172.21.15.78:0/1762264790 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f183000be10 con 0x7f1840100860 2024-09-18T12:52:29.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.888+0000 7f183d7fa640 1 -- 172.21.15.78:0/1762264790 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f183000f3c0 con 0x7f1840100860 2024-09-18T12:52:29.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.888+0000 7f1846119640 1 -- 172.21.15.78:0/1762264790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f184019cb20 con 0x7f1840100860 2024-09-18T12:52:29.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.888+0000 7f1846119640 1 -- 172.21.15.78:0/1762264790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f184019d0b0 con 0x7f1840100860 2024-09-18T12:52:29.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.889+0000 7f1846119640 1 -- 172.21.15.78:0/1762264790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1840100c60 con 0x7f1840100860 2024-09-18T12:52:29.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.890+0000 7f183d7fa640 1 -- 172.21.15.78:0/1762264790 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f183001a070 con 0x7f1840100860 2024-09-18T12:52:29.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.890+0000 7f183d7fa640 1 --2- 172.21.15.78:0/1762264790 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f182c07af80 0x7f182c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:29.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.890+0000 7f183d7fa640 1 -- 172.21.15.78:0/1762264790 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f183009db30 con 0x7f1840100860 2024-09-18T12:52:29.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.890+0000 7f1836ffd640 1 --2- 172.21.15.78:0/1762264790 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f182c07af80 0x7f182c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:29.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.891+0000 7f1836ffd640 1 --2- 172.21.15.78:0/1762264790 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f182c07af80 0x7f182c07d440 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f18401989d0 tx=0x7f1828005a20 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:29.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:29.896+0000 7f183d7fa640 1 -- 172.21.15.78:0/1762264790 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f1830069200 con 0x7f1840100860 2024-09-18T12:52:30.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:30.098+0000 7f1846119640 1 -- 172.21.15.78:0/1762264790 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f184006a970 con 0x7f182c07af80 2024-09-18T12:52:30.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:30.099+0000 7f183d7fa640 1 -- 172.21.15.78:0/1762264790 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f184006a970 con 0x7f182c07af80 2024-09-18T12:52:30.102 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:52:30.102 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:52:30.102 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:52:30.102 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:52:30.102 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:52:30.102 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr" 2024-09-18T12:52:30.102 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:52:30.102 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "2/2 daemons upgraded", 2024-09-18T12:52:30.102 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading grafana daemons", 2024-09-18T12:52:30.102 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:52:30.103 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:52:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:30.101+0000 7f1846119640 1 -- 172.21.15.78:0/1762264790 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f182c07af80 msgr2=0x7f182c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:30.101+0000 7f1846119640 1 --2- 172.21.15.78:0/1762264790 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f182c07af80 0x7f182c07d440 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f18401989d0 tx=0x7f1828005a20 comp rx=0 tx=0).stop 2024-09-18T12:52:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:30.101+0000 7f1846119640 1 -- 172.21.15.78:0/1762264790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1840100860 msgr2=0x7f1840197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:30.101+0000 7f1846119640 1 --2- 172.21.15.78:0/1762264790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1840100860 0x7f1840197520 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f183000d8d0 tx=0x7f183000dd90 comp rx=0 tx=0).stop 2024-09-18T12:52:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:30.102+0000 7f1846119640 1 -- 172.21.15.78:0/1762264790 shutdown_connections 2024-09-18T12:52:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:30.102+0000 7f1846119640 1 --2- 172.21.15.78:0/1762264790 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f182c07af80 0x7f182c07d440 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:30.102+0000 7f1846119640 1 --2- 172.21.15.78:0/1762264790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1840101a60 0x7f1840197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:30.102+0000 7f1846119640 1 --2- 172.21.15.78:0/1762264790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1840100860 0x7f1840197520 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:30.102+0000 7f1846119640 1 -- 172.21.15.78:0/1762264790 >> 172.21.15.78:0/1762264790 conn(0x7f18400fc010 msgr2=0x7f184006a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:30.102+0000 7f1846119640 1 -- 172.21.15.78:0/1762264790 shutdown_connections 2024-09-18T12:52:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:52:30.102+0000 7f1846119640 1 -- 172.21.15.78:0/1762264790 wait complete. 2024-09-18T12:52:30.389 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:30 smithi078 ceph-mon[28091]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:30.389 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:30 smithi078 ceph-mon[28091]: pgmap v65: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:30.389 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:30 smithi078 ceph-mon[28091]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:30.389 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:30 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1890971627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:30.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:30 smithi148 ceph-mon[35352]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:30.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:30 smithi148 ceph-mon[35352]: pgmap v65: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:30.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:30 smithi148 ceph-mon[35352]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:30.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:30 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1890971627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:31.409 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:31 smithi078 ceph-mon[28091]: from='client.14888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:31.409 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:31 smithi078 ceph-mon[28091]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:31.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:31 smithi148 ceph-mon[35352]: from='client.14888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:31.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:31 smithi148 ceph-mon[35352]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:32.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:32 smithi078 ceph-mon[28091]: pgmap v66: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:32 smithi148 ceph-mon[35352]: pgmap v66: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:34.616 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:34 smithi078 ceph-mon[28091]: pgmap v67: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:34.616 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:34 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:34.616 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:34 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:34.616 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:34 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:34 smithi148 ceph-mon[35352]: pgmap v67: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:34 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:34 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:34 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:36.436 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:36 smithi078 ceph-mon[28091]: pgmap v68: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:36 smithi148 ceph-mon[35352]: pgmap v68: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:37.707 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:37 smithi078 ceph-mon[28091]: pgmap v69: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:37.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:37 smithi148 ceph-mon[35352]: pgmap v69: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:39.939 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:39 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:39.939 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:39 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:39.939 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:39 smithi078 ceph-mon[28091]: pgmap v70: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:39.939 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:39 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:39.939 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:39 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:39.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:39 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:39.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:39 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:39.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:39 smithi148 ceph-mon[35352]: pgmap v70: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:39.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:39 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:39.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:39 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:40.909 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:40 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:40.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:40 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:41.934 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:41 smithi078 ceph-mon[28091]: pgmap v71: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:41 smithi148 ceph-mon[35352]: pgmap v71: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:43.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:43.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:43.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:43.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:52:43.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:43.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:52:43.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:52:43.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:43.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.726 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: Upgrade: Finalizing container_image settings 2024-09-18T12:52:43.726 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:43.726 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-18T12:52:43.726 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-18T12:52:43.726 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.726 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-18T12:52:43.726 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-18T12:52:43.726 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-18T12:52:43.726 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-18T12:52:43.726 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-18T12:52:43.726 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-18T12:52:43.726 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-18T12:52:43.726 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-18T12:52:43.726 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.726 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-18T12:52:43.727 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-18T12:52:43.727 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-18T12:52:43.727 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-18T12:52:43.727 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-18T12:52:43.727 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-18T12:52:43.727 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-18T12:52:43.727 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.727 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.727 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.727 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.727 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.727 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.727 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: Upgrade: Complete! 2024-09-18T12:52:43.727 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-18T12:52:43.728 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-18T12:52:43.728 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:43.728 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:43.728 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:52:43.728 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:43.728 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:43.728 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:43.728 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:52:43.728 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:43.728 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:43 smithi148 ceph-mon[35352]: pgmap v72: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:52:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:52:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:52:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:43.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: Upgrade: Finalizing container_image settings 2024-09-18T12:52:43.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:43.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-18T12:52:43.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-18T12:52:43.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-18T12:52:43.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-18T12:52:43.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-18T12:52:43.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-18T12:52:43.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-18T12:52:43.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-18T12:52:43.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-18T12:52:43.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-18T12:52:43.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-18T12:52:43.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-18T12:52:43.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-18T12:52:43.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-18T12:52:43.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-18T12:52:43.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-18T12:52:43.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-18T12:52:43.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:52:43.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: Upgrade: Complete! 2024-09-18T12:52:43.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-18T12:52:43.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-18T12:52:43.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:43.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:43.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:52:43.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:43.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:43.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:43.746 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:52:43.747 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:43.747 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:43 smithi078 ceph-mon[28091]: pgmap v72: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:46 smithi148 ceph-mon[35352]: pgmap v73: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:46 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:46.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:46 smithi078 ceph-mon[28091]: pgmap v73: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:46.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:46 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:52:48.447 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:48 smithi148 ceph-mon[35352]: pgmap v74: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:48.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:48 smithi078 ceph-mon[28091]: pgmap v74: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:50.476 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:50 smithi148 ceph-mon[35352]: pgmap v75: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:50.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:50 smithi078 ceph-mon[28091]: pgmap v75: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:52 smithi148 ceph-mon[35352]: pgmap v76: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:52 smithi078 ceph-mon[28091]: pgmap v76: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:54.438 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:54 smithi078 ceph-mon[28091]: pgmap v77: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:54.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:54 smithi148 ceph-mon[35352]: pgmap v77: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:56 smithi148 ceph-mon[35352]: pgmap v78: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:56 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:56 smithi078 ceph-mon[28091]: pgmap v78: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:56 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:58.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:52:58 smithi148 ceph-mon[35352]: pgmap v79: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:52:58.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:52:58 smithi078 ceph-mon[28091]: pgmap v79: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:00.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.195+0000 7f0918f9e640 1 -- 172.21.15.78:0/767600510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0914104dc0 msgr2=0x7f09141071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:00.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.195+0000 7f0918f9e640 1 --2- 172.21.15.78:0/767600510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0914104dc0 0x7f09141071b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009880 tx=0x7f08fc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:00.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.195+0000 7f0918f9e640 1 -- 172.21.15.78:0/767600510 shutdown_connections 2024-09-18T12:53:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.195+0000 7f0918f9e640 1 --2- 172.21.15.78:0/767600510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0914104dc0 0x7f09141071b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.195+0000 7f0918f9e640 1 --2- 172.21.15.78:0/767600510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0914102490 0x7f0914104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.195+0000 7f0918f9e640 1 -- 172.21.15.78:0/767600510 >> 172.21.15.78:0/767600510 conn(0x7f09140fc010 msgr2=0x7f09140fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.195+0000 7f0918f9e640 1 -- 172.21.15.78:0/767600510 shutdown_connections 2024-09-18T12:53:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.195+0000 7f0918f9e640 1 -- 172.21.15.78:0/767600510 wait complete. 2024-09-18T12:53:00.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.196+0000 7f0918f9e640 1 Processor -- start 2024-09-18T12:53:00.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.196+0000 7f0918f9e640 1 -- start start 2024-09-18T12:53:00.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.196+0000 7f0918f9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0914102490 0x7f09141974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:00.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.196+0000 7f0918f9e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0914104dc0 0x7f0914197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:00.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.196+0000 7f0918f9e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f091410a780 con 0x7f0914102490 2024-09-18T12:53:00.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.196+0000 7f0918f9e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f091410a600 con 0x7f0914104dc0 2024-09-18T12:53:00.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.196+0000 7f091259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0914102490 0x7f09141974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:00.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.196+0000 7f091259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0914102490 0x7f09141974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33650/0 (socket says 172.21.15.78:33650) 2024-09-18T12:53:00.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.196+0000 7f091259c640 1 -- 172.21.15.78:0/1182341073 learned_addr learned my addr 172.21.15.78:0/1182341073 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:00.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.196+0000 7f0911d9b640 1 --2- 172.21.15.78:0/1182341073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0914104dc0 0x7f0914197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.196+0000 7f091259c640 1 -- 172.21.15.78:0/1182341073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0914104dc0 msgr2=0x7f0914197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.196+0000 7f091259c640 1 --2- 172.21.15.78:0/1182341073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0914104dc0 0x7f0914197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.196+0000 7f091259c640 1 -- 172.21.15.78:0/1182341073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0914198010 con 0x7f0914102490 2024-09-18T12:53:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.196+0000 7f0911d9b640 1 --2- 172.21.15.78:0/1182341073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0914104dc0 0x7f0914197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:53:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.196+0000 7f091259c640 1 --2- 172.21.15.78:0/1182341073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0914102490 0x7f09141974e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f090400cc60 tx=0x7f090400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.197+0000 7f090b7fe640 1 -- 172.21.15.78:0/1182341073 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f090400ce10 con 0x7f0914102490 2024-09-18T12:53:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.197+0000 7f0918f9e640 1 -- 172.21.15.78:0/1182341073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f091419ca80 con 0x7f0914102490 2024-09-18T12:53:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.197+0000 7f090b7fe640 1 -- 172.21.15.78:0/1182341073 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f090400f910 con 0x7f0914102490 2024-09-18T12:53:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.197+0000 7f090b7fe640 1 -- 172.21.15.78:0/1182341073 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0904018ae0 con 0x7f0914102490 2024-09-18T12:53:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.197+0000 7f0918f9e640 1 -- 172.21.15.78:0/1182341073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f091419cfe0 con 0x7f0914102490 2024-09-18T12:53:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.198+0000 7f0918f9e640 1 -- 172.21.15.78:0/1182341073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0914102870 con 0x7f0914102490 2024-09-18T12:53:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.199+0000 7f090b7fe640 1 -- 172.21.15.78:0/1182341073 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f0904018ca0 con 0x7f0914102490 2024-09-18T12:53:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.199+0000 7f090b7fe640 1 --2- 172.21.15.78:0/1182341073 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f090007af30 0x7f090007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.199+0000 7f090b7fe640 1 -- 172.21.15.78:0/1182341073 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f090409e6b0 con 0x7f0914102490 2024-09-18T12:53:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.199+0000 7f0911d9b640 1 --2- 172.21.15.78:0/1182341073 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f090007af30 0x7f090007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.200+0000 7f0911d9b640 1 --2- 172.21.15.78:0/1182341073 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f090007af30 0x7f090007d3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0096c0 tx=0x7f08fc009650 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:00.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.204+0000 7f090b7fe640 1 -- 172.21.15.78:0/1182341073 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f0904014030 con 0x7f0914102490 2024-09-18T12:53:00.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.395+0000 7f0918f9e640 1 -- 172.21.15.78:0/1182341073 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f09141058a0 con 0x7f090007af30 2024-09-18T12:53:00.396 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:00 smithi078 ceph-mon[28091]: pgmap v80: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:00.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.396+0000 7f090b7fe640 1 -- 172.21.15.78:0/1182341073 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f09141058a0 con 0x7f090007af30 2024-09-18T12:53:00.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.398+0000 7f0918f9e640 1 -- 172.21.15.78:0/1182341073 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f090007af30 msgr2=0x7f090007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:00.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.398+0000 7f0918f9e640 1 --2- 172.21.15.78:0/1182341073 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f090007af30 0x7f090007d3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0096c0 tx=0x7f08fc009650 comp rx=0 tx=0).stop 2024-09-18T12:53:00.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.398+0000 7f0918f9e640 1 -- 172.21.15.78:0/1182341073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0914102490 msgr2=0x7f09141974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:00.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.398+0000 7f0918f9e640 1 --2- 172.21.15.78:0/1182341073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0914102490 0x7f09141974e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f090400cc60 tx=0x7f090400a620 comp rx=0 tx=0).stop 2024-09-18T12:53:00.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.398+0000 7f0918f9e640 1 -- 172.21.15.78:0/1182341073 shutdown_connections 2024-09-18T12:53:00.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.398+0000 7f0918f9e640 1 --2- 172.21.15.78:0/1182341073 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f090007af30 0x7f090007d3f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:00.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.398+0000 7f0918f9e640 1 --2- 172.21.15.78:0/1182341073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0914104dc0 0x7f0914197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:00.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.398+0000 7f0918f9e640 1 --2- 172.21.15.78:0/1182341073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0914102490 0x7f09141974e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:00.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.398+0000 7f0918f9e640 1 -- 172.21.15.78:0/1182341073 >> 172.21.15.78:0/1182341073 conn(0x7f09140fc010 msgr2=0x7f09140fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:00.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.398+0000 7f0918f9e640 1 -- 172.21.15.78:0/1182341073 shutdown_connections 2024-09-18T12:53:00.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:00.398+0000 7f0918f9e640 1 -- 172.21.15.78:0/1182341073 wait complete. 2024-09-18T12:53:00.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:00 smithi148 ceph-mon[35352]: pgmap v80: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:02.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:02 smithi148 ceph-mon[35352]: from='client.14900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:02.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:02 smithi148 ceph-mon[35352]: pgmap v81: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:02 smithi078 ceph-mon[28091]: from='client.14900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:02 smithi078 ceph-mon[28091]: pgmap v81: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:02.603 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-18T12:53:02.901 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:53:03.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.363+0000 7fc91bd7b640 1 -- 172.21.15.78:0/4012379366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9141067f0 msgr2=0x7fc914106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.363+0000 7fc91bd7b640 1 --2- 172.21.15.78:0/4012379366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9141067f0 0x7fc914106bd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc910009880 tx=0x7fc91002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.363+0000 7fc91bd7b640 1 -- 172.21.15.78:0/4012379366 shutdown_connections 2024-09-18T12:53:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.363+0000 7fc91bd7b640 1 --2- 172.21.15.78:0/4012379366 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9141007f0 0x7fc914100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.363+0000 7fc91bd7b640 1 --2- 172.21.15.78:0/4012379366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9141067f0 0x7fc914106bd0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.363+0000 7fc91bd7b640 1 -- 172.21.15.78:0/4012379366 >> 172.21.15.78:0/4012379366 conn(0x7fc9140fc550 msgr2=0x7fc9140fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.364+0000 7fc91bd7b640 1 -- 172.21.15.78:0/4012379366 shutdown_connections 2024-09-18T12:53:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.364+0000 7fc91bd7b640 1 -- 172.21.15.78:0/4012379366 wait complete. 2024-09-18T12:53:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.364+0000 7fc91bd7b640 1 Processor -- start 2024-09-18T12:53:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.364+0000 7fc91bd7b640 1 -- start start 2024-09-18T12:53:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.365+0000 7fc91bd7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9141007f0 0x7fc914198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.365+0000 7fc91bd7b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9141067f0 0x7fc914198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.365+0000 7fc91bd7b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc91410dcc0 con 0x7fc9141007f0 2024-09-18T12:53:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.365+0000 7fc91bd7b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc91410db40 con 0x7fc9141067f0 2024-09-18T12:53:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.365+0000 7fc919b17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9141007f0 0x7fc914198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.365+0000 7fc919b17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9141007f0 0x7fc914198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48502/0 (socket says 172.21.15.78:48502) 2024-09-18T12:53:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.365+0000 7fc919b17640 1 -- 172.21.15.78:0/2751041048 learned_addr learned my addr 172.21.15.78:0/2751041048 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.365+0000 7fc919316640 1 --2- 172.21.15.78:0/2751041048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9141067f0 0x7fc914198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.365+0000 7fc919b17640 1 -- 172.21.15.78:0/2751041048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9141067f0 msgr2=0x7fc914198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.365+0000 7fc919b17640 1 --2- 172.21.15.78:0/2751041048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9141067f0 0x7fc914198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.365+0000 7fc919b17640 1 -- 172.21.15.78:0/2751041048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc914199350 con 0x7fc9141007f0 2024-09-18T12:53:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.365+0000 7fc919b17640 1 --2- 172.21.15.78:0/2751041048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9141007f0 0x7fc914198810 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc910031460 tx=0x7fc9100045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.366+0000 7fc90affd640 1 -- 172.21.15.78:0/2751041048 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc91003f070 con 0x7fc9141007f0 2024-09-18T12:53:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.366+0000 7fc91bd7b640 1 -- 172.21.15.78:0/2751041048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9141995e0 con 0x7fc9141007f0 2024-09-18T12:53:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.366+0000 7fc90affd640 1 -- 172.21.15.78:0/2751041048 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc9100035f0 con 0x7fc9141007f0 2024-09-18T12:53:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.366+0000 7fc90affd640 1 -- 172.21.15.78:0/2751041048 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc910035030 con 0x7fc9141007f0 2024-09-18T12:53:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.366+0000 7fc91bd7b640 1 -- 172.21.15.78:0/2751041048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9141a1b90 con 0x7fc9141007f0 2024-09-18T12:53:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.367+0000 7fc91bd7b640 1 -- 172.21.15.78:0/2751041048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc914101f30 con 0x7fc9141007f0 2024-09-18T12:53:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.367+0000 7fc90affd640 1 -- 172.21.15.78:0/2751041048 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc910042070 con 0x7fc9141007f0 2024-09-18T12:53:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.368+0000 7fc90affd640 1 --2- 172.21.15.78:0/2751041048 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc90007af30 0x7fc90007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.368+0000 7fc919316640 1 --2- 172.21.15.78:0/2751041048 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc90007af30 0x7fc90007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.368+0000 7fc90affd640 1 -- 172.21.15.78:0/2751041048 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fc9100be970 con 0x7fc9141007f0 2024-09-18T12:53:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.369+0000 7fc919316640 1 --2- 172.21.15.78:0/2751041048 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc90007af30 0x7fc90007d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc91406a7f0 tx=0x7fc90400b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.372+0000 7fc90affd640 1 -- 172.21.15.78:0/2751041048 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fc910089f20 con 0x7fc9141007f0 2024-09-18T12:53:03.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.626+0000 7fc91bd7b640 1 -- 172.21.15.78:0/2751041048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc914108d60 con 0x7fc9141007f0 2024-09-18T12:53:03.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.626+0000 7fc90affd640 1 -- 172.21.15.78:0/2751041048 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fc91008edd0 con 0x7fc9141007f0 2024-09-18T12:53:03.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.628+0000 7fc91bd7b640 1 -- 172.21.15.78:0/2751041048 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc90007af30 msgr2=0x7fc90007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.628+0000 7fc91bd7b640 1 --2- 172.21.15.78:0/2751041048 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc90007af30 0x7fc90007d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc91406a7f0 tx=0x7fc90400b390 comp rx=0 tx=0).stop 2024-09-18T12:53:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.628+0000 7fc91bd7b640 1 -- 172.21.15.78:0/2751041048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9141007f0 msgr2=0x7fc914198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.628+0000 7fc91bd7b640 1 --2- 172.21.15.78:0/2751041048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9141007f0 0x7fc914198810 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc910031460 tx=0x7fc9100045e0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.628+0000 7fc91bd7b640 1 -- 172.21.15.78:0/2751041048 shutdown_connections 2024-09-18T12:53:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.628+0000 7fc91bd7b640 1 --2- 172.21.15.78:0/2751041048 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc90007af30 0x7fc90007d3f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.628+0000 7fc91bd7b640 1 --2- 172.21.15.78:0/2751041048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9141067f0 0x7fc914198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.628+0000 7fc91bd7b640 1 --2- 172.21.15.78:0/2751041048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9141007f0 0x7fc914198810 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.628+0000 7fc91bd7b640 1 -- 172.21.15.78:0/2751041048 >> 172.21.15.78:0/2751041048 conn(0x7fc9140fc550 msgr2=0x7fc9140fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.628+0000 7fc91bd7b640 1 -- 172.21.15.78:0/2751041048 shutdown_connections 2024-09-18T12:53:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:03.628+0000 7fc91bd7b640 1 -- 172.21.15.78:0/2751041048 wait complete. 2024-09-18T12:53:03.639 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:53:04.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:04 smithi078 ceph-mon[28091]: pgmap v82: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:04.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:04 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/2751041048' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:04.298 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-18T12:53:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:04 smithi148 ceph-mon[35352]: pgmap v82: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:04 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/2751041048' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:04.554 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:53:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.018+0000 7fca4d5d1640 1 -- 172.21.15.78:0/1421917973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca481067f0 msgr2=0x7fca48106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.018+0000 7fca4d5d1640 1 --2- 172.21.15.78:0/1421917973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca481067f0 0x7fca48106bd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fca40009880 tx=0x7fca4002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.019+0000 7fca4d5d1640 1 -- 172.21.15.78:0/1421917973 shutdown_connections 2024-09-18T12:53:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.019+0000 7fca4d5d1640 1 --2- 172.21.15.78:0/1421917973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca481007f0 0x7fca48100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.019+0000 7fca4d5d1640 1 --2- 172.21.15.78:0/1421917973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca481067f0 0x7fca48106bd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.019+0000 7fca4d5d1640 1 -- 172.21.15.78:0/1421917973 >> 172.21.15.78:0/1421917973 conn(0x7fca480fc550 msgr2=0x7fca480fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.019+0000 7fca4d5d1640 1 -- 172.21.15.78:0/1421917973 shutdown_connections 2024-09-18T12:53:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.019+0000 7fca4d5d1640 1 -- 172.21.15.78:0/1421917973 wait complete. 2024-09-18T12:53:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.019+0000 7fca4d5d1640 1 Processor -- start 2024-09-18T12:53:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.019+0000 7fca4d5d1640 1 -- start start 2024-09-18T12:53:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca4d5d1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca481007f0 0x7fca481988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca4d5d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca481067f0 0x7fca48198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca4d5d1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fca4810dca0 con 0x7fca481067f0 2024-09-18T12:53:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca4d5d1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fca4810db20 con 0x7fca481007f0 2024-09-18T12:53:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca481067f0 0x7fca48198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca481067f0 0x7fca48198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48520/0 (socket says 172.21.15.78:48520) 2024-09-18T12:53:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca467fc640 1 -- 172.21.15.78:0/1810715482 learned_addr learned my addr 172.21.15.78:0/1810715482 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca46ffd640 1 --2- 172.21.15.78:0/1810715482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca481007f0 0x7fca481988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca467fc640 1 -- 172.21.15.78:0/1810715482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca481007f0 msgr2=0x7fca481988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca467fc640 1 --2- 172.21.15.78:0/1810715482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca481007f0 0x7fca481988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca467fc640 1 -- 172.21.15.78:0/1810715482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca48199380 con 0x7fca481067f0 2024-09-18T12:53:05.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca467fc640 1 --2- 172.21.15.78:0/1810715482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca481067f0 0x7fca48198e10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fca3000cc60 tx=0x7fca3000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:05.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca3ffff640 1 -- 172.21.15.78:0/1810715482 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca3000ce10 con 0x7fca481067f0 2024-09-18T12:53:05.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca3ffff640 1 -- 172.21.15.78:0/1810715482 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca3000f910 con 0x7fca481067f0 2024-09-18T12:53:05.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca4d5d1640 1 -- 172.21.15.78:0/1810715482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca48199670 con 0x7fca481067f0 2024-09-18T12:53:05.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.020+0000 7fca3ffff640 1 -- 172.21.15.78:0/1810715482 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca30018ae0 con 0x7fca481067f0 2024-09-18T12:53:05.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.021+0000 7fca4d5d1640 1 -- 172.21.15.78:0/1810715482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca481a1c70 con 0x7fca481067f0 2024-09-18T12:53:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.022+0000 7fca4d5d1640 1 -- 172.21.15.78:0/1810715482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca48101f30 con 0x7fca481067f0 2024-09-18T12:53:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.022+0000 7fca3ffff640 1 -- 172.21.15.78:0/1810715482 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fca30018c80 con 0x7fca481067f0 2024-09-18T12:53:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.023+0000 7fca3ffff640 1 --2- 172.21.15.78:0/1810715482 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fca3407af80 0x7fca3407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.023+0000 7fca46ffd640 1 --2- 172.21.15.78:0/1810715482 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fca3407af80 0x7fca3407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.023+0000 7fca3ffff640 1 -- 172.21.15.78:0/1810715482 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fca3009e470 con 0x7fca481067f0 2024-09-18T12:53:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.023+0000 7fca46ffd640 1 --2- 172.21.15.78:0/1810715482 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fca3407af80 0x7fca3407d440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fca40000c00 tx=0x7fca40031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.027+0000 7fca3ffff640 1 -- 172.21.15.78:0/1810715482 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fca30014030 con 0x7fca481067f0 2024-09-18T12:53:05.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.273+0000 7fca4d5d1640 1 -- 172.21.15.78:0/1810715482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fca48103a00 con 0x7fca481067f0 2024-09-18T12:53:05.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.273+0000 7fca3ffff640 1 -- 172.21.15.78:0/1810715482 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fca30069b40 con 0x7fca481067f0 2024-09-18T12:53:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.275+0000 7fca4d5d1640 1 -- 172.21.15.78:0/1810715482 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fca3407af80 msgr2=0x7fca3407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.276+0000 7fca4d5d1640 1 --2- 172.21.15.78:0/1810715482 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fca3407af80 0x7fca3407d440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fca40000c00 tx=0x7fca40031400 comp rx=0 tx=0).stop 2024-09-18T12:53:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.276+0000 7fca4d5d1640 1 -- 172.21.15.78:0/1810715482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca481067f0 msgr2=0x7fca48198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.276+0000 7fca4d5d1640 1 --2- 172.21.15.78:0/1810715482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca481067f0 0x7fca48198e10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fca3000cc60 tx=0x7fca3000a620 comp rx=0 tx=0).stop 2024-09-18T12:53:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.276+0000 7fca4d5d1640 1 -- 172.21.15.78:0/1810715482 shutdown_connections 2024-09-18T12:53:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.276+0000 7fca4d5d1640 1 --2- 172.21.15.78:0/1810715482 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fca3407af80 0x7fca3407d440 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.276+0000 7fca4d5d1640 1 --2- 172.21.15.78:0/1810715482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca481067f0 0x7fca48198e10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.276+0000 7fca4d5d1640 1 --2- 172.21.15.78:0/1810715482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca481007f0 0x7fca481988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.276+0000 7fca4d5d1640 1 -- 172.21.15.78:0/1810715482 >> 172.21.15.78:0/1810715482 conn(0x7fca480fc550 msgr2=0x7fca480fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:05.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.276+0000 7fca4d5d1640 1 -- 172.21.15.78:0/1810715482 shutdown_connections 2024-09-18T12:53:05.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:05.276+0000 7fca4d5d1640 1 -- 172.21.15.78:0/1810715482 wait complete. 2024-09-18T12:53:05.286 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)" 2024-09-18T12:53:05.873 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-18T12:53:06.124 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:53:06.400 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:06 smithi078 ceph-mon[28091]: pgmap v83: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:06.401 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:06 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1810715482' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:06.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:06 smithi148 ceph-mon[35352]: pgmap v83: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:06.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:06 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1810715482' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.601+0000 7f3e3ec85640 1 -- 172.21.15.78:0/1676065024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e38100810 msgr2=0x7f3e38100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.601+0000 7f3e3ec85640 1 --2- 172.21.15.78:0/1676065024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e38100810 0x7f3e38100c70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009880 tx=0x7f3e2002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.601+0000 7f3e3ec85640 1 -- 172.21.15.78:0/1676065024 shutdown_connections 2024-09-18T12:53:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.601+0000 7f3e3ec85640 1 --2- 172.21.15.78:0/1676065024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e38100810 0x7f3e38100c70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.601+0000 7f3e3ec85640 1 --2- 172.21.15.78:0/1676065024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e38106810 0x7f3e38106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.601+0000 7f3e3ec85640 1 -- 172.21.15.78:0/1676065024 >> 172.21.15.78:0/1676065024 conn(0x7f3e380fc510 msgr2=0x7f3e380fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.601+0000 7f3e3ec85640 1 -- 172.21.15.78:0/1676065024 shutdown_connections 2024-09-18T12:53:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.601+0000 7f3e3ec85640 1 -- 172.21.15.78:0/1676065024 wait complete. 2024-09-18T12:53:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.601+0000 7f3e3ec85640 1 Processor -- start 2024-09-18T12:53:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.601+0000 7f3e3ec85640 1 -- start start 2024-09-18T12:53:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e3ec85640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e38100810 0x7f3e3810b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e3ec85640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e38106810 0x7f3e3810bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e3ec85640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3810ede0 con 0x7f3e38106810 2024-09-18T12:53:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e3ec85640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3810ec60 con 0x7f3e38100810 2024-09-18T12:53:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e37fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e38106810 0x7f3e3810bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e37fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e38106810 0x7f3e3810bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48534/0 (socket says 172.21.15.78:48534) 2024-09-18T12:53:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e37fff640 1 -- 172.21.15.78:0/1982756355 learned_addr learned my addr 172.21.15.78:0/1982756355 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e37fff640 1 -- 172.21.15.78:0/1982756355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e38100810 msgr2=0x7f3e3810b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e3ca21640 1 --2- 172.21.15.78:0/1982756355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e38100810 0x7f3e3810b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e37fff640 1 --2- 172.21.15.78:0/1982756355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e38100810 0x7f3e3810b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e37fff640 1 -- 172.21.15.78:0/1982756355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3810c220 con 0x7f3e38106810 2024-09-18T12:53:06.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e37fff640 1 --2- 172.21.15.78:0/1982756355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e38106810 0x7f3e3810bce0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3e20031460 tx=0x7f3e200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:06.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e35ffb640 1 -- 172.21.15.78:0/1982756355 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e2003f070 con 0x7f3e38106810 2024-09-18T12:53:06.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e3ec85640 1 -- 172.21.15.78:0/1982756355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e3810c4b0 con 0x7f3e38106810 2024-09-18T12:53:06.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e35ffb640 1 -- 172.21.15.78:0/1982756355 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e200035f0 con 0x7f3e38106810 2024-09-18T12:53:06.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.602+0000 7f3e35ffb640 1 -- 172.21.15.78:0/1982756355 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e20035030 con 0x7f3e38106810 2024-09-18T12:53:06.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.603+0000 7f3e3ec85640 1 -- 172.21.15.78:0/1982756355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e381a3d70 con 0x7f3e38106810 2024-09-18T12:53:06.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.604+0000 7f3e3ec85640 1 -- 172.21.15.78:0/1982756355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e38101f50 con 0x7f3e38106810 2024-09-18T12:53:06.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.604+0000 7f3e35ffb640 1 -- 172.21.15.78:0/1982756355 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3e20042070 con 0x7f3e38106810 2024-09-18T12:53:06.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.605+0000 7f3e35ffb640 1 --2- 172.21.15.78:0/1982756355 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3e2407af80 0x7f3e2407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:06.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.605+0000 7f3e35ffb640 1 -- 172.21.15.78:0/1982756355 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f3e200be8c0 con 0x7f3e38106810 2024-09-18T12:53:06.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.605+0000 7f3e3ca21640 1 --2- 172.21.15.78:0/1982756355 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3e2407af80 0x7f3e2407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:06.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.605+0000 7f3e3ca21640 1 --2- 172.21.15.78:0/1982756355 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3e2407af80 0x7f3e2407d440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3e28005fd0 tx=0x7f3e28005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:06.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.609+0000 7f3e35ffb640 1 -- 172.21.15.78:0/1982756355 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f3e20089f90 con 0x7f3e38106810 2024-09-18T12:53:06.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.867+0000 7f3e3ec85640 1 -- 172.21.15.78:0/1982756355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3e38108d80 con 0x7f3e38106810 2024-09-18T12:53:06.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.867+0000 7f3e35ffb640 1 -- 172.21.15.78:0/1982756355 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f3e2008ee40 con 0x7f3e38106810 2024-09-18T12:53:06.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.870+0000 7f3e3ec85640 1 -- 172.21.15.78:0/1982756355 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3e2407af80 msgr2=0x7f3e2407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:06.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.870+0000 7f3e3ec85640 1 --2- 172.21.15.78:0/1982756355 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3e2407af80 0x7f3e2407d440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3e28005fd0 tx=0x7f3e28005850 comp rx=0 tx=0).stop 2024-09-18T12:53:06.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.870+0000 7f3e3ec85640 1 -- 172.21.15.78:0/1982756355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e38106810 msgr2=0x7f3e3810bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:06.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.870+0000 7f3e3ec85640 1 --2- 172.21.15.78:0/1982756355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e38106810 0x7f3e3810bce0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3e20031460 tx=0x7f3e200045e0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.870+0000 7f3e3ec85640 1 -- 172.21.15.78:0/1982756355 shutdown_connections 2024-09-18T12:53:06.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.870+0000 7f3e3ec85640 1 --2- 172.21.15.78:0/1982756355 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3e2407af80 0x7f3e2407d440 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.870+0000 7f3e3ec85640 1 --2- 172.21.15.78:0/1982756355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e38106810 0x7f3e3810bce0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.870+0000 7f3e3ec85640 1 --2- 172.21.15.78:0/1982756355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e38100810 0x7f3e3810b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.870+0000 7f3e3ec85640 1 -- 172.21.15.78:0/1982756355 >> 172.21.15.78:0/1982756355 conn(0x7f3e380fc510 msgr2=0x7f3e380fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:06.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.870+0000 7f3e3ec85640 1 -- 172.21.15.78:0/1982756355 shutdown_connections 2024-09-18T12:53:06.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:06.870+0000 7f3e3ec85640 1 -- 172.21.15.78:0/1982756355 wait complete. 2024-09-18T12:53:06.880 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:53:07.455 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:07 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1982756355' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:07.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:07 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1982756355' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:07.485 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-18T12:53:07.733 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:53:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.196+0000 7f4685384640 1 -- 172.21.15.78:0/972708230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46801007f0 msgr2=0x7f4680100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.197+0000 7f4685384640 1 --2- 172.21.15.78:0/972708230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46801007f0 0x7f4680100c50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4668009880 tx=0x7f466802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.197+0000 7f4685384640 1 -- 172.21.15.78:0/972708230 shutdown_connections 2024-09-18T12:53:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.197+0000 7f4685384640 1 --2- 172.21.15.78:0/972708230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46801007f0 0x7f4680100c50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.197+0000 7f4685384640 1 --2- 172.21.15.78:0/972708230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46801067f0 0x7f4680106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.197+0000 7f4685384640 1 -- 172.21.15.78:0/972708230 >> 172.21.15.78:0/972708230 conn(0x7f46800fc550 msgr2=0x7f46800fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.197+0000 7f4685384640 1 -- 172.21.15.78:0/972708230 shutdown_connections 2024-09-18T12:53:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.197+0000 7f4685384640 1 -- 172.21.15.78:0/972708230 wait complete. 2024-09-18T12:53:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.197+0000 7f4685384640 1 Processor -- start 2024-09-18T12:53:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.197+0000 7f4685384640 1 -- start start 2024-09-18T12:53:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f4685384640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46801007f0 0x7f46801965e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f4685384640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46801067f0 0x7f4680196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f4685384640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f468010dcc0 con 0x7f46801067f0 2024-09-18T12:53:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f4685384640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f468010db40 con 0x7f46801007f0 2024-09-18T12:53:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f467e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46801067f0 0x7f4680196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f467e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46801067f0 0x7f4680196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48550/0 (socket says 172.21.15.78:48550) 2024-09-18T12:53:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f467e7fc640 1 -- 172.21.15.78:0/4192824343 learned_addr learned my addr 172.21.15.78:0/4192824343 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f467effd640 1 --2- 172.21.15.78:0/4192824343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46801007f0 0x7f46801965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f467e7fc640 1 -- 172.21.15.78:0/4192824343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46801007f0 msgr2=0x7f46801965e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f467e7fc640 1 --2- 172.21.15.78:0/4192824343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46801007f0 0x7f46801965e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:08.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f467e7fc640 1 -- 172.21.15.78:0/4192824343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4680197060 con 0x7f46801067f0 2024-09-18T12:53:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f467e7fc640 1 --2- 172.21.15.78:0/4192824343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46801067f0 0x7f4680196b20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4668031460 tx=0x7f46680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f4677fff640 1 -- 172.21.15.78:0/4192824343 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f466803f070 con 0x7f46801067f0 2024-09-18T12:53:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f4685384640 1 -- 172.21.15.78:0/4192824343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46801972f0 con 0x7f46801067f0 2024-09-18T12:53:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f4677fff640 1 -- 172.21.15.78:0/4192824343 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f46680035f0 con 0x7f46801067f0 2024-09-18T12:53:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f4677fff640 1 -- 172.21.15.78:0/4192824343 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4668035030 con 0x7f46801067f0 2024-09-18T12:53:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.198+0000 7f4685384640 1 -- 172.21.15.78:0/4192824343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46801a3e20 con 0x7f46801067f0 2024-09-18T12:53:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.199+0000 7f4685384640 1 -- 172.21.15.78:0/4192824343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4680101f30 con 0x7f46801067f0 2024-09-18T12:53:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.200+0000 7f4677fff640 1 -- 172.21.15.78:0/4192824343 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4668042070 con 0x7f46801067f0 2024-09-18T12:53:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.201+0000 7f4677fff640 1 --2- 172.21.15.78:0/4192824343 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f466c07af30 0x7f466c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.201+0000 7f467effd640 1 --2- 172.21.15.78:0/4192824343 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f466c07af30 0x7f466c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.201+0000 7f4677fff640 1 -- 172.21.15.78:0/4192824343 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f46680be920 con 0x7f46801067f0 2024-09-18T12:53:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.201+0000 7f467effd640 1 --2- 172.21.15.78:0/4192824343 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f466c07af30 0x7f466c07d3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4670005fd0 tx=0x7f4670009680 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:08.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.205+0000 7f4677fff640 1 -- 172.21.15.78:0/4192824343 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f4668089f70 con 0x7f46801067f0 2024-09-18T12:53:08.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:08.394+0000 7f4685384640 1 -- 172.21.15.78:0/4192824343 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "target": ["mon-mgr", ""]}) -- 0x7f4680062630 con 0x7f466c07af30 2024-09-18T12:53:08.396 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:08 smithi078 ceph-mon[28091]: pgmap v84: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:08.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:08 smithi148 ceph-mon[35352]: pgmap v84: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:10.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:10.162+0000 7f4677fff640 1 -- 172.21.15.78:0/4192824343 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5741 (secure 0 0 0) 0x7f4680062630 con 0x7f466c07af30 2024-09-18T12:53:10.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:10.164+0000 7f4685384640 1 -- 172.21.15.78:0/4192824343 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f466c07af30 msgr2=0x7f466c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:10.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:10.164+0000 7f4685384640 1 --2- 172.21.15.78:0/4192824343 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f466c07af30 0x7f466c07d3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4670005fd0 tx=0x7f4670009680 comp rx=0 tx=0).stop 2024-09-18T12:53:10.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:10.164+0000 7f4685384640 1 -- 172.21.15.78:0/4192824343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46801067f0 msgr2=0x7f4680196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:10.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:10.164+0000 7f4685384640 1 --2- 172.21.15.78:0/4192824343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46801067f0 0x7f4680196b20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4668031460 tx=0x7f46680045e0 comp rx=0 tx=0).stop 2024-09-18T12:53:10.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:10.164+0000 7f4685384640 1 -- 172.21.15.78:0/4192824343 shutdown_connections 2024-09-18T12:53:10.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:10.164+0000 7f4685384640 1 --2- 172.21.15.78:0/4192824343 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f466c07af30 0x7f466c07d3f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:10.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:10.164+0000 7f4685384640 1 --2- 172.21.15.78:0/4192824343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46801067f0 0x7f4680196b20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:10.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:10.164+0000 7f4685384640 1 --2- 172.21.15.78:0/4192824343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46801007f0 0x7f46801965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:10.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:10.164+0000 7f4685384640 1 -- 172.21.15.78:0/4192824343 >> 172.21.15.78:0/4192824343 conn(0x7f46800fc550 msgr2=0x7f46800fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:10.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:10.164+0000 7f4685384640 1 -- 172.21.15.78:0/4192824343 shutdown_connections 2024-09-18T12:53:10.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:10.164+0000 7f4685384640 1 -- 172.21.15.78:0/4192824343 wait complete. 2024-09-18T12:53:10.175 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:53:10.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:10 smithi148 ceph-mon[35352]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:10.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:10 smithi148 ceph-mon[35352]: pgmap v85: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:10.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:10 smithi078 ceph-mon[28091]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:10.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:10 smithi078 ceph-mon[28091]: pgmap v85: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:10.837 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch ps' 2024-09-18T12:53:11.085 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:53:11.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:11 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:11.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:11 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:11.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.593+0000 7f95e2b85640 1 -- 172.21.15.78:0/127516422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95dc074e30 msgr2=0x7f95dc10dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:11.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.593+0000 7f95e2b85640 1 --2- 172.21.15.78:0/127516422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95dc074e30 0x7f95dc10dc80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009b60 tx=0x7f95cc02a800 comp rx=0 tx=0).stop 2024-09-18T12:53:11.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.593+0000 7f95e2b85640 1 -- 172.21.15.78:0/127516422 shutdown_connections 2024-09-18T12:53:11.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.593+0000 7f95e2b85640 1 --2- 172.21.15.78:0/127516422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95dc074e30 0x7f95dc10dc80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:11.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.593+0000 7f95e2b85640 1 --2- 172.21.15.78:0/127516422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95dc074510 0x7f95dc0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:11.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.593+0000 7f95e2b85640 1 -- 172.21.15.78:0/127516422 >> 172.21.15.78:0/127516422 conn(0x7f95dc0fd620 msgr2=0x7f95dc0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:11.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.593+0000 7f95e2b85640 1 -- 172.21.15.78:0/127516422 shutdown_connections 2024-09-18T12:53:11.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.593+0000 7f95e2b85640 1 -- 172.21.15.78:0/127516422 wait complete. 2024-09-18T12:53:11.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.593+0000 7f95e2b85640 1 Processor -- start 2024-09-18T12:53:11.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.593+0000 7f95e2b85640 1 -- start start 2024-09-18T12:53:11.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.593+0000 7f95e2b85640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95dc074510 0x7f95dc19f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:11.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95e2b85640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95dc074e30 0x7f95dc19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:11.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95e2b85640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc110fe0 con 0x7f95dc074510 2024-09-18T12:53:11.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95e2b85640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc110e60 con 0x7f95dc074e30 2024-09-18T12:53:11.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95e0921640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95dc074510 0x7f95dc19f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:11.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95e0921640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95dc074510 0x7f95dc19f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47022/0 (socket says 172.21.15.78:47022) 2024-09-18T12:53:11.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95e0921640 1 -- 172.21.15.78:0/2879468756 learned_addr learned my addr 172.21.15.78:0/2879468756 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:11.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95dbfff640 1 --2- 172.21.15.78:0/2879468756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95dc074e30 0x7f95dc19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:11.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95e0921640 1 -- 172.21.15.78:0/2879468756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95dc074e30 msgr2=0x7f95dc19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:11.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95e0921640 1 --2- 172.21.15.78:0/2879468756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95dc074e30 0x7f95dc19fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:11.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95e0921640 1 -- 172.21.15.78:0/2879468756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95dc1999b0 con 0x7f95dc074510 2024-09-18T12:53:11.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95e0921640 1 --2- 172.21.15.78:0/2879468756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95dc074510 0x7f95dc19f7f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f95d400e970 tx=0x7f95d400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:11.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95d9ffb640 1 -- 172.21.15.78:0/2879468756 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95d400cac0 con 0x7f95dc074510 2024-09-18T12:53:11.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95d9ffb640 1 -- 172.21.15.78:0/2879468756 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f95d40054e0 con 0x7f95dc074510 2024-09-18T12:53:11.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95d9ffb640 1 -- 172.21.15.78:0/2879468756 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95d4004d70 con 0x7f95dc074510 2024-09-18T12:53:11.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95e2b85640 1 -- 172.21.15.78:0/2879468756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95dc199ca0 con 0x7f95dc074510 2024-09-18T12:53:11.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.594+0000 7f95e2b85640 1 -- 172.21.15.78:0/2879468756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95dc19a230 con 0x7f95dc074510 2024-09-18T12:53:11.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.595+0000 7f95e2b85640 1 -- 172.21.15.78:0/2879468756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95dc075c50 con 0x7f95dc074510 2024-09-18T12:53:11.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.596+0000 7f95d9ffb640 1 -- 172.21.15.78:0/2879468756 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f95d4004f90 con 0x7f95dc074510 2024-09-18T12:53:11.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.596+0000 7f95d9ffb640 1 --2- 172.21.15.78:0/2879468756 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f95c807af80 0x7f95c807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:11.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.596+0000 7f95d9ffb640 1 -- 172.21.15.78:0/2879468756 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f95d409e5b0 con 0x7f95dc074510 2024-09-18T12:53:11.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.597+0000 7f95dbfff640 1 --2- 172.21.15.78:0/2879468756 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f95c807af80 0x7f95c807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:11.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.597+0000 7f95dbfff640 1 --2- 172.21.15.78:0/2879468756 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f95c807af80 0x7f95c807d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009b30 tx=0x7f95cc000f40 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:11.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.601+0000 7f95d9ffb640 1 -- 172.21.15.78:0/2879468756 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f95d4069c80 con 0x7f95dc074510 2024-09-18T12:53:11.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.782+0000 7f95e2b85640 1 -- 172.21.15.78:0/2879468756 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f95dc19aee0 con 0x7f95c807af80 2024-09-18T12:53:11.793 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:53:11.793 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (61s) 33s ago 11m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T12:53:11.793 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (3m) 33s ago 12m 8674k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:53:11.793 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (3m) 102s ago 11m 8086k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:53:11.793 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (12m) 33s ago 12m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de bb77146b81c7 2024-09-18T12:53:11.793 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (11m) 102s ago 11m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de f82fdd264dc6 2024-09-18T12:53:11.793 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (39s) 33s ago 11m 43.9M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T12:53:11.793 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (6m) 33s ago 6m 151M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:53:11.794 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (6m) 33s ago 6m 27.2M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:53:11.794 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (6m) 102s ago 6m 14.7M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:53:11.794 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (6m) 102s ago 6m 15.6M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:53:11.794 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (3m) 33s ago 13m 519M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:53:11.794 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (2m) 102s ago 11m 452M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:53:11.794 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (13m) 33s ago 13m 62.4M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1cb11a5bcd72 2024-09-18T12:53:11.794 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (11m) 102s ago 11m 44.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 02dfe1551226 2024-09-18T12:53:11.794 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (111s) 33s ago 12m 11.7M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:53:11.794 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (105s) 102s ago 11m 7335k - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:53:11.794 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (9m) 33s ago 9m 205M 1216M 19.1.1-330-gc2ddf972 ebb0615149de f634ad9ddb36 2024-09-18T12:53:11.794 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (9m) 33s ago 9m 221M 1216M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:53:11.794 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (9m) 33s ago 9m 179M 1216M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:53:11.794 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (8m) 102s ago 8m 236M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:53:11.795 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (8m) 102s ago 8m 208M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:53:11.795 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (7m) 102s ago 7m 194M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:53:11.795 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (82s) 33s ago 11m 45.3M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:53:11.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.792+0000 7f95d9ffb640 1 -- 172.21.15.78:0/2879468756 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f95dc19aee0 con 0x7f95c807af80 2024-09-18T12:53:11.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.794+0000 7f95e2b85640 1 -- 172.21.15.78:0/2879468756 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f95c807af80 msgr2=0x7f95c807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:11.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.794+0000 7f95e2b85640 1 --2- 172.21.15.78:0/2879468756 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f95c807af80 0x7f95c807d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009b30 tx=0x7f95cc000f40 comp rx=0 tx=0).stop 2024-09-18T12:53:11.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.794+0000 7f95e2b85640 1 -- 172.21.15.78:0/2879468756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95dc074510 msgr2=0x7f95dc19f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:11.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.794+0000 7f95e2b85640 1 --2- 172.21.15.78:0/2879468756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95dc074510 0x7f95dc19f7f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f95d400e970 tx=0x7f95d400ee30 comp rx=0 tx=0).stop 2024-09-18T12:53:11.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.794+0000 7f95e2b85640 1 -- 172.21.15.78:0/2879468756 shutdown_connections 2024-09-18T12:53:11.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.794+0000 7f95e2b85640 1 --2- 172.21.15.78:0/2879468756 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f95c807af80 0x7f95c807d440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:11.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.794+0000 7f95e2b85640 1 --2- 172.21.15.78:0/2879468756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95dc074e30 0x7f95dc19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:11.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.794+0000 7f95e2b85640 1 --2- 172.21.15.78:0/2879468756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95dc074510 0x7f95dc19f7f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:11.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.794+0000 7f95e2b85640 1 -- 172.21.15.78:0/2879468756 >> 172.21.15.78:0/2879468756 conn(0x7f95dc0fd620 msgr2=0x7f95dc10b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:11.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.795+0000 7f95e2b85640 1 -- 172.21.15.78:0/2879468756 shutdown_connections 2024-09-18T12:53:11.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:11.795+0000 7f95e2b85640 1 -- 172.21.15.78:0/2879468756 wait complete. 2024-09-18T12:53:12.369 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:12 smithi078 ceph-mon[28091]: pgmap v86: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:12.395 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-18T12:53:12.396 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-18T12:53:12.396 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-18T12:53:12.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:12 smithi148 ceph-mon[35352]: pgmap v86: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:53:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.094+0000 7f58da0db640 1 -- 172.21.15.78:0/860674937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d4106800 msgr2=0x7f58d4106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.094+0000 7f58da0db640 1 --2- 172.21.15.78:0/860674937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d4106800 0x7f58d4106be0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009880 tx=0x7f58c402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.094+0000 7f58da0db640 1 -- 172.21.15.78:0/860674937 shutdown_connections 2024-09-18T12:53:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.094+0000 7f58da0db640 1 --2- 172.21.15.78:0/860674937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d4100800 0x7f58d4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.094+0000 7f58da0db640 1 --2- 172.21.15.78:0/860674937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d4106800 0x7f58d4106be0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.094+0000 7f58da0db640 1 -- 172.21.15.78:0/860674937 >> 172.21.15.78:0/860674937 conn(0x7f58d40fc520 msgr2=0x7f58d40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.094+0000 7f58da0db640 1 -- 172.21.15.78:0/860674937 shutdown_connections 2024-09-18T12:53:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.094+0000 7f58da0db640 1 -- 172.21.15.78:0/860674937 wait complete. 2024-09-18T12:53:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.095+0000 7f58da0db640 1 Processor -- start 2024-09-18T12:53:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.095+0000 7f58da0db640 1 -- start start 2024-09-18T12:53:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.095+0000 7f58da0db640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d4100800 0x7f58d4198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.095+0000 7f58da0db640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d4106800 0x7f58d4198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.095+0000 7f58da0db640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f58d410dd30 con 0x7f58d4106800 2024-09-18T12:53:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.095+0000 7f58da0db640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f58d410dbb0 con 0x7f58d4100800 2024-09-18T12:53:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.095+0000 7f58cbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d4106800 0x7f58d4198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.095+0000 7f58cbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d4106800 0x7f58d4198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47028/0 (socket says 172.21.15.78:47028) 2024-09-18T12:53:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.095+0000 7f58cbfff640 1 -- 172.21.15.78:0/1504264309 learned_addr learned my addr 172.21.15.78:0/1504264309 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.095+0000 7f58d37fe640 1 --2- 172.21.15.78:0/1504264309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d4100800 0x7f58d4198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.096+0000 7f58cbfff640 1 -- 172.21.15.78:0/1504264309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d4100800 msgr2=0x7f58d4198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.096+0000 7f58cbfff640 1 --2- 172.21.15.78:0/1504264309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d4100800 0x7f58d4198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.096+0000 7f58cbfff640 1 -- 172.21.15.78:0/1504264309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d41993d0 con 0x7f58d4106800 2024-09-18T12:53:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.096+0000 7f58d37fe640 1 --2- 172.21.15.78:0/1504264309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d4100800 0x7f58d4198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:53:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.096+0000 7f58cbfff640 1 --2- 172.21.15.78:0/1504264309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d4106800 0x7f58d4198d80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00b420 tx=0x7f58bc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.096+0000 7f58d17fa640 1 -- 172.21.15.78:0/1504264309 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58bc011630 con 0x7f58d4106800 2024-09-18T12:53:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.096+0000 7f58da0db640 1 -- 172.21.15.78:0/1504264309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d41a18b0 con 0x7f58d4106800 2024-09-18T12:53:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.096+0000 7f58d17fa640 1 -- 172.21.15.78:0/1504264309 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f58bc016070 con 0x7f58d4106800 2024-09-18T12:53:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.096+0000 7f58d17fa640 1 -- 172.21.15.78:0/1504264309 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58bc010d40 con 0x7f58d4106800 2024-09-18T12:53:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.096+0000 7f58da0db640 1 -- 172.21.15.78:0/1504264309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d41a1cb0 con 0x7f58d4106800 2024-09-18T12:53:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.097+0000 7f58da0db640 1 -- 172.21.15.78:0/1504264309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d4101f40 con 0x7f58d4106800 2024-09-18T12:53:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.098+0000 7f58d17fa640 1 -- 172.21.15.78:0/1504264309 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f58bc01b460 con 0x7f58d4106800 2024-09-18T12:53:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.098+0000 7f58d17fa640 1 --2- 172.21.15.78:0/1504264309 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f58c007af30 0x7f58c007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:13.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.098+0000 7f58d17fa640 1 -- 172.21.15.78:0/1504264309 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f58bc09d6f0 con 0x7f58d4106800 2024-09-18T12:53:13.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.098+0000 7f58d37fe640 1 --2- 172.21.15.78:0/1504264309 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f58c007af30 0x7f58c007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:13.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.099+0000 7f58d37fe640 1 --2- 172.21.15.78:0/1504264309 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f58c007af30 0x7f58c007d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f58c4006010 tx=0x7f58c40095f0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:13.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.103+0000 7f58d17fa640 1 -- 172.21.15.78:0/1504264309 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f58bc021250 con 0x7f58d4106800 2024-09-18T12:53:13.263 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:13 smithi078 ceph-mon[28091]: from='client.14920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:13.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.280+0000 7f58da0db640 1 -- 172.21.15.78:0/1504264309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) -- 0x7f58d41087e0 con 0x7f58d4106800 2024-09-18T12:53:13.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.283+0000 7f58d17fa640 1 -- 172.21.15.78:0/1504264309 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v66)=0 v66) ==== 125+0+0 (secure 0 0 0) 0x7f58bc068d40 con 0x7f58d4106800 2024-09-18T12:53:13.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.286+0000 7f58da0db640 1 -- 172.21.15.78:0/1504264309 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f58c007af30 msgr2=0x7f58c007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:13.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.286+0000 7f58da0db640 1 --2- 172.21.15.78:0/1504264309 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f58c007af30 0x7f58c007d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f58c4006010 tx=0x7f58c40095f0 comp rx=0 tx=0).stop 2024-09-18T12:53:13.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.286+0000 7f58da0db640 1 -- 172.21.15.78:0/1504264309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d4106800 msgr2=0x7f58d4198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:13.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.286+0000 7f58da0db640 1 --2- 172.21.15.78:0/1504264309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d4106800 0x7f58d4198d80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00b420 tx=0x7f58bc00b8e0 comp rx=0 tx=0).stop 2024-09-18T12:53:13.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.286+0000 7f58da0db640 1 -- 172.21.15.78:0/1504264309 shutdown_connections 2024-09-18T12:53:13.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.286+0000 7f58da0db640 1 --2- 172.21.15.78:0/1504264309 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f58c007af30 0x7f58c007d3f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:13.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.286+0000 7f58da0db640 1 --2- 172.21.15.78:0/1504264309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d4106800 0x7f58d4198d80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:13.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.286+0000 7f58da0db640 1 --2- 172.21.15.78:0/1504264309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d4100800 0x7f58d4198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:13.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.286+0000 7f58da0db640 1 -- 172.21.15.78:0/1504264309 >> 172.21.15.78:0/1504264309 conn(0x7f58d40fc520 msgr2=0x7f58d40fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:13.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.286+0000 7f58da0db640 1 -- 172.21.15.78:0/1504264309 shutdown_connections 2024-09-18T12:53:13.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:13.286+0000 7f58da0db640 1 -- 172.21.15.78:0/1504264309 wait complete. 2024-09-18T12:53:13.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:13 smithi148 ceph-mon[35352]: from='client.14920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:13.911 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-18T12:53:13.911 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-18T12:53:13.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-18T12:53:14.164 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:53:14.593 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:14 smithi078 ceph-mon[28091]: pgmap v87: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:14.593 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:14 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1504264309' entity='client.admin' 2024-09-18T12:53:14.594 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:14 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:14.594 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:14 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:14.594 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:14 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:53:14.594 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:14 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:14.594 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:14 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:14.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.680+0000 7f62ce30f640 1 -- 172.21.15.78:0/1539439693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c8106970 msgr2=0x7f62c8106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:14.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.680+0000 7f62ce30f640 1 --2- 172.21.15.78:0/1539439693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c8106970 0x7f62c8106d50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009880 tx=0x7f62b802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:14.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.680+0000 7f62ce30f640 1 -- 172.21.15.78:0/1539439693 shutdown_connections 2024-09-18T12:53:14.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.680+0000 7f62ce30f640 1 --2- 172.21.15.78:0/1539439693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62c80ffea0 0x7f62c8100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:14.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.680+0000 7f62ce30f640 1 --2- 172.21.15.78:0/1539439693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c8106970 0x7f62c8106d50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:14.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.680+0000 7f62ce30f640 1 -- 172.21.15.78:0/1539439693 >> 172.21.15.78:0/1539439693 conn(0x7f62c80fbc90 msgr2=0x7f62c80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:14.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.680+0000 7f62ce30f640 1 -- 172.21.15.78:0/1539439693 shutdown_connections 2024-09-18T12:53:14.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.680+0000 7f62ce30f640 1 -- 172.21.15.78:0/1539439693 wait complete. 2024-09-18T12:53:14.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.681+0000 7f62ce30f640 1 Processor -- start 2024-09-18T12:53:14.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.681+0000 7f62ce30f640 1 -- start start 2024-09-18T12:53:14.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.681+0000 7f62ce30f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c80ffea0 0x7f62c8101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:14.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.681+0000 7f62ce30f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62c8106970 0x7f62c81015c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:14.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.681+0000 7f62ce30f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f62c810efb0 con 0x7f62c80ffea0 2024-09-18T12:53:14.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.681+0000 7f62ce30f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f62c810ee30 con 0x7f62c8106970 2024-09-18T12:53:14.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.681+0000 7f62c7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c80ffea0 0x7f62c8101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:14.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.681+0000 7f62c7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c80ffea0 0x7f62c8101080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47034/0 (socket says 172.21.15.78:47034) 2024-09-18T12:53:14.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.681+0000 7f62c7fff640 1 -- 172.21.15.78:0/3544665572 learned_addr learned my addr 172.21.15.78:0/3544665572 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:14.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.682+0000 7f62c7fff640 1 -- 172.21.15.78:0/3544665572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62c8106970 msgr2=0x7f62c81015c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:14.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.682+0000 7f62c7fff640 1 --2- 172.21.15.78:0/3544665572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62c8106970 0x7f62c81015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:14.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.682+0000 7f62c7fff640 1 -- 172.21.15.78:0/3544665572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c8101b00 con 0x7f62c80ffea0 2024-09-18T12:53:14.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.682+0000 7f62c7fff640 1 --2- 172.21.15.78:0/3544665572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c80ffea0 0x7f62c8101080 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f62b8031460 tx=0x7f62b80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:14.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.682+0000 7f62c57fa640 1 -- 172.21.15.78:0/3544665572 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f62b803f070 con 0x7f62c80ffea0 2024-09-18T12:53:14.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.682+0000 7f62ce30f640 1 -- 172.21.15.78:0/3544665572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c8101d90 con 0x7f62c80ffea0 2024-09-18T12:53:14.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.682+0000 7f62c57fa640 1 -- 172.21.15.78:0/3544665572 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f62b8004cf0 con 0x7f62c80ffea0 2024-09-18T12:53:14.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.682+0000 7f62c57fa640 1 -- 172.21.15.78:0/3544665572 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f62b8035030 con 0x7f62c80ffea0 2024-09-18T12:53:14.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.682+0000 7f62ce30f640 1 -- 172.21.15.78:0/3544665572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c81a3f40 con 0x7f62c80ffea0 2024-09-18T12:53:14.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.683+0000 7f62ce30f640 1 -- 172.21.15.78:0/3544665572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c81031c0 con 0x7f62c80ffea0 2024-09-18T12:53:14.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.684+0000 7f62c57fa640 1 -- 172.21.15.78:0/3544665572 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f62b8042070 con 0x7f62c80ffea0 2024-09-18T12:53:14.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.684+0000 7f62c57fa640 1 --2- 172.21.15.78:0/3544665572 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f62b007af30 0x7f62b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:14.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.685+0000 7f62c57fa640 1 -- 172.21.15.78:0/3544665572 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f62b80beab0 con 0x7f62c80ffea0 2024-09-18T12:53:14.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.685+0000 7f62c77fe640 1 --2- 172.21.15.78:0/3544665572 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f62b007af30 0x7f62b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:14.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.685+0000 7f62c77fe640 1 --2- 172.21.15.78:0/3544665572 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f62b007af30 0x7f62b007d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62c8102b10 tx=0x7f62bc006c90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:14.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.689+0000 7f62c57fa640 1 -- 172.21.15.78:0/3544665572 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f62b808a100 con 0x7f62c80ffea0 2024-09-18T12:53:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:14 smithi148 ceph-mon[35352]: pgmap v87: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:14 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1504264309' entity='client.admin' 2024-09-18T12:53:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:14 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:14 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:14 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:53:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:14 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:14 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:14.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.874+0000 7f62ce30f640 1 -- 172.21.15.78:0/3544665572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f62c8109e80 con 0x7f62c80ffea0 2024-09-18T12:53:14.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.874+0000 7f62c57fa640 1 -- 172.21.15.78:0/3544665572 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v66)=0 v66) ==== 155+0+0 (secure 0 0 0) 0x7f62b808efb0 con 0x7f62c80ffea0 2024-09-18T12:53:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.876+0000 7f62ce30f640 1 -- 172.21.15.78:0/3544665572 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f62b007af30 msgr2=0x7f62b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.876+0000 7f62ce30f640 1 --2- 172.21.15.78:0/3544665572 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f62b007af30 0x7f62b007d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62c8102b10 tx=0x7f62bc006c90 comp rx=0 tx=0).stop 2024-09-18T12:53:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.876+0000 7f62ce30f640 1 -- 172.21.15.78:0/3544665572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c80ffea0 msgr2=0x7f62c8101080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.876+0000 7f62ce30f640 1 --2- 172.21.15.78:0/3544665572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c80ffea0 0x7f62c8101080 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f62b8031460 tx=0x7f62b80048f0 comp rx=0 tx=0).stop 2024-09-18T12:53:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.877+0000 7f62ce30f640 1 -- 172.21.15.78:0/3544665572 shutdown_connections 2024-09-18T12:53:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.877+0000 7f62ce30f640 1 --2- 172.21.15.78:0/3544665572 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f62b007af30 0x7f62b007d3f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.877+0000 7f62ce30f640 1 --2- 172.21.15.78:0/3544665572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62c8106970 0x7f62c81015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.877+0000 7f62ce30f640 1 --2- 172.21.15.78:0/3544665572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c80ffea0 0x7f62c8101080 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.877+0000 7f62ce30f640 1 -- 172.21.15.78:0/3544665572 >> 172.21.15.78:0/3544665572 conn(0x7f62c80fbc90 msgr2=0x7f62c80fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.877+0000 7f62ce30f640 1 -- 172.21.15.78:0/3544665572 shutdown_connections 2024-09-18T12:53:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:14.877+0000 7f62ce30f640 1 -- 172.21.15.78:0/3544665572 wait complete. 2024-09-18T12:53:15.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:15 smithi078 ceph-mon[28091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:15.539 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-18T12:53:15.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:15 smithi148 ceph-mon[35352]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:15.790 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:53:16.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.298+0000 7ff01119d640 1 -- 172.21.15.78:0/1377565601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c100650 msgr2=0x7ff00c100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:16.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.298+0000 7ff01119d640 1 --2- 172.21.15.78:0/1377565601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c100650 0x7ff00c100ab0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff000009880 tx=0x7ff00002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:16.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.298+0000 7ff01119d640 1 -- 172.21.15.78:0/1377565601 shutdown_connections 2024-09-18T12:53:16.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.298+0000 7ff01119d640 1 --2- 172.21.15.78:0/1377565601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c100650 0x7ff00c100ab0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:16.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.298+0000 7ff01119d640 1 --2- 172.21.15.78:0/1377565601 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff00c106650 0x7ff00c106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:16.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.298+0000 7ff01119d640 1 -- 172.21.15.78:0/1377565601 >> 172.21.15.78:0/1377565601 conn(0x7ff00c0fc350 msgr2=0x7ff00c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:16.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.298+0000 7ff01119d640 1 -- 172.21.15.78:0/1377565601 shutdown_connections 2024-09-18T12:53:16.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.298+0000 7ff01119d640 1 -- 172.21.15.78:0/1377565601 wait complete. 2024-09-18T12:53:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.299+0000 7ff01119d640 1 Processor -- start 2024-09-18T12:53:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.299+0000 7ff01119d640 1 -- start start 2024-09-18T12:53:16.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.299+0000 7ff01119d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c100650 0x7ff00c198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:16.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.299+0000 7ff01119d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff00c106650 0x7ff00c198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.299+0000 7ff01119d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c10db20 con 0x7ff00c100650 2024-09-18T12:53:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.299+0000 7ff01119d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c10d9a0 con 0x7ff00c106650 2024-09-18T12:53:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.299+0000 7ff00bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c100650 0x7ff00c198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.299+0000 7ff00bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c100650 0x7ff00c198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47052/0 (socket says 172.21.15.78:47052) 2024-09-18T12:53:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.299+0000 7ff00bfff640 1 -- 172.21.15.78:0/4269093742 learned_addr learned my addr 172.21.15.78:0/4269093742 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.300+0000 7ff00b7fe640 1 --2- 172.21.15.78:0/4269093742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff00c106650 0x7ff00c198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.300+0000 7ff00bfff640 1 -- 172.21.15.78:0/4269093742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff00c106650 msgr2=0x7ff00c198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:16.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.300+0000 7ff00bfff640 1 --2- 172.21.15.78:0/4269093742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff00c106650 0x7ff00c198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:16.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.300+0000 7ff00bfff640 1 -- 172.21.15.78:0/4269093742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00c199190 con 0x7ff00c100650 2024-09-18T12:53:16.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.300+0000 7ff00bfff640 1 --2- 172.21.15.78:0/4269093742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c100650 0x7ff00c198650 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feffc00d6f0 tx=0x7feffc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:16.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.300+0000 7ff0097fa640 1 -- 172.21.15.78:0/4269093742 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feffc017070 con 0x7ff00c100650 2024-09-18T12:53:16.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.300+0000 7ff01119d640 1 -- 172.21.15.78:0/4269093742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00c199480 con 0x7ff00c100650 2024-09-18T12:53:16.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.300+0000 7ff01119d640 1 -- 172.21.15.78:0/4269093742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff00c1a1a80 con 0x7ff00c100650 2024-09-18T12:53:16.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.301+0000 7ff0097fa640 1 -- 172.21.15.78:0/4269093742 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feffc00de00 con 0x7ff00c100650 2024-09-18T12:53:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.301+0000 7ff0097fa640 1 -- 172.21.15.78:0/4269093742 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feffc020060 con 0x7ff00c100650 2024-09-18T12:53:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.301+0000 7ff01119d640 1 -- 172.21.15.78:0/4269093742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff8005290 con 0x7ff00c100650 2024-09-18T12:53:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.302+0000 7ff0097fa640 1 -- 172.21.15.78:0/4269093742 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7feffc009a30 con 0x7ff00c100650 2024-09-18T12:53:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.303+0000 7ff0097fa640 1 --2- 172.21.15.78:0/4269093742 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feff407af80 0x7feff407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.303+0000 7ff0097fa640 1 -- 172.21.15.78:0/4269093742 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7feffc09d880 con 0x7ff00c100650 2024-09-18T12:53:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.303+0000 7ff00b7fe640 1 --2- 172.21.15.78:0/4269093742 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feff407af80 0x7feff407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.303+0000 7ff00b7fe640 1 --2- 172.21.15.78:0/4269093742 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feff407af80 0x7feff407d440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff00c06ad00 tx=0x7ff000031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.307+0000 7ff0097fa640 1 -- 172.21.15.78:0/4269093742 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7ff00c199480 con 0x7ff00c100650 2024-09-18T12:53:16.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.480+0000 7ff01119d640 1 -- 172.21.15.78:0/4269093742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7feff8005580 con 0x7ff00c100650 2024-09-18T12:53:16.481 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:16 smithi078 ceph-mon[28091]: pgmap v88: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:16.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.480+0000 7ff0097fa640 1 -- 172.21.15.78:0/4269093742 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v66)=0 v66) ==== 163+0+0 (secure 0 0 0) 0x7feffc068eb0 con 0x7ff00c100650 2024-09-18T12:53:16.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.482+0000 7ff01119d640 1 -- 172.21.15.78:0/4269093742 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feff407af80 msgr2=0x7feff407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:16.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.482+0000 7ff01119d640 1 --2- 172.21.15.78:0/4269093742 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feff407af80 0x7feff407d440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff00c06ad00 tx=0x7ff000031400 comp rx=0 tx=0).stop 2024-09-18T12:53:16.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.482+0000 7ff01119d640 1 -- 172.21.15.78:0/4269093742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c100650 msgr2=0x7ff00c198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:16.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.482+0000 7ff01119d640 1 --2- 172.21.15.78:0/4269093742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c100650 0x7ff00c198650 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feffc00d6f0 tx=0x7feffc00dbb0 comp rx=0 tx=0).stop 2024-09-18T12:53:16.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.482+0000 7ff01119d640 1 -- 172.21.15.78:0/4269093742 shutdown_connections 2024-09-18T12:53:16.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.482+0000 7ff01119d640 1 --2- 172.21.15.78:0/4269093742 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feff407af80 0x7feff407d440 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:16.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.482+0000 7ff01119d640 1 --2- 172.21.15.78:0/4269093742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff00c106650 0x7ff00c198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:16.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.482+0000 7ff01119d640 1 --2- 172.21.15.78:0/4269093742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c100650 0x7ff00c198650 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:16.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.482+0000 7ff01119d640 1 -- 172.21.15.78:0/4269093742 >> 172.21.15.78:0/4269093742 conn(0x7ff00c0fc350 msgr2=0x7ff00c0fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:16.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.482+0000 7ff01119d640 1 -- 172.21.15.78:0/4269093742 shutdown_connections 2024-09-18T12:53:16.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:16.482+0000 7ff01119d640 1 -- 172.21.15.78:0/4269093742 wait complete. 2024-09-18T12:53:16.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:16 smithi148 ceph-mon[35352]: pgmap v88: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:17.036 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-18T12:53:17.285 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:53:17.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.769+0000 7f28f3d45640 1 -- 172.21.15.78:0/683310100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ec100800 msgr2=0x7f28ec100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:17.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.769+0000 7f28f3d45640 1 --2- 172.21.15.78:0/683310100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ec100800 0x7f28ec100c60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009880 tx=0x7f28dc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:17.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.769+0000 7f28f3d45640 1 -- 172.21.15.78:0/683310100 shutdown_connections 2024-09-18T12:53:17.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.769+0000 7f28f3d45640 1 --2- 172.21.15.78:0/683310100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ec100800 0x7f28ec100c60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:17.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.769+0000 7f28f3d45640 1 --2- 172.21.15.78:0/683310100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec106800 0x7f28ec106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:17.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.769+0000 7f28f3d45640 1 -- 172.21.15.78:0/683310100 >> 172.21.15.78:0/683310100 conn(0x7f28ec0fc520 msgr2=0x7f28ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:17.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.770+0000 7f28f3d45640 1 -- 172.21.15.78:0/683310100 shutdown_connections 2024-09-18T12:53:17.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.770+0000 7f28f3d45640 1 -- 172.21.15.78:0/683310100 wait complete. 2024-09-18T12:53:17.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.770+0000 7f28f3d45640 1 Processor -- start 2024-09-18T12:53:17.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.770+0000 7f28f3d45640 1 -- start start 2024-09-18T12:53:17.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.770+0000 7f28f3d45640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec100800 0x7f28ec198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:17.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.770+0000 7f28f3d45640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ec106800 0x7f28ec198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:17.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.770+0000 7f28f3d45640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec10dcd0 con 0x7f28ec106800 2024-09-18T12:53:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.770+0000 7f28f3d45640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec10db50 con 0x7f28ec100800 2024-09-18T12:53:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.771+0000 7f28f12e0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ec106800 0x7f28ec198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.771+0000 7f28f12e0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ec106800 0x7f28ec198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47066/0 (socket says 172.21.15.78:47066) 2024-09-18T12:53:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.771+0000 7f28f12e0640 1 -- 172.21.15.78:0/4204691018 learned_addr learned my addr 172.21.15.78:0/4204691018 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.771+0000 7f28f1ae1640 1 --2- 172.21.15.78:0/4204691018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec100800 0x7f28ec198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.771+0000 7f28f12e0640 1 -- 172.21.15.78:0/4204691018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec100800 msgr2=0x7f28ec198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.771+0000 7f28f12e0640 1 --2- 172.21.15.78:0/4204691018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec100800 0x7f28ec198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.771+0000 7f28f12e0640 1 -- 172.21.15.78:0/4204691018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ec199360 con 0x7f28ec106800 2024-09-18T12:53:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.771+0000 7f28f12e0640 1 --2- 172.21.15.78:0/4204691018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ec106800 0x7f28ec198d60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f28dc031460 tx=0x7f28dc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.771+0000 7f28e2ffd640 1 -- 172.21.15.78:0/4204691018 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f28dc03f070 con 0x7f28ec106800 2024-09-18T12:53:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.771+0000 7f28e2ffd640 1 -- 172.21.15.78:0/4204691018 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f28dc0035f0 con 0x7f28ec106800 2024-09-18T12:53:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.771+0000 7f28f3d45640 1 -- 172.21.15.78:0/4204691018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ec1995f0 con 0x7f28ec106800 2024-09-18T12:53:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.771+0000 7f28e2ffd640 1 -- 172.21.15.78:0/4204691018 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f28dc035030 con 0x7f28ec106800 2024-09-18T12:53:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.771+0000 7f28f3d45640 1 -- 172.21.15.78:0/4204691018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ec1a1ba0 con 0x7f28ec106800 2024-09-18T12:53:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.772+0000 7f28f3d45640 1 -- 172.21.15.78:0/4204691018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28ec101f40 con 0x7f28ec106800 2024-09-18T12:53:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.773+0000 7f28e2ffd640 1 -- 172.21.15.78:0/4204691018 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f28dc042070 con 0x7f28ec106800 2024-09-18T12:53:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.773+0000 7f28e2ffd640 1 --2- 172.21.15.78:0/4204691018 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28d807af30 0x7f28d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.773+0000 7f28e2ffd640 1 -- 172.21.15.78:0/4204691018 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f28dc0be920 con 0x7f28ec106800 2024-09-18T12:53:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.773+0000 7f28f1ae1640 1 --2- 172.21.15.78:0/4204691018 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28d807af30 0x7f28d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.774+0000 7f28f1ae1640 1 --2- 172.21.15.78:0/4204691018 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28d807af30 0x7f28d807d3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f28e8005fd0 tx=0x7f28e800b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.778+0000 7f28e2ffd640 1 -- 172.21.15.78:0/4204691018 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f28dc089f70 con 0x7f28ec106800 2024-09-18T12:53:17.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.950+0000 7f28f3d45640 1 -- 172.21.15.78:0/4204691018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f28ec108d70 con 0x7f28ec106800 2024-09-18T12:53:17.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.951+0000 7f28e2ffd640 1 -- 172.21.15.78:0/4204691018 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v66)=0 v66) ==== 135+0+0 (secure 0 0 0) 0x7f28dc08ee20 con 0x7f28ec106800 2024-09-18T12:53:17.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.953+0000 7f28f3d45640 1 -- 172.21.15.78:0/4204691018 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28d807af30 msgr2=0x7f28d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:17.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.953+0000 7f28f3d45640 1 --2- 172.21.15.78:0/4204691018 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28d807af30 0x7f28d807d3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f28e8005fd0 tx=0x7f28e800b390 comp rx=0 tx=0).stop 2024-09-18T12:53:17.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.953+0000 7f28f3d45640 1 -- 172.21.15.78:0/4204691018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ec106800 msgr2=0x7f28ec198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:17.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.953+0000 7f28f3d45640 1 --2- 172.21.15.78:0/4204691018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ec106800 0x7f28ec198d60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f28dc031460 tx=0x7f28dc0045e0 comp rx=0 tx=0).stop 2024-09-18T12:53:17.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.953+0000 7f28f3d45640 1 -- 172.21.15.78:0/4204691018 shutdown_connections 2024-09-18T12:53:17.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.953+0000 7f28f3d45640 1 --2- 172.21.15.78:0/4204691018 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28d807af30 0x7f28d807d3f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:17.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.953+0000 7f28f3d45640 1 --2- 172.21.15.78:0/4204691018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ec106800 0x7f28ec198d60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:17.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.953+0000 7f28f3d45640 1 --2- 172.21.15.78:0/4204691018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec100800 0x7f28ec198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:17.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.953+0000 7f28f3d45640 1 -- 172.21.15.78:0/4204691018 >> 172.21.15.78:0/4204691018 conn(0x7f28ec0fc520 msgr2=0x7f28ec0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:17.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.953+0000 7f28f3d45640 1 -- 172.21.15.78:0/4204691018 shutdown_connections 2024-09-18T12:53:17.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:17.953+0000 7f28f3d45640 1 -- 172.21.15.78:0/4204691018 wait complete. 2024-09-18T12:53:18.565 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:18 smithi078 ceph-mon[28091]: pgmap v89: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:18.594 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-18T12:53:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:18 smithi148 ceph-mon[35352]: pgmap v89: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:53:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.296+0000 7f34f07e0640 1 -- 172.21.15.78:0/2886694631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34e8102ac0 msgr2=0x7f34e8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.296+0000 7f34f07e0640 1 --2- 172.21.15.78:0/2886694631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34e8102ac0 0x7f34e8102ea0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009880 tx=0x7f34e402a530 comp rx=0 tx=0).stop 2024-09-18T12:53:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.296+0000 7f34f07e0640 1 -- 172.21.15.78:0/2886694631 shutdown_connections 2024-09-18T12:53:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.296+0000 7f34f07e0640 1 --2- 172.21.15.78:0/2886694631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34e81033e0 0x7f34e810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.296+0000 7f34f07e0640 1 --2- 172.21.15.78:0/2886694631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34e8102ac0 0x7f34e8102ea0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.296+0000 7f34f07e0640 1 -- 172.21.15.78:0/2886694631 >> 172.21.15.78:0/2886694631 conn(0x7f34e80fc520 msgr2=0x7f34e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.296+0000 7f34f07e0640 1 -- 172.21.15.78:0/2886694631 shutdown_connections 2024-09-18T12:53:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.296+0000 7f34f07e0640 1 -- 172.21.15.78:0/2886694631 wait complete. 2024-09-18T12:53:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.297+0000 7f34f07e0640 1 Processor -- start 2024-09-18T12:53:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.297+0000 7f34f07e0640 1 -- start start 2024-09-18T12:53:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.297+0000 7f34f07e0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34e8102ac0 0x7f34e819f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.297+0000 7f34f07e0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34e81033e0 0x7f34e819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.297+0000 7f34f07e0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f34e810edd0 con 0x7f34e81033e0 2024-09-18T12:53:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.297+0000 7f34f07e0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f34e810ec50 con 0x7f34e8102ac0 2024-09-18T12:53:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.297+0000 7f34edd7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34e81033e0 0x7f34e819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.297+0000 7f34edd7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34e81033e0 0x7f34e819fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47092/0 (socket says 172.21.15.78:47092) 2024-09-18T12:53:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.297+0000 7f34edd7b640 1 -- 172.21.15.78:0/3105670024 learned_addr learned my addr 172.21.15.78:0/3105670024 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.298+0000 7f34ee57c640 1 --2- 172.21.15.78:0/3105670024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34e8102ac0 0x7f34e819f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.298+0000 7f34edd7b640 1 -- 172.21.15.78:0/3105670024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34e8102ac0 msgr2=0x7f34e819f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.298+0000 7f34edd7b640 1 --2- 172.21.15.78:0/3105670024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34e8102ac0 0x7f34e819f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.298+0000 7f34edd7b640 1 -- 172.21.15.78:0/3105670024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e81a03e0 con 0x7f34e81033e0 2024-09-18T12:53:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.298+0000 7f34ee57c640 1 --2- 172.21.15.78:0/3105670024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34e8102ac0 0x7f34e819f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:53:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.298+0000 7f34edd7b640 1 --2- 172.21.15.78:0/3105670024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34e81033e0 0x7f34e819fd30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f34d800c8f0 tx=0x7f34d800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.298+0000 7f34df7fe640 1 -- 172.21.15.78:0/3105670024 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34d80079b0 con 0x7f34e81033e0 2024-09-18T12:53:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.298+0000 7f34df7fe640 1 -- 172.21.15.78:0/3105670024 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34d8007b50 con 0x7f34e81033e0 2024-09-18T12:53:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.298+0000 7f34f07e0640 1 -- 172.21.15.78:0/3105670024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e8199ad0 con 0x7f34e81033e0 2024-09-18T12:53:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.298+0000 7f34df7fe640 1 -- 172.21.15.78:0/3105670024 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34d8018610 con 0x7f34e81033e0 2024-09-18T12:53:19.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.298+0000 7f34f07e0640 1 -- 172.21.15.78:0/3105670024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e819a030 con 0x7f34e81033e0 2024-09-18T12:53:19.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.299+0000 7f34f07e0640 1 -- 172.21.15.78:0/3105670024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e806aa90 con 0x7f34e81033e0 2024-09-18T12:53:19.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.300+0000 7f34df7fe640 1 -- 172.21.15.78:0/3105670024 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f34d800f450 con 0x7f34e81033e0 2024-09-18T12:53:19.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.300+0000 7f34df7fe640 1 --2- 172.21.15.78:0/3105670024 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f34d407af40 0x7f34d407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:19.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.300+0000 7f34df7fe640 1 -- 172.21.15.78:0/3105670024 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f34d809e230 con 0x7f34e81033e0 2024-09-18T12:53:19.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.300+0000 7f34ee57c640 1 --2- 172.21.15.78:0/3105670024 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f34d407af40 0x7f34d407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:19.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.301+0000 7f34ee57c640 1 --2- 172.21.15.78:0/3105670024 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f34d407af40 0x7f34d407d400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34e4000c00 tx=0x7f34e40095a0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:19.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.305+0000 7f34df7fe640 1 -- 172.21.15.78:0/3105670024 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f34d8014030 con 0x7f34e81033e0 2024-09-18T12:53:19.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.496+0000 7f34f07e0640 1 -- 172.21.15.78:0/3105670024 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "target": ["mon-mgr", ""]}) -- 0x7f34e819af50 con 0x7f34d407af40 2024-09-18T12:53:19.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.502+0000 7f34df7fe640 1 -- 172.21.15.78:0/3105670024 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f34e819af50 con 0x7f34d407af40 2024-09-18T12:53:19.503 INFO:teuthology.orchestra.run.smithi078.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:53:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.504+0000 7f34f07e0640 1 -- 172.21.15.78:0/3105670024 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f34d407af40 msgr2=0x7f34d407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.504+0000 7f34f07e0640 1 --2- 172.21.15.78:0/3105670024 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f34d407af40 0x7f34d407d400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34e4000c00 tx=0x7f34e40095a0 comp rx=0 tx=0).stop 2024-09-18T12:53:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.504+0000 7f34f07e0640 1 -- 172.21.15.78:0/3105670024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34e81033e0 msgr2=0x7f34e819fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.504+0000 7f34f07e0640 1 --2- 172.21.15.78:0/3105670024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34e81033e0 0x7f34e819fd30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f34d800c8f0 tx=0x7f34d800cdb0 comp rx=0 tx=0).stop 2024-09-18T12:53:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.504+0000 7f34f07e0640 1 -- 172.21.15.78:0/3105670024 shutdown_connections 2024-09-18T12:53:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.504+0000 7f34f07e0640 1 --2- 172.21.15.78:0/3105670024 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f34d407af40 0x7f34d407d400 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.504+0000 7f34f07e0640 1 --2- 172.21.15.78:0/3105670024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34e81033e0 0x7f34e819fd30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.504+0000 7f34f07e0640 1 --2- 172.21.15.78:0/3105670024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34e8102ac0 0x7f34e819f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.504+0000 7f34f07e0640 1 -- 172.21.15.78:0/3105670024 >> 172.21.15.78:0/3105670024 conn(0x7f34e80fc520 msgr2=0x7f34e8100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.505+0000 7f34f07e0640 1 -- 172.21.15.78:0/3105670024 shutdown_connections 2024-09-18T12:53:19.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:19.505+0000 7f34f07e0640 1 -- 172.21.15.78:0/3105670024 wait complete. 2024-09-18T12:53:20.126 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-18T12:53:20.127 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-18T12:53:20.127 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-18T12:53:20.383 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T12:53:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:20 smithi078 ceph-mon[28091]: pgmap v90: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:20 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:20 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:20 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:20 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:53:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:20 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:20 smithi148 ceph-mon[35352]: pgmap v90: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:20 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:20 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:20 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:20 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:53:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:20 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:21.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.003+0000 7f3fc87e1640 1 -- 172.21.15.78:0/2569261815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc01007f0 msgr2=0x7f3fc0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:21.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.003+0000 7f3fc87e1640 1 --2- 172.21.15.78:0/2569261815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc01007f0 0x7f3fc0100c50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009880 tx=0x7f3fb002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.003+0000 7f3fc87e1640 1 -- 172.21.15.78:0/2569261815 shutdown_connections 2024-09-18T12:53:21.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.003+0000 7f3fc87e1640 1 --2- 172.21.15.78:0/2569261815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc01007f0 0x7f3fc0100c50 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.003+0000 7f3fc87e1640 1 --2- 172.21.15.78:0/2569261815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fc01067f0 0x7f3fc0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.003+0000 7f3fc87e1640 1 -- 172.21.15.78:0/2569261815 >> 172.21.15.78:0/2569261815 conn(0x7f3fc00fc550 msgr2=0x7f3fc00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:21.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.003+0000 7f3fc87e1640 1 -- 172.21.15.78:0/2569261815 shutdown_connections 2024-09-18T12:53:21.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.003+0000 7f3fc87e1640 1 -- 172.21.15.78:0/2569261815 wait complete. 2024-09-18T12:53:21.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.003+0000 7f3fc87e1640 1 Processor -- start 2024-09-18T12:53:21.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.003+0000 7f3fc87e1640 1 -- start start 2024-09-18T12:53:21.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.003+0000 7f3fc87e1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc01007f0 0x7f3fc019f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:21.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.003+0000 7f3fc87e1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fc01067f0 0x7f3fc019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:21.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.003+0000 7f3fc87e1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc010dcc0 con 0x7f3fc01007f0 2024-09-18T12:53:21.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.003+0000 7f3fc87e1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc010db40 con 0x7f3fc01067f0 2024-09-18T12:53:21.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.004+0000 7f3fc657d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc01007f0 0x7f3fc019f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:21.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.004+0000 7f3fc657d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc01007f0 0x7f3fc019f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47106/0 (socket says 172.21.15.78:47106) 2024-09-18T12:53:21.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.004+0000 7f3fc657d640 1 -- 172.21.15.78:0/364046528 learned_addr learned my addr 172.21.15.78:0/364046528 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:21.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.004+0000 7f3fc5d7c640 1 --2- 172.21.15.78:0/364046528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fc01067f0 0x7f3fc019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:21.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.004+0000 7f3fc657d640 1 -- 172.21.15.78:0/364046528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fc01067f0 msgr2=0x7f3fc019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:21.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.004+0000 7f3fc657d640 1 --2- 172.21.15.78:0/364046528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fc01067f0 0x7f3fc019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.004+0000 7f3fc657d640 1 -- 172.21.15.78:0/364046528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc01999b0 con 0x7f3fc01007f0 2024-09-18T12:53:21.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.004+0000 7f3fc657d640 1 --2- 172.21.15.78:0/364046528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc01007f0 0x7f3fc019f7f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00e970 tx=0x7f3fbc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:21.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.004+0000 7f3fb77fe640 1 -- 172.21.15.78:0/364046528 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3fbc00cac0 con 0x7f3fc01007f0 2024-09-18T12:53:21.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.004+0000 7f3fb77fe640 1 -- 172.21.15.78:0/364046528 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3fbc0054e0 con 0x7f3fc01007f0 2024-09-18T12:53:21.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.004+0000 7f3fc87e1640 1 -- 172.21.15.78:0/364046528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc0199ca0 con 0x7f3fc01007f0 2024-09-18T12:53:21.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.004+0000 7f3fb77fe640 1 -- 172.21.15.78:0/364046528 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3fbc010430 con 0x7f3fc01007f0 2024-09-18T12:53:21.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.004+0000 7f3fc87e1640 1 -- 172.21.15.78:0/364046528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc019a200 con 0x7f3fc01007f0 2024-09-18T12:53:21.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.005+0000 7f3fc87e1640 1 -- 172.21.15.78:0/364046528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc0101f30 con 0x7f3fc01007f0 2024-09-18T12:53:21.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.006+0000 7f3fb77fe640 1 -- 172.21.15.78:0/364046528 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3fbc004e80 con 0x7f3fc01007f0 2024-09-18T12:53:21.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.006+0000 7f3fb77fe640 1 --2- 172.21.15.78:0/364046528 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3fac07af30 0x7f3fac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:21.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.007+0000 7f3fc5d7c640 1 --2- 172.21.15.78:0/364046528 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3fac07af30 0x7f3fac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:21.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.007+0000 7f3fb77fe640 1 -- 172.21.15.78:0/364046528 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f3fbc09e5e0 con 0x7f3fc01007f0 2024-09-18T12:53:21.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.007+0000 7f3fc5d7c640 1 --2- 172.21.15.78:0/364046528 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3fac07af30 0x7f3fac07d3f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3fc019b1a0 tx=0x7f3fb0031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:21.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.011+0000 7f3fb77fe640 1 -- 172.21.15.78:0/364046528 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f3fbc069c30 con 0x7f3fc01007f0 2024-09-18T12:53:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.209+0000 7f3fc87e1640 1 -- 172.21.15.78:0/364046528 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3fc019a510 con 0x7f3fac07af30 2024-09-18T12:53:21.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.210+0000 7f3fb77fe640 1 -- 172.21.15.78:0/364046528 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f3fc019a510 con 0x7f3fac07af30 2024-09-18T12:53:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.212+0000 7f3fc87e1640 1 -- 172.21.15.78:0/364046528 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3fac07af30 msgr2=0x7f3fac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.212+0000 7f3fc87e1640 1 --2- 172.21.15.78:0/364046528 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3fac07af30 0x7f3fac07d3f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3fc019b1a0 tx=0x7f3fb0031400 comp rx=0 tx=0).stop 2024-09-18T12:53:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.212+0000 7f3fc87e1640 1 -- 172.21.15.78:0/364046528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc01007f0 msgr2=0x7f3fc019f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.212+0000 7f3fc87e1640 1 --2- 172.21.15.78:0/364046528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc01007f0 0x7f3fc019f7f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00e970 tx=0x7f3fbc00ed70 comp rx=0 tx=0).stop 2024-09-18T12:53:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.212+0000 7f3fc87e1640 1 -- 172.21.15.78:0/364046528 shutdown_connections 2024-09-18T12:53:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.212+0000 7f3fc87e1640 1 --2- 172.21.15.78:0/364046528 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3fac07af30 0x7f3fac07d3f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.212+0000 7f3fc87e1640 1 --2- 172.21.15.78:0/364046528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fc01067f0 0x7f3fc019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.212+0000 7f3fc87e1640 1 --2- 172.21.15.78:0/364046528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fc01007f0 0x7f3fc019f7f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.212+0000 7f3fc87e1640 1 -- 172.21.15.78:0/364046528 >> 172.21.15.78:0/364046528 conn(0x7f3fc00fc550 msgr2=0x7f3fc0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.212+0000 7f3fc87e1640 1 -- 172.21.15.78:0/364046528 shutdown_connections 2024-09-18T12:53:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.212+0000 7f3fc87e1640 1 -- 172.21.15.78:0/364046528 wait complete. 2024-09-18T12:53:21.222 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:53:21.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.299+0000 7f98a15b9640 1 -- 172.21.15.78:0/1203489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f989c102ac0 msgr2=0x7f989c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:21.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.299+0000 7f98a15b9640 1 --2- 172.21.15.78:0/1203489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f989c102ac0 0x7f989c102ea0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f988c009880 tx=0x7f988c02a530 comp rx=0 tx=0).stop 2024-09-18T12:53:21.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.299+0000 7f98a15b9640 1 -- 172.21.15.78:0/1203489 shutdown_connections 2024-09-18T12:53:21.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.299+0000 7f98a15b9640 1 --2- 172.21.15.78:0/1203489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f989c1033e0 0x7f989c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.299+0000 7f98a15b9640 1 --2- 172.21.15.78:0/1203489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f989c102ac0 0x7f989c102ea0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.299+0000 7f98a15b9640 1 -- 172.21.15.78:0/1203489 >> 172.21.15.78:0/1203489 conn(0x7f989c0fc520 msgr2=0x7f989c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:21.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.299+0000 7f98a15b9640 1 -- 172.21.15.78:0/1203489 shutdown_connections 2024-09-18T12:53:21.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.299+0000 7f98a15b9640 1 -- 172.21.15.78:0/1203489 wait complete. 2024-09-18T12:53:21.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.300+0000 7f98a15b9640 1 Processor -- start 2024-09-18T12:53:21.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.300+0000 7f98a15b9640 1 -- start start 2024-09-18T12:53:21.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.300+0000 7f98a15b9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f989c102ac0 0x7f989c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:21.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.300+0000 7f98a15b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f989c1033e0 0x7f989c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:21.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.300+0000 7f98a15b9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f989c10edf0 con 0x7f989c1033e0 2024-09-18T12:53:21.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.300+0000 7f98a15b9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f989c10ec70 con 0x7f989c102ac0 2024-09-18T12:53:21.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.300+0000 7f989a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f989c1033e0 0x7f989c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:21.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.300+0000 7f989a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f989c1033e0 0x7f989c19db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36708/0 (socket says 172.21.15.78:36708) 2024-09-18T12:53:21.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.301+0000 7f989a7fc640 1 -- 172.21.15.78:0/2820037968 learned_addr learned my addr 172.21.15.78:0/2820037968 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:21.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.301+0000 7f989affd640 1 --2- 172.21.15.78:0/2820037968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f989c102ac0 0x7f989c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:21.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.301+0000 7f989a7fc640 1 -- 172.21.15.78:0/2820037968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f989c102ac0 msgr2=0x7f989c19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:21.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.301+0000 7f989a7fc640 1 --2- 172.21.15.78:0/2820037968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f989c102ac0 0x7f989c19d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.301+0000 7f989a7fc640 1 -- 172.21.15.78:0/2820037968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c1977c0 con 0x7f989c1033e0 2024-09-18T12:53:21.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.301+0000 7f989a7fc640 1 --2- 172.21.15.78:0/2820037968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f989c1033e0 0x7f989c19db80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f989000e970 tx=0x7f989000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:21.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.303+0000 7f9883fff640 1 -- 172.21.15.78:0/2820037968 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f989000cac0 con 0x7f989c1033e0 2024-09-18T12:53:21.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.303+0000 7f9883fff640 1 -- 172.21.15.78:0/2820037968 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f98900054e0 con 0x7f989c1033e0 2024-09-18T12:53:21.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.303+0000 7f98a15b9640 1 -- 172.21.15.78:0/2820037968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989c197ab0 con 0x7f989c1033e0 2024-09-18T12:53:21.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.303+0000 7f9883fff640 1 -- 172.21.15.78:0/2820037968 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9890004dd0 con 0x7f989c1033e0 2024-09-18T12:53:21.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.303+0000 7f98a15b9640 1 -- 172.21.15.78:0/2820037968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f989c198040 con 0x7f989c1033e0 2024-09-18T12:53:21.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.304+0000 7f98a15b9640 1 -- 172.21.15.78:0/2820037968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f989c06aa90 con 0x7f989c1033e0 2024-09-18T12:53:21.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.304+0000 7f9883fff640 1 -- 172.21.15.78:0/2820037968 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9890005020 con 0x7f989c1033e0 2024-09-18T12:53:21.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.305+0000 7f9883fff640 1 --2- 172.21.15.78:0/2820037968 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f988407aed0 0x7f988407d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:21.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.305+0000 7f9883fff640 1 -- 172.21.15.78:0/2820037968 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f989009e660 con 0x7f989c1033e0 2024-09-18T12:53:21.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.305+0000 7f989affd640 1 --2- 172.21.15.78:0/2820037968 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f988407aed0 0x7f988407d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:21.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.305+0000 7f989affd640 1 --2- 172.21.15.78:0/2820037968 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f988407aed0 0x7f988407d390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f988c0096c0 tx=0x7f988c031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:21.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.309+0000 7f9883fff640 1 -- 172.21.15.78:0/2820037968 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f9890069c10 con 0x7f989c1033e0 2024-09-18T12:53:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.506+0000 7f98a15b9640 1 -- 172.21.15.78:0/2820037968 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f989c198350 con 0x7f988407aed0 2024-09-18T12:53:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.507+0000 7f9883fff640 1 -- 172.21.15.78:0/2820037968 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f989c198350 con 0x7f988407aed0 2024-09-18T12:53:21.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.509+0000 7f98a15b9640 1 -- 172.21.15.78:0/2820037968 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f988407aed0 msgr2=0x7f988407d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:21.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.509+0000 7f98a15b9640 1 --2- 172.21.15.78:0/2820037968 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f988407aed0 0x7f988407d390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f988c0096c0 tx=0x7f988c031400 comp rx=0 tx=0).stop 2024-09-18T12:53:21.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.509+0000 7f98a15b9640 1 -- 172.21.15.78:0/2820037968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f989c1033e0 msgr2=0x7f989c19db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:21.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.509+0000 7f98a15b9640 1 --2- 172.21.15.78:0/2820037968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f989c1033e0 0x7f989c19db80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f989000e970 tx=0x7f989000ee30 comp rx=0 tx=0).stop 2024-09-18T12:53:21.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.510+0000 7f98a15b9640 1 -- 172.21.15.78:0/2820037968 shutdown_connections 2024-09-18T12:53:21.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.510+0000 7f98a15b9640 1 --2- 172.21.15.78:0/2820037968 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f988407aed0 0x7f988407d390 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.510+0000 7f98a15b9640 1 --2- 172.21.15.78:0/2820037968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f989c1033e0 0x7f989c19db80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.510+0000 7f98a15b9640 1 --2- 172.21.15.78:0/2820037968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f989c102ac0 0x7f989c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.510+0000 7f98a15b9640 1 -- 172.21.15.78:0/2820037968 >> 172.21.15.78:0/2820037968 conn(0x7f989c0fc520 msgr2=0x7f989c10af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:21.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.510+0000 7f98a15b9640 1 -- 172.21.15.78:0/2820037968 shutdown_connections 2024-09-18T12:53:21.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.510+0000 7f98a15b9640 1 -- 172.21.15.78:0/2820037968 wait complete. 2024-09-18T12:53:21.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.591+0000 7f59b86dd640 1 -- 172.21.15.78:0/541171630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b0107900 msgr2=0x7f59b0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:21.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.591+0000 7f59b86dd640 1 --2- 172.21.15.78:0/541171630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b0107900 0x7f59b0107ce0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009880 tx=0x7f59a802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.593 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:21 smithi078 ceph-mon[28091]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:21.593 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:21 smithi078 ceph-mon[28091]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:53:21.593 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:21 smithi078 ceph-mon[28091]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:53:21.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.593+0000 7f59b86dd640 1 -- 172.21.15.78:0/541171630 shutdown_connections 2024-09-18T12:53:21.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.593+0000 7f59b86dd640 1 --2- 172.21.15.78:0/541171630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59b0101900 0x7f59b0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.593+0000 7f59b86dd640 1 --2- 172.21.15.78:0/541171630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b0107900 0x7f59b0107ce0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.593+0000 7f59b86dd640 1 -- 172.21.15.78:0/541171630 >> 172.21.15.78:0/541171630 conn(0x7f59b00fd600 msgr2=0x7f59b00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:21.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.593+0000 7f59b86dd640 1 -- 172.21.15.78:0/541171630 shutdown_connections 2024-09-18T12:53:21.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.593+0000 7f59b86dd640 1 -- 172.21.15.78:0/541171630 wait complete. 2024-09-18T12:53:21.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.593+0000 7f59b86dd640 1 Processor -- start 2024-09-18T12:53:21.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.593+0000 7f59b86dd640 1 -- start start 2024-09-18T12:53:21.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.593+0000 7f59b86dd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59b0101900 0x7f59b019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:21.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.593+0000 7f59b86dd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b0107900 0x7f59b019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:21.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.593+0000 7f59b86dd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f59b010edd0 con 0x7f59b0107900 2024-09-18T12:53:21.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.593+0000 7f59b86dd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f59b010ec50 con 0x7f59b0101900 2024-09-18T12:53:21.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.594+0000 7f59b5c78640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b0107900 0x7f59b019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:21.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.594+0000 7f59b5c78640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b0107900 0x7f59b019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36728/0 (socket says 172.21.15.78:36728) 2024-09-18T12:53:21.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.594+0000 7f59b5c78640 1 -- 172.21.15.78:0/462581144 learned_addr learned my addr 172.21.15.78:0/462581144 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:21.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.594+0000 7f59b6479640 1 --2- 172.21.15.78:0/462581144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59b0101900 0x7f59b019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:21.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.594+0000 7f59b5c78640 1 -- 172.21.15.78:0/462581144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59b0101900 msgr2=0x7f59b019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:21.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.594+0000 7f59b5c78640 1 --2- 172.21.15.78:0/462581144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59b0101900 0x7f59b019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.594+0000 7f59b5c78640 1 -- 172.21.15.78:0/462581144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b01977c0 con 0x7f59b0107900 2024-09-18T12:53:21.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.594+0000 7f59b5c78640 1 --2- 172.21.15.78:0/462581144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b0107900 0x7f59b019db80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f59a400ea00 tx=0x7f59a400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:21.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.594+0000 7f59af7fe640 1 -- 172.21.15.78:0/462581144 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59a400cb80 con 0x7f59b0107900 2024-09-18T12:53:21.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.594+0000 7f59af7fe640 1 -- 172.21.15.78:0/462581144 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f59a400cd20 con 0x7f59b0107900 2024-09-18T12:53:21.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.594+0000 7f59b86dd640 1 -- 172.21.15.78:0/462581144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b0197ab0 con 0x7f59b0107900 2024-09-18T12:53:21.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.595+0000 7f59af7fe640 1 -- 172.21.15.78:0/462581144 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59a4011470 con 0x7f59b0107900 2024-09-18T12:53:21.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.595+0000 7f59b86dd640 1 -- 172.21.15.78:0/462581144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b0198040 con 0x7f59b0107900 2024-09-18T12:53:21.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.595+0000 7f59b86dd640 1 -- 172.21.15.78:0/462581144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b0103040 con 0x7f59b0107900 2024-09-18T12:53:21.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.596+0000 7f59af7fe640 1 -- 172.21.15.78:0/462581144 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f59a4005020 con 0x7f59b0107900 2024-09-18T12:53:21.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.597+0000 7f59af7fe640 1 --2- 172.21.15.78:0/462581144 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f599807af30 0x7f599807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:21.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.597+0000 7f59af7fe640 1 -- 172.21.15.78:0/462581144 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f59a409e470 con 0x7f59b0107900 2024-09-18T12:53:21.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.597+0000 7f59b6479640 1 --2- 172.21.15.78:0/462581144 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f599807af30 0x7f599807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:21.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.597+0000 7f59b6479640 1 --2- 172.21.15.78:0/462581144 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f599807af30 0x7f599807d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f59a80096c0 tx=0x7f59a8031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:21.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.601+0000 7f59af7fe640 1 -- 172.21.15.78:0/462581144 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f59a4016030 con 0x7f59b0107900 2024-09-18T12:53:21.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:21 smithi148 ceph-mon[35352]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:21.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:21 smithi148 ceph-mon[35352]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:53:21.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:21 smithi148 ceph-mon[35352]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:53:21.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.790+0000 7f59b86dd640 1 -- 172.21.15.78:0/462581144 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f59b0198350 con 0x7f599807af30 2024-09-18T12:53:21.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.799+0000 7f59af7fe640 1 -- 172.21.15.78:0/462581144 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f59b0198350 con 0x7f599807af30 2024-09-18T12:53:21.800 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:53:21.800 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (71s) 43s ago 12m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T12:53:21.800 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (3m) 43s ago 12m 8674k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:53:21.800 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (3m) 112s ago 11m 8086k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:53:21.801 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (12m) 43s ago 12m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de bb77146b81c7 2024-09-18T12:53:21.801 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (11m) 112s ago 11m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de f82fdd264dc6 2024-09-18T12:53:21.801 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (49s) 43s ago 11m 43.9M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T12:53:21.801 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (6m) 43s ago 6m 151M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:53:21.801 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (6m) 43s ago 6m 27.2M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:53:21.801 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (6m) 112s ago 6m 14.7M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:53:21.801 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (6m) 112s ago 6m 15.6M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:53:21.801 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (3m) 43s ago 13m 519M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:53:21.801 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (2m) 112s ago 11m 452M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:53:21.801 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (13m) 43s ago 13m 62.4M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1cb11a5bcd72 2024-09-18T12:53:21.801 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (11m) 112s ago 11m 44.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 02dfe1551226 2024-09-18T12:53:21.801 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (2m) 43s ago 12m 11.7M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:53:21.801 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (115s) 112s ago 11m 7335k - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:53:21.802 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (10m) 43s ago 10m 205M 1216M 19.1.1-330-gc2ddf972 ebb0615149de f634ad9ddb36 2024-09-18T12:53:21.802 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (9m) 43s ago 9m 221M 1216M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:53:21.802 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (9m) 43s ago 9m 179M 1216M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:53:21.802 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (8m) 112s ago 8m 236M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:53:21.802 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (8m) 112s ago 8m 208M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:53:21.802 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (7m) 112s ago 7m 194M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:53:21.802 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (92s) 43s ago 11m 45.3M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:53:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.801+0000 7f59b86dd640 1 -- 172.21.15.78:0/462581144 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f599807af30 msgr2=0x7f599807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.801+0000 7f59b86dd640 1 --2- 172.21.15.78:0/462581144 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f599807af30 0x7f599807d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f59a80096c0 tx=0x7f59a8031400 comp rx=0 tx=0).stop 2024-09-18T12:53:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.801+0000 7f59b86dd640 1 -- 172.21.15.78:0/462581144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b0107900 msgr2=0x7f59b019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.801+0000 7f59b86dd640 1 --2- 172.21.15.78:0/462581144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b0107900 0x7f59b019db80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f59a400ea00 tx=0x7f59a400eec0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.801+0000 7f59b86dd640 1 -- 172.21.15.78:0/462581144 shutdown_connections 2024-09-18T12:53:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.801+0000 7f59b86dd640 1 --2- 172.21.15.78:0/462581144 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f599807af30 0x7f599807d3f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.801+0000 7f59b86dd640 1 --2- 172.21.15.78:0/462581144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b0107900 0x7f59b019db80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.801+0000 7f59b86dd640 1 --2- 172.21.15.78:0/462581144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59b0101900 0x7f59b019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.801+0000 7f59b86dd640 1 -- 172.21.15.78:0/462581144 >> 172.21.15.78:0/462581144 conn(0x7f59b00fd600 msgr2=0x7f59b00fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.801+0000 7f59b86dd640 1 -- 172.21.15.78:0/462581144 shutdown_connections 2024-09-18T12:53:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.801+0000 7f59b86dd640 1 -- 172.21.15.78:0/462581144 wait complete. 2024-09-18T12:53:21.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.882+0000 7fbd2eb05640 1 -- 172.21.15.78:0/1421215639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd28106800 msgr2=0x7fbd28106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:21.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.882+0000 7fbd2eb05640 1 --2- 172.21.15.78:0/1421215639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd28106800 0x7fbd28106be0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009880 tx=0x7fbd1c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.882+0000 7fbd2eb05640 1 -- 172.21.15.78:0/1421215639 shutdown_connections 2024-09-18T12:53:21.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.882+0000 7fbd2eb05640 1 --2- 172.21.15.78:0/1421215639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd28100800 0x7fbd28100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.882+0000 7fbd2eb05640 1 --2- 172.21.15.78:0/1421215639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd28106800 0x7fbd28106be0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.882+0000 7fbd2eb05640 1 -- 172.21.15.78:0/1421215639 >> 172.21.15.78:0/1421215639 conn(0x7fbd280fc520 msgr2=0x7fbd280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:21.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.882+0000 7fbd2eb05640 1 -- 172.21.15.78:0/1421215639 shutdown_connections 2024-09-18T12:53:21.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.882+0000 7fbd2eb05640 1 -- 172.21.15.78:0/1421215639 wait complete. 2024-09-18T12:53:21.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.883+0000 7fbd2eb05640 1 Processor -- start 2024-09-18T12:53:21.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.883+0000 7fbd2eb05640 1 -- start start 2024-09-18T12:53:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.883+0000 7fbd2eb05640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd28100800 0x7fbd28198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.883+0000 7fbd2eb05640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd28106800 0x7fbd28198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.883+0000 7fbd2eb05640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2810dcd0 con 0x7fbd28100800 2024-09-18T12:53:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.883+0000 7fbd2eb05640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2810db50 con 0x7fbd28106800 2024-09-18T12:53:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.883+0000 7fbd2c8a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd28100800 0x7fbd28198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.883+0000 7fbd2c8a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd28100800 0x7fbd28198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36744/0 (socket says 172.21.15.78:36744) 2024-09-18T12:53:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.883+0000 7fbd2c8a1640 1 -- 172.21.15.78:0/921975755 learned_addr learned my addr 172.21.15.78:0/921975755 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.884+0000 7fbd27fff640 1 --2- 172.21.15.78:0/921975755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd28106800 0x7fbd28198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.884+0000 7fbd2c8a1640 1 -- 172.21.15.78:0/921975755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd28106800 msgr2=0x7fbd28198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.884+0000 7fbd2c8a1640 1 --2- 172.21.15.78:0/921975755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd28106800 0x7fbd28198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.884+0000 7fbd2c8a1640 1 -- 172.21.15.78:0/921975755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd28199350 con 0x7fbd28100800 2024-09-18T12:53:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.884+0000 7fbd2c8a1640 1 --2- 172.21.15.78:0/921975755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd28100800 0x7fbd28198810 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c031460 tx=0x7fbd1c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.884+0000 7fbd25ffb640 1 -- 172.21.15.78:0/921975755 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd1c03f070 con 0x7fbd28100800 2024-09-18T12:53:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.884+0000 7fbd25ffb640 1 -- 172.21.15.78:0/921975755 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbd1c0035f0 con 0x7fbd28100800 2024-09-18T12:53:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.884+0000 7fbd2eb05640 1 -- 172.21.15.78:0/921975755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd281995e0 con 0x7fbd28100800 2024-09-18T12:53:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.884+0000 7fbd25ffb640 1 -- 172.21.15.78:0/921975755 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd1c035030 con 0x7fbd28100800 2024-09-18T12:53:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.884+0000 7fbd2eb05640 1 -- 172.21.15.78:0/921975755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd281a1b90 con 0x7fbd28100800 2024-09-18T12:53:21.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.885+0000 7fbd2eb05640 1 -- 172.21.15.78:0/921975755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd28101f40 con 0x7fbd28100800 2024-09-18T12:53:21.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.886+0000 7fbd25ffb640 1 -- 172.21.15.78:0/921975755 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbd1c042070 con 0x7fbd28100800 2024-09-18T12:53:21.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.887+0000 7fbd25ffb640 1 --2- 172.21.15.78:0/921975755 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbd1807af80 0x7fbd1807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:21.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.887+0000 7fbd25ffb640 1 -- 172.21.15.78:0/921975755 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fbd1c0be8c0 con 0x7fbd28100800 2024-09-18T12:53:21.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.887+0000 7fbd27fff640 1 --2- 172.21.15.78:0/921975755 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbd1807af80 0x7fbd1807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:21.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.887+0000 7fbd27fff640 1 --2- 172.21.15.78:0/921975755 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbd1807af80 0x7fbd1807d440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbd14005fd0 tx=0x7fbd14005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:21.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:21.891+0000 7fbd25ffb640 1 -- 172.21.15.78:0/921975755 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fbd1c089f90 con 0x7fbd28100800 2024-09-18T12:53:22.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.138+0000 7fbd2eb05640 1 -- 172.21.15.78:0/921975755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fbd28108d70 con 0x7fbd28100800 2024-09-18T12:53:22.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.138+0000 7fbd25ffb640 1 -- 172.21.15.78:0/921975755 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fbd1c08ee40 con 0x7fbd28100800 2024-09-18T12:53:22.140 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:53:22.140 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:53:22.140 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:53:22.140 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:53:22.140 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:53:22.140 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:53:22.140 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:53:22.140 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:53:22.140 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:53:22.140 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:53:22.140 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:53:22.140 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:53:22.141 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:53:22.141 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:53:22.141 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-18T12:53:22.141 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:53:22.141 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:53:22.141 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:53:22.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.141+0000 7fbd2eb05640 1 -- 172.21.15.78:0/921975755 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbd1807af80 msgr2=0x7fbd1807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:22.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.141+0000 7fbd2eb05640 1 --2- 172.21.15.78:0/921975755 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbd1807af80 0x7fbd1807d440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbd14005fd0 tx=0x7fbd14005850 comp rx=0 tx=0).stop 2024-09-18T12:53:22.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.141+0000 7fbd2eb05640 1 -- 172.21.15.78:0/921975755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd28100800 msgr2=0x7fbd28198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:22.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.141+0000 7fbd2eb05640 1 --2- 172.21.15.78:0/921975755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd28100800 0x7fbd28198810 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c031460 tx=0x7fbd1c0045e0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.141+0000 7fbd2eb05640 1 -- 172.21.15.78:0/921975755 shutdown_connections 2024-09-18T12:53:22.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.141+0000 7fbd2eb05640 1 --2- 172.21.15.78:0/921975755 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbd1807af80 0x7fbd1807d440 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.141+0000 7fbd2eb05640 1 --2- 172.21.15.78:0/921975755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd28106800 0x7fbd28198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.141+0000 7fbd2eb05640 1 --2- 172.21.15.78:0/921975755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd28100800 0x7fbd28198810 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.141+0000 7fbd2eb05640 1 -- 172.21.15.78:0/921975755 >> 172.21.15.78:0/921975755 conn(0x7fbd280fc520 msgr2=0x7fbd280fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:22.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.141+0000 7fbd2eb05640 1 -- 172.21.15.78:0/921975755 shutdown_connections 2024-09-18T12:53:22.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.141+0000 7fbd2eb05640 1 -- 172.21.15.78:0/921975755 wait complete. 2024-09-18T12:53:22.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.225+0000 7fe325ba0640 1 -- 172.21.15.78:0/1825825619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe320102b10 msgr2=0x7fe320102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:22.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.225+0000 7fe325ba0640 1 --2- 172.21.15.78:0/1825825619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe320102b10 0x7fe320102ef0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe3100098b0 tx=0x7fe31002a560 comp rx=0 tx=0).stop 2024-09-18T12:53:22.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.226+0000 7fe325ba0640 1 -- 172.21.15.78:0/1825825619 shutdown_connections 2024-09-18T12:53:22.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.226+0000 7fe325ba0640 1 --2- 172.21.15.78:0/1825825619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe320103430 0x7fe32010b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.226+0000 7fe325ba0640 1 --2- 172.21.15.78:0/1825825619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe320102b10 0x7fe320102ef0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.226+0000 7fe325ba0640 1 -- 172.21.15.78:0/1825825619 >> 172.21.15.78:0/1825825619 conn(0x7fe3200fc550 msgr2=0x7fe3200fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:22.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.226+0000 7fe325ba0640 1 -- 172.21.15.78:0/1825825619 shutdown_connections 2024-09-18T12:53:22.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.226+0000 7fe325ba0640 1 -- 172.21.15.78:0/1825825619 wait complete. 2024-09-18T12:53:22.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.226+0000 7fe325ba0640 1 Processor -- start 2024-09-18T12:53:22.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.226+0000 7fe325ba0640 1 -- start start 2024-09-18T12:53:22.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.226+0000 7fe325ba0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe320102b10 0x7fe32019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:22.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.226+0000 7fe325ba0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe320103430 0x7fe32019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:22.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.226+0000 7fe325ba0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe32010ee40 con 0x7fe320103430 2024-09-18T12:53:22.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.226+0000 7fe325ba0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe32010ecc0 con 0x7fe320102b10 2024-09-18T12:53:22.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.227+0000 7fe317fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe320103430 0x7fe32019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:22.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.227+0000 7fe317fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe320103430 0x7fe32019dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36754/0 (socket says 172.21.15.78:36754) 2024-09-18T12:53:22.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.227+0000 7fe317fff640 1 -- 172.21.15.78:0/1680107774 learned_addr learned my addr 172.21.15.78:0/1680107774 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:22.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.227+0000 7fe31f7fe640 1 --2- 172.21.15.78:0/1680107774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe320102b10 0x7fe32019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:22.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.227+0000 7fe317fff640 1 -- 172.21.15.78:0/1680107774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe320102b10 msgr2=0x7fe32019d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:22.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.227+0000 7fe317fff640 1 --2- 172.21.15.78:0/1680107774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe320102b10 0x7fe32019d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.227+0000 7fe317fff640 1 -- 172.21.15.78:0/1680107774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe320197850 con 0x7fe320103430 2024-09-18T12:53:22.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.227+0000 7fe317fff640 1 --2- 172.21.15.78:0/1680107774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe320103430 0x7fe32019dc10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe30800b420 tx=0x7fe30800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:22.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.227+0000 7fe31d7fa640 1 -- 172.21.15.78:0/1680107774 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe308011630 con 0x7fe320103430 2024-09-18T12:53:22.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.227+0000 7fe325ba0640 1 -- 172.21.15.78:0/1680107774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe320197b40 con 0x7fe320103430 2024-09-18T12:53:22.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.227+0000 7fe31d7fa640 1 -- 172.21.15.78:0/1680107774 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe308016070 con 0x7fe320103430 2024-09-18T12:53:22.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.227+0000 7fe31d7fa640 1 -- 172.21.15.78:0/1680107774 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe308010d40 con 0x7fe320103430 2024-09-18T12:53:22.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.227+0000 7fe325ba0640 1 -- 172.21.15.78:0/1680107774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3201980d0 con 0x7fe320103430 2024-09-18T12:53:22.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.228+0000 7fe325ba0640 1 -- 172.21.15.78:0/1680107774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe32006a520 con 0x7fe320103430 2024-09-18T12:53:22.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.229+0000 7fe31d7fa640 1 -- 172.21.15.78:0/1680107774 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe30801b460 con 0x7fe320103430 2024-09-18T12:53:22.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.230+0000 7fe31d7fa640 1 --2- 172.21.15.78:0/1680107774 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe30c07af80 0x7fe30c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:22.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.230+0000 7fe31d7fa640 1 -- 172.21.15.78:0/1680107774 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fe30809d650 con 0x7fe320103430 2024-09-18T12:53:22.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.230+0000 7fe31f7fe640 1 --2- 172.21.15.78:0/1680107774 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe30c07af80 0x7fe30c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:22.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.230+0000 7fe31f7fe640 1 --2- 172.21.15.78:0/1680107774 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe30c07af80 0x7fe30c07d440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe310000c00 tx=0x7fe310031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:22.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.234+0000 7fe31d7fa640 1 -- 172.21.15.78:0/1680107774 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fe308068d20 con 0x7fe320103430 2024-09-18T12:53:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.454+0000 7fe325ba0640 1 -- 172.21.15.78:0/1680107774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe320104f60 con 0x7fe320103430 2024-09-18T12:53:22.456 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:22 smithi078 ceph-mon[28091]: pgmap v91: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:22.456 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:22 smithi078 ceph-mon[28091]: from='client.14944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:22.456 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:22 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:22.456 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:22 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:22.456 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:22 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:22.456 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:22 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/921975755' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:22.456 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:22 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:22.456 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:22 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-18T12:53:22.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.454+0000 7fe31d7fa640 1 -- 172.21.15.78:0/1680107774 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) ==== 76+0+2032 (secure 0 0 0) 0x7fe30806dbd0 con 0x7fe320103430 2024-09-18T12:53:22.457 INFO:teuthology.orchestra.run.smithi078.stdout:e18 2024-09-18T12:53:22.457 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:46:44:251409+0000 2024-09-18T12:53:22.457 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:53:22.457 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:53:22.457 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T12:53:22.457 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:53:22.457 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:53:22.458 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T12:53:22.458 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 18 2024-09-18T12:53:22.458 INFO:teuthology.orchestra.run.smithi078.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:53:22.458 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:53:22.458 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:46:44.251398+0000 2024-09-18T12:53:22.458 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T12:53:22.458 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T12:53:22.458 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T12:53:22.458 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T12:53:22.458 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T12:53:22.458 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T12:53:22.458 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T12:53:22.458 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T12:53:22.458 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 45 2024-09-18T12:53:22.459 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:53:22.459 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T12:53:22.459 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T12:53:22.459 INFO:teuthology.orchestra.run.smithi078.stdout:up {0=14560,1=14574} 2024-09-18T12:53:22.459 INFO:teuthology.orchestra.run.smithi078.stdout:failed 2024-09-18T12:53:22.459 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T12:53:22.459 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T12:53:22.459 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T12:53:22.459 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T12:53:22.459 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T12:53:22.459 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T12:53:22.459 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T12:53:22.459 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T12:53:22.460 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 14560 members: 14560,14574 2024-09-18T12:53:22.460 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{0:14560} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:22.460 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{1:14574} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:22.460 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:53:22.460 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:53:22.460 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T12:53:22.460 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:53:22.460 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:22.460 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/258027429,v1:172.21.15.148:6825/258027429] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 18 2024-09-18T12:53:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.456+0000 7fe325ba0640 1 -- 172.21.15.78:0/1680107774 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe30c07af80 msgr2=0x7fe30c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.456+0000 7fe325ba0640 1 --2- 172.21.15.78:0/1680107774 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe30c07af80 0x7fe30c07d440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe310000c00 tx=0x7fe310031400 comp rx=0 tx=0).stop 2024-09-18T12:53:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.457+0000 7fe325ba0640 1 -- 172.21.15.78:0/1680107774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe320103430 msgr2=0x7fe32019dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.457+0000 7fe325ba0640 1 --2- 172.21.15.78:0/1680107774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe320103430 0x7fe32019dc10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe30800b420 tx=0x7fe30800b8e0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.457+0000 7fe325ba0640 1 -- 172.21.15.78:0/1680107774 shutdown_connections 2024-09-18T12:53:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.457+0000 7fe325ba0640 1 --2- 172.21.15.78:0/1680107774 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe30c07af80 0x7fe30c07d440 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.457+0000 7fe325ba0640 1 --2- 172.21.15.78:0/1680107774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe320103430 0x7fe32019dc10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.457+0000 7fe325ba0640 1 --2- 172.21.15.78:0/1680107774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe320102b10 0x7fe32019d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.457+0000 7fe325ba0640 1 -- 172.21.15.78:0/1680107774 >> 172.21.15.78:0/1680107774 conn(0x7fe3200fc550 msgr2=0x7fe320107e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:22.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.457+0000 7fe325ba0640 1 -- 172.21.15.78:0/1680107774 shutdown_connections 2024-09-18T12:53:22.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.457+0000 7fe325ba0640 1 -- 172.21.15.78:0/1680107774 wait complete. 2024-09-18T12:53:22.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.540+0000 7fc6d959e640 1 -- 172.21.15.78:0/3696894984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d4102ab0 msgr2=0x7fc6d4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:22.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.540+0000 7fc6d959e640 1 --2- 172.21.15.78:0/3696894984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d4102ab0 0x7fc6d4102e90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009880 tx=0x7fc6c402a530 comp rx=0 tx=0).stop 2024-09-18T12:53:22.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.540+0000 7fc6d959e640 1 -- 172.21.15.78:0/3696894984 shutdown_connections 2024-09-18T12:53:22.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.540+0000 7fc6d959e640 1 --2- 172.21.15.78:0/3696894984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6d41033d0 0x7fc6d410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.540+0000 7fc6d959e640 1 --2- 172.21.15.78:0/3696894984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d4102ab0 0x7fc6d4102e90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.540+0000 7fc6d959e640 1 -- 172.21.15.78:0/3696894984 >> 172.21.15.78:0/3696894984 conn(0x7fc6d40fc550 msgr2=0x7fc6d40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:22.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.540+0000 7fc6d959e640 1 -- 172.21.15.78:0/3696894984 shutdown_connections 2024-09-18T12:53:22.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.540+0000 7fc6d959e640 1 -- 172.21.15.78:0/3696894984 wait complete. 2024-09-18T12:53:22.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.541+0000 7fc6d959e640 1 Processor -- start 2024-09-18T12:53:22.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.541+0000 7fc6d959e640 1 -- start start 2024-09-18T12:53:22.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.541+0000 7fc6d959e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d4102ab0 0x7fc6d419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:22.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.541+0000 7fc6d959e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6d41033d0 0x7fc6d419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:22.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.541+0000 7fc6d959e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d410ede0 con 0x7fc6d4102ab0 2024-09-18T12:53:22.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.541+0000 7fc6d959e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d410ec60 con 0x7fc6d41033d0 2024-09-18T12:53:22.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.541+0000 7fc6d2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d4102ab0 0x7fc6d419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:22.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.541+0000 7fc6d2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d4102ab0 0x7fc6d419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36782/0 (socket says 172.21.15.78:36782) 2024-09-18T12:53:22.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.541+0000 7fc6d2ffd640 1 -- 172.21.15.78:0/927674519 learned_addr learned my addr 172.21.15.78:0/927674519 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:22.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.541+0000 7fc6d27fc640 1 --2- 172.21.15.78:0/927674519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6d41033d0 0x7fc6d419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:22.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.542+0000 7fc6d2ffd640 1 -- 172.21.15.78:0/927674519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6d41033d0 msgr2=0x7fc6d419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:22.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.542+0000 7fc6d2ffd640 1 --2- 172.21.15.78:0/927674519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6d41033d0 0x7fc6d419db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.542+0000 7fc6d2ffd640 1 -- 172.21.15.78:0/927674519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d41977b0 con 0x7fc6d4102ab0 2024-09-18T12:53:22.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.542+0000 7fc6d27fc640 1 --2- 172.21.15.78:0/927674519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6d41033d0 0x7fc6d419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:53:22.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.542+0000 7fc6d2ffd640 1 --2- 172.21.15.78:0/927674519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d4102ab0 0x7fc6d419d630 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4031460 tx=0x7fc6c40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:22.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.542+0000 7fc6bbfff640 1 -- 172.21.15.78:0/927674519 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6c403f070 con 0x7fc6d4102ab0 2024-09-18T12:53:22.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.542+0000 7fc6bbfff640 1 -- 172.21.15.78:0/927674519 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc6c40035f0 con 0x7fc6d4102ab0 2024-09-18T12:53:22.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.542+0000 7fc6bbfff640 1 -- 172.21.15.78:0/927674519 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6c4035030 con 0x7fc6d4102ab0 2024-09-18T12:53:22.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.542+0000 7fc6d959e640 1 -- 172.21.15.78:0/927674519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d4197a40 con 0x7fc6d4102ab0 2024-09-18T12:53:22.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.542+0000 7fc6d959e640 1 -- 172.21.15.78:0/927674519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d4197f70 con 0x7fc6d4102ab0 2024-09-18T12:53:22.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.543+0000 7fc6d959e640 1 -- 172.21.15.78:0/927674519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d406a580 con 0x7fc6d4102ab0 2024-09-18T12:53:22.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.544+0000 7fc6bbfff640 1 -- 172.21.15.78:0/927674519 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc6c4042070 con 0x7fc6d4102ab0 2024-09-18T12:53:22.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.544+0000 7fc6bbfff640 1 --2- 172.21.15.78:0/927674519 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc6bc07af30 0x7fc6bc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:22.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.545+0000 7fc6bbfff640 1 -- 172.21.15.78:0/927674519 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fc6c40be9d0 con 0x7fc6d4102ab0 2024-09-18T12:53:22.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.545+0000 7fc6d27fc640 1 --2- 172.21.15.78:0/927674519 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc6bc07af30 0x7fc6bc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:22.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.545+0000 7fc6d27fc640 1 --2- 172.21.15.78:0/927674519 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc6bc07af30 0x7fc6bc07d3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8005fd0 tx=0x7fc6c8005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:22.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.549+0000 7fc6bbfff640 1 -- 172.21.15.78:0/927674519 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fc6c408a020 con 0x7fc6d4102ab0 2024-09-18T12:53:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:22 smithi148 ceph-mon[35352]: pgmap v91: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:22 smithi148 ceph-mon[35352]: from='client.14944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:22 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:22 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:22 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:22 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/921975755' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:22 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:22.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:22 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-18T12:53:22.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.746+0000 7fc6d959e640 1 -- 172.21.15.78:0/927674519 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc6d41982e0 con 0x7fc6bc07af30 2024-09-18T12:53:22.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.747+0000 7fc6bbfff640 1 -- 172.21.15.78:0/927674519 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7fc6d41982e0 con 0x7fc6bc07af30 2024-09-18T12:53:22.748 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:53:22.748 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:53:22.749 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:53:22.749 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:53:22.749 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:53:22.749 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr" 2024-09-18T12:53:22.749 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:53:22.749 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "2/23 daemons upgraded", 2024-09-18T12:53:22.749 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mon daemons", 2024-09-18T12:53:22.749 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:53:22.749 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:53:22.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.749+0000 7fc6d959e640 1 -- 172.21.15.78:0/927674519 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc6bc07af30 msgr2=0x7fc6bc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:22.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.749+0000 7fc6d959e640 1 --2- 172.21.15.78:0/927674519 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc6bc07af30 0x7fc6bc07d3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8005fd0 tx=0x7fc6c8005850 comp rx=0 tx=0).stop 2024-09-18T12:53:22.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.749+0000 7fc6d959e640 1 -- 172.21.15.78:0/927674519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d4102ab0 msgr2=0x7fc6d419d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:22.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.749+0000 7fc6d959e640 1 --2- 172.21.15.78:0/927674519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d4102ab0 0x7fc6d419d630 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4031460 tx=0x7fc6c40045e0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.749+0000 7fc6d959e640 1 -- 172.21.15.78:0/927674519 shutdown_connections 2024-09-18T12:53:22.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.749+0000 7fc6d959e640 1 --2- 172.21.15.78:0/927674519 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc6bc07af30 0x7fc6bc07d3f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.749+0000 7fc6d959e640 1 --2- 172.21.15.78:0/927674519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6d41033d0 0x7fc6d419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.749+0000 7fc6d959e640 1 --2- 172.21.15.78:0/927674519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d4102ab0 0x7fc6d419d630 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.749+0000 7fc6d959e640 1 -- 172.21.15.78:0/927674519 >> 172.21.15.78:0/927674519 conn(0x7fc6d40fc550 msgr2=0x7fc6d410aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:22.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.749+0000 7fc6d959e640 1 -- 172.21.15.78:0/927674519 shutdown_connections 2024-09-18T12:53:22.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.749+0000 7fc6d959e640 1 -- 172.21.15.78:0/927674519 wait complete. 2024-09-18T12:53:22.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.836+0000 7f5ab17ac640 1 -- 172.21.15.78:0/3669645920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aac1033d0 msgr2=0x7f5aac10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:22.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.836+0000 7f5ab17ac640 1 --2- 172.21.15.78:0/3669645920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aac1033d0 0x7f5aac10b8c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009880 tx=0x7f5aa002a530 comp rx=0 tx=0).stop 2024-09-18T12:53:22.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.836+0000 7f5ab17ac640 1 -- 172.21.15.78:0/3669645920 shutdown_connections 2024-09-18T12:53:22.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.836+0000 7f5ab17ac640 1 --2- 172.21.15.78:0/3669645920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aac1033d0 0x7f5aac10b8c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.836+0000 7f5ab17ac640 1 --2- 172.21.15.78:0/3669645920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5aac102ab0 0x7f5aac102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.836+0000 7f5ab17ac640 1 -- 172.21.15.78:0/3669645920 >> 172.21.15.78:0/3669645920 conn(0x7f5aac0fc550 msgr2=0x7f5aac0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:22.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.836+0000 7f5ab17ac640 1 -- 172.21.15.78:0/3669645920 shutdown_connections 2024-09-18T12:53:22.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.836+0000 7f5ab17ac640 1 -- 172.21.15.78:0/3669645920 wait complete. 2024-09-18T12:53:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.837+0000 7f5ab17ac640 1 Processor -- start 2024-09-18T12:53:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.837+0000 7f5ab17ac640 1 -- start start 2024-09-18T12:53:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.837+0000 7f5ab17ac640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5aac102ab0 0x7f5aac19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.837+0000 7f5ab17ac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aac1033d0 0x7f5aac19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.837+0000 7f5ab17ac640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac10ede0 con 0x7f5aac1033d0 2024-09-18T12:53:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.837+0000 7f5ab17ac640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac10ec60 con 0x7f5aac102ab0 2024-09-18T12:53:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.837+0000 7f5aaa7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aac1033d0 0x7f5aac19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.837+0000 7f5aaa7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aac1033d0 0x7f5aac19dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36794/0 (socket says 172.21.15.78:36794) 2024-09-18T12:53:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.838+0000 7f5aaa7fc640 1 -- 172.21.15.78:0/1895443630 learned_addr learned my addr 172.21.15.78:0/1895443630 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.838+0000 7f5aaaffd640 1 --2- 172.21.15.78:0/1895443630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5aac102ab0 0x7f5aac19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.838+0000 7f5aaa7fc640 1 -- 172.21.15.78:0/1895443630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5aac102ab0 msgr2=0x7f5aac19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.838+0000 7f5aaa7fc640 1 --2- 172.21.15.78:0/1895443630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5aac102ab0 0x7f5aac19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:22.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.838+0000 7f5aaa7fc640 1 -- 172.21.15.78:0/1895443630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aac197810 con 0x7f5aac1033d0 2024-09-18T12:53:22.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.838+0000 7f5aaa7fc640 1 --2- 172.21.15.78:0/1895443630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aac1033d0 0x7f5aac19dbd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0031460 tx=0x7f5aa0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:22.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.838+0000 7f5a93fff640 1 -- 172.21.15.78:0/1895443630 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5aa003f070 con 0x7f5aac1033d0 2024-09-18T12:53:22.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.838+0000 7f5a93fff640 1 -- 172.21.15.78:0/1895443630 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5aa00035f0 con 0x7f5aac1033d0 2024-09-18T12:53:22.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.838+0000 7f5ab17ac640 1 -- 172.21.15.78:0/1895443630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aac197aa0 con 0x7f5aac1033d0 2024-09-18T12:53:22.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.838+0000 7f5a93fff640 1 -- 172.21.15.78:0/1895443630 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5aa0035030 con 0x7f5aac1033d0 2024-09-18T12:53:22.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.838+0000 7f5ab17ac640 1 -- 172.21.15.78:0/1895443630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aac197fd0 con 0x7f5aac1033d0 2024-09-18T12:53:22.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.839+0000 7f5ab17ac640 1 -- 172.21.15.78:0/1895443630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aac06a580 con 0x7f5aac1033d0 2024-09-18T12:53:22.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.840+0000 7f5a93fff640 1 -- 172.21.15.78:0/1895443630 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5aa0042070 con 0x7f5aac1033d0 2024-09-18T12:53:22.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.841+0000 7f5a93fff640 1 --2- 172.21.15.78:0/1895443630 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5a9407af30 0x7f5a9407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:22.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.841+0000 7f5a93fff640 1 -- 172.21.15.78:0/1895443630 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f5aa00be950 con 0x7f5aac1033d0 2024-09-18T12:53:22.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.841+0000 7f5aaaffd640 1 --2- 172.21.15.78:0/1895443630 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5a9407af30 0x7f5a9407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:22.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.842+0000 7f5aaaffd640 1 --2- 172.21.15.78:0/1895443630 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5a9407af30 0x7f5a9407d3f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c005fd0 tx=0x7f5a9c00b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:22.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:22.845+0000 7f5a93fff640 1 -- 172.21.15.78:0/1895443630 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f5aa0089f00 con 0x7f5aac1033d0 2024-09-18T12:53:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:23.096+0000 7f5ab17ac640 1 -- 172.21.15.78:0/1895443630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f5aac105f50 con 0x7f5aac1033d0 2024-09-18T12:53:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:23.096+0000 7f5a93fff640 1 -- 172.21.15.78:0/1895443630 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f5aa008edb0 con 0x7f5aac1033d0 2024-09-18T12:53:23.097 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:53:23.098 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:53:23.098 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:53:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:23.098+0000 7f5ab17ac640 1 -- 172.21.15.78:0/1895443630 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5a9407af30 msgr2=0x7f5a9407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:23.098+0000 7f5ab17ac640 1 --2- 172.21.15.78:0/1895443630 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5a9407af30 0x7f5a9407d3f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c005fd0 tx=0x7f5a9c00b390 comp rx=0 tx=0).stop 2024-09-18T12:53:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:23.098+0000 7f5ab17ac640 1 -- 172.21.15.78:0/1895443630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aac1033d0 msgr2=0x7f5aac19dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:23.098+0000 7f5ab17ac640 1 --2- 172.21.15.78:0/1895443630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aac1033d0 0x7f5aac19dbd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0031460 tx=0x7f5aa0004530 comp rx=0 tx=0).stop 2024-09-18T12:53:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:23.098+0000 7f5ab17ac640 1 -- 172.21.15.78:0/1895443630 shutdown_connections 2024-09-18T12:53:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:23.098+0000 7f5ab17ac640 1 --2- 172.21.15.78:0/1895443630 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5a9407af30 0x7f5a9407d3f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:23.098+0000 7f5ab17ac640 1 --2- 172.21.15.78:0/1895443630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aac1033d0 0x7f5aac19dbd0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:23.098+0000 7f5ab17ac640 1 --2- 172.21.15.78:0/1895443630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5aac102ab0 0x7f5aac19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:23.098+0000 7f5ab17ac640 1 -- 172.21.15.78:0/1895443630 >> 172.21.15.78:0/1895443630 conn(0x7f5aac0fc550 msgr2=0x7f5aac108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:23.098+0000 7f5ab17ac640 1 -- 172.21.15.78:0/1895443630 shutdown_connections 2024-09-18T12:53:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:23.098+0000 7f5ab17ac640 1 -- 172.21.15.78:0/1895443630 wait complete. 2024-09-18T12:53:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:23 smithi078 ceph-mon[28091]: from='client.14948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:23 smithi078 ceph-mon[28091]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:23 smithi078 ceph-mon[28091]: Upgrade: Target is version 19.3.0-4983-ge7fb7b56 (squid) 2024-09-18T12:53:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:23 smithi078 ceph-mon[28091]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9'] 2024-09-18T12:53:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:23 smithi078 ceph-mon[28091]: Upgrade: Setting container_image for all mgr 2024-09-18T12:53:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:23 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1680107774' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:53:23.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:23 smithi078 ceph-mon[28091]: from='client.? 172.21.15.78:0/1895443630' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:53:23.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:23 smithi148 ceph-mon[35352]: from='client.14948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:23.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:23 smithi148 ceph-mon[35352]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:23.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:23 smithi148 ceph-mon[35352]: Upgrade: Target is version 19.3.0-4983-ge7fb7b56 (squid) 2024-09-18T12:53:23.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:23 smithi148 ceph-mon[35352]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9'] 2024-09-18T12:53:23.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:23 smithi148 ceph-mon[35352]: Upgrade: Setting container_image for all mgr 2024-09-18T12:53:23.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:23 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1680107774' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:53:23.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:23 smithi148 ceph-mon[35352]: from='client.? 172.21.15.78:0/1895443630' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:53:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:24 smithi078 ceph-mon[28091]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:24 smithi078 ceph-mon[28091]: pgmap v92: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:24 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:24 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:53:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:24 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:53:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:24 smithi078 ceph-mon[28091]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:24 smithi148 ceph-mon[35352]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:24 smithi148 ceph-mon[35352]: pgmap v92: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:24 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:24 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:53:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:24 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:53:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:24 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:25.317 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:25 smithi078 systemd[1]: Stopping Ceph mon.smithi078 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:53:25.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:25 smithi148 ceph-mon[35352]: Upgrade: Updating mon.smithi078 2024-09-18T12:53:25.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:25 smithi148 ceph-mon[35352]: Deploying daemon mon.smithi078 on smithi078 2024-09-18T12:53:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:25 smithi078 ceph-mon[28091]: Upgrade: Updating mon.smithi078 2024-09-18T12:53:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:25 smithi078 ceph-mon[28091]: Deploying daemon mon.smithi078 on smithi078 2024-09-18T12:53:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:25 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[28087]: 2024-09-18T12:53:25.397+0000 7f604de26640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi078 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:53:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:25 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[28087]: 2024-09-18T12:53:25.397+0000 7f604de26640 -1 mon.smithi078@0(leader) e2 *** Got Signal Terminated *** 2024-09-18T12:53:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:25 smithi078 podman[108408]: 2024-09-18 12:53:25.469211368 +0000 UTC m=+0.202590289 container died 1cb11a5bcd725f0f0767432d3bfc584b2d656bbe53fa4fb8ff901b4107d96839 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:53:26.099 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:25 smithi078 podman[108408]: 2024-09-18 12:53:25.864137272 +0000 UTC m=+0.597516191 container cleanup 1cb11a5bcd725f0f0767432d3bfc584b2d656bbe53fa4fb8ff901b4107d96839 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-18T12:53:26.100 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:25 smithi078 bash[108408]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078 2024-09-18T12:53:26.447 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 podman[108420]: 2024-09-18 12:53:26.099067743 +0000 UTC m=+0.624274864 container remove 1cb11a5bcd725f0f0767432d3bfc584b2d656bbe53fa4fb8ff901b4107d96839 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-18T12:53:26.447 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mon.smithi078.service: Deactivated successfully. 2024-09-18T12:53:26.447 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 systemd[1]: Stopped Ceph mon.smithi078 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:53:26.447 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mon.smithi078.service: Consumed 13.241s CPU time. 2024-09-18T12:53:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 systemd[1]: Starting Ceph mon.smithi078 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:53:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 podman[108559]: 2024-09-18 12:53:26.558490279 +0000 UTC m=+0.015866097 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:53:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 podman[108559]: 2024-09-18 12:53:26.666609078 +0000 UTC m=+0.123984896 container create f62f02a2a5d3c196acce83f9282a397e2877ffe16887f6ac6a24dbae5985f366 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-18T12:53:27.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 podman[108559]: 2024-09-18 12:53:26.928412312 +0000 UTC m=+0.385788134 container init f62f02a2a5d3c196acce83f9282a397e2877ffe16887f6ac6a24dbae5985f366 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux ) 2024-09-18T12:53:27.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 podman[108559]: 2024-09-18 12:53:26.931795673 +0000 UTC m=+0.389171498 container start f62f02a2a5d3c196acce83f9282a397e2877ffe16887f6ac6a24dbae5985f366 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:53:27.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: set uid:gid to 167:167 (ceph:ceph) 2024-09-18T12:53:27.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev), process ceph-mon, pid 2 2024-09-18T12:53:27.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: pidfile_write: ignore empty --pid-file 2024-09-18T12:53:27.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: load: jerasure load: lrc 2024-09-18T12:53:27.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: RocksDB version: 7.9.2 2024-09-18T12:53:27.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Git sha 0 2024-09-18T12:53:27.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Compile date 2024-09-17 15:59:30 2024-09-18T12:53:27.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: DB SUMMARY 2024-09-18T12:53:27.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: DB Session ID: 7SWZUY4LH3HU4I0LGVXL 2024-09-18T12:53:27.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: CURRENT file: CURRENT 2024-09-18T12:53:27.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: IDENTITY file: IDENTITY 2024-09-18T12:53:27.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1500 Bytes 2024-09-18T12:53:27.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi078/store.db dir, Total Num: 1, files: 000032.sst 2024-09-18T12:53:27.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi078/store.db: 000030.log size: 2887645 ; 2024-09-18T12:53:27.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.error_if_exists: 0 2024-09-18T12:53:27.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.create_if_missing: 0 2024-09-18T12:53:27.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.paranoid_checks: 1 2024-09-18T12:53:27.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-18T12:53:27.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-18T12:53:27.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-18T12:53:27.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.env: 0x55d0dbb62120 2024-09-18T12:53:27.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.fs: PosixFileSystem 2024-09-18T12:53:27.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.info_log: 0x55d0dc8f98e0 2024-09-18T12:53:27.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_file_opening_threads: 16 2024-09-18T12:53:27.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.statistics: (nil) 2024-09-18T12:53:27.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.use_fsync: 0 2024-09-18T12:53:27.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_log_file_size: 0 2024-09-18T12:53:27.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-18T12:53:27.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-18T12:53:27.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.keep_log_file_num: 1000 2024-09-18T12:53:27.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.recycle_log_file_num: 0 2024-09-18T12:53:27.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.allow_fallocate: 1 2024-09-18T12:53:27.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.allow_mmap_reads: 0 2024-09-18T12:53:27.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.allow_mmap_writes: 0 2024-09-18T12:53:27.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.use_direct_reads: 0 2024-09-18T12:53:27.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-18T12:53:27.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.create_missing_column_families: 0 2024-09-18T12:53:27.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.db_log_dir: 2024-09-18T12:53:27.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.wal_dir: 2024-09-18T12:53:27.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-18T12:53:27.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-18T12:53:27.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-18T12:53:27.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-18T12:53:27.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-18T12:53:27.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-18T12:53:27.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.advise_random_on_open: 1 2024-09-18T12:53:27.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.db_write_buffer_size: 0 2024-09-18T12:53:27.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.write_buffer_manager: 0x55d0dc8fdb80 2024-09-18T12:53:27.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-18T12:53:27.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-18T12:53:27.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-18T12:53:27.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.rate_limiter: (nil) 2024-09-18T12:53:27.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-18T12:53:27.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.wal_recovery_mode: 2 2024-09-18T12:53:27.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.enable_thread_tracking: 0 2024-09-18T12:53:27.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.enable_pipelined_write: 0 2024-09-18T12:53:27.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.unordered_write: 0 2024-09-18T12:53:27.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-18T12:53:27.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-18T12:53:27.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-18T12:53:27.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-18T12:53:27.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.row_cache: None 2024-09-18T12:53:27.250 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.wal_filter: None 2024-09-18T12:53:27.250 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-18T12:53:27.250 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.allow_ingest_behind: 0 2024-09-18T12:53:27.250 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.two_write_queues: 0 2024-09-18T12:53:27.250 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.manual_wal_flush: 0 2024-09-18T12:53:27.250 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.wal_compression: 0 2024-09-18T12:53:27.250 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.atomic_flush: 0 2024-09-18T12:53:27.250 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-18T12:53:27.250 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-18T12:53:27.251 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-18T12:53:27.251 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.log_readahead_size: 0 2024-09-18T12:53:27.251 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-18T12:53:27.251 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.best_efforts_recovery: 0 2024-09-18T12:53:27.251 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-18T12:53:27.251 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-18T12:53:27.251 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.allow_data_in_errors: 0 2024-09-18T12:53:27.251 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.db_host_id: __hostname__ 2024-09-18T12:53:27.251 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-18T12:53:27.251 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_background_jobs: 2 2024-09-18T12:53:27.251 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_background_compactions: -1 2024-09-18T12:53:27.252 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_subcompactions: 1 2024-09-18T12:53:27.252 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-18T12:53:27.252 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-18T12:53:27.252 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-18T12:53:27.252 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_total_wal_size: 0 2024-09-18T12:53:27.252 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-18T12:53:27.252 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-18T12:53:27.252 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-18T12:53:27.252 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-18T12:53:27.252 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_open_files: -1 2024-09-18T12:53:27.252 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.bytes_per_sync: 0 2024-09-18T12:53:27.253 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-18T12:53:27.253 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-18T12:53:27.253 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compaction_readahead_size: 0 2024-09-18T12:53:27.253 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_background_flushes: -1 2024-09-18T12:53:27.253 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Compression algorithms supported: 2024-09-18T12:53:27.253 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: kZSTD supported: 0 2024-09-18T12:53:27.253 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: kXpressCompression supported: 0 2024-09-18T12:53:27.253 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: kBZip2Compression supported: 0 2024-09-18T12:53:27.253 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-18T12:53:27.253 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: kLZ4Compression supported: 1 2024-09-18T12:53:27.253 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: kZlibCompression supported: 1 2024-09-18T12:53:27.254 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: kLZ4HCCompression supported: 1 2024-09-18T12:53:27.254 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: kSnappyCompression supported: 1 2024-09-18T12:53:27.254 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-18T12:53:27.254 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-18T12:53:27.254 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi078/store.db/MANIFEST-000015 2024-09-18T12:53:27.254 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-18T12:53:27.254 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-18T12:53:27.254 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.merge_operator: 2024-09-18T12:53:27.254 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compaction_filter: None 2024-09-18T12:53:27.254 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compaction_filter_factory: None 2024-09-18T12:53:27.254 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.sst_partitioner_factory: None 2024-09-18T12:53:27.254 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-18T12:53:27.255 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-18T12:53:27.255 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d0dc8f9540) 2024-09-18T12:53:27.255 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: cache_index_and_filter_blocks: 1 2024-09-18T12:53:27.255 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-18T12:53:27.255 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-18T12:53:27.255 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: pin_top_level_index_and_filter: 1 2024-09-18T12:53:27.255 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: index_type: 0 2024-09-18T12:53:27.255 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: data_block_index_type: 0 2024-09-18T12:53:27.255 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: index_shortening: 1 2024-09-18T12:53:27.255 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-18T12:53:27.255 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: checksum: 4 2024-09-18T12:53:27.255 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: no_block_cache: 0 2024-09-18T12:53:27.256 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_cache: 0x55d0dc8ed610 2024-09-18T12:53:27.256 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_cache_name: BinnedLRUCache 2024-09-18T12:53:27.256 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_cache_options: 2024-09-18T12:53:27.256 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: capacity : 536870912 2024-09-18T12:53:27.256 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: num_shard_bits : 4 2024-09-18T12:53:27.256 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: strict_capacity_limit : 0 2024-09-18T12:53:27.256 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: high_pri_pool_ratio: 0.000 2024-09-18T12:53:27.256 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_cache_compressed: (nil) 2024-09-18T12:53:27.256 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: persistent_cache: (nil) 2024-09-18T12:53:27.256 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_size: 4096 2024-09-18T12:53:27.256 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_size_deviation: 10 2024-09-18T12:53:27.257 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_restart_interval: 16 2024-09-18T12:53:27.257 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: index_block_restart_interval: 1 2024-09-18T12:53:27.257 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: metadata_block_size: 4096 2024-09-18T12:53:27.257 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: partition_filters: 0 2024-09-18T12:53:27.257 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: use_delta_encoding: 1 2024-09-18T12:53:27.257 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: filter_policy: bloomfilter 2024-09-18T12:53:27.257 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: whole_key_filtering: 1 2024-09-18T12:53:27.257 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: verify_compression: 0 2024-09-18T12:53:27.257 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: read_amp_bytes_per_bit: 0 2024-09-18T12:53:27.257 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: format_version: 5 2024-09-18T12:53:27.257 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: enable_index_compression: 1 2024-09-18T12:53:27.257 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: block_align: 0 2024-09-18T12:53:27.258 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: max_auto_readahead_size: 262144 2024-09-18T12:53:27.258 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: prepopulate_block_cache: 0 2024-09-18T12:53:27.258 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: initial_auto_readahead_size: 8192 2024-09-18T12:53:27.258 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: num_file_reads_for_auto_readahead: 2 2024-09-18T12:53:27.258 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.write_buffer_size: 33554432 2024-09-18T12:53:27.258 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_write_buffer_number: 2 2024-09-18T12:53:27.258 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compression: NoCompression 2024-09-18T12:53:27.258 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.bottommost_compression: Disabled 2024-09-18T12:53:27.258 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.prefix_extractor: nullptr 2024-09-18T12:53:27.258 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-18T12:53:27.258 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.num_levels: 7 2024-09-18T12:53:27.259 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-18T12:53:27.259 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-18T12:53:27.259 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-18T12:53:27.259 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-18T12:53:27.259 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-18T12:53:27.259 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-18T12:53:27.259 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-18T12:53:27.259 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:53:27.259 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-18T12:53:27.259 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-18T12:53:27.259 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:53:27.260 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:53:27.260 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-18T12:53:27.260 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compression_opts.level: 32767 2024-09-18T12:53:27.260 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compression_opts.strategy: 0 2024-09-18T12:53:27.260 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-18T12:53:27.260 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:53:27.260 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:53:27.260 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-18T12:53:27.260 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compression_opts.enabled: false 2024-09-18T12:53:27.260 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:53:27.260 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-18T12:53:27.261 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-18T12:53:27.261 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-18T12:53:27.261 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.target_file_size_base: 67108864 2024-09-18T12:53:27.261 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-18T12:53:27.261 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-18T12:53:27.261 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-18T12:53:27.261 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-18T12:53:27.261 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-18T12:53:27.261 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-18T12:53:27.261 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-18T12:53:27.261 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-18T12:53:27.262 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-18T12:53:27.262 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-18T12:53:27.262 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-18T12:53:27.262 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-18T12:53:27.262 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-18T12:53:27.262 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-18T12:53:27.262 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.arena_block_size: 1048576 2024-09-18T12:53:27.262 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-18T12:53:27.262 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-18T12:53:27.262 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.disable_auto_compactions: 0 2024-09-18T12:53:27.262 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-18T12:53:27.262 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-18T12:53:27.263 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-18T12:53:27.263 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-18T12:53:27.263 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-18T12:53:27.263 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-18T12:53:27.263 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-18T12:53:27.263 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-18T12:53:27.263 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-18T12:53:27.263 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-18T12:53:27.263 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-18T12:53:27.263 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.inplace_update_support: 0 2024-09-18T12:53:27.263 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-18T12:53:27.263 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-18T12:53:27.264 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-18T12:53:27.264 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-18T12:53:27.264 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.bloom_locality: 0 2024-09-18T12:53:27.264 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.max_successive_merges: 0 2024-09-18T12:53:27.264 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-18T12:53:27.264 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.paranoid_file_checks: 0 2024-09-18T12:53:27.264 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.force_consistency_checks: 1 2024-09-18T12:53:27.264 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.report_bg_io_stats: 0 2024-09-18T12:53:27.264 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.ttl: 2592000 2024-09-18T12:53:27.264 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-18T12:53:27.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-18T12:53:27.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-18T12:53:27.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.enable_blob_files: false 2024-09-18T12:53:27.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.min_blob_size: 0 2024-09-18T12:53:27.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.blob_file_size: 268435456 2024-09-18T12:53:27.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-18T12:53:27.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-18T12:53:27.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-18T12:53:27.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-18T12:53:27.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-18T12:53:27.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.blob_file_starting_level: 0 2024-09-18T12:53:27.266 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-18T12:53:27.266 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T12:53:27.266 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi078/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 11980, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-18T12:53:27.266 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-18T12:53:27.266 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b8a53094-9598-4ef2-9e01-70291381e1d7 2024-09-18T12:53:27.266 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664006958539, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-18T12:53:27.266 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-18T12:53:27.266 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664006966822, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 2539042, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11981, "largest_seqno": 13981, "table_properties": {"data_size": 2529864, "index_size": 5892, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2245, "raw_key_size": 21176, "raw_average_key_size": 23, "raw_value_size": 2510724, "raw_average_value_size": 2817, "num_data_blocks": 268, "num_entries": 891, "num_filter_entries": 891, "num_deletions": 8, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726664006, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b8a53094-9598-4ef2-9e01-70291381e1d7", "db_session_id": "7SWZUY4LH3HU4I0LGVXL", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-18T12:53:27.266 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664006966966, "job": 1, "event": "recovery_finished"} 2024-09-18T12:53:27.266 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-18T12:53:27.266 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T12:53:27.267 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi078/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-18T12:53:27.267 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d0dc91ce00 2024-09-18T12:53:27.267 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: DB pointer 0x55d0dca1e000 2024-09-18T12:53:27.267 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-18T12:53:27.267 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-18T12:53:27.267 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: ** DB Stats ** 2024-09-18T12:53:27.267 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:53:27.267 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-18T12:53:27.267 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:53:27.267 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:53:27.267 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-18T12:53:27.267 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:53:27.268 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:53:27.268 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: 2024-09-18T12:53:27.268 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: ** Compaction Stats [default] ** 2024-09-18T12:53:27.268 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:53:27.268 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-18T12:53:27.268 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: L0 1/0 2.42 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 623.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:53:27.268 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: L6 1/0 7.05 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-18T12:53:27.268 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Sum 2/0 9.47 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 623.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:53:27.268 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 623.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:53:27.268 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: 2024-09-18T12:53:27.268 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: ** Compaction Stats [default] ** 2024-09-18T12:53:27.268 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:53:27.269 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T12:53:27.269 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 623.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:53:27.269 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: 2024-09-18T12:53:27.269 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-18T12:53:27.269 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: 2024-09-18T12:53:27.269 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:53:27.269 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-18T12:53:27.269 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-18T12:53:27.269 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-18T12:53:27.269 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-18T12:53:27.270 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-18T12:53:27.270 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Cumulative compaction: 0.00 GB write, 224.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:53:27.270 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Interval compaction: 0.00 GB write, 224.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:53:27.270 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-18T12:53:27.270 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Block cache BinnedLRUCache@0x55d0dc8ed610#2 capacity: 512.00 MB usage: 8.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-18T12:53:27.270 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-09-18T12:53:27.270 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: 2024-09-18T12:53:27.270 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-18T12:53:27.270 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: starting mon.smithi078 rank 0 at public addrs [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] at bind addrs [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi078 fsid ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:53:27.270 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: mon.smithi078@-1(???) e2 preinit fsid ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:53:27.270 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: mon.smithi078@-1(???).mds e18 new map 2024-09-18T12:53:27.270 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: mon.smithi078@-1(???).mds e18 print_map 2024-09-18T12:53:27.271 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: e18 2024-09-18T12:53:27.271 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: btime 2024-09-18T12:46:44:251409+0000 2024-09-18T12:53:27.271 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:53:27.271 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:53:27.271 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: legacy client fscid: 1 2024-09-18T12:53:27.271 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: 2024-09-18T12:53:27.271 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Filesystem 'cephfs' (1) 2024-09-18T12:53:27.271 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: fs_name cephfs 2024-09-18T12:53:27.271 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: epoch 18 2024-09-18T12:53:27.271 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:53:27.271 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:53:27.272 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: modified 2024-09-18T12:46:44.251398+0000 2024-09-18T12:53:27.272 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: tableserver 0 2024-09-18T12:53:27.272 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: root 0 2024-09-18T12:53:27.272 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: session_timeout 60 2024-09-18T12:53:27.272 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: session_autoclose 300 2024-09-18T12:53:27.272 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: max_file_size 1099511627776 2024-09-18T12:53:27.272 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: max_xattr_size 65536 2024-09-18T12:53:27.272 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: required_client_features {} 2024-09-18T12:53:27.272 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: last_failure 0 2024-09-18T12:53:27.272 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: last_failure_osd_epoch 45 2024-09-18T12:53:27.272 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:53:27.273 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: max_mds 2 2024-09-18T12:53:27.273 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: in 0,1 2024-09-18T12:53:27.273 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: up {0=14560,1=14574} 2024-09-18T12:53:27.273 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: failed 2024-09-18T12:53:27.273 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: damaged 2024-09-18T12:53:27.273 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: stopped 2024-09-18T12:53:27.273 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: data_pools [3] 2024-09-18T12:53:27.273 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: metadata_pool 2 2024-09-18T12:53:27.273 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: inline_data enabled 2024-09-18T12:53:27.273 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: balancer 2024-09-18T12:53:27.273 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: bal_rank_mask -1 2024-09-18T12:53:27.274 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: standby_count_wanted 1 2024-09-18T12:53:27.274 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: qdb_cluster leader: 14560 members: 14560,14574 2024-09-18T12:53:27.274 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: [mds.cephfs.smithi078.eakgoe{0:14560} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:27.274 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: [mds.cephfs.smithi078.furyab{1:14574} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:27.274 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: 2024-09-18T12:53:27.274 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: 2024-09-18T12:53:27.274 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: Standby daemons: 2024-09-18T12:53:27.274 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: 2024-09-18T12:53:27.274 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: [mds.cephfs.smithi148.tvvouo{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:27.274 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout: [mds.cephfs.smithi148.fqecmm{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/258027429,v1:172.21.15.148:6825/258027429] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:27.274 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: mon.smithi078@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-18T12:53:27.274 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: mon.smithi078@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:53:27.275 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: mon.smithi078@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:53:27.275 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: mon.smithi078@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:53:27.275 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:26 smithi078 ceph-mon[108578]: mon.smithi078@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-18T12:53:27.275 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:27 smithi078 bash[108559]: f62f02a2a5d3c196acce83f9282a397e2877ffe16887f6ac6a24dbae5985f366 2024-09-18T12:53:27.275 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:27 smithi078 systemd[1]: Started Ceph mon.smithi078 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:53:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:53:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:53:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: pgmap v94: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: pgmap v95: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: mon.smithi078 calling monitor election 2024-09-18T12:53:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: mon.smithi078 is new leader, mons smithi078,smithi148 in quorum (ranks 0,1) 2024-09-18T12:53:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: monmap epoch 2 2024-09-18T12:53:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: fsid ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:53:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: last_changed 2024-09-18T12:42:05.559042+0000 2024-09-18T12:53:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: created 2024-09-18T12:39:37.203660+0000 2024-09-18T12:53:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: min_mon_release 19 (squid) 2024-09-18T12:53:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: election_strategy: 1 2024-09-18T12:53:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.smithi078 2024-09-18T12:53:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.smithi148 2024-09-18T12:53:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:active} 2 up:standby 2024-09-18T12:53:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: osdmap e47: 6 total, 6 up, 6 in 2024-09-18T12:53:30.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: mgrmap e34: smithi078.ohifux(active, since 3m), standbys: smithi148.bfgshs 2024-09-18T12:53:30.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:53:30.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:53:30.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:53:30.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: from='mgr.14770 ' entity='' 2024-09-18T12:53:30.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:30.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:30 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:30.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi078"}]: dispatch 2024-09-18T12:53:30.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-09-18T12:53:30.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:30.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:30.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:30.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: pgmap v94: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:30.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: pgmap v95: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:30.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: mon.smithi078 calling monitor election 2024-09-18T12:53:30.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: mon.smithi078 is new leader, mons smithi078,smithi148 in quorum (ranks 0,1) 2024-09-18T12:53:30.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: monmap epoch 2 2024-09-18T12:53:30.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: fsid ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:53:30.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: last_changed 2024-09-18T12:42:05.559042+0000 2024-09-18T12:53:30.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: created 2024-09-18T12:39:37.203660+0000 2024-09-18T12:53:30.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: min_mon_release 19 (squid) 2024-09-18T12:53:30.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: election_strategy: 1 2024-09-18T12:53:30.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.smithi078 2024-09-18T12:53:30.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.smithi148 2024-09-18T12:53:30.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:active} 2 up:standby 2024-09-18T12:53:30.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: osdmap e47: 6 total, 6 up, 6 in 2024-09-18T12:53:30.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: mgrmap e34: smithi078.ohifux(active, since 3m), standbys: smithi148.bfgshs 2024-09-18T12:53:30.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:53:30.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:53:30.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:53:30.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: from='mgr.14770 ' entity='' 2024-09-18T12:53:30.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:30.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:30 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:32.229 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:32 smithi078 ceph-mon[108578]: pgmap v96: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:32 smithi148 ceph-mon[35352]: pgmap v96: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:34.426 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:34 smithi078 ceph-mon[108578]: pgmap v97: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:34.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:34 smithi148 ceph-mon[35352]: pgmap v97: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:36.379 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:36 smithi078 ceph-mon[108578]: pgmap v98: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:36.379 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:36 smithi078 ceph-mon[108578]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:36.379 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:36 smithi078 ceph-mon[108578]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:36.379 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:36 smithi078 ceph-mon[108578]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:36.379 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:36 smithi078 ceph-mon[108578]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:36 smithi148 ceph-mon[35352]: pgmap v98: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:36 smithi148 ceph-mon[35352]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:36 smithi148 ceph-mon[35352]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:36 smithi148 ceph-mon[35352]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:36 smithi148 ceph-mon[35352]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:38.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:38 smithi148 ceph-mon[35352]: pgmap v99: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:38.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:38 smithi078 ceph-mon[108578]: pgmap v99: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:39.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:39 smithi078 ceph-mon[108578]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:39.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:39 smithi078 ceph-mon[108578]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:39.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:39 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:39 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:53:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:39 smithi078 ceph-mon[108578]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:39 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:39 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:39 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-18T12:53:39.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:39 smithi078 ceph-mon[108578]: pgmap v100: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:40.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:39 smithi148 ceph-mon[35352]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:40.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:39 smithi148 ceph-mon[35352]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:40.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:39 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:40.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:39 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:53:40.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:39 smithi148 ceph-mon[35352]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:40.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:39 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:40.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:39 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:40.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:39 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-18T12:53:40.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:39 smithi148 ceph-mon[35352]: pgmap v100: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:41.650 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:41 smithi148 ceph-mon[35352]: Upgrade: Updating mon.smithi148 2024-09-18T12:53:41.650 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:41 smithi148 ceph-mon[35352]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:41.650 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:41 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:53:41.650 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:41 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:53:41.650 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:41 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:41.650 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:41 smithi148 ceph-mon[35352]: Deploying daemon mon.smithi148 on smithi148 2024-09-18T12:53:41.650 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:41 smithi148 ceph-mon[35352]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:41.650 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:41 smithi148 ceph-mon[35352]: pgmap v101: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:41 smithi078 ceph-mon[108578]: Upgrade: Updating mon.smithi148 2024-09-18T12:53:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:41 smithi078 ceph-mon[108578]: from='mgr.14770 ' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:53:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:53:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:41.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:41 smithi078 ceph-mon[108578]: Deploying daemon mon.smithi148 on smithi148 2024-09-18T12:53:41.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:41.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:41 smithi078 ceph-mon[108578]: pgmap v101: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:42.156 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:41 smithi148 systemd[1]: Stopping Ceph mon.smithi148 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:53:42.156 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:42 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi148[35345]: 2024-09-18T12:53:42.152+0000 7f0f5e31c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi148 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:53:42.156 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:42 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi148[35345]: 2024-09-18T12:53:42.152+0000 7f0f5e31c640 -1 mon.smithi148@1(peon) e2 *** Got Signal Terminated *** 2024-09-18T12:53:42.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:42 smithi148 podman[79870]: 2024-09-18 12:53:42.174247483 +0000 UTC m=+0.124666223 container died 02dfe15512266bed1dab054016e2f63c8fa51b110a194a210ed78c344de1f675 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi148, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97) 2024-09-18T12:53:42.805 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:42 smithi148 podman[79870]: 2024-09-18 12:53:42.595024923 +0000 UTC m=+0.545443660 container cleanup 02dfe15512266bed1dab054016e2f63c8fa51b110a194a210ed78c344de1f675 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi148, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:53:42.805 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:42 smithi148 bash[79870]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi148 2024-09-18T12:53:43.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:42 smithi148 podman[79881]: 2024-09-18 12:53:42.80447823 +0000 UTC m=+0.623683365 container remove 02dfe15512266bed1dab054016e2f63c8fa51b110a194a210ed78c344de1f675 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi148, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-18T12:53:43.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mon.smithi148.service: Deactivated successfully. 2024-09-18T12:53:43.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 systemd[1]: Stopped Ceph mon.smithi148 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:53:43.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mon.smithi148.service: Consumed 7.197s CPU time. 2024-09-18T12:53:43.544 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 systemd[1]: Starting Ceph mon.smithi148 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:53:43.544 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 podman[80011]: 2024-09-18 12:53:43.349885446 +0000 UTC m=+0.015999562 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:53:43.544 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 podman[80011]: 2024-09-18 12:53:43.447236596 +0000 UTC m=+0.113350704 container create 88906a6c2abc72160af2567f5487e06ee198df4a46fcdfa37b11a1dd8396e2fa (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi148, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True) 2024-09-18T12:53:43.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 podman[80011]: 2024-09-18 12:53:43.641388049 +0000 UTC m=+0.307502170 container init 88906a6c2abc72160af2567f5487e06ee198df4a46fcdfa37b11a1dd8396e2fa (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi148, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:53:43.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 podman[80011]: 2024-09-18 12:53:43.644903943 +0000 UTC m=+0.311018059 container start 88906a6c2abc72160af2567f5487e06ee198df4a46fcdfa37b11a1dd8396e2fa (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi148, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-18T12:53:43.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: set uid:gid to 167:167 (ceph:ceph) 2024-09-18T12:53:43.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev), process ceph-mon, pid 2 2024-09-18T12:53:43.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: pidfile_write: ignore empty --pid-file 2024-09-18T12:53:43.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: load: jerasure load: lrc 2024-09-18T12:53:43.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: RocksDB version: 7.9.2 2024-09-18T12:53:43.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Git sha 0 2024-09-18T12:53:43.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Compile date 2024-09-17 15:59:30 2024-09-18T12:53:43.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: DB SUMMARY 2024-09-18T12:53:43.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: DB Session ID: JJQRH47SXYPD3XP3J3DG 2024-09-18T12:53:43.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: CURRENT file: CURRENT 2024-09-18T12:53:43.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: IDENTITY file: IDENTITY 2024-09-18T12:53:43.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1393 Bytes 2024-09-18T12:53:43.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi148/store.db dir, Total Num: 1, files: 000027.sst 2024-09-18T12:53:43.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi148/store.db: 000025.log size: 4906512 ; 2024-09-18T12:53:43.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.error_if_exists: 0 2024-09-18T12:53:43.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.create_if_missing: 0 2024-09-18T12:53:43.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.paranoid_checks: 1 2024-09-18T12:53:43.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-18T12:53:43.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-18T12:53:43.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-18T12:53:43.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.env: 0x560ad8b5e120 2024-09-18T12:53:43.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.fs: PosixFileSystem 2024-09-18T12:53:43.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.info_log: 0x560ad9d7d8e0 2024-09-18T12:53:43.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_file_opening_threads: 16 2024-09-18T12:53:43.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.statistics: (nil) 2024-09-18T12:53:43.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.use_fsync: 0 2024-09-18T12:53:43.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_log_file_size: 0 2024-09-18T12:53:43.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-18T12:53:43.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-18T12:53:43.977 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.keep_log_file_num: 1000 2024-09-18T12:53:43.977 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.recycle_log_file_num: 0 2024-09-18T12:53:43.977 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.allow_fallocate: 1 2024-09-18T12:53:43.977 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.allow_mmap_reads: 0 2024-09-18T12:53:43.977 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.allow_mmap_writes: 0 2024-09-18T12:53:43.977 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.use_direct_reads: 0 2024-09-18T12:53:43.977 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-18T12:53:43.977 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.create_missing_column_families: 0 2024-09-18T12:53:43.977 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.db_log_dir: 2024-09-18T12:53:43.978 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.wal_dir: 2024-09-18T12:53:43.978 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-18T12:53:43.978 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-18T12:53:43.978 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-18T12:53:43.978 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-18T12:53:43.978 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-18T12:53:43.978 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-18T12:53:43.978 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.advise_random_on_open: 1 2024-09-18T12:53:43.978 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.db_write_buffer_size: 0 2024-09-18T12:53:43.978 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.write_buffer_manager: 0x560ad9d81b80 2024-09-18T12:53:43.978 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-18T12:53:43.979 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-18T12:53:43.979 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-18T12:53:43.979 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.rate_limiter: (nil) 2024-09-18T12:53:43.979 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-18T12:53:43.979 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.wal_recovery_mode: 2 2024-09-18T12:53:43.979 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.enable_thread_tracking: 0 2024-09-18T12:53:43.980 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.enable_pipelined_write: 0 2024-09-18T12:53:43.980 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.unordered_write: 0 2024-09-18T12:53:43.980 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-18T12:53:43.980 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-18T12:53:43.980 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-18T12:53:43.980 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-18T12:53:43.981 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.row_cache: None 2024-09-18T12:53:43.981 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.wal_filter: None 2024-09-18T12:53:43.983 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-18T12:53:43.983 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.allow_ingest_behind: 0 2024-09-18T12:53:43.983 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.two_write_queues: 0 2024-09-18T12:53:43.984 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.manual_wal_flush: 0 2024-09-18T12:53:43.984 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.wal_compression: 0 2024-09-18T12:53:43.984 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.atomic_flush: 0 2024-09-18T12:53:43.984 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-18T12:53:43.984 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-18T12:53:43.985 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-18T12:53:43.985 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.log_readahead_size: 0 2024-09-18T12:53:43.985 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-18T12:53:43.985 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.best_efforts_recovery: 0 2024-09-18T12:53:43.985 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-18T12:53:43.986 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-18T12:53:43.986 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.allow_data_in_errors: 0 2024-09-18T12:53:43.986 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.db_host_id: __hostname__ 2024-09-18T12:53:43.986 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-18T12:53:43.986 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_background_jobs: 2 2024-09-18T12:53:43.986 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_background_compactions: -1 2024-09-18T12:53:43.987 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_subcompactions: 1 2024-09-18T12:53:43.987 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-18T12:53:43.987 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-18T12:53:43.987 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-18T12:53:43.987 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_total_wal_size: 0 2024-09-18T12:53:43.987 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-18T12:53:43.988 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-18T12:53:43.988 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-18T12:53:43.988 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-18T12:53:43.988 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_open_files: -1 2024-09-18T12:53:43.988 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.bytes_per_sync: 0 2024-09-18T12:53:43.989 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-18T12:53:43.989 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-18T12:53:43.989 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compaction_readahead_size: 0 2024-09-18T12:53:43.989 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_background_flushes: -1 2024-09-18T12:53:43.990 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Compression algorithms supported: 2024-09-18T12:53:43.990 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: kZSTD supported: 0 2024-09-18T12:53:43.990 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: kXpressCompression supported: 0 2024-09-18T12:53:43.990 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: kBZip2Compression supported: 0 2024-09-18T12:53:43.990 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-18T12:53:43.991 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: kLZ4Compression supported: 1 2024-09-18T12:53:43.991 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: kZlibCompression supported: 1 2024-09-18T12:53:43.991 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: kLZ4HCCompression supported: 1 2024-09-18T12:53:43.991 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: kSnappyCompression supported: 1 2024-09-18T12:53:43.991 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-18T12:53:43.991 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-18T12:53:43.992 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi148/store.db/MANIFEST-000010 2024-09-18T12:53:43.992 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-18T12:53:43.992 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-18T12:53:43.992 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.merge_operator: 2024-09-18T12:53:43.992 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compaction_filter: None 2024-09-18T12:53:43.993 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compaction_filter_factory: None 2024-09-18T12:53:43.993 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.sst_partitioner_factory: None 2024-09-18T12:53:43.993 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-18T12:53:43.993 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-18T12:53:43.993 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560ad9d7d540) 2024-09-18T12:53:43.994 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: cache_index_and_filter_blocks: 1 2024-09-18T12:53:43.994 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-18T12:53:43.994 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-18T12:53:43.994 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: pin_top_level_index_and_filter: 1 2024-09-18T12:53:43.994 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: index_type: 0 2024-09-18T12:53:43.994 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: data_block_index_type: 0 2024-09-18T12:53:43.995 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: index_shortening: 1 2024-09-18T12:53:43.995 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-18T12:53:43.995 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: checksum: 4 2024-09-18T12:53:43.995 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: no_block_cache: 0 2024-09-18T12:53:43.995 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_cache: 0x560ad9d71610 2024-09-18T12:53:43.995 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_cache_name: BinnedLRUCache 2024-09-18T12:53:43.995 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_cache_options: 2024-09-18T12:53:43.996 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: capacity : 536870912 2024-09-18T12:53:43.996 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: num_shard_bits : 4 2024-09-18T12:53:43.996 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: strict_capacity_limit : 0 2024-09-18T12:53:43.996 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: high_pri_pool_ratio: 0.000 2024-09-18T12:53:43.996 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_cache_compressed: (nil) 2024-09-18T12:53:43.996 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: persistent_cache: (nil) 2024-09-18T12:53:43.997 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_size: 4096 2024-09-18T12:53:43.997 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_size_deviation: 10 2024-09-18T12:53:43.997 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_restart_interval: 16 2024-09-18T12:53:43.997 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: index_block_restart_interval: 1 2024-09-18T12:53:43.997 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: metadata_block_size: 4096 2024-09-18T12:53:43.997 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: partition_filters: 0 2024-09-18T12:53:43.997 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: use_delta_encoding: 1 2024-09-18T12:53:43.998 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: filter_policy: bloomfilter 2024-09-18T12:53:43.998 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: whole_key_filtering: 1 2024-09-18T12:53:43.998 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: verify_compression: 0 2024-09-18T12:53:43.998 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: read_amp_bytes_per_bit: 0 2024-09-18T12:53:43.998 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: format_version: 5 2024-09-18T12:53:43.998 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: enable_index_compression: 1 2024-09-18T12:53:43.998 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_align: 0 2024-09-18T12:53:43.998 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: max_auto_readahead_size: 262144 2024-09-18T12:53:43.998 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: prepopulate_block_cache: 0 2024-09-18T12:53:43.998 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: initial_auto_readahead_size: 8192 2024-09-18T12:53:43.999 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: num_file_reads_for_auto_readahead: 2 2024-09-18T12:53:43.999 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.write_buffer_size: 33554432 2024-09-18T12:53:43.999 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_write_buffer_number: 2 2024-09-18T12:53:43.999 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compression: NoCompression 2024-09-18T12:53:43.999 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.bottommost_compression: Disabled 2024-09-18T12:53:43.999 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.prefix_extractor: nullptr 2024-09-18T12:53:43.999 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-18T12:53:43.999 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.num_levels: 7 2024-09-18T12:53:43.999 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-18T12:53:43.999 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-18T12:53:44.000 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-18T12:53:44.000 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-18T12:53:44.000 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-18T12:53:44.000 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-18T12:53:44.000 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-18T12:53:44.000 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:53:44.000 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-18T12:53:44.000 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-18T12:53:44.000 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:53:44.000 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:53:44.000 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-18T12:53:44.000 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compression_opts.level: 32767 2024-09-18T12:53:44.000 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compression_opts.strategy: 0 2024-09-18T12:53:44.001 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-18T12:53:44.001 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:53:44.001 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:53:44.001 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-18T12:53:44.001 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compression_opts.enabled: false 2024-09-18T12:53:44.001 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:53:44.001 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-18T12:53:44.001 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-18T12:53:44.001 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-18T12:53:44.001 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.target_file_size_base: 67108864 2024-09-18T12:53:44.001 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-18T12:53:44.001 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-18T12:53:44.001 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-18T12:53:44.002 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-18T12:53:44.002 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-18T12:53:44.002 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-18T12:53:44.002 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-18T12:53:44.002 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-18T12:53:44.002 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-18T12:53:44.002 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-18T12:53:44.002 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-18T12:53:44.002 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-18T12:53:44.002 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-18T12:53:44.003 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-18T12:53:44.003 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.arena_block_size: 1048576 2024-09-18T12:53:44.003 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-18T12:53:44.003 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-18T12:53:44.003 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.disable_auto_compactions: 0 2024-09-18T12:53:44.003 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-18T12:53:44.003 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-18T12:53:44.003 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-18T12:53:44.003 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-18T12:53:44.003 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-18T12:53:44.003 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-18T12:53:44.004 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-18T12:53:44.004 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-18T12:53:44.004 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-18T12:53:44.004 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-18T12:53:44.004 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-18T12:53:44.004 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.inplace_update_support: 0 2024-09-18T12:53:44.004 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-18T12:53:44.004 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-18T12:53:44.004 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-18T12:53:44.004 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-18T12:53:44.004 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.bloom_locality: 0 2024-09-18T12:53:44.004 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.max_successive_merges: 0 2024-09-18T12:53:44.005 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-18T12:53:44.005 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.paranoid_file_checks: 0 2024-09-18T12:53:44.005 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.force_consistency_checks: 1 2024-09-18T12:53:44.005 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.report_bg_io_stats: 0 2024-09-18T12:53:44.005 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.ttl: 2592000 2024-09-18T12:53:44.005 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-18T12:53:44.005 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-18T12:53:44.005 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-18T12:53:44.005 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.enable_blob_files: false 2024-09-18T12:53:44.005 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.min_blob_size: 0 2024-09-18T12:53:44.005 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.blob_file_size: 268435456 2024-09-18T12:53:44.005 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-18T12:53:44.005 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-18T12:53:44.006 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-18T12:53:44.006 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-18T12:53:44.006 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-18T12:53:44.006 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.blob_file_starting_level: 0 2024-09-18T12:53:44.006 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-18T12:53:44.006 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T12:53:44.006 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi148/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12158, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-18T12:53:44.006 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-18T12:53:44.006 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: deb6e307-91ee-4128-981f-7567b2a4bfef 2024-09-18T12:53:44.006 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664023671474, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-18T12:53:44.007 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-18T12:53:44.007 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664023683091, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2858111, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12163, "largest_seqno": 14913, "table_properties": {"data_size": 2847263, "index_size": 6665, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3141, "raw_key_size": 28116, "raw_average_key_size": 22, "raw_value_size": 2822454, "raw_average_value_size": 2250, "num_data_blocks": 304, "num_entries": 1254, "num_filter_entries": 1254, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726664023, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "deb6e307-91ee-4128-981f-7567b2a4bfef", "db_session_id": "JJQRH47SXYPD3XP3J3DG", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-18T12:53:44.007 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664023683213, "job": 1, "event": "recovery_finished"} 2024-09-18T12:53:44.007 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-18T12:53:44.007 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T12:53:44.007 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi148/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-18T12:53:44.007 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560ad9da0e00 2024-09-18T12:53:44.007 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: DB pointer 0x560ad9ea2000 2024-09-18T12:53:44.007 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-18T12:53:44.007 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-18T12:53:44.007 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ** DB Stats ** 2024-09-18T12:53:44.008 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:53:44.008 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-18T12:53:44.008 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:53:44.008 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:53:44.008 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-18T12:53:44.008 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:53:44.008 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:53:44.008 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-09-18T12:53:44.008 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ** Compaction Stats [default] ** 2024-09-18T12:53:44.008 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:53:44.008 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-18T12:53:44.008 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: L0 1/0 2.73 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 606.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:53:44.009 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: L6 1/0 7.05 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-18T12:53:44.009 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Sum 2/0 9.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 606.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:53:44.009 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 606.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:53:44.009 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-09-18T12:53:44.009 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ** Compaction Stats [default] ** 2024-09-18T12:53:44.009 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:53:44.009 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T12:53:44.009 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 606.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:53:44.009 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-09-18T12:53:44.009 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-18T12:53:44.009 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-09-18T12:53:44.009 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:53:44.010 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-18T12:53:44.010 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-18T12:53:44.010 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-18T12:53:44.010 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-18T12:53:44.010 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-18T12:53:44.010 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Cumulative compaction: 0.00 GB write, 150.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:53:44.010 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Interval compaction: 0.00 GB write, 150.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:53:44.010 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-18T12:53:44.010 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Block cache BinnedLRUCache@0x560ad9d71610#2 capacity: 512.00 MB usage: 11.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-18T12:53:44.011 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,3.28 KB,0.000625849%) IndexBlock(1,8.08 KB,0.00154078%) Misc(1,0.00 KB,0%) 2024-09-18T12:53:44.011 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-09-18T12:53:44.011 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-18T12:53:44.011 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: starting mon.smithi148 rank 1 at public addrs [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] at bind addrs [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi148 fsid ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:53:44.011 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: mon.smithi148@-1(???) e2 preinit fsid ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:53:44.011 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: mon.smithi148@-1(???).mds e18 new map 2024-09-18T12:53:44.011 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: mon.smithi148@-1(???).mds e18 print_map 2024-09-18T12:53:44.011 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: e18 2024-09-18T12:53:44.012 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: btime 2024-09-18T12:46:44:251409+0000 2024-09-18T12:53:44.012 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:53:44.012 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:53:44.012 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: legacy client fscid: 1 2024-09-18T12:53:44.012 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-09-18T12:53:44.012 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Filesystem 'cephfs' (1) 2024-09-18T12:53:44.012 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: fs_name cephfs 2024-09-18T12:53:44.012 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: epoch 18 2024-09-18T12:53:44.012 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:53:44.012 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:53:44.012 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: modified 2024-09-18T12:46:44.251398+0000 2024-09-18T12:53:44.012 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: tableserver 0 2024-09-18T12:53:44.012 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: root 0 2024-09-18T12:53:44.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: session_timeout 60 2024-09-18T12:53:44.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: session_autoclose 300 2024-09-18T12:53:44.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: max_file_size 1099511627776 2024-09-18T12:53:44.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: max_xattr_size 65536 2024-09-18T12:53:44.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: required_client_features {} 2024-09-18T12:53:44.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: last_failure 0 2024-09-18T12:53:44.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: last_failure_osd_epoch 45 2024-09-18T12:53:44.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:53:44.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: max_mds 2 2024-09-18T12:53:44.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: in 0,1 2024-09-18T12:53:44.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: up {0=14560,1=14574} 2024-09-18T12:53:44.013 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: failed 2024-09-18T12:53:44.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: damaged 2024-09-18T12:53:44.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: stopped 2024-09-18T12:53:44.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: data_pools [3] 2024-09-18T12:53:44.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: metadata_pool 2 2024-09-18T12:53:44.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: inline_data enabled 2024-09-18T12:53:44.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: balancer 2024-09-18T12:53:44.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: bal_rank_mask -1 2024-09-18T12:53:44.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: standby_count_wanted 1 2024-09-18T12:53:44.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: qdb_cluster leader: 14560 members: 14560,14574 2024-09-18T12:53:44.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: [mds.cephfs.smithi078.eakgoe{0:14560} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:44.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: [mds.cephfs.smithi078.furyab{1:14574} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:44.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-09-18T12:53:44.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-09-18T12:53:44.014 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Standby daemons: 2024-09-18T12:53:44.015 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-09-18T12:53:44.015 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: [mds.cephfs.smithi148.tvvouo{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:44.015 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: [mds.cephfs.smithi148.fqecmm{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/258027429,v1:172.21.15.148:6825/258027429] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:44.015 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: mon.smithi148@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-18T12:53:44.015 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: mon.smithi148@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:53:44.015 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: mon.smithi148@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:53:44.015 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: mon.smithi148@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:53:44.015 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: mon.smithi148@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-18T12:53:44.015 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 bash[80011]: 88906a6c2abc72160af2567f5487e06ee198df4a46fcdfa37b11a1dd8396e2fa 2024-09-18T12:53:44.015 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 systemd[1]: Started Ceph mon.smithi148 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:53:44.015 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mon metadata", "id": "smithi078"} : dispatch 2024-09-18T12:53:44.015 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mon metadata", "id": "smithi148"} : dispatch 2024-09-18T12:53:44.015 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-18T12:53:44.015 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:43 smithi148 ceph-mon[80030]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:44.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:43 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mon metadata", "id": "smithi078"} : dispatch 2024-09-18T12:53:44.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:43 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mon metadata", "id": "smithi148"} : dispatch 2024-09-18T12:53:44.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:43 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-18T12:53:44.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:43 smithi078 ceph-mon[108578]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:53:44.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: pgmap v102: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:44.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: mon.smithi148 calling monitor election 2024-09-18T12:53:44.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: mon.smithi078 calling monitor election 2024-09-18T12:53:44.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: mon.smithi078 is new leader, mons smithi078,smithi148 in quorum (ranks 0,1) 2024-09-18T12:53:44.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: monmap epoch 2 2024-09-18T12:53:44.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: fsid ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:53:44.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: last_changed 2024-09-18T12:42:05.559042+0000 2024-09-18T12:53:44.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: created 2024-09-18T12:39:37.203660+0000 2024-09-18T12:53:44.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: min_mon_release 19 (squid) 2024-09-18T12:53:44.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: election_strategy: 1 2024-09-18T12:53:44.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.smithi078 2024-09-18T12:53:44.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.smithi148 2024-09-18T12:53:44.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:active} 2 up:standby 2024-09-18T12:53:44.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: osdmap e47: 6 total, 6 up, 6 in 2024-09-18T12:53:44.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: mgrmap e34: smithi078.ohifux(active, since 3m), standbys: smithi148.bfgshs 2024-09-18T12:53:44.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:53:44.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:53:44.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:53:44.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:44.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:44.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:44 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:53:45.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: pgmap v102: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:45.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: mon.smithi148 calling monitor election 2024-09-18T12:53:45.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: mon.smithi078 calling monitor election 2024-09-18T12:53:45.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: mon.smithi078 is new leader, mons smithi078,smithi148 in quorum (ranks 0,1) 2024-09-18T12:53:45.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: monmap epoch 2 2024-09-18T12:53:45.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: fsid ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T12:53:45.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: last_changed 2024-09-18T12:42:05.559042+0000 2024-09-18T12:53:45.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: created 2024-09-18T12:39:37.203660+0000 2024-09-18T12:53:45.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: min_mon_release 19 (squid) 2024-09-18T12:53:45.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: election_strategy: 1 2024-09-18T12:53:45.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.smithi078 2024-09-18T12:53:45.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.smithi148 2024-09-18T12:53:45.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:active} 2 up:standby 2024-09-18T12:53:45.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: osdmap e47: 6 total, 6 up, 6 in 2024-09-18T12:53:45.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: mgrmap e34: smithi078.ohifux(active, since 3m), standbys: smithi148.bfgshs 2024-09-18T12:53:45.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:53:45.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:53:45.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:53:45.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:45.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:45.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:44 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:53:45.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:45 smithi078 ceph-mon[108578]: pgmap v103: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:46.068 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:45 smithi148 ceph-mon[80030]: pgmap v103: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:47 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:47 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:47 smithi148 ceph-mon[80030]: pgmap v104: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:47 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:47 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:47 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:47 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:47 smithi078 ceph-mon[108578]: pgmap v104: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:47 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:47 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:49.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:49 smithi148 ceph-mon[80030]: pgmap v105: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:49.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:49 smithi078 ceph-mon[108578]: pgmap v105: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:51.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:51.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:51.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:51.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:53:51.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:53:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:53:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:53:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:51 smithi078 ceph-mon[108578]: Upgrade: Setting container_image for all mon 2024-09-18T12:53:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi078"} : dispatch 2024-09-18T12:53:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi078"}]': finished 2024-09-18T12:53:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi148"} : dispatch 2024-09-18T12:53:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi148"}]': finished 2024-09-18T12:53:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:51 smithi078 ceph-mon[108578]: pgmap v106: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:53:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:53:51.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:53:51.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:53:51.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:51 smithi148 ceph-mon[80030]: Upgrade: Setting container_image for all mon 2024-09-18T12:53:51.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:51.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi078"} : dispatch 2024-09-18T12:53:51.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi078"}]': finished 2024-09-18T12:53:51.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi148"} : dispatch 2024-09-18T12:53:51.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi148"}]': finished 2024-09-18T12:53:51.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:51 smithi148 ceph-mon[80030]: pgmap v106: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:53.145 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:52 smithi078 ceph-mon[108578]: Upgrade: Updating crash.smithi078 (1/2) 2024-09-18T12:53:53.146 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:52 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:53.146 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:52 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi078", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:53:53.146 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:52 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:53.146 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:52 smithi078 ceph-mon[108578]: Deploying daemon crash.smithi078 on smithi078 2024-09-18T12:53:53.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.186+0000 7fd5c440a640 1 -- 172.21.15.78:0/3324975092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5bc107900 msgr2=0x7fd5bc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:53.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.186+0000 7fd5c440a640 1 --2- 172.21.15.78:0/3324975092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5bc107900 0x7fd5bc107ce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009880 tx=0x7fd5b802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.186+0000 7fd5c440a640 1 -- 172.21.15.78:0/3324975092 shutdown_connections 2024-09-18T12:53:53.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.186+0000 7fd5c440a640 1 --2- 172.21.15.78:0/3324975092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5bc101900 0x7fd5bc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.186+0000 7fd5c440a640 1 --2- 172.21.15.78:0/3324975092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5bc107900 0x7fd5bc107ce0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.186+0000 7fd5c440a640 1 -- 172.21.15.78:0/3324975092 >> 172.21.15.78:0/3324975092 conn(0x7fd5bc0fd600 msgr2=0x7fd5bc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:53.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.186+0000 7fd5c440a640 1 -- 172.21.15.78:0/3324975092 shutdown_connections 2024-09-18T12:53:53.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.186+0000 7fd5c440a640 1 -- 172.21.15.78:0/3324975092 wait complete. 2024-09-18T12:53:53.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.187+0000 7fd5c440a640 1 Processor -- start 2024-09-18T12:53:53.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.187+0000 7fd5c440a640 1 -- start start 2024-09-18T12:53:53.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.187+0000 7fd5c440a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5bc101900 0x7fd5bc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:53.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.187+0000 7fd5c440a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5bc107900 0x7fd5bc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:53.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.187+0000 7fd5c440a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc10ee30 con 0x7fd5bc107900 2024-09-18T12:53:53.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.187+0000 7fd5c440a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc10ecb0 con 0x7fd5bc101900 2024-09-18T12:53:53.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.187+0000 7fd5c19a5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5bc107900 0x7fd5bc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:53.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.187+0000 7fd5c19a5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5bc107900 0x7fd5bc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47648/0 (socket says 172.21.15.78:47648) 2024-09-18T12:53:53.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.187+0000 7fd5c19a5640 1 -- 172.21.15.78:0/1795095218 learned_addr learned my addr 172.21.15.78:0/1795095218 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:53.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.187+0000 7fd5c21a6640 1 --2- 172.21.15.78:0/1795095218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5bc101900 0x7fd5bc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:53.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.187+0000 7fd5c19a5640 1 -- 172.21.15.78:0/1795095218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5bc101900 msgr2=0x7fd5bc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:53.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.187+0000 7fd5c19a5640 1 --2- 172.21.15.78:0/1795095218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5bc101900 0x7fd5bc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.187+0000 7fd5c19a5640 1 -- 172.21.15.78:0/1795095218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5bc074f70 con 0x7fd5bc107900 2024-09-18T12:53:53.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.187+0000 7fd5c21a6640 1 --2- 172.21.15.78:0/1795095218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5bc101900 0x7fd5bc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:53:53.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.188+0000 7fd5c19a5640 1 --2- 172.21.15.78:0/1795095218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5bc107900 0x7fd5bc074a30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00b420 tx=0x7fd5ac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:53.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.188+0000 7fd5b37fe640 1 -- 172.21.15.78:0/1795095218 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd5ac011630 con 0x7fd5bc107900 2024-09-18T12:53:53.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.188+0000 7fd5b37fe640 1 -- 172.21.15.78:0/1795095218 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd5ac016070 con 0x7fd5bc107900 2024-09-18T12:53:53.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.188+0000 7fd5c440a640 1 -- 172.21.15.78:0/1795095218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5bc075260 con 0x7fd5bc107900 2024-09-18T12:53:53.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.188+0000 7fd5b37fe640 1 -- 172.21.15.78:0/1795095218 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd5ac010d40 con 0x7fd5bc107900 2024-09-18T12:53:53.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.188+0000 7fd5c440a640 1 -- 172.21.15.78:0/1795095218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5bc1a3e90 con 0x7fd5bc107900 2024-09-18T12:53:53.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.189+0000 7fd5c440a640 1 -- 172.21.15.78:0/1795095218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5bc103040 con 0x7fd5bc107900 2024-09-18T12:53:53.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.190+0000 7fd5b37fe640 1 -- 172.21.15.78:0/1795095218 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd5ac01b460 con 0x7fd5bc107900 2024-09-18T12:53:53.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.190+0000 7fd5b37fe640 1 --2- 172.21.15.78:0/1795095218 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd5a807af30 0x7fd5a807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:53.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.190+0000 7fd5b37fe640 1 -- 172.21.15.78:0/1795095218 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fd5ac09d780 con 0x7fd5bc107900 2024-09-18T12:53:53.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.190+0000 7fd5c21a6640 1 --2- 172.21.15.78:0/1795095218 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd5a807af30 0x7fd5a807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:53.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.191+0000 7fd5c21a6640 1 --2- 172.21.15.78:0/1795095218 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd5a807af30 0x7fd5a807d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8006010 tx=0x7fd5b80095f0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:53.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.195+0000 7fd5b37fe640 1 -- 172.21.15.78:0/1795095218 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd5ac021250 con 0x7fd5bc107900 2024-09-18T12:53:53.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:52 smithi148 ceph-mon[80030]: Upgrade: Updating crash.smithi078 (1/2) 2024-09-18T12:53:53.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:52 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:53.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:52 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi078", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:53:53.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:52 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:53.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:52 smithi148 ceph-mon[80030]: Deploying daemon crash.smithi078 on smithi078 2024-09-18T12:53:53.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.434+0000 7fd5c440a640 1 -- 172.21.15.78:0/1795095218 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd5bc062630 con 0x7fd5a807af30 2024-09-18T12:53:53.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.436+0000 7fd5b37fe640 1 -- 172.21.15.78:0/1795095218 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7fd5bc062630 con 0x7fd5a807af30 2024-09-18T12:53:53.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.438+0000 7fd5c440a640 1 -- 172.21.15.78:0/1795095218 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd5a807af30 msgr2=0x7fd5a807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.438+0000 7fd5c440a640 1 --2- 172.21.15.78:0/1795095218 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd5a807af30 0x7fd5a807d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8006010 tx=0x7fd5b80095f0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.438+0000 7fd5c440a640 1 -- 172.21.15.78:0/1795095218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5bc107900 msgr2=0x7fd5bc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.438+0000 7fd5c440a640 1 --2- 172.21.15.78:0/1795095218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5bc107900 0x7fd5bc074a30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00b420 tx=0x7fd5ac00b8e0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.438+0000 7fd5c440a640 1 -- 172.21.15.78:0/1795095218 shutdown_connections 2024-09-18T12:53:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.438+0000 7fd5c440a640 1 --2- 172.21.15.78:0/1795095218 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd5a807af30 0x7fd5a807d3f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.438+0000 7fd5c440a640 1 --2- 172.21.15.78:0/1795095218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5bc107900 0x7fd5bc074a30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.438+0000 7fd5c440a640 1 --2- 172.21.15.78:0/1795095218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5bc101900 0x7fd5bc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.438+0000 7fd5c440a640 1 -- 172.21.15.78:0/1795095218 >> 172.21.15.78:0/1795095218 conn(0x7fd5bc0fd600 msgr2=0x7fd5bc0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.438+0000 7fd5c440a640 1 -- 172.21.15.78:0/1795095218 shutdown_connections 2024-09-18T12:53:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.438+0000 7fd5c440a640 1 -- 172.21.15.78:0/1795095218 wait complete. 2024-09-18T12:53:53.449 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:53:53.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.527+0000 7fc59af75640 1 -- 172.21.15.78:0/1979646877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc594101900 msgr2=0x7fc594101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:53.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.527+0000 7fc59af75640 1 --2- 172.21.15.78:0/1979646877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc594101900 0x7fc594101d60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc580009880 tx=0x7fc58002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.527+0000 7fc59af75640 1 -- 172.21.15.78:0/1979646877 shutdown_connections 2024-09-18T12:53:53.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.527+0000 7fc59af75640 1 --2- 172.21.15.78:0/1979646877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc594101900 0x7fc594101d60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.527+0000 7fc59af75640 1 --2- 172.21.15.78:0/1979646877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc594107900 0x7fc594107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.527+0000 7fc59af75640 1 -- 172.21.15.78:0/1979646877 >> 172.21.15.78:0/1979646877 conn(0x7fc5940fd620 msgr2=0x7fc5940ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:53.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.527+0000 7fc59af75640 1 -- 172.21.15.78:0/1979646877 shutdown_connections 2024-09-18T12:53:53.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.527+0000 7fc59af75640 1 -- 172.21.15.78:0/1979646877 wait complete. 2024-09-18T12:53:53.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.528+0000 7fc59af75640 1 Processor -- start 2024-09-18T12:53:53.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.528+0000 7fc59af75640 1 -- start start 2024-09-18T12:53:53.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.528+0000 7fc59af75640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc594101900 0x7fc59419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:53.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.528+0000 7fc59af75640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc594107900 0x7fc59419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:53.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.528+0000 7fc59af75640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc59410edb0 con 0x7fc594107900 2024-09-18T12:53:53.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.528+0000 7fc59af75640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc59410ec30 con 0x7fc594101900 2024-09-18T12:53:53.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.528+0000 7fc593fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc594107900 0x7fc59419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:53.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.528+0000 7fc593fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc594107900 0x7fc59419fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47658/0 (socket says 172.21.15.78:47658) 2024-09-18T12:53:53.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.528+0000 7fc593fff640 1 -- 172.21.15.78:0/2134376441 learned_addr learned my addr 172.21.15.78:0/2134376441 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:53.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.528+0000 7fc598d11640 1 --2- 172.21.15.78:0/2134376441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc594101900 0x7fc59419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:53.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.528+0000 7fc593fff640 1 -- 172.21.15.78:0/2134376441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc594101900 msgr2=0x7fc59419f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:53.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.528+0000 7fc593fff640 1 --2- 172.21.15.78:0/2134376441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc594101900 0x7fc59419f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.528+0000 7fc593fff640 1 -- 172.21.15.78:0/2134376441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5941a0440 con 0x7fc594107900 2024-09-18T12:53:53.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.529+0000 7fc598d11640 1 --2- 172.21.15.78:0/2134376441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc594101900 0x7fc59419f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:53:53.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.529+0000 7fc593fff640 1 --2- 172.21.15.78:0/2134376441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc594107900 0x7fc59419fd90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc580031460 tx=0x7fc5800048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:53.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.529+0000 7fc591ffb640 1 -- 172.21.15.78:0/2134376441 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc58003f070 con 0x7fc594107900 2024-09-18T12:53:53.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.529+0000 7fc59af75640 1 -- 172.21.15.78:0/2134376441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc594199ad0 con 0x7fc594107900 2024-09-18T12:53:53.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.529+0000 7fc591ffb640 1 -- 172.21.15.78:0/2134376441 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc580004cf0 con 0x7fc594107900 2024-09-18T12:53:53.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.529+0000 7fc591ffb640 1 -- 172.21.15.78:0/2134376441 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc580035030 con 0x7fc594107900 2024-09-18T12:53:53.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.529+0000 7fc59af75640 1 -- 172.21.15.78:0/2134376441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc594199fd0 con 0x7fc594107900 2024-09-18T12:53:53.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.530+0000 7fc59af75640 1 -- 172.21.15.78:0/2134376441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc594103040 con 0x7fc594107900 2024-09-18T12:53:53.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.531+0000 7fc591ffb640 1 -- 172.21.15.78:0/2134376441 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc580042070 con 0x7fc594107900 2024-09-18T12:53:53.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.531+0000 7fc591ffb640 1 --2- 172.21.15.78:0/2134376441 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc58407af80 0x7fc58407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:53.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.531+0000 7fc591ffb640 1 -- 172.21.15.78:0/2134376441 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fc5800be990 con 0x7fc594107900 2024-09-18T12:53:53.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.531+0000 7fc598d11640 1 --2- 172.21.15.78:0/2134376441 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc58407af80 0x7fc58407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:53.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.532+0000 7fc598d11640 1 --2- 172.21.15.78:0/2134376441 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc58407af80 0x7fc58407d440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc59419ab50 tx=0x7fc588005db0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:53.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.536+0000 7fc591ffb640 1 -- 172.21.15.78:0/2134376441 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc58008a060 con 0x7fc594107900 2024-09-18T12:53:53.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.746+0000 7fc59af75640 1 -- 172.21.15.78:0/2134376441 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc59419a340 con 0x7fc58407af80 2024-09-18T12:53:53.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.747+0000 7fc591ffb640 1 -- 172.21.15.78:0/2134376441 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7fc59419a340 con 0x7fc58407af80 2024-09-18T12:53:53.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.749+0000 7fc59af75640 1 -- 172.21.15.78:0/2134376441 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc58407af80 msgr2=0x7fc58407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.749+0000 7fc59af75640 1 --2- 172.21.15.78:0/2134376441 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc58407af80 0x7fc58407d440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc59419ab50 tx=0x7fc588005db0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.749+0000 7fc59af75640 1 -- 172.21.15.78:0/2134376441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc594107900 msgr2=0x7fc59419fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.749+0000 7fc59af75640 1 --2- 172.21.15.78:0/2134376441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc594107900 0x7fc59419fd90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc580031460 tx=0x7fc5800048f0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.749+0000 7fc59af75640 1 -- 172.21.15.78:0/2134376441 shutdown_connections 2024-09-18T12:53:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.749+0000 7fc59af75640 1 --2- 172.21.15.78:0/2134376441 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc58407af80 0x7fc58407d440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.749+0000 7fc59af75640 1 --2- 172.21.15.78:0/2134376441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc594107900 0x7fc59419fd90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.749+0000 7fc59af75640 1 --2- 172.21.15.78:0/2134376441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc594101900 0x7fc59419f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.749+0000 7fc59af75640 1 -- 172.21.15.78:0/2134376441 >> 172.21.15.78:0/2134376441 conn(0x7fc5940fd620 msgr2=0x7fc594074460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.749+0000 7fc59af75640 1 -- 172.21.15.78:0/2134376441 shutdown_connections 2024-09-18T12:53:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.749+0000 7fc59af75640 1 -- 172.21.15.78:0/2134376441 wait complete. 2024-09-18T12:53:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.830+0000 7f3ad3c5b640 1 -- 172.21.15.78:0/2675508276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3acc101910 msgr2=0x7f3acc101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.830+0000 7f3ad3c5b640 1 --2- 172.21.15.78:0/2675508276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3acc101910 0x7f3acc101d70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009880 tx=0x7f3abc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.830+0000 7f3ad3c5b640 1 -- 172.21.15.78:0/2675508276 shutdown_connections 2024-09-18T12:53:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.830+0000 7f3ad3c5b640 1 --2- 172.21.15.78:0/2675508276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3acc101910 0x7f3acc101d70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.830+0000 7f3ad3c5b640 1 --2- 172.21.15.78:0/2675508276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3acc107910 0x7f3acc107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.830+0000 7f3ad3c5b640 1 -- 172.21.15.78:0/2675508276 >> 172.21.15.78:0/2675508276 conn(0x7f3acc0fd630 msgr2=0x7f3acc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.831+0000 7f3ad3c5b640 1 -- 172.21.15.78:0/2675508276 shutdown_connections 2024-09-18T12:53:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.831+0000 7f3ad3c5b640 1 -- 172.21.15.78:0/2675508276 wait complete. 2024-09-18T12:53:53.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.831+0000 7f3ad3c5b640 1 Processor -- start 2024-09-18T12:53:53.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.831+0000 7f3ad3c5b640 1 -- start start 2024-09-18T12:53:53.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.831+0000 7f3ad3c5b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3acc101910 0x7f3acc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.831+0000 7f3ad3c5b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3acc107910 0x7f3acc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.831+0000 7f3ad3c5b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc10ede0 con 0x7f3acc101910 2024-09-18T12:53:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.831+0000 7f3ad3c5b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc10ec60 con 0x7f3acc107910 2024-09-18T12:53:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.832+0000 7f3ad19f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3acc101910 0x7f3acc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.832+0000 7f3ad19f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3acc101910 0x7f3acc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47682/0 (socket says 172.21.15.78:47682) 2024-09-18T12:53:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.832+0000 7f3ad19f7640 1 -- 172.21.15.78:0/1359830962 learned_addr learned my addr 172.21.15.78:0/1359830962 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.832+0000 7f3ad11f6640 1 --2- 172.21.15.78:0/1359830962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3acc107910 0x7f3acc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.832+0000 7f3ad19f7640 1 -- 172.21.15.78:0/1359830962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3acc107910 msgr2=0x7f3acc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.832+0000 7f3ad19f7640 1 --2- 172.21.15.78:0/1359830962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3acc107910 0x7f3acc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.832+0000 7f3ad19f7640 1 -- 172.21.15.78:0/1359830962 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3acc074f70 con 0x7f3acc101910 2024-09-18T12:53:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.832+0000 7f3ad19f7640 1 --2- 172.21.15.78:0/1359830962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3acc101910 0x7f3acc0744f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800d6f0 tx=0x7f3ac800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:53.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.834+0000 7f3ac2ffd640 1 -- 172.21.15.78:0/1359830962 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ac8017070 con 0x7f3acc101910 2024-09-18T12:53:53.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.834+0000 7f3ac2ffd640 1 -- 172.21.15.78:0/1359830962 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ac800de00 con 0x7f3acc101910 2024-09-18T12:53:53.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.834+0000 7f3ad3c5b640 1 -- 172.21.15.78:0/1359830962 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3acc075260 con 0x7f3acc101910 2024-09-18T12:53:53.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.834+0000 7f3ac2ffd640 1 -- 172.21.15.78:0/1359830962 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ac8004bb0 con 0x7f3acc101910 2024-09-18T12:53:53.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.834+0000 7f3ad3c5b640 1 -- 172.21.15.78:0/1359830962 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3acc1a3e00 con 0x7f3acc101910 2024-09-18T12:53:53.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.835+0000 7f3ad3c5b640 1 -- 172.21.15.78:0/1359830962 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3acc103050 con 0x7f3acc101910 2024-09-18T12:53:53.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.835+0000 7f3ac2ffd640 1 -- 172.21.15.78:0/1359830962 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3ac8009a30 con 0x7f3acc101910 2024-09-18T12:53:53.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.836+0000 7f3ac2ffd640 1 --2- 172.21.15.78:0/1359830962 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ab807af80 0x7f3ab807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:53.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.836+0000 7f3ac2ffd640 1 -- 172.21.15.78:0/1359830962 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f3ac809db10 con 0x7f3acc101910 2024-09-18T12:53:53.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.836+0000 7f3ad11f6640 1 --2- 172.21.15.78:0/1359830962 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ab807af80 0x7f3ab807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:53.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.836+0000 7f3ad11f6640 1 --2- 172.21.15.78:0/1359830962 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ab807af80 0x7f3ab807d440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3acc075f80 tx=0x7f3abc031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:53.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:53.840+0000 7f3ac2ffd640 1 -- 172.21.15.78:0/1359830962 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3ac8069140 con 0x7f3acc101910 2024-09-18T12:53:53.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:53 smithi078 ceph-mon[108578]: pgmap v107: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:54.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.028+0000 7f3ad3c5b640 1 -- 172.21.15.78:0/1359830962 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3acc062630 con 0x7f3ab807af80 2024-09-18T12:53:54.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.038+0000 7f3ac2ffd640 1 -- 172.21.15.78:0/1359830962 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f3acc062630 con 0x7f3ab807af80 2024-09-18T12:53:54.039 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:53:54.039 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (103s) 18s ago 12m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T12:53:54.039 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (4m) 18s ago 12m 8753k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:53:54.039 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (4m) 7s ago 12m 8262k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:53:54.039 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (12m) 18s ago 12m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de bb77146b81c7 2024-09-18T12:53:54.040 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (12m) 7s ago 12m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de f82fdd264dc6 2024-09-18T12:53:54.040 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (81s) 18s ago 12m 73.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T12:53:54.040 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (7m) 18s ago 7m 152M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:53:54.040 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (7m) 18s ago 7m 27.6M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:53:54.040 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (7m) 7s ago 7m 16.1M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:53:54.040 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (7m) 7s ago 7m 16.9M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:53:54.040 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (3m) 18s ago 13m 521M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:53:54.040 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (2m) 7s ago 11m 454M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:53:54.040 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (27s) 18s ago 14m 24.7M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T12:53:54.040 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (10s) 7s ago 11m 22.2M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T12:53:54.040 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (2m) 18s ago 12m 11.7M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:53:54.040 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (2m) 7s ago 11m 11.3M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:53:54.040 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (10m) 18s ago 10m 207M 1216M 19.1.1-330-gc2ddf972 ebb0615149de f634ad9ddb36 2024-09-18T12:53:54.041 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (10m) 18s ago 10m 223M 1216M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:53:54.041 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (9m) 18s ago 9m 181M 1216M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:53:54.041 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (9m) 7s ago 9m 237M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:53:54.041 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (8m) 7s ago 8m 207M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:53:54.041 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (8m) 7s ago 8m 196M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:53:54.041 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (2m) 18s ago 12m 47.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:53:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.040+0000 7f3ad3c5b640 1 -- 172.21.15.78:0/1359830962 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ab807af80 msgr2=0x7f3ab807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.040+0000 7f3ad3c5b640 1 --2- 172.21.15.78:0/1359830962 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ab807af80 0x7f3ab807d440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3acc075f80 tx=0x7f3abc031400 comp rx=0 tx=0).stop 2024-09-18T12:53:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.040+0000 7f3ad3c5b640 1 -- 172.21.15.78:0/1359830962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3acc101910 msgr2=0x7f3acc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.040+0000 7f3ad3c5b640 1 --2- 172.21.15.78:0/1359830962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3acc101910 0x7f3acc0744f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800d6f0 tx=0x7f3ac800dbb0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.040+0000 7f3ad3c5b640 1 -- 172.21.15.78:0/1359830962 shutdown_connections 2024-09-18T12:53:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.040+0000 7f3ad3c5b640 1 --2- 172.21.15.78:0/1359830962 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ab807af80 0x7f3ab807d440 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.040+0000 7f3ad3c5b640 1 --2- 172.21.15.78:0/1359830962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3acc107910 0x7f3acc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.040+0000 7f3ad3c5b640 1 --2- 172.21.15.78:0/1359830962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3acc101910 0x7f3acc0744f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.040+0000 7f3ad3c5b640 1 -- 172.21.15.78:0/1359830962 >> 172.21.15.78:0/1359830962 conn(0x7f3acc0fd630 msgr2=0x7f3acc0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.040+0000 7f3ad3c5b640 1 -- 172.21.15.78:0/1359830962 shutdown_connections 2024-09-18T12:53:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.040+0000 7f3ad3c5b640 1 -- 172.21.15.78:0/1359830962 wait complete. 2024-09-18T12:53:54.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.122+0000 7f99bfd90640 1 -- 172.21.15.78:0/1664193781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b81011e0 msgr2=0x7f99b8101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:54.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.122+0000 7f99bfd90640 1 --2- 172.21.15.78:0/1664193781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b81011e0 0x7f99b8101620 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009880 tx=0x7f99a802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.122+0000 7f99bfd90640 1 -- 172.21.15.78:0/1664193781 shutdown_connections 2024-09-18T12:53:54.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.122+0000 7f99bfd90640 1 --2- 172.21.15.78:0/1664193781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b81011e0 0x7f99b8101620 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.122+0000 7f99bfd90640 1 --2- 172.21.15.78:0/1664193781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b8106800 0x7f99b8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.122+0000 7f99bfd90640 1 -- 172.21.15.78:0/1664193781 >> 172.21.15.78:0/1664193781 conn(0x7f99b8077270 msgr2=0x7f99b8077680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:54.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.122+0000 7f99bfd90640 1 -- 172.21.15.78:0/1664193781 shutdown_connections 2024-09-18T12:53:54.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.122+0000 7f99bfd90640 1 -- 172.21.15.78:0/1664193781 wait complete. 2024-09-18T12:53:54.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.123+0000 7f99bfd90640 1 Processor -- start 2024-09-18T12:53:54.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.123+0000 7f99bfd90640 1 -- start start 2024-09-18T12:53:54.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.123+0000 7f99bfd90640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b81011e0 0x7f99b8102930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:54.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.123+0000 7f99bfd90640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b8106800 0x7f99b8102e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:54.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.123+0000 7f99bfd90640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f99b810dce0 con 0x7f99b81011e0 2024-09-18T12:53:54.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.123+0000 7f99bfd90640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f99b810db60 con 0x7f99b8106800 2024-09-18T12:53:54.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.123+0000 7f99bdb2c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b81011e0 0x7f99b8102930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:54.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.123+0000 7f99bdb2c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b81011e0 0x7f99b8102930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47694/0 (socket says 172.21.15.78:47694) 2024-09-18T12:53:54.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.123+0000 7f99bdb2c640 1 -- 172.21.15.78:0/3288704451 learned_addr learned my addr 172.21.15.78:0/3288704451 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:54.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.123+0000 7f99bd32b640 1 --2- 172.21.15.78:0/3288704451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b8106800 0x7f99b8102e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:54.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.124+0000 7f99bdb2c640 1 -- 172.21.15.78:0/3288704451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b8106800 msgr2=0x7f99b8102e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:54.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.124+0000 7f99bdb2c640 1 --2- 172.21.15.78:0/3288704451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b8106800 0x7f99b8102e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.124+0000 7f99bdb2c640 1 -- 172.21.15.78:0/3288704451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b81033b0 con 0x7f99b81011e0 2024-09-18T12:53:54.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.124+0000 7f99bd32b640 1 --2- 172.21.15.78:0/3288704451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b8106800 0x7f99b8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:53:54.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.124+0000 7f99bdb2c640 1 --2- 172.21.15.78:0/3288704451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b81011e0 0x7f99b8102930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f99b400c8f0 tx=0x7f99b400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:54.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.124+0000 7f99aeffd640 1 -- 172.21.15.78:0/3288704451 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f99b40079b0 con 0x7f99b81011e0 2024-09-18T12:53:54.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.124+0000 7f99aeffd640 1 -- 172.21.15.78:0/3288704451 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f99b40054e0 con 0x7f99b81011e0 2024-09-18T12:53:54.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.124+0000 7f99bfd90640 1 -- 172.21.15.78:0/3288704451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b81036a0 con 0x7f99b81011e0 2024-09-18T12:53:54.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.124+0000 7f99aeffd640 1 -- 172.21.15.78:0/3288704451 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f99b4004dd0 con 0x7f99b81011e0 2024-09-18T12:53:54.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.124+0000 7f99bfd90640 1 -- 172.21.15.78:0/3288704451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b81a3e70 con 0x7f99b81011e0 2024-09-18T12:53:54.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.125+0000 7f99bfd90640 1 -- 172.21.15.78:0/3288704451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b8069f00 con 0x7f99b81011e0 2024-09-18T12:53:54.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.126+0000 7f99aeffd640 1 -- 172.21.15.78:0/3288704451 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f99b4005020 con 0x7f99b81011e0 2024-09-18T12:53:54.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.126+0000 7f99aeffd640 1 --2- 172.21.15.78:0/3288704451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f99a407aed0 0x7f99a407d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:54.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.126+0000 7f99bd32b640 1 --2- 172.21.15.78:0/3288704451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f99a407aed0 0x7f99a407d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:54.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.126+0000 7f99aeffd640 1 -- 172.21.15.78:0/3288704451 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f99b409df90 con 0x7f99b81011e0 2024-09-18T12:53:54.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.127+0000 7f99bd32b640 1 --2- 172.21.15.78:0/3288704451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f99a407aed0 0x7f99a407d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f99b81043c0 tx=0x7f99a8009560 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:54.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.131+0000 7f99aeffd640 1 -- 172.21.15.78:0/3288704451 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f99b4014030 con 0x7f99b81011e0 2024-09-18T12:53:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:53 smithi148 ceph-mon[80030]: pgmap v107: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:54.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.384+0000 7f99bfd90640 1 -- 172.21.15.78:0/3288704451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f99b81a41e0 con 0x7f99b81011e0 2024-09-18T12:53:54.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.385+0000 7f99aeffd640 1 -- 172.21.15.78:0/3288704451 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+733 (secure 0 0 0) 0x7f99b40695e0 con 0x7f99b81011e0 2024-09-18T12:53:54.386 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:53:54.386 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:53:54.387 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:53:54.387 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:53:54.387 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:53:54.387 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:53:54.387 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:53:54.387 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:53:54.387 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:53:54.387 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:53:54.387 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:53:54.387 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:53:54.387 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:53:54.387 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:53:54.387 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 10, 2024-09-18T12:53:54.387 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T12:53:54.388 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:53:54.388 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:53:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.387+0000 7f99bfd90640 1 -- 172.21.15.78:0/3288704451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f99a407aed0 msgr2=0x7f99a407d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.387+0000 7f99bfd90640 1 --2- 172.21.15.78:0/3288704451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f99a407aed0 0x7f99a407d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f99b81043c0 tx=0x7f99a8009560 comp rx=0 tx=0).stop 2024-09-18T12:53:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.387+0000 7f99bfd90640 1 -- 172.21.15.78:0/3288704451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b81011e0 msgr2=0x7f99b8102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.387+0000 7f99bfd90640 1 --2- 172.21.15.78:0/3288704451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b81011e0 0x7f99b8102930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f99b400c8f0 tx=0x7f99b400cdb0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.387+0000 7f99bfd90640 1 -- 172.21.15.78:0/3288704451 shutdown_connections 2024-09-18T12:53:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.387+0000 7f99bfd90640 1 --2- 172.21.15.78:0/3288704451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f99a407aed0 0x7f99a407d390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.387+0000 7f99bfd90640 1 --2- 172.21.15.78:0/3288704451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b8106800 0x7f99b8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.387+0000 7f99bfd90640 1 --2- 172.21.15.78:0/3288704451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b81011e0 0x7f99b8102930 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.387+0000 7f99bfd90640 1 -- 172.21.15.78:0/3288704451 >> 172.21.15.78:0/3288704451 conn(0x7f99b8077270 msgr2=0x7f99b8104c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.387+0000 7f99bfd90640 1 -- 172.21.15.78:0/3288704451 shutdown_connections 2024-09-18T12:53:54.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.387+0000 7f99bfd90640 1 -- 172.21.15.78:0/3288704451 wait complete. 2024-09-18T12:53:54.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.472+0000 7f4ef0d05640 1 -- 172.21.15.78:0/4040426427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec107900 msgr2=0x7f4eec107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:54.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.472+0000 7f4ef0d05640 1 --2- 172.21.15.78:0/4040426427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec107900 0x7f4eec107ce0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4edc009880 tx=0x7f4edc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.472+0000 7f4ef0d05640 1 -- 172.21.15.78:0/4040426427 shutdown_connections 2024-09-18T12:53:54.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.472+0000 7f4ef0d05640 1 --2- 172.21.15.78:0/4040426427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eec101900 0x7f4eec101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.472+0000 7f4ef0d05640 1 --2- 172.21.15.78:0/4040426427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec107900 0x7f4eec107ce0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.472+0000 7f4ef0d05640 1 -- 172.21.15.78:0/4040426427 >> 172.21.15.78:0/4040426427 conn(0x7f4eec0fd5e0 msgr2=0x7f4eec0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:54.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.473+0000 7f4ef0d05640 1 -- 172.21.15.78:0/4040426427 shutdown_connections 2024-09-18T12:53:54.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.473+0000 7f4ef0d05640 1 -- 172.21.15.78:0/4040426427 wait complete. 2024-09-18T12:53:54.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.473+0000 7f4ef0d05640 1 Processor -- start 2024-09-18T12:53:54.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.473+0000 7f4ef0d05640 1 -- start start 2024-09-18T12:53:54.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.474+0000 7f4ef0d05640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eec101900 0x7f4eec19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:54.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.474+0000 7f4ef0d05640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec107900 0x7f4eec19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:54.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.474+0000 7f4ef0d05640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4eec10edb0 con 0x7f4eec107900 2024-09-18T12:53:54.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.474+0000 7f4ef0d05640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4eec10ec30 con 0x7f4eec101900 2024-09-18T12:53:54.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.474+0000 7f4ee9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec107900 0x7f4eec19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:54.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.474+0000 7f4ee9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec107900 0x7f4eec19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47716/0 (socket says 172.21.15.78:47716) 2024-09-18T12:53:54.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.474+0000 7f4ee9d9b640 1 -- 172.21.15.78:0/2434858459 learned_addr learned my addr 172.21.15.78:0/2434858459 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:54.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.474+0000 7f4eea59c640 1 --2- 172.21.15.78:0/2434858459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eec101900 0x7f4eec19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:54.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.474+0000 7f4ee9d9b640 1 -- 172.21.15.78:0/2434858459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eec101900 msgr2=0x7f4eec19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:54.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.474+0000 7f4ee9d9b640 1 --2- 172.21.15.78:0/2434858459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eec101900 0x7f4eec19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.474+0000 7f4ee9d9b640 1 -- 172.21.15.78:0/2434858459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eec1977a0 con 0x7f4eec107900 2024-09-18T12:53:54.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.474+0000 7f4eea59c640 1 --2- 172.21.15.78:0/2434858459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eec101900 0x7f4eec19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:53:54.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.474+0000 7f4ee9d9b640 1 --2- 172.21.15.78:0/2434858459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec107900 0x7f4eec19db60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000d8d0 tx=0x7f4ee000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:54.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.475+0000 7f4edb7fe640 1 -- 172.21.15.78:0/2434858459 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ee0017030 con 0x7f4eec107900 2024-09-18T12:53:54.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.475+0000 7f4ef0d05640 1 -- 172.21.15.78:0/2434858459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eec197a90 con 0x7f4eec107900 2024-09-18T12:53:54.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.475+0000 7f4edb7fe640 1 -- 172.21.15.78:0/2434858459 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ee0004020 con 0x7f4eec107900 2024-09-18T12:53:54.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.475+0000 7f4edb7fe640 1 -- 172.21.15.78:0/2434858459 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ee00047a0 con 0x7f4eec107900 2024-09-18T12:53:54.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.475+0000 7f4ef0d05640 1 -- 172.21.15.78:0/2434858459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eec198020 con 0x7f4eec107900 2024-09-18T12:53:54.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.476+0000 7f4ef0d05640 1 -- 172.21.15.78:0/2434858459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eec103040 con 0x7f4eec107900 2024-09-18T12:53:54.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.477+0000 7f4edb7fe640 1 -- 172.21.15.78:0/2434858459 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4ee00041d0 con 0x7f4eec107900 2024-09-18T12:53:54.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.477+0000 7f4edb7fe640 1 --2- 172.21.15.78:0/2434858459 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4ed407af90 0x7f4ed407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:54.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.477+0000 7f4edb7fe640 1 -- 172.21.15.78:0/2434858459 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f4ee0018070 con 0x7f4eec107900 2024-09-18T12:53:54.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.477+0000 7f4eea59c640 1 --2- 172.21.15.78:0/2434858459 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4ed407af90 0x7f4ed407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:54.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.478+0000 7f4eea59c640 1 --2- 172.21.15.78:0/2434858459 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4ed407af90 0x7f4ed407d450 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4edc000c00 tx=0x7f4edc031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:54.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.482+0000 7f4edb7fe640 1 -- 172.21.15.78:0/2434858459 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4ee00693d0 con 0x7f4eec107900 2024-09-18T12:53:54.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.716+0000 7f4ef0d05640 1 -- 172.21.15.78:0/2434858459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4eec104b10 con 0x7f4eec107900 2024-09-18T12:53:54.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.717+0000 7f4edb7fe640 1 -- 172.21.15.78:0/2434858459 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) ==== 76+0+2032 (secure 0 0 0) 0x7f4ee006e280 con 0x7f4eec107900 2024-09-18T12:53:54.719 INFO:teuthology.orchestra.run.smithi078.stdout:e18 2024-09-18T12:53:54.719 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:46:44:251409+0000 2024-09-18T12:53:54.719 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:53:54.719 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:53:54.719 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T12:53:54.719 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:53:54.719 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:53:54.719 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T12:53:54.719 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 18 2024-09-18T12:53:54.719 INFO:teuthology.orchestra.run.smithi078.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:53:54.719 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:53:54.719 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:46:44.251398+0000 2024-09-18T12:53:54.720 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T12:53:54.720 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T12:53:54.720 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T12:53:54.720 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T12:53:54.720 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T12:53:54.720 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T12:53:54.720 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T12:53:54.720 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T12:53:54.720 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 45 2024-09-18T12:53:54.720 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:53:54.720 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T12:53:54.720 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T12:53:54.721 INFO:teuthology.orchestra.run.smithi078.stdout:up {0=14560,1=14574} 2024-09-18T12:53:54.721 INFO:teuthology.orchestra.run.smithi078.stdout:failed 2024-09-18T12:53:54.721 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T12:53:54.721 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T12:53:54.721 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T12:53:54.721 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T12:53:54.721 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T12:53:54.721 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T12:53:54.721 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T12:53:54.721 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T12:53:54.721 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 14560 members: 14560,14574 2024-09-18T12:53:54.722 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{0:14560} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:54.722 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{1:14574} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:54.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:53:54.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:53:54.722 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T12:53:54.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:53:54.722 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:54.722 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/258027429,v1:172.21.15.148:6825/258027429] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:53:54.723 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 18 2024-09-18T12:53:54.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.720+0000 7f4ef0d05640 1 -- 172.21.15.78:0/2434858459 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4ed407af90 msgr2=0x7f4ed407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:54.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.720+0000 7f4ef0d05640 1 --2- 172.21.15.78:0/2434858459 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4ed407af90 0x7f4ed407d450 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4edc000c00 tx=0x7f4edc031400 comp rx=0 tx=0).stop 2024-09-18T12:53:54.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.720+0000 7f4ef0d05640 1 -- 172.21.15.78:0/2434858459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec107900 msgr2=0x7f4eec19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:54.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.720+0000 7f4ef0d05640 1 --2- 172.21.15.78:0/2434858459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec107900 0x7f4eec19db60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000d8d0 tx=0x7f4ee000dd90 comp rx=0 tx=0).stop 2024-09-18T12:53:54.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.720+0000 7f4ef0d05640 1 -- 172.21.15.78:0/2434858459 shutdown_connections 2024-09-18T12:53:54.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.720+0000 7f4ef0d05640 1 --2- 172.21.15.78:0/2434858459 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4ed407af90 0x7f4ed407d450 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.720+0000 7f4ef0d05640 1 --2- 172.21.15.78:0/2434858459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec107900 0x7f4eec19db60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.720+0000 7f4ef0d05640 1 --2- 172.21.15.78:0/2434858459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4eec101900 0x7f4eec19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.720+0000 7f4ef0d05640 1 -- 172.21.15.78:0/2434858459 >> 172.21.15.78:0/2434858459 conn(0x7f4eec0fd5e0 msgr2=0x7f4eec0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:54.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.720+0000 7f4ef0d05640 1 -- 172.21.15.78:0/2434858459 shutdown_connections 2024-09-18T12:53:54.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.720+0000 7f4ef0d05640 1 -- 172.21.15.78:0/2434858459 wait complete. 2024-09-18T12:53:54.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.809+0000 7fe4d2165640 1 -- 172.21.15.78:0/1628736689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4cc102ab0 msgr2=0x7fe4cc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:54.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.809+0000 7fe4d2165640 1 --2- 172.21.15.78:0/1628736689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4cc102ab0 0x7fe4cc102e90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009880 tx=0x7fe4bc02a530 comp rx=0 tx=0).stop 2024-09-18T12:53:54.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.809+0000 7fe4d2165640 1 -- 172.21.15.78:0/1628736689 shutdown_connections 2024-09-18T12:53:54.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.809+0000 7fe4d2165640 1 --2- 172.21.15.78:0/1628736689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4cc1033d0 0x7fe4cc10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.809+0000 7fe4d2165640 1 --2- 172.21.15.78:0/1628736689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4cc102ab0 0x7fe4cc102e90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.809+0000 7fe4d2165640 1 -- 172.21.15.78:0/1628736689 >> 172.21.15.78:0/1628736689 conn(0x7fe4cc0fc550 msgr2=0x7fe4cc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:54.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.809+0000 7fe4d2165640 1 -- 172.21.15.78:0/1628736689 shutdown_connections 2024-09-18T12:53:54.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.809+0000 7fe4d2165640 1 -- 172.21.15.78:0/1628736689 wait complete. 2024-09-18T12:53:54.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.809+0000 7fe4d2165640 1 Processor -- start 2024-09-18T12:53:54.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.810+0000 7fe4d2165640 1 -- start start 2024-09-18T12:53:54.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.810+0000 7fe4d2165640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4cc102ab0 0x7fe4cc19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:54.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.810+0000 7fe4d2165640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4cc1033d0 0x7fe4cc19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:54.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.810+0000 7fe4d2165640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc10ede0 con 0x7fe4cc1033d0 2024-09-18T12:53:54.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.810+0000 7fe4d2165640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc10ec60 con 0x7fe4cc102ab0 2024-09-18T12:53:54.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.810+0000 7fe4caffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4cc1033d0 0x7fe4cc19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:54.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.810+0000 7fe4caffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4cc1033d0 0x7fe4cc19db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47732/0 (socket says 172.21.15.78:47732) 2024-09-18T12:53:54.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.810+0000 7fe4caffd640 1 -- 172.21.15.78:0/1851708014 learned_addr learned my addr 172.21.15.78:0/1851708014 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:54.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.810+0000 7fe4cb7fe640 1 --2- 172.21.15.78:0/1851708014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4cc102ab0 0x7fe4cc19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:54.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.810+0000 7fe4caffd640 1 -- 172.21.15.78:0/1851708014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4cc102ab0 msgr2=0x7fe4cc19d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:54.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.810+0000 7fe4caffd640 1 --2- 172.21.15.78:0/1851708014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4cc102ab0 0x7fe4cc19d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:54.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.810+0000 7fe4caffd640 1 -- 172.21.15.78:0/1851708014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc1977b0 con 0x7fe4cc1033d0 2024-09-18T12:53:54.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.811+0000 7fe4caffd640 1 --2- 172.21.15.78:0/1851708014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4cc1033d0 0x7fe4cc19db70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000c8f0 tx=0x7fe4c000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:54.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.811+0000 7fe4c8ff9640 1 -- 172.21.15.78:0/1851708014 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4c000ae50 con 0x7fe4cc1033d0 2024-09-18T12:53:54.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.811+0000 7fe4d2165640 1 -- 172.21.15.78:0/1851708014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4cc197aa0 con 0x7fe4cc1033d0 2024-09-18T12:53:54.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.811+0000 7fe4c8ff9640 1 -- 172.21.15.78:0/1851708014 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe4c0005020 con 0x7fe4cc1033d0 2024-09-18T12:53:54.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.811+0000 7fe4c8ff9640 1 -- 172.21.15.78:0/1851708014 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4c0004d70 con 0x7fe4cc1033d0 2024-09-18T12:53:54.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.811+0000 7fe4d2165640 1 -- 172.21.15.78:0/1851708014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4cc198030 con 0x7fe4cc1033d0 2024-09-18T12:53:54.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.812+0000 7fe4d2165640 1 -- 172.21.15.78:0/1851708014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4cc06a580 con 0x7fe4cc1033d0 2024-09-18T12:53:54.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.813+0000 7fe4c8ff9640 1 -- 172.21.15.78:0/1851708014 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe4c00051d0 con 0x7fe4cc1033d0 2024-09-18T12:53:54.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.813+0000 7fe4c8ff9640 1 --2- 172.21.15.78:0/1851708014 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe4b407b0e0 0x7fe4b407d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:54.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.814+0000 7fe4cb7fe640 1 --2- 172.21.15.78:0/1851708014 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe4b407b0e0 0x7fe4b407d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:54.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.814+0000 7fe4c8ff9640 1 -- 172.21.15.78:0/1851708014 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fe4c009dda0 con 0x7fe4cc1033d0 2024-09-18T12:53:54.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.814+0000 7fe4cb7fe640 1 --2- 172.21.15.78:0/1851708014 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe4b407b0e0 0x7fe4b407d5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc000c00 tx=0x7fe4bc031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:54.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:54.818+0000 7fe4c8ff9640 1 -- 172.21.15.78:0/1851708014 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe4c0014030 con 0x7fe4cc1033d0 2024-09-18T12:53:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:54 smithi078 ceph-mon[108578]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:54 smithi078 ceph-mon[108578]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:54 smithi078 ceph-mon[108578]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:54 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3288704451' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:53:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:54 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2434858459' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:53:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.024+0000 7fe4d2165640 1 -- 172.21.15.78:0/1851708014 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe4cc1983a0 con 0x7fe4b407b0e0 2024-09-18T12:53:55.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.026+0000 7fe4c8ff9640 1 -- 172.21.15.78:0/1851708014 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7fe4cc1983a0 con 0x7fe4b407b0e0 2024-09-18T12:53:55.027 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:53:55.027 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:53:55.027 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:53:55.027 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:53:55.027 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:53:55.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T12:53:55.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon" 2024-09-18T12:53:55.027 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:53:55.027 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "4/23 daemons upgraded", 2024-09-18T12:53:55.027 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading crash daemons", 2024-09-18T12:53:55.028 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:53:55.028 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:53:55.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.028+0000 7fe4d2165640 1 -- 172.21.15.78:0/1851708014 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe4b407b0e0 msgr2=0x7fe4b407d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:55.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.028+0000 7fe4d2165640 1 --2- 172.21.15.78:0/1851708014 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe4b407b0e0 0x7fe4b407d5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc000c00 tx=0x7fe4bc031400 comp rx=0 tx=0).stop 2024-09-18T12:53:55.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.028+0000 7fe4d2165640 1 -- 172.21.15.78:0/1851708014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4cc1033d0 msgr2=0x7fe4cc19db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:55.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.028+0000 7fe4d2165640 1 --2- 172.21.15.78:0/1851708014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4cc1033d0 0x7fe4cc19db70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000c8f0 tx=0x7fe4c000cdb0 comp rx=0 tx=0).stop 2024-09-18T12:53:55.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.028+0000 7fe4d2165640 1 -- 172.21.15.78:0/1851708014 shutdown_connections 2024-09-18T12:53:55.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.028+0000 7fe4d2165640 1 --2- 172.21.15.78:0/1851708014 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe4b407b0e0 0x7fe4b407d5a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:55.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.028+0000 7fe4d2165640 1 --2- 172.21.15.78:0/1851708014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4cc1033d0 0x7fe4cc19db70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:55.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.028+0000 7fe4d2165640 1 --2- 172.21.15.78:0/1851708014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4cc102ab0 0x7fe4cc19d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:55.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.028+0000 7fe4d2165640 1 -- 172.21.15.78:0/1851708014 >> 172.21.15.78:0/1851708014 conn(0x7fe4cc0fc550 msgr2=0x7fe4cc10aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:55.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.028+0000 7fe4d2165640 1 -- 172.21.15.78:0/1851708014 shutdown_connections 2024-09-18T12:53:55.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.028+0000 7fe4d2165640 1 -- 172.21.15.78:0/1851708014 wait complete. 2024-09-18T12:53:55.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.112+0000 7f05d8383640 1 -- 172.21.15.78:0/3791408261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05d0101900 msgr2=0x7f05d0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:55.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.112+0000 7f05d8383640 1 --2- 172.21.15.78:0/3791408261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05d0101900 0x7f05d0101d60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f05c4009880 tx=0x7f05c402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.112+0000 7f05d8383640 1 -- 172.21.15.78:0/3791408261 shutdown_connections 2024-09-18T12:53:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.112+0000 7f05d8383640 1 --2- 172.21.15.78:0/3791408261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05d0101900 0x7f05d0101d60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.112+0000 7f05d8383640 1 --2- 172.21.15.78:0/3791408261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05d0107900 0x7f05d0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.112+0000 7f05d8383640 1 -- 172.21.15.78:0/3791408261 >> 172.21.15.78:0/3791408261 conn(0x7f05d00fd600 msgr2=0x7f05d00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.112+0000 7f05d8383640 1 -- 172.21.15.78:0/3791408261 shutdown_connections 2024-09-18T12:53:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.112+0000 7f05d8383640 1 -- 172.21.15.78:0/3791408261 wait complete. 2024-09-18T12:53:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.113+0000 7f05d8383640 1 Processor -- start 2024-09-18T12:53:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.113+0000 7f05d8383640 1 -- start start 2024-09-18T12:53:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.113+0000 7f05d8383640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05d0101900 0x7f05d019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.113+0000 7f05d8383640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05d0107900 0x7f05d019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.113+0000 7f05d8383640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f05d010edd0 con 0x7f05d0101900 2024-09-18T12:53:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.113+0000 7f05d8383640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f05d010ec50 con 0x7f05d0107900 2024-09-18T12:53:55.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.113+0000 7f05d611f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05d0101900 0x7f05d019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.113+0000 7f05d611f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05d0101900 0x7f05d019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47744/0 (socket says 172.21.15.78:47744) 2024-09-18T12:53:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.113+0000 7f05d611f640 1 -- 172.21.15.78:0/3395113785 learned_addr learned my addr 172.21.15.78:0/3395113785 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:53:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.113+0000 7f05d591e640 1 --2- 172.21.15.78:0/3395113785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05d0107900 0x7f05d019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.113+0000 7f05d611f640 1 -- 172.21.15.78:0/3395113785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05d0107900 msgr2=0x7f05d019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.113+0000 7f05d611f640 1 --2- 172.21.15.78:0/3395113785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05d0107900 0x7f05d019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.113+0000 7f05d611f640 1 -- 172.21.15.78:0/3395113785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d0197800 con 0x7f05d0101900 2024-09-18T12:53:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.114+0000 7f05d611f640 1 --2- 172.21.15.78:0/3395113785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05d0101900 0x7f05d019d680 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f05c800d6f0 tx=0x7f05c800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.114+0000 7f05cf7fe640 1 -- 172.21.15.78:0/3395113785 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05c8017070 con 0x7f05d0101900 2024-09-18T12:53:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.114+0000 7f05cf7fe640 1 -- 172.21.15.78:0/3395113785 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05c800de00 con 0x7f05d0101900 2024-09-18T12:53:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.114+0000 7f05d8383640 1 -- 172.21.15.78:0/3395113785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d0197af0 con 0x7f05d0101900 2024-09-18T12:53:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.114+0000 7f05cf7fe640 1 -- 172.21.15.78:0/3395113785 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05c8004bb0 con 0x7f05d0101900 2024-09-18T12:53:55.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.114+0000 7f05d8383640 1 -- 172.21.15.78:0/3395113785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d0198050 con 0x7f05d0101900 2024-09-18T12:53:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.115+0000 7f05d8383640 1 -- 172.21.15.78:0/3395113785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05d0103040 con 0x7f05d0101900 2024-09-18T12:53:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.115+0000 7f05cf7fe640 1 -- 172.21.15.78:0/3395113785 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f05c8009a30 con 0x7f05d0101900 2024-09-18T12:53:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.116+0000 7f05cf7fe640 1 --2- 172.21.15.78:0/3395113785 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f05b807af80 0x7f05b807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:55.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.116+0000 7f05d591e640 1 --2- 172.21.15.78:0/3395113785 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f05b807af80 0x7f05b807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:55.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.116+0000 7f05cf7fe640 1 -- 172.21.15.78:0/3395113785 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f05c809da70 con 0x7f05d0101900 2024-09-18T12:53:55.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.116+0000 7f05d591e640 1 --2- 172.21.15.78:0/3395113785 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f05b807af80 0x7f05b807d440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05d0198b50 tx=0x7f05c4031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:55.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.120+0000 7f05cf7fe640 1 -- 172.21.15.78:0/3395113785 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f05c8069140 con 0x7f05d0101900 2024-09-18T12:53:55.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:54 smithi148 ceph-mon[80030]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:55.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:54 smithi148 ceph-mon[80030]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:55.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:54 smithi148 ceph-mon[80030]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:55.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:54 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3288704451' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:53:55.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:54 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2434858459' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:53:55.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.374+0000 7f05d8383640 1 -- 172.21.15.78:0/3395113785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f05d0109e70 con 0x7f05d0101900 2024-09-18T12:53:55.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.375+0000 7f05cf7fe640 1 -- 172.21.15.78:0/3395113785 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f05c806dff0 con 0x7f05d0101900 2024-09-18T12:53:55.376 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:53:55.376 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:53:55.377 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:53:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.378+0000 7f05d8383640 1 -- 172.21.15.78:0/3395113785 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f05b807af80 msgr2=0x7f05b807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.378+0000 7f05d8383640 1 --2- 172.21.15.78:0/3395113785 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f05b807af80 0x7f05b807d440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05d0198b50 tx=0x7f05c4031400 comp rx=0 tx=0).stop 2024-09-18T12:53:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.378+0000 7f05d8383640 1 -- 172.21.15.78:0/3395113785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05d0101900 msgr2=0x7f05d019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.378+0000 7f05d8383640 1 --2- 172.21.15.78:0/3395113785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05d0101900 0x7f05d019d680 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f05c800d6f0 tx=0x7f05c800dbb0 comp rx=0 tx=0).stop 2024-09-18T12:53:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.379+0000 7f05d8383640 1 -- 172.21.15.78:0/3395113785 shutdown_connections 2024-09-18T12:53:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.379+0000 7f05d8383640 1 --2- 172.21.15.78:0/3395113785 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f05b807af80 0x7f05b807d440 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.379+0000 7f05d8383640 1 --2- 172.21.15.78:0/3395113785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05d0107900 0x7f05d019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.379+0000 7f05d8383640 1 --2- 172.21.15.78:0/3395113785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05d0101900 0x7f05d019d680 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.379+0000 7f05d8383640 1 -- 172.21.15.78:0/3395113785 >> 172.21.15.78:0/3395113785 conn(0x7f05d00fd600 msgr2=0x7f05d00fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.379+0000 7f05d8383640 1 -- 172.21.15.78:0/3395113785 shutdown_connections 2024-09-18T12:53:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:53:55.379+0000 7f05d8383640 1 -- 172.21.15.78:0/3395113785 wait complete. 2024-09-18T12:53:55.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:55 smithi078 ceph-mon[108578]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:55.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:55 smithi078 ceph-mon[108578]: pgmap v108: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:55.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:55 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3395113785' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:53:55.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:55 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:53:55.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:55 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:55.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:55 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:56.148 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:55 smithi148 ceph-mon[80030]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:56.148 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:55 smithi148 ceph-mon[80030]: pgmap v108: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:56.148 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:55 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3395113785' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:53:56.148 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:55 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:53:56.148 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:55 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:56.148 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:55 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:57 smithi078 ceph-mon[108578]: Upgrade: Updating crash.smithi148 (2/2) 2024-09-18T12:53:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:57 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:57 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi148", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:53:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:57 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:57.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:57 smithi078 ceph-mon[108578]: Deploying daemon crash.smithi148 on smithi148 2024-09-18T12:53:57.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:53:57 smithi078 ceph-mon[108578]: pgmap v109: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:53:58.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:57 smithi148 ceph-mon[80030]: Upgrade: Updating crash.smithi148 (2/2) 2024-09-18T12:53:58.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:57 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:53:58.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:57 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi148", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:53:58.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:57 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:53:58.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:57 smithi148 ceph-mon[80030]: Deploying daemon crash.smithi148 on smithi148 2024-09-18T12:53:58.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:53:57 smithi148 ceph-mon[80030]: pgmap v109: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:00.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:00 smithi148 ceph-mon[80030]: pgmap v110: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:00.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:00 smithi078 ceph-mon[108578]: pgmap v110: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:01.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:01 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:01.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:01 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:01.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:01 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:01.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:01 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:01.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:01 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:01.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:01 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:02.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:02 smithi148 ceph-mon[80030]: pgmap v111: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:02 smithi078 ceph-mon[108578]: pgmap v111: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:04.144 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:03 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:04.145 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:03 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:04.145 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:03 smithi148 ceph-mon[80030]: pgmap v112: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:04.145 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:03 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:04.145 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:03 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:04.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:03 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:04.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:03 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:04.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:03 smithi078 ceph-mon[108578]: pgmap v112: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:04.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:03 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:04.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:03 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:06.173 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:06 smithi078 ceph-mon[108578]: pgmap v113: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:06.173 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:06 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:06.173 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:06 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:06.174 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:06 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:06.174 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:06 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:06.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:06 smithi148 ceph-mon[80030]: pgmap v113: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:06.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:06 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:06.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:06 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:06.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:06 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:06.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:06 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:07.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:07 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:07.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:07 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:07.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:07 smithi148 ceph-mon[80030]: pgmap v114: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:07.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:07 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:07.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:07 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:07.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:07 smithi078 ceph-mon[108578]: pgmap v114: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:09.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:09.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:09.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:09.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:54:09.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:09.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:09.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:09.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:09.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:09.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: Upgrade: Setting container_image for all crash 2024-09-18T12:54:09.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:09.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi078"} : dispatch 2024-09-18T12:54:09.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi078"}]': finished 2024-09-18T12:54:09.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi148"} : dispatch 2024-09-18T12:54:09.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi148"}]': finished 2024-09-18T12:54:09.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-18T12:54:09.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-18T12:54:09.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: Upgrade: osd.0 is safe to restart 2024-09-18T12:54:09.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:09 smithi148 ceph-mon[80030]: pgmap v115: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:09.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:09.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:09.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:09.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:54:09.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:09.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:09.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:09.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:09.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:09.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: Upgrade: Setting container_image for all crash 2024-09-18T12:54:09.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:09.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi078"} : dispatch 2024-09-18T12:54:09.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi078"}]': finished 2024-09-18T12:54:09.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi148"} : dispatch 2024-09-18T12:54:09.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi148"}]': finished 2024-09-18T12:54:09.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-18T12:54:09.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-18T12:54:09.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: Upgrade: osd.0 is safe to restart 2024-09-18T12:54:09.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:09 smithi078 ceph-mon[108578]: pgmap v115: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:11.464 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:11 smithi078 ceph-mon[108578]: Upgrade: Updating osd.0 2024-09-18T12:54:11.464 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:11.464 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-18T12:54:11.464 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:11.464 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:11 smithi078 ceph-mon[108578]: Deploying daemon osd.0 on smithi078 2024-09-18T12:54:11.465 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:11.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:11 smithi148 ceph-mon[80030]: Upgrade: Updating osd.0 2024-09-18T12:54:11.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:11.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-18T12:54:11.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:11.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:11 smithi148 ceph-mon[80030]: Deploying daemon osd.0 on smithi078 2024-09-18T12:54:11.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:12.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:12 smithi148 ceph-mon[80030]: pgmap v116: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:12.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:12 smithi078 ceph-mon[108578]: pgmap v116: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:13.242 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:13 smithi078 systemd[1]: Stopping Ceph osd.0 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:54:13.742 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:13 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0[49795]: 2024-09-18T12:54:13.334+0000 7f19d4cc0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:54:13.742 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:13 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0[49795]: 2024-09-18T12:54:13.334+0000 7f19d4cc0640 -1 osd.0 47 *** Got signal Terminated *** 2024-09-18T12:54:13.742 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:13 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0[49795]: 2024-09-18T12:54:13.334+0000 7f19d4cc0640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:54:14.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:14 smithi148 ceph-mon[80030]: pgmap v117: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:14.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:14 smithi148 ceph-mon[80030]: osd.0 marked itself down and dead 2024-09-18T12:54:14.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:14 smithi078 ceph-mon[108578]: pgmap v117: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:14.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:14 smithi078 ceph-mon[108578]: osd.0 marked itself down and dead 2024-09-18T12:54:14.894 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:14 smithi078 podman[116845]: 2024-09-18 12:54:14.623545214 +0000 UTC m=+1.400861335 container died f634ad9ddb36cbef5393cf05196a05573373a15bdd70e7fe320444c460746634 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:54:15.194 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:14 smithi078 podman[116845]: 2024-09-18 12:54:14.984483197 +0000 UTC m=+1.761799317 container cleanup f634ad9ddb36cbef5393cf05196a05573373a15bdd70e7fe320444c460746634 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-18T12:54:15.194 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:14 smithi078 bash[116845]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0 2024-09-18T12:54:15.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:15 smithi148 ceph-mon[80030]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:54:15.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:15 smithi148 ceph-mon[80030]: osdmap e48: 6 total, 5 up, 6 in 2024-09-18T12:54:15.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:15 smithi148 ceph-mon[80030]: osdmap e49: 6 total, 5 up, 6 in 2024-09-18T12:54:15.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:15 smithi078 ceph-mon[108578]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:54:15.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:15 smithi078 ceph-mon[108578]: osdmap e48: 6 total, 5 up, 6 in 2024-09-18T12:54:15.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:15 smithi078 ceph-mon[108578]: osdmap e49: 6 total, 5 up, 6 in 2024-09-18T12:54:15.492 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:15 smithi078 podman[116866]: 2024-09-18 12:54:15.270130476 +0000 UTC m=+0.640285717 container remove f634ad9ddb36cbef5393cf05196a05573373a15bdd70e7fe320444c460746634 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-18T12:54:15.890 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:15 smithi078 podman[116955]: 2024-09-18 12:54:15.499452325 +0000 UTC m=+0.016472025 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:54:15.891 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:15 smithi078 podman[116955]: 2024-09-18 12:54:15.637719421 +0000 UTC m=+0.154739107 container create 17eca652e29bba932b60677caed42df8246b3327af8f32af5b71d6e5a68f3108 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-18T12:54:15.891 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:15 smithi078 podman[116955]: 2024-09-18 12:54:15.890451685 +0000 UTC m=+0.407471378 container init 17eca652e29bba932b60677caed42df8246b3327af8f32af5b71d6e5a68f3108 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:54:16.196 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:15 smithi078 podman[116955]: 2024-09-18 12:54:15.894037342 +0000 UTC m=+0.411057030 container start 17eca652e29bba932b60677caed42df8246b3327af8f32af5b71d6e5a68f3108 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:54:16.196 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:15 smithi078 podman[116955]: 2024-09-18 12:54:15.97372854 +0000 UTC m=+0.490748241 container attach 17eca652e29bba932b60677caed42df8246b3327af8f32af5b71d6e5a68f3108 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:54:16.196 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:16 smithi078 podman[116955]: 2024-09-18 12:54:16.089183908 +0000 UTC m=+0.606203596 container died 17eca652e29bba932b60677caed42df8246b3327af8f32af5b71d6e5a68f3108 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:54:16.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:16 smithi148 ceph-mon[80030]: pgmap v119: 65 pgs: 9 stale+active+clean, 56 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:16.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:16 smithi078 ceph-mon[108578]: pgmap v119: 65 pgs: 9 stale+active+clean, 56 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:17.242 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:16 smithi078 podman[116978]: 2024-09-18 12:54:16.811317684 +0000 UTC m=+0.715553564 container remove 17eca652e29bba932b60677caed42df8246b3327af8f32af5b71d6e5a68f3108 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-18T12:54:17.242 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:16 smithi078 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-18T12:54:17.242 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:16 smithi078 systemd[1]: Stopped Ceph osd.0 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:54:17.242 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:16 smithi078 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.0.service: Consumed 52.292s CPU time. 2024-09-18T12:54:17.242 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:17 smithi078 systemd[1]: Starting Ceph osd.0 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:54:17.532 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:17 smithi078 ceph-mon[108578]: Health check failed: Degraded data redundancy: 65/333 objects degraded (19.520%), 20 pgs degraded (PG_DEGRADED) 2024-09-18T12:54:17.532 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:17 smithi078 podman[117077]: 2024-09-18 12:54:17.158639604 +0000 UTC m=+0.016471147 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:54:17.533 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:17 smithi078 podman[117077]: 2024-09-18 12:54:17.295915076 +0000 UTC m=+0.153746601 container create 05ac4d3f83fcb97d711a0b7aaabedb1b11ad0b20244266d1e9664950968647b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:54:17.533 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:17 smithi078 podman[117077]: 2024-09-18 12:54:17.531994413 +0000 UTC m=+0.389825941 container init 05ac4d3f83fcb97d711a0b7aaabedb1b11ad0b20244266d1e9664950968647b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-18T12:54:17.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:17 smithi148 ceph-mon[80030]: Health check failed: Degraded data redundancy: 65/333 objects degraded (19.520%), 20 pgs degraded (PG_DEGRADED) 2024-09-18T12:54:17.992 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:17 smithi078 podman[117077]: 2024-09-18 12:54:17.535381889 +0000 UTC m=+0.393213415 container start 05ac4d3f83fcb97d711a0b7aaabedb1b11ad0b20244266d1e9664950968647b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-18T12:54:17.992 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:17 smithi078 podman[117077]: 2024-09-18 12:54:17.632046727 +0000 UTC m=+0.489878265 container attach 05ac4d3f83fcb97d711a0b7aaabedb1b11ad0b20244266d1e9664950968647b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-09-18T12:54:17.992 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:17 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-activate[117092]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:54:17.992 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:17 smithi078 bash[117077]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:54:17.992 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:17 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-activate[117092]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:54:17.992 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:17 smithi078 bash[117077]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:54:18.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:18 smithi078 ceph-mon[108578]: pgmap v121: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/333 objects degraded (19.520%) 2024-09-18T12:54:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:18 smithi148 ceph-mon[80030]: pgmap v121: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/333 objects degraded (19.520%) 2024-09-18T12:54:20.296 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:20 smithi078 ceph-mon[108578]: pgmap v122: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/333 objects degraded (19.520%) 2024-09-18T12:54:20.296 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:20 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-activate[117092]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T12:54:20.296 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:20 smithi078 bash[117077]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T12:54:20.297 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:20 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-activate[117092]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T12:54:20.297 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:20 smithi078 bash[117077]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T12:54:20.297 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:20 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-activate[117092]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T12:54:20.297 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:20 smithi078 bash[117077]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T12:54:20.645 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:20 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-activate[117092]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T12:54:20.645 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:20 smithi078 bash[117077]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T12:54:20.645 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:20 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-activate[117092]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-18T12:54:20.645 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:20 smithi078 bash[117077]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-18T12:54:20.645 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:20 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-activate[117092]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T12:54:20.646 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:20 smithi078 bash[117077]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T12:54:20.646 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:20 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-activate[117092]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-18T12:54:20.646 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:20 smithi078 bash[117077]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-18T12:54:20.646 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:20 smithi078 podman[117077]: 2024-09-18 12:54:20.331835247 +0000 UTC m=+3.189666782 container died 05ac4d3f83fcb97d711a0b7aaabedb1b11ad0b20244266d1e9664950968647b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=) 2024-09-18T12:54:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:20 smithi148 ceph-mon[80030]: pgmap v122: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/333 objects degraded (19.520%) 2024-09-18T12:54:21.305 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:21 smithi078 podman[117253]: 2024-09-18 12:54:21.036850698 +0000 UTC m=+0.693507737 container remove 05ac4d3f83fcb97d711a0b7aaabedb1b11ad0b20244266d1e9664950968647b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:54:21.305 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:21 smithi078 podman[117312]: 2024-09-18 12:54:21.157248343 +0000 UTC m=+0.018245729 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:54:21.305 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:21 smithi078 podman[117312]: 2024-09-18 12:54:21.304811723 +0000 UTC m=+0.165809132 container create 4aad8c6ec439e9dff988514c4949f5eaae02e8938b296476e76be49c5646a372 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:54:21.574 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:21 smithi078 podman[117312]: 2024-09-18 12:54:21.548863627 +0000 UTC m=+0.409860998 container init 4aad8c6ec439e9dff988514c4949f5eaae02e8938b296476e76be49c5646a372 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:54:21.574 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:21 smithi078 podman[117312]: 2024-09-18 12:54:21.55230878 +0000 UTC m=+0.413306147 container start 4aad8c6ec439e9dff988514c4949f5eaae02e8938b296476e76be49c5646a372 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-18T12:54:21.992 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:21 smithi078 ceph-osd[117332]: -- 172.21.15.78:0/2938695583 <== mon.0 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f105fe01e0 con 0x55f1051ebc00 2024-09-18T12:54:21.992 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:21 smithi078 bash[117312]: 4aad8c6ec439e9dff988514c4949f5eaae02e8938b296476e76be49c5646a372 2024-09-18T12:54:21.992 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:21 smithi078 systemd[1]: Started Ceph osd.0 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:54:22.545 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:22 smithi078 ceph-mon[108578]: pgmap v123: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/333 objects degraded (19.520%) 2024-09-18T12:54:22.545 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:22 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:22.545 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:22 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:22.545 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:22 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:22 smithi148 ceph-mon[80030]: pgmap v123: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/333 objects degraded (19.520%) 2024-09-18T12:54:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:22 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:22 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:22 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:23.492 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:23 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0[117328]: 2024-09-18T12:54:23.189+0000 7fd9a8c90640 -1 Falling back to public interface 2024-09-18T12:54:24.547 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:24 smithi078 ceph-mon[108578]: pgmap v124: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/333 objects degraded (19.520%) 2024-09-18T12:54:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:24 smithi148 ceph-mon[80030]: pgmap v124: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/333 objects degraded (19.520%) 2024-09-18T12:54:25.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.471+0000 7efcd9c96640 1 -- 172.21.15.78:0/311702781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4101900 msgr2=0x7efcd4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.471+0000 7efcd9c96640 1 --2- 172.21.15.78:0/311702781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4101900 0x7efcd4101d60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009880 tx=0x7efcc802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:54:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.471+0000 7efcd9c96640 1 -- 172.21.15.78:0/311702781 shutdown_connections 2024-09-18T12:54:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.471+0000 7efcd9c96640 1 --2- 172.21.15.78:0/311702781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4101900 0x7efcd4101d60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.471+0000 7efcd9c96640 1 --2- 172.21.15.78:0/311702781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcd4107900 0x7efcd4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.471+0000 7efcd9c96640 1 -- 172.21.15.78:0/311702781 >> 172.21.15.78:0/311702781 conn(0x7efcd40fd600 msgr2=0x7efcd40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.471+0000 7efcd9c96640 1 -- 172.21.15.78:0/311702781 shutdown_connections 2024-09-18T12:54:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.471+0000 7efcd9c96640 1 -- 172.21.15.78:0/311702781 wait complete. 2024-09-18T12:54:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.471+0000 7efcd9c96640 1 Processor -- start 2024-09-18T12:54:25.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.472+0000 7efcd9c96640 1 -- start start 2024-09-18T12:54:25.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.472+0000 7efcd9c96640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcd4101900 0x7efcd419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:25.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.472+0000 7efcd9c96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4107900 0x7efcd419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:25.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.472+0000 7efcd9c96640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efcd410ee30 con 0x7efcd4107900 2024-09-18T12:54:25.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.472+0000 7efcd9c96640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efcd410ecb0 con 0x7efcd4101900 2024-09-18T12:54:25.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.472+0000 7efcd2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4107900 0x7efcd419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:25.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.472+0000 7efcd2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4107900 0x7efcd419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48814/0 (socket says 172.21.15.78:48814) 2024-09-18T12:54:25.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.472+0000 7efcd2ffd640 1 -- 172.21.15.78:0/3148522382 learned_addr learned my addr 172.21.15.78:0/3148522382 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:54:25.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.472+0000 7efcd37fe640 1 --2- 172.21.15.78:0/3148522382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcd4101900 0x7efcd419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:25.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.472+0000 7efcd2ffd640 1 -- 172.21.15.78:0/3148522382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcd4101900 msgr2=0x7efcd419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:25.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.472+0000 7efcd2ffd640 1 --2- 172.21.15.78:0/3148522382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcd4101900 0x7efcd419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:25.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.472+0000 7efcd2ffd640 1 -- 172.21.15.78:0/3148522382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd4197840 con 0x7efcd4107900 2024-09-18T12:54:25.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.472+0000 7efcd37fe640 1 --2- 172.21.15.78:0/3148522382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcd4101900 0x7efcd419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:54:25.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.473+0000 7efcd2ffd640 1 --2- 172.21.15.78:0/3148522382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4107900 0x7efcd419dc00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efcc8031460 tx=0x7efcc80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:25.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.473+0000 7efcd0ff9640 1 -- 172.21.15.78:0/3148522382 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcc803f070 con 0x7efcd4107900 2024-09-18T12:54:25.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.473+0000 7efcd9c96640 1 -- 172.21.15.78:0/3148522382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd4197ad0 con 0x7efcd4107900 2024-09-18T12:54:25.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.473+0000 7efcd0ff9640 1 -- 172.21.15.78:0/3148522382 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efcc8004cf0 con 0x7efcd4107900 2024-09-18T12:54:25.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.473+0000 7efcd0ff9640 1 -- 172.21.15.78:0/3148522382 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcc8035030 con 0x7efcd4107900 2024-09-18T12:54:25.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.473+0000 7efcd9c96640 1 -- 172.21.15.78:0/3148522382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd4198000 con 0x7efcd4107900 2024-09-18T12:54:25.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.474+0000 7efcd9c96640 1 -- 172.21.15.78:0/3148522382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd4103040 con 0x7efcd4107900 2024-09-18T12:54:25.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.475+0000 7efcd0ff9640 1 -- 172.21.15.78:0/3148522382 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7efcc8042070 con 0x7efcd4107900 2024-09-18T12:54:25.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.475+0000 7efcd0ff9640 1 --2- 172.21.15.78:0/3148522382 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7efcbc07af30 0x7efcbc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:25.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.475+0000 7efcd0ff9640 1 -- 172.21.15.78:0/3148522382 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6070+0+0 (secure 0 0 0) 0x7efcc80beab0 con 0x7efcd4107900 2024-09-18T12:54:25.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.475+0000 7efcd37fe640 1 --2- 172.21.15.78:0/3148522382 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7efcbc07af30 0x7efcbc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:25.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.476+0000 7efcd37fe640 1 --2- 172.21.15.78:0/3148522382 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7efcbc07af30 0x7efcbc07d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efcc4006fd0 tx=0x7efcc4008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:25.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.480+0000 7efcd0ff9640 1 -- 172.21.15.78:0/3148522382 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7efcc808a100 con 0x7efcd4107900 2024-09-18T12:54:25.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.687+0000 7efcd9c96640 1 -- 172.21.15.78:0/3148522382 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efcd41982b0 con 0x7efcbc07af30 2024-09-18T12:54:25.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.688+0000 7efcd0ff9640 1 -- 172.21.15.78:0/3148522382 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7efcd41982b0 con 0x7efcbc07af30 2024-09-18T12:54:25.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.691+0000 7efcd9c96640 1 -- 172.21.15.78:0/3148522382 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7efcbc07af30 msgr2=0x7efcbc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:25.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.691+0000 7efcd9c96640 1 --2- 172.21.15.78:0/3148522382 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7efcbc07af30 0x7efcbc07d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efcc4006fd0 tx=0x7efcc4008040 comp rx=0 tx=0).stop 2024-09-18T12:54:25.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.691+0000 7efcd9c96640 1 -- 172.21.15.78:0/3148522382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4107900 msgr2=0x7efcd419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:25.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.691+0000 7efcd9c96640 1 --2- 172.21.15.78:0/3148522382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4107900 0x7efcd419dc00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efcc8031460 tx=0x7efcc80048f0 comp rx=0 tx=0).stop 2024-09-18T12:54:25.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.691+0000 7efcd9c96640 1 -- 172.21.15.78:0/3148522382 shutdown_connections 2024-09-18T12:54:25.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.691+0000 7efcd9c96640 1 --2- 172.21.15.78:0/3148522382 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7efcbc07af30 0x7efcbc07d3f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:25.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.691+0000 7efcd9c96640 1 --2- 172.21.15.78:0/3148522382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4107900 0x7efcd419dc00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:25.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.691+0000 7efcd9c96640 1 --2- 172.21.15.78:0/3148522382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcd4101900 0x7efcd419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:25.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.691+0000 7efcd9c96640 1 -- 172.21.15.78:0/3148522382 >> 172.21.15.78:0/3148522382 conn(0x7efcd40fd600 msgr2=0x7efcd40fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:25.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.691+0000 7efcd9c96640 1 -- 172.21.15.78:0/3148522382 shutdown_connections 2024-09-18T12:54:25.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.691+0000 7efcd9c96640 1 -- 172.21.15.78:0/3148522382 wait complete. 2024-09-18T12:54:25.701 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:54:25.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.781+0000 7f18131ca640 1 -- 172.21.15.78:0/779352687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c1007f0 msgr2=0x7f180c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:25.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.781+0000 7f18131ca640 1 --2- 172.21.15.78:0/779352687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c1007f0 0x7f180c100c50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009880 tx=0x7f17f802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:54:25.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.781+0000 7f18131ca640 1 -- 172.21.15.78:0/779352687 shutdown_connections 2024-09-18T12:54:25.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.781+0000 7f18131ca640 1 --2- 172.21.15.78:0/779352687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c1007f0 0x7f180c100c50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:25.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.781+0000 7f18131ca640 1 --2- 172.21.15.78:0/779352687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f180c1067f0 0x7f180c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:25.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.781+0000 7f18131ca640 1 -- 172.21.15.78:0/779352687 >> 172.21.15.78:0/779352687 conn(0x7f180c0fc4d0 msgr2=0x7f180c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:25.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.781+0000 7f18131ca640 1 -- 172.21.15.78:0/779352687 shutdown_connections 2024-09-18T12:54:25.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.781+0000 7f18131ca640 1 -- 172.21.15.78:0/779352687 wait complete. 2024-09-18T12:54:25.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.782+0000 7f18131ca640 1 Processor -- start 2024-09-18T12:54:25.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.782+0000 7f18131ca640 1 -- start start 2024-09-18T12:54:25.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.782+0000 7f18131ca640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c1007f0 0x7f180c19f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:25.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.782+0000 7f18131ca640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f180c1067f0 0x7f180c19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:25.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.782+0000 7f18131ca640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f180c10dca0 con 0x7f180c1007f0 2024-09-18T12:54:25.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.782+0000 7f18131ca640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f180c10db20 con 0x7f180c1067f0 2024-09-18T12:54:25.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.782+0000 7f1810f66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c1007f0 0x7f180c19f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:25.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.782+0000 7f1810f66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c1007f0 0x7f180c19f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48832/0 (socket says 172.21.15.78:48832) 2024-09-18T12:54:25.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.782+0000 7f1810f66640 1 -- 172.21.15.78:0/2064922134 learned_addr learned my addr 172.21.15.78:0/2064922134 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:54:25.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.782+0000 7f180bfff640 1 --2- 172.21.15.78:0/2064922134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f180c1067f0 0x7f180c19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:25.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.782+0000 7f1810f66640 1 -- 172.21.15.78:0/2064922134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f180c1067f0 msgr2=0x7f180c19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:25.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.782+0000 7f1810f66640 1 --2- 172.21.15.78:0/2064922134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f180c1067f0 0x7f180c19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:25.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.782+0000 7f1810f66640 1 -- 172.21.15.78:0/2064922134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180c1a03e0 con 0x7f180c1007f0 2024-09-18T12:54:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.783+0000 7f1810f66640 1 --2- 172.21.15.78:0/2064922134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c1007f0 0x7f180c19f7f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f180000c8a0 tx=0x7f180000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.783+0000 7f1809ffb640 1 -- 172.21.15.78:0/2064922134 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18000079b0 con 0x7f180c1007f0 2024-09-18T12:54:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.783+0000 7f1809ffb640 1 -- 172.21.15.78:0/2064922134 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1800007b50 con 0x7f180c1007f0 2024-09-18T12:54:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.783+0000 7f18131ca640 1 -- 172.21.15.78:0/2064922134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f180c199ad0 con 0x7f180c1007f0 2024-09-18T12:54:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.783+0000 7f1809ffb640 1 -- 172.21.15.78:0/2064922134 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1800018700 con 0x7f180c1007f0 2024-09-18T12:54:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.783+0000 7f18131ca640 1 -- 172.21.15.78:0/2064922134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f180c19a030 con 0x7f180c1007f0 2024-09-18T12:54:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.784+0000 7f18131ca640 1 -- 172.21.15.78:0/2064922134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f180c101f30 con 0x7f180c1007f0 2024-09-18T12:54:25.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.785+0000 7f1809ffb640 1 -- 172.21.15.78:0/2064922134 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1800007d00 con 0x7f180c1007f0 2024-09-18T12:54:25.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.785+0000 7f1809ffb640 1 --2- 172.21.15.78:0/2064922134 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17fc07af80 0x7f17fc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:25.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.785+0000 7f1809ffb640 1 -- 172.21.15.78:0/2064922134 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6070+0+0 (secure 0 0 0) 0x7f180009e200 con 0x7f180c1007f0 2024-09-18T12:54:25.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.785+0000 7f180bfff640 1 --2- 172.21.15.78:0/2064922134 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17fc07af80 0x7f17fc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:25.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.786+0000 7f180bfff640 1 --2- 172.21.15.78:0/2064922134 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17fc07af80 0x7f17fc07d440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f180c19b1a0 tx=0x7f17f8031420 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:25.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.790+0000 7f1809ffb640 1 -- 172.21.15.78:0/2064922134 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1800014030 con 0x7f180c1007f0 2024-09-18T12:54:25.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.991+0000 7f18131ca640 1 -- 172.21.15.78:0/2064922134 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f180c19a380 con 0x7f17fc07af80 2024-09-18T12:54:25.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.992+0000 7f1809ffb640 1 -- 172.21.15.78:0/2064922134 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f180c19a380 con 0x7f17fc07af80 2024-09-18T12:54:25.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.994+0000 7f18131ca640 1 -- 172.21.15.78:0/2064922134 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17fc07af80 msgr2=0x7f17fc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:25.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.994+0000 7f18131ca640 1 --2- 172.21.15.78:0/2064922134 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17fc07af80 0x7f17fc07d440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f180c19b1a0 tx=0x7f17f8031420 comp rx=0 tx=0).stop 2024-09-18T12:54:25.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.994+0000 7f18131ca640 1 -- 172.21.15.78:0/2064922134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c1007f0 msgr2=0x7f180c19f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:25.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.994+0000 7f18131ca640 1 --2- 172.21.15.78:0/2064922134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c1007f0 0x7f180c19f7f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f180000c8a0 tx=0x7f180000cd60 comp rx=0 tx=0).stop 2024-09-18T12:54:25.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.994+0000 7f18131ca640 1 -- 172.21.15.78:0/2064922134 shutdown_connections 2024-09-18T12:54:25.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.994+0000 7f18131ca640 1 --2- 172.21.15.78:0/2064922134 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17fc07af80 0x7f17fc07d440 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:25.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.994+0000 7f18131ca640 1 --2- 172.21.15.78:0/2064922134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f180c1067f0 0x7f180c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:25.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.994+0000 7f18131ca640 1 --2- 172.21.15.78:0/2064922134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c1007f0 0x7f180c19f7f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:25.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.994+0000 7f18131ca640 1 -- 172.21.15.78:0/2064922134 >> 172.21.15.78:0/2064922134 conn(0x7f180c0fc4d0 msgr2=0x7f180c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:25.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.995+0000 7f18131ca640 1 -- 172.21.15.78:0/2064922134 shutdown_connections 2024-09-18T12:54:25.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:25.995+0000 7f18131ca640 1 -- 172.21.15.78:0/2064922134 wait complete. 2024-09-18T12:54:26.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.084+0000 7fa31659a640 1 -- 172.21.15.78:0/187211174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa310074f40 msgr2=0x7fa31010dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:26.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.084+0000 7fa31659a640 1 --2- 172.21.15.78:0/187211174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa310074f40 0x7fa31010dc00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa304009880 tx=0x7fa30402a530 comp rx=0 tx=0).stop 2024-09-18T12:54:26.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.084+0000 7fa31659a640 1 -- 172.21.15.78:0/187211174 shutdown_connections 2024-09-18T12:54:26.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.084+0000 7fa31659a640 1 --2- 172.21.15.78:0/187211174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa310074f40 0x7fa31010dc00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.084+0000 7fa31659a640 1 --2- 172.21.15.78:0/187211174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa310074620 0x7fa310074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.084+0000 7fa31659a640 1 -- 172.21.15.78:0/187211174 >> 172.21.15.78:0/187211174 conn(0x7fa3100fd600 msgr2=0x7fa3100ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:26.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.084+0000 7fa31659a640 1 -- 172.21.15.78:0/187211174 shutdown_connections 2024-09-18T12:54:26.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.084+0000 7fa31659a640 1 -- 172.21.15.78:0/187211174 wait complete. 2024-09-18T12:54:26.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.084+0000 7fa31659a640 1 Processor -- start 2024-09-18T12:54:26.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.084+0000 7fa31659a640 1 -- start start 2024-09-18T12:54:26.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.085+0000 7fa31659a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa310074620 0x7fa31019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:26.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.085+0000 7fa31659a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa310074f40 0x7fa31019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:26.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.085+0000 7fa31659a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa310110ff0 con 0x7fa310074620 2024-09-18T12:54:26.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.085+0000 7fa31659a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa310110e70 con 0x7fa310074f40 2024-09-18T12:54:26.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.085+0000 7fa30ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa310074620 0x7fa31019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:26.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.085+0000 7fa30ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa310074620 0x7fa31019f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48854/0 (socket says 172.21.15.78:48854) 2024-09-18T12:54:26.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.085+0000 7fa30ffff640 1 -- 172.21.15.78:0/1868967726 learned_addr learned my addr 172.21.15.78:0/1868967726 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:54:26.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.085+0000 7fa30f7fe640 1 --2- 172.21.15.78:0/1868967726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa310074f40 0x7fa31019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:26.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.085+0000 7fa30ffff640 1 -- 172.21.15.78:0/1868967726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa310074f40 msgr2=0x7fa31019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:26.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.085+0000 7fa30ffff640 1 --2- 172.21.15.78:0/1868967726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa310074f40 0x7fa31019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.085+0000 7fa30ffff640 1 -- 172.21.15.78:0/1868967726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa310199a20 con 0x7fa310074620 2024-09-18T12:54:26.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.085+0000 7fa30f7fe640 1 --2- 172.21.15.78:0/1868967726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa310074f40 0x7fa31019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:54:26.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.085+0000 7fa30ffff640 1 --2- 172.21.15.78:0/1868967726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa310074620 0x7fa31019f860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa30000c8f0 tx=0x7fa30000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:26.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.086+0000 7fa30d7fa640 1 -- 172.21.15.78:0/1868967726 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa3000079b0 con 0x7fa310074620 2024-09-18T12:54:26.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.086+0000 7fa30d7fa640 1 -- 172.21.15.78:0/1868967726 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa3000054e0 con 0x7fa310074620 2024-09-18T12:54:26.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.086+0000 7fa31659a640 1 -- 172.21.15.78:0/1868967726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa310199d10 con 0x7fa310074620 2024-09-18T12:54:26.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.086+0000 7fa30d7fa640 1 -- 172.21.15.78:0/1868967726 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa300004dd0 con 0x7fa310074620 2024-09-18T12:54:26.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.086+0000 7fa31659a640 1 -- 172.21.15.78:0/1868967726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa31019a270 con 0x7fa310074620 2024-09-18T12:54:26.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.087+0000 7fa31659a640 1 -- 172.21.15.78:0/1868967726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa310075cd0 con 0x7fa310074620 2024-09-18T12:54:26.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.087+0000 7fa30d7fa640 1 -- 172.21.15.78:0/1868967726 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa300005020 con 0x7fa310074620 2024-09-18T12:54:26.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.088+0000 7fa30d7fa640 1 --2- 172.21.15.78:0/1868967726 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa2f807aed0 0x7fa2f807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:26.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.088+0000 7fa30f7fe640 1 --2- 172.21.15.78:0/1868967726 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa2f807aed0 0x7fa2f807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:26.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.088+0000 7fa30d7fa640 1 -- 172.21.15.78:0/1868967726 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6070+0+0 (secure 0 0 0) 0x7fa30009df90 con 0x7fa310074620 2024-09-18T12:54:26.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.088+0000 7fa30f7fe640 1 --2- 172.21.15.78:0/1868967726 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa2f807aed0 0x7fa2f807d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa31019b210 tx=0x7fa304009560 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:26.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.092+0000 7fa30d7fa640 1 -- 172.21.15.78:0/1868967726 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa300014030 con 0x7fa310074620 2024-09-18T12:54:26.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.300+0000 7fa31659a640 1 -- 172.21.15.78:0/1868967726 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa31019af50 con 0x7fa2f807aed0 2024-09-18T12:54:26.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.309+0000 7fa30d7fa640 1 -- 172.21.15.78:0/1868967726 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fa31019af50 con 0x7fa2f807aed0 2024-09-18T12:54:26.311 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:54:26.311 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (2m) 21s ago 13m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T12:54:26.311 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (4m) 21s ago 13m 8786k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:54:26.311 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (4m) 23s ago 12m 8292k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:54:26.311 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (31s) 21s ago 13m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T12:54:26.311 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (26s) 23s ago 12m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T12:54:26.311 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (113s) 21s ago 13m 73.5M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T12:54:26.311 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (7m) 21s ago 7m 150M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:54:26.311 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (7m) 21s ago 7m 27.9M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:54:26.311 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (7m) 23s ago 7m 16.2M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:54:26.311 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (7m) 23s ago 7m 17.0M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:54:26.312 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (4m) 21s ago 14m 521M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:54:26.312 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (3m) 23s ago 12m 454M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:54:26.312 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (59s) 21s ago 14m 37.6M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T12:54:26.312 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (42s) 23s ago 12m 26.4M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T12:54:26.312 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (3m) 21s ago 13m 10.8M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:54:26.312 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (2m) 23s ago 12m 11.4M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:54:26.312 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 starting - - - 1216M 2024-09-18T12:54:26.312 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (10m) 21s ago 10m 222M 1216M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:54:26.312 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (10m) 21s ago 10m 180M 1216M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:54:26.312 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (9m) 23s ago 9m 237M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:54:26.312 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (9m) 23s ago 9m 208M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:54:26.312 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (8m) 23s ago 8m 196M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:54:26.312 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (2m) 21s ago 12m 49.7M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:54:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.311+0000 7fa31659a640 1 -- 172.21.15.78:0/1868967726 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa2f807aed0 msgr2=0x7fa2f807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.311+0000 7fa31659a640 1 --2- 172.21.15.78:0/1868967726 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa2f807aed0 0x7fa2f807d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa31019b210 tx=0x7fa304009560 comp rx=0 tx=0).stop 2024-09-18T12:54:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.311+0000 7fa31659a640 1 -- 172.21.15.78:0/1868967726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa310074620 msgr2=0x7fa31019f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.311+0000 7fa31659a640 1 --2- 172.21.15.78:0/1868967726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa310074620 0x7fa31019f860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa30000c8f0 tx=0x7fa30000cdb0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.311+0000 7fa31659a640 1 -- 172.21.15.78:0/1868967726 shutdown_connections 2024-09-18T12:54:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.311+0000 7fa31659a640 1 --2- 172.21.15.78:0/1868967726 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa2f807aed0 0x7fa2f807d390 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.311+0000 7fa31659a640 1 --2- 172.21.15.78:0/1868967726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa310074f40 0x7fa31019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.311+0000 7fa31659a640 1 --2- 172.21.15.78:0/1868967726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa310074620 0x7fa31019f860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.311+0000 7fa31659a640 1 -- 172.21.15.78:0/1868967726 >> 172.21.15.78:0/1868967726 conn(0x7fa3100fd600 msgr2=0x7fa31010b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.312+0000 7fa31659a640 1 -- 172.21.15.78:0/1868967726 shutdown_connections 2024-09-18T12:54:26.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.312+0000 7fa31659a640 1 -- 172.21.15.78:0/1868967726 wait complete. 2024-09-18T12:54:26.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.393+0000 7f5ae0b2f640 1 -- 172.21.15.78:0/1530649456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc107900 msgr2=0x7f5adc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:26.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.393+0000 7f5ae0b2f640 1 --2- 172.21.15.78:0/1530649456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc107900 0x7f5adc107ce0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009880 tx=0x7f5acc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.393+0000 7f5ae0b2f640 1 -- 172.21.15.78:0/1530649456 shutdown_connections 2024-09-18T12:54:26.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.393+0000 7f5ae0b2f640 1 --2- 172.21.15.78:0/1530649456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5adc101900 0x7f5adc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.393+0000 7f5ae0b2f640 1 --2- 172.21.15.78:0/1530649456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc107900 0x7f5adc107ce0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.393+0000 7f5ae0b2f640 1 -- 172.21.15.78:0/1530649456 >> 172.21.15.78:0/1530649456 conn(0x7f5adc0fd600 msgr2=0x7f5adc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:26.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.393+0000 7f5ae0b2f640 1 -- 172.21.15.78:0/1530649456 shutdown_connections 2024-09-18T12:54:26.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.393+0000 7f5ae0b2f640 1 -- 172.21.15.78:0/1530649456 wait complete. 2024-09-18T12:54:26.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.394+0000 7f5ae0b2f640 1 Processor -- start 2024-09-18T12:54:26.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.394+0000 7f5ae0b2f640 1 -- start start 2024-09-18T12:54:26.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.394+0000 7f5ae0b2f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc101900 0x7f5adc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:26.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.394+0000 7f5ae0b2f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5adc107900 0x7f5adc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:26.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.394+0000 7f5ae0b2f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc10edb0 con 0x7f5adc101900 2024-09-18T12:54:26.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.394+0000 7f5ae0b2f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc10ec30 con 0x7f5adc107900 2024-09-18T12:54:26.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.394+0000 7f5ada59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc101900 0x7f5adc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:26.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.394+0000 7f5ada59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc101900 0x7f5adc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48872/0 (socket says 172.21.15.78:48872) 2024-09-18T12:54:26.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.394+0000 7f5ada59c640 1 -- 172.21.15.78:0/170284900 learned_addr learned my addr 172.21.15.78:0/170284900 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:54:26.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.395+0000 7f5ad9d9b640 1 --2- 172.21.15.78:0/170284900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5adc107900 0x7f5adc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:26.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.395+0000 7f5ada59c640 1 -- 172.21.15.78:0/170284900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5adc107900 msgr2=0x7f5adc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:26.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.395+0000 7f5ada59c640 1 --2- 172.21.15.78:0/170284900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5adc107900 0x7f5adc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.395+0000 7f5ada59c640 1 -- 172.21.15.78:0/170284900 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5adc074f70 con 0x7f5adc101900 2024-09-18T12:54:26.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.395+0000 7f5ad9d9b640 1 --2- 172.21.15.78:0/170284900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5adc107900 0x7f5adc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:54:26.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.395+0000 7f5ada59c640 1 --2- 172.21.15.78:0/170284900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc101900 0x7f5adc0744f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5acc031460 tx=0x7f5acc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:26.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.395+0000 7f5acb7fe640 1 -- 172.21.15.78:0/170284900 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5acc03f070 con 0x7f5adc101900 2024-09-18T12:54:26.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.395+0000 7f5acb7fe640 1 -- 172.21.15.78:0/170284900 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5acc0035f0 con 0x7f5adc101900 2024-09-18T12:54:26.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.395+0000 7f5ae0b2f640 1 -- 172.21.15.78:0/170284900 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5adc075200 con 0x7f5adc101900 2024-09-18T12:54:26.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.395+0000 7f5acb7fe640 1 -- 172.21.15.78:0/170284900 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5acc035030 con 0x7f5adc101900 2024-09-18T12:54:26.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.395+0000 7f5ae0b2f640 1 -- 172.21.15.78:0/170284900 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5adc1a3d80 con 0x7f5adc101900 2024-09-18T12:54:26.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.396+0000 7f5ae0b2f640 1 -- 172.21.15.78:0/170284900 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5adc103040 con 0x7f5adc101900 2024-09-18T12:54:26.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.397+0000 7f5acb7fe640 1 -- 172.21.15.78:0/170284900 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5acc042070 con 0x7f5adc101900 2024-09-18T12:54:26.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.397+0000 7f5acb7fe640 1 --2- 172.21.15.78:0/170284900 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5ac407af30 0x7f5ac407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:26.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.397+0000 7f5acb7fe640 1 -- 172.21.15.78:0/170284900 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6070+0+0 (secure 0 0 0) 0x7f5acc0be9d0 con 0x7f5adc101900 2024-09-18T12:54:26.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.397+0000 7f5ad9d9b640 1 --2- 172.21.15.78:0/170284900 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5ac407af30 0x7f5ac407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:26.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.398+0000 7f5ad9d9b640 1 --2- 172.21.15.78:0/170284900 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5ac407af30 0x7f5ac407d3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00058c0 tx=0x7f5ad0005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:26.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.402+0000 7f5acb7fe640 1 -- 172.21.15.78:0/170284900 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5acc08a020 con 0x7f5adc101900 2024-09-18T12:54:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:26 smithi148 ceph-mon[80030]: pgmap v125: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/333 objects degraded (19.520%) 2024-09-18T12:54:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:26 smithi078 ceph-mon[108578]: pgmap v125: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/333 objects degraded (19.520%) 2024-09-18T12:54:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:26.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.772+0000 7f5ae0b2f640 1 -- 172.21.15.78:0/170284900 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5adc104b10 con 0x7f5adc101900 2024-09-18T12:54:26.774 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:54:26.774 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:54:26.774 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:54:26.774 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:54:26.774 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:54:26.774 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:54:26.774 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:54:26.774 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:54:26.774 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5 2024-09-18T12:54:26.774 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:54:26.774 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:54:26.775 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:54:26.775 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:54:26.775 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:54:26.775 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 9, 2024-09-18T12:54:26.775 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T12:54:26.775 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:54:26.775 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:54:26.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.772+0000 7f5acb7fe640 1 -- 172.21.15.78:0/170284900 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+732 (secure 0 0 0) 0x7f5acc08c070 con 0x7f5adc101900 2024-09-18T12:54:26.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.775+0000 7f5ae0b2f640 1 -- 172.21.15.78:0/170284900 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5ac407af30 msgr2=0x7f5ac407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.775+0000 7f5ae0b2f640 1 --2- 172.21.15.78:0/170284900 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5ac407af30 0x7f5ac407d3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00058c0 tx=0x7f5ad0005850 comp rx=0 tx=0).stop 2024-09-18T12:54:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.775+0000 7f5ae0b2f640 1 -- 172.21.15.78:0/170284900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc101900 msgr2=0x7f5adc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.775+0000 7f5ae0b2f640 1 --2- 172.21.15.78:0/170284900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc101900 0x7f5adc0744f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5acc031460 tx=0x7f5acc0045e0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.775+0000 7f5ae0b2f640 1 -- 172.21.15.78:0/170284900 shutdown_connections 2024-09-18T12:54:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.775+0000 7f5ae0b2f640 1 --2- 172.21.15.78:0/170284900 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5ac407af30 0x7f5ac407d3f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.775+0000 7f5ae0b2f640 1 --2- 172.21.15.78:0/170284900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5adc107900 0x7f5adc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.775+0000 7f5ae0b2f640 1 --2- 172.21.15.78:0/170284900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5adc101900 0x7f5adc0744f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.775+0000 7f5ae0b2f640 1 -- 172.21.15.78:0/170284900 >> 172.21.15.78:0/170284900 conn(0x7f5adc0fd600 msgr2=0x7f5adc0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.775+0000 7f5ae0b2f640 1 -- 172.21.15.78:0/170284900 shutdown_connections 2024-09-18T12:54:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.775+0000 7f5ae0b2f640 1 -- 172.21.15.78:0/170284900 wait complete. 2024-09-18T12:54:26.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.858+0000 7ff38ac10640 1 -- 172.21.15.78:0/3660468765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3841007f0 msgr2=0x7ff384100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:26.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.858+0000 7ff38ac10640 1 --2- 172.21.15.78:0/3660468765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3841007f0 0x7ff384100c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff370009880 tx=0x7ff37002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.858+0000 7ff38ac10640 1 -- 172.21.15.78:0/3660468765 shutdown_connections 2024-09-18T12:54:26.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.858+0000 7ff38ac10640 1 --2- 172.21.15.78:0/3660468765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3841007f0 0x7ff384100c50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.858+0000 7ff38ac10640 1 --2- 172.21.15.78:0/3660468765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3841067f0 0x7ff384106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.858+0000 7ff38ac10640 1 -- 172.21.15.78:0/3660468765 >> 172.21.15.78:0/3660468765 conn(0x7ff3840fc550 msgr2=0x7ff3840fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:26.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.858+0000 7ff38ac10640 1 -- 172.21.15.78:0/3660468765 shutdown_connections 2024-09-18T12:54:26.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.858+0000 7ff38ac10640 1 -- 172.21.15.78:0/3660468765 wait complete. 2024-09-18T12:54:26.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.858+0000 7ff38ac10640 1 Processor -- start 2024-09-18T12:54:26.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.858+0000 7ff38ac10640 1 -- start start 2024-09-18T12:54:26.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.859+0000 7ff38ac10640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3841007f0 0x7ff38419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:26.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.859+0000 7ff38ac10640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3841067f0 0x7ff38419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:26.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.859+0000 7ff38ac10640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff38410dcc0 con 0x7ff3841067f0 2024-09-18T12:54:26.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.859+0000 7ff38ac10640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff38410db40 con 0x7ff3841007f0 2024-09-18T12:54:26.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.859+0000 7ff383fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3841067f0 0x7ff38419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:26.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.859+0000 7ff383fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3841067f0 0x7ff38419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48892/0 (socket says 172.21.15.78:48892) 2024-09-18T12:54:26.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.859+0000 7ff383fff640 1 -- 172.21.15.78:0/1015749491 learned_addr learned my addr 172.21.15.78:0/1015749491 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:54:26.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.859+0000 7ff3889ac640 1 --2- 172.21.15.78:0/1015749491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3841007f0 0x7ff38419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:26.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.859+0000 7ff383fff640 1 -- 172.21.15.78:0/1015749491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3841007f0 msgr2=0x7ff38419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:26.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.859+0000 7ff383fff640 1 --2- 172.21.15.78:0/1015749491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3841007f0 0x7ff38419d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:26.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.859+0000 7ff383fff640 1 -- 172.21.15.78:0/1015749491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3841977e0 con 0x7ff3841067f0 2024-09-18T12:54:26.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.859+0000 7ff383fff640 1 --2- 172.21.15.78:0/1015749491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3841067f0 0x7ff38419dba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff370031460 tx=0x7ff3700045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:26.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.859+0000 7ff381ffb640 1 -- 172.21.15.78:0/1015749491 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff37003f070 con 0x7ff3841067f0 2024-09-18T12:54:26.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.860+0000 7ff38ac10640 1 -- 172.21.15.78:0/1015749491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff384197a70 con 0x7ff3841067f0 2024-09-18T12:54:26.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.860+0000 7ff381ffb640 1 -- 172.21.15.78:0/1015749491 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff3700035f0 con 0x7ff3841067f0 2024-09-18T12:54:26.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.860+0000 7ff381ffb640 1 -- 172.21.15.78:0/1015749491 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff370035030 con 0x7ff3841067f0 2024-09-18T12:54:26.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.860+0000 7ff38ac10640 1 -- 172.21.15.78:0/1015749491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff384197fa0 con 0x7ff3841067f0 2024-09-18T12:54:26.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.861+0000 7ff38ac10640 1 -- 172.21.15.78:0/1015749491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff384101f30 con 0x7ff3841067f0 2024-09-18T12:54:26.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.863+0000 7ff381ffb640 1 -- 172.21.15.78:0/1015749491 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff370042070 con 0x7ff3841067f0 2024-09-18T12:54:26.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.863+0000 7ff381ffb640 1 --2- 172.21.15.78:0/1015749491 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff37407af30 0x7ff37407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:26.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.863+0000 7ff381ffb640 1 -- 172.21.15.78:0/1015749491 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6070+0+0 (secure 0 0 0) 0x7ff3700bef30 con 0x7ff3841067f0 2024-09-18T12:54:26.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.863+0000 7ff3889ac640 1 --2- 172.21.15.78:0/1015749491 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff37407af30 0x7ff37407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:26.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.864+0000 7ff3889ac640 1 --2- 172.21.15.78:0/1015749491 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff37407af30 0x7ff37407d3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff378005fd0 tx=0x7ff37800b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:26.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:26.866+0000 7ff381ffb640 1 -- 172.21.15.78:0/1015749491 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff37008a600 con 0x7ff3841067f0 2024-09-18T12:54:27.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.097+0000 7ff38ac10640 1 -- 172.21.15.78:0/1015749491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff384109d70 con 0x7ff3841067f0 2024-09-18T12:54:27.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.097+0000 7ff381ffb640 1 -- 172.21.15.78:0/1015749491 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) ==== 76+0+2032 (secure 0 0 0) 0x7ff37008f4b0 con 0x7ff3841067f0 2024-09-18T12:54:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:e18 2024-09-18T12:54:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:46:44:251409+0000 2024-09-18T12:54:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:54:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:54:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T12:54:27.099 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:54:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:54:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T12:54:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 18 2024-09-18T12:54:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:54:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:54:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:46:44.251398+0000 2024-09-18T12:54:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T12:54:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T12:54:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T12:54:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T12:54:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T12:54:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T12:54:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T12:54:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T12:54:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 45 2024-09-18T12:54:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:54:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T12:54:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T12:54:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:up {0=14560,1=14574} 2024-09-18T12:54:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:failed 2024-09-18T12:54:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T12:54:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T12:54:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T12:54:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T12:54:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T12:54:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T12:54:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T12:54:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T12:54:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 14560 members: 14560,14574 2024-09-18T12:54:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{0:14560} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:54:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{1:14574} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:54:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:54:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:54:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T12:54:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:54:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:54:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/258027429,v1:172.21.15.148:6825/258027429] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:54:27.103 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 18 2024-09-18T12:54:27.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.101+0000 7ff38ac10640 1 -- 172.21.15.78:0/1015749491 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff37407af30 msgr2=0x7ff37407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:27.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.101+0000 7ff38ac10640 1 --2- 172.21.15.78:0/1015749491 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff37407af30 0x7ff37407d3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff378005fd0 tx=0x7ff37800b390 comp rx=0 tx=0).stop 2024-09-18T12:54:27.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.101+0000 7ff38ac10640 1 -- 172.21.15.78:0/1015749491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3841067f0 msgr2=0x7ff38419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:27.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.101+0000 7ff38ac10640 1 --2- 172.21.15.78:0/1015749491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3841067f0 0x7ff38419dba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff370031460 tx=0x7ff3700045e0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.101+0000 7ff38ac10640 1 -- 172.21.15.78:0/1015749491 shutdown_connections 2024-09-18T12:54:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.101+0000 7ff38ac10640 1 --2- 172.21.15.78:0/1015749491 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff37407af30 0x7ff37407d3f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.101+0000 7ff38ac10640 1 --2- 172.21.15.78:0/1015749491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3841067f0 0x7ff38419dba0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.101+0000 7ff38ac10640 1 --2- 172.21.15.78:0/1015749491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3841007f0 0x7ff38419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.101+0000 7ff38ac10640 1 -- 172.21.15.78:0/1015749491 >> 172.21.15.78:0/1015749491 conn(0x7ff3840fc550 msgr2=0x7ff384069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.101+0000 7ff38ac10640 1 -- 172.21.15.78:0/1015749491 shutdown_connections 2024-09-18T12:54:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.101+0000 7ff38ac10640 1 -- 172.21.15.78:0/1015749491 wait complete. 2024-09-18T12:54:27.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.198+0000 7f99783ac640 1 -- 172.21.15.78:0/207914014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99701007f0 msgr2=0x7f9970100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:27.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.198+0000 7f99783ac640 1 --2- 172.21.15.78:0/207914014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99701007f0 0x7f9970100c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9960009880 tx=0x7f996002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.198+0000 7f99783ac640 1 -- 172.21.15.78:0/207914014 shutdown_connections 2024-09-18T12:54:27.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.198+0000 7f99783ac640 1 --2- 172.21.15.78:0/207914014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99701007f0 0x7f9970100c50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.198+0000 7f99783ac640 1 --2- 172.21.15.78:0/207914014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99701067f0 0x7f9970106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.198+0000 7f99783ac640 1 -- 172.21.15.78:0/207914014 >> 172.21.15.78:0/207914014 conn(0x7f99700fc550 msgr2=0x7f99700fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:27.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.199+0000 7f99783ac640 1 -- 172.21.15.78:0/207914014 shutdown_connections 2024-09-18T12:54:27.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.199+0000 7f99783ac640 1 -- 172.21.15.78:0/207914014 wait complete. 2024-09-18T12:54:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.199+0000 7f99783ac640 1 Processor -- start 2024-09-18T12:54:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.199+0000 7f99783ac640 1 -- start start 2024-09-18T12:54:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.200+0000 7f99783ac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99701007f0 0x7f99700fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.200+0000 7f99783ac640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99701067f0 0x7f99700fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.200+0000 7f99783ac640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f997010dca0 con 0x7f99701007f0 2024-09-18T12:54:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.200+0000 7f99783ac640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f997010db20 con 0x7f99701067f0 2024-09-18T12:54:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.200+0000 7f9976148640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99701007f0 0x7f99700fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.200+0000 7f9976148640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99701007f0 0x7f99700fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48900/0 (socket says 172.21.15.78:48900) 2024-09-18T12:54:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.200+0000 7f9975947640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99701067f0 0x7f99700fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.200+0000 7f9976148640 1 -- 172.21.15.78:0/3681782249 learned_addr learned my addr 172.21.15.78:0/3681782249 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:54:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.200+0000 7f9976148640 1 -- 172.21.15.78:0/3681782249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99701067f0 msgr2=0x7f99700fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.200+0000 7f9976148640 1 --2- 172.21.15.78:0/3681782249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99701067f0 0x7f99700fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.200+0000 7f9976148640 1 -- 172.21.15.78:0/3681782249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99700fd700 con 0x7f99701007f0 2024-09-18T12:54:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.200+0000 7f9976148640 1 --2- 172.21.15.78:0/3681782249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99701007f0 0x7f99700fcc80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f996c00d8d0 tx=0x7f996c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.200+0000 7f99677fe640 1 -- 172.21.15.78:0/3681782249 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f996c017030 con 0x7f99701007f0 2024-09-18T12:54:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.201+0000 7f99677fe640 1 -- 172.21.15.78:0/3681782249 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f996c004020 con 0x7f99701007f0 2024-09-18T12:54:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.201+0000 7f99783ac640 1 -- 172.21.15.78:0/3681782249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99700fd9f0 con 0x7f99701007f0 2024-09-18T12:54:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.201+0000 7f99783ac640 1 -- 172.21.15.78:0/3681782249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99701a3e00 con 0x7f99701007f0 2024-09-18T12:54:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.201+0000 7f99677fe640 1 -- 172.21.15.78:0/3681782249 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f996c005630 con 0x7f99701007f0 2024-09-18T12:54:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.202+0000 7f99783ac640 1 -- 172.21.15.78:0/3681782249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9970101f30 con 0x7f99701007f0 2024-09-18T12:54:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.203+0000 7f99677fe640 1 -- 172.21.15.78:0/3681782249 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f996c0041d0 con 0x7f99701007f0 2024-09-18T12:54:27.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.204+0000 7f99677fe640 1 --2- 172.21.15.78:0/3681782249 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f995c07af30 0x7f995c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:27.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.204+0000 7f99677fe640 1 -- 172.21.15.78:0/3681782249 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6070+0+0 (secure 0 0 0) 0x7f996c018070 con 0x7f99701007f0 2024-09-18T12:54:27.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.204+0000 7f9975947640 1 --2- 172.21.15.78:0/3681782249 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f995c07af30 0x7f995c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:27.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.204+0000 7f9975947640 1 --2- 172.21.15.78:0/3681782249 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f995c07af30 0x7f995c07d3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99700fe710 tx=0x7f9960031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:27.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.208+0000 7f99677fe640 1 -- 172.21.15.78:0/3681782249 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f996c020070 con 0x7f99701007f0 2024-09-18T12:54:27.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.447+0000 7f99783ac640 1 -- 172.21.15.78:0/3681782249 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9970062630 con 0x7f995c07af30 2024-09-18T12:54:27.449 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:27 smithi078 ceph-mon[108578]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:27.449 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:27 smithi078 ceph-mon[108578]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:27.449 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:27 smithi078 ceph-mon[108578]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:27.450 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:27.450 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:27.450 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:27 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/170284900' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:27.450 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:27 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1015749491' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:54:27.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.449+0000 7f99677fe640 1 -- 172.21.15.78:0/3681782249 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f9970062630 con 0x7f995c07af30 2024-09-18T12:54:27.450 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:54:27.451 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:54:27.451 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:54:27.451 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:54:27.451 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:54:27.451 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T12:54:27.451 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T12:54:27.451 INFO:teuthology.orchestra.run.smithi078.stdout: "mon" 2024-09-18T12:54:27.451 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:54:27.451 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "7/23 daemons upgraded", 2024-09-18T12:54:27.451 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:54:27.451 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:54:27.451 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:54:27.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.451+0000 7f99783ac640 1 -- 172.21.15.78:0/3681782249 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f995c07af30 msgr2=0x7f995c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:27.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.451+0000 7f99783ac640 1 --2- 172.21.15.78:0/3681782249 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f995c07af30 0x7f995c07d3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99700fe710 tx=0x7f9960031400 comp rx=0 tx=0).stop 2024-09-18T12:54:27.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.451+0000 7f99783ac640 1 -- 172.21.15.78:0/3681782249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99701007f0 msgr2=0x7f99700fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:27.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.451+0000 7f99783ac640 1 --2- 172.21.15.78:0/3681782249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99701007f0 0x7f99700fcc80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f996c00d8d0 tx=0x7f996c00dd90 comp rx=0 tx=0).stop 2024-09-18T12:54:27.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.451+0000 7f99783ac640 1 -- 172.21.15.78:0/3681782249 shutdown_connections 2024-09-18T12:54:27.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.451+0000 7f99783ac640 1 --2- 172.21.15.78:0/3681782249 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f995c07af30 0x7f995c07d3f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.451+0000 7f99783ac640 1 --2- 172.21.15.78:0/3681782249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99701067f0 0x7f99700fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.451+0000 7f99783ac640 1 --2- 172.21.15.78:0/3681782249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99701007f0 0x7f99700fcc80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.451+0000 7f99783ac640 1 -- 172.21.15.78:0/3681782249 >> 172.21.15.78:0/3681782249 conn(0x7f99700fc550 msgr2=0x7f9970069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:27.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.451+0000 7f99783ac640 1 -- 172.21.15.78:0/3681782249 shutdown_connections 2024-09-18T12:54:27.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.451+0000 7f99783ac640 1 -- 172.21.15.78:0/3681782249 wait complete. 2024-09-18T12:54:27.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.535+0000 7fcce0191640 1 -- 172.21.15.78:0/1055363930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd8107900 msgr2=0x7fccd8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:27.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.535+0000 7fcce0191640 1 --2- 172.21.15.78:0/1055363930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd8107900 0x7fccd8107ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009880 tx=0x7fccd402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.536+0000 7fcce0191640 1 -- 172.21.15.78:0/1055363930 shutdown_connections 2024-09-18T12:54:27.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.536+0000 7fcce0191640 1 --2- 172.21.15.78:0/1055363930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccd8101900 0x7fccd8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.536+0000 7fcce0191640 1 --2- 172.21.15.78:0/1055363930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd8107900 0x7fccd8107ce0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.536+0000 7fcce0191640 1 -- 172.21.15.78:0/1055363930 >> 172.21.15.78:0/1055363930 conn(0x7fccd80fd600 msgr2=0x7fccd80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:27.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.536+0000 7fcce0191640 1 -- 172.21.15.78:0/1055363930 shutdown_connections 2024-09-18T12:54:27.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.536+0000 7fcce0191640 1 -- 172.21.15.78:0/1055363930 wait complete. 2024-09-18T12:54:27.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.537+0000 7fcce0191640 1 Processor -- start 2024-09-18T12:54:27.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.537+0000 7fcce0191640 1 -- start start 2024-09-18T12:54:27.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.537+0000 7fcce0191640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccd8101900 0x7fccd819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:27.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.537+0000 7fcce0191640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd8107900 0x7fccd819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:27.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.537+0000 7fcce0191640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fccd810edd0 con 0x7fccd8107900 2024-09-18T12:54:27.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.537+0000 7fcce0191640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fccd810ec50 con 0x7fccd8101900 2024-09-18T12:54:27.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.537+0000 7fccdd72c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd8107900 0x7fccd819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:27.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.537+0000 7fccdd72c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd8107900 0x7fccd819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48914/0 (socket says 172.21.15.78:48914) 2024-09-18T12:54:27.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.537+0000 7fccdd72c640 1 -- 172.21.15.78:0/3827228154 learned_addr learned my addr 172.21.15.78:0/3827228154 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:54:27.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.537+0000 7fccddf2d640 1 --2- 172.21.15.78:0/3827228154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccd8101900 0x7fccd819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:27.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.538+0000 7fccdd72c640 1 -- 172.21.15.78:0/3827228154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccd8101900 msgr2=0x7fccd819d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:27.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.538+0000 7fccdd72c640 1 --2- 172.21.15.78:0/3827228154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccd8101900 0x7fccd819d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.538+0000 7fccdd72c640 1 -- 172.21.15.78:0/3827228154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd81977c0 con 0x7fccd8107900 2024-09-18T12:54:27.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.538+0000 7fccdd72c640 1 --2- 172.21.15.78:0/3827228154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd8107900 0x7fccd819db80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fccc800d6f0 tx=0x7fccc800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:27.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.538+0000 7fccceffd640 1 -- 172.21.15.78:0/3827228154 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fccc8017070 con 0x7fccd8107900 2024-09-18T12:54:27.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.538+0000 7fccceffd640 1 -- 172.21.15.78:0/3827228154 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fccc800de00 con 0x7fccd8107900 2024-09-18T12:54:27.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.538+0000 7fcce0191640 1 -- 172.21.15.78:0/3827228154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd8197ab0 con 0x7fccd8107900 2024-09-18T12:54:27.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.538+0000 7fccceffd640 1 -- 172.21.15.78:0/3827228154 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fccc8004bb0 con 0x7fccd8107900 2024-09-18T12:54:27.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.538+0000 7fcce0191640 1 -- 172.21.15.78:0/3827228154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd8198040 con 0x7fccd8107900 2024-09-18T12:54:27.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.539+0000 7fcce0191640 1 -- 172.21.15.78:0/3827228154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccd8103040 con 0x7fccd8107900 2024-09-18T12:54:27.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.540+0000 7fccceffd640 1 -- 172.21.15.78:0/3827228154 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fccc8004e60 con 0x7fccd8107900 2024-09-18T12:54:27.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.541+0000 7fccceffd640 1 --2- 172.21.15.78:0/3827228154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fccc407af30 0x7fccc407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:27.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.541+0000 7fccddf2d640 1 --2- 172.21.15.78:0/3827228154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fccc407af30 0x7fccc407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:27.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.541+0000 7fccceffd640 1 -- 172.21.15.78:0/3827228154 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6070+0+0 (secure 0 0 0) 0x7fccc809db50 con 0x7fccd8107900 2024-09-18T12:54:27.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.541+0000 7fccddf2d640 1 --2- 172.21.15.78:0/3827228154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fccc407af30 0x7fccc407d3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fccd40096c0 tx=0x7fccd4031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:27.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.545+0000 7fccceffd640 1 -- 172.21.15.78:0/3827228154 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fccc80691a0 con 0x7fccd8107900 2024-09-18T12:54:27.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:27 smithi148 ceph-mon[80030]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:27.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:27 smithi148 ceph-mon[80030]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:27.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:27 smithi148 ceph-mon[80030]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:27.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:27.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:27.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:27 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/170284900' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:27.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:27 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1015749491' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:54:27.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.812+0000 7fcce0191640 1 -- 172.21.15.78:0/3827228154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fccd8109e70 con 0x7fccd8107900 2024-09-18T12:54:27.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.813+0000 7fccceffd640 1 -- 172.21.15.78:0/3827228154 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1573 (secure 0 0 0) 0x7fccc806e050 con 0x7fccd8107900 2024-09-18T12:54:27.814 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 65/333 objects degraded (19.520%), 20 pgs degraded 2024-09-18T12:54:27.814 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:54:27.814 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:54:27.814 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-18T12:54:27.814 INFO:teuthology.orchestra.run.smithi078.stdout: osd.0 (root=default,host=smithi078) is down 2024-09-18T12:54:27.814 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 65/333 objects degraded (19.520%), 20 pgs degraded 2024-09-18T12:54:27.815 INFO:teuthology.orchestra.run.smithi078.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-18T12:54:27.815 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-18T12:54:27.815 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-18T12:54:27.815 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-18T12:54:27.815 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-18T12:54:27.815 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-18T12:54:27.815 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-18T12:54:27.815 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-18T12:54:27.815 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-18T12:54:27.815 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-18T12:54:27.815 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-18T12:54:27.815 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-18T12:54:27.816 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-09-18T12:54:27.816 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-18T12:54:27.816 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-18T12:54:27.816 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-18T12:54:27.816 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-18T12:54:27.816 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-18T12:54:27.816 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-18T12:54:27.816 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-18T12:54:27.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.815+0000 7fcce0191640 1 -- 172.21.15.78:0/3827228154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fccc407af30 msgr2=0x7fccc407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:27.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.815+0000 7fcce0191640 1 --2- 172.21.15.78:0/3827228154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fccc407af30 0x7fccc407d3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fccd40096c0 tx=0x7fccd4031400 comp rx=0 tx=0).stop 2024-09-18T12:54:27.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.815+0000 7fcce0191640 1 -- 172.21.15.78:0/3827228154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd8107900 msgr2=0x7fccd819db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:27.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.815+0000 7fcce0191640 1 --2- 172.21.15.78:0/3827228154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd8107900 0x7fccd819db80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fccc800d6f0 tx=0x7fccc800dbb0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.815+0000 7fcce0191640 1 -- 172.21.15.78:0/3827228154 shutdown_connections 2024-09-18T12:54:27.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.815+0000 7fcce0191640 1 --2- 172.21.15.78:0/3827228154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fccc407af30 0x7fccc407d3f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.815+0000 7fcce0191640 1 --2- 172.21.15.78:0/3827228154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccd8107900 0x7fccd819db80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.815+0000 7fcce0191640 1 --2- 172.21.15.78:0/3827228154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccd8101900 0x7fccd819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:27.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.815+0000 7fcce0191640 1 -- 172.21.15.78:0/3827228154 >> 172.21.15.78:0/3827228154 conn(0x7fccd80fd600 msgr2=0x7fccd80fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:27.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.815+0000 7fcce0191640 1 -- 172.21.15.78:0/3827228154 shutdown_connections 2024-09-18T12:54:27.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:27.815+0000 7fcce0191640 1 -- 172.21.15.78:0/3827228154 wait complete. 2024-09-18T12:54:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:28 smithi078 ceph-mon[108578]: pgmap v126: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/333 objects degraded (19.520%) 2024-09-18T12:54:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:28 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:28 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:28 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3827228154' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:54:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:28 smithi148 ceph-mon[80030]: pgmap v126: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/333 objects degraded (19.520%) 2024-09-18T12:54:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:28 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:28 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:28 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3827228154' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:54:29.163 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:29 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0[117328]: 2024-09-18T12:54:29.021+0000 7fd9a8c90640 -1 osd.0 47 log_to_monitors true 2024-09-18T12:54:29.429 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 12:54:29 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0[117328]: 2024-09-18T12:54:29.306+0000 7fd9a0a3a640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:54:29.429 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:29 smithi078 ceph-mon[108578]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:29.429 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:29 smithi078 ceph-mon[108578]: from='osd.0 [v2:172.21.15.78:6802/627503489,v1:172.21.15.78:6803/627503489]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-18T12:54:29.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:29 smithi148 ceph-mon[80030]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:29.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:29 smithi148 ceph-mon[80030]: from='osd.0 [v2:172.21.15.78:6802/627503489,v1:172.21.15.78:6803/627503489]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-18T12:54:30.399 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:30 smithi078 ceph-mon[108578]: pgmap v127: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/333 objects degraded (19.520%) 2024-09-18T12:54:30.400 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:30 smithi078 ceph-mon[108578]: from='osd.0 [v2:172.21.15.78:6802/627503489,v1:172.21.15.78:6803/627503489]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T12:54:30.400 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:30 smithi078 ceph-mon[108578]: osdmap e50: 6 total, 5 up, 6 in 2024-09-18T12:54:30.400 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:30 smithi078 ceph-mon[108578]: from='osd.0 [v2:172.21.15.78:6802/627503489,v1:172.21.15.78:6803/627503489]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-18T12:54:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:30 smithi148 ceph-mon[80030]: pgmap v127: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/333 objects degraded (19.520%) 2024-09-18T12:54:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:30 smithi148 ceph-mon[80030]: from='osd.0 [v2:172.21.15.78:6802/627503489,v1:172.21.15.78:6803/627503489]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T12:54:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:30 smithi148 ceph-mon[80030]: osdmap e50: 6 total, 5 up, 6 in 2024-09-18T12:54:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:30 smithi148 ceph-mon[80030]: from='osd.0 [v2:172.21.15.78:6802/627503489,v1:172.21.15.78:6803/627503489]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-18T12:54:31.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:31 smithi148 ceph-mon[80030]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:54:31.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:31 smithi148 ceph-mon[80030]: osd.0 [v2:172.21.15.78:6802/627503489,v1:172.21.15.78:6803/627503489] boot 2024-09-18T12:54:31.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:31 smithi148 ceph-mon[80030]: osdmap e51: 6 total, 6 up, 6 in 2024-09-18T12:54:31.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:31 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-18T12:54:31.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:31 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:31.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:31 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:31.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:31 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:31.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:31 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:54:31.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:31 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:31.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:31 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:31.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:31 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:31.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:31 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:31.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:31 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:31.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:31 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-18T12:54:31.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:31 smithi148 ceph-mon[80030]: osdmap e52: 6 total, 6 up, 6 in 2024-09-18T12:54:31.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:31 smithi078 ceph-mon[108578]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:54:31.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:31 smithi078 ceph-mon[108578]: osd.0 [v2:172.21.15.78:6802/627503489,v1:172.21.15.78:6803/627503489] boot 2024-09-18T12:54:31.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:31 smithi078 ceph-mon[108578]: osdmap e51: 6 total, 6 up, 6 in 2024-09-18T12:54:31.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:31 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-18T12:54:31.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:31 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:31.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:31 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:31.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:31 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:31.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:31 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:54:31.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:31 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:31.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:31 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:31.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:31 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:31.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:31 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:31.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:31 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:31.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:31 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-18T12:54:31.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:31 smithi078 ceph-mon[108578]: osdmap e52: 6 total, 6 up, 6 in 2024-09-18T12:54:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:32 smithi148 ceph-mon[80030]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T12:54:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:32 smithi148 ceph-mon[80030]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-18T12:54:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:32 smithi148 ceph-mon[80030]: pgmap v130: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9/333 objects degraded (2.703%) 2024-09-18T12:54:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:32 smithi148 ceph-mon[80030]: Health check update: Degraded data redundancy: 9/333 objects degraded (2.703%), 3 pgs degraded (PG_DEGRADED) 2024-09-18T12:54:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:32 smithi078 ceph-mon[108578]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T12:54:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:32 smithi078 ceph-mon[108578]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-18T12:54:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:32 smithi078 ceph-mon[108578]: pgmap v130: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9/333 objects degraded (2.703%) 2024-09-18T12:54:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:32 smithi078 ceph-mon[108578]: Health check update: Degraded data redundancy: 9/333 objects degraded (2.703%), 3 pgs degraded (PG_DEGRADED) 2024-09-18T12:54:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:34 smithi148 ceph-mon[80030]: pgmap v132: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9/333 objects degraded (2.703%) 2024-09-18T12:54:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:34 smithi078 ceph-mon[108578]: pgmap v132: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9/333 objects degraded (2.703%) 2024-09-18T12:54:35.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:35 smithi148 ceph-mon[80030]: pgmap v133: 65 pgs: 25 peering, 40 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:35.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:35 smithi148 ceph-mon[80030]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/333 objects degraded (2.703%), 3 pgs degraded) 2024-09-18T12:54:35.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:35 smithi078 ceph-mon[108578]: pgmap v133: 65 pgs: 25 peering, 40 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:35.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:35 smithi078 ceph-mon[108578]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/333 objects degraded (2.703%), 3 pgs degraded) 2024-09-18T12:54:38.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:38 smithi148 ceph-mon[80030]: pgmap v134: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:38.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:38 smithi078 ceph-mon[108578]: pgmap v134: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:40.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:40 smithi148 ceph-mon[80030]: pgmap v135: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:40.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:40 smithi078 ceph-mon[108578]: pgmap v135: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:41 smithi148 ceph-mon[80030]: pgmap v136: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:41.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:41.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:41.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:41 smithi078 ceph-mon[108578]: pgmap v136: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:44.392 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:44 smithi078 ceph-mon[108578]: pgmap v137: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:44.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:44 smithi148 ceph-mon[80030]: pgmap v137: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:46 smithi148 ceph-mon[80030]: pgmap v138: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:46 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:46 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-18T12:54:46.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:46 smithi078 ceph-mon[108578]: pgmap v138: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:46.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:46 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:46.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:46 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-18T12:54:47.394 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:47 smithi078 ceph-mon[108578]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T12:54:47.394 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:47 smithi078 ceph-mon[108578]: Upgrade: osd.1 is safe to restart 2024-09-18T12:54:47.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:47 smithi148 ceph-mon[80030]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T12:54:47.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:47 smithi148 ceph-mon[80030]: Upgrade: osd.1 is safe to restart 2024-09-18T12:54:48.440 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:48 smithi078 ceph-mon[108578]: pgmap v139: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:48.440 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:48 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:48.440 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:48 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-18T12:54:48.441 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:48 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:48.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:48 smithi148 ceph-mon[80030]: pgmap v139: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:48.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:48 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:48.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:48 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-18T12:54:48.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:48 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:54:49.310 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:49 smithi078 ceph-mon[108578]: Upgrade: Updating osd.1 2024-09-18T12:54:49.310 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:49 smithi078 ceph-mon[108578]: Deploying daemon osd.1 on smithi078 2024-09-18T12:54:49.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:49 smithi148 ceph-mon[80030]: Upgrade: Updating osd.1 2024-09-18T12:54:49.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:49 smithi148 ceph-mon[80030]: Deploying daemon osd.1 on smithi078 2024-09-18T12:54:50.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:50 smithi148 ceph-mon[80030]: pgmap v140: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:50.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:50 smithi078 ceph-mon[108578]: pgmap v140: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:50.492 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:50 smithi078 systemd[1]: Stopping Ceph osd.1 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:54:50.992 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:50 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1[57239]: 2024-09-18T12:54:50.560+0000 7fb8973a6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:54:50.992 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:50 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1[57239]: 2024-09-18T12:54:50.560+0000 7fb8973a6640 -1 osd.1 52 *** Got signal Terminated *** 2024-09-18T12:54:50.992 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:50 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1[57239]: 2024-09-18T12:54:50.560+0000 7fb8973a6640 -1 osd.1 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:54:51.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:51 smithi148 ceph-mon[80030]: osd.1 marked itself down and dead 2024-09-18T12:54:51.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:51 smithi078 ceph-mon[108578]: osd.1 marked itself down and dead 2024-09-18T12:54:51.992 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:51 smithi078 podman[122466]: 2024-09-18 12:54:51.725239453 +0000 UTC m=+1.277455599 container died dcb6f1300ab9b211854c9f9708812f43613e040c8613b7d8cb09e1508229c921 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97) 2024-09-18T12:54:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:52 smithi148 ceph-mon[80030]: pgmap v141: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:52 smithi148 ceph-mon[80030]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:54:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:52 smithi148 ceph-mon[80030]: osdmap e53: 6 total, 5 up, 6 in 2024-09-18T12:54:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:52 smithi078 ceph-mon[108578]: pgmap v141: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:52 smithi078 ceph-mon[108578]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:54:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:52 smithi078 ceph-mon[108578]: osdmap e53: 6 total, 5 up, 6 in 2024-09-18T12:54:52.492 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:52 smithi078 podman[122466]: 2024-09-18 12:54:52.194577344 +0000 UTC m=+1.746793511 container cleanup dcb6f1300ab9b211854c9f9708812f43613e040c8613b7d8cb09e1508229c921 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:54:52.492 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:52 smithi078 bash[122466]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1 2024-09-18T12:54:52.852 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:52 smithi078 podman[122485]: 2024-09-18 12:54:52.530228813 +0000 UTC m=+0.799197240 container remove dcb6f1300ab9b211854c9f9708812f43613e040c8613b7d8cb09e1508229c921 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-18T12:54:53.134 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:52 smithi078 podman[122574]: 2024-09-18 12:54:52.754528517 +0000 UTC m=+0.016447828 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:54:53.134 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:52 smithi078 podman[122574]: 2024-09-18 12:54:52.872323511 +0000 UTC m=+0.134242862 container create f9ca27ea33e712ecfb85be0402ac3e8bf4a78d532fb1761516a3ca0525dc6ff8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:54:53.134 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:53 smithi078 podman[122574]: 2024-09-18 12:54:53.133387068 +0000 UTC m=+0.395306378 container init f9ca27ea33e712ecfb85be0402ac3e8bf4a78d532fb1761516a3ca0525dc6ff8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:54:53.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:53 smithi148 ceph-mon[80030]: osdmap e54: 6 total, 5 up, 6 in 2024-09-18T12:54:53.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:53 smithi078 ceph-mon[108578]: osdmap e54: 6 total, 5 up, 6 in 2024-09-18T12:54:53.492 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:53 smithi078 podman[122574]: 2024-09-18 12:54:53.136831634 +0000 UTC m=+0.398750949 container start f9ca27ea33e712ecfb85be0402ac3e8bf4a78d532fb1761516a3ca0525dc6ff8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-18T12:54:53.492 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:53 smithi078 podman[122574]: 2024-09-18 12:54:53.24169057 +0000 UTC m=+0.503609891 container attach f9ca27ea33e712ecfb85be0402ac3e8bf4a78d532fb1761516a3ca0525dc6ff8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-18T12:54:53.492 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:53 smithi078 podman[122574]: 2024-09-18 12:54:53.329011655 +0000 UTC m=+0.590930961 container died f9ca27ea33e712ecfb85be0402ac3e8bf4a78d532fb1761516a3ca0525dc6ff8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-18T12:54:54.250 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:54 smithi078 ceph-mon[108578]: pgmap v144: 65 pgs: 12 stale+active+clean, 53 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:54.250 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:53 smithi078 podman[122598]: 2024-09-18 12:54:53.99601315 +0000 UTC m=+0.661398344 container remove f9ca27ea33e712ecfb85be0402ac3e8bf4a78d532fb1761516a3ca0525dc6ff8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-18T12:54:54.251 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:54 smithi078 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-18T12:54:54.251 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:54 smithi078 systemd[1]: Stopped Ceph osd.1 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:54:54.251 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:54 smithi078 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.1.service: Consumed 57.613s CPU time. 2024-09-18T12:54:54.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:54 smithi148 ceph-mon[80030]: pgmap v144: 65 pgs: 12 stale+active+clean, 53 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:54:54.620 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:54 smithi078 systemd[1]: Starting Ceph osd.1 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:54:54.620 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:54 smithi078 podman[122701]: 2024-09-18 12:54:54.364446383 +0000 UTC m=+0.015927810 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:54:54.620 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:54 smithi078 podman[122701]: 2024-09-18 12:54:54.492203197 +0000 UTC m=+0.143684614 container create 668fa63cd96ad06d9293c81ec63dc05020a44717b9a59b5bd6df1a1999650783 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-activate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-18T12:54:54.875 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:54 smithi078 podman[122701]: 2024-09-18 12:54:54.775330321 +0000 UTC m=+0.426811743 container init 668fa63cd96ad06d9293c81ec63dc05020a44717b9a59b5bd6df1a1999650783 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-18T12:54:54.875 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:54 smithi078 podman[122701]: 2024-09-18 12:54:54.779015782 +0000 UTC m=+0.430497199 container start 668fa63cd96ad06d9293c81ec63dc05020a44717b9a59b5bd6df1a1999650783 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-18T12:54:54.875 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:54 smithi078 podman[122701]: 2024-09-18 12:54:54.874896041 +0000 UTC m=+0.526377474 container attach 668fa63cd96ad06d9293c81ec63dc05020a44717b9a59b5bd6df1a1999650783 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-18T12:54:55.220 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:54 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-activate[122716]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:54:55.220 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:54 smithi078 bash[122701]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:54:55.220 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:54 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-activate[122716]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:54:55.220 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:54 smithi078 bash[122701]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:54:55.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:55 smithi078 ceph-mon[108578]: Health check failed: Degraded data redundancy: 4/333 objects degraded (1.201%), 2 pgs degraded (PG_DEGRADED) 2024-09-18T12:54:55.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:55 smithi148 ceph-mon[80030]: Health check failed: Degraded data redundancy: 4/333 objects degraded (1.201%), 2 pgs degraded (PG_DEGRADED) 2024-09-18T12:54:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:56 smithi148 ceph-mon[80030]: pgmap v145: 65 pgs: 3 active+undersized, 9 stale+active+clean, 2 active+undersized+degraded, 51 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4/333 objects degraded (1.201%) 2024-09-18T12:54:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:56 smithi078 ceph-mon[108578]: pgmap v145: 65 pgs: 3 active+undersized, 9 stale+active+clean, 2 active+undersized+degraded, 51 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4/333 objects degraded (1.201%) 2024-09-18T12:54:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:54:57.543 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:57 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-activate[122716]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:54:57.543 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:57 smithi078 bash[122701]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:54:57.544 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:57 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-activate[122716]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T12:54:57.544 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:57 smithi078 bash[122701]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T12:54:57.544 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:57 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-activate[122716]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T12:54:57.544 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:57 smithi078 bash[122701]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T12:54:57.872 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:57 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-activate[122716]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T12:54:57.872 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:57 smithi078 bash[122701]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T12:54:57.872 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:57 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-activate[122716]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-18T12:54:57.872 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:57 smithi078 bash[122701]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-18T12:54:57.872 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:57 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-activate[122716]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:54:57.872 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:57 smithi078 bash[122701]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:54:57.872 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:57 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-activate[122716]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-18T12:54:57.872 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:57 smithi078 bash[122701]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-18T12:54:57.873 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:57 smithi078 podman[122701]: 2024-09-18 12:54:57.5772143 +0000 UTC m=+3.228695725 container died 668fa63cd96ad06d9293c81ec63dc05020a44717b9a59b5bd6df1a1999650783 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-activate, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:54:57.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.905+0000 7f6b73875640 1 -- 172.21.15.78:0/1745328655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b6c1069a0 msgr2=0x7f6b6c106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:57.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.905+0000 7f6b73875640 1 --2- 172.21.15.78:0/1745328655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b6c1069a0 0x7f6b6c106d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009c20 tx=0x7f6b5c02a970 comp rx=0 tx=0).stop 2024-09-18T12:54:57.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.905+0000 7f6b73875640 1 -- 172.21.15.78:0/1745328655 shutdown_connections 2024-09-18T12:54:57.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.905+0000 7f6b73875640 1 --2- 172.21.15.78:0/1745328655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b6c0ffdc0 0x7f6b6c100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:57.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.905+0000 7f6b73875640 1 --2- 172.21.15.78:0/1745328655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b6c1069a0 0x7f6b6c106d80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:57.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.905+0000 7f6b73875640 1 -- 172.21.15.78:0/1745328655 >> 172.21.15.78:0/1745328655 conn(0x7f6b6c0fbc90 msgr2=0x7f6b6c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:57.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.905+0000 7f6b73875640 1 -- 172.21.15.78:0/1745328655 shutdown_connections 2024-09-18T12:54:57.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.905+0000 7f6b73875640 1 -- 172.21.15.78:0/1745328655 wait complete. 2024-09-18T12:54:57.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.905+0000 7f6b73875640 1 Processor -- start 2024-09-18T12:54:57.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.905+0000 7f6b73875640 1 -- start start 2024-09-18T12:54:57.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.906+0000 7f6b73875640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b6c0ffdc0 0x7f6b6c100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.906+0000 7f6b73875640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b6c1069a0 0x7f6b6c1014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.906+0000 7f6b73875640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c10ef40 con 0x7f6b6c1069a0 2024-09-18T12:54:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.906+0000 7f6b73875640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c10edc0 con 0x7f6b6c0ffdc0 2024-09-18T12:54:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.906+0000 7f6b70e10640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b6c1069a0 0x7f6b6c1014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.906+0000 7f6b70e10640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b6c1069a0 0x7f6b6c1014e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58334/0 (socket says 172.21.15.78:58334) 2024-09-18T12:54:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.906+0000 7f6b70e10640 1 -- 172.21.15.78:0/3940874113 learned_addr learned my addr 172.21.15.78:0/3940874113 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:54:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.906+0000 7f6b71611640 1 --2- 172.21.15.78:0/3940874113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b6c0ffdc0 0x7f6b6c100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.906+0000 7f6b70e10640 1 -- 172.21.15.78:0/3940874113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b6c0ffdc0 msgr2=0x7f6b6c100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.906+0000 7f6b70e10640 1 --2- 172.21.15.78:0/3940874113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b6c0ffdc0 0x7f6b6c100fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.906+0000 7f6b70e10640 1 -- 172.21.15.78:0/3940874113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6c101a20 con 0x7f6b6c1069a0 2024-09-18T12:54:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.906+0000 7f6b70e10640 1 --2- 172.21.15.78:0/3940874113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b6c1069a0 0x7f6b6c1014e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000c8f0 tx=0x7f6b6000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.907+0000 7f6b6a7fc640 1 -- 172.21.15.78:0/3940874113 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b600079b0 con 0x7f6b6c1069a0 2024-09-18T12:54:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.907+0000 7f6b6a7fc640 1 -- 172.21.15.78:0/3940874113 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b600054e0 con 0x7f6b6c1069a0 2024-09-18T12:54:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.907+0000 7f6b73875640 1 -- 172.21.15.78:0/3940874113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6c101d10 con 0x7f6b6c1069a0 2024-09-18T12:54:57.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.907+0000 7f6b6a7fc640 1 -- 172.21.15.78:0/3940874113 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b60004dd0 con 0x7f6b6c1069a0 2024-09-18T12:54:57.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.907+0000 7f6b73875640 1 -- 172.21.15.78:0/3940874113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6c1a3f70 con 0x7f6b6c1069a0 2024-09-18T12:54:57.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.908+0000 7f6b73875640 1 -- 172.21.15.78:0/3940874113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6c1030e0 con 0x7f6b6c1069a0 2024-09-18T12:54:57.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.908+0000 7f6b6a7fc640 1 -- 172.21.15.78:0/3940874113 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6b60005020 con 0x7f6b6c1069a0 2024-09-18T12:54:57.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.909+0000 7f6b6a7fc640 1 --2- 172.21.15.78:0/3940874113 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6b5407aed0 0x7f6b5407d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:57.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.909+0000 7f6b6a7fc640 1 -- 172.21.15.78:0/3940874113 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6070+0+0 (secure 0 0 0) 0x7f6b6009df20 con 0x7f6b6c1069a0 2024-09-18T12:54:57.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.909+0000 7f6b71611640 1 --2- 172.21.15.78:0/3940874113 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6b5407aed0 0x7f6b5407d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:57.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.909+0000 7f6b71611640 1 --2- 172.21.15.78:0/3940874113 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6b5407aed0 0x7f6b5407d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009430 tx=0x7f6b5c03c040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:57.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:57.913+0000 7f6b6a7fc640 1 -- 172.21.15.78:0/3940874113 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6b60014030 con 0x7f6b6c1069a0 2024-09-18T12:54:58.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.106+0000 7f6b73875640 1 -- 172.21.15.78:0/3940874113 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6b6c062630 con 0x7f6b5407aed0 2024-09-18T12:54:58.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.108+0000 7f6b6a7fc640 1 -- 172.21.15.78:0/3940874113 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f6b6c062630 con 0x7f6b5407aed0 2024-09-18T12:54:58.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.110+0000 7f6b73875640 1 -- 172.21.15.78:0/3940874113 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6b5407aed0 msgr2=0x7f6b5407d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:58.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.110+0000 7f6b73875640 1 --2- 172.21.15.78:0/3940874113 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6b5407aed0 0x7f6b5407d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009430 tx=0x7f6b5c03c040 comp rx=0 tx=0).stop 2024-09-18T12:54:58.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.110+0000 7f6b73875640 1 -- 172.21.15.78:0/3940874113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b6c1069a0 msgr2=0x7f6b6c1014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:58.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.110+0000 7f6b73875640 1 --2- 172.21.15.78:0/3940874113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b6c1069a0 0x7f6b6c1014e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000c8f0 tx=0x7f6b6000cdb0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.110+0000 7f6b73875640 1 -- 172.21.15.78:0/3940874113 shutdown_connections 2024-09-18T12:54:58.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.110+0000 7f6b73875640 1 --2- 172.21.15.78:0/3940874113 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6b5407aed0 0x7f6b5407d390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.110+0000 7f6b73875640 1 --2- 172.21.15.78:0/3940874113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b6c1069a0 0x7f6b6c1014e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.110+0000 7f6b73875640 1 --2- 172.21.15.78:0/3940874113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b6c0ffdc0 0x7f6b6c100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.110+0000 7f6b73875640 1 -- 172.21.15.78:0/3940874113 >> 172.21.15.78:0/3940874113 conn(0x7f6b6c0fbc90 msgr2=0x7f6b6c0fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:58.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.110+0000 7f6b73875640 1 -- 172.21.15.78:0/3940874113 shutdown_connections 2024-09-18T12:54:58.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.110+0000 7f6b73875640 1 -- 172.21.15.78:0/3940874113 wait complete. 2024-09-18T12:54:58.120 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:54:58.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.194+0000 7f261ce4a640 1 -- 172.21.15.78:0/2785074435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618100800 msgr2=0x7f2618100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:58.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.194+0000 7f261ce4a640 1 --2- 172.21.15.78:0/2785074435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618100800 0x7f2618100c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f260c009880 tx=0x7f260c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.194+0000 7f261ce4a640 1 -- 172.21.15.78:0/2785074435 shutdown_connections 2024-09-18T12:54:58.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.194+0000 7f261ce4a640 1 --2- 172.21.15.78:0/2785074435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618100800 0x7f2618100c60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.194+0000 7f261ce4a640 1 --2- 172.21.15.78:0/2785074435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2618106800 0x7f2618106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.194+0000 7f261ce4a640 1 -- 172.21.15.78:0/2785074435 >> 172.21.15.78:0/2785074435 conn(0x7f26180fc520 msgr2=0x7f26180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:58.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.194+0000 7f261ce4a640 1 -- 172.21.15.78:0/2785074435 shutdown_connections 2024-09-18T12:54:58.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.194+0000 7f261ce4a640 1 -- 172.21.15.78:0/2785074435 wait complete. 2024-09-18T12:54:58.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.195+0000 7f261ce4a640 1 Processor -- start 2024-09-18T12:54:58.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.195+0000 7f261ce4a640 1 -- start start 2024-09-18T12:54:58.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f261ce4a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618100800 0x7f261819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:58.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f261ce4a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2618106800 0x7f261819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:58.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f261ce4a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f261810dcd0 con 0x7f2618100800 2024-09-18T12:54:58.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f261ce4a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f261810db50 con 0x7f2618106800 2024-09-18T12:54:58.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f261659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618100800 0x7f261819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:58.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f261659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618100800 0x7f261819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58354/0 (socket says 172.21.15.78:58354) 2024-09-18T12:54:58.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f261659c640 1 -- 172.21.15.78:0/465683154 learned_addr learned my addr 172.21.15.78:0/465683154 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:54:58.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f2615d9b640 1 --2- 172.21.15.78:0/465683154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2618106800 0x7f261819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:58.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f261659c640 1 -- 172.21.15.78:0/465683154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2618106800 msgr2=0x7f261819dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:58.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f261659c640 1 --2- 172.21.15.78:0/465683154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2618106800 0x7f261819dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f261659c640 1 -- 172.21.15.78:0/465683154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26181977f0 con 0x7f2618100800 2024-09-18T12:54:58.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f261659c640 1 --2- 172.21.15.78:0/465683154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618100800 0x7f261819d670 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f260800d6f0 tx=0x7f260800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:58.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f26077fe640 1 -- 172.21.15.78:0/465683154 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2608017070 con 0x7f2618100800 2024-09-18T12:54:58.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f26077fe640 1 -- 172.21.15.78:0/465683154 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f260800de00 con 0x7f2618100800 2024-09-18T12:54:58.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f261ce4a640 1 -- 172.21.15.78:0/465683154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2618197ae0 con 0x7f2618100800 2024-09-18T12:54:58.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f26077fe640 1 -- 172.21.15.78:0/465683154 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2608004bb0 con 0x7f2618100800 2024-09-18T12:54:58.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.196+0000 7f261ce4a640 1 -- 172.21.15.78:0/465683154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2618198040 con 0x7f2618100800 2024-09-18T12:54:58.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.197+0000 7f261ce4a640 1 -- 172.21.15.78:0/465683154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2618101f40 con 0x7f2618100800 2024-09-18T12:54:58.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.198+0000 7f26077fe640 1 -- 172.21.15.78:0/465683154 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2608009a30 con 0x7f2618100800 2024-09-18T12:54:58.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.199+0000 7f26077fe640 1 --2- 172.21.15.78:0/465683154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f260007af80 0x7f260007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:58.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.199+0000 7f26077fe640 1 -- 172.21.15.78:0/465683154 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6070+0+0 (secure 0 0 0) 0x7f260809db20 con 0x7f2618100800 2024-09-18T12:54:58.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.199+0000 7f2615d9b640 1 --2- 172.21.15.78:0/465683154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f260007af80 0x7f260007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:58.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.199+0000 7f2615d9b640 1 --2- 172.21.15.78:0/465683154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f260007af80 0x7f260007d440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2618198b40 tx=0x7f260c031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:58.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.203+0000 7f26077fe640 1 -- 172.21.15.78:0/465683154 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f26080691f0 con 0x7f2618100800 2024-09-18T12:54:58.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.415+0000 7f261ce4a640 1 -- 172.21.15.78:0/465683154 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f26181983b0 con 0x7f260007af80 2024-09-18T12:54:58.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.417+0000 7f26077fe640 1 -- 172.21.15.78:0/465683154 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f26181983b0 con 0x7f260007af80 2024-09-18T12:54:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.419+0000 7f261ce4a640 1 -- 172.21.15.78:0/465683154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f260007af80 msgr2=0x7f260007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.419+0000 7f261ce4a640 1 --2- 172.21.15.78:0/465683154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f260007af80 0x7f260007d440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2618198b40 tx=0x7f260c031400 comp rx=0 tx=0).stop 2024-09-18T12:54:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.419+0000 7f261ce4a640 1 -- 172.21.15.78:0/465683154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618100800 msgr2=0x7f261819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.419+0000 7f261ce4a640 1 --2- 172.21.15.78:0/465683154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618100800 0x7f261819d670 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f260800d6f0 tx=0x7f260800dbb0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.419+0000 7f261ce4a640 1 -- 172.21.15.78:0/465683154 shutdown_connections 2024-09-18T12:54:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.419+0000 7f261ce4a640 1 --2- 172.21.15.78:0/465683154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f260007af80 0x7f260007d440 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.419+0000 7f261ce4a640 1 --2- 172.21.15.78:0/465683154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2618106800 0x7f261819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.419+0000 7f261ce4a640 1 --2- 172.21.15.78:0/465683154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618100800 0x7f261819d670 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.419+0000 7f261ce4a640 1 -- 172.21.15.78:0/465683154 >> 172.21.15.78:0/465683154 conn(0x7f26180fc520 msgr2=0x7f261806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:58.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.419+0000 7f261ce4a640 1 -- 172.21.15.78:0/465683154 shutdown_connections 2024-09-18T12:54:58.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.420+0000 7f261ce4a640 1 -- 172.21.15.78:0/465683154 wait complete. 2024-09-18T12:54:58.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:58 smithi078 ceph-mon[108578]: pgmap v146: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/333 objects degraded (14.715%) 2024-09-18T12:54:58.492 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:58 smithi078 podman[122876]: 2024-09-18 12:54:58.31347115 +0000 UTC m=+0.726333545 container remove 668fa63cd96ad06d9293c81ec63dc05020a44717b9a59b5bd6df1a1999650783 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-18T12:54:58.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.504+0000 7f8d641dc640 1 -- 172.21.15.78:0/2654296762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5c102b20 msgr2=0x7f8d5c102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:58.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.504+0000 7f8d641dc640 1 --2- 172.21.15.78:0/2654296762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5c102b20 0x7f8d5c102f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8d540098b0 tx=0x7f8d5402a560 comp rx=0 tx=0).stop 2024-09-18T12:54:58.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.504+0000 7f8d641dc640 1 -- 172.21.15.78:0/2654296762 shutdown_connections 2024-09-18T12:54:58.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.504+0000 7f8d641dc640 1 --2- 172.21.15.78:0/2654296762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d5c103440 0x7f8d5c10b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.504+0000 7f8d641dc640 1 --2- 172.21.15.78:0/2654296762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5c102b20 0x7f8d5c102f00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.504+0000 7f8d641dc640 1 -- 172.21.15.78:0/2654296762 >> 172.21.15.78:0/2654296762 conn(0x7f8d5c0fc520 msgr2=0x7f8d5c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:58.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.504+0000 7f8d641dc640 1 -- 172.21.15.78:0/2654296762 shutdown_connections 2024-09-18T12:54:58.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.504+0000 7f8d641dc640 1 -- 172.21.15.78:0/2654296762 wait complete. 2024-09-18T12:54:58.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.505+0000 7f8d641dc640 1 Processor -- start 2024-09-18T12:54:58.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.505+0000 7f8d641dc640 1 -- start start 2024-09-18T12:54:58.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.505+0000 7f8d641dc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d5c102b20 0x7f8d5c100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:58.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.505+0000 7f8d641dc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5c103440 0x7f8d5c100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:58.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.505+0000 7f8d641dc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c10ee50 con 0x7f8d5c103440 2024-09-18T12:54:58.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.505+0000 7f8d641dc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c10ecd0 con 0x7f8d5c102b20 2024-09-18T12:54:58.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.505+0000 7f8d61777640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5c103440 0x7f8d5c100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:58.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.505+0000 7f8d61777640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5c103440 0x7f8d5c100cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58362/0 (socket says 172.21.15.78:58362) 2024-09-18T12:54:58.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.505+0000 7f8d61777640 1 -- 172.21.15.78:0/1113709705 learned_addr learned my addr 172.21.15.78:0/1113709705 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:54:58.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.505+0000 7f8d61f78640 1 --2- 172.21.15.78:0/1113709705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d5c102b20 0x7f8d5c100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:58.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.505+0000 7f8d61777640 1 -- 172.21.15.78:0/1113709705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d5c102b20 msgr2=0x7f8d5c100780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:58.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.505+0000 7f8d61777640 1 --2- 172.21.15.78:0/1113709705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d5c102b20 0x7f8d5c100780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.505+0000 7f8d61777640 1 -- 172.21.15.78:0/1113709705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c101200 con 0x7f8d5c103440 2024-09-18T12:54:58.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.506+0000 7f8d61777640 1 --2- 172.21.15.78:0/1113709705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5c103440 0x7f8d5c100cc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000ba50 tx=0x7f8d5000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:58.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.506+0000 7f8d5affd640 1 -- 172.21.15.78:0/1113709705 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d50019070 con 0x7f8d5c103440 2024-09-18T12:54:58.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.506+0000 7f8d5affd640 1 -- 172.21.15.78:0/1113709705 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d5000ce20 con 0x7f8d5c103440 2024-09-18T12:54:58.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.506+0000 7f8d641dc640 1 -- 172.21.15.78:0/1113709705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5c1014f0 con 0x7f8d5c103440 2024-09-18T12:54:58.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.506+0000 7f8d5affd640 1 -- 172.21.15.78:0/1113709705 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d500075a0 con 0x7f8d5c103440 2024-09-18T12:54:58.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.506+0000 7f8d641dc640 1 -- 172.21.15.78:0/1113709705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d5c1a3f20 con 0x7f8d5c103440 2024-09-18T12:54:58.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.507+0000 7f8d641dc640 1 -- 172.21.15.78:0/1113709705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d5c06aa30 con 0x7f8d5c103440 2024-09-18T12:54:58.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.507+0000 7f8d5affd640 1 -- 172.21.15.78:0/1113709705 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8d5001c070 con 0x7f8d5c103440 2024-09-18T12:54:58.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.508+0000 7f8d5affd640 1 --2- 172.21.15.78:0/1113709705 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8d4407af80 0x7f8d4407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:58.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.508+0000 7f8d5affd640 1 -- 172.21.15.78:0/1113709705 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6070+0+0 (secure 0 0 0) 0x7f8d5009d7f0 con 0x7f8d5c103440 2024-09-18T12:54:58.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.508+0000 7f8d61f78640 1 --2- 172.21.15.78:0/1113709705 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8d4407af80 0x7f8d4407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:58.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.508+0000 7f8d61f78640 1 --2- 172.21.15.78:0/1113709705 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8d4407af80 0x7f8d4407d440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d54031460 tx=0x7f8d54009560 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:58.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.512+0000 7f8d5affd640 1 -- 172.21.15.78:0/1113709705 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8d50068ec0 con 0x7f8d5c103440 2024-09-18T12:54:58.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.713+0000 7f8d641dc640 1 -- 172.21.15.78:0/1113709705 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8d5c062630 con 0x7f8d4407af80 2024-09-18T12:54:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:58 smithi148 ceph-mon[80030]: pgmap v146: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/333 objects degraded (14.715%) 2024-09-18T12:54:58.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.723+0000 7f8d5affd640 1 -- 172.21.15.78:0/1113709705 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f8d5c062630 con 0x7f8d4407af80 2024-09-18T12:54:58.724 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:54:58.724 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (2m) 31s ago 13m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T12:54:58.724 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (5m) 31s ago 13m 8820k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:54:58.724 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (5m) 55s ago 13m 8292k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:54:58.724 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (63s) 31s ago 13m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T12:54:58.725 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (58s) 55s ago 13m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T12:54:58.725 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (2m) 31s ago 13m 75.6M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T12:54:58.725 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (8m) 31s ago 8m 150M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:54:58.725 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (8m) 31s ago 8m 27.9M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:54:58.725 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (8m) 55s ago 8m 16.2M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:54:58.725 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (8m) 55s ago 8m 17.0M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:54:58.725 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (5m) 31s ago 15m 521M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:54:58.725 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (3m) 55s ago 12m 454M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:54:58.725 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (92s) 31s ago 15m 38.8M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T12:54:58.725 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (75s) 55s ago 12m 26.4M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T12:54:58.726 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (3m) 31s ago 13m 10.9M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:54:58.726 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (3m) 55s ago 13m 11.4M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:54:58.726 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (37s) 31s ago 11m 14.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T12:54:58.726 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (11m) 31s ago 11m 222M 1216M 19.1.1-330-gc2ddf972 ebb0615149de dcb6f1300ab9 2024-09-18T12:54:58.726 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (10m) 31s ago 10m 181M 1216M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:54:58.726 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (10m) 55s ago 10m 237M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:54:58.726 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (9m) 55s ago 9m 208M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:54:58.726 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (9m) 55s ago 9m 196M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:54:58.726 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (3m) 31s ago 13m 49.7M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:54:58.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.725+0000 7f8d641dc640 1 -- 172.21.15.78:0/1113709705 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8d4407af80 msgr2=0x7f8d4407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:58.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.725+0000 7f8d641dc640 1 --2- 172.21.15.78:0/1113709705 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8d4407af80 0x7f8d4407d440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d54031460 tx=0x7f8d54009560 comp rx=0 tx=0).stop 2024-09-18T12:54:58.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.725+0000 7f8d641dc640 1 -- 172.21.15.78:0/1113709705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5c103440 msgr2=0x7f8d5c100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:58.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.725+0000 7f8d641dc640 1 --2- 172.21.15.78:0/1113709705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5c103440 0x7f8d5c100cc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000ba50 tx=0x7f8d5000bf10 comp rx=0 tx=0).stop 2024-09-18T12:54:58.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.725+0000 7f8d641dc640 1 -- 172.21.15.78:0/1113709705 shutdown_connections 2024-09-18T12:54:58.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.725+0000 7f8d641dc640 1 --2- 172.21.15.78:0/1113709705 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8d4407af80 0x7f8d4407d440 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.725+0000 7f8d641dc640 1 --2- 172.21.15.78:0/1113709705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5c103440 0x7f8d5c100cc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.725+0000 7f8d641dc640 1 --2- 172.21.15.78:0/1113709705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d5c102b20 0x7f8d5c100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.725+0000 7f8d641dc640 1 -- 172.21.15.78:0/1113709705 >> 172.21.15.78:0/1113709705 conn(0x7f8d5c0fc520 msgr2=0x7f8d5c108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:58.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.725+0000 7f8d641dc640 1 -- 172.21.15.78:0/1113709705 shutdown_connections 2024-09-18T12:54:58.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.725+0000 7f8d641dc640 1 -- 172.21.15.78:0/1113709705 wait complete. 2024-09-18T12:54:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.807+0000 7fb2add96640 1 -- 172.21.15.78:0/2532049212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a8102ac0 msgr2=0x7fb2a8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.807+0000 7fb2add96640 1 --2- 172.21.15.78:0/2532049212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a8102ac0 0x7fb2a8102ea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb290009880 tx=0x7fb29002a530 comp rx=0 tx=0).stop 2024-09-18T12:54:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.807+0000 7fb2add96640 1 -- 172.21.15.78:0/2532049212 shutdown_connections 2024-09-18T12:54:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.807+0000 7fb2add96640 1 --2- 172.21.15.78:0/2532049212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2a81033e0 0x7fb2a810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.807+0000 7fb2add96640 1 --2- 172.21.15.78:0/2532049212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a8102ac0 0x7fb2a8102ea0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.807+0000 7fb2add96640 1 -- 172.21.15.78:0/2532049212 >> 172.21.15.78:0/2532049212 conn(0x7fb2a80fc520 msgr2=0x7fb2a80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.807+0000 7fb2add96640 1 -- 172.21.15.78:0/2532049212 shutdown_connections 2024-09-18T12:54:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.807+0000 7fb2add96640 1 -- 172.21.15.78:0/2532049212 wait complete. 2024-09-18T12:54:58.809 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:58 smithi078 podman[122982]: 2024-09-18 12:54:58.43368618 +0000 UTC m=+0.019604232 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:54:58.810 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:58 smithi078 podman[122982]: 2024-09-18 12:54:58.573120217 +0000 UTC m=+0.159038257 container create 407cc1be36c1dbd321ea0ccbf35dd14dfb1c2e0dc42752b85567eddd278cbb4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-18T12:54:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.808+0000 7fb2add96640 1 Processor -- start 2024-09-18T12:54:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.808+0000 7fb2add96640 1 -- start start 2024-09-18T12:54:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.808+0000 7fb2add96640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2a8102ac0 0x7fb2a819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.808+0000 7fb2add96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a81033e0 0x7fb2a819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.808+0000 7fb2add96640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a810edd0 con 0x7fb2a81033e0 2024-09-18T12:54:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.808+0000 7fb2add96640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a810ec50 con 0x7fb2a8102ac0 2024-09-18T12:54:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.808+0000 7fb2a6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a81033e0 0x7fb2a819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.808+0000 7fb2a6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a81033e0 0x7fb2a819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58382/0 (socket says 172.21.15.78:58382) 2024-09-18T12:54:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.808+0000 7fb2a6ffd640 1 -- 172.21.15.78:0/2438960212 learned_addr learned my addr 172.21.15.78:0/2438960212 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:54:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.808+0000 7fb2a77fe640 1 --2- 172.21.15.78:0/2438960212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2a8102ac0 0x7fb2a819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.808+0000 7fb2a6ffd640 1 -- 172.21.15.78:0/2438960212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2a8102ac0 msgr2=0x7fb2a819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.808+0000 7fb2a6ffd640 1 --2- 172.21.15.78:0/2438960212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2a8102ac0 0x7fb2a819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.808+0000 7fb2a6ffd640 1 -- 172.21.15.78:0/2438960212 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a81977e0 con 0x7fb2a81033e0 2024-09-18T12:54:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.808+0000 7fb2a77fe640 1 --2- 172.21.15.78:0/2438960212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2a8102ac0 0x7fb2a819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:54:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.809+0000 7fb2a6ffd640 1 --2- 172.21.15.78:0/2438960212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a81033e0 0x7fb2a819dba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb29800d8d0 tx=0x7fb29800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.809+0000 7fb2a4ff9640 1 -- 172.21.15.78:0/2438960212 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb298017030 con 0x7fb2a81033e0 2024-09-18T12:54:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.809+0000 7fb2a4ff9640 1 -- 172.21.15.78:0/2438960212 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb29800be10 con 0x7fb2a81033e0 2024-09-18T12:54:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.809+0000 7fb2add96640 1 -- 172.21.15.78:0/2438960212 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a8197ad0 con 0x7fb2a81033e0 2024-09-18T12:54:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.809+0000 7fb2a4ff9640 1 -- 172.21.15.78:0/2438960212 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb298005580 con 0x7fb2a81033e0 2024-09-18T12:54:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.809+0000 7fb2add96640 1 -- 172.21.15.78:0/2438960212 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a8198060 con 0x7fb2a81033e0 2024-09-18T12:54:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.810+0000 7fb2add96640 1 -- 172.21.15.78:0/2438960212 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a806aa90 con 0x7fb2a81033e0 2024-09-18T12:54:58.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.811+0000 7fb2a4ff9640 1 -- 172.21.15.78:0/2438960212 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fb298004020 con 0x7fb2a81033e0 2024-09-18T12:54:58.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.811+0000 7fb2a4ff9640 1 --2- 172.21.15.78:0/2438960212 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb29407af30 0x7fb29407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:58.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.811+0000 7fb2a4ff9640 1 -- 172.21.15.78:0/2438960212 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6070+0+0 (secure 0 0 0) 0x7fb298018070 con 0x7fb2a81033e0 2024-09-18T12:54:58.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.811+0000 7fb2a77fe640 1 --2- 172.21.15.78:0/2438960212 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb29407af30 0x7fb29407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:58.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.812+0000 7fb2a77fe640 1 --2- 172.21.15.78:0/2438960212 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb29407af30 0x7fb29407d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb290000c00 tx=0x7fb290031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:58.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:58.816+0000 7fb2a4ff9640 1 -- 172.21.15.78:0/2438960212 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fb298069370 con 0x7fb2a81033e0 2024-09-18T12:54:59.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.094+0000 7fb2add96640 1 -- 172.21.15.78:0/2438960212 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb2a8105f90 con 0x7fb2a81033e0 2024-09-18T12:54:59.096 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:58 smithi078 podman[122982]: 2024-09-18 12:54:58.843081622 +0000 UTC m=+0.428999670 container init 407cc1be36c1dbd321ea0ccbf35dd14dfb1c2e0dc42752b85567eddd278cbb4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-18T12:54:59.096 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:58 smithi078 podman[122982]: 2024-09-18 12:54:58.84778448 +0000 UTC m=+0.433702520 container start 407cc1be36c1dbd321ea0ccbf35dd14dfb1c2e0dc42752b85567eddd278cbb4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-18T12:54:59.096 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:58 smithi078 ceph-osd[123045]: -- 172.21.15.78:0/2368928917 <== mon.0 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f7227f61e0 con 0x55f722786000 2024-09-18T12:54:59.096 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:58 smithi078 bash[122982]: 407cc1be36c1dbd321ea0ccbf35dd14dfb1c2e0dc42752b85567eddd278cbb4c 2024-09-18T12:54:59.096 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:54:58 smithi078 systemd[1]: Started Ceph osd.1 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:54:59.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.094+0000 7fb2a4ff9640 1 -- 172.21.15.78:0/2438960212 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fb29806e220 con 0x7fb2a81033e0 2024-09-18T12:54:59.097 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:54:59.097 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:54:59.097 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:54:59.097 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:54:59.097 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:54:59.097 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:54:59.097 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:54:59.097 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:54:59.097 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4, 2024-09-18T12:54:59.097 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:54:59.097 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:54:59.097 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:54:59.097 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:54:59.097 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:54:59.098 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:54:59.098 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 8, 2024-09-18T12:54:59.098 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 5 2024-09-18T12:54:59.098 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:54:59.098 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:54:59.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.097+0000 7fb2add96640 1 -- 172.21.15.78:0/2438960212 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb29407af30 msgr2=0x7fb29407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:59.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.097+0000 7fb2add96640 1 --2- 172.21.15.78:0/2438960212 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb29407af30 0x7fb29407d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb290000c00 tx=0x7fb290031400 comp rx=0 tx=0).stop 2024-09-18T12:54:59.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.097+0000 7fb2add96640 1 -- 172.21.15.78:0/2438960212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a81033e0 msgr2=0x7fb2a819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:59.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.097+0000 7fb2add96640 1 --2- 172.21.15.78:0/2438960212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a81033e0 0x7fb2a819dba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb29800d8d0 tx=0x7fb29800dd90 comp rx=0 tx=0).stop 2024-09-18T12:54:59.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.097+0000 7fb2add96640 1 -- 172.21.15.78:0/2438960212 shutdown_connections 2024-09-18T12:54:59.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.097+0000 7fb2add96640 1 --2- 172.21.15.78:0/2438960212 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb29407af30 0x7fb29407d3f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.097+0000 7fb2add96640 1 --2- 172.21.15.78:0/2438960212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a81033e0 0x7fb2a819dba0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.097+0000 7fb2add96640 1 --2- 172.21.15.78:0/2438960212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2a8102ac0 0x7fb2a819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.097+0000 7fb2add96640 1 -- 172.21.15.78:0/2438960212 >> 172.21.15.78:0/2438960212 conn(0x7fb2a80fc520 msgr2=0x7fb2a8108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:59.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.097+0000 7fb2add96640 1 -- 172.21.15.78:0/2438960212 shutdown_connections 2024-09-18T12:54:59.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.097+0000 7fb2add96640 1 -- 172.21.15.78:0/2438960212 wait complete. 2024-09-18T12:54:59.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.182+0000 7f4fa1005640 1 -- 172.21.15.78:0/321723865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f9c1007f0 msgr2=0x7f4f9c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:59.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.182+0000 7f4fa1005640 1 --2- 172.21.15.78:0/321723865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f9c1007f0 0x7f4f9c100c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009880 tx=0x7f4f9002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.182+0000 7f4fa1005640 1 -- 172.21.15.78:0/321723865 shutdown_connections 2024-09-18T12:54:59.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.182+0000 7f4fa1005640 1 --2- 172.21.15.78:0/321723865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f9c1007f0 0x7f4f9c100c50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.182+0000 7f4fa1005640 1 --2- 172.21.15.78:0/321723865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f9c1067f0 0x7f4f9c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.182+0000 7f4fa1005640 1 -- 172.21.15.78:0/321723865 >> 172.21.15.78:0/321723865 conn(0x7f4f9c0fc550 msgr2=0x7f4f9c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:59.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.183+0000 7f4fa1005640 1 -- 172.21.15.78:0/321723865 shutdown_connections 2024-09-18T12:54:59.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.183+0000 7f4fa1005640 1 -- 172.21.15.78:0/321723865 wait complete. 2024-09-18T12:54:59.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.183+0000 7f4fa1005640 1 Processor -- start 2024-09-18T12:54:59.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.184+0000 7f4fa1005640 1 -- start start 2024-09-18T12:54:59.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.184+0000 7f4fa1005640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f9c1007f0 0x7f4f9c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:59.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.184+0000 7f4fa1005640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f9c1067f0 0x7f4f9c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:59.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.184+0000 7f4fa1005640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c10dd20 con 0x7f4f9c1067f0 2024-09-18T12:54:59.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.184+0000 7f4fa1005640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c10dba0 con 0x7f4f9c1007f0 2024-09-18T12:54:59.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.184+0000 7f4f9a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f9c1067f0 0x7f4f9c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:59.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.184+0000 7f4f9a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f9c1067f0 0x7f4f9c198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58404/0 (socket says 172.21.15.78:58404) 2024-09-18T12:54:59.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.184+0000 7f4f9a59c640 1 -- 172.21.15.78:0/4113614564 learned_addr learned my addr 172.21.15.78:0/4113614564 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:54:59.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.184+0000 7f4f9ad9d640 1 --2- 172.21.15.78:0/4113614564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f9c1007f0 0x7f4f9c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:59.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.184+0000 7f4f9a59c640 1 -- 172.21.15.78:0/4113614564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f9c1007f0 msgr2=0x7f4f9c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:59.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.184+0000 7f4f9a59c640 1 --2- 172.21.15.78:0/4113614564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f9c1007f0 0x7f4f9c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.184+0000 7f4f9a59c640 1 -- 172.21.15.78:0/4113614564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c1994b0 con 0x7f4f9c1067f0 2024-09-18T12:54:59.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.185+0000 7f4f9a59c640 1 --2- 172.21.15.78:0/4113614564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f9c1067f0 0x7f4f9c198eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f90031460 tx=0x7f4f900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:59.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.185+0000 7f4f83fff640 1 -- 172.21.15.78:0/4113614564 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f9003f070 con 0x7f4f9c1067f0 2024-09-18T12:54:59.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.185+0000 7f4fa1005640 1 -- 172.21.15.78:0/4113614564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9c199740 con 0x7f4f9c1067f0 2024-09-18T12:54:59.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.185+0000 7f4f83fff640 1 -- 172.21.15.78:0/4113614564 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f90004cf0 con 0x7f4f9c1067f0 2024-09-18T12:54:59.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.185+0000 7f4f83fff640 1 -- 172.21.15.78:0/4113614564 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f90035030 con 0x7f4f9c1067f0 2024-09-18T12:54:59.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.185+0000 7f4fa1005640 1 -- 172.21.15.78:0/4113614564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9c1a1cf0 con 0x7f4f9c1067f0 2024-09-18T12:54:59.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.186+0000 7f4fa1005640 1 -- 172.21.15.78:0/4113614564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f9c101f30 con 0x7f4f9c1067f0 2024-09-18T12:54:59.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.187+0000 7f4f83fff640 1 -- 172.21.15.78:0/4113614564 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4f90042070 con 0x7f4f9c1067f0 2024-09-18T12:54:59.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.188+0000 7f4f83fff640 1 --2- 172.21.15.78:0/4113614564 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f8407af30 0x7f4f8407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:59.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.188+0000 7f4f9ad9d640 1 --2- 172.21.15.78:0/4113614564 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f8407af30 0x7f4f8407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:59.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.188+0000 7f4f83fff640 1 -- 172.21.15.78:0/4113614564 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6070+0+0 (secure 0 0 0) 0x7f4f900bf030 con 0x7f4f9c1067f0 2024-09-18T12:54:59.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.188+0000 7f4f9ad9d640 1 --2- 172.21.15.78:0/4113614564 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f8407af30 0x7f4f8407d3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009990 tx=0x7f4f8c009110 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:59.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.192+0000 7f4f83fff640 1 -- 172.21.15.78:0/4113614564 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4f9008a700 con 0x7f4f9c1067f0 2024-09-18T12:54:59.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.439+0000 7f4fa1005640 1 -- 172.21.15.78:0/4113614564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4f9c100c50 con 0x7f4f9c1067f0 2024-09-18T12:54:59.441 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:59 smithi078 ceph-mon[108578]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:59.442 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:59 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:59.442 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:59 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:59.442 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:59 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:59.442 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:54:59 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2438960212' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:59.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.440+0000 7f4f83fff640 1 -- 172.21.15.78:0/4113614564 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) ==== 76+0+2032 (secure 0 0 0) 0x7f4f9008f5b0 con 0x7f4f9c1067f0 2024-09-18T12:54:59.442 INFO:teuthology.orchestra.run.smithi078.stdout:e18 2024-09-18T12:54:59.442 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:46:44:251409+0000 2024-09-18T12:54:59.443 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:54:59.443 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:54:59.443 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T12:54:59.443 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:54:59.443 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:54:59.443 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T12:54:59.443 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 18 2024-09-18T12:54:59.443 INFO:teuthology.orchestra.run.smithi078.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:54:59.443 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:54:59.443 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:46:44.251398+0000 2024-09-18T12:54:59.443 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T12:54:59.443 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T12:54:59.443 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T12:54:59.443 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T12:54:59.444 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T12:54:59.444 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T12:54:59.444 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T12:54:59.444 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T12:54:59.444 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 45 2024-09-18T12:54:59.444 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:54:59.444 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T12:54:59.444 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T12:54:59.444 INFO:teuthology.orchestra.run.smithi078.stdout:up {0=14560,1=14574} 2024-09-18T12:54:59.445 INFO:teuthology.orchestra.run.smithi078.stdout:failed 2024-09-18T12:54:59.445 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T12:54:59.445 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T12:54:59.445 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T12:54:59.446 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T12:54:59.446 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T12:54:59.446 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T12:54:59.446 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T12:54:59.446 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T12:54:59.446 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 14560 members: 14560,14574 2024-09-18T12:54:59.446 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{0:14560} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:54:59.446 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{1:14574} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:54:59.446 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:54:59.446 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:54:59.446 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T12:54:59.446 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:54:59.446 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:54:59.446 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/258027429,v1:172.21.15.148:6825/258027429] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:54:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 18 2024-09-18T12:54:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.442+0000 7f4fa1005640 1 -- 172.21.15.78:0/4113614564 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f8407af30 msgr2=0x7f4f8407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.442+0000 7f4fa1005640 1 --2- 172.21.15.78:0/4113614564 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f8407af30 0x7f4f8407d3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009990 tx=0x7f4f8c009110 comp rx=0 tx=0).stop 2024-09-18T12:54:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.442+0000 7f4fa1005640 1 -- 172.21.15.78:0/4113614564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f9c1067f0 msgr2=0x7f4f9c198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.442+0000 7f4fa1005640 1 --2- 172.21.15.78:0/4113614564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f9c1067f0 0x7f4f9c198eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f90031460 tx=0x7f4f900048f0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.443+0000 7f4fa1005640 1 -- 172.21.15.78:0/4113614564 shutdown_connections 2024-09-18T12:54:59.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.443+0000 7f4fa1005640 1 --2- 172.21.15.78:0/4113614564 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f8407af30 0x7f4f8407d3f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.443+0000 7f4fa1005640 1 --2- 172.21.15.78:0/4113614564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f9c1067f0 0x7f4f9c198eb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.443+0000 7f4fa1005640 1 --2- 172.21.15.78:0/4113614564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f9c1007f0 0x7f4f9c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.443+0000 7f4fa1005640 1 -- 172.21.15.78:0/4113614564 >> 172.21.15.78:0/4113614564 conn(0x7f4f9c0fc550 msgr2=0x7f4f9c0fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:59.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.443+0000 7f4fa1005640 1 -- 172.21.15.78:0/4113614564 shutdown_connections 2024-09-18T12:54:59.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.443+0000 7f4fa1005640 1 -- 172.21.15.78:0/4113614564 wait complete. 2024-09-18T12:54:59.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.530+0000 7f3c98e65640 1 -- 172.21.15.78:0/3421836790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c94107900 msgr2=0x7f3c94107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:59.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.530+0000 7f3c98e65640 1 --2- 172.21.15.78:0/3421836790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c94107900 0x7f3c94107ce0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009880 tx=0x7f3c8402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.530+0000 7f3c98e65640 1 -- 172.21.15.78:0/3421836790 shutdown_connections 2024-09-18T12:54:59.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.530+0000 7f3c98e65640 1 --2- 172.21.15.78:0/3421836790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c94101900 0x7f3c94101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.530+0000 7f3c98e65640 1 --2- 172.21.15.78:0/3421836790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c94107900 0x7f3c94107ce0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.530+0000 7f3c98e65640 1 -- 172.21.15.78:0/3421836790 >> 172.21.15.78:0/3421836790 conn(0x7f3c940fd5e0 msgr2=0x7f3c940ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:59.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.530+0000 7f3c98e65640 1 -- 172.21.15.78:0/3421836790 shutdown_connections 2024-09-18T12:54:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.530+0000 7f3c98e65640 1 -- 172.21.15.78:0/3421836790 wait complete. 2024-09-18T12:54:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.531+0000 7f3c98e65640 1 Processor -- start 2024-09-18T12:54:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.531+0000 7f3c98e65640 1 -- start start 2024-09-18T12:54:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.531+0000 7f3c98e65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c94101900 0x7f3c9419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.531+0000 7f3c98e65640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c94107900 0x7f3c9419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.531+0000 7f3c98e65640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9410edd0 con 0x7f3c94101900 2024-09-18T12:54:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.531+0000 7f3c98e65640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9410ec50 con 0x7f3c94107900 2024-09-18T12:54:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.531+0000 7f3c9259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c94101900 0x7f3c9419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.531+0000 7f3c9259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c94101900 0x7f3c9419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58430/0 (socket says 172.21.15.78:58430) 2024-09-18T12:54:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.531+0000 7f3c9259c640 1 -- 172.21.15.78:0/4048701012 learned_addr learned my addr 172.21.15.78:0/4048701012 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:54:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.531+0000 7f3c91d9b640 1 --2- 172.21.15.78:0/4048701012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c94107900 0x7f3c9419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.531+0000 7f3c9259c640 1 -- 172.21.15.78:0/4048701012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c94107900 msgr2=0x7f3c9419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.531+0000 7f3c9259c640 1 --2- 172.21.15.78:0/4048701012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c94107900 0x7f3c9419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.531+0000 7f3c9259c640 1 -- 172.21.15.78:0/4048701012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c94197800 con 0x7f3c94101900 2024-09-18T12:54:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.532+0000 7f3c9259c640 1 --2- 172.21.15.78:0/4048701012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c94101900 0x7f3c9419d680 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3c84031460 tx=0x7f3c840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.532+0000 7f3c837fe640 1 -- 172.21.15.78:0/4048701012 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c8403f070 con 0x7f3c94101900 2024-09-18T12:54:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.532+0000 7f3c837fe640 1 -- 172.21.15.78:0/4048701012 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c840035f0 con 0x7f3c94101900 2024-09-18T12:54:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.532+0000 7f3c837fe640 1 -- 172.21.15.78:0/4048701012 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c84035030 con 0x7f3c94101900 2024-09-18T12:54:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.532+0000 7f3c98e65640 1 -- 172.21.15.78:0/4048701012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c94197a90 con 0x7f3c94101900 2024-09-18T12:54:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.532+0000 7f3c98e65640 1 -- 172.21.15.78:0/4048701012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c94197fc0 con 0x7f3c94101900 2024-09-18T12:54:59.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.533+0000 7f3c98e65640 1 -- 172.21.15.78:0/4048701012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c94103040 con 0x7f3c94101900 2024-09-18T12:54:59.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.533+0000 7f3c837fe640 1 -- 172.21.15.78:0/4048701012 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3c84042070 con 0x7f3c94101900 2024-09-18T12:54:59.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.534+0000 7f3c837fe640 1 --2- 172.21.15.78:0/4048701012 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3c7c07af80 0x7f3c7c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:59.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.534+0000 7f3c837fe640 1 -- 172.21.15.78:0/4048701012 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6070+0+0 (secure 0 0 0) 0x7f3c840be8c0 con 0x7f3c94101900 2024-09-18T12:54:59.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.534+0000 7f3c91d9b640 1 --2- 172.21.15.78:0/4048701012 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3c7c07af80 0x7f3c7c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:59.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.534+0000 7f3c91d9b640 1 --2- 172.21.15.78:0/4048701012 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3c7c07af80 0x7f3c7c07d440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3c88005fd0 tx=0x7f3c88005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:59.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.538+0000 7f3c837fe640 1 -- 172.21.15.78:0/4048701012 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3c84089f90 con 0x7f3c94101900 2024-09-18T12:54:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:59 smithi148 ceph-mon[80030]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:59 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:59 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:54:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:59 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:54:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:54:59 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2438960212' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:54:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.736+0000 7f3c98e65640 1 -- 172.21.15.78:0/4048701012 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3c94198270 con 0x7f3c7c07af80 2024-09-18T12:54:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.738+0000 7f3c837fe640 1 -- 172.21.15.78:0/4048701012 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f3c94198270 con 0x7f3c7c07af80 2024-09-18T12:54:59.739 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:54:59.739 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:54:59.739 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:54:59.740 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:54:59.740 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:54:59.740 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T12:54:59.740 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T12:54:59.740 INFO:teuthology.orchestra.run.smithi078.stdout: "mon" 2024-09-18T12:54:59.740 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:54:59.740 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "7/23 daemons upgraded", 2024-09-18T12:54:59.740 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:54:59.740 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:54:59.740 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:54:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.740+0000 7f3c98e65640 1 -- 172.21.15.78:0/4048701012 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3c7c07af80 msgr2=0x7f3c7c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.740+0000 7f3c98e65640 1 --2- 172.21.15.78:0/4048701012 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3c7c07af80 0x7f3c7c07d440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3c88005fd0 tx=0x7f3c88005850 comp rx=0 tx=0).stop 2024-09-18T12:54:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.740+0000 7f3c98e65640 1 -- 172.21.15.78:0/4048701012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c94101900 msgr2=0x7f3c9419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.740+0000 7f3c98e65640 1 --2- 172.21.15.78:0/4048701012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c94101900 0x7f3c9419d680 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3c84031460 tx=0x7f3c840045e0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.740+0000 7f3c98e65640 1 -- 172.21.15.78:0/4048701012 shutdown_connections 2024-09-18T12:54:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.740+0000 7f3c98e65640 1 --2- 172.21.15.78:0/4048701012 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3c7c07af80 0x7f3c7c07d440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.740+0000 7f3c98e65640 1 --2- 172.21.15.78:0/4048701012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c94107900 0x7f3c9419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.740+0000 7f3c98e65640 1 --2- 172.21.15.78:0/4048701012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c94101900 0x7f3c9419d680 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.740+0000 7f3c98e65640 1 -- 172.21.15.78:0/4048701012 >> 172.21.15.78:0/4048701012 conn(0x7f3c940fd5e0 msgr2=0x7f3c940fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.740+0000 7f3c98e65640 1 -- 172.21.15.78:0/4048701012 shutdown_connections 2024-09-18T12:54:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.740+0000 7f3c98e65640 1 -- 172.21.15.78:0/4048701012 wait complete. 2024-09-18T12:54:59.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.824+0000 7f56ec67a640 1 -- 172.21.15.78:0/2234050738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e41003c0 msgr2=0x7f56e41007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:59.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.824+0000 7f56ec67a640 1 --2- 172.21.15.78:0/2234050738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e41003c0 0x7f56e41007a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009c20 tx=0x7f56e002a970 comp rx=0 tx=0).stop 2024-09-18T12:54:59.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.824+0000 7f56ec67a640 1 -- 172.21.15.78:0/2234050738 shutdown_connections 2024-09-18T12:54:59.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.824+0000 7f56ec67a640 1 --2- 172.21.15.78:0/2234050738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56e4100d70 0x7f56e4104c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.824+0000 7f56ec67a640 1 --2- 172.21.15.78:0/2234050738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e41003c0 0x7f56e41007a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.824+0000 7f56ec67a640 1 -- 172.21.15.78:0/2234050738 >> 172.21.15.78:0/2234050738 conn(0x7f56e40771e0 msgr2=0x7f56e40775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:59.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.825+0000 7f56ec67a640 1 -- 172.21.15.78:0/2234050738 shutdown_connections 2024-09-18T12:54:59.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.825+0000 7f56ec67a640 1 -- 172.21.15.78:0/2234050738 wait complete. 2024-09-18T12:54:59.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.825+0000 7f56ec67a640 1 Processor -- start 2024-09-18T12:54:59.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.825+0000 7f56ec67a640 1 -- start start 2024-09-18T12:54:59.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.825+0000 7f56ec67a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56e41003c0 0x7f56e419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:59.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.825+0000 7f56ec67a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e4100d70 0x7f56e419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:59.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.825+0000 7f56ec67a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f56e410cc10 con 0x7f56e4100d70 2024-09-18T12:54:59.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.825+0000 7f56ec67a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f56e410ca90 con 0x7f56e41003c0 2024-09-18T12:54:59.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.825+0000 7f56e9c15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e4100d70 0x7f56e419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:59.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.826+0000 7f56e9c15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e4100d70 0x7f56e419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58444/0 (socket says 172.21.15.78:58444) 2024-09-18T12:54:59.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.826+0000 7f56e9c15640 1 -- 172.21.15.78:0/2475855008 learned_addr learned my addr 172.21.15.78:0/2475855008 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:54:59.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.826+0000 7f56ea416640 1 --2- 172.21.15.78:0/2475855008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56e41003c0 0x7f56e419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:59.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.826+0000 7f56e9c15640 1 -- 172.21.15.78:0/2475855008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56e41003c0 msgr2=0x7f56e419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:59.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.826+0000 7f56e9c15640 1 --2- 172.21.15.78:0/2475855008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56e41003c0 0x7f56e419d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:59.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.826+0000 7f56e9c15640 1 -- 172.21.15.78:0/2475855008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e41977e0 con 0x7f56e4100d70 2024-09-18T12:54:59.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.826+0000 7f56ea416640 1 --2- 172.21.15.78:0/2475855008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56e41003c0 0x7f56e419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:54:59.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.826+0000 7f56e9c15640 1 --2- 172.21.15.78:0/2475855008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e4100d70 0x7f56e419dba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f56d400db10 tx=0x7f56d400a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:59.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.826+0000 7f56db7fe640 1 -- 172.21.15.78:0/2475855008 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f56d400ac60 con 0x7f56e4100d70 2024-09-18T12:54:59.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.826+0000 7f56ec67a640 1 -- 172.21.15.78:0/2475855008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e4197ad0 con 0x7f56e4100d70 2024-09-18T12:54:59.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.826+0000 7f56db7fe640 1 -- 172.21.15.78:0/2475855008 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f56d400ae00 con 0x7f56e4100d70 2024-09-18T12:54:59.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.826+0000 7f56db7fe640 1 -- 172.21.15.78:0/2475855008 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f56d400e680 con 0x7f56e4100d70 2024-09-18T12:54:59.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.826+0000 7f56ec67a640 1 -- 172.21.15.78:0/2475855008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e4198060 con 0x7f56e4100d70 2024-09-18T12:54:59.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.827+0000 7f56ec67a640 1 -- 172.21.15.78:0/2475855008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e41016e0 con 0x7f56e4100d70 2024-09-18T12:54:59.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.828+0000 7f56db7fe640 1 -- 172.21.15.78:0/2475855008 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f56d4005020 con 0x7f56e4100d70 2024-09-18T12:54:59.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.828+0000 7f56db7fe640 1 --2- 172.21.15.78:0/2475855008 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f56d007af30 0x7f56d007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:59.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.828+0000 7f56db7fe640 1 -- 172.21.15.78:0/2475855008 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6070+0+0 (secure 0 0 0) 0x7f56d409e040 con 0x7f56e4100d70 2024-09-18T12:54:59.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.828+0000 7f56ea416640 1 --2- 172.21.15.78:0/2475855008 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f56d007af30 0x7f56d007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:59.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.829+0000 7f56ea416640 1 --2- 172.21.15.78:0/2475855008 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f56d007af30 0x7f56d007d3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f56e0005e30 tx=0x7f56e0005da0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:59.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:54:59.833+0000 7f56db7fe640 1 -- 172.21.15.78:0/2475855008 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f56d4069690 con 0x7f56e4100d70 2024-09-18T12:55:00.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:00.087+0000 7f56ec67a640 1 -- 172.21.15.78:0/2475855008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f56e41084e0 con 0x7f56e4100d70 2024-09-18T12:55:00.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:00.088+0000 7f56db7fe640 1 -- 172.21.15.78:0/2475855008 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1294 (secure 0 0 0) 0x7f56d406e540 con 0x7f56e4100d70 2024-09-18T12:55:00.089 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 49/333 objects degraded (14.715%), 15 pgs degraded 2024-09-18T12:55:00.089 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:55:00.089 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:55:00.089 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-18T12:55:00.090 INFO:teuthology.orchestra.run.smithi078.stdout: osd.1 (root=default,host=smithi078) is down 2024-09-18T12:55:00.090 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 49/333 objects degraded (14.715%), 15 pgs degraded 2024-09-18T12:55:00.090 INFO:teuthology.orchestra.run.smithi078.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-18T12:55:00.090 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-18T12:55:00.090 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-18T12:55:00.090 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-18T12:55:00.090 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-18T12:55:00.090 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-18T12:55:00.090 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-18T12:55:00.090 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-18T12:55:00.090 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-18T12:55:00.090 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-18T12:55:00.090 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-18T12:55:00.091 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-09-18T12:55:00.091 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-18T12:55:00.091 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-09-18T12:55:00.091 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-18T12:55:00.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:00.090+0000 7f56ec67a640 1 -- 172.21.15.78:0/2475855008 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f56d007af30 msgr2=0x7f56d007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:00.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:00.090+0000 7f56ec67a640 1 --2- 172.21.15.78:0/2475855008 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f56d007af30 0x7f56d007d3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f56e0005e30 tx=0x7f56e0005da0 comp rx=0 tx=0).stop 2024-09-18T12:55:00.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:00.090+0000 7f56ec67a640 1 -- 172.21.15.78:0/2475855008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e4100d70 msgr2=0x7f56e419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:00.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:00.090+0000 7f56ec67a640 1 --2- 172.21.15.78:0/2475855008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e4100d70 0x7f56e419dba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f56d400db10 tx=0x7f56d400a250 comp rx=0 tx=0).stop 2024-09-18T12:55:00.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:00.090+0000 7f56ec67a640 1 -- 172.21.15.78:0/2475855008 shutdown_connections 2024-09-18T12:55:00.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:00.090+0000 7f56ec67a640 1 --2- 172.21.15.78:0/2475855008 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f56d007af30 0x7f56d007d3f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:00.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:00.090+0000 7f56ec67a640 1 --2- 172.21.15.78:0/2475855008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e4100d70 0x7f56e419dba0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:00.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:00.090+0000 7f56ec67a640 1 --2- 172.21.15.78:0/2475855008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56e41003c0 0x7f56e419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:00.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:00.090+0000 7f56ec67a640 1 -- 172.21.15.78:0/2475855008 >> 172.21.15.78:0/2475855008 conn(0x7f56e40771e0 msgr2=0x7f56e40fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:00.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:00.090+0000 7f56ec67a640 1 -- 172.21.15.78:0/2475855008 shutdown_connections 2024-09-18T12:55:00.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:00.090+0000 7f56ec67a640 1 -- 172.21.15.78:0/2475855008 wait complete. 2024-09-18T12:55:00.452 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:00 smithi078 ceph-mon[108578]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:00.452 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:00 smithi078 ceph-mon[108578]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:00.452 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:00 smithi078 ceph-mon[108578]: pgmap v147: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/333 objects degraded (14.715%) 2024-09-18T12:55:00.452 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:00 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/4113614564' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:55:00.452 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:00 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2475855008' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:55:00.482 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:00 smithi148 ceph-mon[80030]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:00.482 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:00 smithi148 ceph-mon[80030]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:00.482 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:00 smithi148 ceph-mon[80030]: pgmap v147: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/333 objects degraded (14.715%) 2024-09-18T12:55:00.482 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:00 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/4113614564' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:55:00.482 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:00 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2475855008' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:55:00.707 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:55:00 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1[123018]: 2024-09-18T12:55:00.496+0000 7f8c7f53b640 -1 Falling back to public interface 2024-09-18T12:55:01.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:01 smithi078 ceph-mon[108578]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:01.703 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:01 smithi148 ceph-mon[80030]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:02 smithi078 ceph-mon[108578]: pgmap v148: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/333 objects degraded (14.715%) 2024-09-18T12:55:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:02 smithi078 ceph-mon[108578]: Health check update: Degraded data redundancy: 49/333 objects degraded (14.715%), 15 pgs degraded (PG_DEGRADED) 2024-09-18T12:55:02.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:02 smithi148 ceph-mon[80030]: pgmap v148: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/333 objects degraded (14.715%) 2024-09-18T12:55:02.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:02 smithi148 ceph-mon[80030]: Health check update: Degraded data redundancy: 49/333 objects degraded (14.715%), 15 pgs degraded (PG_DEGRADED) 2024-09-18T12:55:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:04 smithi078 ceph-mon[108578]: pgmap v149: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/333 objects degraded (14.715%) 2024-09-18T12:55:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:04 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:04 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:04 smithi148 ceph-mon[80030]: pgmap v149: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/333 objects degraded (14.715%) 2024-09-18T12:55:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:04 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:04 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:06.218 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:05 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:06.218 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:05 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:06.218 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:05 smithi078 ceph-mon[108578]: pgmap v150: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/333 objects degraded (14.715%) 2024-09-18T12:55:06.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:05 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:06.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:05 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:06.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:05 smithi148 ceph-mon[80030]: pgmap v150: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/333 objects degraded (14.715%) 2024-09-18T12:55:06.492 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:55:06 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1[123018]: 2024-09-18T12:55:06.404+0000 7f8c7f53b640 -1 osd.1 52 log_to_monitors true 2024-09-18T12:55:07.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:06 smithi148 ceph-mon[80030]: from='osd.1 [v2:172.21.15.78:6810/542961810,v1:172.21.15.78:6811/542961810]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-18T12:55:07.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:06 smithi078 ceph-mon[108578]: from='osd.1 [v2:172.21.15.78:6810/542961810,v1:172.21.15.78:6811/542961810]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-18T12:55:07.242 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 12:55:06 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1[123018]: 2024-09-18T12:55:06.852+0000 7f8c772e5640 -1 osd.1 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:55:07.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:07 smithi078 ceph-mon[108578]: from='osd.1 [v2:172.21.15.78:6810/542961810,v1:172.21.15.78:6811/542961810]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T12:55:07.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:07 smithi078 ceph-mon[108578]: osdmap e55: 6 total, 5 up, 6 in 2024-09-18T12:55:07.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:07 smithi078 ceph-mon[108578]: from='osd.1 [v2:172.21.15.78:6810/542961810,v1:172.21.15.78:6811/542961810]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-18T12:55:07.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:07 smithi078 ceph-mon[108578]: pgmap v152: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/333 objects degraded (14.715%) 2024-09-18T12:55:08.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:07 smithi148 ceph-mon[80030]: from='osd.1 [v2:172.21.15.78:6810/542961810,v1:172.21.15.78:6811/542961810]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T12:55:08.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:07 smithi148 ceph-mon[80030]: osdmap e55: 6 total, 5 up, 6 in 2024-09-18T12:55:08.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:07 smithi148 ceph-mon[80030]: from='osd.1 [v2:172.21.15.78:6810/542961810,v1:172.21.15.78:6811/542961810]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-18T12:55:08.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:07 smithi148 ceph-mon[80030]: pgmap v152: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/333 objects degraded (14.715%) 2024-09-18T12:55:09.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:08 smithi148 ceph-mon[80030]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:55:09.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:08 smithi148 ceph-mon[80030]: osd.1 [v2:172.21.15.78:6810/542961810,v1:172.21.15.78:6811/542961810] boot 2024-09-18T12:55:09.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:08 smithi148 ceph-mon[80030]: osdmap e56: 6 total, 6 up, 6 in 2024-09-18T12:55:09.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:08 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-18T12:55:09.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:08 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:09.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:08 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:09.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:08 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:55:09.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:08 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:55:09.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:08 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:09.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:08 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:55:09.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:08 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:09.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:08 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:09.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:08 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:09.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:08 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-18T12:55:09.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:08 smithi078 ceph-mon[108578]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:55:09.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:08 smithi078 ceph-mon[108578]: osd.1 [v2:172.21.15.78:6810/542961810,v1:172.21.15.78:6811/542961810] boot 2024-09-18T12:55:09.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:08 smithi078 ceph-mon[108578]: osdmap e56: 6 total, 6 up, 6 in 2024-09-18T12:55:09.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:08 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-18T12:55:09.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:08 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:09.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:08 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:09.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:08 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:55:09.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:08 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:55:09.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:08 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:09.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:08 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:55:09.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:08 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:09.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:08 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:09.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:08 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:09.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:08 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-18T12:55:09.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:09 smithi078 ceph-mon[108578]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T12:55:09.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:09 smithi078 ceph-mon[108578]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-18T12:55:09.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:09 smithi078 ceph-mon[108578]: osdmap e57: 6 total, 6 up, 6 in 2024-09-18T12:55:09.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:09 smithi078 ceph-mon[108578]: pgmap v155: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/333 objects degraded (14.715%) 2024-09-18T12:55:10.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:09 smithi148 ceph-mon[80030]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T12:55:10.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:09 smithi148 ceph-mon[80030]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-18T12:55:10.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:09 smithi148 ceph-mon[80030]: osdmap e57: 6 total, 6 up, 6 in 2024-09-18T12:55:10.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:09 smithi148 ceph-mon[80030]: pgmap v155: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/333 objects degraded (14.715%) 2024-09-18T12:55:11.776 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:11.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:11.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:11 smithi148 ceph-mon[80030]: pgmap v156: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24/333 objects degraded (7.207%) 2024-09-18T12:55:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:11 smithi078 ceph-mon[108578]: pgmap v156: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24/333 objects degraded (7.207%) 2024-09-18T12:55:12.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:12 smithi148 ceph-mon[80030]: Health check update: Degraded data redundancy: 24/333 objects degraded (7.207%), 7 pgs degraded (PG_DEGRADED) 2024-09-18T12:55:12.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:12 smithi078 ceph-mon[108578]: Health check update: Degraded data redundancy: 24/333 objects degraded (7.207%), 7 pgs degraded (PG_DEGRADED) 2024-09-18T12:55:13.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:13 smithi148 ceph-mon[80030]: pgmap v157: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:13.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:13 smithi078 ceph-mon[108578]: pgmap v157: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:14.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:14 smithi148 ceph-mon[80030]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/333 objects degraded (7.207%), 7 pgs degraded) 2024-09-18T12:55:14.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:14 smithi078 ceph-mon[108578]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/333 objects degraded (7.207%), 7 pgs degraded) 2024-09-18T12:55:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:15 smithi148 ceph-mon[80030]: pgmap v158: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:15.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:15 smithi078 ceph-mon[108578]: pgmap v158: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:18.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:18 smithi148 ceph-mon[80030]: pgmap v159: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:18.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:18 smithi078 ceph-mon[108578]: pgmap v159: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:20.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:20 smithi148 ceph-mon[80030]: pgmap v160: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:20 smithi078 ceph-mon[108578]: pgmap v160: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:21.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:21 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:21.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:21 smithi148 ceph-mon[80030]: pgmap v161: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:21.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:21 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:21.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:21 smithi078 ceph-mon[108578]: pgmap v161: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:24.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:24 smithi148 ceph-mon[80030]: pgmap v162: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:24.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-18T12:55:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:24 smithi078 ceph-mon[108578]: pgmap v162: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-18T12:55:25.395 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:25 smithi078 ceph-mon[108578]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T12:55:25.396 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:25 smithi078 ceph-mon[108578]: Upgrade: osd.2 is safe to restart 2024-09-18T12:55:25.396 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:25 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:25.396 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:25 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-18T12:55:25.396 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:25 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:55:25.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:25 smithi148 ceph-mon[80030]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T12:55:25.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:25 smithi148 ceph-mon[80030]: Upgrade: osd.2 is safe to restart 2024-09-18T12:55:25.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:25 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:25.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:25 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-18T12:55:25.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:25 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:55:26.384 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:26 smithi078 ceph-mon[108578]: Upgrade: Updating osd.2 2024-09-18T12:55:26.385 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:26 smithi078 ceph-mon[108578]: Deploying daemon osd.2 on smithi078 2024-09-18T12:55:26.385 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:26 smithi078 ceph-mon[108578]: pgmap v163: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:26.385 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:26.385 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:26 smithi148 ceph-mon[80030]: Upgrade: Updating osd.2 2024-09-18T12:55:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:26 smithi148 ceph-mon[80030]: Deploying daemon osd.2 on smithi078 2024-09-18T12:55:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:26 smithi148 ceph-mon[80030]: pgmap v163: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:26.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:27.992 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:27 smithi078 systemd[1]: Stopping Ceph osd.2 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:55:28.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:28 smithi148 ceph-mon[80030]: pgmap v164: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:28.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:28 smithi148 ceph-mon[80030]: osd.2 marked itself down and dead 2024-09-18T12:55:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:28 smithi078 ceph-mon[108578]: pgmap v164: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:28 smithi078 ceph-mon[108578]: osd.2 marked itself down and dead 2024-09-18T12:55:28.492 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:28 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2[64612]: 2024-09-18T12:55:28.039+0000 7f4c9e612640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:55:28.492 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:28 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2[64612]: 2024-09-18T12:55:28.039+0000 7f4c9e612640 -1 osd.2 57 *** Got signal Terminated *** 2024-09-18T12:55:28.492 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:28 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2[64612]: 2024-09-18T12:55:28.039+0000 7f4c9e612640 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:55:28.992 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:28 smithi078 podman[128082]: 2024-09-18 12:55:28.599416429 +0000 UTC m=+0.673288856 container died aa438874cd43c0cccaf74462623466fa9d79b8fc0fd47f2628e5c8a16bfc80f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-18T12:55:29.458 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:29 smithi078 ceph-mon[108578]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:55:29.459 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:29 smithi078 ceph-mon[108578]: osdmap e58: 6 total, 5 up, 6 in 2024-09-18T12:55:29.459 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:29 smithi078 podman[128082]: 2024-09-18 12:55:29.16460553 +0000 UTC m=+1.238477955 container cleanup aa438874cd43c0cccaf74462623466fa9d79b8fc0fd47f2628e5c8a16bfc80f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-18T12:55:29.459 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:29 smithi078 bash[128082]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2 2024-09-18T12:55:29.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:29 smithi148 ceph-mon[80030]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:55:29.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:29 smithi148 ceph-mon[80030]: osdmap e58: 6 total, 5 up, 6 in 2024-09-18T12:55:29.742 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:29 smithi078 podman[128108]: 2024-09-18 12:55:29.458028003 +0000 UTC m=+0.851953791 container remove aa438874cd43c0cccaf74462623466fa9d79b8fc0fd47f2628e5c8a16bfc80f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-18T12:55:30.029 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:29 smithi078 podman[128197]: 2024-09-18 12:55:29.678023692 +0000 UTC m=+0.015873925 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:55:30.029 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:29 smithi078 podman[128197]: 2024-09-18 12:55:29.784286452 +0000 UTC m=+0.122136715 container create cb437ed19f0e6371c2acff991aa9ac3cb1b29471dfb9ed1826cfa8e559f1996f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-18T12:55:30.029 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:30 smithi078 podman[128197]: 2024-09-18 12:55:30.028575865 +0000 UTC m=+0.366426096 container init cb437ed19f0e6371c2acff991aa9ac3cb1b29471dfb9ed1826cfa8e559f1996f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-18T12:55:30.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.177+0000 7fac593c3640 1 -- 172.21.15.78:0/3361560466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac54101910 msgr2=0x7fac54101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:30.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.177+0000 7fac593c3640 1 --2- 172.21.15.78:0/3361560466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac54101910 0x7fac54101d70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fac44009880 tx=0x7fac4402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.177+0000 7fac593c3640 1 -- 172.21.15.78:0/3361560466 shutdown_connections 2024-09-18T12:55:30.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.177+0000 7fac593c3640 1 --2- 172.21.15.78:0/3361560466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac54101910 0x7fac54101d70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.177+0000 7fac593c3640 1 --2- 172.21.15.78:0/3361560466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac54107910 0x7fac54107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.177+0000 7fac593c3640 1 -- 172.21.15.78:0/3361560466 >> 172.21.15.78:0/3361560466 conn(0x7fac540fd610 msgr2=0x7fac540ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:30.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.177+0000 7fac593c3640 1 -- 172.21.15.78:0/3361560466 shutdown_connections 2024-09-18T12:55:30.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.177+0000 7fac593c3640 1 -- 172.21.15.78:0/3361560466 wait complete. 2024-09-18T12:55:30.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.178+0000 7fac593c3640 1 Processor -- start 2024-09-18T12:55:30.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.178+0000 7fac593c3640 1 -- start start 2024-09-18T12:55:30.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.178+0000 7fac593c3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac54101910 0x7fac5419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:30.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.178+0000 7fac593c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac54107910 0x7fac5419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:30.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.178+0000 7fac593c3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fac5410ede0 con 0x7fac54107910 2024-09-18T12:55:30.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.178+0000 7fac593c3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fac5410ec60 con 0x7fac54101910 2024-09-18T12:55:30.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.178+0000 7fac527fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac54107910 0x7fac5419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:30.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.178+0000 7fac527fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac54107910 0x7fac5419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44692/0 (socket says 172.21.15.78:44692) 2024-09-18T12:55:30.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.178+0000 7fac527fc640 1 -- 172.21.15.78:0/3441656737 learned_addr learned my addr 172.21.15.78:0/3441656737 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:55:30.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.178+0000 7fac52ffd640 1 --2- 172.21.15.78:0/3441656737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac54101910 0x7fac5419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:30.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.178+0000 7fac527fc640 1 -- 172.21.15.78:0/3441656737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac54101910 msgr2=0x7fac5419d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:30.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.178+0000 7fac527fc640 1 --2- 172.21.15.78:0/3441656737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac54101910 0x7fac5419d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.178+0000 7fac527fc640 1 -- 172.21.15.78:0/3441656737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac541977b0 con 0x7fac54107910 2024-09-18T12:55:30.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.178+0000 7fac52ffd640 1 --2- 172.21.15.78:0/3441656737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac54101910 0x7fac5419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:55:30.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.179+0000 7fac527fc640 1 --2- 172.21.15.78:0/3441656737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac54107910 0x7fac5419db70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fac44031460 tx=0x7fac440045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:30.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.179+0000 7fac4bfff640 1 -- 172.21.15.78:0/3441656737 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac4403f070 con 0x7fac54107910 2024-09-18T12:55:30.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.179+0000 7fac593c3640 1 -- 172.21.15.78:0/3441656737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac54197a40 con 0x7fac54107910 2024-09-18T12:55:30.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.179+0000 7fac4bfff640 1 -- 172.21.15.78:0/3441656737 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac440035f0 con 0x7fac54107910 2024-09-18T12:55:30.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.179+0000 7fac4bfff640 1 -- 172.21.15.78:0/3441656737 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac44035030 con 0x7fac54107910 2024-09-18T12:55:30.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.179+0000 7fac593c3640 1 -- 172.21.15.78:0/3441656737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac54197f70 con 0x7fac54107910 2024-09-18T12:55:30.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.180+0000 7fac593c3640 1 -- 172.21.15.78:0/3441656737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac54103050 con 0x7fac54107910 2024-09-18T12:55:30.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.181+0000 7fac4bfff640 1 -- 172.21.15.78:0/3441656737 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fac44042070 con 0x7fac54107910 2024-09-18T12:55:30.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.181+0000 7fac4bfff640 1 --2- 172.21.15.78:0/3441656737 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fac4007af80 0x7fac4007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:30.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.181+0000 7fac4bfff640 1 -- 172.21.15.78:0/3441656737 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6070+0+0 (secure 0 0 0) 0x7fac440be8e0 con 0x7fac54107910 2024-09-18T12:55:30.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.181+0000 7fac52ffd640 1 --2- 172.21.15.78:0/3441656737 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fac4007af80 0x7fac4007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:30.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.182+0000 7fac52ffd640 1 --2- 172.21.15.78:0/3441656737 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fac4007af80 0x7fac4007d440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac3c009b40 tx=0x7fac3c005e50 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:30.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.186+0000 7fac4bfff640 1 -- 172.21.15.78:0/3441656737 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fac44089fb0 con 0x7fac54107910 2024-09-18T12:55:30.386 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:30 smithi078 ceph-mon[108578]: pgmap v166: 65 pgs: 9 stale+active+clean, 56 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:30.386 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:30 smithi078 ceph-mon[108578]: osdmap e59: 6 total, 5 up, 6 in 2024-09-18T12:55:30.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.384+0000 7fac593c3640 1 -- 172.21.15.78:0/3441656737 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fac541982e0 con 0x7fac4007af80 2024-09-18T12:55:30.386 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:30 smithi078 podman[128197]: 2024-09-18 12:55:30.032021276 +0000 UTC m=+0.369871501 container start cb437ed19f0e6371c2acff991aa9ac3cb1b29471dfb9ed1826cfa8e559f1996f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-18T12:55:30.387 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:30 smithi078 podman[128197]: 2024-09-18 12:55:30.153779261 +0000 UTC m=+0.491629495 container attach cb437ed19f0e6371c2acff991aa9ac3cb1b29471dfb9ed1826cfa8e559f1996f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:55:30.387 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:30 smithi078 podman[128197]: 2024-09-18 12:55:30.218240893 +0000 UTC m=+0.556091133 container died cb437ed19f0e6371c2acff991aa9ac3cb1b29471dfb9ed1826cfa8e559f1996f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-18T12:55:30.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.385+0000 7fac4bfff640 1 -- 172.21.15.78:0/3441656737 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fac541982e0 con 0x7fac4007af80 2024-09-18T12:55:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.388+0000 7fac593c3640 1 -- 172.21.15.78:0/3441656737 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fac4007af80 msgr2=0x7fac4007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.388+0000 7fac593c3640 1 --2- 172.21.15.78:0/3441656737 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fac4007af80 0x7fac4007d440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac3c009b40 tx=0x7fac3c005e50 comp rx=0 tx=0).stop 2024-09-18T12:55:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.388+0000 7fac593c3640 1 -- 172.21.15.78:0/3441656737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac54107910 msgr2=0x7fac5419db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.388+0000 7fac593c3640 1 --2- 172.21.15.78:0/3441656737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac54107910 0x7fac5419db70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fac44031460 tx=0x7fac440045e0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.388+0000 7fac593c3640 1 -- 172.21.15.78:0/3441656737 shutdown_connections 2024-09-18T12:55:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.388+0000 7fac593c3640 1 --2- 172.21.15.78:0/3441656737 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fac4007af80 0x7fac4007d440 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.388+0000 7fac593c3640 1 --2- 172.21.15.78:0/3441656737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac54107910 0x7fac5419db70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.388+0000 7fac593c3640 1 --2- 172.21.15.78:0/3441656737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac54101910 0x7fac5419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.388+0000 7fac593c3640 1 -- 172.21.15.78:0/3441656737 >> 172.21.15.78:0/3441656737 conn(0x7fac540fd610 msgr2=0x7fac540fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.388+0000 7fac593c3640 1 -- 172.21.15.78:0/3441656737 shutdown_connections 2024-09-18T12:55:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.388+0000 7fac593c3640 1 -- 172.21.15.78:0/3441656737 wait complete. 2024-09-18T12:55:30.398 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:55:30.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:30 smithi148 ceph-mon[80030]: pgmap v166: 65 pgs: 9 stale+active+clean, 56 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:30.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:30 smithi148 ceph-mon[80030]: osdmap e59: 6 total, 5 up, 6 in 2024-09-18T12:55:30.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.474+0000 7f6a52e71640 1 -- 172.21.15.78:0/2945567522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c107900 msgr2=0x7f6a4c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:30.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.474+0000 7f6a52e71640 1 --2- 172.21.15.78:0/2945567522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c107900 0x7f6a4c107ce0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009880 tx=0x7f6a4002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.474+0000 7f6a52e71640 1 -- 172.21.15.78:0/2945567522 shutdown_connections 2024-09-18T12:55:30.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.474+0000 7f6a52e71640 1 --2- 172.21.15.78:0/2945567522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4c101900 0x7f6a4c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.474+0000 7f6a52e71640 1 --2- 172.21.15.78:0/2945567522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c107900 0x7f6a4c107ce0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.474+0000 7f6a52e71640 1 -- 172.21.15.78:0/2945567522 >> 172.21.15.78:0/2945567522 conn(0x7f6a4c0fd600 msgr2=0x7f6a4c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:30.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.474+0000 7f6a52e71640 1 -- 172.21.15.78:0/2945567522 shutdown_connections 2024-09-18T12:55:30.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.474+0000 7f6a52e71640 1 -- 172.21.15.78:0/2945567522 wait complete. 2024-09-18T12:55:30.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.475+0000 7f6a52e71640 1 Processor -- start 2024-09-18T12:55:30.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.475+0000 7f6a52e71640 1 -- start start 2024-09-18T12:55:30.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.475+0000 7f6a52e71640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4c101900 0x7f6a4c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:30.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.475+0000 7f6a52e71640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c107900 0x7f6a4c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:30.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.475+0000 7f6a52e71640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c10edb0 con 0x7f6a4c107900 2024-09-18T12:55:30.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.475+0000 7f6a52e71640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c10ec30 con 0x7f6a4c101900 2024-09-18T12:55:30.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.475+0000 7f6a4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c107900 0x7f6a4c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:30.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.475+0000 7f6a4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c107900 0x7f6a4c19db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44718/0 (socket says 172.21.15.78:44718) 2024-09-18T12:55:30.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.475+0000 7f6a4bfff640 1 -- 172.21.15.78:0/3045884448 learned_addr learned my addr 172.21.15.78:0/3045884448 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:55:30.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.476+0000 7f6a50c0d640 1 --2- 172.21.15.78:0/3045884448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4c101900 0x7f6a4c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:30.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.476+0000 7f6a4bfff640 1 -- 172.21.15.78:0/3045884448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4c101900 msgr2=0x7f6a4c19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:30.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.476+0000 7f6a4bfff640 1 --2- 172.21.15.78:0/3045884448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4c101900 0x7f6a4c19d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.476+0000 7f6a4bfff640 1 -- 172.21.15.78:0/3045884448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4c1977c0 con 0x7f6a4c107900 2024-09-18T12:55:30.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.476+0000 7f6a4bfff640 1 --2- 172.21.15.78:0/3045884448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c107900 0x7f6a4c19db80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800d8d0 tx=0x7f6a3800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:30.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.476+0000 7f6a49ffb640 1 -- 172.21.15.78:0/3045884448 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a38017070 con 0x7f6a4c107900 2024-09-18T12:55:30.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.476+0000 7f6a52e71640 1 -- 172.21.15.78:0/3045884448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4c197ab0 con 0x7f6a4c107900 2024-09-18T12:55:30.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.476+0000 7f6a49ffb640 1 -- 172.21.15.78:0/3045884448 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a38010460 con 0x7f6a4c107900 2024-09-18T12:55:30.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.476+0000 7f6a49ffb640 1 -- 172.21.15.78:0/3045884448 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a3800f5f0 con 0x7f6a4c107900 2024-09-18T12:55:30.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.476+0000 7f6a52e71640 1 -- 172.21.15.78:0/3045884448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a4c198040 con 0x7f6a4c107900 2024-09-18T12:55:30.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.477+0000 7f6a52e71640 1 -- 172.21.15.78:0/3045884448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a4c103040 con 0x7f6a4c107900 2024-09-18T12:55:30.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.478+0000 7f6a49ffb640 1 -- 172.21.15.78:0/3045884448 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6a38009a30 con 0x7f6a4c107900 2024-09-18T12:55:30.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.478+0000 7f6a49ffb640 1 --2- 172.21.15.78:0/3045884448 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6a3c07af90 0x7f6a3c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:30.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.479+0000 7f6a49ffb640 1 -- 172.21.15.78:0/3045884448 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6070+0+0 (secure 0 0 0) 0x7f6a3809dd10 con 0x7f6a4c107900 2024-09-18T12:55:30.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.479+0000 7f6a50c0d640 1 --2- 172.21.15.78:0/3045884448 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6a3c07af90 0x7f6a3c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:30.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.479+0000 7f6a50c0d640 1 --2- 172.21.15.78:0/3045884448 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6a3c07af90 0x7f6a3c07d450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6a400096c0 tx=0x7f6a40031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:30.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.483+0000 7f6a49ffb640 1 -- 172.21.15.78:0/3045884448 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6a380693e0 con 0x7f6a4c107900 2024-09-18T12:55:30.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.680+0000 7f6a52e71640 1 -- 172.21.15.78:0/3045884448 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6a4c1982f0 con 0x7f6a3c07af90 2024-09-18T12:55:30.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.681+0000 7f6a49ffb640 1 -- 172.21.15.78:0/3045884448 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f6a4c1982f0 con 0x7f6a3c07af90 2024-09-18T12:55:30.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.683+0000 7f6a52e71640 1 -- 172.21.15.78:0/3045884448 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6a3c07af90 msgr2=0x7f6a3c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:30.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.683+0000 7f6a52e71640 1 --2- 172.21.15.78:0/3045884448 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6a3c07af90 0x7f6a3c07d450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6a400096c0 tx=0x7f6a40031400 comp rx=0 tx=0).stop 2024-09-18T12:55:30.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.683+0000 7f6a52e71640 1 -- 172.21.15.78:0/3045884448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c107900 msgr2=0x7f6a4c19db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:30.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.683+0000 7f6a52e71640 1 --2- 172.21.15.78:0/3045884448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c107900 0x7f6a4c19db80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800d8d0 tx=0x7f6a3800dd90 comp rx=0 tx=0).stop 2024-09-18T12:55:30.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.683+0000 7f6a52e71640 1 -- 172.21.15.78:0/3045884448 shutdown_connections 2024-09-18T12:55:30.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.683+0000 7f6a52e71640 1 --2- 172.21.15.78:0/3045884448 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6a3c07af90 0x7f6a3c07d450 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.683+0000 7f6a52e71640 1 --2- 172.21.15.78:0/3045884448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c107900 0x7f6a4c19db80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.683+0000 7f6a52e71640 1 --2- 172.21.15.78:0/3045884448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a4c101900 0x7f6a4c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.684+0000 7f6a52e71640 1 -- 172.21.15.78:0/3045884448 >> 172.21.15.78:0/3045884448 conn(0x7f6a4c0fd600 msgr2=0x7f6a4c0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:30.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.684+0000 7f6a52e71640 1 -- 172.21.15.78:0/3045884448 shutdown_connections 2024-09-18T12:55:30.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.684+0000 7f6a52e71640 1 -- 172.21.15.78:0/3045884448 wait complete. 2024-09-18T12:55:30.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.765+0000 7fbc17e7e640 1 -- 172.21.15.78:0/3053527091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc101007f0 msgr2=0x7fbc10100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:30.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.765+0000 7fbc17e7e640 1 --2- 172.21.15.78:0/3053527091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc101007f0 0x7fbc10100c50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009880 tx=0x7fbc0402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.766+0000 7fbc17e7e640 1 -- 172.21.15.78:0/3053527091 shutdown_connections 2024-09-18T12:55:30.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.766+0000 7fbc17e7e640 1 --2- 172.21.15.78:0/3053527091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc101007f0 0x7fbc10100c50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.766+0000 7fbc17e7e640 1 --2- 172.21.15.78:0/3053527091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc101067f0 0x7fbc10106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.766+0000 7fbc17e7e640 1 -- 172.21.15.78:0/3053527091 >> 172.21.15.78:0/3053527091 conn(0x7fbc100fc550 msgr2=0x7fbc100fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:30.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.766+0000 7fbc17e7e640 1 -- 172.21.15.78:0/3053527091 shutdown_connections 2024-09-18T12:55:30.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.766+0000 7fbc17e7e640 1 -- 172.21.15.78:0/3053527091 wait complete. 2024-09-18T12:55:30.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.766+0000 7fbc17e7e640 1 Processor -- start 2024-09-18T12:55:30.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.766+0000 7fbc17e7e640 1 -- start start 2024-09-18T12:55:30.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc17e7e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc101007f0 0x7fbc100fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:30.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc17e7e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc101067f0 0x7fbc100fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:30.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc17e7e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1010dcc0 con 0x7fbc101067f0 2024-09-18T12:55:30.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc17e7e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1010db40 con 0x7fbc101007f0 2024-09-18T12:55:30.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc15419640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc101067f0 0x7fbc100fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:30.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc15419640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc101067f0 0x7fbc100fd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44728/0 (socket says 172.21.15.78:44728) 2024-09-18T12:55:30.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc15419640 1 -- 172.21.15.78:0/1917027755 learned_addr learned my addr 172.21.15.78:0/1917027755 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:55:30.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc15c1a640 1 --2- 172.21.15.78:0/1917027755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc101007f0 0x7fbc100fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:30.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc15419640 1 -- 172.21.15.78:0/1917027755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc101007f0 msgr2=0x7fbc100fccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:30.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc15419640 1 --2- 172.21.15.78:0/1917027755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc101007f0 0x7fbc100fccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc15419640 1 -- 172.21.15.78:0/1917027755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc100fd750 con 0x7fbc101067f0 2024-09-18T12:55:30.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc15419640 1 --2- 172.21.15.78:0/1917027755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc101067f0 0x7fbc100fd210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc04031460 tx=0x7fbc040045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:30.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc0effd640 1 -- 172.21.15.78:0/1917027755 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc0403f070 con 0x7fbc101067f0 2024-09-18T12:55:30.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc0effd640 1 -- 172.21.15.78:0/1917027755 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc04004b10 con 0x7fbc101067f0 2024-09-18T12:55:30.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc17e7e640 1 -- 172.21.15.78:0/1917027755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc100fd9e0 con 0x7fbc101067f0 2024-09-18T12:55:30.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc0effd640 1 -- 172.21.15.78:0/1917027755 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc04035030 con 0x7fbc101067f0 2024-09-18T12:55:30.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.767+0000 7fbc17e7e640 1 -- 172.21.15.78:0/1917027755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc101a3da0 con 0x7fbc101067f0 2024-09-18T12:55:30.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.768+0000 7fbc17e7e640 1 -- 172.21.15.78:0/1917027755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc10101f30 con 0x7fbc101067f0 2024-09-18T12:55:30.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.769+0000 7fbc0effd640 1 -- 172.21.15.78:0/1917027755 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbc04042070 con 0x7fbc101067f0 2024-09-18T12:55:30.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.769+0000 7fbc0effd640 1 --2- 172.21.15.78:0/1917027755 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbbf807af40 0x7fbbf807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:30.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.770+0000 7fbc0effd640 1 -- 172.21.15.78:0/1917027755 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6070+0+0 (secure 0 0 0) 0x7fbc040bea50 con 0x7fbc101067f0 2024-09-18T12:55:30.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.770+0000 7fbc15c1a640 1 --2- 172.21.15.78:0/1917027755 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbbf807af40 0x7fbbf807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:30.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.770+0000 7fbc15c1a640 1 --2- 172.21.15.78:0/1917027755 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbbf807af40 0x7fbbf807d400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbc08005fd0 tx=0x7fbc0800b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:30.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.774+0000 7fbc0effd640 1 -- 172.21.15.78:0/1917027755 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbc0408a0a0 con 0x7fbc101067f0 2024-09-18T12:55:30.934 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:30 smithi078 podman[128241]: 2024-09-18 12:55:30.899943483 +0000 UTC m=+0.676197977 container remove cb437ed19f0e6371c2acff991aa9ac3cb1b29471dfb9ed1826cfa8e559f1996f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731) 2024-09-18T12:55:30.934 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:30 smithi078 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-18T12:55:30.934 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:30 smithi078 systemd[1]: Stopped Ceph osd.2 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:55:30.934 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:30 smithi078 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.2.service: Consumed 47.668s CPU time. 2024-09-18T12:55:30.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.963+0000 7fbc17e7e640 1 -- 172.21.15.78:0/1917027755 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbc10062630 con 0x7fbbf807af40 2024-09-18T12:55:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.981+0000 7fbc0effd640 1 -- 172.21.15.78:0/1917027755 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fbc10062630 con 0x7fbbf807af40 2024-09-18T12:55:30.983 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:55:30.983 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (3m) 26s ago 14m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T12:55:30.983 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (5m) 26s ago 14m 8862k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:55:30.983 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (5m) 88s ago 13m 8292k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:55:30.983 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (96s) 26s ago 14m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T12:55:30.983 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (91s) 88s ago 13m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T12:55:30.983 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (2m) 26s ago 14m 75.7M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T12:55:30.983 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (9m) 26s ago 9m 150M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:55:30.983 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (8m) 26s ago 8m 28.0M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:55:30.983 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (8m) 88s ago 8m 16.2M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:55:30.983 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (8m) 88s ago 8m 17.0M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:55:30.984 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (5m) 26s ago 15m 523M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:55:30.984 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (4m) 88s ago 13m 454M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:55:30.984 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (2m) 26s ago 15m 41.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T12:55:30.984 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (107s) 88s ago 13m 26.4M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T12:55:30.984 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (4m) 26s ago 14m 11.7M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:55:30.984 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (4m) 88s ago 13m 11.4M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:55:30.984 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (69s) 26s ago 12m 83.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T12:55:30.984 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (32s) 26s ago 11m 12.2M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T12:55:30.984 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (11m) 26s ago 11m 180M 1216M 19.1.1-330-gc2ddf972 ebb0615149de aa438874cd43 2024-09-18T12:55:30.984 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (10m) 88s ago 10m 237M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:55:30.984 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (10m) 88s ago 10m 208M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:55:30.984 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (10m) 88s ago 9m 196M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:55:30.985 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (3m) 26s ago 13m 52.0M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:55:30.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.984+0000 7fbc17e7e640 1 -- 172.21.15.78:0/1917027755 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbbf807af40 msgr2=0x7fbbf807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:30.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.984+0000 7fbc17e7e640 1 --2- 172.21.15.78:0/1917027755 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbbf807af40 0x7fbbf807d400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbc08005fd0 tx=0x7fbc0800b390 comp rx=0 tx=0).stop 2024-09-18T12:55:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.984+0000 7fbc17e7e640 1 -- 172.21.15.78:0/1917027755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc101067f0 msgr2=0x7fbc100fd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.984+0000 7fbc17e7e640 1 --2- 172.21.15.78:0/1917027755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc101067f0 0x7fbc100fd210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc04031460 tx=0x7fbc040045e0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.984+0000 7fbc17e7e640 1 -- 172.21.15.78:0/1917027755 shutdown_connections 2024-09-18T12:55:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.984+0000 7fbc17e7e640 1 --2- 172.21.15.78:0/1917027755 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbbf807af40 0x7fbbf807d400 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.984+0000 7fbc17e7e640 1 --2- 172.21.15.78:0/1917027755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc101067f0 0x7fbc100fd210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.984+0000 7fbc17e7e640 1 --2- 172.21.15.78:0/1917027755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc101007f0 0x7fbc100fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.984+0000 7fbc17e7e640 1 -- 172.21.15.78:0/1917027755 >> 172.21.15.78:0/1917027755 conn(0x7fbc100fc550 msgr2=0x7fbc10069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.985+0000 7fbc17e7e640 1 -- 172.21.15.78:0/1917027755 shutdown_connections 2024-09-18T12:55:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:30.985+0000 7fbc17e7e640 1 -- 172.21.15.78:0/1917027755 wait complete. 2024-09-18T12:55:31.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.065+0000 7fd3ecd74640 1 -- 172.21.15.78:0/3962769273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e81033d0 msgr2=0x7fd3e810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.065+0000 7fd3ecd74640 1 --2- 172.21.15.78:0/3962769273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e81033d0 0x7fd3e810b8c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009880 tx=0x7fd3dc02a530 comp rx=0 tx=0).stop 2024-09-18T12:55:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.065+0000 7fd3ecd74640 1 -- 172.21.15.78:0/3962769273 shutdown_connections 2024-09-18T12:55:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.065+0000 7fd3ecd74640 1 --2- 172.21.15.78:0/3962769273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e81033d0 0x7fd3e810b8c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.065+0000 7fd3ecd74640 1 --2- 172.21.15.78:0/3962769273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3e8102ab0 0x7fd3e8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.065+0000 7fd3ecd74640 1 -- 172.21.15.78:0/3962769273 >> 172.21.15.78:0/3962769273 conn(0x7fd3e80fc550 msgr2=0x7fd3e80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.065+0000 7fd3ecd74640 1 -- 172.21.15.78:0/3962769273 shutdown_connections 2024-09-18T12:55:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.065+0000 7fd3ecd74640 1 -- 172.21.15.78:0/3962769273 wait complete. 2024-09-18T12:55:31.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.066+0000 7fd3ecd74640 1 Processor -- start 2024-09-18T12:55:31.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.066+0000 7fd3ecd74640 1 -- start start 2024-09-18T12:55:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.066+0000 7fd3ecd74640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3e8102ab0 0x7fd3e819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.066+0000 7fd3ecd74640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e81033d0 0x7fd3e819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.066+0000 7fd3ecd74640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e810ede0 con 0x7fd3e81033d0 2024-09-18T12:55:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.066+0000 7fd3ecd74640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e810ec60 con 0x7fd3e8102ab0 2024-09-18T12:55:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.066+0000 7fd3e5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e81033d0 0x7fd3e819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.066+0000 7fd3e5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e81033d0 0x7fd3e819dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44744/0 (socket says 172.21.15.78:44744) 2024-09-18T12:55:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.067+0000 7fd3e5d9b640 1 -- 172.21.15.78:0/4242703457 learned_addr learned my addr 172.21.15.78:0/4242703457 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:55:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.067+0000 7fd3e659c640 1 --2- 172.21.15.78:0/4242703457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3e8102ab0 0x7fd3e819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.067+0000 7fd3e5d9b640 1 -- 172.21.15.78:0/4242703457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3e8102ab0 msgr2=0x7fd3e819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.067+0000 7fd3e5d9b640 1 --2- 172.21.15.78:0/4242703457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3e8102ab0 0x7fd3e819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.067+0000 7fd3e5d9b640 1 -- 172.21.15.78:0/4242703457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e8197810 con 0x7fd3e81033d0 2024-09-18T12:55:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.067+0000 7fd3e5d9b640 1 --2- 172.21.15.78:0/4242703457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e81033d0 0x7fd3e819dbd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc031460 tx=0x7fd3dc0045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.067+0000 7fd3d77fe640 1 -- 172.21.15.78:0/4242703457 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3dc03f070 con 0x7fd3e81033d0 2024-09-18T12:55:31.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.067+0000 7fd3d77fe640 1 -- 172.21.15.78:0/4242703457 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd3dc0035f0 con 0x7fd3e81033d0 2024-09-18T12:55:31.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.067+0000 7fd3ecd74640 1 -- 172.21.15.78:0/4242703457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e8197aa0 con 0x7fd3e81033d0 2024-09-18T12:55:31.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.067+0000 7fd3d77fe640 1 -- 172.21.15.78:0/4242703457 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3dc035030 con 0x7fd3e81033d0 2024-09-18T12:55:31.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.067+0000 7fd3ecd74640 1 -- 172.21.15.78:0/4242703457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e8197fd0 con 0x7fd3e81033d0 2024-09-18T12:55:31.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.068+0000 7fd3ecd74640 1 -- 172.21.15.78:0/4242703457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e806a580 con 0x7fd3e81033d0 2024-09-18T12:55:31.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.069+0000 7fd3d77fe640 1 -- 172.21.15.78:0/4242703457 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd3dc042070 con 0x7fd3e81033d0 2024-09-18T12:55:31.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.069+0000 7fd3d77fe640 1 --2- 172.21.15.78:0/4242703457 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd3d007af30 0x7fd3d007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:31.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.069+0000 7fd3e659c640 1 --2- 172.21.15.78:0/4242703457 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd3d007af30 0x7fd3d007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:31.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.069+0000 7fd3d77fe640 1 -- 172.21.15.78:0/4242703457 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6070+0+0 (secure 0 0 0) 0x7fd3dc0be780 con 0x7fd3e81033d0 2024-09-18T12:55:31.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.070+0000 7fd3e659c640 1 --2- 172.21.15.78:0/4242703457 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd3d007af30 0x7fd3d007d3f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009bd0 tx=0x7fd3d8005f90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:31.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.077+0000 7fd3d77fe640 1 -- 172.21.15.78:0/4242703457 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd3dc089dd0 con 0x7fd3e81033d0 2024-09-18T12:55:31.212 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:31 smithi078 systemd[1]: Starting Ceph osd.2 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:55:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.337+0000 7fd3ecd74640 1 -- 172.21.15.78:0/4242703457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd3e8198d40 con 0x7fd3e81033d0 2024-09-18T12:55:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.338+0000 7fd3d77fe640 1 -- 172.21.15.78:0/4242703457 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fd3dc08ec80 con 0x7fd3e81033d0 2024-09-18T12:55:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:55:31.340 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:55:31.340 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:55:31.340 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:55:31.340 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:55:31.340 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:55:31.340 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:55:31.340 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:55:31.340 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3, 2024-09-18T12:55:31.340 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:55:31.340 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:55:31.340 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:55:31.340 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:55:31.341 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:55:31.341 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:55:31.341 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 7, 2024-09-18T12:55:31.341 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T12:55:31.341 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:55:31.341 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:55:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.340+0000 7fd3ecd74640 1 -- 172.21.15.78:0/4242703457 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd3d007af30 msgr2=0x7fd3d007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.340+0000 7fd3ecd74640 1 --2- 172.21.15.78:0/4242703457 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd3d007af30 0x7fd3d007d3f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009bd0 tx=0x7fd3d8005f90 comp rx=0 tx=0).stop 2024-09-18T12:55:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.341+0000 7fd3ecd74640 1 -- 172.21.15.78:0/4242703457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e81033d0 msgr2=0x7fd3e819dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.341+0000 7fd3ecd74640 1 --2- 172.21.15.78:0/4242703457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e81033d0 0x7fd3e819dbd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc031460 tx=0x7fd3dc0045c0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.341+0000 7fd3ecd74640 1 -- 172.21.15.78:0/4242703457 shutdown_connections 2024-09-18T12:55:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.341+0000 7fd3ecd74640 1 --2- 172.21.15.78:0/4242703457 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd3d007af30 0x7fd3d007d3f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.341+0000 7fd3ecd74640 1 --2- 172.21.15.78:0/4242703457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e81033d0 0x7fd3e819dbd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.341+0000 7fd3ecd74640 1 --2- 172.21.15.78:0/4242703457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3e8102ab0 0x7fd3e819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.341+0000 7fd3ecd74640 1 -- 172.21.15.78:0/4242703457 >> 172.21.15.78:0/4242703457 conn(0x7fd3e80fc550 msgr2=0x7fd3e8108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.341+0000 7fd3ecd74640 1 -- 172.21.15.78:0/4242703457 shutdown_connections 2024-09-18T12:55:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.341+0000 7fd3ecd74640 1 -- 172.21.15.78:0/4242703457 wait complete. 2024-09-18T12:55:31.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.425+0000 7fd1258fe640 1 -- 172.21.15.78:0/3124856438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd120101900 msgr2=0x7fd120101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:31.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.425+0000 7fd1258fe640 1 --2- 172.21.15.78:0/3124856438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd120101900 0x7fd120101d60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd114009880 tx=0x7fd11402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.425+0000 7fd1258fe640 1 -- 172.21.15.78:0/3124856438 shutdown_connections 2024-09-18T12:55:31.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.425+0000 7fd1258fe640 1 --2- 172.21.15.78:0/3124856438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd120101900 0x7fd120101d60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.425+0000 7fd1258fe640 1 --2- 172.21.15.78:0/3124856438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd120107900 0x7fd120107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.425+0000 7fd1258fe640 1 -- 172.21.15.78:0/3124856438 >> 172.21.15.78:0/3124856438 conn(0x7fd1200fd600 msgr2=0x7fd1200ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:31.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.425+0000 7fd1258fe640 1 -- 172.21.15.78:0/3124856438 shutdown_connections 2024-09-18T12:55:31.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.425+0000 7fd1258fe640 1 -- 172.21.15.78:0/3124856438 wait complete. 2024-09-18T12:55:31.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.425+0000 7fd1258fe640 1 Processor -- start 2024-09-18T12:55:31.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.426+0000 7fd1258fe640 1 -- start start 2024-09-18T12:55:31.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.426+0000 7fd1258fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd120101900 0x7fd1200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.426+0000 7fd1258fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd120107900 0x7fd120074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.426+0000 7fd1258fe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd12010edd0 con 0x7fd120101900 2024-09-18T12:55:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.426+0000 7fd1258fe640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd12010ec50 con 0x7fd120107900 2024-09-18T12:55:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.426+0000 7fd11effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd120101900 0x7fd1200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.426+0000 7fd11effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd120101900 0x7fd1200744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36162/0 (socket says 172.21.15.78:36162) 2024-09-18T12:55:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.426+0000 7fd11effd640 1 -- 172.21.15.78:0/294212196 learned_addr learned my addr 172.21.15.78:0/294212196 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:55:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.426+0000 7fd11e7fc640 1 --2- 172.21.15.78:0/294212196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd120107900 0x7fd120074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.426+0000 7fd11effd640 1 -- 172.21.15.78:0/294212196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd120107900 msgr2=0x7fd120074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.426+0000 7fd11effd640 1 --2- 172.21.15.78:0/294212196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd120107900 0x7fd120074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.426+0000 7fd11effd640 1 -- 172.21.15.78:0/294212196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd120074f70 con 0x7fd120101900 2024-09-18T12:55:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.427+0000 7fd11effd640 1 --2- 172.21.15.78:0/294212196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd120101900 0x7fd1200744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd11000d6f0 tx=0x7fd11000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.427+0000 7fd1248fc640 1 -- 172.21.15.78:0/294212196 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd110017070 con 0x7fd120101900 2024-09-18T12:55:31.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.427+0000 7fd1258fe640 1 -- 172.21.15.78:0/294212196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd120075260 con 0x7fd120101900 2024-09-18T12:55:31.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.427+0000 7fd1248fc640 1 -- 172.21.15.78:0/294212196 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd11000de00 con 0x7fd120101900 2024-09-18T12:55:31.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.427+0000 7fd1248fc640 1 -- 172.21.15.78:0/294212196 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd110004bb0 con 0x7fd120101900 2024-09-18T12:55:31.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.427+0000 7fd1258fe640 1 -- 172.21.15.78:0/294212196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1201a3e80 con 0x7fd120101900 2024-09-18T12:55:31.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.428+0000 7fd1258fe640 1 -- 172.21.15.78:0/294212196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd120103040 con 0x7fd120101900 2024-09-18T12:55:31.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.429+0000 7fd1248fc640 1 -- 172.21.15.78:0/294212196 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd110009a30 con 0x7fd120101900 2024-09-18T12:55:31.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.429+0000 7fd1248fc640 1 --2- 172.21.15.78:0/294212196 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd10807af90 0x7fd10807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:31.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.429+0000 7fd1248fc640 1 -- 172.21.15.78:0/294212196 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6070+0+0 (secure 0 0 0) 0x7fd11009db30 con 0x7fd120101900 2024-09-18T12:55:31.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.429+0000 7fd11e7fc640 1 --2- 172.21.15.78:0/294212196 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd10807af90 0x7fd10807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:31.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.430+0000 7fd11e7fc640 1 --2- 172.21.15.78:0/294212196 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd10807af90 0x7fd10807d450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd1140096c0 tx=0x7fd114000bc0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:31.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.433+0000 7fd1248fc640 1 -- 172.21.15.78:0/294212196 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd110069200 con 0x7fd120101900 2024-09-18T12:55:31.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:31 smithi148 ceph-mon[80030]: Health check failed: Degraded data redundancy: 28/333 objects degraded (8.408%), 10 pgs degraded (PG_DEGRADED) 2024-09-18T12:55:31.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:31 smithi078 ceph-mon[108578]: Health check failed: Degraded data redundancy: 28/333 objects degraded (8.408%), 10 pgs degraded (PG_DEGRADED) 2024-09-18T12:55:31.492 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:31 smithi078 podman[128408]: 2024-09-18 12:55:31.261477398 +0000 UTC m=+0.016410606 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:55:31.492 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:31 smithi078 podman[128408]: 2024-09-18 12:55:31.384832002 +0000 UTC m=+0.139765204 container create c4d5b87a3b227c4cef54afd83eab331d6fd5d42309e4aa01e1273fed43199565 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-18T12:55:31.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.654+0000 7fd1258fe640 1 -- 172.21.15.78:0/294212196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd120109e70 con 0x7fd120101900 2024-09-18T12:55:31.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.655+0000 7fd1248fc640 1 -- 172.21.15.78:0/294212196 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) ==== 76+0+2032 (secure 0 0 0) 0x7fd11005ee20 con 0x7fd120101900 2024-09-18T12:55:31.657 INFO:teuthology.orchestra.run.smithi078.stdout:e18 2024-09-18T12:55:31.657 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:46:44:251409+0000 2024-09-18T12:55:31.657 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:55:31.657 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:55:31.657 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T12:55:31.657 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:55:31.657 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:55:31.657 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T12:55:31.657 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 18 2024-09-18T12:55:31.658 INFO:teuthology.orchestra.run.smithi078.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:55:31.658 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:55:31.658 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:46:44.251398+0000 2024-09-18T12:55:31.658 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T12:55:31.658 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T12:55:31.658 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T12:55:31.658 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T12:55:31.658 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T12:55:31.658 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T12:55:31.658 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T12:55:31.658 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T12:55:31.658 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 45 2024-09-18T12:55:31.658 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:55:31.659 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T12:55:31.659 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T12:55:31.659 INFO:teuthology.orchestra.run.smithi078.stdout:up {0=14560,1=14574} 2024-09-18T12:55:31.659 INFO:teuthology.orchestra.run.smithi078.stdout:failed 2024-09-18T12:55:31.659 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T12:55:31.659 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T12:55:31.659 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T12:55:31.659 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T12:55:31.659 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T12:55:31.659 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T12:55:31.659 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T12:55:31.659 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T12:55:31.659 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 14560 members: 14560,14574 2024-09-18T12:55:31.659 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{0:14560} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:55:31.660 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{1:14574} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:55:31.660 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:55:31.660 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:55:31.660 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T12:55:31.660 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:55:31.660 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:55:31.660 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/258027429,v1:172.21.15.148:6825/258027429] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:55:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 18 2024-09-18T12:55:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.657+0000 7fd1258fe640 1 -- 172.21.15.78:0/294212196 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd10807af90 msgr2=0x7fd10807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.657+0000 7fd1258fe640 1 --2- 172.21.15.78:0/294212196 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd10807af90 0x7fd10807d450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd1140096c0 tx=0x7fd114000bc0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.657+0000 7fd1258fe640 1 -- 172.21.15.78:0/294212196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd120101900 msgr2=0x7fd1200744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.657+0000 7fd1258fe640 1 --2- 172.21.15.78:0/294212196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd120101900 0x7fd1200744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd11000d6f0 tx=0x7fd11000dbb0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.657+0000 7fd1258fe640 1 -- 172.21.15.78:0/294212196 shutdown_connections 2024-09-18T12:55:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.657+0000 7fd1258fe640 1 --2- 172.21.15.78:0/294212196 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd10807af90 0x7fd10807d450 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.657+0000 7fd1258fe640 1 --2- 172.21.15.78:0/294212196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd120107900 0x7fd120074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.657+0000 7fd1258fe640 1 --2- 172.21.15.78:0/294212196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd120101900 0x7fd1200744f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.657+0000 7fd1258fe640 1 -- 172.21.15.78:0/294212196 >> 172.21.15.78:0/294212196 conn(0x7fd1200fd600 msgr2=0x7fd1200fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:31.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.657+0000 7fd1258fe640 1 -- 172.21.15.78:0/294212196 shutdown_connections 2024-09-18T12:55:31.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.658+0000 7fd1258fe640 1 -- 172.21.15.78:0/294212196 wait complete. 2024-09-18T12:55:31.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.743+0000 7f8a98d61640 1 -- 172.21.15.78:0/3583798041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a94102b70 msgr2=0x7f8a94102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:31.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.743+0000 7f8a98d61640 1 --2- 172.21.15.78:0/3583798041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a94102b70 0x7f8a94102f50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009880 tx=0x7f8a8402a530 comp rx=0 tx=0).stop 2024-09-18T12:55:31.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.743+0000 7f8a98d61640 1 -- 172.21.15.78:0/3583798041 shutdown_connections 2024-09-18T12:55:31.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.743+0000 7f8a98d61640 1 --2- 172.21.15.78:0/3583798041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a94103490 0x7f8a9410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.743+0000 7f8a98d61640 1 --2- 172.21.15.78:0/3583798041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a94102b70 0x7f8a94102f50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.743+0000 7f8a98d61640 1 -- 172.21.15.78:0/3583798041 >> 172.21.15.78:0/3583798041 conn(0x7f8a940fc550 msgr2=0x7f8a940fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:31.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.743+0000 7f8a98d61640 1 -- 172.21.15.78:0/3583798041 shutdown_connections 2024-09-18T12:55:31.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.743+0000 7f8a98d61640 1 -- 172.21.15.78:0/3583798041 wait complete. 2024-09-18T12:55:31.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.744+0000 7f8a98d61640 1 Processor -- start 2024-09-18T12:55:31.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.744+0000 7f8a98d61640 1 -- start start 2024-09-18T12:55:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.744+0000 7f8a98d61640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a94102b70 0x7f8a941007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.744+0000 7f8a98d61640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a94103490 0x7f8a94100d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.744+0000 7f8a98d61640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9410edc0 con 0x7f8a94103490 2024-09-18T12:55:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.744+0000 7f8a98d61640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9410ec40 con 0x7f8a94102b70 2024-09-18T12:55:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.744+0000 7f8a91d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a94103490 0x7f8a94100d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.744+0000 7f8a91d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a94103490 0x7f8a94100d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36178/0 (socket says 172.21.15.78:36178) 2024-09-18T12:55:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.744+0000 7f8a91d9b640 1 -- 172.21.15.78:0/4022793908 learned_addr learned my addr 172.21.15.78:0/4022793908 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:55:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.744+0000 7f8a9259c640 1 --2- 172.21.15.78:0/4022793908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a94102b70 0x7f8a941007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.744+0000 7f8a91d9b640 1 -- 172.21.15.78:0/4022793908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a94102b70 msgr2=0x7f8a941007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.744+0000 7f8a91d9b640 1 --2- 172.21.15.78:0/4022793908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a94102b70 0x7f8a941007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.744+0000 7f8a91d9b640 1 -- 172.21.15.78:0/4022793908 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a94101250 con 0x7f8a94103490 2024-09-18T12:55:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.745+0000 7f8a91d9b640 1 --2- 172.21.15.78:0/4022793908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a94103490 0x7f8a94100d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00d8d0 tx=0x7f8a7c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.745+0000 7f8a8b7fe640 1 -- 172.21.15.78:0/4022793908 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a7c017030 con 0x7f8a94103490 2024-09-18T12:55:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.745+0000 7f8a8b7fe640 1 -- 172.21.15.78:0/4022793908 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a7c004020 con 0x7f8a94103490 2024-09-18T12:55:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.745+0000 7f8a98d61640 1 -- 172.21.15.78:0/4022793908 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a94101540 con 0x7f8a94103490 2024-09-18T12:55:31.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.745+0000 7f8a8b7fe640 1 -- 172.21.15.78:0/4022793908 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a7c0047a0 con 0x7f8a94103490 2024-09-18T12:55:31.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.745+0000 7f8a98d61640 1 -- 172.21.15.78:0/4022793908 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a941a3e30 con 0x7f8a94103490 2024-09-18T12:55:31.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.746+0000 7f8a98d61640 1 -- 172.21.15.78:0/4022793908 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a9406a4c0 con 0x7f8a94103490 2024-09-18T12:55:31.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.747+0000 7f8a8b7fe640 1 -- 172.21.15.78:0/4022793908 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8a7c0041d0 con 0x7f8a94103490 2024-09-18T12:55:31.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.747+0000 7f8a8b7fe640 1 --2- 172.21.15.78:0/4022793908 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a8007af40 0x7f8a8007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:31.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.747+0000 7f8a8b7fe640 1 -- 172.21.15.78:0/4022793908 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6070+0+0 (secure 0 0 0) 0x7f8a7c018070 con 0x7f8a94103490 2024-09-18T12:55:31.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.747+0000 7f8a9259c640 1 --2- 172.21.15.78:0/4022793908 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a8007af40 0x7f8a8007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:31.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.748+0000 7f8a9259c640 1 --2- 172.21.15.78:0/4022793908 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a8007af40 0x7f8a8007d400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8a840096c0 tx=0x7f8a84004f30 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:31.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.752+0000 7f8a8b7fe640 1 -- 172.21.15.78:0/4022793908 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8a7c0693b0 con 0x7f8a94103490 2024-09-18T12:55:31.768 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:31 smithi078 podman[128408]: 2024-09-18 12:55:31.629443086 +0000 UTC m=+0.384376289 container init c4d5b87a3b227c4cef54afd83eab331d6fd5d42309e4aa01e1273fed43199565 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-18T12:55:31.768 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:31 smithi078 podman[128408]: 2024-09-18 12:55:31.63274984 +0000 UTC m=+0.387683051 container start c4d5b87a3b227c4cef54afd83eab331d6fd5d42309e4aa01e1273fed43199565 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:55:31.768 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:31 smithi078 podman[128408]: 2024-09-18 12:55:31.712749892 +0000 UTC m=+0.467683103 container attach c4d5b87a3b227c4cef54afd83eab331d6fd5d42309e4aa01e1273fed43199565 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-activate, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:55:31.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.948+0000 7f8a98d61640 1 -- 172.21.15.78:0/4022793908 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8a94062630 con 0x7f8a8007af40 2024-09-18T12:55:31.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.949+0000 7f8a8b7fe640 1 -- 172.21.15.78:0/4022793908 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f8a94062630 con 0x7f8a8007af40 2024-09-18T12:55:31.950 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:55:31.950 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:55:31.950 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:55:31.950 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:55:31.950 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:55:31.950 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T12:55:31.951 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T12:55:31.951 INFO:teuthology.orchestra.run.smithi078.stdout: "mon" 2024-09-18T12:55:31.951 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:55:31.951 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "8/23 daemons upgraded", 2024-09-18T12:55:31.951 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:55:31.951 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:55:31.951 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:55:31.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.951+0000 7f8a98d61640 1 -- 172.21.15.78:0/4022793908 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a8007af40 msgr2=0x7f8a8007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:31.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.951+0000 7f8a98d61640 1 --2- 172.21.15.78:0/4022793908 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a8007af40 0x7f8a8007d400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8a840096c0 tx=0x7f8a84004f30 comp rx=0 tx=0).stop 2024-09-18T12:55:31.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.951+0000 7f8a98d61640 1 -- 172.21.15.78:0/4022793908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a94103490 msgr2=0x7f8a94100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:31.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.951+0000 7f8a98d61640 1 --2- 172.21.15.78:0/4022793908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a94103490 0x7f8a94100d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00d8d0 tx=0x7f8a7c00dd90 comp rx=0 tx=0).stop 2024-09-18T12:55:31.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.951+0000 7f8a98d61640 1 -- 172.21.15.78:0/4022793908 shutdown_connections 2024-09-18T12:55:31.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.951+0000 7f8a98d61640 1 --2- 172.21.15.78:0/4022793908 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a8007af40 0x7f8a8007d400 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.951+0000 7f8a98d61640 1 --2- 172.21.15.78:0/4022793908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a94103490 0x7f8a94100d10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.951+0000 7f8a98d61640 1 --2- 172.21.15.78:0/4022793908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a94102b70 0x7f8a941007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.951+0000 7f8a98d61640 1 -- 172.21.15.78:0/4022793908 >> 172.21.15.78:0/4022793908 conn(0x7f8a940fc550 msgr2=0x7f8a94108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.951+0000 7f8a98d61640 1 -- 172.21.15.78:0/4022793908 shutdown_connections 2024-09-18T12:55:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:31.951+0000 7f8a98d61640 1 -- 172.21.15.78:0/4022793908 wait complete. 2024-09-18T12:55:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.032+0000 7f2936085640 1 -- 172.21.15.78:0/4461317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2930106800 msgr2=0x7f2930106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.032+0000 7f2936085640 1 --2- 172.21.15.78:0/4461317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2930106800 0x7f2930106be0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2920009880 tx=0x7f292002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:55:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.032+0000 7f2936085640 1 -- 172.21.15.78:0/4461317 shutdown_connections 2024-09-18T12:55:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.032+0000 7f2936085640 1 --2- 172.21.15.78:0/4461317 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2930100800 0x7f2930100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.032+0000 7f2936085640 1 --2- 172.21.15.78:0/4461317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2930106800 0x7f2930106be0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.032+0000 7f2936085640 1 -- 172.21.15.78:0/4461317 >> 172.21.15.78:0/4461317 conn(0x7f29300fc520 msgr2=0x7f29300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.032+0000 7f2936085640 1 -- 172.21.15.78:0/4461317 shutdown_connections 2024-09-18T12:55:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.033+0000 7f2936085640 1 -- 172.21.15.78:0/4461317 wait complete. 2024-09-18T12:55:32.034 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:31 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-activate[128445]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:55:32.035 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:31 smithi078 bash[128408]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:55:32.035 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:31 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-activate[128445]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:55:32.035 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:31 smithi078 bash[128408]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:55:32.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.033+0000 7f2936085640 1 Processor -- start 2024-09-18T12:55:32.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.033+0000 7f2936085640 1 -- start start 2024-09-18T12:55:32.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.033+0000 7f2936085640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2930100800 0x7f2930199d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.033+0000 7f2936085640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f293019a2b0 0x7f293019e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.033+0000 7f2936085640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f293010dcd0 con 0x7f2930100800 2024-09-18T12:55:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.033+0000 7f2936085640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f293010db50 con 0x7f293019a2b0 2024-09-18T12:55:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.034+0000 7f292f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2930100800 0x7f2930199d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.034+0000 7f292f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2930100800 0x7f2930199d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36192/0 (socket says 172.21.15.78:36192) 2024-09-18T12:55:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.034+0000 7f292f7fe640 1 -- 172.21.15.78:0/2819959475 learned_addr learned my addr 172.21.15.78:0/2819959475 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:55:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.034+0000 7f292effd640 1 --2- 172.21.15.78:0/2819959475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f293019a2b0 0x7f293019e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.034+0000 7f292f7fe640 1 -- 172.21.15.78:0/2819959475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f293019a2b0 msgr2=0x7f293019e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.034+0000 7f292f7fe640 1 --2- 172.21.15.78:0/2819959475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f293019a2b0 0x7f293019e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.034+0000 7f292f7fe640 1 -- 172.21.15.78:0/2819959475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293019a960 con 0x7f2930100800 2024-09-18T12:55:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.034+0000 7f292f7fe640 1 --2- 172.21.15.78:0/2819959475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2930100800 0x7f2930199d70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2920005940 tx=0x7f29200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.034+0000 7f292cff9640 1 -- 172.21.15.78:0/2819959475 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f292003f070 con 0x7f2930100800 2024-09-18T12:55:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.034+0000 7f292cff9640 1 -- 172.21.15.78:0/2819959475 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f29200035f0 con 0x7f2930100800 2024-09-18T12:55:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.034+0000 7f2936085640 1 -- 172.21.15.78:0/2819959475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f293019eb80 con 0x7f2930100800 2024-09-18T12:55:32.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.034+0000 7f292cff9640 1 -- 172.21.15.78:0/2819959475 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2920035030 con 0x7f2930100800 2024-09-18T12:55:32.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.034+0000 7f2936085640 1 -- 172.21.15.78:0/2819959475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f293019f110 con 0x7f2930100800 2024-09-18T12:55:32.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.035+0000 7f2936085640 1 -- 172.21.15.78:0/2819959475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2930101f40 con 0x7f2930100800 2024-09-18T12:55:32.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.036+0000 7f292cff9640 1 -- 172.21.15.78:0/2819959475 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2920042070 con 0x7f2930100800 2024-09-18T12:55:32.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.037+0000 7f292cff9640 1 --2- 172.21.15.78:0/2819959475 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f291807af30 0x7f291807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:32.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.037+0000 7f292cff9640 1 -- 172.21.15.78:0/2819959475 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6070+0+0 (secure 0 0 0) 0x7f29200be860 con 0x7f2930100800 2024-09-18T12:55:32.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.037+0000 7f292effd640 1 --2- 172.21.15.78:0/2819959475 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f291807af30 0x7f291807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:32.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.038+0000 7f292effd640 1 --2- 172.21.15.78:0/2819959475 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f291807af30 0x7f291807d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2924009b60 tx=0x7f2924005f90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:32.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.042+0000 7f292cff9640 1 -- 172.21.15.78:0/2819959475 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2920089eb0 con 0x7f2930100800 2024-09-18T12:55:32.299 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:32 smithi078 ceph-mon[108578]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:32.299 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:32 smithi078 ceph-mon[108578]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:32.299 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:32 smithi078 ceph-mon[108578]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:32.299 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:32 smithi078 ceph-mon[108578]: pgmap v168: 65 pgs: 10 active+undersized, 4 stale+active+clean, 10 active+undersized+degraded, 41 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/333 objects degraded (8.408%) 2024-09-18T12:55:32.299 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:32 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/4242703457' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:32.300 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:32 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/294212196' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:55:32.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.298+0000 7f2936085640 1 -- 172.21.15.78:0/2819959475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f293019f3c0 con 0x7f2930100800 2024-09-18T12:55:32.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.298+0000 7f292cff9640 1 -- 172.21.15.78:0/2819959475 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1018 (secure 0 0 0) 0x7f292008ed60 con 0x7f2930100800 2024-09-18T12:55:32.300 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 28/333 objects degraded (8.408%), 10 pgs degraded 2024-09-18T12:55:32.300 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:55:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:55:32.300 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-18T12:55:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: osd.2 (root=default,host=smithi078) is down 2024-09-18T12:55:32.301 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 28/333 objects degraded (8.408%), 10 pgs degraded 2024-09-18T12:55:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-18T12:55:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-18T12:55:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-18T12:55:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-18T12:55:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-18T12:55:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-18T12:55:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-09-18T12:55:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-18T12:55:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-18T12:55:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-18T12:55:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.300+0000 7f2936085640 1 -- 172.21.15.78:0/2819959475 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f291807af30 msgr2=0x7f291807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.300+0000 7f2936085640 1 --2- 172.21.15.78:0/2819959475 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f291807af30 0x7f291807d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2924009b60 tx=0x7f2924005f90 comp rx=0 tx=0).stop 2024-09-18T12:55:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.300+0000 7f2936085640 1 -- 172.21.15.78:0/2819959475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2930100800 msgr2=0x7f2930199d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.300+0000 7f2936085640 1 --2- 172.21.15.78:0/2819959475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2930100800 0x7f2930199d70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2920005940 tx=0x7f29200045e0 comp rx=0 tx=0).stop 2024-09-18T12:55:32.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.300+0000 7f2936085640 1 -- 172.21.15.78:0/2819959475 shutdown_connections 2024-09-18T12:55:32.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.300+0000 7f2936085640 1 --2- 172.21.15.78:0/2819959475 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f291807af30 0x7f291807d3f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:32.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.300+0000 7f2936085640 1 --2- 172.21.15.78:0/2819959475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f293019a2b0 0x7f293019e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:32.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.300+0000 7f2936085640 1 --2- 172.21.15.78:0/2819959475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2930100800 0x7f2930199d70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:32.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.300+0000 7f2936085640 1 -- 172.21.15.78:0/2819959475 >> 172.21.15.78:0/2819959475 conn(0x7f29300fc520 msgr2=0x7f29300fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:32.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.300+0000 7f2936085640 1 -- 172.21.15.78:0/2819959475 shutdown_connections 2024-09-18T12:55:32.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:55:32.300+0000 7f2936085640 1 -- 172.21.15.78:0/2819959475 wait complete. 2024-09-18T12:55:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:32 smithi148 ceph-mon[80030]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:32 smithi148 ceph-mon[80030]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:32 smithi148 ceph-mon[80030]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:32 smithi148 ceph-mon[80030]: pgmap v168: 65 pgs: 10 active+undersized, 4 stale+active+clean, 10 active+undersized+degraded, 41 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/333 objects degraded (8.408%) 2024-09-18T12:55:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:32 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/4242703457' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:32 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/294212196' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:55:33.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:33 smithi148 ceph-mon[80030]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:33.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:33 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2819959475' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:55:33.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:33 smithi078 ceph-mon[108578]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:33.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:33 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2819959475' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:55:34.409 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:34 smithi078 ceph-mon[108578]: pgmap v169: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/333 objects degraded (12.913%) 2024-09-18T12:55:34.410 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:34 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-activate[128445]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T12:55:34.410 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:34 smithi078 bash[128408]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T12:55:34.410 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:34 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-activate[128445]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T12:55:34.410 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:34 smithi078 bash[128408]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T12:55:34.411 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:34 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-activate[128445]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T12:55:34.411 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:34 smithi078 bash[128408]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T12:55:34.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:34 smithi148 ceph-mon[80030]: pgmap v169: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/333 objects degraded (12.913%) 2024-09-18T12:55:34.742 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:34 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-activate[128445]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T12:55:34.743 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:34 smithi078 bash[128408]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T12:55:34.743 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:34 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-activate[128445]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-18T12:55:34.743 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:34 smithi078 bash[128408]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-18T12:55:34.743 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:34 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-activate[128445]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T12:55:34.743 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:34 smithi078 bash[128408]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T12:55:34.744 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:34 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-activate[128445]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-18T12:55:34.744 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:34 smithi078 bash[128408]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-18T12:55:34.744 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:34 smithi078 podman[128408]: 2024-09-18 12:55:34.440959192 +0000 UTC m=+3.195892398 container died c4d5b87a3b227c4cef54afd83eab331d6fd5d42309e4aa01e1273fed43199565 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-18T12:55:35.492 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:35 smithi078 podman[128663]: 2024-09-18 12:55:35.159026303 +0000 UTC m=+0.706807704 container remove c4d5b87a3b227c4cef54afd83eab331d6fd5d42309e4aa01e1273fed43199565 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True) 2024-09-18T12:55:35.492 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:35 smithi078 podman[128723]: 2024-09-18 12:55:35.277103242 +0000 UTC m=+0.016260423 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:55:35.492 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:35 smithi078 podman[128723]: 2024-09-18 12:55:35.401835525 +0000 UTC m=+0.140992750 container create c74b9bc9ce72d8d3352eb246a986b7539184416dd994b6b8c6d0f0bc3265dbd3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-18T12:55:35.992 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:35 smithi078 podman[128723]: 2024-09-18 12:55:35.662804258 +0000 UTC m=+0.401961438 container init c74b9bc9ce72d8d3352eb246a986b7539184416dd994b6b8c6d0f0bc3265dbd3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=) 2024-09-18T12:55:35.992 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:35 smithi078 podman[128723]: 2024-09-18 12:55:35.666217697 +0000 UTC m=+0.405374878 container start c74b9bc9ce72d8d3352eb246a986b7539184416dd994b6b8c6d0f0bc3265dbd3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:55:35.992 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:35 smithi078 ceph-osd[128742]: -- 172.21.15.78:0/55309404 <== mon.0 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5616c88b21e0 con 0x5616c7c80000 2024-09-18T12:55:35.992 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:35 smithi078 bash[128723]: c74b9bc9ce72d8d3352eb246a986b7539184416dd994b6b8c6d0f0bc3265dbd3 2024-09-18T12:55:35.992 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:35 smithi078 systemd[1]: Started Ceph osd.2 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:55:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:36 smithi148 ceph-mon[80030]: pgmap v170: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/333 objects degraded (12.913%) 2024-09-18T12:55:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:36 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:36 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:36.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:36 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:55:36.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:36 smithi078 ceph-mon[108578]: pgmap v170: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/333 objects degraded (12.913%) 2024-09-18T12:55:36.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:36 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:36.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:36 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:36.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:36 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:55:37.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:37 smithi078 ceph-mon[108578]: Health check update: Degraded data redundancy: 43/333 objects degraded (12.913%), 13 pgs degraded (PG_DEGRADED) 2024-09-18T12:55:37.492 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:37 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2[128738]: 2024-09-18T12:55:37.337+0000 7f3844323640 -1 Falling back to public interface 2024-09-18T12:55:37.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:37 smithi148 ceph-mon[80030]: Health check update: Degraded data redundancy: 43/333 objects degraded (12.913%), 13 pgs degraded (PG_DEGRADED) 2024-09-18T12:55:38.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:38 smithi078 ceph-mon[108578]: pgmap v171: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/333 objects degraded (12.913%) 2024-09-18T12:55:38.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:38 smithi148 ceph-mon[80030]: pgmap v171: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/333 objects degraded (12.913%) 2024-09-18T12:55:40.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:40 smithi078 ceph-mon[108578]: pgmap v172: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/333 objects degraded (12.913%) 2024-09-18T12:55:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:40 smithi148 ceph-mon[80030]: pgmap v172: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/333 objects degraded (12.913%) 2024-09-18T12:55:41.811 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:41.811 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:41.812 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:41.812 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:41.812 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:41 smithi078 ceph-mon[108578]: pgmap v173: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/333 objects degraded (12.913%) 2024-09-18T12:55:41.812 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:41.812 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:41 smithi148 ceph-mon[80030]: pgmap v173: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/333 objects degraded (12.913%) 2024-09-18T12:55:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:41.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:42.702 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:42 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2[128738]: 2024-09-18T12:55:42.539+0000 7f3844323640 -1 osd.2 57 log_to_monitors true 2024-09-18T12:55:43.265 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:43 smithi078 ceph-mon[108578]: from='osd.2 [v2:172.21.15.78:6818/3116773481,v1:172.21.15.78:6819/3116773481]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-18T12:55:43.266 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 12:55:43 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2[128738]: 2024-09-18T12:55:43.038+0000 7f38380c5640 -1 osd.2 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:55:43.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:43 smithi148 ceph-mon[80030]: from='osd.2 [v2:172.21.15.78:6818/3116773481,v1:172.21.15.78:6819/3116773481]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-18T12:55:44.202 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:44 smithi078 ceph-mon[108578]: from='osd.2 [v2:172.21.15.78:6818/3116773481,v1:172.21.15.78:6819/3116773481]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T12:55:44.203 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:44 smithi078 ceph-mon[108578]: osdmap e60: 6 total, 5 up, 6 in 2024-09-18T12:55:44.203 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:44 smithi078 ceph-mon[108578]: from='osd.2 [v2:172.21.15.78:6818/3116773481,v1:172.21.15.78:6819/3116773481]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-18T12:55:44.203 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:44 smithi078 ceph-mon[108578]: pgmap v175: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/333 objects degraded (12.913%) 2024-09-18T12:55:44.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:44 smithi148 ceph-mon[80030]: from='osd.2 [v2:172.21.15.78:6818/3116773481,v1:172.21.15.78:6819/3116773481]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T12:55:44.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:44 smithi148 ceph-mon[80030]: osdmap e60: 6 total, 5 up, 6 in 2024-09-18T12:55:44.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:44 smithi148 ceph-mon[80030]: from='osd.2 [v2:172.21.15.78:6818/3116773481,v1:172.21.15.78:6819/3116773481]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-18T12:55:44.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:44 smithi148 ceph-mon[80030]: pgmap v175: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/333 objects degraded (12.913%) 2024-09-18T12:55:45.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:45 smithi148 ceph-mon[80030]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:55:45.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:45 smithi148 ceph-mon[80030]: osd.2 [v2:172.21.15.78:6818/3116773481,v1:172.21.15.78:6819/3116773481] boot 2024-09-18T12:55:45.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:45 smithi148 ceph-mon[80030]: osdmap e61: 6 total, 6 up, 6 in 2024-09-18T12:55:45.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:45 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-18T12:55:45.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:45 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:45.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:45 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:45.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:45 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:55:45.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:45 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:55:45.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:45 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:45.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:45 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:55:45.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:45 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:45.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:45 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:45.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:45 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:45.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:45 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-18T12:55:45.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:45 smithi078 ceph-mon[108578]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:55:45.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:45 smithi078 ceph-mon[108578]: osd.2 [v2:172.21.15.78:6818/3116773481,v1:172.21.15.78:6819/3116773481] boot 2024-09-18T12:55:45.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:45 smithi078 ceph-mon[108578]: osdmap e61: 6 total, 6 up, 6 in 2024-09-18T12:55:45.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:45 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-18T12:55:45.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:45 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:45.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:45 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:45.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:45 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:55:45.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:45 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:55:45.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:45 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:45.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:45 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:55:45.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:45 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:45.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:45 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:45.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:45 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:55:45.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:45 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-18T12:55:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:46 smithi148 ceph-mon[80030]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T12:55:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:46 smithi148 ceph-mon[80030]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-18T12:55:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:46 smithi148 ceph-mon[80030]: osdmap e62: 6 total, 6 up, 6 in 2024-09-18T12:55:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:46 smithi148 ceph-mon[80030]: pgmap v178: 65 pgs: 5 peering, 11 active+undersized, 11 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/333 objects degraded (11.111%) 2024-09-18T12:55:46.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:46 smithi078 ceph-mon[108578]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T12:55:46.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:46 smithi078 ceph-mon[108578]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-18T12:55:46.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:46 smithi078 ceph-mon[108578]: osdmap e62: 6 total, 6 up, 6 in 2024-09-18T12:55:46.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:46 smithi078 ceph-mon[108578]: pgmap v178: 65 pgs: 5 peering, 11 active+undersized, 11 active+undersized+degraded, 38 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/333 objects degraded (11.111%) 2024-09-18T12:55:47.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:47 smithi148 ceph-mon[80030]: Health check update: Degraded data redundancy: 37/333 objects degraded (11.111%), 11 pgs degraded (PG_DEGRADED) 2024-09-18T12:55:47.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:47 smithi078 ceph-mon[108578]: Health check update: Degraded data redundancy: 37/333 objects degraded (11.111%), 11 pgs degraded (PG_DEGRADED) 2024-09-18T12:55:48.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:48 smithi148 ceph-mon[80030]: pgmap v179: 65 pgs: 5 peering, 4 active+undersized, 5 active+undersized+degraded, 51 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18/333 objects degraded (5.405%) 2024-09-18T12:55:48.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:48 smithi078 ceph-mon[108578]: pgmap v179: 65 pgs: 5 peering, 4 active+undersized, 5 active+undersized+degraded, 51 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18/333 objects degraded (5.405%) 2024-09-18T12:55:49.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:49 smithi148 ceph-mon[80030]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/333 objects degraded (5.405%), 5 pgs degraded) 2024-09-18T12:55:49.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:49 smithi078 ceph-mon[108578]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/333 objects degraded (5.405%), 5 pgs degraded) 2024-09-18T12:55:50.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:50 smithi148 ceph-mon[80030]: pgmap v180: 65 pgs: 5 peering, 60 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:50.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:50 smithi078 ceph-mon[108578]: pgmap v180: 65 pgs: 5 peering, 60 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:52 smithi148 ceph-mon[80030]: pgmap v181: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:52 smithi078 ceph-mon[108578]: pgmap v181: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:54.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:54 smithi148 ceph-mon[80030]: pgmap v182: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:54.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:54 smithi078 ceph-mon[108578]: pgmap v182: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:56 smithi148 ceph-mon[80030]: pgmap v183: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:56 smithi078 ceph-mon[108578]: pgmap v183: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:55:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:55:58.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:55:58 smithi148 ceph-mon[80030]: pgmap v184: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:55:58.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:55:58 smithi078 ceph-mon[108578]: pgmap v184: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:00.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:00 smithi148 ceph-mon[80030]: pgmap v185: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:00.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:00 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-18T12:56:00.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:00 smithi078 ceph-mon[108578]: pgmap v185: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:00.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:00 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-18T12:56:01.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:01 smithi148 ceph-mon[80030]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T12:56:01.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:01 smithi148 ceph-mon[80030]: Upgrade: osd.3 is safe to restart 2024-09-18T12:56:01.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:01 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:01.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:01 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:01.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:01 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-18T12:56:01.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:01 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:01.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:01 smithi078 ceph-mon[108578]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T12:56:01.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:01 smithi078 ceph-mon[108578]: Upgrade: osd.3 is safe to restart 2024-09-18T12:56:01.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:01 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:01.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:01 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:01.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:01 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-18T12:56:01.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:01 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.394+0000 7f8297d0a640 1 -- 172.21.15.78:0/2879164387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8290102b30 msgr2=0x7f8290102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.394+0000 7f8297d0a640 1 --2- 172.21.15.78:0/2879164387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8290102b30 0x7f8290102f10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8284009880 tx=0x7f828402a530 comp rx=0 tx=0).stop 2024-09-18T12:56:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.394+0000 7f8297d0a640 1 -- 172.21.15.78:0/2879164387 shutdown_connections 2024-09-18T12:56:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.394+0000 7f8297d0a640 1 --2- 172.21.15.78:0/2879164387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8290103450 0x7f829010b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.394+0000 7f8297d0a640 1 --2- 172.21.15.78:0/2879164387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8290102b30 0x7f8290102f10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.394+0000 7f8297d0a640 1 -- 172.21.15.78:0/2879164387 >> 172.21.15.78:0/2879164387 conn(0x7f82900fc550 msgr2=0x7f82900fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.394+0000 7f8297d0a640 1 -- 172.21.15.78:0/2879164387 shutdown_connections 2024-09-18T12:56:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.394+0000 7f8297d0a640 1 -- 172.21.15.78:0/2879164387 wait complete. 2024-09-18T12:56:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.395+0000 7f8297d0a640 1 Processor -- start 2024-09-18T12:56:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.395+0000 7f8297d0a640 1 -- start start 2024-09-18T12:56:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.395+0000 7f8297d0a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8290102b30 0x7f829019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.395+0000 7f8297d0a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8290103450 0x7f829019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.395+0000 7f8297d0a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f829010edc0 con 0x7f8290103450 2024-09-18T12:56:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.395+0000 7f8297d0a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f829010ec40 con 0x7f8290102b30 2024-09-18T12:56:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.395+0000 7f82952a5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8290103450 0x7f829019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.395+0000 7f82952a5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8290103450 0x7f829019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48912/0 (socket says 172.21.15.78:48912) 2024-09-18T12:56:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.395+0000 7f82952a5640 1 -- 172.21.15.78:0/2056259632 learned_addr learned my addr 172.21.15.78:0/2056259632 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:56:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.396+0000 7f8295aa6640 1 --2- 172.21.15.78:0/2056259632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8290102b30 0x7f829019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.396+0000 7f82952a5640 1 -- 172.21.15.78:0/2056259632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8290102b30 msgr2=0x7f829019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.396+0000 7f82952a5640 1 --2- 172.21.15.78:0/2056259632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8290102b30 0x7f829019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.396+0000 7f82952a5640 1 -- 172.21.15.78:0/2056259632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82901977b0 con 0x7f8290103450 2024-09-18T12:56:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.396+0000 7f8295aa6640 1 --2- 172.21.15.78:0/2056259632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8290102b30 0x7f829019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:56:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.396+0000 7f82952a5640 1 --2- 172.21.15.78:0/2056259632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8290103450 0x7f829019db70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f828c00c8a0 tx=0x7f828c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.396+0000 7f8282ffd640 1 -- 172.21.15.78:0/2056259632 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f828c0079b0 con 0x7f8290103450 2024-09-18T12:56:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.396+0000 7f8282ffd640 1 -- 172.21.15.78:0/2056259632 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f828c007b50 con 0x7f8290103450 2024-09-18T12:56:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.396+0000 7f8297d0a640 1 -- 172.21.15.78:0/2056259632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8290197aa0 con 0x7f8290103450 2024-09-18T12:56:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.396+0000 7f8282ffd640 1 -- 172.21.15.78:0/2056259632 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f828c018700 con 0x7f8290103450 2024-09-18T12:56:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.396+0000 7f8297d0a640 1 -- 172.21.15.78:0/2056259632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8290198030 con 0x7f8290103450 2024-09-18T12:56:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.397+0000 7f8297d0a640 1 -- 172.21.15.78:0/2056259632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f829006a500 con 0x7f8290103450 2024-09-18T12:56:02.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.398+0000 7f8282ffd640 1 -- 172.21.15.78:0/2056259632 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f828c007d00 con 0x7f8290103450 2024-09-18T12:56:02.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.399+0000 7f8282ffd640 1 --2- 172.21.15.78:0/2056259632 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f827c07af30 0x7f827c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:02.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.399+0000 7f8282ffd640 1 -- 172.21.15.78:0/2056259632 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7f828c09e2c0 con 0x7f8290103450 2024-09-18T12:56:02.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.399+0000 7f8295aa6640 1 --2- 172.21.15.78:0/2056259632 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f827c07af30 0x7f827c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:02.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.399+0000 7f8295aa6640 1 --2- 172.21.15.78:0/2056259632 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f827c07af30 0x7f827c07d3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8284004f90 tx=0x7f8284009560 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:02.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.403+0000 7f8282ffd640 1 -- 172.21.15.78:0/2056259632 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f828c014030 con 0x7f8290103450 2024-09-18T12:56:02.431 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:02 smithi148 ceph-mon[80030]: Upgrade: Updating osd.3 2024-09-18T12:56:02.431 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:02 smithi148 ceph-mon[80030]: Deploying daemon osd.3 on smithi148 2024-09-18T12:56:02.431 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:02 smithi148 ceph-mon[80030]: pgmap v186: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:02 smithi078 ceph-mon[108578]: Upgrade: Updating osd.3 2024-09-18T12:56:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:02 smithi078 ceph-mon[108578]: Deploying daemon osd.3 on smithi148 2024-09-18T12:56:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:02 smithi078 ceph-mon[108578]: pgmap v186: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:02.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.595+0000 7f8297d0a640 1 -- 172.21.15.78:0/2056259632 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8290198340 con 0x7f827c07af30 2024-09-18T12:56:02.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.596+0000 7f8282ffd640 1 -- 172.21.15.78:0/2056259632 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f8290198340 con 0x7f827c07af30 2024-09-18T12:56:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.599+0000 7f8297d0a640 1 -- 172.21.15.78:0/2056259632 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f827c07af30 msgr2=0x7f827c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.599+0000 7f8297d0a640 1 --2- 172.21.15.78:0/2056259632 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f827c07af30 0x7f827c07d3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8284004f90 tx=0x7f8284009560 comp rx=0 tx=0).stop 2024-09-18T12:56:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.599+0000 7f8297d0a640 1 -- 172.21.15.78:0/2056259632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8290103450 msgr2=0x7f829019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.599+0000 7f8297d0a640 1 --2- 172.21.15.78:0/2056259632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8290103450 0x7f829019db70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f828c00c8a0 tx=0x7f828c00cd60 comp rx=0 tx=0).stop 2024-09-18T12:56:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.599+0000 7f8297d0a640 1 -- 172.21.15.78:0/2056259632 shutdown_connections 2024-09-18T12:56:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.599+0000 7f8297d0a640 1 --2- 172.21.15.78:0/2056259632 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f827c07af30 0x7f827c07d3f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.599+0000 7f8297d0a640 1 --2- 172.21.15.78:0/2056259632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8290103450 0x7f829019db70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.599+0000 7f8297d0a640 1 --2- 172.21.15.78:0/2056259632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8290102b30 0x7f829019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.599+0000 7f8297d0a640 1 -- 172.21.15.78:0/2056259632 >> 172.21.15.78:0/2056259632 conn(0x7f82900fc550 msgr2=0x7f8290108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.599+0000 7f8297d0a640 1 -- 172.21.15.78:0/2056259632 shutdown_connections 2024-09-18T12:56:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.599+0000 7f8297d0a640 1 -- 172.21.15.78:0/2056259632 wait complete. 2024-09-18T12:56:02.609 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:56:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.682+0000 7fc20f7c1640 1 -- 172.21.15.78:0/3071039341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc208103480 msgr2=0x7fc20810b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.682+0000 7fc20f7c1640 1 --2- 172.21.15.78:0/3071039341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc208103480 0x7fc20810b970 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc009880 tx=0x7fc1fc02a530 comp rx=0 tx=0).stop 2024-09-18T12:56:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.682+0000 7fc20f7c1640 1 -- 172.21.15.78:0/3071039341 shutdown_connections 2024-09-18T12:56:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.682+0000 7fc20f7c1640 1 --2- 172.21.15.78:0/3071039341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc208103480 0x7fc20810b970 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.682+0000 7fc20f7c1640 1 --2- 172.21.15.78:0/3071039341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc208102b60 0x7fc208102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.682+0000 7fc20f7c1640 1 -- 172.21.15.78:0/3071039341 >> 172.21.15.78:0/3071039341 conn(0x7fc2080fc520 msgr2=0x7fc2080fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.682+0000 7fc20f7c1640 1 -- 172.21.15.78:0/3071039341 shutdown_connections 2024-09-18T12:56:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.682+0000 7fc20f7c1640 1 -- 172.21.15.78:0/3071039341 wait complete. 2024-09-18T12:56:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.683+0000 7fc20f7c1640 1 Processor -- start 2024-09-18T12:56:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.683+0000 7fc20f7c1640 1 -- start start 2024-09-18T12:56:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.683+0000 7fc20f7c1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc208102b60 0x7fc20819d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.683+0000 7fc20f7c1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc208103480 0x7fc20819dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.683+0000 7fc20f7c1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc20810edf0 con 0x7fc208103480 2024-09-18T12:56:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.683+0000 7fc20f7c1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc20810ec70 con 0x7fc208102b60 2024-09-18T12:56:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.683+0000 7fc20cd5c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc208103480 0x7fc20819dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.683+0000 7fc20cd5c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc208103480 0x7fc20819dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48924/0 (socket says 172.21.15.78:48924) 2024-09-18T12:56:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.683+0000 7fc20cd5c640 1 -- 172.21.15.78:0/3142008127 learned_addr learned my addr 172.21.15.78:0/3142008127 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:56:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.683+0000 7fc20d55d640 1 --2- 172.21.15.78:0/3142008127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc208102b60 0x7fc20819d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.683+0000 7fc20cd5c640 1 -- 172.21.15.78:0/3142008127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc208102b60 msgr2=0x7fc20819d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.683+0000 7fc20cd5c640 1 --2- 172.21.15.78:0/3142008127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc208102b60 0x7fc20819d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.683+0000 7fc20cd5c640 1 -- 172.21.15.78:0/3142008127 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2081978a0 con 0x7fc208103480 2024-09-18T12:56:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.684+0000 7fc20cd5c640 1 --2- 172.21.15.78:0/3142008127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc208103480 0x7fc20819dc20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc004f90 tx=0x7fc1fc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.684+0000 7fc1fa7fc640 1 -- 172.21.15.78:0/3142008127 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1fc03f070 con 0x7fc208103480 2024-09-18T12:56:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.684+0000 7fc20f7c1640 1 -- 172.21.15.78:0/3142008127 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc208197b30 con 0x7fc208103480 2024-09-18T12:56:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.684+0000 7fc1fa7fc640 1 -- 172.21.15.78:0/3142008127 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1fc004c70 con 0x7fc208103480 2024-09-18T12:56:02.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.684+0000 7fc1fa7fc640 1 -- 172.21.15.78:0/3142008127 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1fc035030 con 0x7fc208103480 2024-09-18T12:56:02.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.684+0000 7fc20f7c1640 1 -- 172.21.15.78:0/3142008127 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc208198060 con 0x7fc208103480 2024-09-18T12:56:02.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.685+0000 7fc20f7c1640 1 -- 172.21.15.78:0/3142008127 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc20806a9f0 con 0x7fc208103480 2024-09-18T12:56:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.685+0000 7fc1fa7fc640 1 -- 172.21.15.78:0/3142008127 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc1fc042070 con 0x7fc208103480 2024-09-18T12:56:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.686+0000 7fc1fa7fc640 1 --2- 172.21.15.78:0/3142008127 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc1f407af30 0x7fc1f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.686+0000 7fc20d55d640 1 --2- 172.21.15.78:0/3142008127 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc1f407af30 0x7fc1f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.686+0000 7fc1fa7fc640 1 -- 172.21.15.78:0/3142008127 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7fc1fc0be930 con 0x7fc208103480 2024-09-18T12:56:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.686+0000 7fc20d55d640 1 --2- 172.21.15.78:0/3142008127 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc1f407af30 0x7fc1f407d3f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc2081989e0 tx=0x7fc20400b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.690+0000 7fc1fa7fc640 1 -- 172.21.15.78:0/3142008127 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc1fc089f80 con 0x7fc208103480 2024-09-18T12:56:02.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.883+0000 7fc20f7c1640 1 -- 172.21.15.78:0/3142008127 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc208106060 con 0x7fc1f407af30 2024-09-18T12:56:02.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.884+0000 7fc1fa7fc640 1 -- 172.21.15.78:0/3142008127 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fc204003890 con 0x7fc1f407af30 2024-09-18T12:56:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.886+0000 7fc20f7c1640 1 -- 172.21.15.78:0/3142008127 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc1f407af30 msgr2=0x7fc1f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.886+0000 7fc20f7c1640 1 --2- 172.21.15.78:0/3142008127 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc1f407af30 0x7fc1f407d3f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc2081989e0 tx=0x7fc20400b390 comp rx=0 tx=0).stop 2024-09-18T12:56:02.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.886+0000 7fc20f7c1640 1 -- 172.21.15.78:0/3142008127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc208103480 msgr2=0x7fc20819dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.886+0000 7fc20f7c1640 1 --2- 172.21.15.78:0/3142008127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc208103480 0x7fc20819dc20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc004f90 tx=0x7fc1fc0048f0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.886+0000 7fc20f7c1640 1 -- 172.21.15.78:0/3142008127 shutdown_connections 2024-09-18T12:56:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.886+0000 7fc20f7c1640 1 --2- 172.21.15.78:0/3142008127 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc1f407af30 0x7fc1f407d3f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.886+0000 7fc20f7c1640 1 --2- 172.21.15.78:0/3142008127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc208103480 0x7fc20819dc20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.886+0000 7fc20f7c1640 1 --2- 172.21.15.78:0/3142008127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc208102b60 0x7fc20819d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.886+0000 7fc20f7c1640 1 -- 172.21.15.78:0/3142008127 >> 172.21.15.78:0/3142008127 conn(0x7fc2080fc520 msgr2=0x7fc208103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.886+0000 7fc20f7c1640 1 -- 172.21.15.78:0/3142008127 shutdown_connections 2024-09-18T12:56:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.886+0000 7fc20f7c1640 1 -- 172.21.15.78:0/3142008127 wait complete. 2024-09-18T12:56:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.967+0000 7fca9abef640 1 -- 172.21.15.78:0/4273329620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca94100800 msgr2=0x7fca94100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.967+0000 7fca9abef640 1 --2- 172.21.15.78:0/4273329620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca94100800 0x7fca94100c60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fca80009880 tx=0x7fca8002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.967+0000 7fca9abef640 1 -- 172.21.15.78:0/4273329620 shutdown_connections 2024-09-18T12:56:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.967+0000 7fca9abef640 1 --2- 172.21.15.78:0/4273329620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca94100800 0x7fca94100c60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.967+0000 7fca9abef640 1 --2- 172.21.15.78:0/4273329620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca94106800 0x7fca94106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.967+0000 7fca9abef640 1 -- 172.21.15.78:0/4273329620 >> 172.21.15.78:0/4273329620 conn(0x7fca940fc520 msgr2=0x7fca940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.967+0000 7fca9abef640 1 -- 172.21.15.78:0/4273329620 shutdown_connections 2024-09-18T12:56:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.967+0000 7fca9abef640 1 -- 172.21.15.78:0/4273329620 wait complete. 2024-09-18T12:56:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.968+0000 7fca9abef640 1 Processor -- start 2024-09-18T12:56:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.968+0000 7fca9abef640 1 -- start start 2024-09-18T12:56:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.968+0000 7fca9abef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca94100800 0x7fca941987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.968+0000 7fca9abef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca94106800 0x7fca94198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.968+0000 7fca9abef640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fca9410dcb0 con 0x7fca94100800 2024-09-18T12:56:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.968+0000 7fca9abef640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fca9410db30 con 0x7fca94106800 2024-09-18T12:56:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.968+0000 7fca9898b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca94100800 0x7fca941987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.968+0000 7fca9898b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca94100800 0x7fca941987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48938/0 (socket says 172.21.15.78:48938) 2024-09-18T12:56:02.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.968+0000 7fca9898b640 1 -- 172.21.15.78:0/592692074 learned_addr learned my addr 172.21.15.78:0/592692074 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:56:02.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.968+0000 7fca93fff640 1 --2- 172.21.15.78:0/592692074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca94106800 0x7fca94198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:02.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.968+0000 7fca9898b640 1 -- 172.21.15.78:0/592692074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca94106800 msgr2=0x7fca94198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:02.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.968+0000 7fca9898b640 1 --2- 172.21.15.78:0/592692074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca94106800 0x7fca94198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.968+0000 7fca9898b640 1 -- 172.21.15.78:0/592692074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca94199320 con 0x7fca94100800 2024-09-18T12:56:02.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.968+0000 7fca9898b640 1 --2- 172.21.15.78:0/592692074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca94100800 0x7fca941987e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fca8800d8d0 tx=0x7fca8800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.969+0000 7fca91ffb640 1 -- 172.21.15.78:0/592692074 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca88017030 con 0x7fca94100800 2024-09-18T12:56:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.969+0000 7fca91ffb640 1 -- 172.21.15.78:0/592692074 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca88004020 con 0x7fca94100800 2024-09-18T12:56:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.969+0000 7fca9abef640 1 -- 172.21.15.78:0/592692074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca94199610 con 0x7fca94100800 2024-09-18T12:56:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.969+0000 7fca91ffb640 1 -- 172.21.15.78:0/592692074 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca880047a0 con 0x7fca94100800 2024-09-18T12:56:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.969+0000 7fca9abef640 1 -- 172.21.15.78:0/592692074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca941a1c10 con 0x7fca94100800 2024-09-18T12:56:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.970+0000 7fca9abef640 1 -- 172.21.15.78:0/592692074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca94101f40 con 0x7fca94100800 2024-09-18T12:56:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.970+0000 7fca91ffb640 1 -- 172.21.15.78:0/592692074 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fca880041d0 con 0x7fca94100800 2024-09-18T12:56:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.971+0000 7fca91ffb640 1 --2- 172.21.15.78:0/592692074 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fca8407af80 0x7fca8407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.971+0000 7fca93fff640 1 --2- 172.21.15.78:0/592692074 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fca8407af80 0x7fca8407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.971+0000 7fca91ffb640 1 -- 172.21.15.78:0/592692074 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7fca88018070 con 0x7fca94100800 2024-09-18T12:56:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.972+0000 7fca93fff640 1 --2- 172.21.15.78:0/592692074 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fca8407af80 0x7fca8407d440 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fca9406ad00 tx=0x7fca80031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:02.976+0000 7fca91ffb640 1 -- 172.21.15.78:0/592692074 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fca94199610 con 0x7fca94100800 2024-09-18T12:56:03.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.181+0000 7fca9abef640 1 -- 172.21.15.78:0/592692074 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fca94062630 con 0x7fca8407af80 2024-09-18T12:56:03.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.191+0000 7fca91ffb640 1 -- 172.21.15.78:0/592692074 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fca94062630 con 0x7fca8407af80 2024-09-18T12:56:03.192 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:56:03.192 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (3m) 22s ago 14m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T12:56:03.193 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (6m) 22s ago 15m 8908k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:56:03.193 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (6m) 2m ago 14m 8292k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:56:03.193 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (2m) 22s ago 15m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T12:56:03.193 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (2m) 2m ago 14m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T12:56:03.193 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (3m) 22s ago 14m 75.8M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T12:56:03.193 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (9m) 22s ago 9m 150M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:56:03.193 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (9m) 22s ago 9m 28.0M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:56:03.193 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (9m) 2m ago 9m 16.2M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:56:03.193 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (9m) 2m ago 9m 17.0M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:56:03.193 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (6m) 22s ago 16m 524M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:56:03.193 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (4m) 2m ago 14m 454M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:56:03.193 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (2m) 22s ago 16m 42.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T12:56:03.193 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (2m) 2m ago 13m 26.4M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T12:56:03.194 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (4m) 22s ago 14m 11.7M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:56:03.194 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (4m) 2m ago 14m 11.4M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:56:03.194 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (102s) 22s ago 12m 84.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T12:56:03.194 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (64s) 22s ago 12m 86.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T12:56:03.194 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (27s) 22s ago 11m 11.4M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T12:56:03.194 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (11m) 2m ago 11m 237M 2240M 19.1.1-330-gc2ddf972 ebb0615149de ce11db957f1a 2024-09-18T12:56:03.194 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (10m) 2m ago 10m 208M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:56:03.194 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (10m) 2m ago 10m 196M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:56:03.194 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (4m) 22s ago 14m 56.3M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:56:03.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.194+0000 7fca9abef640 1 -- 172.21.15.78:0/592692074 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fca8407af80 msgr2=0x7fca8407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:03.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.194+0000 7fca9abef640 1 --2- 172.21.15.78:0/592692074 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fca8407af80 0x7fca8407d440 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fca9406ad00 tx=0x7fca80031400 comp rx=0 tx=0).stop 2024-09-18T12:56:03.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.194+0000 7fca9abef640 1 -- 172.21.15.78:0/592692074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca94100800 msgr2=0x7fca941987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:03.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.194+0000 7fca9abef640 1 --2- 172.21.15.78:0/592692074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca94100800 0x7fca941987e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fca8800d8d0 tx=0x7fca8800dd90 comp rx=0 tx=0).stop 2024-09-18T12:56:03.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.194+0000 7fca9abef640 1 -- 172.21.15.78:0/592692074 shutdown_connections 2024-09-18T12:56:03.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.194+0000 7fca9abef640 1 --2- 172.21.15.78:0/592692074 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fca8407af80 0x7fca8407d440 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.194+0000 7fca9abef640 1 --2- 172.21.15.78:0/592692074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca94106800 0x7fca94198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.194+0000 7fca9abef640 1 --2- 172.21.15.78:0/592692074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca94100800 0x7fca941987e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.194+0000 7fca9abef640 1 -- 172.21.15.78:0/592692074 >> 172.21.15.78:0/592692074 conn(0x7fca940fc520 msgr2=0x7fca940fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:03.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.194+0000 7fca9abef640 1 -- 172.21.15.78:0/592692074 shutdown_connections 2024-09-18T12:56:03.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.194+0000 7fca9abef640 1 -- 172.21.15.78:0/592692074 wait complete. 2024-09-18T12:56:03.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.275+0000 7f7f974f9640 1 -- 172.21.15.78:0/834314677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f90107900 msgr2=0x7f7f90107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:03.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.275+0000 7f7f974f9640 1 --2- 172.21.15.78:0/834314677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f90107900 0x7f7f90107ce0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009880 tx=0x7f7f8c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.275+0000 7f7f974f9640 1 -- 172.21.15.78:0/834314677 shutdown_connections 2024-09-18T12:56:03.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.275+0000 7f7f974f9640 1 --2- 172.21.15.78:0/834314677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f90101900 0x7f7f90101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.275+0000 7f7f974f9640 1 --2- 172.21.15.78:0/834314677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f90107900 0x7f7f90107ce0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.275+0000 7f7f974f9640 1 -- 172.21.15.78:0/834314677 >> 172.21.15.78:0/834314677 conn(0x7f7f900fd5e0 msgr2=0x7f7f900ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:03.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.276+0000 7f7f974f9640 1 -- 172.21.15.78:0/834314677 shutdown_connections 2024-09-18T12:56:03.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.276+0000 7f7f974f9640 1 -- 172.21.15.78:0/834314677 wait complete. 2024-09-18T12:56:03.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.276+0000 7f7f974f9640 1 Processor -- start 2024-09-18T12:56:03.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.276+0000 7f7f974f9640 1 -- start start 2024-09-18T12:56:03.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.276+0000 7f7f974f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f90101900 0x7f7f9019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.276+0000 7f7f974f9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f90107900 0x7f7f9019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.277+0000 7f7f974f9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9010edb0 con 0x7f7f90101900 2024-09-18T12:56:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.277+0000 7f7f974f9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9010ec30 con 0x7f7f90107900 2024-09-18T12:56:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.277+0000 7f7f95295640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f90101900 0x7f7f9019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.277+0000 7f7f95295640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f90101900 0x7f7f9019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48954/0 (socket says 172.21.15.78:48954) 2024-09-18T12:56:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.277+0000 7f7f95295640 1 -- 172.21.15.78:0/3290335371 learned_addr learned my addr 172.21.15.78:0/3290335371 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:56:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.277+0000 7f7f94a94640 1 --2- 172.21.15.78:0/3290335371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f90107900 0x7f7f9019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.277+0000 7f7f95295640 1 -- 172.21.15.78:0/3290335371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f90107900 msgr2=0x7f7f9019dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.277+0000 7f7f95295640 1 --2- 172.21.15.78:0/3290335371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f90107900 0x7f7f9019dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.277+0000 7f7f95295640 1 -- 172.21.15.78:0/3290335371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f90197770 con 0x7f7f90101900 2024-09-18T12:56:03.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.277+0000 7f7f95295640 1 --2- 172.21.15.78:0/3290335371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f90101900 0x7f7f9019d6a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c031460 tx=0x7f7f8c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:03.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.277+0000 7f7f867fc640 1 -- 172.21.15.78:0/3290335371 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f8c03f070 con 0x7f7f90101900 2024-09-18T12:56:03.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.277+0000 7f7f974f9640 1 -- 172.21.15.78:0/3290335371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f90197a00 con 0x7f7f90101900 2024-09-18T12:56:03.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.277+0000 7f7f867fc640 1 -- 172.21.15.78:0/3290335371 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7f8c004cf0 con 0x7f7f90101900 2024-09-18T12:56:03.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.277+0000 7f7f867fc640 1 -- 172.21.15.78:0/3290335371 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f8c035030 con 0x7f7f90101900 2024-09-18T12:56:03.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.277+0000 7f7f974f9640 1 -- 172.21.15.78:0/3290335371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f90197f30 con 0x7f7f90101900 2024-09-18T12:56:03.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.278+0000 7f7f974f9640 1 -- 172.21.15.78:0/3290335371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f90103040 con 0x7f7f90101900 2024-09-18T12:56:03.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.279+0000 7f7f867fc640 1 -- 172.21.15.78:0/3290335371 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7f8c042070 con 0x7f7f90101900 2024-09-18T12:56:03.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.279+0000 7f7f867fc640 1 --2- 172.21.15.78:0/3290335371 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f7c07af80 0x7f7f7c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:03.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.280+0000 7f7f867fc640 1 -- 172.21.15.78:0/3290335371 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7f7f8c0be990 con 0x7f7f90101900 2024-09-18T12:56:03.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.280+0000 7f7f94a94640 1 --2- 172.21.15.78:0/3290335371 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f7c07af80 0x7f7f7c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:03.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.280+0000 7f7f94a94640 1 --2- 172.21.15.78:0/3290335371 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f7c07af80 0x7f7f7c07d440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f80005e10 tx=0x7f7f80005da0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:03.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.284+0000 7f7f867fc640 1 -- 172.21.15.78:0/3290335371 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7f8c08a060 con 0x7f7f90101900 2024-09-18T12:56:03.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.531+0000 7f7f974f9640 1 -- 172.21.15.78:0/3290335371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7f90104b10 con 0x7f7f90101900 2024-09-18T12:56:03.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.532+0000 7f7f867fc640 1 -- 172.21.15.78:0/3290335371 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f7f8c08ef10 con 0x7f7f90101900 2024-09-18T12:56:03.533 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:56:03.533 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:56:03.533 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:56:03.533 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:56:03.533 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:56:03.534 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:56:03.534 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:56:03.534 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:56:03.534 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3, 2024-09-18T12:56:03.534 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 3 2024-09-18T12:56:03.534 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:56:03.534 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:56:03.534 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:56:03.534 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:56:03.534 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:56:03.534 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 7, 2024-09-18T12:56:03.534 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 7 2024-09-18T12:56:03.534 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:56:03.535 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:56:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.534+0000 7f7f974f9640 1 -- 172.21.15.78:0/3290335371 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f7c07af80 msgr2=0x7f7f7c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.534+0000 7f7f974f9640 1 --2- 172.21.15.78:0/3290335371 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f7c07af80 0x7f7f7c07d440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f80005e10 tx=0x7f7f80005da0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.534+0000 7f7f974f9640 1 -- 172.21.15.78:0/3290335371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f90101900 msgr2=0x7f7f9019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.534+0000 7f7f974f9640 1 --2- 172.21.15.78:0/3290335371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f90101900 0x7f7f9019d6a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c031460 tx=0x7f7f8c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.534+0000 7f7f974f9640 1 -- 172.21.15.78:0/3290335371 shutdown_connections 2024-09-18T12:56:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.534+0000 7f7f974f9640 1 --2- 172.21.15.78:0/3290335371 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f7c07af80 0x7f7f7c07d440 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.534+0000 7f7f974f9640 1 --2- 172.21.15.78:0/3290335371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f90107900 0x7f7f9019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.534+0000 7f7f974f9640 1 --2- 172.21.15.78:0/3290335371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f90101900 0x7f7f9019d6a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.534+0000 7f7f974f9640 1 -- 172.21.15.78:0/3290335371 >> 172.21.15.78:0/3290335371 conn(0x7f7f900fd5e0 msgr2=0x7f7f900fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.534+0000 7f7f974f9640 1 -- 172.21.15.78:0/3290335371 shutdown_connections 2024-09-18T12:56:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.534+0000 7f7f974f9640 1 -- 172.21.15.78:0/3290335371 wait complete. 2024-09-18T12:56:03.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.616+0000 7f174c424640 1 -- 172.21.15.78:0/1699175102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1744107900 msgr2=0x7f1744107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.616+0000 7f174c424640 1 --2- 172.21.15.78:0/1699175102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1744107900 0x7f1744107ce0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1740009880 tx=0x7f174002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.616+0000 7f174c424640 1 -- 172.21.15.78:0/1699175102 shutdown_connections 2024-09-18T12:56:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.616+0000 7f174c424640 1 --2- 172.21.15.78:0/1699175102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744101900 0x7f1744101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.616+0000 7f174c424640 1 --2- 172.21.15.78:0/1699175102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1744107900 0x7f1744107ce0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.616+0000 7f174c424640 1 -- 172.21.15.78:0/1699175102 >> 172.21.15.78:0/1699175102 conn(0x7f17440fd600 msgr2=0x7f17440ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.616+0000 7f174c424640 1 -- 172.21.15.78:0/1699175102 shutdown_connections 2024-09-18T12:56:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.616+0000 7f174c424640 1 -- 172.21.15.78:0/1699175102 wait complete. 2024-09-18T12:56:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.617+0000 7f174c424640 1 Processor -- start 2024-09-18T12:56:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.617+0000 7f174c424640 1 -- start start 2024-09-18T12:56:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.617+0000 7f174c424640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744101900 0x7f174419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.617+0000 7f174c424640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1744107900 0x7f174419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.617+0000 7f174c424640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f174410edb0 con 0x7f1744107900 2024-09-18T12:56:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.617+0000 7f174c424640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f174410ec30 con 0x7f1744101900 2024-09-18T12:56:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.617+0000 7f17499bf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1744107900 0x7f174419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.617+0000 7f17499bf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1744107900 0x7f174419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48980/0 (socket says 172.21.15.78:48980) 2024-09-18T12:56:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.617+0000 7f17499bf640 1 -- 172.21.15.78:0/1887329996 learned_addr learned my addr 172.21.15.78:0/1887329996 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:56:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.617+0000 7f174a1c0640 1 --2- 172.21.15.78:0/1887329996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744101900 0x7f174419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.617+0000 7f17499bf640 1 -- 172.21.15.78:0/1887329996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744101900 msgr2=0x7f174419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.617+0000 7f17499bf640 1 --2- 172.21.15.78:0/1887329996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744101900 0x7f174419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.617+0000 7f17499bf640 1 -- 172.21.15.78:0/1887329996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17441977c0 con 0x7f1744107900 2024-09-18T12:56:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.617+0000 7f17499bf640 1 --2- 172.21.15.78:0/1887329996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1744107900 0x7f174419db80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f173400d8d0 tx=0x7f173400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.618+0000 7f173b7fe640 1 -- 172.21.15.78:0/1887329996 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1734017070 con 0x7f1744107900 2024-09-18T12:56:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.618+0000 7f173b7fe640 1 -- 172.21.15.78:0/1887329996 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1734010460 con 0x7f1744107900 2024-09-18T12:56:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.618+0000 7f174c424640 1 -- 172.21.15.78:0/1887329996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1744197ab0 con 0x7f1744107900 2024-09-18T12:56:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.618+0000 7f173b7fe640 1 -- 172.21.15.78:0/1887329996 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f173400f5f0 con 0x7f1744107900 2024-09-18T12:56:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.618+0000 7f174c424640 1 -- 172.21.15.78:0/1887329996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1744198040 con 0x7f1744107900 2024-09-18T12:56:03.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.619+0000 7f174c424640 1 -- 172.21.15.78:0/1887329996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1744103040 con 0x7f1744107900 2024-09-18T12:56:03.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.619+0000 7f173b7fe640 1 -- 172.21.15.78:0/1887329996 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1734009a30 con 0x7f1744107900 2024-09-18T12:56:03.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.620+0000 7f173b7fe640 1 --2- 172.21.15.78:0/1887329996 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f173007af40 0x7f173007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:03.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.620+0000 7f174a1c0640 1 --2- 172.21.15.78:0/1887329996 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f173007af40 0x7f173007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:03.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.620+0000 7f173b7fe640 1 -- 172.21.15.78:0/1887329996 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7f173409de90 con 0x7f1744107900 2024-09-18T12:56:03.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.620+0000 7f174a1c0640 1 --2- 172.21.15.78:0/1887329996 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f173007af40 0x7f173007d400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1740031460 tx=0x7f17400095c0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:03.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.624+0000 7f173b7fe640 1 -- 172.21.15.78:0/1887329996 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f17340694e0 con 0x7f1744107900 2024-09-18T12:56:03.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.836+0000 7f174c424640 1 -- 172.21.15.78:0/1887329996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1744104b10 con 0x7f1744107900 2024-09-18T12:56:03.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.836+0000 7f173b7fe640 1 -- 172.21.15.78:0/1887329996 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) ==== 76+0+2032 (secure 0 0 0) 0x7f173406e390 con 0x7f1744107900 2024-09-18T12:56:03.838 INFO:teuthology.orchestra.run.smithi078.stdout:e18 2024-09-18T12:56:03.838 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:46:44:251409+0000 2024-09-18T12:56:03.838 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:56:03.838 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:56:03.838 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T12:56:03.838 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:56:03.838 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:56:03.838 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T12:56:03.838 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 18 2024-09-18T12:56:03.839 INFO:teuthology.orchestra.run.smithi078.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:56:03.839 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:56:03.839 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:46:44.251398+0000 2024-09-18T12:56:03.839 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T12:56:03.839 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T12:56:03.839 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T12:56:03.839 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T12:56:03.839 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T12:56:03.839 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T12:56:03.839 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T12:56:03.839 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T12:56:03.840 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 45 2024-09-18T12:56:03.840 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:56:03.840 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T12:56:03.840 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T12:56:03.840 INFO:teuthology.orchestra.run.smithi078.stdout:up {0=14560,1=14574} 2024-09-18T12:56:03.840 INFO:teuthology.orchestra.run.smithi078.stdout:failed 2024-09-18T12:56:03.840 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T12:56:03.840 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T12:56:03.840 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T12:56:03.840 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T12:56:03.841 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T12:56:03.841 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T12:56:03.841 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T12:56:03.841 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T12:56:03.841 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 14560 members: 14560,14574 2024-09-18T12:56:03.841 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{0:14560} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:03.841 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{1:14574} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:03.841 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:56:03.841 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:56:03.841 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T12:56:03.841 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:56:03.841 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:03.842 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/258027429,v1:172.21.15.148:6825/258027429] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:03.843 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 18 2024-09-18T12:56:03.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.838+0000 7f174c424640 1 -- 172.21.15.78:0/1887329996 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f173007af40 msgr2=0x7f173007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:03.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.838+0000 7f174c424640 1 --2- 172.21.15.78:0/1887329996 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f173007af40 0x7f173007d400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1740031460 tx=0x7f17400095c0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.838+0000 7f174c424640 1 -- 172.21.15.78:0/1887329996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1744107900 msgr2=0x7f174419db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:03.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.838+0000 7f174c424640 1 --2- 172.21.15.78:0/1887329996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1744107900 0x7f174419db80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f173400d8d0 tx=0x7f173400dd90 comp rx=0 tx=0).stop 2024-09-18T12:56:03.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.838+0000 7f174c424640 1 -- 172.21.15.78:0/1887329996 shutdown_connections 2024-09-18T12:56:03.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.838+0000 7f174c424640 1 --2- 172.21.15.78:0/1887329996 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f173007af40 0x7f173007d400 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.838+0000 7f174c424640 1 --2- 172.21.15.78:0/1887329996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1744107900 0x7f174419db80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.838+0000 7f174c424640 1 --2- 172.21.15.78:0/1887329996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744101900 0x7f174419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.838+0000 7f174c424640 1 -- 172.21.15.78:0/1887329996 >> 172.21.15.78:0/1887329996 conn(0x7f17440fd600 msgr2=0x7f17440ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:03.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.838+0000 7f174c424640 1 -- 172.21.15.78:0/1887329996 shutdown_connections 2024-09-18T12:56:03.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.838+0000 7f174c424640 1 -- 172.21.15.78:0/1887329996 wait complete. 2024-09-18T12:56:03.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.920+0000 7fbcc3cc7640 1 -- 172.21.15.78:0/392080851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcbc102ac0 msgr2=0x7fbcbc102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:03.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.920+0000 7fbcc3cc7640 1 --2- 172.21.15.78:0/392080851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcbc102ac0 0x7fbcbc102ea0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009880 tx=0x7fbcb802a530 comp rx=0 tx=0).stop 2024-09-18T12:56:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.920+0000 7fbcc3cc7640 1 -- 172.21.15.78:0/392080851 shutdown_connections 2024-09-18T12:56:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.920+0000 7fbcc3cc7640 1 --2- 172.21.15.78:0/392080851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcbc1033e0 0x7fbcbc10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.920+0000 7fbcc3cc7640 1 --2- 172.21.15.78:0/392080851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcbc102ac0 0x7fbcbc102ea0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.920+0000 7fbcc3cc7640 1 -- 172.21.15.78:0/392080851 >> 172.21.15.78:0/392080851 conn(0x7fbcbc0fc520 msgr2=0x7fbcbc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.920+0000 7fbcc3cc7640 1 -- 172.21.15.78:0/392080851 shutdown_connections 2024-09-18T12:56:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.920+0000 7fbcc3cc7640 1 -- 172.21.15.78:0/392080851 wait complete. 2024-09-18T12:56:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.921+0000 7fbcc3cc7640 1 Processor -- start 2024-09-18T12:56:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.921+0000 7fbcc3cc7640 1 -- start start 2024-09-18T12:56:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.921+0000 7fbcc3cc7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcbc102ac0 0x7fbcbc100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.921+0000 7fbcc3cc7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcbc1033e0 0x7fbcbc100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.921+0000 7fbcc3cc7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc10edd0 con 0x7fbcbc102ac0 2024-09-18T12:56:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.921+0000 7fbcc3cc7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc10ec50 con 0x7fbcbc1033e0 2024-09-18T12:56:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.921+0000 7fbcc1a63640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcbc102ac0 0x7fbcbc100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.921+0000 7fbcc1a63640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcbc102ac0 0x7fbcbc100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48996/0 (socket says 172.21.15.78:48996) 2024-09-18T12:56:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.921+0000 7fbcc1a63640 1 -- 172.21.15.78:0/408676017 learned_addr learned my addr 172.21.15.78:0/408676017 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:56:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.921+0000 7fbcc1262640 1 --2- 172.21.15.78:0/408676017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcbc1033e0 0x7fbcbc100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.921+0000 7fbcc1a63640 1 -- 172.21.15.78:0/408676017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcbc1033e0 msgr2=0x7fbcbc100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.921+0000 7fbcc1a63640 1 --2- 172.21.15.78:0/408676017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcbc1033e0 0x7fbcbc100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.921+0000 7fbcc1a63640 1 -- 172.21.15.78:0/408676017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcbc1011a0 con 0x7fbcbc102ac0 2024-09-18T12:56:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.922+0000 7fbcc1a63640 1 --2- 172.21.15.78:0/408676017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcbc102ac0 0x7fbcbc100720 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8031460 tx=0x7fbcb80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.922+0000 7fbcb2ffd640 1 -- 172.21.15.78:0/408676017 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbcb803f070 con 0x7fbcbc102ac0 2024-09-18T12:56:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.922+0000 7fbcb2ffd640 1 -- 172.21.15.78:0/408676017 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbcb80035f0 con 0x7fbcbc102ac0 2024-09-18T12:56:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.922+0000 7fbcc3cc7640 1 -- 172.21.15.78:0/408676017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcbc101430 con 0x7fbcbc102ac0 2024-09-18T12:56:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.922+0000 7fbcb2ffd640 1 -- 172.21.15.78:0/408676017 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbcb8035030 con 0x7fbcbc102ac0 2024-09-18T12:56:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.922+0000 7fbcc3cc7640 1 -- 172.21.15.78:0/408676017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcbc1a3ea0 con 0x7fbcbc102ac0 2024-09-18T12:56:03.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.923+0000 7fbcc3cc7640 1 -- 172.21.15.78:0/408676017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcbc06aa90 con 0x7fbcbc102ac0 2024-09-18T12:56:03.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.923+0000 7fbcb2ffd640 1 -- 172.21.15.78:0/408676017 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbcb8042070 con 0x7fbcbc102ac0 2024-09-18T12:56:03.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.924+0000 7fbcb2ffd640 1 --2- 172.21.15.78:0/408676017 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbca807af80 0x7fbca807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:03.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.924+0000 7fbcb2ffd640 1 -- 172.21.15.78:0/408676017 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7fbcb80be810 con 0x7fbcbc102ac0 2024-09-18T12:56:03.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.924+0000 7fbcc1262640 1 --2- 172.21.15.78:0/408676017 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbca807af80 0x7fbca807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:03.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.924+0000 7fbcc1262640 1 --2- 172.21.15.78:0/408676017 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbca807af80 0x7fbca807d440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc1021b0 tx=0x7fbcac00b360 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:03.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:03.928+0000 7fbcb2ffd640 1 -- 172.21.15.78:0/408676017 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbcb8089ee0 con 0x7fbcbc102ac0 2024-09-18T12:56:04.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.119+0000 7fbcc3cc7640 1 -- 172.21.15.78:0/408676017 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbcbc062630 con 0x7fbca807af80 2024-09-18T12:56:04.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.120+0000 7fbcb2ffd640 1 -- 172.21.15.78:0/408676017 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fbcbc062630 con 0x7fbca807af80 2024-09-18T12:56:04.122 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:56:04.122 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:56:04.122 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:56:04.122 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:56:04.122 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:56:04.122 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T12:56:04.122 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T12:56:04.122 INFO:teuthology.orchestra.run.smithi078.stdout: "mon" 2024-09-18T12:56:04.122 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:56:04.122 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "9/23 daemons upgraded", 2024-09-18T12:56:04.122 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:56:04.123 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:56:04.123 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:56:04.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.123+0000 7fbcc3cc7640 1 -- 172.21.15.78:0/408676017 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbca807af80 msgr2=0x7fbca807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.123+0000 7fbcc3cc7640 1 --2- 172.21.15.78:0/408676017 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbca807af80 0x7fbca807d440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc1021b0 tx=0x7fbcac00b360 comp rx=0 tx=0).stop 2024-09-18T12:56:04.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.123+0000 7fbcc3cc7640 1 -- 172.21.15.78:0/408676017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcbc102ac0 msgr2=0x7fbcbc100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.123+0000 7fbcc3cc7640 1 --2- 172.21.15.78:0/408676017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcbc102ac0 0x7fbcbc100720 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8031460 tx=0x7fbcb80045e0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.124+0000 7fbcc3cc7640 1 -- 172.21.15.78:0/408676017 shutdown_connections 2024-09-18T12:56:04.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.124+0000 7fbcc3cc7640 1 --2- 172.21.15.78:0/408676017 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbca807af80 0x7fbca807d440 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.124+0000 7fbcc3cc7640 1 --2- 172.21.15.78:0/408676017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcbc1033e0 0x7fbcbc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.124+0000 7fbcc3cc7640 1 --2- 172.21.15.78:0/408676017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcbc102ac0 0x7fbcbc100720 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.124+0000 7fbcc3cc7640 1 -- 172.21.15.78:0/408676017 >> 172.21.15.78:0/408676017 conn(0x7fbcbc0fc520 msgr2=0x7fbcbc108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:04.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.124+0000 7fbcc3cc7640 1 -- 172.21.15.78:0/408676017 shutdown_connections 2024-09-18T12:56:04.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.124+0000 7fbcc3cc7640 1 -- 172.21.15.78:0/408676017 wait complete. 2024-09-18T12:56:04.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.207+0000 7f65d60a4640 1 -- 172.21.15.78:0/2332066508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d0103430 msgr2=0x7f65d010b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.207+0000 7f65d60a4640 1 --2- 172.21.15.78:0/2332066508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d0103430 0x7f65d010b920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f65c40098b0 tx=0x7f65c402a560 comp rx=0 tx=0).stop 2024-09-18T12:56:04.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.207+0000 7f65d60a4640 1 -- 172.21.15.78:0/2332066508 shutdown_connections 2024-09-18T12:56:04.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.207+0000 7f65d60a4640 1 --2- 172.21.15.78:0/2332066508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d0103430 0x7f65d010b920 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.207+0000 7f65d60a4640 1 --2- 172.21.15.78:0/2332066508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65d0102b10 0x7f65d0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.207+0000 7f65d60a4640 1 -- 172.21.15.78:0/2332066508 >> 172.21.15.78:0/2332066508 conn(0x7f65d00fc550 msgr2=0x7f65d00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:04.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.207+0000 7f65d60a4640 1 -- 172.21.15.78:0/2332066508 shutdown_connections 2024-09-18T12:56:04.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.207+0000 7f65d60a4640 1 -- 172.21.15.78:0/2332066508 wait complete. 2024-09-18T12:56:04.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.208+0000 7f65d60a4640 1 Processor -- start 2024-09-18T12:56:04.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.208+0000 7f65d60a4640 1 -- start start 2024-09-18T12:56:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.208+0000 7f65d60a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d0102b10 0x7f65d019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.208+0000 7f65d60a4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65d0103430 0x7f65d019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.208+0000 7f65d60a4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f65d010ede0 con 0x7f65d0102b10 2024-09-18T12:56:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.208+0000 7f65d60a4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f65d010ec60 con 0x7f65d0103430 2024-09-18T12:56:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.209+0000 7f65cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d0102b10 0x7f65d019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.209+0000 7f65cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d0102b10 0x7f65d019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49010/0 (socket says 172.21.15.78:49010) 2024-09-18T12:56:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.209+0000 7f65cf7fe640 1 -- 172.21.15.78:0/3439265536 learned_addr learned my addr 172.21.15.78:0/3439265536 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:56:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.209+0000 7f65ceffd640 1 --2- 172.21.15.78:0/3439265536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65d0103430 0x7f65d019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.209+0000 7f65ceffd640 1 -- 172.21.15.78:0/3439265536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d0102b10 msgr2=0x7f65d019d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.209+0000 7f65ceffd640 1 --2- 172.21.15.78:0/3439265536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d0102b10 0x7f65d019d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.209+0000 7f65ceffd640 1 -- 172.21.15.78:0/3439265536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d01977f0 con 0x7f65d0103430 2024-09-18T12:56:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.209+0000 7f65cf7fe640 1 --2- 172.21.15.78:0/3439265536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d0102b10 0x7f65d019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:56:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.209+0000 7f65ceffd640 1 --2- 172.21.15.78:0/3439265536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65d0103430 0x7f65d019dbb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f65c402aa80 tx=0x7f65c40045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.209+0000 7f65ccff9640 1 -- 172.21.15.78:0/3439265536 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f65c403f070 con 0x7f65d0103430 2024-09-18T12:56:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.209+0000 7f65d60a4640 1 -- 172.21.15.78:0/3439265536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d0197a80 con 0x7f65d0103430 2024-09-18T12:56:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.209+0000 7f65ccff9640 1 -- 172.21.15.78:0/3439265536 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f65c40035f0 con 0x7f65d0103430 2024-09-18T12:56:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.209+0000 7f65ccff9640 1 -- 172.21.15.78:0/3439265536 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f65c4035030 con 0x7f65d0103430 2024-09-18T12:56:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.210+0000 7f65d60a4640 1 -- 172.21.15.78:0/3439265536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d0197fb0 con 0x7f65d0103430 2024-09-18T12:56:04.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.211+0000 7f65d60a4640 1 -- 172.21.15.78:0/3439265536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d006a520 con 0x7f65d0103430 2024-09-18T12:56:04.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.211+0000 7f65ccff9640 1 -- 172.21.15.78:0/3439265536 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f65c4042070 con 0x7f65d0103430 2024-09-18T12:56:04.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.212+0000 7f65ccff9640 1 --2- 172.21.15.78:0/3439265536 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f65b807af80 0x7f65b807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:04.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.212+0000 7f65ccff9640 1 -- 172.21.15.78:0/3439265536 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7f65c40be6f0 con 0x7f65d0103430 2024-09-18T12:56:04.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.212+0000 7f65cf7fe640 1 --2- 172.21.15.78:0/3439265536 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f65b807af80 0x7f65b807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:04.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.213+0000 7f65cf7fe640 1 --2- 172.21.15.78:0/3439265536 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f65b807af80 0x7f65b807d440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f65c0011500 tx=0x7f65c0005f90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:04.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.217+0000 7f65ccff9640 1 -- 172.21.15.78:0/3439265536 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f65c4089dc0 con 0x7f65d0103430 2024-09-18T12:56:04.444 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:04 smithi078 ceph-mon[108578]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:04.444 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:04 smithi078 ceph-mon[108578]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:04.444 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:04 smithi078 ceph-mon[108578]: pgmap v187: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:04.444 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:04 smithi078 ceph-mon[108578]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:04.444 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:04 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3290335371' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:04.445 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:04 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1887329996' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:56:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:04 smithi148 ceph-mon[80030]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:04 smithi148 ceph-mon[80030]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:04 smithi148 ceph-mon[80030]: pgmap v187: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:04 smithi148 ceph-mon[80030]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:04 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3290335371' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:04 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1887329996' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:56:04.473 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:04 smithi148 systemd[1]: Stopping Ceph osd.3 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:56:04.474 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:04 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3[41294]: 2024-09-18T12:56:04.311+0000 7fad8d246640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:56:04.474 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:04 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3[41294]: 2024-09-18T12:56:04.311+0000 7fad8d246640 -1 osd.3 62 *** Got signal Terminated *** 2024-09-18T12:56:04.474 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:04 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3[41294]: 2024-09-18T12:56:04.311+0000 7fad8d246640 -1 osd.3 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:56:04.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.473+0000 7f65d60a4640 1 -- 172.21.15.78:0/3439265536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f65d0198d20 con 0x7f65d0103430 2024-09-18T12:56:04.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.474+0000 7f65ccff9640 1 -- 172.21.15.78:0/3439265536 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f65c408ec70 con 0x7f65d0103430 2024-09-18T12:56:04.475 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:04.475 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:04.475 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:56:04.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.476+0000 7f65d60a4640 1 -- 172.21.15.78:0/3439265536 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f65b807af80 msgr2=0x7f65b807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.476+0000 7f65d60a4640 1 --2- 172.21.15.78:0/3439265536 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f65b807af80 0x7f65b807d440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f65c0011500 tx=0x7f65c0005f90 comp rx=0 tx=0).stop 2024-09-18T12:56:04.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.476+0000 7f65d60a4640 1 -- 172.21.15.78:0/3439265536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65d0103430 msgr2=0x7f65d019dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.476+0000 7f65d60a4640 1 --2- 172.21.15.78:0/3439265536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65d0103430 0x7f65d019dbb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f65c402aa80 tx=0x7f65c40045e0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.476+0000 7f65d60a4640 1 -- 172.21.15.78:0/3439265536 shutdown_connections 2024-09-18T12:56:04.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.476+0000 7f65d60a4640 1 --2- 172.21.15.78:0/3439265536 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f65b807af80 0x7f65b807d440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.476+0000 7f65d60a4640 1 --2- 172.21.15.78:0/3439265536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65d0103430 0x7f65d019dbb0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.476+0000 7f65d60a4640 1 --2- 172.21.15.78:0/3439265536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d0102b10 0x7f65d019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.476+0000 7f65d60a4640 1 -- 172.21.15.78:0/3439265536 >> 172.21.15.78:0/3439265536 conn(0x7f65d00fc550 msgr2=0x7f65d0103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:04.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.476+0000 7f65d60a4640 1 -- 172.21.15.78:0/3439265536 shutdown_connections 2024-09-18T12:56:04.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:04.476+0000 7f65d60a4640 1 -- 172.21.15.78:0/3439265536 wait complete. 2024-09-18T12:56:05.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:05 smithi078 ceph-mon[108578]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:05.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:05 smithi078 ceph-mon[108578]: osd.3 marked itself down and dead 2024-09-18T12:56:05.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:05 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3439265536' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:56:05.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:05 smithi148 ceph-mon[80030]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:05.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:05 smithi148 ceph-mon[80030]: osd.3 marked itself down and dead 2024-09-18T12:56:05.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:05 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3439265536' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:56:06.096 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:05 smithi148 podman[87881]: 2024-09-18 12:56:05.802957979 +0000 UTC m=+1.588582921 container died ce11db957f1a6e2aeaf8959f22599acc97962b828234acf1db1710a701c86da5 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-18T12:56:06.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:06 smithi148 ceph-mon[80030]: pgmap v188: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:06.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:06 smithi148 ceph-mon[80030]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:56:06.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:06 smithi148 ceph-mon[80030]: osdmap e63: 6 total, 5 up, 6 in 2024-09-18T12:56:06.474 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:06 smithi148 podman[87881]: 2024-09-18 12:56:06.319597041 +0000 UTC m=+2.105222044 container cleanup ce11db957f1a6e2aeaf8959f22599acc97962b828234acf1db1710a701c86da5 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:56:06.474 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:06 smithi148 bash[87881]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3 2024-09-18T12:56:06.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:06 smithi078 ceph-mon[108578]: pgmap v188: 65 pgs: 65 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:06.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:06 smithi078 ceph-mon[108578]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:56:06.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:06 smithi078 ceph-mon[108578]: osdmap e63: 6 total, 5 up, 6 in 2024-09-18T12:56:06.951 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:06 smithi148 podman[87896]: 2024-09-18 12:56:06.537430267 +0000 UTC m=+0.737150845 container remove ce11db957f1a6e2aeaf8959f22599acc97962b828234acf1db1710a701c86da5 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:56:07.216 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:06 smithi148 podman[87988]: 2024-09-18 12:56:06.853097172 +0000 UTC m=+0.015902865 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:56:07.217 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:06 smithi148 podman[87988]: 2024-09-18 12:56:06.955057839 +0000 UTC m=+0.117863554 container create 6837369c1279480f4b479e969cc61704a202992d190a7d277a8e2eaaeb28f9d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-18T12:56:07.217 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:07 smithi148 podman[87988]: 2024-09-18 12:56:07.216189353 +0000 UTC m=+0.378995052 container init 6837369c1279480f4b479e969cc61704a202992d190a7d277a8e2eaaeb28f9d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-18T12:56:07.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:07 smithi148 ceph-mon[80030]: osdmap e64: 6 total, 5 up, 6 in 2024-09-18T12:56:07.473 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:07 smithi148 podman[87988]: 2024-09-18 12:56:07.219712198 +0000 UTC m=+0.382517878 container start 6837369c1279480f4b479e969cc61704a202992d190a7d277a8e2eaaeb28f9d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:56:07.473 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:07 smithi148 podman[87988]: 2024-09-18 12:56:07.318863931 +0000 UTC m=+0.481669630 container attach 6837369c1279480f4b479e969cc61704a202992d190a7d277a8e2eaaeb28f9d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:56:07.473 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:07 smithi148 podman[87988]: 2024-09-18 12:56:07.4066984 +0000 UTC m=+0.569504080 container died 6837369c1279480f4b479e969cc61704a202992d190a7d277a8e2eaaeb28f9d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True) 2024-09-18T12:56:07.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:07 smithi078 ceph-mon[108578]: osdmap e64: 6 total, 5 up, 6 in 2024-09-18T12:56:07.963 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:07 smithi148 podman[88011]: 2024-09-18 12:56:07.936205017 +0000 UTC m=+0.524017580 container remove 6837369c1279480f4b479e969cc61704a202992d190a7d277a8e2eaaeb28f9d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:56:08.223 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:07 smithi148 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-18T12:56:08.223 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:07 smithi148 systemd[1]: Stopped Ceph osd.3 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:56:08.223 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:07 smithi148 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 3.605s CPU time. 2024-09-18T12:56:08.223 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:08 smithi148 systemd[1]: Starting Ceph osd.3 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:56:08.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:08 smithi078 ceph-mon[108578]: pgmap v191: 65 pgs: 3 active+undersized, 18 peering, 4 stale+active+clean, 6 active+undersized+degraded, 34 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20/333 objects degraded (6.006%) 2024-09-18T12:56:08.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:08 smithi078 ceph-mon[108578]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-09-18T12:56:08.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:08 smithi078 ceph-mon[108578]: Health check failed: Degraded data redundancy: 20/333 objects degraded (6.006%), 6 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:08.539 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:08 smithi148 ceph-mon[80030]: pgmap v191: 65 pgs: 3 active+undersized, 18 peering, 4 stale+active+clean, 6 active+undersized+degraded, 34 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20/333 objects degraded (6.006%) 2024-09-18T12:56:08.540 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:08 smithi148 ceph-mon[80030]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-09-18T12:56:08.540 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:08 smithi148 ceph-mon[80030]: Health check failed: Degraded data redundancy: 20/333 objects degraded (6.006%), 6 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:08.540 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:08 smithi148 podman[88108]: 2024-09-18 12:56:08.297782782 +0000 UTC m=+0.015782647 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:56:08.540 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:08 smithi148 podman[88108]: 2024-09-18 12:56:08.420959512 +0000 UTC m=+0.138959365 container create 105faaf950a0d6a1d71ccc85dfaa87c4ffd1d81622beafd3a153b8de1562a07d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-activate, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-18T12:56:08.805 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:08 smithi148 podman[88108]: 2024-09-18 12:56:08.656631521 +0000 UTC m=+0.374631385 container init 105faaf950a0d6a1d71ccc85dfaa87c4ffd1d81622beafd3a153b8de1562a07d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-activate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:56:08.805 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:08 smithi148 podman[88108]: 2024-09-18 12:56:08.659985728 +0000 UTC m=+0.377985581 container start 105faaf950a0d6a1d71ccc85dfaa87c4ffd1d81622beafd3a153b8de1562a07d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-18T12:56:08.805 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:08 smithi148 podman[88108]: 2024-09-18 12:56:08.748304252 +0000 UTC m=+0.466304107 container attach 105faaf950a0d6a1d71ccc85dfaa87c4ffd1d81622beafd3a153b8de1562a07d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-activate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-18T12:56:08.805 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:08 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-activate[88123]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:08.805 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:08 smithi148 bash[88108]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:08.808 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:08 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-activate[88123]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:08.808 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:08 smithi148 bash[88108]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:10 smithi148 ceph-mon[80030]: pgmap v192: 65 pgs: 5 active+undersized, 18 peering, 3 stale+active+clean, 8 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24/333 objects degraded (7.207%) 2024-09-18T12:56:10.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:10 smithi078 ceph-mon[108578]: pgmap v192: 65 pgs: 5 active+undersized, 18 peering, 3 stale+active+clean, 8 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24/333 objects degraded (7.207%) 2024-09-18T12:56:11.422 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:11 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-activate[88123]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T12:56:11.423 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:11 smithi148 bash[88108]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T12:56:11.423 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:11 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-activate[88123]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T12:56:11.423 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:11 smithi148 bash[88108]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T12:56:11.423 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:11 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-activate[88123]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T12:56:11.423 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:11 smithi148 bash[88108]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T12:56:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:11.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:11 smithi148 ceph-mon[80030]: pgmap v193: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 70/333 objects degraded (21.021%) 2024-09-18T12:56:11.724 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:11 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-activate[88123]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T12:56:11.724 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:11 smithi148 bash[88108]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T12:56:11.724 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:11 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-activate[88123]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-18T12:56:11.725 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:11 smithi148 bash[88108]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-18T12:56:11.725 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:11 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-activate[88123]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T12:56:11.725 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:11 smithi148 bash[88108]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T12:56:11.725 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:11 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-activate[88123]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-18T12:56:11.725 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:11 smithi148 bash[88108]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-18T12:56:11.725 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:11 smithi148 podman[88108]: 2024-09-18 12:56:11.457389435 +0000 UTC m=+3.175389303 container died 105faaf950a0d6a1d71ccc85dfaa87c4ffd1d81622beafd3a153b8de1562a07d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:56:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:11 smithi078 ceph-mon[108578]: pgmap v193: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 70/333 objects degraded (21.021%) 2024-09-18T12:56:12.394 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:12 smithi148 podman[88280]: 2024-09-18 12:56:12.035299819 +0000 UTC m=+0.567618026 container remove 105faaf950a0d6a1d71ccc85dfaa87c4ffd1d81622beafd3a153b8de1562a07d (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-18T12:56:12.394 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:12 smithi148 podman[88339]: 2024-09-18 12:56:12.147018653 +0000 UTC m=+0.015766318 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:56:12.394 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:12 smithi148 podman[88339]: 2024-09-18 12:56:12.269519988 +0000 UTC m=+0.138267653 container create 084fd12e18904e2d3ee6d52b5f10e36af7bd6590ce70ca43a5ef7c2d82db6866 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:56:12.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:12 smithi148 ceph-mon[80030]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-09-18T12:56:12.973 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:12 smithi148 podman[88339]: 2024-09-18 12:56:12.622051043 +0000 UTC m=+0.490798708 container init 084fd12e18904e2d3ee6d52b5f10e36af7bd6590ce70ca43a5ef7c2d82db6866 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2) 2024-09-18T12:56:12.973 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:12 smithi148 podman[88339]: 2024-09-18 12:56:12.625538944 +0000 UTC m=+0.494286609 container start 084fd12e18904e2d3ee6d52b5f10e36af7bd6590ce70ca43a5ef7c2d82db6866 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:56:12.973 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:12 smithi148 ceph-osd[88358]: -- 172.21.15.148:0/2581309964 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bbfd1861e0 con 0x55bbfd116000 2024-09-18T12:56:12.974 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:12 smithi148 bash[88339]: 084fd12e18904e2d3ee6d52b5f10e36af7bd6590ce70ca43a5ef7c2d82db6866 2024-09-18T12:56:12.974 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:12 smithi148 systemd[1]: Started Ceph osd.3 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:56:12.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:12 smithi078 ceph-mon[108578]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-09-18T12:56:14.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:13 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:14.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:13 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:14.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:13 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:13 smithi148 ceph-mon[80030]: pgmap v194: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 70/333 objects degraded (21.021%) 2024-09-18T12:56:14.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:13 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:14.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:13 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:14.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:13 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:14.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:13 smithi078 ceph-mon[108578]: pgmap v194: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 70/333 objects degraded (21.021%) 2024-09-18T12:56:14.787 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:14 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3[88354]: 2024-09-18T12:56:14.511+0000 7f863433e640 -1 Falling back to public interface 2024-09-18T12:56:16.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:16 smithi148 ceph-mon[80030]: pgmap v195: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 70/333 objects degraded (21.021%) 2024-09-18T12:56:16.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:16 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:16.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:16 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:16.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:16 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:16.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:16 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:16.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:16 smithi078 ceph-mon[108578]: pgmap v195: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 70/333 objects degraded (21.021%) 2024-09-18T12:56:16.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:16 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:16.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:16 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:16.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:16 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:16.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:16 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:17.464 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:17 smithi148 ceph-mon[80030]: Health check update: Degraded data redundancy: 70/333 objects degraded (21.021%), 19 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:17.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:17 smithi078 ceph-mon[108578]: Health check update: Degraded data redundancy: 70/333 objects degraded (21.021%), 19 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:18.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:18 smithi148 ceph-mon[80030]: pgmap v196: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 70/333 objects degraded (21.021%) 2024-09-18T12:56:18.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:18 smithi078 ceph-mon[108578]: pgmap v196: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 70/333 objects degraded (21.021%) 2024-09-18T12:56:20.473 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:20 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3[88354]: 2024-09-18T12:56:20.205+0000 7f863433e640 -1 osd.3 62 log_to_monitors true 2024-09-18T12:56:20.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:20 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:20.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:20 smithi148 ceph-mon[80030]: pgmap v197: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 70/333 objects degraded (21.021%) 2024-09-18T12:56:20.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:20 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:20.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:20 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:20.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:20 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:56:20.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:20 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:20.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:20 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:20.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:20 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:20.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:20 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:20.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:20 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:20.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:20 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-18T12:56:20.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:20 smithi148 ceph-mon[80030]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T12:56:20.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:20 smithi148 ceph-mon[80030]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-18T12:56:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:20 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:20.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:20 smithi078 ceph-mon[108578]: pgmap v197: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 70/333 objects degraded (21.021%) 2024-09-18T12:56:20.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:20 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:20.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:20 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:20.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:20 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:56:20.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:20 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:20.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:20 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:20.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:20 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:20.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:20 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:20.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:20 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:20.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:20 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-18T12:56:20.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:20 smithi078 ceph-mon[108578]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T12:56:20.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:20 smithi078 ceph-mon[108578]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-18T12:56:21.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:21 smithi148 ceph-mon[80030]: from='osd.3 [v2:172.21.15.148:6800/1646376191,v1:172.21.15.148:6801/1646376191]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-18T12:56:21.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:21 smithi148 ceph-mon[80030]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-18T12:56:21.473 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 12:56:21 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3[88354]: 2024-09-18T12:56:21.132+0000 7f86280e0640 -1 osd.3 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:56:21.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:21 smithi078 ceph-mon[108578]: from='osd.3 [v2:172.21.15.148:6800/1646376191,v1:172.21.15.148:6801/1646376191]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-18T12:56:21.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:21 smithi078 ceph-mon[108578]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-18T12:56:22.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:22 smithi148 ceph-mon[80030]: pgmap v198: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 70/333 objects degraded (21.021%) 2024-09-18T12:56:22.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:22 smithi148 ceph-mon[80030]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T12:56:22.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:22 smithi148 ceph-mon[80030]: osdmap e65: 6 total, 5 up, 6 in 2024-09-18T12:56:22.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:22 smithi148 ceph-mon[80030]: from='osd.3 [v2:172.21.15.148:6800/1646376191,v1:172.21.15.148:6801/1646376191]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-18T12:56:22.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:22 smithi148 ceph-mon[80030]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-18T12:56:22.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:22 smithi078 ceph-mon[108578]: pgmap v198: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 70/333 objects degraded (21.021%) 2024-09-18T12:56:22.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:22 smithi078 ceph-mon[108578]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T12:56:22.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:22 smithi078 ceph-mon[108578]: osdmap e65: 6 total, 5 up, 6 in 2024-09-18T12:56:22.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:22 smithi078 ceph-mon[108578]: from='osd.3 [v2:172.21.15.148:6800/1646376191,v1:172.21.15.148:6801/1646376191]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-18T12:56:22.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:22 smithi078 ceph-mon[108578]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-18T12:56:23.402 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:23 smithi078 ceph-mon[108578]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:56:23.402 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:23 smithi078 ceph-mon[108578]: osd.3 [v2:172.21.15.148:6800/1646376191,v1:172.21.15.148:6801/1646376191] boot 2024-09-18T12:56:23.402 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:23 smithi078 ceph-mon[108578]: osdmap e66: 6 total, 6 up, 6 in 2024-09-18T12:56:23.403 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:23 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-18T12:56:23.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:23 smithi148 ceph-mon[80030]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:56:23.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:23 smithi148 ceph-mon[80030]: osd.3 [v2:172.21.15.148:6800/1646376191,v1:172.21.15.148:6801/1646376191] boot 2024-09-18T12:56:23.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:23 smithi148 ceph-mon[80030]: osdmap e66: 6 total, 6 up, 6 in 2024-09-18T12:56:23.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:23 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-18T12:56:24.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:24 smithi148 ceph-mon[80030]: pgmap v201: 65 pgs: 3 peering, 18 active+undersized, 17 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/333 objects degraded (19.820%) 2024-09-18T12:56:24.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:24 smithi148 ceph-mon[80030]: Health check update: Degraded data redundancy: 66/333 objects degraded (19.820%), 17 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:24.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:24 smithi148 ceph-mon[80030]: osdmap e67: 6 total, 6 up, 6 in 2024-09-18T12:56:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:24 smithi078 ceph-mon[108578]: pgmap v201: 65 pgs: 3 peering, 18 active+undersized, 17 active+undersized+degraded, 27 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/333 objects degraded (19.820%) 2024-09-18T12:56:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:24 smithi078 ceph-mon[108578]: Health check update: Degraded data redundancy: 66/333 objects degraded (19.820%), 17 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:24 smithi078 ceph-mon[108578]: osdmap e67: 6 total, 6 up, 6 in 2024-09-18T12:56:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:26 smithi148 ceph-mon[80030]: pgmap v203: 65 pgs: 3 peering, 15 active+undersized, 16 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 63/333 objects degraded (18.919%) 2024-09-18T12:56:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:26.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:26 smithi078 ceph-mon[108578]: pgmap v203: 65 pgs: 3 peering, 15 active+undersized, 16 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 63/333 objects degraded (18.919%) 2024-09-18T12:56:26.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:26.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:27.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:27 smithi148 ceph-mon[80030]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 63/333 objects degraded (18.919%), 16 pgs degraded) 2024-09-18T12:56:27.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:27 smithi078 ceph-mon[108578]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 63/333 objects degraded (18.919%), 16 pgs degraded) 2024-09-18T12:56:28.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:28 smithi148 ceph-mon[80030]: pgmap v204: 65 pgs: 3 peering, 62 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:28.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:28 smithi078 ceph-mon[108578]: pgmap v204: 65 pgs: 3 peering, 62 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:30.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:30 smithi148 ceph-mon[80030]: pgmap v205: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:30.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:30 smithi078 ceph-mon[108578]: pgmap v205: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:32 smithi148 ceph-mon[80030]: pgmap v206: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:32 smithi078 ceph-mon[108578]: pgmap v206: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:34.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:34 smithi148 ceph-mon[80030]: pgmap v207: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:34.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:34 smithi078 ceph-mon[108578]: pgmap v207: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:34.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.570+0000 7ff1b232a640 1 -- 172.21.15.78:0/4235326553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1ac100af0 msgr2=0x7ff1ac106630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:34.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.570+0000 7ff1b232a640 1 --2- 172.21.15.78:0/4235326553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1ac100af0 0x7ff1ac106630 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009880 tx=0x7ff1a002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:56:34.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.571+0000 7ff1b232a640 1 -- 172.21.15.78:0/4235326553 shutdown_connections 2024-09-18T12:56:34.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.571+0000 7ff1b232a640 1 --2- 172.21.15.78:0/4235326553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1ac100af0 0x7ff1ac106630 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:34.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.571+0000 7ff1b232a640 1 --2- 172.21.15.78:0/4235326553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1ac100140 0x7ff1ac100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:34.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.571+0000 7ff1b232a640 1 -- 172.21.15.78:0/4235326553 >> 172.21.15.78:0/4235326553 conn(0x7ff1ac0fbc90 msgr2=0x7ff1ac0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.571+0000 7ff1b232a640 1 -- 172.21.15.78:0/4235326553 shutdown_connections 2024-09-18T12:56:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.571+0000 7ff1b232a640 1 -- 172.21.15.78:0/4235326553 wait complete. 2024-09-18T12:56:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.571+0000 7ff1b232a640 1 Processor -- start 2024-09-18T12:56:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.571+0000 7ff1b232a640 1 -- start start 2024-09-18T12:56:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.572+0000 7ff1b232a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1ac100140 0x7ff1ac1010c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.572+0000 7ff1b232a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1ac100af0 0x7ff1ac101600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.572+0000 7ff1b232a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac10ee20 con 0x7ff1ac100af0 2024-09-18T12:56:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.572+0000 7ff1b232a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac10eca0 con 0x7ff1ac100140 2024-09-18T12:56:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.572+0000 7ff1ab7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1ac100af0 0x7ff1ac101600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.572+0000 7ff1ab7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1ac100af0 0x7ff1ac101600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56466/0 (socket says 172.21.15.78:56466) 2024-09-18T12:56:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.572+0000 7ff1ab7fe640 1 -- 172.21.15.78:0/2891940297 learned_addr learned my addr 172.21.15.78:0/2891940297 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:56:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.572+0000 7ff1abfff640 1 --2- 172.21.15.78:0/2891940297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1ac100140 0x7ff1ac1010c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.572+0000 7ff1ab7fe640 1 -- 172.21.15.78:0/2891940297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1ac100140 msgr2=0x7ff1ac1010c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.572+0000 7ff1ab7fe640 1 --2- 172.21.15.78:0/2891940297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1ac100140 0x7ff1ac1010c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:34.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.572+0000 7ff1ab7fe640 1 -- 172.21.15.78:0/2891940297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ac101b40 con 0x7ff1ac100af0 2024-09-18T12:56:34.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.572+0000 7ff1ab7fe640 1 --2- 172.21.15.78:0/2891940297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1ac100af0 0x7ff1ac101600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0031460 tx=0x7ff1a00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:34.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.573+0000 7ff1a97fa640 1 -- 172.21.15.78:0/2891940297 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff1a003f070 con 0x7ff1ac100af0 2024-09-18T12:56:34.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.573+0000 7ff1b232a640 1 -- 172.21.15.78:0/2891940297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1ac101dd0 con 0x7ff1ac100af0 2024-09-18T12:56:34.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.573+0000 7ff1a97fa640 1 -- 172.21.15.78:0/2891940297 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff1a00035f0 con 0x7ff1ac100af0 2024-09-18T12:56:34.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.573+0000 7ff1a97fa640 1 -- 172.21.15.78:0/2891940297 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff1a0035030 con 0x7ff1ac100af0 2024-09-18T12:56:34.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.573+0000 7ff1b232a640 1 -- 172.21.15.78:0/2891940297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1ac1a3dd0 con 0x7ff1ac100af0 2024-09-18T12:56:34.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.574+0000 7ff1b232a640 1 -- 172.21.15.78:0/2891940297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1ac103200 con 0x7ff1ac100af0 2024-09-18T12:56:34.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.574+0000 7ff1a97fa640 1 -- 172.21.15.78:0/2891940297 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff1a0042070 con 0x7ff1ac100af0 2024-09-18T12:56:34.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.575+0000 7ff1a97fa640 1 --2- 172.21.15.78:0/2891940297 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff19407af30 0x7ff19407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:34.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.575+0000 7ff1abfff640 1 --2- 172.21.15.78:0/2891940297 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff19407af30 0x7ff19407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:34.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.575+0000 7ff1a97fa640 1 -- 172.21.15.78:0/2891940297 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7ff1a00be8b0 con 0x7ff1ac100af0 2024-09-18T12:56:34.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.576+0000 7ff1abfff640 1 --2- 172.21.15.78:0/2891940297 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff19407af30 0x7ff19407d3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00bbe0 tx=0x7ff19c00b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:34.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.580+0000 7ff1a97fa640 1 -- 172.21.15.78:0/2891940297 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff1a0089f00 con 0x7ff1ac100af0 2024-09-18T12:56:34.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.770+0000 7ff1b232a640 1 -- 172.21.15.78:0/2891940297 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff1ac062630 con 0x7ff19407af30 2024-09-18T12:56:34.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.772+0000 7ff1a97fa640 1 -- 172.21.15.78:0/2891940297 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7ff1ac062630 con 0x7ff19407af30 2024-09-18T12:56:34.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.774+0000 7ff1b232a640 1 -- 172.21.15.78:0/2891940297 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff19407af30 msgr2=0x7ff19407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:34.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.774+0000 7ff1b232a640 1 --2- 172.21.15.78:0/2891940297 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff19407af30 0x7ff19407d3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00bbe0 tx=0x7ff19c00b390 comp rx=0 tx=0).stop 2024-09-18T12:56:34.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.774+0000 7ff1b232a640 1 -- 172.21.15.78:0/2891940297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1ac100af0 msgr2=0x7ff1ac101600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:34.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.774+0000 7ff1b232a640 1 --2- 172.21.15.78:0/2891940297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1ac100af0 0x7ff1ac101600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0031460 tx=0x7ff1a00045e0 comp rx=0 tx=0).stop 2024-09-18T12:56:34.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.774+0000 7ff1b232a640 1 -- 172.21.15.78:0/2891940297 shutdown_connections 2024-09-18T12:56:34.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.774+0000 7ff1b232a640 1 --2- 172.21.15.78:0/2891940297 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff19407af30 0x7ff19407d3f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:34.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.774+0000 7ff1b232a640 1 --2- 172.21.15.78:0/2891940297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1ac100af0 0x7ff1ac101600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:34.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.774+0000 7ff1b232a640 1 --2- 172.21.15.78:0/2891940297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1ac100140 0x7ff1ac1010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:34.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.774+0000 7ff1b232a640 1 -- 172.21.15.78:0/2891940297 >> 172.21.15.78:0/2891940297 conn(0x7ff1ac0fbc90 msgr2=0x7ff1ac105850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:34.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.774+0000 7ff1b232a640 1 -- 172.21.15.78:0/2891940297 shutdown_connections 2024-09-18T12:56:34.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.774+0000 7ff1b232a640 1 -- 172.21.15.78:0/2891940297 wait complete. 2024-09-18T12:56:34.784 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:56:34.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.857+0000 7fb00573a640 1 -- 172.21.15.78:0/2074271666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb000101900 msgr2=0x7fb000101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:34.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.857+0000 7fb00573a640 1 --2- 172.21.15.78:0/2074271666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb000101900 0x7fb000101d60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fafe8009880 tx=0x7fafe802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:56:34.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.857+0000 7fb00573a640 1 -- 172.21.15.78:0/2074271666 shutdown_connections 2024-09-18T12:56:34.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.857+0000 7fb00573a640 1 --2- 172.21.15.78:0/2074271666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb000101900 0x7fb000101d60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:34.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.857+0000 7fb00573a640 1 --2- 172.21.15.78:0/2074271666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb000107900 0x7fb000107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:34.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.857+0000 7fb00573a640 1 -- 172.21.15.78:0/2074271666 >> 172.21.15.78:0/2074271666 conn(0x7fb0000fd600 msgr2=0x7fb0000ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:34.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.857+0000 7fb00573a640 1 -- 172.21.15.78:0/2074271666 shutdown_connections 2024-09-18T12:56:34.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.857+0000 7fb00573a640 1 -- 172.21.15.78:0/2074271666 wait complete. 2024-09-18T12:56:34.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.858+0000 7fb00573a640 1 Processor -- start 2024-09-18T12:56:34.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.858+0000 7fb00573a640 1 -- start start 2024-09-18T12:56:34.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.858+0000 7fb00573a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb000101900 0x7fb0000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:34.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.858+0000 7fb00573a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb000107900 0x7fb000074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:34.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.858+0000 7fb00573a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb00010edd0 con 0x7fb000107900 2024-09-18T12:56:34.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.858+0000 7fb00573a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb00010ec50 con 0x7fb000101900 2024-09-18T12:56:34.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.858+0000 7faff67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb000107900 0x7fb000074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:34.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.858+0000 7faff67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb000107900 0x7fb000074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56490/0 (socket says 172.21.15.78:56490) 2024-09-18T12:56:34.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.858+0000 7faff67fc640 1 -- 172.21.15.78:0/2520884932 learned_addr learned my addr 172.21.15.78:0/2520884932 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:56:34.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.858+0000 7faffeffd640 1 --2- 172.21.15.78:0/2520884932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb000101900 0x7fb0000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:34.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.859+0000 7faff67fc640 1 -- 172.21.15.78:0/2520884932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb000101900 msgr2=0x7fb0000744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:34.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.859+0000 7faff67fc640 1 --2- 172.21.15.78:0/2520884932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb000101900 0x7fb0000744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:34.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.859+0000 7faff67fc640 1 -- 172.21.15.78:0/2520884932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb000074f70 con 0x7fb000107900 2024-09-18T12:56:34.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.859+0000 7faff67fc640 1 --2- 172.21.15.78:0/2520884932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb000107900 0x7fb000074a30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fafe8031460 tx=0x7fafe80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:34.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.859+0000 7faffcff9640 1 -- 172.21.15.78:0/2520884932 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafe803f070 con 0x7fb000107900 2024-09-18T12:56:34.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.859+0000 7faffcff9640 1 -- 172.21.15.78:0/2520884932 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fafe80035f0 con 0x7fb000107900 2024-09-18T12:56:34.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.859+0000 7fb00573a640 1 -- 172.21.15.78:0/2520884932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb000075200 con 0x7fb000107900 2024-09-18T12:56:34.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.859+0000 7faffcff9640 1 -- 172.21.15.78:0/2520884932 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafe8035030 con 0x7fb000107900 2024-09-18T12:56:34.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.859+0000 7fb00573a640 1 -- 172.21.15.78:0/2520884932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0001a3d60 con 0x7fb000107900 2024-09-18T12:56:34.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.861+0000 7fb00573a640 1 -- 172.21.15.78:0/2520884932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb000103040 con 0x7fb000107900 2024-09-18T12:56:34.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.861+0000 7faffcff9640 1 -- 172.21.15.78:0/2520884932 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fafe8042070 con 0x7fb000107900 2024-09-18T12:56:34.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.862+0000 7faffcff9640 1 --2- 172.21.15.78:0/2520884932 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fafec07af30 0x7fafec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:34.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.862+0000 7faffcff9640 1 -- 172.21.15.78:0/2520884932 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7fafe80be8b0 con 0x7fb000107900 2024-09-18T12:56:34.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.862+0000 7faffeffd640 1 --2- 172.21.15.78:0/2520884932 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fafec07af30 0x7fafec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:34.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.862+0000 7faffeffd640 1 --2- 172.21.15.78:0/2520884932 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fafec07af30 0x7fafec07d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faff0005fd0 tx=0x7faff000b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:34.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:34.866+0000 7faffcff9640 1 -- 172.21.15.78:0/2520884932 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fafe8089f00 con 0x7fb000107900 2024-09-18T12:56:35.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.056+0000 7fb00573a640 1 -- 172.21.15.78:0/2520884932 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb000062630 con 0x7fafec07af30 2024-09-18T12:56:35.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.058+0000 7faffcff9640 1 -- 172.21.15.78:0/2520884932 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fb000062630 con 0x7fafec07af30 2024-09-18T12:56:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.060+0000 7fb00573a640 1 -- 172.21.15.78:0/2520884932 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fafec07af30 msgr2=0x7fafec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.060+0000 7fb00573a640 1 --2- 172.21.15.78:0/2520884932 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fafec07af30 0x7fafec07d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faff0005fd0 tx=0x7faff000b390 comp rx=0 tx=0).stop 2024-09-18T12:56:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.060+0000 7fb00573a640 1 -- 172.21.15.78:0/2520884932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb000107900 msgr2=0x7fb000074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.060+0000 7fb00573a640 1 --2- 172.21.15.78:0/2520884932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb000107900 0x7fb000074a30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fafe8031460 tx=0x7fafe80045e0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.060+0000 7fb00573a640 1 -- 172.21.15.78:0/2520884932 shutdown_connections 2024-09-18T12:56:35.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.060+0000 7fb00573a640 1 --2- 172.21.15.78:0/2520884932 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fafec07af30 0x7fafec07d3f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.060+0000 7fb00573a640 1 --2- 172.21.15.78:0/2520884932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb000107900 0x7fb000074a30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.060+0000 7fb00573a640 1 --2- 172.21.15.78:0/2520884932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb000101900 0x7fb0000744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.060+0000 7fb00573a640 1 -- 172.21.15.78:0/2520884932 >> 172.21.15.78:0/2520884932 conn(0x7fb0000fd600 msgr2=0x7fb0000fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.060+0000 7fb00573a640 1 -- 172.21.15.78:0/2520884932 shutdown_connections 2024-09-18T12:56:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.060+0000 7fb00573a640 1 -- 172.21.15.78:0/2520884932 wait complete. 2024-09-18T12:56:35.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.142+0000 7f1805b62640 1 -- 172.21.15.78:0/3486917977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1800101900 msgr2=0x7f1800101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:35.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.142+0000 7f1805b62640 1 --2- 172.21.15.78:0/3486917977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1800101900 0x7f1800101d60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009880 tx=0x7f17f402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.142+0000 7f1805b62640 1 -- 172.21.15.78:0/3486917977 shutdown_connections 2024-09-18T12:56:35.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.142+0000 7f1805b62640 1 --2- 172.21.15.78:0/3486917977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1800101900 0x7f1800101d60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.142+0000 7f1805b62640 1 --2- 172.21.15.78:0/3486917977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1800107900 0x7f1800107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.142+0000 7f1805b62640 1 -- 172.21.15.78:0/3486917977 >> 172.21.15.78:0/3486917977 conn(0x7f18000fd600 msgr2=0x7f18000ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:35.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.142+0000 7f1805b62640 1 -- 172.21.15.78:0/3486917977 shutdown_connections 2024-09-18T12:56:35.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.142+0000 7f1805b62640 1 -- 172.21.15.78:0/3486917977 wait complete. 2024-09-18T12:56:35.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.143+0000 7f1805b62640 1 Processor -- start 2024-09-18T12:56:35.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.143+0000 7f1805b62640 1 -- start start 2024-09-18T12:56:35.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.143+0000 7f1805b62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1800101900 0x7f180019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:35.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.143+0000 7f1805b62640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1800107900 0x7f180019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:35.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.143+0000 7f1805b62640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f180010ee30 con 0x7f1800101900 2024-09-18T12:56:35.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.143+0000 7f1805b62640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f180010ecb0 con 0x7f1800107900 2024-09-18T12:56:35.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.143+0000 7f17ff7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1800101900 0x7f180019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:35.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.143+0000 7f17ff7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1800101900 0x7f180019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56500/0 (socket says 172.21.15.78:56500) 2024-09-18T12:56:35.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.143+0000 7f17ff7fe640 1 -- 172.21.15.78:0/1933302116 learned_addr learned my addr 172.21.15.78:0/1933302116 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:56:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.143+0000 7f17feffd640 1 --2- 172.21.15.78:0/1933302116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1800107900 0x7f180019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.144+0000 7f17ff7fe640 1 -- 172.21.15.78:0/1933302116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1800107900 msgr2=0x7f180019dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.144+0000 7f17ff7fe640 1 --2- 172.21.15.78:0/1933302116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1800107900 0x7f180019dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.144+0000 7f17ff7fe640 1 -- 172.21.15.78:0/1933302116 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1800197840 con 0x7f1800101900 2024-09-18T12:56:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.144+0000 7f17feffd640 1 --2- 172.21.15.78:0/1933302116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1800107900 0x7f180019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:56:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.144+0000 7f17ff7fe640 1 --2- 172.21.15.78:0/1933302116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1800101900 0x7f180019d6c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f17f000b420 tx=0x7f17f000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.144+0000 7f17fcff9640 1 -- 172.21.15.78:0/1933302116 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f17f0011630 con 0x7f1800101900 2024-09-18T12:56:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.144+0000 7f17fcff9640 1 -- 172.21.15.78:0/1933302116 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f17f0016070 con 0x7f1800101900 2024-09-18T12:56:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.144+0000 7f1805b62640 1 -- 172.21.15.78:0/1933302116 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1800197b30 con 0x7f1800101900 2024-09-18T12:56:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.144+0000 7f17fcff9640 1 -- 172.21.15.78:0/1933302116 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f17f0010d40 con 0x7f1800101900 2024-09-18T12:56:35.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.144+0000 7f1805b62640 1 -- 172.21.15.78:0/1933302116 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1800198090 con 0x7f1800101900 2024-09-18T12:56:35.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.145+0000 7f1805b62640 1 -- 172.21.15.78:0/1933302116 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1800103040 con 0x7f1800101900 2024-09-18T12:56:35.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.146+0000 7f17fcff9640 1 -- 172.21.15.78:0/1933302116 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f17f001b460 con 0x7f1800101900 2024-09-18T12:56:35.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.146+0000 7f17fcff9640 1 --2- 172.21.15.78:0/1933302116 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17e807af80 0x7f17e807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:35.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.146+0000 7f17fcff9640 1 -- 172.21.15.78:0/1933302116 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7f17f009d650 con 0x7f1800101900 2024-09-18T12:56:35.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.146+0000 7f17feffd640 1 --2- 172.21.15.78:0/1933302116 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17e807af80 0x7f17e807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:35.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.147+0000 7f17feffd640 1 --2- 172.21.15.78:0/1933302116 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17e807af80 0x7f17e807d440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1800198b90 tx=0x7f17f4031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:35.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.151+0000 7f17fcff9640 1 -- 172.21.15.78:0/1933302116 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f17f0068d20 con 0x7f1800101900 2024-09-18T12:56:35.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.338+0000 7f1805b62640 1 -- 172.21.15.78:0/1933302116 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f18001983a0 con 0x7f17e807af80 2024-09-18T12:56:35.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.348+0000 7f17fcff9640 1 -- 172.21.15.78:0/1933302116 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f18001983a0 con 0x7f17e807af80 2024-09-18T12:56:35.349 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:56:35.349 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (4m) 54s ago 15m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T12:56:35.349 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (6m) 54s ago 15m 8908k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:56:35.349 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (6m) 19s ago 14m 8476k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:56:35.349 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (2m) 54s ago 15m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T12:56:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (2m) 19s ago 14m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T12:56:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (4m) 54s ago 15m 75.8M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T12:56:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (10m) 54s ago 10m 150M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:56:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (10m) 54s ago 9m 28.0M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:56:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (10m) 19s ago 10m 17.1M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:56:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (9m) 19s ago 9m 17.9M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:56:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (6m) 54s ago 16m 524M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:56:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (5m) 19s ago 14m 455M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:56:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (3m) 54s ago 16m 42.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T12:56:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (2m) 19s ago 14m 37.9M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T12:56:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (5m) 54s ago 15m 11.7M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:56:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (5m) 19s ago 14m 12.3M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:56:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (2m) 54s ago 13m 84.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T12:56:35.351 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (96s) 54s ago 12m 86.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T12:56:35.351 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (60s) 54s ago 12m 11.4M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T12:56:35.351 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (23s) 19s ago 11m 12.2M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T12:56:35.351 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (11m) 19s ago 11m 210M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 47ae96232883 2024-09-18T12:56:35.351 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (11m) 19s ago 11m 193M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:56:35.351 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (4m) 54s ago 14m 56.3M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:56:35.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.350+0000 7f1805b62640 1 -- 172.21.15.78:0/1933302116 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17e807af80 msgr2=0x7f17e807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:35.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.350+0000 7f1805b62640 1 --2- 172.21.15.78:0/1933302116 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17e807af80 0x7f17e807d440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1800198b90 tx=0x7f17f4031400 comp rx=0 tx=0).stop 2024-09-18T12:56:35.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.350+0000 7f1805b62640 1 -- 172.21.15.78:0/1933302116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1800101900 msgr2=0x7f180019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:35.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.350+0000 7f1805b62640 1 --2- 172.21.15.78:0/1933302116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1800101900 0x7f180019d6c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f17f000b420 tx=0x7f17f000b8e0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.350+0000 7f1805b62640 1 -- 172.21.15.78:0/1933302116 shutdown_connections 2024-09-18T12:56:35.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.350+0000 7f1805b62640 1 --2- 172.21.15.78:0/1933302116 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17e807af80 0x7f17e807d440 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.350+0000 7f1805b62640 1 --2- 172.21.15.78:0/1933302116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1800107900 0x7f180019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.350+0000 7f1805b62640 1 --2- 172.21.15.78:0/1933302116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1800101900 0x7f180019d6c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.350+0000 7f1805b62640 1 -- 172.21.15.78:0/1933302116 >> 172.21.15.78:0/1933302116 conn(0x7f18000fd600 msgr2=0x7f18000fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:35.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.350+0000 7f1805b62640 1 -- 172.21.15.78:0/1933302116 shutdown_connections 2024-09-18T12:56:35.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.350+0000 7f1805b62640 1 -- 172.21.15.78:0/1933302116 wait complete. 2024-09-18T12:56:35.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.431+0000 7f5730235640 1 -- 172.21.15.78:0/4240701147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5728102b80 msgr2=0x7f5728102f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:35.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.431+0000 7f5730235640 1 --2- 172.21.15.78:0/4240701147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5728102b80 0x7f5728102f60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5724009880 tx=0x7f572402a530 comp rx=0 tx=0).stop 2024-09-18T12:56:35.433 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:35 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-18T12:56:35.433 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:35 smithi078 ceph-mon[108578]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T12:56:35.433 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:35 smithi078 ceph-mon[108578]: Upgrade: osd.4 is safe to restart 2024-09-18T12:56:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.431+0000 7f5730235640 1 -- 172.21.15.78:0/4240701147 shutdown_connections 2024-09-18T12:56:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.431+0000 7f5730235640 1 --2- 172.21.15.78:0/4240701147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57281034a0 0x7f572810b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.431+0000 7f5730235640 1 --2- 172.21.15.78:0/4240701147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5728102b80 0x7f5728102f60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.431+0000 7f5730235640 1 -- 172.21.15.78:0/4240701147 >> 172.21.15.78:0/4240701147 conn(0x7f57280fc520 msgr2=0x7f57280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.431+0000 7f5730235640 1 -- 172.21.15.78:0/4240701147 shutdown_connections 2024-09-18T12:56:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.431+0000 7f5730235640 1 -- 172.21.15.78:0/4240701147 wait complete. 2024-09-18T12:56:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.432+0000 7f5730235640 1 Processor -- start 2024-09-18T12:56:35.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.432+0000 7f5730235640 1 -- start start 2024-09-18T12:56:35.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.432+0000 7f5730235640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5728102b80 0x7f572819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:35.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.432+0000 7f5730235640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57281034a0 0x7f572819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:35.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.432+0000 7f5730235640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f572810edf0 con 0x7f5728102b80 2024-09-18T12:56:35.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.432+0000 7f5730235640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f572810ec70 con 0x7f57281034a0 2024-09-18T12:56:35.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.433+0000 7f572dfd1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5728102b80 0x7f572819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:35.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.433+0000 7f572dfd1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5728102b80 0x7f572819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56514/0 (socket says 172.21.15.78:56514) 2024-09-18T12:56:35.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.433+0000 7f572dfd1640 1 -- 172.21.15.78:0/3536343744 learned_addr learned my addr 172.21.15.78:0/3536343744 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:56:35.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.433+0000 7f572d7d0640 1 --2- 172.21.15.78:0/3536343744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57281034a0 0x7f572819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:35.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.433+0000 7f572dfd1640 1 -- 172.21.15.78:0/3536343744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57281034a0 msgr2=0x7f572819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:35.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.433+0000 7f572dfd1640 1 --2- 172.21.15.78:0/3536343744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57281034a0 0x7f572819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.433+0000 7f572dfd1640 1 -- 172.21.15.78:0/3536343744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5728197800 con 0x7f5728102b80 2024-09-18T12:56:35.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.433+0000 7f572dfd1640 1 --2- 172.21.15.78:0/3536343744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5728102b80 0x7f572819d680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5724004f90 tx=0x7f57240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:35.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.433+0000 7f571effd640 1 -- 172.21.15.78:0/3536343744 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f572403f070 con 0x7f5728102b80 2024-09-18T12:56:35.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.433+0000 7f571effd640 1 -- 172.21.15.78:0/3536343744 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5724004ac0 con 0x7f5728102b80 2024-09-18T12:56:35.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.433+0000 7f5730235640 1 -- 172.21.15.78:0/3536343744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5728197a90 con 0x7f5728102b80 2024-09-18T12:56:35.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.433+0000 7f571effd640 1 -- 172.21.15.78:0/3536343744 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5724035030 con 0x7f5728102b80 2024-09-18T12:56:35.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.434+0000 7f5730235640 1 -- 172.21.15.78:0/3536343744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5728197fc0 con 0x7f5728102b80 2024-09-18T12:56:35.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.435+0000 7f5730235640 1 -- 172.21.15.78:0/3536343744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f572806a9d0 con 0x7f5728102b80 2024-09-18T12:56:35.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.435+0000 7f571effd640 1 -- 172.21.15.78:0/3536343744 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5724042070 con 0x7f5728102b80 2024-09-18T12:56:35.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.436+0000 7f571effd640 1 --2- 172.21.15.78:0/3536343744 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f571407af80 0x7f571407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:35.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.436+0000 7f572d7d0640 1 --2- 172.21.15.78:0/3536343744 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f571407af80 0x7f571407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:35.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.436+0000 7f571effd640 1 -- 172.21.15.78:0/3536343744 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7f57240be7d0 con 0x7f5728102b80 2024-09-18T12:56:35.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.437+0000 7f572d7d0640 1 --2- 172.21.15.78:0/3536343744 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f571407af80 0x7f571407d440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5728108950 tx=0x7f5718005f90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.440+0000 7f571effd640 1 -- 172.21.15.78:0/3536343744 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5724089ea0 con 0x7f5728102b80 2024-09-18T12:56:35.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:35 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-18T12:56:35.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:35 smithi148 ceph-mon[80030]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T12:56:35.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:35 smithi148 ceph-mon[80030]: Upgrade: osd.4 is safe to restart 2024-09-18T12:56:35.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.686+0000 7f5730235640 1 -- 172.21.15.78:0/3536343744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5728105fe0 con 0x7f5728102b80 2024-09-18T12:56:35.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.687+0000 7f571effd640 1 -- 172.21.15.78:0/3536343744 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f572408c3c0 con 0x7f5728102b80 2024-09-18T12:56:35.688 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:56:35.688 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:56:35.689 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:56:35.689 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:56:35.689 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:56:35.689 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:56:35.689 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:56:35.689 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:56:35.689 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2, 2024-09-18T12:56:35.689 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T12:56:35.689 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:56:35.689 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:56:35.689 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:56:35.689 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:56:35.689 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:56:35.690 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6, 2024-09-18T12:56:35.690 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 8 2024-09-18T12:56:35.690 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:56:35.690 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:56:35.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.689+0000 7f5730235640 1 -- 172.21.15.78:0/3536343744 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f571407af80 msgr2=0x7f571407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:35.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.689+0000 7f5730235640 1 --2- 172.21.15.78:0/3536343744 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f571407af80 0x7f571407d440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5728108950 tx=0x7f5718005f90 comp rx=0 tx=0).stop 2024-09-18T12:56:35.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.689+0000 7f5730235640 1 -- 172.21.15.78:0/3536343744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5728102b80 msgr2=0x7f572819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:35.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.689+0000 7f5730235640 1 --2- 172.21.15.78:0/3536343744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5728102b80 0x7f572819d680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5724004f90 tx=0x7f57240046c0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.689+0000 7f5730235640 1 -- 172.21.15.78:0/3536343744 shutdown_connections 2024-09-18T12:56:35.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.689+0000 7f5730235640 1 --2- 172.21.15.78:0/3536343744 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f571407af80 0x7f571407d440 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.689+0000 7f5730235640 1 --2- 172.21.15.78:0/3536343744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57281034a0 0x7f572819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.689+0000 7f5730235640 1 --2- 172.21.15.78:0/3536343744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5728102b80 0x7f572819d680 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.689+0000 7f5730235640 1 -- 172.21.15.78:0/3536343744 >> 172.21.15.78:0/3536343744 conn(0x7f57280fc520 msgr2=0x7f5728108fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:35.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.689+0000 7f5730235640 1 -- 172.21.15.78:0/3536343744 shutdown_connections 2024-09-18T12:56:35.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.689+0000 7f5730235640 1 -- 172.21.15.78:0/3536343744 wait complete. 2024-09-18T12:56:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.772+0000 7fa6434e9640 1 -- 172.21.15.78:0/3884952603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63c101900 msgr2=0x7fa63c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.772+0000 7fa6434e9640 1 --2- 172.21.15.78:0/3884952603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63c101900 0x7fa63c101d60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa62c009880 tx=0x7fa62c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.772+0000 7fa6434e9640 1 -- 172.21.15.78:0/3884952603 shutdown_connections 2024-09-18T12:56:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.772+0000 7fa6434e9640 1 --2- 172.21.15.78:0/3884952603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63c101900 0x7fa63c101d60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.772+0000 7fa6434e9640 1 --2- 172.21.15.78:0/3884952603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa63c107900 0x7fa63c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.772+0000 7fa6434e9640 1 -- 172.21.15.78:0/3884952603 >> 172.21.15.78:0/3884952603 conn(0x7fa63c0fd600 msgr2=0x7fa63c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.772+0000 7fa6434e9640 1 -- 172.21.15.78:0/3884952603 shutdown_connections 2024-09-18T12:56:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.772+0000 7fa6434e9640 1 -- 172.21.15.78:0/3884952603 wait complete. 2024-09-18T12:56:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.773+0000 7fa6434e9640 1 Processor -- start 2024-09-18T12:56:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.773+0000 7fa6434e9640 1 -- start start 2024-09-18T12:56:35.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.773+0000 7fa6434e9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa63c101900 0x7fa63c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:35.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.773+0000 7fa6434e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63c107900 0x7fa63c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:35.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.773+0000 7fa6434e9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c10edd0 con 0x7fa63c107900 2024-09-18T12:56:35.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.773+0000 7fa6434e9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c10ec50 con 0x7fa63c101900 2024-09-18T12:56:35.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.773+0000 7fa640a84640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63c107900 0x7fa63c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:35.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.773+0000 7fa641285640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa63c101900 0x7fa63c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.773+0000 7fa640a84640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63c107900 0x7fa63c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56538/0 (socket says 172.21.15.78:56538) 2024-09-18T12:56:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.773+0000 7fa640a84640 1 -- 172.21.15.78:0/552773962 learned_addr learned my addr 172.21.15.78:0/552773962 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:56:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.774+0000 7fa641285640 1 -- 172.21.15.78:0/552773962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63c107900 msgr2=0x7fa63c19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.774+0000 7fa641285640 1 --2- 172.21.15.78:0/552773962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63c107900 0x7fa63c19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.774+0000 7fa641285640 1 -- 172.21.15.78:0/552773962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa63c197800 con 0x7fa63c101900 2024-09-18T12:56:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.774+0000 7fa640a84640 1 --2- 172.21.15.78:0/552773962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63c107900 0x7fa63c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:56:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.774+0000 7fa641285640 1 --2- 172.21.15.78:0/552773962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa63c101900 0x7fa63c19d680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa63800e970 tx=0x7fa63800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.774+0000 7fa6327fc640 1 -- 172.21.15.78:0/552773962 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa63800cac0 con 0x7fa63c101900 2024-09-18T12:56:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.774+0000 7fa6434e9640 1 -- 172.21.15.78:0/552773962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa63c197af0 con 0x7fa63c101900 2024-09-18T12:56:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.774+0000 7fa6327fc640 1 -- 172.21.15.78:0/552773962 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa63800cc60 con 0x7fa63c101900 2024-09-18T12:56:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.774+0000 7fa6327fc640 1 -- 172.21.15.78:0/552773962 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa6380047a0 con 0x7fa63c101900 2024-09-18T12:56:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.774+0000 7fa6434e9640 1 -- 172.21.15.78:0/552773962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa63c198050 con 0x7fa63c101900 2024-09-18T12:56:35.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.775+0000 7fa6434e9640 1 -- 172.21.15.78:0/552773962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa63c103040 con 0x7fa63c101900 2024-09-18T12:56:35.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.776+0000 7fa6327fc640 1 -- 172.21.15.78:0/552773962 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa638004a70 con 0x7fa63c101900 2024-09-18T12:56:35.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.776+0000 7fa6327fc640 1 --2- 172.21.15.78:0/552773962 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa62807af30 0x7fa62807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:35.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.776+0000 7fa640a84640 1 --2- 172.21.15.78:0/552773962 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa62807af30 0x7fa62807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:35.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.776+0000 7fa6327fc640 1 -- 172.21.15.78:0/552773962 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7fa63809e480 con 0x7fa63c101900 2024-09-18T12:56:35.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.777+0000 7fa640a84640 1 --2- 172.21.15.78:0/552773962 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa62807af30 0x7fa62807d3f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa63c198b50 tx=0x7fa62c0058d0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:35.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.781+0000 7fa6327fc640 1 -- 172.21.15.78:0/552773962 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa638069a70 con 0x7fa63c101900 2024-09-18T12:56:35.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.993+0000 7fa6434e9640 1 -- 172.21.15.78:0/552773962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa63c109e70 con 0x7fa63c101900 2024-09-18T12:56:35.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.993+0000 7fa6327fc640 1 -- 172.21.15.78:0/552773962 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) ==== 76+0+2032 (secure 0 0 0) 0x7fa63806e920 con 0x7fa63c101900 2024-09-18T12:56:35.995 INFO:teuthology.orchestra.run.smithi078.stdout:e18 2024-09-18T12:56:35.995 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:46:44:251409+0000 2024-09-18T12:56:35.995 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:56:35.995 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:56:35.995 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T12:56:35.995 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:56:35.995 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:56:35.995 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T12:56:35.996 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 18 2024-09-18T12:56:35.996 INFO:teuthology.orchestra.run.smithi078.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:56:35.996 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:56:35.996 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:46:44.251398+0000 2024-09-18T12:56:35.996 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T12:56:35.996 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T12:56:35.996 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T12:56:35.996 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T12:56:35.996 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T12:56:35.996 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T12:56:35.996 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T12:56:35.996 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T12:56:35.996 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 45 2024-09-18T12:56:35.997 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:56:35.997 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T12:56:35.997 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T12:56:35.997 INFO:teuthology.orchestra.run.smithi078.stdout:up {0=14560,1=14574} 2024-09-18T12:56:35.997 INFO:teuthology.orchestra.run.smithi078.stdout:failed 2024-09-18T12:56:35.997 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T12:56:35.997 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T12:56:35.997 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T12:56:35.997 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T12:56:35.997 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T12:56:35.997 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T12:56:35.997 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T12:56:35.998 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T12:56:35.998 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 14560 members: 14560,14574 2024-09-18T12:56:35.998 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{0:14560} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:35.998 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{1:14574} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:35.998 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:56:35.998 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:56:35.998 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T12:56:35.998 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:56:35.998 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:35.998 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/258027429,v1:172.21.15.148:6825/258027429] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:35.999 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 18 2024-09-18T12:56:35.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.996+0000 7fa6434e9640 1 -- 172.21.15.78:0/552773962 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa62807af30 msgr2=0x7fa62807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:35.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.996+0000 7fa6434e9640 1 --2- 172.21.15.78:0/552773962 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa62807af30 0x7fa62807d3f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa63c198b50 tx=0x7fa62c0058d0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.996+0000 7fa6434e9640 1 -- 172.21.15.78:0/552773962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa63c101900 msgr2=0x7fa63c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:35.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.996+0000 7fa6434e9640 1 --2- 172.21.15.78:0/552773962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa63c101900 0x7fa63c19d680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa63800e970 tx=0x7fa63800ee30 comp rx=0 tx=0).stop 2024-09-18T12:56:35.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.996+0000 7fa6434e9640 1 -- 172.21.15.78:0/552773962 shutdown_connections 2024-09-18T12:56:35.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.996+0000 7fa6434e9640 1 --2- 172.21.15.78:0/552773962 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa62807af30 0x7fa62807d3f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:35.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.996+0000 7fa6434e9640 1 --2- 172.21.15.78:0/552773962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63c107900 0x7fa63c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.996+0000 7fa6434e9640 1 --2- 172.21.15.78:0/552773962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa63c101900 0x7fa63c19d680 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.996+0000 7fa6434e9640 1 -- 172.21.15.78:0/552773962 >> 172.21.15.78:0/552773962 conn(0x7fa63c0fd600 msgr2=0x7fa63c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:36.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.996+0000 7fa6434e9640 1 -- 172.21.15.78:0/552773962 shutdown_connections 2024-09-18T12:56:36.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:35.996+0000 7fa6434e9640 1 -- 172.21.15.78:0/552773962 wait complete. 2024-09-18T12:56:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.080+0000 7fa754a88640 1 -- 172.21.15.78:0/1815269569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7500745e0 msgr2=0x7fa7500749c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.080+0000 7fa754a88640 1 --2- 172.21.15.78:0/1815269569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7500745e0 0x7fa7500749c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa7400098b0 tx=0x7fa74002a560 comp rx=0 tx=0).stop 2024-09-18T12:56:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.080+0000 7fa754a88640 1 -- 172.21.15.78:0/1815269569 shutdown_connections 2024-09-18T12:56:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.080+0000 7fa754a88640 1 --2- 172.21.15.78:0/1815269569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa750074f00 0x7fa75010dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.080+0000 7fa754a88640 1 --2- 172.21.15.78:0/1815269569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7500745e0 0x7fa7500749c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.080+0000 7fa754a88640 1 -- 172.21.15.78:0/1815269569 >> 172.21.15.78:0/1815269569 conn(0x7fa7500fd600 msgr2=0x7fa7500ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.080+0000 7fa754a88640 1 -- 172.21.15.78:0/1815269569 shutdown_connections 2024-09-18T12:56:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.080+0000 7fa754a88640 1 -- 172.21.15.78:0/1815269569 wait complete. 2024-09-18T12:56:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.080+0000 7fa754a88640 1 Processor -- start 2024-09-18T12:56:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.081+0000 7fa754a88640 1 -- start start 2024-09-18T12:56:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.081+0000 7fa754a88640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7500745e0 0x7fa75019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.081+0000 7fa754a88640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa750074f00 0x7fa75019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.081+0000 7fa754a88640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa750110ff0 con 0x7fa750074f00 2024-09-18T12:56:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.081+0000 7fa754a88640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa750110e70 con 0x7fa7500745e0 2024-09-18T12:56:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.081+0000 7fa74dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa750074f00 0x7fa75019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.081+0000 7fa74dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa750074f00 0x7fa75019fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56560/0 (socket says 172.21.15.78:56560) 2024-09-18T12:56:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.081+0000 7fa74dd9b640 1 -- 172.21.15.78:0/474603056 learned_addr learned my addr 172.21.15.78:0/474603056 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:56:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.081+0000 7fa74e59c640 1 --2- 172.21.15.78:0/474603056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7500745e0 0x7fa75019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.081+0000 7fa74dd9b640 1 -- 172.21.15.78:0/474603056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7500745e0 msgr2=0x7fa75019f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.081+0000 7fa74dd9b640 1 --2- 172.21.15.78:0/474603056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7500745e0 0x7fa75019f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.081+0000 7fa74dd9b640 1 -- 172.21.15.78:0/474603056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa750199a20 con 0x7fa750074f00 2024-09-18T12:56:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.081+0000 7fa74dd9b640 1 --2- 172.21.15.78:0/474603056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa750074f00 0x7fa75019fda0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa74400d6f0 tx=0x7fa74400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.082+0000 7fa73f7fe640 1 -- 172.21.15.78:0/474603056 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa744017070 con 0x7fa750074f00 2024-09-18T12:56:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.082+0000 7fa73f7fe640 1 -- 172.21.15.78:0/474603056 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa74400de00 con 0x7fa750074f00 2024-09-18T12:56:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.082+0000 7fa754a88640 1 -- 172.21.15.78:0/474603056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa750199d10 con 0x7fa750074f00 2024-09-18T12:56:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.082+0000 7fa73f7fe640 1 -- 172.21.15.78:0/474603056 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa744004bb0 con 0x7fa750074f00 2024-09-18T12:56:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.082+0000 7fa754a88640 1 -- 172.21.15.78:0/474603056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75019a2a0 con 0x7fa750074f00 2024-09-18T12:56:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.083+0000 7fa754a88640 1 -- 172.21.15.78:0/474603056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa750075c90 con 0x7fa750074f00 2024-09-18T12:56:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.083+0000 7fa73f7fe640 1 -- 172.21.15.78:0/474603056 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa744009a30 con 0x7fa750074f00 2024-09-18T12:56:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.084+0000 7fa73f7fe640 1 --2- 172.21.15.78:0/474603056 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa73807af80 0x7fa73807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.084+0000 7fa73f7fe640 1 -- 172.21.15.78:0/474603056 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7fa74409da70 con 0x7fa750074f00 2024-09-18T12:56:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.084+0000 7fa74e59c640 1 --2- 172.21.15.78:0/474603056 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa73807af80 0x7fa73807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:36.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.084+0000 7fa74e59c640 1 --2- 172.21.15.78:0/474603056 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa73807af80 0x7fa73807d440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa740009230 tx=0x7fa740031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:36.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.088+0000 7fa73f7fe640 1 -- 172.21.15.78:0/474603056 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa744069140 con 0x7fa750074f00 2024-09-18T12:56:36.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.279+0000 7fa754a88640 1 -- 172.21.15.78:0/474603056 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa75019af50 con 0x7fa73807af80 2024-09-18T12:56:36.281 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:36 smithi078 ceph-mon[108578]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:36.281 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:36 smithi078 ceph-mon[108578]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:36.281 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:36 smithi078 ceph-mon[108578]: pgmap v208: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:36.281 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:36 smithi078 ceph-mon[108578]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:36.281 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:36 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:36.281 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:36 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:36.281 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:36 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-18T12:56:36.281 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:36 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:36.281 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:36 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3536343744' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:36.281 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:36 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/552773962' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:56:36.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.280+0000 7fa73f7fe640 1 -- 172.21.15.78:0/474603056 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fa75019af50 con 0x7fa73807af80 2024-09-18T12:56:36.282 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:56:36.282 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:56:36.282 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:56:36.282 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:56:36.282 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:56:36.282 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T12:56:36.283 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T12:56:36.283 INFO:teuthology.orchestra.run.smithi078.stdout: "mon" 2024-09-18T12:56:36.283 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:56:36.283 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "10/23 daemons upgraded", 2024-09-18T12:56:36.283 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:56:36.283 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:56:36.283 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:56:36.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.283+0000 7fa754a88640 1 -- 172.21.15.78:0/474603056 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa73807af80 msgr2=0x7fa73807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:36.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.283+0000 7fa754a88640 1 --2- 172.21.15.78:0/474603056 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa73807af80 0x7fa73807d440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa740009230 tx=0x7fa740031400 comp rx=0 tx=0).stop 2024-09-18T12:56:36.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.283+0000 7fa754a88640 1 -- 172.21.15.78:0/474603056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa750074f00 msgr2=0x7fa75019fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:36.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.283+0000 7fa754a88640 1 --2- 172.21.15.78:0/474603056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa750074f00 0x7fa75019fda0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa74400d6f0 tx=0x7fa74400dbb0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.283+0000 7fa754a88640 1 -- 172.21.15.78:0/474603056 shutdown_connections 2024-09-18T12:56:36.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.283+0000 7fa754a88640 1 --2- 172.21.15.78:0/474603056 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa73807af80 0x7fa73807d440 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.283+0000 7fa754a88640 1 --2- 172.21.15.78:0/474603056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa750074f00 0x7fa75019fda0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.283+0000 7fa754a88640 1 --2- 172.21.15.78:0/474603056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7500745e0 0x7fa75019f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.283+0000 7fa754a88640 1 -- 172.21.15.78:0/474603056 >> 172.21.15.78:0/474603056 conn(0x7fa7500fd600 msgr2=0x7fa75010b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:36.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.283+0000 7fa754a88640 1 -- 172.21.15.78:0/474603056 shutdown_connections 2024-09-18T12:56:36.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.283+0000 7fa754a88640 1 -- 172.21.15.78:0/474603056 wait complete. 2024-09-18T12:56:36.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.364+0000 7fe0b030f640 1 -- 172.21.15.78:0/3898728418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8106800 msgr2=0x7fe0a8106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:36.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.364+0000 7fe0b030f640 1 --2- 172.21.15.78:0/3898728418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8106800 0x7fe0a8106be0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe09c009880 tx=0x7fe09c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.364+0000 7fe0b030f640 1 -- 172.21.15.78:0/3898728418 shutdown_connections 2024-09-18T12:56:36.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.364+0000 7fe0b030f640 1 --2- 172.21.15.78:0/3898728418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a8100800 0x7fe0a8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.364+0000 7fe0b030f640 1 --2- 172.21.15.78:0/3898728418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8106800 0x7fe0a8106be0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.364+0000 7fe0b030f640 1 -- 172.21.15.78:0/3898728418 >> 172.21.15.78:0/3898728418 conn(0x7fe0a80fc520 msgr2=0x7fe0a80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.364+0000 7fe0b030f640 1 -- 172.21.15.78:0/3898728418 shutdown_connections 2024-09-18T12:56:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.364+0000 7fe0b030f640 1 -- 172.21.15.78:0/3898728418 wait complete. 2024-09-18T12:56:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.365+0000 7fe0b030f640 1 Processor -- start 2024-09-18T12:56:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.365+0000 7fe0b030f640 1 -- start start 2024-09-18T12:56:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.365+0000 7fe0b030f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100800 0x7fe0a819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.365+0000 7fe0b030f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a8106800 0x7fe0a819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.365+0000 7fe0b030f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a810dcd0 con 0x7fe0a8100800 2024-09-18T12:56:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.365+0000 7fe0b030f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a810db50 con 0x7fe0a8106800 2024-09-18T12:56:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.365+0000 7fe0ae0ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100800 0x7fe0a819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.365+0000 7fe0ae0ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100800 0x7fe0a819c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56590/0 (socket says 172.21.15.78:56590) 2024-09-18T12:56:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.365+0000 7fe0ae0ab640 1 -- 172.21.15.78:0/214195072 learned_addr learned my addr 172.21.15.78:0/214195072 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:56:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.365+0000 7fe0ad8aa640 1 --2- 172.21.15.78:0/214195072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a8106800 0x7fe0a819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.365+0000 7fe0ae0ab640 1 -- 172.21.15.78:0/214195072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a8106800 msgr2=0x7fe0a819cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.365+0000 7fe0ae0ab640 1 --2- 172.21.15.78:0/214195072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a8106800 0x7fe0a819cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.365+0000 7fe0ae0ab640 1 -- 172.21.15.78:0/214195072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a81966d0 con 0x7fe0a8100800 2024-09-18T12:56:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.365+0000 7fe0ae0ab640 1 --2- 172.21.15.78:0/214195072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100800 0x7fe0a819c600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe09c031460 tx=0x7fe09c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.366+0000 7fe09b7fe640 1 -- 172.21.15.78:0/214195072 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe09c03f070 con 0x7fe0a8100800 2024-09-18T12:56:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.366+0000 7fe09b7fe640 1 -- 172.21.15.78:0/214195072 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe09c004cf0 con 0x7fe0a8100800 2024-09-18T12:56:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.366+0000 7fe0b030f640 1 -- 172.21.15.78:0/214195072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a8196960 con 0x7fe0a8100800 2024-09-18T12:56:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.366+0000 7fe09b7fe640 1 -- 172.21.15.78:0/214195072 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe09c035030 con 0x7fe0a8100800 2024-09-18T12:56:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.366+0000 7fe0b030f640 1 -- 172.21.15.78:0/214195072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a8196e60 con 0x7fe0a8100800 2024-09-18T12:56:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.367+0000 7fe0b030f640 1 -- 172.21.15.78:0/214195072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a8101f40 con 0x7fe0a8100800 2024-09-18T12:56:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.367+0000 7fe09b7fe640 1 -- 172.21.15.78:0/214195072 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe09c042070 con 0x7fe0a8100800 2024-09-18T12:56:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.368+0000 7fe09b7fe640 1 --2- 172.21.15.78:0/214195072 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe09407af80 0x7fe09407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.368+0000 7fe09b7fe640 1 -- 172.21.15.78:0/214195072 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7fe09c0be8e0 con 0x7fe0a8100800 2024-09-18T12:56:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.368+0000 7fe0ad8aa640 1 --2- 172.21.15.78:0/214195072 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe09407af80 0x7fe09407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.368+0000 7fe0ad8aa640 1 --2- 172.21.15.78:0/214195072 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe09407af80 0x7fe09407d440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8197f20 tx=0x7fe0a400a250 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:36.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.372+0000 7fe09b7fe640 1 -- 172.21.15.78:0/214195072 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe09c089fb0 con 0x7fe0a8100800 2024-09-18T12:56:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:36 smithi148 ceph-mon[80030]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:36 smithi148 ceph-mon[80030]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:36 smithi148 ceph-mon[80030]: pgmap v208: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:36.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:36 smithi148 ceph-mon[80030]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:36.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:36 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:36.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:36 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:36.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:36 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-18T12:56:36.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:36 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:36.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:36 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3536343744' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:36.475 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:36 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/552773962' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:56:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.618+0000 7fe0b030f640 1 -- 172.21.15.78:0/214195072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe0a8108d70 con 0x7fe0a8100800 2024-09-18T12:56:36.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.618+0000 7fe09b7fe640 1 -- 172.21.15.78:0/214195072 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fe09c08ee60 con 0x7fe0a8100800 2024-09-18T12:56:36.620 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:36.620 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:36.620 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:56:36.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.620+0000 7fe0b030f640 1 -- 172.21.15.78:0/214195072 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe09407af80 msgr2=0x7fe09407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:36.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.620+0000 7fe0b030f640 1 --2- 172.21.15.78:0/214195072 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe09407af80 0x7fe09407d440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8197f20 tx=0x7fe0a400a250 comp rx=0 tx=0).stop 2024-09-18T12:56:36.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.620+0000 7fe0b030f640 1 -- 172.21.15.78:0/214195072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100800 msgr2=0x7fe0a819c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:36.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.620+0000 7fe0b030f640 1 --2- 172.21.15.78:0/214195072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100800 0x7fe0a819c600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe09c031460 tx=0x7fe09c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.620+0000 7fe0b030f640 1 -- 172.21.15.78:0/214195072 shutdown_connections 2024-09-18T12:56:36.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.620+0000 7fe0b030f640 1 --2- 172.21.15.78:0/214195072 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe09407af80 0x7fe09407d440 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.620+0000 7fe0b030f640 1 --2- 172.21.15.78:0/214195072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a8106800 0x7fe0a819cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.620+0000 7fe0b030f640 1 --2- 172.21.15.78:0/214195072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100800 0x7fe0a819c600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.620+0000 7fe0b030f640 1 -- 172.21.15.78:0/214195072 >> 172.21.15.78:0/214195072 conn(0x7fe0a80fc520 msgr2=0x7fe0a80fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:36.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.620+0000 7fe0b030f640 1 -- 172.21.15.78:0/214195072 shutdown_connections 2024-09-18T12:56:36.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:56:36.620+0000 7fe0b030f640 1 -- 172.21.15.78:0/214195072 wait complete. 2024-09-18T12:56:37.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:37 smithi148 ceph-mon[80030]: Upgrade: Updating osd.4 2024-09-18T12:56:37.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:37 smithi148 ceph-mon[80030]: Deploying daemon osd.4 on smithi148 2024-09-18T12:56:37.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:37 smithi148 ceph-mon[80030]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:37.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:37 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/214195072' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:56:37.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:37 smithi078 ceph-mon[108578]: Upgrade: Updating osd.4 2024-09-18T12:56:37.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:37 smithi078 ceph-mon[108578]: Deploying daemon osd.4 on smithi148 2024-09-18T12:56:37.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:37 smithi078 ceph-mon[108578]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:37.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:37 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/214195072' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:56:38.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:38 smithi148 ceph-mon[80030]: pgmap v209: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:38.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:38 smithi078 ceph-mon[108578]: pgmap v209: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:38.745 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:38 smithi148 systemd[1]: Stopping Ceph osd.4 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:56:39.212 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:38 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[48135]: 2024-09-18T12:56:38.742+0000 7fd9a0319640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:56:39.213 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:38 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[48135]: 2024-09-18T12:56:38.742+0000 7fd9a0319640 -1 osd.4 67 *** Got signal Terminated *** 2024-09-18T12:56:39.213 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:38 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[48135]: 2024-09-18T12:56:38.742+0000 7fd9a0319640 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:56:39.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:39 smithi148 ceph-mon[80030]: osd.4 marked itself down and dead 2024-09-18T12:56:39.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:39 smithi078 ceph-mon[108578]: osd.4 marked itself down and dead 2024-09-18T12:56:39.946 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:39 smithi148 podman[92561]: 2024-09-18 12:56:39.663079824 +0000 UTC m=+1.027345861 container died 47ae962328833ca00eb85b09cd1a917505e6e708faf1c376cb5ee3fc4e5517e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-18T12:56:40.211 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:40 smithi148 podman[92561]: 2024-09-18 12:56:40.036160036 +0000 UTC m=+1.400426070 container cleanup 47ae962328833ca00eb85b09cd1a917505e6e708faf1c376cb5ee3fc4e5517e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-18T12:56:40.211 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:40 smithi148 bash[92561]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4 2024-09-18T12:56:40.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:40 smithi148 ceph-mon[80030]: pgmap v210: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:40.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:40 smithi148 ceph-mon[80030]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:56:40.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:40 smithi148 ceph-mon[80030]: osdmap e68: 6 total, 5 up, 6 in 2024-09-18T12:56:40.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:40 smithi148 podman[92575]: 2024-09-18 12:56:40.296112526 +0000 UTC m=+0.629544216 container remove 47ae962328833ca00eb85b09cd1a917505e6e708faf1c376cb5ee3fc4e5517e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True) 2024-09-18T12:56:40.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:40 smithi078 ceph-mon[108578]: pgmap v210: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:56:40.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:40 smithi078 ceph-mon[108578]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:56:40.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:40 smithi078 ceph-mon[108578]: osdmap e68: 6 total, 5 up, 6 in 2024-09-18T12:56:40.973 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:40 smithi148 podman[92665]: 2024-09-18 12:56:40.551417215 +0000 UTC m=+0.015996253 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:56:40.973 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:40 smithi148 podman[92665]: 2024-09-18 12:56:40.680629904 +0000 UTC m=+0.145208971 container create 1568d707550d79f7110763b7aa03c5d5bed6c53ac81184d3825bba0f1eaf7ddd (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:56:40.973 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:40 smithi148 podman[92665]: 2024-09-18 12:56:40.891153181 +0000 UTC m=+0.355732208 container init 1568d707550d79f7110763b7aa03c5d5bed6c53ac81184d3825bba0f1eaf7ddd (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-18T12:56:40.973 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:40 smithi148 podman[92665]: 2024-09-18 12:56:40.89476249 +0000 UTC m=+0.359341519 container start 1568d707550d79f7110763b7aa03c5d5bed6c53ac81184d3825bba0f1eaf7ddd (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-18T12:56:41.428 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:41 smithi148 ceph-mon[80030]: osdmap e69: 6 total, 5 up, 6 in 2024-09-18T12:56:41.428 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:41.428 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:41.428 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:40 smithi148 podman[92665]: 2024-09-18 12:56:40.974284376 +0000 UTC m=+0.438863406 container attach 1568d707550d79f7110763b7aa03c5d5bed6c53ac81184d3825bba0f1eaf7ddd (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-18T12:56:41.428 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:41 smithi148 podman[92665]: 2024-09-18 12:56:41.087099867 +0000 UTC m=+0.551678908 container died 1568d707550d79f7110763b7aa03c5d5bed6c53ac81184d3825bba0f1eaf7ddd (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731) 2024-09-18T12:56:41.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:41 smithi078 ceph-mon[108578]: osdmap e69: 6 total, 5 up, 6 in 2024-09-18T12:56:41.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:41.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:41.973 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:41 smithi148 podman[92688]: 2024-09-18 12:56:41.702822671 +0000 UTC m=+0.609372095 container remove 1568d707550d79f7110763b7aa03c5d5bed6c53ac81184d3825bba0f1eaf7ddd (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:56:41.974 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:41 smithi148 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-18T12:56:41.974 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:41 smithi148 systemd[1]: Stopped Ceph osd.4 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:56:41.974 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:41 smithi148 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.4.service: Consumed 51.438s CPU time. 2024-09-18T12:56:41.974 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:41 smithi148 systemd[1]: Starting Ceph osd.4 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:56:42.328 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:42 smithi148 ceph-mon[80030]: pgmap v213: 65 pgs: 3 active+undersized, 8 peering, 3 stale+active+clean, 2 active+undersized+degraded, 49 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/333 objects degraded (2.102%) 2024-09-18T12:56:42.328 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:42 smithi148 ceph-mon[80030]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-18T12:56:42.328 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:42 smithi148 ceph-mon[80030]: Health check failed: Degraded data redundancy: 7/333 objects degraded (2.102%), 2 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:42.329 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:42 smithi148 podman[92787]: 2024-09-18 12:56:42.058030191 +0000 UTC m=+0.018249537 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:56:42.329 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:42 smithi148 podman[92787]: 2024-09-18 12:56:42.196386272 +0000 UTC m=+0.156605602 container create 485d05d1b0942b4f9ab1d6e282f68d456d67475fae5beb09e822cfd3cbd3e3bc (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-18T12:56:42.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:42 smithi078 ceph-mon[108578]: pgmap v213: 65 pgs: 3 active+undersized, 8 peering, 3 stale+active+clean, 2 active+undersized+degraded, 49 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/333 objects degraded (2.102%) 2024-09-18T12:56:42.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:42 smithi078 ceph-mon[108578]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-18T12:56:42.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:42 smithi078 ceph-mon[108578]: Health check failed: Degraded data redundancy: 7/333 objects degraded (2.102%), 2 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:42.591 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:42 smithi148 podman[92787]: 2024-09-18 12:56:42.440389087 +0000 UTC m=+0.400608425 container init 485d05d1b0942b4f9ab1d6e282f68d456d67475fae5beb09e822cfd3cbd3e3bc (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2) 2024-09-18T12:56:42.591 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:42 smithi148 podman[92787]: 2024-09-18 12:56:42.444233844 +0000 UTC m=+0.404453182 container start 485d05d1b0942b4f9ab1d6e282f68d456d67475fae5beb09e822cfd3cbd3e3bc (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-18T12:56:42.591 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:42 smithi148 podman[92787]: 2024-09-18 12:56:42.515507815 +0000 UTC m=+0.475727149 container attach 485d05d1b0942b4f9ab1d6e282f68d456d67475fae5beb09e822cfd3cbd3e3bc (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-activate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:56:42.591 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:42 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-activate[92803]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:42.592 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:42 smithi148 bash[92787]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:42.592 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:42 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-activate[92803]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:42.592 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:42 smithi148 bash[92787]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:56:44.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:44 smithi078 ceph-mon[108578]: pgmap v214: 65 pgs: 15 active+undersized, 8 peering, 11 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 42/333 objects degraded (12.613%) 2024-09-18T12:56:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:44 smithi148 ceph-mon[80030]: pgmap v214: 65 pgs: 15 active+undersized, 8 peering, 11 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 42/333 objects degraded (12.613%) 2024-09-18T12:56:45.198 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:44 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-activate[92803]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T12:56:45.198 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:44 smithi148 bash[92787]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T12:56:45.198 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:44 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-activate[92803]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T12:56:45.198 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:44 smithi148 bash[92787]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T12:56:45.198 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:45 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-activate[92803]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T12:56:45.198 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:45 smithi148 bash[92787]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T12:56:45.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:45 smithi148 ceph-mon[80030]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-18T12:56:45.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:45 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-activate[92803]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T12:56:45.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:45 smithi148 bash[92787]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T12:56:45.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:45 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-activate[92803]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-18T12:56:45.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:45 smithi148 bash[92787]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-18T12:56:45.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:45 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-activate[92803]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T12:56:45.474 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:45 smithi148 bash[92787]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T12:56:45.474 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:45 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-activate[92803]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-18T12:56:45.474 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:45 smithi148 bash[92787]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-18T12:56:45.474 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:45 smithi148 podman[92787]: 2024-09-18 12:56:45.231359045 +0000 UTC m=+3.191578376 container died 485d05d1b0942b4f9ab1d6e282f68d456d67475fae5beb09e822cfd3cbd3e3bc (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-activate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:56:45.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:45 smithi078 ceph-mon[108578]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-18T12:56:46.223 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:46 smithi148 podman[92961]: 2024-09-18 12:56:46.019152059 +0000 UTC m=+0.781248130 container remove 485d05d1b0942b4f9ab1d6e282f68d456d67475fae5beb09e822cfd3cbd3e3bc (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:56:46.532 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:46 smithi148 ceph-mon[80030]: pgmap v215: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/333 objects degraded (16.216%) 2024-09-18T12:56:46.532 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:46 smithi148 podman[93016]: 2024-09-18 12:56:46.136587655 +0000 UTC m=+0.016478693 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:56:46.532 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:46 smithi148 podman[93016]: 2024-09-18 12:56:46.278995753 +0000 UTC m=+0.158886785 container create da0a51763e0cbba96601942491e3199f70c37df9c1782c10b29ab80b41108fc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:56:46.532 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:46 smithi148 podman[93016]: 2024-09-18 12:56:46.531829811 +0000 UTC m=+0.411720840 container init da0a51763e0cbba96601942491e3199f70c37df9c1782c10b29ab80b41108fc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-18T12:56:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:46 smithi078 ceph-mon[108578]: pgmap v215: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/333 objects degraded (16.216%) 2024-09-18T12:56:46.973 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:46 smithi148 podman[93016]: 2024-09-18 12:56:46.535133212 +0000 UTC m=+0.415024242 container start da0a51763e0cbba96601942491e3199f70c37df9c1782c10b29ab80b41108fc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-18T12:56:46.973 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:46 smithi148 ceph-osd[93035]: -- 172.21.15.148:0/3915202976 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55843067e1e0 con 0x55842f81dc00 2024-09-18T12:56:46.973 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:46 smithi148 bash[93016]: da0a51763e0cbba96601942491e3199f70c37df9c1782c10b29ab80b41108fc0 2024-09-18T12:56:46.973 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:46 smithi148 systemd[1]: Started Ceph osd.4 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:56:47.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:47 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:47.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:47 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:47.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:47 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:47.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:47 smithi148 ceph-mon[80030]: Health check update: Degraded data redundancy: 54/333 objects degraded (16.216%), 15 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:47.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:47 smithi148 ceph-mon[80030]: pgmap v216: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/333 objects degraded (16.216%) 2024-09-18T12:56:47.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:47 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:47.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:47 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:47.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:47 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:47.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:47 smithi078 ceph-mon[108578]: Health check update: Degraded data redundancy: 54/333 objects degraded (16.216%), 15 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:47.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:47 smithi078 ceph-mon[108578]: pgmap v216: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/333 objects degraded (16.216%) 2024-09-18T12:56:48.723 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:48 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T12:56:48.426+0000 7f386268c640 -1 Falling back to public interface 2024-09-18T12:56:50.596 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:50 smithi148 ceph-mon[80030]: pgmap v217: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/333 objects degraded (16.216%) 2024-09-18T12:56:50.596 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:50 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:50.596 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:50 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:50.596 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:50 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:50.596 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:50 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:50 smithi078 ceph-mon[108578]: pgmap v217: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/333 objects degraded (16.216%) 2024-09-18T12:56:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:50 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:50 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:50 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:50 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:52 smithi148 ceph-mon[80030]: pgmap v218: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/333 objects degraded (16.216%) 2024-09-18T12:56:52.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:52 smithi078 ceph-mon[108578]: pgmap v218: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/333 objects degraded (16.216%) 2024-09-18T12:56:54.223 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:53 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T12:56:53.796+0000 7f386268c640 -1 osd.4 67 log_to_monitors true 2024-09-18T12:56:54.223 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T12:56:54.035+0000 7f385a436640 -1 osd.4 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:56:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:54.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:56:54.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:54.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:54.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:54.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:54.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:54.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-18T12:56:54.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-mon[80030]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T12:56:54.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-mon[80030]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-18T12:56:54.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-mon[80030]: pgmap v219: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/333 objects degraded (16.216%) 2024-09-18T12:56:54.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-mon[80030]: from='osd.4 [v2:172.21.15.148:6808/3876966286,v1:172.21.15.148:6809/3876966286]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-18T12:56:54.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:54 smithi148 ceph-mon[80030]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-18T12:56:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:54 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:54 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:54 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:54 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:56:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:54 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:54 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:54 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:54 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:54.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:54 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:54.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:54 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-18T12:56:54.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:54 smithi078 ceph-mon[108578]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T12:56:54.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:54 smithi078 ceph-mon[108578]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-18T12:56:54.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:54 smithi078 ceph-mon[108578]: pgmap v219: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/333 objects degraded (16.216%) 2024-09-18T12:56:54.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:54 smithi078 ceph-mon[108578]: from='osd.4 [v2:172.21.15.148:6808/3876966286,v1:172.21.15.148:6809/3876966286]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-18T12:56:54.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:54 smithi078 ceph-mon[108578]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-18T12:56:55.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:55 smithi148 ceph-mon[80030]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T12:56:55.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:55 smithi148 ceph-mon[80030]: osdmap e70: 6 total, 5 up, 6 in 2024-09-18T12:56:55.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:55 smithi148 ceph-mon[80030]: from='osd.4 [v2:172.21.15.148:6808/3876966286,v1:172.21.15.148:6809/3876966286]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-18T12:56:55.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:55 smithi148 ceph-mon[80030]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-18T12:56:55.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:55 smithi078 ceph-mon[108578]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T12:56:55.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:55 smithi078 ceph-mon[108578]: osdmap e70: 6 total, 5 up, 6 in 2024-09-18T12:56:55.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:55 smithi078 ceph-mon[108578]: from='osd.4 [v2:172.21.15.148:6808/3876966286,v1:172.21.15.148:6809/3876966286]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-18T12:56:55.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:55 smithi078 ceph-mon[108578]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-18T12:56:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:56 smithi148 ceph-mon[80030]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:56:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:56 smithi148 ceph-mon[80030]: osd.4 [v2:172.21.15.148:6808/3876966286,v1:172.21.15.148:6809/3876966286] boot 2024-09-18T12:56:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:56 smithi148 ceph-mon[80030]: osdmap e71: 6 total, 6 up, 6 in 2024-09-18T12:56:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-18T12:56:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:56 smithi148 ceph-mon[80030]: pgmap v222: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/333 objects degraded (16.216%) 2024-09-18T12:56:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:56 smithi078 ceph-mon[108578]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:56:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:56 smithi078 ceph-mon[108578]: osd.4 [v2:172.21.15.148:6808/3876966286,v1:172.21.15.148:6809/3876966286] boot 2024-09-18T12:56:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:56 smithi078 ceph-mon[108578]: osdmap e71: 6 total, 6 up, 6 in 2024-09-18T12:56:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-18T12:56:56.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:56 smithi078 ceph-mon[108578]: pgmap v222: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/333 objects degraded (16.216%) 2024-09-18T12:56:56.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:56:56.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:57.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:57 smithi148 ceph-mon[80030]: osdmap e72: 6 total, 6 up, 6 in 2024-09-18T12:56:57.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:57 smithi078 ceph-mon[108578]: osdmap e72: 6 total, 6 up, 6 in 2024-09-18T12:56:58.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:58 smithi148 ceph-mon[80030]: pgmap v224: 65 pgs: 8 active+undersized, 5 active+undersized+degraded, 52 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14/333 objects degraded (4.204%) 2024-09-18T12:56:58.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:58 smithi078 ceph-mon[108578]: pgmap v224: 65 pgs: 8 active+undersized, 5 active+undersized+degraded, 52 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14/333 objects degraded (4.204%) 2024-09-18T12:56:59.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:56:59 smithi148 ceph-mon[80030]: Health check update: Degraded data redundancy: 14/333 objects degraded (4.204%), 5 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:59.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:56:59 smithi078 ceph-mon[108578]: Health check update: Degraded data redundancy: 14/333 objects degraded (4.204%), 5 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:00.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:00 smithi148 ceph-mon[80030]: pgmap v225: 65 pgs: 3 active+undersized, 3 active+undersized+degraded, 59 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 9/333 objects degraded (2.703%) 2024-09-18T12:57:00.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:00 smithi078 ceph-mon[108578]: pgmap v225: 65 pgs: 3 active+undersized, 3 active+undersized+degraded, 59 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 9/333 objects degraded (2.703%) 2024-09-18T12:57:01.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:01 smithi148 ceph-mon[80030]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/333 objects degraded (2.703%), 3 pgs degraded) 2024-09-18T12:57:01.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:01 smithi078 ceph-mon[108578]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/333 objects degraded (2.703%), 3 pgs degraded) 2024-09-18T12:57:02.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:02 smithi148 ceph-mon[80030]: pgmap v226: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:02 smithi078 ceph-mon[108578]: pgmap v226: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:04 smithi078 ceph-mon[108578]: pgmap v227: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:04 smithi148 ceph-mon[80030]: pgmap v227: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:06.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:06 smithi078 ceph-mon[108578]: pgmap v228: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:06.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.719+0000 7f3ed9779640 1 -- 172.21.15.78:0/3816006924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed41007f0 msgr2=0x7f3ed4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:06.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.719+0000 7f3ed9779640 1 --2- 172.21.15.78:0/3816006924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed41007f0 0x7f3ed4100c50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009880 tx=0x7f3ec802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:57:06.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.719+0000 7f3ed9779640 1 -- 172.21.15.78:0/3816006924 shutdown_connections 2024-09-18T12:57:06.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.719+0000 7f3ed9779640 1 --2- 172.21.15.78:0/3816006924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed41007f0 0x7f3ed4100c50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:06.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.719+0000 7f3ed9779640 1 --2- 172.21.15.78:0/3816006924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ed41067f0 0x7f3ed4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:06.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.719+0000 7f3ed9779640 1 -- 172.21.15.78:0/3816006924 >> 172.21.15.78:0/3816006924 conn(0x7f3ed40fc550 msgr2=0x7f3ed40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:06.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.719+0000 7f3ed9779640 1 -- 172.21.15.78:0/3816006924 shutdown_connections 2024-09-18T12:57:06.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.719+0000 7f3ed9779640 1 -- 172.21.15.78:0/3816006924 wait complete. 2024-09-18T12:57:06.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.720+0000 7f3ed9779640 1 Processor -- start 2024-09-18T12:57:06.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.720+0000 7f3ed9779640 1 -- start start 2024-09-18T12:57:06.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.720+0000 7f3ed9779640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed41007f0 0x7f3ed419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:06.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.720+0000 7f3ed9779640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ed41067f0 0x7f3ed419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:06.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.720+0000 7f3ed9779640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed410dcc0 con 0x7f3ed41007f0 2024-09-18T12:57:06.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.720+0000 7f3ed9779640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed410db40 con 0x7f3ed41067f0 2024-09-18T12:57:06.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.720+0000 7f3ed2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed41007f0 0x7f3ed419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:06.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.721+0000 7f3ed2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed41007f0 0x7f3ed419f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56364/0 (socket says 172.21.15.78:56364) 2024-09-18T12:57:06.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.721+0000 7f3ed2ffd640 1 -- 172.21.15.78:0/4286031907 learned_addr learned my addr 172.21.15.78:0/4286031907 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:57:06.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.721+0000 7f3ed27fc640 1 --2- 172.21.15.78:0/4286031907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ed41067f0 0x7f3ed419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:06.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.721+0000 7f3ed2ffd640 1 -- 172.21.15.78:0/4286031907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ed41067f0 msgr2=0x7f3ed419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:06.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.721+0000 7f3ed2ffd640 1 --2- 172.21.15.78:0/4286031907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ed41067f0 0x7f3ed419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:06.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.721+0000 7f3ed2ffd640 1 -- 172.21.15.78:0/4286031907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed41999b0 con 0x7f3ed41007f0 2024-09-18T12:57:06.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.721+0000 7f3ed2ffd640 1 --2- 172.21.15.78:0/4286031907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed41007f0 0x7f3ed419f7f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400eb10 tx=0x7f3ec400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:06.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.721+0000 7f3ebbfff640 1 -- 172.21.15.78:0/4286031907 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ec400cce0 con 0x7f3ed41007f0 2024-09-18T12:57:06.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.721+0000 7f3ebbfff640 1 -- 172.21.15.78:0/4286031907 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ec4005020 con 0x7f3ed41007f0 2024-09-18T12:57:06.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.721+0000 7f3ed9779640 1 -- 172.21.15.78:0/4286031907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed4199ca0 con 0x7f3ed41007f0 2024-09-18T12:57:06.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.721+0000 7f3ebbfff640 1 -- 172.21.15.78:0/4286031907 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ec4010660 con 0x7f3ed41007f0 2024-09-18T12:57:06.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.721+0000 7f3ed9779640 1 -- 172.21.15.78:0/4286031907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed419a200 con 0x7f3ed41007f0 2024-09-18T12:57:06.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:06 smithi148 ceph-mon[80030]: pgmap v228: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:06.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.722+0000 7f3ed9779640 1 -- 172.21.15.78:0/4286031907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed4101f30 con 0x7f3ed41007f0 2024-09-18T12:57:06.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.723+0000 7f3ebbfff640 1 -- 172.21.15.78:0/4286031907 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3ec40051d0 con 0x7f3ed41007f0 2024-09-18T12:57:06.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.724+0000 7f3ebbfff640 1 --2- 172.21.15.78:0/4286031907 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ebc07af30 0x7f3ebc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:06.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.724+0000 7f3ebbfff640 1 -- 172.21.15.78:0/4286031907 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6070+0+0 (secure 0 0 0) 0x7f3ec409e880 con 0x7f3ed41007f0 2024-09-18T12:57:06.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.724+0000 7f3ed27fc640 1 --2- 172.21.15.78:0/4286031907 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ebc07af30 0x7f3ebc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:06.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.724+0000 7f3ed27fc640 1 --2- 172.21.15.78:0/4286031907 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ebc07af30 0x7f3ebc07d3f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ed419b1a0 tx=0x7f3ec8031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:06.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.728+0000 7f3ebbfff640 1 -- 172.21.15.78:0/4286031907 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3ec4069e30 con 0x7f3ed41007f0 2024-09-18T12:57:06.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.921+0000 7f3ed9779640 1 -- 172.21.15.78:0/4286031907 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3ed419a510 con 0x7f3ebc07af30 2024-09-18T12:57:06.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.922+0000 7f3ebbfff640 1 -- 172.21.15.78:0/4286031907 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f3ed419a510 con 0x7f3ebc07af30 2024-09-18T12:57:06.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.925+0000 7f3ed9779640 1 -- 172.21.15.78:0/4286031907 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ebc07af30 msgr2=0x7f3ebc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:06.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.925+0000 7f3ed9779640 1 --2- 172.21.15.78:0/4286031907 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ebc07af30 0x7f3ebc07d3f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ed419b1a0 tx=0x7f3ec8031400 comp rx=0 tx=0).stop 2024-09-18T12:57:06.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.925+0000 7f3ed9779640 1 -- 172.21.15.78:0/4286031907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed41007f0 msgr2=0x7f3ed419f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.925+0000 7f3ed9779640 1 --2- 172.21.15.78:0/4286031907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed41007f0 0x7f3ed419f7f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400eb10 tx=0x7f3ec400c2d0 comp rx=0 tx=0).stop 2024-09-18T12:57:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.925+0000 7f3ed9779640 1 -- 172.21.15.78:0/4286031907 shutdown_connections 2024-09-18T12:57:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.925+0000 7f3ed9779640 1 --2- 172.21.15.78:0/4286031907 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ebc07af30 0x7f3ebc07d3f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.925+0000 7f3ed9779640 1 --2- 172.21.15.78:0/4286031907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ed41067f0 0x7f3ed419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.925+0000 7f3ed9779640 1 --2- 172.21.15.78:0/4286031907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ed41007f0 0x7f3ed419f7f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.925+0000 7f3ed9779640 1 -- 172.21.15.78:0/4286031907 >> 172.21.15.78:0/4286031907 conn(0x7f3ed40fc550 msgr2=0x7f3ed4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.925+0000 7f3ed9779640 1 -- 172.21.15.78:0/4286031907 shutdown_connections 2024-09-18T12:57:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:06.925+0000 7f3ed9779640 1 -- 172.21.15.78:0/4286031907 wait complete. 2024-09-18T12:57:06.935 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:57:07.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.008+0000 7f1c448d2640 1 -- 172.21.15.78:0/152180985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40107900 msgr2=0x7f1c40107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:07.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.008+0000 7f1c448d2640 1 --2- 172.21.15.78:0/152180985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40107900 0x7f1c40107ce0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1c38009880 tx=0x7f1c3802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.008+0000 7f1c448d2640 1 -- 172.21.15.78:0/152180985 shutdown_connections 2024-09-18T12:57:07.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.008+0000 7f1c448d2640 1 --2- 172.21.15.78:0/152180985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c40101900 0x7f1c40101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.008+0000 7f1c448d2640 1 --2- 172.21.15.78:0/152180985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40107900 0x7f1c40107ce0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.008+0000 7f1c448d2640 1 -- 172.21.15.78:0/152180985 >> 172.21.15.78:0/152180985 conn(0x7f1c400fd600 msgr2=0x7f1c400ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:07.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.008+0000 7f1c448d2640 1 -- 172.21.15.78:0/152180985 shutdown_connections 2024-09-18T12:57:07.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.008+0000 7f1c448d2640 1 -- 172.21.15.78:0/152180985 wait complete. 2024-09-18T12:57:07.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.008+0000 7f1c448d2640 1 Processor -- start 2024-09-18T12:57:07.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.009+0000 7f1c448d2640 1 -- start start 2024-09-18T12:57:07.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.009+0000 7f1c448d2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c40101900 0x7f1c400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:07.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.009+0000 7f1c448d2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40107900 0x7f1c40074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:07.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.009+0000 7f1c448d2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4010edd0 con 0x7f1c40107900 2024-09-18T12:57:07.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.009+0000 7f1c448d2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4010ec50 con 0x7f1c40101900 2024-09-18T12:57:07.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.009+0000 7f1c3dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40107900 0x7f1c40074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:07.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.009+0000 7f1c3dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40107900 0x7f1c40074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56376/0 (socket says 172.21.15.78:56376) 2024-09-18T12:57:07.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.009+0000 7f1c3dd9b640 1 -- 172.21.15.78:0/3584688343 learned_addr learned my addr 172.21.15.78:0/3584688343 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:57:07.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.009+0000 7f1c3e59c640 1 --2- 172.21.15.78:0/3584688343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c40101900 0x7f1c400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:07.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.009+0000 7f1c3dd9b640 1 -- 172.21.15.78:0/3584688343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c40101900 msgr2=0x7f1c400744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:07.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.009+0000 7f1c3dd9b640 1 --2- 172.21.15.78:0/3584688343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c40101900 0x7f1c400744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.009+0000 7f1c3dd9b640 1 -- 172.21.15.78:0/3584688343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c40074f70 con 0x7f1c40107900 2024-09-18T12:57:07.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.009+0000 7f1c3dd9b640 1 --2- 172.21.15.78:0/3584688343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40107900 0x7f1c40074a30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800ea00 tx=0x7f1c2800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:07.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.009+0000 7f1c377fe640 1 -- 172.21.15.78:0/3584688343 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c2800cb80 con 0x7f1c40107900 2024-09-18T12:57:07.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.009+0000 7f1c377fe640 1 -- 172.21.15.78:0/3584688343 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c2800cd20 con 0x7f1c40107900 2024-09-18T12:57:07.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.010+0000 7f1c377fe640 1 -- 172.21.15.78:0/3584688343 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c28011470 con 0x7f1c40107900 2024-09-18T12:57:07.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.010+0000 7f1c448d2640 1 -- 172.21.15.78:0/3584688343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c40075260 con 0x7f1c40107900 2024-09-18T12:57:07.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.010+0000 7f1c448d2640 1 -- 172.21.15.78:0/3584688343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c401a3e40 con 0x7f1c40107900 2024-09-18T12:57:07.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.011+0000 7f1c448d2640 1 -- 172.21.15.78:0/3584688343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c40103040 con 0x7f1c40107900 2024-09-18T12:57:07.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.011+0000 7f1c377fe640 1 -- 172.21.15.78:0/3584688343 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1c280116e0 con 0x7f1c40107900 2024-09-18T12:57:07.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.012+0000 7f1c377fe640 1 --2- 172.21.15.78:0/3584688343 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1c2c07af90 0x7f1c2c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:07.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.012+0000 7f1c3e59c640 1 --2- 172.21.15.78:0/3584688343 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1c2c07af90 0x7f1c2c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:07.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.012+0000 7f1c377fe640 1 -- 172.21.15.78:0/3584688343 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6070+0+0 (secure 0 0 0) 0x7f1c2809e380 con 0x7f1c40107900 2024-09-18T12:57:07.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.013+0000 7f1c3e59c640 1 --2- 172.21.15.78:0/3584688343 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1c2c07af90 0x7f1c2c07d450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1c38031460 tx=0x7f1c380095c0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:07.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.016+0000 7f1c377fe640 1 -- 172.21.15.78:0/3584688343 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1c28016030 con 0x7f1c40107900 2024-09-18T12:57:07.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.208+0000 7f1c448d2640 1 -- 172.21.15.78:0/3584688343 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1c40062630 con 0x7f1c2c07af90 2024-09-18T12:57:07.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.210+0000 7f1c377fe640 1 -- 172.21.15.78:0/3584688343 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f1c40062630 con 0x7f1c2c07af90 2024-09-18T12:57:07.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.212+0000 7f1c448d2640 1 -- 172.21.15.78:0/3584688343 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1c2c07af90 msgr2=0x7f1c2c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:07.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.212+0000 7f1c448d2640 1 --2- 172.21.15.78:0/3584688343 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1c2c07af90 0x7f1c2c07d450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1c38031460 tx=0x7f1c380095c0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.212+0000 7f1c448d2640 1 -- 172.21.15.78:0/3584688343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40107900 msgr2=0x7f1c40074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.212+0000 7f1c448d2640 1 --2- 172.21.15.78:0/3584688343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40107900 0x7f1c40074a30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800ea00 tx=0x7f1c2800eec0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.212+0000 7f1c448d2640 1 -- 172.21.15.78:0/3584688343 shutdown_connections 2024-09-18T12:57:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.212+0000 7f1c448d2640 1 --2- 172.21.15.78:0/3584688343 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1c2c07af90 0x7f1c2c07d450 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.212+0000 7f1c448d2640 1 --2- 172.21.15.78:0/3584688343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40107900 0x7f1c40074a30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.212+0000 7f1c448d2640 1 --2- 172.21.15.78:0/3584688343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c40101900 0x7f1c400744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.212+0000 7f1c448d2640 1 -- 172.21.15.78:0/3584688343 >> 172.21.15.78:0/3584688343 conn(0x7f1c400fd600 msgr2=0x7f1c400fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.212+0000 7f1c448d2640 1 -- 172.21.15.78:0/3584688343 shutdown_connections 2024-09-18T12:57:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.212+0000 7f1c448d2640 1 -- 172.21.15.78:0/3584688343 wait complete. 2024-09-18T12:57:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.294+0000 7fd8686db640 1 -- 172.21.15.78:0/2615720034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd860100800 msgr2=0x7fd860100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.294+0000 7fd8686db640 1 --2- 172.21.15.78:0/2615720034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd860100800 0x7fd860100c60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009880 tx=0x7fd85c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.294+0000 7fd8686db640 1 -- 172.21.15.78:0/2615720034 shutdown_connections 2024-09-18T12:57:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.294+0000 7fd8686db640 1 --2- 172.21.15.78:0/2615720034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd860100800 0x7fd860100c60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.294+0000 7fd8686db640 1 --2- 172.21.15.78:0/2615720034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd860106800 0x7fd860106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.294+0000 7fd8686db640 1 -- 172.21.15.78:0/2615720034 >> 172.21.15.78:0/2615720034 conn(0x7fd8600fc520 msgr2=0x7fd8600fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.294+0000 7fd8686db640 1 -- 172.21.15.78:0/2615720034 shutdown_connections 2024-09-18T12:57:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.294+0000 7fd8686db640 1 -- 172.21.15.78:0/2615720034 wait complete. 2024-09-18T12:57:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.295+0000 7fd8686db640 1 Processor -- start 2024-09-18T12:57:07.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.295+0000 7fd8686db640 1 -- start start 2024-09-18T12:57:07.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.295+0000 7fd8686db640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd860100800 0x7fd86019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:07.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.295+0000 7fd8686db640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd860106800 0x7fd86019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:07.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.295+0000 7fd8686db640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd86010dd30 con 0x7fd860106800 2024-09-18T12:57:07.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.295+0000 7fd8686db640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd86010dbb0 con 0x7fd860100800 2024-09-18T12:57:07.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.295+0000 7fd865c76640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd860106800 0x7fd86019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:07.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.295+0000 7fd865c76640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd860106800 0x7fd86019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56382/0 (socket says 172.21.15.78:56382) 2024-09-18T12:57:07.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.295+0000 7fd865c76640 1 -- 172.21.15.78:0/1612577099 learned_addr learned my addr 172.21.15.78:0/1612577099 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:57:07.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.295+0000 7fd866477640 1 --2- 172.21.15.78:0/1612577099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd860100800 0x7fd86019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:07.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.295+0000 7fd865c76640 1 -- 172.21.15.78:0/1612577099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd860100800 msgr2=0x7fd86019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:07.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.295+0000 7fd865c76640 1 --2- 172.21.15.78:0/1612577099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd860100800 0x7fd86019d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.295+0000 7fd865c76640 1 -- 172.21.15.78:0/1612577099 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd860197870 con 0x7fd860106800 2024-09-18T12:57:07.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.295+0000 7fd866477640 1 --2- 172.21.15.78:0/1612577099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd860100800 0x7fd86019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:57:07.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.296+0000 7fd865c76640 1 --2- 172.21.15.78:0/1612577099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd860106800 0x7fd86019dbf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd85c031460 tx=0x7fd85c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:07.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.296+0000 7fd8537fe640 1 -- 172.21.15.78:0/1612577099 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd85c03f070 con 0x7fd860106800 2024-09-18T12:57:07.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.296+0000 7fd8686db640 1 -- 172.21.15.78:0/1612577099 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd860197b00 con 0x7fd860106800 2024-09-18T12:57:07.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.296+0000 7fd8537fe640 1 -- 172.21.15.78:0/1612577099 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd85c004cf0 con 0x7fd860106800 2024-09-18T12:57:07.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.296+0000 7fd8537fe640 1 -- 172.21.15.78:0/1612577099 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd85c035030 con 0x7fd860106800 2024-09-18T12:57:07.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.296+0000 7fd8686db640 1 -- 172.21.15.78:0/1612577099 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd860198030 con 0x7fd860106800 2024-09-18T12:57:07.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.297+0000 7fd8686db640 1 -- 172.21.15.78:0/1612577099 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd860101f40 con 0x7fd860106800 2024-09-18T12:57:07.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.298+0000 7fd8537fe640 1 -- 172.21.15.78:0/1612577099 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd85c042070 con 0x7fd860106800 2024-09-18T12:57:07.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.298+0000 7fd8537fe640 1 --2- 172.21.15.78:0/1612577099 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd84c07af80 0x7fd84c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:07.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.298+0000 7fd8537fe640 1 -- 172.21.15.78:0/1612577099 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6070+0+0 (secure 0 0 0) 0x7fd85c0be990 con 0x7fd860106800 2024-09-18T12:57:07.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.298+0000 7fd866477640 1 --2- 172.21.15.78:0/1612577099 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd84c07af80 0x7fd84c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:07.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.299+0000 7fd866477640 1 --2- 172.21.15.78:0/1612577099 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd84c07af80 0x7fd84c07d440 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd8601989b0 tx=0x7fd854008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:07.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.303+0000 7fd8537fe640 1 -- 172.21.15.78:0/1612577099 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd85c08a060 con 0x7fd860106800 2024-09-18T12:57:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.484+0000 7fd8686db640 1 -- 172.21.15.78:0/1612577099 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd860198da0 con 0x7fd84c07af80 2024-09-18T12:57:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.494+0000 7fd8537fe640 1 -- 172.21.15.78:0/1612577099 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fd860198da0 con 0x7fd84c07af80 2024-09-18T12:57:07.495 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:57:07.495 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (4m) 86s ago 15m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T12:57:07.495 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (7m) 86s ago 16m 8908k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:57:07.496 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (7m) 18s ago 15m 8539k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:57:07.496 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (3m) 86s ago 16m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T12:57:07.496 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (3m) 18s ago 15m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T12:57:07.496 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (4m) 86s ago 15m 75.8M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T12:57:07.496 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (10m) 86s ago 10m 150M - 19.1.1-330-gc2ddf972 ebb0615149de e7b927a987e3 2024-09-18T12:57:07.496 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (10m) 86s ago 10m 28.0M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:57:07.496 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (10m) 18s ago 10m 17.4M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:57:07.496 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (10m) 18s ago 10m 18.2M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:57:07.496 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (7m) 86s ago 17m 524M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:57:07.496 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (6m) 18s ago 15m 455M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:57:07.496 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (3m) 86s ago 17m 42.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T12:57:07.497 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (3m) 18s ago 15m 38.8M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T12:57:07.497 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (5m) 86s ago 16m 11.7M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:57:07.497 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (5m) 18s ago 15m 11.0M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:57:07.497 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (2m) 86s ago 13m 84.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T12:57:07.497 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (2m) 86s ago 13m 86.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T12:57:07.497 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (92s) 86s ago 12m 11.4M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T12:57:07.497 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (55s) 18s ago 12m 90.0M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T12:57:07.498 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (21s) 18s ago 12m 12.0M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T12:57:07.498 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (11m) 18s ago 11m 194M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 72e3a0acad4d 2024-09-18T12:57:07.498 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (5m) 86s ago 15m 56.3M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:57:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.496+0000 7fd8686db640 1 -- 172.21.15.78:0/1612577099 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd84c07af80 msgr2=0x7fd84c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.496+0000 7fd8686db640 1 --2- 172.21.15.78:0/1612577099 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd84c07af80 0x7fd84c07d440 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd8601989b0 tx=0x7fd854008040 comp rx=0 tx=0).stop 2024-09-18T12:57:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.496+0000 7fd8686db640 1 -- 172.21.15.78:0/1612577099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd860106800 msgr2=0x7fd86019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.496+0000 7fd8686db640 1 --2- 172.21.15.78:0/1612577099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd860106800 0x7fd86019dbf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd85c031460 tx=0x7fd85c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.496+0000 7fd8686db640 1 -- 172.21.15.78:0/1612577099 shutdown_connections 2024-09-18T12:57:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.496+0000 7fd8686db640 1 --2- 172.21.15.78:0/1612577099 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd84c07af80 0x7fd84c07d440 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.496+0000 7fd8686db640 1 --2- 172.21.15.78:0/1612577099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd860106800 0x7fd86019dbf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.496+0000 7fd8686db640 1 --2- 172.21.15.78:0/1612577099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd860100800 0x7fd86019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.496+0000 7fd8686db640 1 -- 172.21.15.78:0/1612577099 >> 172.21.15.78:0/1612577099 conn(0x7fd8600fc520 msgr2=0x7fd86006a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.496+0000 7fd8686db640 1 -- 172.21.15.78:0/1612577099 shutdown_connections 2024-09-18T12:57:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.496+0000 7fd8686db640 1 -- 172.21.15.78:0/1612577099 wait complete. 2024-09-18T12:57:07.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.576+0000 7f489ac81640 1 -- 172.21.15.78:0/4155163789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894106800 msgr2=0x7f4894106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:07.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.576+0000 7f489ac81640 1 --2- 172.21.15.78:0/4155163789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894106800 0x7f4894106be0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4888009880 tx=0x7f488802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.576+0000 7f489ac81640 1 -- 172.21.15.78:0/4155163789 shutdown_connections 2024-09-18T12:57:07.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.576+0000 7f489ac81640 1 --2- 172.21.15.78:0/4155163789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4894100800 0x7f4894100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.576+0000 7f489ac81640 1 --2- 172.21.15.78:0/4155163789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894106800 0x7f4894106be0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.576+0000 7f489ac81640 1 -- 172.21.15.78:0/4155163789 >> 172.21.15.78:0/4155163789 conn(0x7f48940fc520 msgr2=0x7f48940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:07.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.577+0000 7f489ac81640 1 -- 172.21.15.78:0/4155163789 shutdown_connections 2024-09-18T12:57:07.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.577+0000 7f489ac81640 1 -- 172.21.15.78:0/4155163789 wait complete. 2024-09-18T12:57:07.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.577+0000 7f489ac81640 1 Processor -- start 2024-09-18T12:57:07.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.577+0000 7f489ac81640 1 -- start start 2024-09-18T12:57:07.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.578+0000 7f489ac81640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4894100800 0x7f489419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:07.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.578+0000 7f489ac81640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894106800 0x7f489419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:07.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.578+0000 7f489ac81640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f489410dcd0 con 0x7f4894106800 2024-09-18T12:57:07.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.578+0000 7f489ac81640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f489410db50 con 0x7f4894100800 2024-09-18T12:57:07.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.578+0000 7f4893fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894106800 0x7f489419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:07.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.578+0000 7f4893fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894106800 0x7f489419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56392/0 (socket says 172.21.15.78:56392) 2024-09-18T12:57:07.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.578+0000 7f4893fff640 1 -- 172.21.15.78:0/3714164599 learned_addr learned my addr 172.21.15.78:0/3714164599 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:57:07.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.578+0000 7f4898a1d640 1 --2- 172.21.15.78:0/3714164599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4894100800 0x7f489419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:07.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.578+0000 7f4893fff640 1 -- 172.21.15.78:0/3714164599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4894100800 msgr2=0x7f489419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:07.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.578+0000 7f4893fff640 1 --2- 172.21.15.78:0/3714164599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4894100800 0x7f489419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.578+0000 7f4893fff640 1 -- 172.21.15.78:0/3714164599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48941977c0 con 0x7f4894106800 2024-09-18T12:57:07.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.578+0000 7f4893fff640 1 --2- 172.21.15.78:0/3714164599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894106800 0x7f489419db80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f488000d6f0 tx=0x7f488000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:07.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.578+0000 7f4891ffb640 1 -- 172.21.15.78:0/3714164599 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4880017070 con 0x7f4894106800 2024-09-18T12:57:07.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.578+0000 7f4891ffb640 1 -- 172.21.15.78:0/3714164599 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f488000de00 con 0x7f4894106800 2024-09-18T12:57:07.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.579+0000 7f489ac81640 1 -- 172.21.15.78:0/3714164599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4894197ab0 con 0x7f4894106800 2024-09-18T12:57:07.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.579+0000 7f4891ffb640 1 -- 172.21.15.78:0/3714164599 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4880004bb0 con 0x7f4894106800 2024-09-18T12:57:07.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.579+0000 7f489ac81640 1 -- 172.21.15.78:0/3714164599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4894198040 con 0x7f4894106800 2024-09-18T12:57:07.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.580+0000 7f489ac81640 1 -- 172.21.15.78:0/3714164599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4894101f40 con 0x7f4894106800 2024-09-18T12:57:07.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.580+0000 7f4891ffb640 1 -- 172.21.15.78:0/3714164599 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4880004e60 con 0x7f4894106800 2024-09-18T12:57:07.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.581+0000 7f4891ffb640 1 --2- 172.21.15.78:0/3714164599 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f488407af30 0x7f488407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:07.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.581+0000 7f4891ffb640 1 -- 172.21.15.78:0/3714164599 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6070+0+0 (secure 0 0 0) 0x7f488009db50 con 0x7f4894106800 2024-09-18T12:57:07.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.581+0000 7f4898a1d640 1 --2- 172.21.15.78:0/3714164599 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f488407af30 0x7f488407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:07.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.582+0000 7f4898a1d640 1 --2- 172.21.15.78:0/3714164599 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f488407af30 0x7f488407d3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48880096c0 tx=0x7f4888031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:07.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.585+0000 7f4891ffb640 1 -- 172.21.15.78:0/3714164599 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f48800691a0 con 0x7f4894106800 2024-09-18T12:57:07.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.827+0000 7f489ac81640 1 -- 172.21.15.78:0/3714164599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4894109d80 con 0x7f4894106800 2024-09-18T12:57:07.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.827+0000 7f4891ffb640 1 -- 172.21.15.78:0/3714164599 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f488006e050 con 0x7f4894106800 2024-09-18T12:57:07.828 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:57:07.829 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:57:07.829 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:57:07.829 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:57:07.829 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:57:07.829 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:57:07.829 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:57:07.829 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:57:07.829 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-18T12:57:07.829 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 5 2024-09-18T12:57:07.829 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:57:07.829 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:57:07.829 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:57:07.829 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:57:07.830 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:57:07.830 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5, 2024-09-18T12:57:07.830 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 9 2024-09-18T12:57:07.830 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:57:07.830 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:57:07.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.830+0000 7f489ac81640 1 -- 172.21.15.78:0/3714164599 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f488407af30 msgr2=0x7f488407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:07.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.830+0000 7f489ac81640 1 --2- 172.21.15.78:0/3714164599 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f488407af30 0x7f488407d3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48880096c0 tx=0x7f4888031400 comp rx=0 tx=0).stop 2024-09-18T12:57:07.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.830+0000 7f489ac81640 1 -- 172.21.15.78:0/3714164599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894106800 msgr2=0x7f489419db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:07.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.830+0000 7f489ac81640 1 --2- 172.21.15.78:0/3714164599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894106800 0x7f489419db80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f488000d6f0 tx=0x7f488000dbb0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.830+0000 7f489ac81640 1 -- 172.21.15.78:0/3714164599 shutdown_connections 2024-09-18T12:57:07.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.830+0000 7f489ac81640 1 --2- 172.21.15.78:0/3714164599 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f488407af30 0x7f488407d3f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.830+0000 7f489ac81640 1 --2- 172.21.15.78:0/3714164599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894106800 0x7f489419db80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.830+0000 7f489ac81640 1 --2- 172.21.15.78:0/3714164599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4894100800 0x7f489419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.830+0000 7f489ac81640 1 -- 172.21.15.78:0/3714164599 >> 172.21.15.78:0/3714164599 conn(0x7f48940fc520 msgr2=0x7f489406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:07.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.830+0000 7f489ac81640 1 -- 172.21.15.78:0/3714164599 shutdown_connections 2024-09-18T12:57:07.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.830+0000 7f489ac81640 1 -- 172.21.15.78:0/3714164599 wait complete. 2024-09-18T12:57:07.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.911+0000 7f5970c56640 1 -- 172.21.15.78:0/2629162857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f596c100140 msgr2=0x7f596c100520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:07.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.911+0000 7f5970c56640 1 --2- 172.21.15.78:0/2629162857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f596c100140 0x7f596c100520 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f595c009880 tx=0x7f595c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.911+0000 7f5970c56640 1 -- 172.21.15.78:0/2629162857 shutdown_connections 2024-09-18T12:57:07.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.911+0000 7f5970c56640 1 --2- 172.21.15.78:0/2629162857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f596c100af0 0x7f596c106630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.911+0000 7f5970c56640 1 --2- 172.21.15.78:0/2629162857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f596c100140 0x7f596c100520 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.911+0000 7f5970c56640 1 -- 172.21.15.78:0/2629162857 >> 172.21.15.78:0/2629162857 conn(0x7f596c0fbc90 msgr2=0x7f596c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:07.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.911+0000 7f5970c56640 1 -- 172.21.15.78:0/2629162857 shutdown_connections 2024-09-18T12:57:07.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.911+0000 7f5970c56640 1 -- 172.21.15.78:0/2629162857 wait complete. 2024-09-18T12:57:07.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.912+0000 7f5970c56640 1 Processor -- start 2024-09-18T12:57:07.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.912+0000 7f5970c56640 1 -- start start 2024-09-18T12:57:07.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.912+0000 7f5970c56640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f596c100140 0x7f596c19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:07.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.912+0000 7f5970c56640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f596c100af0 0x7f596c19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:07.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.912+0000 7f5970c56640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f596c10ee40 con 0x7f596c100140 2024-09-18T12:57:07.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.912+0000 7f5970c56640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f596c10ecc0 con 0x7f596c100af0 2024-09-18T12:57:07.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.912+0000 7f596a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f596c100140 0x7f596c19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:07.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.912+0000 7f596a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f596c100140 0x7f596c19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56402/0 (socket says 172.21.15.78:56402) 2024-09-18T12:57:07.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.912+0000 7f596a59c640 1 -- 172.21.15.78:0/2909927388 learned_addr learned my addr 172.21.15.78:0/2909927388 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:57:07.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.913+0000 7f5969d9b640 1 --2- 172.21.15.78:0/2909927388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f596c100af0 0x7f596c19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:07.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.913+0000 7f596a59c640 1 -- 172.21.15.78:0/2909927388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f596c100af0 msgr2=0x7f596c19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:07.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.913+0000 7f596a59c640 1 --2- 172.21.15.78:0/2909927388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f596c100af0 0x7f596c19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:07.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.913+0000 7f596a59c640 1 -- 172.21.15.78:0/2909927388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c1977b0 con 0x7f596c100140 2024-09-18T12:57:07.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.913+0000 7f5969d9b640 1 --2- 172.21.15.78:0/2909927388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f596c100af0 0x7f596c19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:57:07.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.913+0000 7f596a59c640 1 --2- 172.21.15.78:0/2909927388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f596c100140 0x7f596c19d630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f595c031460 tx=0x7f595c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:07.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.913+0000 7f595b7fe640 1 -- 172.21.15.78:0/2909927388 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f595c03f070 con 0x7f596c100140 2024-09-18T12:57:07.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.913+0000 7f595b7fe640 1 -- 172.21.15.78:0/2909927388 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f595c004cf0 con 0x7f596c100140 2024-09-18T12:57:07.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.913+0000 7f5970c56640 1 -- 172.21.15.78:0/2909927388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596c197a40 con 0x7f596c100140 2024-09-18T12:57:07.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.913+0000 7f595b7fe640 1 -- 172.21.15.78:0/2909927388 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f595c035030 con 0x7f596c100140 2024-09-18T12:57:07.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.913+0000 7f5970c56640 1 -- 172.21.15.78:0/2909927388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596c197f70 con 0x7f596c100140 2024-09-18T12:57:07.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.914+0000 7f5970c56640 1 -- 172.21.15.78:0/2909927388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f596c103200 con 0x7f596c100140 2024-09-18T12:57:07.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.915+0000 7f595b7fe640 1 -- 172.21.15.78:0/2909927388 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f595c042070 con 0x7f596c100140 2024-09-18T12:57:07.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.915+0000 7f595b7fe640 1 --2- 172.21.15.78:0/2909927388 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f595407af30 0x7f595407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:07.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.916+0000 7f595b7fe640 1 -- 172.21.15.78:0/2909927388 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6070+0+0 (secure 0 0 0) 0x7f595c0beab0 con 0x7f596c100140 2024-09-18T12:57:07.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.916+0000 7f5969d9b640 1 --2- 172.21.15.78:0/2909927388 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f595407af30 0x7f595407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:07.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.916+0000 7f5969d9b640 1 --2- 172.21.15.78:0/2909927388 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f595407af30 0x7f595407d3f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f596c0fe2a0 tx=0x7f596000a5c0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:07.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:07.920+0000 7f595b7fe640 1 -- 172.21.15.78:0/2909927388 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f595c08a100 con 0x7f596c100140 2024-09-18T12:57:08.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.127+0000 7f5970c56640 1 -- 172.21.15.78:0/2909927388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f596c109ed0 con 0x7f596c100140 2024-09-18T12:57:08.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.127+0000 7f595b7fe640 1 -- 172.21.15.78:0/2909927388 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) ==== 76+0+2032 (secure 0 0 0) 0x7f595c08efb0 con 0x7f596c100140 2024-09-18T12:57:08.129 INFO:teuthology.orchestra.run.smithi078.stdout:e18 2024-09-18T12:57:08.129 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:46:44:251409+0000 2024-09-18T12:57:08.129 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:57:08.129 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:57:08.129 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T12:57:08.129 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:57:08.129 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:57:08.129 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T12:57:08.129 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 18 2024-09-18T12:57:08.130 INFO:teuthology.orchestra.run.smithi078.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:57:08.130 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:57:08.130 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:46:44.251398+0000 2024-09-18T12:57:08.130 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T12:57:08.130 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T12:57:08.130 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T12:57:08.130 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T12:57:08.130 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T12:57:08.130 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T12:57:08.130 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T12:57:08.130 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T12:57:08.130 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 45 2024-09-18T12:57:08.130 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:57:08.131 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T12:57:08.131 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T12:57:08.131 INFO:teuthology.orchestra.run.smithi078.stdout:up {0=14560,1=14574} 2024-09-18T12:57:08.131 INFO:teuthology.orchestra.run.smithi078.stdout:failed 2024-09-18T12:57:08.131 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T12:57:08.131 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T12:57:08.131 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T12:57:08.131 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T12:57:08.131 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T12:57:08.131 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T12:57:08.131 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T12:57:08.131 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T12:57:08.132 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 14560 members: 14560,14574 2024-09-18T12:57:08.132 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{0:14560} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.78:6826/2954199576,v1:172.21.15.78:6827/2954199576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:08.132 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{1:14574} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.78:6828/2120994206,v1:172.21.15.78:6829/2120994206] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:08.132 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:57:08.132 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:57:08.132 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T12:57:08.132 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:57:08.132 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:08.132 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/258027429,v1:172.21.15.148:6825/258027429] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:08.133 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 18 2024-09-18T12:57:08.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.130+0000 7f5970c56640 1 -- 172.21.15.78:0/2909927388 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f595407af30 msgr2=0x7f595407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:08.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.130+0000 7f5970c56640 1 --2- 172.21.15.78:0/2909927388 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f595407af30 0x7f595407d3f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f596c0fe2a0 tx=0x7f596000a5c0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.130+0000 7f5970c56640 1 -- 172.21.15.78:0/2909927388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f596c100140 msgr2=0x7f596c19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:08.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.130+0000 7f5970c56640 1 --2- 172.21.15.78:0/2909927388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f596c100140 0x7f596c19d630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f595c031460 tx=0x7f595c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.130+0000 7f5970c56640 1 -- 172.21.15.78:0/2909927388 shutdown_connections 2024-09-18T12:57:08.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.130+0000 7f5970c56640 1 --2- 172.21.15.78:0/2909927388 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f595407af30 0x7f595407d3f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.130+0000 7f5970c56640 1 --2- 172.21.15.78:0/2909927388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f596c100af0 0x7f596c19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.130+0000 7f5970c56640 1 --2- 172.21.15.78:0/2909927388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f596c100140 0x7f596c19d630 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.130+0000 7f5970c56640 1 -- 172.21.15.78:0/2909927388 >> 172.21.15.78:0/2909927388 conn(0x7f596c0fbc90 msgr2=0x7f596c105850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:08.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.130+0000 7f5970c56640 1 -- 172.21.15.78:0/2909927388 shutdown_connections 2024-09-18T12:57:08.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.130+0000 7f5970c56640 1 -- 172.21.15.78:0/2909927388 wait complete. 2024-09-18T12:57:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.215+0000 7fda6b30d640 1 -- 172.21.15.78:0/2456899680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda64100250 msgr2=0x7fda64100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.215+0000 7fda6b30d640 1 --2- 172.21.15.78:0/2456899680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda64100250 0x7fda64100630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fda60009c20 tx=0x7fda6002a970 comp rx=0 tx=0).stop 2024-09-18T12:57:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.216+0000 7fda6b30d640 1 -- 172.21.15.78:0/2456899680 shutdown_connections 2024-09-18T12:57:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.216+0000 7fda6b30d640 1 --2- 172.21.15.78:0/2456899680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda64100c00 0x7fda64104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.216+0000 7fda6b30d640 1 --2- 172.21.15.78:0/2456899680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda64100250 0x7fda64100630 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.216+0000 7fda6b30d640 1 -- 172.21.15.78:0/2456899680 >> 172.21.15.78:0/2456899680 conn(0x7fda640fbc90 msgr2=0x7fda640fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.216+0000 7fda6b30d640 1 -- 172.21.15.78:0/2456899680 shutdown_connections 2024-09-18T12:57:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.216+0000 7fda6b30d640 1 -- 172.21.15.78:0/2456899680 wait complete. 2024-09-18T12:57:08.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.216+0000 7fda6b30d640 1 Processor -- start 2024-09-18T12:57:08.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.216+0000 7fda6b30d640 1 -- start start 2024-09-18T12:57:08.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.216+0000 7fda6b30d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda64100250 0x7fda641956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:08.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.216+0000 7fda6b30d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda64100c00 0x7fda64195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:08.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.216+0000 7fda6b30d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fda6410cc20 con 0x7fda64100250 2024-09-18T12:57:08.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.216+0000 7fda6b30d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fda6410caa0 con 0x7fda64100c00 2024-09-18T12:57:08.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.217+0000 7fda690a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda64100250 0x7fda641956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:08.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.217+0000 7fda690a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda64100250 0x7fda641956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56416/0 (socket says 172.21.15.78:56416) 2024-09-18T12:57:08.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.217+0000 7fda690a9640 1 -- 172.21.15.78:0/1104109133 learned_addr learned my addr 172.21.15.78:0/1104109133 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:57:08.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.217+0000 7fda688a8640 1 --2- 172.21.15.78:0/1104109133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda64100c00 0x7fda64195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:08.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.217+0000 7fda690a9640 1 -- 172.21.15.78:0/1104109133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda64100c00 msgr2=0x7fda64195bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:08.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.217+0000 7fda690a9640 1 --2- 172.21.15.78:0/1104109133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda64100c00 0x7fda64195bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.217+0000 7fda690a9640 1 -- 172.21.15.78:0/1104109133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda64196130 con 0x7fda64100250 2024-09-18T12:57:08.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.217+0000 7fda690a9640 1 --2- 172.21.15.78:0/1104109133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda64100250 0x7fda641956b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fda6002ae90 tx=0x7fda6002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:08.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.217+0000 7fda5a7fc640 1 -- 172.21.15.78:0/1104109133 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda60047070 con 0x7fda64100250 2024-09-18T12:57:08.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.217+0000 7fda6b30d640 1 -- 172.21.15.78:0/1104109133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda641963c0 con 0x7fda64100250 2024-09-18T12:57:08.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.217+0000 7fda5a7fc640 1 -- 172.21.15.78:0/1104109133 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda6002f7e0 con 0x7fda64100250 2024-09-18T12:57:08.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.217+0000 7fda5a7fc640 1 -- 172.21.15.78:0/1104109133 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda60034070 con 0x7fda64100250 2024-09-18T12:57:08.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.217+0000 7fda6b30d640 1 -- 172.21.15.78:0/1104109133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda641a3e80 con 0x7fda64100250 2024-09-18T12:57:08.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.218+0000 7fda6b30d640 1 -- 172.21.15.78:0/1104109133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda64101730 con 0x7fda64100250 2024-09-18T12:57:08.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.219+0000 7fda5a7fc640 1 -- 172.21.15.78:0/1104109133 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fda6004a070 con 0x7fda64100250 2024-09-18T12:57:08.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.219+0000 7fda5a7fc640 1 --2- 172.21.15.78:0/1104109133 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fda5007af30 0x7fda5007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:08.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.219+0000 7fda5a7fc640 1 -- 172.21.15.78:0/1104109133 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6070+0+0 (secure 0 0 0) 0x7fda600beca0 con 0x7fda64100250 2024-09-18T12:57:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.219+0000 7fda688a8640 1 --2- 172.21.15.78:0/1104109133 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fda5007af30 0x7fda5007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:08.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.220+0000 7fda688a8640 1 --2- 172.21.15.78:0/1104109133 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fda5007af30 0x7fda5007d3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fda64197140 tx=0x7fda5400b490 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:08.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.224+0000 7fda5a7fc640 1 -- 172.21.15.78:0/1104109133 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fda600c3070 con 0x7fda64100250 2024-09-18T12:57:08.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.415+0000 7fda6b30d640 1 -- 172.21.15.78:0/1104109133 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fda64062630 con 0x7fda5007af30 2024-09-18T12:57:08.417 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:08 smithi078 ceph-mon[108578]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:08.417 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:08 smithi078 ceph-mon[108578]: pgmap v229: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:08.417 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:08 smithi078 ceph-mon[108578]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:08.417 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:08 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3714164599' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:08.417 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:08 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-18T12:57:08.417 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:08 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2909927388' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:57:08.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.416+0000 7fda5a7fc640 1 -- 172.21.15.78:0/1104109133 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fda64062630 con 0x7fda5007af30 2024-09-18T12:57:08.418 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:57:08.418 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:57:08.418 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:57:08.418 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:57:08.418 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:57:08.418 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T12:57:08.418 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T12:57:08.418 INFO:teuthology.orchestra.run.smithi078.stdout: "mon" 2024-09-18T12:57:08.418 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:57:08.418 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "11/23 daemons upgraded", 2024-09-18T12:57:08.419 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:57:08.419 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:57:08.419 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:57:08.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.418+0000 7fda6b30d640 1 -- 172.21.15.78:0/1104109133 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fda5007af30 msgr2=0x7fda5007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:08.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.418+0000 7fda6b30d640 1 --2- 172.21.15.78:0/1104109133 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fda5007af30 0x7fda5007d3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fda64197140 tx=0x7fda5400b490 comp rx=0 tx=0).stop 2024-09-18T12:57:08.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.418+0000 7fda6b30d640 1 -- 172.21.15.78:0/1104109133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda64100250 msgr2=0x7fda641956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:08.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.418+0000 7fda6b30d640 1 --2- 172.21.15.78:0/1104109133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda64100250 0x7fda641956b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fda6002ae90 tx=0x7fda6002f5f0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.418+0000 7fda6b30d640 1 -- 172.21.15.78:0/1104109133 shutdown_connections 2024-09-18T12:57:08.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.418+0000 7fda6b30d640 1 --2- 172.21.15.78:0/1104109133 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fda5007af30 0x7fda5007d3f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.418+0000 7fda6b30d640 1 --2- 172.21.15.78:0/1104109133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda64100c00 0x7fda64195bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.418+0000 7fda6b30d640 1 --2- 172.21.15.78:0/1104109133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda64100250 0x7fda641956b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.418+0000 7fda6b30d640 1 -- 172.21.15.78:0/1104109133 >> 172.21.15.78:0/1104109133 conn(0x7fda640fbc90 msgr2=0x7fda640fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:08.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.419+0000 7fda6b30d640 1 -- 172.21.15.78:0/1104109133 shutdown_connections 2024-09-18T12:57:08.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.419+0000 7fda6b30d640 1 -- 172.21.15.78:0/1104109133 wait complete. 2024-09-18T12:57:08.486 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:08 smithi148 ceph-mon[80030]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:08.486 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:08 smithi148 ceph-mon[80030]: pgmap v229: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:08.486 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:08 smithi148 ceph-mon[80030]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:08.486 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:08 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3714164599' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:08.486 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:08 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-18T12:57:08.486 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:08 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2909927388' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:57:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.500+0000 7f6b40328640 1 -- 172.21.15.78:0/3964411892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b38101900 msgr2=0x7f6b38101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.500+0000 7f6b40328640 1 --2- 172.21.15.78:0/3964411892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b38101900 0x7f6b38101d60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6b28009880 tx=0x7f6b2802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.500+0000 7f6b40328640 1 -- 172.21.15.78:0/3964411892 shutdown_connections 2024-09-18T12:57:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.500+0000 7f6b40328640 1 --2- 172.21.15.78:0/3964411892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b38101900 0x7f6b38101d60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.500+0000 7f6b40328640 1 --2- 172.21.15.78:0/3964411892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b38107900 0x7f6b38107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.500+0000 7f6b40328640 1 -- 172.21.15.78:0/3964411892 >> 172.21.15.78:0/3964411892 conn(0x7f6b380fd600 msgr2=0x7f6b380ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.500+0000 7f6b40328640 1 -- 172.21.15.78:0/3964411892 shutdown_connections 2024-09-18T12:57:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.500+0000 7f6b40328640 1 -- 172.21.15.78:0/3964411892 wait complete. 2024-09-18T12:57:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.501+0000 7f6b40328640 1 Processor -- start 2024-09-18T12:57:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.501+0000 7f6b40328640 1 -- start start 2024-09-18T12:57:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.501+0000 7f6b40328640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b38101900 0x7f6b380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.501+0000 7f6b40328640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b38107900 0x7f6b38074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.501+0000 7f6b40328640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3810edd0 con 0x7f6b38101900 2024-09-18T12:57:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.501+0000 7f6b40328640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3810ec50 con 0x7f6b38107900 2024-09-18T12:57:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.501+0000 7f6b3e0c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b38101900 0x7f6b380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.501+0000 7f6b3e0c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b38101900 0x7f6b380744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56446/0 (socket says 172.21.15.78:56446) 2024-09-18T12:57:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.501+0000 7f6b3e0c4640 1 -- 172.21.15.78:0/1887200291 learned_addr learned my addr 172.21.15.78:0/1887200291 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:57:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.501+0000 7f6b3d8c3640 1 --2- 172.21.15.78:0/1887200291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b38107900 0x7f6b38074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.501+0000 7f6b3e0c4640 1 -- 172.21.15.78:0/1887200291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b38107900 msgr2=0x7f6b38074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.501+0000 7f6b3e0c4640 1 --2- 172.21.15.78:0/1887200291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b38107900 0x7f6b38074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.501+0000 7f6b3e0c4640 1 -- 172.21.15.78:0/1887200291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b38074f70 con 0x7f6b38101900 2024-09-18T12:57:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.502+0000 7f6b3e0c4640 1 --2- 172.21.15.78:0/1887200291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b38101900 0x7f6b380744f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400d6f0 tx=0x7f6b3400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.502+0000 7f6b2f7fe640 1 -- 172.21.15.78:0/1887200291 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b34017070 con 0x7f6b38101900 2024-09-18T12:57:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.502+0000 7f6b2f7fe640 1 -- 172.21.15.78:0/1887200291 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b3400de00 con 0x7f6b38101900 2024-09-18T12:57:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.502+0000 7f6b40328640 1 -- 172.21.15.78:0/1887200291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b38075260 con 0x7f6b38101900 2024-09-18T12:57:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.502+0000 7f6b2f7fe640 1 -- 172.21.15.78:0/1887200291 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b34004bb0 con 0x7f6b38101900 2024-09-18T12:57:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.502+0000 7f6b40328640 1 -- 172.21.15.78:0/1887200291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b381a3e80 con 0x7f6b38101900 2024-09-18T12:57:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.503+0000 7f6b40328640 1 -- 172.21.15.78:0/1887200291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b38103040 con 0x7f6b38101900 2024-09-18T12:57:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.503+0000 7f6b2f7fe640 1 -- 172.21.15.78:0/1887200291 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6b34009a30 con 0x7f6b38101900 2024-09-18T12:57:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.504+0000 7f6b2f7fe640 1 --2- 172.21.15.78:0/1887200291 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6b2407af80 0x7f6b2407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.504+0000 7f6b2f7fe640 1 -- 172.21.15.78:0/1887200291 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6070+0+0 (secure 0 0 0) 0x7f6b3409da70 con 0x7f6b38101900 2024-09-18T12:57:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.504+0000 7f6b3d8c3640 1 --2- 172.21.15.78:0/1887200291 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6b2407af80 0x7f6b2407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.504+0000 7f6b3d8c3640 1 --2- 172.21.15.78:0/1887200291 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6b2407af80 0x7f6b2407d440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6b38075f80 tx=0x7f6b28031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:08.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.508+0000 7f6b2f7fe640 1 -- 172.21.15.78:0/1887200291 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6b34069140 con 0x7f6b38101900 2024-09-18T12:57:08.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.757+0000 7f6b40328640 1 -- 172.21.15.78:0/1887200291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6b38109e70 con 0x7f6b38101900 2024-09-18T12:57:08.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.758+0000 7f6b2f7fe640 1 -- 172.21.15.78:0/1887200291 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f6b3406dff0 con 0x7f6b38101900 2024-09-18T12:57:08.759 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:57:08.759 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:57:08.759 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:57:08.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.760+0000 7f6b40328640 1 -- 172.21.15.78:0/1887200291 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6b2407af80 msgr2=0x7f6b2407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:08.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.760+0000 7f6b40328640 1 --2- 172.21.15.78:0/1887200291 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6b2407af80 0x7f6b2407d440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6b38075f80 tx=0x7f6b28031400 comp rx=0 tx=0).stop 2024-09-18T12:57:08.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.760+0000 7f6b40328640 1 -- 172.21.15.78:0/1887200291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b38101900 msgr2=0x7f6b380744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:08.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.760+0000 7f6b40328640 1 --2- 172.21.15.78:0/1887200291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b38101900 0x7f6b380744f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400d6f0 tx=0x7f6b3400dbb0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.760+0000 7f6b40328640 1 -- 172.21.15.78:0/1887200291 shutdown_connections 2024-09-18T12:57:08.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.760+0000 7f6b40328640 1 --2- 172.21.15.78:0/1887200291 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6b2407af80 0x7f6b2407d440 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.760+0000 7f6b40328640 1 --2- 172.21.15.78:0/1887200291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b38107900 0x7f6b38074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.760+0000 7f6b40328640 1 --2- 172.21.15.78:0/1887200291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b38101900 0x7f6b380744f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.760+0000 7f6b40328640 1 -- 172.21.15.78:0/1887200291 >> 172.21.15.78:0/1887200291 conn(0x7f6b380fd600 msgr2=0x7f6b380fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:08.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.760+0000 7f6b40328640 1 -- 172.21.15.78:0/1887200291 shutdown_connections 2024-09-18T12:57:08.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:08.760+0000 7f6b40328640 1 -- 172.21.15.78:0/1887200291 wait complete. 2024-09-18T12:57:09.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:09 smithi078 ceph-mon[108578]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:09.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:09 smithi078 ceph-mon[108578]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T12:57:09.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:09 smithi078 ceph-mon[108578]: Upgrade: osd.5 is safe to restart 2024-09-18T12:57:09.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:09 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1887200291' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:57:09.503 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:09 smithi148 ceph-mon[80030]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:09.504 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:09 smithi148 ceph-mon[80030]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T12:57:09.504 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:09 smithi148 ceph-mon[80030]: Upgrade: osd.5 is safe to restart 2024-09-18T12:57:09.504 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:09 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1887200291' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:57:10.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:10 smithi148 ceph-mon[80030]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:10.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:10 smithi148 ceph-mon[80030]: pgmap v230: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:10.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:10 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:10.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:10 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-18T12:57:10.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:10 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:10.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:10 smithi078 ceph-mon[108578]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:10.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:10 smithi078 ceph-mon[108578]: pgmap v230: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:10.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:10 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:10.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:10 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-18T12:57:10.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:10 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:11.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:11 smithi148 ceph-mon[80030]: Upgrade: Updating osd.5 2024-09-18T12:57:11.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:11 smithi148 ceph-mon[80030]: Deploying daemon osd.5 on smithi148 2024-09-18T12:57:11.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:11.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:11.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:11.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:11 smithi078 ceph-mon[108578]: Upgrade: Updating osd.5 2024-09-18T12:57:11.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:11 smithi078 ceph-mon[108578]: Deploying daemon osd.5 on smithi148 2024-09-18T12:57:11.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:11.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:11.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:12.468 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:12 smithi148 ceph-mon[80030]: pgmap v231: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:12.469 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:12 smithi148 systemd[1]: Stopping Ceph osd.5 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:57:12.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:12 smithi078 ceph-mon[108578]: pgmap v231: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:12.723 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:12 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[54886]: 2024-09-18T12:57:12.467+0000 7f441298f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:57:12.723 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:12 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[54886]: 2024-09-18T12:57:12.467+0000 7f441298f640 -1 osd.5 72 *** Got signal Terminated *** 2024-09-18T12:57:12.723 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:12 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[54886]: 2024-09-18T12:57:12.467+0000 7f441298f640 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:57:13.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:13 smithi148 ceph-mon[80030]: osd.5 marked itself down and dead 2024-09-18T12:57:13.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:13 smithi078 ceph-mon[108578]: osd.5 marked itself down and dead 2024-09-18T12:57:14.019 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:13 smithi148 podman[97226]: 2024-09-18 12:57:13.740039042 +0000 UTC m=+1.365742722 container died 72e3a0acad4d5db6fe58eecbd4de0e711ce8960ad63e43b9ebf3bc3f69fbf773 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:57:14.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:14 smithi148 ceph-mon[80030]: pgmap v232: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:14.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:14 smithi148 ceph-mon[80030]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:57:14.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:14 smithi148 ceph-mon[80030]: osdmap e73: 6 total, 5 up, 6 in 2024-09-18T12:57:14.377 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:14 smithi148 podman[97226]: 2024-09-18 12:57:14.117196419 +0000 UTC m=+1.742900098 container cleanup 72e3a0acad4d5db6fe58eecbd4de0e711ce8960ad63e43b9ebf3bc3f69fbf773 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-18T12:57:14.377 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:14 smithi148 bash[97226]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5 2024-09-18T12:57:14.723 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:14 smithi148 podman[97253]: 2024-09-18 12:57:14.376551009 +0000 UTC m=+0.635083445 container remove 72e3a0acad4d5db6fe58eecbd4de0e711ce8960ad63e43b9ebf3bc3f69fbf773 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-18T12:57:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:14 smithi078 ceph-mon[108578]: pgmap v232: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:14 smithi078 ceph-mon[108578]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:57:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:14 smithi078 ceph-mon[108578]: osdmap e73: 6 total, 5 up, 6 in 2024-09-18T12:57:15.022 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:14 smithi148 podman[97343]: 2024-09-18 12:57:14.727443133 +0000 UTC m=+0.106603604 container create dca71fe4a9e634903dfc856fd29ec5c7f7e584011889115aff4ccbc193bdf0a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:57:15.022 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:14 smithi148 podman[97343]: 2024-09-18 12:57:14.637126634 +0000 UTC m=+0.016287119 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:57:15.023 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:14 smithi148 podman[97343]: 2024-09-18 12:57:14.930171939 +0000 UTC m=+0.309332420 container init dca71fe4a9e634903dfc856fd29ec5c7f7e584011889115aff4ccbc193bdf0a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:57:15.023 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:14 smithi148 podman[97343]: 2024-09-18 12:57:14.933503362 +0000 UTC m=+0.312663834 container start dca71fe4a9e634903dfc856fd29ec5c7f7e584011889115aff4ccbc193bdf0a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:57:15.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:15 smithi148 ceph-mon[80030]: osdmap e74: 6 total, 5 up, 6 in 2024-09-18T12:57:15.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:15 smithi148 podman[97343]: 2024-09-18 12:57:15.02166952 +0000 UTC m=+0.400830005 container attach dca71fe4a9e634903dfc856fd29ec5c7f7e584011889115aff4ccbc193bdf0a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-18T12:57:15.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:15 smithi148 podman[97343]: 2024-09-18 12:57:15.123429529 +0000 UTC m=+0.502590013 container died dca71fe4a9e634903dfc856fd29ec5c7f7e584011889115aff4ccbc193bdf0a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:57:15.710 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:15 smithi078 ceph-mon[108578]: osdmap e74: 6 total, 5 up, 6 in 2024-09-18T12:57:16.222 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:15 smithi148 podman[97365]: 2024-09-18 12:57:15.783475552 +0000 UTC m=+0.649690119 container remove dca71fe4a9e634903dfc856fd29ec5c7f7e584011889115aff4ccbc193bdf0a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:57:16.222 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:15 smithi148 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-18T12:57:16.222 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:15 smithi148 systemd[1]: Stopped Ceph osd.5 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:57:16.222 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:15 smithi148 systemd[1]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.5.service: Consumed 52.785s CPU time. 2024-09-18T12:57:16.222 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:16 smithi148 systemd[1]: Starting Ceph osd.5 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T12:57:16.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:16 smithi148 ceph-mon[80030]: pgmap v235: 65 pgs: 3 active+undersized, 7 peering, 7 stale+active+clean, 48 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:16.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:16 smithi148 ceph-mon[80030]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-18T12:57:16.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:16 smithi148 podman[97462]: 2024-09-18 12:57:16.12399819 +0000 UTC m=+0.016430623 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:57:16.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:16 smithi148 podman[97462]: 2024-09-18 12:57:16.226003113 +0000 UTC m=+0.118435517 container create 8f212dc5283fba0b2cfd2debcf59f344037bc086cf083d42c25330b76c920235 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-18T12:57:16.474 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:16 smithi148 podman[97462]: 2024-09-18 12:57:16.437018746 +0000 UTC m=+0.329451174 container init 8f212dc5283fba0b2cfd2debcf59f344037bc086cf083d42c25330b76c920235 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-18T12:57:16.474 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:16 smithi148 podman[97462]: 2024-09-18 12:57:16.44039242 +0000 UTC m=+0.332824827 container start 8f212dc5283fba0b2cfd2debcf59f344037bc086cf083d42c25330b76c920235 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-18T12:57:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:16 smithi078 ceph-mon[108578]: pgmap v235: 65 pgs: 3 active+undersized, 7 peering, 7 stale+active+clean, 48 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:16 smithi078 ceph-mon[108578]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-18T12:57:16.973 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:16 smithi148 podman[97462]: 2024-09-18 12:57:16.512087605 +0000 UTC m=+0.404520016 container attach 8f212dc5283fba0b2cfd2debcf59f344037bc086cf083d42c25330b76c920235 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-18T12:57:16.973 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:16 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-activate[97477]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:16.973 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:16 smithi148 bash[97462]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:16.973 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:16 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-activate[97477]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:16.973 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:16 smithi148 bash[97462]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:17.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:17 smithi148 ceph-mon[80030]: Health check failed: Degraded data redundancy: 34/333 objects degraded (10.210%), 8 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:17.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:17 smithi078 ceph-mon[108578]: Health check failed: Degraded data redundancy: 34/333 objects degraded (10.210%), 8 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:18.707 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:18 smithi078 ceph-mon[108578]: pgmap v236: 65 pgs: 8 active+undersized, 7 peering, 3 stale+active+clean, 8 active+undersized+degraded, 39 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 34/333 objects degraded (10.210%) 2024-09-18T12:57:18.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:18 smithi148 ceph-mon[80030]: pgmap v236: 65 pgs: 8 active+undersized, 7 peering, 3 stale+active+clean, 8 active+undersized+degraded, 39 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 34/333 objects degraded (10.210%) 2024-09-18T12:57:19.205 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:18 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-activate[97477]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T12:57:19.205 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:18 smithi148 bash[97462]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T12:57:19.205 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:18 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-activate[97477]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T12:57:19.205 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:18 smithi148 bash[97462]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T12:57:19.205 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:19 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-activate[97477]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T12:57:19.205 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:19 smithi148 bash[97462]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T12:57:19.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:19 smithi148 ceph-mon[80030]: pgmap v237: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-09-18T12:57:19.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:19 smithi148 ceph-mon[80030]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-18T12:57:19.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:19 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-activate[97477]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T12:57:19.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:19 smithi148 bash[97462]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T12:57:19.474 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:19 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-activate[97477]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-18T12:57:19.474 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:19 smithi148 bash[97462]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-18T12:57:19.474 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:19 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-activate[97477]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T12:57:19.474 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:19 smithi148 bash[97462]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T12:57:19.474 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:19 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-activate[97477]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-18T12:57:19.474 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:19 smithi148 bash[97462]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-18T12:57:19.474 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:19 smithi148 podman[97462]: 2024-09-18 12:57:19.232944814 +0000 UTC m=+3.125377228 container died 8f212dc5283fba0b2cfd2debcf59f344037bc086cf083d42c25330b76c920235 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-18T12:57:19.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:19 smithi078 ceph-mon[108578]: pgmap v237: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-09-18T12:57:19.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:19 smithi078 ceph-mon[108578]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-18T12:57:19.973 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:19 smithi148 podman[97645]: 2024-09-18 12:57:19.773921549 +0000 UTC m=+0.530915002 container remove 8f212dc5283fba0b2cfd2debcf59f344037bc086cf083d42c25330b76c920235 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-18T12:57:20.236 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:19 smithi148 podman[97705]: 2024-09-18 12:57:19.883102624 +0000 UTC m=+0.016669258 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:57:20.236 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:20 smithi148 podman[97705]: 2024-09-18 12:57:20.016518901 +0000 UTC m=+0.150085525 container create aed13dbdc2528fb2d0ff7bbc27bac4d1b39542802e0546b650e5366453eaa52a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-18T12:57:20.236 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:20 smithi148 podman[97705]: 2024-09-18 12:57:20.235789543 +0000 UTC m=+0.369356171 container init aed13dbdc2528fb2d0ff7bbc27bac4d1b39542802e0546b650e5366453eaa52a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-18T12:57:20.723 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:20 smithi148 podman[97705]: 2024-09-18 12:57:20.239307711 +0000 UTC m=+0.372874334 container start aed13dbdc2528fb2d0ff7bbc27bac4d1b39542802e0546b650e5366453eaa52a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:57:20.723 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:20 smithi148 ceph-osd[97726]: -- 172.21.15.148:0/201406386 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55adecfe41e0 con 0x55adec1d9c00 2024-09-18T12:57:20.723 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:20 smithi148 bash[97705]: aed13dbdc2528fb2d0ff7bbc27bac4d1b39542802e0546b650e5366453eaa52a 2024-09-18T12:57:20.723 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:20 smithi148 systemd[1]: Started Ceph osd.5 for ecc0857e-75ba-11ef-bceb-c7b262605968. 2024-09-18T12:57:21.707 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:21 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:21.707 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:21 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:21.708 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:21 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:21.708 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:21 smithi078 ceph-mon[108578]: pgmap v238: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-09-18T12:57:21.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:21 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:21.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:21 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:21.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:21 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:21.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:21 smithi148 ceph-mon[80030]: pgmap v238: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-09-18T12:57:22.223 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:21 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T12:57:21.872+0000 7fefd2e50640 -1 Falling back to public interface 2024-09-18T12:57:24.315 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:24.315 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:24.316 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:24 smithi148 ceph-mon[80030]: pgmap v239: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-09-18T12:57:24.316 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:24.316 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:24 smithi078 ceph-mon[108578]: pgmap v239: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-09-18T12:57:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:26 smithi148 ceph-mon[80030]: pgmap v240: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-09-18T12:57:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:26.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:26 smithi078 ceph-mon[108578]: pgmap v240: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-09-18T12:57:26.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:26.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:27.403 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[108574]: 2024-09-18T12:57:27.052+0000 7f54f5309640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:57:27.669 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T12:57:27.368+0000 7fefd2e50640 -1 osd.5 72 log_to_monitors true 2024-09-18T12:57:27.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:27.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:27.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:27.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:57:27.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:27.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:27.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:27.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:27.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:27.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:27.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: Upgrade: Setting container_image for all osd 2024-09-18T12:57:27.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:27.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-18T12:57:27.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: Health check update: Degraded data redundancy: 52/333 objects degraded (15.616%), 14 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:27.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-18T12:57:27.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-18T12:57:27.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-18T12:57:27.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-18T12:57:27.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-18T12:57:27.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-18T12:57:27.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-18T12:57:27.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-18T12:57:27.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-18T12:57:27.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-18T12:57:27.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-18T12:57:27.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-18T12:57:27.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-18T12:57:27.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T12:57:27.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:57:27.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-18T12:57:27.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: osdmap e75: 6 total, 5 up, 6 in 2024-09-18T12:57:27.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-18T12:57:27.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: pgmap v242: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-09-18T12:57:27.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='osd.5 [v2:172.21.15.148:6816/3595868149,v1:172.21.15.148:6817/3595868149]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-18T12:57:27.976 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:27 smithi148 ceph-mon[80030]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-18T12:57:27.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:27.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:27.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:27.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:57:27.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:27.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:27.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:27.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:27.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:27.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:27.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: Upgrade: Setting container_image for all osd 2024-09-18T12:57:27.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:27.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-18T12:57:27.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: Health check update: Degraded data redundancy: 52/333 objects degraded (15.616%), 14 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:27.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-18T12:57:27.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-18T12:57:27.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-18T12:57:27.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-18T12:57:27.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-18T12:57:27.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-18T12:57:27.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-18T12:57:27.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-18T12:57:27.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-18T12:57:27.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-18T12:57:27.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-18T12:57:27.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-18T12:57:27.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-18T12:57:27.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T12:57:27.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:57:27.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-18T12:57:27.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: osdmap e75: 6 total, 5 up, 6 in 2024-09-18T12:57:27.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-18T12:57:27.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: pgmap v242: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-09-18T12:57:27.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='osd.5 [v2:172.21.15.148:6816/3595868149,v1:172.21.15.148:6817/3595868149]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-18T12:57:27.995 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:27 smithi078 ceph-mon[108578]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-18T12:57:28.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 12:57:28 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T12:57:28.083+0000 7fefcabfa640 -1 osd.5 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:57:29.190 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:29 smithi078 ceph-mon[108578]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T12:57:29.190 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:29 smithi078 ceph-mon[108578]: from='osd.5 [v2:172.21.15.148:6816/3595868149,v1:172.21.15.148:6817/3595868149]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-18T12:57:29.191 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:29 smithi078 ceph-mon[108578]: mds.? [v2:172.21.15.78:6826/2971989157,v1:172.21.15.78:6827/2971989157] up:boot 2024-09-18T12:57:29.191 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:29 smithi078 ceph-mon[108578]: mds.? [v2:172.21.15.78:6828/1628237937,v1:172.21.15.78:6829/1628237937] up:boot 2024-09-18T12:57:29.191 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:29 smithi078 ceph-mon[108578]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-18T12:57:29.191 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:29 smithi078 ceph-mon[108578]: osdmap e76: 6 total, 5 up, 6 in 2024-09-18T12:57:29.191 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:29 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi078.furyab"} : dispatch 2024-09-18T12:57:29.191 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:29 smithi078 ceph-mon[108578]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-18T12:57:29.191 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:29 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi078.eakgoe"} : dispatch 2024-09-18T12:57:29.191 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:29 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:29.191 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:29 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi078.eakgoe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:57:29.191 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:29 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:29.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:29 smithi148 ceph-mon[80030]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T12:57:29.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:29 smithi148 ceph-mon[80030]: from='osd.5 [v2:172.21.15.148:6816/3595868149,v1:172.21.15.148:6817/3595868149]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-18T12:57:29.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:29 smithi148 ceph-mon[80030]: mds.? [v2:172.21.15.78:6826/2971989157,v1:172.21.15.78:6827/2971989157] up:boot 2024-09-18T12:57:29.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:29 smithi148 ceph-mon[80030]: mds.? [v2:172.21.15.78:6828/1628237937,v1:172.21.15.78:6829/1628237937] up:boot 2024-09-18T12:57:29.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:29 smithi148 ceph-mon[80030]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-18T12:57:29.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:29 smithi148 ceph-mon[80030]: osdmap e76: 6 total, 5 up, 6 in 2024-09-18T12:57:29.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:29 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi078.furyab"} : dispatch 2024-09-18T12:57:29.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:29 smithi148 ceph-mon[80030]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-18T12:57:29.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:29 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi078.eakgoe"} : dispatch 2024-09-18T12:57:29.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:29 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:29.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:29 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi078.eakgoe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:57:29.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:29 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:30.224 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:30 smithi078 ceph-mon[108578]: Upgrade: Updating mds.cephfs.smithi078.eakgoe 2024-09-18T12:57:30.225 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:30 smithi078 ceph-mon[108578]: Deploying daemon mds.cephfs.smithi078.eakgoe on smithi078 2024-09-18T12:57:30.225 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:30 smithi078 ceph-mon[108578]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:57:30.225 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:30 smithi078 ceph-mon[108578]: osd.5 [v2:172.21.15.148:6816/3595868149,v1:172.21.15.148:6817/3595868149] boot 2024-09-18T12:57:30.225 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:30 smithi078 ceph-mon[108578]: osdmap e77: 6 total, 6 up, 6 in 2024-09-18T12:57:30.225 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:30 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-18T12:57:30.225 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:30 smithi078 ceph-mon[108578]: pgmap v245: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-09-18T12:57:30.225 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:30 smithi078 ceph-mon[108578]: osdmap e78: 6 total, 6 up, 6 in 2024-09-18T12:57:30.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:30 smithi148 ceph-mon[80030]: Upgrade: Updating mds.cephfs.smithi078.eakgoe 2024-09-18T12:57:30.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:30 smithi148 ceph-mon[80030]: Deploying daemon mds.cephfs.smithi078.eakgoe on smithi078 2024-09-18T12:57:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:30 smithi148 ceph-mon[80030]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:57:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:30 smithi148 ceph-mon[80030]: osd.5 [v2:172.21.15.148:6816/3595868149,v1:172.21.15.148:6817/3595868149] boot 2024-09-18T12:57:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:30 smithi148 ceph-mon[80030]: osdmap e77: 6 total, 6 up, 6 in 2024-09-18T12:57:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:30 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-18T12:57:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:30 smithi148 ceph-mon[80030]: pgmap v245: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-09-18T12:57:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:30 smithi148 ceph-mon[80030]: osdmap e78: 6 total, 6 up, 6 in 2024-09-18T12:57:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:32 smithi148 ceph-mon[80030]: osdmap e79: 6 total, 6 up, 6 in 2024-09-18T12:57:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:32 smithi148 ceph-mon[80030]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-18T12:57:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:32 smithi148 ceph-mon[80030]: pgmap v248: 65 pgs: 1 peering, 13 active+undersized, 14 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-09-18T12:57:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:32 smithi078 ceph-mon[108578]: osdmap e79: 6 total, 6 up, 6 in 2024-09-18T12:57:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:32 smithi078 ceph-mon[108578]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-18T12:57:32.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:32 smithi078 ceph-mon[108578]: pgmap v248: 65 pgs: 1 peering, 13 active+undersized, 14 active+undersized+degraded, 37 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/333 objects degraded (15.616%) 2024-09-18T12:57:33.393 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:33 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi078.eakgoe"} : dispatch 2024-09-18T12:57:33.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:33 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi078.eakgoe"} : dispatch 2024-09-18T12:57:34.409 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:34 smithi078 ceph-mon[108578]: pgmap v249: 65 pgs: 1 peering, 1 active+undersized, 2 active+undersized+degraded, 61 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5/333 objects degraded (1.502%) 2024-09-18T12:57:34.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:34 smithi148 ceph-mon[80030]: pgmap v249: 65 pgs: 1 peering, 1 active+undersized, 2 active+undersized+degraded, 61 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5/333 objects degraded (1.502%) 2024-09-18T12:57:35.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:35 smithi078 ceph-mon[108578]: Health check update: Degraded data redundancy: 5/333 objects degraded (1.502%), 2 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:35.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:35 smithi148 ceph-mon[80030]: Health check update: Degraded data redundancy: 5/333 objects degraded (1.502%), 2 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:36.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:36 smithi078 ceph-mon[108578]: pgmap v250: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:36.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:36 smithi148 ceph-mon[80030]: pgmap v250: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:37.463 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:37 smithi078 ceph-mon[108578]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/333 objects degraded (1.502%), 2 pgs degraded) 2024-09-18T12:57:37.463 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:37 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:37.463 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:37 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:37.463 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:37 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:37.463 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:37 smithi078 ceph-mon[108578]: mds.? [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] up:boot 2024-09-18T12:57:37.463 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:37 smithi078 ceph-mon[108578]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-18T12:57:37.463 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:37 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi078.eakgoe"} : dispatch 2024-09-18T12:57:37.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:37 smithi148 ceph-mon[80030]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/333 objects degraded (1.502%), 2 pgs degraded) 2024-09-18T12:57:37.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:37 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:37.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:37 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:37.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:37 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:37.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:37 smithi148 ceph-mon[80030]: mds.? [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] up:boot 2024-09-18T12:57:37.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:37 smithi148 ceph-mon[80030]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-18T12:57:37.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:37 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi078.eakgoe"} : dispatch 2024-09-18T12:57:38.415 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:38 smithi078 ceph-mon[108578]: pgmap v251: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:38.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:38 smithi148 ceph-mon[80030]: pgmap v251: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.845+0000 7fbea29e5640 1 -- 172.21.15.78:0/2637683318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe9c101900 msgr2=0x7fbe9c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.845+0000 7fbea29e5640 1 --2- 172.21.15.78:0/2637683318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe9c101900 0x7fbe9c101d60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009880 tx=0x7fbe9002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:57:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.845+0000 7fbea29e5640 1 -- 172.21.15.78:0/2637683318 shutdown_connections 2024-09-18T12:57:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.845+0000 7fbea29e5640 1 --2- 172.21.15.78:0/2637683318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe9c101900 0x7fbe9c101d60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.845+0000 7fbea29e5640 1 --2- 172.21.15.78:0/2637683318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe9c107900 0x7fbe9c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.845+0000 7fbea29e5640 1 -- 172.21.15.78:0/2637683318 >> 172.21.15.78:0/2637683318 conn(0x7fbe9c0fd600 msgr2=0x7fbe9c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.845+0000 7fbea29e5640 1 -- 172.21.15.78:0/2637683318 shutdown_connections 2024-09-18T12:57:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.845+0000 7fbea29e5640 1 -- 172.21.15.78:0/2637683318 wait complete. 2024-09-18T12:57:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.846+0000 7fbea29e5640 1 Processor -- start 2024-09-18T12:57:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.846+0000 7fbea29e5640 1 -- start start 2024-09-18T12:57:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.846+0000 7fbea29e5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe9c101900 0x7fbe9c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.846+0000 7fbea29e5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe9c107900 0x7fbe9c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.846+0000 7fbea29e5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c10ee30 con 0x7fbe9c107900 2024-09-18T12:57:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.846+0000 7fbea29e5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c10ecb0 con 0x7fbe9c101900 2024-09-18T12:57:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.846+0000 7fbe9b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe9c107900 0x7fbe9c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.847+0000 7fbe9b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe9c107900 0x7fbe9c19dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56916/0 (socket says 172.21.15.78:56916) 2024-09-18T12:57:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.847+0000 7fbe9b7fe640 1 -- 172.21.15.78:0/598268383 learned_addr learned my addr 172.21.15.78:0/598268383 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:57:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.847+0000 7fbe9b7fe640 1 -- 172.21.15.78:0/598268383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe9c101900 msgr2=0x7fbe9c19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.847+0000 7fbe9b7fe640 1 --2- 172.21.15.78:0/598268383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe9c101900 0x7fbe9c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.847+0000 7fbe9b7fe640 1 -- 172.21.15.78:0/598268383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c197840 con 0x7fbe9c107900 2024-09-18T12:57:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.847+0000 7fbe9b7fe640 1 --2- 172.21.15.78:0/598268383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe9c107900 0x7fbe9c19dc00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbe90031460 tx=0x7fbe900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.847+0000 7fbe997fa640 1 -- 172.21.15.78:0/598268383 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe9003f070 con 0x7fbe9c107900 2024-09-18T12:57:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.847+0000 7fbea29e5640 1 -- 172.21.15.78:0/598268383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9c197ad0 con 0x7fbe9c107900 2024-09-18T12:57:38.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.847+0000 7fbe997fa640 1 -- 172.21.15.78:0/598268383 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbe90004cf0 con 0x7fbe9c107900 2024-09-18T12:57:38.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.847+0000 7fbe997fa640 1 -- 172.21.15.78:0/598268383 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe90035030 con 0x7fbe9c107900 2024-09-18T12:57:38.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.847+0000 7fbea29e5640 1 -- 172.21.15.78:0/598268383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9c198000 con 0x7fbe9c107900 2024-09-18T12:57:38.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.848+0000 7fbea29e5640 1 -- 172.21.15.78:0/598268383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe9c103040 con 0x7fbe9c107900 2024-09-18T12:57:38.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.849+0000 7fbe997fa640 1 -- 172.21.15.78:0/598268383 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbe90042070 con 0x7fbe9c107900 2024-09-18T12:57:38.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.849+0000 7fbe997fa640 1 --2- 172.21.15.78:0/598268383 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbe8407af30 0x7fbe8407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:38.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.849+0000 7fbe997fa640 1 -- 172.21.15.78:0/598268383 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6242+0+0 (secure 0 0 0) 0x7fbe900beb60 con 0x7fbe9c107900 2024-09-18T12:57:38.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.849+0000 7fbe9bfff640 1 --2- 172.21.15.78:0/598268383 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbe8407af30 0x7fbe8407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:38.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.850+0000 7fbe9bfff640 1 --2- 172.21.15.78:0/598268383 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbe8407af30 0x7fbe8407d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009710 tx=0x7fbe8c006c90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:38.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:38.854+0000 7fbe997fa640 1 -- 172.21.15.78:0/598268383 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbe9008a100 con 0x7fbe9c107900 2024-09-18T12:57:39.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.047+0000 7fbea29e5640 1 -- 172.21.15.78:0/598268383 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbe9c1982b0 con 0x7fbe8407af30 2024-09-18T12:57:39.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.048+0000 7fbe997fa640 1 -- 172.21.15.78:0/598268383 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fbe9c1982b0 con 0x7fbe8407af30 2024-09-18T12:57:39.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.050+0000 7fbea29e5640 1 -- 172.21.15.78:0/598268383 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbe8407af30 msgr2=0x7fbe8407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:39.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.050+0000 7fbea29e5640 1 --2- 172.21.15.78:0/598268383 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbe8407af30 0x7fbe8407d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009710 tx=0x7fbe8c006c90 comp rx=0 tx=0).stop 2024-09-18T12:57:39.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.050+0000 7fbea29e5640 1 -- 172.21.15.78:0/598268383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe9c107900 msgr2=0x7fbe9c19dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:39.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.050+0000 7fbea29e5640 1 --2- 172.21.15.78:0/598268383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe9c107900 0x7fbe9c19dc00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbe90031460 tx=0x7fbe900048f0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.050+0000 7fbea29e5640 1 -- 172.21.15.78:0/598268383 shutdown_connections 2024-09-18T12:57:39.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.050+0000 7fbea29e5640 1 --2- 172.21.15.78:0/598268383 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbe8407af30 0x7fbe8407d3f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.050+0000 7fbea29e5640 1 --2- 172.21.15.78:0/598268383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe9c107900 0x7fbe9c19dc00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.050+0000 7fbea29e5640 1 --2- 172.21.15.78:0/598268383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe9c101900 0x7fbe9c19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.050+0000 7fbea29e5640 1 -- 172.21.15.78:0/598268383 >> 172.21.15.78:0/598268383 conn(0x7fbe9c0fd600 msgr2=0x7fbe9c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:39.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.050+0000 7fbea29e5640 1 -- 172.21.15.78:0/598268383 shutdown_connections 2024-09-18T12:57:39.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.050+0000 7fbea29e5640 1 -- 172.21.15.78:0/598268383 wait complete. 2024-09-18T12:57:39.060 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:57:39.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.134+0000 7fae74040640 1 -- 172.21.15.78:0/58005166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae6c101900 msgr2=0x7fae6c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:39.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.134+0000 7fae74040640 1 --2- 172.21.15.78:0/58005166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae6c101900 0x7fae6c101d60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fae5c009880 tx=0x7fae5c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.134+0000 7fae74040640 1 -- 172.21.15.78:0/58005166 shutdown_connections 2024-09-18T12:57:39.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.134+0000 7fae74040640 1 --2- 172.21.15.78:0/58005166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae6c101900 0x7fae6c101d60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.134+0000 7fae74040640 1 --2- 172.21.15.78:0/58005166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae6c107900 0x7fae6c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.134+0000 7fae74040640 1 -- 172.21.15.78:0/58005166 >> 172.21.15.78:0/58005166 conn(0x7fae6c0fd600 msgr2=0x7fae6c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:39.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.134+0000 7fae74040640 1 -- 172.21.15.78:0/58005166 shutdown_connections 2024-09-18T12:57:39.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.134+0000 7fae74040640 1 -- 172.21.15.78:0/58005166 wait complete. 2024-09-18T12:57:39.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.135+0000 7fae74040640 1 Processor -- start 2024-09-18T12:57:39.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.135+0000 7fae74040640 1 -- start start 2024-09-18T12:57:39.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.135+0000 7fae74040640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae6c101900 0x7fae6c19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:39.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.135+0000 7fae74040640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae6c107900 0x7fae6c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:39.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.135+0000 7fae74040640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c10edd0 con 0x7fae6c107900 2024-09-18T12:57:39.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.135+0000 7fae74040640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c10ec50 con 0x7fae6c101900 2024-09-18T12:57:39.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.135+0000 7fae715db640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae6c107900 0x7fae6c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:39.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.135+0000 7fae715db640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae6c107900 0x7fae6c19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56930/0 (socket says 172.21.15.78:56930) 2024-09-18T12:57:39.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.135+0000 7fae715db640 1 -- 172.21.15.78:0/1311628153 learned_addr learned my addr 172.21.15.78:0/1311628153 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:57:39.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.135+0000 7fae71ddc640 1 --2- 172.21.15.78:0/1311628153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae6c101900 0x7fae6c19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:39.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.136+0000 7fae715db640 1 -- 172.21.15.78:0/1311628153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae6c101900 msgr2=0x7fae6c19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:39.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.136+0000 7fae715db640 1 --2- 172.21.15.78:0/1311628153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae6c101900 0x7fae6c19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.136+0000 7fae715db640 1 -- 172.21.15.78:0/1311628153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c1977a0 con 0x7fae6c107900 2024-09-18T12:57:39.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.136+0000 7fae715db640 1 --2- 172.21.15.78:0/1311628153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae6c107900 0x7fae6c19db60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fae5c031460 tx=0x7fae5c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:39.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.136+0000 7fae62ffd640 1 -- 172.21.15.78:0/1311628153 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae5c03f070 con 0x7fae6c107900 2024-09-18T12:57:39.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.136+0000 7fae62ffd640 1 -- 172.21.15.78:0/1311628153 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fae5c0035f0 con 0x7fae6c107900 2024-09-18T12:57:39.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.136+0000 7fae74040640 1 -- 172.21.15.78:0/1311628153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae6c197a30 con 0x7fae6c107900 2024-09-18T12:57:39.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.136+0000 7fae62ffd640 1 -- 172.21.15.78:0/1311628153 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae5c035030 con 0x7fae6c107900 2024-09-18T12:57:39.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.136+0000 7fae74040640 1 -- 172.21.15.78:0/1311628153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae6c197f60 con 0x7fae6c107900 2024-09-18T12:57:39.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.137+0000 7fae74040640 1 -- 172.21.15.78:0/1311628153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae6c103040 con 0x7fae6c107900 2024-09-18T12:57:39.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.138+0000 7fae62ffd640 1 -- 172.21.15.78:0/1311628153 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fae5c042070 con 0x7fae6c107900 2024-09-18T12:57:39.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.138+0000 7fae62ffd640 1 --2- 172.21.15.78:0/1311628153 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fae5807af30 0x7fae5807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:39.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.138+0000 7fae71ddc640 1 --2- 172.21.15.78:0/1311628153 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fae5807af30 0x7fae5807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:39.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.138+0000 7fae62ffd640 1 -- 172.21.15.78:0/1311628153 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6242+0+0 (secure 0 0 0) 0x7fae5c0bea30 con 0x7fae6c107900 2024-09-18T12:57:39.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.139+0000 7fae71ddc640 1 --2- 172.21.15.78:0/1311628153 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fae5807af30 0x7fae5807d3f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fae68005fd0 tx=0x7fae6800b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:39.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.143+0000 7fae62ffd640 1 -- 172.21.15.78:0/1311628153 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fae5c089f70 con 0x7fae6c107900 2024-09-18T12:57:39.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.339+0000 7fae74040640 1 -- 172.21.15.78:0/1311628153 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fae6c198210 con 0x7fae5807af30 2024-09-18T12:57:39.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.340+0000 7fae62ffd640 1 -- 172.21.15.78:0/1311628153 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fae6c198210 con 0x7fae5807af30 2024-09-18T12:57:39.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.343+0000 7fae74040640 1 -- 172.21.15.78:0/1311628153 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fae5807af30 msgr2=0x7fae5807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:39.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.343+0000 7fae74040640 1 --2- 172.21.15.78:0/1311628153 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fae5807af30 0x7fae5807d3f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fae68005fd0 tx=0x7fae6800b390 comp rx=0 tx=0).stop 2024-09-18T12:57:39.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.343+0000 7fae74040640 1 -- 172.21.15.78:0/1311628153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae6c107900 msgr2=0x7fae6c19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:39.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.343+0000 7fae74040640 1 --2- 172.21.15.78:0/1311628153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae6c107900 0x7fae6c19db60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fae5c031460 tx=0x7fae5c0045e0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.343+0000 7fae74040640 1 -- 172.21.15.78:0/1311628153 shutdown_connections 2024-09-18T12:57:39.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.343+0000 7fae74040640 1 --2- 172.21.15.78:0/1311628153 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fae5807af30 0x7fae5807d3f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.343+0000 7fae74040640 1 --2- 172.21.15.78:0/1311628153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae6c107900 0x7fae6c19db60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.343+0000 7fae74040640 1 --2- 172.21.15.78:0/1311628153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae6c101900 0x7fae6c19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.343+0000 7fae74040640 1 -- 172.21.15.78:0/1311628153 >> 172.21.15.78:0/1311628153 conn(0x7fae6c0fd600 msgr2=0x7fae6c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:39.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.343+0000 7fae74040640 1 -- 172.21.15.78:0/1311628153 shutdown_connections 2024-09-18T12:57:39.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.343+0000 7fae74040640 1 -- 172.21.15.78:0/1311628153 wait complete. 2024-09-18T12:57:39.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.426+0000 7fd94c5ae640 1 -- 172.21.15.78:0/4141062639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd944102b30 msgr2=0x7fd944102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:39.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.426+0000 7fd94c5ae640 1 --2- 172.21.15.78:0/4141062639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd944102b30 0x7fd944102f10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd938009880 tx=0x7fd93802a530 comp rx=0 tx=0).stop 2024-09-18T12:57:39.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.426+0000 7fd94c5ae640 1 -- 172.21.15.78:0/4141062639 shutdown_connections 2024-09-18T12:57:39.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.426+0000 7fd94c5ae640 1 --2- 172.21.15.78:0/4141062639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd944103450 0x7fd94410b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.426+0000 7fd94c5ae640 1 --2- 172.21.15.78:0/4141062639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd944102b30 0x7fd944102f10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.426+0000 7fd94c5ae640 1 -- 172.21.15.78:0/4141062639 >> 172.21.15.78:0/4141062639 conn(0x7fd9440fc550 msgr2=0x7fd9440fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:39.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.426+0000 7fd94c5ae640 1 -- 172.21.15.78:0/4141062639 shutdown_connections 2024-09-18T12:57:39.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.426+0000 7fd94c5ae640 1 -- 172.21.15.78:0/4141062639 wait complete. 2024-09-18T12:57:39.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.426+0000 7fd94c5ae640 1 Processor -- start 2024-09-18T12:57:39.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.427+0000 7fd94c5ae640 1 -- start start 2024-09-18T12:57:39.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.427+0000 7fd94c5ae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd944102b30 0x7fd944100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:39.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.427+0000 7fd94c5ae640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd944103450 0x7fd944100cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:39.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.427+0000 7fd94c5ae640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd94410ede0 con 0x7fd944102b30 2024-09-18T12:57:39.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.427+0000 7fd94c5ae640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd94410ec60 con 0x7fd944103450 2024-09-18T12:57:39.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.427+0000 7fd94a34a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd944102b30 0x7fd944100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:39.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.427+0000 7fd94a34a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd944102b30 0x7fd944100790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56950/0 (socket says 172.21.15.78:56950) 2024-09-18T12:57:39.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.427+0000 7fd94a34a640 1 -- 172.21.15.78:0/1130794011 learned_addr learned my addr 172.21.15.78:0/1130794011 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:57:39.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.427+0000 7fd949b49640 1 --2- 172.21.15.78:0/1130794011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd944103450 0x7fd944100cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:39.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.427+0000 7fd94a34a640 1 -- 172.21.15.78:0/1130794011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd944103450 msgr2=0x7fd944100cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:39.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.427+0000 7fd94a34a640 1 --2- 172.21.15.78:0/1130794011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd944103450 0x7fd944100cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.427+0000 7fd94a34a640 1 -- 172.21.15.78:0/1130794011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd944101210 con 0x7fd944102b30 2024-09-18T12:57:39.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.428+0000 7fd94a34a640 1 --2- 172.21.15.78:0/1130794011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd944102b30 0x7fd944100790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd938004f90 tx=0x7fd9380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:39.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.428+0000 7fd9377fe640 1 -- 172.21.15.78:0/1130794011 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd93803f070 con 0x7fd944102b30 2024-09-18T12:57:39.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.428+0000 7fd9377fe640 1 -- 172.21.15.78:0/1130794011 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd938004cf0 con 0x7fd944102b30 2024-09-18T12:57:39.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.428+0000 7fd94c5ae640 1 -- 172.21.15.78:0/1130794011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9441014a0 con 0x7fd944102b30 2024-09-18T12:57:39.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.428+0000 7fd9377fe640 1 -- 172.21.15.78:0/1130794011 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd938035030 con 0x7fd944102b30 2024-09-18T12:57:39.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.428+0000 7fd94c5ae640 1 -- 172.21.15.78:0/1130794011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9441a3d90 con 0x7fd944102b30 2024-09-18T12:57:39.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.429+0000 7fd94c5ae640 1 -- 172.21.15.78:0/1130794011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd94406a500 con 0x7fd944102b30 2024-09-18T12:57:39.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.430+0000 7fd9377fe640 1 -- 172.21.15.78:0/1130794011 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd938042070 con 0x7fd944102b30 2024-09-18T12:57:39.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.430+0000 7fd9377fe640 1 --2- 172.21.15.78:0/1130794011 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd93007af80 0x7fd93007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:39.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.430+0000 7fd9377fe640 1 -- 172.21.15.78:0/1130794011 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6242+0+0 (secure 0 0 0) 0x7fd9380bea00 con 0x7fd944102b30 2024-09-18T12:57:39.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.430+0000 7fd949b49640 1 --2- 172.21.15.78:0/1130794011 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd93007af80 0x7fd93007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:39.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.431+0000 7fd949b49640 1 --2- 172.21.15.78:0/1130794011 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd93007af80 0x7fd93007d440 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd944102220 tx=0x7fd94000a250 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:39.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.435+0000 7fd9377fe640 1 -- 172.21.15.78:0/1130794011 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd93808a020 con 0x7fd944102b30 2024-09-18T12:57:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.628+0000 7fd94c5ae640 1 -- 172.21.15.78:0/1130794011 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd944062630 con 0x7fd93007af80 2024-09-18T12:57:39.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.637+0000 7fd9377fe640 1 -- 172.21.15.78:0/1130794011 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fd944062630 con 0x7fd93007af80 2024-09-18T12:57:39.638 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:57:39.638 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (5m) 118s ago 16m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T12:57:39.638 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (8m) 118s ago 16m 8908k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:57:39.639 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (7m) 16s ago 15m 8594k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:57:39.639 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (3m) 118s ago 16m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T12:57:39.639 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (3m) 16s ago 15m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T12:57:39.639 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (5m) 118s ago 16m 75.8M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T12:57:39.639 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 starting - - - - 2024-09-18T12:57:39.639 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (11m) 118s ago 11m 28.0M - 19.1.1-330-gc2ddf972 ebb0615149de 317fd6a8b0db 2024-09-18T12:57:39.639 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (11m) 16s ago 11m 17.6M - 19.1.1-330-gc2ddf972 ebb0615149de 926db5241917 2024-09-18T12:57:39.639 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (11m) 16s ago 11m 18.4M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:57:39.639 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (7m) 118s ago 17m 524M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:57:39.639 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (6m) 16s ago 15m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:57:39.639 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (4m) 118s ago 17m 42.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T12:57:39.640 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (3m) 16s ago 15m 39.8M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T12:57:39.640 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (6m) 118s ago 16m 11.7M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:57:39.640 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (6m) 16s ago 15m 11.3M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:57:39.640 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (3m) 118s ago 14m 84.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T12:57:39.640 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (2m) 118s ago 13m 86.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T12:57:39.640 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (2m) 118s ago 13m 11.4M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T12:57:39.640 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (87s) 16s ago 13m 91.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T12:57:39.640 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (53s) 16s ago 12m 85.2M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T12:57:39.640 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (19s) 16s ago 12m 14.4M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T12:57:39.640 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (5m) 118s ago 16m 56.3M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:57:39.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.639+0000 7fd94c5ae640 1 -- 172.21.15.78:0/1130794011 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd93007af80 msgr2=0x7fd93007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:39.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.639+0000 7fd94c5ae640 1 --2- 172.21.15.78:0/1130794011 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd93007af80 0x7fd93007d440 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd944102220 tx=0x7fd94000a250 comp rx=0 tx=0).stop 2024-09-18T12:57:39.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.639+0000 7fd94c5ae640 1 -- 172.21.15.78:0/1130794011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd944102b30 msgr2=0x7fd944100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:39.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.639+0000 7fd94c5ae640 1 --2- 172.21.15.78:0/1130794011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd944102b30 0x7fd944100790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd938004f90 tx=0x7fd9380048f0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.640+0000 7fd94c5ae640 1 -- 172.21.15.78:0/1130794011 shutdown_connections 2024-09-18T12:57:39.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.640+0000 7fd94c5ae640 1 --2- 172.21.15.78:0/1130794011 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd93007af80 0x7fd93007d440 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.640+0000 7fd94c5ae640 1 --2- 172.21.15.78:0/1130794011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd944103450 0x7fd944100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.640+0000 7fd94c5ae640 1 --2- 172.21.15.78:0/1130794011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd944102b30 0x7fd944100790 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.640+0000 7fd94c5ae640 1 -- 172.21.15.78:0/1130794011 >> 172.21.15.78:0/1130794011 conn(0x7fd9440fc550 msgr2=0x7fd944108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:39.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.640+0000 7fd94c5ae640 1 -- 172.21.15.78:0/1130794011 shutdown_connections 2024-09-18T12:57:39.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.640+0000 7fd94c5ae640 1 -- 172.21.15.78:0/1130794011 wait complete. 2024-09-18T12:57:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.730+0000 7f97dc09a640 1 -- 172.21.15.78:0/811675379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97d41007f0 msgr2=0x7f97d4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.730+0000 7f97dc09a640 1 --2- 172.21.15.78:0/811675379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97d41007f0 0x7f97d4100c50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009880 tx=0x7f97c402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.730+0000 7f97dc09a640 1 -- 172.21.15.78:0/811675379 shutdown_connections 2024-09-18T12:57:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.730+0000 7f97dc09a640 1 --2- 172.21.15.78:0/811675379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97d41007f0 0x7f97d4100c50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.730+0000 7f97dc09a640 1 --2- 172.21.15.78:0/811675379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97d41067f0 0x7f97d4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.730+0000 7f97dc09a640 1 -- 172.21.15.78:0/811675379 >> 172.21.15.78:0/811675379 conn(0x7f97d40fc550 msgr2=0x7f97d40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.730+0000 7f97dc09a640 1 -- 172.21.15.78:0/811675379 shutdown_connections 2024-09-18T12:57:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.730+0000 7f97dc09a640 1 -- 172.21.15.78:0/811675379 wait complete. 2024-09-18T12:57:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.730+0000 7f97dc09a640 1 Processor -- start 2024-09-18T12:57:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.730+0000 7f97dc09a640 1 -- start start 2024-09-18T12:57:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.731+0000 7f97dc09a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97d41007f0 0x7f97d419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.731+0000 7f97dc09a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97d41067f0 0x7f97d419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.731+0000 7f97dc09a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f97d410dca0 con 0x7f97d41007f0 2024-09-18T12:57:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.731+0000 7f97dc09a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f97d410db20 con 0x7f97d41067f0 2024-09-18T12:57:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.731+0000 7f97d9e36640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97d41007f0 0x7f97d419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:39.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.731+0000 7f97d9e36640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97d41007f0 0x7f97d419f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56964/0 (socket says 172.21.15.78:56964) 2024-09-18T12:57:39.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.731+0000 7f97d9e36640 1 -- 172.21.15.78:0/759773007 learned_addr learned my addr 172.21.15.78:0/759773007 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:57:39.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.731+0000 7f97d9635640 1 --2- 172.21.15.78:0/759773007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97d41067f0 0x7f97d419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:39.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.731+0000 7f97d9e36640 1 -- 172.21.15.78:0/759773007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97d41067f0 msgr2=0x7f97d419fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:39.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.731+0000 7f97d9e36640 1 --2- 172.21.15.78:0/759773007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97d41067f0 0x7f97d419fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:39.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.731+0000 7f97d9e36640 1 -- 172.21.15.78:0/759773007 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d41a03c0 con 0x7f97d41007f0 2024-09-18T12:57:39.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.731+0000 7f97d9e36640 1 --2- 172.21.15.78:0/759773007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97d41007f0 0x7f97d419f7d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f97d000c8a0 tx=0x7f97d000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.732+0000 7f97caffd640 1 -- 172.21.15.78:0/759773007 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f97d00079b0 con 0x7f97d41007f0 2024-09-18T12:57:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.732+0000 7f97dc09a640 1 -- 172.21.15.78:0/759773007 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d4199ab0 con 0x7f97d41007f0 2024-09-18T12:57:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.732+0000 7f97caffd640 1 -- 172.21.15.78:0/759773007 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f97d0007b50 con 0x7f97d41007f0 2024-09-18T12:57:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.732+0000 7f97caffd640 1 -- 172.21.15.78:0/759773007 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f97d0018700 con 0x7f97d41007f0 2024-09-18T12:57:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.732+0000 7f97dc09a640 1 -- 172.21.15.78:0/759773007 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d419a010 con 0x7f97d41007f0 2024-09-18T12:57:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.733+0000 7f97dc09a640 1 -- 172.21.15.78:0/759773007 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d4101f30 con 0x7f97d41007f0 2024-09-18T12:57:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.733+0000 7f97caffd640 1 -- 172.21.15.78:0/759773007 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f97d0007d00 con 0x7f97d41007f0 2024-09-18T12:57:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.734+0000 7f97caffd640 1 --2- 172.21.15.78:0/759773007 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f97c007af80 0x7f97c007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.734+0000 7f97caffd640 1 -- 172.21.15.78:0/759773007 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6242+0+0 (secure 0 0 0) 0x7f97d009e2b0 con 0x7f97d41007f0 2024-09-18T12:57:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.734+0000 7f97d9635640 1 --2- 172.21.15.78:0/759773007 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f97c007af80 0x7f97c007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:39.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.735+0000 7f97d9635640 1 --2- 172.21.15.78:0/759773007 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f97c007af80 0x7f97c007d440 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f97d419b180 tx=0x7f97c4031420 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:39.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.739+0000 7f97caffd640 1 -- 172.21.15.78:0/759773007 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f97d0014030 con 0x7f97d41007f0 2024-09-18T12:57:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.996+0000 7f97dc09a640 1 -- 172.21.15.78:0/759773007 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f97d4100c50 con 0x7f97d41007f0 2024-09-18T12:57:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.996+0000 7f97caffd640 1 -- 172.21.15.78:0/759773007 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f97d00698d0 con 0x7f97d41007f0 2024-09-18T12:57:39.998 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:57:39.998 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:57:39.998 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:57:39.998 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:57:39.998 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:57:39.998 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:57:39.998 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:57:39.998 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:57:39.998 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T12:57:39.998 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:57:39.998 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:57:39.999 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3, 2024-09-18T12:57:39.999 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:57:39.999 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:57:39.999 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:57:39.999 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3, 2024-09-18T12:57:39.999 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 11 2024-09-18T12:57:39.999 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:57:39.999 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:57:40.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.998+0000 7f97dc09a640 1 -- 172.21.15.78:0/759773007 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f97c007af80 msgr2=0x7f97c007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.998+0000 7f97dc09a640 1 --2- 172.21.15.78:0/759773007 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f97c007af80 0x7f97c007d440 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f97d419b180 tx=0x7f97c4031420 comp rx=0 tx=0).stop 2024-09-18T12:57:40.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.998+0000 7f97dc09a640 1 -- 172.21.15.78:0/759773007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97d41007f0 msgr2=0x7f97d419f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.998+0000 7f97dc09a640 1 --2- 172.21.15.78:0/759773007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97d41007f0 0x7f97d419f7d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f97d000c8a0 tx=0x7f97d000cd60 comp rx=0 tx=0).stop 2024-09-18T12:57:40.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.999+0000 7f97dc09a640 1 -- 172.21.15.78:0/759773007 shutdown_connections 2024-09-18T12:57:40.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.999+0000 7f97dc09a640 1 --2- 172.21.15.78:0/759773007 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f97c007af80 0x7f97c007d440 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.999+0000 7f97dc09a640 1 --2- 172.21.15.78:0/759773007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97d41067f0 0x7f97d419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.999+0000 7f97dc09a640 1 --2- 172.21.15.78:0/759773007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97d41007f0 0x7f97d419f7d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.999+0000 7f97dc09a640 1 -- 172.21.15.78:0/759773007 >> 172.21.15.78:0/759773007 conn(0x7f97d40fc550 msgr2=0x7f97d4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:40.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.999+0000 7f97dc09a640 1 -- 172.21.15.78:0/759773007 shutdown_connections 2024-09-18T12:57:40.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:39.999+0000 7f97dc09a640 1 -- 172.21.15.78:0/759773007 wait complete. 2024-09-18T12:57:40.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.081+0000 7fee011fd640 1 -- 172.21.15.78:0/1076736798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedfc107900 msgr2=0x7fedfc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.081+0000 7fee011fd640 1 --2- 172.21.15.78:0/1076736798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedfc107900 0x7fedfc107ce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fedec009880 tx=0x7fedec02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.081+0000 7fee011fd640 1 -- 172.21.15.78:0/1076736798 shutdown_connections 2024-09-18T12:57:40.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.081+0000 7fee011fd640 1 --2- 172.21.15.78:0/1076736798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedfc101900 0x7fedfc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.081+0000 7fee011fd640 1 --2- 172.21.15.78:0/1076736798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedfc107900 0x7fedfc107ce0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.081+0000 7fee011fd640 1 -- 172.21.15.78:0/1076736798 >> 172.21.15.78:0/1076736798 conn(0x7fedfc0fd600 msgr2=0x7fedfc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:40.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.081+0000 7fee011fd640 1 -- 172.21.15.78:0/1076736798 shutdown_connections 2024-09-18T12:57:40.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.081+0000 7fee011fd640 1 -- 172.21.15.78:0/1076736798 wait complete. 2024-09-18T12:57:40.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.082+0000 7fee011fd640 1 Processor -- start 2024-09-18T12:57:40.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.082+0000 7fee011fd640 1 -- start start 2024-09-18T12:57:40.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.082+0000 7fee011fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedfc101900 0x7fedfc19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.082+0000 7fee011fd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedfc107900 0x7fedfc19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.082+0000 7fee011fd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc10edd0 con 0x7fedfc101900 2024-09-18T12:57:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.082+0000 7fee011fd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc10ec50 con 0x7fedfc107900 2024-09-18T12:57:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.082+0000 7fedfad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedfc101900 0x7fedfc19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.082+0000 7fedfad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedfc101900 0x7fedfc19d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56982/0 (socket says 172.21.15.78:56982) 2024-09-18T12:57:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.082+0000 7fedfad9d640 1 -- 172.21.15.78:0/1895801054 learned_addr learned my addr 172.21.15.78:0/1895801054 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:57:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.082+0000 7fedfad9d640 1 -- 172.21.15.78:0/1895801054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedfc107900 msgr2=0x7fedfc19db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.082+0000 7fedfad9d640 1 --2- 172.21.15.78:0/1895801054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedfc107900 0x7fedfc19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.082+0000 7fedfad9d640 1 -- 172.21.15.78:0/1895801054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedfc1977a0 con 0x7fedfc101900 2024-09-18T12:57:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.083+0000 7fedfad9d640 1 --2- 172.21.15.78:0/1895801054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedfc101900 0x7fedfc19d620 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fedec031460 tx=0x7fedec0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.083+0000 7fede3fff640 1 -- 172.21.15.78:0/1895801054 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedec03f070 con 0x7fedfc101900 2024-09-18T12:57:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.083+0000 7fede3fff640 1 -- 172.21.15.78:0/1895801054 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fedec0035f0 con 0x7fedfc101900 2024-09-18T12:57:40.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.083+0000 7fede3fff640 1 -- 172.21.15.78:0/1895801054 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedec035030 con 0x7fedfc101900 2024-09-18T12:57:40.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.083+0000 7fee011fd640 1 -- 172.21.15.78:0/1895801054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedfc197a30 con 0x7fedfc101900 2024-09-18T12:57:40.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.083+0000 7fee011fd640 1 -- 172.21.15.78:0/1895801054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedfc197f60 con 0x7fedfc101900 2024-09-18T12:57:40.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.084+0000 7fee011fd640 1 -- 172.21.15.78:0/1895801054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedfc103040 con 0x7fedfc101900 2024-09-18T12:57:40.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.084+0000 7fede3fff640 1 -- 172.21.15.78:0/1895801054 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fedec042070 con 0x7fedfc101900 2024-09-18T12:57:40.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.085+0000 7fede3fff640 1 --2- 172.21.15.78:0/1895801054 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fede407af30 0x7fede407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:40.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.085+0000 7fede3fff640 1 -- 172.21.15.78:0/1895801054 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6242+0+0 (secure 0 0 0) 0x7fedec0bea80 con 0x7fedfc101900 2024-09-18T12:57:40.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.085+0000 7fedfa59c640 1 --2- 172.21.15.78:0/1895801054 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fede407af30 0x7fede407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:40.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.085+0000 7fedfa59c640 1 --2- 172.21.15.78:0/1895801054 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fede407af30 0x7fede407d3f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fedf0005fd0 tx=0x7fedf0005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:40.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.089+0000 7fede3fff640 1 -- 172.21.15.78:0/1895801054 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fedec08a020 con 0x7fedfc101900 2024-09-18T12:57:40.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.315+0000 7fee011fd640 1 -- 172.21.15.78:0/1895801054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fedfc109e70 con 0x7fedfc101900 2024-09-18T12:57:40.316 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:40 smithi078 ceph-mon[108578]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:40.317 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:40 smithi078 ceph-mon[108578]: pgmap v252: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:40.317 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:40 smithi078 ceph-mon[108578]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:40.317 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:40 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/759773007' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:40.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.315+0000 7fede3fff640 1 -- 172.21.15.78:0/1895801054 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) ==== 76+0+2000 (secure 0 0 0) 0x7fedec0be7e0 con 0x7fedfc101900 2024-09-18T12:57:40.317 INFO:teuthology.orchestra.run.smithi078.stdout:e22 2024-09-18T12:57:40.318 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:57:37:091220+0000 2024-09-18T12:57:40.318 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:57:40.318 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:57:40.318 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T12:57:40.318 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:57:40.318 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:57:40.318 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T12:57:40.318 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T12:57:40.318 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T12:57:40.318 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:57:40.318 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T12:57:40.318 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T12:57:40.319 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T12:57:40.319 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T12:57:40.319 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T12:57:40.319 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T12:57:40.319 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T12:57:40.319 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T12:57:40.319 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T12:57:40.319 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T12:57:40.319 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:57:40.319 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T12:57:40.319 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T12:57:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T12:57:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T12:57:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T12:57:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T12:57:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T12:57:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T12:57:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T12:57:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T12:57:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T12:57:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T12:57:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T12:57:40.320 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:57:40.321 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:57:40.321 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T12:57:40.321 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:57:40.321 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:40.321 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/258027429,v1:172.21.15.148:6825/258027429] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:40.321 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34310} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2971989157,v1:172.21.15.78:6827/2971989157] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:40.321 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:40.322 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 22 2024-09-18T12:57:40.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.318+0000 7fee011fd640 1 -- 172.21.15.78:0/1895801054 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fede407af30 msgr2=0x7fede407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.318+0000 7fee011fd640 1 --2- 172.21.15.78:0/1895801054 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fede407af30 0x7fede407d3f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fedf0005fd0 tx=0x7fedf0005850 comp rx=0 tx=0).stop 2024-09-18T12:57:40.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.318+0000 7fee011fd640 1 -- 172.21.15.78:0/1895801054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedfc101900 msgr2=0x7fedfc19d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.318+0000 7fee011fd640 1 --2- 172.21.15.78:0/1895801054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedfc101900 0x7fedfc19d620 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fedec031460 tx=0x7fedec0045e0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.318+0000 7fee011fd640 1 -- 172.21.15.78:0/1895801054 shutdown_connections 2024-09-18T12:57:40.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.318+0000 7fee011fd640 1 --2- 172.21.15.78:0/1895801054 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fede407af30 0x7fede407d3f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.318+0000 7fee011fd640 1 --2- 172.21.15.78:0/1895801054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fedfc107900 0x7fedfc19db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.318+0000 7fee011fd640 1 --2- 172.21.15.78:0/1895801054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedfc101900 0x7fedfc19d620 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.318+0000 7fee011fd640 1 -- 172.21.15.78:0/1895801054 >> 172.21.15.78:0/1895801054 conn(0x7fedfc0fd600 msgr2=0x7fedfc0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:40.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.318+0000 7fee011fd640 1 -- 172.21.15.78:0/1895801054 shutdown_connections 2024-09-18T12:57:40.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.318+0000 7fee011fd640 1 -- 172.21.15.78:0/1895801054 wait complete. 2024-09-18T12:57:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.402+0000 7f42bf395640 1 -- 172.21.15.78:0/1351389500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b8101900 msgr2=0x7f42b8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.402+0000 7f42bf395640 1 --2- 172.21.15.78:0/1351389500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b8101900 0x7f42b8101d60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009880 tx=0x7f42ac02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.402+0000 7f42bf395640 1 -- 172.21.15.78:0/1351389500 shutdown_connections 2024-09-18T12:57:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.402+0000 7f42bf395640 1 --2- 172.21.15.78:0/1351389500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b8101900 0x7f42b8101d60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.402+0000 7f42bf395640 1 --2- 172.21.15.78:0/1351389500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42b8107900 0x7f42b8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.402+0000 7f42bf395640 1 -- 172.21.15.78:0/1351389500 >> 172.21.15.78:0/1351389500 conn(0x7f42b80fd620 msgr2=0x7f42b80ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.402+0000 7f42bf395640 1 -- 172.21.15.78:0/1351389500 shutdown_connections 2024-09-18T12:57:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.402+0000 7f42bf395640 1 -- 172.21.15.78:0/1351389500 wait complete. 2024-09-18T12:57:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.402+0000 7f42bf395640 1 Processor -- start 2024-09-18T12:57:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.402+0000 7f42bf395640 1 -- start start 2024-09-18T12:57:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42bf395640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42b8101900 0x7f42b819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42bf395640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b8107900 0x7f42b819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42bf395640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42b810edb0 con 0x7f42b8107900 2024-09-18T12:57:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42bf395640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f42b810ec30 con 0x7f42b8101900 2024-09-18T12:57:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42bc930640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b8107900 0x7f42b819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42bc930640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b8107900 0x7f42b819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57002/0 (socket says 172.21.15.78:57002) 2024-09-18T12:57:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42bc930640 1 -- 172.21.15.78:0/2200854905 learned_addr learned my addr 172.21.15.78:0/2200854905 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:57:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42bd131640 1 --2- 172.21.15.78:0/2200854905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42b8101900 0x7f42b819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42bc930640 1 -- 172.21.15.78:0/2200854905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42b8101900 msgr2=0x7f42b819d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42bc930640 1 --2- 172.21.15.78:0/2200854905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42b8101900 0x7f42b819d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42bc930640 1 -- 172.21.15.78:0/2200854905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b81977c0 con 0x7f42b8107900 2024-09-18T12:57:40.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42bc930640 1 --2- 172.21.15.78:0/2200854905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b8107900 0x7f42b819db80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f42ac031460 tx=0x7f42ac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:40.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42b67fc640 1 -- 172.21.15.78:0/2200854905 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42ac03f070 con 0x7f42b8107900 2024-09-18T12:57:40.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42bf395640 1 -- 172.21.15.78:0/2200854905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b8197a50 con 0x7f42b8107900 2024-09-18T12:57:40.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42b67fc640 1 -- 172.21.15.78:0/2200854905 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42ac0044d0 con 0x7f42b8107900 2024-09-18T12:57:40.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.403+0000 7f42b67fc640 1 -- 172.21.15.78:0/2200854905 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42ac035030 con 0x7f42b8107900 2024-09-18T12:57:40.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.404+0000 7f42bf395640 1 -- 172.21.15.78:0/2200854905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b8197f80 con 0x7f42b8107900 2024-09-18T12:57:40.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.404+0000 7f42bf395640 1 -- 172.21.15.78:0/2200854905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b8103040 con 0x7f42b8107900 2024-09-18T12:57:40.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.405+0000 7f42b67fc640 1 -- 172.21.15.78:0/2200854905 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f42ac042070 con 0x7f42b8107900 2024-09-18T12:57:40.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.405+0000 7f42b67fc640 1 --2- 172.21.15.78:0/2200854905 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f42a007af40 0x7f42a007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:40.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.406+0000 7f42b67fc640 1 -- 172.21.15.78:0/2200854905 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6242+0+0 (secure 0 0 0) 0x7f42ac0beb20 con 0x7f42b8107900 2024-09-18T12:57:40.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.406+0000 7f42bd131640 1 --2- 172.21.15.78:0/2200854905 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f42a007af40 0x7f42a007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.406+0000 7f42bd131640 1 --2- 172.21.15.78:0/2200854905 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f42a007af40 0x7f42a007d400 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f42a8007ec0 tx=0x7f42a80075b0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:40.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.410+0000 7f42b67fc640 1 -- 172.21.15.78:0/2200854905 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f42ac004cf0 con 0x7f42b8107900 2024-09-18T12:57:40.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:40 smithi148 ceph-mon[80030]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:40.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:40 smithi148 ceph-mon[80030]: pgmap v252: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:40.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:40 smithi148 ceph-mon[80030]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:40.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:40 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/759773007' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:40.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.613+0000 7f42bf395640 1 -- 172.21.15.78:0/2200854905 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f42b8198cf0 con 0x7f42a007af40 2024-09-18T12:57:40.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.615+0000 7f42b67fc640 1 -- 172.21.15.78:0/2200854905 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f42b8198cf0 con 0x7f42a007af40 2024-09-18T12:57:40.616 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:57:40.616 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:57:40.616 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:57:40.616 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:57:40.616 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:57:40.616 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T12:57:40.616 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T12:57:40.616 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T12:57:40.616 INFO:teuthology.orchestra.run.smithi078.stdout: "mon" 2024-09-18T12:57:40.616 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:57:40.617 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "12/23 daemons upgraded", 2024-09-18T12:57:40.617 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T12:57:40.617 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:57:40.617 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:57:40.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.617+0000 7f42bf395640 1 -- 172.21.15.78:0/2200854905 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f42a007af40 msgr2=0x7f42a007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.617+0000 7f42bf395640 1 --2- 172.21.15.78:0/2200854905 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f42a007af40 0x7f42a007d400 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f42a8007ec0 tx=0x7f42a80075b0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.617+0000 7f42bf395640 1 -- 172.21.15.78:0/2200854905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b8107900 msgr2=0x7f42b819db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.617+0000 7f42bf395640 1 --2- 172.21.15.78:0/2200854905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b8107900 0x7f42b819db80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f42ac031460 tx=0x7f42ac0048f0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.617+0000 7f42bf395640 1 -- 172.21.15.78:0/2200854905 shutdown_connections 2024-09-18T12:57:40.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.617+0000 7f42bf395640 1 --2- 172.21.15.78:0/2200854905 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f42a007af40 0x7f42a007d400 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.617+0000 7f42bf395640 1 --2- 172.21.15.78:0/2200854905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b8107900 0x7f42b819db80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.617+0000 7f42bf395640 1 --2- 172.21.15.78:0/2200854905 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42b8101900 0x7f42b819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.617+0000 7f42bf395640 1 -- 172.21.15.78:0/2200854905 >> 172.21.15.78:0/2200854905 conn(0x7f42b80fd620 msgr2=0x7f42b80fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:40.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.617+0000 7f42bf395640 1 -- 172.21.15.78:0/2200854905 shutdown_connections 2024-09-18T12:57:40.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.617+0000 7f42bf395640 1 -- 172.21.15.78:0/2200854905 wait complete. 2024-09-18T12:57:40.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.698+0000 7f554f79d640 1 -- 172.21.15.78:0/2759186413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5548103490 msgr2=0x7f554810b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.698+0000 7f554f79d640 1 --2- 172.21.15.78:0/2759186413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5548103490 0x7f554810b980 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f553c009880 tx=0x7f553c02a530 comp rx=0 tx=0).stop 2024-09-18T12:57:40.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.698+0000 7f554f79d640 1 -- 172.21.15.78:0/2759186413 shutdown_connections 2024-09-18T12:57:40.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.698+0000 7f554f79d640 1 --2- 172.21.15.78:0/2759186413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5548103490 0x7f554810b980 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.698+0000 7f554f79d640 1 --2- 172.21.15.78:0/2759186413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5548102b70 0x7f5548102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.698+0000 7f554f79d640 1 -- 172.21.15.78:0/2759186413 >> 172.21.15.78:0/2759186413 conn(0x7f55480fc550 msgr2=0x7f55480fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:40.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.699+0000 7f554f79d640 1 -- 172.21.15.78:0/2759186413 shutdown_connections 2024-09-18T12:57:40.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.699+0000 7f554f79d640 1 -- 172.21.15.78:0/2759186413 wait complete. 2024-09-18T12:57:40.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.699+0000 7f554f79d640 1 Processor -- start 2024-09-18T12:57:40.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.699+0000 7f554f79d640 1 -- start start 2024-09-18T12:57:40.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.699+0000 7f554f79d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5548102b70 0x7f554819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:40.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.699+0000 7f554f79d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5548103490 0x7f554819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.699+0000 7f554f79d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f554810ede0 con 0x7f5548102b70 2024-09-18T12:57:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.699+0000 7f554f79d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f554810ec60 con 0x7f5548103490 2024-09-18T12:57:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.700+0000 7f554d539640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5548102b70 0x7f554819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.700+0000 7f554d539640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5548102b70 0x7f554819d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57024/0 (socket says 172.21.15.78:57024) 2024-09-18T12:57:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.700+0000 7f554d539640 1 -- 172.21.15.78:0/123246419 learned_addr learned my addr 172.21.15.78:0/123246419 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:57:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.700+0000 7f554cd38640 1 --2- 172.21.15.78:0/123246419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5548103490 0x7f554819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.700+0000 7f554d539640 1 -- 172.21.15.78:0/123246419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5548103490 msgr2=0x7f554819db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.700+0000 7f554d539640 1 --2- 172.21.15.78:0/123246419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5548103490 0x7f554819db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.700+0000 7f554d539640 1 -- 172.21.15.78:0/123246419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55481977d0 con 0x7f5548102b70 2024-09-18T12:57:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.700+0000 7f554d539640 1 --2- 172.21.15.78:0/123246419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5548102b70 0x7f554819d650 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f554000d6f0 tx=0x7f554000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.700+0000 7f55467fc640 1 -- 172.21.15.78:0/123246419 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5540017070 con 0x7f5548102b70 2024-09-18T12:57:40.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.700+0000 7f554f79d640 1 -- 172.21.15.78:0/123246419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5548197ac0 con 0x7f5548102b70 2024-09-18T12:57:40.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.700+0000 7f55467fc640 1 -- 172.21.15.78:0/123246419 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f554000de00 con 0x7f5548102b70 2024-09-18T12:57:40.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.700+0000 7f55467fc640 1 -- 172.21.15.78:0/123246419 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5540004bb0 con 0x7f5548102b70 2024-09-18T12:57:40.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.700+0000 7f554f79d640 1 -- 172.21.15.78:0/123246419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5548198050 con 0x7f5548102b70 2024-09-18T12:57:40.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.701+0000 7f554f79d640 1 -- 172.21.15.78:0/123246419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f554806a4c0 con 0x7f5548102b70 2024-09-18T12:57:40.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.702+0000 7f55467fc640 1 -- 172.21.15.78:0/123246419 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5540009a30 con 0x7f5548102b70 2024-09-18T12:57:40.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.702+0000 7f55467fc640 1 --2- 172.21.15.78:0/123246419 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f553007af80 0x7f553007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:40.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.702+0000 7f554cd38640 1 --2- 172.21.15.78:0/123246419 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f553007af80 0x7f553007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:40.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.702+0000 7f55467fc640 1 -- 172.21.15.78:0/123246419 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6242+0+0 (secure 0 0 0) 0x7f554009dbd0 con 0x7f5548102b70 2024-09-18T12:57:40.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.703+0000 7f554cd38640 1 --2- 172.21.15.78:0/123246419 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f553007af80 0x7f553007d440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f553c004f90 tx=0x7f553c009560 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:40.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.707+0000 7f55467fc640 1 -- 172.21.15.78:0/123246419 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f55400691f0 con 0x7f5548102b70 2024-09-18T12:57:40.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.952+0000 7f554f79d640 1 -- 172.21.15.78:0/123246419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f5548106000 con 0x7f5548102b70 2024-09-18T12:57:40.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.952+0000 7f55467fc640 1 -- 172.21.15.78:0/123246419 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f554006e0a0 con 0x7f5548102b70 2024-09-18T12:57:40.954 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T12:57:40.954 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T12:57:40.954 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T12:57:40.954 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:57:40.954 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:57:40.954 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T12:57:40.954 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T12:57:40.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.954+0000 7f554f79d640 1 -- 172.21.15.78:0/123246419 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f553007af80 msgr2=0x7f553007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.954+0000 7f554f79d640 1 --2- 172.21.15.78:0/123246419 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f553007af80 0x7f553007d440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f553c004f90 tx=0x7f553c009560 comp rx=0 tx=0).stop 2024-09-18T12:57:40.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.954+0000 7f554f79d640 1 -- 172.21.15.78:0/123246419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5548102b70 msgr2=0x7f554819d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:40.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.954+0000 7f554f79d640 1 --2- 172.21.15.78:0/123246419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5548102b70 0x7f554819d650 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f554000d6f0 tx=0x7f554000dbb0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.954+0000 7f554f79d640 1 -- 172.21.15.78:0/123246419 shutdown_connections 2024-09-18T12:57:40.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.954+0000 7f554f79d640 1 --2- 172.21.15.78:0/123246419 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f553007af80 0x7f553007d440 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.954+0000 7f554f79d640 1 --2- 172.21.15.78:0/123246419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5548103490 0x7f554819db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.954+0000 7f554f79d640 1 --2- 172.21.15.78:0/123246419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5548102b70 0x7f554819d650 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:40.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.954+0000 7f554f79d640 1 -- 172.21.15.78:0/123246419 >> 172.21.15.78:0/123246419 conn(0x7f55480fc550 msgr2=0x7f5548103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:40.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.955+0000 7f554f79d640 1 -- 172.21.15.78:0/123246419 shutdown_connections 2024-09-18T12:57:40.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:57:40.955+0000 7f554f79d640 1 -- 172.21.15.78:0/123246419 wait complete. 2024-09-18T12:57:41.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:41 smithi078 ceph-mon[108578]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:41.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:41 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1895801054' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:57:41.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:41.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:41.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:41.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:41 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/123246419' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:57:41.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:41 smithi148 ceph-mon[80030]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:41.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:41 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1895801054' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:57:41.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:41.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:41.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:41.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:41 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/123246419' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:57:42.468 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:42 smithi078 ceph-mon[108578]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:42.468 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:42 smithi078 ceph-mon[108578]: pgmap v253: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:42.468 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:42 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:42.468 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:42 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:42.468 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:42 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:42.468 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:42 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:42.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:42 smithi148 ceph-mon[80030]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:42.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:42 smithi148 ceph-mon[80030]: pgmap v253: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:42.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:42 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:42.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:42 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:42.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:42 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:42.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:42 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:44.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:44 smithi148 ceph-mon[80030]: pgmap v254: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:44.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:44 smithi078 ceph-mon[108578]: pgmap v254: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:46.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:46 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:46.413 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:46 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:46.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:46 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:46.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:46 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:57:46.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:46 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:46.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:46 smithi078 ceph-mon[108578]: pgmap v255: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:46.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:46 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:46.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:46 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:46.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:46 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:46.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:46 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:46.414 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:46 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:46 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:46 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:46 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:46 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:57:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:46 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:46 smithi148 ceph-mon[80030]: pgmap v255: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:46.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:46 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:46.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:46 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:46.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:46 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:46.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:46 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:46.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:46 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:47.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:47 smithi078 ceph-mon[108578]: Upgrade: Updating mds.cephfs.smithi078.furyab 2024-09-18T12:57:47.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:47 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:47.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:47 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi078.furyab", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:57:47.720 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:47 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:47.721 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:47 smithi078 ceph-mon[108578]: Deploying daemon mds.cephfs.smithi078.furyab on smithi078 2024-09-18T12:57:47.721 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:47 smithi078 ceph-mon[108578]: pgmap v256: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:47 smithi148 ceph-mon[80030]: Upgrade: Updating mds.cephfs.smithi078.furyab 2024-09-18T12:57:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:47 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:47 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi078.furyab", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:57:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:47 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:47 smithi148 ceph-mon[80030]: Deploying daemon mds.cephfs.smithi078.furyab on smithi078 2024-09-18T12:57:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:47 smithi148 ceph-mon[80030]: pgmap v256: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:49 smithi148 ceph-mon[80030]: osdmap e80: 6 total, 6 up, 6 in 2024-09-18T12:57:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:49 smithi148 ceph-mon[80030]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-18T12:57:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:49 smithi148 ceph-mon[80030]: pgmap v258: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:49.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:49 smithi078 ceph-mon[108578]: osdmap e80: 6 total, 6 up, 6 in 2024-09-18T12:57:49.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:49 smithi078 ceph-mon[108578]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-18T12:57:49.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:49 smithi078 ceph-mon[108578]: pgmap v258: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:52.442 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:52 smithi078 ceph-mon[108578]: pgmap v259: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:52 smithi148 ceph-mon[80030]: pgmap v259: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:53.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:53 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:53.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:53 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:53.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:53 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:53.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:53 smithi148 ceph-mon[80030]: pgmap v260: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:53.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:53 smithi148 ceph-mon[80030]: mds.? [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] up:boot 2024-09-18T12:57:53.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:53 smithi148 ceph-mon[80030]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-18T12:57:53.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:53 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi078.furyab"} : dispatch 2024-09-18T12:57:53.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:53 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:53.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:53 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:53.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:53 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:53.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:53 smithi078 ceph-mon[108578]: pgmap v260: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:53.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:53 smithi078 ceph-mon[108578]: mds.? [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] up:boot 2024-09-18T12:57:53.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:53 smithi078 ceph-mon[108578]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-18T12:57:53.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:53 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi078.furyab"} : dispatch 2024-09-18T12:57:56.448 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:56 smithi078 ceph-mon[108578]: pgmap v261: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:56.448 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:56 smithi148 ceph-mon[80030]: pgmap v261: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:58.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:58 smithi148 ceph-mon[80030]: pgmap v262: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:58.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:58 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:58.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:58 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:58.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:58 smithi078 ceph-mon[108578]: pgmap v262: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:57:58.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:58 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:58.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:58 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:59.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:59 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:59.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:57:59 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:59.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:59 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:57:59.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:57:59 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:00.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:00 smithi148 ceph-mon[80030]: pgmap v263: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:00.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:00 smithi078 ceph-mon[108578]: pgmap v263: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:02.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:02 smithi148 ceph-mon[80030]: pgmap v264: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:02.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:02 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:02.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:02 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:02.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:02 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:02.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:02 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:02.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:02 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:02.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:02 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:02.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:02 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:02.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:02 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:02.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:02 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:02.474 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:02 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:02 smithi078 ceph-mon[108578]: pgmap v264: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:02 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:02 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:02 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:02 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:02 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:02 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:02.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:02 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:02.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:02 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:02.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:02 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:02.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:02 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:03.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:03 smithi078 ceph-mon[108578]: Upgrade: Updating mds.cephfs.smithi148.fqecmm 2024-09-18T12:58:03.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:03 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:03.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:03 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.fqecmm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:58:03.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:03 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:03.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:03 smithi078 ceph-mon[108578]: Deploying daemon mds.cephfs.smithi148.fqecmm on smithi148 2024-09-18T12:58:03.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:03 smithi078 ceph-mon[108578]: pgmap v265: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:04.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:03 smithi148 ceph-mon[80030]: Upgrade: Updating mds.cephfs.smithi148.fqecmm 2024-09-18T12:58:04.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:03 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:04.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:03 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.fqecmm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:58:04.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:03 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:04.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:03 smithi148 ceph-mon[80030]: Deploying daemon mds.cephfs.smithi148.fqecmm on smithi148 2024-09-18T12:58:04.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:03 smithi148 ceph-mon[80030]: pgmap v265: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:06.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:05 smithi148 ceph-mon[80030]: osdmap e81: 6 total, 6 up, 6 in 2024-09-18T12:58:06.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:05 smithi148 ceph-mon[80030]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-18T12:58:06.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:05 smithi148 ceph-mon[80030]: pgmap v267: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:06.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:05 smithi078 ceph-mon[108578]: osdmap e81: 6 total, 6 up, 6 in 2024-09-18T12:58:06.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:05 smithi078 ceph-mon[108578]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-18T12:58:06.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:05 smithi078 ceph-mon[108578]: pgmap v267: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:06.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:06 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi148.fqecmm"} : dispatch 2024-09-18T12:58:07.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:06 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi148.fqecmm"} : dispatch 2024-09-18T12:58:08.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:07 smithi148 ceph-mon[80030]: pgmap v268: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:08.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:07 smithi078 ceph-mon[108578]: pgmap v268: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:10.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:10 smithi148 ceph-mon[80030]: pgmap v269: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:10.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:10 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:10.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:10 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:10.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:10 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:10.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:10 smithi078 ceph-mon[108578]: pgmap v269: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:10.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:10 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:10.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:10 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:10.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:10 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:11.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.048+0000 7fbde1f27640 1 -- 172.21.15.78:0/1268458203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbddc101900 msgr2=0x7fbddc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:11.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.048+0000 7fbde1f27640 1 --2- 172.21.15.78:0/1268458203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbddc101900 0x7fbddc101d60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009880 tx=0x7fbdd002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.048+0000 7fbde1f27640 1 -- 172.21.15.78:0/1268458203 shutdown_connections 2024-09-18T12:58:11.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.048+0000 7fbde1f27640 1 --2- 172.21.15.78:0/1268458203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbddc101900 0x7fbddc101d60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.048+0000 7fbde1f27640 1 --2- 172.21.15.78:0/1268458203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbddc107900 0x7fbddc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.048+0000 7fbde1f27640 1 -- 172.21.15.78:0/1268458203 >> 172.21.15.78:0/1268458203 conn(0x7fbddc0fd600 msgr2=0x7fbddc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:11.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.048+0000 7fbde1f27640 1 -- 172.21.15.78:0/1268458203 shutdown_connections 2024-09-18T12:58:11.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.048+0000 7fbde1f27640 1 -- 172.21.15.78:0/1268458203 wait complete. 2024-09-18T12:58:11.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.049+0000 7fbde1f27640 1 Processor -- start 2024-09-18T12:58:11.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.049+0000 7fbde1f27640 1 -- start start 2024-09-18T12:58:11.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.049+0000 7fbde1f27640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbddc101900 0x7fbddc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:11.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.049+0000 7fbde1f27640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbddc107900 0x7fbddc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:11.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.049+0000 7fbde1f27640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc10edd0 con 0x7fbddc101900 2024-09-18T12:58:11.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.049+0000 7fbde1f27640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc10ec50 con 0x7fbddc107900 2024-09-18T12:58:11.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.049+0000 7fbddb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbddc101900 0x7fbddc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:11.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.049+0000 7fbddb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbddc101900 0x7fbddc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34318/0 (socket says 172.21.15.78:34318) 2024-09-18T12:58:11.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.050+0000 7fbddb7fe640 1 -- 172.21.15.78:0/1888734657 learned_addr learned my addr 172.21.15.78:0/1888734657 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:58:11.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.050+0000 7fbddaffd640 1 --2- 172.21.15.78:0/1888734657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbddc107900 0x7fbddc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:11.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.050+0000 7fbddb7fe640 1 -- 172.21.15.78:0/1888734657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbddc107900 msgr2=0x7fbddc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:11.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.050+0000 7fbddb7fe640 1 --2- 172.21.15.78:0/1888734657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbddc107900 0x7fbddc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.050+0000 7fbddb7fe640 1 -- 172.21.15.78:0/1888734657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbddc074f70 con 0x7fbddc101900 2024-09-18T12:58:11.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.050+0000 7fbddb7fe640 1 --2- 172.21.15.78:0/1888734657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbddc101900 0x7fbddc0744f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00d6f0 tx=0x7fbdcc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:11.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.050+0000 7fbdd8ff9640 1 -- 172.21.15.78:0/1888734657 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbdcc017070 con 0x7fbddc101900 2024-09-18T12:58:11.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.050+0000 7fbdd8ff9640 1 -- 172.21.15.78:0/1888734657 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbdcc00de00 con 0x7fbddc101900 2024-09-18T12:58:11.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.050+0000 7fbde1f27640 1 -- 172.21.15.78:0/1888734657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbddc075260 con 0x7fbddc101900 2024-09-18T12:58:11.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.050+0000 7fbdd8ff9640 1 -- 172.21.15.78:0/1888734657 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbdcc004bb0 con 0x7fbddc101900 2024-09-18T12:58:11.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.050+0000 7fbde1f27640 1 -- 172.21.15.78:0/1888734657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbddc1a3e20 con 0x7fbddc101900 2024-09-18T12:58:11.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.051+0000 7fbde1f27640 1 -- 172.21.15.78:0/1888734657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbddc103040 con 0x7fbddc101900 2024-09-18T12:58:11.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.052+0000 7fbdd8ff9640 1 -- 172.21.15.78:0/1888734657 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbdcc004e60 con 0x7fbddc101900 2024-09-18T12:58:11.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.053+0000 7fbdd8ff9640 1 --2- 172.21.15.78:0/1888734657 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbdc407af30 0x7fbdc407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:11.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.053+0000 7fbddaffd640 1 --2- 172.21.15.78:0/1888734657 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbdc407af30 0x7fbdc407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:11.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.053+0000 7fbdd8ff9640 1 -- 172.21.15.78:0/1888734657 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7fbdcc09dbe0 con 0x7fbddc101900 2024-09-18T12:58:11.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.053+0000 7fbddaffd640 1 --2- 172.21.15.78:0/1888734657 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbdc407af30 0x7fbdc407d3f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbddc075f80 tx=0x7fbdd0031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:11.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.058+0000 7fbdd8ff9640 1 -- 172.21.15.78:0/1888734657 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbdcc069180 con 0x7fbddc101900 2024-09-18T12:58:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.254+0000 7fbde1f27640 1 -- 172.21.15.78:0/1888734657 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbddc062630 con 0x7fbdc407af30 2024-09-18T12:58:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.255+0000 7fbdd8ff9640 1 -- 172.21.15.78:0/1888734657 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fbddc062630 con 0x7fbdc407af30 2024-09-18T12:58:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.258+0000 7fbde1f27640 1 -- 172.21.15.78:0/1888734657 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbdc407af30 msgr2=0x7fbdc407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.258+0000 7fbde1f27640 1 --2- 172.21.15.78:0/1888734657 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbdc407af30 0x7fbdc407d3f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbddc075f80 tx=0x7fbdd0031400 comp rx=0 tx=0).stop 2024-09-18T12:58:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.258+0000 7fbde1f27640 1 -- 172.21.15.78:0/1888734657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbddc101900 msgr2=0x7fbddc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.258+0000 7fbde1f27640 1 --2- 172.21.15.78:0/1888734657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbddc101900 0x7fbddc0744f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00d6f0 tx=0x7fbdcc00dbb0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.258+0000 7fbde1f27640 1 -- 172.21.15.78:0/1888734657 shutdown_connections 2024-09-18T12:58:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.258+0000 7fbde1f27640 1 --2- 172.21.15.78:0/1888734657 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbdc407af30 0x7fbdc407d3f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.258+0000 7fbde1f27640 1 --2- 172.21.15.78:0/1888734657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbddc107900 0x7fbddc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.258+0000 7fbde1f27640 1 --2- 172.21.15.78:0/1888734657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbddc101900 0x7fbddc0744f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.258+0000 7fbde1f27640 1 -- 172.21.15.78:0/1888734657 >> 172.21.15.78:0/1888734657 conn(0x7fbddc0fd600 msgr2=0x7fbddc0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.258+0000 7fbde1f27640 1 -- 172.21.15.78:0/1888734657 shutdown_connections 2024-09-18T12:58:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.258+0000 7fbde1f27640 1 -- 172.21.15.78:0/1888734657 wait complete. 2024-09-18T12:58:11.268 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:58:11.311 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:11 smithi148 ceph-mon[80030]: mds.? [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] up:boot 2024-09-18T12:58:11.311 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:11 smithi148 ceph-mon[80030]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-18T12:58:11.311 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi148.fqecmm"} : dispatch 2024-09-18T12:58:11.311 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:11.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.341+0000 7fcdab234640 1 -- 172.21.15.78:0/2257909478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda4106800 msgr2=0x7fcda4106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:11.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.341+0000 7fcdab234640 1 --2- 172.21.15.78:0/2257909478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda4106800 0x7fcda4106be0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009880 tx=0x7fcd9802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.341+0000 7fcdab234640 1 -- 172.21.15.78:0/2257909478 shutdown_connections 2024-09-18T12:58:11.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.341+0000 7fcdab234640 1 --2- 172.21.15.78:0/2257909478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda4100800 0x7fcda4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.341+0000 7fcdab234640 1 --2- 172.21.15.78:0/2257909478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda4106800 0x7fcda4106be0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.341+0000 7fcdab234640 1 -- 172.21.15.78:0/2257909478 >> 172.21.15.78:0/2257909478 conn(0x7fcda40fc520 msgr2=0x7fcda40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:11.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.341+0000 7fcdab234640 1 -- 172.21.15.78:0/2257909478 shutdown_connections 2024-09-18T12:58:11.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.341+0000 7fcdab234640 1 -- 172.21.15.78:0/2257909478 wait complete. 2024-09-18T12:58:11.343 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:11 smithi078 ceph-mon[108578]: mds.? [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] up:boot 2024-09-18T12:58:11.344 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:11 smithi078 ceph-mon[108578]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-18T12:58:11.344 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi148.fqecmm"} : dispatch 2024-09-18T12:58:11.344 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:11.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.341+0000 7fcdab234640 1 Processor -- start 2024-09-18T12:58:11.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.342+0000 7fcdab234640 1 -- start start 2024-09-18T12:58:11.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.342+0000 7fcdab234640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda4100800 0x7fcda41987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:11.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.342+0000 7fcdab234640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda4106800 0x7fcda4198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:11.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.342+0000 7fcdab234640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcda410dcb0 con 0x7fcda4106800 2024-09-18T12:58:11.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.342+0000 7fcdab234640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcda410db30 con 0x7fcda4100800 2024-09-18T12:58:11.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.342+0000 7fcda3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda4106800 0x7fcda4198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:11.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.342+0000 7fcda3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda4106800 0x7fcda4198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48110/0 (socket says 172.21.15.78:48110) 2024-09-18T12:58:11.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.342+0000 7fcda3fff640 1 -- 172.21.15.78:0/792667453 learned_addr learned my addr 172.21.15.78:0/792667453 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:58:11.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.342+0000 7fcda8fd0640 1 --2- 172.21.15.78:0/792667453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda4100800 0x7fcda41987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:11.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.342+0000 7fcda3fff640 1 -- 172.21.15.78:0/792667453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda4100800 msgr2=0x7fcda41987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:11.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.342+0000 7fcda3fff640 1 --2- 172.21.15.78:0/792667453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda4100800 0x7fcda41987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.342+0000 7fcda3fff640 1 -- 172.21.15.78:0/792667453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda4199320 con 0x7fcda4106800 2024-09-18T12:58:11.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.342+0000 7fcda3fff640 1 --2- 172.21.15.78:0/792667453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda4106800 0x7fcda4198d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000d8d0 tx=0x7fcd9000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:11.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.343+0000 7fcda1ffb640 1 -- 172.21.15.78:0/792667453 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd90017070 con 0x7fcda4106800 2024-09-18T12:58:11.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.343+0000 7fcdab234640 1 -- 172.21.15.78:0/792667453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda4199610 con 0x7fcda4106800 2024-09-18T12:58:11.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.343+0000 7fcda1ffb640 1 -- 172.21.15.78:0/792667453 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd90010460 con 0x7fcda4106800 2024-09-18T12:58:11.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.343+0000 7fcda1ffb640 1 -- 172.21.15.78:0/792667453 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd9000f5f0 con 0x7fcda4106800 2024-09-18T12:58:11.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.343+0000 7fcdab234640 1 -- 172.21.15.78:0/792667453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda41a1c10 con 0x7fcda4106800 2024-09-18T12:58:11.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.344+0000 7fcdab234640 1 -- 172.21.15.78:0/792667453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda4101f40 con 0x7fcda4106800 2024-09-18T12:58:11.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.345+0000 7fcda1ffb640 1 -- 172.21.15.78:0/792667453 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fcd90009a30 con 0x7fcda4106800 2024-09-18T12:58:11.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.345+0000 7fcda1ffb640 1 --2- 172.21.15.78:0/792667453 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd9407af80 0x7fcd9407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:11.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.345+0000 7fcda1ffb640 1 -- 172.21.15.78:0/792667453 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7fcd9009ddc0 con 0x7fcda4106800 2024-09-18T12:58:11.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.345+0000 7fcda8fd0640 1 --2- 172.21.15.78:0/792667453 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd9407af80 0x7fcd9407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:11.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.346+0000 7fcda8fd0640 1 --2- 172.21.15.78:0/792667453 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd9407af80 0x7fcd9407d440 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcd980096c0 tx=0x7fcd98031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:11.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.350+0000 7fcda1ffb640 1 -- 172.21.15.78:0/792667453 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fcda4199610 con 0x7fcda4106800 2024-09-18T12:58:11.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.539+0000 7fcdab234640 1 -- 172.21.15.78:0/792667453 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcda4062630 con 0x7fcd9407af80 2024-09-18T12:58:11.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.541+0000 7fcda1ffb640 1 -- 172.21.15.78:0/792667453 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fcda4062630 con 0x7fcd9407af80 2024-09-18T12:58:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.543+0000 7fcdab234640 1 -- 172.21.15.78:0/792667453 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd9407af80 msgr2=0x7fcd9407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.543+0000 7fcdab234640 1 --2- 172.21.15.78:0/792667453 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd9407af80 0x7fcd9407d440 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcd980096c0 tx=0x7fcd98031400 comp rx=0 tx=0).stop 2024-09-18T12:58:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.543+0000 7fcdab234640 1 -- 172.21.15.78:0/792667453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda4106800 msgr2=0x7fcda4198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.543+0000 7fcdab234640 1 --2- 172.21.15.78:0/792667453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda4106800 0x7fcda4198d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000d8d0 tx=0x7fcd9000dd90 comp rx=0 tx=0).stop 2024-09-18T12:58:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.543+0000 7fcdab234640 1 -- 172.21.15.78:0/792667453 shutdown_connections 2024-09-18T12:58:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.543+0000 7fcdab234640 1 --2- 172.21.15.78:0/792667453 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd9407af80 0x7fcd9407d440 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.543+0000 7fcdab234640 1 --2- 172.21.15.78:0/792667453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda4106800 0x7fcda4198d20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.543+0000 7fcdab234640 1 --2- 172.21.15.78:0/792667453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda4100800 0x7fcda41987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.543+0000 7fcdab234640 1 -- 172.21.15.78:0/792667453 >> 172.21.15.78:0/792667453 conn(0x7fcda40fc520 msgr2=0x7fcda40fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:11.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.543+0000 7fcdab234640 1 -- 172.21.15.78:0/792667453 shutdown_connections 2024-09-18T12:58:11.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.543+0000 7fcdab234640 1 -- 172.21.15.78:0/792667453 wait complete. 2024-09-18T12:58:11.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.625+0000 7f885d5c2640 1 -- 172.21.15.78:0/3403668834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88581007f0 msgr2=0x7f8858100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:11.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.625+0000 7f885d5c2640 1 --2- 172.21.15.78:0/3403668834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88581007f0 0x7f8858100c50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8840009880 tx=0x7f884002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.625+0000 7f885d5c2640 1 -- 172.21.15.78:0/3403668834 shutdown_connections 2024-09-18T12:58:11.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.625+0000 7f885d5c2640 1 --2- 172.21.15.78:0/3403668834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88581007f0 0x7f8858100c50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.625+0000 7f885d5c2640 1 --2- 172.21.15.78:0/3403668834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88581067f0 0x7f8858106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.625+0000 7f885d5c2640 1 -- 172.21.15.78:0/3403668834 >> 172.21.15.78:0/3403668834 conn(0x7f88580fc550 msgr2=0x7f88580fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:11.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.625+0000 7f885d5c2640 1 -- 172.21.15.78:0/3403668834 shutdown_connections 2024-09-18T12:58:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.625+0000 7f885d5c2640 1 -- 172.21.15.78:0/3403668834 wait complete. 2024-09-18T12:58:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.625+0000 7f885d5c2640 1 Processor -- start 2024-09-18T12:58:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.626+0000 7f885d5c2640 1 -- start start 2024-09-18T12:58:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.626+0000 7f885d5c2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88581007f0 0x7f885819f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.626+0000 7f885d5c2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88581067f0 0x7f885819fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.626+0000 7f885d5c2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f885810cc30 con 0x7f88581067f0 2024-09-18T12:58:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.626+0000 7f885d5c2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f885810cab0 con 0x7f88581007f0 2024-09-18T12:58:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.626+0000 7f884ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88581067f0 0x7f885819fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.626+0000 7f884ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88581067f0 0x7f885819fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48116/0 (socket says 172.21.15.78:48116) 2024-09-18T12:58:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.626+0000 7f884ffff640 1 -- 172.21.15.78:0/3014443937 learned_addr learned my addr 172.21.15.78:0/3014443937 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:58:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.626+0000 7f8856ffd640 1 --2- 172.21.15.78:0/3014443937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88581007f0 0x7f885819f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.626+0000 7f884ffff640 1 -- 172.21.15.78:0/3014443937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88581007f0 msgr2=0x7f885819f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.626+0000 7f884ffff640 1 --2- 172.21.15.78:0/3014443937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88581007f0 0x7f885819f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.626+0000 7f884ffff640 1 -- 172.21.15.78:0/3014443937 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8858199a70 con 0x7f88581067f0 2024-09-18T12:58:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.626+0000 7f884ffff640 1 --2- 172.21.15.78:0/3014443937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88581067f0 0x7f885819fdf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8840031460 tx=0x7f88400048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.627+0000 7f8854ff9640 1 -- 172.21.15.78:0/3014443937 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f884003f070 con 0x7f88581067f0 2024-09-18T12:58:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.627+0000 7f885d5c2640 1 -- 172.21.15.78:0/3014443937 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8858199d00 con 0x7f88581067f0 2024-09-18T12:58:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.627+0000 7f8854ff9640 1 -- 172.21.15.78:0/3014443937 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f88400044d0 con 0x7f88581067f0 2024-09-18T12:58:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.627+0000 7f8854ff9640 1 -- 172.21.15.78:0/3014443937 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8840035030 con 0x7f88581067f0 2024-09-18T12:58:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.627+0000 7f885d5c2640 1 -- 172.21.15.78:0/3014443937 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885819a230 con 0x7f88581067f0 2024-09-18T12:58:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.628+0000 7f885d5c2640 1 -- 172.21.15.78:0/3014443937 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8858101f30 con 0x7f88581067f0 2024-09-18T12:58:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.628+0000 7f8854ff9640 1 -- 172.21.15.78:0/3014443937 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8840042070 con 0x7f88581067f0 2024-09-18T12:58:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.629+0000 7f8854ff9640 1 --2- 172.21.15.78:0/3014443937 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f884407af90 0x7f884407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.629+0000 7f8854ff9640 1 -- 172.21.15.78:0/3014443937 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f88400beaa0 con 0x7f88581067f0 2024-09-18T12:58:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.629+0000 7f8856ffd640 1 --2- 172.21.15.78:0/3014443937 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f884407af90 0x7f884407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:11.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.629+0000 7f8856ffd640 1 --2- 172.21.15.78:0/3014443937 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f884407af90 0x7f884407d450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f885819abb0 tx=0x7f8848009110 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:11.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.633+0000 7f8854ff9640 1 -- 172.21.15.78:0/3014443937 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8840004cf0 con 0x7f88581067f0 2024-09-18T12:58:11.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.818+0000 7f885d5c2640 1 -- 172.21.15.78:0/3014443937 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f885819afa0 con 0x7f884407af90 2024-09-18T12:58:11.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.828+0000 7f8854ff9640 1 -- 172.21.15.78:0/3014443937 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f885819afa0 con 0x7f884407af90 2024-09-18T12:58:11.829 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:58:11.829 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (6m) 14s ago 16m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T12:58:11.829 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (8m) 14s ago 17m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:58:11.829 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (8m) 48s ago 16m 8594k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:58:11.829 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (4m) 14s ago 17m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T12:58:11.829 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (4m) 48s ago 16m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T12:58:11.829 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (5m) 14s ago 16m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T12:58:11.829 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (36s) 14s ago 11m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T12:58:11.830 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (19s) 14s ago 11m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T12:58:11.830 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 starting - - - - 2024-09-18T12:58:11.830 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (11m) 48s ago 11m 18.4M - 19.1.1-330-gc2ddf972 ebb0615149de d7fbff39733c 2024-09-18T12:58:11.830 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (8m) 14s ago 18m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:58:11.830 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (7m) 48s ago 16m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:58:11.830 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (4m) 14s ago 18m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T12:58:11.830 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (4m) 48s ago 16m 39.8M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T12:58:11.830 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (6m) 14s ago 17m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:58:11.830 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (6m) 48s ago 16m 11.3M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:58:11.830 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (3m) 14s ago 14m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T12:58:11.830 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (3m) 14s ago 14m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T12:58:11.830 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (2m) 14s ago 14m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T12:58:11.830 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (119s) 48s ago 13m 91.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T12:58:11.831 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (85s) 48s ago 13m 85.2M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T12:58:11.831 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (51s) 48s ago 12m 14.4M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T12:58:11.831 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (6m) 14s ago 16m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:58:11.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.830+0000 7f885d5c2640 1 -- 172.21.15.78:0/3014443937 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f884407af90 msgr2=0x7f884407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:11.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.830+0000 7f885d5c2640 1 --2- 172.21.15.78:0/3014443937 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f884407af90 0x7f884407d450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f885819abb0 tx=0x7f8848009110 comp rx=0 tx=0).stop 2024-09-18T12:58:11.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.830+0000 7f885d5c2640 1 -- 172.21.15.78:0/3014443937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88581067f0 msgr2=0x7f885819fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:11.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.830+0000 7f885d5c2640 1 --2- 172.21.15.78:0/3014443937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88581067f0 0x7f885819fdf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8840031460 tx=0x7f88400048f0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.830+0000 7f885d5c2640 1 -- 172.21.15.78:0/3014443937 shutdown_connections 2024-09-18T12:58:11.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.830+0000 7f885d5c2640 1 --2- 172.21.15.78:0/3014443937 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f884407af90 0x7f884407d450 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.830+0000 7f885d5c2640 1 --2- 172.21.15.78:0/3014443937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88581067f0 0x7f885819fdf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.830+0000 7f885d5c2640 1 --2- 172.21.15.78:0/3014443937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88581007f0 0x7f885819f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.830+0000 7f885d5c2640 1 -- 172.21.15.78:0/3014443937 >> 172.21.15.78:0/3014443937 conn(0x7f88580fc550 msgr2=0x7f88580fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:11.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.830+0000 7f885d5c2640 1 -- 172.21.15.78:0/3014443937 shutdown_connections 2024-09-18T12:58:11.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.830+0000 7f885d5c2640 1 -- 172.21.15.78:0/3014443937 wait complete. 2024-09-18T12:58:11.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.910+0000 7f3aa905f640 1 -- 172.21.15.78:0/87323625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3aa4101900 msgr2=0x7f3aa4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:11.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.910+0000 7f3aa905f640 1 --2- 172.21.15.78:0/87323625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3aa4101900 0x7f3aa4101d60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3a98009880 tx=0x7f3a9802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.910+0000 7f3aa905f640 1 -- 172.21.15.78:0/87323625 shutdown_connections 2024-09-18T12:58:11.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.910+0000 7f3aa905f640 1 --2- 172.21.15.78:0/87323625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3aa4101900 0x7f3aa4101d60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.910+0000 7f3aa905f640 1 --2- 172.21.15.78:0/87323625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3aa4107900 0x7f3aa4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.910+0000 7f3aa905f640 1 -- 172.21.15.78:0/87323625 >> 172.21.15.78:0/87323625 conn(0x7f3aa40fd620 msgr2=0x7f3aa40ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:11.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.910+0000 7f3aa905f640 1 -- 172.21.15.78:0/87323625 shutdown_connections 2024-09-18T12:58:11.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.910+0000 7f3aa905f640 1 -- 172.21.15.78:0/87323625 wait complete. 2024-09-18T12:58:11.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.911+0000 7f3aa905f640 1 Processor -- start 2024-09-18T12:58:11.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.912+0000 7f3aa905f640 1 -- start start 2024-09-18T12:58:11.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.912+0000 7f3aa905f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3aa4101900 0x7f3aa419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:11.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.912+0000 7f3aa905f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3aa4107900 0x7f3aa419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:11.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.912+0000 7f3aa905f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa410edd0 con 0x7f3aa4107900 2024-09-18T12:58:11.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.912+0000 7f3aa905f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa410ec50 con 0x7f3aa4101900 2024-09-18T12:58:11.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.912+0000 7f3aa259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3aa4107900 0x7f3aa419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:11.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.912+0000 7f3aa2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3aa4101900 0x7f3aa419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:11.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.912+0000 7f3aa259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3aa4107900 0x7f3aa419dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48126/0 (socket says 172.21.15.78:48126) 2024-09-18T12:58:11.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.912+0000 7f3aa259c640 1 -- 172.21.15.78:0/54410049 learned_addr learned my addr 172.21.15.78:0/54410049 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:58:11.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.912+0000 7f3aa2d9d640 1 -- 172.21.15.78:0/54410049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3aa4107900 msgr2=0x7f3aa419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:11.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.913+0000 7f3aa2d9d640 1 --2- 172.21.15.78:0/54410049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3aa4107900 0x7f3aa419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:11.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.913+0000 7f3aa2d9d640 1 -- 172.21.15.78:0/54410049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa4197820 con 0x7f3aa4101900 2024-09-18T12:58:11.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.913+0000 7f3aa259c640 1 --2- 172.21.15.78:0/54410049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3aa4107900 0x7f3aa419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:58:11.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.913+0000 7f3aa2d9d640 1 --2- 172.21.15.78:0/54410049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3aa4101900 0x7f3aa419d6a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00d6a0 tx=0x7f3a9c00db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:11.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.913+0000 7f3a8bfff640 1 -- 172.21.15.78:0/54410049 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a9c017070 con 0x7f3aa4101900 2024-09-18T12:58:11.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.913+0000 7f3aa905f640 1 -- 172.21.15.78:0/54410049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa4197b10 con 0x7f3aa4101900 2024-09-18T12:58:11.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.913+0000 7f3a8bfff640 1 -- 172.21.15.78:0/54410049 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a9c0054e0 con 0x7f3aa4101900 2024-09-18T12:58:11.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.913+0000 7f3a8bfff640 1 -- 172.21.15.78:0/54410049 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a9c004b90 con 0x7f3aa4101900 2024-09-18T12:58:11.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.913+0000 7f3aa905f640 1 -- 172.21.15.78:0/54410049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa4198070 con 0x7f3aa4101900 2024-09-18T12:58:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.915+0000 7f3aa905f640 1 -- 172.21.15.78:0/54410049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa4103040 con 0x7f3aa4101900 2024-09-18T12:58:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.915+0000 7f3a8bfff640 1 -- 172.21.15.78:0/54410049 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3a9c0097c0 con 0x7f3aa4101900 2024-09-18T12:58:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.915+0000 7f3a8bfff640 1 --2- 172.21.15.78:0/54410049 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3a8c07af80 0x7f3a8c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.915+0000 7f3aa259c640 1 --2- 172.21.15.78:0/54410049 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3a8c07af80 0x7f3a8c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.915+0000 7f3a8bfff640 1 -- 172.21.15.78:0/54410049 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f3a9c09da80 con 0x7f3aa4101900 2024-09-18T12:58:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.916+0000 7f3aa259c640 1 --2- 172.21.15.78:0/54410049 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3a8c07af80 0x7f3a8c07d440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4198b70 tx=0x7f3a980058d0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:11.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:11.920+0000 7f3a8bfff640 1 -- 172.21.15.78:0/54410049 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3a9c0690a0 con 0x7f3aa4101900 2024-09-18T12:58:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.167+0000 7f3aa905f640 1 -- 172.21.15.78:0/54410049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3aa4109e70 con 0x7f3aa4101900 2024-09-18T12:58:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.167+0000 7f3a8bfff640 1 -- 172.21.15.78:0/54410049 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f3a9c06b5c0 con 0x7f3aa4101900 2024-09-18T12:58:12.169 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:58:12.169 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:58:12.169 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:58:12.169 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:58:12.169 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:58:12.169 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:58:12.169 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:58:12.169 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:58:12.169 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T12:58:12.169 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:58:12.169 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:58:12.170 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-18T12:58:12.170 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 3 2024-09-18T12:58:12.170 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:58:12.170 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:58:12.170 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-18T12:58:12.170 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 13 2024-09-18T12:58:12.170 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:58:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:58:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.169+0000 7f3aa905f640 1 -- 172.21.15.78:0/54410049 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3a8c07af80 msgr2=0x7f3a8c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.169+0000 7f3aa905f640 1 --2- 172.21.15.78:0/54410049 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3a8c07af80 0x7f3a8c07d440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4198b70 tx=0x7f3a980058d0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.169+0000 7f3aa905f640 1 -- 172.21.15.78:0/54410049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3aa4101900 msgr2=0x7f3aa419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.169+0000 7f3aa905f640 1 --2- 172.21.15.78:0/54410049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3aa4101900 0x7f3aa419d6a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00d6a0 tx=0x7f3a9c00db60 comp rx=0 tx=0).stop 2024-09-18T12:58:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.169+0000 7f3aa905f640 1 -- 172.21.15.78:0/54410049 shutdown_connections 2024-09-18T12:58:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.169+0000 7f3aa905f640 1 --2- 172.21.15.78:0/54410049 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3a8c07af80 0x7f3a8c07d440 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.169+0000 7f3aa905f640 1 --2- 172.21.15.78:0/54410049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3aa4107900 0x7f3aa419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.169+0000 7f3aa905f640 1 --2- 172.21.15.78:0/54410049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3aa4101900 0x7f3aa419d6a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.170+0000 7f3aa905f640 1 -- 172.21.15.78:0/54410049 >> 172.21.15.78:0/54410049 conn(0x7f3aa40fd620 msgr2=0x7f3aa40fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:12.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.170+0000 7f3aa905f640 1 -- 172.21.15.78:0/54410049 shutdown_connections 2024-09-18T12:58:12.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.170+0000 7f3aa905f640 1 -- 172.21.15.78:0/54410049 wait complete. 2024-09-18T12:58:12.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.251+0000 7ffab50a0640 1 -- 172.21.15.78:0/891437407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab0100800 msgr2=0x7ffab0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:12.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.251+0000 7ffab50a0640 1 --2- 172.21.15.78:0/891437407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab0100800 0x7ffab0100c60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009880 tx=0x7ffa9802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.251+0000 7ffab50a0640 1 -- 172.21.15.78:0/891437407 shutdown_connections 2024-09-18T12:58:12.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.251+0000 7ffab50a0640 1 --2- 172.21.15.78:0/891437407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab0100800 0x7ffab0100c60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.251+0000 7ffab50a0640 1 --2- 172.21.15.78:0/891437407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffab0106800 0x7ffab0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.251+0000 7ffab50a0640 1 -- 172.21.15.78:0/891437407 >> 172.21.15.78:0/891437407 conn(0x7ffab00fc520 msgr2=0x7ffab00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:12.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.251+0000 7ffab50a0640 1 -- 172.21.15.78:0/891437407 shutdown_connections 2024-09-18T12:58:12.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.251+0000 7ffab50a0640 1 -- 172.21.15.78:0/891437407 wait complete. 2024-09-18T12:58:12.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.252+0000 7ffab50a0640 1 Processor -- start 2024-09-18T12:58:12.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.252+0000 7ffab50a0640 1 -- start start 2024-09-18T12:58:12.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.252+0000 7ffab50a0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffab0100800 0x7ffab019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:12.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.252+0000 7ffab50a0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab0106800 0x7ffab019cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:12.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.252+0000 7ffab50a0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffab010dcb0 con 0x7ffab0106800 2024-09-18T12:58:12.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.252+0000 7ffab50a0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffab010db30 con 0x7ffab0100800 2024-09-18T12:58:12.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.252+0000 7ffaa7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab0106800 0x7ffab019cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:12.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.252+0000 7ffaa7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab0106800 0x7ffab019cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48138/0 (socket says 172.21.15.78:48138) 2024-09-18T12:58:12.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.252+0000 7ffaa7fff640 1 -- 172.21.15.78:0/665871940 learned_addr learned my addr 172.21.15.78:0/665871940 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:58:12.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.252+0000 7ffaaed9d640 1 --2- 172.21.15.78:0/665871940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffab0100800 0x7ffab019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:12.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.253+0000 7ffaa7fff640 1 -- 172.21.15.78:0/665871940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffab0100800 msgr2=0x7ffab019c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:12.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.253+0000 7ffaa7fff640 1 --2- 172.21.15.78:0/665871940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffab0100800 0x7ffab019c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.253+0000 7ffaa7fff640 1 -- 172.21.15.78:0/665871940 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab01966c0 con 0x7ffab0106800 2024-09-18T12:58:12.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.253+0000 7ffaa7fff640 1 --2- 172.21.15.78:0/665871940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab0106800 0x7ffab019cb30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffa98031460 tx=0x7ffa980048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:12.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.253+0000 7ffaacd99640 1 -- 172.21.15.78:0/665871940 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa9803f070 con 0x7ffab0106800 2024-09-18T12:58:12.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.253+0000 7ffaacd99640 1 -- 172.21.15.78:0/665871940 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa98004cf0 con 0x7ffab0106800 2024-09-18T12:58:12.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.253+0000 7ffab50a0640 1 -- 172.21.15.78:0/665871940 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab0196950 con 0x7ffab0106800 2024-09-18T12:58:12.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.253+0000 7ffaacd99640 1 -- 172.21.15.78:0/665871940 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa98035030 con 0x7ffab0106800 2024-09-18T12:58:12.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.253+0000 7ffab50a0640 1 -- 172.21.15.78:0/665871940 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab0196e50 con 0x7ffab0106800 2024-09-18T12:58:12.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.254+0000 7ffab50a0640 1 -- 172.21.15.78:0/665871940 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab0101f40 con 0x7ffab0106800 2024-09-18T12:58:12.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.255+0000 7ffaacd99640 1 -- 172.21.15.78:0/665871940 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ffa98042070 con 0x7ffab0106800 2024-09-18T12:58:12.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.255+0000 7ffaacd99640 1 --2- 172.21.15.78:0/665871940 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ffa9c07af80 0x7ffa9c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:12.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.255+0000 7ffaacd99640 1 -- 172.21.15.78:0/665871940 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7ffa980beb10 con 0x7ffab0106800 2024-09-18T12:58:12.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.255+0000 7ffaaed9d640 1 --2- 172.21.15.78:0/665871940 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ffa9c07af80 0x7ffa9c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:12.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.256+0000 7ffaaed9d640 1 --2- 172.21.15.78:0/665871940 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ffa9c07af80 0x7ffa9c07d440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00058c0 tx=0x7ffaa000a2d0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:12.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.260+0000 7ffaacd99640 1 -- 172.21.15.78:0/665871940 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ffa9808a010 con 0x7ffab0106800 2024-09-18T12:58:12.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.469+0000 7ffab50a0640 1 -- 172.21.15.78:0/665871940 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ffab0108d90 con 0x7ffab0106800 2024-09-18T12:58:12.471 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:12 smithi078 ceph-mon[108578]: pgmap v270: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:12.471 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:12 smithi078 ceph-mon[108578]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:12.471 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:12 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/54410049' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:12.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.470+0000 7ffaacd99640 1 -- 172.21.15.78:0/665871940 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2002 (secure 0 0 0) 0x7ffa9808eec0 con 0x7ffab0106800 2024-09-18T12:58:12.472 INFO:teuthology.orchestra.run.smithi078.stdout:e26 2024-09-18T12:58:12.472 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:10:183617+0000 2024-09-18T12:58:12.472 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:58:12.472 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:58:12.472 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T12:58:12.472 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:58:12.472 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:58:12.472 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T12:58:12.472 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T12:58:12.472 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T12:58:12.472 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:58:12.473 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T12:58:12.473 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T12:58:12.473 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T12:58:12.473 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T12:58:12.473 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T12:58:12.473 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T12:58:12.473 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T12:58:12.473 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T12:58:12.473 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T12:58:12.473 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T12:58:12.473 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:58:12.473 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T12:58:12.473 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T12:58:12.473 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T12:58:12.474 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T12:58:12.474 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T12:58:12.474 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T12:58:12.474 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T12:58:12.474 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T12:58:12.474 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T12:58:12.474 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T12:58:12.474 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T12:58:12.474 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T12:58:12.474 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T12:58:12.474 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:58:12.474 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:58:12.474 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T12:58:12.474 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:58:12.475 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.148:6826/1048760842,v1:172.21.15.148:6827/1048760842] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:12.475 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:12.475 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:12.475 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:12.475 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 26 2024-09-18T12:58:12.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.472+0000 7ffab50a0640 1 -- 172.21.15.78:0/665871940 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ffa9c07af80 msgr2=0x7ffa9c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:12.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.472+0000 7ffab50a0640 1 --2- 172.21.15.78:0/665871940 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ffa9c07af80 0x7ffa9c07d440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00058c0 tx=0x7ffaa000a2d0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.472+0000 7ffab50a0640 1 -- 172.21.15.78:0/665871940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab0106800 msgr2=0x7ffab019cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:12.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.472+0000 7ffab50a0640 1 --2- 172.21.15.78:0/665871940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab0106800 0x7ffab019cb30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffa98031460 tx=0x7ffa980048f0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.472+0000 7ffab50a0640 1 -- 172.21.15.78:0/665871940 shutdown_connections 2024-09-18T12:58:12.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.472+0000 7ffab50a0640 1 --2- 172.21.15.78:0/665871940 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ffa9c07af80 0x7ffa9c07d440 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.472+0000 7ffab50a0640 1 --2- 172.21.15.78:0/665871940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab0106800 0x7ffab019cb30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.472+0000 7ffab50a0640 1 --2- 172.21.15.78:0/665871940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffab0100800 0x7ffab019c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.472+0000 7ffab50a0640 1 -- 172.21.15.78:0/665871940 >> 172.21.15.78:0/665871940 conn(0x7ffab00fc520 msgr2=0x7ffab00fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:12.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.472+0000 7ffab50a0640 1 -- 172.21.15.78:0/665871940 shutdown_connections 2024-09-18T12:58:12.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.472+0000 7ffab50a0640 1 -- 172.21.15.78:0/665871940 wait complete. 2024-09-18T12:58:12.477 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:12 smithi148 ceph-mon[80030]: pgmap v270: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:12.477 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:12 smithi148 ceph-mon[80030]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:12.477 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:12 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/54410049' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:12.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.554+0000 7fe0ae7a8640 1 -- 172.21.15.78:0/1640349534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100ad0 msgr2=0x7fe0a8106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:12.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.554+0000 7fe0ae7a8640 1 --2- 172.21.15.78:0/1640349534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100ad0 0x7fe0a8106610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe09c009880 tx=0x7fe09c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.554+0000 7fe0ae7a8640 1 -- 172.21.15.78:0/1640349534 shutdown_connections 2024-09-18T12:58:12.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.554+0000 7fe0ae7a8640 1 --2- 172.21.15.78:0/1640349534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100ad0 0x7fe0a8106610 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.554+0000 7fe0ae7a8640 1 --2- 172.21.15.78:0/1640349534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a8100120 0x7fe0a8100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.554+0000 7fe0ae7a8640 1 -- 172.21.15.78:0/1640349534 >> 172.21.15.78:0/1640349534 conn(0x7fe0a80fbc90 msgr2=0x7fe0a80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:12.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.554+0000 7fe0ae7a8640 1 -- 172.21.15.78:0/1640349534 shutdown_connections 2024-09-18T12:58:12.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.554+0000 7fe0ae7a8640 1 -- 172.21.15.78:0/1640349534 wait complete. 2024-09-18T12:58:12.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.555+0000 7fe0ae7a8640 1 Processor -- start 2024-09-18T12:58:12.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.555+0000 7fe0ae7a8640 1 -- start start 2024-09-18T12:58:12.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0ae7a8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a8100120 0x7fe0a819d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:12.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0ae7a8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100ad0 0x7fe0a819dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:12.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0ae7a8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a810ee40 con 0x7fe0a8100ad0 2024-09-18T12:58:12.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0ae7a8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a810ecc0 con 0x7fe0a8100120 2024-09-18T12:58:12.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0a77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100ad0 0x7fe0a819dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0a77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100ad0 0x7fe0a819dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48158/0 (socket says 172.21.15.78:48158) 2024-09-18T12:58:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0a77fe640 1 -- 172.21.15.78:0/3794926555 learned_addr learned my addr 172.21.15.78:0/3794926555 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:58:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0a7fff640 1 --2- 172.21.15.78:0/3794926555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a8100120 0x7fe0a819d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0a77fe640 1 -- 172.21.15.78:0/3794926555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a8100120 msgr2=0x7fe0a819d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0a77fe640 1 --2- 172.21.15.78:0/3794926555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a8100120 0x7fe0a819d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0a77fe640 1 -- 172.21.15.78:0/3794926555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a81978d0 con 0x7fe0a8100ad0 2024-09-18T12:58:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0a77fe640 1 --2- 172.21.15.78:0/3794926555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100ad0 0x7fe0a819dc50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe09c031460 tx=0x7fe09c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0a57fa640 1 -- 172.21.15.78:0/3794926555 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe09c03f070 con 0x7fe0a8100ad0 2024-09-18T12:58:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0a57fa640 1 -- 172.21.15.78:0/3794926555 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe09c0035f0 con 0x7fe0a8100ad0 2024-09-18T12:58:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0ae7a8640 1 -- 172.21.15.78:0/3794926555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a8197b60 con 0x7fe0a8100ad0 2024-09-18T12:58:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0a57fa640 1 -- 172.21.15.78:0/3794926555 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe09c035030 con 0x7fe0a8100ad0 2024-09-18T12:58:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.556+0000 7fe0ae7a8640 1 -- 172.21.15.78:0/3794926555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a8198090 con 0x7fe0a8100ad0 2024-09-18T12:58:12.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.557+0000 7fe0ae7a8640 1 -- 172.21.15.78:0/3794926555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a81031e0 con 0x7fe0a8100ad0 2024-09-18T12:58:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.558+0000 7fe0a57fa640 1 -- 172.21.15.78:0/3794926555 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe09c042070 con 0x7fe0a8100ad0 2024-09-18T12:58:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.559+0000 7fe0a57fa640 1 --2- 172.21.15.78:0/3794926555 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe09007af30 0x7fe09007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.559+0000 7fe0a57fa640 1 -- 172.21.15.78:0/3794926555 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7fe09c0be970 con 0x7fe0a8100ad0 2024-09-18T12:58:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.559+0000 7fe0a7fff640 1 --2- 172.21.15.78:0/3794926555 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe09007af30 0x7fe09007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:12.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.559+0000 7fe0a7fff640 1 --2- 172.21.15.78:0/3794926555 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe09007af30 0x7fe09007d3f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8198a10 tx=0x7fe09800b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:12.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.563+0000 7fe0a57fa640 1 -- 172.21.15.78:0/3794926555 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe09c0c0e20 con 0x7fe0a8100ad0 2024-09-18T12:58:12.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.757+0000 7fe0ae7a8640 1 -- 172.21.15.78:0/3794926555 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe0a8109f60 con 0x7fe09007af30 2024-09-18T12:58:12.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.758+0000 7fe0a57fa640 1 -- 172.21.15.78:0/3794926555 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fe0a8109f60 con 0x7fe09007af30 2024-09-18T12:58:12.759 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:58:12.759 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:58:12.759 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:58:12.759 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:58:12.759 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:58:12.760 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T12:58:12.760 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T12:58:12.760 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T12:58:12.760 INFO:teuthology.orchestra.run.smithi078.stdout: "mon" 2024-09-18T12:58:12.760 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:58:12.760 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "15/23 daemons upgraded", 2024-09-18T12:58:12.760 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T12:58:12.760 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:58:12.760 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:58:12.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.760+0000 7fe0ae7a8640 1 -- 172.21.15.78:0/3794926555 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe09007af30 msgr2=0x7fe09007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:12.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.760+0000 7fe0ae7a8640 1 --2- 172.21.15.78:0/3794926555 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe09007af30 0x7fe09007d3f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8198a10 tx=0x7fe09800b390 comp rx=0 tx=0).stop 2024-09-18T12:58:12.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.760+0000 7fe0ae7a8640 1 -- 172.21.15.78:0/3794926555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100ad0 msgr2=0x7fe0a819dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:12.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.760+0000 7fe0ae7a8640 1 --2- 172.21.15.78:0/3794926555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100ad0 0x7fe0a819dc50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe09c031460 tx=0x7fe09c0045e0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.760+0000 7fe0ae7a8640 1 -- 172.21.15.78:0/3794926555 shutdown_connections 2024-09-18T12:58:12.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.760+0000 7fe0ae7a8640 1 --2- 172.21.15.78:0/3794926555 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe09007af30 0x7fe09007d3f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.760+0000 7fe0ae7a8640 1 --2- 172.21.15.78:0/3794926555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a8100ad0 0x7fe0a819dc50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.760+0000 7fe0ae7a8640 1 --2- 172.21.15.78:0/3794926555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a8100120 0x7fe0a819d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.760+0000 7fe0ae7a8640 1 -- 172.21.15.78:0/3794926555 >> 172.21.15.78:0/3794926555 conn(0x7fe0a80fbc90 msgr2=0x7fe0a80fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:12.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.760+0000 7fe0ae7a8640 1 -- 172.21.15.78:0/3794926555 shutdown_connections 2024-09-18T12:58:12.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.760+0000 7fe0ae7a8640 1 -- 172.21.15.78:0/3794926555 wait complete. 2024-09-18T12:58:12.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.841+0000 7fbcd02ee640 1 -- 172.21.15.78:0/2575666907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcc81033d0 msgr2=0x7fbcc810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:12.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.841+0000 7fbcd02ee640 1 --2- 172.21.15.78:0/2575666907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcc81033d0 0x7fbcc810b8c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009880 tx=0x7fbcbc02a530 comp rx=0 tx=0).stop 2024-09-18T12:58:12.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.842+0000 7fbcd02ee640 1 -- 172.21.15.78:0/2575666907 shutdown_connections 2024-09-18T12:58:12.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.842+0000 7fbcd02ee640 1 --2- 172.21.15.78:0/2575666907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcc81033d0 0x7fbcc810b8c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.842+0000 7fbcd02ee640 1 --2- 172.21.15.78:0/2575666907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcc8102ab0 0x7fbcc8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.842+0000 7fbcd02ee640 1 -- 172.21.15.78:0/2575666907 >> 172.21.15.78:0/2575666907 conn(0x7fbcc80fc550 msgr2=0x7fbcc80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:12.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.842+0000 7fbcd02ee640 1 -- 172.21.15.78:0/2575666907 shutdown_connections 2024-09-18T12:58:12.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.842+0000 7fbcd02ee640 1 -- 172.21.15.78:0/2575666907 wait complete. 2024-09-18T12:58:12.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.842+0000 7fbcd02ee640 1 Processor -- start 2024-09-18T12:58:12.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.842+0000 7fbcd02ee640 1 -- start start 2024-09-18T12:58:12.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.842+0000 7fbcd02ee640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcc8102ab0 0x7fbcc819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:12.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.842+0000 7fbcd02ee640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcc81033d0 0x7fbcc819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:12.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.842+0000 7fbcd02ee640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc810ede0 con 0x7fbcc81033d0 2024-09-18T12:58:12.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.842+0000 7fbcd02ee640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc810ec60 con 0x7fbcc8102ab0 2024-09-18T12:58:12.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.843+0000 7fbccd889640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcc81033d0 0x7fbcc819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:12.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.843+0000 7fbccd889640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcc81033d0 0x7fbcc819dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48182/0 (socket says 172.21.15.78:48182) 2024-09-18T12:58:12.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.843+0000 7fbccd889640 1 -- 172.21.15.78:0/1282450929 learned_addr learned my addr 172.21.15.78:0/1282450929 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:58:12.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.843+0000 7fbcce08a640 1 --2- 172.21.15.78:0/1282450929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcc8102ab0 0x7fbcc819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:12.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.843+0000 7fbccd889640 1 -- 172.21.15.78:0/1282450929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcc8102ab0 msgr2=0x7fbcc819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:12.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.843+0000 7fbccd889640 1 --2- 172.21.15.78:0/1282450929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcc8102ab0 0x7fbcc819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:12.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.843+0000 7fbccd889640 1 -- 172.21.15.78:0/1282450929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc8197810 con 0x7fbcc81033d0 2024-09-18T12:58:12.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.843+0000 7fbccd889640 1 --2- 172.21.15.78:0/1282450929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcc81033d0 0x7fbcc819dbd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc031460 tx=0x7fbcbc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:12.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.843+0000 7fbcc77fe640 1 -- 172.21.15.78:0/1282450929 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbcbc03f070 con 0x7fbcc81033d0 2024-09-18T12:58:12.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.843+0000 7fbcc77fe640 1 -- 172.21.15.78:0/1282450929 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbcbc0035f0 con 0x7fbcc81033d0 2024-09-18T12:58:12.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.843+0000 7fbcd02ee640 1 -- 172.21.15.78:0/1282450929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc8197aa0 con 0x7fbcc81033d0 2024-09-18T12:58:12.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.843+0000 7fbcc77fe640 1 -- 172.21.15.78:0/1282450929 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbcbc035030 con 0x7fbcc81033d0 2024-09-18T12:58:12.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.843+0000 7fbcd02ee640 1 -- 172.21.15.78:0/1282450929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc8197fd0 con 0x7fbcc81033d0 2024-09-18T12:58:12.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.844+0000 7fbcd02ee640 1 -- 172.21.15.78:0/1282450929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc806a580 con 0x7fbcc81033d0 2024-09-18T12:58:12.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.845+0000 7fbcc77fe640 1 -- 172.21.15.78:0/1282450929 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbcbc042070 con 0x7fbcc81033d0 2024-09-18T12:58:12.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.845+0000 7fbcc77fe640 1 --2- 172.21.15.78:0/1282450929 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbcb007af80 0x7fbcb007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:12.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.845+0000 7fbcc77fe640 1 -- 172.21.15.78:0/1282450929 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7fbcbc0be890 con 0x7fbcc81033d0 2024-09-18T12:58:12.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.845+0000 7fbcce08a640 1 --2- 172.21.15.78:0/1282450929 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbcb007af80 0x7fbcb007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:12.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.846+0000 7fbcce08a640 1 --2- 172.21.15.78:0/1282450929 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbcb007af80 0x7fbcb007d440 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8005fd0 tx=0x7fbcb8009680 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:12.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:12.849+0000 7fbcc77fe640 1 -- 172.21.15.78:0/1282450929 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbcbc089eb0 con 0x7fbcc81033d0 2024-09-18T12:58:13.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:13.093+0000 7fbcd02ee640 1 -- 172.21.15.78:0/1282450929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fbcc8105f50 con 0x7fbcc81033d0 2024-09-18T12:58:13.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:13.093+0000 7fbcc77fe640 1 -- 172.21.15.78:0/1282450929 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fbcbc08ed60 con 0x7fbcc81033d0 2024-09-18T12:58:13.096 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T12:58:13.096 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T12:58:13.096 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T12:58:13.096 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:58:13.096 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:58:13.096 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T12:58:13.096 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T12:58:13.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:13.095+0000 7fbcd02ee640 1 -- 172.21.15.78:0/1282450929 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbcb007af80 msgr2=0x7fbcb007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:13.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:13.095+0000 7fbcd02ee640 1 --2- 172.21.15.78:0/1282450929 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbcb007af80 0x7fbcb007d440 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8005fd0 tx=0x7fbcb8009680 comp rx=0 tx=0).stop 2024-09-18T12:58:13.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:13.095+0000 7fbcd02ee640 1 -- 172.21.15.78:0/1282450929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcc81033d0 msgr2=0x7fbcc819dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:13.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:13.095+0000 7fbcd02ee640 1 --2- 172.21.15.78:0/1282450929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcc81033d0 0x7fbcc819dbd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc031460 tx=0x7fbcbc004530 comp rx=0 tx=0).stop 2024-09-18T12:58:13.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:13.096+0000 7fbcd02ee640 1 -- 172.21.15.78:0/1282450929 shutdown_connections 2024-09-18T12:58:13.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:13.096+0000 7fbcd02ee640 1 --2- 172.21.15.78:0/1282450929 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbcb007af80 0x7fbcb007d440 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:13.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:13.096+0000 7fbcd02ee640 1 --2- 172.21.15.78:0/1282450929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcc81033d0 0x7fbcc819dbd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:13.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:13.096+0000 7fbcd02ee640 1 --2- 172.21.15.78:0/1282450929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcc8102ab0 0x7fbcc819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:13.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:13.096+0000 7fbcd02ee640 1 -- 172.21.15.78:0/1282450929 >> 172.21.15.78:0/1282450929 conn(0x7fbcc80fc550 msgr2=0x7fbcc8108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:13.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:13.096+0000 7fbcd02ee640 1 -- 172.21.15.78:0/1282450929 shutdown_connections 2024-09-18T12:58:13.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:13.096+0000 7fbcd02ee640 1 -- 172.21.15.78:0/1282450929 wait complete. 2024-09-18T12:58:13.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:13 smithi148 ceph-mon[80030]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:13.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:13 smithi148 ceph-mon[80030]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:13.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:13 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/665871940' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:58:13.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:13 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:13.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:13 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:13.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:13 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1282450929' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:58:13.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:13 smithi078 ceph-mon[108578]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:13.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:13 smithi078 ceph-mon[108578]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:13.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:13 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/665871940' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:58:13.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:13 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:13.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:13 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:13.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:13 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1282450929' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:58:14.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:14 smithi078 ceph-mon[108578]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:14.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:14 smithi078 ceph-mon[108578]: pgmap v271: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:14.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:14 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:14.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:14 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:14.719 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:14 smithi148 ceph-mon[80030]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:14.719 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:14 smithi148 ceph-mon[80030]: pgmap v271: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:14.719 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:14 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:14.719 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:14 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:16.596 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:16 smithi148 ceph-mon[80030]: pgmap v272: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:16.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:16 smithi078 ceph-mon[108578]: pgmap v272: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:17.961 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:17 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:17.961 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:17 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:17.961 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:17 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:17.962 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:17 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:17.962 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:17 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:17.962 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:17 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:17.962 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:17 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:17.962 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:17 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:17.962 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:17 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:17.962 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:17 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:17.962 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:17 smithi148 ceph-mon[80030]: pgmap v273: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:17.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:17 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:17.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:17 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:17.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:17 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:17.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:17 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:17.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:17 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:17.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:17 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:17.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:17 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:17.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:17 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:17.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:17 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:17.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:17 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:17.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:17 smithi078 ceph-mon[108578]: pgmap v273: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:19.339 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:18 smithi148 ceph-mon[80030]: Upgrade: Updating mds.cephfs.smithi148.tvvouo 2024-09-18T12:58:19.339 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:18 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:19.339 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:18 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.tvvouo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:58:19.339 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:18 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:19.340 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:18 smithi148 ceph-mon[80030]: Deploying daemon mds.cephfs.smithi148.tvvouo on smithi148 2024-09-18T12:58:19.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:18 smithi078 ceph-mon[108578]: Upgrade: Updating mds.cephfs.smithi148.tvvouo 2024-09-18T12:58:19.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:18 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:19.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:18 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.tvvouo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T12:58:19.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:18 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:19.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:18 smithi078 ceph-mon[108578]: Deploying daemon mds.cephfs.smithi148.tvvouo on smithi148 2024-09-18T12:58:20.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:20 smithi148 ceph-mon[80030]: pgmap v274: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:20.395 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:20 smithi078 ceph-mon[108578]: pgmap v274: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:21.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:21 smithi148 ceph-mon[80030]: osdmap e82: 6 total, 6 up, 6 in 2024-09-18T12:58:21.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:21 smithi148 ceph-mon[80030]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-18T12:58:21.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:21 smithi078 ceph-mon[108578]: osdmap e82: 6 total, 6 up, 6 in 2024-09-18T12:58:21.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:21 smithi078 ceph-mon[108578]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-18T12:58:22.314 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:22 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi148.tvvouo"} : dispatch 2024-09-18T12:58:22.314 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:22 smithi148 ceph-mon[80030]: pgmap v276: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:22.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:22 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi148.tvvouo"} : dispatch 2024-09-18T12:58:22.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:22 smithi078 ceph-mon[108578]: pgmap v276: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:24.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:24 smithi148 ceph-mon[80030]: pgmap v277: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:24.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:24.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:24.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:24 smithi078 ceph-mon[108578]: pgmap v277: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:25.470 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:25 smithi078 ceph-mon[108578]: mds.? [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] up:boot 2024-09-18T12:58:25.470 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:25 smithi078 ceph-mon[108578]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-18T12:58:25.471 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:25 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi148.tvvouo"} : dispatch 2024-09-18T12:58:25.472 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:25 smithi148 ceph-mon[80030]: mds.? [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] up:boot 2024-09-18T12:58:25.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:25 smithi148 ceph-mon[80030]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-18T12:58:25.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:25 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "mds metadata", "who": "cephfs.smithi148.tvvouo"} : dispatch 2024-09-18T12:58:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:26 smithi148 ceph-mon[80030]: pgmap v278: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:26.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:26 smithi078 ceph-mon[108578]: pgmap v278: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:26.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:27.540 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:27.540 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:27.540 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:27.540 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:27 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:27.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:27.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:27.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:27.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:27 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T12:58:28.553 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:28 smithi148 ceph-mon[80030]: pgmap v279: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:28.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:28 smithi078 ceph-mon[108578]: pgmap v279: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:30.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:30 smithi078 ceph-mon[108578]: pgmap v280: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:30 smithi148 ceph-mon[80030]: pgmap v280: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:32 smithi148 ceph-mon[80030]: pgmap v281: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:32 smithi078 ceph-mon[108578]: pgmap v281: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:34 smithi148 ceph-mon[80030]: pgmap v282: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:34 smithi078 ceph-mon[108578]: pgmap v282: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:36.709 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:36 smithi078 ceph-mon[108578]: pgmap v283: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:36 smithi148 ceph-mon[80030]: pgmap v283: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:38.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:38 smithi148 ceph-mon[80030]: pgmap v284: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:38.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:38 smithi078 ceph-mon[108578]: pgmap v284: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:40.712 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:40 smithi078 ceph-mon[108578]: pgmap v285: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:40 smithi148 ceph-mon[80030]: pgmap v285: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:42.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:42 smithi078 ceph-mon[108578]: pgmap v286: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:42 smithi148 ceph-mon[80030]: pgmap v286: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:43.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.191+0000 7f3b5acd0640 1 -- 172.21.15.78:0/860148643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b54074590 msgr2=0x7f3b54074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:43.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.191+0000 7f3b5acd0640 1 --2- 172.21.15.78:0/860148643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b54074590 0x7f3b54074970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009880 tx=0x7f3b4802a530 comp rx=0 tx=0).stop 2024-09-18T12:58:43.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.191+0000 7f3b5acd0640 1 -- 172.21.15.78:0/860148643 shutdown_connections 2024-09-18T12:58:43.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.191+0000 7f3b5acd0640 1 --2- 172.21.15.78:0/860148643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b54074eb0 0x7f3b541123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.191+0000 7f3b5acd0640 1 --2- 172.21.15.78:0/860148643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b54074590 0x7f3b54074970 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.191+0000 7f3b5acd0640 1 -- 172.21.15.78:0/860148643 >> 172.21.15.78:0/860148643 conn(0x7f3b540fd600 msgr2=0x7f3b540ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:43.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.192+0000 7f3b5acd0640 1 -- 172.21.15.78:0/860148643 shutdown_connections 2024-09-18T12:58:43.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.192+0000 7f3b5acd0640 1 -- 172.21.15.78:0/860148643 wait complete. 2024-09-18T12:58:43.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.192+0000 7f3b5acd0640 1 Processor -- start 2024-09-18T12:58:43.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.192+0000 7f3b5acd0640 1 -- start start 2024-09-18T12:58:43.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.192+0000 7f3b5acd0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b54074590 0x7f3b5419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:43.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.192+0000 7f3b5acd0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b54074eb0 0x7f3b5419e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:43.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.192+0000 7f3b5acd0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3b541153d0 con 0x7f3b54074590 2024-09-18T12:58:43.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.193+0000 7f3b5acd0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b54115250 con 0x7f3b54074eb0 2024-09-18T12:58:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.193+0000 7f3b58a6c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b54074590 0x7f3b5419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.193+0000 7f3b58a6c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b54074590 0x7f3b5419dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47534/0 (socket says 172.21.15.78:47534) 2024-09-18T12:58:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.193+0000 7f3b58a6c640 1 -- 172.21.15.78:0/2939823738 learned_addr learned my addr 172.21.15.78:0/2939823738 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:58:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.193+0000 7f3b53fff640 1 --2- 172.21.15.78:0/2939823738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b54074eb0 0x7f3b5419e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.193+0000 7f3b58a6c640 1 -- 172.21.15.78:0/2939823738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b54074eb0 msgr2=0x7f3b5419e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.193+0000 7f3b58a6c640 1 --2- 172.21.15.78:0/2939823738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b54074eb0 0x7f3b5419e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.193+0000 7f3b58a6c640 1 -- 172.21.15.78:0/2939823738 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5419ebe0 con 0x7f3b54074590 2024-09-18T12:58:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.193+0000 7f3b58a6c640 1 --2- 172.21.15.78:0/2939823738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b54074590 0x7f3b5419dff0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3b48031460 tx=0x7f3b480048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.193+0000 7f3b51ffb640 1 -- 172.21.15.78:0/2939823738 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b4803f070 con 0x7f3b54074590 2024-09-18T12:58:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.193+0000 7f3b51ffb640 1 -- 172.21.15.78:0/2939823738 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3b48004cf0 con 0x7f3b54074590 2024-09-18T12:58:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.193+0000 7f3b5acd0640 1 -- 172.21.15.78:0/2939823738 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b541a2920 con 0x7f3b54074590 2024-09-18T12:58:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.193+0000 7f3b51ffb640 1 -- 172.21.15.78:0/2939823738 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b48035030 con 0x7f3b54074590 2024-09-18T12:58:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.194+0000 7f3b5acd0640 1 -- 172.21.15.78:0/2939823738 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b541a2e50 con 0x7f3b54074590 2024-09-18T12:58:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.195+0000 7f3b5acd0640 1 -- 172.21.15.78:0/2939823738 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b54075cd0 con 0x7f3b54074590 2024-09-18T12:58:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.196+0000 7f3b51ffb640 1 -- 172.21.15.78:0/2939823738 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3b48042070 con 0x7f3b54074590 2024-09-18T12:58:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.196+0000 7f3b51ffb640 1 --2- 172.21.15.78:0/2939823738 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3b4407af30 0x7f3b4407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:43.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.196+0000 7f3b51ffb640 1 -- 172.21.15.78:0/2939823738 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f3b480beb20 con 0x7f3b54074590 2024-09-18T12:58:43.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.196+0000 7f3b53fff640 1 --2- 172.21.15.78:0/2939823738 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3b4407af30 0x7f3b4407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:43.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.197+0000 7f3b53fff640 1 --2- 172.21.15.78:0/2939823738 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3b4407af30 0x7f3b4407d3f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3b40005e10 tx=0x7f3b40005da0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:43.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.201+0000 7f3b51ffb640 1 -- 172.21.15.78:0/2939823738 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3b4808a0c0 con 0x7f3b54074590 2024-09-18T12:58:43.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.394+0000 7f3b5acd0640 1 -- 172.21.15.78:0/2939823738 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3b5410f5f0 con 0x7f3b4407af30 2024-09-18T12:58:43.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.396+0000 7f3b51ffb640 1 -- 172.21.15.78:0/2939823738 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3b5410f5f0 con 0x7f3b4407af30 2024-09-18T12:58:43.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.398+0000 7f3b5acd0640 1 -- 172.21.15.78:0/2939823738 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3b4407af30 msgr2=0x7f3b4407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:43.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.398+0000 7f3b5acd0640 1 --2- 172.21.15.78:0/2939823738 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3b4407af30 0x7f3b4407d3f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3b40005e10 tx=0x7f3b40005da0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.398+0000 7f3b5acd0640 1 -- 172.21.15.78:0/2939823738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b54074590 msgr2=0x7f3b5419dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:43.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.398+0000 7f3b5acd0640 1 --2- 172.21.15.78:0/2939823738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b54074590 0x7f3b5419dff0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3b48031460 tx=0x7f3b480048f0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.398+0000 7f3b5acd0640 1 -- 172.21.15.78:0/2939823738 shutdown_connections 2024-09-18T12:58:43.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.398+0000 7f3b5acd0640 1 --2- 172.21.15.78:0/2939823738 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3b4407af30 0x7f3b4407d3f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.398+0000 7f3b5acd0640 1 --2- 172.21.15.78:0/2939823738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b54074eb0 0x7f3b5419e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.398+0000 7f3b5acd0640 1 --2- 172.21.15.78:0/2939823738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b54074590 0x7f3b5419dff0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.398+0000 7f3b5acd0640 1 -- 172.21.15.78:0/2939823738 >> 172.21.15.78:0/2939823738 conn(0x7f3b540fd600 msgr2=0x7f3b54104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:43.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.398+0000 7f3b5acd0640 1 -- 172.21.15.78:0/2939823738 shutdown_connections 2024-09-18T12:58:43.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.398+0000 7f3b5acd0640 1 -- 172.21.15.78:0/2939823738 wait complete. 2024-09-18T12:58:43.408 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:58:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.481+0000 7f0000057640 1 -- 172.21.15.78:0/163119064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efff8101900 msgr2=0x7efff8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.482+0000 7f0000057640 1 --2- 172.21.15.78:0/163119064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efff8101900 0x7efff8101d60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7effec009880 tx=0x7effec02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.482+0000 7f0000057640 1 -- 172.21.15.78:0/163119064 shutdown_connections 2024-09-18T12:58:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.482+0000 7f0000057640 1 --2- 172.21.15.78:0/163119064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efff8101900 0x7efff8101d60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.482+0000 7f0000057640 1 --2- 172.21.15.78:0/163119064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efff8107900 0x7efff8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.482+0000 7f0000057640 1 -- 172.21.15.78:0/163119064 >> 172.21.15.78:0/163119064 conn(0x7efff80fd600 msgr2=0x7efff80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:43.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.482+0000 7f0000057640 1 -- 172.21.15.78:0/163119064 shutdown_connections 2024-09-18T12:58:43.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.482+0000 7f0000057640 1 -- 172.21.15.78:0/163119064 wait complete. 2024-09-18T12:58:43.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.482+0000 7f0000057640 1 Processor -- start 2024-09-18T12:58:43.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.482+0000 7f0000057640 1 -- start start 2024-09-18T12:58:43.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.482+0000 7f0000057640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efff8101900 0x7efff819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:43.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.482+0000 7f0000057640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efff8107900 0x7efff819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:43.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.483+0000 7f0000057640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efff810edd0 con 0x7efff8107900 2024-09-18T12:58:43.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.483+0000 7f0000057640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efff810ec50 con 0x7efff8101900 2024-09-18T12:58:43.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.483+0000 7efffd5f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efff8107900 0x7efff819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:43.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.483+0000 7efffd5f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efff8107900 0x7efff819db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47556/0 (socket says 172.21.15.78:47556) 2024-09-18T12:58:43.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.483+0000 7efffd5f2640 1 -- 172.21.15.78:0/186837648 learned_addr learned my addr 172.21.15.78:0/186837648 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:58:43.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.483+0000 7efffddf3640 1 --2- 172.21.15.78:0/186837648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efff8101900 0x7efff819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:43.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.483+0000 7efffd5f2640 1 -- 172.21.15.78:0/186837648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efff8101900 msgr2=0x7efff819d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:43.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.483+0000 7efffd5f2640 1 --2- 172.21.15.78:0/186837648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efff8101900 0x7efff819d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.483+0000 7efffd5f2640 1 -- 172.21.15.78:0/186837648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff81977a0 con 0x7efff8107900 2024-09-18T12:58:43.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.483+0000 7efffd5f2640 1 --2- 172.21.15.78:0/186837648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efff8107900 0x7efff819db60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7effec031460 tx=0x7effec004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:43.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.483+0000 7efff6ffd640 1 -- 172.21.15.78:0/186837648 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7effec03f070 con 0x7efff8107900 2024-09-18T12:58:43.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.483+0000 7efff6ffd640 1 -- 172.21.15.78:0/186837648 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7effec0035f0 con 0x7efff8107900 2024-09-18T12:58:43.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.483+0000 7f0000057640 1 -- 172.21.15.78:0/186837648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff8197a30 con 0x7efff8107900 2024-09-18T12:58:43.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.483+0000 7efff6ffd640 1 -- 172.21.15.78:0/186837648 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7effec035030 con 0x7efff8107900 2024-09-18T12:58:43.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.484+0000 7f0000057640 1 -- 172.21.15.78:0/186837648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff8197f60 con 0x7efff8107900 2024-09-18T12:58:43.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.485+0000 7f0000057640 1 -- 172.21.15.78:0/186837648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efff8103040 con 0x7efff8107900 2024-09-18T12:58:43.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.485+0000 7efff6ffd640 1 -- 172.21.15.78:0/186837648 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7effec042070 con 0x7efff8107900 2024-09-18T12:58:43.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.486+0000 7efff6ffd640 1 --2- 172.21.15.78:0/186837648 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7effe007af30 0x7effe007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:43.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.486+0000 7efff6ffd640 1 -- 172.21.15.78:0/186837648 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7effec0be960 con 0x7efff8107900 2024-09-18T12:58:43.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.486+0000 7efffddf3640 1 --2- 172.21.15.78:0/186837648 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7effe007af30 0x7effe007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:43.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.486+0000 7efffddf3640 1 --2- 172.21.15.78:0/186837648 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7effe007af30 0x7effe007d3f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7effe8005fd0 tx=0x7effe8009500 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:43.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.491+0000 7efff6ffd640 1 -- 172.21.15.78:0/186837648 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7effec089f00 con 0x7efff8107900 2024-09-18T12:58:43.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.681+0000 7f0000057640 1 -- 172.21.15.78:0/186837648 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efff81982d0 con 0x7effe007af30 2024-09-18T12:58:43.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.683+0000 7efff6ffd640 1 -- 172.21.15.78:0/186837648 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7efff81982d0 con 0x7effe007af30 2024-09-18T12:58:43.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.685+0000 7f0000057640 1 -- 172.21.15.78:0/186837648 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7effe007af30 msgr2=0x7effe007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:43.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.685+0000 7f0000057640 1 --2- 172.21.15.78:0/186837648 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7effe007af30 0x7effe007d3f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7effe8005fd0 tx=0x7effe8009500 comp rx=0 tx=0).stop 2024-09-18T12:58:43.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.685+0000 7f0000057640 1 -- 172.21.15.78:0/186837648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efff8107900 msgr2=0x7efff819db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:43.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.685+0000 7f0000057640 1 --2- 172.21.15.78:0/186837648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efff8107900 0x7efff819db60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7effec031460 tx=0x7effec004530 comp rx=0 tx=0).stop 2024-09-18T12:58:43.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.685+0000 7f0000057640 1 -- 172.21.15.78:0/186837648 shutdown_connections 2024-09-18T12:58:43.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.685+0000 7f0000057640 1 --2- 172.21.15.78:0/186837648 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7effe007af30 0x7effe007d3f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.685+0000 7f0000057640 1 --2- 172.21.15.78:0/186837648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efff8107900 0x7efff819db60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.685+0000 7f0000057640 1 --2- 172.21.15.78:0/186837648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efff8101900 0x7efff819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.685+0000 7f0000057640 1 -- 172.21.15.78:0/186837648 >> 172.21.15.78:0/186837648 conn(0x7efff80fd600 msgr2=0x7efff80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:43.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.685+0000 7f0000057640 1 -- 172.21.15.78:0/186837648 shutdown_connections 2024-09-18T12:58:43.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.685+0000 7f0000057640 1 -- 172.21.15.78:0/186837648 wait complete. 2024-09-18T12:58:43.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.767+0000 7f7c11b30640 1 -- 172.21.15.78:0/3250779978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c0c106800 msgr2=0x7f7c0c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.767+0000 7f7c11b30640 1 --2- 172.21.15.78:0/3250779978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c0c106800 0x7f7c0c106be0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009880 tx=0x7f7bfc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.767+0000 7f7c11b30640 1 -- 172.21.15.78:0/3250779978 shutdown_connections 2024-09-18T12:58:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.767+0000 7f7c11b30640 1 --2- 172.21.15.78:0/3250779978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c100800 0x7f7c0c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.767+0000 7f7c11b30640 1 --2- 172.21.15.78:0/3250779978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c0c106800 0x7f7c0c106be0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.767+0000 7f7c11b30640 1 -- 172.21.15.78:0/3250779978 >> 172.21.15.78:0/3250779978 conn(0x7f7c0c0fc520 msgr2=0x7f7c0c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.767+0000 7f7c11b30640 1 -- 172.21.15.78:0/3250779978 shutdown_connections 2024-09-18T12:58:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.767+0000 7f7c11b30640 1 -- 172.21.15.78:0/3250779978 wait complete. 2024-09-18T12:58:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.768+0000 7f7c11b30640 1 Processor -- start 2024-09-18T12:58:43.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.768+0000 7f7c11b30640 1 -- start start 2024-09-18T12:58:43.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.768+0000 7f7c11b30640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c0c100800 0x7f7c0c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:43.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.768+0000 7f7c11b30640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c106800 0x7f7c0c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:43.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.768+0000 7f7c11b30640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c10dd30 con 0x7f7c0c100800 2024-09-18T12:58:43.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.768+0000 7f7c11b30640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c10dbb0 con 0x7f7c0c106800 2024-09-18T12:58:43.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.768+0000 7f7c0b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c0c100800 0x7f7c0c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:43.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.768+0000 7f7c0b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c0c100800 0x7f7c0c19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47574/0 (socket says 172.21.15.78:47574) 2024-09-18T12:58:43.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.768+0000 7f7c0b7fe640 1 -- 172.21.15.78:0/1276870512 learned_addr learned my addr 172.21.15.78:0/1276870512 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:58:43.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.768+0000 7f7c0affd640 1 --2- 172.21.15.78:0/1276870512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c106800 0x7f7c0c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:43.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.768+0000 7f7c0b7fe640 1 -- 172.21.15.78:0/1276870512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c106800 msgr2=0x7f7c0c19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:43.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.768+0000 7f7c0b7fe640 1 --2- 172.21.15.78:0/1276870512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c106800 0x7f7c0c19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.768+0000 7f7c0b7fe640 1 -- 172.21.15.78:0/1276870512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c197880 con 0x7f7c0c100800 2024-09-18T12:58:43.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.768+0000 7f7c0affd640 1 --2- 172.21.15.78:0/1276870512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c106800 0x7f7c0c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:58:43.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.769+0000 7f7c0b7fe640 1 --2- 172.21.15.78:0/1276870512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c0c100800 0x7f7c0c19d6c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc031460 tx=0x7f7bfc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:43.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.769+0000 7f7c08ff9640 1 -- 172.21.15.78:0/1276870512 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7bfc03f070 con 0x7f7c0c100800 2024-09-18T12:58:43.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.769+0000 7f7c08ff9640 1 -- 172.21.15.78:0/1276870512 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7bfc004cf0 con 0x7f7c0c100800 2024-09-18T12:58:43.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.769+0000 7f7c11b30640 1 -- 172.21.15.78:0/1276870512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0c197b10 con 0x7f7c0c100800 2024-09-18T12:58:43.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.769+0000 7f7c08ff9640 1 -- 172.21.15.78:0/1276870512 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7bfc035030 con 0x7f7c0c100800 2024-09-18T12:58:43.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.769+0000 7f7c11b30640 1 -- 172.21.15.78:0/1276870512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c0c198040 con 0x7f7c0c100800 2024-09-18T12:58:43.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.770+0000 7f7c11b30640 1 -- 172.21.15.78:0/1276870512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c0c101f40 con 0x7f7c0c100800 2024-09-18T12:58:43.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.771+0000 7f7c08ff9640 1 -- 172.21.15.78:0/1276870512 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7bfc042070 con 0x7f7c0c100800 2024-09-18T12:58:43.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.771+0000 7f7c08ff9640 1 --2- 172.21.15.78:0/1276870512 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7bf407af80 0x7f7bf407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:43.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.771+0000 7f7c0affd640 1 --2- 172.21.15.78:0/1276870512 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7bf407af80 0x7f7bf407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:43.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.771+0000 7f7c08ff9640 1 -- 172.21.15.78:0/1276870512 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f7bfc0bea40 con 0x7f7c0c100800 2024-09-18T12:58:43.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.772+0000 7f7c0affd640 1 --2- 172.21.15.78:0/1276870512 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7bf407af80 0x7f7bf407d440 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7c00006fd0 tx=0x7f7c00008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.775+0000 7f7c08ff9640 1 -- 172.21.15.78:0/1276870512 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7bfc08a060 con 0x7f7c0c100800 2024-09-18T12:58:43.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.959+0000 7f7c11b30640 1 -- 172.21.15.78:0/1276870512 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7c0c198db0 con 0x7f7bf407af80 2024-09-18T12:58:43.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.969+0000 7f7c08ff9640 1 -- 172.21.15.78:0/1276870512 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f7c0c198db0 con 0x7f7bf407af80 2024-09-18T12:58:43.970 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:58:43.971 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (6m) 46s ago 17m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T12:58:43.971 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (9m) 46s ago 17m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:58:43.971 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (8m) 17s ago 16m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:58:43.971 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (4m) 46s ago 17m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T12:58:43.971 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (4m) 17s ago 16m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T12:58:43.971 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (6m) 46s ago 17m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T12:58:43.971 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (68s) 46s ago 12m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T12:58:43.971 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (51s) 46s ago 12m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T12:58:43.971 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (34s) 17s ago 12m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T12:58:43.971 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (20s) 17s ago 12m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T12:58:43.971 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (8m) 46s ago 18m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:58:43.972 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (7m) 17s ago 16m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:58:43.972 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (5m) 46s ago 19m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T12:58:43.972 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (5m) 17s ago 16m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T12:58:43.972 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (7m) 46s ago 17m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:58:43.972 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (7m) 17s ago 16m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:58:43.973 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (4m) 46s ago 15m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T12:58:43.973 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (3m) 46s ago 15m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T12:58:43.973 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (3m) 46s ago 14m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T12:58:43.973 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (2m) 17s ago 14m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T12:58:43.973 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (117s) 17s ago 13m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T12:58:43.974 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (84s) 17s ago 13m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T12:58:43.974 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (6m) 46s ago 17m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:58:43.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.971+0000 7f7c11b30640 1 -- 172.21.15.78:0/1276870512 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7bf407af80 msgr2=0x7f7bf407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:43.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.971+0000 7f7c11b30640 1 --2- 172.21.15.78:0/1276870512 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7bf407af80 0x7f7bf407d440 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7c00006fd0 tx=0x7f7c00008040 comp rx=0 tx=0).stop 2024-09-18T12:58:43.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.971+0000 7f7c11b30640 1 -- 172.21.15.78:0/1276870512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c0c100800 msgr2=0x7f7c0c19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:43.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.971+0000 7f7c11b30640 1 --2- 172.21.15.78:0/1276870512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c0c100800 0x7f7c0c19d6c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc031460 tx=0x7f7bfc0048f0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.971+0000 7f7c11b30640 1 -- 172.21.15.78:0/1276870512 shutdown_connections 2024-09-18T12:58:43.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.971+0000 7f7c11b30640 1 --2- 172.21.15.78:0/1276870512 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7bf407af80 0x7f7bf407d440 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.971+0000 7f7c11b30640 1 --2- 172.21.15.78:0/1276870512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c0c106800 0x7f7c0c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.971+0000 7f7c11b30640 1 --2- 172.21.15.78:0/1276870512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c0c100800 0x7f7c0c19d6c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:43.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.971+0000 7f7c11b30640 1 -- 172.21.15.78:0/1276870512 >> 172.21.15.78:0/1276870512 conn(0x7f7c0c0fc520 msgr2=0x7f7c0c06a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:43.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.971+0000 7f7c11b30640 1 -- 172.21.15.78:0/1276870512 shutdown_connections 2024-09-18T12:58:43.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:43.971+0000 7f7c11b30640 1 -- 172.21.15.78:0/1276870512 wait complete. 2024-09-18T12:58:44.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.052+0000 7f4d8d991640 1 -- 172.21.15.78:0/2840827103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88100800 msgr2=0x7f4d88100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:44.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.052+0000 7f4d8d991640 1 --2- 172.21.15.78:0/2840827103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88100800 0x7f4d88100c60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4d70009880 tx=0x7f4d7002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.052+0000 7f4d8d991640 1 -- 172.21.15.78:0/2840827103 shutdown_connections 2024-09-18T12:58:44.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.052+0000 7f4d8d991640 1 --2- 172.21.15.78:0/2840827103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88100800 0x7f4d88100c60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.052+0000 7f4d8d991640 1 --2- 172.21.15.78:0/2840827103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d88106800 0x7f4d88106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.052+0000 7f4d8d991640 1 -- 172.21.15.78:0/2840827103 >> 172.21.15.78:0/2840827103 conn(0x7f4d880fc520 msgr2=0x7f4d880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:44.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.052+0000 7f4d8d991640 1 -- 172.21.15.78:0/2840827103 shutdown_connections 2024-09-18T12:58:44.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.052+0000 7f4d8d991640 1 -- 172.21.15.78:0/2840827103 wait complete. 2024-09-18T12:58:44.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.053+0000 7f4d8d991640 1 Processor -- start 2024-09-18T12:58:44.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.053+0000 7f4d8d991640 1 -- start start 2024-09-18T12:58:44.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.053+0000 7f4d8d991640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88100800 0x7f4d881987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:44.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.053+0000 7f4d8d991640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d88106800 0x7f4d88198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:44.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.053+0000 7f4d8d991640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8810dcb0 con 0x7f4d88100800 2024-09-18T12:58:44.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.053+0000 7f4d8d991640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8810db30 con 0x7f4d88106800 2024-09-18T12:58:44.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.053+0000 7f4d86ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88100800 0x7f4d881987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:44.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.053+0000 7f4d86ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88100800 0x7f4d881987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47598/0 (socket says 172.21.15.78:47598) 2024-09-18T12:58:44.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.053+0000 7f4d86ffd640 1 -- 172.21.15.78:0/2996671657 learned_addr learned my addr 172.21.15.78:0/2996671657 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:58:44.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.053+0000 7f4d867fc640 1 --2- 172.21.15.78:0/2996671657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d88106800 0x7f4d88198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:44.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.054+0000 7f4d86ffd640 1 -- 172.21.15.78:0/2996671657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d88106800 msgr2=0x7f4d88198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:44.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.054+0000 7f4d86ffd640 1 --2- 172.21.15.78:0/2996671657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d88106800 0x7f4d88198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.054+0000 7f4d86ffd640 1 -- 172.21.15.78:0/2996671657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d88199320 con 0x7f4d88100800 2024-09-18T12:58:44.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.054+0000 7f4d86ffd640 1 --2- 172.21.15.78:0/2996671657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88100800 0x7f4d881987e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000ea30 tx=0x7f4d8000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:44.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.054+0000 7f4d8c98f640 1 -- 172.21.15.78:0/2996671657 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d8000cbe0 con 0x7f4d88100800 2024-09-18T12:58:44.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.054+0000 7f4d8c98f640 1 -- 172.21.15.78:0/2996671657 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4d8000cd80 con 0x7f4d88100800 2024-09-18T12:58:44.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.054+0000 7f4d8d991640 1 -- 172.21.15.78:0/2996671657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d88199610 con 0x7f4d88100800 2024-09-18T12:58:44.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.055+0000 7f4d8c98f640 1 -- 172.21.15.78:0/2996671657 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d8001a920 con 0x7f4d88100800 2024-09-18T12:58:44.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.055+0000 7f4d8d991640 1 -- 172.21.15.78:0/2996671657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d881a1c10 con 0x7f4d88100800 2024-09-18T12:58:44.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.056+0000 7f4d8d991640 1 -- 172.21.15.78:0/2996671657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d88101f40 con 0x7f4d88100800 2024-09-18T12:58:44.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.056+0000 7f4d8c98f640 1 -- 172.21.15.78:0/2996671657 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4d8001abd0 con 0x7f4d88100800 2024-09-18T12:58:44.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.057+0000 7f4d8c98f640 1 --2- 172.21.15.78:0/2996671657 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4d7407af30 0x7f4d7407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:44.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.057+0000 7f4d8c98f640 1 -- 172.21.15.78:0/2996671657 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f4d8009e670 con 0x7f4d88100800 2024-09-18T12:58:44.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.057+0000 7f4d867fc640 1 --2- 172.21.15.78:0/2996671657 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4d7407af30 0x7f4d7407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:44.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.057+0000 7f4d867fc640 1 --2- 172.21.15.78:0/2996671657 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4d7407af30 0x7f4d7407d3f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4d8806ad00 tx=0x7f4d70031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:44.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.061+0000 7f4d8c98f640 1 -- 172.21.15.78:0/2996671657 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4d88199610 con 0x7f4d88100800 2024-09-18T12:58:44.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.319+0000 7f4d8d991640 1 -- 172.21.15.78:0/2996671657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4d88108d90 con 0x7f4d88100800 2024-09-18T12:58:44.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.320+0000 7f4d8c98f640 1 -- 172.21.15.78:0/2996671657 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f4d80016030 con 0x7f4d88100800 2024-09-18T12:58:44.322 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:58:44.322 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:58:44.322 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:58:44.322 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:58:44.322 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:58:44.322 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:58:44.322 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:58:44.323 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:58:44.323 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T12:58:44.323 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:58:44.323 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:58:44.323 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T12:58:44.323 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:58:44.323 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:58:44.324 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T12:58:44.324 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:58:44.324 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:58:44.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.322+0000 7f4d8d991640 1 -- 172.21.15.78:0/2996671657 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4d7407af30 msgr2=0x7f4d7407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:44.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.322+0000 7f4d8d991640 1 --2- 172.21.15.78:0/2996671657 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4d7407af30 0x7f4d7407d3f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4d8806ad00 tx=0x7f4d70031400 comp rx=0 tx=0).stop 2024-09-18T12:58:44.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.322+0000 7f4d8d991640 1 -- 172.21.15.78:0/2996671657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88100800 msgr2=0x7f4d881987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:44.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.322+0000 7f4d8d991640 1 --2- 172.21.15.78:0/2996671657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88100800 0x7f4d881987e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000ea30 tx=0x7f4d8000eef0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.322+0000 7f4d8d991640 1 -- 172.21.15.78:0/2996671657 shutdown_connections 2024-09-18T12:58:44.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.322+0000 7f4d8d991640 1 --2- 172.21.15.78:0/2996671657 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4d7407af30 0x7f4d7407d3f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.322+0000 7f4d8d991640 1 --2- 172.21.15.78:0/2996671657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d88106800 0x7f4d88198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.322+0000 7f4d8d991640 1 --2- 172.21.15.78:0/2996671657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88100800 0x7f4d881987e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.322+0000 7f4d8d991640 1 -- 172.21.15.78:0/2996671657 >> 172.21.15.78:0/2996671657 conn(0x7f4d880fc520 msgr2=0x7f4d880fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:44.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.322+0000 7f4d8d991640 1 -- 172.21.15.78:0/2996671657 shutdown_connections 2024-09-18T12:58:44.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.322+0000 7f4d8d991640 1 -- 172.21.15.78:0/2996671657 wait complete. 2024-09-18T12:58:44.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.404+0000 7f42e584a640 1 -- 172.21.15.78:0/1790998969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42e01033e0 msgr2=0x7f42e010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:44.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.404+0000 7f42e584a640 1 --2- 172.21.15.78:0/1790998969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42e01033e0 0x7f42e010b8d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009880 tx=0x7f42d402a530 comp rx=0 tx=0).stop 2024-09-18T12:58:44.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.404+0000 7f42e584a640 1 -- 172.21.15.78:0/1790998969 shutdown_connections 2024-09-18T12:58:44.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.404+0000 7f42e584a640 1 --2- 172.21.15.78:0/1790998969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42e01033e0 0x7f42e010b8d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.404+0000 7f42e584a640 1 --2- 172.21.15.78:0/1790998969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42e0102ac0 0x7f42e0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.404+0000 7f42e584a640 1 -- 172.21.15.78:0/1790998969 >> 172.21.15.78:0/1790998969 conn(0x7f42e00fc520 msgr2=0x7f42e00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:44.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.404+0000 7f42e584a640 1 -- 172.21.15.78:0/1790998969 shutdown_connections 2024-09-18T12:58:44.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.405+0000 7f42e584a640 1 -- 172.21.15.78:0/1790998969 wait complete. 2024-09-18T12:58:44.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.405+0000 7f42e584a640 1 Processor -- start 2024-09-18T12:58:44.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.405+0000 7f42e584a640 1 -- start start 2024-09-18T12:58:44.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.405+0000 7f42e584a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42e0102ac0 0x7f42e019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:44.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.405+0000 7f42e584a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42e01033e0 0x7f42e019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:44.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.405+0000 7f42e584a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42e010edf0 con 0x7f42e0102ac0 2024-09-18T12:58:44.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.405+0000 7f42e584a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f42e010ec70 con 0x7f42e01033e0 2024-09-18T12:58:44.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.405+0000 7f42deffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42e0102ac0 0x7f42e019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:44.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.406+0000 7f42deffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42e0102ac0 0x7f42e019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47624/0 (socket says 172.21.15.78:47624) 2024-09-18T12:58:44.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.406+0000 7f42deffd640 1 -- 172.21.15.78:0/1622212070 learned_addr learned my addr 172.21.15.78:0/1622212070 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:58:44.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.406+0000 7f42de7fc640 1 --2- 172.21.15.78:0/1622212070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42e01033e0 0x7f42e019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:44.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.406+0000 7f42deffd640 1 -- 172.21.15.78:0/1622212070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42e01033e0 msgr2=0x7f42e019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:44.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.406+0000 7f42deffd640 1 --2- 172.21.15.78:0/1622212070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42e01033e0 0x7f42e019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.406+0000 7f42deffd640 1 -- 172.21.15.78:0/1622212070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e0197800 con 0x7f42e0102ac0 2024-09-18T12:58:44.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.406+0000 7f42deffd640 1 --2- 172.21.15.78:0/1622212070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42e0102ac0 0x7f42e019d680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f42d000cc60 tx=0x7f42d000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:44.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.406+0000 7f42e4848640 1 -- 172.21.15.78:0/1622212070 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42d000ad30 con 0x7f42e0102ac0 2024-09-18T12:58:44.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.406+0000 7f42e584a640 1 -- 172.21.15.78:0/1622212070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e0197af0 con 0x7f42e0102ac0 2024-09-18T12:58:44.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.406+0000 7f42e4848640 1 -- 172.21.15.78:0/1622212070 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42d0005020 con 0x7f42e0102ac0 2024-09-18T12:58:44.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.406+0000 7f42e4848640 1 -- 172.21.15.78:0/1622212070 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42d000f640 con 0x7f42e0102ac0 2024-09-18T12:58:44.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.406+0000 7f42e584a640 1 -- 172.21.15.78:0/1622212070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e0198050 con 0x7f42e0102ac0 2024-09-18T12:58:44.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.407+0000 7f42e584a640 1 -- 172.21.15.78:0/1622212070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e006aa90 con 0x7f42e0102ac0 2024-09-18T12:58:44.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.408+0000 7f42e4848640 1 -- 172.21.15.78:0/1622212070 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f42d00051d0 con 0x7f42e0102ac0 2024-09-18T12:58:44.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.408+0000 7f42e4848640 1 --2- 172.21.15.78:0/1622212070 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f42c807af40 0x7f42c807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:44.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.408+0000 7f42e4848640 1 -- 172.21.15.78:0/1622212070 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f42d009e2e0 con 0x7f42e0102ac0 2024-09-18T12:58:44.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.409+0000 7f42de7fc640 1 --2- 172.21.15.78:0/1622212070 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f42c807af40 0x7f42c807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:44.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.409+0000 7f42de7fc640 1 --2- 172.21.15.78:0/1622212070 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f42c807af40 0x7f42c807d400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f42e0198b50 tx=0x7f42d4009560 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:44.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.413+0000 7f42e4848640 1 -- 172.21.15.78:0/1622212070 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f42d0014030 con 0x7f42e0102ac0 2024-09-18T12:58:44.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.623+0000 7f42e584a640 1 -- 172.21.15.78:0/1622212070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f42e0105f60 con 0x7f42e0102ac0 2024-09-18T12:58:44.625 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:44 smithi078 ceph-mon[108578]: pgmap v287: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:44.625 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:44 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2996671657' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:44.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.624+0000 7f42e4848640 1 -- 172.21.15.78:0/1622212070 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f42d0069880 con 0x7f42e0102ac0 2024-09-18T12:58:44.625 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T12:58:44.626 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T12:58:44.626 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:58:44.626 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:58:44.626 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T12:58:44.626 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:58:44.626 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:58:44.626 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T12:58:44.626 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T12:58:44.626 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T12:58:44.626 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:58:44.626 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T12:58:44.626 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T12:58:44.626 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T12:58:44.627 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T12:58:44.627 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T12:58:44.627 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T12:58:44.627 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T12:58:44.627 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T12:58:44.627 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T12:58:44.627 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T12:58:44.627 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:58:44.627 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T12:58:44.627 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T12:58:44.627 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T12:58:44.627 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T12:58:44.627 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T12:58:44.628 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T12:58:44.628 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T12:58:44.628 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T12:58:44.628 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T12:58:44.628 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T12:58:44.628 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T12:58:44.628 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T12:58:44.628 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T12:58:44.628 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:58:44.628 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:58:44.628 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T12:58:44.628 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:58:44.628 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:44.629 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:44.629 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:44.629 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:44.629 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T12:58:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.626+0000 7f42e584a640 1 -- 172.21.15.78:0/1622212070 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f42c807af40 msgr2=0x7f42c807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.626+0000 7f42e584a640 1 --2- 172.21.15.78:0/1622212070 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f42c807af40 0x7f42c807d400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f42e0198b50 tx=0x7f42d4009560 comp rx=0 tx=0).stop 2024-09-18T12:58:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.626+0000 7f42e584a640 1 -- 172.21.15.78:0/1622212070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42e0102ac0 msgr2=0x7f42e019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.626+0000 7f42e584a640 1 --2- 172.21.15.78:0/1622212070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42e0102ac0 0x7f42e019d680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f42d000cc60 tx=0x7f42d000a620 comp rx=0 tx=0).stop 2024-09-18T12:58:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.626+0000 7f42e584a640 1 -- 172.21.15.78:0/1622212070 shutdown_connections 2024-09-18T12:58:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.626+0000 7f42e584a640 1 --2- 172.21.15.78:0/1622212070 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f42c807af40 0x7f42c807d400 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.626+0000 7f42e584a640 1 --2- 172.21.15.78:0/1622212070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42e01033e0 0x7f42e019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.626+0000 7f42e584a640 1 --2- 172.21.15.78:0/1622212070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42e0102ac0 0x7f42e019d680 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.626+0000 7f42e584a640 1 -- 172.21.15.78:0/1622212070 >> 172.21.15.78:0/1622212070 conn(0x7f42e00fc520 msgr2=0x7f42e0108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.626+0000 7f42e584a640 1 -- 172.21.15.78:0/1622212070 shutdown_connections 2024-09-18T12:58:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.626+0000 7f42e584a640 1 -- 172.21.15.78:0/1622212070 wait complete. 2024-09-18T12:58:44.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.709+0000 7f8a55d06640 1 -- 172.21.15.78:0/723854677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a501067f0 msgr2=0x7f8a50106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:44.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.709+0000 7f8a55d06640 1 --2- 172.21.15.78:0/723854677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a501067f0 0x7f8a50106bd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009880 tx=0x7f8a4002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.709+0000 7f8a55d06640 1 -- 172.21.15.78:0/723854677 shutdown_connections 2024-09-18T12:58:44.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.709+0000 7f8a55d06640 1 --2- 172.21.15.78:0/723854677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a501007f0 0x7f8a50100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.709+0000 7f8a55d06640 1 --2- 172.21.15.78:0/723854677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a501067f0 0x7f8a50106bd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.709+0000 7f8a55d06640 1 -- 172.21.15.78:0/723854677 >> 172.21.15.78:0/723854677 conn(0x7f8a500fc550 msgr2=0x7f8a500fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:44.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.709+0000 7f8a55d06640 1 -- 172.21.15.78:0/723854677 shutdown_connections 2024-09-18T12:58:44.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.709+0000 7f8a55d06640 1 -- 172.21.15.78:0/723854677 wait complete. 2024-09-18T12:58:44.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.710+0000 7f8a55d06640 1 Processor -- start 2024-09-18T12:58:44.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.710+0000 7f8a55d06640 1 -- start start 2024-09-18T12:58:44.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.710+0000 7f8a55d06640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a501007f0 0x7f8a5019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:44.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.710+0000 7f8a55d06640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a501067f0 0x7f8a5019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:44.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.710+0000 7f8a55d06640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5010dd20 con 0x7f8a501007f0 2024-09-18T12:58:44.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.710+0000 7f8a55d06640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5010dba0 con 0x7f8a501067f0 2024-09-18T12:58:44.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.710+0000 7f8a4f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a501007f0 0x7f8a5019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:44.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.710+0000 7f8a4f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a501007f0 0x7f8a5019c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47632/0 (socket says 172.21.15.78:47632) 2024-09-18T12:58:44.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.710+0000 7f8a4f7fe640 1 -- 172.21.15.78:0/4039230956 learned_addr learned my addr 172.21.15.78:0/4039230956 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:58:44.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.710+0000 7f8a4f7fe640 1 -- 172.21.15.78:0/4039230956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a501067f0 msgr2=0x7f8a5019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:44.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.710+0000 7f8a4f7fe640 1 --2- 172.21.15.78:0/4039230956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a501067f0 0x7f8a5019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.710+0000 7f8a4f7fe640 1 -- 172.21.15.78:0/4039230956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a50196830 con 0x7f8a501007f0 2024-09-18T12:58:44.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.710+0000 7f8a4f7fe640 1 --2- 172.21.15.78:0/4039230956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a501007f0 0x7f8a5019c6b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8a40031460 tx=0x7f8a400048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:44.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.711+0000 7f8a4d7fa640 1 -- 172.21.15.78:0/4039230956 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a4003f070 con 0x7f8a501007f0 2024-09-18T12:58:44.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.711+0000 7f8a55d06640 1 -- 172.21.15.78:0/4039230956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a50196ac0 con 0x7f8a501007f0 2024-09-18T12:58:44.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.711+0000 7f8a4d7fa640 1 -- 172.21.15.78:0/4039230956 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a40004cf0 con 0x7f8a501007f0 2024-09-18T12:58:44.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.711+0000 7f8a4d7fa640 1 -- 172.21.15.78:0/4039230956 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a40035030 con 0x7f8a501007f0 2024-09-18T12:58:44.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.711+0000 7f8a55d06640 1 -- 172.21.15.78:0/4039230956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a50196ff0 con 0x7f8a501007f0 2024-09-18T12:58:44.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.712+0000 7f8a55d06640 1 -- 172.21.15.78:0/4039230956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a50101f30 con 0x7f8a501007f0 2024-09-18T12:58:44.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.712+0000 7f8a4d7fa640 1 -- 172.21.15.78:0/4039230956 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8a40042070 con 0x7f8a501007f0 2024-09-18T12:58:44.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.713+0000 7f8a4d7fa640 1 --2- 172.21.15.78:0/4039230956 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a3c07af30 0x7f8a3c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:44.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.713+0000 7f8a4d7fa640 1 -- 172.21.15.78:0/4039230956 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f8a400beb60 con 0x7f8a501007f0 2024-09-18T12:58:44.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.713+0000 7f8a47fff640 1 --2- 172.21.15.78:0/4039230956 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a3c07af30 0x7f8a3c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:44.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.713+0000 7f8a47fff640 1 --2- 172.21.15.78:0/4039230956 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a3c07af30 0x7f8a3c07d3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8a50105ea0 tx=0x7f8a38006c90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:44.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.717+0000 7f8a4d7fa640 1 -- 172.21.15.78:0/4039230956 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8a4008a100 con 0x7f8a501007f0 2024-09-18T12:58:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:44 smithi148 ceph-mon[80030]: pgmap v287: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:44 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2996671657' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:44.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.911+0000 7f8a55d06640 1 -- 172.21.15.78:0/4039230956 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8a50197360 con 0x7f8a3c07af30 2024-09-18T12:58:44.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.913+0000 7f8a4d7fa640 1 -- 172.21.15.78:0/4039230956 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8a50197360 con 0x7f8a3c07af30 2024-09-18T12:58:44.914 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:58:44.914 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:58:44.914 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:58:44.914 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:58:44.914 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:58:44.914 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T12:58:44.914 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T12:58:44.914 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T12:58:44.914 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T12:58:44.914 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T12:58:44.914 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:58:44.915 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T12:58:44.915 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T12:58:44.915 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:58:44.915 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:58:44.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.915+0000 7f8a55d06640 1 -- 172.21.15.78:0/4039230956 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a3c07af30 msgr2=0x7f8a3c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:44.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.915+0000 7f8a55d06640 1 --2- 172.21.15.78:0/4039230956 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a3c07af30 0x7f8a3c07d3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8a50105ea0 tx=0x7f8a38006c90 comp rx=0 tx=0).stop 2024-09-18T12:58:44.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.915+0000 7f8a55d06640 1 -- 172.21.15.78:0/4039230956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a501007f0 msgr2=0x7f8a5019c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:44.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.915+0000 7f8a55d06640 1 --2- 172.21.15.78:0/4039230956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a501007f0 0x7f8a5019c6b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8a40031460 tx=0x7f8a400048f0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.915+0000 7f8a55d06640 1 -- 172.21.15.78:0/4039230956 shutdown_connections 2024-09-18T12:58:44.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.915+0000 7f8a55d06640 1 --2- 172.21.15.78:0/4039230956 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a3c07af30 0x7f8a3c07d3f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.915+0000 7f8a55d06640 1 --2- 172.21.15.78:0/4039230956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a501067f0 0x7f8a5019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.915+0000 7f8a55d06640 1 --2- 172.21.15.78:0/4039230956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a501007f0 0x7f8a5019c6b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.915+0000 7f8a55d06640 1 -- 172.21.15.78:0/4039230956 >> 172.21.15.78:0/4039230956 conn(0x7f8a500fc550 msgr2=0x7f8a500fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:44.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.915+0000 7f8a55d06640 1 -- 172.21.15.78:0/4039230956 shutdown_connections 2024-09-18T12:58:44.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.915+0000 7f8a55d06640 1 -- 172.21.15.78:0/4039230956 wait complete. 2024-09-18T12:58:44.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.995+0000 7fe03d42a640 1 -- 172.21.15.78:0/1269509644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe038102ac0 msgr2=0x7fe038102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:44.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.995+0000 7fe03d42a640 1 --2- 172.21.15.78:0/1269509644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe038102ac0 0x7fe038102ea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe028009880 tx=0x7fe02802a530 comp rx=0 tx=0).stop 2024-09-18T12:58:44.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.995+0000 7fe03d42a640 1 -- 172.21.15.78:0/1269509644 shutdown_connections 2024-09-18T12:58:44.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.995+0000 7fe03d42a640 1 --2- 172.21.15.78:0/1269509644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0381033e0 0x7fe03810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.995+0000 7fe03d42a640 1 --2- 172.21.15.78:0/1269509644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe038102ac0 0x7fe038102ea0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:44.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.995+0000 7fe03d42a640 1 -- 172.21.15.78:0/1269509644 >> 172.21.15.78:0/1269509644 conn(0x7fe0380fc520 msgr2=0x7fe0380fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:44.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.995+0000 7fe03d42a640 1 -- 172.21.15.78:0/1269509644 shutdown_connections 2024-09-18T12:58:44.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.995+0000 7fe03d42a640 1 -- 172.21.15.78:0/1269509644 wait complete. 2024-09-18T12:58:44.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.996+0000 7fe03d42a640 1 Processor -- start 2024-09-18T12:58:44.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.996+0000 7fe03d42a640 1 -- start start 2024-09-18T12:58:44.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.996+0000 7fe03d42a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe038102ac0 0x7fe03819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:44.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.996+0000 7fe03d42a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0381033e0 0x7fe03819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:44.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.996+0000 7fe03d42a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe03810edf0 con 0x7fe038102ac0 2024-09-18T12:58:44.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.996+0000 7fe03d42a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe03810ec70 con 0x7fe0381033e0 2024-09-18T12:58:44.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.996+0000 7fe036ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe038102ac0 0x7fe03819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:44.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.996+0000 7fe036ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe038102ac0 0x7fe03819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47658/0 (socket says 172.21.15.78:47658) 2024-09-18T12:58:44.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.996+0000 7fe036ffd640 1 -- 172.21.15.78:0/3782690967 learned_addr learned my addr 172.21.15.78:0/3782690967 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:58:44.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.997+0000 7fe02e7fc640 1 --2- 172.21.15.78:0/3782690967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0381033e0 0x7fe03819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:44.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.997+0000 7fe036ffd640 1 -- 172.21.15.78:0/3782690967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0381033e0 msgr2=0x7fe03819db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:44.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.997+0000 7fe036ffd640 1 --2- 172.21.15.78:0/3782690967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0381033e0 0x7fe03819db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:45.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.997+0000 7fe036ffd640 1 -- 172.21.15.78:0/3782690967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0381977c0 con 0x7fe038102ac0 2024-09-18T12:58:45.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.997+0000 7fe036ffd640 1 --2- 172.21.15.78:0/3782690967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe038102ac0 0x7fe03819d640 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe028031460 tx=0x7fe0280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:45.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.997+0000 7fe034ff9640 1 -- 172.21.15.78:0/3782690967 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe02803f070 con 0x7fe038102ac0 2024-09-18T12:58:45.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.997+0000 7fe034ff9640 1 -- 172.21.15.78:0/3782690967 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe028004cf0 con 0x7fe038102ac0 2024-09-18T12:58:45.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.997+0000 7fe034ff9640 1 -- 172.21.15.78:0/3782690967 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe028035030 con 0x7fe038102ac0 2024-09-18T12:58:45.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.997+0000 7fe03d42a640 1 -- 172.21.15.78:0/3782690967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe038197a50 con 0x7fe038102ac0 2024-09-18T12:58:45.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.997+0000 7fe03d42a640 1 -- 172.21.15.78:0/3782690967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe038197f80 con 0x7fe038102ac0 2024-09-18T12:58:45.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.998+0000 7fe03d42a640 1 -- 172.21.15.78:0/3782690967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe03806aa90 con 0x7fe038102ac0 2024-09-18T12:58:45.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.999+0000 7fe034ff9640 1 -- 172.21.15.78:0/3782690967 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe028042070 con 0x7fe038102ac0 2024-09-18T12:58:45.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.999+0000 7fe034ff9640 1 --2- 172.21.15.78:0/3782690967 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe02407af80 0x7fe02407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:45.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.999+0000 7fe034ff9640 1 -- 172.21.15.78:0/3782690967 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fe0280bea40 con 0x7fe038102ac0 2024-09-18T12:58:45.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:44.999+0000 7fe02e7fc640 1 --2- 172.21.15.78:0/3782690967 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe02407af80 0x7fe02407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:45.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:45.000+0000 7fe02e7fc640 1 --2- 172.21.15.78:0/3782690967 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe02407af80 0x7fe02407d440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe038108900 tx=0x7fe020005ec0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:45.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:45.004+0000 7fe034ff9640 1 -- 172.21.15.78:0/3782690967 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe02808a060 con 0x7fe038102ac0 2024-09-18T12:58:45.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:45.249+0000 7fe03d42a640 1 -- 172.21.15.78:0/3782690967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe038198230 con 0x7fe038102ac0 2024-09-18T12:58:45.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:45.249+0000 7fe034ff9640 1 -- 172.21.15.78:0/3782690967 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fe02808ef10 con 0x7fe038102ac0 2024-09-18T12:58:45.250 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T12:58:45.250 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T12:58:45.250 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T12:58:45.250 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:58:45.251 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:58:45.251 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T12:58:45.251 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T12:58:45.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:45.251+0000 7fe03d42a640 1 -- 172.21.15.78:0/3782690967 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe02407af80 msgr2=0x7fe02407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:45.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:45.251+0000 7fe03d42a640 1 --2- 172.21.15.78:0/3782690967 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe02407af80 0x7fe02407d440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe038108900 tx=0x7fe020005ec0 comp rx=0 tx=0).stop 2024-09-18T12:58:45.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:45.251+0000 7fe03d42a640 1 -- 172.21.15.78:0/3782690967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe038102ac0 msgr2=0x7fe03819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:45.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:45.251+0000 7fe03d42a640 1 --2- 172.21.15.78:0/3782690967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe038102ac0 0x7fe03819d640 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe028031460 tx=0x7fe0280048f0 comp rx=0 tx=0).stop 2024-09-18T12:58:45.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:45.251+0000 7fe03d42a640 1 -- 172.21.15.78:0/3782690967 shutdown_connections 2024-09-18T12:58:45.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:45.251+0000 7fe03d42a640 1 --2- 172.21.15.78:0/3782690967 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe02407af80 0x7fe02407d440 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:45.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:45.251+0000 7fe03d42a640 1 --2- 172.21.15.78:0/3782690967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0381033e0 0x7fe03819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:45.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:45.251+0000 7fe03d42a640 1 --2- 172.21.15.78:0/3782690967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe038102ac0 0x7fe03819d640 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:45.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:45.251+0000 7fe03d42a640 1 -- 172.21.15.78:0/3782690967 >> 172.21.15.78:0/3782690967 conn(0x7fe0380fc520 msgr2=0x7fe03810aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:45.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:45.251+0000 7fe03d42a640 1 -- 172.21.15.78:0/3782690967 shutdown_connections 2024-09-18T12:58:45.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:58:45.251+0000 7fe03d42a640 1 -- 172.21.15.78:0/3782690967 wait complete. 2024-09-18T12:58:45.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:45 smithi078 ceph-mon[108578]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:45.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:45 smithi078 ceph-mon[108578]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:45.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:45 smithi078 ceph-mon[108578]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:45.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:45 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1622212070' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:58:45.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:45 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3782690967' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:58:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:45 smithi148 ceph-mon[80030]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:45 smithi148 ceph-mon[80030]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:45 smithi148 ceph-mon[80030]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:45 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1622212070' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:58:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:45 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3782690967' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:58:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:46 smithi148 ceph-mon[80030]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:46 smithi148 ceph-mon[80030]: pgmap v288: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:46 smithi078 ceph-mon[108578]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:46 smithi078 ceph-mon[108578]: pgmap v288: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:48.711 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:48 smithi078 ceph-mon[108578]: pgmap v289: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:48.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:48 smithi148 ceph-mon[80030]: pgmap v289: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:50 smithi148 ceph-mon[80030]: pgmap v290: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:50.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:50 smithi078 ceph-mon[108578]: pgmap v290: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:51.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:51 smithi078 ceph-mon[108578]: pgmap v291: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:51.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:51 smithi148 ceph-mon[80030]: pgmap v291: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:54.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:54 smithi148 ceph-mon[80030]: pgmap v292: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:54.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:54 smithi078 ceph-mon[108578]: pgmap v292: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:56 smithi148 ceph-mon[80030]: pgmap v293: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:56 smithi078 ceph-mon[108578]: pgmap v293: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:58.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:58:58 smithi148 ceph-mon[80030]: pgmap v294: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:58:58.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:58:58 smithi078 ceph-mon[108578]: pgmap v294: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:00.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:00 smithi148 ceph-mon[80030]: pgmap v295: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:00.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:00 smithi078 ceph-mon[108578]: pgmap v295: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:02.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:02 smithi148 ceph-mon[80030]: pgmap v296: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:02 smithi078 ceph-mon[108578]: pgmap v296: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:04.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:04 smithi148 ceph-mon[80030]: pgmap v297: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:04 smithi078 ceph-mon[108578]: pgmap v297: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:06.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:06 smithi148 ceph-mon[80030]: pgmap v298: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:06.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:06 smithi078 ceph-mon[108578]: pgmap v298: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:08.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:08 smithi148 ceph-mon[80030]: pgmap v299: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:08.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:08 smithi078 ceph-mon[108578]: pgmap v299: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:10.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:10 smithi148 ceph-mon[80030]: pgmap v300: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:10.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:10 smithi078 ceph-mon[108578]: pgmap v300: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:11.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:12.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:12 smithi078 ceph-mon[108578]: pgmap v301: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:12.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:12 smithi148 ceph-mon[80030]: pgmap v301: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:14.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:14 smithi078 ceph-mon[108578]: pgmap v302: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:14 smithi148 ceph-mon[80030]: pgmap v302: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:15.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.345+0000 7fd54a633640 1 -- 172.21.15.78:0/1543669628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544100af0 msgr2=0x7fd544106630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:15.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.345+0000 7fd54a633640 1 --2- 172.21.15.78:0/1543669628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544100af0 0x7fd544106630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd538009880 tx=0x7fd53802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.346+0000 7fd54a633640 1 -- 172.21.15.78:0/1543669628 shutdown_connections 2024-09-18T12:59:15.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.346+0000 7fd54a633640 1 --2- 172.21.15.78:0/1543669628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544100af0 0x7fd544106630 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.346+0000 7fd54a633640 1 --2- 172.21.15.78:0/1543669628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd544100140 0x7fd544100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.346+0000 7fd54a633640 1 -- 172.21.15.78:0/1543669628 >> 172.21.15.78:0/1543669628 conn(0x7fd5440fbc90 msgr2=0x7fd5440fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.346+0000 7fd54a633640 1 -- 172.21.15.78:0/1543669628 shutdown_connections 2024-09-18T12:59:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.346+0000 7fd54a633640 1 -- 172.21.15.78:0/1543669628 wait complete. 2024-09-18T12:59:15.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.346+0000 7fd54a633640 1 Processor -- start 2024-09-18T12:59:15.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.346+0000 7fd54a633640 1 -- start start 2024-09-18T12:59:15.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.347+0000 7fd54a633640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544100140 0x7fd54419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:15.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.347+0000 7fd54a633640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd544100af0 0x7fd54419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:15.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.347+0000 7fd54a633640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd54410ee40 con 0x7fd544100140 2024-09-18T12:59:15.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.347+0000 7fd54a633640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd54410ecc0 con 0x7fd544100af0 2024-09-18T12:59:15.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.347+0000 7fd543fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544100140 0x7fd54419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:15.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.347+0000 7fd543fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544100140 0x7fd54419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47092/0 (socket says 172.21.15.78:47092) 2024-09-18T12:59:15.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.347+0000 7fd543fff640 1 -- 172.21.15.78:0/2922319634 learned_addr learned my addr 172.21.15.78:0/2922319634 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:59:15.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.347+0000 7fd5437fe640 1 --2- 172.21.15.78:0/2922319634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd544100af0 0x7fd54419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:15.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.347+0000 7fd543fff640 1 -- 172.21.15.78:0/2922319634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd544100af0 msgr2=0x7fd54419dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.347+0000 7fd543fff640 1 --2- 172.21.15.78:0/2922319634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd544100af0 0x7fd54419dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.347+0000 7fd543fff640 1 -- 172.21.15.78:0/2922319634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd544197810 con 0x7fd544100140 2024-09-18T12:59:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.347+0000 7fd5437fe640 1 --2- 172.21.15.78:0/2922319634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd544100af0 0x7fd54419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:59:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.348+0000 7fd543fff640 1 --2- 172.21.15.78:0/2922319634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544100140 0x7fd54419d690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd53400d6f0 tx=0x7fd53400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.348+0000 7fd5417fa640 1 -- 172.21.15.78:0/2922319634 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd534017070 con 0x7fd544100140 2024-09-18T12:59:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.348+0000 7fd5417fa640 1 -- 172.21.15.78:0/2922319634 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd53400de00 con 0x7fd544100140 2024-09-18T12:59:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.348+0000 7fd5417fa640 1 -- 172.21.15.78:0/2922319634 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd534004bb0 con 0x7fd544100140 2024-09-18T12:59:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.348+0000 7fd54a633640 1 -- 172.21.15.78:0/2922319634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd544197b00 con 0x7fd544100140 2024-09-18T12:59:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.348+0000 7fd54a633640 1 -- 172.21.15.78:0/2922319634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd544198060 con 0x7fd544100140 2024-09-18T12:59:15.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.349+0000 7fd54a633640 1 -- 172.21.15.78:0/2922319634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd544103200 con 0x7fd544100140 2024-09-18T12:59:15.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.350+0000 7fd5417fa640 1 -- 172.21.15.78:0/2922319634 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd534009a30 con 0x7fd544100140 2024-09-18T12:59:15.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.350+0000 7fd5417fa640 1 --2- 172.21.15.78:0/2922319634 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd52c07af80 0x7fd52c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:15.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.350+0000 7fd5417fa640 1 -- 172.21.15.78:0/2922319634 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fd53409dc70 con 0x7fd544100140 2024-09-18T12:59:15.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.351+0000 7fd5437fe640 1 --2- 172.21.15.78:0/2922319634 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd52c07af80 0x7fd52c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:15.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.351+0000 7fd5437fe640 1 --2- 172.21.15.78:0/2922319634 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd52c07af80 0x7fd52c07d440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd538000c00 tx=0x7fd538031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:15.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.355+0000 7fd5417fa640 1 -- 172.21.15.78:0/2922319634 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd5340a4080 con 0x7fd544100140 2024-09-18T12:59:15.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.549+0000 7fd54a633640 1 -- 172.21.15.78:0/2922319634 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd5441982e0 con 0x7fd52c07af80 2024-09-18T12:59:15.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.551+0000 7fd5417fa640 1 -- 172.21.15.78:0/2922319634 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd5441982e0 con 0x7fd52c07af80 2024-09-18T12:59:15.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.553+0000 7fd54a633640 1 -- 172.21.15.78:0/2922319634 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd52c07af80 msgr2=0x7fd52c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:15.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.553+0000 7fd54a633640 1 --2- 172.21.15.78:0/2922319634 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd52c07af80 0x7fd52c07d440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd538000c00 tx=0x7fd538031400 comp rx=0 tx=0).stop 2024-09-18T12:59:15.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.553+0000 7fd54a633640 1 -- 172.21.15.78:0/2922319634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544100140 msgr2=0x7fd54419d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:15.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.553+0000 7fd54a633640 1 --2- 172.21.15.78:0/2922319634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544100140 0x7fd54419d690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd53400d6f0 tx=0x7fd53400dbb0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.553+0000 7fd54a633640 1 -- 172.21.15.78:0/2922319634 shutdown_connections 2024-09-18T12:59:15.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.553+0000 7fd54a633640 1 --2- 172.21.15.78:0/2922319634 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd52c07af80 0x7fd52c07d440 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.553+0000 7fd54a633640 1 --2- 172.21.15.78:0/2922319634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd544100af0 0x7fd54419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.553+0000 7fd54a633640 1 --2- 172.21.15.78:0/2922319634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544100140 0x7fd54419d690 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.553+0000 7fd54a633640 1 -- 172.21.15.78:0/2922319634 >> 172.21.15.78:0/2922319634 conn(0x7fd5440fbc90 msgr2=0x7fd544105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:15.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.553+0000 7fd54a633640 1 -- 172.21.15.78:0/2922319634 shutdown_connections 2024-09-18T12:59:15.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.553+0000 7fd54a633640 1 -- 172.21.15.78:0/2922319634 wait complete. 2024-09-18T12:59:15.563 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:59:15.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.635+0000 7f32eb9b2640 1 -- 172.21.15.78:0/3104333083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e4103440 msgr2=0x7f32e410b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:15.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.635+0000 7f32eb9b2640 1 --2- 172.21.15.78:0/3104333083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e4103440 0x7f32e410b930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f32d80098b0 tx=0x7f32d802a560 comp rx=0 tx=0).stop 2024-09-18T12:59:15.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.635+0000 7f32eb9b2640 1 -- 172.21.15.78:0/3104333083 shutdown_connections 2024-09-18T12:59:15.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.635+0000 7f32eb9b2640 1 --2- 172.21.15.78:0/3104333083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e4103440 0x7f32e410b930 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.635+0000 7f32eb9b2640 1 --2- 172.21.15.78:0/3104333083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e4102b20 0x7f32e4102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.635+0000 7f32eb9b2640 1 -- 172.21.15.78:0/3104333083 >> 172.21.15.78:0/3104333083 conn(0x7f32e40fc520 msgr2=0x7f32e40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:15.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.635+0000 7f32eb9b2640 1 -- 172.21.15.78:0/3104333083 shutdown_connections 2024-09-18T12:59:15.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.635+0000 7f32eb9b2640 1 -- 172.21.15.78:0/3104333083 wait complete. 2024-09-18T12:59:15.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.636+0000 7f32eb9b2640 1 Processor -- start 2024-09-18T12:59:15.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.636+0000 7f32eb9b2640 1 -- start start 2024-09-18T12:59:15.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.636+0000 7f32eb9b2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e4102b20 0x7f32e419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:15.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.636+0000 7f32eb9b2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e4103440 0x7f32e419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:15.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.636+0000 7f32eb9b2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32e410ee50 con 0x7f32e4102b20 2024-09-18T12:59:15.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.636+0000 7f32eb9b2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f32e410ecd0 con 0x7f32e4103440 2024-09-18T12:59:15.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.637+0000 7f32e974e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e4102b20 0x7f32e419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:15.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.637+0000 7f32e974e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e4102b20 0x7f32e419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47110/0 (socket says 172.21.15.78:47110) 2024-09-18T12:59:15.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.637+0000 7f32e974e640 1 -- 172.21.15.78:0/2248063185 learned_addr learned my addr 172.21.15.78:0/2248063185 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:59:15.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.637+0000 7f32e8f4d640 1 --2- 172.21.15.78:0/2248063185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e4103440 0x7f32e419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:15.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.637+0000 7f32e974e640 1 -- 172.21.15.78:0/2248063185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e4103440 msgr2=0x7f32e419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:15.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.637+0000 7f32e974e640 1 --2- 172.21.15.78:0/2248063185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e4103440 0x7f32e419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.637+0000 7f32e974e640 1 -- 172.21.15.78:0/2248063185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e4197840 con 0x7f32e4102b20 2024-09-18T12:59:15.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.637+0000 7f32e974e640 1 --2- 172.21.15.78:0/2248063185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e4102b20 0x7f32e419d6c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f32e000b420 tx=0x7f32e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:15.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.637+0000 7f32d67fc640 1 -- 172.21.15.78:0/2248063185 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f32e0011630 con 0x7f32e4102b20 2024-09-18T12:59:15.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.637+0000 7f32d67fc640 1 -- 172.21.15.78:0/2248063185 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f32e0016070 con 0x7f32e4102b20 2024-09-18T12:59:15.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.637+0000 7f32eb9b2640 1 -- 172.21.15.78:0/2248063185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e4197b30 con 0x7f32e4102b20 2024-09-18T12:59:15.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.637+0000 7f32d67fc640 1 -- 172.21.15.78:0/2248063185 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f32e0010d40 con 0x7f32e4102b20 2024-09-18T12:59:15.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.637+0000 7f32eb9b2640 1 -- 172.21.15.78:0/2248063185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e4198090 con 0x7f32e4102b20 2024-09-18T12:59:15.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.638+0000 7f32eb9b2640 1 -- 172.21.15.78:0/2248063185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e406aa30 con 0x7f32e4102b20 2024-09-18T12:59:15.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.639+0000 7f32d67fc640 1 -- 172.21.15.78:0/2248063185 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f32e001b460 con 0x7f32e4102b20 2024-09-18T12:59:15.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.639+0000 7f32d67fc640 1 --2- 172.21.15.78:0/2248063185 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f32d007af90 0x7f32d007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:15.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.640+0000 7f32d67fc640 1 -- 172.21.15.78:0/2248063185 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f32e009d7b0 con 0x7f32e4102b20 2024-09-18T12:59:15.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.640+0000 7f32e8f4d640 1 --2- 172.21.15.78:0/2248063185 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f32d007af90 0x7f32d007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:15.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.640+0000 7f32e8f4d640 1 --2- 172.21.15.78:0/2248063185 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f32d007af90 0x7f32d007d450 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f32d8000c00 tx=0x7f32d80095c0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:15.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.644+0000 7f32d67fc640 1 -- 172.21.15.78:0/2248063185 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f32e0021250 con 0x7f32e4102b20 2024-09-18T12:59:15.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.839+0000 7f32eb9b2640 1 -- 172.21.15.78:0/2248063185 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f32e4198370 con 0x7f32d007af90 2024-09-18T12:59:15.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.841+0000 7f32d67fc640 1 -- 172.21.15.78:0/2248063185 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f32e4198370 con 0x7f32d007af90 2024-09-18T12:59:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.843+0000 7f32eb9b2640 1 -- 172.21.15.78:0/2248063185 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f32d007af90 msgr2=0x7f32d007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.843+0000 7f32eb9b2640 1 --2- 172.21.15.78:0/2248063185 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f32d007af90 0x7f32d007d450 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f32d8000c00 tx=0x7f32d80095c0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.843+0000 7f32eb9b2640 1 -- 172.21.15.78:0/2248063185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e4102b20 msgr2=0x7f32e419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.843+0000 7f32eb9b2640 1 --2- 172.21.15.78:0/2248063185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e4102b20 0x7f32e419d6c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f32e000b420 tx=0x7f32e000b8e0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.843+0000 7f32eb9b2640 1 -- 172.21.15.78:0/2248063185 shutdown_connections 2024-09-18T12:59:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.843+0000 7f32eb9b2640 1 --2- 172.21.15.78:0/2248063185 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f32d007af90 0x7f32d007d450 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.843+0000 7f32eb9b2640 1 --2- 172.21.15.78:0/2248063185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e4103440 0x7f32e419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.843+0000 7f32eb9b2640 1 --2- 172.21.15.78:0/2248063185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e4102b20 0x7f32e419d6c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.843+0000 7f32eb9b2640 1 -- 172.21.15.78:0/2248063185 >> 172.21.15.78:0/2248063185 conn(0x7f32e40fc520 msgr2=0x7f32e4103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.843+0000 7f32eb9b2640 1 -- 172.21.15.78:0/2248063185 shutdown_connections 2024-09-18T12:59:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.843+0000 7f32eb9b2640 1 -- 172.21.15.78:0/2248063185 wait complete. 2024-09-18T12:59:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.925+0000 7f3d47088640 1 -- 172.21.15.78:0/944781677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d40107900 msgr2=0x7f3d40107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.925+0000 7f3d47088640 1 --2- 172.21.15.78:0/944781677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d40107900 0x7f3d40107ce0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009880 tx=0x7f3d3402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.925+0000 7f3d47088640 1 -- 172.21.15.78:0/944781677 shutdown_connections 2024-09-18T12:59:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.925+0000 7f3d47088640 1 --2- 172.21.15.78:0/944781677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d40101900 0x7f3d40101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.925+0000 7f3d47088640 1 --2- 172.21.15.78:0/944781677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d40107900 0x7f3d40107ce0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.925+0000 7f3d47088640 1 -- 172.21.15.78:0/944781677 >> 172.21.15.78:0/944781677 conn(0x7f3d400fd600 msgr2=0x7f3d400ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.925+0000 7f3d47088640 1 -- 172.21.15.78:0/944781677 shutdown_connections 2024-09-18T12:59:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.925+0000 7f3d47088640 1 -- 172.21.15.78:0/944781677 wait complete. 2024-09-18T12:59:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.925+0000 7f3d47088640 1 Processor -- start 2024-09-18T12:59:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.925+0000 7f3d47088640 1 -- start start 2024-09-18T12:59:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.926+0000 7f3d47088640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d40101900 0x7f3d400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.926+0000 7f3d47088640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d40107900 0x7f3d40074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.926+0000 7f3d47088640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4010edd0 con 0x7f3d40101900 2024-09-18T12:59:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.926+0000 7f3d47088640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4010ec50 con 0x7f3d40107900 2024-09-18T12:59:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.926+0000 7f3d44e24640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d40101900 0x7f3d400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.926+0000 7f3d44e24640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d40101900 0x7f3d400744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47126/0 (socket says 172.21.15.78:47126) 2024-09-18T12:59:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.926+0000 7f3d44e24640 1 -- 172.21.15.78:0/401005745 learned_addr learned my addr 172.21.15.78:0/401005745 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:59:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.926+0000 7f3d3ffff640 1 --2- 172.21.15.78:0/401005745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d40107900 0x7f3d40074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.926+0000 7f3d44e24640 1 -- 172.21.15.78:0/401005745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d40107900 msgr2=0x7f3d40074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.926+0000 7f3d44e24640 1 --2- 172.21.15.78:0/401005745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d40107900 0x7f3d40074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.926+0000 7f3d44e24640 1 -- 172.21.15.78:0/401005745 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d40074f70 con 0x7f3d40101900 2024-09-18T12:59:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.926+0000 7f3d3ffff640 1 --2- 172.21.15.78:0/401005745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d40107900 0x7f3d40074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:59:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.926+0000 7f3d44e24640 1 --2- 172.21.15.78:0/401005745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d40101900 0x7f3d400744f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3d34031460 tx=0x7f3d340045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.926+0000 7f3d3dffb640 1 -- 172.21.15.78:0/401005745 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d3403f070 con 0x7f3d40101900 2024-09-18T12:59:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.927+0000 7f3d47088640 1 -- 172.21.15.78:0/401005745 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d40075200 con 0x7f3d40101900 2024-09-18T12:59:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.927+0000 7f3d3dffb640 1 -- 172.21.15.78:0/401005745 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d340035f0 con 0x7f3d40101900 2024-09-18T12:59:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.927+0000 7f3d3dffb640 1 -- 172.21.15.78:0/401005745 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d34035030 con 0x7f3d40101900 2024-09-18T12:59:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.927+0000 7f3d47088640 1 -- 172.21.15.78:0/401005745 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d401a3d60 con 0x7f3d40101900 2024-09-18T12:59:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.928+0000 7f3d47088640 1 -- 172.21.15.78:0/401005745 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d40103040 con 0x7f3d40101900 2024-09-18T12:59:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.928+0000 7f3d3dffb640 1 -- 172.21.15.78:0/401005745 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3d34042070 con 0x7f3d40101900 2024-09-18T12:59:15.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.929+0000 7f3d3dffb640 1 --2- 172.21.15.78:0/401005745 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3d3007af30 0x7f3d3007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:15.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.929+0000 7f3d3dffb640 1 -- 172.21.15.78:0/401005745 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f3d340beb20 con 0x7f3d40101900 2024-09-18T12:59:15.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.929+0000 7f3d3ffff640 1 --2- 172.21.15.78:0/401005745 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3d3007af30 0x7f3d3007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:15.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.930+0000 7f3d3ffff640 1 --2- 172.21.15.78:0/401005745 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3d3007af30 0x7f3d3007d3f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c0058c0 tx=0x7f3d2c005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:15.933+0000 7f3d3dffb640 1 -- 172.21.15.78:0/401005745 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3d3408a020 con 0x7f3d40101900 2024-09-18T12:59:16.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.114+0000 7f3d47088640 1 -- 172.21.15.78:0/401005745 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3d40062630 con 0x7f3d3007af30 2024-09-18T12:59:16.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.124+0000 7f3d3dffb640 1 -- 172.21.15.78:0/401005745 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f3d40062630 con 0x7f3d3007af30 2024-09-18T12:59:16.125 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:59:16.125 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (7m) 78s ago 18m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T12:59:16.125 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (9m) 78s ago 18m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:59:16.125 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (9m) 49s ago 17m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:59:16.125 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (5m) 78s ago 18m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T12:59:16.126 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (5m) 49s ago 17m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T12:59:16.126 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (6m) 78s ago 17m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T12:59:16.126 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (100s) 78s ago 12m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T12:59:16.126 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (83s) 78s ago 12m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T12:59:16.126 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (66s) 49s ago 12m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T12:59:16.126 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (53s) 49s ago 12m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T12:59:16.126 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (9m) 78s ago 19m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:59:16.126 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (8m) 49s ago 17m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:59:16.126 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (5m) 78s ago 19m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T12:59:16.126 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (5m) 49s ago 17m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T12:59:16.126 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (7m) 78s ago 18m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:59:16.126 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (7m) 49s ago 17m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:59:16.126 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (4m) 78s ago 16m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T12:59:16.126 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (4m) 78s ago 15m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T12:59:16.127 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (3m) 78s ago 15m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T12:59:16.127 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (3m) 49s ago 14m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T12:59:16.127 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (2m) 49s ago 14m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T12:59:16.127 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (116s) 49s ago 13m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T12:59:16.127 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (7m) 78s ago 17m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:59:16.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.126+0000 7f3d47088640 1 -- 172.21.15.78:0/401005745 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3d3007af30 msgr2=0x7f3d3007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:16.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.126+0000 7f3d47088640 1 --2- 172.21.15.78:0/401005745 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3d3007af30 0x7f3d3007d3f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c0058c0 tx=0x7f3d2c005850 comp rx=0 tx=0).stop 2024-09-18T12:59:16.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.126+0000 7f3d47088640 1 -- 172.21.15.78:0/401005745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d40101900 msgr2=0x7f3d400744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:16.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.126+0000 7f3d47088640 1 --2- 172.21.15.78:0/401005745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d40101900 0x7f3d400744f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3d34031460 tx=0x7f3d340045e0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.126+0000 7f3d47088640 1 -- 172.21.15.78:0/401005745 shutdown_connections 2024-09-18T12:59:16.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.126+0000 7f3d47088640 1 --2- 172.21.15.78:0/401005745 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3d3007af30 0x7f3d3007d3f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.126+0000 7f3d47088640 1 --2- 172.21.15.78:0/401005745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d40107900 0x7f3d40074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.126+0000 7f3d47088640 1 --2- 172.21.15.78:0/401005745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d40101900 0x7f3d400744f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.127+0000 7f3d47088640 1 -- 172.21.15.78:0/401005745 >> 172.21.15.78:0/401005745 conn(0x7f3d400fd600 msgr2=0x7f3d400fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:16.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.127+0000 7f3d47088640 1 -- 172.21.15.78:0/401005745 shutdown_connections 2024-09-18T12:59:16.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.127+0000 7f3d47088640 1 -- 172.21.15.78:0/401005745 wait complete. 2024-09-18T12:59:16.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.206+0000 7fcaea5f4640 1 -- 172.21.15.78:0/3831534651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae4100800 msgr2=0x7fcae4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:16.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.206+0000 7fcaea5f4640 1 --2- 172.21.15.78:0/3831534651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae4100800 0x7fcae4100c60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009880 tx=0x7fcad802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.206+0000 7fcaea5f4640 1 -- 172.21.15.78:0/3831534651 shutdown_connections 2024-09-18T12:59:16.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.206+0000 7fcaea5f4640 1 --2- 172.21.15.78:0/3831534651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae4100800 0x7fcae4100c60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.206+0000 7fcaea5f4640 1 --2- 172.21.15.78:0/3831534651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae4106800 0x7fcae4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.206+0000 7fcaea5f4640 1 -- 172.21.15.78:0/3831534651 >> 172.21.15.78:0/3831534651 conn(0x7fcae40fc520 msgr2=0x7fcae40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:16.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.206+0000 7fcaea5f4640 1 -- 172.21.15.78:0/3831534651 shutdown_connections 2024-09-18T12:59:16.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.207+0000 7fcaea5f4640 1 -- 172.21.15.78:0/3831534651 wait complete. 2024-09-18T12:59:16.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.207+0000 7fcaea5f4640 1 Processor -- start 2024-09-18T12:59:16.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.207+0000 7fcaea5f4640 1 -- start start 2024-09-18T12:59:16.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.208+0000 7fcaea5f4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae4100800 0x7fcae4198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:16.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.208+0000 7fcaea5f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae4106800 0x7fcae4198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:16.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.208+0000 7fcaea5f4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcae410dd30 con 0x7fcae4106800 2024-09-18T12:59:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.208+0000 7fcaea5f4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcae410dbb0 con 0x7fcae4100800 2024-09-18T12:59:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.208+0000 7fcae37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae4106800 0x7fcae4198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.208+0000 7fcae37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae4106800 0x7fcae4198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47130/0 (socket says 172.21.15.78:47130) 2024-09-18T12:59:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.208+0000 7fcae37fe640 1 -- 172.21.15.78:0/865490297 learned_addr learned my addr 172.21.15.78:0/865490297 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:59:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.208+0000 7fcae3fff640 1 --2- 172.21.15.78:0/865490297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae4100800 0x7fcae4198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.208+0000 7fcae37fe640 1 -- 172.21.15.78:0/865490297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae4100800 msgr2=0x7fcae4198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.208+0000 7fcae37fe640 1 --2- 172.21.15.78:0/865490297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae4100800 0x7fcae4198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.208+0000 7fcae37fe640 1 -- 172.21.15.78:0/865490297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae41993c0 con 0x7fcae4106800 2024-09-18T12:59:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.208+0000 7fcae37fe640 1 --2- 172.21.15.78:0/865490297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae4106800 0x7fcae4198dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcad8031460 tx=0x7fcad80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.209+0000 7fcae17fa640 1 -- 172.21.15.78:0/865490297 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcad803f070 con 0x7fcae4106800 2024-09-18T12:59:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.209+0000 7fcae17fa640 1 -- 172.21.15.78:0/865490297 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcad8004cf0 con 0x7fcae4106800 2024-09-18T12:59:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.209+0000 7fcaea5f4640 1 -- 172.21.15.78:0/865490297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcae4199650 con 0x7fcae4106800 2024-09-18T12:59:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.209+0000 7fcae17fa640 1 -- 172.21.15.78:0/865490297 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcad8035030 con 0x7fcae4106800 2024-09-18T12:59:16.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.209+0000 7fcaea5f4640 1 -- 172.21.15.78:0/865490297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcae41a1c00 con 0x7fcae4106800 2024-09-18T12:59:16.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.210+0000 7fcaea5f4640 1 -- 172.21.15.78:0/865490297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcae4101f40 con 0x7fcae4106800 2024-09-18T12:59:16.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.211+0000 7fcae17fa640 1 -- 172.21.15.78:0/865490297 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fcad8042070 con 0x7fcae4106800 2024-09-18T12:59:16.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.211+0000 7fcae17fa640 1 --2- 172.21.15.78:0/865490297 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcacc07af80 0x7fcacc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:16.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.211+0000 7fcae17fa640 1 -- 172.21.15.78:0/865490297 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fcad80bea40 con 0x7fcae4106800 2024-09-18T12:59:16.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.211+0000 7fcae3fff640 1 --2- 172.21.15.78:0/865490297 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcacc07af80 0x7fcacc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:16.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.212+0000 7fcae3fff640 1 --2- 172.21.15.78:0/865490297 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcacc07af80 0x7fcacc07d440 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcad4009890 tx=0x7fcad4008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:16.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.215+0000 7fcae17fa640 1 -- 172.21.15.78:0/865490297 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fcad808a060 con 0x7fcae4106800 2024-09-18T12:59:16.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.471+0000 7fcaea5f4640 1 -- 172.21.15.78:0/865490297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fcae406a7a0 con 0x7fcae4106800 2024-09-18T12:59:16.473 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:16 smithi078 ceph-mon[108578]: pgmap v303: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:16.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.472+0000 7fcae17fa640 1 -- 172.21.15.78:0/865490297 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fcad808ef10 con 0x7fcae4106800 2024-09-18T12:59:16.473 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:59:16.474 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:59:16.474 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:59:16.474 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:59:16.474 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:59:16.474 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:59:16.474 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:59:16.474 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:59:16.474 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T12:59:16.474 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:59:16.474 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:59:16.474 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T12:59:16.474 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:59:16.474 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:59:16.475 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T12:59:16.475 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:59:16.475 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:59:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.474+0000 7fcaea5f4640 1 -- 172.21.15.78:0/865490297 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcacc07af80 msgr2=0x7fcacc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.474+0000 7fcaea5f4640 1 --2- 172.21.15.78:0/865490297 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcacc07af80 0x7fcacc07d440 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcad4009890 tx=0x7fcad4008040 comp rx=0 tx=0).stop 2024-09-18T12:59:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.474+0000 7fcaea5f4640 1 -- 172.21.15.78:0/865490297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae4106800 msgr2=0x7fcae4198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.474+0000 7fcaea5f4640 1 --2- 172.21.15.78:0/865490297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae4106800 0x7fcae4198dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcad8031460 tx=0x7fcad80048f0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.474+0000 7fcaea5f4640 1 -- 172.21.15.78:0/865490297 shutdown_connections 2024-09-18T12:59:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.474+0000 7fcaea5f4640 1 --2- 172.21.15.78:0/865490297 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcacc07af80 0x7fcacc07d440 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.474+0000 7fcaea5f4640 1 --2- 172.21.15.78:0/865490297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae4106800 0x7fcae4198dc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.474+0000 7fcaea5f4640 1 --2- 172.21.15.78:0/865490297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae4100800 0x7fcae4198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.474+0000 7fcaea5f4640 1 -- 172.21.15.78:0/865490297 >> 172.21.15.78:0/865490297 conn(0x7fcae40fc520 msgr2=0x7fcae40fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.474+0000 7fcaea5f4640 1 -- 172.21.15.78:0/865490297 shutdown_connections 2024-09-18T12:59:16.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.474+0000 7fcaea5f4640 1 -- 172.21.15.78:0/865490297 wait complete. 2024-09-18T12:59:16.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.555+0000 7fec9d42e640 1 -- 172.21.15.78:0/1071259285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec98106800 msgr2=0x7fec98106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.555+0000 7fec9d42e640 1 --2- 172.21.15.78:0/1071259285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec98106800 0x7fec98106be0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fec88009880 tx=0x7fec8802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.555+0000 7fec9d42e640 1 -- 172.21.15.78:0/1071259285 shutdown_connections 2024-09-18T12:59:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.555+0000 7fec9d42e640 1 --2- 172.21.15.78:0/1071259285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec98100800 0x7fec98100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.555+0000 7fec9d42e640 1 --2- 172.21.15.78:0/1071259285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec98106800 0x7fec98106be0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.555+0000 7fec9d42e640 1 -- 172.21.15.78:0/1071259285 >> 172.21.15.78:0/1071259285 conn(0x7fec980fc520 msgr2=0x7fec980fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.555+0000 7fec9d42e640 1 -- 172.21.15.78:0/1071259285 shutdown_connections 2024-09-18T12:59:16.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.555+0000 7fec9d42e640 1 -- 172.21.15.78:0/1071259285 wait complete. 2024-09-18T12:59:16.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.556+0000 7fec9d42e640 1 Processor -- start 2024-09-18T12:59:16.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.556+0000 7fec9d42e640 1 -- start start 2024-09-18T12:59:16.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.556+0000 7fec9d42e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec98100800 0x7fec98198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:16.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.556+0000 7fec9d42e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec98106800 0x7fec98198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:16.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.556+0000 7fec9d42e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fec9810dcd0 con 0x7fec98106800 2024-09-18T12:59:16.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.556+0000 7fec9d42e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fec9810db50 con 0x7fec98100800 2024-09-18T12:59:16.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.556+0000 7fec967fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec98106800 0x7fec98198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:16.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.556+0000 7fec967fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec98106800 0x7fec98198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47150/0 (socket says 172.21.15.78:47150) 2024-09-18T12:59:16.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.557+0000 7fec967fc640 1 -- 172.21.15.78:0/3475426163 learned_addr learned my addr 172.21.15.78:0/3475426163 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:59:16.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.557+0000 7fec96ffd640 1 --2- 172.21.15.78:0/3475426163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec98100800 0x7fec98198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:16.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.557+0000 7fec967fc640 1 -- 172.21.15.78:0/3475426163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec98100800 msgr2=0x7fec98198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:16.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.557+0000 7fec967fc640 1 --2- 172.21.15.78:0/3475426163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec98100800 0x7fec98198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.557+0000 7fec967fc640 1 -- 172.21.15.78:0/3475426163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec98199350 con 0x7fec98106800 2024-09-18T12:59:16.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.557+0000 7fec96ffd640 1 --2- 172.21.15.78:0/3475426163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec98100800 0x7fec98198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:59:16.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.557+0000 7fec967fc640 1 --2- 172.21.15.78:0/3475426163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec98106800 0x7fec98198d50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00d6f0 tx=0x7fec8c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:16.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.557+0000 7fec7ffff640 1 -- 172.21.15.78:0/3475426163 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec8c017070 con 0x7fec98106800 2024-09-18T12:59:16.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.557+0000 7fec7ffff640 1 -- 172.21.15.78:0/3475426163 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fec8c00de00 con 0x7fec98106800 2024-09-18T12:59:16.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.557+0000 7fec9d42e640 1 -- 172.21.15.78:0/3475426163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec98199640 con 0x7fec98106800 2024-09-18T12:59:16.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.557+0000 7fec7ffff640 1 -- 172.21.15.78:0/3475426163 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec8c004bb0 con 0x7fec98106800 2024-09-18T12:59:16.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.557+0000 7fec9d42e640 1 -- 172.21.15.78:0/3475426163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec981a1c40 con 0x7fec98106800 2024-09-18T12:59:16.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.558+0000 7fec9d42e640 1 -- 172.21.15.78:0/3475426163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec98101f40 con 0x7fec98106800 2024-09-18T12:59:16.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.559+0000 7fec7ffff640 1 -- 172.21.15.78:0/3475426163 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fec8c004e60 con 0x7fec98106800 2024-09-18T12:59:16.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.559+0000 7fec7ffff640 1 --2- 172.21.15.78:0/3475426163 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fec8007af30 0x7fec8007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:16.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.559+0000 7fec7ffff640 1 -- 172.21.15.78:0/3475426163 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fec8c09dd50 con 0x7fec98106800 2024-09-18T12:59:16.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.559+0000 7fec96ffd640 1 --2- 172.21.15.78:0/3475426163 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fec8007af30 0x7fec8007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:16.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.560+0000 7fec96ffd640 1 --2- 172.21.15.78:0/3475426163 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fec8007af30 0x7fec8007d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fec88000c00 tx=0x7fec88031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:16.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.564+0000 7fec7ffff640 1 -- 172.21.15.78:0/3475426163 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fec98199640 con 0x7fec98106800 2024-09-18T12:59:16.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:16 smithi148 ceph-mon[80030]: pgmap v303: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:16.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.773+0000 7fec9d42e640 1 -- 172.21.15.78:0/3475426163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fec98108d70 con 0x7fec98106800 2024-09-18T12:59:16.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.774+0000 7fec7ffff640 1 -- 172.21.15.78:0/3475426163 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7fec8c069250 con 0x7fec98106800 2024-09-18T12:59:16.775 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T12:59:16.775 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T12:59:16.775 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:59:16.776 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:59:16.776 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T12:59:16.776 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:59:16.776 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:59:16.776 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T12:59:16.776 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T12:59:16.776 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T12:59:16.776 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:59:16.776 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T12:59:16.776 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T12:59:16.776 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T12:59:16.776 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T12:59:16.777 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T12:59:16.777 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T12:59:16.777 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T12:59:16.777 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T12:59:16.777 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T12:59:16.777 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T12:59:16.777 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:59:16.777 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T12:59:16.777 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T12:59:16.777 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T12:59:16.777 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T12:59:16.777 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T12:59:16.778 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T12:59:16.778 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T12:59:16.778 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T12:59:16.778 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T12:59:16.778 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T12:59:16.778 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T12:59:16.778 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T12:59:16.778 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T12:59:16.778 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:59:16.778 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:59:16.779 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T12:59:16.779 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:59:16.779 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:16.779 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:16.779 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:16.779 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T12:59:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.777+0000 7fec9d42e640 1 -- 172.21.15.78:0/3475426163 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fec8007af30 msgr2=0x7fec8007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.777+0000 7fec9d42e640 1 --2- 172.21.15.78:0/3475426163 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fec8007af30 0x7fec8007d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fec88000c00 tx=0x7fec88031400 comp rx=0 tx=0).stop 2024-09-18T12:59:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.777+0000 7fec9d42e640 1 -- 172.21.15.78:0/3475426163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec98106800 msgr2=0x7fec98198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.777+0000 7fec9d42e640 1 --2- 172.21.15.78:0/3475426163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec98106800 0x7fec98198d50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00d6f0 tx=0x7fec8c00dbb0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.777+0000 7fec9d42e640 1 -- 172.21.15.78:0/3475426163 shutdown_connections 2024-09-18T12:59:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.777+0000 7fec9d42e640 1 --2- 172.21.15.78:0/3475426163 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fec8007af30 0x7fec8007d3f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.777+0000 7fec9d42e640 1 --2- 172.21.15.78:0/3475426163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec98106800 0x7fec98198d50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.777+0000 7fec9d42e640 1 --2- 172.21.15.78:0/3475426163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec98100800 0x7fec98198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.777+0000 7fec9d42e640 1 -- 172.21.15.78:0/3475426163 >> 172.21.15.78:0/3475426163 conn(0x7fec980fc520 msgr2=0x7fec980fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.777+0000 7fec9d42e640 1 -- 172.21.15.78:0/3475426163 shutdown_connections 2024-09-18T12:59:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.777+0000 7fec9d42e640 1 -- 172.21.15.78:0/3475426163 wait complete. 2024-09-18T12:59:16.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.859+0000 7fc4664ba640 1 -- 172.21.15.78:0/1572961031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc460107900 msgr2=0x7fc460107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.859+0000 7fc4664ba640 1 --2- 172.21.15.78:0/1572961031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc460107900 0x7fc460107ce0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc450009880 tx=0x7fc45002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.859+0000 7fc4664ba640 1 -- 172.21.15.78:0/1572961031 shutdown_connections 2024-09-18T12:59:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.859+0000 7fc4664ba640 1 --2- 172.21.15.78:0/1572961031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc460101900 0x7fc460101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.859+0000 7fc4664ba640 1 --2- 172.21.15.78:0/1572961031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc460107900 0x7fc460107ce0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.859+0000 7fc4664ba640 1 -- 172.21.15.78:0/1572961031 >> 172.21.15.78:0/1572961031 conn(0x7fc4600fd600 msgr2=0x7fc4600ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.859+0000 7fc4664ba640 1 -- 172.21.15.78:0/1572961031 shutdown_connections 2024-09-18T12:59:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.859+0000 7fc4664ba640 1 -- 172.21.15.78:0/1572961031 wait complete. 2024-09-18T12:59:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.860+0000 7fc4664ba640 1 Processor -- start 2024-09-18T12:59:16.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.860+0000 7fc4664ba640 1 -- start start 2024-09-18T12:59:16.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.860+0000 7fc4664ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc460101900 0x7fc46019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:16.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.860+0000 7fc4664ba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc460107900 0x7fc46019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:16.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.860+0000 7fc4664ba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc46010edd0 con 0x7fc460101900 2024-09-18T12:59:16.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.860+0000 7fc4664ba640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc46010ec50 con 0x7fc460107900 2024-09-18T12:59:16.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.860+0000 7fc45ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc460101900 0x7fc46019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:16.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.860+0000 7fc45ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc460101900 0x7fc46019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47158/0 (socket says 172.21.15.78:47158) 2024-09-18T12:59:16.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.860+0000 7fc45ffff640 1 -- 172.21.15.78:0/2828940564 learned_addr learned my addr 172.21.15.78:0/2828940564 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:59:16.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.860+0000 7fc45f7fe640 1 --2- 172.21.15.78:0/2828940564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc460107900 0x7fc46019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:16.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.860+0000 7fc45ffff640 1 -- 172.21.15.78:0/2828940564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc460107900 msgr2=0x7fc46019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:16.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.860+0000 7fc45ffff640 1 --2- 172.21.15.78:0/2828940564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc460107900 0x7fc46019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:16.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.860+0000 7fc45ffff640 1 -- 172.21.15.78:0/2828940564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4601977c0 con 0x7fc460101900 2024-09-18T12:59:16.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.861+0000 7fc45ffff640 1 --2- 172.21.15.78:0/2828940564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc460101900 0x7fc46019d640 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc450031460 tx=0x7fc4500045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:16.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.861+0000 7fc45d7fa640 1 -- 172.21.15.78:0/2828940564 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc45003f070 con 0x7fc460101900 2024-09-18T12:59:16.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.861+0000 7fc45d7fa640 1 -- 172.21.15.78:0/2828940564 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc4500035f0 con 0x7fc460101900 2024-09-18T12:59:16.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.861+0000 7fc4664ba640 1 -- 172.21.15.78:0/2828940564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc460197a50 con 0x7fc460101900 2024-09-18T12:59:16.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.861+0000 7fc45d7fa640 1 -- 172.21.15.78:0/2828940564 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc450035030 con 0x7fc460101900 2024-09-18T12:59:16.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.861+0000 7fc4664ba640 1 -- 172.21.15.78:0/2828940564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc460197f80 con 0x7fc460101900 2024-09-18T12:59:16.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.862+0000 7fc4664ba640 1 -- 172.21.15.78:0/2828940564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc460103040 con 0x7fc460101900 2024-09-18T12:59:16.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.862+0000 7fc45d7fa640 1 -- 172.21.15.78:0/2828940564 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc450042070 con 0x7fc460101900 2024-09-18T12:59:16.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.863+0000 7fc45d7fa640 1 --2- 172.21.15.78:0/2828940564 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc44807af30 0x7fc44807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:16.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.863+0000 7fc45d7fa640 1 -- 172.21.15.78:0/2828940564 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fc4500beaa0 con 0x7fc460101900 2024-09-18T12:59:16.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.863+0000 7fc45f7fe640 1 --2- 172.21.15.78:0/2828940564 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc44807af30 0x7fc44807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:16.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.863+0000 7fc45f7fe640 1 --2- 172.21.15.78:0/2828940564 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc44807af30 0x7fc44807d3f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc454005fd0 tx=0x7fc454005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:16.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:16.867+0000 7fc45d7fa640 1 -- 172.21.15.78:0/2828940564 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc450089fe0 con 0x7fc460101900 2024-09-18T12:59:17.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.059+0000 7fc4664ba640 1 -- 172.21.15.78:0/2828940564 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc460198230 con 0x7fc44807af30 2024-09-18T12:59:17.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.060+0000 7fc45d7fa640 1 -- 172.21.15.78:0/2828940564 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc460198230 con 0x7fc44807af30 2024-09-18T12:59:17.061 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:59:17.062 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:59:17.062 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:59:17.062 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:59:17.062 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:59:17.062 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T12:59:17.062 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T12:59:17.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T12:59:17.062 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T12:59:17.062 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T12:59:17.062 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:59:17.062 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T12:59:17.062 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T12:59:17.062 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:59:17.063 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:59:17.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.062+0000 7fc4664ba640 1 -- 172.21.15.78:0/2828940564 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc44807af30 msgr2=0x7fc44807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:17.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.062+0000 7fc4664ba640 1 --2- 172.21.15.78:0/2828940564 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc44807af30 0x7fc44807d3f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc454005fd0 tx=0x7fc454005850 comp rx=0 tx=0).stop 2024-09-18T12:59:17.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.062+0000 7fc4664ba640 1 -- 172.21.15.78:0/2828940564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc460101900 msgr2=0x7fc46019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:17.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.062+0000 7fc4664ba640 1 --2- 172.21.15.78:0/2828940564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc460101900 0x7fc46019d640 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc450031460 tx=0x7fc4500045e0 comp rx=0 tx=0).stop 2024-09-18T12:59:17.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.062+0000 7fc4664ba640 1 -- 172.21.15.78:0/2828940564 shutdown_connections 2024-09-18T12:59:17.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.062+0000 7fc4664ba640 1 --2- 172.21.15.78:0/2828940564 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc44807af30 0x7fc44807d3f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:17.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.062+0000 7fc4664ba640 1 --2- 172.21.15.78:0/2828940564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc460107900 0x7fc46019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:17.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.062+0000 7fc4664ba640 1 --2- 172.21.15.78:0/2828940564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc460101900 0x7fc46019d640 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:17.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.063+0000 7fc4664ba640 1 -- 172.21.15.78:0/2828940564 >> 172.21.15.78:0/2828940564 conn(0x7fc4600fd600 msgr2=0x7fc4600fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:17.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.063+0000 7fc4664ba640 1 -- 172.21.15.78:0/2828940564 shutdown_connections 2024-09-18T12:59:17.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.063+0000 7fc4664ba640 1 -- 172.21.15.78:0/2828940564 wait complete. 2024-09-18T12:59:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.144+0000 7fc4559b2640 1 -- 172.21.15.78:0/3279132189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc450101900 msgr2=0x7fc450101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.144+0000 7fc4559b2640 1 --2- 172.21.15.78:0/3279132189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc450101900 0x7fc450101d60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc438009880 tx=0x7fc43802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.144+0000 7fc4559b2640 1 -- 172.21.15.78:0/3279132189 shutdown_connections 2024-09-18T12:59:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.144+0000 7fc4559b2640 1 --2- 172.21.15.78:0/3279132189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc450101900 0x7fc450101d60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.144+0000 7fc4559b2640 1 --2- 172.21.15.78:0/3279132189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc450107900 0x7fc450107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.144+0000 7fc4559b2640 1 -- 172.21.15.78:0/3279132189 >> 172.21.15.78:0/3279132189 conn(0x7fc4500fd600 msgr2=0x7fc4500ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.144+0000 7fc4559b2640 1 -- 172.21.15.78:0/3279132189 shutdown_connections 2024-09-18T12:59:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.144+0000 7fc4559b2640 1 -- 172.21.15.78:0/3279132189 wait complete. 2024-09-18T12:59:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.145+0000 7fc4559b2640 1 Processor -- start 2024-09-18T12:59:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.145+0000 7fc4559b2640 1 -- start start 2024-09-18T12:59:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.145+0000 7fc4559b2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc450101900 0x7fc4500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.145+0000 7fc4559b2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc450107900 0x7fc450074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.145+0000 7fc4559b2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc45010edd0 con 0x7fc450101900 2024-09-18T12:59:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.145+0000 7fc4559b2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc45010ec50 con 0x7fc450107900 2024-09-18T12:59:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.146+0000 7fc44effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc450101900 0x7fc4500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.146+0000 7fc44effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc450101900 0x7fc4500744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47172/0 (socket says 172.21.15.78:47172) 2024-09-18T12:59:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.146+0000 7fc44effd640 1 -- 172.21.15.78:0/1981340632 learned_addr learned my addr 172.21.15.78:0/1981340632 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:59:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.146+0000 7fc44e7fc640 1 --2- 172.21.15.78:0/1981340632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc450107900 0x7fc450074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.146+0000 7fc44effd640 1 -- 172.21.15.78:0/1981340632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc450107900 msgr2=0x7fc450074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.146+0000 7fc44effd640 1 --2- 172.21.15.78:0/1981340632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc450107900 0x7fc450074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.146+0000 7fc44effd640 1 -- 172.21.15.78:0/1981340632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc450074f70 con 0x7fc450101900 2024-09-18T12:59:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.146+0000 7fc44e7fc640 1 --2- 172.21.15.78:0/1981340632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc450107900 0x7fc450074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:59:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.146+0000 7fc44effd640 1 --2- 172.21.15.78:0/1981340632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc450101900 0x7fc4500744f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc44800ea00 tx=0x7fc44800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.146+0000 7fc4549b0640 1 -- 172.21.15.78:0/1981340632 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc44800cb80 con 0x7fc450101900 2024-09-18T12:59:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.146+0000 7fc4549b0640 1 -- 172.21.15.78:0/1981340632 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc44800cd20 con 0x7fc450101900 2024-09-18T12:59:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.146+0000 7fc4559b2640 1 -- 172.21.15.78:0/1981340632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc450075260 con 0x7fc450101900 2024-09-18T12:59:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.146+0000 7fc4549b0640 1 -- 172.21.15.78:0/1981340632 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc448011470 con 0x7fc450101900 2024-09-18T12:59:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.147+0000 7fc4559b2640 1 -- 172.21.15.78:0/1981340632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4501a3e80 con 0x7fc450101900 2024-09-18T12:59:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.148+0000 7fc4559b2640 1 -- 172.21.15.78:0/1981340632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc450103040 con 0x7fc450101900 2024-09-18T12:59:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.148+0000 7fc4549b0640 1 -- 172.21.15.78:0/1981340632 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc448011720 con 0x7fc450101900 2024-09-18T12:59:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.149+0000 7fc4549b0640 1 --2- 172.21.15.78:0/1981340632 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc43c07af80 0x7fc43c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.149+0000 7fc44e7fc640 1 --2- 172.21.15.78:0/1981340632 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc43c07af80 0x7fc43c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.149+0000 7fc4549b0640 1 -- 172.21.15.78:0/1981340632 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fc44809e0e0 con 0x7fc450101900 2024-09-18T12:59:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.149+0000 7fc44e7fc640 1 --2- 172.21.15.78:0/1981340632 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc43c07af80 0x7fc43c07d440 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc438006010 tx=0x7fc4380095f0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:17.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.153+0000 7fc4549b0640 1 -- 172.21.15.78:0/1981340632 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc448016030 con 0x7fc450101900 2024-09-18T12:59:17.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.400+0000 7fc4559b2640 1 -- 172.21.15.78:0/1981340632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fc450101d60 con 0x7fc450101900 2024-09-18T12:59:17.401 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:17 smithi078 ceph-mon[108578]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:17.402 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:17 smithi078 ceph-mon[108578]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:17.402 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:17 smithi078 ceph-mon[108578]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:17.402 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:17 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/865490297' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:17.402 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:17 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3475426163' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:59:17.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.400+0000 7fc4549b0640 1 -- 172.21.15.78:0/1981340632 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fc4480697a0 con 0x7fc450101900 2024-09-18T12:59:17.402 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T12:59:17.402 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T12:59:17.403 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T12:59:17.403 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:59:17.403 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:59:17.403 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T12:59:17.403 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T12:59:17.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.403+0000 7fc4559b2640 1 -- 172.21.15.78:0/1981340632 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc43c07af80 msgr2=0x7fc43c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:17.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.403+0000 7fc4559b2640 1 --2- 172.21.15.78:0/1981340632 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc43c07af80 0x7fc43c07d440 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc438006010 tx=0x7fc4380095f0 comp rx=0 tx=0).stop 2024-09-18T12:59:17.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.403+0000 7fc4559b2640 1 -- 172.21.15.78:0/1981340632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc450101900 msgr2=0x7fc4500744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:17.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.403+0000 7fc4559b2640 1 --2- 172.21.15.78:0/1981340632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc450101900 0x7fc4500744f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc44800ea00 tx=0x7fc44800eec0 comp rx=0 tx=0).stop 2024-09-18T12:59:17.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.403+0000 7fc4559b2640 1 -- 172.21.15.78:0/1981340632 shutdown_connections 2024-09-18T12:59:17.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.403+0000 7fc4559b2640 1 --2- 172.21.15.78:0/1981340632 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc43c07af80 0x7fc43c07d440 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:17.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.403+0000 7fc4559b2640 1 --2- 172.21.15.78:0/1981340632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc450107900 0x7fc450074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:17.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.403+0000 7fc4559b2640 1 --2- 172.21.15.78:0/1981340632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc450101900 0x7fc4500744f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:17.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.403+0000 7fc4559b2640 1 -- 172.21.15.78:0/1981340632 >> 172.21.15.78:0/1981340632 conn(0x7fc4500fd600 msgr2=0x7fc4500fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:17.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.403+0000 7fc4559b2640 1 -- 172.21.15.78:0/1981340632 shutdown_connections 2024-09-18T12:59:17.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:17.403+0000 7fc4559b2640 1 -- 172.21.15.78:0/1981340632 wait complete. 2024-09-18T12:59:17.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:17 smithi148 ceph-mon[80030]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:17.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:17 smithi148 ceph-mon[80030]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:17.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:17 smithi148 ceph-mon[80030]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:17.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:17 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/865490297' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:17.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:17 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3475426163' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:59:18.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:18 smithi078 ceph-mon[108578]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:18.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:18 smithi078 ceph-mon[108578]: pgmap v304: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:18.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:18 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1981340632' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:59:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:18 smithi148 ceph-mon[80030]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:18 smithi148 ceph-mon[80030]: pgmap v304: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:18 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1981340632' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:59:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:20 smithi148 ceph-mon[80030]: pgmap v305: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:20.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:20 smithi078 ceph-mon[108578]: pgmap v305: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:22 smithi148 ceph-mon[80030]: pgmap v306: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:22.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:22 smithi078 ceph-mon[108578]: pgmap v306: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:24.715 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:24 smithi078 ceph-mon[108578]: pgmap v307: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:24 smithi148 ceph-mon[80030]: pgmap v307: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:26 smithi148 ceph-mon[80030]: pgmap v308: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:26 smithi078 ceph-mon[108578]: pgmap v308: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:28 smithi148 ceph-mon[80030]: pgmap v309: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:28.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:28 smithi078 ceph-mon[108578]: pgmap v309: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:30.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:30 smithi078 ceph-mon[108578]: pgmap v310: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:30.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:30 smithi148 ceph-mon[80030]: pgmap v310: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:32 smithi148 ceph-mon[80030]: pgmap v311: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:32 smithi078 ceph-mon[108578]: pgmap v311: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:34.553 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:34 smithi148 ceph-mon[80030]: pgmap v312: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:34 smithi078 ceph-mon[108578]: pgmap v312: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:36.544 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:36 smithi078 ceph-mon[108578]: pgmap v313: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:36 smithi148 ceph-mon[80030]: pgmap v313: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:38.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:38 smithi148 ceph-mon[80030]: pgmap v314: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:38.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:38 smithi078 ceph-mon[108578]: pgmap v314: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:40 smithi148 ceph-mon[80030]: pgmap v315: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:40.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:40 smithi078 ceph-mon[108578]: pgmap v315: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:41.619 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:42.713 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:42 smithi078 ceph-mon[108578]: pgmap v316: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:42.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:42 smithi148 ceph-mon[80030]: pgmap v316: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:44.703 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:44 smithi148 ceph-mon[80030]: pgmap v317: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:44 smithi078 ceph-mon[108578]: pgmap v317: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:46.694 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:46 smithi078 ceph-mon[108578]: pgmap v318: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:46 smithi148 ceph-mon[80030]: pgmap v318: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:47.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.497+0000 7f8525505640 1 -- 172.21.15.78:0/3359963708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8520100800 msgr2=0x7f8520100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:47.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.497+0000 7f8525505640 1 --2- 172.21.15.78:0/3359963708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8520100800 0x7f8520100c60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8508009880 tx=0x7f850802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:47.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.498+0000 7f8525505640 1 -- 172.21.15.78:0/3359963708 shutdown_connections 2024-09-18T12:59:47.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.498+0000 7f8525505640 1 --2- 172.21.15.78:0/3359963708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8520100800 0x7f8520100c60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:47.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.498+0000 7f8525505640 1 --2- 172.21.15.78:0/3359963708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8520106800 0x7f8520106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:47.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.498+0000 7f8525505640 1 -- 172.21.15.78:0/3359963708 >> 172.21.15.78:0/3359963708 conn(0x7f85200fc520 msgr2=0x7f85200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:47.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.498+0000 7f8525505640 1 -- 172.21.15.78:0/3359963708 shutdown_connections 2024-09-18T12:59:47.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.498+0000 7f8525505640 1 -- 172.21.15.78:0/3359963708 wait complete. 2024-09-18T12:59:47.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.498+0000 7f8525505640 1 Processor -- start 2024-09-18T12:59:47.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.498+0000 7f8525505640 1 -- start start 2024-09-18T12:59:47.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f8525505640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8520100800 0x7f85200fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:47.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f8525505640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8520106800 0x7f85200fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:47.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f8525505640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f852010dcd0 con 0x7f8520106800 2024-09-18T12:59:47.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f8525505640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f852010db50 con 0x7f8520100800 2024-09-18T12:59:47.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f8517fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8520106800 0x7f85200fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:47.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f8517fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8520106800 0x7f85200fd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56552/0 (socket says 172.21.15.78:56552) 2024-09-18T12:59:47.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f8517fff640 1 -- 172.21.15.78:0/2318626669 learned_addr learned my addr 172.21.15.78:0/2318626669 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:59:47.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f851effd640 1 --2- 172.21.15.78:0/2318626669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8520100800 0x7f85200fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:47.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f8517fff640 1 -- 172.21.15.78:0/2318626669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8520100800 msgr2=0x7f85200fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:47.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f8517fff640 1 --2- 172.21.15.78:0/2318626669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8520100800 0x7f85200fcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:47.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f8517fff640 1 -- 172.21.15.78:0/2318626669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85200fd690 con 0x7f8520106800 2024-09-18T12:59:47.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f851effd640 1 --2- 172.21.15.78:0/2318626669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8520100800 0x7f85200fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:59:47.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f8517fff640 1 --2- 172.21.15.78:0/2318626669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8520106800 0x7f85200fd150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8508031460 tx=0x7f85080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:47.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f851cff9640 1 -- 172.21.15.78:0/2318626669 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f850803f070 con 0x7f8520106800 2024-09-18T12:59:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f8525505640 1 -- 172.21.15.78:0/2318626669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85200fd920 con 0x7f8520106800 2024-09-18T12:59:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f851cff9640 1 -- 172.21.15.78:0/2318626669 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f85080035f0 con 0x7f8520106800 2024-09-18T12:59:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.499+0000 7f851cff9640 1 -- 172.21.15.78:0/2318626669 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8508035030 con 0x7f8520106800 2024-09-18T12:59:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.500+0000 7f8525505640 1 -- 172.21.15.78:0/2318626669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85201a3db0 con 0x7f8520106800 2024-09-18T12:59:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.500+0000 7f8525505640 1 -- 172.21.15.78:0/2318626669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8520101f40 con 0x7f8520106800 2024-09-18T12:59:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.501+0000 7f851cff9640 1 -- 172.21.15.78:0/2318626669 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8508042070 con 0x7f8520106800 2024-09-18T12:59:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.502+0000 7f851cff9640 1 --2- 172.21.15.78:0/2318626669 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f850c07af30 0x7f850c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.502+0000 7f851cff9640 1 -- 172.21.15.78:0/2318626669 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f85080bea80 con 0x7f8520106800 2024-09-18T12:59:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.502+0000 7f851effd640 1 --2- 172.21.15.78:0/2318626669 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f850c07af30 0x7f850c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.502+0000 7f851effd640 1 --2- 172.21.15.78:0/2318626669 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f850c07af30 0x7f850c07d3f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f85100058c0 tx=0x7f8510005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:47.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.506+0000 7f851cff9640 1 -- 172.21.15.78:0/2318626669 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f850808a020 con 0x7f8520106800 2024-09-18T12:59:47.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.699+0000 7f8525505640 1 -- 172.21.15.78:0/2318626669 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8520062630 con 0x7f850c07af30 2024-09-18T12:59:47.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.700+0000 7f851cff9640 1 -- 172.21.15.78:0/2318626669 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8520062630 con 0x7f850c07af30 2024-09-18T12:59:47.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.702+0000 7f8525505640 1 -- 172.21.15.78:0/2318626669 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f850c07af30 msgr2=0x7f850c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:47.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.702+0000 7f8525505640 1 --2- 172.21.15.78:0/2318626669 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f850c07af30 0x7f850c07d3f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f85100058c0 tx=0x7f8510005850 comp rx=0 tx=0).stop 2024-09-18T12:59:47.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.702+0000 7f8525505640 1 -- 172.21.15.78:0/2318626669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8520106800 msgr2=0x7f85200fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:47.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.702+0000 7f8525505640 1 --2- 172.21.15.78:0/2318626669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8520106800 0x7f85200fd150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8508031460 tx=0x7f85080045e0 comp rx=0 tx=0).stop 2024-09-18T12:59:47.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.702+0000 7f8525505640 1 -- 172.21.15.78:0/2318626669 shutdown_connections 2024-09-18T12:59:47.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.702+0000 7f8525505640 1 --2- 172.21.15.78:0/2318626669 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f850c07af30 0x7f850c07d3f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:47.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.702+0000 7f8525505640 1 --2- 172.21.15.78:0/2318626669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8520106800 0x7f85200fd150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:47.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.702+0000 7f8525505640 1 --2- 172.21.15.78:0/2318626669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8520100800 0x7f85200fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:47.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.702+0000 7f8525505640 1 -- 172.21.15.78:0/2318626669 >> 172.21.15.78:0/2318626669 conn(0x7f85200fc520 msgr2=0x7f852006a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:47.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.703+0000 7f8525505640 1 -- 172.21.15.78:0/2318626669 shutdown_connections 2024-09-18T12:59:47.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.703+0000 7f8525505640 1 -- 172.21.15.78:0/2318626669 wait complete. 2024-09-18T12:59:47.713 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T12:59:47.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.786+0000 7f902ee23640 1 -- 172.21.15.78:0/3396174559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9028106800 msgr2=0x7f9028106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:47.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.786+0000 7f902ee23640 1 --2- 172.21.15.78:0/3396174559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9028106800 0x7f9028106be0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9020009880 tx=0x7f902002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:47.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.786+0000 7f902ee23640 1 -- 172.21.15.78:0/3396174559 shutdown_connections 2024-09-18T12:59:47.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.786+0000 7f902ee23640 1 --2- 172.21.15.78:0/3396174559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9028100800 0x7f9028100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:47.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.786+0000 7f902ee23640 1 --2- 172.21.15.78:0/3396174559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9028106800 0x7f9028106be0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:47.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.786+0000 7f902ee23640 1 -- 172.21.15.78:0/3396174559 >> 172.21.15.78:0/3396174559 conn(0x7f90280fc520 msgr2=0x7f90280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:47.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.786+0000 7f902ee23640 1 -- 172.21.15.78:0/3396174559 shutdown_connections 2024-09-18T12:59:47.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.786+0000 7f902ee23640 1 -- 172.21.15.78:0/3396174559 wait complete. 2024-09-18T12:59:47.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.787+0000 7f902ee23640 1 Processor -- start 2024-09-18T12:59:47.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.787+0000 7f902ee23640 1 -- start start 2024-09-18T12:59:47.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.787+0000 7f902ee23640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9028100800 0x7f902819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:47.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.787+0000 7f902ee23640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9028106800 0x7f902819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:47.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.787+0000 7f902ee23640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f902810dd30 con 0x7f9028106800 2024-09-18T12:59:47.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.787+0000 7f902ee23640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f902810dbb0 con 0x7f9028100800 2024-09-18T12:59:47.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.787+0000 7f9027fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9028106800 0x7f902819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:47.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.787+0000 7f9027fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9028106800 0x7f902819dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56576/0 (socket says 172.21.15.78:56576) 2024-09-18T12:59:47.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.787+0000 7f9027fff640 1 -- 172.21.15.78:0/3424232748 learned_addr learned my addr 172.21.15.78:0/3424232748 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:59:47.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.787+0000 7f902cbbf640 1 --2- 172.21.15.78:0/3424232748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9028100800 0x7f902819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:47.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.787+0000 7f9027fff640 1 -- 172.21.15.78:0/3424232748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9028100800 msgr2=0x7f902819d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:47.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.787+0000 7f9027fff640 1 --2- 172.21.15.78:0/3424232748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9028100800 0x7f902819d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:47.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.787+0000 7f9027fff640 1 -- 172.21.15.78:0/3424232748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9028197850 con 0x7f9028106800 2024-09-18T12:59:47.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.787+0000 7f902cbbf640 1 --2- 172.21.15.78:0/3424232748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9028100800 0x7f902819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:59:47.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.788+0000 7f9027fff640 1 --2- 172.21.15.78:0/3424232748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9028106800 0x7f902819dc10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f901800ba50 tx=0x7f901800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:47.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.788+0000 7f9025ffb640 1 -- 172.21.15.78:0/3424232748 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9018019070 con 0x7f9028106800 2024-09-18T12:59:47.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.788+0000 7f9025ffb640 1 -- 172.21.15.78:0/3424232748 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f901800ce20 con 0x7f9028106800 2024-09-18T12:59:47.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.788+0000 7f9025ffb640 1 -- 172.21.15.78:0/3424232748 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90180075a0 con 0x7f9028106800 2024-09-18T12:59:47.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.788+0000 7f902ee23640 1 -- 172.21.15.78:0/3424232748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9028197b40 con 0x7f9028106800 2024-09-18T12:59:47.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.788+0000 7f902ee23640 1 -- 172.21.15.78:0/3424232748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90281980d0 con 0x7f9028106800 2024-09-18T12:59:47.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.789+0000 7f902ee23640 1 -- 172.21.15.78:0/3424232748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9028101f40 con 0x7f9028106800 2024-09-18T12:59:47.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.790+0000 7f9025ffb640 1 -- 172.21.15.78:0/3424232748 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f901801c070 con 0x7f9028106800 2024-09-18T12:59:47.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.790+0000 7f9025ffb640 1 --2- 172.21.15.78:0/3424232748 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f901407af40 0x7f901407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:47.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.790+0000 7f9025ffb640 1 -- 172.21.15.78:0/3424232748 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f901809d950 con 0x7f9028106800 2024-09-18T12:59:47.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.790+0000 7f902cbbf640 1 --2- 172.21.15.78:0/3424232748 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f901407af40 0x7f901407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:47.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.791+0000 7f902cbbf640 1 --2- 172.21.15.78:0/3424232748 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f901407af40 0x7f901407d400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9020031460 tx=0x7f9020004280 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.795+0000 7f9025ffb640 1 -- 172.21.15.78:0/3424232748 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9018068ef0 con 0x7f9028106800 2024-09-18T12:59:47.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.987+0000 7f902ee23640 1 -- 172.21.15.78:0/3424232748 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f90281983e0 con 0x7f901407af40 2024-09-18T12:59:47.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.988+0000 7f9025ffb640 1 -- 172.21.15.78:0/3424232748 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f90281983e0 con 0x7f901407af40 2024-09-18T12:59:47.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.990+0000 7f902ee23640 1 -- 172.21.15.78:0/3424232748 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f901407af40 msgr2=0x7f901407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:47.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.990+0000 7f902ee23640 1 --2- 172.21.15.78:0/3424232748 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f901407af40 0x7f901407d400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9020031460 tx=0x7f9020004280 comp rx=0 tx=0).stop 2024-09-18T12:59:47.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.990+0000 7f902ee23640 1 -- 172.21.15.78:0/3424232748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9028106800 msgr2=0x7f902819dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:47.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.990+0000 7f902ee23640 1 --2- 172.21.15.78:0/3424232748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9028106800 0x7f902819dc10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f901800ba50 tx=0x7f901800bf10 comp rx=0 tx=0).stop 2024-09-18T12:59:47.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.990+0000 7f902ee23640 1 -- 172.21.15.78:0/3424232748 shutdown_connections 2024-09-18T12:59:47.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.990+0000 7f902ee23640 1 --2- 172.21.15.78:0/3424232748 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f901407af40 0x7f901407d400 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:47.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.990+0000 7f902ee23640 1 --2- 172.21.15.78:0/3424232748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9028106800 0x7f902819dc10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:47.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.990+0000 7f902ee23640 1 --2- 172.21.15.78:0/3424232748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9028100800 0x7f902819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:47.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.990+0000 7f902ee23640 1 -- 172.21.15.78:0/3424232748 >> 172.21.15.78:0/3424232748 conn(0x7f90280fc520 msgr2=0x7f902806a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:47.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.990+0000 7f902ee23640 1 -- 172.21.15.78:0/3424232748 shutdown_connections 2024-09-18T12:59:47.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:47.990+0000 7f902ee23640 1 -- 172.21.15.78:0/3424232748 wait complete. 2024-09-18T12:59:48.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.072+0000 7feda35f9640 1 -- 172.21.15.78:0/3864666976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed9c1033e0 msgr2=0x7fed9c10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.072+0000 7feda35f9640 1 --2- 172.21.15.78:0/3864666976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed9c1033e0 0x7fed9c10b8d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fed98009880 tx=0x7fed9802a530 comp rx=0 tx=0).stop 2024-09-18T12:59:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.072+0000 7feda35f9640 1 -- 172.21.15.78:0/3864666976 shutdown_connections 2024-09-18T12:59:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.072+0000 7feda35f9640 1 --2- 172.21.15.78:0/3864666976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed9c1033e0 0x7fed9c10b8d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.072+0000 7feda35f9640 1 --2- 172.21.15.78:0/3864666976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed9c102ac0 0x7fed9c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.072+0000 7feda35f9640 1 -- 172.21.15.78:0/3864666976 >> 172.21.15.78:0/3864666976 conn(0x7fed9c0fc520 msgr2=0x7fed9c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.072+0000 7feda35f9640 1 -- 172.21.15.78:0/3864666976 shutdown_connections 2024-09-18T12:59:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.072+0000 7feda35f9640 1 -- 172.21.15.78:0/3864666976 wait complete. 2024-09-18T12:59:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.073+0000 7feda35f9640 1 Processor -- start 2024-09-18T12:59:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.073+0000 7feda35f9640 1 -- start start 2024-09-18T12:59:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.073+0000 7feda35f9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed9c102ac0 0x7fed9c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.073+0000 7feda35f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed9c1033e0 0x7fed9c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.073+0000 7feda35f9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c10ee50 con 0x7fed9c1033e0 2024-09-18T12:59:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.073+0000 7feda35f9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c10ecd0 con 0x7fed9c102ac0 2024-09-18T12:59:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.073+0000 7feda0b94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed9c1033e0 0x7fed9c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.073+0000 7feda0b94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed9c1033e0 0x7fed9c19dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56592/0 (socket says 172.21.15.78:56592) 2024-09-18T12:59:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.073+0000 7feda0b94640 1 -- 172.21.15.78:0/1190915966 learned_addr learned my addr 172.21.15.78:0/1190915966 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:59:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.073+0000 7feda1395640 1 --2- 172.21.15.78:0/1190915966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed9c102ac0 0x7fed9c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.074+0000 7feda0b94640 1 -- 172.21.15.78:0/1190915966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed9c102ac0 msgr2=0x7fed9c19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.074+0000 7feda0b94640 1 --2- 172.21.15.78:0/1190915966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed9c102ac0 0x7fed9c19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.074+0000 7feda0b94640 1 -- 172.21.15.78:0/1190915966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9c197860 con 0x7fed9c1033e0 2024-09-18T12:59:48.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.074+0000 7feda0b94640 1 --2- 172.21.15.78:0/1190915966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed9c1033e0 0x7fed9c19dbe0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fed98031460 tx=0x7fed980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:48.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.074+0000 7fed927fc640 1 -- 172.21.15.78:0/1190915966 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed9803f070 con 0x7fed9c1033e0 2024-09-18T12:59:48.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.074+0000 7fed927fc640 1 -- 172.21.15.78:0/1190915966 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed98004ac0 con 0x7fed9c1033e0 2024-09-18T12:59:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.074+0000 7feda35f9640 1 -- 172.21.15.78:0/1190915966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9c197af0 con 0x7fed9c1033e0 2024-09-18T12:59:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.074+0000 7feda35f9640 1 -- 172.21.15.78:0/1190915966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed9c198020 con 0x7fed9c1033e0 2024-09-18T12:59:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.074+0000 7fed927fc640 1 -- 172.21.15.78:0/1190915966 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed98035030 con 0x7fed9c1033e0 2024-09-18T12:59:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.075+0000 7feda35f9640 1 -- 172.21.15.78:0/1190915966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed80005290 con 0x7fed9c1033e0 2024-09-18T12:59:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.076+0000 7fed927fc640 1 -- 172.21.15.78:0/1190915966 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fed98042070 con 0x7fed9c1033e0 2024-09-18T12:59:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.076+0000 7fed927fc640 1 --2- 172.21.15.78:0/1190915966 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fed8807af30 0x7fed8807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.076+0000 7fed927fc640 1 -- 172.21.15.78:0/1190915966 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fed980be970 con 0x7fed9c1033e0 2024-09-18T12:59:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.076+0000 7feda1395640 1 --2- 172.21.15.78:0/1190915966 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fed8807af30 0x7fed8807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:48.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.077+0000 7feda1395640 1 --2- 172.21.15.78:0/1190915966 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fed8807af30 0x7fed8807d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed9c1989a0 tx=0x7fed8c009110 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:48.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.081+0000 7fed927fc640 1 -- 172.21.15.78:0/1190915966 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fed980c0e20 con 0x7fed9c1033e0 2024-09-18T12:59:48.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.266+0000 7feda35f9640 1 -- 172.21.15.78:0/1190915966 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fed80000bc0 con 0x7fed8807af30 2024-09-18T12:59:48.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.275+0000 7fed927fc640 1 -- 172.21.15.78:0/1190915966 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fed80000bc0 con 0x7fed8807af30 2024-09-18T12:59:48.277 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:59:48.277 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (7m) 110s ago 18m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T12:59:48.277 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (10m) 110s ago 18m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T12:59:48.277 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (9m) 81s ago 17m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T12:59:48.277 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (5m) 110s ago 18m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T12:59:48.277 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (5m) 81s ago 17m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T12:59:48.277 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (7m) 110s ago 18m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T12:59:48.277 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (2m) 110s ago 13m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T12:59:48.277 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (116s) 110s ago 13m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T12:59:48.277 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (98s) 81s ago 13m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T12:59:48.277 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (85s) 81s ago 13m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T12:59:48.278 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (9m) 110s ago 19m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T12:59:48.278 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (8m) 81s ago 17m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T12:59:48.278 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (6m) 110s ago 20m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T12:59:48.278 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (6m) 81s ago 17m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T12:59:48.278 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (8m) 110s ago 18m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T12:59:48.278 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (8m) 81s ago 17m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T12:59:48.278 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (5m) 110s ago 16m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T12:59:48.278 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (4m) 110s ago 16m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T12:59:48.278 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (4m) 110s ago 15m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T12:59:48.278 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (3m) 81s ago 15m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T12:59:48.278 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (3m) 81s ago 14m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T12:59:48.278 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (2m) 81s ago 14m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T12:59:48.278 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (7m) 110s ago 18m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T12:59:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.277+0000 7feda35f9640 1 -- 172.21.15.78:0/1190915966 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fed8807af30 msgr2=0x7fed8807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.277+0000 7feda35f9640 1 --2- 172.21.15.78:0/1190915966 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fed8807af30 0x7fed8807d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed9c1989a0 tx=0x7fed8c009110 comp rx=0 tx=0).stop 2024-09-18T12:59:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.277+0000 7feda35f9640 1 -- 172.21.15.78:0/1190915966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed9c1033e0 msgr2=0x7fed9c19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.277+0000 7feda35f9640 1 --2- 172.21.15.78:0/1190915966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed9c1033e0 0x7fed9c19dbe0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fed98031460 tx=0x7fed980046c0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.277+0000 7feda35f9640 1 -- 172.21.15.78:0/1190915966 shutdown_connections 2024-09-18T12:59:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.277+0000 7feda35f9640 1 --2- 172.21.15.78:0/1190915966 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fed8807af30 0x7fed8807d3f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.277+0000 7feda35f9640 1 --2- 172.21.15.78:0/1190915966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed9c1033e0 0x7fed9c19dbe0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.277+0000 7feda35f9640 1 --2- 172.21.15.78:0/1190915966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed9c102ac0 0x7fed9c19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.277+0000 7feda35f9640 1 -- 172.21.15.78:0/1190915966 >> 172.21.15.78:0/1190915966 conn(0x7fed9c0fc520 msgr2=0x7fed9c108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.278+0000 7feda35f9640 1 -- 172.21.15.78:0/1190915966 shutdown_connections 2024-09-18T12:59:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.278+0000 7feda35f9640 1 -- 172.21.15.78:0/1190915966 wait complete. 2024-09-18T12:59:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.357+0000 7fd5d98ee640 1 -- 172.21.15.78:0/4143568882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5d4102b70 msgr2=0x7fd5d4102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.357+0000 7fd5d98ee640 1 --2- 172.21.15.78:0/4143568882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5d4102b70 0x7fd5d4102f50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4009c20 tx=0x7fd5c402aa00 comp rx=0 tx=0).stop 2024-09-18T12:59:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.357+0000 7fd5d98ee640 1 -- 172.21.15.78:0/4143568882 shutdown_connections 2024-09-18T12:59:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.357+0000 7fd5d98ee640 1 --2- 172.21.15.78:0/4143568882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5d4103490 0x7fd5d410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.357+0000 7fd5d98ee640 1 --2- 172.21.15.78:0/4143568882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5d4102b70 0x7fd5d4102f50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.357+0000 7fd5d98ee640 1 -- 172.21.15.78:0/4143568882 >> 172.21.15.78:0/4143568882 conn(0x7fd5d40fc550 msgr2=0x7fd5d40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:48.359 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:48 smithi078 ceph-mon[108578]: pgmap v319: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.358+0000 7fd5d98ee640 1 -- 172.21.15.78:0/4143568882 shutdown_connections 2024-09-18T12:59:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.358+0000 7fd5d98ee640 1 -- 172.21.15.78:0/4143568882 wait complete. 2024-09-18T12:59:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.358+0000 7fd5d98ee640 1 Processor -- start 2024-09-18T12:59:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.358+0000 7fd5d98ee640 1 -- start start 2024-09-18T12:59:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.359+0000 7fd5d98ee640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5d4102b70 0x7fd5d419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.359+0000 7fd5d98ee640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5d4103490 0x7fd5d419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.359+0000 7fd5d98ee640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d410ede0 con 0x7fd5d4103490 2024-09-18T12:59:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.359+0000 7fd5d98ee640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d410ec60 con 0x7fd5d4102b70 2024-09-18T12:59:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.359+0000 7fd5d27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5d4103490 0x7fd5d419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.359+0000 7fd5d27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5d4103490 0x7fd5d419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56612/0 (socket says 172.21.15.78:56612) 2024-09-18T12:59:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.359+0000 7fd5d27fc640 1 -- 172.21.15.78:0/115233442 learned_addr learned my addr 172.21.15.78:0/115233442 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:59:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.359+0000 7fd5d2ffd640 1 --2- 172.21.15.78:0/115233442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5d4102b70 0x7fd5d419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.359+0000 7fd5d27fc640 1 -- 172.21.15.78:0/115233442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5d4102b70 msgr2=0x7fd5d419f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.359+0000 7fd5d27fc640 1 --2- 172.21.15.78:0/115233442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5d4102b70 0x7fd5d419f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.359+0000 7fd5d27fc640 1 -- 172.21.15.78:0/115233442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d41999b0 con 0x7fd5d4103490 2024-09-18T12:59:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.359+0000 7fd5d27fc640 1 --2- 172.21.15.78:0/115233442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5d4103490 0x7fd5d419fd30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00d6f0 tx=0x7fd5bc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.359+0000 7fd5d88ec640 1 -- 172.21.15.78:0/115233442 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd5bc017070 con 0x7fd5d4103490 2024-09-18T12:59:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.360+0000 7fd5d98ee640 1 -- 172.21.15.78:0/115233442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d4199ca0 con 0x7fd5d4103490 2024-09-18T12:59:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.360+0000 7fd5d88ec640 1 -- 172.21.15.78:0/115233442 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd5bc00de00 con 0x7fd5d4103490 2024-09-18T12:59:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.360+0000 7fd5d98ee640 1 -- 172.21.15.78:0/115233442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d419a230 con 0x7fd5d4103490 2024-09-18T12:59:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.360+0000 7fd5d88ec640 1 -- 172.21.15.78:0/115233442 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd5bc004bb0 con 0x7fd5d4103490 2024-09-18T12:59:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.361+0000 7fd5d98ee640 1 -- 172.21.15.78:0/115233442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d406a4c0 con 0x7fd5d4103490 2024-09-18T12:59:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.361+0000 7fd5d88ec640 1 -- 172.21.15.78:0/115233442 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd5bc004e60 con 0x7fd5d4103490 2024-09-18T12:59:48.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.362+0000 7fd5d88ec640 1 --2- 172.21.15.78:0/115233442 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd5c007af30 0x7fd5c007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:48.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.362+0000 7fd5d88ec640 1 -- 172.21.15.78:0/115233442 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fd5bc09dc60 con 0x7fd5d4103490 2024-09-18T12:59:48.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.362+0000 7fd5d2ffd640 1 --2- 172.21.15.78:0/115233442 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd5c007af30 0x7fd5c007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:48.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.362+0000 7fd5d2ffd640 1 --2- 172.21.15.78:0/115233442 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd5c007af30 0x7fd5c007d3f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4009430 tx=0x7fd5c403a040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:48.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.366+0000 7fd5d88ec640 1 -- 172.21.15.78:0/115233442 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd5bc0691a0 con 0x7fd5d4103490 2024-09-18T12:59:48.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.610+0000 7fd5d98ee640 1 -- 172.21.15.78:0/115233442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd5d419aee0 con 0x7fd5d4103490 2024-09-18T12:59:48.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.611+0000 7fd5d88ec640 1 -- 172.21.15.78:0/115233442 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fd5bc06e050 con 0x7fd5d4103490 2024-09-18T12:59:48.612 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:59:48.612 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T12:59:48.612 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:59:48.613 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:59:48.613 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T12:59:48.613 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:59:48.613 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:59:48.613 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T12:59:48.613 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T12:59:48.613 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:59:48.613 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T12:59:48.613 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T12:59:48.614 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T12:59:48.614 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T12:59:48.614 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T12:59:48.614 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T12:59:48.614 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:59:48.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.613+0000 7fd5d98ee640 1 -- 172.21.15.78:0/115233442 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd5c007af30 msgr2=0x7fd5c007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:48.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.613+0000 7fd5d98ee640 1 --2- 172.21.15.78:0/115233442 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd5c007af30 0x7fd5c007d3f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4009430 tx=0x7fd5c403a040 comp rx=0 tx=0).stop 2024-09-18T12:59:48.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.613+0000 7fd5d98ee640 1 -- 172.21.15.78:0/115233442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5d4103490 msgr2=0x7fd5d419fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:48.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.613+0000 7fd5d98ee640 1 --2- 172.21.15.78:0/115233442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5d4103490 0x7fd5d419fd30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00d6f0 tx=0x7fd5bc00dbb0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.613+0000 7fd5d98ee640 1 -- 172.21.15.78:0/115233442 shutdown_connections 2024-09-18T12:59:48.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.613+0000 7fd5d98ee640 1 --2- 172.21.15.78:0/115233442 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd5c007af30 0x7fd5c007d3f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.613+0000 7fd5d98ee640 1 --2- 172.21.15.78:0/115233442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5d4103490 0x7fd5d419fd30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.613+0000 7fd5d98ee640 1 --2- 172.21.15.78:0/115233442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5d4102b70 0x7fd5d419f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.613+0000 7fd5d98ee640 1 -- 172.21.15.78:0/115233442 >> 172.21.15.78:0/115233442 conn(0x7fd5d40fc550 msgr2=0x7fd5d4100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:48.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.613+0000 7fd5d98ee640 1 -- 172.21.15.78:0/115233442 shutdown_connections 2024-09-18T12:59:48.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.613+0000 7fd5d98ee640 1 -- 172.21.15.78:0/115233442 wait complete. 2024-09-18T12:59:48.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.695+0000 7f73d2a28640 1 -- 172.21.15.78:0/3100276583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73cc107900 msgr2=0x7f73cc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.695+0000 7f73d2a28640 1 --2- 172.21.15.78:0/3100276583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73cc107900 0x7f73cc107ce0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f73bc009880 tx=0x7f73bc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.695+0000 7f73d2a28640 1 -- 172.21.15.78:0/3100276583 shutdown_connections 2024-09-18T12:59:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.695+0000 7f73d2a28640 1 --2- 172.21.15.78:0/3100276583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73cc101900 0x7f73cc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.695+0000 7f73d2a28640 1 --2- 172.21.15.78:0/3100276583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73cc107900 0x7f73cc107ce0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.695+0000 7f73d2a28640 1 -- 172.21.15.78:0/3100276583 >> 172.21.15.78:0/3100276583 conn(0x7f73cc0fd600 msgr2=0x7f73cc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.695+0000 7f73d2a28640 1 -- 172.21.15.78:0/3100276583 shutdown_connections 2024-09-18T12:59:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.695+0000 7f73d2a28640 1 -- 172.21.15.78:0/3100276583 wait complete. 2024-09-18T12:59:48.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.696+0000 7f73d2a28640 1 Processor -- start 2024-09-18T12:59:48.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.696+0000 7f73d2a28640 1 -- start start 2024-09-18T12:59:48.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.696+0000 7f73d2a28640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73cc101900 0x7f73cc19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:48.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.696+0000 7f73d2a28640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73cc107900 0x7f73cc19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:48.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.696+0000 7f73d2a28640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc10edd0 con 0x7f73cc107900 2024-09-18T12:59:48.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.696+0000 7f73d2a28640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc10ec50 con 0x7f73cc101900 2024-09-18T12:59:48.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.696+0000 7f73cb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73cc107900 0x7f73cc19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:48.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.696+0000 7f73cb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73cc107900 0x7f73cc19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56632/0 (socket says 172.21.15.78:56632) 2024-09-18T12:59:48.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.696+0000 7f73cb7fe640 1 -- 172.21.15.78:0/2891778073 learned_addr learned my addr 172.21.15.78:0/2891778073 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:59:48.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.697+0000 7f73cbfff640 1 --2- 172.21.15.78:0/2891778073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73cc101900 0x7f73cc19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:48.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.697+0000 7f73cb7fe640 1 -- 172.21.15.78:0/2891778073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73cc101900 msgr2=0x7f73cc19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:48.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.697+0000 7f73cb7fe640 1 --2- 172.21.15.78:0/2891778073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73cc101900 0x7f73cc19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.697+0000 7f73cb7fe640 1 -- 172.21.15.78:0/2891778073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73cc1977a0 con 0x7f73cc107900 2024-09-18T12:59:48.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.697+0000 7f73cb7fe640 1 --2- 172.21.15.78:0/2891778073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73cc107900 0x7f73cc19db60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f73c000c8f0 tx=0x7f73c000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:48.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.697+0000 7f73c97fa640 1 -- 172.21.15.78:0/2891778073 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73c00079b0 con 0x7f73cc107900 2024-09-18T12:59:48.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.697+0000 7f73c97fa640 1 -- 172.21.15.78:0/2891778073 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f73c00054e0 con 0x7f73cc107900 2024-09-18T12:59:48.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.697+0000 7f73d2a28640 1 -- 172.21.15.78:0/2891778073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73cc197a90 con 0x7f73cc107900 2024-09-18T12:59:48.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.697+0000 7f73c97fa640 1 -- 172.21.15.78:0/2891778073 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73c0004dd0 con 0x7f73cc107900 2024-09-18T12:59:48.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.697+0000 7f73d2a28640 1 -- 172.21.15.78:0/2891778073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73cc198020 con 0x7f73cc107900 2024-09-18T12:59:48.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.698+0000 7f73d2a28640 1 -- 172.21.15.78:0/2891778073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73cc103040 con 0x7f73cc107900 2024-09-18T12:59:48.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.699+0000 7f73c97fa640 1 -- 172.21.15.78:0/2891778073 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f73c0005020 con 0x7f73cc107900 2024-09-18T12:59:48.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.699+0000 7f73c97fa640 1 --2- 172.21.15.78:0/2891778073 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f73b407af30 0x7f73b407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:48.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.700+0000 7f73c97fa640 1 -- 172.21.15.78:0/2891778073 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f73c009dee0 con 0x7f73cc107900 2024-09-18T12:59:48.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.700+0000 7f73cbfff640 1 --2- 172.21.15.78:0/2891778073 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f73b407af30 0x7f73b407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:48.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.700+0000 7f73cbfff640 1 --2- 172.21.15.78:0/2891778073 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f73b407af30 0x7f73b407d3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f73bc000c00 tx=0x7f73bc031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:48.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.704+0000 7f73c97fa640 1 -- 172.21.15.78:0/2891778073 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f73c0014030 con 0x7f73cc107900 2024-09-18T12:59:48.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:48 smithi148 ceph-mon[80030]: pgmap v319: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:48.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.916+0000 7f73d2a28640 1 -- 172.21.15.78:0/2891778073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f73cc109e70 con 0x7f73cc107900 2024-09-18T12:59:48.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.917+0000 7f73c97fa640 1 -- 172.21.15.78:0/2891778073 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f73c0069500 con 0x7f73cc107900 2024-09-18T12:59:48.918 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T12:59:48.918 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T12:59:48.918 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:59:48.919 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:59:48.919 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T12:59:48.919 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:59:48.919 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:59:48.919 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T12:59:48.919 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T12:59:48.919 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T12:59:48.920 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T12:59:48.920 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T12:59:48.920 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T12:59:48.920 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T12:59:48.920 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T12:59:48.920 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T12:59:48.920 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T12:59:48.920 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T12:59:48.920 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T12:59:48.920 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T12:59:48.920 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T12:59:48.920 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:59:48.920 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T12:59:48.921 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T12:59:48.921 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T12:59:48.921 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T12:59:48.921 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T12:59:48.921 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T12:59:48.921 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T12:59:48.921 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T12:59:48.921 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T12:59:48.921 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T12:59:48.921 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T12:59:48.921 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T12:59:48.921 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T12:59:48.922 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:59:48.922 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:59:48.922 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T12:59:48.922 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T12:59:48.922 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:48.922 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:48.922 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:48.922 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:48.923 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T12:59:48.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.920+0000 7f73d2a28640 1 -- 172.21.15.78:0/2891778073 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f73b407af30 msgr2=0x7f73b407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:48.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.920+0000 7f73d2a28640 1 --2- 172.21.15.78:0/2891778073 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f73b407af30 0x7f73b407d3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f73bc000c00 tx=0x7f73bc031400 comp rx=0 tx=0).stop 2024-09-18T12:59:48.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.920+0000 7f73d2a28640 1 -- 172.21.15.78:0/2891778073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73cc107900 msgr2=0x7f73cc19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:48.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.920+0000 7f73d2a28640 1 --2- 172.21.15.78:0/2891778073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73cc107900 0x7f73cc19db60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f73c000c8f0 tx=0x7f73c000cdb0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.920+0000 7f73d2a28640 1 -- 172.21.15.78:0/2891778073 shutdown_connections 2024-09-18T12:59:48.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.920+0000 7f73d2a28640 1 --2- 172.21.15.78:0/2891778073 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f73b407af30 0x7f73b407d3f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.920+0000 7f73d2a28640 1 --2- 172.21.15.78:0/2891778073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73cc107900 0x7f73cc19db60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.920+0000 7f73d2a28640 1 --2- 172.21.15.78:0/2891778073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73cc101900 0x7f73cc19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:48.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.920+0000 7f73d2a28640 1 -- 172.21.15.78:0/2891778073 >> 172.21.15.78:0/2891778073 conn(0x7f73cc0fd600 msgr2=0x7f73cc0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:48.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.920+0000 7f73d2a28640 1 -- 172.21.15.78:0/2891778073 shutdown_connections 2024-09-18T12:59:48.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:48.920+0000 7f73d2a28640 1 -- 172.21.15.78:0/2891778073 wait complete. 2024-09-18T12:59:49.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.002+0000 7feb3f55d640 1 -- 172.21.15.78:0/2406322339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb381011d0 msgr2=0x7feb381056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:49.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.002+0000 7feb3f55d640 1 --2- 172.21.15.78:0/2406322339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb381011d0 0x7feb381056a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feb28009880 tx=0x7feb2802a530 comp rx=0 tx=0).stop 2024-09-18T12:59:49.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.002+0000 7feb3f55d640 1 -- 172.21.15.78:0/2406322339 shutdown_connections 2024-09-18T12:59:49.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.002+0000 7feb3f55d640 1 --2- 172.21.15.78:0/2406322339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb381011d0 0x7feb381056a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.002+0000 7feb3f55d640 1 --2- 172.21.15.78:0/2406322339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb381008b0 0x7feb38100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.002+0000 7feb3f55d640 1 -- 172.21.15.78:0/2406322339 >> 172.21.15.78:0/2406322339 conn(0x7feb380fc520 msgr2=0x7feb380fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:49.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.003+0000 7feb3f55d640 1 -- 172.21.15.78:0/2406322339 shutdown_connections 2024-09-18T12:59:49.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.003+0000 7feb3f55d640 1 -- 172.21.15.78:0/2406322339 wait complete. 2024-09-18T12:59:49.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.003+0000 7feb3f55d640 1 Processor -- start 2024-09-18T12:59:49.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.003+0000 7feb3f55d640 1 -- start start 2024-09-18T12:59:49.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.003+0000 7feb3f55d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb381008b0 0x7feb3819dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:49.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.003+0000 7feb3f55d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb381011d0 0x7feb3819e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:49.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.003+0000 7feb3f55d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feb381153d0 con 0x7feb381011d0 2024-09-18T12:59:49.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.003+0000 7feb3f55d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feb38115250 con 0x7feb381008b0 2024-09-18T12:59:49.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.003+0000 7feb3caf8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb381011d0 0x7feb3819e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:49.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.003+0000 7feb3caf8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb381011d0 0x7feb3819e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56656/0 (socket says 172.21.15.78:56656) 2024-09-18T12:59:49.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.003+0000 7feb3caf8640 1 -- 172.21.15.78:0/1571032547 learned_addr learned my addr 172.21.15.78:0/1571032547 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:59:49.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.004+0000 7feb3d2f9640 1 --2- 172.21.15.78:0/1571032547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb381008b0 0x7feb3819dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:49.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.004+0000 7feb3caf8640 1 -- 172.21.15.78:0/1571032547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb381008b0 msgr2=0x7feb3819dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:49.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.004+0000 7feb3caf8640 1 --2- 172.21.15.78:0/1571032547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb381008b0 0x7feb3819dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.004+0000 7feb3caf8640 1 -- 172.21.15.78:0/1571032547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3819ebc0 con 0x7feb381011d0 2024-09-18T12:59:49.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.004+0000 7feb3caf8640 1 --2- 172.21.15.78:0/1571032547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb381011d0 0x7feb3819e510 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feb28031460 tx=0x7feb280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:49.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.004+0000 7feb2e7fc640 1 -- 172.21.15.78:0/1571032547 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb2803f070 con 0x7feb381011d0 2024-09-18T12:59:49.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.004+0000 7feb2e7fc640 1 -- 172.21.15.78:0/1571032547 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feb28004ac0 con 0x7feb381011d0 2024-09-18T12:59:49.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.004+0000 7feb3f55d640 1 -- 172.21.15.78:0/1571032547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb381a2900 con 0x7feb381011d0 2024-09-18T12:59:49.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.004+0000 7feb2e7fc640 1 -- 172.21.15.78:0/1571032547 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb28035030 con 0x7feb381011d0 2024-09-18T12:59:49.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.004+0000 7feb3f55d640 1 -- 172.21.15.78:0/1571032547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb381a2e30 con 0x7feb381011d0 2024-09-18T12:59:49.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.005+0000 7feb3f55d640 1 -- 172.21.15.78:0/1571032547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb3806aa90 con 0x7feb381011d0 2024-09-18T12:59:49.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.006+0000 7feb2e7fc640 1 -- 172.21.15.78:0/1571032547 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7feb28042070 con 0x7feb381011d0 2024-09-18T12:59:49.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.006+0000 7feb2e7fc640 1 --2- 172.21.15.78:0/1571032547 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feb2407af30 0x7feb2407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:49.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.007+0000 7feb3d2f9640 1 --2- 172.21.15.78:0/1571032547 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feb2407af30 0x7feb2407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:49.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.007+0000 7feb2e7fc640 1 -- 172.21.15.78:0/1571032547 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7feb280beac0 con 0x7feb381011d0 2024-09-18T12:59:49.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.007+0000 7feb3d2f9640 1 --2- 172.21.15.78:0/1571032547 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feb2407af30 0x7feb2407d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7feb34007350 tx=0x7feb340072e0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:49.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.011+0000 7feb2e7fc640 1 -- 172.21.15.78:0/1571032547 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7feb2808a060 con 0x7feb381011d0 2024-09-18T12:59:49.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.203+0000 7feb3f55d640 1 -- 172.21.15.78:0/1571032547 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7feb381a31a0 con 0x7feb2407af30 2024-09-18T12:59:49.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.205+0000 7feb2e7fc640 1 -- 172.21.15.78:0/1571032547 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7feb381a31a0 con 0x7feb2407af30 2024-09-18T12:59:49.206 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T12:59:49.206 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:59:49.206 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T12:59:49.206 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:59:49.206 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T12:59:49.206 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T12:59:49.206 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T12:59:49.206 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T12:59:49.206 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T12:59:49.206 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T12:59:49.206 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T12:59:49.206 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T12:59:49.207 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T12:59:49.207 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T12:59:49.207 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T12:59:49.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.207+0000 7feb3f55d640 1 -- 172.21.15.78:0/1571032547 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feb2407af30 msgr2=0x7feb2407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:49.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.207+0000 7feb3f55d640 1 --2- 172.21.15.78:0/1571032547 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feb2407af30 0x7feb2407d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7feb34007350 tx=0x7feb340072e0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.207+0000 7feb3f55d640 1 -- 172.21.15.78:0/1571032547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb381011d0 msgr2=0x7feb3819e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:49.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.207+0000 7feb3f55d640 1 --2- 172.21.15.78:0/1571032547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb381011d0 0x7feb3819e510 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feb28031460 tx=0x7feb280046c0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.207+0000 7feb3f55d640 1 -- 172.21.15.78:0/1571032547 shutdown_connections 2024-09-18T12:59:49.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.207+0000 7feb3f55d640 1 --2- 172.21.15.78:0/1571032547 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feb2407af30 0x7feb2407d3f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.207+0000 7feb3f55d640 1 --2- 172.21.15.78:0/1571032547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb381011d0 0x7feb3819e510 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.207+0000 7feb3f55d640 1 --2- 172.21.15.78:0/1571032547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb381008b0 0x7feb3819dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.207+0000 7feb3f55d640 1 -- 172.21.15.78:0/1571032547 >> 172.21.15.78:0/1571032547 conn(0x7feb380fc520 msgr2=0x7feb38112be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:49.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.207+0000 7feb3f55d640 1 -- 172.21.15.78:0/1571032547 shutdown_connections 2024-09-18T12:59:49.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.207+0000 7feb3f55d640 1 -- 172.21.15.78:0/1571032547 wait complete. 2024-09-18T12:59:49.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.292+0000 7f951484f640 1 -- 172.21.15.78:0/1316737173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95101067f0 msgr2=0x7f9510106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:49.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.292+0000 7f951484f640 1 --2- 172.21.15.78:0/1316737173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95101067f0 0x7f9510106bd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009880 tx=0x7f94f802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.292+0000 7f951484f640 1 -- 172.21.15.78:0/1316737173 shutdown_connections 2024-09-18T12:59:49.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.292+0000 7f951484f640 1 --2- 172.21.15.78:0/1316737173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95101007f0 0x7f9510100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.292+0000 7f951484f640 1 --2- 172.21.15.78:0/1316737173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95101067f0 0x7f9510106bd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.292+0000 7f951484f640 1 -- 172.21.15.78:0/1316737173 >> 172.21.15.78:0/1316737173 conn(0x7f95100fc550 msgr2=0x7f95100fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:49.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.292+0000 7f951484f640 1 -- 172.21.15.78:0/1316737173 shutdown_connections 2024-09-18T12:59:49.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.292+0000 7f951484f640 1 -- 172.21.15.78:0/1316737173 wait complete. 2024-09-18T12:59:49.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.293+0000 7f951484f640 1 Processor -- start 2024-09-18T12:59:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.293+0000 7f951484f640 1 -- start start 2024-09-18T12:59:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.293+0000 7f951484f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95101007f0 0x7f95101988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.293+0000 7f951484f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95101067f0 0x7f9510198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.293+0000 7f951484f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f951010dca0 con 0x7f95101007f0 2024-09-18T12:59:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.293+0000 7f951484f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f951010db20 con 0x7f95101067f0 2024-09-18T12:59:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.293+0000 7f950e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95101007f0 0x7f95101988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.293+0000 7f950e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95101007f0 0x7f95101988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56678/0 (socket says 172.21.15.78:56678) 2024-09-18T12:59:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.293+0000 7f950e59c640 1 -- 172.21.15.78:0/3995427939 learned_addr learned my addr 172.21.15.78:0/3995427939 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T12:59:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.293+0000 7f950dd9b640 1 --2- 172.21.15.78:0/3995427939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95101067f0 0x7f9510198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.294+0000 7f950e59c640 1 -- 172.21.15.78:0/3995427939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95101067f0 msgr2=0x7f9510198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.294+0000 7f950e59c640 1 --2- 172.21.15.78:0/3995427939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95101067f0 0x7f9510198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.294+0000 7f950e59c640 1 -- 172.21.15.78:0/3995427939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9510199410 con 0x7f95101007f0 2024-09-18T12:59:49.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.294+0000 7f950e59c640 1 --2- 172.21.15.78:0/3995427939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95101007f0 0x7f95101988d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f94f8031460 tx=0x7f94f80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:49.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.295+0000 7f95077fe640 1 -- 172.21.15.78:0/3995427939 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94f803f070 con 0x7f95101007f0 2024-09-18T12:59:49.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.295+0000 7f95077fe640 1 -- 172.21.15.78:0/3995427939 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94f8004b10 con 0x7f95101007f0 2024-09-18T12:59:49.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.295+0000 7f951484f640 1 -- 172.21.15.78:0/3995427939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95101996a0 con 0x7f95101007f0 2024-09-18T12:59:49.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.295+0000 7f95077fe640 1 -- 172.21.15.78:0/3995427939 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94f8035030 con 0x7f95101007f0 2024-09-18T12:59:49.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.295+0000 7f951484f640 1 -- 172.21.15.78:0/3995427939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95101a1c50 con 0x7f95101007f0 2024-09-18T12:59:49.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.296+0000 7f951484f640 1 -- 172.21.15.78:0/3995427939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9510101f30 con 0x7f95101007f0 2024-09-18T12:59:49.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.296+0000 7f95077fe640 1 -- 172.21.15.78:0/3995427939 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f94f8042070 con 0x7f95101007f0 2024-09-18T12:59:49.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.297+0000 7f95077fe640 1 --2- 172.21.15.78:0/3995427939 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f94fc07af90 0x7f94fc07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:49.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.297+0000 7f95077fe640 1 -- 172.21.15.78:0/3995427939 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f94f80beb10 con 0x7f95101007f0 2024-09-18T12:59:49.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.297+0000 7f950dd9b640 1 --2- 172.21.15.78:0/3995427939 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f94fc07af90 0x7f94fc07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:49.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.298+0000 7f950dd9b640 1 --2- 172.21.15.78:0/3995427939 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f94fc07af90 0x7f94fc07d450 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9500005fd0 tx=0x7f9500005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:49.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.301+0000 7f95077fe640 1 -- 172.21.15.78:0/3995427939 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f94f808a0d0 con 0x7f95101007f0 2024-09-18T12:59:49.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:49 smithi078 ceph-mon[108578]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:49.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:49 smithi078 ceph-mon[108578]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:49.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:49 smithi078 ceph-mon[108578]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:49.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:49 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/115233442' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:49.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:49 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2891778073' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:59:49.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.544+0000 7f951484f640 1 -- 172.21.15.78:0/3995427939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f9510100c50 con 0x7f95101007f0 2024-09-18T12:59:49.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.544+0000 7f95077fe640 1 -- 172.21.15.78:0/3995427939 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f94f808ef80 con 0x7f95101007f0 2024-09-18T12:59:49.545 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T12:59:49.545 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T12:59:49.545 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T12:59:49.546 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:59:49.546 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:59:49.546 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T12:59:49.546 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T12:59:49.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.546+0000 7f951484f640 1 -- 172.21.15.78:0/3995427939 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f94fc07af90 msgr2=0x7f94fc07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:49.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.546+0000 7f951484f640 1 --2- 172.21.15.78:0/3995427939 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f94fc07af90 0x7f94fc07d450 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9500005fd0 tx=0x7f9500005850 comp rx=0 tx=0).stop 2024-09-18T12:59:49.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.546+0000 7f951484f640 1 -- 172.21.15.78:0/3995427939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95101007f0 msgr2=0x7f95101988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:49.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.546+0000 7f951484f640 1 --2- 172.21.15.78:0/3995427939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95101007f0 0x7f95101988d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f94f8031460 tx=0x7f94f80045e0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.546+0000 7f951484f640 1 -- 172.21.15.78:0/3995427939 shutdown_connections 2024-09-18T12:59:49.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.546+0000 7f951484f640 1 --2- 172.21.15.78:0/3995427939 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f94fc07af90 0x7f94fc07d450 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.546+0000 7f951484f640 1 --2- 172.21.15.78:0/3995427939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95101067f0 0x7f9510198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.546+0000 7f951484f640 1 --2- 172.21.15.78:0/3995427939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95101007f0 0x7f95101988d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:49.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.546+0000 7f951484f640 1 -- 172.21.15.78:0/3995427939 >> 172.21.15.78:0/3995427939 conn(0x7f95100fc550 msgr2=0x7f95100fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:49.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.546+0000 7f951484f640 1 -- 172.21.15.78:0/3995427939 shutdown_connections 2024-09-18T12:59:49.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T12:59:49.546+0000 7f951484f640 1 -- 172.21.15.78:0/3995427939 wait complete. 2024-09-18T12:59:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:49 smithi148 ceph-mon[80030]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:49 smithi148 ceph-mon[80030]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:49 smithi148 ceph-mon[80030]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:49 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/115233442' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:49 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2891778073' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:59:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:50 smithi148 ceph-mon[80030]: pgmap v320: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:50 smithi148 ceph-mon[80030]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:50 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3995427939' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:59:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:50 smithi078 ceph-mon[108578]: pgmap v320: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:50 smithi078 ceph-mon[108578]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:50 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3995427939' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:59:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:52 smithi148 ceph-mon[80030]: pgmap v321: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:52.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:52 smithi078 ceph-mon[108578]: pgmap v321: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:54.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:54 smithi078 ceph-mon[108578]: pgmap v322: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:54.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:54 smithi148 ceph-mon[80030]: pgmap v322: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:56 smithi148 ceph-mon[80030]: pgmap v323: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:56.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:56 smithi078 ceph-mon[108578]: pgmap v323: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 12:59:58 smithi148 ceph-mon[80030]: pgmap v324: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T12:59:58.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 12:59:58 smithi078 ceph-mon[108578]: pgmap v324: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:00.311 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:00 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[108574]: 2024-09-18T12:59:59.998+0000 7f54f7b0e640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:00:00.311 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:00 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[108574]: 2024-09-18T12:59:59.998+0000 7f54f7b0e640 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:00:00.311 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:00 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[108574]: 2024-09-18T12:59:59.998+0000 7f54f7b0e640 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-09-18T13:00:00.311 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:00 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[108574]: 2024-09-18T12:59:59.998+0000 7f54f7b0e640 -1 log_channel(cluster) log [ERR] : [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:00:00.312 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:00 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[108574]: 2024-09-18T12:59:59.998+0000 7f54f7b0e640 -1 log_channel(cluster) log [ERR] : fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:00:00.312 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:00 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[108574]: 2024-09-18T12:59:59.998+0000 7f54f7b0e640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:00:00.312 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:00 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[108574]: 2024-09-18T12:59:59.998+0000 7f54f7b0e640 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-09-18T13:00:00.312 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:00 smithi078 ceph-mon[108578]: pgmap v325: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:00.312 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:00 smithi078 ceph-mon[108578]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:00:00.312 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:00 smithi078 ceph-mon[108578]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:00:00.312 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:00 smithi078 ceph-mon[108578]: fs cephfs is degraded 2024-09-18T13:00:00.709 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:00 smithi078 ceph-mon[108578]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:00:00.709 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:00 smithi078 ceph-mon[108578]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:00:00.709 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:00 smithi078 ceph-mon[108578]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:00:00.709 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:00 smithi078 ceph-mon[108578]: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:00:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:00 smithi148 ceph-mon[80030]: pgmap v325: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:00 smithi148 ceph-mon[80030]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:00:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:00 smithi148 ceph-mon[80030]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:00:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:00 smithi148 ceph-mon[80030]: fs cephfs is degraded 2024-09-18T13:00:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:00 smithi148 ceph-mon[80030]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:00:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:00 smithi148 ceph-mon[80030]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:00:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:00 smithi148 ceph-mon[80030]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:00:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:00 smithi148 ceph-mon[80030]: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:00:02.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:02 smithi148 ceph-mon[80030]: pgmap v326: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:02.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:02 smithi078 ceph-mon[108578]: pgmap v326: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:04 smithi148 ceph-mon[80030]: pgmap v327: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:04.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:04 smithi078 ceph-mon[108578]: pgmap v327: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:06.708 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:06 smithi078 ceph-mon[108578]: pgmap v328: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:06.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:06 smithi148 ceph-mon[80030]: pgmap v328: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:08.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:08 smithi148 ceph-mon[80030]: pgmap v329: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:08.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:08 smithi078 ceph-mon[108578]: pgmap v329: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:10.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:10 smithi148 ceph-mon[80030]: pgmap v330: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:10.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:10 smithi078 ceph-mon[108578]: pgmap v330: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:12.707 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:12 smithi078 ceph-mon[108578]: pgmap v331: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:12.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:12 smithi148 ceph-mon[80030]: pgmap v331: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:14 smithi148 ceph-mon[80030]: pgmap v332: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:14 smithi078 ceph-mon[108578]: pgmap v332: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:16.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:16 smithi148 ceph-mon[80030]: pgmap v333: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:16 smithi078 ceph-mon[108578]: pgmap v333: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:18.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:18 smithi078 ceph-mon[108578]: pgmap v334: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:18 smithi148 ceph-mon[80030]: pgmap v334: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:19.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.639+0000 7fc11fb34640 1 -- 172.21.15.78:0/2670814691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc118101900 msgr2=0x7fc118101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:19.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.639+0000 7fc11fb34640 1 --2- 172.21.15.78:0/2670814691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc118101900 0x7fc118101d60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc114009880 tx=0x7fc11402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:19.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.639+0000 7fc11fb34640 1 -- 172.21.15.78:0/2670814691 shutdown_connections 2024-09-18T13:00:19.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.639+0000 7fc11fb34640 1 --2- 172.21.15.78:0/2670814691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc118101900 0x7fc118101d60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:19.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.639+0000 7fc11fb34640 1 --2- 172.21.15.78:0/2670814691 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc118107900 0x7fc118107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:19.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.639+0000 7fc11fb34640 1 -- 172.21.15.78:0/2670814691 >> 172.21.15.78:0/2670814691 conn(0x7fc1180fd600 msgr2=0x7fc1180ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:19.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.639+0000 7fc11fb34640 1 -- 172.21.15.78:0/2670814691 shutdown_connections 2024-09-18T13:00:19.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.639+0000 7fc11fb34640 1 -- 172.21.15.78:0/2670814691 wait complete. 2024-09-18T13:00:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.640+0000 7fc11fb34640 1 Processor -- start 2024-09-18T13:00:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.640+0000 7fc11fb34640 1 -- start start 2024-09-18T13:00:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.640+0000 7fc11fb34640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc118101900 0x7fc11819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.640+0000 7fc11fb34640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc118107900 0x7fc11819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.640+0000 7fc11fb34640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc11810edd0 con 0x7fc118107900 2024-09-18T13:00:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.640+0000 7fc11fb34640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc11810ec50 con 0x7fc118101900 2024-09-18T13:00:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.640+0000 7fc11d0cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc118107900 0x7fc11819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.640+0000 7fc11d0cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc118107900 0x7fc11819db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37724/0 (socket says 172.21.15.78:37724) 2024-09-18T13:00:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.640+0000 7fc11d0cf640 1 -- 172.21.15.78:0/3971700451 learned_addr learned my addr 172.21.15.78:0/3971700451 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:00:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.641+0000 7fc11d8d0640 1 --2- 172.21.15.78:0/3971700451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc118101900 0x7fc11819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.641+0000 7fc11d0cf640 1 -- 172.21.15.78:0/3971700451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc118101900 msgr2=0x7fc11819d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.641+0000 7fc11d0cf640 1 --2- 172.21.15.78:0/3971700451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc118101900 0x7fc11819d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.641+0000 7fc11d0cf640 1 -- 172.21.15.78:0/3971700451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1181977a0 con 0x7fc118107900 2024-09-18T13:00:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.641+0000 7fc11d0cf640 1 --2- 172.21.15.78:0/3971700451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc118107900 0x7fc11819db60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc114031460 tx=0x7fc1140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.641+0000 7fc10affd640 1 -- 172.21.15.78:0/3971700451 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc11403f070 con 0x7fc118107900 2024-09-18T13:00:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.641+0000 7fc11fb34640 1 -- 172.21.15.78:0/3971700451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc118197a30 con 0x7fc118107900 2024-09-18T13:00:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.641+0000 7fc10affd640 1 -- 172.21.15.78:0/3971700451 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1140035f0 con 0x7fc118107900 2024-09-18T13:00:19.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.641+0000 7fc10affd640 1 -- 172.21.15.78:0/3971700451 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc114035030 con 0x7fc118107900 2024-09-18T13:00:19.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.641+0000 7fc11fb34640 1 -- 172.21.15.78:0/3971700451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc118197f60 con 0x7fc118107900 2024-09-18T13:00:19.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.642+0000 7fc11fb34640 1 -- 172.21.15.78:0/3971700451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc118103040 con 0x7fc118107900 2024-09-18T13:00:19.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.643+0000 7fc10affd640 1 -- 172.21.15.78:0/3971700451 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc114042070 con 0x7fc118107900 2024-09-18T13:00:19.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.643+0000 7fc10affd640 1 --2- 172.21.15.78:0/3971700451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc10407af30 0x7fc10407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:19.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.644+0000 7fc11d8d0640 1 --2- 172.21.15.78:0/3971700451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc10407af30 0x7fc10407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:19.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.644+0000 7fc10affd640 1 -- 172.21.15.78:0/3971700451 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fc1140be9d0 con 0x7fc118107900 2024-09-18T13:00:19.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.644+0000 7fc11d8d0640 1 --2- 172.21.15.78:0/3971700451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc10407af30 0x7fc10407d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc10c005fd0 tx=0x7fc10c00b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:19.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.648+0000 7fc10affd640 1 -- 172.21.15.78:0/3971700451 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc114089f70 con 0x7fc118107900 2024-09-18T13:00:19.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.840+0000 7fc11fb34640 1 -- 172.21.15.78:0/3971700451 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc118198210 con 0x7fc10407af30 2024-09-18T13:00:19.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.841+0000 7fc10affd640 1 -- 172.21.15.78:0/3971700451 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc118198210 con 0x7fc10407af30 2024-09-18T13:00:19.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.844+0000 7fc11fb34640 1 -- 172.21.15.78:0/3971700451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc10407af30 msgr2=0x7fc10407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:19.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.844+0000 7fc11fb34640 1 --2- 172.21.15.78:0/3971700451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc10407af30 0x7fc10407d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc10c005fd0 tx=0x7fc10c00b390 comp rx=0 tx=0).stop 2024-09-18T13:00:19.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.844+0000 7fc11fb34640 1 -- 172.21.15.78:0/3971700451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc118107900 msgr2=0x7fc11819db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:19.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.844+0000 7fc11fb34640 1 --2- 172.21.15.78:0/3971700451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc118107900 0x7fc11819db60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc114031460 tx=0x7fc1140045e0 comp rx=0 tx=0).stop 2024-09-18T13:00:19.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.844+0000 7fc11fb34640 1 -- 172.21.15.78:0/3971700451 shutdown_connections 2024-09-18T13:00:19.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.844+0000 7fc11fb34640 1 --2- 172.21.15.78:0/3971700451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc10407af30 0x7fc10407d3f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:19.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.844+0000 7fc11fb34640 1 --2- 172.21.15.78:0/3971700451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc118107900 0x7fc11819db60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:19.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.844+0000 7fc11fb34640 1 --2- 172.21.15.78:0/3971700451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc118101900 0x7fc11819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:19.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.844+0000 7fc11fb34640 1 -- 172.21.15.78:0/3971700451 >> 172.21.15.78:0/3971700451 conn(0x7fc1180fd600 msgr2=0x7fc1180fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:19.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.844+0000 7fc11fb34640 1 -- 172.21.15.78:0/3971700451 shutdown_connections 2024-09-18T13:00:19.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.844+0000 7fc11fb34640 1 -- 172.21.15.78:0/3971700451 wait complete. 2024-09-18T13:00:19.854 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:00:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.927+0000 7f7f74779640 1 -- 172.21.15.78:0/1017477854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f6c100800 msgr2=0x7f7f6c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.927+0000 7f7f74779640 1 --2- 172.21.15.78:0/1017477854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f6c100800 0x7f7f6c100c60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009880 tx=0x7f7f5c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.927+0000 7f7f74779640 1 -- 172.21.15.78:0/1017477854 shutdown_connections 2024-09-18T13:00:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.927+0000 7f7f74779640 1 --2- 172.21.15.78:0/1017477854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f6c100800 0x7f7f6c100c60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.927+0000 7f7f74779640 1 --2- 172.21.15.78:0/1017477854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f6c106800 0x7f7f6c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.928+0000 7f7f74779640 1 -- 172.21.15.78:0/1017477854 >> 172.21.15.78:0/1017477854 conn(0x7f7f6c0fc520 msgr2=0x7f7f6c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.928+0000 7f7f74779640 1 -- 172.21.15.78:0/1017477854 shutdown_connections 2024-09-18T13:00:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.928+0000 7f7f74779640 1 -- 172.21.15.78:0/1017477854 wait complete. 2024-09-18T13:00:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.928+0000 7f7f74779640 1 Processor -- start 2024-09-18T13:00:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.928+0000 7f7f74779640 1 -- start start 2024-09-18T13:00:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.928+0000 7f7f74779640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f6c100800 0x7f7f6c1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:19.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.928+0000 7f7f74779640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f6c106800 0x7f7f6c198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:19.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.928+0000 7f7f74779640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c10dcb0 con 0x7f7f6c106800 2024-09-18T13:00:19.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.928+0000 7f7f74779640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c10db30 con 0x7f7f6c100800 2024-09-18T13:00:19.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.929+0000 7f7f71d14640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f6c106800 0x7f7f6c198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:19.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.929+0000 7f7f71d14640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f6c106800 0x7f7f6c198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37748/0 (socket says 172.21.15.78:37748) 2024-09-18T13:00:19.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.929+0000 7f7f71d14640 1 -- 172.21.15.78:0/2500420538 learned_addr learned my addr 172.21.15.78:0/2500420538 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:00:19.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.929+0000 7f7f72515640 1 --2- 172.21.15.78:0/2500420538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f6c100800 0x7f7f6c1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:19.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.929+0000 7f7f71d14640 1 -- 172.21.15.78:0/2500420538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f6c100800 msgr2=0x7f7f6c1987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:19.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.929+0000 7f7f71d14640 1 --2- 172.21.15.78:0/2500420538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f6c100800 0x7f7f6c1987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:19.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.929+0000 7f7f71d14640 1 -- 172.21.15.78:0/2500420538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6c199300 con 0x7f7f6c106800 2024-09-18T13:00:19.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.929+0000 7f7f71d14640 1 --2- 172.21.15.78:0/2500420538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f6c106800 0x7f7f6c198d00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c031460 tx=0x7f7f5c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:19.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.929+0000 7f7f637fe640 1 -- 172.21.15.78:0/2500420538 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f5c03f070 con 0x7f7f6c106800 2024-09-18T13:00:19.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.929+0000 7f7f637fe640 1 -- 172.21.15.78:0/2500420538 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7f5c004cf0 con 0x7f7f6c106800 2024-09-18T13:00:19.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.929+0000 7f7f74779640 1 -- 172.21.15.78:0/2500420538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6c199590 con 0x7f7f6c106800 2024-09-18T13:00:19.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.929+0000 7f7f637fe640 1 -- 172.21.15.78:0/2500420538 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f5c035030 con 0x7f7f6c106800 2024-09-18T13:00:19.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.929+0000 7f7f74779640 1 -- 172.21.15.78:0/2500420538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6c1a1b40 con 0x7f7f6c106800 2024-09-18T13:00:19.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.930+0000 7f7f74779640 1 -- 172.21.15.78:0/2500420538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f6c101f40 con 0x7f7f6c106800 2024-09-18T13:00:19.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.931+0000 7f7f637fe640 1 -- 172.21.15.78:0/2500420538 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7f5c042070 con 0x7f7f6c106800 2024-09-18T13:00:19.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.931+0000 7f7f637fe640 1 --2- 172.21.15.78:0/2500420538 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f5807af80 0x7f7f5807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:19.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.931+0000 7f7f72515640 1 --2- 172.21.15.78:0/2500420538 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f5807af80 0x7f7f5807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:19.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.931+0000 7f7f637fe640 1 -- 172.21.15.78:0/2500420538 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f7f5c0be990 con 0x7f7f6c106800 2024-09-18T13:00:19.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.932+0000 7f7f72515640 1 --2- 172.21.15.78:0/2500420538 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f5807af80 0x7f7f5807d440 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7f680058c0 tx=0x7f7f6800a2d0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:19.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:19.936+0000 7f7f637fe640 1 -- 172.21.15.78:0/2500420538 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7f5c089fb0 con 0x7f7f6c106800 2024-09-18T13:00:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.128+0000 7f7f74779640 1 -- 172.21.15.78:0/2500420538 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7f6c062630 con 0x7f7f5807af80 2024-09-18T13:00:20.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.129+0000 7f7f637fe640 1 -- 172.21.15.78:0/2500420538 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7f6c062630 con 0x7f7f5807af80 2024-09-18T13:00:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.131+0000 7f7f74779640 1 -- 172.21.15.78:0/2500420538 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f5807af80 msgr2=0x7f7f5807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.131+0000 7f7f74779640 1 --2- 172.21.15.78:0/2500420538 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f5807af80 0x7f7f5807d440 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7f680058c0 tx=0x7f7f6800a2d0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.131+0000 7f7f74779640 1 -- 172.21.15.78:0/2500420538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f6c106800 msgr2=0x7f7f6c198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.131+0000 7f7f74779640 1 --2- 172.21.15.78:0/2500420538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f6c106800 0x7f7f6c198d00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c031460 tx=0x7f7f5c0048f0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.131+0000 7f7f74779640 1 -- 172.21.15.78:0/2500420538 shutdown_connections 2024-09-18T13:00:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.131+0000 7f7f74779640 1 --2- 172.21.15.78:0/2500420538 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f5807af80 0x7f7f5807d440 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.131+0000 7f7f74779640 1 --2- 172.21.15.78:0/2500420538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f6c106800 0x7f7f6c198d00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.131+0000 7f7f74779640 1 --2- 172.21.15.78:0/2500420538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f6c100800 0x7f7f6c1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.131+0000 7f7f74779640 1 -- 172.21.15.78:0/2500420538 >> 172.21.15.78:0/2500420538 conn(0x7f7f6c0fc520 msgr2=0x7f7f6c0fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.131+0000 7f7f74779640 1 -- 172.21.15.78:0/2500420538 shutdown_connections 2024-09-18T13:00:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.131+0000 7f7f74779640 1 -- 172.21.15.78:0/2500420538 wait complete. 2024-09-18T13:00:20.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.212+0000 7f1442f0c640 1 -- 172.21.15.78:0/339089168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f143c106800 msgr2=0x7f143c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:20.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.212+0000 7f1442f0c640 1 --2- 172.21.15.78:0/339089168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f143c106800 0x7f143c106be0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1430009880 tx=0x7f143002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.212+0000 7f1442f0c640 1 -- 172.21.15.78:0/339089168 shutdown_connections 2024-09-18T13:00:20.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.212+0000 7f1442f0c640 1 --2- 172.21.15.78:0/339089168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c100800 0x7f143c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.212+0000 7f1442f0c640 1 --2- 172.21.15.78:0/339089168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f143c106800 0x7f143c106be0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.212+0000 7f1442f0c640 1 -- 172.21.15.78:0/339089168 >> 172.21.15.78:0/339089168 conn(0x7f143c0fc520 msgr2=0x7f143c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:20.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.212+0000 7f1442f0c640 1 -- 172.21.15.78:0/339089168 shutdown_connections 2024-09-18T13:00:20.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.213+0000 7f1442f0c640 1 -- 172.21.15.78:0/339089168 wait complete. 2024-09-18T13:00:20.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.213+0000 7f1442f0c640 1 Processor -- start 2024-09-18T13:00:20.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.213+0000 7f1442f0c640 1 -- start start 2024-09-18T13:00:20.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.214+0000 7f1442f0c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c100800 0x7f143c1987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:20.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.214+0000 7f1442f0c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f143c106800 0x7f143c198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:20.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.214+0000 7f1442f0c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f143c10dcd0 con 0x7f143c106800 2024-09-18T13:00:20.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.214+0000 7f1442f0c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f143c10db50 con 0x7f143c100800 2024-09-18T13:00:20.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.214+0000 7f143bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f143c106800 0x7f143c198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:20.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.214+0000 7f143bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f143c106800 0x7f143c198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37776/0 (socket says 172.21.15.78:37776) 2024-09-18T13:00:20.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.214+0000 7f143bfff640 1 -- 172.21.15.78:0/1446221193 learned_addr learned my addr 172.21.15.78:0/1446221193 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:00:20.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.214+0000 7f1440ca8640 1 --2- 172.21.15.78:0/1446221193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c100800 0x7f143c1987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:20.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.214+0000 7f143bfff640 1 -- 172.21.15.78:0/1446221193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c100800 msgr2=0x7f143c1987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:20.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.214+0000 7f143bfff640 1 --2- 172.21.15.78:0/1446221193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c100800 0x7f143c1987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.214+0000 7f143bfff640 1 -- 172.21.15.78:0/1446221193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143c199360 con 0x7f143c106800 2024-09-18T13:00:20.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.214+0000 7f143bfff640 1 --2- 172.21.15.78:0/1446221193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f143c106800 0x7f143c198d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f142800d6f0 tx=0x7f142800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:20.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.214+0000 7f1439ffb640 1 -- 172.21.15.78:0/1446221193 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1428017070 con 0x7f143c106800 2024-09-18T13:00:20.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.215+0000 7f1439ffb640 1 -- 172.21.15.78:0/1446221193 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f142800de00 con 0x7f143c106800 2024-09-18T13:00:20.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.215+0000 7f1439ffb640 1 -- 172.21.15.78:0/1446221193 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1428004bb0 con 0x7f143c106800 2024-09-18T13:00:20.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.215+0000 7f1442f0c640 1 -- 172.21.15.78:0/1446221193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143c1a1840 con 0x7f143c106800 2024-09-18T13:00:20.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.215+0000 7f1442f0c640 1 -- 172.21.15.78:0/1446221193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f143c1a1c40 con 0x7f143c106800 2024-09-18T13:00:20.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.216+0000 7f1442f0c640 1 -- 172.21.15.78:0/1446221193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f143c101f40 con 0x7f143c106800 2024-09-18T13:00:20.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.217+0000 7f1439ffb640 1 -- 172.21.15.78:0/1446221193 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1428009a30 con 0x7f143c106800 2024-09-18T13:00:20.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.217+0000 7f1439ffb640 1 --2- 172.21.15.78:0/1446221193 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f142c07af80 0x7f142c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:20.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.217+0000 7f1439ffb640 1 -- 172.21.15.78:0/1446221193 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f142809db20 con 0x7f143c106800 2024-09-18T13:00:20.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.217+0000 7f1440ca8640 1 --2- 172.21.15.78:0/1446221193 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f142c07af80 0x7f142c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:20.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.218+0000 7f1440ca8640 1 --2- 172.21.15.78:0/1446221193 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f142c07af80 0x7f142c07d440 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f14300096c0 tx=0x7f1430031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:20.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.223+0000 7f1439ffb640 1 -- 172.21.15.78:0/1446221193 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1428069140 con 0x7f143c106800 2024-09-18T13:00:20.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.407+0000 7f1442f0c640 1 -- 172.21.15.78:0/1446221193 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f143c108de0 con 0x7f142c07af80 2024-09-18T13:00:20.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.416+0000 7f1439ffb640 1 -- 172.21.15.78:0/1446221193 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f1430004260 con 0x7f142c07af80 2024-09-18T13:00:20.417 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:00:20.417 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (8m) 2m ago 19m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:00:20.417 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (10m) 2m ago 19m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:00:20.417 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (10m) 114s ago 18m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:00:20.418 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (6m) 2m ago 19m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:00:20.418 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (6m) 114s ago 18m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:00:20.418 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (7m) 2m ago 18m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:00:20.418 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (2m) 2m ago 13m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:00:20.418 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (2m) 2m ago 13m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:00:20.418 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (2m) 114s ago 13m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:00:20.418 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (117s) 114s ago 13m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:00:20.418 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (10m) 2m ago 20m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:00:20.418 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (9m) 114s ago 18m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:00:20.418 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (6m) 2m ago 20m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:00:20.418 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (6m) 114s ago 18m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:00:20.418 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (8m) 2m ago 19m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:00:20.418 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (8m) 114s ago 18m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:00:20.419 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (5m) 2m ago 17m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:00:20.419 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (5m) 2m ago 16m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:00:20.419 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (4m) 2m ago 16m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:00:20.419 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (4m) 114s ago 15m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:00:20.419 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (3m) 114s ago 15m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:00:20.419 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (3m) 114s ago 14m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:00:20.419 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (8m) 2m ago 18m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:00:20.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.418+0000 7f1442f0c640 1 -- 172.21.15.78:0/1446221193 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f142c07af80 msgr2=0x7f142c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:20.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.418+0000 7f1442f0c640 1 --2- 172.21.15.78:0/1446221193 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f142c07af80 0x7f142c07d440 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f14300096c0 tx=0x7f1430031400 comp rx=0 tx=0).stop 2024-09-18T13:00:20.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.418+0000 7f1442f0c640 1 -- 172.21.15.78:0/1446221193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f143c106800 msgr2=0x7f143c198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:20.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.418+0000 7f1442f0c640 1 --2- 172.21.15.78:0/1446221193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f143c106800 0x7f143c198d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f142800d6f0 tx=0x7f142800dbb0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.418+0000 7f1442f0c640 1 -- 172.21.15.78:0/1446221193 shutdown_connections 2024-09-18T13:00:20.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.418+0000 7f1442f0c640 1 --2- 172.21.15.78:0/1446221193 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f142c07af80 0x7f142c07d440 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.418+0000 7f1442f0c640 1 --2- 172.21.15.78:0/1446221193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f143c106800 0x7f143c198d10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.418+0000 7f1442f0c640 1 --2- 172.21.15.78:0/1446221193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c100800 0x7f143c1987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.418+0000 7f1442f0c640 1 -- 172.21.15.78:0/1446221193 >> 172.21.15.78:0/1446221193 conn(0x7f143c0fc520 msgr2=0x7f143c0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:20.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.418+0000 7f1442f0c640 1 -- 172.21.15.78:0/1446221193 shutdown_connections 2024-09-18T13:00:20.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.418+0000 7f1442f0c640 1 -- 172.21.15.78:0/1446221193 wait complete. 2024-09-18T13:00:20.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:20 smithi078 ceph-mon[108578]: pgmap v335: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.497+0000 7f100b874640 1 -- 172.21.15.78:0/2506643690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10041067f0 msgr2=0x7f1004106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.497+0000 7f100b874640 1 --2- 172.21.15.78:0/2506643690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10041067f0 0x7f1004106bd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1000009880 tx=0x7f100002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.497+0000 7f100b874640 1 -- 172.21.15.78:0/2506643690 shutdown_connections 2024-09-18T13:00:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.497+0000 7f100b874640 1 --2- 172.21.15.78:0/2506643690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10041007f0 0x7f1004100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.497+0000 7f100b874640 1 --2- 172.21.15.78:0/2506643690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10041067f0 0x7f1004106bd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.497+0000 7f100b874640 1 -- 172.21.15.78:0/2506643690 >> 172.21.15.78:0/2506643690 conn(0x7f10040fc550 msgr2=0x7f10040fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.498+0000 7f100b874640 1 -- 172.21.15.78:0/2506643690 shutdown_connections 2024-09-18T13:00:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.498+0000 7f100b874640 1 -- 172.21.15.78:0/2506643690 wait complete. 2024-09-18T13:00:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.498+0000 7f100b874640 1 Processor -- start 2024-09-18T13:00:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.498+0000 7f100b874640 1 -- start start 2024-09-18T13:00:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.498+0000 7f100b874640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10041007f0 0x7f1004196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.498+0000 7f100b874640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10041067f0 0x7f1004196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.498+0000 7f100b874640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f100410dcc0 con 0x7f10041007f0 2024-09-18T13:00:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.498+0000 7f100b874640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f100410db40 con 0x7f10041067f0 2024-09-18T13:00:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.499+0000 7f1009610640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10041007f0 0x7f1004196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.499+0000 7f1009610640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10041007f0 0x7f1004196600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37796/0 (socket says 172.21.15.78:37796) 2024-09-18T13:00:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.499+0000 7f1009610640 1 -- 172.21.15.78:0/4125126753 learned_addr learned my addr 172.21.15.78:0/4125126753 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:00:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.499+0000 7f1008e0f640 1 --2- 172.21.15.78:0/4125126753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10041067f0 0x7f1004196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.499+0000 7f1009610640 1 -- 172.21.15.78:0/4125126753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10041067f0 msgr2=0x7f1004196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.499+0000 7f1009610640 1 --2- 172.21.15.78:0/4125126753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10041067f0 0x7f1004196b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.499+0000 7f1009610640 1 -- 172.21.15.78:0/4125126753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1004197080 con 0x7f10041007f0 2024-09-18T13:00:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.499+0000 7f1009610640 1 --2- 172.21.15.78:0/4125126753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10041007f0 0x7f1004196600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1000031460 tx=0x7f10000045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.499+0000 7f0ffa7fc640 1 -- 172.21.15.78:0/4125126753 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f100003f070 con 0x7f10041007f0 2024-09-18T13:00:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.499+0000 7f0ffa7fc640 1 -- 172.21.15.78:0/4125126753 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10000035f0 con 0x7f10041007f0 2024-09-18T13:00:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.499+0000 7f100b874640 1 -- 172.21.15.78:0/4125126753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1004197310 con 0x7f10041007f0 2024-09-18T13:00:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.499+0000 7f0ffa7fc640 1 -- 172.21.15.78:0/4125126753 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1000035030 con 0x7f10041007f0 2024-09-18T13:00:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.499+0000 7f100b874640 1 -- 172.21.15.78:0/4125126753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10041a3e40 con 0x7f10041007f0 2024-09-18T13:00:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.500+0000 7f100b874640 1 -- 172.21.15.78:0/4125126753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1004101f30 con 0x7f10041007f0 2024-09-18T13:00:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.501+0000 7f0ffa7fc640 1 -- 172.21.15.78:0/4125126753 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1000042070 con 0x7f10041007f0 2024-09-18T13:00:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.501+0000 7f0ffa7fc640 1 --2- 172.21.15.78:0/4125126753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0ff007af30 0x7f0ff007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.501+0000 7f0ffa7fc640 1 -- 172.21.15.78:0/4125126753 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f10000bea80 con 0x7f10041007f0 2024-09-18T13:00:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.501+0000 7f1008e0f640 1 --2- 172.21.15.78:0/4125126753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0ff007af30 0x7f0ff007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.502+0000 7f1008e0f640 1 --2- 172.21.15.78:0/4125126753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0ff007af30 0x7f0ff007d3f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4005fd0 tx=0x7f0ff4005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.506+0000 7f0ffa7fc640 1 -- 172.21.15.78:0/4125126753 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f100008a020 con 0x7f10041007f0 2024-09-18T13:00:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:20 smithi148 ceph-mon[80030]: pgmap v335: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:20.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.754+0000 7f100b874640 1 -- 172.21.15.78:0/4125126753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1004108d90 con 0x7f10041007f0 2024-09-18T13:00:20.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.754+0000 7f0ffa7fc640 1 -- 172.21.15.78:0/4125126753 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f100008c070 con 0x7f10041007f0 2024-09-18T13:00:20.756 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:00:20.756 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:00:20.756 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:00:20.756 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:00:20.756 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:00:20.756 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:00:20.756 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:00:20.756 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:00:20.756 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:00:20.757 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:00:20.757 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:00:20.757 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:00:20.757 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:00:20.757 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:00:20.757 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:00:20.757 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:00:20.757 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:00:20.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.757+0000 7f100b874640 1 -- 172.21.15.78:0/4125126753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0ff007af30 msgr2=0x7f0ff007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:20.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.757+0000 7f100b874640 1 --2- 172.21.15.78:0/4125126753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0ff007af30 0x7f0ff007d3f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4005fd0 tx=0x7f0ff4005850 comp rx=0 tx=0).stop 2024-09-18T13:00:20.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.757+0000 7f100b874640 1 -- 172.21.15.78:0/4125126753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10041007f0 msgr2=0x7f1004196600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:20.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.757+0000 7f100b874640 1 --2- 172.21.15.78:0/4125126753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10041007f0 0x7f1004196600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1000031460 tx=0x7f10000045e0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.758+0000 7f100b874640 1 -- 172.21.15.78:0/4125126753 shutdown_connections 2024-09-18T13:00:20.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.758+0000 7f100b874640 1 --2- 172.21.15.78:0/4125126753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0ff007af30 0x7f0ff007d3f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.758+0000 7f100b874640 1 --2- 172.21.15.78:0/4125126753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10041067f0 0x7f1004196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.758+0000 7f100b874640 1 --2- 172.21.15.78:0/4125126753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10041007f0 0x7f1004196600 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.758+0000 7f100b874640 1 -- 172.21.15.78:0/4125126753 >> 172.21.15.78:0/4125126753 conn(0x7f10040fc550 msgr2=0x7f10040fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:20.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.758+0000 7f100b874640 1 -- 172.21.15.78:0/4125126753 shutdown_connections 2024-09-18T13:00:20.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.758+0000 7f100b874640 1 -- 172.21.15.78:0/4125126753 wait complete. 2024-09-18T13:00:20.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.839+0000 7fbc1383d640 1 -- 172.21.15.78:0/2234115626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0c074590 msgr2=0x7fbc0c074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:20.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.839+0000 7fbc1383d640 1 --2- 172.21.15.78:0/2234115626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0c074590 0x7fbc0c074970 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009880 tx=0x7fbc0802a530 comp rx=0 tx=0).stop 2024-09-18T13:00:20.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.839+0000 7fbc1383d640 1 -- 172.21.15.78:0/2234115626 shutdown_connections 2024-09-18T13:00:20.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.839+0000 7fbc1383d640 1 --2- 172.21.15.78:0/2234115626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc0c074eb0 0x7fbc0c1123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.839+0000 7fbc1383d640 1 --2- 172.21.15.78:0/2234115626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0c074590 0x7fbc0c074970 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.839+0000 7fbc1383d640 1 -- 172.21.15.78:0/2234115626 >> 172.21.15.78:0/2234115626 conn(0x7fbc0c0fd600 msgr2=0x7fbc0c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.840+0000 7fbc1383d640 1 -- 172.21.15.78:0/2234115626 shutdown_connections 2024-09-18T13:00:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.840+0000 7fbc1383d640 1 -- 172.21.15.78:0/2234115626 wait complete. 2024-09-18T13:00:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.840+0000 7fbc1383d640 1 Processor -- start 2024-09-18T13:00:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.840+0000 7fbc1383d640 1 -- start start 2024-09-18T13:00:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc1383d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc0c074590 0x7fbc0c19e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc1383d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0c074eb0 0x7fbc0c19e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc1383d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0c1153f0 con 0x7fbc0c074eb0 2024-09-18T13:00:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc1383d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0c115270 con 0x7fbc0c074590 2024-09-18T13:00:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc10dd8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0c074eb0 0x7fbc0c19e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc10dd8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0c074eb0 0x7fbc0c19e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37818/0 (socket says 172.21.15.78:37818) 2024-09-18T13:00:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc10dd8640 1 -- 172.21.15.78:0/1918728770 learned_addr learned my addr 172.21.15.78:0/1918728770 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:00:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc115d9640 1 --2- 172.21.15.78:0/1918728770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc0c074590 0x7fbc0c19e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc10dd8640 1 -- 172.21.15.78:0/1918728770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc0c074590 msgr2=0x7fbc0c19e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc10dd8640 1 --2- 172.21.15.78:0/1918728770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc0c074590 0x7fbc0c19e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc10dd8640 1 -- 172.21.15.78:0/1918728770 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0c1a2900 con 0x7fbc0c074eb0 2024-09-18T13:00:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc10dd8640 1 --2- 172.21.15.78:0/1918728770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0c074eb0 0x7fbc0c19e570 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00d6f0 tx=0x7fbbfc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc027fc640 1 -- 172.21.15.78:0/1918728770 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbbfc017070 con 0x7fbc0c074eb0 2024-09-18T13:00:20.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc1383d640 1 -- 172.21.15.78:0/1918728770 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc0c1a2bf0 con 0x7fbc0c074eb0 2024-09-18T13:00:20.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc027fc640 1 -- 172.21.15.78:0/1918728770 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbbfc00de00 con 0x7fbc0c074eb0 2024-09-18T13:00:20.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc027fc640 1 -- 172.21.15.78:0/1918728770 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbbfc004bb0 con 0x7fbc0c074eb0 2024-09-18T13:00:20.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.841+0000 7fbc1383d640 1 -- 172.21.15.78:0/1918728770 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc0c1a3180 con 0x7fbc0c074eb0 2024-09-18T13:00:20.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.843+0000 7fbc1383d640 1 -- 172.21.15.78:0/1918728770 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc0c075cd0 con 0x7fbc0c074eb0 2024-09-18T13:00:20.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.843+0000 7fbc027fc640 1 -- 172.21.15.78:0/1918728770 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbbfc004e60 con 0x7fbc0c074eb0 2024-09-18T13:00:20.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.844+0000 7fbc027fc640 1 --2- 172.21.15.78:0/1918728770 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbbf807af30 0x7fbbf807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:20.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.844+0000 7fbc027fc640 1 -- 172.21.15.78:0/1918728770 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fbbfc09dca0 con 0x7fbc0c074eb0 2024-09-18T13:00:20.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.844+0000 7fbc115d9640 1 --2- 172.21.15.78:0/1918728770 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbbf807af30 0x7fbbf807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:20.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.844+0000 7fbc115d9640 1 --2- 172.21.15.78:0/1918728770 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbbf807af30 0x7fbbf807d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbc080096c0 tx=0x7fbc08031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:20.848+0000 7fbc027fc640 1 -- 172.21.15.78:0/1918728770 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbbfc0a2070 con 0x7fbc0c074eb0 2024-09-18T13:00:21.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.058+0000 7fbc1383d640 1 -- 172.21.15.78:0/1918728770 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbc0c10fac0 con 0x7fbc0c074eb0 2024-09-18T13:00:21.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.058+0000 7fbc027fc640 1 -- 172.21.15.78:0/1918728770 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7fbbfc069240 con 0x7fbc0c074eb0 2024-09-18T13:00:21.060 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:00:21.060 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:00:21.060 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:00:21.060 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:00:21.060 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:00:21.060 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:00:21.060 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:00:21.060 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:00:21.060 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:00:21.061 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:00:21.061 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:00:21.061 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:00:21.061 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:00:21.061 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:00:21.061 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:00:21.061 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:00:21.061 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:00:21.061 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:00:21.061 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:00:21.061 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:00:21.061 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:00:21.061 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:00:21.062 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:00:21.062 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:00:21.062 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:00:21.062 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:00:21.062 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:00:21.062 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:00:21.062 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:00:21.062 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:00:21.062 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:00:21.062 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:00:21.062 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:00:21.062 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:00:21.062 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:00:21.062 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:00:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:00:21.063 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:00:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:00:21.063 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:21.063 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:21.063 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:21.063 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:00:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.061+0000 7fbc1383d640 1 -- 172.21.15.78:0/1918728770 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbbf807af30 msgr2=0x7fbbf807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.061+0000 7fbc1383d640 1 --2- 172.21.15.78:0/1918728770 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbbf807af30 0x7fbbf807d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbc080096c0 tx=0x7fbc08031400 comp rx=0 tx=0).stop 2024-09-18T13:00:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.061+0000 7fbc1383d640 1 -- 172.21.15.78:0/1918728770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0c074eb0 msgr2=0x7fbc0c19e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.061+0000 7fbc1383d640 1 --2- 172.21.15.78:0/1918728770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0c074eb0 0x7fbc0c19e570 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00d6f0 tx=0x7fbbfc00dbb0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.061+0000 7fbc1383d640 1 -- 172.21.15.78:0/1918728770 shutdown_connections 2024-09-18T13:00:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.061+0000 7fbc1383d640 1 --2- 172.21.15.78:0/1918728770 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbbf807af30 0x7fbbf807d3f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.061+0000 7fbc1383d640 1 --2- 172.21.15.78:0/1918728770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0c074eb0 0x7fbc0c19e570 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.061+0000 7fbc1383d640 1 --2- 172.21.15.78:0/1918728770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc0c074590 0x7fbc0c19e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.061+0000 7fbc1383d640 1 -- 172.21.15.78:0/1918728770 >> 172.21.15.78:0/1918728770 conn(0x7fbc0c0fd600 msgr2=0x7fbc0c104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:21.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.061+0000 7fbc1383d640 1 -- 172.21.15.78:0/1918728770 shutdown_connections 2024-09-18T13:00:21.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.061+0000 7fbc1383d640 1 -- 172.21.15.78:0/1918728770 wait complete. 2024-09-18T13:00:21.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.144+0000 7f6da4fa7640 1 -- 172.21.15.78:0/1347021544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6da01067f0 msgr2=0x7f6da0106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:21.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.144+0000 7f6da4fa7640 1 --2- 172.21.15.78:0/1347021544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6da01067f0 0x7f6da0106bd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009880 tx=0x7f6d9002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.144+0000 7f6da4fa7640 1 -- 172.21.15.78:0/1347021544 shutdown_connections 2024-09-18T13:00:21.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.144+0000 7f6da4fa7640 1 --2- 172.21.15.78:0/1347021544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6da01007f0 0x7f6da0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.144+0000 7f6da4fa7640 1 --2- 172.21.15.78:0/1347021544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6da01067f0 0x7f6da0106bd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.144+0000 7f6da4fa7640 1 -- 172.21.15.78:0/1347021544 >> 172.21.15.78:0/1347021544 conn(0x7f6da00fc550 msgr2=0x7f6da00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:21.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.144+0000 7f6da4fa7640 1 -- 172.21.15.78:0/1347021544 shutdown_connections 2024-09-18T13:00:21.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.144+0000 7f6da4fa7640 1 -- 172.21.15.78:0/1347021544 wait complete. 2024-09-18T13:00:21.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.144+0000 7f6da4fa7640 1 Processor -- start 2024-09-18T13:00:21.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.144+0000 7f6da4fa7640 1 -- start start 2024-09-18T13:00:21.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.145+0000 7f6da4fa7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6da01007f0 0x7f6da01988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:21.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.145+0000 7f6da4fa7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6da01067f0 0x7f6da0198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:21.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.145+0000 7f6da4fa7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6da010dca0 con 0x7f6da01067f0 2024-09-18T13:00:21.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.145+0000 7f6da4fa7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6da010db20 con 0x7f6da01007f0 2024-09-18T13:00:21.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.145+0000 7f6d9dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6da01067f0 0x7f6da0198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:21.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.145+0000 7f6d9dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6da01067f0 0x7f6da0198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37832/0 (socket says 172.21.15.78:37832) 2024-09-18T13:00:21.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.145+0000 7f6d9dd9b640 1 -- 172.21.15.78:0/529484610 learned_addr learned my addr 172.21.15.78:0/529484610 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:00:21.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.145+0000 7f6d9e59c640 1 --2- 172.21.15.78:0/529484610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6da01007f0 0x7f6da01988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:21.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.145+0000 7f6d9dd9b640 1 -- 172.21.15.78:0/529484610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6da01007f0 msgr2=0x7f6da01988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:21.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.145+0000 7f6d9dd9b640 1 --2- 172.21.15.78:0/529484610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6da01007f0 0x7f6da01988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.145+0000 7f6d9dd9b640 1 -- 172.21.15.78:0/529484610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da0199380 con 0x7f6da01067f0 2024-09-18T13:00:21.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.145+0000 7f6d9dd9b640 1 --2- 172.21.15.78:0/529484610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6da01067f0 0x7f6da0198e10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400c8a0 tx=0x7f6d9400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:21.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.145+0000 7f6d8f7fe640 1 -- 172.21.15.78:0/529484610 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d940079b0 con 0x7f6da01067f0 2024-09-18T13:00:21.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.145+0000 7f6da4fa7640 1 -- 172.21.15.78:0/529484610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da0199670 con 0x7f6da01067f0 2024-09-18T13:00:21.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.146+0000 7f6d8f7fe640 1 -- 172.21.15.78:0/529484610 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d94007b50 con 0x7f6da01067f0 2024-09-18T13:00:21.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.146+0000 7f6d8f7fe640 1 -- 172.21.15.78:0/529484610 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d94018700 con 0x7f6da01067f0 2024-09-18T13:00:21.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.146+0000 7f6da4fa7640 1 -- 172.21.15.78:0/529484610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da01a1c70 con 0x7f6da01067f0 2024-09-18T13:00:21.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.147+0000 7f6da4fa7640 1 -- 172.21.15.78:0/529484610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da0101f30 con 0x7f6da01067f0 2024-09-18T13:00:21.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.147+0000 7f6d8f7fe640 1 -- 172.21.15.78:0/529484610 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6d94007d00 con 0x7f6da01067f0 2024-09-18T13:00:21.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.148+0000 7f6d8f7fe640 1 --2- 172.21.15.78:0/529484610 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6d8807af30 0x7f6d8807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:21.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.148+0000 7f6d8f7fe640 1 -- 172.21.15.78:0/529484610 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f6d9409e350 con 0x7f6da01067f0 2024-09-18T13:00:21.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.148+0000 7f6d9e59c640 1 --2- 172.21.15.78:0/529484610 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6d8807af30 0x7f6d8807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:21.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.148+0000 7f6d9e59c640 1 --2- 172.21.15.78:0/529484610 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6d8807af30 0x7f6d8807d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d90031460 tx=0x7f6d90005bd0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:21.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.152+0000 7f6d8f7fe640 1 -- 172.21.15.78:0/529484610 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6d94014030 con 0x7f6da01067f0 2024-09-18T13:00:21.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.344+0000 7f6da4fa7640 1 -- 172.21.15.78:0/529484610 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6da0062630 con 0x7f6d8807af30 2024-09-18T13:00:21.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.346+0000 7f6d8f7fe640 1 -- 172.21.15.78:0/529484610 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6da0062630 con 0x7f6d8807af30 2024-09-18T13:00:21.347 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:00:21.347 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:00:21.347 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:00:21.347 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:00:21.347 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:00:21.347 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:00:21.347 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:00:21.347 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:00:21.347 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:00:21.347 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:00:21.347 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:00:21.348 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:00:21.348 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:00:21.348 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:00:21.348 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:00:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.349+0000 7f6da4fa7640 1 -- 172.21.15.78:0/529484610 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6d8807af30 msgr2=0x7f6d8807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.349+0000 7f6da4fa7640 1 --2- 172.21.15.78:0/529484610 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6d8807af30 0x7f6d8807d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d90031460 tx=0x7f6d90005bd0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.349+0000 7f6da4fa7640 1 -- 172.21.15.78:0/529484610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6da01067f0 msgr2=0x7f6da0198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.349+0000 7f6da4fa7640 1 --2- 172.21.15.78:0/529484610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6da01067f0 0x7f6da0198e10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400c8a0 tx=0x7f6d9400cd60 comp rx=0 tx=0).stop 2024-09-18T13:00:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.349+0000 7f6da4fa7640 1 -- 172.21.15.78:0/529484610 shutdown_connections 2024-09-18T13:00:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.349+0000 7f6da4fa7640 1 --2- 172.21.15.78:0/529484610 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6d8807af30 0x7f6d8807d3f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.349+0000 7f6da4fa7640 1 --2- 172.21.15.78:0/529484610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6da01067f0 0x7f6da0198e10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.349+0000 7f6da4fa7640 1 --2- 172.21.15.78:0/529484610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6da01007f0 0x7f6da01988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.349+0000 7f6da4fa7640 1 -- 172.21.15.78:0/529484610 >> 172.21.15.78:0/529484610 conn(0x7f6da00fc550 msgr2=0x7f6da00fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.349+0000 7f6da4fa7640 1 -- 172.21.15.78:0/529484610 shutdown_connections 2024-09-18T13:00:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.349+0000 7f6da4fa7640 1 -- 172.21.15.78:0/529484610 wait complete. 2024-09-18T13:00:21.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.430+0000 7f24fff85640 1 -- 172.21.15.78:0/4186948257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24f8100800 msgr2=0x7f24f8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:21.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.430+0000 7f24fff85640 1 --2- 172.21.15.78:0/4186948257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24f8100800 0x7f24f8100c60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009880 tx=0x7f24f402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.430+0000 7f24fff85640 1 -- 172.21.15.78:0/4186948257 shutdown_connections 2024-09-18T13:00:21.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.430+0000 7f24fff85640 1 --2- 172.21.15.78:0/4186948257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24f8100800 0x7f24f8100c60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.430+0000 7f24fff85640 1 --2- 172.21.15.78:0/4186948257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24f8106800 0x7f24f8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.430+0000 7f24fff85640 1 -- 172.21.15.78:0/4186948257 >> 172.21.15.78:0/4186948257 conn(0x7f24f80fc520 msgr2=0x7f24f80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:21.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.430+0000 7f24fff85640 1 -- 172.21.15.78:0/4186948257 shutdown_connections 2024-09-18T13:00:21.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.430+0000 7f24fff85640 1 -- 172.21.15.78:0/4186948257 wait complete. 2024-09-18T13:00:21.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.430+0000 7f24fff85640 1 Processor -- start 2024-09-18T13:00:21.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.430+0000 7f24fff85640 1 -- start start 2024-09-18T13:00:21.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24fff85640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24f8100800 0x7f24f8198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:21.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24fff85640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24f8106800 0x7f24f8198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:21.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24fff85640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f24f810dcb0 con 0x7f24f8106800 2024-09-18T13:00:21.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24fff85640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f24f810db30 con 0x7f24f8100800 2024-09-18T13:00:21.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24fd520640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24f8106800 0x7f24f8198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24fd520640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24f8106800 0x7f24f8198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55462/0 (socket says 172.21.15.78:55462) 2024-09-18T13:00:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24fd520640 1 -- 172.21.15.78:0/1502326331 learned_addr learned my addr 172.21.15.78:0/1502326331 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:00:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24fdd21640 1 --2- 172.21.15.78:0/1502326331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24f8100800 0x7f24f8198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24fd520640 1 -- 172.21.15.78:0/1502326331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24f8100800 msgr2=0x7f24f8198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24fd520640 1 --2- 172.21.15.78:0/1502326331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24f8100800 0x7f24f8198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24fd520640 1 -- 172.21.15.78:0/1502326331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f81992b0 con 0x7f24f8106800 2024-09-18T13:00:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24fd520640 1 --2- 172.21.15.78:0/1502326331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24f8106800 0x7f24f8198d40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f24f4031460 tx=0x7f24f40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24eeffd640 1 -- 172.21.15.78:0/1502326331 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24f403f070 con 0x7f24f8106800 2024-09-18T13:00:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24eeffd640 1 -- 172.21.15.78:0/1502326331 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24f4004cf0 con 0x7f24f8106800 2024-09-18T13:00:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24eeffd640 1 -- 172.21.15.78:0/1502326331 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24f4035030 con 0x7f24f8106800 2024-09-18T13:00:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.431+0000 7f24fff85640 1 -- 172.21.15.78:0/1502326331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f8199540 con 0x7f24f8106800 2024-09-18T13:00:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.432+0000 7f24fff85640 1 -- 172.21.15.78:0/1502326331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f81a1af0 con 0x7f24f8106800 2024-09-18T13:00:21.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.433+0000 7f24fff85640 1 -- 172.21.15.78:0/1502326331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f8101f40 con 0x7f24f8106800 2024-09-18T13:00:21.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.433+0000 7f24eeffd640 1 -- 172.21.15.78:0/1502326331 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f24f4042070 con 0x7f24f8106800 2024-09-18T13:00:21.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.433+0000 7f24eeffd640 1 --2- 172.21.15.78:0/1502326331 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f24e407af30 0x7f24e407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:21.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.434+0000 7f24eeffd640 1 -- 172.21.15.78:0/1502326331 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f24f40bea30 con 0x7f24f8106800 2024-09-18T13:00:21.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.434+0000 7f24fdd21640 1 --2- 172.21.15.78:0/1502326331 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f24e407af30 0x7f24e407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:21.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.434+0000 7f24fdd21640 1 --2- 172.21.15.78:0/1502326331 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f24e407af30 0x7f24e407d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f24e800abe0 tx=0x7f24e800a2d0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:21.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.438+0000 7f24eeffd640 1 -- 172.21.15.78:0/1502326331 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f24f4089fd0 con 0x7f24f8106800 2024-09-18T13:00:21.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.680+0000 7f24fff85640 1 -- 172.21.15.78:0/1502326331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f24f806a7a0 con 0x7f24f8106800 2024-09-18T13:00:21.681 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:21 smithi078 ceph-mon[108578]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:21.681 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:21 smithi078 ceph-mon[108578]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:21.681 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:21 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/4125126753' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:21.682 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:21 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1918728770' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:00:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.680+0000 7f24eeffd640 1 -- 172.21.15.78:0/1502326331 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f24f408ee80 con 0x7f24f8106800 2024-09-18T13:00:21.682 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:00:21.682 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:00:21.682 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:00:21.682 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:00:21.682 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:00:21.682 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:00:21.683 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:00:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.682+0000 7f24fff85640 1 -- 172.21.15.78:0/1502326331 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f24e407af30 msgr2=0x7f24e407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.682+0000 7f24fff85640 1 --2- 172.21.15.78:0/1502326331 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f24e407af30 0x7f24e407d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f24e800abe0 tx=0x7f24e800a2d0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.682+0000 7f24fff85640 1 -- 172.21.15.78:0/1502326331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24f8106800 msgr2=0x7f24f8198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.682+0000 7f24fff85640 1 --2- 172.21.15.78:0/1502326331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24f8106800 0x7f24f8198d40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f24f4031460 tx=0x7f24f40048f0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.682+0000 7f24fff85640 1 -- 172.21.15.78:0/1502326331 shutdown_connections 2024-09-18T13:00:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.682+0000 7f24fff85640 1 --2- 172.21.15.78:0/1502326331 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f24e407af30 0x7f24e407d3f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.682+0000 7f24fff85640 1 --2- 172.21.15.78:0/1502326331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24f8106800 0x7f24f8198d40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.682+0000 7f24fff85640 1 --2- 172.21.15.78:0/1502326331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24f8100800 0x7f24f8198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.682+0000 7f24fff85640 1 -- 172.21.15.78:0/1502326331 >> 172.21.15.78:0/1502326331 conn(0x7f24f80fc520 msgr2=0x7f24f80fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.682+0000 7f24fff85640 1 -- 172.21.15.78:0/1502326331 shutdown_connections 2024-09-18T13:00:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:21.682+0000 7f24fff85640 1 -- 172.21.15.78:0/1502326331 wait complete. 2024-09-18T13:00:21.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:21 smithi148 ceph-mon[80030]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:21.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:21 smithi148 ceph-mon[80030]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:21.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:21 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/4125126753' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:21.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:21 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1918728770' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:00:22.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:22 smithi078 ceph-mon[108578]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:22.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:22 smithi078 ceph-mon[108578]: pgmap v336: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:22.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:22 smithi078 ceph-mon[108578]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:22.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:22 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1502326331' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:00:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:22 smithi148 ceph-mon[80030]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:22 smithi148 ceph-mon[80030]: pgmap v336: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:22 smithi148 ceph-mon[80030]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:22 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1502326331' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:00:24.710 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:24 smithi078 ceph-mon[108578]: pgmap v337: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:24.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:24 smithi148 ceph-mon[80030]: pgmap v337: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:26 smithi148 ceph-mon[80030]: pgmap v338: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:26.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:26 smithi078 ceph-mon[108578]: pgmap v338: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:28 smithi148 ceph-mon[80030]: pgmap v339: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:28.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:28 smithi078 ceph-mon[108578]: pgmap v339: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:30.701 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:30 smithi078 ceph-mon[108578]: pgmap v340: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:30.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:30 smithi148 ceph-mon[80030]: pgmap v340: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:32 smithi148 ceph-mon[80030]: pgmap v341: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:32.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:32 smithi078 ceph-mon[108578]: pgmap v341: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:34 smithi148 ceph-mon[80030]: pgmap v342: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:34 smithi078 ceph-mon[108578]: pgmap v342: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:36.712 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:36 smithi078 ceph-mon[108578]: pgmap v343: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:36 smithi148 ceph-mon[80030]: pgmap v343: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:38.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:38 smithi148 ceph-mon[80030]: pgmap v344: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:38.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:38 smithi078 ceph-mon[108578]: pgmap v344: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:40 smithi148 ceph-mon[80030]: pgmap v345: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:40 smithi078 ceph-mon[108578]: pgmap v345: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:42.701 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:42 smithi078 ceph-mon[108578]: pgmap v346: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:42 smithi148 ceph-mon[80030]: pgmap v346: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:44 smithi148 ceph-mon[80030]: pgmap v347: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:44 smithi078 ceph-mon[108578]: pgmap v347: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:46 smithi148 ceph-mon[80030]: pgmap v348: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:46 smithi078 ceph-mon[108578]: pgmap v348: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:47 smithi148 ceph-mon[80030]: pgmap v349: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:47 smithi078 ceph-mon[108578]: pgmap v349: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:50.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:50 smithi078 ceph-mon[108578]: pgmap v350: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:50.691 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:50 smithi148 ceph-mon[80030]: pgmap v350: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.777+0000 7f31c951c640 1 -- 172.21.15.78:0/2731210415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31c4100800 msgr2=0x7f31c4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.777+0000 7f31c951c640 1 --2- 172.21.15.78:0/2731210415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31c4100800 0x7f31c4100c60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009880 tx=0x7f31ac02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.777+0000 7f31c951c640 1 -- 172.21.15.78:0/2731210415 shutdown_connections 2024-09-18T13:00:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.777+0000 7f31c951c640 1 --2- 172.21.15.78:0/2731210415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31c4100800 0x7f31c4100c60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.777+0000 7f31c951c640 1 --2- 172.21.15.78:0/2731210415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31c4106800 0x7f31c4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.777+0000 7f31c951c640 1 -- 172.21.15.78:0/2731210415 >> 172.21.15.78:0/2731210415 conn(0x7f31c40fc520 msgr2=0x7f31c40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.777+0000 7f31c951c640 1 -- 172.21.15.78:0/2731210415 shutdown_connections 2024-09-18T13:00:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.777+0000 7f31c951c640 1 -- 172.21.15.78:0/2731210415 wait complete. 2024-09-18T13:00:51.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.778+0000 7f31c951c640 1 Processor -- start 2024-09-18T13:00:51.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.778+0000 7f31c951c640 1 -- start start 2024-09-18T13:00:51.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.779+0000 7f31c951c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31c4100800 0x7f31c41987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:51.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.779+0000 7f31c951c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31c4106800 0x7f31c4198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:51.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.779+0000 7f31c951c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f31c410dcd0 con 0x7f31c4100800 2024-09-18T13:00:51.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.779+0000 7f31c951c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f31c410db50 con 0x7f31c4106800 2024-09-18T13:00:51.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.779+0000 7f31c2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31c4100800 0x7f31c41987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:51.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.779+0000 7f31c2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31c4100800 0x7f31c41987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49660/0 (socket says 172.21.15.78:49660) 2024-09-18T13:00:51.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.779+0000 7f31c2ffd640 1 -- 172.21.15.78:0/2784957446 learned_addr learned my addr 172.21.15.78:0/2784957446 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:00:51.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.779+0000 7f31ba7fc640 1 --2- 172.21.15.78:0/2784957446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31c4106800 0x7f31c4198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:51.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.779+0000 7f31c2ffd640 1 -- 172.21.15.78:0/2784957446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31c4106800 msgr2=0x7f31c4198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:51.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.779+0000 7f31c2ffd640 1 --2- 172.21.15.78:0/2784957446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31c4106800 0x7f31c4198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:51.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.779+0000 7f31c2ffd640 1 -- 172.21.15.78:0/2784957446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c4199320 con 0x7f31c4100800 2024-09-18T13:00:51.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.779+0000 7f31c2ffd640 1 --2- 172.21.15.78:0/2784957446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31c4100800 0x7f31c41987e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f31b400d6f0 tx=0x7f31b400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:51.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.780+0000 7f31c0ff9640 1 -- 172.21.15.78:0/2784957446 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f31b4017070 con 0x7f31c4100800 2024-09-18T13:00:51.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.780+0000 7f31c0ff9640 1 -- 172.21.15.78:0/2784957446 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31b400de00 con 0x7f31c4100800 2024-09-18T13:00:51.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.780+0000 7f31c951c640 1 -- 172.21.15.78:0/2784957446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c4199610 con 0x7f31c4100800 2024-09-18T13:00:51.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.780+0000 7f31c0ff9640 1 -- 172.21.15.78:0/2784957446 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f31b4004bb0 con 0x7f31c4100800 2024-09-18T13:00:51.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.780+0000 7f31c951c640 1 -- 172.21.15.78:0/2784957446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c41a1c10 con 0x7f31c4100800 2024-09-18T13:00:51.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.781+0000 7f31c951c640 1 -- 172.21.15.78:0/2784957446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c4101f40 con 0x7f31c4100800 2024-09-18T13:00:51.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.782+0000 7f31c0ff9640 1 -- 172.21.15.78:0/2784957446 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f31b4004e60 con 0x7f31c4100800 2024-09-18T13:00:51.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.782+0000 7f31c0ff9640 1 --2- 172.21.15.78:0/2784957446 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f31b007af30 0x7f31b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:51.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.782+0000 7f31c0ff9640 1 -- 172.21.15.78:0/2784957446 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f31b409dc00 con 0x7f31c4100800 2024-09-18T13:00:51.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.782+0000 7f31ba7fc640 1 --2- 172.21.15.78:0/2784957446 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f31b007af30 0x7f31b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:51.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.783+0000 7f31ba7fc640 1 --2- 172.21.15.78:0/2784957446 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f31b007af30 0x7f31b007d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f31c406ad00 tx=0x7f31ac031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:51.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.787+0000 7f31c0ff9640 1 -- 172.21.15.78:0/2784957446 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f31b40a3020 con 0x7f31c4100800 2024-09-18T13:00:51.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.981+0000 7f31c951c640 1 -- 172.21.15.78:0/2784957446 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f31c4062630 con 0x7f31b007af30 2024-09-18T13:00:51.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.982+0000 7f31c0ff9640 1 -- 172.21.15.78:0/2784957446 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f31c4062630 con 0x7f31b007af30 2024-09-18T13:00:51.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.984+0000 7f31c951c640 1 -- 172.21.15.78:0/2784957446 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f31b007af30 msgr2=0x7f31b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:51.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.984+0000 7f31c951c640 1 --2- 172.21.15.78:0/2784957446 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f31b007af30 0x7f31b007d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f31c406ad00 tx=0x7f31ac031400 comp rx=0 tx=0).stop 2024-09-18T13:00:51.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.984+0000 7f31c951c640 1 -- 172.21.15.78:0/2784957446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31c4100800 msgr2=0x7f31c41987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:51.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.984+0000 7f31c951c640 1 --2- 172.21.15.78:0/2784957446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31c4100800 0x7f31c41987e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f31b400d6f0 tx=0x7f31b400dbb0 comp rx=0 tx=0).stop 2024-09-18T13:00:51.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.984+0000 7f31c951c640 1 -- 172.21.15.78:0/2784957446 shutdown_connections 2024-09-18T13:00:51.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.984+0000 7f31c951c640 1 --2- 172.21.15.78:0/2784957446 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f31b007af30 0x7f31b007d3f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:51.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.984+0000 7f31c951c640 1 --2- 172.21.15.78:0/2784957446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31c4106800 0x7f31c4198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:51.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.984+0000 7f31c951c640 1 --2- 172.21.15.78:0/2784957446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31c4100800 0x7f31c41987e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:51.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.984+0000 7f31c951c640 1 -- 172.21.15.78:0/2784957446 >> 172.21.15.78:0/2784957446 conn(0x7f31c40fc520 msgr2=0x7f31c40fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:51.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.984+0000 7f31c951c640 1 -- 172.21.15.78:0/2784957446 shutdown_connections 2024-09-18T13:00:51.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:51.984+0000 7f31c951c640 1 -- 172.21.15.78:0/2784957446 wait complete. 2024-09-18T13:00:51.994 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:00:52.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.066+0000 7fcc9b4d2640 1 -- 172.21.15.78:0/2305257996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc941033e0 msgr2=0x7fcc9410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:52.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.066+0000 7fcc9b4d2640 1 --2- 172.21.15.78:0/2305257996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc941033e0 0x7fcc9410b8d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009880 tx=0x7fcc8402a530 comp rx=0 tx=0).stop 2024-09-18T13:00:52.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.066+0000 7fcc9b4d2640 1 -- 172.21.15.78:0/2305257996 shutdown_connections 2024-09-18T13:00:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.066+0000 7fcc9b4d2640 1 --2- 172.21.15.78:0/2305257996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc941033e0 0x7fcc9410b8d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.066+0000 7fcc9b4d2640 1 --2- 172.21.15.78:0/2305257996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc94102ac0 0x7fcc94102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.066+0000 7fcc9b4d2640 1 -- 172.21.15.78:0/2305257996 >> 172.21.15.78:0/2305257996 conn(0x7fcc940fc520 msgr2=0x7fcc940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.066+0000 7fcc9b4d2640 1 -- 172.21.15.78:0/2305257996 shutdown_connections 2024-09-18T13:00:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.066+0000 7fcc9b4d2640 1 -- 172.21.15.78:0/2305257996 wait complete. 2024-09-18T13:00:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.067+0000 7fcc9b4d2640 1 Processor -- start 2024-09-18T13:00:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.067+0000 7fcc9b4d2640 1 -- start start 2024-09-18T13:00:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.067+0000 7fcc9b4d2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc94102ac0 0x7fcc9419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.067+0000 7fcc9b4d2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc941033e0 0x7fcc9419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.067+0000 7fcc9b4d2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9410edf0 con 0x7fcc941033e0 2024-09-18T13:00:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.067+0000 7fcc9b4d2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9410ec70 con 0x7fcc94102ac0 2024-09-18T13:00:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.067+0000 7fcc98a6d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc941033e0 0x7fcc9419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.067+0000 7fcc98a6d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc941033e0 0x7fcc9419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49684/0 (socket says 172.21.15.78:49684) 2024-09-18T13:00:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.067+0000 7fcc98a6d640 1 -- 172.21.15.78:0/2693381295 learned_addr learned my addr 172.21.15.78:0/2693381295 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:00:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.067+0000 7fcc9926e640 1 --2- 172.21.15.78:0/2693381295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc94102ac0 0x7fcc9419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.068+0000 7fcc98a6d640 1 -- 172.21.15.78:0/2693381295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc94102ac0 msgr2=0x7fcc9419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.068+0000 7fcc98a6d640 1 --2- 172.21.15.78:0/2693381295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc94102ac0 0x7fcc9419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.068+0000 7fcc98a6d640 1 -- 172.21.15.78:0/2693381295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc94197800 con 0x7fcc941033e0 2024-09-18T13:00:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.068+0000 7fcc98a6d640 1 --2- 172.21.15.78:0/2693381295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc941033e0 0x7fcc9419dbc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcc84031460 tx=0x7fcc84004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.068+0000 7fcc8a7fc640 1 -- 172.21.15.78:0/2693381295 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc8403f070 con 0x7fcc941033e0 2024-09-18T13:00:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.068+0000 7fcc8a7fc640 1 -- 172.21.15.78:0/2693381295 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc840035f0 con 0x7fcc941033e0 2024-09-18T13:00:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.068+0000 7fcc9b4d2640 1 -- 172.21.15.78:0/2693381295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc94197a90 con 0x7fcc941033e0 2024-09-18T13:00:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.068+0000 7fcc8a7fc640 1 -- 172.21.15.78:0/2693381295 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc84035030 con 0x7fcc941033e0 2024-09-18T13:00:52.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.068+0000 7fcc9b4d2640 1 -- 172.21.15.78:0/2693381295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc94197fc0 con 0x7fcc941033e0 2024-09-18T13:00:52.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.069+0000 7fcc9b4d2640 1 -- 172.21.15.78:0/2693381295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc9406aa90 con 0x7fcc941033e0 2024-09-18T13:00:52.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.070+0000 7fcc8a7fc640 1 -- 172.21.15.78:0/2693381295 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fcc84042070 con 0x7fcc941033e0 2024-09-18T13:00:52.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.070+0000 7fcc8a7fc640 1 --2- 172.21.15.78:0/2693381295 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcc8007af80 0x7fcc8007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:52.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.070+0000 7fcc8a7fc640 1 -- 172.21.15.78:0/2693381295 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fcc840be890 con 0x7fcc941033e0 2024-09-18T13:00:52.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.070+0000 7fcc9926e640 1 --2- 172.21.15.78:0/2693381295 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcc8007af80 0x7fcc8007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:52.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.071+0000 7fcc9926e640 1 --2- 172.21.15.78:0/2693381295 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcc8007af80 0x7fcc8007d440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc90005fd0 tx=0x7fcc9000b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:52.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.075+0000 7fcc8a7fc640 1 -- 172.21.15.78:0/2693381295 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fcc84089eb0 con 0x7fcc941033e0 2024-09-18T13:00:52.241 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:52 smithi078 ceph-mon[108578]: pgmap v351: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:52.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.268+0000 7fcc9b4d2640 1 -- 172.21.15.78:0/2693381295 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcc94198330 con 0x7fcc8007af80 2024-09-18T13:00:52.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.269+0000 7fcc8a7fc640 1 -- 172.21.15.78:0/2693381295 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fcc94198330 con 0x7fcc8007af80 2024-09-18T13:00:52.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.271+0000 7fcc9b4d2640 1 -- 172.21.15.78:0/2693381295 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcc8007af80 msgr2=0x7fcc8007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:52.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.271+0000 7fcc9b4d2640 1 --2- 172.21.15.78:0/2693381295 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcc8007af80 0x7fcc8007d440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc90005fd0 tx=0x7fcc9000b390 comp rx=0 tx=0).stop 2024-09-18T13:00:52.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.271+0000 7fcc9b4d2640 1 -- 172.21.15.78:0/2693381295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc941033e0 msgr2=0x7fcc9419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:52.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.271+0000 7fcc9b4d2640 1 --2- 172.21.15.78:0/2693381295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc941033e0 0x7fcc9419dbc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcc84031460 tx=0x7fcc84004530 comp rx=0 tx=0).stop 2024-09-18T13:00:52.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.271+0000 7fcc9b4d2640 1 -- 172.21.15.78:0/2693381295 shutdown_connections 2024-09-18T13:00:52.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.271+0000 7fcc9b4d2640 1 --2- 172.21.15.78:0/2693381295 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcc8007af80 0x7fcc8007d440 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.271+0000 7fcc9b4d2640 1 --2- 172.21.15.78:0/2693381295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc941033e0 0x7fcc9419dbc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.271+0000 7fcc9b4d2640 1 --2- 172.21.15.78:0/2693381295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc94102ac0 0x7fcc9419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.271+0000 7fcc9b4d2640 1 -- 172.21.15.78:0/2693381295 >> 172.21.15.78:0/2693381295 conn(0x7fcc940fc520 msgr2=0x7fcc94108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:52.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.271+0000 7fcc9b4d2640 1 -- 172.21.15.78:0/2693381295 shutdown_connections 2024-09-18T13:00:52.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.271+0000 7fcc9b4d2640 1 -- 172.21.15.78:0/2693381295 wait complete. 2024-09-18T13:00:52.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.352+0000 7f61f2659640 1 -- 172.21.15.78:0/3176868775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ec1097c0 msgr2=0x7f61ec109c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:52.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.352+0000 7f61f2659640 1 --2- 172.21.15.78:0/3176868775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ec1097c0 0x7f61ec109c20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f61e00098b0 tx=0x7f61e002a4d0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.352+0000 7f61f2659640 1 -- 172.21.15.78:0/3176868775 shutdown_connections 2024-09-18T13:00:52.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.352+0000 7f61f2659640 1 --2- 172.21.15.78:0/3176868775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ec1097c0 0x7f61ec109c20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.352+0000 7f61f2659640 1 --2- 172.21.15.78:0/3176868775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61ec073fd0 0x7f61ec1091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.352+0000 7f61f2659640 1 -- 172.21.15.78:0/3176868775 >> 172.21.15.78:0/3176868775 conn(0x7f61ec06cc10 msgr2=0x7f61ec06d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:52.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.352+0000 7f61f2659640 1 -- 172.21.15.78:0/3176868775 shutdown_connections 2024-09-18T13:00:52.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.352+0000 7f61f2659640 1 -- 172.21.15.78:0/3176868775 wait complete. 2024-09-18T13:00:52.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.353+0000 7f61f2659640 1 Processor -- start 2024-09-18T13:00:52.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.353+0000 7f61f2659640 1 -- start start 2024-09-18T13:00:52.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.353+0000 7f61f2659640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61ec073fd0 0x7f61ec1a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:52.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.353+0000 7f61f2659640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ec1097c0 0x7f61ec1a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:52.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.353+0000 7f61f2659640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec119710 con 0x7f61ec1097c0 2024-09-18T13:00:52.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.353+0000 7f61f2659640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec119590 con 0x7f61ec073fd0 2024-09-18T13:00:52.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.353+0000 7f61eb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ec1097c0 0x7f61ec1a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:52.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.354+0000 7f61eb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ec1097c0 0x7f61ec1a27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49700/0 (socket says 172.21.15.78:49700) 2024-09-18T13:00:52.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.354+0000 7f61eb7fe640 1 -- 172.21.15.78:0/2658480938 learned_addr learned my addr 172.21.15.78:0/2658480938 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:00:52.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.354+0000 7f61ebfff640 1 --2- 172.21.15.78:0/2658480938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61ec073fd0 0x7f61ec1a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:52.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.354+0000 7f61eb7fe640 1 -- 172.21.15.78:0/2658480938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61ec073fd0 msgr2=0x7f61ec1a22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:52.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.354+0000 7f61eb7fe640 1 --2- 172.21.15.78:0/2658480938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61ec073fd0 0x7f61ec1a22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.354+0000 7f61eb7fe640 1 -- 172.21.15.78:0/2658480938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ec1a6b80 con 0x7f61ec1097c0 2024-09-18T13:00:52.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.354+0000 7f61eb7fe640 1 --2- 172.21.15.78:0/2658480938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ec1097c0 0x7f61ec1a27f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f61e0031460 tx=0x7f61e00045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:52.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.354+0000 7f61e97fa640 1 -- 172.21.15.78:0/2658480938 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f61e003f070 con 0x7f61ec1097c0 2024-09-18T13:00:52.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.354+0000 7f61e97fa640 1 -- 172.21.15.78:0/2658480938 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f61e00035f0 con 0x7f61ec1097c0 2024-09-18T13:00:52.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.354+0000 7f61f2659640 1 -- 172.21.15.78:0/2658480938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ec1a6e70 con 0x7f61ec1097c0 2024-09-18T13:00:52.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.354+0000 7f61e97fa640 1 -- 172.21.15.78:0/2658480938 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f61e0035030 con 0x7f61ec1097c0 2024-09-18T13:00:52.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.354+0000 7f61f2659640 1 -- 172.21.15.78:0/2658480938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ec1a7400 con 0x7f61ec1097c0 2024-09-18T13:00:52.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.355+0000 7f61f2659640 1 -- 172.21.15.78:0/2658480938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61ec073850 con 0x7f61ec1097c0 2024-09-18T13:00:52.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.356+0000 7f61e97fa640 1 -- 172.21.15.78:0/2658480938 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f61e0042070 con 0x7f61ec1097c0 2024-09-18T13:00:52.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.356+0000 7f61e97fa640 1 --2- 172.21.15.78:0/2658480938 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f61d407af80 0x7f61d407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:52.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.357+0000 7f61e97fa640 1 -- 172.21.15.78:0/2658480938 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f61e00be8e0 con 0x7f61ec1097c0 2024-09-18T13:00:52.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.357+0000 7f61ebfff640 1 --2- 172.21.15.78:0/2658480938 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f61d407af80 0x7f61d407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:52.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.357+0000 7f61ebfff640 1 --2- 172.21.15.78:0/2658480938 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f61d407af80 0x7f61d407d440 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f61dc005fd0 tx=0x7f61dc00b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:52.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.361+0000 7f61e97fa640 1 -- 172.21.15.78:0/2658480938 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f61e0089f00 con 0x7f61ec1097c0 2024-09-18T13:00:52.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.546+0000 7f61f2659640 1 -- 172.21.15.78:0/2658480938 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f61ec1a3610 con 0x7f61d407af80 2024-09-18T13:00:52.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.556+0000 7f61e97fa640 1 -- 172.21.15.78:0/2658480938 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f61ec1a3610 con 0x7f61d407af80 2024-09-18T13:00:52.557 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:00:52.557 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (8m) 2m ago 19m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:00:52.557 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (11m) 2m ago 19m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:00:52.557 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (11m) 2m ago 19m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:00:52.557 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (6m) 2m ago 19m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:00:52.557 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (6m) 2m ago 18m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:00:52.557 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (8m) 2m ago 19m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:00:52.558 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (3m) 2m ago 14m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:00:52.558 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (3m) 2m ago 14m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:00:52.558 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (2m) 2m ago 14m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:00:52.558 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (2m) 2m ago 14m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:00:52.558 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (10m) 2m ago 20m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:00:52.558 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (9m) 2m ago 18m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:00:52.558 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (7m) 2m ago 21m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:00:52.558 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (7m) 2m ago 18m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:00:52.558 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (9m) 2m ago 19m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:00:52.558 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (9m) 2m ago 18m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:00:52.558 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (6m) 2m ago 17m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:00:52.558 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (5m) 2m ago 17m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:00:52.559 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (5m) 2m ago 16m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:00:52.559 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (4m) 2m ago 16m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:00:52.559 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (4m) 2m ago 15m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:00:52.559 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (3m) 2m ago 15m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:00:52.559 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (9m) 2m ago 19m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:00:52.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.558+0000 7f61f2659640 1 -- 172.21.15.78:0/2658480938 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f61d407af80 msgr2=0x7f61d407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:52.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.558+0000 7f61f2659640 1 --2- 172.21.15.78:0/2658480938 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f61d407af80 0x7f61d407d440 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f61dc005fd0 tx=0x7f61dc00b390 comp rx=0 tx=0).stop 2024-09-18T13:00:52.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.558+0000 7f61f2659640 1 -- 172.21.15.78:0/2658480938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ec1097c0 msgr2=0x7f61ec1a27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:52.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.558+0000 7f61f2659640 1 --2- 172.21.15.78:0/2658480938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ec1097c0 0x7f61ec1a27f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f61e0031460 tx=0x7f61e00045c0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.558+0000 7f61f2659640 1 -- 172.21.15.78:0/2658480938 shutdown_connections 2024-09-18T13:00:52.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.558+0000 7f61f2659640 1 --2- 172.21.15.78:0/2658480938 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f61d407af80 0x7f61d407d440 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.558+0000 7f61f2659640 1 --2- 172.21.15.78:0/2658480938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61ec1097c0 0x7f61ec1a27f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.558+0000 7f61f2659640 1 --2- 172.21.15.78:0/2658480938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61ec073fd0 0x7f61ec1a22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.558+0000 7f61f2659640 1 -- 172.21.15.78:0/2658480938 >> 172.21.15.78:0/2658480938 conn(0x7f61ec06cc10 msgr2=0x7f61ec071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:52.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.559+0000 7f61f2659640 1 -- 172.21.15.78:0/2658480938 shutdown_connections 2024-09-18T13:00:52.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.559+0000 7f61f2659640 1 -- 172.21.15.78:0/2658480938 wait complete. 2024-09-18T13:00:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.639+0000 7f0dd1201640 1 -- 172.21.15.78:0/708698104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc106640 msgr2=0x7f0dcc106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.639+0000 7f0dd1201640 1 --2- 172.21.15.78:0/708698104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc106640 0x7f0dcc106a20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009880 tx=0x7f0dbc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.639+0000 7f0dd1201640 1 -- 172.21.15.78:0/708698104 shutdown_connections 2024-09-18T13:00:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.639+0000 7f0dd1201640 1 --2- 172.21.15.78:0/708698104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dcc100640 0x7f0dcc100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.639+0000 7f0dd1201640 1 --2- 172.21.15.78:0/708698104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc106640 0x7f0dcc106a20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.639+0000 7f0dd1201640 1 -- 172.21.15.78:0/708698104 >> 172.21.15.78:0/708698104 conn(0x7f0dcc0fc340 msgr2=0x7f0dcc0fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.639+0000 7f0dd1201640 1 -- 172.21.15.78:0/708698104 shutdown_connections 2024-09-18T13:00:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.639+0000 7f0dd1201640 1 -- 172.21.15.78:0/708698104 wait complete. 2024-09-18T13:00:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.640+0000 7f0dd1201640 1 Processor -- start 2024-09-18T13:00:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.640+0000 7f0dd1201640 1 -- start start 2024-09-18T13:00:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.640+0000 7f0dd1201640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dcc100640 0x7f0dcc196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.640+0000 7f0dd1201640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc106640 0x7f0dcc196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.640+0000 7f0dd1201640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc10db10 con 0x7f0dcc106640 2024-09-18T13:00:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.640+0000 7f0dd1201640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc10d990 con 0x7f0dcc100640 2024-09-18T13:00:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.641+0000 7f0dc259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc106640 0x7f0dcc196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.641+0000 7f0dc259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc106640 0x7f0dcc196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49722/0 (socket says 172.21.15.78:49722) 2024-09-18T13:00:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.641+0000 7f0dc259c640 1 -- 172.21.15.78:0/883649302 learned_addr learned my addr 172.21.15.78:0/883649302 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:00:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.641+0000 7f0dcad9d640 1 --2- 172.21.15.78:0/883649302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dcc100640 0x7f0dcc196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.641+0000 7f0dc259c640 1 -- 172.21.15.78:0/883649302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dcc100640 msgr2=0x7f0dcc196730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.641+0000 7f0dc259c640 1 --2- 172.21.15.78:0/883649302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dcc100640 0x7f0dcc196730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.641+0000 7f0dc259c640 1 -- 172.21.15.78:0/883649302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dcc19b000 con 0x7f0dcc106640 2024-09-18T13:00:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.641+0000 7f0dc259c640 1 --2- 172.21.15.78:0/883649302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc106640 0x7f0dcc196c70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0db400d6f0 tx=0x7f0db400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.641+0000 7f0dc8d99640 1 -- 172.21.15.78:0/883649302 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0db4017070 con 0x7f0dcc106640 2024-09-18T13:00:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.641+0000 7f0dc8d99640 1 -- 172.21.15.78:0/883649302 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0db400de00 con 0x7f0dcc106640 2024-09-18T13:00:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.641+0000 7f0dd1201640 1 -- 172.21.15.78:0/883649302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dcc19b2f0 con 0x7f0dcc106640 2024-09-18T13:00:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.641+0000 7f0dc8d99640 1 -- 172.21.15.78:0/883649302 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0db4004bb0 con 0x7f0dcc106640 2024-09-18T13:00:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.641+0000 7f0dd1201640 1 -- 172.21.15.78:0/883649302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dcc19b880 con 0x7f0dcc106640 2024-09-18T13:00:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.643+0000 7f0dd1201640 1 -- 172.21.15.78:0/883649302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dcc101d80 con 0x7f0dcc106640 2024-09-18T13:00:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.643+0000 7f0dc8d99640 1 -- 172.21.15.78:0/883649302 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f0db4004e60 con 0x7f0dcc106640 2024-09-18T13:00:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.644+0000 7f0dc8d99640 1 --2- 172.21.15.78:0/883649302 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0db807d140 0x7f0db807f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.644+0000 7f0dc8d99640 1 -- 172.21.15.78:0/883649302 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f0db409dc00 con 0x7f0dcc106640 2024-09-18T13:00:52.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.644+0000 7f0dcad9d640 1 --2- 172.21.15.78:0/883649302 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0db807d140 0x7f0db807f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:52.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.644+0000 7f0dcad9d640 1 --2- 172.21.15.78:0/883649302 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0db807d140 0x7f0db807f600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0096c0 tx=0x7f0dbc031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:52.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.648+0000 7f0dc8d99640 1 -- 172.21.15.78:0/883649302 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f0db40a3020 con 0x7f0dcc106640 2024-09-18T13:00:52.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:52 smithi148 ceph-mon[80030]: pgmap v351: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:52.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.898+0000 7f0dd1201640 1 -- 172.21.15.78:0/883649302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0dcc197ac0 con 0x7f0dcc106640 2024-09-18T13:00:52.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.898+0000 7f0dc8d99640 1 -- 172.21.15.78:0/883649302 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f0dcc197ac0 con 0x7f0dcc106640 2024-09-18T13:00:52.899 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:00:52.900 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:00:52.900 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:00:52.900 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:00:52.900 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:00:52.900 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:00:52.900 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:00:52.900 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:00:52.900 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:00:52.900 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:00:52.900 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:00:52.900 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:00:52.900 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:00:52.901 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:00:52.901 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:00:52.901 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:00:52.901 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:00:52.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.901+0000 7f0dd1201640 1 -- 172.21.15.78:0/883649302 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0db807d140 msgr2=0x7f0db807f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:52.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.901+0000 7f0dd1201640 1 --2- 172.21.15.78:0/883649302 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0db807d140 0x7f0db807f600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0096c0 tx=0x7f0dbc031400 comp rx=0 tx=0).stop 2024-09-18T13:00:52.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.901+0000 7f0dd1201640 1 -- 172.21.15.78:0/883649302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc106640 msgr2=0x7f0dcc196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:52.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.901+0000 7f0dd1201640 1 --2- 172.21.15.78:0/883649302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc106640 0x7f0dcc196c70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0db400d6f0 tx=0x7f0db400dbb0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.901+0000 7f0dd1201640 1 -- 172.21.15.78:0/883649302 shutdown_connections 2024-09-18T13:00:52.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.901+0000 7f0dd1201640 1 --2- 172.21.15.78:0/883649302 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0db807d140 0x7f0db807f600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.901+0000 7f0dd1201640 1 --2- 172.21.15.78:0/883649302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dcc106640 0x7f0dcc196c70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.901+0000 7f0dd1201640 1 --2- 172.21.15.78:0/883649302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dcc100640 0x7f0dcc196730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.901+0000 7f0dd1201640 1 -- 172.21.15.78:0/883649302 >> 172.21.15.78:0/883649302 conn(0x7f0dcc0fc340 msgr2=0x7f0dcc0fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:52.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.901+0000 7f0dd1201640 1 -- 172.21.15.78:0/883649302 shutdown_connections 2024-09-18T13:00:52.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.901+0000 7f0dd1201640 1 -- 172.21.15.78:0/883649302 wait complete. 2024-09-18T13:00:52.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.983+0000 7f3f53401640 1 -- 172.21.15.78:0/1094584411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c100800 msgr2=0x7f3f4c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:52.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.983+0000 7f3f53401640 1 --2- 172.21.15.78:0/1094584411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c100800 0x7f3f4c100c60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009880 tx=0x7f3f4002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.983+0000 7f3f53401640 1 -- 172.21.15.78:0/1094584411 shutdown_connections 2024-09-18T13:00:52.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.983+0000 7f3f53401640 1 --2- 172.21.15.78:0/1094584411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c100800 0x7f3f4c100c60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.983+0000 7f3f53401640 1 --2- 172.21.15.78:0/1094584411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f4c106800 0x7f3f4c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.983+0000 7f3f53401640 1 -- 172.21.15.78:0/1094584411 >> 172.21.15.78:0/1094584411 conn(0x7f3f4c0fc520 msgr2=0x7f3f4c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:52.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.983+0000 7f3f53401640 1 -- 172.21.15.78:0/1094584411 shutdown_connections 2024-09-18T13:00:52.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.983+0000 7f3f53401640 1 -- 172.21.15.78:0/1094584411 wait complete. 2024-09-18T13:00:52.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.983+0000 7f3f53401640 1 Processor -- start 2024-09-18T13:00:52.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.983+0000 7f3f53401640 1 -- start start 2024-09-18T13:00:52.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f53401640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c100800 0x7f3f4c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:52.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f53401640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f4c106800 0x7f3f4c19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:52.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f53401640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c10dd30 con 0x7f3f4c100800 2024-09-18T13:00:52.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f53401640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c10dbb0 con 0x7f3f4c106800 2024-09-18T13:00:52.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f5119d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c100800 0x7f3f4c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:52.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f5119d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c100800 0x7f3f4c19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49740/0 (socket says 172.21.15.78:49740) 2024-09-18T13:00:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f5119d640 1 -- 172.21.15.78:0/3804026451 learned_addr learned my addr 172.21.15.78:0/3804026451 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:00:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f5099c640 1 --2- 172.21.15.78:0/3804026451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f4c106800 0x7f3f4c19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f5119d640 1 -- 172.21.15.78:0/3804026451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f4c106800 msgr2=0x7f3f4c19dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f5119d640 1 --2- 172.21.15.78:0/3804026451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f4c106800 0x7f3f4c19dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f5119d640 1 -- 172.21.15.78:0/3804026451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c197870 con 0x7f3f4c100800 2024-09-18T13:00:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f5099c640 1 --2- 172.21.15.78:0/3804026451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f4c106800 0x7f3f4c19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:00:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f5119d640 1 --2- 172.21.15.78:0/3804026451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c100800 0x7f3f4c19d6b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400b420 tx=0x7f3f4400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f4a7fc640 1 -- 172.21.15.78:0/3804026451 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f44011630 con 0x7f3f4c100800 2024-09-18T13:00:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f53401640 1 -- 172.21.15.78:0/3804026451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4c197b60 con 0x7f3f4c100800 2024-09-18T13:00:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.984+0000 7f3f4a7fc640 1 -- 172.21.15.78:0/3804026451 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f44016070 con 0x7f3f4c100800 2024-09-18T13:00:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.985+0000 7f3f4a7fc640 1 -- 172.21.15.78:0/3804026451 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f44010d40 con 0x7f3f4c100800 2024-09-18T13:00:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.985+0000 7f3f53401640 1 -- 172.21.15.78:0/3804026451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4c1980f0 con 0x7f3f4c100800 2024-09-18T13:00:52.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.986+0000 7f3f53401640 1 -- 172.21.15.78:0/3804026451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f4c101f40 con 0x7f3f4c100800 2024-09-18T13:00:52.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.986+0000 7f3f4a7fc640 1 -- 172.21.15.78:0/3804026451 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3f4401b460 con 0x7f3f4c100800 2024-09-18T13:00:52.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.987+0000 7f3f4a7fc640 1 --2- 172.21.15.78:0/3804026451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3f3407af30 0x7f3f3407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:52.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.987+0000 7f3f5099c640 1 --2- 172.21.15.78:0/3804026451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3f3407af30 0x7f3f3407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:52.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.987+0000 7f3f4a7fc640 1 -- 172.21.15.78:0/3804026451 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f3f4409d7a0 con 0x7f3f4c100800 2024-09-18T13:00:52.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.987+0000 7f3f5099c640 1 --2- 172.21.15.78:0/3804026451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3f3407af30 0x7f3f3407d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f40031460 tx=0x7f3f400095f0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:52.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:52.991+0000 7f3f4a7fc640 1 -- 172.21.15.78:0/3804026451 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3f44021250 con 0x7f3f4c100800 2024-09-18T13:00:53.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.200+0000 7f3f53401640 1 -- 172.21.15.78:0/3804026451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3f4c198da0 con 0x7f3f4c100800 2024-09-18T13:00:53.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.201+0000 7f3f4a7fc640 1 -- 172.21.15.78:0/3804026451 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f3f44068d40 con 0x7f3f4c100800 2024-09-18T13:00:53.202 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:00:53.202 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:00:53.202 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:00:53.202 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:00:53.202 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:00:53.202 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:00:53.202 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:00:53.203 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:00:53.203 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:00:53.203 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:00:53.203 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:00:53.203 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:00:53.203 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:00:53.203 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:00:53.203 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:00:53.203 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:00:53.203 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:00:53.203 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:00:53.203 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:00:53.203 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:00:53.203 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:00:53.204 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:00:53.204 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:00:53.204 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:00:53.204 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:00:53.204 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:00:53.204 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:00:53.204 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:00:53.204 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:00:53.204 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:00:53.204 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:00:53.204 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:00:53.204 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:00:53.204 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:00:53.204 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:00:53.205 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:00:53.205 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:00:53.205 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:00:53.205 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:00:53.205 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:53.205 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:53.205 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:53.205 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:53.206 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:00:53.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.204+0000 7f3f53401640 1 -- 172.21.15.78:0/3804026451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3f3407af30 msgr2=0x7f3f3407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:53.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.204+0000 7f3f53401640 1 --2- 172.21.15.78:0/3804026451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3f3407af30 0x7f3f3407d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f40031460 tx=0x7f3f400095f0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.204+0000 7f3f53401640 1 -- 172.21.15.78:0/3804026451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c100800 msgr2=0x7f3f4c19d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:53.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.204+0000 7f3f53401640 1 --2- 172.21.15.78:0/3804026451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c100800 0x7f3f4c19d6b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400b420 tx=0x7f3f4400b8e0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.204+0000 7f3f53401640 1 -- 172.21.15.78:0/3804026451 shutdown_connections 2024-09-18T13:00:53.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.204+0000 7f3f53401640 1 --2- 172.21.15.78:0/3804026451 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3f3407af30 0x7f3f3407d3f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.204+0000 7f3f53401640 1 --2- 172.21.15.78:0/3804026451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f4c106800 0x7f3f4c19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.204+0000 7f3f53401640 1 --2- 172.21.15.78:0/3804026451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c100800 0x7f3f4c19d6b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.204+0000 7f3f53401640 1 -- 172.21.15.78:0/3804026451 >> 172.21.15.78:0/3804026451 conn(0x7f3f4c0fc520 msgr2=0x7f3f4c06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:53.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.204+0000 7f3f53401640 1 -- 172.21.15.78:0/3804026451 shutdown_connections 2024-09-18T13:00:53.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.204+0000 7f3f53401640 1 -- 172.21.15.78:0/3804026451 wait complete. 2024-09-18T13:00:53.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.289+0000 7f725c2fd640 1 -- 172.21.15.78:0/3752593846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7254100800 msgr2=0x7f7254100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:53.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.289+0000 7f725c2fd640 1 --2- 172.21.15.78:0/3752593846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7254100800 0x7f7254100c60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7250009880 tx=0x7f725002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.289+0000 7f725c2fd640 1 -- 172.21.15.78:0/3752593846 shutdown_connections 2024-09-18T13:00:53.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.289+0000 7f725c2fd640 1 --2- 172.21.15.78:0/3752593846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7254100800 0x7f7254100c60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.289+0000 7f725c2fd640 1 --2- 172.21.15.78:0/3752593846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7254106800 0x7f7254106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.289+0000 7f725c2fd640 1 -- 172.21.15.78:0/3752593846 >> 172.21.15.78:0/3752593846 conn(0x7f72540fc520 msgr2=0x7f72540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.289+0000 7f725c2fd640 1 -- 172.21.15.78:0/3752593846 shutdown_connections 2024-09-18T13:00:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.289+0000 7f725c2fd640 1 -- 172.21.15.78:0/3752593846 wait complete. 2024-09-18T13:00:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.289+0000 7f725c2fd640 1 Processor -- start 2024-09-18T13:00:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.289+0000 7f725c2fd640 1 -- start start 2024-09-18T13:00:53.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f725c2fd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7254100800 0x7f725419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:53.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f725c2fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7254106800 0x7f725419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:53.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f725c2fd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f725410dcb0 con 0x7f7254106800 2024-09-18T13:00:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f725c2fd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f725410db30 con 0x7f7254100800 2024-09-18T13:00:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f7259898640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7254106800 0x7f725419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f7259898640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7254106800 0x7f725419db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49758/0 (socket says 172.21.15.78:49758) 2024-09-18T13:00:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f7259898640 1 -- 172.21.15.78:0/4164081154 learned_addr learned my addr 172.21.15.78:0/4164081154 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:00:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f725a099640 1 --2- 172.21.15.78:0/4164081154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7254100800 0x7f725419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f7259898640 1 -- 172.21.15.78:0/4164081154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7254100800 msgr2=0x7f725419d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f7259898640 1 --2- 172.21.15.78:0/4164081154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7254100800 0x7f725419d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f7259898640 1 -- 172.21.15.78:0/4164081154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72541977a0 con 0x7f7254106800 2024-09-18T13:00:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f7259898640 1 --2- 172.21.15.78:0/4164081154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7254106800 0x7f725419db60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7250031460 tx=0x7f72500045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f72477fe640 1 -- 172.21.15.78:0/4164081154 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f725003f070 con 0x7f7254106800 2024-09-18T13:00:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f72477fe640 1 -- 172.21.15.78:0/4164081154 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7250004b10 con 0x7f7254106800 2024-09-18T13:00:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f72477fe640 1 -- 172.21.15.78:0/4164081154 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7250035030 con 0x7f7254106800 2024-09-18T13:00:53.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f725c2fd640 1 -- 172.21.15.78:0/4164081154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7254197a30 con 0x7f7254106800 2024-09-18T13:00:53.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.290+0000 7f725c2fd640 1 -- 172.21.15.78:0/4164081154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7254197f60 con 0x7f7254106800 2024-09-18T13:00:53.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.291+0000 7f725c2fd640 1 -- 172.21.15.78:0/4164081154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7254101f40 con 0x7f7254106800 2024-09-18T13:00:53.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.292+0000 7f72477fe640 1 -- 172.21.15.78:0/4164081154 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7250042070 con 0x7f7254106800 2024-09-18T13:00:53.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.292+0000 7f72477fe640 1 --2- 172.21.15.78:0/4164081154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f724007af90 0x7f724007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:53.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.293+0000 7f72477fe640 1 -- 172.21.15.78:0/4164081154 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f72500bea20 con 0x7f7254106800 2024-09-18T13:00:53.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.293+0000 7f725a099640 1 --2- 172.21.15.78:0/4164081154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f724007af90 0x7f724007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:53.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.293+0000 7f725a099640 1 --2- 172.21.15.78:0/4164081154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f724007af90 0x7f724007d450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f724800bbe0 tx=0x7f724800b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:53.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.297+0000 7f72477fe640 1 -- 172.21.15.78:0/4164081154 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f725008a040 con 0x7f7254106800 2024-09-18T13:00:53.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.487+0000 7f725c2fd640 1 -- 172.21.15.78:0/4164081154 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f72541982d0 con 0x7f724007af90 2024-09-18T13:00:53.488 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:53 smithi078 ceph-mon[108578]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:53.488 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:53 smithi078 ceph-mon[108578]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:53.488 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:53 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/883649302' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:53.488 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:53 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3804026451' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:00:53.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.488+0000 7f72477fe640 1 -- 172.21.15.78:0/4164081154 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f72541982d0 con 0x7f724007af90 2024-09-18T13:00:53.489 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:00:53.489 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:00:53.489 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:00:53.489 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:00:53.489 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:00:53.490 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:00:53.490 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:00:53.490 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:00:53.490 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:00:53.490 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:00:53.490 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:00:53.490 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:00:53.490 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:00:53.490 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:00:53.490 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:00:53.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.490+0000 7f725c2fd640 1 -- 172.21.15.78:0/4164081154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f724007af90 msgr2=0x7f724007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:53.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.490+0000 7f725c2fd640 1 --2- 172.21.15.78:0/4164081154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f724007af90 0x7f724007d450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f724800bbe0 tx=0x7f724800b390 comp rx=0 tx=0).stop 2024-09-18T13:00:53.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.490+0000 7f725c2fd640 1 -- 172.21.15.78:0/4164081154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7254106800 msgr2=0x7f725419db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:53.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.490+0000 7f725c2fd640 1 --2- 172.21.15.78:0/4164081154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7254106800 0x7f725419db60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7250031460 tx=0x7f72500045e0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.490+0000 7f725c2fd640 1 -- 172.21.15.78:0/4164081154 shutdown_connections 2024-09-18T13:00:53.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.490+0000 7f725c2fd640 1 --2- 172.21.15.78:0/4164081154 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f724007af90 0x7f724007d450 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.490+0000 7f725c2fd640 1 --2- 172.21.15.78:0/4164081154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7254106800 0x7f725419db60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.490+0000 7f725c2fd640 1 --2- 172.21.15.78:0/4164081154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7254100800 0x7f725419d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.490+0000 7f725c2fd640 1 -- 172.21.15.78:0/4164081154 >> 172.21.15.78:0/4164081154 conn(0x7f72540fc520 msgr2=0x7f725406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:53.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.490+0000 7f725c2fd640 1 -- 172.21.15.78:0/4164081154 shutdown_connections 2024-09-18T13:00:53.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.490+0000 7f725c2fd640 1 -- 172.21.15.78:0/4164081154 wait complete. 2024-09-18T13:00:53.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.572+0000 7fcd3e791640 1 -- 172.21.15.78:0/97050703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd38106800 msgr2=0x7fcd38106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:53.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.572+0000 7fcd3e791640 1 --2- 172.21.15.78:0/97050703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd38106800 0x7fcd38106be0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009880 tx=0x7fcd2802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.572+0000 7fcd3e791640 1 -- 172.21.15.78:0/97050703 shutdown_connections 2024-09-18T13:00:53.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.572+0000 7fcd3e791640 1 --2- 172.21.15.78:0/97050703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd38100800 0x7fcd38100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.572+0000 7fcd3e791640 1 --2- 172.21.15.78:0/97050703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd38106800 0x7fcd38106be0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.572+0000 7fcd3e791640 1 -- 172.21.15.78:0/97050703 >> 172.21.15.78:0/97050703 conn(0x7fcd380fc520 msgr2=0x7fcd380fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:53.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.572+0000 7fcd3e791640 1 -- 172.21.15.78:0/97050703 shutdown_connections 2024-09-18T13:00:53.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.572+0000 7fcd3e791640 1 -- 172.21.15.78:0/97050703 wait complete. 2024-09-18T13:00:53.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.572+0000 7fcd3e791640 1 Processor -- start 2024-09-18T13:00:53.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.572+0000 7fcd3e791640 1 -- start start 2024-09-18T13:00:53.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.573+0000 7fcd3e791640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd38100800 0x7fcd3819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:53.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.573+0000 7fcd3e791640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd38106800 0x7fcd3819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:53.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.573+0000 7fcd3e791640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3810dcb0 con 0x7fcd38106800 2024-09-18T13:00:53.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.573+0000 7fcd3e791640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3810db30 con 0x7fcd38100800 2024-09-18T13:00:53.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.573+0000 7fcd377fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd38106800 0x7fcd3819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:53.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.573+0000 7fcd377fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd38106800 0x7fcd3819dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49784/0 (socket says 172.21.15.78:49784) 2024-09-18T13:00:53.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.573+0000 7fcd377fe640 1 -- 172.21.15.78:0/1952323728 learned_addr learned my addr 172.21.15.78:0/1952323728 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:00:53.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.573+0000 7fcd37fff640 1 --2- 172.21.15.78:0/1952323728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd38100800 0x7fcd3819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:53.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.573+0000 7fcd377fe640 1 -- 172.21.15.78:0/1952323728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd38100800 msgr2=0x7fcd3819d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:53.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.573+0000 7fcd377fe640 1 --2- 172.21.15.78:0/1952323728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd38100800 0x7fcd3819d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.573+0000 7fcd377fe640 1 -- 172.21.15.78:0/1952323728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd38197850 con 0x7fcd38106800 2024-09-18T13:00:53.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.573+0000 7fcd377fe640 1 --2- 172.21.15.78:0/1952323728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd38106800 0x7fcd3819dc10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000c8a0 tx=0x7fcd2000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:53.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.574+0000 7fcd357fa640 1 -- 172.21.15.78:0/1952323728 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd200079b0 con 0x7fcd38106800 2024-09-18T13:00:53.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.574+0000 7fcd3e791640 1 -- 172.21.15.78:0/1952323728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd38197b40 con 0x7fcd38106800 2024-09-18T13:00:53.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.574+0000 7fcd357fa640 1 -- 172.21.15.78:0/1952323728 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd20007b50 con 0x7fcd38106800 2024-09-18T13:00:53.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.574+0000 7fcd357fa640 1 -- 172.21.15.78:0/1952323728 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd20018700 con 0x7fcd38106800 2024-09-18T13:00:53.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.574+0000 7fcd3e791640 1 -- 172.21.15.78:0/1952323728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd381980d0 con 0x7fcd38106800 2024-09-18T13:00:53.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.575+0000 7fcd3e791640 1 -- 172.21.15.78:0/1952323728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd38101f40 con 0x7fcd38106800 2024-09-18T13:00:53.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.575+0000 7fcd357fa640 1 -- 172.21.15.78:0/1952323728 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fcd20007d00 con 0x7fcd38106800 2024-09-18T13:00:53.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.576+0000 7fcd357fa640 1 --2- 172.21.15.78:0/1952323728 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd2407af40 0x7fcd2407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:53.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.576+0000 7fcd357fa640 1 -- 172.21.15.78:0/1952323728 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fcd2009e280 con 0x7fcd38106800 2024-09-18T13:00:53.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.576+0000 7fcd37fff640 1 --2- 172.21.15.78:0/1952323728 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd2407af40 0x7fcd2407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:53.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.576+0000 7fcd37fff640 1 --2- 172.21.15.78:0/1952323728 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd2407af40 0x7fcd2407d400 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcd28000c00 tx=0x7fcd28031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:53.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.580+0000 7fcd357fa640 1 -- 172.21.15.78:0/1952323728 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fcd20014030 con 0x7fcd38106800 2024-09-18T13:00:53.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:53 smithi148 ceph-mon[80030]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:53.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:53 smithi148 ceph-mon[80030]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:53.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:53 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/883649302' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:53.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:53 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3804026451' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:00:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.824+0000 7fcd3e791640 1 -- 172.21.15.78:0/1952323728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fcd38198d80 con 0x7fcd38106800 2024-09-18T13:00:53.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.825+0000 7fcd357fa640 1 -- 172.21.15.78:0/1952323728 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fcd20069820 con 0x7fcd38106800 2024-09-18T13:00:53.827 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:00:53.827 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:00:53.827 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:00:53.827 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:00:53.827 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:00:53.827 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:00:53.827 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:00:53.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.827+0000 7fcd3e791640 1 -- 172.21.15.78:0/1952323728 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd2407af40 msgr2=0x7fcd2407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:53.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.827+0000 7fcd3e791640 1 --2- 172.21.15.78:0/1952323728 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd2407af40 0x7fcd2407d400 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcd28000c00 tx=0x7fcd28031400 comp rx=0 tx=0).stop 2024-09-18T13:00:53.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.827+0000 7fcd3e791640 1 -- 172.21.15.78:0/1952323728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd38106800 msgr2=0x7fcd3819dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:53.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.827+0000 7fcd3e791640 1 --2- 172.21.15.78:0/1952323728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd38106800 0x7fcd3819dc10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000c8a0 tx=0x7fcd2000cd60 comp rx=0 tx=0).stop 2024-09-18T13:00:53.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.827+0000 7fcd3e791640 1 -- 172.21.15.78:0/1952323728 shutdown_connections 2024-09-18T13:00:53.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.827+0000 7fcd3e791640 1 --2- 172.21.15.78:0/1952323728 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd2407af40 0x7fcd2407d400 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.827+0000 7fcd3e791640 1 --2- 172.21.15.78:0/1952323728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd38106800 0x7fcd3819dc10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.827+0000 7fcd3e791640 1 --2- 172.21.15.78:0/1952323728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd38100800 0x7fcd3819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.827+0000 7fcd3e791640 1 -- 172.21.15.78:0/1952323728 >> 172.21.15.78:0/1952323728 conn(0x7fcd380fc520 msgr2=0x7fcd3806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.827+0000 7fcd3e791640 1 -- 172.21.15.78:0/1952323728 shutdown_connections 2024-09-18T13:00:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:00:53.827+0000 7fcd3e791640 1 -- 172.21.15.78:0/1952323728 wait complete. 2024-09-18T13:00:54.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:54 smithi078 ceph-mon[108578]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:54.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:54 smithi078 ceph-mon[108578]: pgmap v352: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:54.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:54 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1952323728' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:00:54.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:54 smithi148 ceph-mon[80030]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:54.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:54 smithi148 ceph-mon[80030]: pgmap v352: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:54.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:54 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1952323728' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:00:55.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:55 smithi078 ceph-mon[108578]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:55.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:55 smithi148 ceph-mon[80030]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:56 smithi148 ceph-mon[80030]: pgmap v353: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:56.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:56 smithi078 ceph-mon[108578]: pgmap v353: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:00:58 smithi148 ceph-mon[80030]: pgmap v354: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:58.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:00:58 smithi078 ceph-mon[108578]: pgmap v354: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:00.525 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:00 smithi148 ceph-mon[80030]: pgmap v355: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:00.704 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:00 smithi078 ceph-mon[108578]: pgmap v355: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:02.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:02 smithi148 ceph-mon[80030]: pgmap v356: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:02.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:02 smithi078 ceph-mon[108578]: pgmap v356: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:04 smithi148 ceph-mon[80030]: pgmap v357: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:04.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:04 smithi078 ceph-mon[108578]: pgmap v357: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:06.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:06 smithi078 ceph-mon[108578]: pgmap v358: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:06.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:06 smithi148 ceph-mon[80030]: pgmap v358: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:08.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:08 smithi148 ceph-mon[80030]: pgmap v359: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:08.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:08 smithi078 ceph-mon[108578]: pgmap v359: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:10 smithi148 ceph-mon[80030]: pgmap v360: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:10.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:10 smithi078 ceph-mon[108578]: pgmap v360: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:12.711 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:12 smithi078 ceph-mon[108578]: pgmap v361: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:12.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:12 smithi148 ceph-mon[80030]: pgmap v361: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:14 smithi148 ceph-mon[80030]: pgmap v362: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:14.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:14 smithi078 ceph-mon[108578]: pgmap v362: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:16.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:16 smithi148 ceph-mon[80030]: pgmap v363: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:16 smithi078 ceph-mon[108578]: pgmap v363: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:18.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:18 smithi078 ceph-mon[108578]: pgmap v364: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:18 smithi148 ceph-mon[80030]: pgmap v364: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:20 smithi148 ceph-mon[80030]: pgmap v365: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:20.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:20 smithi078 ceph-mon[108578]: pgmap v365: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:22 smithi148 ceph-mon[80030]: pgmap v366: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:22.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:22 smithi078 ceph-mon[108578]: pgmap v366: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:23.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.921+0000 7f66921ae640 1 -- 172.21.15.78:0/2236409000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f668c107900 msgr2=0x7f668c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:23.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.921+0000 7f66921ae640 1 --2- 172.21.15.78:0/2236409000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f668c107900 0x7f668c107ce0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f667c009880 tx=0x7f667c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:01:23.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.921+0000 7f66921ae640 1 -- 172.21.15.78:0/2236409000 shutdown_connections 2024-09-18T13:01:23.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.921+0000 7f66921ae640 1 --2- 172.21.15.78:0/2236409000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f668c101900 0x7f668c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:23.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.921+0000 7f66921ae640 1 --2- 172.21.15.78:0/2236409000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f668c107900 0x7f668c107ce0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:23.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.921+0000 7f66921ae640 1 -- 172.21.15.78:0/2236409000 >> 172.21.15.78:0/2236409000 conn(0x7f668c0fd600 msgr2=0x7f668c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:23.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.921+0000 7f66921ae640 1 -- 172.21.15.78:0/2236409000 shutdown_connections 2024-09-18T13:01:23.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.921+0000 7f66921ae640 1 -- 172.21.15.78:0/2236409000 wait complete. 2024-09-18T13:01:23.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.922+0000 7f66921ae640 1 Processor -- start 2024-09-18T13:01:23.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.922+0000 7f66921ae640 1 -- start start 2024-09-18T13:01:23.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.922+0000 7f66921ae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f668c101900 0x7f668c19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:23.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.922+0000 7f66921ae640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f668c107900 0x7f668c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:23.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.922+0000 7f66921ae640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f668c10ee30 con 0x7f668c101900 2024-09-18T13:01:23.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.922+0000 7f66921ae640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f668c10ecb0 con 0x7f668c107900 2024-09-18T13:01:23.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.922+0000 7f668b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f668c101900 0x7f668c19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:23.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.922+0000 7f668b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f668c101900 0x7f668c19f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44666/0 (socket says 172.21.15.78:44666) 2024-09-18T13:01:23.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.922+0000 7f668b7fe640 1 -- 172.21.15.78:0/3111314774 learned_addr learned my addr 172.21.15.78:0/3111314774 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:01:23.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.922+0000 7f6682ffd640 1 --2- 172.21.15.78:0/3111314774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f668c107900 0x7f668c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:23.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.923+0000 7f668b7fe640 1 -- 172.21.15.78:0/3111314774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f668c107900 msgr2=0x7f668c19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:23.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.923+0000 7f668b7fe640 1 --2- 172.21.15.78:0/3111314774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f668c107900 0x7f668c19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:23.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.923+0000 7f668b7fe640 1 -- 172.21.15.78:0/3111314774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668c199a10 con 0x7f668c101900 2024-09-18T13:01:23.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.923+0000 7f668b7fe640 1 --2- 172.21.15.78:0/3111314774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f668c101900 0x7f668c19f850 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f667c031460 tx=0x7f667c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:23.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.923+0000 7f66897fa640 1 -- 172.21.15.78:0/3111314774 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f667c03f070 con 0x7f668c101900 2024-09-18T13:01:23.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.923+0000 7f66921ae640 1 -- 172.21.15.78:0/3111314774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f668c199ca0 con 0x7f668c101900 2024-09-18T13:01:23.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.923+0000 7f66897fa640 1 -- 172.21.15.78:0/3111314774 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f667c004cf0 con 0x7f668c101900 2024-09-18T13:01:23.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.923+0000 7f66897fa640 1 -- 172.21.15.78:0/3111314774 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f667c035030 con 0x7f668c101900 2024-09-18T13:01:23.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.923+0000 7f66921ae640 1 -- 172.21.15.78:0/3111314774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f668c19a1d0 con 0x7f668c101900 2024-09-18T13:01:23.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.924+0000 7f66921ae640 1 -- 172.21.15.78:0/3111314774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f668c103040 con 0x7f668c101900 2024-09-18T13:01:23.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.925+0000 7f66897fa640 1 -- 172.21.15.78:0/3111314774 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f667c042070 con 0x7f668c101900 2024-09-18T13:01:23.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.925+0000 7f66897fa640 1 --2- 172.21.15.78:0/3111314774 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f667807af30 0x7f667807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:23.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.926+0000 7f66897fa640 1 -- 172.21.15.78:0/3111314774 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f667c0beaf0 con 0x7f668c101900 2024-09-18T13:01:23.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.926+0000 7f6682ffd640 1 --2- 172.21.15.78:0/3111314774 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f667807af30 0x7f667807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:23.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.926+0000 7f6682ffd640 1 --2- 172.21.15.78:0/3111314774 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f667807af30 0x7f667807d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f668c0757c0 tx=0x7f6674009110 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:23.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:23.930+0000 7f66897fa640 1 -- 172.21.15.78:0/3111314774 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f667c08a090 con 0x7f668c101900 2024-09-18T13:01:24.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.120+0000 7f66921ae640 1 -- 172.21.15.78:0/3111314774 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f668c19a480 con 0x7f667807af30 2024-09-18T13:01:24.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.121+0000 7f66897fa640 1 -- 172.21.15.78:0/3111314774 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f668c19a480 con 0x7f667807af30 2024-09-18T13:01:24.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.123+0000 7f66921ae640 1 -- 172.21.15.78:0/3111314774 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f667807af30 msgr2=0x7f667807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:24.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.123+0000 7f66921ae640 1 --2- 172.21.15.78:0/3111314774 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f667807af30 0x7f667807d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f668c0757c0 tx=0x7f6674009110 comp rx=0 tx=0).stop 2024-09-18T13:01:24.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.123+0000 7f66921ae640 1 -- 172.21.15.78:0/3111314774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f668c101900 msgr2=0x7f668c19f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:24.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.123+0000 7f66921ae640 1 --2- 172.21.15.78:0/3111314774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f668c101900 0x7f668c19f850 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f667c031460 tx=0x7f667c0048f0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.123+0000 7f66921ae640 1 -- 172.21.15.78:0/3111314774 shutdown_connections 2024-09-18T13:01:24.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.123+0000 7f66921ae640 1 --2- 172.21.15.78:0/3111314774 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f667807af30 0x7f667807d3f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.123+0000 7f66921ae640 1 --2- 172.21.15.78:0/3111314774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f668c107900 0x7f668c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.123+0000 7f66921ae640 1 --2- 172.21.15.78:0/3111314774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f668c101900 0x7f668c19f850 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.123+0000 7f66921ae640 1 -- 172.21.15.78:0/3111314774 >> 172.21.15.78:0/3111314774 conn(0x7f668c0fd600 msgr2=0x7f668c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:24.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.123+0000 7f66921ae640 1 -- 172.21.15.78:0/3111314774 shutdown_connections 2024-09-18T13:01:24.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.123+0000 7f66921ae640 1 -- 172.21.15.78:0/3111314774 wait complete. 2024-09-18T13:01:24.133 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:01:24.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.206+0000 7fd7324c0640 1 -- 172.21.15.78:0/1081231457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72c1007f0 msgr2=0x7fd72c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:24.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.206+0000 7fd7324c0640 1 --2- 172.21.15.78:0/1081231457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72c1007f0 0x7fd72c100c50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd720009880 tx=0x7fd72002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.206+0000 7fd7324c0640 1 -- 172.21.15.78:0/1081231457 shutdown_connections 2024-09-18T13:01:24.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.206+0000 7fd7324c0640 1 --2- 172.21.15.78:0/1081231457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72c1007f0 0x7fd72c100c50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.206+0000 7fd7324c0640 1 --2- 172.21.15.78:0/1081231457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd72c1067f0 0x7fd72c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.206+0000 7fd7324c0640 1 -- 172.21.15.78:0/1081231457 >> 172.21.15.78:0/1081231457 conn(0x7fd72c0fc550 msgr2=0x7fd72c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:24.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.207+0000 7fd7324c0640 1 -- 172.21.15.78:0/1081231457 shutdown_connections 2024-09-18T13:01:24.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.207+0000 7fd7324c0640 1 -- 172.21.15.78:0/1081231457 wait complete. 2024-09-18T13:01:24.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.207+0000 7fd7324c0640 1 Processor -- start 2024-09-18T13:01:24.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.207+0000 7fd7324c0640 1 -- start start 2024-09-18T13:01:24.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.208+0000 7fd7324c0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd72c1007f0 0x7fd72c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:24.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.208+0000 7fd7324c0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72c1067f0 0x7fd72c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:24.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.208+0000 7fd7324c0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c10dd20 con 0x7fd72c1067f0 2024-09-18T13:01:24.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.208+0000 7fd7324c0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c10dba0 con 0x7fd72c1007f0 2024-09-18T13:01:24.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.208+0000 7fd72b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72c1067f0 0x7fd72c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:24.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.208+0000 7fd72b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72c1067f0 0x7fd72c198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44692/0 (socket says 172.21.15.78:44692) 2024-09-18T13:01:24.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.208+0000 7fd72b7fe640 1 -- 172.21.15.78:0/2458123521 learned_addr learned my addr 172.21.15.78:0/2458123521 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:01:24.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.208+0000 7fd72bfff640 1 --2- 172.21.15.78:0/2458123521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd72c1007f0 0x7fd72c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:24.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.208+0000 7fd72b7fe640 1 -- 172.21.15.78:0/2458123521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd72c1007f0 msgr2=0x7fd72c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:24.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.208+0000 7fd72b7fe640 1 --2- 172.21.15.78:0/2458123521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd72c1007f0 0x7fd72c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.208+0000 7fd72b7fe640 1 -- 172.21.15.78:0/2458123521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72c1994b0 con 0x7fd72c1067f0 2024-09-18T13:01:24.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.209+0000 7fd72b7fe640 1 --2- 172.21.15.78:0/2458123521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72c1067f0 0x7fd72c198eb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd720031460 tx=0x7fd7200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:24.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.209+0000 7fd7297fa640 1 -- 172.21.15.78:0/2458123521 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd72003f070 con 0x7fd72c1067f0 2024-09-18T13:01:24.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.209+0000 7fd7297fa640 1 -- 172.21.15.78:0/2458123521 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd720004cf0 con 0x7fd72c1067f0 2024-09-18T13:01:24.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.209+0000 7fd7297fa640 1 -- 172.21.15.78:0/2458123521 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd720035030 con 0x7fd72c1067f0 2024-09-18T13:01:24.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.209+0000 7fd7324c0640 1 -- 172.21.15.78:0/2458123521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd72c199740 con 0x7fd72c1067f0 2024-09-18T13:01:24.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.209+0000 7fd7324c0640 1 -- 172.21.15.78:0/2458123521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd72c1a1cf0 con 0x7fd72c1067f0 2024-09-18T13:01:24.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.210+0000 7fd7324c0640 1 -- 172.21.15.78:0/2458123521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd72c101f30 con 0x7fd72c1067f0 2024-09-18T13:01:24.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.211+0000 7fd7297fa640 1 -- 172.21.15.78:0/2458123521 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd720042070 con 0x7fd72c1067f0 2024-09-18T13:01:24.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.211+0000 7fd7297fa640 1 --2- 172.21.15.78:0/2458123521 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd71407af30 0x7fd71407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:24.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.211+0000 7fd7297fa640 1 -- 172.21.15.78:0/2458123521 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fd7200beaf0 con 0x7fd72c1067f0 2024-09-18T13:01:24.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.211+0000 7fd72bfff640 1 --2- 172.21.15.78:0/2458123521 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd71407af30 0x7fd71407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:24.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.212+0000 7fd72bfff640 1 --2- 172.21.15.78:0/2458123521 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd71407af30 0x7fd71407d3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009990 tx=0x7fd71c009110 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:24.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.216+0000 7fd7297fa640 1 -- 172.21.15.78:0/2458123521 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd72008a090 con 0x7fd72c1067f0 2024-09-18T13:01:24.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.410+0000 7fd7324c0640 1 -- 172.21.15.78:0/2458123521 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd72c062630 con 0x7fd71407af30 2024-09-18T13:01:24.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.411+0000 7fd7297fa640 1 -- 172.21.15.78:0/2458123521 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd72c062630 con 0x7fd71407af30 2024-09-18T13:01:24.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.413+0000 7fd7324c0640 1 -- 172.21.15.78:0/2458123521 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd71407af30 msgr2=0x7fd71407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:24.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.413+0000 7fd7324c0640 1 --2- 172.21.15.78:0/2458123521 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd71407af30 0x7fd71407d3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009990 tx=0x7fd71c009110 comp rx=0 tx=0).stop 2024-09-18T13:01:24.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.413+0000 7fd7324c0640 1 -- 172.21.15.78:0/2458123521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72c1067f0 msgr2=0x7fd72c198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:24.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.413+0000 7fd7324c0640 1 --2- 172.21.15.78:0/2458123521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72c1067f0 0x7fd72c198eb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd720031460 tx=0x7fd7200048f0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.413+0000 7fd7324c0640 1 -- 172.21.15.78:0/2458123521 shutdown_connections 2024-09-18T13:01:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.413+0000 7fd7324c0640 1 --2- 172.21.15.78:0/2458123521 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd71407af30 0x7fd71407d3f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.413+0000 7fd7324c0640 1 --2- 172.21.15.78:0/2458123521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72c1067f0 0x7fd72c198eb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.413+0000 7fd7324c0640 1 --2- 172.21.15.78:0/2458123521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd72c1007f0 0x7fd72c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.413+0000 7fd7324c0640 1 -- 172.21.15.78:0/2458123521 >> 172.21.15.78:0/2458123521 conn(0x7fd72c0fc550 msgr2=0x7fd72c0fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.413+0000 7fd7324c0640 1 -- 172.21.15.78:0/2458123521 shutdown_connections 2024-09-18T13:01:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.413+0000 7fd7324c0640 1 -- 172.21.15.78:0/2458123521 wait complete. 2024-09-18T13:01:24.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:24 smithi078 ceph-mon[108578]: pgmap v367: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:24.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.494+0000 7f7f7daef640 1 -- 172.21.15.78:0/1758327504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f781007f0 msgr2=0x7f7f78100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:24.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.494+0000 7f7f7daef640 1 --2- 172.21.15.78:0/1758327504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f781007f0 0x7f7f78100c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7f60009880 tx=0x7f7f6002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.495+0000 7f7f7daef640 1 -- 172.21.15.78:0/1758327504 shutdown_connections 2024-09-18T13:01:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.495+0000 7f7f7daef640 1 --2- 172.21.15.78:0/1758327504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f781007f0 0x7f7f78100c50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.495+0000 7f7f7daef640 1 --2- 172.21.15.78:0/1758327504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f781067f0 0x7f7f78106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.495+0000 7f7f7daef640 1 -- 172.21.15.78:0/1758327504 >> 172.21.15.78:0/1758327504 conn(0x7f7f780fc550 msgr2=0x7f7f780fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.495+0000 7f7f7daef640 1 -- 172.21.15.78:0/1758327504 shutdown_connections 2024-09-18T13:01:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.495+0000 7f7f7daef640 1 -- 172.21.15.78:0/1758327504 wait complete. 2024-09-18T13:01:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.495+0000 7f7f7daef640 1 Processor -- start 2024-09-18T13:01:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.495+0000 7f7f7daef640 1 -- start start 2024-09-18T13:01:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.495+0000 7f7f7daef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f781007f0 0x7f7f7819d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.495+0000 7f7f7daef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f781067f0 0x7f7f7819dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.495+0000 7f7f7daef640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7810dd20 con 0x7f7f781007f0 2024-09-18T13:01:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.495+0000 7f7f7daef640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7810dba0 con 0x7f7f781067f0 2024-09-18T13:01:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.496+0000 7f7f777fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f781007f0 0x7f7f7819d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.496+0000 7f7f777fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f781007f0 0x7f7f7819d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44698/0 (socket says 172.21.15.78:44698) 2024-09-18T13:01:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.496+0000 7f7f777fe640 1 -- 172.21.15.78:0/1922151037 learned_addr learned my addr 172.21.15.78:0/1922151037 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:01:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.496+0000 7f7f6ffff640 1 --2- 172.21.15.78:0/1922151037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f781067f0 0x7f7f7819dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.496+0000 7f7f777fe640 1 -- 172.21.15.78:0/1922151037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f781067f0 msgr2=0x7f7f7819dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.496+0000 7f7f777fe640 1 --2- 172.21.15.78:0/1922151037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f781067f0 0x7f7f7819dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.496+0000 7f7f777fe640 1 -- 172.21.15.78:0/1922151037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f78197900 con 0x7f7f781007f0 2024-09-18T13:01:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.496+0000 7f7f6ffff640 1 --2- 172.21.15.78:0/1922151037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f781067f0 0x7f7f7819dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:01:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.496+0000 7f7f777fe640 1 --2- 172.21.15.78:0/1922151037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f781007f0 0x7f7f7819d740 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800b420 tx=0x7f7f6800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.496+0000 7f7f757fa640 1 -- 172.21.15.78:0/1922151037 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f68011630 con 0x7f7f781007f0 2024-09-18T13:01:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.496+0000 7f7f7daef640 1 -- 172.21.15.78:0/1922151037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f78197b90 con 0x7f7f781007f0 2024-09-18T13:01:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.496+0000 7f7f757fa640 1 -- 172.21.15.78:0/1922151037 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7f68016070 con 0x7f7f781007f0 2024-09-18T13:01:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.496+0000 7f7f757fa640 1 -- 172.21.15.78:0/1922151037 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f68010d40 con 0x7f7f781007f0 2024-09-18T13:01:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.496+0000 7f7f7daef640 1 -- 172.21.15.78:0/1922151037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f78198120 con 0x7f7f781007f0 2024-09-18T13:01:24.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.497+0000 7f7f7daef640 1 -- 172.21.15.78:0/1922151037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f78101f30 con 0x7f7f781007f0 2024-09-18T13:01:24.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.498+0000 7f7f757fa640 1 -- 172.21.15.78:0/1922151037 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7f6801b460 con 0x7f7f781007f0 2024-09-18T13:01:24.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.498+0000 7f7f757fa640 1 --2- 172.21.15.78:0/1922151037 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f6407af80 0x7f7f6407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:24.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.499+0000 7f7f757fa640 1 -- 172.21.15.78:0/1922151037 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f7f6809d700 con 0x7f7f781007f0 2024-09-18T13:01:24.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.499+0000 7f7f6ffff640 1 --2- 172.21.15.78:0/1922151037 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f6407af80 0x7f7f6407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:24.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.499+0000 7f7f6ffff640 1 --2- 172.21.15.78:0/1922151037 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f6407af80 0x7f7f6407d440 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7f781990f0 tx=0x7f7f60031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:24.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.503+0000 7f7f757fa640 1 -- 172.21.15.78:0/1922151037 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7f68068d20 con 0x7f7f781007f0 2024-09-18T13:01:24.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.685+0000 7f7f7daef640 1 -- 172.21.15.78:0/1922151037 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7f78198ea0 con 0x7f7f6407af80 2024-09-18T13:01:24.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.694+0000 7f7f757fa640 1 -- 172.21.15.78:0/1922151037 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f7f78198ea0 con 0x7f7f6407af80 2024-09-18T13:01:24.695 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:01:24.695 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (9m) 3m ago 20m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:01:24.695 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (11m) 3m ago 20m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:01:24.696 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (11m) 2m ago 19m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:01:24.696 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (7m) 3m ago 20m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:01:24.696 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (7m) 2m ago 19m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:01:24.696 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (8m) 3m ago 20m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:01:24.696 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (3m) 3m ago 14m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:01:24.696 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (3m) 3m ago 14m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:01:24.696 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (3m) 2m ago 14m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:01:24.696 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (3m) 2m ago 14m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:01:24.696 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (11m) 3m ago 21m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:01:24.696 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (10m) 2m ago 19m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:01:24.696 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (7m) 3m ago 21m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:01:24.696 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (7m) 2m ago 19m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:01:24.697 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (10m) 3m ago 20m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:01:24.697 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (9m) 2m ago 19m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:01:24.697 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (7m) 3m ago 18m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:01:24.697 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (6m) 3m ago 17m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:01:24.697 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (5m) 3m ago 17m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:01:24.697 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (5m) 2m ago 16m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:01:24.697 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (4m) 2m ago 16m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:01:24.697 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (4m) 2m ago 15m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:01:24.697 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (9m) 3m ago 19m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:01:24.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.696+0000 7f7f7daef640 1 -- 172.21.15.78:0/1922151037 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f6407af80 msgr2=0x7f7f6407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:24.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.696+0000 7f7f7daef640 1 --2- 172.21.15.78:0/1922151037 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f6407af80 0x7f7f6407d440 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7f781990f0 tx=0x7f7f60031400 comp rx=0 tx=0).stop 2024-09-18T13:01:24.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.696+0000 7f7f7daef640 1 -- 172.21.15.78:0/1922151037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f781007f0 msgr2=0x7f7f7819d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:24.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.696+0000 7f7f7daef640 1 --2- 172.21.15.78:0/1922151037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f781007f0 0x7f7f7819d740 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800b420 tx=0x7f7f6800b8e0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.697+0000 7f7f7daef640 1 -- 172.21.15.78:0/1922151037 shutdown_connections 2024-09-18T13:01:24.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.697+0000 7f7f7daef640 1 --2- 172.21.15.78:0/1922151037 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7f6407af80 0x7f7f6407d440 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.697+0000 7f7f7daef640 1 --2- 172.21.15.78:0/1922151037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f781067f0 0x7f7f7819dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.697+0000 7f7f7daef640 1 --2- 172.21.15.78:0/1922151037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f781007f0 0x7f7f7819d740 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.697+0000 7f7f7daef640 1 -- 172.21.15.78:0/1922151037 >> 172.21.15.78:0/1922151037 conn(0x7f7f780fc550 msgr2=0x7f7f78104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:24.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.697+0000 7f7f7daef640 1 -- 172.21.15.78:0/1922151037 shutdown_connections 2024-09-18T13:01:24.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.697+0000 7f7f7daef640 1 -- 172.21.15.78:0/1922151037 wait complete. 2024-09-18T13:01:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:24 smithi148 ceph-mon[80030]: pgmap v367: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:24.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.777+0000 7fb2e49b8640 1 -- 172.21.15.78:0/3063647056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e0102b50 msgr2=0x7fb2e0102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:24.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.777+0000 7fb2e49b8640 1 --2- 172.21.15.78:0/3063647056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e0102b50 0x7fb2e0102f30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009880 tx=0x7fb2d002a530 comp rx=0 tx=0).stop 2024-09-18T13:01:24.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.777+0000 7fb2e49b8640 1 -- 172.21.15.78:0/3063647056 shutdown_connections 2024-09-18T13:01:24.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.777+0000 7fb2e49b8640 1 --2- 172.21.15.78:0/3063647056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2e0103470 0x7fb2e010b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.777+0000 7fb2e49b8640 1 --2- 172.21.15.78:0/3063647056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e0102b50 0x7fb2e0102f30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.777+0000 7fb2e49b8640 1 -- 172.21.15.78:0/3063647056 >> 172.21.15.78:0/3063647056 conn(0x7fb2e00fc550 msgr2=0x7fb2e00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:24.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.777+0000 7fb2e49b8640 1 -- 172.21.15.78:0/3063647056 shutdown_connections 2024-09-18T13:01:24.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.777+0000 7fb2e49b8640 1 -- 172.21.15.78:0/3063647056 wait complete. 2024-09-18T13:01:24.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.778+0000 7fb2e49b8640 1 Processor -- start 2024-09-18T13:01:24.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.778+0000 7fb2e49b8640 1 -- start start 2024-09-18T13:01:24.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.778+0000 7fb2e49b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e0102b50 0x7fb2e019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:24.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.778+0000 7fb2e49b8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2e0103470 0x7fb2e019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:24.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.778+0000 7fb2e49b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e010ede0 con 0x7fb2e0102b50 2024-09-18T13:01:24.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.778+0000 7fb2e49b8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e010ec60 con 0x7fb2e0103470 2024-09-18T13:01:24.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.778+0000 7fb2de59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e0102b50 0x7fb2e019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:24.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.778+0000 7fb2de59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e0102b50 0x7fb2e019d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44730/0 (socket says 172.21.15.78:44730) 2024-09-18T13:01:24.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.778+0000 7fb2de59c640 1 -- 172.21.15.78:0/2807003956 learned_addr learned my addr 172.21.15.78:0/2807003956 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:01:24.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.778+0000 7fb2ddd9b640 1 --2- 172.21.15.78:0/2807003956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2e0103470 0x7fb2e019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:24.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.778+0000 7fb2de59c640 1 -- 172.21.15.78:0/2807003956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2e0103470 msgr2=0x7fb2e019db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:24.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.778+0000 7fb2de59c640 1 --2- 172.21.15.78:0/2807003956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2e0103470 0x7fb2e019db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:24.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.778+0000 7fb2de59c640 1 -- 172.21.15.78:0/2807003956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e01977d0 con 0x7fb2e0102b50 2024-09-18T13:01:24.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.778+0000 7fb2ddd9b640 1 --2- 172.21.15.78:0/2807003956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2e0103470 0x7fb2e019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:01:24.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.778+0000 7fb2de59c640 1 --2- 172.21.15.78:0/2807003956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e0102b50 0x7fb2e019d650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0004f90 tx=0x7fb2d00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:24.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.779+0000 7fb2d77fe640 1 -- 172.21.15.78:0/2807003956 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb2d003f070 con 0x7fb2e0102b50 2024-09-18T13:01:24.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.779+0000 7fb2e49b8640 1 -- 172.21.15.78:0/2807003956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e0197a60 con 0x7fb2e0102b50 2024-09-18T13:01:24.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.779+0000 7fb2d77fe640 1 -- 172.21.15.78:0/2807003956 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb2d0004c70 con 0x7fb2e0102b50 2024-09-18T13:01:24.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.779+0000 7fb2d77fe640 1 -- 172.21.15.78:0/2807003956 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb2d0035030 con 0x7fb2e0102b50 2024-09-18T13:01:24.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.779+0000 7fb2e49b8640 1 -- 172.21.15.78:0/2807003956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e0197f90 con 0x7fb2e0102b50 2024-09-18T13:01:24.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.780+0000 7fb2e49b8640 1 -- 172.21.15.78:0/2807003956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e006a4e0 con 0x7fb2e0102b50 2024-09-18T13:01:24.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.781+0000 7fb2d77fe640 1 -- 172.21.15.78:0/2807003956 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fb2d0042070 con 0x7fb2e0102b50 2024-09-18T13:01:24.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.782+0000 7fb2d77fe640 1 --2- 172.21.15.78:0/2807003956 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb2cc07af30 0x7fb2cc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:24.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.782+0000 7fb2d77fe640 1 -- 172.21.15.78:0/2807003956 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fb2d00be600 con 0x7fb2e0102b50 2024-09-18T13:01:24.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.782+0000 7fb2ddd9b640 1 --2- 172.21.15.78:0/2807003956 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb2cc07af30 0x7fb2cc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:24.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.782+0000 7fb2ddd9b640 1 --2- 172.21.15.78:0/2807003956 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb2cc07af30 0x7fb2cc07d3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0108920 tx=0x7fb2c8005e50 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:24.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:24.788+0000 7fb2d77fe640 1 -- 172.21.15.78:0/2807003956 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fb2d0089ba0 con 0x7fb2e0102b50 2024-09-18T13:01:25.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.032+0000 7fb2e49b8640 1 -- 172.21.15.78:0/2807003956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb2e0105fb0 con 0x7fb2e0102b50 2024-09-18T13:01:25.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.032+0000 7fb2d77fe640 1 -- 172.21.15.78:0/2807003956 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fb2d008ea50 con 0x7fb2e0102b50 2024-09-18T13:01:25.034 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:01:25.034 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:01:25.034 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:01:25.034 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:01:25.034 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:01:25.034 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:01:25.034 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:01:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:01:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:01:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:01:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:01:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:01:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:01:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:01:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:01:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:01:25.035 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:01:25.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.035+0000 7fb2e49b8640 1 -- 172.21.15.78:0/2807003956 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb2cc07af30 msgr2=0x7fb2cc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:25.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.035+0000 7fb2e49b8640 1 --2- 172.21.15.78:0/2807003956 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb2cc07af30 0x7fb2cc07d3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0108920 tx=0x7fb2c8005e50 comp rx=0 tx=0).stop 2024-09-18T13:01:25.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.035+0000 7fb2e49b8640 1 -- 172.21.15.78:0/2807003956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e0102b50 msgr2=0x7fb2e019d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:25.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.035+0000 7fb2e49b8640 1 --2- 172.21.15.78:0/2807003956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e0102b50 0x7fb2e019d650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0004f90 tx=0x7fb2d00048f0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.035+0000 7fb2e49b8640 1 -- 172.21.15.78:0/2807003956 shutdown_connections 2024-09-18T13:01:25.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.035+0000 7fb2e49b8640 1 --2- 172.21.15.78:0/2807003956 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb2cc07af30 0x7fb2cc07d3f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.035+0000 7fb2e49b8640 1 --2- 172.21.15.78:0/2807003956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2e0103470 0x7fb2e019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.035+0000 7fb2e49b8640 1 --2- 172.21.15.78:0/2807003956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e0102b50 0x7fb2e019d650 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.035+0000 7fb2e49b8640 1 -- 172.21.15.78:0/2807003956 >> 172.21.15.78:0/2807003956 conn(0x7fb2e00fc550 msgr2=0x7fb2e0108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.035+0000 7fb2e49b8640 1 -- 172.21.15.78:0/2807003956 shutdown_connections 2024-09-18T13:01:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.035+0000 7fb2e49b8640 1 -- 172.21.15.78:0/2807003956 wait complete. 2024-09-18T13:01:25.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.117+0000 7f9cbd692640 1 -- 172.21.15.78:0/3353477781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb8106820 msgr2=0x7f9cb8106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:25.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.117+0000 7f9cbd692640 1 --2- 172.21.15.78:0/3353477781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb8106820 0x7f9cb8106c00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009880 tx=0x7f9cac02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.117+0000 7f9cbd692640 1 -- 172.21.15.78:0/3353477781 shutdown_connections 2024-09-18T13:01:25.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.117+0000 7f9cbd692640 1 --2- 172.21.15.78:0/3353477781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8100820 0x7f9cb8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.117+0000 7f9cbd692640 1 --2- 172.21.15.78:0/3353477781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb8106820 0x7f9cb8106c00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.117+0000 7f9cbd692640 1 -- 172.21.15.78:0/3353477781 >> 172.21.15.78:0/3353477781 conn(0x7f9cb80fc540 msgr2=0x7f9cb80fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.117+0000 7f9cbd692640 1 -- 172.21.15.78:0/3353477781 shutdown_connections 2024-09-18T13:01:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.117+0000 7f9cbd692640 1 -- 172.21.15.78:0/3353477781 wait complete. 2024-09-18T13:01:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.117+0000 7f9cbd692640 1 Processor -- start 2024-09-18T13:01:25.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.118+0000 7f9cbd692640 1 -- start start 2024-09-18T13:01:25.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.118+0000 7f9cbd692640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb8100820 0x7f9cb8107750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:25.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.118+0000 7f9cbd692640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8106820 0x7f9cb8107c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:25.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.118+0000 7f9cbd692640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb810dcd0 con 0x7f9cb8100820 2024-09-18T13:01:25.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.118+0000 7f9cbd692640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb810db50 con 0x7f9cb8106820 2024-09-18T13:01:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.118+0000 7f9cb6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb8100820 0x7f9cb8107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.118+0000 7f9cb6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb8100820 0x7f9cb8107750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44744/0 (socket says 172.21.15.78:44744) 2024-09-18T13:01:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.118+0000 7f9cb6ffd640 1 -- 172.21.15.78:0/2355155894 learned_addr learned my addr 172.21.15.78:0/2355155894 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:01:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.118+0000 7f9cb67fc640 1 --2- 172.21.15.78:0/2355155894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8106820 0x7f9cb8107c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.118+0000 7f9cb6ffd640 1 -- 172.21.15.78:0/2355155894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8106820 msgr2=0x7f9cb8107c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.118+0000 7f9cb6ffd640 1 --2- 172.21.15.78:0/2355155894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8106820 0x7f9cb8107c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.118+0000 7f9cb6ffd640 1 -- 172.21.15.78:0/2355155894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb81081d0 con 0x7f9cb8100820 2024-09-18T13:01:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.119+0000 7f9cb6ffd640 1 --2- 172.21.15.78:0/2355155894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb8100820 0x7f9cb8107750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9cac031460 tx=0x7f9cac0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.119+0000 7f9c9ffff640 1 -- 172.21.15.78:0/2355155894 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9cac03f070 con 0x7f9cb8100820 2024-09-18T13:01:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.119+0000 7f9c9ffff640 1 -- 172.21.15.78:0/2355155894 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9cac004b10 con 0x7f9cb8100820 2024-09-18T13:01:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.119+0000 7f9cbd692640 1 -- 172.21.15.78:0/2355155894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb8108460 con 0x7f9cb8100820 2024-09-18T13:01:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.119+0000 7f9c9ffff640 1 -- 172.21.15.78:0/2355155894 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9cac035030 con 0x7f9cb8100820 2024-09-18T13:01:25.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.119+0000 7f9cbd692640 1 -- 172.21.15.78:0/2355155894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb81a3d80 con 0x7f9cb8100820 2024-09-18T13:01:25.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.120+0000 7f9cbd692640 1 -- 172.21.15.78:0/2355155894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb8101f60 con 0x7f9cb8100820 2024-09-18T13:01:25.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.121+0000 7f9c9ffff640 1 -- 172.21.15.78:0/2355155894 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9cac042070 con 0x7f9cb8100820 2024-09-18T13:01:25.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.121+0000 7f9c9ffff640 1 --2- 172.21.15.78:0/2355155894 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9ca007af40 0x7f9ca007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:25.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.121+0000 7f9c9ffff640 1 -- 172.21.15.78:0/2355155894 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f9cac0beb00 con 0x7f9cb8100820 2024-09-18T13:01:25.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.121+0000 7f9cb67fc640 1 --2- 172.21.15.78:0/2355155894 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9ca007af40 0x7f9ca007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:25.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.122+0000 7f9cb67fc640 1 --2- 172.21.15.78:0/2355155894 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9ca007af40 0x7f9ca007d400 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9cb81091e0 tx=0x7f9ca800b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:25.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.125+0000 7f9c9ffff640 1 -- 172.21.15.78:0/2355155894 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9cac08a0a0 con 0x7f9cb8100820 2024-09-18T13:01:25.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.343+0000 7f9cbd692640 1 -- 172.21.15.78:0/2355155894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9cb81a4030 con 0x7f9cb8100820 2024-09-18T13:01:25.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.343+0000 7f9c9ffff640 1 -- 172.21.15.78:0/2355155894 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f9cac08ef50 con 0x7f9cb8100820 2024-09-18T13:01:25.345 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:01:25.345 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:01:25.345 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:01:25.345 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:01:25.345 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:01:25.345 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:01:25.345 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:01:25.345 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:01:25.345 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:01:25.345 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:01:25.345 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:01:25.346 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:01:25.346 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:01:25.346 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:01:25.346 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:01:25.346 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:01:25.346 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:01:25.346 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:01:25.346 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:01:25.346 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:01:25.346 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:01:25.346 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:01:25.346 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:01:25.346 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:01:25.346 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:01:25.347 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:01:25.347 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:01:25.347 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:01:25.347 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:01:25.347 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:01:25.347 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:01:25.347 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:01:25.347 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:01:25.347 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:01:25.347 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:01:25.348 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:01:25.348 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:01:25.348 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:01:25.348 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:01:25.348 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:25.348 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:25.348 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:25.348 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:25.349 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:01:25.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.346+0000 7f9cbd692640 1 -- 172.21.15.78:0/2355155894 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9ca007af40 msgr2=0x7f9ca007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:25.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.346+0000 7f9cbd692640 1 --2- 172.21.15.78:0/2355155894 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9ca007af40 0x7f9ca007d400 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9cb81091e0 tx=0x7f9ca800b390 comp rx=0 tx=0).stop 2024-09-18T13:01:25.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.346+0000 7f9cbd692640 1 -- 172.21.15.78:0/2355155894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb8100820 msgr2=0x7f9cb8107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:25.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.346+0000 7f9cbd692640 1 --2- 172.21.15.78:0/2355155894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb8100820 0x7f9cb8107750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9cac031460 tx=0x7f9cac0045e0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.346+0000 7f9cbd692640 1 -- 172.21.15.78:0/2355155894 shutdown_connections 2024-09-18T13:01:25.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.346+0000 7f9cbd692640 1 --2- 172.21.15.78:0/2355155894 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9ca007af40 0x7f9ca007d400 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.346+0000 7f9cbd692640 1 --2- 172.21.15.78:0/2355155894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8106820 0x7f9cb8107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.346+0000 7f9cbd692640 1 --2- 172.21.15.78:0/2355155894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cb8100820 0x7f9cb8107750 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.346+0000 7f9cbd692640 1 -- 172.21.15.78:0/2355155894 >> 172.21.15.78:0/2355155894 conn(0x7f9cb80fc540 msgr2=0x7f9cb806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:25.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.346+0000 7f9cbd692640 1 -- 172.21.15.78:0/2355155894 shutdown_connections 2024-09-18T13:01:25.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.346+0000 7f9cbd692640 1 -- 172.21.15.78:0/2355155894 wait complete. 2024-09-18T13:01:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.429+0000 7f85b71d8640 1 -- 172.21.15.78:0/1276471936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85b0106800 msgr2=0x7f85b0106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.429+0000 7f85b71d8640 1 --2- 172.21.15.78:0/1276471936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85b0106800 0x7f85b0106be0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009880 tx=0x7f85a402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.429+0000 7f85b71d8640 1 -- 172.21.15.78:0/1276471936 shutdown_connections 2024-09-18T13:01:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.429+0000 7f85b71d8640 1 --2- 172.21.15.78:0/1276471936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85b0100800 0x7f85b0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.429+0000 7f85b71d8640 1 --2- 172.21.15.78:0/1276471936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85b0106800 0x7f85b0106be0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.429+0000 7f85b71d8640 1 -- 172.21.15.78:0/1276471936 >> 172.21.15.78:0/1276471936 conn(0x7f85b00fc520 msgr2=0x7f85b00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.429+0000 7f85b71d8640 1 -- 172.21.15.78:0/1276471936 shutdown_connections 2024-09-18T13:01:25.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.429+0000 7f85b71d8640 1 -- 172.21.15.78:0/1276471936 wait complete. 2024-09-18T13:01:25.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.429+0000 7f85b71d8640 1 Processor -- start 2024-09-18T13:01:25.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.429+0000 7f85b71d8640 1 -- start start 2024-09-18T13:01:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.429+0000 7f85b71d8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85b0100800 0x7f85b0198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.429+0000 7f85b71d8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85b0106800 0x7f85b0198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.429+0000 7f85b71d8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f85b010dd30 con 0x7f85b0106800 2024-09-18T13:01:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.429+0000 7f85b71d8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f85b010dbb0 con 0x7f85b0100800 2024-09-18T13:01:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.430+0000 7f85affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85b0106800 0x7f85b0198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.430+0000 7f85affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85b0106800 0x7f85b0198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44772/0 (socket says 172.21.15.78:44772) 2024-09-18T13:01:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.430+0000 7f85affff640 1 -- 172.21.15.78:0/4215482890 learned_addr learned my addr 172.21.15.78:0/4215482890 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:01:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.430+0000 7f85affff640 1 -- 172.21.15.78:0/4215482890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85b0100800 msgr2=0x7f85b0198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.430+0000 7f85affff640 1 --2- 172.21.15.78:0/4215482890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85b0100800 0x7f85b0198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.430+0000 7f85affff640 1 -- 172.21.15.78:0/4215482890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b01993b0 con 0x7f85b0106800 2024-09-18T13:01:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.430+0000 7f85affff640 1 --2- 172.21.15.78:0/4215482890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85b0106800 0x7f85b0198db0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f859c00b420 tx=0x7f859c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.430+0000 7f85adffb640 1 -- 172.21.15.78:0/4215482890 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f859c011630 con 0x7f85b0106800 2024-09-18T13:01:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.430+0000 7f85adffb640 1 -- 172.21.15.78:0/4215482890 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f859c016070 con 0x7f85b0106800 2024-09-18T13:01:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.430+0000 7f85b71d8640 1 -- 172.21.15.78:0/4215482890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b01996a0 con 0x7f85b0106800 2024-09-18T13:01:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.430+0000 7f85adffb640 1 -- 172.21.15.78:0/4215482890 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f859c010d40 con 0x7f85b0106800 2024-09-18T13:01:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.431+0000 7f85b71d8640 1 -- 172.21.15.78:0/4215482890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b01a1ca0 con 0x7f85b0106800 2024-09-18T13:01:25.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.432+0000 7f85b71d8640 1 -- 172.21.15.78:0/4215482890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85b0101f40 con 0x7f85b0106800 2024-09-18T13:01:25.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.432+0000 7f85adffb640 1 -- 172.21.15.78:0/4215482890 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f859c0117d0 con 0x7f85b0106800 2024-09-18T13:01:25.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.433+0000 7f85adffb640 1 --2- 172.21.15.78:0/4215482890 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f85a007af80 0x7f85a007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:25.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.433+0000 7f85adffb640 1 -- 172.21.15.78:0/4215482890 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f859c09d790 con 0x7f85b0106800 2024-09-18T13:01:25.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.433+0000 7f85b4f74640 1 --2- 172.21.15.78:0/4215482890 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f85a007af80 0x7f85a007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:25.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.433+0000 7f85b4f74640 1 --2- 172.21.15.78:0/4215482890 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f85a007af80 0x7f85a007d440 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f85a40096c0 tx=0x7f85a4000bc0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:25.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.437+0000 7f85adffb640 1 -- 172.21.15.78:0/4215482890 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f85b01996a0 con 0x7f85b0106800 2024-09-18T13:01:25.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.642+0000 7f85b71d8640 1 -- 172.21.15.78:0/4215482890 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f85b0062630 con 0x7f85a007af80 2024-09-18T13:01:25.644 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:25 smithi078 ceph-mon[108578]: from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:25.644 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:25 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2807003956' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.643+0000 7f85adffb640 1 -- 172.21.15.78:0/4215482890 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f85b0062630 con 0x7f85a007af80 2024-09-18T13:01:25.644 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:01:25.645 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:01:25.645 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:01:25.645 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:01:25.645 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:01:25.645 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:01:25.645 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:01:25.645 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:01:25.645 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:01:25.645 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:01:25.645 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:01:25.645 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:01:25.645 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:01:25.646 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:01:25.646 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:01:25.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.645+0000 7f85b71d8640 1 -- 172.21.15.78:0/4215482890 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f85a007af80 msgr2=0x7f85a007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:25.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.645+0000 7f85b71d8640 1 --2- 172.21.15.78:0/4215482890 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f85a007af80 0x7f85a007d440 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f85a40096c0 tx=0x7f85a4000bc0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.645+0000 7f85b71d8640 1 -- 172.21.15.78:0/4215482890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85b0106800 msgr2=0x7f85b0198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:25.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.645+0000 7f85b71d8640 1 --2- 172.21.15.78:0/4215482890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85b0106800 0x7f85b0198db0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f859c00b420 tx=0x7f859c00b8e0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.646+0000 7f85b71d8640 1 -- 172.21.15.78:0/4215482890 shutdown_connections 2024-09-18T13:01:25.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.646+0000 7f85b71d8640 1 --2- 172.21.15.78:0/4215482890 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f85a007af80 0x7f85a007d440 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.646+0000 7f85b71d8640 1 --2- 172.21.15.78:0/4215482890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85b0106800 0x7f85b0198db0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.646+0000 7f85b71d8640 1 --2- 172.21.15.78:0/4215482890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85b0100800 0x7f85b0198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.646+0000 7f85b71d8640 1 -- 172.21.15.78:0/4215482890 >> 172.21.15.78:0/4215482890 conn(0x7f85b00fc520 msgr2=0x7f85b00fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:25.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.646+0000 7f85b71d8640 1 -- 172.21.15.78:0/4215482890 shutdown_connections 2024-09-18T13:01:25.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.646+0000 7f85b71d8640 1 -- 172.21.15.78:0/4215482890 wait complete. 2024-09-18T13:01:25.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:25 smithi148 ceph-mon[80030]: from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:25.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:25 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2807003956' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:25.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.727+0000 7fa2d384d640 1 -- 172.21.15.78:0/2048198381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2cc100330 msgr2=0x7fa2cc100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:25.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.727+0000 7fa2d384d640 1 --2- 172.21.15.78:0/2048198381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2cc100330 0x7fa2cc100710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009880 tx=0x7fa2c802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.727+0000 7fa2d384d640 1 -- 172.21.15.78:0/2048198381 shutdown_connections 2024-09-18T13:01:25.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.727+0000 7fa2d384d640 1 --2- 172.21.15.78:0/2048198381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc100ce0 0x7fa2cc1065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.727+0000 7fa2d384d640 1 --2- 172.21.15.78:0/2048198381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2cc100330 0x7fa2cc100710 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.727+0000 7fa2d384d640 1 -- 172.21.15.78:0/2048198381 >> 172.21.15.78:0/2048198381 conn(0x7fa2cc077270 msgr2=0x7fa2cc077680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:25.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.727+0000 7fa2d384d640 1 -- 172.21.15.78:0/2048198381 shutdown_connections 2024-09-18T13:01:25.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.727+0000 7fa2d384d640 1 -- 172.21.15.78:0/2048198381 wait complete. 2024-09-18T13:01:25.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.728+0000 7fa2d384d640 1 Processor -- start 2024-09-18T13:01:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.728+0000 7fa2d384d640 1 -- start start 2024-09-18T13:01:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.728+0000 7fa2d384d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2cc100330 0x7fa2cc19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.728+0000 7fa2d384d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc100ce0 0x7fa2cc19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.728+0000 7fa2d384d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa2cc10ee10 con 0x7fa2cc100330 2024-09-18T13:01:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.728+0000 7fa2d384d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa2cc10ec90 con 0x7fa2cc100ce0 2024-09-18T13:01:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.728+0000 7fa2d15e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2cc100330 0x7fa2cc19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.728+0000 7fa2d15e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2cc100330 0x7fa2cc19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44782/0 (socket says 172.21.15.78:44782) 2024-09-18T13:01:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.728+0000 7fa2d15e9640 1 -- 172.21.15.78:0/270452086 learned_addr learned my addr 172.21.15.78:0/270452086 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:01:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.729+0000 7fa2d0de8640 1 --2- 172.21.15.78:0/270452086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc100ce0 0x7fa2cc19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.729+0000 7fa2d15e9640 1 -- 172.21.15.78:0/270452086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc100ce0 msgr2=0x7fa2cc19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.729+0000 7fa2d15e9640 1 --2- 172.21.15.78:0/270452086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc100ce0 0x7fa2cc19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.729+0000 7fa2d15e9640 1 -- 172.21.15.78:0/270452086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2cc197820 con 0x7fa2cc100330 2024-09-18T13:01:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.729+0000 7fa2d15e9640 1 --2- 172.21.15.78:0/270452086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2cc100330 0x7fa2cc19d6a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8031460 tx=0x7fa2c80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:25.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.729+0000 7fa2c27fc640 1 -- 172.21.15.78:0/270452086 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2c803f070 con 0x7fa2cc100330 2024-09-18T13:01:25.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.729+0000 7fa2d384d640 1 -- 172.21.15.78:0/270452086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2cc197ab0 con 0x7fa2cc100330 2024-09-18T13:01:25.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.729+0000 7fa2c27fc640 1 -- 172.21.15.78:0/270452086 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa2c8004cf0 con 0x7fa2cc100330 2024-09-18T13:01:25.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.729+0000 7fa2c27fc640 1 -- 172.21.15.78:0/270452086 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2c8035030 con 0x7fa2cc100330 2024-09-18T13:01:25.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.729+0000 7fa2d384d640 1 -- 172.21.15.78:0/270452086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2cc197fe0 con 0x7fa2cc100330 2024-09-18T13:01:25.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.730+0000 7fa2d384d640 1 -- 172.21.15.78:0/270452086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2cc069e00 con 0x7fa2cc100330 2024-09-18T13:01:25.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.731+0000 7fa2c27fc640 1 -- 172.21.15.78:0/270452086 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa2c8042070 con 0x7fa2cc100330 2024-09-18T13:01:25.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.731+0000 7fa2c27fc640 1 --2- 172.21.15.78:0/270452086 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa2b807af30 0x7fa2b807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:25.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.731+0000 7fa2c27fc640 1 -- 172.21.15.78:0/270452086 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fa2c80beb20 con 0x7fa2cc100330 2024-09-18T13:01:25.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.731+0000 7fa2d0de8640 1 --2- 172.21.15.78:0/270452086 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa2b807af30 0x7fa2b807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:25.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.732+0000 7fa2d0de8640 1 --2- 172.21.15.78:0/270452086 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa2b807af30 0x7fa2b807d3f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc005fd0 tx=0x7fa2bc005e20 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:25.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.735+0000 7fa2c27fc640 1 -- 172.21.15.78:0/270452086 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa2c808a0c0 con 0x7fa2cc100330 2024-09-18T13:01:25.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.979+0000 7fa2d384d640 1 -- 172.21.15.78:0/270452086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fa2cc109e80 con 0x7fa2cc100330 2024-09-18T13:01:25.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.979+0000 7fa2c27fc640 1 -- 172.21.15.78:0/270452086 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fa2c808ef70 con 0x7fa2cc100330 2024-09-18T13:01:25.980 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:01:25.980 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:01:25.980 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:01:25.981 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:01:25.981 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:01:25.981 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:01:25.981 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:01:25.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.981+0000 7fa2d384d640 1 -- 172.21.15.78:0/270452086 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa2b807af30 msgr2=0x7fa2b807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:25.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.981+0000 7fa2d384d640 1 --2- 172.21.15.78:0/270452086 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa2b807af30 0x7fa2b807d3f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc005fd0 tx=0x7fa2bc005e20 comp rx=0 tx=0).stop 2024-09-18T13:01:25.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.981+0000 7fa2d384d640 1 -- 172.21.15.78:0/270452086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2cc100330 msgr2=0x7fa2cc19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:25.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.981+0000 7fa2d384d640 1 --2- 172.21.15.78:0/270452086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2cc100330 0x7fa2cc19d6a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8031460 tx=0x7fa2c80048f0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.981+0000 7fa2d384d640 1 -- 172.21.15.78:0/270452086 shutdown_connections 2024-09-18T13:01:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.981+0000 7fa2d384d640 1 --2- 172.21.15.78:0/270452086 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa2b807af30 0x7fa2b807d3f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.981+0000 7fa2d384d640 1 --2- 172.21.15.78:0/270452086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc100ce0 0x7fa2cc19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.981+0000 7fa2d384d640 1 --2- 172.21.15.78:0/270452086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2cc100330 0x7fa2cc19d6a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.981+0000 7fa2d384d640 1 -- 172.21.15.78:0/270452086 >> 172.21.15.78:0/270452086 conn(0x7fa2cc077270 msgr2=0x7fa2cc0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.981+0000 7fa2d384d640 1 -- 172.21.15.78:0/270452086 shutdown_connections 2024-09-18T13:01:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:25.981+0000 7fa2d384d640 1 -- 172.21.15.78:0/270452086 wait complete. 2024-09-18T13:01:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:26 smithi148 ceph-mon[80030]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:26 smithi148 ceph-mon[80030]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:26 smithi148 ceph-mon[80030]: pgmap v368: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:26 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2355155894' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:01:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:26.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:26 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/270452086' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:01:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:26 smithi078 ceph-mon[108578]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:26 smithi078 ceph-mon[108578]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:26 smithi078 ceph-mon[108578]: pgmap v368: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:26 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2355155894' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:01:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:26 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/270452086' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:01:27.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:27 smithi078 ceph-mon[108578]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:27.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:27 smithi148 ceph-mon[80030]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:28 smithi078 ceph-mon[108578]: pgmap v369: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:28 smithi148 ceph-mon[80030]: pgmap v369: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:30.715 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:30 smithi078 ceph-mon[108578]: pgmap v370: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:30.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:30 smithi148 ceph-mon[80030]: pgmap v370: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:32 smithi148 ceph-mon[80030]: pgmap v371: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:32 smithi078 ceph-mon[108578]: pgmap v371: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:34 smithi148 ceph-mon[80030]: pgmap v372: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:34 smithi078 ceph-mon[108578]: pgmap v372: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:36.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:36 smithi078 ceph-mon[108578]: pgmap v373: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:36.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:36 smithi148 ceph-mon[80030]: pgmap v373: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:38.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:38 smithi148 ceph-mon[80030]: pgmap v374: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:38.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:38 smithi078 ceph-mon[108578]: pgmap v374: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:40 smithi148 ceph-mon[80030]: pgmap v375: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:40.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:40 smithi078 ceph-mon[108578]: pgmap v375: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:41.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:42.708 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:42 smithi078 ceph-mon[108578]: pgmap v376: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:42.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:42 smithi148 ceph-mon[80030]: pgmap v376: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:44 smithi148 ceph-mon[80030]: pgmap v377: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:44.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:44 smithi078 ceph-mon[108578]: pgmap v377: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:46 smithi148 ceph-mon[80030]: pgmap v378: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:46 smithi078 ceph-mon[108578]: pgmap v378: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:48.708 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:48 smithi078 ceph-mon[108578]: pgmap v379: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:48.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:48 smithi148 ceph-mon[80030]: pgmap v379: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:50 smithi148 ceph-mon[80030]: pgmap v380: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:50.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:50 smithi078 ceph-mon[108578]: pgmap v380: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:52 smithi148 ceph-mon[80030]: pgmap v381: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:52.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:52 smithi078 ceph-mon[108578]: pgmap v381: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:54.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:54 smithi078 ceph-mon[108578]: pgmap v382: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:54.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:54 smithi148 ceph-mon[80030]: pgmap v382: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:56.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.073+0000 7f59dc611640 1 -- 172.21.15.78:0/3538655714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d4106800 msgr2=0x7f59d4106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:56.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.073+0000 7f59dc611640 1 --2- 172.21.15.78:0/3538655714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d4106800 0x7f59d4106be0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009880 tx=0x7f59cc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.073+0000 7f59dc611640 1 -- 172.21.15.78:0/3538655714 shutdown_connections 2024-09-18T13:01:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.073+0000 7f59dc611640 1 --2- 172.21.15.78:0/3538655714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d4100800 0x7f59d4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.073+0000 7f59dc611640 1 --2- 172.21.15.78:0/3538655714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d4106800 0x7f59d4106be0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.073+0000 7f59dc611640 1 -- 172.21.15.78:0/3538655714 >> 172.21.15.78:0/3538655714 conn(0x7f59d40fc520 msgr2=0x7f59d40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.073+0000 7f59dc611640 1 -- 172.21.15.78:0/3538655714 shutdown_connections 2024-09-18T13:01:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.073+0000 7f59dc611640 1 -- 172.21.15.78:0/3538655714 wait complete. 2024-09-18T13:01:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.074+0000 7f59dc611640 1 Processor -- start 2024-09-18T13:01:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.074+0000 7f59dc611640 1 -- start start 2024-09-18T13:01:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.074+0000 7f59dc611640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d4100800 0x7f59d419f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.074+0000 7f59dc611640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d4106800 0x7f59d419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:56.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.074+0000 7f59dc611640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f59d410dcb0 con 0x7f59d4100800 2024-09-18T13:01:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.074+0000 7f59dc611640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f59d410db30 con 0x7f59d4106800 2024-09-18T13:01:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.074+0000 7f59da3ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d4100800 0x7f59d419f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.074+0000 7f59da3ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d4100800 0x7f59d419f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35922/0 (socket says 172.21.15.78:35922) 2024-09-18T13:01:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.074+0000 7f59da3ad640 1 -- 172.21.15.78:0/1770772491 learned_addr learned my addr 172.21.15.78:0/1770772491 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:01:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.075+0000 7f59d9bac640 1 --2- 172.21.15.78:0/1770772491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d4106800 0x7f59d419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.075+0000 7f59da3ad640 1 -- 172.21.15.78:0/1770772491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d4106800 msgr2=0x7f59d419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.075+0000 7f59da3ad640 1 --2- 172.21.15.78:0/1770772491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d4106800 0x7f59d419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.075+0000 7f59da3ad640 1 -- 172.21.15.78:0/1770772491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d4199a20 con 0x7f59d4100800 2024-09-18T13:01:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.075+0000 7f59da3ad640 1 --2- 172.21.15.78:0/1770772491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d4100800 0x7f59d419f860 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f59cc031460 tx=0x7f59cc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.075+0000 7f59d37fe640 1 -- 172.21.15.78:0/1770772491 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59cc03f070 con 0x7f59d4100800 2024-09-18T13:01:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.075+0000 7f59d37fe640 1 -- 172.21.15.78:0/1770772491 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f59cc0035f0 con 0x7f59d4100800 2024-09-18T13:01:56.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.075+0000 7f59dc611640 1 -- 172.21.15.78:0/1770772491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d4199cb0 con 0x7f59d4100800 2024-09-18T13:01:56.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.075+0000 7f59d37fe640 1 -- 172.21.15.78:0/1770772491 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59cc035030 con 0x7f59d4100800 2024-09-18T13:01:56.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.075+0000 7f59dc611640 1 -- 172.21.15.78:0/1770772491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d419a1e0 con 0x7f59d4100800 2024-09-18T13:01:56.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.076+0000 7f59dc611640 1 -- 172.21.15.78:0/1770772491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d4101f40 con 0x7f59d4100800 2024-09-18T13:01:56.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.077+0000 7f59d37fe640 1 -- 172.21.15.78:0/1770772491 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f59cc042070 con 0x7f59d4100800 2024-09-18T13:01:56.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.077+0000 7f59d37fe640 1 --2- 172.21.15.78:0/1770772491 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f59bc07af80 0x7f59bc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:56.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.078+0000 7f59d37fe640 1 -- 172.21.15.78:0/1770772491 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f59cc0be960 con 0x7f59d4100800 2024-09-18T13:01:56.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.078+0000 7f59d9bac640 1 --2- 172.21.15.78:0/1770772491 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f59bc07af80 0x7f59bc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:56.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.078+0000 7f59d9bac640 1 --2- 172.21.15.78:0/1770772491 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f59bc07af80 0x7f59bc07d440 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f59d40ffb30 tx=0x7f59c800b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:56.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.082+0000 7f59d37fe640 1 -- 172.21.15.78:0/1770772491 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f59cc089ee0 con 0x7f59d4100800 2024-09-18T13:01:56.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.275+0000 7f59dc611640 1 -- 172.21.15.78:0/1770772491 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f59d419b050 con 0x7f59bc07af80 2024-09-18T13:01:56.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.276+0000 7f59d37fe640 1 -- 172.21.15.78:0/1770772491 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f59c8010bb0 con 0x7f59bc07af80 2024-09-18T13:01:56.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.278+0000 7f59dc611640 1 -- 172.21.15.78:0/1770772491 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f59bc07af80 msgr2=0x7f59bc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:56.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.278+0000 7f59dc611640 1 --2- 172.21.15.78:0/1770772491 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f59bc07af80 0x7f59bc07d440 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f59d40ffb30 tx=0x7f59c800b390 comp rx=0 tx=0).stop 2024-09-18T13:01:56.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.278+0000 7f59dc611640 1 -- 172.21.15.78:0/1770772491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d4100800 msgr2=0x7f59d419f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:56.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.278+0000 7f59dc611640 1 --2- 172.21.15.78:0/1770772491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d4100800 0x7f59d419f860 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f59cc031460 tx=0x7f59cc0045e0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.278+0000 7f59dc611640 1 -- 172.21.15.78:0/1770772491 shutdown_connections 2024-09-18T13:01:56.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.278+0000 7f59dc611640 1 --2- 172.21.15.78:0/1770772491 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f59bc07af80 0x7f59bc07d440 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.278+0000 7f59dc611640 1 --2- 172.21.15.78:0/1770772491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d4106800 0x7f59d419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.278+0000 7f59dc611640 1 --2- 172.21.15.78:0/1770772491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d4100800 0x7f59d419f860 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.278+0000 7f59dc611640 1 -- 172.21.15.78:0/1770772491 >> 172.21.15.78:0/1770772491 conn(0x7f59d40fc520 msgr2=0x7f59d406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:56.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.278+0000 7f59dc611640 1 -- 172.21.15.78:0/1770772491 shutdown_connections 2024-09-18T13:01:56.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.278+0000 7f59dc611640 1 -- 172.21.15.78:0/1770772491 wait complete. 2024-09-18T13:01:56.288 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:01:56.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.361+0000 7f580aeee640 1 -- 172.21.15.78:0/679137583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5804102b30 msgr2=0x7f5804102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:56.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.361+0000 7f580aeee640 1 --2- 172.21.15.78:0/679137583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5804102b30 0x7f5804102f10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009880 tx=0x7f57f802a530 comp rx=0 tx=0).stop 2024-09-18T13:01:56.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.361+0000 7f580aeee640 1 -- 172.21.15.78:0/679137583 shutdown_connections 2024-09-18T13:01:56.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.361+0000 7f580aeee640 1 --2- 172.21.15.78:0/679137583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5804103450 0x7f580410b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.361+0000 7f580aeee640 1 --2- 172.21.15.78:0/679137583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5804102b30 0x7f5804102f10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.361+0000 7f580aeee640 1 -- 172.21.15.78:0/679137583 >> 172.21.15.78:0/679137583 conn(0x7f58040fc550 msgr2=0x7f58040fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:56.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.361+0000 7f580aeee640 1 -- 172.21.15.78:0/679137583 shutdown_connections 2024-09-18T13:01:56.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.361+0000 7f580aeee640 1 -- 172.21.15.78:0/679137583 wait complete. 2024-09-18T13:01:56.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.361+0000 7f580aeee640 1 Processor -- start 2024-09-18T13:01:56.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.361+0000 7f580aeee640 1 -- start start 2024-09-18T13:01:56.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.362+0000 7f580aeee640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5804102b30 0x7f580419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:56.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.362+0000 7f580aeee640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5804103450 0x7f580419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.362+0000 7f580aeee640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f580410ede0 con 0x7f5804103450 2024-09-18T13:01:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.362+0000 7f580aeee640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f580410ec60 con 0x7f5804102b30 2024-09-18T13:01:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.362+0000 7f5803fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5804103450 0x7f580419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.362+0000 7f5803fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5804103450 0x7f580419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35952/0 (socket says 172.21.15.78:35952) 2024-09-18T13:01:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.362+0000 7f5803fff640 1 -- 172.21.15.78:0/1372234785 learned_addr learned my addr 172.21.15.78:0/1372234785 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:01:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.362+0000 7f5808c8a640 1 --2- 172.21.15.78:0/1372234785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5804102b30 0x7f580419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.362+0000 7f5803fff640 1 -- 172.21.15.78:0/1372234785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5804102b30 msgr2=0x7f580419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.362+0000 7f5803fff640 1 --2- 172.21.15.78:0/1372234785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5804102b30 0x7f580419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.362+0000 7f5803fff640 1 -- 172.21.15.78:0/1372234785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58041977d0 con 0x7f5804103450 2024-09-18T13:01:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.362+0000 7f5803fff640 1 --2- 172.21.15.78:0/1372234785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5804103450 0x7f580419db90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f57f000d6f0 tx=0x7f57f000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.362+0000 7f5801ffb640 1 -- 172.21.15.78:0/1372234785 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57f0017070 con 0x7f5804103450 2024-09-18T13:01:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.362+0000 7f580aeee640 1 -- 172.21.15.78:0/1372234785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5804197ac0 con 0x7f5804103450 2024-09-18T13:01:56.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.362+0000 7f5801ffb640 1 -- 172.21.15.78:0/1372234785 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f57f000de00 con 0x7f5804103450 2024-09-18T13:01:56.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.363+0000 7f5801ffb640 1 -- 172.21.15.78:0/1372234785 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57f0004bb0 con 0x7f5804103450 2024-09-18T13:01:56.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.363+0000 7f580aeee640 1 -- 172.21.15.78:0/1372234785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5804198050 con 0x7f5804103450 2024-09-18T13:01:56.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.364+0000 7f580aeee640 1 -- 172.21.15.78:0/1372234785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f580406a500 con 0x7f5804103450 2024-09-18T13:01:56.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.364+0000 7f5801ffb640 1 -- 172.21.15.78:0/1372234785 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f57f0004e60 con 0x7f5804103450 2024-09-18T13:01:56.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.364+0000 7f5801ffb640 1 --2- 172.21.15.78:0/1372234785 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f57f407af30 0x7f57f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:56.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.365+0000 7f5801ffb640 1 -- 172.21.15.78:0/1372234785 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f57f009dcb0 con 0x7f5804103450 2024-09-18T13:01:56.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.365+0000 7f5808c8a640 1 --2- 172.21.15.78:0/1372234785 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f57f407af30 0x7f57f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:56.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.365+0000 7f5808c8a640 1 --2- 172.21.15.78:0/1372234785 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f57f407af30 0x7f57f407d3f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f57f80096c0 tx=0x7f57f8004f30 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:56.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.369+0000 7f5801ffb640 1 -- 172.21.15.78:0/1372234785 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f57f0069250 con 0x7f5804103450 2024-09-18T13:01:56.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.559+0000 7f580aeee640 1 -- 172.21.15.78:0/1372234785 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5804198300 con 0x7f57f407af30 2024-09-18T13:01:56.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.561+0000 7f5801ffb640 1 -- 172.21.15.78:0/1372234785 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5804198300 con 0x7f57f407af30 2024-09-18T13:01:56.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.563+0000 7f580aeee640 1 -- 172.21.15.78:0/1372234785 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f57f407af30 msgr2=0x7f57f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:56.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.563+0000 7f580aeee640 1 --2- 172.21.15.78:0/1372234785 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f57f407af30 0x7f57f407d3f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f57f80096c0 tx=0x7f57f8004f30 comp rx=0 tx=0).stop 2024-09-18T13:01:56.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.563+0000 7f580aeee640 1 -- 172.21.15.78:0/1372234785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5804103450 msgr2=0x7f580419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:56.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.563+0000 7f580aeee640 1 --2- 172.21.15.78:0/1372234785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5804103450 0x7f580419db90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f57f000d6f0 tx=0x7f57f000dbb0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.563+0000 7f580aeee640 1 -- 172.21.15.78:0/1372234785 shutdown_connections 2024-09-18T13:01:56.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.563+0000 7f580aeee640 1 --2- 172.21.15.78:0/1372234785 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f57f407af30 0x7f57f407d3f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.563+0000 7f580aeee640 1 --2- 172.21.15.78:0/1372234785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5804103450 0x7f580419db90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.563+0000 7f580aeee640 1 --2- 172.21.15.78:0/1372234785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5804102b30 0x7f580419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.563+0000 7f580aeee640 1 -- 172.21.15.78:0/1372234785 >> 172.21.15.78:0/1372234785 conn(0x7f58040fc550 msgr2=0x7f5804108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:56.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.563+0000 7f580aeee640 1 -- 172.21.15.78:0/1372234785 shutdown_connections 2024-09-18T13:01:56.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.563+0000 7f580aeee640 1 -- 172.21.15.78:0/1372234785 wait complete. 2024-09-18T13:01:56.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.644+0000 7f7a6da44640 1 -- 172.21.15.78:0/2339887388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a68103450 msgr2=0x7f7a6810b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:56.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.644+0000 7f7a6da44640 1 --2- 172.21.15.78:0/2339887388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a68103450 0x7f7a6810b940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009880 tx=0x7f7a5002a530 comp rx=0 tx=0).stop 2024-09-18T13:01:56.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.644+0000 7f7a6da44640 1 -- 172.21.15.78:0/2339887388 shutdown_connections 2024-09-18T13:01:56.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.644+0000 7f7a6da44640 1 --2- 172.21.15.78:0/2339887388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a68103450 0x7f7a6810b940 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.644+0000 7f7a6da44640 1 --2- 172.21.15.78:0/2339887388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a68102b30 0x7f7a68102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.645 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:56 smithi078 ceph-mon[108578]: pgmap v383: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:56.646 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:56.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.644+0000 7f7a6da44640 1 -- 172.21.15.78:0/2339887388 >> 172.21.15.78:0/2339887388 conn(0x7f7a680fc550 msgr2=0x7f7a680fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:56.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.644+0000 7f7a6da44640 1 -- 172.21.15.78:0/2339887388 shutdown_connections 2024-09-18T13:01:56.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.644+0000 7f7a6da44640 1 -- 172.21.15.78:0/2339887388 wait complete. 2024-09-18T13:01:56.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.645+0000 7f7a6da44640 1 Processor -- start 2024-09-18T13:01:56.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.645+0000 7f7a6da44640 1 -- start start 2024-09-18T13:01:56.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.645+0000 7f7a6da44640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a68102b30 0x7f7a68100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:56.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.645+0000 7f7a6da44640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a68103450 0x7f7a68100cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:56.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.645+0000 7f7a6da44640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6810ede0 con 0x7f7a68103450 2024-09-18T13:01:56.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.645+0000 7f7a6da44640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6810ec60 con 0x7f7a68102b30 2024-09-18T13:01:56.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.645+0000 7f7a667fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a68103450 0x7f7a68100cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:56.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.645+0000 7f7a667fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a68103450 0x7f7a68100cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35966/0 (socket says 172.21.15.78:35966) 2024-09-18T13:01:56.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.645+0000 7f7a667fc640 1 -- 172.21.15.78:0/330243268 learned_addr learned my addr 172.21.15.78:0/330243268 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:01:56.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.645+0000 7f7a66ffd640 1 --2- 172.21.15.78:0/330243268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a68102b30 0x7f7a68100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:56.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.645+0000 7f7a667fc640 1 -- 172.21.15.78:0/330243268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a68102b30 msgr2=0x7f7a68100790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:56.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.645+0000 7f7a667fc640 1 --2- 172.21.15.78:0/330243268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a68102b30 0x7f7a68100790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.645+0000 7f7a667fc640 1 -- 172.21.15.78:0/330243268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a68101210 con 0x7f7a68103450 2024-09-18T13:01:56.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.645+0000 7f7a66ffd640 1 --2- 172.21.15.78:0/330243268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a68102b30 0x7f7a68100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:01:56.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.646+0000 7f7a667fc640 1 --2- 172.21.15.78:0/330243268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a68103450 0x7f7a68100cd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7a50004f90 tx=0x7f7a500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:56.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.646+0000 7f7a6ca42640 1 -- 172.21.15.78:0/330243268 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a5003f070 con 0x7f7a68103450 2024-09-18T13:01:56.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.646+0000 7f7a6ca42640 1 -- 172.21.15.78:0/330243268 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7a50004c70 con 0x7f7a68103450 2024-09-18T13:01:56.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.646+0000 7f7a6da44640 1 -- 172.21.15.78:0/330243268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a681014a0 con 0x7f7a68103450 2024-09-18T13:01:56.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.646+0000 7f7a6ca42640 1 -- 172.21.15.78:0/330243268 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a50035030 con 0x7f7a68103450 2024-09-18T13:01:56.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.646+0000 7f7a6da44640 1 -- 172.21.15.78:0/330243268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a681a3d70 con 0x7f7a68103450 2024-09-18T13:01:56.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.647+0000 7f7a6da44640 1 -- 172.21.15.78:0/330243268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a6806a500 con 0x7f7a68103450 2024-09-18T13:01:56.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.648+0000 7f7a6ca42640 1 -- 172.21.15.78:0/330243268 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7a50042070 con 0x7f7a68103450 2024-09-18T13:01:56.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.648+0000 7f7a6ca42640 1 --2- 172.21.15.78:0/330243268 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7a5407af30 0x7f7a5407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:56.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.649+0000 7f7a6ca42640 1 -- 172.21.15.78:0/330243268 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f7a500bea90 con 0x7f7a68103450 2024-09-18T13:01:56.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.649+0000 7f7a66ffd640 1 --2- 172.21.15.78:0/330243268 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7a5407af30 0x7f7a5407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:56.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.649+0000 7f7a66ffd640 1 --2- 172.21.15.78:0/330243268 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7a5407af30 0x7f7a5407d3f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7a58005fd0 tx=0x7f7a58009520 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:56.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.653+0000 7f7a6ca42640 1 -- 172.21.15.78:0/330243268 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7a5008a030 con 0x7f7a68103450 2024-09-18T13:01:56.677 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:56 smithi148 ceph-mon[80030]: pgmap v383: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:56.677 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:56.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.836+0000 7f7a6da44640 1 -- 172.21.15.78:0/330243268 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7a68062630 con 0x7f7a5407af30 2024-09-18T13:01:56.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.846+0000 7f7a6ca42640 1 -- 172.21.15.78:0/330243268 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f7a68062630 con 0x7f7a5407af30 2024-09-18T13:01:56.847 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:01:56.847 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (9m) 3m ago 20m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:01:56.847 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (12m) 3m ago 20m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:01:56.847 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (12m) 3m ago 20m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:01:56.847 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (8m) 3m ago 20m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:01:56.847 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (7m) 3m ago 20m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:01:56.847 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (9m) 3m ago 20m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:01:56.847 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (4m) 3m ago 15m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:01:56.847 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (4m) 3m ago 15m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:01:56.848 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (3m) 3m ago 15m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:01:56.848 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (3m) 3m ago 15m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:01:56.848 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (12m) 3m ago 21m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:01:56.848 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (10m) 3m ago 19m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:01:56.848 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (8m) 3m ago 22m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:01:56.848 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (8m) 3m ago 19m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:01:56.848 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (10m) 3m ago 20m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:01:56.848 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (10m) 3m ago 19m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:01:56.848 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (7m) 3m ago 18m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:01:56.848 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (6m) 3m ago 18m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:01:56.848 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (6m) 3m ago 17m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:01:56.848 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (5m) 3m ago 17m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:01:56.849 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (5m) 3m ago 16m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:01:56.849 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (4m) 3m ago 16m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:01:56.849 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (10m) 3m ago 20m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:01:56.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.848+0000 7f7a6da44640 1 -- 172.21.15.78:0/330243268 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7a5407af30 msgr2=0x7f7a5407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.848+0000 7f7a6da44640 1 --2- 172.21.15.78:0/330243268 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7a5407af30 0x7f7a5407d3f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7a58005fd0 tx=0x7f7a58009520 comp rx=0 tx=0).stop 2024-09-18T13:01:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.848+0000 7f7a6da44640 1 -- 172.21.15.78:0/330243268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a68103450 msgr2=0x7f7a68100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.848+0000 7f7a6da44640 1 --2- 172.21.15.78:0/330243268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a68103450 0x7f7a68100cd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7a50004f90 tx=0x7f7a500048f0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.848+0000 7f7a6da44640 1 -- 172.21.15.78:0/330243268 shutdown_connections 2024-09-18T13:01:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.848+0000 7f7a6da44640 1 --2- 172.21.15.78:0/330243268 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7a5407af30 0x7f7a5407d3f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.848+0000 7f7a6da44640 1 --2- 172.21.15.78:0/330243268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a68103450 0x7f7a68100cd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.848+0000 7f7a6da44640 1 --2- 172.21.15.78:0/330243268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a68102b30 0x7f7a68100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.848+0000 7f7a6da44640 1 -- 172.21.15.78:0/330243268 >> 172.21.15.78:0/330243268 conn(0x7f7a680fc550 msgr2=0x7f7a68103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.848+0000 7f7a6da44640 1 -- 172.21.15.78:0/330243268 shutdown_connections 2024-09-18T13:01:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.848+0000 7f7a6da44640 1 -- 172.21.15.78:0/330243268 wait complete. 2024-09-18T13:01:56.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.930+0000 7faddca53640 1 -- 172.21.15.78:0/2825132559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81067f0 msgr2=0x7fadd8106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.930+0000 7faddca53640 1 --2- 172.21.15.78:0/2825132559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81067f0 0x7fadd8106bd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009c20 tx=0x7fadd002a970 comp rx=0 tx=0).stop 2024-09-18T13:01:57.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.930+0000 7faddca53640 1 -- 172.21.15.78:0/2825132559 shutdown_connections 2024-09-18T13:01:57.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.930+0000 7faddca53640 1 --2- 172.21.15.78:0/2825132559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd81007f0 0x7fadd8100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.930+0000 7faddca53640 1 --2- 172.21.15.78:0/2825132559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81067f0 0x7fadd8106bd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.930+0000 7faddca53640 1 -- 172.21.15.78:0/2825132559 >> 172.21.15.78:0/2825132559 conn(0x7fadd80fc550 msgr2=0x7fadd80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:57.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.930+0000 7faddca53640 1 -- 172.21.15.78:0/2825132559 shutdown_connections 2024-09-18T13:01:57.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.930+0000 7faddca53640 1 -- 172.21.15.78:0/2825132559 wait complete. 2024-09-18T13:01:57.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.931+0000 7faddca53640 1 Processor -- start 2024-09-18T13:01:57.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.931+0000 7faddca53640 1 -- start start 2024-09-18T13:01:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.931+0000 7faddca53640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd81007f0 0x7fadd81988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.931+0000 7faddca53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81067f0 0x7fadd8198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.931+0000 7faddca53640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fadd810dca0 con 0x7fadd81067f0 2024-09-18T13:01:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.931+0000 7faddca53640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fadd810db20 con 0x7fadd81007f0 2024-09-18T13:01:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.931+0000 7fadd5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81067f0 0x7fadd8198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.931+0000 7fadd5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81067f0 0x7fadd8198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35990/0 (socket says 172.21.15.78:35990) 2024-09-18T13:01:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.931+0000 7fadd5d9b640 1 -- 172.21.15.78:0/3096738295 learned_addr learned my addr 172.21.15.78:0/3096738295 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:01:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.931+0000 7fadd659c640 1 --2- 172.21.15.78:0/3096738295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd81007f0 0x7fadd81988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.931+0000 7fadd5d9b640 1 -- 172.21.15.78:0/3096738295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd81007f0 msgr2=0x7fadd81988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.931+0000 7fadd5d9b640 1 --2- 172.21.15.78:0/3096738295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd81007f0 0x7fadd81988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.931+0000 7fadd5d9b640 1 -- 172.21.15.78:0/3096738295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd8199410 con 0x7fadd81067f0 2024-09-18T13:01:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.931+0000 7fadd5d9b640 1 --2- 172.21.15.78:0/3096738295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81067f0 0x7fadd8198e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c810 tx=0x7fadc000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.932+0000 7fadcf7fe640 1 -- 172.21.15.78:0/3096738295 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fadc0004020 con 0x7fadd81067f0 2024-09-18T13:01:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.932+0000 7faddca53640 1 -- 172.21.15.78:0/3096738295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd8199700 con 0x7fadd81067f0 2024-09-18T13:01:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.932+0000 7fadcf7fe640 1 -- 172.21.15.78:0/3096738295 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fadc00041c0 con 0x7fadd81067f0 2024-09-18T13:01:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.932+0000 7fadcf7fe640 1 -- 172.21.15.78:0/3096738295 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fadc00047a0 con 0x7fadd81067f0 2024-09-18T13:01:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.932+0000 7faddca53640 1 -- 172.21.15.78:0/3096738295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd81a1d00 con 0x7fadd81067f0 2024-09-18T13:01:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.933+0000 7faddca53640 1 -- 172.21.15.78:0/3096738295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd8101f30 con 0x7fadd81067f0 2024-09-18T13:01:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.934+0000 7fadcf7fe640 1 -- 172.21.15.78:0/3096738295 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fadc00079b0 con 0x7fadd81067f0 2024-09-18T13:01:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.934+0000 7fadcf7fe640 1 --2- 172.21.15.78:0/3096738295 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fadc407af30 0x7fadc407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.934+0000 7fadcf7fe640 1 -- 172.21.15.78:0/3096738295 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fadc009db60 con 0x7fadd81067f0 2024-09-18T13:01:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.935+0000 7fadd659c640 1 --2- 172.21.15.78:0/3096738295 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fadc407af30 0x7fadc407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.935+0000 7fadd659c640 1 --2- 172.21.15.78:0/3096738295 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fadc407af30 0x7fadc407d3f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009430 tx=0x7fadd003c040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:57.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:56.939+0000 7fadcf7fe640 1 -- 172.21.15.78:0/3096738295 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fadd8199700 con 0x7fadd81067f0 2024-09-18T13:01:57.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.183+0000 7faddca53640 1 -- 172.21.15.78:0/3096738295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fadd806a290 con 0x7fadd81067f0 2024-09-18T13:01:57.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.184+0000 7fadcf7fe640 1 -- 172.21.15.78:0/3096738295 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fadc0014030 con 0x7fadd81067f0 2024-09-18T13:01:57.185 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:01:57.185 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:01:57.185 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:01:57.185 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:01:57.185 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:01:57.185 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:01:57.185 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:01:57.185 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:01:57.185 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:01:57.185 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:01:57.185 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:01:57.186 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:01:57.186 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:01:57.186 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:01:57.186 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:01:57.186 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:01:57.186 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:01:57.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.186+0000 7faddca53640 1 -- 172.21.15.78:0/3096738295 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fadc407af30 msgr2=0x7fadc407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.186+0000 7faddca53640 1 --2- 172.21.15.78:0/3096738295 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fadc407af30 0x7fadc407d3f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009430 tx=0x7fadd003c040 comp rx=0 tx=0).stop 2024-09-18T13:01:57.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.186+0000 7faddca53640 1 -- 172.21.15.78:0/3096738295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81067f0 msgr2=0x7fadd8198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.186+0000 7faddca53640 1 --2- 172.21.15.78:0/3096738295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81067f0 0x7fadd8198e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c810 tx=0x7fadc000ccd0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.186+0000 7faddca53640 1 -- 172.21.15.78:0/3096738295 shutdown_connections 2024-09-18T13:01:57.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.186+0000 7faddca53640 1 --2- 172.21.15.78:0/3096738295 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fadc407af30 0x7fadc407d3f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.186+0000 7faddca53640 1 --2- 172.21.15.78:0/3096738295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81067f0 0x7fadd8198e10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.186+0000 7faddca53640 1 --2- 172.21.15.78:0/3096738295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd81007f0 0x7fadd81988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.186+0000 7faddca53640 1 -- 172.21.15.78:0/3096738295 >> 172.21.15.78:0/3096738295 conn(0x7fadd80fc550 msgr2=0x7fadd80fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:57.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.186+0000 7faddca53640 1 -- 172.21.15.78:0/3096738295 shutdown_connections 2024-09-18T13:01:57.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.186+0000 7faddca53640 1 -- 172.21.15.78:0/3096738295 wait complete. 2024-09-18T13:01:57.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.268+0000 7fcf9f809640 1 -- 172.21.15.78:0/1609082479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf980ffdc0 msgr2=0x7fcf98100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.268+0000 7fcf9f809640 1 --2- 172.21.15.78:0/1609082479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf980ffdc0 0x7fcf98100220 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009880 tx=0x7fcf9402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.268+0000 7fcf9f809640 1 -- 172.21.15.78:0/1609082479 shutdown_connections 2024-09-18T13:01:57.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.268+0000 7fcf9f809640 1 --2- 172.21.15.78:0/1609082479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf980ffdc0 0x7fcf98100220 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.268+0000 7fcf9f809640 1 --2- 172.21.15.78:0/1609082479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf981069a0 0x7fcf98106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.268+0000 7fcf9f809640 1 -- 172.21.15.78:0/1609082479 >> 172.21.15.78:0/1609082479 conn(0x7fcf980fbc90 msgr2=0x7fcf980fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:57.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.268+0000 7fcf9f809640 1 -- 172.21.15.78:0/1609082479 shutdown_connections 2024-09-18T13:01:57.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.268+0000 7fcf9f809640 1 -- 172.21.15.78:0/1609082479 wait complete. 2024-09-18T13:01:57.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.269+0000 7fcf9f809640 1 Processor -- start 2024-09-18T13:01:57.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.269+0000 7fcf9f809640 1 -- start start 2024-09-18T13:01:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.269+0000 7fcf9f809640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf980ffdc0 0x7fcf9819d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.269+0000 7fcf9f809640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf981069a0 0x7fcf9819dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.269+0000 7fcf9f809640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9810efa0 con 0x7fcf980ffdc0 2024-09-18T13:01:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.269+0000 7fcf9f809640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9810ee20 con 0x7fcf981069a0 2024-09-18T13:01:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.269+0000 7fcf9d5a5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf980ffdc0 0x7fcf9819d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.269+0000 7fcf9d5a5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf980ffdc0 0x7fcf9819d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36006/0 (socket says 172.21.15.78:36006) 2024-09-18T13:01:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.269+0000 7fcf9d5a5640 1 -- 172.21.15.78:0/3112876031 learned_addr learned my addr 172.21.15.78:0/3112876031 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:01:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.269+0000 7fcf9cda4640 1 --2- 172.21.15.78:0/3112876031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf981069a0 0x7fcf9819dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.269+0000 7fcf9d5a5640 1 -- 172.21.15.78:0/3112876031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf981069a0 msgr2=0x7fcf9819dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.269+0000 7fcf9d5a5640 1 --2- 172.21.15.78:0/3112876031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf981069a0 0x7fcf9819dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.269+0000 7fcf9d5a5640 1 -- 172.21.15.78:0/3112876031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf98197930 con 0x7fcf980ffdc0 2024-09-18T13:01:57.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.269+0000 7fcf9d5a5640 1 --2- 172.21.15.78:0/3112876031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf980ffdc0 0x7fcf9819d770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800b420 tx=0x7fcf8800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:57.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.270+0000 7fcf8e7fc640 1 -- 172.21.15.78:0/3112876031 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf88011630 con 0x7fcf980ffdc0 2024-09-18T13:01:57.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.270+0000 7fcf9f809640 1 -- 172.21.15.78:0/3112876031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf98197c20 con 0x7fcf980ffdc0 2024-09-18T13:01:57.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.270+0000 7fcf8e7fc640 1 -- 172.21.15.78:0/3112876031 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcf88016070 con 0x7fcf980ffdc0 2024-09-18T13:01:57.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.270+0000 7fcf8e7fc640 1 -- 172.21.15.78:0/3112876031 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf88010d40 con 0x7fcf980ffdc0 2024-09-18T13:01:57.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.270+0000 7fcf9f809640 1 -- 172.21.15.78:0/3112876031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf98198180 con 0x7fcf980ffdc0 2024-09-18T13:01:57.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.271+0000 7fcf9f809640 1 -- 172.21.15.78:0/3112876031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf981030e0 con 0x7fcf980ffdc0 2024-09-18T13:01:57.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.271+0000 7fcf8e7fc640 1 -- 172.21.15.78:0/3112876031 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fcf8801b460 con 0x7fcf980ffdc0 2024-09-18T13:01:57.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.272+0000 7fcf8e7fc640 1 --2- 172.21.15.78:0/3112876031 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcf8407af30 0x7fcf8407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:57.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.272+0000 7fcf9cda4640 1 --2- 172.21.15.78:0/3112876031 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcf8407af30 0x7fcf8407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:57.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.272+0000 7fcf8e7fc640 1 -- 172.21.15.78:0/3112876031 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fcf8809d810 con 0x7fcf980ffdc0 2024-09-18T13:01:57.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.273+0000 7fcf9cda4640 1 --2- 172.21.15.78:0/3112876031 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcf8407af30 0x7fcf8407d3f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcf98199120 tx=0x7fcf94031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:57.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.277+0000 7fcf8e7fc640 1 -- 172.21.15.78:0/3112876031 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fcf88021250 con 0x7fcf980ffdc0 2024-09-18T13:01:57.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.487+0000 7fcf9f809640 1 -- 172.21.15.78:0/3112876031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fcf98198e60 con 0x7fcf980ffdc0 2024-09-18T13:01:57.488 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:57 smithi078 ceph-mon[108578]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:57.488 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:57 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3096738295' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:57.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.487+0000 7fcf8e7fc640 1 -- 172.21.15.78:0/3112876031 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7fcf88068db0 con 0x7fcf980ffdc0 2024-09-18T13:01:57.489 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:01:57.489 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:01:57.489 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:01:57.489 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:01:57.489 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:01:57.489 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:01:57.490 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:01:57.490 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:01:57.490 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:01:57.490 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:01:57.490 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:01:57.490 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:01:57.490 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:01:57.490 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:01:57.490 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:01:57.490 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:01:57.490 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:01:57.491 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:01:57.491 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:01:57.491 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:01:57.491 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:01:57.491 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:01:57.491 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:01:57.491 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:01:57.491 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:01:57.491 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:01:57.491 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:01:57.491 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:01:57.491 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:01:57.491 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:01:57.492 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:01:57.492 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:01:57.492 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:01:57.492 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:01:57.492 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:01:57.492 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:01:57.492 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:01:57.492 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:01:57.492 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:01:57.492 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:57.492 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:57.492 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:57.492 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:57.493 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:01:57.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.489+0000 7fcf9f809640 1 -- 172.21.15.78:0/3112876031 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcf8407af30 msgr2=0x7fcf8407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.489+0000 7fcf9f809640 1 --2- 172.21.15.78:0/3112876031 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcf8407af30 0x7fcf8407d3f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcf98199120 tx=0x7fcf94031400 comp rx=0 tx=0).stop 2024-09-18T13:01:57.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.489+0000 7fcf9f809640 1 -- 172.21.15.78:0/3112876031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf980ffdc0 msgr2=0x7fcf9819d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.489+0000 7fcf9f809640 1 --2- 172.21.15.78:0/3112876031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf980ffdc0 0x7fcf9819d770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800b420 tx=0x7fcf8800b8e0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.489+0000 7fcf9f809640 1 -- 172.21.15.78:0/3112876031 shutdown_connections 2024-09-18T13:01:57.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.489+0000 7fcf9f809640 1 --2- 172.21.15.78:0/3112876031 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcf8407af30 0x7fcf8407d3f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.489+0000 7fcf9f809640 1 --2- 172.21.15.78:0/3112876031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf981069a0 0x7fcf9819dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.489+0000 7fcf9f809640 1 --2- 172.21.15.78:0/3112876031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf980ffdc0 0x7fcf9819d770 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.489+0000 7fcf9f809640 1 -- 172.21.15.78:0/3112876031 >> 172.21.15.78:0/3112876031 conn(0x7fcf980fbc90 msgr2=0x7fcf980fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:57.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.490+0000 7fcf9f809640 1 -- 172.21.15.78:0/3112876031 shutdown_connections 2024-09-18T13:01:57.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.490+0000 7fcf9f809640 1 -- 172.21.15.78:0/3112876031 wait complete. 2024-09-18T13:01:57.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.571+0000 7fcd7a20c640 1 -- 172.21.15.78:0/4113764709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd74106800 msgr2=0x7fcd74106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.571+0000 7fcd7a20c640 1 --2- 172.21.15.78:0/4113764709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd74106800 0x7fcd74106be0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcd64009880 tx=0x7fcd6402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.571+0000 7fcd7a20c640 1 -- 172.21.15.78:0/4113764709 shutdown_connections 2024-09-18T13:01:57.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.571+0000 7fcd7a20c640 1 --2- 172.21.15.78:0/4113764709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd74100800 0x7fcd74100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.571+0000 7fcd7a20c640 1 --2- 172.21.15.78:0/4113764709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd74106800 0x7fcd74106be0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.571+0000 7fcd7a20c640 1 -- 172.21.15.78:0/4113764709 >> 172.21.15.78:0/4113764709 conn(0x7fcd740fc520 msgr2=0x7fcd740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:57.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.571+0000 7fcd7a20c640 1 -- 172.21.15.78:0/4113764709 shutdown_connections 2024-09-18T13:01:57.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.571+0000 7fcd7a20c640 1 -- 172.21.15.78:0/4113764709 wait complete. 2024-09-18T13:01:57.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.572+0000 7fcd7a20c640 1 Processor -- start 2024-09-18T13:01:57.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.572+0000 7fcd7a20c640 1 -- start start 2024-09-18T13:01:57.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.572+0000 7fcd7a20c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd74100800 0x7fcd7419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:57.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.572+0000 7fcd7a20c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd74106800 0x7fcd7419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:57.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.572+0000 7fcd7a20c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7410dcb0 con 0x7fcd74106800 2024-09-18T13:01:57.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.572+0000 7fcd7a20c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7410db30 con 0x7fcd74100800 2024-09-18T13:01:57.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.573+0000 7fcd72ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd74106800 0x7fcd7419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:57.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.573+0000 7fcd72ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd74106800 0x7fcd7419db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36028/0 (socket says 172.21.15.78:36028) 2024-09-18T13:01:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.573+0000 7fcd72ffd640 1 -- 172.21.15.78:0/2339178458 learned_addr learned my addr 172.21.15.78:0/2339178458 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:01:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.573+0000 7fcd737fe640 1 --2- 172.21.15.78:0/2339178458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd74100800 0x7fcd7419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.573+0000 7fcd72ffd640 1 -- 172.21.15.78:0/2339178458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd74100800 msgr2=0x7fcd7419d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.573+0000 7fcd72ffd640 1 --2- 172.21.15.78:0/2339178458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd74100800 0x7fcd7419d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.573+0000 7fcd72ffd640 1 -- 172.21.15.78:0/2339178458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd74197790 con 0x7fcd74106800 2024-09-18T13:01:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.573+0000 7fcd72ffd640 1 --2- 172.21.15.78:0/2339178458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd74106800 0x7fcd7419db50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcd6800d8d0 tx=0x7fcd6800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.573+0000 7fcd70ff9640 1 -- 172.21.15.78:0/2339178458 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd68017030 con 0x7fcd74106800 2024-09-18T13:01:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.573+0000 7fcd7a20c640 1 -- 172.21.15.78:0/2339178458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd74197a80 con 0x7fcd74106800 2024-09-18T13:01:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.573+0000 7fcd70ff9640 1 -- 172.21.15.78:0/2339178458 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd68004020 con 0x7fcd74106800 2024-09-18T13:01:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.573+0000 7fcd70ff9640 1 -- 172.21.15.78:0/2339178458 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd680047a0 con 0x7fcd74106800 2024-09-18T13:01:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.573+0000 7fcd7a20c640 1 -- 172.21.15.78:0/2339178458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd74198010 con 0x7fcd74106800 2024-09-18T13:01:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.574+0000 7fcd7a20c640 1 -- 172.21.15.78:0/2339178458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd74101f40 con 0x7fcd74106800 2024-09-18T13:01:57.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.575+0000 7fcd70ff9640 1 -- 172.21.15.78:0/2339178458 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fcd680041d0 con 0x7fcd74106800 2024-09-18T13:01:57.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.575+0000 7fcd70ff9640 1 --2- 172.21.15.78:0/2339178458 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd5c07af30 0x7fcd5c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:57.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.576+0000 7fcd70ff9640 1 -- 172.21.15.78:0/2339178458 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fcd68018070 con 0x7fcd74106800 2024-09-18T13:01:57.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.576+0000 7fcd737fe640 1 --2- 172.21.15.78:0/2339178458 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd5c07af30 0x7fcd5c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:57.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.576+0000 7fcd737fe640 1 --2- 172.21.15.78:0/2339178458 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd5c07af30 0x7fcd5c07d3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcd640096c0 tx=0x7fcd64031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:57.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.580+0000 7fcd70ff9640 1 -- 172.21.15.78:0/2339178458 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fcd680a4080 con 0x7fcd74106800 2024-09-18T13:01:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:57 smithi148 ceph-mon[80030]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:57 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3096738295' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:57.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.773+0000 7fcd7a20c640 1 -- 172.21.15.78:0/2339178458 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcd74198380 con 0x7fcd5c07af30 2024-09-18T13:01:57.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.774+0000 7fcd70ff9640 1 -- 172.21.15.78:0/2339178458 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fcd74198380 con 0x7fcd5c07af30 2024-09-18T13:01:57.775 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:01:57.775 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:01:57.775 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:01:57.775 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:01:57.775 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:01:57.775 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:01:57.776 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:01:57.776 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:01:57.776 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:01:57.776 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:01:57.776 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:01:57.776 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:01:57.776 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:01:57.776 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:01:57.776 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:01:57.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.776+0000 7fcd7a20c640 1 -- 172.21.15.78:0/2339178458 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd5c07af30 msgr2=0x7fcd5c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.776+0000 7fcd7a20c640 1 --2- 172.21.15.78:0/2339178458 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd5c07af30 0x7fcd5c07d3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcd640096c0 tx=0x7fcd64031400 comp rx=0 tx=0).stop 2024-09-18T13:01:57.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.776+0000 7fcd7a20c640 1 -- 172.21.15.78:0/2339178458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd74106800 msgr2=0x7fcd7419db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.776+0000 7fcd7a20c640 1 --2- 172.21.15.78:0/2339178458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd74106800 0x7fcd7419db50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcd6800d8d0 tx=0x7fcd6800dd90 comp rx=0 tx=0).stop 2024-09-18T13:01:57.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.776+0000 7fcd7a20c640 1 -- 172.21.15.78:0/2339178458 shutdown_connections 2024-09-18T13:01:57.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.776+0000 7fcd7a20c640 1 --2- 172.21.15.78:0/2339178458 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcd5c07af30 0x7fcd5c07d3f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.776+0000 7fcd7a20c640 1 --2- 172.21.15.78:0/2339178458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd74106800 0x7fcd7419db50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.776+0000 7fcd7a20c640 1 --2- 172.21.15.78:0/2339178458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd74100800 0x7fcd7419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.776+0000 7fcd7a20c640 1 -- 172.21.15.78:0/2339178458 >> 172.21.15.78:0/2339178458 conn(0x7fcd740fc520 msgr2=0x7fcd7406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:57.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.776+0000 7fcd7a20c640 1 -- 172.21.15.78:0/2339178458 shutdown_connections 2024-09-18T13:01:57.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.776+0000 7fcd7a20c640 1 -- 172.21.15.78:0/2339178458 wait complete. 2024-09-18T13:01:57.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.857+0000 7fcb4baef640 1 -- 172.21.15.78:0/1486741080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb441011d0 msgr2=0x7fcb441056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.857+0000 7fcb4baef640 1 --2- 172.21.15.78:0/1486741080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb441011d0 0x7fcb441056a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009880 tx=0x7fcb3402a530 comp rx=0 tx=0).stop 2024-09-18T13:01:57.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.857+0000 7fcb4baef640 1 -- 172.21.15.78:0/1486741080 shutdown_connections 2024-09-18T13:01:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.857+0000 7fcb4baef640 1 --2- 172.21.15.78:0/1486741080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb441011d0 0x7fcb441056a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.857+0000 7fcb4baef640 1 --2- 172.21.15.78:0/1486741080 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb441008b0 0x7fcb44100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.857+0000 7fcb4baef640 1 -- 172.21.15.78:0/1486741080 >> 172.21.15.78:0/1486741080 conn(0x7fcb440fc520 msgr2=0x7fcb440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.857+0000 7fcb4baef640 1 -- 172.21.15.78:0/1486741080 shutdown_connections 2024-09-18T13:01:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.857+0000 7fcb4baef640 1 -- 172.21.15.78:0/1486741080 wait complete. 2024-09-18T13:01:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.858+0000 7fcb4baef640 1 Processor -- start 2024-09-18T13:01:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.858+0000 7fcb4baef640 1 -- start start 2024-09-18T13:01:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.858+0000 7fcb4baef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb441008b0 0x7fcb4419e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.858+0000 7fcb4baef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb441011d0 0x7fcb4419e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.858+0000 7fcb4baef640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcb44115450 con 0x7fcb441008b0 2024-09-18T13:01:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.858+0000 7fcb4baef640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcb441152d0 con 0x7fcb441011d0 2024-09-18T13:01:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.858+0000 7fcb4988b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb441008b0 0x7fcb4419e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.858+0000 7fcb4988b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb441008b0 0x7fcb4419e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36040/0 (socket says 172.21.15.78:36040) 2024-09-18T13:01:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.858+0000 7fcb4988b640 1 -- 172.21.15.78:0/2711801615 learned_addr learned my addr 172.21.15.78:0/2711801615 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:01:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.858+0000 7fcb4908a640 1 --2- 172.21.15.78:0/2711801615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb441011d0 0x7fcb4419e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.859+0000 7fcb4988b640 1 -- 172.21.15.78:0/2711801615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb441011d0 msgr2=0x7fcb4419e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.859+0000 7fcb4988b640 1 --2- 172.21.15.78:0/2711801615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb441011d0 0x7fcb4419e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.859+0000 7fcb4988b640 1 -- 172.21.15.78:0/2711801615 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb441a28e0 con 0x7fcb441008b0 2024-09-18T13:01:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.859+0000 7fcb4988b640 1 --2- 172.21.15.78:0/2711801615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb441008b0 0x7fcb4419e010 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000b420 tx=0x7fcb4000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.859+0000 7fcb3affd640 1 -- 172.21.15.78:0/2711801615 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb40011630 con 0x7fcb441008b0 2024-09-18T13:01:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.859+0000 7fcb3affd640 1 -- 172.21.15.78:0/2711801615 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb40016070 con 0x7fcb441008b0 2024-09-18T13:01:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.859+0000 7fcb4baef640 1 -- 172.21.15.78:0/2711801615 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb441a2bd0 con 0x7fcb441008b0 2024-09-18T13:01:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.859+0000 7fcb3affd640 1 -- 172.21.15.78:0/2711801615 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb40010d40 con 0x7fcb441008b0 2024-09-18T13:01:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.859+0000 7fcb4baef640 1 -- 172.21.15.78:0/2711801615 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb441a3160 con 0x7fcb441008b0 2024-09-18T13:01:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.860+0000 7fcb4baef640 1 -- 172.21.15.78:0/2711801615 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb4406aa90 con 0x7fcb441008b0 2024-09-18T13:01:57.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.861+0000 7fcb3affd640 1 -- 172.21.15.78:0/2711801615 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fcb4001b460 con 0x7fcb441008b0 2024-09-18T13:01:57.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.861+0000 7fcb3affd640 1 --2- 172.21.15.78:0/2711801615 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcb3007af30 0x7fcb3007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:57.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.861+0000 7fcb3affd640 1 -- 172.21.15.78:0/2711801615 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fcb4009d720 con 0x7fcb441008b0 2024-09-18T13:01:57.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.861+0000 7fcb4908a640 1 --2- 172.21.15.78:0/2711801615 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcb3007af30 0x7fcb3007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:57.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.862+0000 7fcb4908a640 1 --2- 172.21.15.78:0/2711801615 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcb3007af30 0x7fcb3007d3f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcb441124f0 tx=0x7fcb34031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:57.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:57.868+0000 7fcb3affd640 1 -- 172.21.15.78:0/2711801615 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fcb40068cc0 con 0x7fcb441008b0 2024-09-18T13:01:58.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:58.112+0000 7fcb4baef640 1 -- 172.21.15.78:0/2711801615 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fcb44102d40 con 0x7fcb441008b0 2024-09-18T13:01:58.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:58.112+0000 7fcb3affd640 1 -- 172.21.15.78:0/2711801615 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fcb4006db70 con 0x7fcb441008b0 2024-09-18T13:01:58.113 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:01:58.114 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:01:58.114 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:01:58.114 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:01:58.114 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:01:58.114 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:01:58.114 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:01:58.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:58.114+0000 7fcb4baef640 1 -- 172.21.15.78:0/2711801615 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcb3007af30 msgr2=0x7fcb3007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:58.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:58.114+0000 7fcb4baef640 1 --2- 172.21.15.78:0/2711801615 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcb3007af30 0x7fcb3007d3f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcb441124f0 tx=0x7fcb34031400 comp rx=0 tx=0).stop 2024-09-18T13:01:58.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:58.114+0000 7fcb4baef640 1 -- 172.21.15.78:0/2711801615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb441008b0 msgr2=0x7fcb4419e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:58.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:58.114+0000 7fcb4baef640 1 --2- 172.21.15.78:0/2711801615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb441008b0 0x7fcb4419e010 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000b420 tx=0x7fcb4000b8e0 comp rx=0 tx=0).stop 2024-09-18T13:01:58.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:58.114+0000 7fcb4baef640 1 -- 172.21.15.78:0/2711801615 shutdown_connections 2024-09-18T13:01:58.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:58.114+0000 7fcb4baef640 1 --2- 172.21.15.78:0/2711801615 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcb3007af30 0x7fcb3007d3f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:58.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:58.114+0000 7fcb4baef640 1 --2- 172.21.15.78:0/2711801615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb441011d0 0x7fcb4419e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:58.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:58.114+0000 7fcb4baef640 1 --2- 172.21.15.78:0/2711801615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb441008b0 0x7fcb4419e010 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:58.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:58.114+0000 7fcb4baef640 1 -- 172.21.15.78:0/2711801615 >> 172.21.15.78:0/2711801615 conn(0x7fcb440fc520 msgr2=0x7fcb44112bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:58.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:58.114+0000 7fcb4baef640 1 -- 172.21.15.78:0/2711801615 shutdown_connections 2024-09-18T13:01:58.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:01:58.114+0000 7fcb4baef640 1 -- 172.21.15.78:0/2711801615 wait complete. 2024-09-18T13:01:58.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:58 smithi078 ceph-mon[108578]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:58.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:58 smithi078 ceph-mon[108578]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:58.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:58 smithi078 ceph-mon[108578]: pgmap v384: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:58.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:58 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3112876031' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:01:58.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:58 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2711801615' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:01:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:58 smithi148 ceph-mon[80030]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:58 smithi148 ceph-mon[80030]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:58 smithi148 ceph-mon[80030]: pgmap v384: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:58 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3112876031' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:01:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:58 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2711801615' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:01:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:01:59 smithi148 ceph-mon[80030]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:59.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:01:59 smithi078 ceph-mon[108578]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:02:00.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:00 smithi148 ceph-mon[80030]: pgmap v385: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:00.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:00 smithi078 ceph-mon[108578]: pgmap v385: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:02.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:02 smithi148 ceph-mon[80030]: pgmap v386: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:02 smithi078 ceph-mon[108578]: pgmap v386: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:04 smithi148 ceph-mon[80030]: pgmap v387: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:04 smithi078 ceph-mon[108578]: pgmap v387: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:06.707 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:06 smithi078 ceph-mon[108578]: pgmap v388: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:06.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:06 smithi148 ceph-mon[80030]: pgmap v388: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:08.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:08 smithi148 ceph-mon[80030]: pgmap v389: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:08.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:08 smithi078 ceph-mon[108578]: pgmap v389: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:10 smithi148 ceph-mon[80030]: pgmap v390: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:10.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:10 smithi078 ceph-mon[108578]: pgmap v390: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:12.704 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:12 smithi078 ceph-mon[108578]: pgmap v391: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:12.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:12 smithi148 ceph-mon[80030]: pgmap v391: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:14 smithi148 ceph-mon[80030]: pgmap v392: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:14.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:14 smithi078 ceph-mon[108578]: pgmap v392: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:16.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:16 smithi148 ceph-mon[80030]: pgmap v393: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:16 smithi078 ceph-mon[108578]: pgmap v393: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:18.708 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:18 smithi078 ceph-mon[108578]: pgmap v394: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:18.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:18 smithi148 ceph-mon[80030]: pgmap v394: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:20.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:20 smithi148 ceph-mon[80030]: pgmap v395: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:20.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:20 smithi078 ceph-mon[108578]: pgmap v395: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:22 smithi148 ceph-mon[80030]: pgmap v396: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:22.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:22 smithi078 ceph-mon[108578]: pgmap v396: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:24.712 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:24 smithi078 ceph-mon[108578]: pgmap v397: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:24 smithi148 ceph-mon[80030]: pgmap v397: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:25.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:25 smithi148 ceph-mon[80030]: pgmap v398: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:25 smithi078 ceph-mon[108578]: pgmap v398: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:26.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:27.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:27 smithi078 ceph-mon[108578]: pgmap v399: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:27.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:27 smithi148 ceph-mon[80030]: pgmap v399: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:28.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.207+0000 7f8f0bd04640 1 -- 172.21.15.78:0/4077278828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f04106800 msgr2=0x7f8f04106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:28.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.207+0000 7f8f0bd04640 1 --2- 172.21.15.78:0/4077278828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f04106800 0x7f8f04106be0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009880 tx=0x7f8ef802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.207+0000 7f8f0bd04640 1 -- 172.21.15.78:0/4077278828 shutdown_connections 2024-09-18T13:02:28.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.207+0000 7f8f0bd04640 1 --2- 172.21.15.78:0/4077278828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f04100800 0x7f8f04100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.207+0000 7f8f0bd04640 1 --2- 172.21.15.78:0/4077278828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f04106800 0x7f8f04106be0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.207+0000 7f8f0bd04640 1 -- 172.21.15.78:0/4077278828 >> 172.21.15.78:0/4077278828 conn(0x7f8f040fc520 msgr2=0x7f8f040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:28.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.207+0000 7f8f0bd04640 1 -- 172.21.15.78:0/4077278828 shutdown_connections 2024-09-18T13:02:28.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.207+0000 7f8f0bd04640 1 -- 172.21.15.78:0/4077278828 wait complete. 2024-09-18T13:02:28.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.208+0000 7f8f0bd04640 1 Processor -- start 2024-09-18T13:02:28.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.208+0000 7f8f0bd04640 1 -- start start 2024-09-18T13:02:28.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.208+0000 7f8f0bd04640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f04100800 0x7f8f0419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:28.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.208+0000 7f8f0bd04640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f04106800 0x7f8f0419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:28.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.208+0000 7f8f0bd04640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0410dcb0 con 0x7f8f04106800 2024-09-18T13:02:28.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.208+0000 7f8f0bd04640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0410db30 con 0x7f8f04100800 2024-09-18T13:02:28.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.208+0000 7f8f0929f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f04106800 0x7f8f0419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:28.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.208+0000 7f8f0929f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f04106800 0x7f8f0419fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49422/0 (socket says 172.21.15.78:49422) 2024-09-18T13:02:28.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.208+0000 7f8f0929f640 1 -- 172.21.15.78:0/2048429339 learned_addr learned my addr 172.21.15.78:0/2048429339 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:02:28.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.208+0000 7f8f09aa0640 1 --2- 172.21.15.78:0/2048429339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f04100800 0x7f8f0419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:28.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.209+0000 7f8f0929f640 1 -- 172.21.15.78:0/2048429339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f04100800 msgr2=0x7f8f0419f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:28.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.209+0000 7f8f0929f640 1 --2- 172.21.15.78:0/2048429339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f04100800 0x7f8f0419f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.209+0000 7f8f0929f640 1 -- 172.21.15.78:0/2048429339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f04199a40 con 0x7f8f04106800 2024-09-18T13:02:28.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.209+0000 7f8f0929f640 1 --2- 172.21.15.78:0/2048429339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f04106800 0x7f8f0419fdc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000d8d0 tx=0x7f8f0000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:28.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.209+0000 7f8ef6ffd640 1 -- 172.21.15.78:0/2048429339 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f00017070 con 0x7f8f04106800 2024-09-18T13:02:28.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.209+0000 7f8ef6ffd640 1 -- 172.21.15.78:0/2048429339 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f00010460 con 0x7f8f04106800 2024-09-18T13:02:28.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.209+0000 7f8f0bd04640 1 -- 172.21.15.78:0/2048429339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f04199d30 con 0x7f8f04106800 2024-09-18T13:02:28.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.209+0000 7f8ef6ffd640 1 -- 172.21.15.78:0/2048429339 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f0000f5f0 con 0x7f8f04106800 2024-09-18T13:02:28.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.209+0000 7f8f0bd04640 1 -- 172.21.15.78:0/2048429339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f0419a2c0 con 0x7f8f04106800 2024-09-18T13:02:28.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.210+0000 7f8f0bd04640 1 -- 172.21.15.78:0/2048429339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f04101f40 con 0x7f8f04106800 2024-09-18T13:02:28.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.211+0000 7f8ef6ffd640 1 -- 172.21.15.78:0/2048429339 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8f00009a30 con 0x7f8f04106800 2024-09-18T13:02:28.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.211+0000 7f8ef6ffd640 1 --2- 172.21.15.78:0/2048429339 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8ef007af30 0x7f8ef007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:28.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.212+0000 7f8f09aa0640 1 --2- 172.21.15.78:0/2048429339 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8ef007af30 0x7f8ef007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:28.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.212+0000 7f8ef6ffd640 1 -- 172.21.15.78:0/2048429339 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f8f0009df00 con 0x7f8f04106800 2024-09-18T13:02:28.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.212+0000 7f8f09aa0640 1 --2- 172.21.15.78:0/2048429339 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8ef007af30 0x7f8ef007d3f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8000c00 tx=0x7f8ef8031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:28.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.216+0000 7f8ef6ffd640 1 -- 172.21.15.78:0/2048429339 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8f000694a0 con 0x7f8f04106800 2024-09-18T13:02:28.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.408+0000 7f8f0bd04640 1 -- 172.21.15.78:0/2048429339 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8f0419b050 con 0x7f8ef007af30 2024-09-18T13:02:28.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.409+0000 7f8ef6ffd640 1 -- 172.21.15.78:0/2048429339 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8f0419b050 con 0x7f8ef007af30 2024-09-18T13:02:28.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.411+0000 7f8f0bd04640 1 -- 172.21.15.78:0/2048429339 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8ef007af30 msgr2=0x7f8ef007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:28.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.411+0000 7f8f0bd04640 1 --2- 172.21.15.78:0/2048429339 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8ef007af30 0x7f8ef007d3f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8000c00 tx=0x7f8ef8031400 comp rx=0 tx=0).stop 2024-09-18T13:02:28.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.411+0000 7f8f0bd04640 1 -- 172.21.15.78:0/2048429339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f04106800 msgr2=0x7f8f0419fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:28.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.411+0000 7f8f0bd04640 1 --2- 172.21.15.78:0/2048429339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f04106800 0x7f8f0419fdc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000d8d0 tx=0x7f8f0000dd90 comp rx=0 tx=0).stop 2024-09-18T13:02:28.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.412+0000 7f8f0bd04640 1 -- 172.21.15.78:0/2048429339 shutdown_connections 2024-09-18T13:02:28.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.412+0000 7f8f0bd04640 1 --2- 172.21.15.78:0/2048429339 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8ef007af30 0x7f8ef007d3f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.412+0000 7f8f0bd04640 1 --2- 172.21.15.78:0/2048429339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f04106800 0x7f8f0419fdc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.412+0000 7f8f0bd04640 1 --2- 172.21.15.78:0/2048429339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f04100800 0x7f8f0419f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.412+0000 7f8f0bd04640 1 -- 172.21.15.78:0/2048429339 >> 172.21.15.78:0/2048429339 conn(0x7f8f040fc520 msgr2=0x7f8f0406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:28.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.412+0000 7f8f0bd04640 1 -- 172.21.15.78:0/2048429339 shutdown_connections 2024-09-18T13:02:28.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.412+0000 7f8f0bd04640 1 -- 172.21.15.78:0/2048429339 wait complete. 2024-09-18T13:02:28.422 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:02:28.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.495+0000 7ffa5c52b640 1 -- 172.21.15.78:0/3302593303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa54100800 msgr2=0x7ffa54100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:28.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.495+0000 7ffa5c52b640 1 --2- 172.21.15.78:0/3302593303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa54100800 0x7ffa54100c60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009880 tx=0x7ffa4402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.495+0000 7ffa5c52b640 1 -- 172.21.15.78:0/3302593303 shutdown_connections 2024-09-18T13:02:28.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.495+0000 7ffa5c52b640 1 --2- 172.21.15.78:0/3302593303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa54100800 0x7ffa54100c60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.495+0000 7ffa5c52b640 1 --2- 172.21.15.78:0/3302593303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa54106800 0x7ffa54106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.495+0000 7ffa5c52b640 1 -- 172.21.15.78:0/3302593303 >> 172.21.15.78:0/3302593303 conn(0x7ffa540fc520 msgr2=0x7ffa540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:28.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.495+0000 7ffa5c52b640 1 -- 172.21.15.78:0/3302593303 shutdown_connections 2024-09-18T13:02:28.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.495+0000 7ffa5c52b640 1 -- 172.21.15.78:0/3302593303 wait complete. 2024-09-18T13:02:28.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.495+0000 7ffa5c52b640 1 Processor -- start 2024-09-18T13:02:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.495+0000 7ffa5c52b640 1 -- start start 2024-09-18T13:02:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.496+0000 7ffa5c52b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa54100800 0x7ffa5419c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.496+0000 7ffa5c52b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa54106800 0x7ffa5419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.496+0000 7ffa5c52b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5410dcd0 con 0x7ffa54106800 2024-09-18T13:02:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.496+0000 7ffa5c52b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5410db50 con 0x7ffa54100800 2024-09-18T13:02:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.496+0000 7ffa59ac6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa54106800 0x7ffa5419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.496+0000 7ffa59ac6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa54106800 0x7ffa5419cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49446/0 (socket says 172.21.15.78:49446) 2024-09-18T13:02:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.496+0000 7ffa59ac6640 1 -- 172.21.15.78:0/984393978 learned_addr learned my addr 172.21.15.78:0/984393978 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:02:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.496+0000 7ffa5a2c7640 1 --2- 172.21.15.78:0/984393978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa54100800 0x7ffa5419c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.496+0000 7ffa59ac6640 1 -- 172.21.15.78:0/984393978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa54100800 msgr2=0x7ffa5419c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.496+0000 7ffa59ac6640 1 --2- 172.21.15.78:0/984393978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa54100800 0x7ffa5419c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.496+0000 7ffa59ac6640 1 -- 172.21.15.78:0/984393978 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa541966a0 con 0x7ffa54106800 2024-09-18T13:02:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.496+0000 7ffa5a2c7640 1 --2- 172.21.15.78:0/984393978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa54100800 0x7ffa5419c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:02:28.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.496+0000 7ffa59ac6640 1 --2- 172.21.15.78:0/984393978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa54106800 0x7ffa5419cb10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ffa44031460 tx=0x7ffa440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:28.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.496+0000 7ffa4b7fe640 1 -- 172.21.15.78:0/984393978 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa44035070 con 0x7ffa54106800 2024-09-18T13:02:28.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.496+0000 7ffa4b7fe640 1 -- 172.21.15.78:0/984393978 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa44004c70 con 0x7ffa54106800 2024-09-18T13:02:28.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.497+0000 7ffa4b7fe640 1 -- 172.21.15.78:0/984393978 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa44031960 con 0x7ffa54106800 2024-09-18T13:02:28.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.497+0000 7ffa5c52b640 1 -- 172.21.15.78:0/984393978 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa54196930 con 0x7ffa54106800 2024-09-18T13:02:28.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.497+0000 7ffa5c52b640 1 -- 172.21.15.78:0/984393978 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa54196e30 con 0x7ffa54106800 2024-09-18T13:02:28.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.498+0000 7ffa5c52b640 1 -- 172.21.15.78:0/984393978 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa54101f40 con 0x7ffa54106800 2024-09-18T13:02:28.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.498+0000 7ffa4b7fe640 1 -- 172.21.15.78:0/984393978 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ffa44003cd0 con 0x7ffa54106800 2024-09-18T13:02:28.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.499+0000 7ffa4b7fe640 1 --2- 172.21.15.78:0/984393978 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ffa4007af80 0x7ffa4007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:28.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.499+0000 7ffa5a2c7640 1 --2- 172.21.15.78:0/984393978 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ffa4007af80 0x7ffa4007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:28.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.499+0000 7ffa4b7fe640 1 -- 172.21.15.78:0/984393978 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7ffa4403e070 con 0x7ffa54106800 2024-09-18T13:02:28.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.499+0000 7ffa5a2c7640 1 --2- 172.21.15.78:0/984393978 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ffa4007af80 0x7ffa4007d440 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffa50005fd0 tx=0x7ffa50005ea0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:28.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.503+0000 7ffa4b7fe640 1 -- 172.21.15.78:0/984393978 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ffa4408bb70 con 0x7ffa54106800 2024-09-18T13:02:28.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.695+0000 7ffa5c52b640 1 -- 172.21.15.78:0/984393978 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ffa54197150 con 0x7ffa4007af80 2024-09-18T13:02:28.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.696+0000 7ffa4b7fe640 1 -- 172.21.15.78:0/984393978 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ffa54197150 con 0x7ffa4007af80 2024-09-18T13:02:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.698+0000 7ffa5c52b640 1 -- 172.21.15.78:0/984393978 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ffa4007af80 msgr2=0x7ffa4007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.698+0000 7ffa5c52b640 1 --2- 172.21.15.78:0/984393978 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ffa4007af80 0x7ffa4007d440 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffa50005fd0 tx=0x7ffa50005ea0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.698+0000 7ffa5c52b640 1 -- 172.21.15.78:0/984393978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa54106800 msgr2=0x7ffa5419cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.698+0000 7ffa5c52b640 1 --2- 172.21.15.78:0/984393978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa54106800 0x7ffa5419cb10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ffa44031460 tx=0x7ffa440048f0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.698+0000 7ffa5c52b640 1 -- 172.21.15.78:0/984393978 shutdown_connections 2024-09-18T13:02:28.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.698+0000 7ffa5c52b640 1 --2- 172.21.15.78:0/984393978 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ffa4007af80 0x7ffa4007d440 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.698+0000 7ffa5c52b640 1 --2- 172.21.15.78:0/984393978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa54106800 0x7ffa5419cb10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.698+0000 7ffa5c52b640 1 --2- 172.21.15.78:0/984393978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa54100800 0x7ffa5419c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.698+0000 7ffa5c52b640 1 -- 172.21.15.78:0/984393978 >> 172.21.15.78:0/984393978 conn(0x7ffa540fc520 msgr2=0x7ffa540fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:28.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.698+0000 7ffa5c52b640 1 -- 172.21.15.78:0/984393978 shutdown_connections 2024-09-18T13:02:28.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.698+0000 7ffa5c52b640 1 -- 172.21.15.78:0/984393978 wait complete. 2024-09-18T13:02:28.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.780+0000 7f2dcb2d0640 1 -- 172.21.15.78:0/2222112347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc4101900 msgr2=0x7f2dc4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:28.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.780+0000 7f2dcb2d0640 1 --2- 172.21.15.78:0/2222112347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc4101900 0x7f2dc4101d60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009880 tx=0x7f2dc002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.780+0000 7f2dcb2d0640 1 -- 172.21.15.78:0/2222112347 shutdown_connections 2024-09-18T13:02:28.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.780+0000 7f2dcb2d0640 1 --2- 172.21.15.78:0/2222112347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc4101900 0x7f2dc4101d60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.780+0000 7f2dcb2d0640 1 --2- 172.21.15.78:0/2222112347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2dc4107900 0x7f2dc4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.780+0000 7f2dcb2d0640 1 -- 172.21.15.78:0/2222112347 >> 172.21.15.78:0/2222112347 conn(0x7f2dc40fd600 msgr2=0x7f2dc40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:28.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.780+0000 7f2dcb2d0640 1 -- 172.21.15.78:0/2222112347 shutdown_connections 2024-09-18T13:02:28.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.780+0000 7f2dcb2d0640 1 -- 172.21.15.78:0/2222112347 wait complete. 2024-09-18T13:02:28.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.780+0000 7f2dcb2d0640 1 Processor -- start 2024-09-18T13:02:28.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.780+0000 7f2dcb2d0640 1 -- start start 2024-09-18T13:02:28.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.781+0000 7f2dcb2d0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc4101900 0x7f2dc419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:28.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.781+0000 7f2dcb2d0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2dc4107900 0x7f2dc419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:28.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.781+0000 7f2dcb2d0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc410edd0 con 0x7f2dc4101900 2024-09-18T13:02:28.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.781+0000 7f2dcb2d0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc410ec50 con 0x7f2dc4107900 2024-09-18T13:02:28.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.781+0000 7f2dc906c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc4101900 0x7f2dc419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:28.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.781+0000 7f2dc906c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc4101900 0x7f2dc419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49464/0 (socket says 172.21.15.78:49464) 2024-09-18T13:02:28.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.781+0000 7f2dc906c640 1 -- 172.21.15.78:0/1281699705 learned_addr learned my addr 172.21.15.78:0/1281699705 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:02:28.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.781+0000 7f2dc886b640 1 --2- 172.21.15.78:0/1281699705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2dc4107900 0x7f2dc419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:28.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.781+0000 7f2dc906c640 1 -- 172.21.15.78:0/1281699705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2dc4107900 msgr2=0x7f2dc419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:28.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.781+0000 7f2dc906c640 1 --2- 172.21.15.78:0/1281699705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2dc4107900 0x7f2dc419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.781+0000 7f2dc906c640 1 -- 172.21.15.78:0/1281699705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc4197800 con 0x7f2dc4101900 2024-09-18T13:02:28.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.781+0000 7f2dc886b640 1 --2- 172.21.15.78:0/1281699705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2dc4107900 0x7f2dc419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:02:28.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.781+0000 7f2dc906c640 1 --2- 172.21.15.78:0/1281699705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc4101900 0x7f2dc419d680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2db800d6f0 tx=0x7f2db800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:28.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.782+0000 7f2db67fc640 1 -- 172.21.15.78:0/1281699705 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2db8017070 con 0x7f2dc4101900 2024-09-18T13:02:28.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.782+0000 7f2db67fc640 1 -- 172.21.15.78:0/1281699705 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2db800de00 con 0x7f2dc4101900 2024-09-18T13:02:28.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.782+0000 7f2dcb2d0640 1 -- 172.21.15.78:0/1281699705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc4197af0 con 0x7f2dc4101900 2024-09-18T13:02:28.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.782+0000 7f2db67fc640 1 -- 172.21.15.78:0/1281699705 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2db8004bb0 con 0x7f2dc4101900 2024-09-18T13:02:28.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.782+0000 7f2dcb2d0640 1 -- 172.21.15.78:0/1281699705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc4198050 con 0x7f2dc4101900 2024-09-18T13:02:28.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.783+0000 7f2dcb2d0640 1 -- 172.21.15.78:0/1281699705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc4103040 con 0x7f2dc4101900 2024-09-18T13:02:28.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.783+0000 7f2db67fc640 1 -- 172.21.15.78:0/1281699705 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2db8004e60 con 0x7f2dc4101900 2024-09-18T13:02:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.784+0000 7f2db67fc640 1 --2- 172.21.15.78:0/1281699705 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2db007af40 0x7f2db007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.784+0000 7f2db67fc640 1 -- 172.21.15.78:0/1281699705 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f2db809dcb0 con 0x7f2dc4101900 2024-09-18T13:02:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.784+0000 7f2dc886b640 1 --2- 172.21.15.78:0/1281699705 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2db007af40 0x7f2db007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.784+0000 7f2dc886b640 1 --2- 172.21.15.78:0/1281699705 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2db007af40 0x7f2db007d400 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4198b50 tx=0x7f2dc0031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:28.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.788+0000 7f2db67fc640 1 -- 172.21.15.78:0/1281699705 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2db8069250 con 0x7f2dc4101900 2024-09-18T13:02:28.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.973+0000 7f2dcb2d0640 1 -- 172.21.15.78:0/1281699705 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2dc4198300 con 0x7f2db007af40 2024-09-18T13:02:28.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.983+0000 7f2db67fc640 1 -- 172.21.15.78:0/1281699705 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f2dc4198300 con 0x7f2db007af40 2024-09-18T13:02:28.984 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:02:28.984 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (10m) 4m ago 21m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:02:28.984 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (12m) 4m ago 21m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:02:28.984 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (12m) 4m ago 20m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:02:28.984 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (8m) 4m ago 21m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:02:28.984 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (8m) 4m ago 20m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:02:28.984 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (9m) 4m ago 21m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:02:28.984 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (4m) 4m ago 15m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:02:28.984 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (4m) 4m ago 15m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:02:28.984 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (4m) 4m ago 15m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:02:28.984 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (4m) 4m ago 15m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:02:28.985 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (12m) 4m ago 22m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:02:28.985 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (11m) 4m ago 20m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:02:28.985 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (9m) 4m ago 22m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:02:28.985 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (8m) 4m ago 20m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:02:28.985 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (11m) 4m ago 21m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:02:28.985 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (11m) 4m ago 20m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:02:28.985 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (8m) 4m ago 19m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:02:28.985 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (7m) 4m ago 18m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:02:28.985 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (6m) 4m ago 18m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:02:28.985 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (6m) 4m ago 17m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:02:28.986 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (5m) 4m ago 17m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:02:28.986 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (5m) 4m ago 16m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:02:28.986 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (10m) 4m ago 20m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:02:28.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.985+0000 7f2dcb2d0640 1 -- 172.21.15.78:0/1281699705 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2db007af40 msgr2=0x7f2db007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:28.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.985+0000 7f2dcb2d0640 1 --2- 172.21.15.78:0/1281699705 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2db007af40 0x7f2db007d400 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4198b50 tx=0x7f2dc0031400 comp rx=0 tx=0).stop 2024-09-18T13:02:28.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.985+0000 7f2dcb2d0640 1 -- 172.21.15.78:0/1281699705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc4101900 msgr2=0x7f2dc419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:28.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.985+0000 7f2dcb2d0640 1 --2- 172.21.15.78:0/1281699705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc4101900 0x7f2dc419d680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2db800d6f0 tx=0x7f2db800dbb0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.985+0000 7f2dcb2d0640 1 -- 172.21.15.78:0/1281699705 shutdown_connections 2024-09-18T13:02:28.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.985+0000 7f2dcb2d0640 1 --2- 172.21.15.78:0/1281699705 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2db007af40 0x7f2db007d400 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.985+0000 7f2dcb2d0640 1 --2- 172.21.15.78:0/1281699705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2dc4107900 0x7f2dc419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.985+0000 7f2dcb2d0640 1 --2- 172.21.15.78:0/1281699705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dc4101900 0x7f2dc419d680 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:28.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.985+0000 7f2dcb2d0640 1 -- 172.21.15.78:0/1281699705 >> 172.21.15.78:0/1281699705 conn(0x7f2dc40fd600 msgr2=0x7f2dc40fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:28.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.985+0000 7f2dcb2d0640 1 -- 172.21.15.78:0/1281699705 shutdown_connections 2024-09-18T13:02:28.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:28.985+0000 7f2dcb2d0640 1 -- 172.21.15.78:0/1281699705 wait complete. 2024-09-18T13:02:29.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.066+0000 7f17c1a47640 1 -- 172.21.15.78:0/3299249312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc1007f0 msgr2=0x7f17bc100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:29.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.066+0000 7f17c1a47640 1 --2- 172.21.15.78:0/3299249312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc1007f0 0x7f17bc100c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009880 tx=0x7f17a402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.066+0000 7f17c1a47640 1 -- 172.21.15.78:0/3299249312 shutdown_connections 2024-09-18T13:02:29.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.066+0000 7f17c1a47640 1 --2- 172.21.15.78:0/3299249312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc1007f0 0x7f17bc100c50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.066+0000 7f17c1a47640 1 --2- 172.21.15.78:0/3299249312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17bc1067f0 0x7f17bc106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.066+0000 7f17c1a47640 1 -- 172.21.15.78:0/3299249312 >> 172.21.15.78:0/3299249312 conn(0x7f17bc0fc550 msgr2=0x7f17bc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:29.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.066+0000 7f17c1a47640 1 -- 172.21.15.78:0/3299249312 shutdown_connections 2024-09-18T13:02:29.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.066+0000 7f17c1a47640 1 -- 172.21.15.78:0/3299249312 wait complete. 2024-09-18T13:02:29.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.067+0000 7f17c1a47640 1 Processor -- start 2024-09-18T13:02:29.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.067+0000 7f17c1a47640 1 -- start start 2024-09-18T13:02:29.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.067+0000 7f17c1a47640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17bc1007f0 0x7f17bc19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:29.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.067+0000 7f17c1a47640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc1067f0 0x7f17bc19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:29.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.067+0000 7f17c1a47640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc10dcc0 con 0x7f17bc1067f0 2024-09-18T13:02:29.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.067+0000 7f17c1a47640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc10db40 con 0x7f17bc1007f0 2024-09-18T13:02:29.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.067+0000 7f17ba7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc1067f0 0x7f17bc19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:29.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.067+0000 7f17ba7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc1067f0 0x7f17bc19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49492/0 (socket says 172.21.15.78:49492) 2024-09-18T13:02:29.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.067+0000 7f17ba7fc640 1 -- 172.21.15.78:0/2948667753 learned_addr learned my addr 172.21.15.78:0/2948667753 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:02:29.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.067+0000 7f17baffd640 1 --2- 172.21.15.78:0/2948667753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17bc1007f0 0x7f17bc19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:29.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.067+0000 7f17ba7fc640 1 -- 172.21.15.78:0/2948667753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17bc1007f0 msgr2=0x7f17bc19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:29.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.067+0000 7f17ba7fc640 1 --2- 172.21.15.78:0/2948667753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17bc1007f0 0x7f17bc19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.067+0000 7f17ba7fc640 1 -- 172.21.15.78:0/2948667753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17bc1977e0 con 0x7f17bc1067f0 2024-09-18T13:02:29.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.068+0000 7f17ba7fc640 1 --2- 172.21.15.78:0/2948667753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc1067f0 0x7f17bc19dba0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f17a4031460 tx=0x7f17a40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:29.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.068+0000 7f17c0a45640 1 -- 172.21.15.78:0/2948667753 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f17a403f070 con 0x7f17bc1067f0 2024-09-18T13:02:29.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.068+0000 7f17c0a45640 1 -- 172.21.15.78:0/2948667753 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f17a40035f0 con 0x7f17bc1067f0 2024-09-18T13:02:29.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.068+0000 7f17c1a47640 1 -- 172.21.15.78:0/2948667753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17bc197a70 con 0x7f17bc1067f0 2024-09-18T13:02:29.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.068+0000 7f17c0a45640 1 -- 172.21.15.78:0/2948667753 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f17a4035030 con 0x7f17bc1067f0 2024-09-18T13:02:29.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.068+0000 7f17c1a47640 1 -- 172.21.15.78:0/2948667753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17bc197fa0 con 0x7f17bc1067f0 2024-09-18T13:02:29.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.069+0000 7f17c1a47640 1 -- 172.21.15.78:0/2948667753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17bc101f30 con 0x7f17bc1067f0 2024-09-18T13:02:29.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.070+0000 7f17c0a45640 1 -- 172.21.15.78:0/2948667753 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f17a4042070 con 0x7f17bc1067f0 2024-09-18T13:02:29.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.071+0000 7f17c0a45640 1 --2- 172.21.15.78:0/2948667753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17a807af80 0x7f17a807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:29.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.071+0000 7f17c0a45640 1 -- 172.21.15.78:0/2948667753 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f17a40be970 con 0x7f17bc1067f0 2024-09-18T13:02:29.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.071+0000 7f17baffd640 1 --2- 172.21.15.78:0/2948667753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17a807af80 0x7f17a807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:29.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.071+0000 7f17baffd640 1 --2- 172.21.15.78:0/2948667753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17a807af80 0x7f17a807d440 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f17b4005fd0 tx=0x7f17b4005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:29.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.075+0000 7f17c0a45640 1 -- 172.21.15.78:0/2948667753 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f17a40c0e20 con 0x7f17bc1067f0 2024-09-18T13:02:29.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.327+0000 7f17c1a47640 1 -- 172.21.15.78:0/2948667753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f17bc109d70 con 0x7f17bc1067f0 2024-09-18T13:02:29.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.327+0000 7f17c0a45640 1 -- 172.21.15.78:0/2948667753 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f17a4089f90 con 0x7f17bc1067f0 2024-09-18T13:02:29.329 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:02:29.329 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:02:29.329 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:02:29.329 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:02:29.329 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:02:29.330 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:02:29.330 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:02:29.330 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:02:29.330 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:02:29.330 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:02:29.330 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:02:29.331 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:02:29.331 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:02:29.331 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:02:29.331 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:02:29.331 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:02:29.331 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:02:29.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.329+0000 7f17c1a47640 1 -- 172.21.15.78:0/2948667753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17a807af80 msgr2=0x7f17a807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:29.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.329+0000 7f17c1a47640 1 --2- 172.21.15.78:0/2948667753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17a807af80 0x7f17a807d440 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f17b4005fd0 tx=0x7f17b4005850 comp rx=0 tx=0).stop 2024-09-18T13:02:29.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.329+0000 7f17c1a47640 1 -- 172.21.15.78:0/2948667753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc1067f0 msgr2=0x7f17bc19dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:29.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.329+0000 7f17c1a47640 1 --2- 172.21.15.78:0/2948667753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc1067f0 0x7f17bc19dba0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f17a4031460 tx=0x7f17a40045e0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.330+0000 7f17c1a47640 1 -- 172.21.15.78:0/2948667753 shutdown_connections 2024-09-18T13:02:29.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.330+0000 7f17c1a47640 1 --2- 172.21.15.78:0/2948667753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f17a807af80 0x7f17a807d440 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.330+0000 7f17c1a47640 1 --2- 172.21.15.78:0/2948667753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17bc1067f0 0x7f17bc19dba0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.330+0000 7f17c1a47640 1 --2- 172.21.15.78:0/2948667753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17bc1007f0 0x7f17bc19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.330+0000 7f17c1a47640 1 -- 172.21.15.78:0/2948667753 >> 172.21.15.78:0/2948667753 conn(0x7f17bc0fc550 msgr2=0x7f17bc069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:29.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.330+0000 7f17c1a47640 1 -- 172.21.15.78:0/2948667753 shutdown_connections 2024-09-18T13:02:29.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.330+0000 7f17c1a47640 1 -- 172.21.15.78:0/2948667753 wait complete. 2024-09-18T13:02:29.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.411+0000 7fd03a184640 1 -- 172.21.15.78:0/1235321816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034107900 msgr2=0x7fd034107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:29.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.411+0000 7fd03a184640 1 --2- 172.21.15.78:0/1235321816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034107900 0x7fd034107ce0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd01c009880 tx=0x7fd01c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.411+0000 7fd03a184640 1 -- 172.21.15.78:0/1235321816 shutdown_connections 2024-09-18T13:02:29.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.411+0000 7fd03a184640 1 --2- 172.21.15.78:0/1235321816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd034101900 0x7fd034101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.411+0000 7fd03a184640 1 --2- 172.21.15.78:0/1235321816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034107900 0x7fd034107ce0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.411+0000 7fd03a184640 1 -- 172.21.15.78:0/1235321816 >> 172.21.15.78:0/1235321816 conn(0x7fd0340fd600 msgr2=0x7fd0340ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:29.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.411+0000 7fd03a184640 1 -- 172.21.15.78:0/1235321816 shutdown_connections 2024-09-18T13:02:29.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.411+0000 7fd03a184640 1 -- 172.21.15.78:0/1235321816 wait complete. 2024-09-18T13:02:29.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.411+0000 7fd03a184640 1 Processor -- start 2024-09-18T13:02:29.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.411+0000 7fd03a184640 1 -- start start 2024-09-18T13:02:29.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.412+0000 7fd03a184640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034101900 0x7fd03419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:29.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.412+0000 7fd03a184640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd034107900 0x7fd03419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:29.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.412+0000 7fd03a184640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd03410edb0 con 0x7fd034101900 2024-09-18T13:02:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.412+0000 7fd03a184640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd03410ec30 con 0x7fd034107900 2024-09-18T13:02:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.412+0000 7fd0337fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034101900 0x7fd03419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.412+0000 7fd0337fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034101900 0x7fd03419d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49508/0 (socket says 172.21.15.78:49508) 2024-09-18T13:02:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.412+0000 7fd0337fe640 1 -- 172.21.15.78:0/1477592083 learned_addr learned my addr 172.21.15.78:0/1477592083 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:02:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.412+0000 7fd032ffd640 1 --2- 172.21.15.78:0/1477592083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd034107900 0x7fd03419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.412+0000 7fd0337fe640 1 -- 172.21.15.78:0/1477592083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd034107900 msgr2=0x7fd03419db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.412+0000 7fd0337fe640 1 --2- 172.21.15.78:0/1477592083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd034107900 0x7fd03419db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.412+0000 7fd0337fe640 1 -- 172.21.15.78:0/1477592083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0341977a0 con 0x7fd034101900 2024-09-18T13:02:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.412+0000 7fd032ffd640 1 --2- 172.21.15.78:0/1477592083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd034107900 0x7fd03419db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:02:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.412+0000 7fd0337fe640 1 --2- 172.21.15.78:0/1477592083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034101900 0x7fd03419d620 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd01c031460 tx=0x7fd01c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.412+0000 7fd030ff9640 1 -- 172.21.15.78:0/1477592083 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd01c03f070 con 0x7fd034101900 2024-09-18T13:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.412+0000 7fd030ff9640 1 -- 172.21.15.78:0/1477592083 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd01c004cf0 con 0x7fd034101900 2024-09-18T13:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.413+0000 7fd03a184640 1 -- 172.21.15.78:0/1477592083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd034197a30 con 0x7fd034101900 2024-09-18T13:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.413+0000 7fd030ff9640 1 -- 172.21.15.78:0/1477592083 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd01c035030 con 0x7fd034101900 2024-09-18T13:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.413+0000 7fd03a184640 1 -- 172.21.15.78:0/1477592083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd034197f60 con 0x7fd034101900 2024-09-18T13:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.414+0000 7fd03a184640 1 -- 172.21.15.78:0/1477592083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd034103040 con 0x7fd034101900 2024-09-18T13:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.414+0000 7fd030ff9640 1 -- 172.21.15.78:0/1477592083 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd01c042070 con 0x7fd034101900 2024-09-18T13:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.415+0000 7fd030ff9640 1 --2- 172.21.15.78:0/1477592083 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd02007af80 0x7fd02007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.415+0000 7fd032ffd640 1 --2- 172.21.15.78:0/1477592083 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd02007af80 0x7fd02007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.415+0000 7fd030ff9640 1 -- 172.21.15.78:0/1477592083 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fd01c0bea90 con 0x7fd034101900 2024-09-18T13:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.416+0000 7fd032ffd640 1 --2- 172.21.15.78:0/1477592083 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd02007af80 0x7fd02007d440 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd03410c2f0 tx=0x7fd024005d90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:29.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.419+0000 7fd030ff9640 1 -- 172.21.15.78:0/1477592083 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd01c08a0b0 con 0x7fd034101900 2024-09-18T13:02:29.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.630+0000 7fd03a184640 1 -- 172.21.15.78:0/1477592083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd034198d00 con 0x7fd034101900 2024-09-18T13:02:29.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.630+0000 7fd030ff9640 1 -- 172.21.15.78:0/1477592083 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7fd034198d00 con 0x7fd034101900 2024-09-18T13:02:29.632 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:02:29.632 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:02:29.632 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:02:29.632 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:02:29.632 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:02:29.632 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:02:29.632 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:02:29.632 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:02:29.632 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:02:29.632 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:02:29.632 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:02:29.633 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:02:29.633 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:02:29.633 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:02:29.633 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:02:29.633 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:02:29.633 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:02:29.633 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:02:29.633 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:02:29.633 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:02:29.633 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:02:29.633 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:02:29.633 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:02:29.633 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:02:29.634 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:02:29.634 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:02:29.634 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:02:29.634 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:02:29.634 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:02:29.634 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:02:29.634 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:02:29.634 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:02:29.634 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:02:29.634 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:02:29.634 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:02:29.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:02:29.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:02:29.634 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:02:29.635 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:02:29.635 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:02:29.635 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:02:29.635 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:02:29.635 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:02:29.636 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:02:29.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.633+0000 7fd03a184640 1 -- 172.21.15.78:0/1477592083 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd02007af80 msgr2=0x7fd02007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:29.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.633+0000 7fd03a184640 1 --2- 172.21.15.78:0/1477592083 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd02007af80 0x7fd02007d440 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd03410c2f0 tx=0x7fd024005d90 comp rx=0 tx=0).stop 2024-09-18T13:02:29.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.633+0000 7fd03a184640 1 -- 172.21.15.78:0/1477592083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034101900 msgr2=0x7fd03419d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:29.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.633+0000 7fd03a184640 1 --2- 172.21.15.78:0/1477592083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034101900 0x7fd03419d620 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd01c031460 tx=0x7fd01c0048f0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.633+0000 7fd03a184640 1 -- 172.21.15.78:0/1477592083 shutdown_connections 2024-09-18T13:02:29.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.633+0000 7fd03a184640 1 --2- 172.21.15.78:0/1477592083 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd02007af80 0x7fd02007d440 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.633+0000 7fd03a184640 1 --2- 172.21.15.78:0/1477592083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd034107900 0x7fd03419db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.633+0000 7fd03a184640 1 --2- 172.21.15.78:0/1477592083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034101900 0x7fd03419d620 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.633+0000 7fd03a184640 1 -- 172.21.15.78:0/1477592083 >> 172.21.15.78:0/1477592083 conn(0x7fd0340fd600 msgr2=0x7fd0340feef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:29.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.633+0000 7fd03a184640 1 -- 172.21.15.78:0/1477592083 shutdown_connections 2024-09-18T13:02:29.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.633+0000 7fd03a184640 1 -- 172.21.15.78:0/1477592083 wait complete. 2024-09-18T13:02:29.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.715+0000 7fcedf5c3640 1 -- 172.21.15.78:0/32717647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced81007f0 msgr2=0x7fced8100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:29.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.715+0000 7fcedf5c3640 1 --2- 172.21.15.78:0/32717647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced81007f0 0x7fced8100c50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fced4009880 tx=0x7fced402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.716+0000 7fcedf5c3640 1 -- 172.21.15.78:0/32717647 shutdown_connections 2024-09-18T13:02:29.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.716+0000 7fcedf5c3640 1 --2- 172.21.15.78:0/32717647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced81007f0 0x7fced8100c50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.716+0000 7fcedf5c3640 1 --2- 172.21.15.78:0/32717647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81067f0 0x7fced8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.716+0000 7fcedf5c3640 1 -- 172.21.15.78:0/32717647 >> 172.21.15.78:0/32717647 conn(0x7fced80fc550 msgr2=0x7fced80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:29.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.716+0000 7fcedf5c3640 1 -- 172.21.15.78:0/32717647 shutdown_connections 2024-09-18T13:02:29.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.716+0000 7fcedf5c3640 1 -- 172.21.15.78:0/32717647 wait complete. 2024-09-18T13:02:29.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.716+0000 7fcedf5c3640 1 Processor -- start 2024-09-18T13:02:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.716+0000 7fcedf5c3640 1 -- start start 2024-09-18T13:02:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.716+0000 7fcedf5c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced81007f0 0x7fced819c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.716+0000 7fcedf5c3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81067f0 0x7fced819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.716+0000 7fcedf5c3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fced810dd20 con 0x7fced81007f0 2024-09-18T13:02:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.716+0000 7fcedf5c3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fced810dba0 con 0x7fced81067f0 2024-09-18T13:02:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.717+0000 7fcedd35f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced81007f0 0x7fced819c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.717+0000 7fcedd35f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced81007f0 0x7fced819c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49528/0 (socket says 172.21.15.78:49528) 2024-09-18T13:02:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.717+0000 7fcedd35f640 1 -- 172.21.15.78:0/3011739440 learned_addr learned my addr 172.21.15.78:0/3011739440 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:02:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.717+0000 7fcedcb5e640 1 --2- 172.21.15.78:0/3011739440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81067f0 0x7fced819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.717+0000 7fcedd35f640 1 -- 172.21.15.78:0/3011739440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81067f0 msgr2=0x7fced819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.717+0000 7fcedd35f640 1 --2- 172.21.15.78:0/3011739440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81067f0 0x7fced819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.717+0000 7fcedd35f640 1 -- 172.21.15.78:0/3011739440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced8196830 con 0x7fced81007f0 2024-09-18T13:02:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.717+0000 7fcedcb5e640 1 --2- 172.21.15.78:0/3011739440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81067f0 0x7fced819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:02:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.717+0000 7fcedd35f640 1 --2- 172.21.15.78:0/3011739440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced81007f0 0x7fced819c6b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00b420 tx=0x7fcecc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.717+0000 7fceca7fc640 1 -- 172.21.15.78:0/3011739440 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcecc011630 con 0x7fced81007f0 2024-09-18T13:02:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.717+0000 7fceca7fc640 1 -- 172.21.15.78:0/3011739440 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcecc016070 con 0x7fced81007f0 2024-09-18T13:02:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.717+0000 7fcedf5c3640 1 -- 172.21.15.78:0/3011739440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced8196b20 con 0x7fced81007f0 2024-09-18T13:02:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.717+0000 7fcedf5c3640 1 -- 172.21.15.78:0/3011739440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced8197080 con 0x7fced81007f0 2024-09-18T13:02:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.717+0000 7fceca7fc640 1 -- 172.21.15.78:0/3011739440 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcecc010d40 con 0x7fced81007f0 2024-09-18T13:02:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.718+0000 7fcedf5c3640 1 -- 172.21.15.78:0/3011739440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced8101f30 con 0x7fced81007f0 2024-09-18T13:02:29.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.719+0000 7fceca7fc640 1 -- 172.21.15.78:0/3011739440 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fcecc01b480 con 0x7fced81007f0 2024-09-18T13:02:29.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.719+0000 7fceca7fc640 1 --2- 172.21.15.78:0/3011739440 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcec407af30 0x7fcec407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:29.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.719+0000 7fceca7fc640 1 -- 172.21.15.78:0/3011739440 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fcecc09d7a0 con 0x7fced81007f0 2024-09-18T13:02:29.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.719+0000 7fcedcb5e640 1 --2- 172.21.15.78:0/3011739440 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcec407af30 0x7fcec407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:29.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.720+0000 7fcedcb5e640 1 --2- 172.21.15.78:0/3011739440 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcec407af30 0x7fcec407d3f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fced8197b80 tx=0x7fced4031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.724+0000 7fceca7fc640 1 -- 172.21.15.78:0/3011739440 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fcecc068d40 con 0x7fced81007f0 2024-09-18T13:02:29.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.915+0000 7fcedf5c3640 1 -- 172.21.15.78:0/3011739440 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fced8197390 con 0x7fcec407af30 2024-09-18T13:02:29.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.917+0000 7fceca7fc640 1 -- 172.21.15.78:0/3011739440 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fced8197390 con 0x7fcec407af30 2024-09-18T13:02:29.918 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:02:29.918 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:02:29.918 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:02:29.918 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:02:29.918 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:02:29.918 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:02:29.918 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:02:29.918 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:02:29.918 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:02:29.918 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:02:29.918 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:02:29.919 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:02:29.919 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:02:29.919 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:02:29.919 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:02:29.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.920+0000 7fcedf5c3640 1 -- 172.21.15.78:0/3011739440 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcec407af30 msgr2=0x7fcec407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:29.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.920+0000 7fcedf5c3640 1 --2- 172.21.15.78:0/3011739440 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcec407af30 0x7fcec407d3f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fced8197b80 tx=0x7fced4031400 comp rx=0 tx=0).stop 2024-09-18T13:02:29.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.920+0000 7fcedf5c3640 1 -- 172.21.15.78:0/3011739440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced81007f0 msgr2=0x7fced819c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:29.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.920+0000 7fcedf5c3640 1 --2- 172.21.15.78:0/3011739440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced81007f0 0x7fced819c6b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00b420 tx=0x7fcecc00b8e0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.920+0000 7fcedf5c3640 1 -- 172.21.15.78:0/3011739440 shutdown_connections 2024-09-18T13:02:29.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.920+0000 7fcedf5c3640 1 --2- 172.21.15.78:0/3011739440 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcec407af30 0x7fcec407d3f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.920+0000 7fcedf5c3640 1 --2- 172.21.15.78:0/3011739440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81067f0 0x7fced819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.920+0000 7fcedf5c3640 1 --2- 172.21.15.78:0/3011739440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced81007f0 0x7fced819c6b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:29.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.920+0000 7fcedf5c3640 1 -- 172.21.15.78:0/3011739440 >> 172.21.15.78:0/3011739440 conn(0x7fced80fc550 msgr2=0x7fced80fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:29.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.920+0000 7fcedf5c3640 1 -- 172.21.15.78:0/3011739440 shutdown_connections 2024-09-18T13:02:29.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:29.920+0000 7fcedf5c3640 1 -- 172.21.15.78:0/3011739440 wait complete. 2024-09-18T13:02:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.001+0000 7fcc908ce640 1 -- 172.21.15.78:0/1219607347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc8c100800 msgr2=0x7fcc8c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.001+0000 7fcc908ce640 1 --2- 172.21.15.78:0/1219607347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc8c100800 0x7fcc8c100c60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009880 tx=0x7fcc7402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:02:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.001+0000 7fcc908ce640 1 -- 172.21.15.78:0/1219607347 shutdown_connections 2024-09-18T13:02:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.001+0000 7fcc908ce640 1 --2- 172.21.15.78:0/1219607347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc8c100800 0x7fcc8c100c60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.001+0000 7fcc908ce640 1 --2- 172.21.15.78:0/1219607347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc8c106800 0x7fcc8c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.001+0000 7fcc908ce640 1 -- 172.21.15.78:0/1219607347 >> 172.21.15.78:0/1219607347 conn(0x7fcc8c0fc520 msgr2=0x7fcc8c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:30.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.001+0000 7fcc908ce640 1 -- 172.21.15.78:0/1219607347 shutdown_connections 2024-09-18T13:02:30.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.001+0000 7fcc908ce640 1 -- 172.21.15.78:0/1219607347 wait complete. 2024-09-18T13:02:30.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.002+0000 7fcc908ce640 1 Processor -- start 2024-09-18T13:02:30.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.002+0000 7fcc908ce640 1 -- start start 2024-09-18T13:02:30.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.002+0000 7fcc908ce640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc8c100800 0x7fcc8c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:30.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.002+0000 7fcc908ce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc8c106800 0x7fcc8c198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:30.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.002+0000 7fcc908ce640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8c10dcd0 con 0x7fcc8c106800 2024-09-18T13:02:30.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.002+0000 7fcc908ce640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8c10db50 con 0x7fcc8c100800 2024-09-18T13:02:30.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.002+0000 7fcc83fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc8c106800 0x7fcc8c198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:30.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.002+0000 7fcc83fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc8c106800 0x7fcc8c198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49536/0 (socket says 172.21.15.78:49536) 2024-09-18T13:02:30.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.002+0000 7fcc83fff640 1 -- 172.21.15.78:0/1724193538 learned_addr learned my addr 172.21.15.78:0/1724193538 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:02:30.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.002+0000 7fcc8a59c640 1 --2- 172.21.15.78:0/1724193538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc8c100800 0x7fcc8c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:30.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.002+0000 7fcc83fff640 1 -- 172.21.15.78:0/1724193538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc8c100800 msgr2=0x7fcc8c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:30.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.002+0000 7fcc83fff640 1 --2- 172.21.15.78:0/1724193538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc8c100800 0x7fcc8c198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:30.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.002+0000 7fcc83fff640 1 -- 172.21.15.78:0/1724193538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8c199360 con 0x7fcc8c106800 2024-09-18T13:02:30.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.003+0000 7fcc83fff640 1 --2- 172.21.15.78:0/1724193538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc8c106800 0x7fcc8c198d60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcc74031460 tx=0x7fcc740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:30.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.003+0000 7fcc837fe640 1 -- 172.21.15.78:0/1724193538 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc7403f070 con 0x7fcc8c106800 2024-09-18T13:02:30.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.003+0000 7fcc837fe640 1 -- 172.21.15.78:0/1724193538 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc74004cf0 con 0x7fcc8c106800 2024-09-18T13:02:30.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.003+0000 7fcc908ce640 1 -- 172.21.15.78:0/1724193538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc8c1995f0 con 0x7fcc8c106800 2024-09-18T13:02:30.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.003+0000 7fcc837fe640 1 -- 172.21.15.78:0/1724193538 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc74035030 con 0x7fcc8c106800 2024-09-18T13:02:30.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.003+0000 7fcc908ce640 1 -- 172.21.15.78:0/1724193538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc8c1a1ba0 con 0x7fcc8c106800 2024-09-18T13:02:30.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.004+0000 7fcc908ce640 1 -- 172.21.15.78:0/1724193538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc8c101f40 con 0x7fcc8c106800 2024-09-18T13:02:30.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.004+0000 7fcc837fe640 1 -- 172.21.15.78:0/1724193538 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fcc74042070 con 0x7fcc8c106800 2024-09-18T13:02:30.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.005+0000 7fcc837fe640 1 --2- 172.21.15.78:0/1724193538 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcc7807af30 0x7fcc7807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:30.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.005+0000 7fcc837fe640 1 -- 172.21.15.78:0/1724193538 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fcc740beb80 con 0x7fcc8c106800 2024-09-18T13:02:30.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.005+0000 7fcc8a59c640 1 --2- 172.21.15.78:0/1724193538 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcc7807af30 0x7fcc7807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:30.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.005+0000 7fcc8a59c640 1 --2- 172.21.15.78:0/1724193538 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcc7807af30 0x7fcc7807d3f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c005fd0 tx=0x7fcc7c005e20 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:30.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.009+0000 7fcc837fe640 1 -- 172.21.15.78:0/1724193538 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fcc7408a120 con 0x7fcc8c106800 2024-09-18T13:02:30.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.251+0000 7fcc908ce640 1 -- 172.21.15.78:0/1724193538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fcc8c06a7a0 con 0x7fcc8c106800 2024-09-18T13:02:30.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.255+0000 7fcc837fe640 1 -- 172.21.15.78:0/1724193538 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fcc7408efd0 con 0x7fcc8c106800 2024-09-18T13:02:30.256 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:02:30.256 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:02:30.256 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:02:30.256 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:02:30.256 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:02:30.256 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:02:30.256 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:02:30.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.257+0000 7fcc908ce640 1 -- 172.21.15.78:0/1724193538 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcc7807af30 msgr2=0x7fcc7807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:30.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.257+0000 7fcc908ce640 1 --2- 172.21.15.78:0/1724193538 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcc7807af30 0x7fcc7807d3f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c005fd0 tx=0x7fcc7c005e20 comp rx=0 tx=0).stop 2024-09-18T13:02:30.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.257+0000 7fcc908ce640 1 -- 172.21.15.78:0/1724193538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc8c106800 msgr2=0x7fcc8c198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:30.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.257+0000 7fcc908ce640 1 --2- 172.21.15.78:0/1724193538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc8c106800 0x7fcc8c198d60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcc74031460 tx=0x7fcc740048f0 comp rx=0 tx=0).stop 2024-09-18T13:02:30.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.257+0000 7fcc908ce640 1 -- 172.21.15.78:0/1724193538 shutdown_connections 2024-09-18T13:02:30.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.257+0000 7fcc908ce640 1 --2- 172.21.15.78:0/1724193538 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcc7807af30 0x7fcc7807d3f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:30.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.257+0000 7fcc908ce640 1 --2- 172.21.15.78:0/1724193538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc8c106800 0x7fcc8c198d60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:30.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.257+0000 7fcc908ce640 1 --2- 172.21.15.78:0/1724193538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc8c100800 0x7fcc8c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:30.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.257+0000 7fcc908ce640 1 -- 172.21.15.78:0/1724193538 >> 172.21.15.78:0/1724193538 conn(0x7fcc8c0fc520 msgr2=0x7fcc8c0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:30.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.257+0000 7fcc908ce640 1 -- 172.21.15.78:0/1724193538 shutdown_connections 2024-09-18T13:02:30.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:02:30.257+0000 7fcc908ce640 1 -- 172.21.15.78:0/1724193538 wait complete. 2024-09-18T13:02:30.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:30 smithi078 ceph-mon[108578]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:02:30.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:30 smithi078 ceph-mon[108578]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:02:30.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:30 smithi078 ceph-mon[108578]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:02:30.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:30 smithi078 ceph-mon[108578]: pgmap v400: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:30.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:30 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2948667753' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:02:30.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:30 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1477592083' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:02:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:30 smithi148 ceph-mon[80030]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:02:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:30 smithi148 ceph-mon[80030]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:02:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:30 smithi148 ceph-mon[80030]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:02:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:30 smithi148 ceph-mon[80030]: pgmap v400: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:30 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2948667753' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:02:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:30 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1477592083' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:02:31.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:31 smithi148 ceph-mon[80030]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:02:31.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:31 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1724193538' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:02:31.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:31 smithi078 ceph-mon[108578]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:02:31.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:31 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1724193538' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:02:32.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:32 smithi148 ceph-mon[80030]: pgmap v401: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:32 smithi078 ceph-mon[108578]: pgmap v401: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:34.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:34 smithi078 ceph-mon[108578]: pgmap v402: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:34 smithi148 ceph-mon[80030]: pgmap v402: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:36.713 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:36 smithi078 ceph-mon[108578]: pgmap v403: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:36 smithi148 ceph-mon[80030]: pgmap v403: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:38.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:38 smithi148 ceph-mon[80030]: pgmap v404: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:38.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:38 smithi078 ceph-mon[108578]: pgmap v404: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:40 smithi148 ceph-mon[80030]: pgmap v405: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:40.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:40 smithi078 ceph-mon[108578]: pgmap v405: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:41.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:42.709 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:42 smithi078 ceph-mon[108578]: pgmap v406: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:42.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:42 smithi148 ceph-mon[80030]: pgmap v406: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:44 smithi148 ceph-mon[80030]: pgmap v407: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:44.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:44 smithi078 ceph-mon[108578]: pgmap v407: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:46 smithi148 ceph-mon[80030]: pgmap v408: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:46.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:46 smithi078 ceph-mon[108578]: pgmap v408: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:48.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:48 smithi078 ceph-mon[108578]: pgmap v409: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:48.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:48 smithi148 ceph-mon[80030]: pgmap v409: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:50 smithi148 ceph-mon[80030]: pgmap v410: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:50 smithi078 ceph-mon[108578]: pgmap v410: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:52 smithi148 ceph-mon[80030]: pgmap v411: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:52.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:52 smithi078 ceph-mon[108578]: pgmap v411: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:54.711 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:54 smithi078 ceph-mon[108578]: pgmap v412: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:54.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:54 smithi148 ceph-mon[80030]: pgmap v412: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:56 smithi148 ceph-mon[80030]: pgmap v413: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:56.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:56 smithi078 ceph-mon[108578]: pgmap v413: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:02:58 smithi148 ceph-mon[80030]: pgmap v414: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:02:58.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:02:58 smithi078 ceph-mon[108578]: pgmap v414: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:00.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.351+0000 7f7551a03640 1 -- 172.21.15.78:0/1830864740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f754c106800 msgr2=0x7f754c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:00.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.351+0000 7f7551a03640 1 --2- 172.21.15.78:0/1830864740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f754c106800 0x7f754c106be0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f753c009880 tx=0x7f753c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.352+0000 7f7551a03640 1 -- 172.21.15.78:0/1830864740 shutdown_connections 2024-09-18T13:03:00.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.352+0000 7f7551a03640 1 --2- 172.21.15.78:0/1830864740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f754c100800 0x7f754c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.352+0000 7f7551a03640 1 --2- 172.21.15.78:0/1830864740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f754c106800 0x7f754c106be0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.352+0000 7f7551a03640 1 -- 172.21.15.78:0/1830864740 >> 172.21.15.78:0/1830864740 conn(0x7f754c0fc520 msgr2=0x7f754c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:00.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.352+0000 7f7551a03640 1 -- 172.21.15.78:0/1830864740 shutdown_connections 2024-09-18T13:03:00.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.352+0000 7f7551a03640 1 -- 172.21.15.78:0/1830864740 wait complete. 2024-09-18T13:03:00.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.352+0000 7f7551a03640 1 Processor -- start 2024-09-18T13:03:00.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.352+0000 7f7551a03640 1 -- start start 2024-09-18T13:03:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.352+0000 7f7551a03640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f754c100800 0x7f754c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.352+0000 7f7551a03640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f754c106800 0x7f754c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.352+0000 7f7551a03640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f754c10dcb0 con 0x7f754c100800 2024-09-18T13:03:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.352+0000 7f7551a03640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f754c10db30 con 0x7f754c106800 2024-09-18T13:03:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.353+0000 7f754affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f754c100800 0x7f754c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.353+0000 7f754affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f754c100800 0x7f754c1987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52174/0 (socket says 172.21.15.78:52174) 2024-09-18T13:03:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.353+0000 7f754affd640 1 -- 172.21.15.78:0/493048953 learned_addr learned my addr 172.21.15.78:0/493048953 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:03:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.353+0000 7f7543fff640 1 --2- 172.21.15.78:0/493048953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f754c106800 0x7f754c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.353+0000 7f754affd640 1 -- 172.21.15.78:0/493048953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f754c106800 msgr2=0x7f754c198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.353+0000 7f754affd640 1 --2- 172.21.15.78:0/493048953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f754c106800 0x7f754c198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.353+0000 7f754affd640 1 -- 172.21.15.78:0/493048953 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754c199320 con 0x7f754c100800 2024-09-18T13:03:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.353+0000 7f754affd640 1 --2- 172.21.15.78:0/493048953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f754c100800 0x7f754c1987e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f753c031460 tx=0x7f753c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.353+0000 7f7550a01640 1 -- 172.21.15.78:0/493048953 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f753c03f070 con 0x7f754c100800 2024-09-18T13:03:00.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.354+0000 7f7550a01640 1 -- 172.21.15.78:0/493048953 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f753c0035f0 con 0x7f754c100800 2024-09-18T13:03:00.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.354+0000 7f7551a03640 1 -- 172.21.15.78:0/493048953 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f754c1995b0 con 0x7f754c100800 2024-09-18T13:03:00.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.354+0000 7f7550a01640 1 -- 172.21.15.78:0/493048953 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f753c035030 con 0x7f754c100800 2024-09-18T13:03:00.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.354+0000 7f7551a03640 1 -- 172.21.15.78:0/493048953 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f754c1a1b60 con 0x7f754c100800 2024-09-18T13:03:00.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.355+0000 7f7551a03640 1 -- 172.21.15.78:0/493048953 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f754c101f40 con 0x7f754c100800 2024-09-18T13:03:00.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.356+0000 7f7550a01640 1 -- 172.21.15.78:0/493048953 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f753c042070 con 0x7f754c100800 2024-09-18T13:03:00.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.356+0000 7f7550a01640 1 --2- 172.21.15.78:0/493048953 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f753807af80 0x7f753807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:00.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.357+0000 7f7550a01640 1 -- 172.21.15.78:0/493048953 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f753c0be8c0 con 0x7f754c100800 2024-09-18T13:03:00.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.357+0000 7f7543fff640 1 --2- 172.21.15.78:0/493048953 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f753807af80 0x7f753807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:00.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.357+0000 7f7543fff640 1 --2- 172.21.15.78:0/493048953 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f753807af80 0x7f753807d440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f754c06ad00 tx=0x7f753400b410 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:00.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.361+0000 7f7550a01640 1 -- 172.21.15.78:0/493048953 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f753c089ee0 con 0x7f754c100800 2024-09-18T13:03:00.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.553+0000 7f7551a03640 1 -- 172.21.15.78:0/493048953 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f754c062630 con 0x7f753807af80 2024-09-18T13:03:00.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.555+0000 7f7550a01640 1 -- 172.21.15.78:0/493048953 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f754c062630 con 0x7f753807af80 2024-09-18T13:03:00.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.557+0000 7f7551a03640 1 -- 172.21.15.78:0/493048953 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f753807af80 msgr2=0x7f753807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:00.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.557+0000 7f7551a03640 1 --2- 172.21.15.78:0/493048953 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f753807af80 0x7f753807d440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f754c06ad00 tx=0x7f753400b410 comp rx=0 tx=0).stop 2024-09-18T13:03:00.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.557+0000 7f7551a03640 1 -- 172.21.15.78:0/493048953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f754c100800 msgr2=0x7f754c1987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:00.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.557+0000 7f7551a03640 1 --2- 172.21.15.78:0/493048953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f754c100800 0x7f754c1987e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f753c031460 tx=0x7f753c0045e0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.558 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:00 smithi078 ceph-mon[108578]: pgmap v415: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:00.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.557+0000 7f7551a03640 1 -- 172.21.15.78:0/493048953 shutdown_connections 2024-09-18T13:03:00.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.557+0000 7f7551a03640 1 --2- 172.21.15.78:0/493048953 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f753807af80 0x7f753807d440 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.557+0000 7f7551a03640 1 --2- 172.21.15.78:0/493048953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f754c106800 0x7f754c198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.557+0000 7f7551a03640 1 --2- 172.21.15.78:0/493048953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f754c100800 0x7f754c1987e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.557+0000 7f7551a03640 1 -- 172.21.15.78:0/493048953 >> 172.21.15.78:0/493048953 conn(0x7f754c0fc520 msgr2=0x7f754c0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:00.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.557+0000 7f7551a03640 1 -- 172.21.15.78:0/493048953 shutdown_connections 2024-09-18T13:03:00.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.557+0000 7f7551a03640 1 -- 172.21.15.78:0/493048953 wait complete. 2024-09-18T13:03:00.568 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:03:00.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.641+0000 7fb749dd7640 1 -- 172.21.15.78:0/566523863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb744100800 msgr2=0x7fb744100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:00.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.641+0000 7fb749dd7640 1 --2- 172.21.15.78:0/566523863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb744100800 0x7fb744100c60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009880 tx=0x7fb72c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.641+0000 7fb749dd7640 1 -- 172.21.15.78:0/566523863 shutdown_connections 2024-09-18T13:03:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.641+0000 7fb749dd7640 1 --2- 172.21.15.78:0/566523863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb744100800 0x7fb744100c60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.641+0000 7fb749dd7640 1 --2- 172.21.15.78:0/566523863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb744106800 0x7fb744106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.641+0000 7fb749dd7640 1 -- 172.21.15.78:0/566523863 >> 172.21.15.78:0/566523863 conn(0x7fb7440fc520 msgr2=0x7fb7440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.641+0000 7fb749dd7640 1 -- 172.21.15.78:0/566523863 shutdown_connections 2024-09-18T13:03:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.641+0000 7fb749dd7640 1 -- 172.21.15.78:0/566523863 wait complete. 2024-09-18T13:03:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.642+0000 7fb749dd7640 1 Processor -- start 2024-09-18T13:03:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.642+0000 7fb749dd7640 1 -- start start 2024-09-18T13:03:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.642+0000 7fb749dd7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb744100800 0x7fb74419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.642+0000 7fb749dd7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb744106800 0x7fb74419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.642+0000 7fb749dd7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb74410dcd0 con 0x7fb744106800 2024-09-18T13:03:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.642+0000 7fb749dd7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb74410db50 con 0x7fb744100800 2024-09-18T13:03:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.642+0000 7fb742ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb744106800 0x7fb74419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.642+0000 7fb742ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb744106800 0x7fb74419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52194/0 (socket says 172.21.15.78:52194) 2024-09-18T13:03:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.642+0000 7fb742ffd640 1 -- 172.21.15.78:0/3793473809 learned_addr learned my addr 172.21.15.78:0/3793473809 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:03:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.642+0000 7fb7437fe640 1 --2- 172.21.15.78:0/3793473809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb744100800 0x7fb74419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.642+0000 7fb742ffd640 1 -- 172.21.15.78:0/3793473809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb744100800 msgr2=0x7fb74419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.642+0000 7fb742ffd640 1 --2- 172.21.15.78:0/3793473809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb744100800 0x7fb74419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.642+0000 7fb742ffd640 1 -- 172.21.15.78:0/3793473809 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7441977f0 con 0x7fb744106800 2024-09-18T13:03:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.643+0000 7fb742ffd640 1 --2- 172.21.15.78:0/3793473809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb744106800 0x7fb74419dbb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb72c031460 tx=0x7fb72c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.643+0000 7fb740ff9640 1 -- 172.21.15.78:0/3793473809 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb72c03f070 con 0x7fb744106800 2024-09-18T13:03:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.643+0000 7fb749dd7640 1 -- 172.21.15.78:0/3793473809 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb744197a80 con 0x7fb744106800 2024-09-18T13:03:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.643+0000 7fb740ff9640 1 -- 172.21.15.78:0/3793473809 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb72c0035f0 con 0x7fb744106800 2024-09-18T13:03:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.643+0000 7fb740ff9640 1 -- 172.21.15.78:0/3793473809 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb72c035030 con 0x7fb744106800 2024-09-18T13:03:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.643+0000 7fb749dd7640 1 -- 172.21.15.78:0/3793473809 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb744197fb0 con 0x7fb744106800 2024-09-18T13:03:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.644+0000 7fb749dd7640 1 -- 172.21.15.78:0/3793473809 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb744101f40 con 0x7fb744106800 2024-09-18T13:03:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.644+0000 7fb740ff9640 1 -- 172.21.15.78:0/3793473809 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fb72c042070 con 0x7fb744106800 2024-09-18T13:03:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.645+0000 7fb740ff9640 1 --2- 172.21.15.78:0/3793473809 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb73007af30 0x7fb73007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.645+0000 7fb740ff9640 1 -- 172.21.15.78:0/3793473809 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fb72c0beae0 con 0x7fb744106800 2024-09-18T13:03:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.645+0000 7fb7437fe640 1 --2- 172.21.15.78:0/3793473809 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb73007af30 0x7fb73007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.645+0000 7fb7437fe640 1 --2- 172.21.15.78:0/3793473809 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb73007af30 0x7fb73007d3f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb734005fd0 tx=0x7fb734009870 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:00.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.649+0000 7fb740ff9640 1 -- 172.21.15.78:0/3793473809 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fb72c089fe0 con 0x7fb744106800 2024-09-18T13:03:00.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:00 smithi148 ceph-mon[80030]: pgmap v415: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.846+0000 7fb749dd7640 1 -- 172.21.15.78:0/3793473809 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb744198320 con 0x7fb73007af30 2024-09-18T13:03:00.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.847+0000 7fb740ff9640 1 -- 172.21.15.78:0/3793473809 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fb744198320 con 0x7fb73007af30 2024-09-18T13:03:00.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.849+0000 7fb749dd7640 1 -- 172.21.15.78:0/3793473809 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb73007af30 msgr2=0x7fb73007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.849+0000 7fb749dd7640 1 --2- 172.21.15.78:0/3793473809 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb73007af30 0x7fb73007d3f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb734005fd0 tx=0x7fb734009870 comp rx=0 tx=0).stop 2024-09-18T13:03:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.849+0000 7fb749dd7640 1 -- 172.21.15.78:0/3793473809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb744106800 msgr2=0x7fb74419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.849+0000 7fb749dd7640 1 --2- 172.21.15.78:0/3793473809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb744106800 0x7fb74419dbb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb72c031460 tx=0x7fb72c0045e0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.849+0000 7fb749dd7640 1 -- 172.21.15.78:0/3793473809 shutdown_connections 2024-09-18T13:03:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.849+0000 7fb749dd7640 1 --2- 172.21.15.78:0/3793473809 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb73007af30 0x7fb73007d3f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.849+0000 7fb749dd7640 1 --2- 172.21.15.78:0/3793473809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb744106800 0x7fb74419dbb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.849+0000 7fb749dd7640 1 --2- 172.21.15.78:0/3793473809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb744100800 0x7fb74419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.849+0000 7fb749dd7640 1 -- 172.21.15.78:0/3793473809 >> 172.21.15.78:0/3793473809 conn(0x7fb7440fc520 msgr2=0x7fb74406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.850+0000 7fb749dd7640 1 -- 172.21.15.78:0/3793473809 shutdown_connections 2024-09-18T13:03:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.850+0000 7fb749dd7640 1 -- 172.21.15.78:0/3793473809 wait complete. 2024-09-18T13:03:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.931+0000 7fd2bec01640 1 -- 172.21.15.78:0/2794461546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b8106800 msgr2=0x7fd2b8106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.931+0000 7fd2bec01640 1 --2- 172.21.15.78:0/2794461546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b8106800 0x7fd2b8106be0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009880 tx=0x7fd2ac02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.931+0000 7fd2bec01640 1 -- 172.21.15.78:0/2794461546 shutdown_connections 2024-09-18T13:03:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.931+0000 7fd2bec01640 1 --2- 172.21.15.78:0/2794461546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2b8100800 0x7fd2b8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.931+0000 7fd2bec01640 1 --2- 172.21.15.78:0/2794461546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b8106800 0x7fd2b8106be0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.931+0000 7fd2bec01640 1 -- 172.21.15.78:0/2794461546 >> 172.21.15.78:0/2794461546 conn(0x7fd2b80fc520 msgr2=0x7fd2b80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.931+0000 7fd2bec01640 1 -- 172.21.15.78:0/2794461546 shutdown_connections 2024-09-18T13:03:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.931+0000 7fd2bec01640 1 -- 172.21.15.78:0/2794461546 wait complete. 2024-09-18T13:03:00.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.931+0000 7fd2bec01640 1 Processor -- start 2024-09-18T13:03:00.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.931+0000 7fd2bec01640 1 -- start start 2024-09-18T13:03:00.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.932+0000 7fd2bec01640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b8100800 0x7fd2b8198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:00.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.932+0000 7fd2bec01640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2b8106800 0x7fd2b8198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:00.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.932+0000 7fd2bec01640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b810dd30 con 0x7fd2b8100800 2024-09-18T13:03:00.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.932+0000 7fd2bec01640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b810dbb0 con 0x7fd2b8106800 2024-09-18T13:03:00.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.932+0000 7fd2bc99d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b8100800 0x7fd2b8198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:00.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.932+0000 7fd2bc99d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b8100800 0x7fd2b8198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52206/0 (socket says 172.21.15.78:52206) 2024-09-18T13:03:00.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.932+0000 7fd2bc99d640 1 -- 172.21.15.78:0/684312272 learned_addr learned my addr 172.21.15.78:0/684312272 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:03:00.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.932+0000 7fd2b7fff640 1 --2- 172.21.15.78:0/684312272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2b8106800 0x7fd2b8198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:00.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.932+0000 7fd2bc99d640 1 -- 172.21.15.78:0/684312272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2b8106800 msgr2=0x7fd2b8198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:00.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.932+0000 7fd2bc99d640 1 --2- 172.21.15.78:0/684312272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2b8106800 0x7fd2b8198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:00.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.932+0000 7fd2bc99d640 1 -- 172.21.15.78:0/684312272 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b81993c0 con 0x7fd2b8100800 2024-09-18T13:03:00.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.932+0000 7fd2bc99d640 1 --2- 172.21.15.78:0/684312272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b8100800 0x7fd2b8198880 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac031460 tx=0x7fd2ac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:00.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.932+0000 7fd2b5ffb640 1 -- 172.21.15.78:0/684312272 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2ac03f070 con 0x7fd2b8100800 2024-09-18T13:03:00.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.932+0000 7fd2b5ffb640 1 -- 172.21.15.78:0/684312272 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd2ac004cf0 con 0x7fd2b8100800 2024-09-18T13:03:00.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.932+0000 7fd2bec01640 1 -- 172.21.15.78:0/684312272 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b8199650 con 0x7fd2b8100800 2024-09-18T13:03:00.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.933+0000 7fd2b5ffb640 1 -- 172.21.15.78:0/684312272 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2ac035030 con 0x7fd2b8100800 2024-09-18T13:03:00.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.933+0000 7fd2bec01640 1 -- 172.21.15.78:0/684312272 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b81a1c00 con 0x7fd2b8100800 2024-09-18T13:03:00.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.934+0000 7fd2bec01640 1 -- 172.21.15.78:0/684312272 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b8101f40 con 0x7fd2b8100800 2024-09-18T13:03:00.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.934+0000 7fd2b5ffb640 1 -- 172.21.15.78:0/684312272 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd2ac042070 con 0x7fd2b8100800 2024-09-18T13:03:00.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.935+0000 7fd2b5ffb640 1 --2- 172.21.15.78:0/684312272 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd2a807af30 0x7fd2a807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:00.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.935+0000 7fd2b5ffb640 1 -- 172.21.15.78:0/684312272 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fd2ac0beb60 con 0x7fd2b8100800 2024-09-18T13:03:00.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.935+0000 7fd2b7fff640 1 --2- 172.21.15.78:0/684312272 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd2a807af30 0x7fd2a807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:00.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.935+0000 7fd2b7fff640 1 --2- 172.21.15.78:0/684312272 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd2a807af30 0x7fd2a807d3f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd2b806ad00 tx=0x7fd2a4008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:00.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:00.939+0000 7fd2b5ffb640 1 -- 172.21.15.78:0/684312272 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd2ac08a100 con 0x7fd2b8100800 2024-09-18T13:03:01.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.120+0000 7fd2bec01640 1 -- 172.21.15.78:0/684312272 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd2b8062630 con 0x7fd2a807af30 2024-09-18T13:03:01.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.130+0000 7fd2b5ffb640 1 -- 172.21.15.78:0/684312272 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fd2b8062630 con 0x7fd2a807af30 2024-09-18T13:03:01.131 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:03:01.131 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (10m) 5m ago 21m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:03:01.131 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (13m) 5m ago 22m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:03:01.131 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (13m) 4m ago 21m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:03:01.131 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (9m) 5m ago 21m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:03:01.132 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (9m) 4m ago 21m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:03:01.132 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (10m) 5m ago 21m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:03:01.132 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (5m) 5m ago 16m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:03:01.132 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (5m) 5m ago 16m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:03:01.132 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (4m) 4m ago 16m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:03:01.132 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (4m) 4m ago 16m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:03:01.132 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (13m) 5m ago 23m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:03:01.132 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (11m) 4m ago 20m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:03:01.132 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (9m) 5m ago 23m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:03:01.132 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (9m) 4m ago 20m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:03:01.132 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (11m) 5m ago 21m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:03:01.132 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (11m) 4m ago 21m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:03:01.132 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (8m) 5m ago 19m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:03:01.133 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (8m) 5m ago 19m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:03:01.133 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (7m) 5m ago 18m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:03:01.133 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (6m) 4m ago 18m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:03:01.133 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (6m) 4m ago 17m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:03:01.133 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (5m) 4m ago 17m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:03:01.133 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (11m) 5m ago 21m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:03:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.132+0000 7fd2bec01640 1 -- 172.21.15.78:0/684312272 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd2a807af30 msgr2=0x7fd2a807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.132+0000 7fd2bec01640 1 --2- 172.21.15.78:0/684312272 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd2a807af30 0x7fd2a807d3f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd2b806ad00 tx=0x7fd2a4008040 comp rx=0 tx=0).stop 2024-09-18T13:03:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.132+0000 7fd2bec01640 1 -- 172.21.15.78:0/684312272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b8100800 msgr2=0x7fd2b8198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.132+0000 7fd2bec01640 1 --2- 172.21.15.78:0/684312272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b8100800 0x7fd2b8198880 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac031460 tx=0x7fd2ac0048f0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.132+0000 7fd2bec01640 1 -- 172.21.15.78:0/684312272 shutdown_connections 2024-09-18T13:03:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.132+0000 7fd2bec01640 1 --2- 172.21.15.78:0/684312272 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd2a807af30 0x7fd2a807d3f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.132+0000 7fd2bec01640 1 --2- 172.21.15.78:0/684312272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2b8106800 0x7fd2b8198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.132+0000 7fd2bec01640 1 --2- 172.21.15.78:0/684312272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b8100800 0x7fd2b8198880 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.132+0000 7fd2bec01640 1 -- 172.21.15.78:0/684312272 >> 172.21.15.78:0/684312272 conn(0x7fd2b80fc520 msgr2=0x7fd2b80fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.132+0000 7fd2bec01640 1 -- 172.21.15.78:0/684312272 shutdown_connections 2024-09-18T13:03:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.132+0000 7fd2bec01640 1 -- 172.21.15.78:0/684312272 wait complete. 2024-09-18T13:03:01.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.213+0000 7f5f49e19640 1 -- 172.21.15.78:0/3234255555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f44101900 msgr2=0x7f5f44101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:01.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.213+0000 7f5f49e19640 1 --2- 172.21.15.78:0/3234255555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f44101900 0x7f5f44101d60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009880 tx=0x7f5f3802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.213+0000 7f5f49e19640 1 -- 172.21.15.78:0/3234255555 shutdown_connections 2024-09-18T13:03:01.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.213+0000 7f5f49e19640 1 --2- 172.21.15.78:0/3234255555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f44101900 0x7f5f44101d60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.213+0000 7f5f49e19640 1 --2- 172.21.15.78:0/3234255555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f44107900 0x7f5f44107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.213+0000 7f5f49e19640 1 -- 172.21.15.78:0/3234255555 >> 172.21.15.78:0/3234255555 conn(0x7f5f440fd600 msgr2=0x7f5f440ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:01.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.213+0000 7f5f49e19640 1 -- 172.21.15.78:0/3234255555 shutdown_connections 2024-09-18T13:03:01.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.213+0000 7f5f49e19640 1 -- 172.21.15.78:0/3234255555 wait complete. 2024-09-18T13:03:01.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.214+0000 7f5f49e19640 1 Processor -- start 2024-09-18T13:03:01.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.214+0000 7f5f49e19640 1 -- start start 2024-09-18T13:03:01.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.214+0000 7f5f49e19640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f44101900 0x7f5f4419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:01.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.214+0000 7f5f49e19640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f44107900 0x7f5f4419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:01.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.214+0000 7f5f49e19640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4410edd0 con 0x7f5f44107900 2024-09-18T13:03:01.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.214+0000 7f5f49e19640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4410ec50 con 0x7f5f44101900 2024-09-18T13:03:01.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.214+0000 7f5f42ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f44107900 0x7f5f4419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:01.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.214+0000 7f5f42ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f44107900 0x7f5f4419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50012/0 (socket says 172.21.15.78:50012) 2024-09-18T13:03:01.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.214+0000 7f5f42ffd640 1 -- 172.21.15.78:0/3547661105 learned_addr learned my addr 172.21.15.78:0/3547661105 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:03:01.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.214+0000 7f5f437fe640 1 --2- 172.21.15.78:0/3547661105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f44101900 0x7f5f4419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:01.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.214+0000 7f5f42ffd640 1 -- 172.21.15.78:0/3547661105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f44101900 msgr2=0x7f5f4419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:01.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.214+0000 7f5f42ffd640 1 --2- 172.21.15.78:0/3547661105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f44101900 0x7f5f4419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.215+0000 7f5f42ffd640 1 -- 172.21.15.78:0/3547661105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f44197800 con 0x7f5f44107900 2024-09-18T13:03:01.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.215+0000 7f5f437fe640 1 --2- 172.21.15.78:0/3547661105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f44101900 0x7f5f4419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:03:01.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.215+0000 7f5f42ffd640 1 --2- 172.21.15.78:0/3547661105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f44107900 0x7f5f4419dbc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5f38031460 tx=0x7f5f380045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:01.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.215+0000 7f5f40ff9640 1 -- 172.21.15.78:0/3547661105 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f3803f070 con 0x7f5f44107900 2024-09-18T13:03:01.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.215+0000 7f5f40ff9640 1 -- 172.21.15.78:0/3547661105 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f380035f0 con 0x7f5f44107900 2024-09-18T13:03:01.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.215+0000 7f5f40ff9640 1 -- 172.21.15.78:0/3547661105 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f38035030 con 0x7f5f44107900 2024-09-18T13:03:01.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.215+0000 7f5f49e19640 1 -- 172.21.15.78:0/3547661105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f44197a90 con 0x7f5f44107900 2024-09-18T13:03:01.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.215+0000 7f5f49e19640 1 -- 172.21.15.78:0/3547661105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f44197fc0 con 0x7f5f44107900 2024-09-18T13:03:01.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.216+0000 7f5f49e19640 1 -- 172.21.15.78:0/3547661105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f44103040 con 0x7f5f44107900 2024-09-18T13:03:01.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.217+0000 7f5f40ff9640 1 -- 172.21.15.78:0/3547661105 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5f38042070 con 0x7f5f44107900 2024-09-18T13:03:01.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.217+0000 7f5f40ff9640 1 --2- 172.21.15.78:0/3547661105 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5f2c07af30 0x7f5f2c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:01.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.217+0000 7f5f40ff9640 1 -- 172.21.15.78:0/3547661105 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f5f380bea80 con 0x7f5f44107900 2024-09-18T13:03:01.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.217+0000 7f5f437fe640 1 --2- 172.21.15.78:0/3547661105 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5f2c07af30 0x7f5f2c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:01.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.218+0000 7f5f437fe640 1 --2- 172.21.15.78:0/3547661105 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5f2c07af30 0x7f5f2c07d3f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009b40 tx=0x7f5f34005e50 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:01.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.221+0000 7f5f40ff9640 1 -- 172.21.15.78:0/3547661105 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5f3808a020 con 0x7f5f44107900 2024-09-18T13:03:01.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.466+0000 7f5f49e19640 1 -- 172.21.15.78:0/3547661105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5f44109e70 con 0x7f5f44107900 2024-09-18T13:03:01.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.466+0000 7f5f40ff9640 1 -- 172.21.15.78:0/3547661105 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f5f3808c070 con 0x7f5f44107900 2024-09-18T13:03:01.468 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:03:01.468 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:03:01.468 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:03:01.468 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:03:01.468 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:03:01.468 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:03:01.468 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:03:01.468 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:03:01.469 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:03:01.469 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:03:01.469 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:03:01.469 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:03:01.469 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:03:01.469 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:03:01.469 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:03:01.469 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:03:01.469 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:03:01.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.469+0000 7f5f49e19640 1 -- 172.21.15.78:0/3547661105 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5f2c07af30 msgr2=0x7f5f2c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.469+0000 7f5f49e19640 1 --2- 172.21.15.78:0/3547661105 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5f2c07af30 0x7f5f2c07d3f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009b40 tx=0x7f5f34005e50 comp rx=0 tx=0).stop 2024-09-18T13:03:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.469+0000 7f5f49e19640 1 -- 172.21.15.78:0/3547661105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f44107900 msgr2=0x7f5f4419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.469+0000 7f5f49e19640 1 --2- 172.21.15.78:0/3547661105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f44107900 0x7f5f4419dbc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5f38031460 tx=0x7f5f380045e0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.469+0000 7f5f49e19640 1 -- 172.21.15.78:0/3547661105 shutdown_connections 2024-09-18T13:03:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.469+0000 7f5f49e19640 1 --2- 172.21.15.78:0/3547661105 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5f2c07af30 0x7f5f2c07d3f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.469+0000 7f5f49e19640 1 --2- 172.21.15.78:0/3547661105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f44107900 0x7f5f4419dbc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.469+0000 7f5f49e19640 1 --2- 172.21.15.78:0/3547661105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f44101900 0x7f5f4419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.469+0000 7f5f49e19640 1 -- 172.21.15.78:0/3547661105 >> 172.21.15.78:0/3547661105 conn(0x7f5f440fd600 msgr2=0x7f5f440fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.469+0000 7f5f49e19640 1 -- 172.21.15.78:0/3547661105 shutdown_connections 2024-09-18T13:03:01.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.469+0000 7f5f49e19640 1 -- 172.21.15.78:0/3547661105 wait complete. 2024-09-18T13:03:01.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.549+0000 7fcf6b4e6640 1 -- 172.21.15.78:0/666094984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf64100800 msgr2=0x7fcf64100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:01.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.549+0000 7fcf6b4e6640 1 --2- 172.21.15.78:0/666094984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf64100800 0x7fcf64100c60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009880 tx=0x7fcf5402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.549+0000 7fcf6b4e6640 1 -- 172.21.15.78:0/666094984 shutdown_connections 2024-09-18T13:03:01.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.549+0000 7fcf6b4e6640 1 --2- 172.21.15.78:0/666094984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf64100800 0x7fcf64100c60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.549+0000 7fcf6b4e6640 1 --2- 172.21.15.78:0/666094984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf64106800 0x7fcf64106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.549+0000 7fcf6b4e6640 1 -- 172.21.15.78:0/666094984 >> 172.21.15.78:0/666094984 conn(0x7fcf640fc520 msgr2=0x7fcf640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:01.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.549+0000 7fcf6b4e6640 1 -- 172.21.15.78:0/666094984 shutdown_connections 2024-09-18T13:03:01.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.549+0000 7fcf6b4e6640 1 -- 172.21.15.78:0/666094984 wait complete. 2024-09-18T13:03:01.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.550+0000 7fcf6b4e6640 1 Processor -- start 2024-09-18T13:03:01.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.550+0000 7fcf6b4e6640 1 -- start start 2024-09-18T13:03:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.550+0000 7fcf6b4e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf64100800 0x7fcf640fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.550+0000 7fcf6b4e6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf64106800 0x7fcf640fd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.550+0000 7fcf6b4e6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6410dcd0 con 0x7fcf64100800 2024-09-18T13:03:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.550+0000 7fcf6b4e6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6410db50 con 0x7fcf64106800 2024-09-18T13:03:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.550+0000 7fcf69282640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf64100800 0x7fcf640fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.550+0000 7fcf69282640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf64100800 0x7fcf640fcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50032/0 (socket says 172.21.15.78:50032) 2024-09-18T13:03:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.550+0000 7fcf69282640 1 -- 172.21.15.78:0/520142414 learned_addr learned my addr 172.21.15.78:0/520142414 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:03:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.550+0000 7fcf68a81640 1 --2- 172.21.15.78:0/520142414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf64106800 0x7fcf640fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.550+0000 7fcf69282640 1 -- 172.21.15.78:0/520142414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf64106800 msgr2=0x7fcf640fd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.550+0000 7fcf69282640 1 --2- 172.21.15.78:0/520142414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf64106800 0x7fcf640fd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.550+0000 7fcf69282640 1 -- 172.21.15.78:0/520142414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf640fd6d0 con 0x7fcf64100800 2024-09-18T13:03:01.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.550+0000 7fcf68a81640 1 --2- 172.21.15.78:0/520142414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf64106800 0x7fcf640fd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:03:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.551+0000 7fcf69282640 1 --2- 172.21.15.78:0/520142414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf64100800 0x7fcf640fcc50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000d6f0 tx=0x7fcf6000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.551+0000 7fcf5a7fc640 1 -- 172.21.15.78:0/520142414 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf60017070 con 0x7fcf64100800 2024-09-18T13:03:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.551+0000 7fcf5a7fc640 1 -- 172.21.15.78:0/520142414 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcf6000de00 con 0x7fcf64100800 2024-09-18T13:03:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.551+0000 7fcf6b4e6640 1 -- 172.21.15.78:0/520142414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf640fd9c0 con 0x7fcf64100800 2024-09-18T13:03:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.551+0000 7fcf5a7fc640 1 -- 172.21.15.78:0/520142414 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf60004bb0 con 0x7fcf64100800 2024-09-18T13:03:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.551+0000 7fcf6b4e6640 1 -- 172.21.15.78:0/520142414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf641a3e70 con 0x7fcf64100800 2024-09-18T13:03:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.552+0000 7fcf6b4e6640 1 -- 172.21.15.78:0/520142414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf64101f40 con 0x7fcf64100800 2024-09-18T13:03:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.552+0000 7fcf5a7fc640 1 -- 172.21.15.78:0/520142414 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fcf60009a30 con 0x7fcf64100800 2024-09-18T13:03:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.553+0000 7fcf5a7fc640 1 --2- 172.21.15.78:0/520142414 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcf5007af80 0x7fcf5007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.553+0000 7fcf5a7fc640 1 -- 172.21.15.78:0/520142414 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fcf6009dbe0 con 0x7fcf64100800 2024-09-18T13:03:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.553+0000 7fcf68a81640 1 --2- 172.21.15.78:0/520142414 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcf5007af80 0x7fcf5007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.553+0000 7fcf68a81640 1 --2- 172.21.15.78:0/520142414 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcf5007af80 0x7fcf5007d440 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcf640fe6e0 tx=0x7fcf54031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:01.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.557+0000 7fcf5a7fc640 1 -- 172.21.15.78:0/520142414 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fcf60069200 con 0x7fcf64100800 2024-09-18T13:03:01.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.768+0000 7fcf6b4e6640 1 -- 172.21.15.78:0/520142414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fcf64109d80 con 0x7fcf64100800 2024-09-18T13:03:01.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.768+0000 7fcf5a7fc640 1 -- 172.21.15.78:0/520142414 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7fcf6005ee20 con 0x7fcf64100800 2024-09-18T13:03:01.769 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:03:01.770 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:03:01.770 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:03:01.770 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:03:01.770 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:03:01.770 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:03:01.770 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:03:01.770 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:03:01.770 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:03:01.770 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:03:01.770 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:03:01.770 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:03:01.771 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:03:01.771 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:03:01.771 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:03:01.771 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:03:01.771 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:03:01.771 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:03:01.771 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:03:01.771 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:03:01.771 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:03:01.771 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:03:01.771 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:03:01.771 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:03:01.771 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:03:01.772 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:03:01.772 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:03:01.772 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:03:01.772 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:03:01.772 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:03:01.772 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:03:01.772 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:03:01.772 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:03:01.772 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:03:01.772 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:03:01.772 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:03:01.772 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:03:01.772 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:03:01.772 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:03:01.773 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:01.773 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:01.773 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:01.773 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:03:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.770+0000 7fcf6b4e6640 1 -- 172.21.15.78:0/520142414 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcf5007af80 msgr2=0x7fcf5007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.770+0000 7fcf6b4e6640 1 --2- 172.21.15.78:0/520142414 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcf5007af80 0x7fcf5007d440 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcf640fe6e0 tx=0x7fcf54031400 comp rx=0 tx=0).stop 2024-09-18T13:03:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.770+0000 7fcf6b4e6640 1 -- 172.21.15.78:0/520142414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf64100800 msgr2=0x7fcf640fcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.770+0000 7fcf6b4e6640 1 --2- 172.21.15.78:0/520142414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf64100800 0x7fcf640fcc50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000d6f0 tx=0x7fcf6000dbb0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.770+0000 7fcf6b4e6640 1 -- 172.21.15.78:0/520142414 shutdown_connections 2024-09-18T13:03:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.770+0000 7fcf6b4e6640 1 --2- 172.21.15.78:0/520142414 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fcf5007af80 0x7fcf5007d440 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.770+0000 7fcf6b4e6640 1 --2- 172.21.15.78:0/520142414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf64106800 0x7fcf640fd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.770+0000 7fcf6b4e6640 1 --2- 172.21.15.78:0/520142414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf64100800 0x7fcf640fcc50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.770+0000 7fcf6b4e6640 1 -- 172.21.15.78:0/520142414 >> 172.21.15.78:0/520142414 conn(0x7fcf640fc520 msgr2=0x7fcf6406a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.771+0000 7fcf6b4e6640 1 -- 172.21.15.78:0/520142414 shutdown_connections 2024-09-18T13:03:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.771+0000 7fcf6b4e6640 1 -- 172.21.15.78:0/520142414 wait complete. 2024-09-18T13:03:01.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.853+0000 7fafefe1e640 1 -- 172.21.15.78:0/2626220593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe8101900 msgr2=0x7fafe8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:01.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.853+0000 7fafefe1e640 1 --2- 172.21.15.78:0/2626220593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe8101900 0x7fafe8101d60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fafd8009880 tx=0x7fafd802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.853+0000 7fafefe1e640 1 -- 172.21.15.78:0/2626220593 shutdown_connections 2024-09-18T13:03:01.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.853+0000 7fafefe1e640 1 --2- 172.21.15.78:0/2626220593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe8101900 0x7fafe8101d60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.853+0000 7fafefe1e640 1 --2- 172.21.15.78:0/2626220593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafe8107900 0x7fafe8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.853+0000 7fafefe1e640 1 -- 172.21.15.78:0/2626220593 >> 172.21.15.78:0/2626220593 conn(0x7fafe80fd620 msgr2=0x7fafe80ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:01.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.853+0000 7fafefe1e640 1 -- 172.21.15.78:0/2626220593 shutdown_connections 2024-09-18T13:03:01.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.853+0000 7fafefe1e640 1 -- 172.21.15.78:0/2626220593 wait complete. 2024-09-18T13:03:01.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.853+0000 7fafefe1e640 1 Processor -- start 2024-09-18T13:03:01.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.853+0000 7fafefe1e640 1 -- start start 2024-09-18T13:03:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafefe1e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe8101900 0x7fafe819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafefe1e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafe8107900 0x7fafe819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafefe1e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fafe810ee30 con 0x7fafe8101900 2024-09-18T13:03:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafefe1e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fafe810ecb0 con 0x7fafe8107900 2024-09-18T13:03:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafedbba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe8101900 0x7fafe819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafedbba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe8101900 0x7fafe819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50042/0 (socket says 172.21.15.78:50042) 2024-09-18T13:03:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafedbba640 1 -- 172.21.15.78:0/3356415709 learned_addr learned my addr 172.21.15.78:0/3356415709 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:03:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafed3b9640 1 --2- 172.21.15.78:0/3356415709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafe8107900 0x7fafe819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafedbba640 1 -- 172.21.15.78:0/3356415709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafe8107900 msgr2=0x7fafe819dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafedbba640 1 --2- 172.21.15.78:0/3356415709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafe8107900 0x7fafe819dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafedbba640 1 -- 172.21.15.78:0/3356415709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe8197840 con 0x7fafe8101900 2024-09-18T13:03:01.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafedbba640 1 --2- 172.21.15.78:0/3356415709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe8101900 0x7fafe819d6c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fafe400b420 tx=0x7fafe400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:01.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafdeffd640 1 -- 172.21.15.78:0/3356415709 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafe4011630 con 0x7fafe8101900 2024-09-18T13:03:01.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafefe1e640 1 -- 172.21.15.78:0/3356415709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafe8197b30 con 0x7fafe8101900 2024-09-18T13:03:01.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafdeffd640 1 -- 172.21.15.78:0/3356415709 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fafe4016070 con 0x7fafe8101900 2024-09-18T13:03:01.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafdeffd640 1 -- 172.21.15.78:0/3356415709 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafe4010d40 con 0x7fafe8101900 2024-09-18T13:03:01.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.854+0000 7fafefe1e640 1 -- 172.21.15.78:0/3356415709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafe8198090 con 0x7fafe8101900 2024-09-18T13:03:01.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.855+0000 7fafefe1e640 1 -- 172.21.15.78:0/3356415709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafe8103040 con 0x7fafe8101900 2024-09-18T13:03:01.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.856+0000 7fafdeffd640 1 -- 172.21.15.78:0/3356415709 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fafe401b460 con 0x7fafe8101900 2024-09-18T13:03:01.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.857+0000 7fafdeffd640 1 --2- 172.21.15.78:0/3356415709 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fafd407af30 0x7fafd407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:01.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.857+0000 7fafdeffd640 1 -- 172.21.15.78:0/3356415709 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fafe409d7f0 con 0x7fafe8101900 2024-09-18T13:03:01.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.857+0000 7fafed3b9640 1 --2- 172.21.15.78:0/3356415709 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fafd407af30 0x7fafd407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:01.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.857+0000 7fafed3b9640 1 --2- 172.21.15.78:0/3356415709 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fafd407af30 0x7fafd407d3f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fafe8198b90 tx=0x7fafd8031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:01.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:01.862+0000 7fafdeffd640 1 -- 172.21.15.78:0/3356415709 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fafe4021250 con 0x7fafe8101900 2024-09-18T13:03:02.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.052+0000 7fafefe1e640 1 -- 172.21.15.78:0/3356415709 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fafe8198400 con 0x7fafd407af30 2024-09-18T13:03:02.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.054+0000 7fafdeffd640 1 -- 172.21.15.78:0/3356415709 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fafe8198400 con 0x7fafd407af30 2024-09-18T13:03:02.055 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:03:02.055 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:03:02.055 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:03:02.055 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:03:02.055 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:03:02.055 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:03:02.055 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:03:02.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:03:02.055 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:03:02.055 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:03:02.056 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:03:02.056 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:03:02.056 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:03:02.056 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:03:02.056 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:03:02.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.056+0000 7fafefe1e640 1 -- 172.21.15.78:0/3356415709 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fafd407af30 msgr2=0x7fafd407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:02.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.056+0000 7fafefe1e640 1 --2- 172.21.15.78:0/3356415709 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fafd407af30 0x7fafd407d3f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fafe8198b90 tx=0x7fafd8031400 comp rx=0 tx=0).stop 2024-09-18T13:03:02.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.056+0000 7fafefe1e640 1 -- 172.21.15.78:0/3356415709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe8101900 msgr2=0x7fafe819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:02.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.056+0000 7fafefe1e640 1 --2- 172.21.15.78:0/3356415709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe8101900 0x7fafe819d6c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fafe400b420 tx=0x7fafe400b8e0 comp rx=0 tx=0).stop 2024-09-18T13:03:02.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.056+0000 7fafefe1e640 1 -- 172.21.15.78:0/3356415709 shutdown_connections 2024-09-18T13:03:02.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.056+0000 7fafefe1e640 1 --2- 172.21.15.78:0/3356415709 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fafd407af30 0x7fafd407d3f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:02.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.056+0000 7fafefe1e640 1 --2- 172.21.15.78:0/3356415709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafe8107900 0x7fafe819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:02.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.056+0000 7fafefe1e640 1 --2- 172.21.15.78:0/3356415709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafe8101900 0x7fafe819d6c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:02.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.056+0000 7fafefe1e640 1 -- 172.21.15.78:0/3356415709 >> 172.21.15.78:0/3356415709 conn(0x7fafe80fd620 msgr2=0x7fafe80fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:02.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.056+0000 7fafefe1e640 1 -- 172.21.15.78:0/3356415709 shutdown_connections 2024-09-18T13:03:02.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.056+0000 7fafefe1e640 1 -- 172.21.15.78:0/3356415709 wait complete. 2024-09-18T13:03:02.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.137+0000 7f9122a76640 1 -- 172.21.15.78:0/3267687826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c106800 msgr2=0x7f911c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:02.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.137+0000 7f9122a76640 1 --2- 172.21.15.78:0/3267687826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c106800 0x7f911c106be0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9110009880 tx=0x7f911002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:02.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.137+0000 7f9122a76640 1 -- 172.21.15.78:0/3267687826 shutdown_connections 2024-09-18T13:03:02.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.137+0000 7f9122a76640 1 --2- 172.21.15.78:0/3267687826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f911c100800 0x7f911c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:02.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.137+0000 7f9122a76640 1 --2- 172.21.15.78:0/3267687826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c106800 0x7f911c106be0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:02.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.137+0000 7f9122a76640 1 -- 172.21.15.78:0/3267687826 >> 172.21.15.78:0/3267687826 conn(0x7f911c0fc520 msgr2=0x7f911c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:02.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.137+0000 7f9122a76640 1 -- 172.21.15.78:0/3267687826 shutdown_connections 2024-09-18T13:03:02.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.137+0000 7f9122a76640 1 -- 172.21.15.78:0/3267687826 wait complete. 2024-09-18T13:03:02.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.137+0000 7f9122a76640 1 Processor -- start 2024-09-18T13:03:02.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.138+0000 7f9122a76640 1 -- start start 2024-09-18T13:03:02.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.138+0000 7f9122a76640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c100800 0x7f911c107730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:02.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.138+0000 7f9122a76640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f911c106800 0x7f911c107c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:02.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.138+0000 7f9122a76640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f911c10dcb0 con 0x7f911c100800 2024-09-18T13:03:02.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.138+0000 7f9122a76640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f911c10db30 con 0x7f911c106800 2024-09-18T13:03:02.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.138+0000 7f9120812640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c100800 0x7f911c107730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:02.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.138+0000 7f9120812640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c100800 0x7f911c107730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50056/0 (socket says 172.21.15.78:50056) 2024-09-18T13:03:02.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.138+0000 7f9120812640 1 -- 172.21.15.78:0/2713212115 learned_addr learned my addr 172.21.15.78:0/2713212115 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:03:02.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.138+0000 7f911bfff640 1 --2- 172.21.15.78:0/2713212115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f911c106800 0x7f911c107c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:02.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.138+0000 7f9120812640 1 -- 172.21.15.78:0/2713212115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f911c106800 msgr2=0x7f911c107c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.138+0000 7f9120812640 1 --2- 172.21.15.78:0/2713212115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f911c106800 0x7f911c107c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.138+0000 7f9120812640 1 -- 172.21.15.78:0/2713212115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911c1081b0 con 0x7f911c100800 2024-09-18T13:03:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.138+0000 7f911bfff640 1 --2- 172.21.15.78:0/2713212115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f911c106800 0x7f911c107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:03:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.138+0000 7f9120812640 1 --2- 172.21.15.78:0/2713212115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c100800 0x7f911c107730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9110031460 tx=0x7f91100045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.139+0000 7f9119ffb640 1 -- 172.21.15.78:0/2713212115 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f911003f070 con 0x7f911c100800 2024-09-18T13:03:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.139+0000 7f9122a76640 1 -- 172.21.15.78:0/2713212115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f911c108440 con 0x7f911c100800 2024-09-18T13:03:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.139+0000 7f9119ffb640 1 -- 172.21.15.78:0/2713212115 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f91100035f0 con 0x7f911c100800 2024-09-18T13:03:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.139+0000 7f9119ffb640 1 -- 172.21.15.78:0/2713212115 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9110035030 con 0x7f911c100800 2024-09-18T13:03:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.139+0000 7f9122a76640 1 -- 172.21.15.78:0/2713212115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f911c1a3eb0 con 0x7f911c100800 2024-09-18T13:03:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.140+0000 7f9122a76640 1 -- 172.21.15.78:0/2713212115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f911c101f40 con 0x7f911c100800 2024-09-18T13:03:02.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.140+0000 7f9119ffb640 1 -- 172.21.15.78:0/2713212115 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9110042070 con 0x7f911c100800 2024-09-18T13:03:02.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.141+0000 7f9119ffb640 1 --2- 172.21.15.78:0/2713212115 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f910c07af30 0x7f910c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:02.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.141+0000 7f9119ffb640 1 -- 172.21.15.78:0/2713212115 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f91100bea80 con 0x7f911c100800 2024-09-18T13:03:02.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.141+0000 7f911bfff640 1 --2- 172.21.15.78:0/2713212115 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f910c07af30 0x7f910c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:02.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.141+0000 7f911bfff640 1 --2- 172.21.15.78:0/2713212115 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f910c07af30 0x7f910c07d3f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f911c1091c0 tx=0x7f910800b5f0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:02.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.145+0000 7f9119ffb640 1 -- 172.21.15.78:0/2713212115 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f911008a020 con 0x7f911c100800 2024-09-18T13:03:02.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.394+0000 7f9122a76640 1 -- 172.21.15.78:0/2713212115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f911c1a41c0 con 0x7f911c100800 2024-09-18T13:03:02.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.394+0000 7f9119ffb640 1 -- 172.21.15.78:0/2713212115 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f911008c020 con 0x7f911c100800 2024-09-18T13:03:02.395 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:03:02.396 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:03:02.396 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:03:02.396 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:03:02.396 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:03:02.396 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:03:02.396 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:03:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.396+0000 7f9122a76640 1 -- 172.21.15.78:0/2713212115 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f910c07af30 msgr2=0x7f910c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.396+0000 7f9122a76640 1 --2- 172.21.15.78:0/2713212115 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f910c07af30 0x7f910c07d3f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f911c1091c0 tx=0x7f910800b5f0 comp rx=0 tx=0).stop 2024-09-18T13:03:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.397+0000 7f9122a76640 1 -- 172.21.15.78:0/2713212115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c100800 msgr2=0x7f911c107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.397+0000 7f9122a76640 1 --2- 172.21.15.78:0/2713212115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c100800 0x7f911c107730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9110031460 tx=0x7f91100045e0 comp rx=0 tx=0).stop 2024-09-18T13:03:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.397+0000 7f9122a76640 1 -- 172.21.15.78:0/2713212115 shutdown_connections 2024-09-18T13:03:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.397+0000 7f9122a76640 1 --2- 172.21.15.78:0/2713212115 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f910c07af30 0x7f910c07d3f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.397+0000 7f9122a76640 1 --2- 172.21.15.78:0/2713212115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f911c106800 0x7f911c107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.397+0000 7f9122a76640 1 --2- 172.21.15.78:0/2713212115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c100800 0x7f911c107730 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.397+0000 7f9122a76640 1 -- 172.21.15.78:0/2713212115 >> 172.21.15.78:0/2713212115 conn(0x7f911c0fc520 msgr2=0x7f911c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.397+0000 7f9122a76640 1 -- 172.21.15.78:0/2713212115 shutdown_connections 2024-09-18T13:03:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:02.397+0000 7f9122a76640 1 -- 172.21.15.78:0/2713212115 wait complete. 2024-09-18T13:03:02.662 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:02 smithi148 ceph-mon[80030]: from='client.34610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:02.662 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:02 smithi148 ceph-mon[80030]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:02.662 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:02 smithi148 ceph-mon[80030]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:02.662 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:02 smithi148 ceph-mon[80030]: pgmap v416: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:02.662 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:02 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3547661105' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:02.663 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:02 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/520142414' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:03:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:02 smithi078 ceph-mon[108578]: from='client.34610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:02 smithi078 ceph-mon[108578]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:02 smithi078 ceph-mon[108578]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:02 smithi078 ceph-mon[108578]: pgmap v416: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:02 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3547661105' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:02 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/520142414' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:03:03.645 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:03 smithi078 ceph-mon[108578]: from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:03.645 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:03 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2713212115' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:03:03.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:03 smithi148 ceph-mon[80030]: from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:03.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:03 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2713212115' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:03:04.638 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:04 smithi078 ceph-mon[108578]: pgmap v417: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:04 smithi148 ceph-mon[80030]: pgmap v417: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:06.700 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:06 smithi078 ceph-mon[108578]: pgmap v418: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:06.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:06 smithi148 ceph-mon[80030]: pgmap v418: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:08.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:08 smithi148 ceph-mon[80030]: pgmap v419: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:08.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:08 smithi078 ceph-mon[108578]: pgmap v419: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:10 smithi148 ceph-mon[80030]: pgmap v420: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:10.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:10 smithi078 ceph-mon[108578]: pgmap v420: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:11.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:12.711 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:12 smithi078 ceph-mon[108578]: pgmap v421: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:12.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:12 smithi148 ceph-mon[80030]: pgmap v421: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:14 smithi148 ceph-mon[80030]: pgmap v422: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:14 smithi078 ceph-mon[108578]: pgmap v422: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:16.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:16 smithi148 ceph-mon[80030]: pgmap v423: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:16 smithi078 ceph-mon[108578]: pgmap v423: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:18.714 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:18 smithi078 ceph-mon[108578]: pgmap v424: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:18.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:18 smithi148 ceph-mon[80030]: pgmap v424: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:20 smithi148 ceph-mon[80030]: pgmap v425: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:20.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:20 smithi078 ceph-mon[108578]: pgmap v425: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:22 smithi148 ceph-mon[80030]: pgmap v426: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:22.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:22 smithi078 ceph-mon[108578]: pgmap v426: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:24.704 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:24 smithi078 ceph-mon[108578]: pgmap v427: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:24.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:24 smithi148 ceph-mon[80030]: pgmap v427: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:26 smithi148 ceph-mon[80030]: pgmap v428: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:26 smithi078 ceph-mon[108578]: pgmap v428: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:28.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:28 smithi148 ceph-mon[80030]: pgmap v429: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:28.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:28 smithi078 ceph-mon[108578]: pgmap v429: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:30.701 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:30 smithi078 ceph-mon[108578]: pgmap v430: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:30.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:30 smithi148 ceph-mon[80030]: pgmap v430: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:32.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.490+0000 7f9ad03fe640 1 -- 172.21.15.78:0/1251341589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac8103440 msgr2=0x7f9ac810b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:32.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.490+0000 7f9ad03fe640 1 --2- 172.21.15.78:0/1251341589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac8103440 0x7f9ac810b930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80098b0 tx=0x7f9ab802a560 comp rx=0 tx=0).stop 2024-09-18T13:03:32.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.490+0000 7f9ad03fe640 1 -- 172.21.15.78:0/1251341589 shutdown_connections 2024-09-18T13:03:32.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.490+0000 7f9ad03fe640 1 --2- 172.21.15.78:0/1251341589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac8103440 0x7f9ac810b930 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.490+0000 7f9ad03fe640 1 --2- 172.21.15.78:0/1251341589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac8102b20 0x7f9ac8102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.490+0000 7f9ad03fe640 1 -- 172.21.15.78:0/1251341589 >> 172.21.15.78:0/1251341589 conn(0x7f9ac80fc520 msgr2=0x7f9ac80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:32.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.490+0000 7f9ad03fe640 1 -- 172.21.15.78:0/1251341589 shutdown_connections 2024-09-18T13:03:32.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.490+0000 7f9ad03fe640 1 -- 172.21.15.78:0/1251341589 wait complete. 2024-09-18T13:03:32.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.491+0000 7f9ad03fe640 1 Processor -- start 2024-09-18T13:03:32.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.491+0000 7f9ad03fe640 1 -- start start 2024-09-18T13:03:32.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.491+0000 7f9ad03fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac8102b20 0x7f9ac8100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:32.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.491+0000 7f9ad03fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac8103440 0x7f9ac8100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:32.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.491+0000 7f9ad03fe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac810edd0 con 0x7f9ac8103440 2024-09-18T13:03:32.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.491+0000 7f9ad03fe640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac810ec50 con 0x7f9ac8102b20 2024-09-18T13:03:32.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.491+0000 7f9acd999640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac8103440 0x7f9ac8100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:32.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.491+0000 7f9acd999640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac8103440 0x7f9ac8100cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60464/0 (socket says 172.21.15.78:60464) 2024-09-18T13:03:32.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.491+0000 7f9acd999640 1 -- 172.21.15.78:0/4292299949 learned_addr learned my addr 172.21.15.78:0/4292299949 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:03:32.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.492+0000 7f9ace19a640 1 --2- 172.21.15.78:0/4292299949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac8102b20 0x7f9ac8100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:32.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.492+0000 7f9acd999640 1 -- 172.21.15.78:0/4292299949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac8102b20 msgr2=0x7f9ac8100780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:32.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.492+0000 7f9acd999640 1 --2- 172.21.15.78:0/4292299949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac8102b20 0x7f9ac8100780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.492+0000 7f9acd999640 1 -- 172.21.15.78:0/4292299949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac8101200 con 0x7f9ac8103440 2024-09-18T13:03:32.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.492+0000 7f9ace19a640 1 --2- 172.21.15.78:0/4292299949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac8102b20 0x7f9ac8100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:03:32.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.492+0000 7f9acd999640 1 --2- 172.21.15.78:0/4292299949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac8103440 0x7f9ac8100cc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8031460 tx=0x7f9ab80045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:32.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.492+0000 7f9abf7fe640 1 -- 172.21.15.78:0/4292299949 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ab803f070 con 0x7f9ac8103440 2024-09-18T13:03:32.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.492+0000 7f9abf7fe640 1 -- 172.21.15.78:0/4292299949 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9ab80035f0 con 0x7f9ac8103440 2024-09-18T13:03:32.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.492+0000 7f9abf7fe640 1 -- 172.21.15.78:0/4292299949 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ab8035030 con 0x7f9ac8103440 2024-09-18T13:03:32.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.492+0000 7f9ad03fe640 1 -- 172.21.15.78:0/4292299949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac8101490 con 0x7f9ac8103440 2024-09-18T13:03:32.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.492+0000 7f9ad03fe640 1 -- 172.21.15.78:0/4292299949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac81a3de0 con 0x7f9ac8103440 2024-09-18T13:03:32.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.493+0000 7f9ad03fe640 1 -- 172.21.15.78:0/4292299949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac806aa30 con 0x7f9ac8103440 2024-09-18T13:03:32.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.494+0000 7f9abf7fe640 1 -- 172.21.15.78:0/4292299949 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9ab8042070 con 0x7f9ac8103440 2024-09-18T13:03:32.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.494+0000 7f9abf7fe640 1 --2- 172.21.15.78:0/4292299949 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9ab407af80 0x7f9ab407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:32.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.494+0000 7f9abf7fe640 1 -- 172.21.15.78:0/4292299949 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f9ab80be920 con 0x7f9ac8103440 2024-09-18T13:03:32.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.494+0000 7f9ace19a640 1 --2- 172.21.15.78:0/4292299949 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9ab407af80 0x7f9ab407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:32.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.495+0000 7f9ace19a640 1 --2- 172.21.15.78:0/4292299949 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9ab407af80 0x7f9ab407d440 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009b40 tx=0x7f9ac4005e50 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:32.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.499+0000 7f9abf7fe640 1 -- 172.21.15.78:0/4292299949 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9ab8089f40 con 0x7f9ac8103440 2024-09-18T13:03:32.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.692+0000 7f9ad03fe640 1 -- 172.21.15.78:0/4292299949 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9ac8062630 con 0x7f9ab407af80 2024-09-18T13:03:32.693 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:32 smithi078 ceph-mon[108578]: pgmap v431: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:32.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.693+0000 7f9abf7fe640 1 -- 172.21.15.78:0/4292299949 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9ac8062630 con 0x7f9ab407af80 2024-09-18T13:03:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.696+0000 7f9ad03fe640 1 -- 172.21.15.78:0/4292299949 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9ab407af80 msgr2=0x7f9ab407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.696+0000 7f9ad03fe640 1 --2- 172.21.15.78:0/4292299949 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9ab407af80 0x7f9ab407d440 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009b40 tx=0x7f9ac4005e50 comp rx=0 tx=0).stop 2024-09-18T13:03:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.696+0000 7f9ad03fe640 1 -- 172.21.15.78:0/4292299949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac8103440 msgr2=0x7f9ac8100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.696+0000 7f9ad03fe640 1 --2- 172.21.15.78:0/4292299949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac8103440 0x7f9ac8100cc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8031460 tx=0x7f9ab80045c0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.696+0000 7f9ad03fe640 1 -- 172.21.15.78:0/4292299949 shutdown_connections 2024-09-18T13:03:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.696+0000 7f9ad03fe640 1 --2- 172.21.15.78:0/4292299949 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9ab407af80 0x7f9ab407d440 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.696+0000 7f9ad03fe640 1 --2- 172.21.15.78:0/4292299949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac8103440 0x7f9ac8100cc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.696+0000 7f9ad03fe640 1 --2- 172.21.15.78:0/4292299949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac8102b20 0x7f9ac8100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.696+0000 7f9ad03fe640 1 -- 172.21.15.78:0/4292299949 >> 172.21.15.78:0/4292299949 conn(0x7f9ac80fc520 msgr2=0x7f9ac8103d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.696+0000 7f9ad03fe640 1 -- 172.21.15.78:0/4292299949 shutdown_connections 2024-09-18T13:03:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.696+0000 7f9ad03fe640 1 -- 172.21.15.78:0/4292299949 wait complete. 2024-09-18T13:03:32.706 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:03:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:32 smithi148 ceph-mon[80030]: pgmap v431: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:32.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.780+0000 7fbdf649e640 1 -- 172.21.15.78:0/1458073798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdf01067f0 msgr2=0x7fbdf0106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:32.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.780+0000 7fbdf649e640 1 --2- 172.21.15.78:0/1458073798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdf01067f0 0x7fbdf0106bd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009880 tx=0x7fbde002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.780+0000 7fbdf649e640 1 -- 172.21.15.78:0/1458073798 shutdown_connections 2024-09-18T13:03:32.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.780+0000 7fbdf649e640 1 --2- 172.21.15.78:0/1458073798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdf01007f0 0x7fbdf0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.780+0000 7fbdf649e640 1 --2- 172.21.15.78:0/1458073798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdf01067f0 0x7fbdf0106bd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.780+0000 7fbdf649e640 1 -- 172.21.15.78:0/1458073798 >> 172.21.15.78:0/1458073798 conn(0x7fbdf00fc550 msgr2=0x7fbdf00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.780+0000 7fbdf649e640 1 -- 172.21.15.78:0/1458073798 shutdown_connections 2024-09-18T13:03:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.780+0000 7fbdf649e640 1 -- 172.21.15.78:0/1458073798 wait complete. 2024-09-18T13:03:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.780+0000 7fbdf649e640 1 Processor -- start 2024-09-18T13:03:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.780+0000 7fbdf649e640 1 -- start start 2024-09-18T13:03:32.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.781+0000 7fbdf649e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdf01007f0 0x7fbdf019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:32.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.781+0000 7fbdf649e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdf01067f0 0x7fbdf019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:32.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.781+0000 7fbdf649e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf010dca0 con 0x7fbdf01067f0 2024-09-18T13:03:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.781+0000 7fbdf649e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf010db20 con 0x7fbdf01007f0 2024-09-18T13:03:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.781+0000 7fbdef7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdf01067f0 0x7fbdf019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.781+0000 7fbdef7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdf01067f0 0x7fbdf019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60474/0 (socket says 172.21.15.78:60474) 2024-09-18T13:03:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.781+0000 7fbdef7fe640 1 -- 172.21.15.78:0/1262389596 learned_addr learned my addr 172.21.15.78:0/1262389596 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:03:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.781+0000 7fbdeffff640 1 --2- 172.21.15.78:0/1262389596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdf01007f0 0x7fbdf019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.781+0000 7fbdef7fe640 1 -- 172.21.15.78:0/1262389596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdf01007f0 msgr2=0x7fbdf019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.781+0000 7fbdef7fe640 1 --2- 172.21.15.78:0/1262389596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdf01007f0 0x7fbdf019d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.781+0000 7fbdef7fe640 1 -- 172.21.15.78:0/1262389596 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf0197870 con 0x7fbdf01067f0 2024-09-18T13:03:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.781+0000 7fbdeffff640 1 --2- 172.21.15.78:0/1262389596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdf01007f0 0x7fbdf019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:03:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.781+0000 7fbdef7fe640 1 --2- 172.21.15.78:0/1262389596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdf01067f0 0x7fbdf019dbf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbde400c8a0 tx=0x7fbde400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.781+0000 7fbded7fa640 1 -- 172.21.15.78:0/1262389596 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbde40079b0 con 0x7fbdf01067f0 2024-09-18T13:03:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.782+0000 7fbded7fa640 1 -- 172.21.15.78:0/1262389596 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbde4007b50 con 0x7fbdf01067f0 2024-09-18T13:03:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.782+0000 7fbded7fa640 1 -- 172.21.15.78:0/1262389596 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbde4018700 con 0x7fbdf01067f0 2024-09-18T13:03:32.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.782+0000 7fbdf649e640 1 -- 172.21.15.78:0/1262389596 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf0197b00 con 0x7fbdf01067f0 2024-09-18T13:03:32.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.782+0000 7fbdf649e640 1 -- 172.21.15.78:0/1262389596 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf0198090 con 0x7fbdf01067f0 2024-09-18T13:03:32.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.783+0000 7fbdf649e640 1 -- 172.21.15.78:0/1262389596 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf019e2f0 con 0x7fbdf01067f0 2024-09-18T13:03:32.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.783+0000 7fbded7fa640 1 -- 172.21.15.78:0/1262389596 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbde4007d00 con 0x7fbdf01067f0 2024-09-18T13:03:32.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.784+0000 7fbded7fa640 1 --2- 172.21.15.78:0/1262389596 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbdd807af40 0x7fbdd807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:32.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.784+0000 7fbded7fa640 1 -- 172.21.15.78:0/1262389596 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fbde409e2e0 con 0x7fbdf01067f0 2024-09-18T13:03:32.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.784+0000 7fbdeffff640 1 --2- 172.21.15.78:0/1262389596 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbdd807af40 0x7fbdd807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:32.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.784+0000 7fbdeffff640 1 --2- 172.21.15.78:0/1262389596 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbdd807af40 0x7fbdd807d400 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbde0000c00 tx=0x7fbde00095a0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:32.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.788+0000 7fbded7fa640 1 -- 172.21.15.78:0/1262389596 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbde4014030 con 0x7fbdf01067f0 2024-09-18T13:03:32.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.978+0000 7fbdf649e640 1 -- 172.21.15.78:0/1262389596 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbdf0198da0 con 0x7fbdd807af40 2024-09-18T13:03:32.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.979+0000 7fbded7fa640 1 -- 172.21.15.78:0/1262389596 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fbdf0198da0 con 0x7fbdd807af40 2024-09-18T13:03:32.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.982+0000 7fbdf649e640 1 -- 172.21.15.78:0/1262389596 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbdd807af40 msgr2=0x7fbdd807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:32.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.982+0000 7fbdf649e640 1 --2- 172.21.15.78:0/1262389596 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbdd807af40 0x7fbdd807d400 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbde0000c00 tx=0x7fbde00095a0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.982+0000 7fbdf649e640 1 -- 172.21.15.78:0/1262389596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdf01067f0 msgr2=0x7fbdf019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:32.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.982+0000 7fbdf649e640 1 --2- 172.21.15.78:0/1262389596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdf01067f0 0x7fbdf019dbf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbde400c8a0 tx=0x7fbde400cd60 comp rx=0 tx=0).stop 2024-09-18T13:03:32.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.982+0000 7fbdf649e640 1 -- 172.21.15.78:0/1262389596 shutdown_connections 2024-09-18T13:03:32.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.982+0000 7fbdf649e640 1 --2- 172.21.15.78:0/1262389596 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbdd807af40 0x7fbdd807d400 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.982+0000 7fbdf649e640 1 --2- 172.21.15.78:0/1262389596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdf01067f0 0x7fbdf019dbf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.982+0000 7fbdf649e640 1 --2- 172.21.15.78:0/1262389596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdf01007f0 0x7fbdf019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.982+0000 7fbdf649e640 1 -- 172.21.15.78:0/1262389596 >> 172.21.15.78:0/1262389596 conn(0x7fbdf00fc550 msgr2=0x7fbdf0109f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:32.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.982+0000 7fbdf649e640 1 -- 172.21.15.78:0/1262389596 shutdown_connections 2024-09-18T13:03:32.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:32.982+0000 7fbdf649e640 1 -- 172.21.15.78:0/1262389596 wait complete. 2024-09-18T13:03:33.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.063+0000 7f5c7ecfa640 1 -- 172.21.15.78:0/677083629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c781033e0 msgr2=0x7f5c7810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.063+0000 7f5c7ecfa640 1 --2- 172.21.15.78:0/677083629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c781033e0 0x7f5c7810b8d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009880 tx=0x7f5c6802a530 comp rx=0 tx=0).stop 2024-09-18T13:03:33.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.063+0000 7f5c7ecfa640 1 -- 172.21.15.78:0/677083629 shutdown_connections 2024-09-18T13:03:33.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.063+0000 7f5c7ecfa640 1 --2- 172.21.15.78:0/677083629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c781033e0 0x7f5c7810b8d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.063+0000 7f5c7ecfa640 1 --2- 172.21.15.78:0/677083629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c78102ac0 0x7f5c78102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.063+0000 7f5c7ecfa640 1 -- 172.21.15.78:0/677083629 >> 172.21.15.78:0/677083629 conn(0x7f5c780fc520 msgr2=0x7f5c780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.063+0000 7f5c7ecfa640 1 -- 172.21.15.78:0/677083629 shutdown_connections 2024-09-18T13:03:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.063+0000 7f5c7ecfa640 1 -- 172.21.15.78:0/677083629 wait complete. 2024-09-18T13:03:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.064+0000 7f5c7ecfa640 1 Processor -- start 2024-09-18T13:03:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.064+0000 7f5c7ecfa640 1 -- start start 2024-09-18T13:03:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.064+0000 7f5c7ecfa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c78102ac0 0x7f5c7819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.064+0000 7f5c7ecfa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c781033e0 0x7f5c7819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.064+0000 7f5c7ecfa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7810ee50 con 0x7f5c781033e0 2024-09-18T13:03:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.064+0000 7f5c7ecfa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7810ecd0 con 0x7f5c78102ac0 2024-09-18T13:03:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.064+0000 7f5c6ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c781033e0 0x7f5c7819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.064+0000 7f5c6ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c781033e0 0x7f5c7819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60502/0 (socket says 172.21.15.78:60502) 2024-09-18T13:03:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.064+0000 7f5c6ffff640 1 -- 172.21.15.78:0/2335332903 learned_addr learned my addr 172.21.15.78:0/2335332903 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:03:33.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.065+0000 7f5c7ca96640 1 --2- 172.21.15.78:0/2335332903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c78102ac0 0x7f5c7819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:33.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.065+0000 7f5c6ffff640 1 -- 172.21.15.78:0/2335332903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c78102ac0 msgr2=0x7f5c7819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.065+0000 7f5c6ffff640 1 --2- 172.21.15.78:0/2335332903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c78102ac0 0x7f5c7819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.065+0000 7f5c6ffff640 1 -- 172.21.15.78:0/2335332903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c78197860 con 0x7f5c781033e0 2024-09-18T13:03:33.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.065+0000 7f5c6ffff640 1 --2- 172.21.15.78:0/2335332903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c781033e0 0x7f5c7819dbe0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5c68031460 tx=0x7f5c680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:33.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.065+0000 7f5c6dffb640 1 -- 172.21.15.78:0/2335332903 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c6803f070 con 0x7f5c781033e0 2024-09-18T13:03:33.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.065+0000 7f5c7ecfa640 1 -- 172.21.15.78:0/2335332903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c78197af0 con 0x7f5c781033e0 2024-09-18T13:03:33.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.065+0000 7f5c6dffb640 1 -- 172.21.15.78:0/2335332903 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c68004ac0 con 0x7f5c781033e0 2024-09-18T13:03:33.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.065+0000 7f5c6dffb640 1 -- 172.21.15.78:0/2335332903 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c68035030 con 0x7f5c781033e0 2024-09-18T13:03:33.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.065+0000 7f5c7ecfa640 1 -- 172.21.15.78:0/2335332903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c78198020 con 0x7f5c781033e0 2024-09-18T13:03:33.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.066+0000 7f5c7ecfa640 1 -- 172.21.15.78:0/2335332903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c7806aa90 con 0x7f5c781033e0 2024-09-18T13:03:33.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.067+0000 7f5c6dffb640 1 -- 172.21.15.78:0/2335332903 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5c68042070 con 0x7f5c781033e0 2024-09-18T13:03:33.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.067+0000 7f5c6dffb640 1 --2- 172.21.15.78:0/2335332903 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5c6007af80 0x7f5c6007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:33.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.067+0000 7f5c6dffb640 1 -- 172.21.15.78:0/2335332903 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f5c680bea80 con 0x7f5c781033e0 2024-09-18T13:03:33.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.067+0000 7f5c7ca96640 1 --2- 172.21.15.78:0/2335332903 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5c6007af80 0x7f5c6007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:33.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.068+0000 7f5c7ca96640 1 --2- 172.21.15.78:0/2335332903 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5c6007af80 0x7f5c6007d440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5c781989a0 tx=0x7f5c74008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:33.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.072+0000 7f5c6dffb640 1 -- 172.21.15.78:0/2335332903 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5c6808a0a0 con 0x7f5c781033e0 2024-09-18T13:03:33.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.254+0000 7f5c7ecfa640 1 -- 172.21.15.78:0/2335332903 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5c78198d90 con 0x7f5c6007af80 2024-09-18T13:03:33.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.263+0000 7f5c6dffb640 1 -- 172.21.15.78:0/2335332903 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5c78198d90 con 0x7f5c6007af80 2024-09-18T13:03:33.264 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:03:33.264 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (11m) 5m ago 22m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:03:33.265 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (13m) 5m ago 22m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:03:33.265 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (13m) 5m ago 21m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:03:33.265 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (9m) 5m ago 22m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:03:33.265 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (9m) 5m ago 21m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:03:33.265 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (11m) 5m ago 22m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:03:33.265 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (5m) 5m ago 17m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:03:33.265 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (5m) 5m ago 16m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:03:33.265 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (5m) 5m ago 17m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:03:33.265 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (5m) 5m ago 16m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:03:33.265 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (13m) 5m ago 23m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:03:33.265 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (12m) 5m ago 21m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:03:33.265 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (10m) 5m ago 23m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:03:33.265 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (9m) 5m ago 21m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:03:33.266 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (12m) 5m ago 22m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:03:33.266 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (12m) 5m ago 21m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:03:33.266 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (9m) 5m ago 20m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:03:33.266 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (8m) 5m ago 19m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:03:33.266 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (7m) 5m ago 19m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:03:33.266 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (7m) 5m ago 18m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:03:33.266 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (6m) 5m ago 18m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:03:33.266 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (6m) 5m ago 18m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:03:33.266 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (11m) 5m ago 21m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:03:33.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.266+0000 7f5c7ecfa640 1 -- 172.21.15.78:0/2335332903 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5c6007af80 msgr2=0x7f5c6007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.266+0000 7f5c7ecfa640 1 --2- 172.21.15.78:0/2335332903 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5c6007af80 0x7f5c6007d440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5c781989a0 tx=0x7f5c74008040 comp rx=0 tx=0).stop 2024-09-18T13:03:33.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.266+0000 7f5c7ecfa640 1 -- 172.21.15.78:0/2335332903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c781033e0 msgr2=0x7f5c7819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.266+0000 7f5c7ecfa640 1 --2- 172.21.15.78:0/2335332903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c781033e0 0x7f5c7819dbe0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5c68031460 tx=0x7f5c680046c0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.266+0000 7f5c7ecfa640 1 -- 172.21.15.78:0/2335332903 shutdown_connections 2024-09-18T13:03:33.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.266+0000 7f5c7ecfa640 1 --2- 172.21.15.78:0/2335332903 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5c6007af80 0x7f5c6007d440 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.266+0000 7f5c7ecfa640 1 --2- 172.21.15.78:0/2335332903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c781033e0 0x7f5c7819dbe0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.266+0000 7f5c7ecfa640 1 --2- 172.21.15.78:0/2335332903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c78102ac0 0x7f5c7819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.266+0000 7f5c7ecfa640 1 -- 172.21.15.78:0/2335332903 >> 172.21.15.78:0/2335332903 conn(0x7f5c780fc520 msgr2=0x7f5c78108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:33.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.266+0000 7f5c7ecfa640 1 -- 172.21.15.78:0/2335332903 shutdown_connections 2024-09-18T13:03:33.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.266+0000 7f5c7ecfa640 1 -- 172.21.15.78:0/2335332903 wait complete. 2024-09-18T13:03:33.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.347+0000 7f8a1fe5c640 1 -- 172.21.15.78:0/1736760383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a18074f40 msgr2=0x7f8a1810dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.347+0000 7f8a1fe5c640 1 --2- 172.21.15.78:0/1736760383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a18074f40 0x7f8a1810dc00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009880 tx=0x7f8a0802a530 comp rx=0 tx=0).stop 2024-09-18T13:03:33.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.347+0000 7f8a1fe5c640 1 -- 172.21.15.78:0/1736760383 shutdown_connections 2024-09-18T13:03:33.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.347+0000 7f8a1fe5c640 1 --2- 172.21.15.78:0/1736760383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a18074f40 0x7f8a1810dc00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.347+0000 7f8a1fe5c640 1 --2- 172.21.15.78:0/1736760383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a18074620 0x7f8a18074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.347+0000 7f8a1fe5c640 1 -- 172.21.15.78:0/1736760383 >> 172.21.15.78:0/1736760383 conn(0x7f8a180fd5e0 msgr2=0x7f8a180ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:33.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.347+0000 7f8a1fe5c640 1 -- 172.21.15.78:0/1736760383 shutdown_connections 2024-09-18T13:03:33.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.347+0000 7f8a1fe5c640 1 -- 172.21.15.78:0/1736760383 wait complete. 2024-09-18T13:03:33.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.347+0000 7f8a1fe5c640 1 Processor -- start 2024-09-18T13:03:33.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.348+0000 7f8a1fe5c640 1 -- start start 2024-09-18T13:03:33.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.348+0000 7f8a1fe5c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a18074620 0x7f8a1819f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.348+0000 7f8a1fe5c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a18074f40 0x7f8a1819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.348+0000 7f8a1fe5c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8a18111050 con 0x7f8a18074f40 2024-09-18T13:03:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.348+0000 7f8a1fe5c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8a18110ed0 con 0x7f8a18074620 2024-09-18T13:03:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.348+0000 7f8a1d3f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a18074f40 0x7f8a1819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.348+0000 7f8a1d3f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a18074f40 0x7f8a1819fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60516/0 (socket says 172.21.15.78:60516) 2024-09-18T13:03:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.348+0000 7f8a1d3f7640 1 -- 172.21.15.78:0/1085484999 learned_addr learned my addr 172.21.15.78:0/1085484999 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:03:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.348+0000 7f8a1dbf8640 1 --2- 172.21.15.78:0/1085484999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a18074620 0x7f8a1819f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.348+0000 7f8a1d3f7640 1 -- 172.21.15.78:0/1085484999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a18074620 msgr2=0x7f8a1819f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.348+0000 7f8a1d3f7640 1 --2- 172.21.15.78:0/1085484999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a18074620 0x7f8a1819f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.348+0000 7f8a1d3f7640 1 -- 172.21.15.78:0/1085484999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a18199a60 con 0x7f8a18074f40 2024-09-18T13:03:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.348+0000 7f8a1d3f7640 1 --2- 172.21.15.78:0/1085484999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a18074f40 0x7f8a1819fde0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8a08031460 tx=0x7f8a080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.348+0000 7f8a16ffd640 1 -- 172.21.15.78:0/1085484999 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a0803f070 con 0x7f8a18074f40 2024-09-18T13:03:33.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.349+0000 7f8a1fe5c640 1 -- 172.21.15.78:0/1085484999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a18199cf0 con 0x7f8a18074f40 2024-09-18T13:03:33.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.349+0000 7f8a16ffd640 1 -- 172.21.15.78:0/1085484999 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a08004cf0 con 0x7f8a18074f40 2024-09-18T13:03:33.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.349+0000 7f8a16ffd640 1 -- 172.21.15.78:0/1085484999 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a08035030 con 0x7f8a18074f40 2024-09-18T13:03:33.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.349+0000 7f8a1fe5c640 1 -- 172.21.15.78:0/1085484999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a1819a220 con 0x7f8a18074f40 2024-09-18T13:03:33.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.349+0000 7f8a1fe5c640 1 -- 172.21.15.78:0/1085484999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a18075cd0 con 0x7f8a18074f40 2024-09-18T13:03:33.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.350+0000 7f8a16ffd640 1 -- 172.21.15.78:0/1085484999 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8a08042070 con 0x7f8a18074f40 2024-09-18T13:03:33.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.351+0000 7f8a16ffd640 1 --2- 172.21.15.78:0/1085484999 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a0007af30 0x7f8a0007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:33.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.351+0000 7f8a16ffd640 1 -- 172.21.15.78:0/1085484999 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f8a080bec00 con 0x7f8a18074f40 2024-09-18T13:03:33.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.351+0000 7f8a1dbf8640 1 --2- 172.21.15.78:0/1085484999 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a0007af30 0x7f8a0007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:33.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.351+0000 7f8a1dbf8640 1 --2- 172.21.15.78:0/1085484999 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a0007af30 0x7f8a0007d3f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8a1819aba0 tx=0x7f8a0c008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:33.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.356+0000 7f8a16ffd640 1 -- 172.21.15.78:0/1085484999 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8a0808a100 con 0x7f8a18074f40 2024-09-18T13:03:33.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.601+0000 7f8a1fe5c640 1 -- 172.21.15.78:0/1085484999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8a1819aff0 con 0x7f8a18074f40 2024-09-18T13:03:33.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.601+0000 7f8a16ffd640 1 -- 172.21.15.78:0/1085484999 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f8a0808efb0 con 0x7f8a18074f40 2024-09-18T13:03:33.602 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:03:33.602 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:03:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:03:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:03:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:03:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:03:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:03:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:03:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:03:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:03:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:03:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:03:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:03:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:03:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:03:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:03:33.604 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:03:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.603+0000 7f8a1fe5c640 1 -- 172.21.15.78:0/1085484999 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a0007af30 msgr2=0x7f8a0007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.603+0000 7f8a1fe5c640 1 --2- 172.21.15.78:0/1085484999 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a0007af30 0x7f8a0007d3f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8a1819aba0 tx=0x7f8a0c008040 comp rx=0 tx=0).stop 2024-09-18T13:03:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.603+0000 7f8a1fe5c640 1 -- 172.21.15.78:0/1085484999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a18074f40 msgr2=0x7f8a1819fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.603+0000 7f8a1fe5c640 1 --2- 172.21.15.78:0/1085484999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a18074f40 0x7f8a1819fde0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8a08031460 tx=0x7f8a080048f0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.604+0000 7f8a1fe5c640 1 -- 172.21.15.78:0/1085484999 shutdown_connections 2024-09-18T13:03:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.604+0000 7f8a1fe5c640 1 --2- 172.21.15.78:0/1085484999 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8a0007af30 0x7f8a0007d3f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.604+0000 7f8a1fe5c640 1 --2- 172.21.15.78:0/1085484999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a18074f40 0x7f8a1819fde0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.604+0000 7f8a1fe5c640 1 --2- 172.21.15.78:0/1085484999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a18074620 0x7f8a1819f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.604+0000 7f8a1fe5c640 1 -- 172.21.15.78:0/1085484999 >> 172.21.15.78:0/1085484999 conn(0x7f8a180fd5e0 msgr2=0x7f8a1810d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.604+0000 7f8a1fe5c640 1 -- 172.21.15.78:0/1085484999 shutdown_connections 2024-09-18T13:03:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.604+0000 7f8a1fe5c640 1 -- 172.21.15.78:0/1085484999 wait complete. 2024-09-18T13:03:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.686+0000 7f13c6059640 1 -- 172.21.15.78:0/3235979334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c0101900 msgr2=0x7f13c0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.686+0000 7f13c6059640 1 --2- 172.21.15.78:0/3235979334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c0101900 0x7f13c0101d60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009880 tx=0x7f13b402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.687+0000 7f13c6059640 1 -- 172.21.15.78:0/3235979334 shutdown_connections 2024-09-18T13:03:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.687+0000 7f13c6059640 1 --2- 172.21.15.78:0/3235979334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c0101900 0x7f13c0101d60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.687+0000 7f13c6059640 1 --2- 172.21.15.78:0/3235979334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13c0107900 0x7f13c0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.687+0000 7f13c6059640 1 -- 172.21.15.78:0/3235979334 >> 172.21.15.78:0/3235979334 conn(0x7f13c00fd600 msgr2=0x7f13c00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.687+0000 7f13c6059640 1 -- 172.21.15.78:0/3235979334 shutdown_connections 2024-09-18T13:03:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.687+0000 7f13c6059640 1 -- 172.21.15.78:0/3235979334 wait complete. 2024-09-18T13:03:33.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.687+0000 7f13c6059640 1 Processor -- start 2024-09-18T13:03:33.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.687+0000 7f13c6059640 1 -- start start 2024-09-18T13:03:33.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13c6059640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c0101900 0x7f13c019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:33.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13c6059640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13c0107900 0x7f13c019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:33.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13c6059640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f13c010edd0 con 0x7f13c0101900 2024-09-18T13:03:33.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13c6059640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f13c010ec50 con 0x7f13c0107900 2024-09-18T13:03:33.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c0101900 0x7f13c019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:33.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c0101900 0x7f13c019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60530/0 (socket says 172.21.15.78:60530) 2024-09-18T13:03:33.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13bf7fe640 1 -- 172.21.15.78:0/512596752 learned_addr learned my addr 172.21.15.78:0/512596752 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:03:33.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13beffd640 1 --2- 172.21.15.78:0/512596752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13c0107900 0x7f13c019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:33.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13bf7fe640 1 -- 172.21.15.78:0/512596752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13c0107900 msgr2=0x7f13c019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13bf7fe640 1 --2- 172.21.15.78:0/512596752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13c0107900 0x7f13c019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13bf7fe640 1 -- 172.21.15.78:0/512596752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c0197800 con 0x7f13c0101900 2024-09-18T13:03:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13bf7fe640 1 --2- 172.21.15.78:0/512596752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c0101900 0x7f13c019d680 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f13b000ea00 tx=0x7f13b000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13bcff9640 1 -- 172.21.15.78:0/512596752 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13b000cb80 con 0x7f13c0101900 2024-09-18T13:03:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13bcff9640 1 -- 172.21.15.78:0/512596752 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13b000cd20 con 0x7f13c0101900 2024-09-18T13:03:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13c6059640 1 -- 172.21.15.78:0/512596752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c0197af0 con 0x7f13c0101900 2024-09-18T13:03:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13bcff9640 1 -- 172.21.15.78:0/512596752 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13b0011470 con 0x7f13c0101900 2024-09-18T13:03:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.688+0000 7f13c6059640 1 -- 172.21.15.78:0/512596752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c0198050 con 0x7f13c0101900 2024-09-18T13:03:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.689+0000 7f13c6059640 1 -- 172.21.15.78:0/512596752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c0103040 con 0x7f13c0101900 2024-09-18T13:03:33.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.690+0000 7f13bcff9640 1 -- 172.21.15.78:0/512596752 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f13b0005020 con 0x7f13c0101900 2024-09-18T13:03:33.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.691+0000 7f13bcff9640 1 --2- 172.21.15.78:0/512596752 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f13a807af30 0x7f13a807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:33.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.691+0000 7f13beffd640 1 --2- 172.21.15.78:0/512596752 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f13a807af30 0x7f13a807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:33.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.691+0000 7f13bcff9640 1 -- 172.21.15.78:0/512596752 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f13b009e450 con 0x7f13c0101900 2024-09-18T13:03:33.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.691+0000 7f13beffd640 1 --2- 172.21.15.78:0/512596752 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f13a807af30 0x7f13a807d3f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f13c0198b50 tx=0x7f13b4031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:33.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.695+0000 7f13bcff9640 1 -- 172.21.15.78:0/512596752 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f13b0016030 con 0x7f13c0101900 2024-09-18T13:03:33.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.907+0000 7f13c6059640 1 -- 172.21.15.78:0/512596752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f13c0109e70 con 0x7f13c0101900 2024-09-18T13:03:33.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.907+0000 7f13bcff9640 1 -- 172.21.15.78:0/512596752 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f13b00699f0 con 0x7f13c0101900 2024-09-18T13:03:33.909 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:03:33.909 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:03:33.909 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:03:33.909 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:03:33.909 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:03:33.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:03:33.909 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:03:33.909 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:03:33.909 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:03:33.909 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:03:33.909 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:03:33.910 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:03:33.910 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:03:33.910 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:03:33.910 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:03:33.910 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:03:33.910 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:03:33.910 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:03:33.910 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:03:33.910 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:03:33.910 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:03:33.910 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:03:33.910 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:03:33.910 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:03:33.911 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:03:33.911 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:03:33.911 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:03:33.911 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:03:33.911 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:03:33.911 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:03:33.911 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:03:33.911 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:03:33.911 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:03:33.911 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:03:33.911 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:03:33.911 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:03:33.911 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:03:33.911 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:03:33.912 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:03:33.912 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:33.912 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:33.912 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:33.912 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:33.913 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:03:33.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.909+0000 7f13c6059640 1 -- 172.21.15.78:0/512596752 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f13a807af30 msgr2=0x7f13a807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.909+0000 7f13c6059640 1 --2- 172.21.15.78:0/512596752 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f13a807af30 0x7f13a807d3f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f13c0198b50 tx=0x7f13b4031400 comp rx=0 tx=0).stop 2024-09-18T13:03:33.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.909+0000 7f13c6059640 1 -- 172.21.15.78:0/512596752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c0101900 msgr2=0x7f13c019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.909+0000 7f13c6059640 1 --2- 172.21.15.78:0/512596752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c0101900 0x7f13c019d680 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f13b000ea00 tx=0x7f13b000eec0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.909+0000 7f13c6059640 1 -- 172.21.15.78:0/512596752 shutdown_connections 2024-09-18T13:03:33.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.910+0000 7f13c6059640 1 --2- 172.21.15.78:0/512596752 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f13a807af30 0x7f13a807d3f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.910+0000 7f13c6059640 1 --2- 172.21.15.78:0/512596752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13c0107900 0x7f13c019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.910+0000 7f13c6059640 1 --2- 172.21.15.78:0/512596752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c0101900 0x7f13c019d680 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.910+0000 7f13c6059640 1 -- 172.21.15.78:0/512596752 >> 172.21.15.78:0/512596752 conn(0x7f13c00fd600 msgr2=0x7f13c00fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:33.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.910+0000 7f13c6059640 1 -- 172.21.15.78:0/512596752 shutdown_connections 2024-09-18T13:03:33.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.910+0000 7f13c6059640 1 -- 172.21.15.78:0/512596752 wait complete. 2024-09-18T13:03:33.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.992+0000 7f3b6a00f640 1 -- 172.21.15.78:0/3976712767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b641033e0 msgr2=0x7f3b6410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.992+0000 7f3b6a00f640 1 --2- 172.21.15.78:0/3976712767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b641033e0 0x7f3b6410b8d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009880 tx=0x7f3b5802a530 comp rx=0 tx=0).stop 2024-09-18T13:03:33.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.992+0000 7f3b6a00f640 1 -- 172.21.15.78:0/3976712767 shutdown_connections 2024-09-18T13:03:33.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.992+0000 7f3b6a00f640 1 --2- 172.21.15.78:0/3976712767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b641033e0 0x7f3b6410b8d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.992+0000 7f3b6a00f640 1 --2- 172.21.15.78:0/3976712767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b64102ac0 0x7f3b64102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.992+0000 7f3b6a00f640 1 -- 172.21.15.78:0/3976712767 >> 172.21.15.78:0/3976712767 conn(0x7f3b640fc520 msgr2=0x7f3b640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:33.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.992+0000 7f3b6a00f640 1 -- 172.21.15.78:0/3976712767 shutdown_connections 2024-09-18T13:03:33.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.992+0000 7f3b6a00f640 1 -- 172.21.15.78:0/3976712767 wait complete. 2024-09-18T13:03:33.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.993+0000 7f3b6a00f640 1 Processor -- start 2024-09-18T13:03:33.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.993+0000 7f3b6a00f640 1 -- start start 2024-09-18T13:03:33.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.993+0000 7f3b6a00f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64102ac0 0x7f3b6419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:33.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.993+0000 7f3b6a00f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b641033e0 0x7f3b6419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:33.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.993+0000 7f3b6a00f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6410edd0 con 0x7f3b64102ac0 2024-09-18T13:03:33.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.993+0000 7f3b6a00f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6410ec50 con 0x7f3b641033e0 2024-09-18T13:03:33.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.993+0000 7f3b637fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64102ac0 0x7f3b6419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:33.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.993+0000 7f3b637fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64102ac0 0x7f3b6419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60546/0 (socket says 172.21.15.78:60546) 2024-09-18T13:03:33.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.993+0000 7f3b637fe640 1 -- 172.21.15.78:0/16455284 learned_addr learned my addr 172.21.15.78:0/16455284 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:03:33.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.993+0000 7f3b62ffd640 1 --2- 172.21.15.78:0/16455284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b641033e0 0x7f3b6419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:33.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.993+0000 7f3b637fe640 1 -- 172.21.15.78:0/16455284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b641033e0 msgr2=0x7f3b6419dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.993+0000 7f3b637fe640 1 --2- 172.21.15.78:0/16455284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b641033e0 0x7f3b6419dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.993+0000 7f3b637fe640 1 -- 172.21.15.78:0/16455284 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b641977e0 con 0x7f3b64102ac0 2024-09-18T13:03:33.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.994+0000 7f3b62ffd640 1 --2- 172.21.15.78:0/16455284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b641033e0 0x7f3b6419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:03:33.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.994+0000 7f3b637fe640 1 --2- 172.21.15.78:0/16455284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64102ac0 0x7f3b6419d660 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400d8d0 tx=0x7f3b5400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:33.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.994+0000 7f3b60ff9640 1 -- 172.21.15.78:0/16455284 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b54017070 con 0x7f3b64102ac0 2024-09-18T13:03:33.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.994+0000 7f3b60ff9640 1 -- 172.21.15.78:0/16455284 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3b54010460 con 0x7f3b64102ac0 2024-09-18T13:03:33.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.994+0000 7f3b60ff9640 1 -- 172.21.15.78:0/16455284 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b5400f5f0 con 0x7f3b64102ac0 2024-09-18T13:03:33.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.994+0000 7f3b6a00f640 1 -- 172.21.15.78:0/16455284 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b64197ad0 con 0x7f3b64102ac0 2024-09-18T13:03:33.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.994+0000 7f3b6a00f640 1 -- 172.21.15.78:0/16455284 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b64198030 con 0x7f3b64102ac0 2024-09-18T13:03:33.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.995+0000 7f3b6a00f640 1 -- 172.21.15.78:0/16455284 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b6406aa90 con 0x7f3b64102ac0 2024-09-18T13:03:33.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.995+0000 7f3b60ff9640 1 -- 172.21.15.78:0/16455284 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3b54009a30 con 0x7f3b64102ac0 2024-09-18T13:03:33.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.996+0000 7f3b60ff9640 1 --2- 172.21.15.78:0/16455284 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3b4c07af30 0x7f3b4c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:33.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.996+0000 7f3b60ff9640 1 -- 172.21.15.78:0/16455284 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f3b5409df40 con 0x7f3b64102ac0 2024-09-18T13:03:33.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.996+0000 7f3b62ffd640 1 --2- 172.21.15.78:0/16455284 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3b4c07af30 0x7f3b4c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:33.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:33.996+0000 7f3b62ffd640 1 --2- 172.21.15.78:0/16455284 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3b4c07af30 0x7f3b4c07d3f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3b64198b30 tx=0x7f3b58031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:34.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.000+0000 7f3b60ff9640 1 -- 172.21.15.78:0/16455284 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3b540694e0 con 0x7f3b64102ac0 2024-09-18T13:03:34.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.194+0000 7f3b6a00f640 1 -- 172.21.15.78:0/16455284 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3b641982e0 con 0x7f3b4c07af30 2024-09-18T13:03:34.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.196+0000 7f3b60ff9640 1 -- 172.21.15.78:0/16455284 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3b641982e0 con 0x7f3b4c07af30 2024-09-18T13:03:34.197 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:03:34.197 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:03:34.197 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:03:34.197 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:03:34.197 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:03:34.197 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:03:34.197 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:03:34.197 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:03:34.197 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:03:34.198 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:03:34.198 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:03:34.198 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:03:34.198 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:03:34.198 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:03:34.198 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:03:34.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.198+0000 7f3b6a00f640 1 -- 172.21.15.78:0/16455284 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3b4c07af30 msgr2=0x7f3b4c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:34.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.198+0000 7f3b6a00f640 1 --2- 172.21.15.78:0/16455284 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3b4c07af30 0x7f3b4c07d3f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3b64198b30 tx=0x7f3b58031400 comp rx=0 tx=0).stop 2024-09-18T13:03:34.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.198+0000 7f3b6a00f640 1 -- 172.21.15.78:0/16455284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64102ac0 msgr2=0x7f3b6419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:34.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.198+0000 7f3b6a00f640 1 --2- 172.21.15.78:0/16455284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64102ac0 0x7f3b6419d660 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400d8d0 tx=0x7f3b5400dd90 comp rx=0 tx=0).stop 2024-09-18T13:03:34.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.198+0000 7f3b6a00f640 1 -- 172.21.15.78:0/16455284 shutdown_connections 2024-09-18T13:03:34.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.198+0000 7f3b6a00f640 1 --2- 172.21.15.78:0/16455284 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3b4c07af30 0x7f3b4c07d3f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.198+0000 7f3b6a00f640 1 --2- 172.21.15.78:0/16455284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b641033e0 0x7f3b6419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.198+0000 7f3b6a00f640 1 --2- 172.21.15.78:0/16455284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64102ac0 0x7f3b6419d660 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.198+0000 7f3b6a00f640 1 -- 172.21.15.78:0/16455284 >> 172.21.15.78:0/16455284 conn(0x7f3b640fc520 msgr2=0x7f3b64108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:34.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.198+0000 7f3b6a00f640 1 -- 172.21.15.78:0/16455284 shutdown_connections 2024-09-18T13:03:34.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.198+0000 7f3b6a00f640 1 -- 172.21.15.78:0/16455284 wait complete. 2024-09-18T13:03:34.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.288+0000 7f76e16a9640 1 -- 172.21.15.78:0/3711499744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76dc1008c0 msgr2=0x7f76dc100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:34.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.288+0000 7f76e16a9640 1 --2- 172.21.15.78:0/3711499744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76dc1008c0 0x7f76dc100ca0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009880 tx=0x7f76cc02a530 comp rx=0 tx=0).stop 2024-09-18T13:03:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.288+0000 7f76e16a9640 1 -- 172.21.15.78:0/3711499744 shutdown_connections 2024-09-18T13:03:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.288+0000 7f76e16a9640 1 --2- 172.21.15.78:0/3711499744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76dc1011e0 0x7f76dc1056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.288+0000 7f76e16a9640 1 --2- 172.21.15.78:0/3711499744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76dc1008c0 0x7f76dc100ca0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.288+0000 7f76e16a9640 1 -- 172.21.15.78:0/3711499744 >> 172.21.15.78:0/3711499744 conn(0x7f76dc0fc510 msgr2=0x7f76dc0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.288+0000 7f76e16a9640 1 -- 172.21.15.78:0/3711499744 shutdown_connections 2024-09-18T13:03:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.288+0000 7f76e16a9640 1 -- 172.21.15.78:0/3711499744 wait complete. 2024-09-18T13:03:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.289+0000 7f76e16a9640 1 Processor -- start 2024-09-18T13:03:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.289+0000 7f76e16a9640 1 -- start start 2024-09-18T13:03:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.289+0000 7f76e16a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76dc1008c0 0x7f76dc19dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.289+0000 7f76e16a9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76dc1011e0 0x7f76dc19e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.289+0000 7f76e16a9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc1153e0 con 0x7f76dc1008c0 2024-09-18T13:03:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.289+0000 7f76e16a9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc115260 con 0x7f76dc1011e0 2024-09-18T13:03:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.289+0000 7f76daffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76dc1008c0 0x7f76dc19dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:34.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.289+0000 7f76daffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76dc1008c0 0x7f76dc19dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60562/0 (socket says 172.21.15.78:60562) 2024-09-18T13:03:34.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.289+0000 7f76daffd640 1 -- 172.21.15.78:0/2820566944 learned_addr learned my addr 172.21.15.78:0/2820566944 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:03:34.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.289+0000 7f76daffd640 1 -- 172.21.15.78:0/2820566944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76dc1011e0 msgr2=0x7f76dc19e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:34.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.289+0000 7f76daffd640 1 --2- 172.21.15.78:0/2820566944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76dc1011e0 0x7f76dc19e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.289+0000 7f76daffd640 1 -- 172.21.15.78:0/2820566944 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76dc19eb90 con 0x7f76dc1008c0 2024-09-18T13:03:34.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.290+0000 7f76daffd640 1 --2- 172.21.15.78:0/2820566944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76dc1008c0 0x7f76dc19dfa0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f76cc031460 tx=0x7f76cc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.290+0000 7f76d8ff9640 1 -- 172.21.15.78:0/2820566944 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76cc03f070 con 0x7f76dc1008c0 2024-09-18T13:03:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.290+0000 7f76d8ff9640 1 -- 172.21.15.78:0/2820566944 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76cc004cf0 con 0x7f76dc1008c0 2024-09-18T13:03:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.290+0000 7f76e16a9640 1 -- 172.21.15.78:0/2820566944 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76dc1a28d0 con 0x7f76dc1008c0 2024-09-18T13:03:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.290+0000 7f76d8ff9640 1 -- 172.21.15.78:0/2820566944 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76cc035030 con 0x7f76dc1008c0 2024-09-18T13:03:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.290+0000 7f76e16a9640 1 -- 172.21.15.78:0/2820566944 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76dc1a2e00 con 0x7f76dc1008c0 2024-09-18T13:03:34.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.291+0000 7f76e16a9640 1 -- 172.21.15.78:0/2820566944 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76dc06ada0 con 0x7f76dc1008c0 2024-09-18T13:03:34.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.292+0000 7f76d8ff9640 1 -- 172.21.15.78:0/2820566944 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f76cc042070 con 0x7f76dc1008c0 2024-09-18T13:03:34.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.292+0000 7f76d8ff9640 1 --2- 172.21.15.78:0/2820566944 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f76c807af30 0x7f76c807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:34.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.292+0000 7f76d3fff640 1 --2- 172.21.15.78:0/2820566944 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f76c807af30 0x7f76c807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:34.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.292+0000 7f76d8ff9640 1 -- 172.21.15.78:0/2820566944 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f76cc0bebc0 con 0x7f76dc1008c0 2024-09-18T13:03:34.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.293+0000 7f76d3fff640 1 --2- 172.21.15.78:0/2820566944 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f76c807af30 0x7f76c807d3f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f76dc112500 tx=0x7f76c4005d10 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:34.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.296+0000 7f76d8ff9640 1 -- 172.21.15.78:0/2820566944 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f76cc08a0c0 con 0x7f76dc1008c0 2024-09-18T13:03:34.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:34 smithi078 ceph-mon[108578]: from='client.34638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:34.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:34 smithi078 ceph-mon[108578]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:34.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:34 smithi078 ceph-mon[108578]: pgmap v432: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:34.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:34 smithi078 ceph-mon[108578]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:34.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:34 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1085484999' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:34.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:34 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/512596752' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:03:34.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.540+0000 7f76e16a9640 1 -- 172.21.15.78:0/2820566944 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f76dc102d80 con 0x7f76dc1008c0 2024-09-18T13:03:34.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.541+0000 7f76d8ff9640 1 -- 172.21.15.78:0/2820566944 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f76cc08ef70 con 0x7f76dc1008c0 2024-09-18T13:03:34.542 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:03:34.542 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:03:34.542 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:03:34.542 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:03:34.542 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:03:34.543 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:03:34.543 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:03:34.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.543+0000 7f76e16a9640 1 -- 172.21.15.78:0/2820566944 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f76c807af30 msgr2=0x7f76c807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:34.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.543+0000 7f76e16a9640 1 --2- 172.21.15.78:0/2820566944 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f76c807af30 0x7f76c807d3f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f76dc112500 tx=0x7f76c4005d10 comp rx=0 tx=0).stop 2024-09-18T13:03:34.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.543+0000 7f76e16a9640 1 -- 172.21.15.78:0/2820566944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76dc1008c0 msgr2=0x7f76dc19dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:34.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.543+0000 7f76e16a9640 1 --2- 172.21.15.78:0/2820566944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76dc1008c0 0x7f76dc19dfa0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f76cc031460 tx=0x7f76cc0048f0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.543+0000 7f76e16a9640 1 -- 172.21.15.78:0/2820566944 shutdown_connections 2024-09-18T13:03:34.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.543+0000 7f76e16a9640 1 --2- 172.21.15.78:0/2820566944 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f76c807af30 0x7f76c807d3f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.543+0000 7f76e16a9640 1 --2- 172.21.15.78:0/2820566944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76dc1011e0 0x7f76dc19e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.543+0000 7f76e16a9640 1 --2- 172.21.15.78:0/2820566944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76dc1008c0 0x7f76dc19dfa0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.543+0000 7f76e16a9640 1 -- 172.21.15.78:0/2820566944 >> 172.21.15.78:0/2820566944 conn(0x7f76dc0fc510 msgr2=0x7f76dc112b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:34.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.543+0000 7f76e16a9640 1 -- 172.21.15.78:0/2820566944 shutdown_connections 2024-09-18T13:03:34.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:03:34.543+0000 7f76e16a9640 1 -- 172.21.15.78:0/2820566944 wait complete. 2024-09-18T13:03:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:34 smithi148 ceph-mon[80030]: from='client.34638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:34 smithi148 ceph-mon[80030]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:34 smithi148 ceph-mon[80030]: pgmap v432: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:34 smithi148 ceph-mon[80030]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:34 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1085484999' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:34 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/512596752' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:03:35.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:35 smithi148 ceph-mon[80030]: from='client.34658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:35.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:35 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2820566944' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:03:35.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:35 smithi078 ceph-mon[108578]: from='client.34658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:35.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:35 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2820566944' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:03:36.707 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:36 smithi078 ceph-mon[108578]: pgmap v433: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:36.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:36 smithi148 ceph-mon[80030]: pgmap v433: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:38.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:38 smithi148 ceph-mon[80030]: pgmap v434: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:38.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:38 smithi078 ceph-mon[108578]: pgmap v434: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:40.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:40 smithi078 ceph-mon[108578]: pgmap v435: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:40 smithi148 ceph-mon[80030]: pgmap v435: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:41.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:42.701 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:42 smithi078 ceph-mon[108578]: pgmap v436: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:42.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:42 smithi148 ceph-mon[80030]: pgmap v436: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:44 smithi148 ceph-mon[80030]: pgmap v437: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:44 smithi078 ceph-mon[108578]: pgmap v437: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:46 smithi148 ceph-mon[80030]: pgmap v438: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:46.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:46 smithi078 ceph-mon[108578]: pgmap v438: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:48.708 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:48 smithi078 ceph-mon[108578]: pgmap v439: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:48.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:48 smithi148 ceph-mon[80030]: pgmap v439: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:50 smithi148 ceph-mon[80030]: pgmap v440: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:50.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:50 smithi078 ceph-mon[108578]: pgmap v440: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:52 smithi148 ceph-mon[80030]: pgmap v441: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:52.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:52 smithi078 ceph-mon[108578]: pgmap v441: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:54.710 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:54 smithi078 ceph-mon[108578]: pgmap v442: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:54.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:54 smithi148 ceph-mon[80030]: pgmap v442: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:56 smithi148 ceph-mon[80030]: pgmap v443: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:56 smithi078 ceph-mon[108578]: pgmap v443: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:03:58 smithi148 ceph-mon[80030]: pgmap v444: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:03:58.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:03:58 smithi078 ceph-mon[108578]: pgmap v444: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:00.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:00 smithi078 ceph-mon[108578]: pgmap v445: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:00.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:00 smithi148 ceph-mon[80030]: pgmap v445: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:02.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:02 smithi148 ceph-mon[80030]: pgmap v446: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:02.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:02 smithi078 ceph-mon[108578]: pgmap v446: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:03.643 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:03 smithi078 ceph-mon[108578]: pgmap v447: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:03.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:03 smithi148 ceph-mon[80030]: pgmap v447: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:04.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.637+0000 7f6efd8c2640 1 -- 172.21.15.78:0/3362326280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81007f0 msgr2=0x7f6ef8100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:04.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.637+0000 7f6efd8c2640 1 --2- 172.21.15.78:0/3362326280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81007f0 0x7f6ef8100c50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009880 tx=0x7f6ee002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:04:04.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.637+0000 7f6efd8c2640 1 -- 172.21.15.78:0/3362326280 shutdown_connections 2024-09-18T13:04:04.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.637+0000 7f6efd8c2640 1 --2- 172.21.15.78:0/3362326280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81007f0 0x7f6ef8100c50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:04.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.637+0000 7f6efd8c2640 1 --2- 172.21.15.78:0/3362326280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ef81067f0 0x7f6ef8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:04.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.637+0000 7f6efd8c2640 1 -- 172.21.15.78:0/3362326280 >> 172.21.15.78:0/3362326280 conn(0x7f6ef80fc550 msgr2=0x7f6ef80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:04.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.637+0000 7f6efd8c2640 1 -- 172.21.15.78:0/3362326280 shutdown_connections 2024-09-18T13:04:04.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.637+0000 7f6efd8c2640 1 -- 172.21.15.78:0/3362326280 wait complete. 2024-09-18T13:04:04.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.637+0000 7f6efd8c2640 1 Processor -- start 2024-09-18T13:04:04.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.638+0000 7f6efd8c2640 1 -- start start 2024-09-18T13:04:04.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.638+0000 7f6efd8c2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81007f0 0x7f6ef819d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:04.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.638+0000 7f6efd8c2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ef81067f0 0x7f6ef819dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:04.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.638+0000 7f6efd8c2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef810dd20 con 0x7f6ef81007f0 2024-09-18T13:04:04.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.638+0000 7f6efd8c2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef810dba0 con 0x7f6ef81067f0 2024-09-18T13:04:04.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.638+0000 7f6ef6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81007f0 0x7f6ef819d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:04.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.638+0000 7f6ef6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81007f0 0x7f6ef819d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58468/0 (socket says 172.21.15.78:58468) 2024-09-18T13:04:04.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.638+0000 7f6ef6ffd640 1 -- 172.21.15.78:0/1316443697 learned_addr learned my addr 172.21.15.78:0/1316443697 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:04:04.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.638+0000 7f6ef67fc640 1 --2- 172.21.15.78:0/1316443697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ef81067f0 0x7f6ef819dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:04.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.638+0000 7f6ef6ffd640 1 -- 172.21.15.78:0/1316443697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ef81067f0 msgr2=0x7f6ef819dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:04.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.638+0000 7f6ef6ffd640 1 --2- 172.21.15.78:0/1316443697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ef81067f0 0x7f6ef819dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:04.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.638+0000 7f6ef6ffd640 1 -- 172.21.15.78:0/1316443697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef81978d0 con 0x7f6ef81007f0 2024-09-18T13:04:04.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.638+0000 7f6ef6ffd640 1 --2- 172.21.15.78:0/1316443697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81007f0 0x7f6ef819d710 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800ba50 tx=0x7f6ee800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:04.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.639+0000 7f6efc8c0640 1 -- 172.21.15.78:0/1316443697 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ee8019070 con 0x7f6ef81007f0 2024-09-18T13:04:04.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.639+0000 7f6efd8c2640 1 -- 172.21.15.78:0/1316443697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef8197bc0 con 0x7f6ef81007f0 2024-09-18T13:04:04.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.639+0000 7f6efc8c0640 1 -- 172.21.15.78:0/1316443697 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ee800ce20 con 0x7f6ef81007f0 2024-09-18T13:04:04.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.639+0000 7f6efc8c0640 1 -- 172.21.15.78:0/1316443697 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ee80075a0 con 0x7f6ef81007f0 2024-09-18T13:04:04.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.639+0000 7f6efd8c2640 1 -- 172.21.15.78:0/1316443697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef8198120 con 0x7f6ef81007f0 2024-09-18T13:04:04.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.640+0000 7f6efd8c2640 1 -- 172.21.15.78:0/1316443697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef8101f30 con 0x7f6ef81007f0 2024-09-18T13:04:04.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.641+0000 7f6efc8c0640 1 -- 172.21.15.78:0/1316443697 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6ee801c070 con 0x7f6ef81007f0 2024-09-18T13:04:04.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.641+0000 7f6efc8c0640 1 --2- 172.21.15.78:0/1316443697 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6ee407af90 0x7f6ee407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:04.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.641+0000 7f6efc8c0640 1 -- 172.21.15.78:0/1316443697 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f6ee809d860 con 0x7f6ef81007f0 2024-09-18T13:04:04.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.641+0000 7f6ef67fc640 1 --2- 172.21.15.78:0/1316443697 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6ee407af90 0x7f6ee407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:04.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.642+0000 7f6ef67fc640 1 --2- 172.21.15.78:0/1316443697 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6ee407af90 0x7f6ee407d450 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ef81990c0 tx=0x7f6ee00095c0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:04.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.646+0000 7f6efc8c0640 1 -- 172.21.15.78:0/1316443697 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6ee8068e80 con 0x7f6ef81007f0 2024-09-18T13:04:04.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.836+0000 7f6efd8c2640 1 -- 172.21.15.78:0/1316443697 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6ef8109e00 con 0x7f6ee407af90 2024-09-18T13:04:04.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.838+0000 7f6efc8c0640 1 -- 172.21.15.78:0/1316443697 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6ee0004340 con 0x7f6ee407af90 2024-09-18T13:04:04.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.840+0000 7f6efd8c2640 1 -- 172.21.15.78:0/1316443697 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6ee407af90 msgr2=0x7f6ee407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:04.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.840+0000 7f6efd8c2640 1 --2- 172.21.15.78:0/1316443697 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6ee407af90 0x7f6ee407d450 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ef81990c0 tx=0x7f6ee00095c0 comp rx=0 tx=0).stop 2024-09-18T13:04:04.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.840+0000 7f6efd8c2640 1 -- 172.21.15.78:0/1316443697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81007f0 msgr2=0x7f6ef819d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:04.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.840+0000 7f6efd8c2640 1 --2- 172.21.15.78:0/1316443697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81007f0 0x7f6ef819d710 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800ba50 tx=0x7f6ee800bf10 comp rx=0 tx=0).stop 2024-09-18T13:04:04.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.840+0000 7f6efd8c2640 1 -- 172.21.15.78:0/1316443697 shutdown_connections 2024-09-18T13:04:04.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.840+0000 7f6efd8c2640 1 --2- 172.21.15.78:0/1316443697 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6ee407af90 0x7f6ee407d450 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:04.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.840+0000 7f6efd8c2640 1 --2- 172.21.15.78:0/1316443697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ef81067f0 0x7f6ef819dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:04.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.840+0000 7f6efd8c2640 1 --2- 172.21.15.78:0/1316443697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81007f0 0x7f6ef819d710 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:04.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.840+0000 7f6efd8c2640 1 -- 172.21.15.78:0/1316443697 >> 172.21.15.78:0/1316443697 conn(0x7f6ef80fc550 msgr2=0x7f6ef8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:04.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.840+0000 7f6efd8c2640 1 -- 172.21.15.78:0/1316443697 shutdown_connections 2024-09-18T13:04:04.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.840+0000 7f6efd8c2640 1 -- 172.21.15.78:0/1316443697 wait complete. 2024-09-18T13:04:04.850 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:04:04.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.923+0000 7f4165f2a640 1 -- 172.21.15.78:0/3381787001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4160100800 msgr2=0x7f4160100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:04.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.923+0000 7f4165f2a640 1 --2- 172.21.15.78:0/3381787001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4160100800 0x7f4160100c60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4154009880 tx=0x7f415402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:04:04.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.923+0000 7f4165f2a640 1 -- 172.21.15.78:0/3381787001 shutdown_connections 2024-09-18T13:04:04.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.923+0000 7f4165f2a640 1 --2- 172.21.15.78:0/3381787001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4160100800 0x7f4160100c60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:04.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.923+0000 7f4165f2a640 1 --2- 172.21.15.78:0/3381787001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4160106800 0x7f4160106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:04.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.923+0000 7f4165f2a640 1 -- 172.21.15.78:0/3381787001 >> 172.21.15.78:0/3381787001 conn(0x7f41600fc520 msgr2=0x7f41600fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:04.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.923+0000 7f4165f2a640 1 -- 172.21.15.78:0/3381787001 shutdown_connections 2024-09-18T13:04:04.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.923+0000 7f4165f2a640 1 -- 172.21.15.78:0/3381787001 wait complete. 2024-09-18T13:04:04.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.924+0000 7f4165f2a640 1 Processor -- start 2024-09-18T13:04:04.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.924+0000 7f4165f2a640 1 -- start start 2024-09-18T13:04:04.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f4165f2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4160100800 0x7f41601023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:04.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f4165f2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4160106800 0x7f4160102910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:04.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f4165f2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f416010dcd0 con 0x7f4160106800 2024-09-18T13:04:04.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f4165f2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f416010db50 con 0x7f4160100800 2024-09-18T13:04:04.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f415effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4160106800 0x7f4160102910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:04.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f415effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4160106800 0x7f4160102910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58492/0 (socket says 172.21.15.78:58492) 2024-09-18T13:04:04.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f415effd640 1 -- 172.21.15.78:0/4239926246 learned_addr learned my addr 172.21.15.78:0/4239926246 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:04:04.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f415f7fe640 1 --2- 172.21.15.78:0/4239926246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4160100800 0x7f41601023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:04.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f415effd640 1 -- 172.21.15.78:0/4239926246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4160100800 msgr2=0x7f41601023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:04.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f415effd640 1 --2- 172.21.15.78:0/4239926246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4160100800 0x7f41601023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:04.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f415effd640 1 -- 172.21.15.78:0/4239926246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4160102e50 con 0x7f4160106800 2024-09-18T13:04:04.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f415effd640 1 --2- 172.21.15.78:0/4239926246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4160106800 0x7f4160102910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4154031460 tx=0x7f41540048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:04.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f415cff9640 1 -- 172.21.15.78:0/4239926246 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f415403f070 con 0x7f4160106800 2024-09-18T13:04:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f415cff9640 1 -- 172.21.15.78:0/4239926246 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4154004cf0 con 0x7f4160106800 2024-09-18T13:04:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f415cff9640 1 -- 172.21.15.78:0/4239926246 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4154035030 con 0x7f4160106800 2024-09-18T13:04:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f4165f2a640 1 -- 172.21.15.78:0/4239926246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41601030e0 con 0x7f4160106800 2024-09-18T13:04:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.925+0000 7f4165f2a640 1 -- 172.21.15.78:0/4239926246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41601a3d40 con 0x7f4160106800 2024-09-18T13:04:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.926+0000 7f4165f2a640 1 -- 172.21.15.78:0/4239926246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4160101f40 con 0x7f4160106800 2024-09-18T13:04:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.927+0000 7f415cff9640 1 -- 172.21.15.78:0/4239926246 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4154042070 con 0x7f4160106800 2024-09-18T13:04:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.927+0000 7f415cff9640 1 --2- 172.21.15.78:0/4239926246 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f414807af30 0x7f414807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.928+0000 7f415cff9640 1 -- 172.21.15.78:0/4239926246 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f41540beb20 con 0x7f4160106800 2024-09-18T13:04:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.928+0000 7f415f7fe640 1 --2- 172.21.15.78:0/4239926246 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f414807af30 0x7f414807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:04.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.928+0000 7f415f7fe640 1 --2- 172.21.15.78:0/4239926246 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f414807af30 0x7f414807d3f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4150005fd0 tx=0x7f4150005e20 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:04.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:04.932+0000 7f415cff9640 1 -- 172.21.15.78:0/4239926246 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f415408a0c0 con 0x7f4160106800 2024-09-18T13:04:05.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.122+0000 7f4165f2a640 1 -- 172.21.15.78:0/4239926246 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f416006a1b0 con 0x7f414807af30 2024-09-18T13:04:05.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.123+0000 7f415cff9640 1 -- 172.21.15.78:0/4239926246 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f416006a1b0 con 0x7f414807af30 2024-09-18T13:04:05.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.125+0000 7f4165f2a640 1 -- 172.21.15.78:0/4239926246 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f414807af30 msgr2=0x7f414807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:05.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.125+0000 7f4165f2a640 1 --2- 172.21.15.78:0/4239926246 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f414807af30 0x7f414807d3f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4150005fd0 tx=0x7f4150005e20 comp rx=0 tx=0).stop 2024-09-18T13:04:05.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.125+0000 7f4165f2a640 1 -- 172.21.15.78:0/4239926246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4160106800 msgr2=0x7f4160102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:05.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.126+0000 7f4165f2a640 1 --2- 172.21.15.78:0/4239926246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4160106800 0x7f4160102910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4154031460 tx=0x7f41540048f0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.126+0000 7f4165f2a640 1 -- 172.21.15.78:0/4239926246 shutdown_connections 2024-09-18T13:04:05.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.126+0000 7f4165f2a640 1 --2- 172.21.15.78:0/4239926246 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f414807af30 0x7f414807d3f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.126+0000 7f4165f2a640 1 --2- 172.21.15.78:0/4239926246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4160106800 0x7f4160102910 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.126+0000 7f4165f2a640 1 --2- 172.21.15.78:0/4239926246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4160100800 0x7f41601023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.126+0000 7f4165f2a640 1 -- 172.21.15.78:0/4239926246 >> 172.21.15.78:0/4239926246 conn(0x7f41600fc520 msgr2=0x7f41601045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:05.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.126+0000 7f4165f2a640 1 -- 172.21.15.78:0/4239926246 shutdown_connections 2024-09-18T13:04:05.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.126+0000 7f4165f2a640 1 -- 172.21.15.78:0/4239926246 wait complete. 2024-09-18T13:04:05.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.207+0000 7fa15d206640 1 -- 172.21.15.78:0/95967656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1581067f0 msgr2=0x7fa158106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.207+0000 7fa15d206640 1 --2- 172.21.15.78:0/95967656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1581067f0 0x7fa158106bd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa148009880 tx=0x7fa14802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.207+0000 7fa15d206640 1 -- 172.21.15.78:0/95967656 shutdown_connections 2024-09-18T13:04:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.207+0000 7fa15d206640 1 --2- 172.21.15.78:0/95967656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1581007f0 0x7fa158100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.207+0000 7fa15d206640 1 --2- 172.21.15.78:0/95967656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1581067f0 0x7fa158106bd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.207+0000 7fa15d206640 1 -- 172.21.15.78:0/95967656 >> 172.21.15.78:0/95967656 conn(0x7fa1580fc550 msgr2=0x7fa1580fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.207+0000 7fa15d206640 1 -- 172.21.15.78:0/95967656 shutdown_connections 2024-09-18T13:04:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.207+0000 7fa15d206640 1 -- 172.21.15.78:0/95967656 wait complete. 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.208+0000 7fa15d206640 1 Processor -- start 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.208+0000 7fa15d206640 1 -- start start 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.208+0000 7fa15d206640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1581007f0 0x7fa1581988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.208+0000 7fa15d206640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1581067f0 0x7fa158198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.208+0000 7fa15d206640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa15810dca0 con 0x7fa1581007f0 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.208+0000 7fa15d206640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa15810db20 con 0x7fa1581067f0 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.208+0000 7fa156d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1581007f0 0x7fa1581988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.208+0000 7fa156d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1581007f0 0x7fa1581988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58504/0 (socket says 172.21.15.78:58504) 2024-09-18T13:04:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.208+0000 7fa156d9d640 1 -- 172.21.15.78:0/2712821895 learned_addr learned my addr 172.21.15.78:0/2712821895 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:04:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.209+0000 7fa14ffff640 1 --2- 172.21.15.78:0/2712821895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1581067f0 0x7fa158198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.209+0000 7fa156d9d640 1 -- 172.21.15.78:0/2712821895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1581067f0 msgr2=0x7fa158198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.209+0000 7fa156d9d640 1 --2- 172.21.15.78:0/2712821895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1581067f0 0x7fa158198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.209+0000 7fa156d9d640 1 -- 172.21.15.78:0/2712821895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa158199380 con 0x7fa1581007f0 2024-09-18T13:04:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.209+0000 7fa14ffff640 1 --2- 172.21.15.78:0/2712821895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1581067f0 0x7fa158198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:04:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.209+0000 7fa156d9d640 1 --2- 172.21.15.78:0/2712821895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1581007f0 0x7fa1581988d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa148031460 tx=0x7fa1480048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.209+0000 7fa154d99640 1 -- 172.21.15.78:0/2712821895 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa14803f070 con 0x7fa1581007f0 2024-09-18T13:04:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.209+0000 7fa154d99640 1 -- 172.21.15.78:0/2712821895 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa148004cf0 con 0x7fa1581007f0 2024-09-18T13:04:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.209+0000 7fa15d206640 1 -- 172.21.15.78:0/2712821895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa158199610 con 0x7fa1581007f0 2024-09-18T13:04:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.209+0000 7fa154d99640 1 -- 172.21.15.78:0/2712821895 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa148035030 con 0x7fa1581007f0 2024-09-18T13:04:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.209+0000 7fa15d206640 1 -- 172.21.15.78:0/2712821895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1581a1bc0 con 0x7fa1581007f0 2024-09-18T13:04:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.210+0000 7fa15d206640 1 -- 172.21.15.78:0/2712821895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa158101f30 con 0x7fa1581007f0 2024-09-18T13:04:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.211+0000 7fa154d99640 1 -- 172.21.15.78:0/2712821895 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa148042070 con 0x7fa1581007f0 2024-09-18T13:04:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.212+0000 7fa154d99640 1 --2- 172.21.15.78:0/2712821895 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa14407af30 0x7fa14407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.212+0000 7fa154d99640 1 -- 172.21.15.78:0/2712821895 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fa1480beb20 con 0x7fa1581007f0 2024-09-18T13:04:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.212+0000 7fa14ffff640 1 --2- 172.21.15.78:0/2712821895 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa14407af30 0x7fa14407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.212+0000 7fa14ffff640 1 --2- 172.21.15.78:0/2712821895 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa14407af30 0x7fa14407d3f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa15806a7f0 tx=0x7fa140005d90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.216+0000 7fa154d99640 1 -- 172.21.15.78:0/2712821895 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa14808a0c0 con 0x7fa1581007f0 2024-09-18T13:04:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.399+0000 7fa15d206640 1 -- 172.21.15.78:0/2712821895 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa158062630 con 0x7fa14407af30 2024-09-18T13:04:05.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.408+0000 7fa154d99640 1 -- 172.21.15.78:0/2712821895 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fa158062630 con 0x7fa14407af30 2024-09-18T13:04:05.409 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:04:05.410 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (11m) 6m ago 22m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:04:05.410 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (14m) 6m ago 23m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:04:05.410 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (14m) 5m ago 22m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:04:05.410 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (10m) 6m ago 23m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:04:05.410 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (10m) 5m ago 22m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:04:05.410 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (11m) 6m ago 22m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:04:05.410 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (6m) 6m ago 17m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:04:05.410 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (6m) 6m ago 17m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:04:05.410 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (5m) 5m ago 17m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:04:05.410 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (5m) 5m ago 17m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:04:05.410 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (14m) 6m ago 24m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:04:05.410 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (12m) 5m ago 22m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:04:05.410 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (10m) 6m ago 24m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:04:05.410 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (10m) 5m ago 21m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:04:05.410 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (12m) 6m ago 22m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:04:05.411 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (12m) 5m ago 22m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:04:05.411 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (9m) 6m ago 20m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:04:05.411 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (9m) 6m ago 20m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:04:05.411 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (8m) 6m ago 19m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:04:05.411 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (7m) 5m ago 19m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:04:05.411 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (7m) 5m ago 19m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:04:05.411 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (6m) 5m ago 18m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:04:05.411 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (12m) 6m ago 22m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:04:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.411+0000 7fa15d206640 1 -- 172.21.15.78:0/2712821895 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa14407af30 msgr2=0x7fa14407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.411+0000 7fa15d206640 1 --2- 172.21.15.78:0/2712821895 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa14407af30 0x7fa14407d3f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa15806a7f0 tx=0x7fa140005d90 comp rx=0 tx=0).stop 2024-09-18T13:04:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.411+0000 7fa15d206640 1 -- 172.21.15.78:0/2712821895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1581007f0 msgr2=0x7fa1581988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.411+0000 7fa15d206640 1 --2- 172.21.15.78:0/2712821895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1581007f0 0x7fa1581988d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa148031460 tx=0x7fa1480048f0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.411+0000 7fa15d206640 1 -- 172.21.15.78:0/2712821895 shutdown_connections 2024-09-18T13:04:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.411+0000 7fa15d206640 1 --2- 172.21.15.78:0/2712821895 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa14407af30 0x7fa14407d3f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.411+0000 7fa15d206640 1 --2- 172.21.15.78:0/2712821895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1581067f0 0x7fa158198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.411+0000 7fa15d206640 1 --2- 172.21.15.78:0/2712821895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1581007f0 0x7fa1581988d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.411+0000 7fa15d206640 1 -- 172.21.15.78:0/2712821895 >> 172.21.15.78:0/2712821895 conn(0x7fa1580fc550 msgr2=0x7fa1580fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.411+0000 7fa15d206640 1 -- 172.21.15.78:0/2712821895 shutdown_connections 2024-09-18T13:04:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.411+0000 7fa15d206640 1 -- 172.21.15.78:0/2712821895 wait complete. 2024-09-18T13:04:05.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.492+0000 7fdf94660640 1 -- 172.21.15.78:0/2476394525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf8c103b30 msgr2=0x7fdf8c103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:05.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.492+0000 7fdf94660640 1 --2- 172.21.15.78:0/2476394525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf8c103b30 0x7fdf8c103f90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009880 tx=0x7fdf7c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.492+0000 7fdf94660640 1 -- 172.21.15.78:0/2476394525 shutdown_connections 2024-09-18T13:04:05.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.492+0000 7fdf94660640 1 --2- 172.21.15.78:0/2476394525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf8c103b30 0x7fdf8c103f90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.492+0000 7fdf94660640 1 --2- 172.21.15.78:0/2476394525 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf8c109be0 0x7fdf8c109fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.492+0000 7fdf94660640 1 -- 172.21.15.78:0/2476394525 >> 172.21.15.78:0/2476394525 conn(0x7fdf8c0ff810 msgr2=0x7fdf8c101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:05.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.492+0000 7fdf94660640 1 -- 172.21.15.78:0/2476394525 shutdown_connections 2024-09-18T13:04:05.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.492+0000 7fdf94660640 1 -- 172.21.15.78:0/2476394525 wait complete. 2024-09-18T13:04:05.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.493+0000 7fdf94660640 1 Processor -- start 2024-09-18T13:04:05.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.493+0000 7fdf94660640 1 -- start start 2024-09-18T13:04:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.493+0000 7fdf94660640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf8c103b30 0x7fdf8c19f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.493+0000 7fdf94660640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf8c109be0 0x7fdf8c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.493+0000 7fdf94660640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c111050 con 0x7fdf8c109be0 2024-09-18T13:04:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.493+0000 7fdf94660640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c110ed0 con 0x7fdf8c103b30 2024-09-18T13:04:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.493+0000 7fdf91bfb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf8c109be0 0x7fdf8c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.493+0000 7fdf91bfb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf8c109be0 0x7fdf8c19fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58516/0 (socket says 172.21.15.78:58516) 2024-09-18T13:04:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.493+0000 7fdf91bfb640 1 -- 172.21.15.78:0/3554953048 learned_addr learned my addr 172.21.15.78:0/3554953048 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:04:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.493+0000 7fdf923fc640 1 --2- 172.21.15.78:0/3554953048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf8c103b30 0x7fdf8c19f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.494+0000 7fdf91bfb640 1 -- 172.21.15.78:0/3554953048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf8c103b30 msgr2=0x7fdf8c19f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.494+0000 7fdf91bfb640 1 --2- 172.21.15.78:0/3554953048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf8c103b30 0x7fdf8c19f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.494+0000 7fdf91bfb640 1 -- 172.21.15.78:0/3554953048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8c1999a0 con 0x7fdf8c109be0 2024-09-18T13:04:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.494+0000 7fdf91bfb640 1 --2- 172.21.15.78:0/3554953048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf8c109be0 0x7fdf8c19fd20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c004f90 tx=0x7fdf7c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.494+0000 7fdf837fe640 1 -- 172.21.15.78:0/3554953048 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf7c03f070 con 0x7fdf8c109be0 2024-09-18T13:04:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.494+0000 7fdf837fe640 1 -- 172.21.15.78:0/3554953048 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdf7c004cf0 con 0x7fdf8c109be0 2024-09-18T13:04:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.494+0000 7fdf94660640 1 -- 172.21.15.78:0/3554953048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf8c199c30 con 0x7fdf8c109be0 2024-09-18T13:04:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.494+0000 7fdf94660640 1 -- 172.21.15.78:0/3554953048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf8c19a1e0 con 0x7fdf8c109be0 2024-09-18T13:04:05.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.494+0000 7fdf837fe640 1 -- 172.21.15.78:0/3554953048 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf7c035030 con 0x7fdf8c109be0 2024-09-18T13:04:05.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.495+0000 7fdf94660640 1 -- 172.21.15.78:0/3554953048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf70005290 con 0x7fdf8c109be0 2024-09-18T13:04:05.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.496+0000 7fdf837fe640 1 -- 172.21.15.78:0/3554953048 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fdf7c042070 con 0x7fdf8c109be0 2024-09-18T13:04:05.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.496+0000 7fdf837fe640 1 --2- 172.21.15.78:0/3554953048 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdf7807af30 0x7fdf7807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:05.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.496+0000 7fdf923fc640 1 --2- 172.21.15.78:0/3554953048 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdf7807af30 0x7fdf7807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:05.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.496+0000 7fdf837fe640 1 -- 172.21.15.78:0/3554953048 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fdf7c0bea40 con 0x7fdf8c109be0 2024-09-18T13:04:05.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.497+0000 7fdf923fc640 1 --2- 172.21.15.78:0/3554953048 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdf7807af30 0x7fdf7807d3f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c19aae0 tx=0x7fdf88008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:05.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.501+0000 7fdf837fe640 1 -- 172.21.15.78:0/3554953048 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fdf7c089fe0 con 0x7fdf8c109be0 2024-09-18T13:04:05.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.788+0000 7fdf94660640 1 -- 172.21.15.78:0/3554953048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fdf70005d90 con 0x7fdf8c109be0 2024-09-18T13:04:05.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.788+0000 7fdf837fe640 1 -- 172.21.15.78:0/3554953048 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fdf7c08ee90 con 0x7fdf8c109be0 2024-09-18T13:04:05.790 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:04:05.790 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:04:05.790 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:04:05.790 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:04:05.790 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:04:05.790 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:04:05.790 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:04:05.790 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:04:05.790 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:04:05.790 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:04:05.790 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:04:05.790 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:04:05.791 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:04:05.791 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:04:05.791 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:04:05.791 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:04:05.791 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:04:05.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.791+0000 7fdf94660640 1 -- 172.21.15.78:0/3554953048 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdf7807af30 msgr2=0x7fdf7807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:05.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.791+0000 7fdf94660640 1 --2- 172.21.15.78:0/3554953048 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdf7807af30 0x7fdf7807d3f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c19aae0 tx=0x7fdf88008040 comp rx=0 tx=0).stop 2024-09-18T13:04:05.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.791+0000 7fdf94660640 1 -- 172.21.15.78:0/3554953048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf8c109be0 msgr2=0x7fdf8c19fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:05.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.791+0000 7fdf94660640 1 --2- 172.21.15.78:0/3554953048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf8c109be0 0x7fdf8c19fd20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c004f90 tx=0x7fdf7c0048f0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.791+0000 7fdf94660640 1 -- 172.21.15.78:0/3554953048 shutdown_connections 2024-09-18T13:04:05.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.791+0000 7fdf94660640 1 --2- 172.21.15.78:0/3554953048 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdf7807af30 0x7fdf7807d3f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.791+0000 7fdf94660640 1 --2- 172.21.15.78:0/3554953048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf8c109be0 0x7fdf8c19fd20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.791+0000 7fdf94660640 1 --2- 172.21.15.78:0/3554953048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf8c103b30 0x7fdf8c19f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.791+0000 7fdf94660640 1 -- 172.21.15.78:0/3554953048 >> 172.21.15.78:0/3554953048 conn(0x7fdf8c0ff810 msgr2=0x7fdf8c101000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:05.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.791+0000 7fdf94660640 1 -- 172.21.15.78:0/3554953048 shutdown_connections 2024-09-18T13:04:05.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.791+0000 7fdf94660640 1 -- 172.21.15.78:0/3554953048 wait complete. 2024-09-18T13:04:05.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.872+0000 7f86bcfa7640 1 -- 172.21.15.78:0/868645559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b8107900 msgr2=0x7f86b8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:05.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.872+0000 7f86bcfa7640 1 --2- 172.21.15.78:0/868645559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b8107900 0x7f86b8107ce0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009880 tx=0x7f86a002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.872+0000 7f86bcfa7640 1 -- 172.21.15.78:0/868645559 shutdown_connections 2024-09-18T13:04:05.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.872+0000 7f86bcfa7640 1 --2- 172.21.15.78:0/868645559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b8101900 0x7f86b8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.872+0000 7f86bcfa7640 1 --2- 172.21.15.78:0/868645559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b8107900 0x7f86b8107ce0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.872+0000 7f86bcfa7640 1 -- 172.21.15.78:0/868645559 >> 172.21.15.78:0/868645559 conn(0x7f86b80fd600 msgr2=0x7f86b80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:05.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.872+0000 7f86bcfa7640 1 -- 172.21.15.78:0/868645559 shutdown_connections 2024-09-18T13:04:05.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.872+0000 7f86bcfa7640 1 -- 172.21.15.78:0/868645559 wait complete. 2024-09-18T13:04:05.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.873+0000 7f86bcfa7640 1 Processor -- start 2024-09-18T13:04:05.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.873+0000 7f86bcfa7640 1 -- start start 2024-09-18T13:04:05.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.873+0000 7f86bcfa7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b8101900 0x7f86b819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:05.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.873+0000 7f86bcfa7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b8107900 0x7f86b819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:05.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.873+0000 7f86bcfa7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f86b810ee30 con 0x7f86b8107900 2024-09-18T13:04:05.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.873+0000 7f86bcfa7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f86b810ecb0 con 0x7f86b8101900 2024-09-18T13:04:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.873+0000 7f86b5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b8107900 0x7f86b819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.873+0000 7f86b5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b8107900 0x7f86b819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58546/0 (socket says 172.21.15.78:58546) 2024-09-18T13:04:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.873+0000 7f86b5d9b640 1 -- 172.21.15.78:0/4134821974 learned_addr learned my addr 172.21.15.78:0/4134821974 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:04:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.873+0000 7f86b659c640 1 --2- 172.21.15.78:0/4134821974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b8101900 0x7f86b819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.873+0000 7f86b5d9b640 1 -- 172.21.15.78:0/4134821974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b8101900 msgr2=0x7f86b819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.873+0000 7f86b5d9b640 1 --2- 172.21.15.78:0/4134821974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b8101900 0x7f86b819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.873+0000 7f86b5d9b640 1 -- 172.21.15.78:0/4134821974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b8197860 con 0x7f86b8107900 2024-09-18T13:04:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.874+0000 7f86b5d9b640 1 --2- 172.21.15.78:0/4134821974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b8107900 0x7f86b819dbe0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f86a800b420 tx=0x7f86a800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.874+0000 7f86af7fe640 1 -- 172.21.15.78:0/4134821974 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86a8011630 con 0x7f86b8107900 2024-09-18T13:04:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.874+0000 7f86af7fe640 1 -- 172.21.15.78:0/4134821974 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f86a8016070 con 0x7f86b8107900 2024-09-18T13:04:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.874+0000 7f86bcfa7640 1 -- 172.21.15.78:0/4134821974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b8197b50 con 0x7f86b8107900 2024-09-18T13:04:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.874+0000 7f86af7fe640 1 -- 172.21.15.78:0/4134821974 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86a8010d40 con 0x7f86b8107900 2024-09-18T13:04:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.874+0000 7f86bcfa7640 1 -- 172.21.15.78:0/4134821974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b81980e0 con 0x7f86b8107900 2024-09-18T13:04:05.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.875+0000 7f86bcfa7640 1 -- 172.21.15.78:0/4134821974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b8103040 con 0x7f86b8107900 2024-09-18T13:04:05.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.875+0000 7f86af7fe640 1 -- 172.21.15.78:0/4134821974 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f86a801b460 con 0x7f86b8107900 2024-09-18T13:04:05.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.876+0000 7f86af7fe640 1 --2- 172.21.15.78:0/4134821974 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f86a407af90 0x7f86a407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:05.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.876+0000 7f86b659c640 1 --2- 172.21.15.78:0/4134821974 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f86a407af90 0x7f86a407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:05.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.876+0000 7f86af7fe640 1 -- 172.21.15.78:0/4134821974 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f86a809d650 con 0x7f86b8107900 2024-09-18T13:04:05.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.877+0000 7f86b659c640 1 --2- 172.21.15.78:0/4134821974 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f86a407af90 0x7f86a407d450 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f86a0000c00 tx=0x7f86a0031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:05.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:05.880+0000 7f86af7fe640 1 -- 172.21.15.78:0/4134821974 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f86a8068c70 con 0x7f86b8107900 2024-09-18T13:04:06.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.088+0000 7f86bcfa7640 1 -- 172.21.15.78:0/4134821974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f86b8198d90 con 0x7f86b8107900 2024-09-18T13:04:06.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.089+0000 7f86af7fe640 1 -- 172.21.15.78:0/4134821974 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f86a806db20 con 0x7f86b8107900 2024-09-18T13:04:06.090 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:04:06.090 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:04:06.090 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:04:06.090 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:04:06.090 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:04:06.091 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:04:06.091 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:04:06.091 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:04:06.091 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:04:06.091 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:04:06.091 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:04:06.091 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:04:06.091 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:04:06.091 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:04:06.091 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:04:06.091 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:04:06.092 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:04:06.092 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:04:06.092 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:04:06.092 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:04:06.092 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:04:06.092 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:04:06.092 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:04:06.092 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:04:06.092 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:04:06.092 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:04:06.092 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:04:06.093 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:04:06.093 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:04:06.093 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:04:06.093 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:04:06.093 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:04:06.093 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:04:06.093 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:04:06.093 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:04:06.093 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:04:06.093 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:04:06.093 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:04:06.093 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:04:06.093 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:04:06.093 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:04:06.094 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:04:06.094 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:04:06.094 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:04:06.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.091+0000 7f86bcfa7640 1 -- 172.21.15.78:0/4134821974 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f86a407af90 msgr2=0x7f86a407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.092+0000 7f86bcfa7640 1 --2- 172.21.15.78:0/4134821974 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f86a407af90 0x7f86a407d450 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f86a0000c00 tx=0x7f86a0031400 comp rx=0 tx=0).stop 2024-09-18T13:04:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.092+0000 7f86bcfa7640 1 -- 172.21.15.78:0/4134821974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b8107900 msgr2=0x7f86b819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.092+0000 7f86bcfa7640 1 --2- 172.21.15.78:0/4134821974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b8107900 0x7f86b819dbe0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f86a800b420 tx=0x7f86a800b8e0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.092+0000 7f86bcfa7640 1 -- 172.21.15.78:0/4134821974 shutdown_connections 2024-09-18T13:04:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.092+0000 7f86bcfa7640 1 --2- 172.21.15.78:0/4134821974 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f86a407af90 0x7f86a407d450 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.092+0000 7f86bcfa7640 1 --2- 172.21.15.78:0/4134821974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b8107900 0x7f86b819dbe0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.092+0000 7f86bcfa7640 1 --2- 172.21.15.78:0/4134821974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b8101900 0x7f86b819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.092+0000 7f86bcfa7640 1 -- 172.21.15.78:0/4134821974 >> 172.21.15.78:0/4134821974 conn(0x7f86b80fd600 msgr2=0x7f86b80fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.092+0000 7f86bcfa7640 1 -- 172.21.15.78:0/4134821974 shutdown_connections 2024-09-18T13:04:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.092+0000 7f86bcfa7640 1 -- 172.21.15.78:0/4134821974 wait complete. 2024-09-18T13:04:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.174+0000 7fce408f7640 1 -- 172.21.15.78:0/1765472433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c106800 msgr2=0x7fce3c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.174+0000 7fce408f7640 1 --2- 172.21.15.78:0/1765472433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c106800 0x7fce3c106be0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fce30009880 tx=0x7fce3002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.174+0000 7fce408f7640 1 -- 172.21.15.78:0/1765472433 shutdown_connections 2024-09-18T13:04:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.174+0000 7fce408f7640 1 --2- 172.21.15.78:0/1765472433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce3c100800 0x7fce3c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.174+0000 7fce408f7640 1 --2- 172.21.15.78:0/1765472433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c106800 0x7fce3c106be0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.174+0000 7fce408f7640 1 -- 172.21.15.78:0/1765472433 >> 172.21.15.78:0/1765472433 conn(0x7fce3c0fc520 msgr2=0x7fce3c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.174+0000 7fce408f7640 1 -- 172.21.15.78:0/1765472433 shutdown_connections 2024-09-18T13:04:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.174+0000 7fce408f7640 1 -- 172.21.15.78:0/1765472433 wait complete. 2024-09-18T13:04:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.175+0000 7fce408f7640 1 Processor -- start 2024-09-18T13:04:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.175+0000 7fce408f7640 1 -- start start 2024-09-18T13:04:06.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.175+0000 7fce408f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c100800 0x7fce3c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:06.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.175+0000 7fce408f7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce3c106800 0x7fce3c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:06.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.175+0000 7fce408f7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c10ee50 con 0x7fce3c100800 2024-09-18T13:04:06.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.175+0000 7fce408f7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c10ecd0 con 0x7fce3c106800 2024-09-18T13:04:06.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.175+0000 7fce3a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c100800 0x7fce3c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:06.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.175+0000 7fce3a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c100800 0x7fce3c19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58558/0 (socket says 172.21.15.78:58558) 2024-09-18T13:04:06.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.175+0000 7fce3a59c640 1 -- 172.21.15.78:0/2211440618 learned_addr learned my addr 172.21.15.78:0/2211440618 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:04:06.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.175+0000 7fce39d9b640 1 --2- 172.21.15.78:0/2211440618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce3c106800 0x7fce3c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:06.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.176+0000 7fce3a59c640 1 -- 172.21.15.78:0/2211440618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce3c106800 msgr2=0x7fce3c19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:06.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.176+0000 7fce3a59c640 1 --2- 172.21.15.78:0/2211440618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce3c106800 0x7fce3c19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.176+0000 7fce3a59c640 1 -- 172.21.15.78:0/2211440618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c197880 con 0x7fce3c100800 2024-09-18T13:04:06.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.176+0000 7fce39d9b640 1 --2- 172.21.15.78:0/2211440618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce3c106800 0x7fce3c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:04:06.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.176+0000 7fce3a59c640 1 --2- 172.21.15.78:0/2211440618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c100800 0x7fce3c19d6c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fce30031460 tx=0x7fce300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:06.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.176+0000 7fce2b7fe640 1 -- 172.21.15.78:0/2211440618 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce3003f070 con 0x7fce3c100800 2024-09-18T13:04:06.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.176+0000 7fce2b7fe640 1 -- 172.21.15.78:0/2211440618 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce30004cf0 con 0x7fce3c100800 2024-09-18T13:04:06.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.176+0000 7fce408f7640 1 -- 172.21.15.78:0/2211440618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3c197b10 con 0x7fce3c100800 2024-09-18T13:04:06.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.176+0000 7fce2b7fe640 1 -- 172.21.15.78:0/2211440618 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce30035030 con 0x7fce3c100800 2024-09-18T13:04:06.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.176+0000 7fce408f7640 1 -- 172.21.15.78:0/2211440618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3c198040 con 0x7fce3c100800 2024-09-18T13:04:06.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.177+0000 7fce408f7640 1 -- 172.21.15.78:0/2211440618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3c101f40 con 0x7fce3c100800 2024-09-18T13:04:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.178+0000 7fce2b7fe640 1 -- 172.21.15.78:0/2211440618 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fce30042070 con 0x7fce3c100800 2024-09-18T13:04:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.178+0000 7fce2b7fe640 1 --2- 172.21.15.78:0/2211440618 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fce2407af30 0x7fce2407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.178+0000 7fce2b7fe640 1 -- 172.21.15.78:0/2211440618 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fce300beb60 con 0x7fce3c100800 2024-09-18T13:04:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.178+0000 7fce39d9b640 1 --2- 172.21.15.78:0/2211440618 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fce2407af30 0x7fce2407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.179+0000 7fce39d9b640 1 --2- 172.21.15.78:0/2211440618 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fce2407af30 0x7fce2407d3f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0feb30 tx=0x7fce2c008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:06.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.183+0000 7fce2b7fe640 1 -- 172.21.15.78:0/2211440618 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fce3008a100 con 0x7fce3c100800 2024-09-18T13:04:06.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.378+0000 7fce408f7640 1 -- 172.21.15.78:0/2211440618 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fce3c198db0 con 0x7fce2407af30 2024-09-18T13:04:06.380 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:06 smithi078 ceph-mon[108578]: from='client.34666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:06.380 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:06 smithi078 ceph-mon[108578]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:06.380 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:06 smithi078 ceph-mon[108578]: pgmap v448: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:06.380 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:06 smithi078 ceph-mon[108578]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:06.380 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:06 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3554953048' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:04:06.380 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:06 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/4134821974' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:04:06.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.380+0000 7fce2b7fe640 1 -- 172.21.15.78:0/2211440618 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fce3c198db0 con 0x7fce2407af30 2024-09-18T13:04:06.381 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:04:06.381 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:04:06.381 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:04:06.381 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:04:06.381 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:04:06.381 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:04:06.382 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:04:06.382 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:04:06.382 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:04:06.382 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:04:06.382 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:04:06.382 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:04:06.382 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:04:06.382 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:04:06.382 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:04:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.382+0000 7fce408f7640 1 -- 172.21.15.78:0/2211440618 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fce2407af30 msgr2=0x7fce2407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.382+0000 7fce408f7640 1 --2- 172.21.15.78:0/2211440618 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fce2407af30 0x7fce2407d3f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0feb30 tx=0x7fce2c008040 comp rx=0 tx=0).stop 2024-09-18T13:04:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.382+0000 7fce408f7640 1 -- 172.21.15.78:0/2211440618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c100800 msgr2=0x7fce3c19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.382+0000 7fce408f7640 1 --2- 172.21.15.78:0/2211440618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c100800 0x7fce3c19d6c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fce30031460 tx=0x7fce300048f0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.382+0000 7fce408f7640 1 -- 172.21.15.78:0/2211440618 shutdown_connections 2024-09-18T13:04:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.382+0000 7fce408f7640 1 --2- 172.21.15.78:0/2211440618 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fce2407af30 0x7fce2407d3f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.382+0000 7fce408f7640 1 --2- 172.21.15.78:0/2211440618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce3c106800 0x7fce3c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.382+0000 7fce408f7640 1 --2- 172.21.15.78:0/2211440618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c100800 0x7fce3c19d6c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.382+0000 7fce408f7640 1 -- 172.21.15.78:0/2211440618 >> 172.21.15.78:0/2211440618 conn(0x7fce3c0fc520 msgr2=0x7fce3c0fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.382+0000 7fce408f7640 1 -- 172.21.15.78:0/2211440618 shutdown_connections 2024-09-18T13:04:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.382+0000 7fce408f7640 1 -- 172.21.15.78:0/2211440618 wait complete. 2024-09-18T13:04:06.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.463+0000 7fb55b566640 1 -- 172.21.15.78:0/3651839650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5541033d0 msgr2=0x7fb55410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:06.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.463+0000 7fb55b566640 1 --2- 172.21.15.78:0/3651839650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5541033d0 0x7fb55410b8c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb544009880 tx=0x7fb54402a530 comp rx=0 tx=0).stop 2024-09-18T13:04:06.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.463+0000 7fb55b566640 1 -- 172.21.15.78:0/3651839650 shutdown_connections 2024-09-18T13:04:06.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.463+0000 7fb55b566640 1 --2- 172.21.15.78:0/3651839650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5541033d0 0x7fb55410b8c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.463+0000 7fb55b566640 1 --2- 172.21.15.78:0/3651839650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb554102ab0 0x7fb554102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.463+0000 7fb55b566640 1 -- 172.21.15.78:0/3651839650 >> 172.21.15.78:0/3651839650 conn(0x7fb5540fc550 msgr2=0x7fb5540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:06.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.463+0000 7fb55b566640 1 -- 172.21.15.78:0/3651839650 shutdown_connections 2024-09-18T13:04:06.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.463+0000 7fb55b566640 1 -- 172.21.15.78:0/3651839650 wait complete. 2024-09-18T13:04:06.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.463+0000 7fb55b566640 1 Processor -- start 2024-09-18T13:04:06.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.463+0000 7fb55b566640 1 -- start start 2024-09-18T13:04:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb55b566640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb554102ab0 0x7fb55419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb55b566640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5541033d0 0x7fb55419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb55b566640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb55410ede0 con 0x7fb554102ab0 2024-09-18T13:04:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb55b566640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb55410ec60 con 0x7fb5541033d0 2024-09-18T13:04:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb559302640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb554102ab0 0x7fb55419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb559302640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb554102ab0 0x7fb55419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58570/0 (socket says 172.21.15.78:58570) 2024-09-18T13:04:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb559302640 1 -- 172.21.15.78:0/2262610511 learned_addr learned my addr 172.21.15.78:0/2262610511 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:04:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb558b01640 1 --2- 172.21.15.78:0/2262610511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5541033d0 0x7fb55419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb559302640 1 -- 172.21.15.78:0/2262610511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5541033d0 msgr2=0x7fb55419dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb559302640 1 --2- 172.21.15.78:0/2262610511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5541033d0 0x7fb55419dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb559302640 1 -- 172.21.15.78:0/2262610511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb554197810 con 0x7fb554102ab0 2024-09-18T13:04:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb558b01640 1 --2- 172.21.15.78:0/2262610511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5541033d0 0x7fb55419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:04:06.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb559302640 1 --2- 172.21.15.78:0/2262610511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb554102ab0 0x7fb55419d690 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb55000d6f0 tx=0x7fb55000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:06.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb54a7fc640 1 -- 172.21.15.78:0/2262610511 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb550017070 con 0x7fb554102ab0 2024-09-18T13:04:06.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb54a7fc640 1 -- 172.21.15.78:0/2262610511 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb55000de00 con 0x7fb554102ab0 2024-09-18T13:04:06.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb55b566640 1 -- 172.21.15.78:0/2262610511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb554197b00 con 0x7fb554102ab0 2024-09-18T13:04:06.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb54a7fc640 1 -- 172.21.15.78:0/2262610511 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb550004bb0 con 0x7fb554102ab0 2024-09-18T13:04:06.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.464+0000 7fb55b566640 1 -- 172.21.15.78:0/2262610511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb554198060 con 0x7fb554102ab0 2024-09-18T13:04:06.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.465+0000 7fb55b566640 1 -- 172.21.15.78:0/2262610511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb55406a580 con 0x7fb554102ab0 2024-09-18T13:04:06.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.466+0000 7fb54a7fc640 1 -- 172.21.15.78:0/2262610511 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fb550009a30 con 0x7fb554102ab0 2024-09-18T13:04:06.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.467+0000 7fb54a7fc640 1 --2- 172.21.15.78:0/2262610511 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb54007af80 0x7fb54007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:06.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.467+0000 7fb54a7fc640 1 -- 172.21.15.78:0/2262610511 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fb55009dbd0 con 0x7fb554102ab0 2024-09-18T13:04:06.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.467+0000 7fb558b01640 1 --2- 172.21.15.78:0/2262610511 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb54007af80 0x7fb54007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:06.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.467+0000 7fb558b01640 1 --2- 172.21.15.78:0/2262610511 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb54007af80 0x7fb54007d440 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb554198b60 tx=0x7fb544031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:06.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.471+0000 7fb54a7fc640 1 -- 172.21.15.78:0/2262610511 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fb5500691f0 con 0x7fb554102ab0 2024-09-18T13:04:06.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.715+0000 7fb55b566640 1 -- 172.21.15.78:0/2262610511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb554105f50 con 0x7fb554102ab0 2024-09-18T13:04:06.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.715+0000 7fb54a7fc640 1 -- 172.21.15.78:0/2262610511 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fb55006e0a0 con 0x7fb554102ab0 2024-09-18T13:04:06.716 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:04:06.716 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:04:06.716 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:04:06.716 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:04:06.716 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:04:06.717 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:04:06.717 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:04:06.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.717+0000 7fb55b566640 1 -- 172.21.15.78:0/2262610511 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb54007af80 msgr2=0x7fb54007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:06.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.717+0000 7fb55b566640 1 --2- 172.21.15.78:0/2262610511 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb54007af80 0x7fb54007d440 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb554198b60 tx=0x7fb544031400 comp rx=0 tx=0).stop 2024-09-18T13:04:06.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.717+0000 7fb55b566640 1 -- 172.21.15.78:0/2262610511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb554102ab0 msgr2=0x7fb55419d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:06.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.717+0000 7fb55b566640 1 --2- 172.21.15.78:0/2262610511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb554102ab0 0x7fb55419d690 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb55000d6f0 tx=0x7fb55000dbb0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.717+0000 7fb55b566640 1 -- 172.21.15.78:0/2262610511 shutdown_connections 2024-09-18T13:04:06.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.717+0000 7fb55b566640 1 --2- 172.21.15.78:0/2262610511 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb54007af80 0x7fb54007d440 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.717+0000 7fb55b566640 1 --2- 172.21.15.78:0/2262610511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5541033d0 0x7fb55419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.717+0000 7fb55b566640 1 --2- 172.21.15.78:0/2262610511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb554102ab0 0x7fb55419d690 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:06.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.717+0000 7fb55b566640 1 -- 172.21.15.78:0/2262610511 >> 172.21.15.78:0/2262610511 conn(0x7fb5540fc550 msgr2=0x7fb554108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:06.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.718+0000 7fb55b566640 1 -- 172.21.15.78:0/2262610511 shutdown_connections 2024-09-18T13:04:06.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:06.718+0000 7fb55b566640 1 -- 172.21.15.78:0/2262610511 wait complete. 2024-09-18T13:04:06.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:06 smithi148 ceph-mon[80030]: from='client.34666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:06.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:06 smithi148 ceph-mon[80030]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:06.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:06 smithi148 ceph-mon[80030]: pgmap v448: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:06.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:06 smithi148 ceph-mon[80030]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:06.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:06 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3554953048' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:04:06.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:06 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/4134821974' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:04:07.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:07 smithi148 ceph-mon[80030]: from='client.34686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:07.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:07 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2262610511' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:04:07.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:07 smithi078 ceph-mon[108578]: from='client.34686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:07.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:07 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2262610511' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:04:08.648 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:08 smithi148 ceph-mon[80030]: pgmap v449: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:08.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:08 smithi078 ceph-mon[108578]: pgmap v449: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:10.654 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:10 smithi078 ceph-mon[108578]: pgmap v450: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:10 smithi148 ceph-mon[80030]: pgmap v450: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:12.701 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:12 smithi078 ceph-mon[108578]: pgmap v451: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:12.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:12 smithi148 ceph-mon[80030]: pgmap v451: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:14 smithi148 ceph-mon[80030]: pgmap v452: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:14.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:14 smithi078 ceph-mon[108578]: pgmap v452: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:16.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:16 smithi148 ceph-mon[80030]: pgmap v453: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:16 smithi078 ceph-mon[108578]: pgmap v453: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:18.704 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:18 smithi078 ceph-mon[108578]: pgmap v454: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:18 smithi148 ceph-mon[80030]: pgmap v454: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:20 smithi148 ceph-mon[80030]: pgmap v455: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:20.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:20 smithi078 ceph-mon[108578]: pgmap v455: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:22 smithi148 ceph-mon[80030]: pgmap v456: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:22.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:22 smithi078 ceph-mon[108578]: pgmap v456: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:24.714 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:24 smithi078 ceph-mon[108578]: pgmap v457: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:24.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:24 smithi148 ceph-mon[80030]: pgmap v457: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:26 smithi148 ceph-mon[80030]: pgmap v458: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:26 smithi078 ceph-mon[108578]: pgmap v458: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:28.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:28 smithi148 ceph-mon[80030]: pgmap v459: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:28.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:28 smithi078 ceph-mon[108578]: pgmap v459: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:30.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:30 smithi078 ceph-mon[108578]: pgmap v460: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:30 smithi148 ceph-mon[80030]: pgmap v460: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:32 smithi148 ceph-mon[80030]: pgmap v461: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:32.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:32 smithi078 ceph-mon[108578]: pgmap v461: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:34 smithi148 ceph-mon[80030]: pgmap v462: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:34.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:34 smithi078 ceph-mon[108578]: pgmap v462: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:36.708 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:36 smithi078 ceph-mon[108578]: pgmap v463: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:36.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:36 smithi148 ceph-mon[80030]: pgmap v463: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:36.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.808+0000 7f1e5679b640 1 -- 172.21.15.78:0/2600224632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50100800 msgr2=0x7f1e50100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:36.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.808+0000 7f1e5679b640 1 --2- 172.21.15.78:0/2600224632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50100800 0x7f1e50100c60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009880 tx=0x7f1e3802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:04:36.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.808+0000 7f1e5679b640 1 -- 172.21.15.78:0/2600224632 shutdown_connections 2024-09-18T13:04:36.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.808+0000 7f1e5679b640 1 --2- 172.21.15.78:0/2600224632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50100800 0x7f1e50100c60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:36.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.808+0000 7f1e5679b640 1 --2- 172.21.15.78:0/2600224632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e50106800 0x7f1e50106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:36.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.808+0000 7f1e5679b640 1 -- 172.21.15.78:0/2600224632 >> 172.21.15.78:0/2600224632 conn(0x7f1e500fc520 msgr2=0x7f1e500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:36.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.808+0000 7f1e5679b640 1 -- 172.21.15.78:0/2600224632 shutdown_connections 2024-09-18T13:04:36.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.808+0000 7f1e5679b640 1 -- 172.21.15.78:0/2600224632 wait complete. 2024-09-18T13:04:36.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.809+0000 7f1e5679b640 1 Processor -- start 2024-09-18T13:04:36.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.809+0000 7f1e5679b640 1 -- start start 2024-09-18T13:04:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.809+0000 7f1e5679b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50100800 0x7f1e501023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.809+0000 7f1e5679b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e50106800 0x7f1e50102910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.809+0000 7f1e5679b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5010dcd0 con 0x7f1e50100800 2024-09-18T13:04:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.809+0000 7f1e5679b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5010db50 con 0x7f1e50106800 2024-09-18T13:04:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.809+0000 7f1e4ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50100800 0x7f1e501023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.809+0000 7f1e4ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50100800 0x7f1e501023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50862/0 (socket says 172.21.15.78:50862) 2024-09-18T13:04:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.809+0000 7f1e4ffff640 1 -- 172.21.15.78:0/709981862 learned_addr learned my addr 172.21.15.78:0/709981862 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:04:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.810+0000 7f1e4ffff640 1 -- 172.21.15.78:0/709981862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e50106800 msgr2=0x7f1e50102910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.810+0000 7f1e4f7fe640 1 --2- 172.21.15.78:0/709981862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e50106800 0x7f1e50102910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.810+0000 7f1e4ffff640 1 --2- 172.21.15.78:0/709981862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e50106800 0x7f1e50102910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.810+0000 7f1e4ffff640 1 -- 172.21.15.78:0/709981862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e50102e50 con 0x7f1e50100800 2024-09-18T13:04:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.810+0000 7f1e4f7fe640 1 --2- 172.21.15.78:0/709981862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e50106800 0x7f1e50102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:04:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.810+0000 7f1e4ffff640 1 --2- 172.21.15.78:0/709981862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50100800 0x7f1e501023d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000d6f0 tx=0x7f1e4000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.810+0000 7f1e4d7fa640 1 -- 172.21.15.78:0/709981862 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e40017070 con 0x7f1e50100800 2024-09-18T13:04:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.810+0000 7f1e5679b640 1 -- 172.21.15.78:0/709981862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e50103140 con 0x7f1e50100800 2024-09-18T13:04:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.810+0000 7f1e4d7fa640 1 -- 172.21.15.78:0/709981862 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e4000de00 con 0x7f1e50100800 2024-09-18T13:04:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.810+0000 7f1e4d7fa640 1 -- 172.21.15.78:0/709981862 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e40004bb0 con 0x7f1e50100800 2024-09-18T13:04:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.810+0000 7f1e5679b640 1 -- 172.21.15.78:0/709981862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e501a3e00 con 0x7f1e50100800 2024-09-18T13:04:36.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.811+0000 7f1e5679b640 1 -- 172.21.15.78:0/709981862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e50101f40 con 0x7f1e50100800 2024-09-18T13:04:36.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.812+0000 7f1e4d7fa640 1 -- 172.21.15.78:0/709981862 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1e40004e60 con 0x7f1e50100800 2024-09-18T13:04:36.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.812+0000 7f1e4d7fa640 1 --2- 172.21.15.78:0/709981862 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1e3c07af30 0x7f1e3c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:36.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.813+0000 7f1e4d7fa640 1 -- 172.21.15.78:0/709981862 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f1e4009dc90 con 0x7f1e50100800 2024-09-18T13:04:36.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.813+0000 7f1e4f7fe640 1 --2- 172.21.15.78:0/709981862 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1e3c07af30 0x7f1e3c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:36.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.813+0000 7f1e4f7fe640 1 --2- 172.21.15.78:0/709981862 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1e3c07af30 0x7f1e3c07d3f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1e38006010 tx=0x7f1e380095f0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:36.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:36.817+0000 7f1e4d7fa640 1 -- 172.21.15.78:0/709981862 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1e40069230 con 0x7f1e50100800 2024-09-18T13:04:37.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.009+0000 7f1e5679b640 1 -- 172.21.15.78:0/709981862 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1e5006a1b0 con 0x7f1e3c07af30 2024-09-18T13:04:37.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.010+0000 7f1e4d7fa640 1 -- 172.21.15.78:0/709981862 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f1e5006a1b0 con 0x7f1e3c07af30 2024-09-18T13:04:37.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.012+0000 7f1e5679b640 1 -- 172.21.15.78:0/709981862 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1e3c07af30 msgr2=0x7f1e3c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.012+0000 7f1e5679b640 1 --2- 172.21.15.78:0/709981862 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1e3c07af30 0x7f1e3c07d3f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1e38006010 tx=0x7f1e380095f0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.012+0000 7f1e5679b640 1 -- 172.21.15.78:0/709981862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50100800 msgr2=0x7f1e501023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.012+0000 7f1e5679b640 1 --2- 172.21.15.78:0/709981862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50100800 0x7f1e501023d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000d6f0 tx=0x7f1e4000dbb0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.013+0000 7f1e5679b640 1 -- 172.21.15.78:0/709981862 shutdown_connections 2024-09-18T13:04:37.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.013+0000 7f1e5679b640 1 --2- 172.21.15.78:0/709981862 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1e3c07af30 0x7f1e3c07d3f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.013+0000 7f1e5679b640 1 --2- 172.21.15.78:0/709981862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e50106800 0x7f1e50102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.013+0000 7f1e5679b640 1 --2- 172.21.15.78:0/709981862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50100800 0x7f1e501023d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.013+0000 7f1e5679b640 1 -- 172.21.15.78:0/709981862 >> 172.21.15.78:0/709981862 conn(0x7f1e500fc520 msgr2=0x7f1e501045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:37.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.013+0000 7f1e5679b640 1 -- 172.21.15.78:0/709981862 shutdown_connections 2024-09-18T13:04:37.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.013+0000 7f1e5679b640 1 -- 172.21.15.78:0/709981862 wait complete. 2024-09-18T13:04:37.022 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:04:37.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.095+0000 7f7bc4a53640 1 -- 172.21.15.78:0/3060226816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc0107900 msgr2=0x7f7bc0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.095+0000 7f7bc4a53640 1 --2- 172.21.15.78:0/3060226816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc0107900 0x7f7bc0107ce0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009880 tx=0x7f7bb002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.095+0000 7f7bc4a53640 1 -- 172.21.15.78:0/3060226816 shutdown_connections 2024-09-18T13:04:37.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.095+0000 7f7bc4a53640 1 --2- 172.21.15.78:0/3060226816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bc0101900 0x7f7bc0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.095+0000 7f7bc4a53640 1 --2- 172.21.15.78:0/3060226816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc0107900 0x7f7bc0107ce0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.095+0000 7f7bc4a53640 1 -- 172.21.15.78:0/3060226816 >> 172.21.15.78:0/3060226816 conn(0x7f7bc00fd600 msgr2=0x7f7bc00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:37.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.095+0000 7f7bc4a53640 1 -- 172.21.15.78:0/3060226816 shutdown_connections 2024-09-18T13:04:37.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.095+0000 7f7bc4a53640 1 -- 172.21.15.78:0/3060226816 wait complete. 2024-09-18T13:04:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.096+0000 7f7bc4a53640 1 Processor -- start 2024-09-18T13:04:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.096+0000 7f7bc4a53640 1 -- start start 2024-09-18T13:04:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.096+0000 7f7bc4a53640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bc0101900 0x7f7bc019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.096+0000 7f7bc4a53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc0107900 0x7f7bc019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.096+0000 7f7bc4a53640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc010ee30 con 0x7f7bc0107900 2024-09-18T13:04:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.096+0000 7f7bc4a53640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc010ecb0 con 0x7f7bc0101900 2024-09-18T13:04:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.096+0000 7f7bb7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc0107900 0x7f7bc019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.096+0000 7f7bb7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc0107900 0x7f7bc019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50884/0 (socket says 172.21.15.78:50884) 2024-09-18T13:04:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.096+0000 7f7bb7fff640 1 -- 172.21.15.78:0/4207953053 learned_addr learned my addr 172.21.15.78:0/4207953053 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:04:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.096+0000 7f7bbe59c640 1 --2- 172.21.15.78:0/4207953053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bc0101900 0x7f7bc019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.097+0000 7f7bb7fff640 1 -- 172.21.15.78:0/4207953053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bc0101900 msgr2=0x7f7bc019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.097+0000 7f7bb7fff640 1 --2- 172.21.15.78:0/4207953053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bc0101900 0x7f7bc019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.097+0000 7f7bb7fff640 1 -- 172.21.15.78:0/4207953053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc0197810 con 0x7f7bc0107900 2024-09-18T13:04:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.097+0000 7f7bb7fff640 1 --2- 172.21.15.78:0/4207953053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc0107900 0x7f7bc019dbd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800b420 tx=0x7f7ba800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.097+0000 7f7bb77fe640 1 -- 172.21.15.78:0/4207953053 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ba8011630 con 0x7f7bc0107900 2024-09-18T13:04:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.097+0000 7f7bb77fe640 1 -- 172.21.15.78:0/4207953053 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ba8016070 con 0x7f7bc0107900 2024-09-18T13:04:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.097+0000 7f7bc4a53640 1 -- 172.21.15.78:0/4207953053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc0197b00 con 0x7f7bc0107900 2024-09-18T13:04:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.097+0000 7f7bb77fe640 1 -- 172.21.15.78:0/4207953053 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ba8010d40 con 0x7f7bc0107900 2024-09-18T13:04:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.097+0000 7f7bc4a53640 1 -- 172.21.15.78:0/4207953053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc0198090 con 0x7f7bc0107900 2024-09-18T13:04:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.098+0000 7f7bc4a53640 1 -- 172.21.15.78:0/4207953053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bc0103040 con 0x7f7bc0107900 2024-09-18T13:04:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.099+0000 7f7bb77fe640 1 -- 172.21.15.78:0/4207953053 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7ba801b460 con 0x7f7bc0107900 2024-09-18T13:04:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.099+0000 7f7bb77fe640 1 --2- 172.21.15.78:0/4207953053 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7bac07af30 0x7f7bac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.099+0000 7f7bb77fe640 1 -- 172.21.15.78:0/4207953053 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f7ba809d810 con 0x7f7bc0107900 2024-09-18T13:04:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.099+0000 7f7bbe59c640 1 --2- 172.21.15.78:0/4207953053 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7bac07af30 0x7f7bac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.099+0000 7f7bbe59c640 1 --2- 172.21.15.78:0/4207953053 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7bac07af30 0x7f7bac07d3f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00096c0 tx=0x7f7bb0031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:37.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.103+0000 7f7bb77fe640 1 -- 172.21.15.78:0/4207953053 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7ba8021250 con 0x7f7bc0107900 2024-09-18T13:04:37.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.295+0000 7f7bc4a53640 1 -- 172.21.15.78:0/4207953053 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7bc0198400 con 0x7f7bac07af30 2024-09-18T13:04:37.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.296+0000 7f7bb77fe640 1 -- 172.21.15.78:0/4207953053 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7bc0198400 con 0x7f7bac07af30 2024-09-18T13:04:37.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.298+0000 7f7bc4a53640 1 -- 172.21.15.78:0/4207953053 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7bac07af30 msgr2=0x7f7bac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.298+0000 7f7bc4a53640 1 --2- 172.21.15.78:0/4207953053 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7bac07af30 0x7f7bac07d3f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00096c0 tx=0x7f7bb0031400 comp rx=0 tx=0).stop 2024-09-18T13:04:37.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.298+0000 7f7bc4a53640 1 -- 172.21.15.78:0/4207953053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc0107900 msgr2=0x7f7bc019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.298+0000 7f7bc4a53640 1 --2- 172.21.15.78:0/4207953053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc0107900 0x7f7bc019dbd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800b420 tx=0x7f7ba800b8e0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.298+0000 7f7bc4a53640 1 -- 172.21.15.78:0/4207953053 shutdown_connections 2024-09-18T13:04:37.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.298+0000 7f7bc4a53640 1 --2- 172.21.15.78:0/4207953053 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7bac07af30 0x7f7bac07d3f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.298+0000 7f7bc4a53640 1 --2- 172.21.15.78:0/4207953053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc0107900 0x7f7bc019dbd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.298+0000 7f7bc4a53640 1 --2- 172.21.15.78:0/4207953053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bc0101900 0x7f7bc019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.298+0000 7f7bc4a53640 1 -- 172.21.15.78:0/4207953053 >> 172.21.15.78:0/4207953053 conn(0x7f7bc00fd600 msgr2=0x7f7bc00fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:37.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.299+0000 7f7bc4a53640 1 -- 172.21.15.78:0/4207953053 shutdown_connections 2024-09-18T13:04:37.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.299+0000 7f7bc4a53640 1 -- 172.21.15.78:0/4207953053 wait complete. 2024-09-18T13:04:37.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.380+0000 7ff595f56640 1 -- 172.21.15.78:0/2546099230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff590101910 msgr2=0x7ff590101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.380+0000 7ff595f56640 1 --2- 172.21.15.78:0/2546099230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff590101910 0x7ff590101d70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff584009880 tx=0x7ff58402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.380+0000 7ff595f56640 1 -- 172.21.15.78:0/2546099230 shutdown_connections 2024-09-18T13:04:37.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.380+0000 7ff595f56640 1 --2- 172.21.15.78:0/2546099230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff590101910 0x7ff590101d70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.380+0000 7ff595f56640 1 --2- 172.21.15.78:0/2546099230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff590107910 0x7ff590107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.380+0000 7ff595f56640 1 -- 172.21.15.78:0/2546099230 >> 172.21.15.78:0/2546099230 conn(0x7ff5900fd610 msgr2=0x7ff5900ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:37.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.380+0000 7ff595f56640 1 -- 172.21.15.78:0/2546099230 shutdown_connections 2024-09-18T13:04:37.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.380+0000 7ff595f56640 1 -- 172.21.15.78:0/2546099230 wait complete. 2024-09-18T13:04:37.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.381+0000 7ff595f56640 1 Processor -- start 2024-09-18T13:04:37.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.381+0000 7ff595f56640 1 -- start start 2024-09-18T13:04:37.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.381+0000 7ff595f56640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff590101910 0x7ff59019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.381+0000 7ff595f56640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff590107910 0x7ff59019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.381+0000 7ff595f56640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff59010ede0 con 0x7ff590101910 2024-09-18T13:04:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.381+0000 7ff595f56640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff59010ec60 con 0x7ff590107910 2024-09-18T13:04:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.381+0000 7ff58f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff590101910 0x7ff59019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.381+0000 7ff58f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff590101910 0x7ff59019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50908/0 (socket says 172.21.15.78:50908) 2024-09-18T13:04:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.381+0000 7ff58f7fe640 1 -- 172.21.15.78:0/3612525663 learned_addr learned my addr 172.21.15.78:0/3612525663 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:04:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.381+0000 7ff58effd640 1 --2- 172.21.15.78:0/3612525663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff590107910 0x7ff59019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.381+0000 7ff58f7fe640 1 -- 172.21.15.78:0/3612525663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff590107910 msgr2=0x7ff59019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.381+0000 7ff58f7fe640 1 --2- 172.21.15.78:0/3612525663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff590107910 0x7ff59019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.381+0000 7ff58f7fe640 1 -- 172.21.15.78:0/3612525663 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5901977f0 con 0x7ff590101910 2024-09-18T13:04:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.382+0000 7ff58effd640 1 --2- 172.21.15.78:0/3612525663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff590107910 0x7ff59019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:04:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.382+0000 7ff58f7fe640 1 --2- 172.21.15.78:0/3612525663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff590101910 0x7ff59019d670 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff58000c8f0 tx=0x7ff58000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:37.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.382+0000 7ff58cff9640 1 -- 172.21.15.78:0/3612525663 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff5800079b0 con 0x7ff590101910 2024-09-18T13:04:37.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.382+0000 7ff58cff9640 1 -- 172.21.15.78:0/3612525663 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff5800054e0 con 0x7ff590101910 2024-09-18T13:04:37.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.382+0000 7ff595f56640 1 -- 172.21.15.78:0/3612525663 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff590197ae0 con 0x7ff590101910 2024-09-18T13:04:37.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.382+0000 7ff58cff9640 1 -- 172.21.15.78:0/3612525663 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff580004dd0 con 0x7ff590101910 2024-09-18T13:04:37.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.382+0000 7ff595f56640 1 -- 172.21.15.78:0/3612525663 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff590198070 con 0x7ff590101910 2024-09-18T13:04:37.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.383+0000 7ff595f56640 1 -- 172.21.15.78:0/3612525663 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff590103050 con 0x7ff590101910 2024-09-18T13:04:37.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.384+0000 7ff58cff9640 1 -- 172.21.15.78:0/3612525663 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff580005020 con 0x7ff590101910 2024-09-18T13:04:37.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.384+0000 7ff58cff9640 1 --2- 172.21.15.78:0/3612525663 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff57807aed0 0x7ff57807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:37.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.384+0000 7ff58effd640 1 --2- 172.21.15.78:0/3612525663 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff57807aed0 0x7ff57807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:37.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.384+0000 7ff58cff9640 1 -- 172.21.15.78:0/3612525663 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7ff58009e080 con 0x7ff590101910 2024-09-18T13:04:37.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.385+0000 7ff58effd640 1 --2- 172.21.15.78:0/3612525663 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff57807aed0 0x7ff57807d390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff584031460 tx=0x7ff5840095f0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:37.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.389+0000 7ff58cff9640 1 -- 172.21.15.78:0/3612525663 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff580014030 con 0x7ff590101910 2024-09-18T13:04:37.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.572+0000 7ff595f56640 1 -- 172.21.15.78:0/3612525663 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff590198380 con 0x7ff57807aed0 2024-09-18T13:04:37.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.582+0000 7ff58cff9640 1 -- 172.21.15.78:0/3612525663 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ff590198380 con 0x7ff57807aed0 2024-09-18T13:04:37.583 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:04:37.584 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (12m) 6m ago 23m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:04:37.584 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (15m) 6m ago 23m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:04:37.584 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (14m) 6m ago 22m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:04:37.584 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (10m) 6m ago 23m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:04:37.584 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (10m) 6m ago 22m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:04:37.584 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (12m) 6m ago 23m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:04:37.584 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (7m) 6m ago 18m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:04:37.584 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (6m) 6m ago 18m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:04:37.584 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (6m) 6m ago 18m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:04:37.584 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (6m) 6m ago 17m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:04:37.584 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (14m) 6m ago 24m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:04:37.584 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (13m) 6m ago 22m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:04:37.584 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (11m) 6m ago 24m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:04:37.585 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (10m) 6m ago 22m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:04:37.585 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (13m) 6m ago 23m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:04:37.585 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (13m) 6m ago 22m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:04:37.585 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (10m) 6m ago 21m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:04:37.585 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (9m) 6m ago 20m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:04:37.585 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (9m) 6m ago 20m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:04:37.585 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (8m) 6m ago 20m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:04:37.585 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (7m) 6m ago 19m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:04:37.585 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (7m) 6m ago 19m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:04:37.585 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (12m) 6m ago 23m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:04:37.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.585+0000 7ff595f56640 1 -- 172.21.15.78:0/3612525663 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff57807aed0 msgr2=0x7ff57807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.585+0000 7ff595f56640 1 --2- 172.21.15.78:0/3612525663 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff57807aed0 0x7ff57807d390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff584031460 tx=0x7ff5840095f0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.585+0000 7ff595f56640 1 -- 172.21.15.78:0/3612525663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff590101910 msgr2=0x7ff59019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.585+0000 7ff595f56640 1 --2- 172.21.15.78:0/3612525663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff590101910 0x7ff59019d670 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff58000c8f0 tx=0x7ff58000cdb0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.585+0000 7ff595f56640 1 -- 172.21.15.78:0/3612525663 shutdown_connections 2024-09-18T13:04:37.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.585+0000 7ff595f56640 1 --2- 172.21.15.78:0/3612525663 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff57807aed0 0x7ff57807d390 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.585+0000 7ff595f56640 1 --2- 172.21.15.78:0/3612525663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff590107910 0x7ff59019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.585+0000 7ff595f56640 1 --2- 172.21.15.78:0/3612525663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff590101910 0x7ff59019d670 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.585+0000 7ff595f56640 1 -- 172.21.15.78:0/3612525663 >> 172.21.15.78:0/3612525663 conn(0x7ff5900fd610 msgr2=0x7ff5900fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:37.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.585+0000 7ff595f56640 1 -- 172.21.15.78:0/3612525663 shutdown_connections 2024-09-18T13:04:37.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.585+0000 7ff595f56640 1 -- 172.21.15.78:0/3612525663 wait complete. 2024-09-18T13:04:37.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.665+0000 7f7af3f2d640 1 -- 172.21.15.78:0/4054834674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec107900 msgr2=0x7f7aec107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.665+0000 7f7af3f2d640 1 --2- 172.21.15.78:0/4054834674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec107900 0x7f7aec107ce0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8009880 tx=0x7f7ae802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.665+0000 7f7af3f2d640 1 -- 172.21.15.78:0/4054834674 shutdown_connections 2024-09-18T13:04:37.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.665+0000 7f7af3f2d640 1 --2- 172.21.15.78:0/4054834674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7aec101900 0x7f7aec101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.665+0000 7f7af3f2d640 1 --2- 172.21.15.78:0/4054834674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec107900 0x7f7aec107ce0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.665+0000 7f7af3f2d640 1 -- 172.21.15.78:0/4054834674 >> 172.21.15.78:0/4054834674 conn(0x7f7aec0fd600 msgr2=0x7f7aec0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.665+0000 7f7af3f2d640 1 -- 172.21.15.78:0/4054834674 shutdown_connections 2024-09-18T13:04:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.665+0000 7f7af3f2d640 1 -- 172.21.15.78:0/4054834674 wait complete. 2024-09-18T13:04:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.666+0000 7f7af3f2d640 1 Processor -- start 2024-09-18T13:04:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.666+0000 7f7af3f2d640 1 -- start start 2024-09-18T13:04:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.666+0000 7f7af3f2d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7aec101900 0x7f7aec0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.666+0000 7f7af3f2d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec107900 0x7f7aec074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.666+0000 7f7af3f2d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec10edd0 con 0x7f7aec107900 2024-09-18T13:04:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.666+0000 7f7af3f2d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec10ec50 con 0x7f7aec101900 2024-09-18T13:04:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.666+0000 7f7af14c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec107900 0x7f7aec074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.666+0000 7f7af14c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec107900 0x7f7aec074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50938/0 (socket says 172.21.15.78:50938) 2024-09-18T13:04:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.666+0000 7f7af14c8640 1 -- 172.21.15.78:0/4259971864 learned_addr learned my addr 172.21.15.78:0/4259971864 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:04:37.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.666+0000 7f7af1cc9640 1 --2- 172.21.15.78:0/4259971864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7aec101900 0x7f7aec0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:37.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.666+0000 7f7af14c8640 1 -- 172.21.15.78:0/4259971864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7aec101900 msgr2=0x7f7aec0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.666+0000 7f7af14c8640 1 --2- 172.21.15.78:0/4259971864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7aec101900 0x7f7aec0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.666+0000 7f7af14c8640 1 -- 172.21.15.78:0/4259971864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec074f70 con 0x7f7aec107900 2024-09-18T13:04:37.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.667+0000 7f7af14c8640 1 --2- 172.21.15.78:0/4259971864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec107900 0x7f7aec074a30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00c8f0 tx=0x7f7adc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:37.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.667+0000 7f7ae2ffd640 1 -- 172.21.15.78:0/4259971864 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7adc0079b0 con 0x7f7aec107900 2024-09-18T13:04:37.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.667+0000 7f7ae2ffd640 1 -- 172.21.15.78:0/4259971864 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7adc0054e0 con 0x7f7aec107900 2024-09-18T13:04:37.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.667+0000 7f7af3f2d640 1 -- 172.21.15.78:0/4259971864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aec075260 con 0x7f7aec107900 2024-09-18T13:04:37.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.667+0000 7f7ae2ffd640 1 -- 172.21.15.78:0/4259971864 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7adc004dd0 con 0x7f7aec107900 2024-09-18T13:04:37.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.667+0000 7f7af3f2d640 1 -- 172.21.15.78:0/4259971864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aec1a3ea0 con 0x7f7aec107900 2024-09-18T13:04:37.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.668+0000 7f7af3f2d640 1 -- 172.21.15.78:0/4259971864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aec103040 con 0x7f7aec107900 2024-09-18T13:04:37.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.668+0000 7f7ae2ffd640 1 -- 172.21.15.78:0/4259971864 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7adc005020 con 0x7f7aec107900 2024-09-18T13:04:37.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.669+0000 7f7ae2ffd640 1 --2- 172.21.15.78:0/4259971864 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ad807aed0 0x7f7ad807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:37.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.669+0000 7f7af1cc9640 1 --2- 172.21.15.78:0/4259971864 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ad807aed0 0x7f7ad807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:37.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.669+0000 7f7ae2ffd640 1 -- 172.21.15.78:0/4259971864 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f7adc09df80 con 0x7f7aec107900 2024-09-18T13:04:37.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.670+0000 7f7af1cc9640 1 --2- 172.21.15.78:0/4259971864 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ad807aed0 0x7f7ad807d390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8000c00 tx=0x7f7ae8031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:37.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.674+0000 7f7ae2ffd640 1 -- 172.21.15.78:0/4259971864 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7adc014030 con 0x7f7aec107900 2024-09-18T13:04:37.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.920+0000 7f7af3f2d640 1 -- 172.21.15.78:0/4259971864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7aec109e70 con 0x7f7aec107900 2024-09-18T13:04:37.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.920+0000 7f7ae2ffd640 1 -- 172.21.15.78:0/4259971864 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f7adc069520 con 0x7f7aec107900 2024-09-18T13:04:37.922 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:04:37.922 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:04:37.922 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:04:37.922 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:04:37.922 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:04:37.922 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:04:37.922 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:04:37.922 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:04:37.922 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:04:37.922 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:04:37.922 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:04:37.923 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:04:37.923 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:04:37.923 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:04:37.923 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:04:37.923 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:04:37.923 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:04:37.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.923+0000 7f7af3f2d640 1 -- 172.21.15.78:0/4259971864 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ad807aed0 msgr2=0x7f7ad807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.923+0000 7f7af3f2d640 1 --2- 172.21.15.78:0/4259971864 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ad807aed0 0x7f7ad807d390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8000c00 tx=0x7f7ae8031400 comp rx=0 tx=0).stop 2024-09-18T13:04:37.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.923+0000 7f7af3f2d640 1 -- 172.21.15.78:0/4259971864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec107900 msgr2=0x7f7aec074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:37.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.923+0000 7f7af3f2d640 1 --2- 172.21.15.78:0/4259971864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec107900 0x7f7aec074a30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00c8f0 tx=0x7f7adc00cdb0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.923+0000 7f7af3f2d640 1 -- 172.21.15.78:0/4259971864 shutdown_connections 2024-09-18T13:04:37.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.923+0000 7f7af3f2d640 1 --2- 172.21.15.78:0/4259971864 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ad807aed0 0x7f7ad807d390 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.923+0000 7f7af3f2d640 1 --2- 172.21.15.78:0/4259971864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec107900 0x7f7aec074a30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.923+0000 7f7af3f2d640 1 --2- 172.21.15.78:0/4259971864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7aec101900 0x7f7aec0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:37.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.923+0000 7f7af3f2d640 1 -- 172.21.15.78:0/4259971864 >> 172.21.15.78:0/4259971864 conn(0x7f7aec0fd600 msgr2=0x7f7aec0fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:37.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.923+0000 7f7af3f2d640 1 -- 172.21.15.78:0/4259971864 shutdown_connections 2024-09-18T13:04:37.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:37.923+0000 7f7af3f2d640 1 -- 172.21.15.78:0/4259971864 wait complete. 2024-09-18T13:04:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.004+0000 7f66807fd640 1 -- 172.21.15.78:0/3627120673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6678106800 msgr2=0x7f6678106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.004+0000 7f66807fd640 1 --2- 172.21.15.78:0/3627120673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6678106800 0x7f6678106be0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6674009880 tx=0x7f667402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.004+0000 7f66807fd640 1 -- 172.21.15.78:0/3627120673 shutdown_connections 2024-09-18T13:04:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.004+0000 7f66807fd640 1 --2- 172.21.15.78:0/3627120673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6678100800 0x7f6678100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.004+0000 7f66807fd640 1 --2- 172.21.15.78:0/3627120673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6678106800 0x7f6678106be0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.004+0000 7f66807fd640 1 -- 172.21.15.78:0/3627120673 >> 172.21.15.78:0/3627120673 conn(0x7f66780fc520 msgr2=0x7f66780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.004+0000 7f66807fd640 1 -- 172.21.15.78:0/3627120673 shutdown_connections 2024-09-18T13:04:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.004+0000 7f66807fd640 1 -- 172.21.15.78:0/3627120673 wait complete. 2024-09-18T13:04:38.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.005+0000 7f66807fd640 1 Processor -- start 2024-09-18T13:04:38.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.005+0000 7f66807fd640 1 -- start start 2024-09-18T13:04:38.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.005+0000 7f66807fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6678100800 0x7f667819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:38.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.005+0000 7f66807fd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6678106800 0x7f667819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:38.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.005+0000 7f66807fd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f667810dcd0 con 0x7f6678100800 2024-09-18T13:04:38.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.005+0000 7f66807fd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f667810db50 con 0x7f6678106800 2024-09-18T13:04:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.005+0000 7f667e599640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6678100800 0x7f667819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.005+0000 7f667e599640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6678100800 0x7f667819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50966/0 (socket says 172.21.15.78:50966) 2024-09-18T13:04:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.005+0000 7f667e599640 1 -- 172.21.15.78:0/1064324665 learned_addr learned my addr 172.21.15.78:0/1064324665 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:04:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.005+0000 7f667dd98640 1 --2- 172.21.15.78:0/1064324665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6678106800 0x7f667819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.005+0000 7f667e599640 1 -- 172.21.15.78:0/1064324665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6678106800 msgr2=0x7f667819db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.006+0000 7f667e599640 1 --2- 172.21.15.78:0/1064324665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6678106800 0x7f667819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.006+0000 7f667e599640 1 -- 172.21.15.78:0/1064324665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66781977c0 con 0x7f6678100800 2024-09-18T13:04:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.006+0000 7f667e599640 1 --2- 172.21.15.78:0/1064324665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6678100800 0x7f667819d640 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6674031460 tx=0x7f6674004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.006+0000 7f666f7fe640 1 -- 172.21.15.78:0/1064324665 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f667403f070 con 0x7f6678100800 2024-09-18T13:04:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.006+0000 7f666f7fe640 1 -- 172.21.15.78:0/1064324665 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f66740035f0 con 0x7f6678100800 2024-09-18T13:04:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.006+0000 7f66807fd640 1 -- 172.21.15.78:0/1064324665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6678197a50 con 0x7f6678100800 2024-09-18T13:04:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.006+0000 7f666f7fe640 1 -- 172.21.15.78:0/1064324665 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6674035030 con 0x7f6678100800 2024-09-18T13:04:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.006+0000 7f66807fd640 1 -- 172.21.15.78:0/1064324665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6678197f80 con 0x7f6678100800 2024-09-18T13:04:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.007+0000 7f66807fd640 1 -- 172.21.15.78:0/1064324665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6678101f40 con 0x7f6678100800 2024-09-18T13:04:38.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.007+0000 7f666f7fe640 1 -- 172.21.15.78:0/1064324665 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6674042070 con 0x7f6678100800 2024-09-18T13:04:38.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.008+0000 7f666f7fe640 1 --2- 172.21.15.78:0/1064324665 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f666407af30 0x7f666407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:38.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.008+0000 7f666f7fe640 1 -- 172.21.15.78:0/1064324665 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f66740bea10 con 0x7f6678100800 2024-09-18T13:04:38.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.008+0000 7f667dd98640 1 --2- 172.21.15.78:0/1064324665 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f666407af30 0x7f666407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:38.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.009+0000 7f667dd98640 1 --2- 172.21.15.78:0/1064324665 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f666407af30 0x7f666407d3f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6678104fa0 tx=0x7f6668005f90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:38.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.012+0000 7f666f7fe640 1 -- 172.21.15.78:0/1064324665 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6674089fb0 con 0x7f6678100800 2024-09-18T13:04:38.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.222+0000 7f66807fd640 1 -- 172.21.15.78:0/1064324665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6678109d80 con 0x7f6678100800 2024-09-18T13:04:38.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.223+0000 7f666f7fe640 1 -- 172.21.15.78:0/1064324665 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f667408ee60 con 0x7f6678100800 2024-09-18T13:04:38.224 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:04:38.224 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:04:38.224 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:04:38.224 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:04:38.224 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:04:38.225 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:04:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:04:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:04:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:04:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:04:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:04:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:04:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:04:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:04:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:04:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:04:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:04:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:04:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:04:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:04:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:04:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:04:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:04:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:04:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:04:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:04:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:04:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:04:38.226 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:04:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:04:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:04:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:04:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:04:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:04:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:04:38.227 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:04:38.227 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:04:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:04:38.227 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:04:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:04:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:04:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:04:38.227 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:04:38.228 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:04:38.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.225+0000 7f66807fd640 1 -- 172.21.15.78:0/1064324665 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f666407af30 msgr2=0x7f666407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:38.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.225+0000 7f66807fd640 1 --2- 172.21.15.78:0/1064324665 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f666407af30 0x7f666407d3f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6678104fa0 tx=0x7f6668005f90 comp rx=0 tx=0).stop 2024-09-18T13:04:38.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.225+0000 7f66807fd640 1 -- 172.21.15.78:0/1064324665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6678100800 msgr2=0x7f667819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:38.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.225+0000 7f66807fd640 1 --2- 172.21.15.78:0/1064324665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6678100800 0x7f667819d640 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6674031460 tx=0x7f6674004530 comp rx=0 tx=0).stop 2024-09-18T13:04:38.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.225+0000 7f66807fd640 1 -- 172.21.15.78:0/1064324665 shutdown_connections 2024-09-18T13:04:38.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.225+0000 7f66807fd640 1 --2- 172.21.15.78:0/1064324665 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f666407af30 0x7f666407d3f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.225+0000 7f66807fd640 1 --2- 172.21.15.78:0/1064324665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6678106800 0x7f667819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.225+0000 7f66807fd640 1 --2- 172.21.15.78:0/1064324665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6678100800 0x7f667819d640 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.225+0000 7f66807fd640 1 -- 172.21.15.78:0/1064324665 >> 172.21.15.78:0/1064324665 conn(0x7f66780fc520 msgr2=0x7f667806a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:38.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.225+0000 7f66807fd640 1 -- 172.21.15.78:0/1064324665 shutdown_connections 2024-09-18T13:04:38.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.225+0000 7f66807fd640 1 -- 172.21.15.78:0/1064324665 wait complete. 2024-09-18T13:04:38.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.309+0000 7f3624864640 1 -- 172.21.15.78:0/377831038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3620100800 msgr2=0x7f3620100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:38.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.309+0000 7f3624864640 1 --2- 172.21.15.78:0/377831038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3620100800 0x7f3620100c60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3610009880 tx=0x7f361002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.309+0000 7f3624864640 1 -- 172.21.15.78:0/377831038 shutdown_connections 2024-09-18T13:04:38.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.309+0000 7f3624864640 1 --2- 172.21.15.78:0/377831038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3620100800 0x7f3620100c60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.309+0000 7f3624864640 1 --2- 172.21.15.78:0/377831038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3620106800 0x7f3620106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.309+0000 7f3624864640 1 -- 172.21.15.78:0/377831038 >> 172.21.15.78:0/377831038 conn(0x7f36200fc520 msgr2=0x7f36200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:38.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.309+0000 7f3624864640 1 -- 172.21.15.78:0/377831038 shutdown_connections 2024-09-18T13:04:38.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.309+0000 7f3624864640 1 -- 172.21.15.78:0/377831038 wait complete. 2024-09-18T13:04:38.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.310+0000 7f3624864640 1 Processor -- start 2024-09-18T13:04:38.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.310+0000 7f3624864640 1 -- start start 2024-09-18T13:04:38.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.310+0000 7f3624864640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3620100800 0x7f3620198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:38.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.310+0000 7f3624864640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3620106800 0x7f3620198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:38.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.310+0000 7f3624864640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f362010dd30 con 0x7f3620100800 2024-09-18T13:04:38.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.310+0000 7f3624864640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f362010dbb0 con 0x7f3620106800 2024-09-18T13:04:38.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.310+0000 7f361e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3620100800 0x7f3620198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:38.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.310+0000 7f361e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3620100800 0x7f3620198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50992/0 (socket says 172.21.15.78:50992) 2024-09-18T13:04:38.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.310+0000 7f361e59c640 1 -- 172.21.15.78:0/3846283001 learned_addr learned my addr 172.21.15.78:0/3846283001 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:04:38.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.310+0000 7f361e59c640 1 -- 172.21.15.78:0/3846283001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3620106800 msgr2=0x7f3620198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:38.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.310+0000 7f361e59c640 1 --2- 172.21.15.78:0/3846283001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3620106800 0x7f3620198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.310+0000 7f361e59c640 1 -- 172.21.15.78:0/3846283001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36201993a0 con 0x7f3620100800 2024-09-18T13:04:38.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.310+0000 7f361e59c640 1 --2- 172.21.15.78:0/3846283001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3620100800 0x7f3620198860 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f361400b420 tx=0x7f361400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:38.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.311+0000 7f360f7fe640 1 -- 172.21.15.78:0/3846283001 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3614011630 con 0x7f3620100800 2024-09-18T13:04:38.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.311+0000 7f3624864640 1 -- 172.21.15.78:0/3846283001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3620199690 con 0x7f3620100800 2024-09-18T13:04:38.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.311+0000 7f360f7fe640 1 -- 172.21.15.78:0/3846283001 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3614016070 con 0x7f3620100800 2024-09-18T13:04:38.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.311+0000 7f360f7fe640 1 -- 172.21.15.78:0/3846283001 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3614010d40 con 0x7f3620100800 2024-09-18T13:04:38.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.311+0000 7f3624864640 1 -- 172.21.15.78:0/3846283001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36201a1c90 con 0x7f3620100800 2024-09-18T13:04:38.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.312+0000 7f3624864640 1 -- 172.21.15.78:0/3846283001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3620101f40 con 0x7f3620100800 2024-09-18T13:04:38.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.312+0000 7f360f7fe640 1 -- 172.21.15.78:0/3846283001 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f361401b460 con 0x7f3620100800 2024-09-18T13:04:38.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.313+0000 7f360f7fe640 1 --2- 172.21.15.78:0/3846283001 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f360807af30 0x7f360807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:38.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.313+0000 7f360f7fe640 1 -- 172.21.15.78:0/3846283001 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f361409d7a0 con 0x7f3620100800 2024-09-18T13:04:38.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.313+0000 7f361dd9b640 1 --2- 172.21.15.78:0/3846283001 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f360807af30 0x7f360807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:38.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.313+0000 7f361dd9b640 1 --2- 172.21.15.78:0/3846283001 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f360807af30 0x7f360807d3f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f36100096c0 tx=0x7f3610000bc0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:38.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.317+0000 7f360f7fe640 1 -- 172.21.15.78:0/3846283001 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3620199690 con 0x7f3620100800 2024-09-18T13:04:38.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:38 smithi078 ceph-mon[108578]: from='client.34694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:38.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:38 smithi078 ceph-mon[108578]: pgmap v464: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:38.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:38 smithi078 ceph-mon[108578]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:38.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:38 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/4259971864' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:04:38.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:38 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1064324665' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:04:38.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.511+0000 7f3624864640 1 -- 172.21.15.78:0/3846283001 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3620108e00 con 0x7f360807af30 2024-09-18T13:04:38.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.512+0000 7f360f7fe640 1 -- 172.21.15.78:0/3846283001 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3610004340 con 0x7f360807af30 2024-09-18T13:04:38.513 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:04:38.513 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:04:38.513 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:04:38.513 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:04:38.513 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:04:38.513 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:04:38.514 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:04:38.514 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:04:38.514 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:04:38.514 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:04:38.514 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:04:38.514 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:04:38.514 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:04:38.514 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:04:38.514 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:04:38.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.514+0000 7f3624864640 1 -- 172.21.15.78:0/3846283001 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f360807af30 msgr2=0x7f360807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:38.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.514+0000 7f3624864640 1 --2- 172.21.15.78:0/3846283001 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f360807af30 0x7f360807d3f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f36100096c0 tx=0x7f3610000bc0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.514+0000 7f3624864640 1 -- 172.21.15.78:0/3846283001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3620100800 msgr2=0x7f3620198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.514+0000 7f3624864640 1 --2- 172.21.15.78:0/3846283001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3620100800 0x7f3620198860 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f361400b420 tx=0x7f361400b8e0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.514+0000 7f3624864640 1 -- 172.21.15.78:0/3846283001 shutdown_connections 2024-09-18T13:04:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.514+0000 7f3624864640 1 --2- 172.21.15.78:0/3846283001 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f360807af30 0x7f360807d3f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.514+0000 7f3624864640 1 --2- 172.21.15.78:0/3846283001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3620106800 0x7f3620198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.514+0000 7f3624864640 1 --2- 172.21.15.78:0/3846283001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3620100800 0x7f3620198860 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.514+0000 7f3624864640 1 -- 172.21.15.78:0/3846283001 >> 172.21.15.78:0/3846283001 conn(0x7f36200fc520 msgr2=0x7f36200fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.514+0000 7f3624864640 1 -- 172.21.15.78:0/3846283001 shutdown_connections 2024-09-18T13:04:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.514+0000 7f3624864640 1 -- 172.21.15.78:0/3846283001 wait complete. 2024-09-18T13:04:38.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.595+0000 7fd248a78640 1 -- 172.21.15.78:0/764138742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd244107900 msgr2=0x7fd244107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:38.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.595+0000 7fd248a78640 1 --2- 172.21.15.78:0/764138742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd244107900 0x7fd244107ce0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009880 tx=0x7fd22c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.595+0000 7fd248a78640 1 -- 172.21.15.78:0/764138742 shutdown_connections 2024-09-18T13:04:38.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.595+0000 7fd248a78640 1 --2- 172.21.15.78:0/764138742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd244101900 0x7fd244101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.595+0000 7fd248a78640 1 --2- 172.21.15.78:0/764138742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd244107900 0x7fd244107ce0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.595+0000 7fd248a78640 1 -- 172.21.15.78:0/764138742 >> 172.21.15.78:0/764138742 conn(0x7fd2440fd600 msgr2=0x7fd2440ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:38.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.595+0000 7fd248a78640 1 -- 172.21.15.78:0/764138742 shutdown_connections 2024-09-18T13:04:38.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.595+0000 7fd248a78640 1 -- 172.21.15.78:0/764138742 wait complete. 2024-09-18T13:04:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.596+0000 7fd248a78640 1 Processor -- start 2024-09-18T13:04:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.596+0000 7fd248a78640 1 -- start start 2024-09-18T13:04:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.596+0000 7fd248a78640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd244101900 0x7fd24419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.596+0000 7fd248a78640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd244107900 0x7fd24419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.596+0000 7fd248a78640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd24410edb0 con 0x7fd244107900 2024-09-18T13:04:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.596+0000 7fd248a78640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd24410ec30 con 0x7fd244101900 2024-09-18T13:04:38.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.596+0000 7fd241d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd244107900 0x7fd24419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:38.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.596+0000 7fd241d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd244107900 0x7fd24419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51016/0 (socket says 172.21.15.78:51016) 2024-09-18T13:04:38.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.596+0000 7fd241d9b640 1 -- 172.21.15.78:0/3853797163 learned_addr learned my addr 172.21.15.78:0/3853797163 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:04:38.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.596+0000 7fd24259c640 1 --2- 172.21.15.78:0/3853797163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd244101900 0x7fd24419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:38.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.596+0000 7fd241d9b640 1 -- 172.21.15.78:0/3853797163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd244101900 msgr2=0x7fd24419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:38.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.596+0000 7fd241d9b640 1 --2- 172.21.15.78:0/3853797163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd244101900 0x7fd24419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.596+0000 7fd241d9b640 1 -- 172.21.15.78:0/3853797163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2441977c0 con 0x7fd244107900 2024-09-18T13:04:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.596+0000 7fd24259c640 1 --2- 172.21.15.78:0/3853797163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd244101900 0x7fd24419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:04:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.597+0000 7fd241d9b640 1 --2- 172.21.15.78:0/3853797163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd244107900 0x7fd24419db80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd23400c8a0 tx=0x7fd23400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.597+0000 7fd23b7fe640 1 -- 172.21.15.78:0/3853797163 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2340079b0 con 0x7fd244107900 2024-09-18T13:04:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.597+0000 7fd248a78640 1 -- 172.21.15.78:0/3853797163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd244197ab0 con 0x7fd244107900 2024-09-18T13:04:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.597+0000 7fd23b7fe640 1 -- 172.21.15.78:0/3853797163 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd234007b50 con 0x7fd244107900 2024-09-18T13:04:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.597+0000 7fd23b7fe640 1 -- 172.21.15.78:0/3853797163 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd234018700 con 0x7fd244107900 2024-09-18T13:04:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.597+0000 7fd248a78640 1 -- 172.21.15.78:0/3853797163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd244198040 con 0x7fd244107900 2024-09-18T13:04:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.598+0000 7fd248a78640 1 -- 172.21.15.78:0/3853797163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd244103040 con 0x7fd244107900 2024-09-18T13:04:38.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.599+0000 7fd23b7fe640 1 -- 172.21.15.78:0/3853797163 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd234007d00 con 0x7fd244107900 2024-09-18T13:04:38.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.599+0000 7fd23b7fe640 1 --2- 172.21.15.78:0/3853797163 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd23007af30 0x7fd23007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:04:38.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.599+0000 7fd23b7fe640 1 -- 172.21.15.78:0/3853797163 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fd23409e370 con 0x7fd244107900 2024-09-18T13:04:38.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.599+0000 7fd24259c640 1 --2- 172.21.15.78:0/3853797163 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd23007af30 0x7fd23007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:04:38.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.600+0000 7fd24259c640 1 --2- 172.21.15.78:0/3853797163 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd23007af30 0x7fd23007d3f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd22c031460 tx=0x7fd22c009560 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:04:38.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.604+0000 7fd23b7fe640 1 -- 172.21.15.78:0/3853797163 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd234014030 con 0x7fd244107900 2024-09-18T13:04:38.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:38 smithi148 ceph-mon[80030]: from='client.34694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:38.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:38 smithi148 ceph-mon[80030]: pgmap v464: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:38.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:38 smithi148 ceph-mon[80030]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:38.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:38 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/4259971864' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:04:38.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:38 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1064324665' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:04:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.845+0000 7fd248a78640 1 -- 172.21.15.78:0/3853797163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd244198d20 con 0x7fd244107900 2024-09-18T13:04:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.846+0000 7fd23b7fe640 1 -- 172.21.15.78:0/3853797163 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fd244198d20 con 0x7fd244107900 2024-09-18T13:04:38.847 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:04:38.847 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:04:38.847 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:04:38.847 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:04:38.847 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:04:38.848 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:04:38.848 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:04:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.848+0000 7fd248a78640 1 -- 172.21.15.78:0/3853797163 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd23007af30 msgr2=0x7fd23007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.848+0000 7fd248a78640 1 --2- 172.21.15.78:0/3853797163 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd23007af30 0x7fd23007d3f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd22c031460 tx=0x7fd22c009560 comp rx=0 tx=0).stop 2024-09-18T13:04:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.848+0000 7fd248a78640 1 -- 172.21.15.78:0/3853797163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd244107900 msgr2=0x7fd24419db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:04:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.848+0000 7fd248a78640 1 --2- 172.21.15.78:0/3853797163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd244107900 0x7fd24419db80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd23400c8a0 tx=0x7fd23400cd60 comp rx=0 tx=0).stop 2024-09-18T13:04:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.848+0000 7fd248a78640 1 -- 172.21.15.78:0/3853797163 shutdown_connections 2024-09-18T13:04:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.848+0000 7fd248a78640 1 --2- 172.21.15.78:0/3853797163 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd23007af30 0x7fd23007d3f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.848+0000 7fd248a78640 1 --2- 172.21.15.78:0/3853797163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd244107900 0x7fd24419db80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.848+0000 7fd248a78640 1 --2- 172.21.15.78:0/3853797163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd244101900 0x7fd24419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:04:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.848+0000 7fd248a78640 1 -- 172.21.15.78:0/3853797163 >> 172.21.15.78:0/3853797163 conn(0x7fd2440fd600 msgr2=0x7fd2440ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:04:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.848+0000 7fd248a78640 1 -- 172.21.15.78:0/3853797163 shutdown_connections 2024-09-18T13:04:38.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:04:38.848+0000 7fd248a78640 1 -- 172.21.15.78:0/3853797163 wait complete. 2024-09-18T13:04:39.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:39 smithi148 ceph-mon[80030]: from='client.34702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:39.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:39 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3853797163' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:04:39.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:39 smithi078 ceph-mon[108578]: from='client.34702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:39.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:39 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3853797163' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:04:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:40 smithi148 ceph-mon[80030]: from='client.34714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:40 smithi148 ceph-mon[80030]: pgmap v465: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:40.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:40 smithi078 ceph-mon[108578]: from='client.34714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:04:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:40 smithi078 ceph-mon[108578]: pgmap v465: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:41.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:42.710 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:42 smithi078 ceph-mon[108578]: pgmap v466: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:42 smithi148 ceph-mon[80030]: pgmap v466: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:44.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:44 smithi148 ceph-mon[80030]: pgmap v467: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:44 smithi078 ceph-mon[108578]: pgmap v467: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:46.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:46 smithi078 ceph-mon[108578]: pgmap v468: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:46 smithi148 ceph-mon[80030]: pgmap v468: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:48.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:48 smithi078 ceph-mon[108578]: pgmap v469: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:48.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:48 smithi148 ceph-mon[80030]: pgmap v469: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:50.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:50 smithi148 ceph-mon[80030]: pgmap v470: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:50 smithi078 ceph-mon[108578]: pgmap v470: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:52 smithi148 ceph-mon[80030]: pgmap v471: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:52.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:52 smithi078 ceph-mon[108578]: pgmap v471: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:54.709 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:54 smithi078 ceph-mon[108578]: pgmap v472: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:54.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:54 smithi148 ceph-mon[80030]: pgmap v472: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:56 smithi148 ceph-mon[80030]: pgmap v473: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:56 smithi078 ceph-mon[108578]: pgmap v473: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:04:58 smithi148 ceph-mon[80030]: pgmap v474: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:04:58.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:04:58 smithi078 ceph-mon[108578]: pgmap v474: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:00.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:00 smithi148 ceph-mon[80030]: pgmap v475: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:00.714 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:00 smithi078 ceph-mon[108578]: pgmap v475: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:02.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:02 smithi148 ceph-mon[80030]: pgmap v476: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:02.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:02 smithi078 ceph-mon[108578]: pgmap v476: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:04 smithi148 ceph-mon[80030]: pgmap v477: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:04 smithi078 ceph-mon[108578]: pgmap v477: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:06.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:06 smithi078 ceph-mon[108578]: pgmap v478: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:06.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:06 smithi148 ceph-mon[80030]: pgmap v478: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:08.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:08 smithi148 ceph-mon[80030]: pgmap v479: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:08.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:08 smithi078 ceph-mon[108578]: pgmap v479: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:08.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.943+0000 7f8d2acd6640 1 -- 172.21.15.78:0/1346852956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d241033d0 msgr2=0x7f8d2410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:08.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.943+0000 7f8d2acd6640 1 --2- 172.21.15.78:0/1346852956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d241033d0 0x7f8d2410b8c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009880 tx=0x7f8d1402a530 comp rx=0 tx=0).stop 2024-09-18T13:05:08.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.943+0000 7f8d2acd6640 1 -- 172.21.15.78:0/1346852956 shutdown_connections 2024-09-18T13:05:08.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.943+0000 7f8d2acd6640 1 --2- 172.21.15.78:0/1346852956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d241033d0 0x7f8d2410b8c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:08.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.943+0000 7f8d2acd6640 1 --2- 172.21.15.78:0/1346852956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d24102ab0 0x7f8d24102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:08.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.943+0000 7f8d2acd6640 1 -- 172.21.15.78:0/1346852956 >> 172.21.15.78:0/1346852956 conn(0x7f8d240fc550 msgr2=0x7f8d240fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:08.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.943+0000 7f8d2acd6640 1 -- 172.21.15.78:0/1346852956 shutdown_connections 2024-09-18T13:05:08.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.943+0000 7f8d2acd6640 1 -- 172.21.15.78:0/1346852956 wait complete. 2024-09-18T13:05:08.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.944+0000 7f8d2acd6640 1 Processor -- start 2024-09-18T13:05:08.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.944+0000 7f8d2acd6640 1 -- start start 2024-09-18T13:05:08.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.944+0000 7f8d2acd6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d24102ab0 0x7f8d2419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:08.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.944+0000 7f8d2acd6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d241033d0 0x7f8d2419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:08.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.944+0000 7f8d2acd6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2410ede0 con 0x7f8d241033d0 2024-09-18T13:05:08.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.944+0000 7f8d2acd6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2410ec60 con 0x7f8d24102ab0 2024-09-18T13:05:08.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.944+0000 7f8d1bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d241033d0 0x7f8d2419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:08.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.944+0000 7f8d1bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d241033d0 0x7f8d2419dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34684/0 (socket says 172.21.15.78:34684) 2024-09-18T13:05:08.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.944+0000 7f8d1bfff640 1 -- 172.21.15.78:0/3126852952 learned_addr learned my addr 172.21.15.78:0/3126852952 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:05:08.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.944+0000 7f8d28a72640 1 --2- 172.21.15.78:0/3126852952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d24102ab0 0x7f8d2419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:08.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.944+0000 7f8d1bfff640 1 -- 172.21.15.78:0/3126852952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d24102ab0 msgr2=0x7f8d2419d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:08.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.944+0000 7f8d1bfff640 1 --2- 172.21.15.78:0/3126852952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d24102ab0 0x7f8d2419d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:08.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.945+0000 7f8d1bfff640 1 -- 172.21.15.78:0/3126852952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d24197810 con 0x7f8d241033d0 2024-09-18T13:05:08.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.945+0000 7f8d28a72640 1 --2- 172.21.15.78:0/3126852952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d24102ab0 0x7f8d2419d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:05:08.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.945+0000 7f8d1bfff640 1 --2- 172.21.15.78:0/3126852952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d241033d0 0x7f8d2419dbd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8d14031460 tx=0x7f8d14004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:08.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.945+0000 7f8d19ffb640 1 -- 172.21.15.78:0/3126852952 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d1403f070 con 0x7f8d241033d0 2024-09-18T13:05:08.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.945+0000 7f8d19ffb640 1 -- 172.21.15.78:0/3126852952 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d140035f0 con 0x7f8d241033d0 2024-09-18T13:05:08.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.945+0000 7f8d2acd6640 1 -- 172.21.15.78:0/3126852952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d24197aa0 con 0x7f8d241033d0 2024-09-18T13:05:08.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.945+0000 7f8d19ffb640 1 -- 172.21.15.78:0/3126852952 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d14035030 con 0x7f8d241033d0 2024-09-18T13:05:08.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.945+0000 7f8d2acd6640 1 -- 172.21.15.78:0/3126852952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d24197fd0 con 0x7f8d241033d0 2024-09-18T13:05:08.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.946+0000 7f8d2acd6640 1 -- 172.21.15.78:0/3126852952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d2406a580 con 0x7f8d241033d0 2024-09-18T13:05:08.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.947+0000 7f8d19ffb640 1 -- 172.21.15.78:0/3126852952 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8d14042070 con 0x7f8d241033d0 2024-09-18T13:05:08.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.947+0000 7f8d19ffb640 1 --2- 172.21.15.78:0/3126852952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8d0c07af30 0x7f8d0c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:08.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.948+0000 7f8d19ffb640 1 -- 172.21.15.78:0/3126852952 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f8d140bea10 con 0x7f8d241033d0 2024-09-18T13:05:08.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.948+0000 7f8d28a72640 1 --2- 172.21.15.78:0/3126852952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8d0c07af30 0x7f8d0c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:08.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.948+0000 7f8d28a72640 1 --2- 172.21.15.78:0/3126852952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8d0c07af30 0x7f8d0c07d3f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8d200058c0 tx=0x7f8d20005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:08.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:08.952+0000 7f8d19ffb640 1 -- 172.21.15.78:0/3126852952 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8d14089fb0 con 0x7f8d241033d0 2024-09-18T13:05:09.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.144+0000 7f8d2acd6640 1 -- 172.21.15.78:0/3126852952 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8d24198340 con 0x7f8d0c07af30 2024-09-18T13:05:09.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.145+0000 7f8d19ffb640 1 -- 172.21.15.78:0/3126852952 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8d24198340 con 0x7f8d0c07af30 2024-09-18T13:05:09.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.147+0000 7f8d2acd6640 1 -- 172.21.15.78:0/3126852952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8d0c07af30 msgr2=0x7f8d0c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:09.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.147+0000 7f8d2acd6640 1 --2- 172.21.15.78:0/3126852952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8d0c07af30 0x7f8d0c07d3f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8d200058c0 tx=0x7f8d20005850 comp rx=0 tx=0).stop 2024-09-18T13:05:09.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.147+0000 7f8d2acd6640 1 -- 172.21.15.78:0/3126852952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d241033d0 msgr2=0x7f8d2419dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:09.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.147+0000 7f8d2acd6640 1 --2- 172.21.15.78:0/3126852952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d241033d0 0x7f8d2419dbd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8d14031460 tx=0x7f8d14004530 comp rx=0 tx=0).stop 2024-09-18T13:05:09.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.147+0000 7f8d2acd6640 1 -- 172.21.15.78:0/3126852952 shutdown_connections 2024-09-18T13:05:09.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.147+0000 7f8d2acd6640 1 --2- 172.21.15.78:0/3126852952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8d0c07af30 0x7f8d0c07d3f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.147+0000 7f8d2acd6640 1 --2- 172.21.15.78:0/3126852952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d241033d0 0x7f8d2419dbd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.148+0000 7f8d2acd6640 1 --2- 172.21.15.78:0/3126852952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d24102ab0 0x7f8d2419d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.148+0000 7f8d2acd6640 1 -- 172.21.15.78:0/3126852952 >> 172.21.15.78:0/3126852952 conn(0x7f8d240fc550 msgr2=0x7f8d24108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:09.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.148+0000 7f8d2acd6640 1 -- 172.21.15.78:0/3126852952 shutdown_connections 2024-09-18T13:05:09.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.148+0000 7f8d2acd6640 1 -- 172.21.15.78:0/3126852952 wait complete. 2024-09-18T13:05:09.158 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:05:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.231+0000 7f966addc640 1 -- 172.21.15.78:0/2497552764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9664101900 msgr2=0x7f9664101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.231+0000 7f966addc640 1 --2- 172.21.15.78:0/2497552764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9664101900 0x7f9664101d60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9654009c20 tx=0x7f965402a970 comp rx=0 tx=0).stop 2024-09-18T13:05:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.231+0000 7f966addc640 1 -- 172.21.15.78:0/2497552764 shutdown_connections 2024-09-18T13:05:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.231+0000 7f966addc640 1 --2- 172.21.15.78:0/2497552764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9664101900 0x7f9664101d60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.231+0000 7f966addc640 1 --2- 172.21.15.78:0/2497552764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9664107900 0x7f9664107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.231+0000 7f966addc640 1 -- 172.21.15.78:0/2497552764 >> 172.21.15.78:0/2497552764 conn(0x7f96640fd620 msgr2=0x7f96640ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.231+0000 7f966addc640 1 -- 172.21.15.78:0/2497552764 shutdown_connections 2024-09-18T13:05:09.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.231+0000 7f966addc640 1 -- 172.21.15.78:0/2497552764 wait complete. 2024-09-18T13:05:09.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.231+0000 7f966addc640 1 Processor -- start 2024-09-18T13:05:09.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.231+0000 7f966addc640 1 -- start start 2024-09-18T13:05:09.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.232+0000 7f966addc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9664101900 0x7f966419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:09.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.232+0000 7f966addc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9664107900 0x7f966419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:09.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.232+0000 7f966addc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f966410edd0 con 0x7f9664101900 2024-09-18T13:05:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.232+0000 7f966addc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f966410ec50 con 0x7f9664107900 2024-09-18T13:05:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.232+0000 7f9668b78640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9664101900 0x7f966419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.232+0000 7f9668b78640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9664101900 0x7f966419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34694/0 (socket says 172.21.15.78:34694) 2024-09-18T13:05:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.232+0000 7f9668b78640 1 -- 172.21.15.78:0/1400327981 learned_addr learned my addr 172.21.15.78:0/1400327981 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:05:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.232+0000 7f9663fff640 1 --2- 172.21.15.78:0/1400327981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9664107900 0x7f966419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.232+0000 7f9668b78640 1 -- 172.21.15.78:0/1400327981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9664107900 msgr2=0x7f966419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.232+0000 7f9668b78640 1 --2- 172.21.15.78:0/1400327981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9664107900 0x7f966419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.232+0000 7f9668b78640 1 -- 172.21.15.78:0/1400327981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9664197800 con 0x7f9664101900 2024-09-18T13:05:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.232+0000 7f9668b78640 1 --2- 172.21.15.78:0/1400327981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9664101900 0x7f966419d680 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f965c00c8f0 tx=0x7f965c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.233+0000 7f9661ffb640 1 -- 172.21.15.78:0/1400327981 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f965c0079b0 con 0x7f9664101900 2024-09-18T13:05:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.233+0000 7f9661ffb640 1 -- 172.21.15.78:0/1400327981 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f965c0054e0 con 0x7f9664101900 2024-09-18T13:05:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.233+0000 7f966addc640 1 -- 172.21.15.78:0/1400327981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9664197af0 con 0x7f9664101900 2024-09-18T13:05:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.233+0000 7f9661ffb640 1 -- 172.21.15.78:0/1400327981 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f965c004dd0 con 0x7f9664101900 2024-09-18T13:05:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.233+0000 7f966addc640 1 -- 172.21.15.78:0/1400327981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9664198080 con 0x7f9664101900 2024-09-18T13:05:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.234+0000 7f966addc640 1 -- 172.21.15.78:0/1400327981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9664103040 con 0x7f9664101900 2024-09-18T13:05:09.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.235+0000 7f9661ffb640 1 -- 172.21.15.78:0/1400327981 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f965c005020 con 0x7f9664101900 2024-09-18T13:05:09.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.235+0000 7f9661ffb640 1 --2- 172.21.15.78:0/1400327981 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f965007aed0 0x7f965007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:09.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.235+0000 7f9661ffb640 1 -- 172.21.15.78:0/1400327981 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f965c09df80 con 0x7f9664101900 2024-09-18T13:05:09.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.235+0000 7f9663fff640 1 --2- 172.21.15.78:0/1400327981 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f965007aed0 0x7f965007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:09.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.236+0000 7f9663fff640 1 --2- 172.21.15.78:0/1400327981 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f965007aed0 0x7f965007d390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f96640ffc40 tx=0x7f965403c040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:09.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.240+0000 7f9661ffb640 1 -- 172.21.15.78:0/1400327981 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f965c014030 con 0x7f9664101900 2024-09-18T13:05:09.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.434+0000 7f966addc640 1 -- 172.21.15.78:0/1400327981 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9664198390 con 0x7f965007aed0 2024-09-18T13:05:09.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.436+0000 7f9661ffb640 1 -- 172.21.15.78:0/1400327981 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9664198390 con 0x7f965007aed0 2024-09-18T13:05:09.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.438+0000 7f966addc640 1 -- 172.21.15.78:0/1400327981 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f965007aed0 msgr2=0x7f965007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:09.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.438+0000 7f966addc640 1 --2- 172.21.15.78:0/1400327981 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f965007aed0 0x7f965007d390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f96640ffc40 tx=0x7f965403c040 comp rx=0 tx=0).stop 2024-09-18T13:05:09.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.438+0000 7f966addc640 1 -- 172.21.15.78:0/1400327981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9664101900 msgr2=0x7f966419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:09.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.438+0000 7f966addc640 1 --2- 172.21.15.78:0/1400327981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9664101900 0x7f966419d680 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f965c00c8f0 tx=0x7f965c00cdb0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.438+0000 7f966addc640 1 -- 172.21.15.78:0/1400327981 shutdown_connections 2024-09-18T13:05:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.438+0000 7f966addc640 1 --2- 172.21.15.78:0/1400327981 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f965007aed0 0x7f965007d390 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.438+0000 7f966addc640 1 --2- 172.21.15.78:0/1400327981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9664107900 0x7f966419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.438+0000 7f966addc640 1 --2- 172.21.15.78:0/1400327981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9664101900 0x7f966419d680 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.438+0000 7f966addc640 1 -- 172.21.15.78:0/1400327981 >> 172.21.15.78:0/1400327981 conn(0x7f96640fd620 msgr2=0x7f96640fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.438+0000 7f966addc640 1 -- 172.21.15.78:0/1400327981 shutdown_connections 2024-09-18T13:05:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.438+0000 7f966addc640 1 -- 172.21.15.78:0/1400327981 wait complete. 2024-09-18T13:05:09.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.520+0000 7f57927d2640 1 -- 172.21.15.78:0/1144843818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f578c1033d0 msgr2=0x7f578c10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:09.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.520+0000 7f57927d2640 1 --2- 172.21.15.78:0/1144843818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f578c1033d0 0x7f578c10b8c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5780009880 tx=0x7f578002a530 comp rx=0 tx=0).stop 2024-09-18T13:05:09.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.520+0000 7f57927d2640 1 -- 172.21.15.78:0/1144843818 shutdown_connections 2024-09-18T13:05:09.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.520+0000 7f57927d2640 1 --2- 172.21.15.78:0/1144843818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f578c1033d0 0x7f578c10b8c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.520+0000 7f57927d2640 1 --2- 172.21.15.78:0/1144843818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f578c102ab0 0x7f578c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.520+0000 7f57927d2640 1 -- 172.21.15.78:0/1144843818 >> 172.21.15.78:0/1144843818 conn(0x7f578c0fc550 msgr2=0x7f578c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:09.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.520+0000 7f57927d2640 1 -- 172.21.15.78:0/1144843818 shutdown_connections 2024-09-18T13:05:09.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.520+0000 7f57927d2640 1 -- 172.21.15.78:0/1144843818 wait complete. 2024-09-18T13:05:09.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.520+0000 7f57927d2640 1 Processor -- start 2024-09-18T13:05:09.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.521+0000 7f57927d2640 1 -- start start 2024-09-18T13:05:09.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.521+0000 7f57927d2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f578c102ab0 0x7f578c19d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:09.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.521+0000 7f57927d2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f578c1033d0 0x7f578c19db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:09.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.521+0000 7f57927d2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f578c10edc0 con 0x7f578c102ab0 2024-09-18T13:05:09.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.521+0000 7f57927d2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f578c10ec40 con 0x7f578c1033d0 2024-09-18T13:05:09.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.521+0000 7f578bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f578c102ab0 0x7f578c19d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:09.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.521+0000 7f578bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f578c102ab0 0x7f578c19d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34702/0 (socket says 172.21.15.78:34702) 2024-09-18T13:05:09.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.521+0000 7f578bfff640 1 -- 172.21.15.78:0/2972992408 learned_addr learned my addr 172.21.15.78:0/2972992408 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:05:09.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.521+0000 7f578b7fe640 1 --2- 172.21.15.78:0/2972992408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f578c1033d0 0x7f578c19db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:09.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.521+0000 7f578bfff640 1 -- 172.21.15.78:0/2972992408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f578c1033d0 msgr2=0x7f578c19db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:09.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.521+0000 7f578bfff640 1 --2- 172.21.15.78:0/2972992408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f578c1033d0 0x7f578c19db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.521+0000 7f578bfff640 1 -- 172.21.15.78:0/2972992408 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578c197790 con 0x7f578c102ab0 2024-09-18T13:05:09.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.521+0000 7f578bfff640 1 --2- 172.21.15.78:0/2972992408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f578c102ab0 0x7f578c19d610 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f577c00d8d0 tx=0x7f577c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:09.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.522+0000 7f57897fa640 1 -- 172.21.15.78:0/2972992408 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f577c017030 con 0x7f578c102ab0 2024-09-18T13:05:09.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.522+0000 7f57927d2640 1 -- 172.21.15.78:0/2972992408 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578c197a80 con 0x7f578c102ab0 2024-09-18T13:05:09.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.522+0000 7f57897fa640 1 -- 172.21.15.78:0/2972992408 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f577c004020 con 0x7f578c102ab0 2024-09-18T13:05:09.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.522+0000 7f57897fa640 1 -- 172.21.15.78:0/2972992408 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f577c0047a0 con 0x7f578c102ab0 2024-09-18T13:05:09.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.522+0000 7f57927d2640 1 -- 172.21.15.78:0/2972992408 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f578c197fe0 con 0x7f578c102ab0 2024-09-18T13:05:09.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.523+0000 7f57927d2640 1 -- 172.21.15.78:0/2972992408 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f578c06a580 con 0x7f578c102ab0 2024-09-18T13:05:09.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.523+0000 7f57897fa640 1 -- 172.21.15.78:0/2972992408 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f577c0041d0 con 0x7f578c102ab0 2024-09-18T13:05:09.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.524+0000 7f57897fa640 1 --2- 172.21.15.78:0/2972992408 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f577407af30 0x7f577407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:09.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.524+0000 7f57897fa640 1 -- 172.21.15.78:0/2972992408 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f577c018070 con 0x7f578c102ab0 2024-09-18T13:05:09.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.524+0000 7f578b7fe640 1 --2- 172.21.15.78:0/2972992408 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f577407af30 0x7f577407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:09.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.524+0000 7f578b7fe640 1 --2- 172.21.15.78:0/2972992408 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f577407af30 0x7f577407d3f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f578c198ae0 tx=0x7f5780031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:09.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.528+0000 7f57897fa640 1 -- 172.21.15.78:0/2972992408 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f577c069420 con 0x7f578c102ab0 2024-09-18T13:05:09.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.711+0000 7f57927d2640 1 -- 172.21.15.78:0/2972992408 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f578c1982f0 con 0x7f577407af30 2024-09-18T13:05:09.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.721+0000 7f57897fa640 1 -- 172.21.15.78:0/2972992408 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f578c1982f0 con 0x7f577407af30 2024-09-18T13:05:09.722 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:05:09.722 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (12m) 7m ago 23m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:05:09.723 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (15m) 7m ago 24m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:05:09.723 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (15m) 6m ago 23m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:05:09.723 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (11m) 7m ago 24m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:05:09.723 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (11m) 6m ago 23m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:05:09.723 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (12m) 7m ago 23m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:05:09.723 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (7m) 7m ago 18m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:05:09.723 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (7m) 7m ago 18m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:05:09.723 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (7m) 6m ago 18m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:05:09.723 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (6m) 6m ago 18m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:05:09.723 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (15m) 7m ago 25m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:05:09.723 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (14m) 6m ago 23m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:05:09.724 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (11m) 7m ago 25m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:05:09.724 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (11m) 6m ago 23m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:05:09.724 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (13m) 7m ago 24m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:05:09.724 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (13m) 6m ago 23m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:05:09.724 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (10m) 7m ago 21m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:05:09.724 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (10m) 7m ago 21m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:05:09.724 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (9m) 7m ago 20m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:05:09.724 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (8m) 6m ago 20m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:05:09.724 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (8m) 6m ago 20m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:05:09.724 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (7m) 6m ago 19m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:05:09.725 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (13m) 7m ago 23m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:05:09.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.723+0000 7f57927d2640 1 -- 172.21.15.78:0/2972992408 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f577407af30 msgr2=0x7f577407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:09.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.723+0000 7f57927d2640 1 --2- 172.21.15.78:0/2972992408 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f577407af30 0x7f577407d3f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f578c198ae0 tx=0x7f5780031400 comp rx=0 tx=0).stop 2024-09-18T13:05:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.723+0000 7f57927d2640 1 -- 172.21.15.78:0/2972992408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f578c102ab0 msgr2=0x7f578c19d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.723+0000 7f57927d2640 1 --2- 172.21.15.78:0/2972992408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f578c102ab0 0x7f578c19d610 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f577c00d8d0 tx=0x7f577c00dd90 comp rx=0 tx=0).stop 2024-09-18T13:05:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.723+0000 7f57927d2640 1 -- 172.21.15.78:0/2972992408 shutdown_connections 2024-09-18T13:05:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.723+0000 7f57927d2640 1 --2- 172.21.15.78:0/2972992408 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f577407af30 0x7f577407d3f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.723+0000 7f57927d2640 1 --2- 172.21.15.78:0/2972992408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f578c1033d0 0x7f578c19db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.723+0000 7f57927d2640 1 --2- 172.21.15.78:0/2972992408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f578c102ab0 0x7f578c19d610 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.723+0000 7f57927d2640 1 -- 172.21.15.78:0/2972992408 >> 172.21.15.78:0/2972992408 conn(0x7f578c0fc550 msgr2=0x7f578c10aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.723+0000 7f57927d2640 1 -- 172.21.15.78:0/2972992408 shutdown_connections 2024-09-18T13:05:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.723+0000 7f57927d2640 1 -- 172.21.15.78:0/2972992408 wait complete. 2024-09-18T13:05:09.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.803+0000 7f3cec6ec640 1 -- 172.21.15.78:0/3457180040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce41067f0 msgr2=0x7f3ce4106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:09.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.803+0000 7f3cec6ec640 1 --2- 172.21.15.78:0/3457180040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce41067f0 0x7f3ce4106bd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009c20 tx=0x7f3cd402a970 comp rx=0 tx=0).stop 2024-09-18T13:05:09.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.803+0000 7f3cec6ec640 1 -- 172.21.15.78:0/3457180040 shutdown_connections 2024-09-18T13:05:09.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.803+0000 7f3cec6ec640 1 --2- 172.21.15.78:0/3457180040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce41007f0 0x7f3ce4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.803+0000 7f3cec6ec640 1 --2- 172.21.15.78:0/3457180040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce41067f0 0x7f3ce4106bd0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.803+0000 7f3cec6ec640 1 -- 172.21.15.78:0/3457180040 >> 172.21.15.78:0/3457180040 conn(0x7f3ce40fc550 msgr2=0x7f3ce40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:09.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.803+0000 7f3cec6ec640 1 -- 172.21.15.78:0/3457180040 shutdown_connections 2024-09-18T13:05:09.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.803+0000 7f3cec6ec640 1 -- 172.21.15.78:0/3457180040 wait complete. 2024-09-18T13:05:09.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.803+0000 7f3cec6ec640 1 Processor -- start 2024-09-18T13:05:09.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.803+0000 7f3cec6ec640 1 -- start start 2024-09-18T13:05:09.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.804+0000 7f3cec6ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce41007f0 0x7f3ce419b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:09.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.804+0000 7f3cec6ec640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce41067f0 0x7f3ce419bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:09.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.804+0000 7f3cec6ec640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce410cc30 con 0x7f3ce41007f0 2024-09-18T13:05:09.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.804+0000 7f3cec6ec640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce410cab0 con 0x7f3ce41067f0 2024-09-18T13:05:09.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.804+0000 7f3cea488640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce41007f0 0x7f3ce419b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:09.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.804+0000 7f3cea488640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce41007f0 0x7f3ce419b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34718/0 (socket says 172.21.15.78:34718) 2024-09-18T13:05:09.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.804+0000 7f3cea488640 1 -- 172.21.15.78:0/3648100804 learned_addr learned my addr 172.21.15.78:0/3648100804 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:05:09.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.804+0000 7f3ce9c87640 1 --2- 172.21.15.78:0/3648100804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce41067f0 0x7f3ce419bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:09.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.804+0000 7f3cea488640 1 -- 172.21.15.78:0/3648100804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce41067f0 msgr2=0x7f3ce419bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:09.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.804+0000 7f3cea488640 1 --2- 172.21.15.78:0/3648100804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce41067f0 0x7f3ce419bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:09.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.804+0000 7f3cea488640 1 -- 172.21.15.78:0/3648100804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce4195740 con 0x7f3ce41007f0 2024-09-18T13:05:09.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.804+0000 7f3cea488640 1 --2- 172.21.15.78:0/3648100804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce41007f0 0x7f3ce419b670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4005cc0 tx=0x7f3cd402f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:09.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.805+0000 7f3ce37fe640 1 -- 172.21.15.78:0/3648100804 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cd4047070 con 0x7f3ce41007f0 2024-09-18T13:05:09.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.805+0000 7f3cec6ec640 1 -- 172.21.15.78:0/3648100804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce41959d0 con 0x7f3ce41007f0 2024-09-18T13:05:09.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.805+0000 7f3ce37fe640 1 -- 172.21.15.78:0/3648100804 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3cd402f7e0 con 0x7f3ce41007f0 2024-09-18T13:05:09.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.805+0000 7f3ce37fe640 1 -- 172.21.15.78:0/3648100804 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cd4034070 con 0x7f3ce41007f0 2024-09-18T13:05:09.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.805+0000 7f3cec6ec640 1 -- 172.21.15.78:0/3648100804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce4195ed0 con 0x7f3ce41007f0 2024-09-18T13:05:09.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.806+0000 7f3cec6ec640 1 -- 172.21.15.78:0/3648100804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce4101f30 con 0x7f3ce41007f0 2024-09-18T13:05:09.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.806+0000 7f3ce37fe640 1 -- 172.21.15.78:0/3648100804 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3cd404a070 con 0x7f3ce41007f0 2024-09-18T13:05:09.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.807+0000 7f3ce37fe640 1 --2- 172.21.15.78:0/3648100804 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ccc07d1a0 0x7f3ccc07f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:09.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.807+0000 7f3ce37fe640 1 -- 172.21.15.78:0/3648100804 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f3cd40beec0 con 0x7f3ce41007f0 2024-09-18T13:05:09.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.807+0000 7f3ce9c87640 1 --2- 172.21.15.78:0/3648100804 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ccc07d1a0 0x7f3ccc07f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:09.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.807+0000 7f3ce9c87640 1 --2- 172.21.15.78:0/3648100804 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ccc07d1a0 0x7f3ccc07f660 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4196f90 tx=0x7f3cd8008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:09.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:09.811+0000 7f3ce37fe640 1 -- 172.21.15.78:0/3648100804 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3cd403f070 con 0x7f3ce41007f0 2024-09-18T13:05:10.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.057+0000 7f3cec6ec640 1 -- 172.21.15.78:0/3648100804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3ce4196c70 con 0x7f3ce41007f0 2024-09-18T13:05:10.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.058+0000 7f3ce37fe640 1 -- 172.21.15.78:0/3648100804 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f3cd4004820 con 0x7f3ce41007f0 2024-09-18T13:05:10.059 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:05:10.059 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:05:10.059 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:05:10.059 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:05:10.060 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:05:10.060 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:05:10.060 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:05:10.060 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:05:10.060 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:05:10.060 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:05:10.060 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:05:10.060 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:05:10.060 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:05:10.060 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:05:10.061 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:05:10.061 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:05:10.061 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:05:10.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.060+0000 7f3cec6ec640 1 -- 172.21.15.78:0/3648100804 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ccc07d1a0 msgr2=0x7f3ccc07f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:10.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.060+0000 7f3cec6ec640 1 --2- 172.21.15.78:0/3648100804 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ccc07d1a0 0x7f3ccc07f660 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4196f90 tx=0x7f3cd8008040 comp rx=0 tx=0).stop 2024-09-18T13:05:10.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.060+0000 7f3cec6ec640 1 -- 172.21.15.78:0/3648100804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce41007f0 msgr2=0x7f3ce419b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:10.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.060+0000 7f3cec6ec640 1 --2- 172.21.15.78:0/3648100804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce41007f0 0x7f3ce419b670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4005cc0 tx=0x7f3cd402f5f0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.060+0000 7f3cec6ec640 1 -- 172.21.15.78:0/3648100804 shutdown_connections 2024-09-18T13:05:10.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.060+0000 7f3cec6ec640 1 --2- 172.21.15.78:0/3648100804 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ccc07d1a0 0x7f3ccc07f660 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.060+0000 7f3cec6ec640 1 --2- 172.21.15.78:0/3648100804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce41067f0 0x7f3ce419bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.060+0000 7f3cec6ec640 1 --2- 172.21.15.78:0/3648100804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ce41007f0 0x7f3ce419b670 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.060+0000 7f3cec6ec640 1 -- 172.21.15.78:0/3648100804 >> 172.21.15.78:0/3648100804 conn(0x7f3ce40fc550 msgr2=0x7f3ce40fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:10.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.060+0000 7f3cec6ec640 1 -- 172.21.15.78:0/3648100804 shutdown_connections 2024-09-18T13:05:10.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.060+0000 7f3cec6ec640 1 -- 172.21.15.78:0/3648100804 wait complete. 2024-09-18T13:05:10.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.141+0000 7f159e961640 1 -- 172.21.15.78:0/881146864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1598106800 msgr2=0x7f1598106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:10.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.141+0000 7f159e961640 1 --2- 172.21.15.78:0/881146864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1598106800 0x7f1598106be0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1588009880 tx=0x7f158802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.141+0000 7f159e961640 1 -- 172.21.15.78:0/881146864 shutdown_connections 2024-09-18T13:05:10.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.141+0000 7f159e961640 1 --2- 172.21.15.78:0/881146864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1598100800 0x7f1598100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.141+0000 7f159e961640 1 --2- 172.21.15.78:0/881146864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1598106800 0x7f1598106be0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.141+0000 7f159e961640 1 -- 172.21.15.78:0/881146864 >> 172.21.15.78:0/881146864 conn(0x7f15980fc520 msgr2=0x7f15980fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:10.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.141+0000 7f159e961640 1 -- 172.21.15.78:0/881146864 shutdown_connections 2024-09-18T13:05:10.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.141+0000 7f159e961640 1 -- 172.21.15.78:0/881146864 wait complete. 2024-09-18T13:05:10.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.142+0000 7f159e961640 1 Processor -- start 2024-09-18T13:05:10.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.142+0000 7f159e961640 1 -- start start 2024-09-18T13:05:10.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.142+0000 7f159e961640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1598100800 0x7f1598198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:10.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.142+0000 7f159e961640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1598106800 0x7f1598198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:10.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.142+0000 7f159e961640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f159810dcd0 con 0x7f1598100800 2024-09-18T13:05:10.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.142+0000 7f159e961640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f159810db50 con 0x7f1598106800 2024-09-18T13:05:10.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.142+0000 7f1597fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1598100800 0x7f1598198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:10.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.142+0000 7f1597fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1598100800 0x7f1598198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34748/0 (socket says 172.21.15.78:34748) 2024-09-18T13:05:10.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.142+0000 7f1597fff640 1 -- 172.21.15.78:0/2686489027 learned_addr learned my addr 172.21.15.78:0/2686489027 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:05:10.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.142+0000 7f15977fe640 1 --2- 172.21.15.78:0/2686489027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1598106800 0x7f1598198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:10.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.142+0000 7f1597fff640 1 -- 172.21.15.78:0/2686489027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1598106800 msgr2=0x7f1598198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:10.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.142+0000 7f1597fff640 1 --2- 172.21.15.78:0/2686489027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1598106800 0x7f1598198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.142+0000 7f1597fff640 1 -- 172.21.15.78:0/2686489027 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1598199350 con 0x7f1598100800 2024-09-18T13:05:10.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.143+0000 7f1597fff640 1 --2- 172.21.15.78:0/2686489027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1598100800 0x7f1598198810 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1588031460 tx=0x7f15880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:10.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.143+0000 7f15957fa640 1 -- 172.21.15.78:0/2686489027 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f158803f070 con 0x7f1598100800 2024-09-18T13:05:10.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.143+0000 7f15957fa640 1 -- 172.21.15.78:0/2686489027 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f15880035f0 con 0x7f1598100800 2024-09-18T13:05:10.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.143+0000 7f159e961640 1 -- 172.21.15.78:0/2686489027 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15981995e0 con 0x7f1598100800 2024-09-18T13:05:10.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.143+0000 7f15957fa640 1 -- 172.21.15.78:0/2686489027 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1588035030 con 0x7f1598100800 2024-09-18T13:05:10.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.143+0000 7f159e961640 1 -- 172.21.15.78:0/2686489027 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15981a1b90 con 0x7f1598100800 2024-09-18T13:05:10.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.144+0000 7f159e961640 1 -- 172.21.15.78:0/2686489027 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1598101f40 con 0x7f1598100800 2024-09-18T13:05:10.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.145+0000 7f15957fa640 1 -- 172.21.15.78:0/2686489027 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1588042070 con 0x7f1598100800 2024-09-18T13:05:10.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.145+0000 7f15957fa640 1 --2- 172.21.15.78:0/2686489027 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f158007af30 0x7f158007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:10.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.145+0000 7f15957fa640 1 -- 172.21.15.78:0/2686489027 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f15880be9d0 con 0x7f1598100800 2024-09-18T13:05:10.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.145+0000 7f15977fe640 1 --2- 172.21.15.78:0/2686489027 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f158007af30 0x7f158007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:10.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.146+0000 7f15977fe640 1 --2- 172.21.15.78:0/2686489027 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f158007af30 0x7f158007d3f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f159806ad00 tx=0x7f158c00b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:10.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.150+0000 7f15957fa640 1 -- 172.21.15.78:0/2686489027 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1588089f70 con 0x7f1598100800 2024-09-18T13:05:10.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.359+0000 7f159e961640 1 -- 172.21.15.78:0/2686489027 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1598108d70 con 0x7f1598100800 2024-09-18T13:05:10.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.359+0000 7f15957fa640 1 -- 172.21.15.78:0/2686489027 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f158808ee20 con 0x7f1598100800 2024-09-18T13:05:10.361 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:05:10.361 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:05:10.361 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:05:10.361 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:05:10.361 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:05:10.361 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:05:10.361 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:05:10.361 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:05:10.361 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:05:10.361 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:05:10.362 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:05:10.362 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:05:10.362 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:05:10.362 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:05:10.362 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:05:10.362 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:05:10.362 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:05:10.362 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:05:10.362 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:05:10.362 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:05:10.362 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:05:10.362 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:05:10.362 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:05:10.363 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:05:10.363 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:05:10.363 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:05:10.363 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:05:10.363 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:05:10.363 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:05:10.363 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:05:10.363 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:05:10.363 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:05:10.363 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:05:10.363 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:05:10.363 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:05:10.363 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:05:10.364 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:05:10.364 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:05:10.364 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:05:10.364 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:05:10.364 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:05:10.364 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:05:10.364 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:05:10.365 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:05:10.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.361+0000 7f159e961640 1 -- 172.21.15.78:0/2686489027 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f158007af30 msgr2=0x7f158007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:10.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.361+0000 7f159e961640 1 --2- 172.21.15.78:0/2686489027 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f158007af30 0x7f158007d3f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f159806ad00 tx=0x7f158c00b390 comp rx=0 tx=0).stop 2024-09-18T13:05:10.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.361+0000 7f159e961640 1 -- 172.21.15.78:0/2686489027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1598100800 msgr2=0x7f1598198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:10.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.361+0000 7f159e961640 1 --2- 172.21.15.78:0/2686489027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1598100800 0x7f1598198810 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1588031460 tx=0x7f15880045e0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.362+0000 7f159e961640 1 -- 172.21.15.78:0/2686489027 shutdown_connections 2024-09-18T13:05:10.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.362+0000 7f159e961640 1 --2- 172.21.15.78:0/2686489027 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f158007af30 0x7f158007d3f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.362+0000 7f159e961640 1 --2- 172.21.15.78:0/2686489027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1598106800 0x7f1598198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.362+0000 7f159e961640 1 --2- 172.21.15.78:0/2686489027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1598100800 0x7f1598198810 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.362+0000 7f159e961640 1 -- 172.21.15.78:0/2686489027 >> 172.21.15.78:0/2686489027 conn(0x7f15980fc520 msgr2=0x7f15980fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:10.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.362+0000 7f159e961640 1 -- 172.21.15.78:0/2686489027 shutdown_connections 2024-09-18T13:05:10.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.362+0000 7f159e961640 1 -- 172.21.15.78:0/2686489027 wait complete. 2024-09-18T13:05:10.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.443+0000 7f72a9718640 1 -- 172.21.15.78:0/4115448012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a4100ce0 msgr2=0x7f72a41065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:10.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.443+0000 7f72a9718640 1 --2- 172.21.15.78:0/4115448012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a4100ce0 0x7f72a41065a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7298009880 tx=0x7f729802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.443+0000 7f72a9718640 1 -- 172.21.15.78:0/4115448012 shutdown_connections 2024-09-18T13:05:10.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.443+0000 7f72a9718640 1 --2- 172.21.15.78:0/4115448012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a4100ce0 0x7f72a41065a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.443+0000 7f72a9718640 1 --2- 172.21.15.78:0/4115448012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72a4100330 0x7f72a4100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.443+0000 7f72a9718640 1 -- 172.21.15.78:0/4115448012 >> 172.21.15.78:0/4115448012 conn(0x7f72a4077270 msgr2=0x7f72a4077680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:10.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.443+0000 7f72a9718640 1 -- 172.21.15.78:0/4115448012 shutdown_connections 2024-09-18T13:05:10.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.443+0000 7f72a9718640 1 -- 172.21.15.78:0/4115448012 wait complete. 2024-09-18T13:05:10.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.444+0000 7f72a9718640 1 Processor -- start 2024-09-18T13:05:10.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.444+0000 7f72a9718640 1 -- start start 2024-09-18T13:05:10.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.444+0000 7f72a9718640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72a4100330 0x7f72a41012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:10.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.444+0000 7f72a9718640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a4100ce0 0x7f72a41017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:10.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.444+0000 7f72a9718640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f72a410edd0 con 0x7f72a4100ce0 2024-09-18T13:05:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.444+0000 7f72a9718640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f72a410ec50 con 0x7f72a4100330 2024-09-18T13:05:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.444+0000 7f72a27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a4100ce0 0x7f72a41017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.445+0000 7f72a27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a4100ce0 0x7f72a41017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34772/0 (socket says 172.21.15.78:34772) 2024-09-18T13:05:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.445+0000 7f72a27fc640 1 -- 172.21.15.78:0/442820221 learned_addr learned my addr 172.21.15.78:0/442820221 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:05:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.445+0000 7f72a2ffd640 1 --2- 172.21.15.78:0/442820221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72a4100330 0x7f72a41012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.445+0000 7f72a27fc640 1 -- 172.21.15.78:0/442820221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72a4100330 msgr2=0x7f72a41012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.445+0000 7f72a27fc640 1 --2- 172.21.15.78:0/442820221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72a4100330 0x7f72a41012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.445+0000 7f72a27fc640 1 -- 172.21.15.78:0/442820221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a4101d30 con 0x7f72a4100ce0 2024-09-18T13:05:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.445+0000 7f72a2ffd640 1 --2- 172.21.15.78:0/442820221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72a4100330 0x7f72a41012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:05:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.445+0000 7f72a27fc640 1 --2- 172.21.15.78:0/442820221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a4100ce0 0x7f72a41017f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f72980045e0 tx=0x7f7298004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.445+0000 7f728bfff640 1 -- 172.21.15.78:0/442820221 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f729803f070 con 0x7f72a4100ce0 2024-09-18T13:05:10.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.445+0000 7f72a9718640 1 -- 172.21.15.78:0/442820221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a4101fc0 con 0x7f72a4100ce0 2024-09-18T13:05:10.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.445+0000 7f728bfff640 1 -- 172.21.15.78:0/442820221 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72980035f0 con 0x7f72a4100ce0 2024-09-18T13:05:10.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.445+0000 7f728bfff640 1 -- 172.21.15.78:0/442820221 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7298035030 con 0x7f72a4100ce0 2024-09-18T13:05:10.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.445+0000 7f72a9718640 1 -- 172.21.15.78:0/442820221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a41a3d90 con 0x7f72a4100ce0 2024-09-18T13:05:10.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.446+0000 7f72a9718640 1 -- 172.21.15.78:0/442820221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a4069e00 con 0x7f72a4100ce0 2024-09-18T13:05:10.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.447+0000 7f728bfff640 1 -- 172.21.15.78:0/442820221 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7298042070 con 0x7f72a4100ce0 2024-09-18T13:05:10.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.447+0000 7f728bfff640 1 --2- 172.21.15.78:0/442820221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f728c07af40 0x7f728c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:10.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.448+0000 7f72a2ffd640 1 --2- 172.21.15.78:0/442820221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f728c07af40 0x7f728c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:10.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.448+0000 7f728bfff640 1 -- 172.21.15.78:0/442820221 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f72980be710 con 0x7f72a4100ce0 2024-09-18T13:05:10.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.448+0000 7f72a2ffd640 1 --2- 172.21.15.78:0/442820221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f728c07af40 0x7f728c07d400 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7294005fd0 tx=0x7f7294009520 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:10.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.452+0000 7f728bfff640 1 -- 172.21.15.78:0/442820221 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7298089cb0 con 0x7f72a4100ce0 2024-09-18T13:05:10.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.644+0000 7f72a9718640 1 -- 172.21.15.78:0/442820221 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f72a4062630 con 0x7f728c07af40 2024-09-18T13:05:10.646 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:10 smithi078 ceph-mon[108578]: from='client.34722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:10.646 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:10 smithi078 ceph-mon[108578]: pgmap v480: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:10.646 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:10 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3648100804' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:05:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.646+0000 7f728bfff640 1 -- 172.21.15.78:0/442820221 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f72a4062630 con 0x7f728c07af40 2024-09-18T13:05:10.647 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:05:10.647 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:05:10.647 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:05:10.647 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:05:10.647 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:05:10.647 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:05:10.647 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:05:10.648 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:05:10.648 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:05:10.648 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:05:10.648 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:05:10.648 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:05:10.648 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:05:10.648 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:05:10.648 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:05:10.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.648+0000 7f72a9718640 1 -- 172.21.15.78:0/442820221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f728c07af40 msgr2=0x7f728c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:10.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.648+0000 7f72a9718640 1 --2- 172.21.15.78:0/442820221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f728c07af40 0x7f728c07d400 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7294005fd0 tx=0x7f7294009520 comp rx=0 tx=0).stop 2024-09-18T13:05:10.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.648+0000 7f72a9718640 1 -- 172.21.15.78:0/442820221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a4100ce0 msgr2=0x7f72a41017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:10.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.648+0000 7f72a9718640 1 --2- 172.21.15.78:0/442820221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a4100ce0 0x7f72a41017f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f72980045e0 tx=0x7f7298004610 comp rx=0 tx=0).stop 2024-09-18T13:05:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.648+0000 7f72a9718640 1 -- 172.21.15.78:0/442820221 shutdown_connections 2024-09-18T13:05:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.648+0000 7f72a9718640 1 --2- 172.21.15.78:0/442820221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f728c07af40 0x7f728c07d400 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.648+0000 7f72a9718640 1 --2- 172.21.15.78:0/442820221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a4100ce0 0x7f72a41017f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.648+0000 7f72a9718640 1 --2- 172.21.15.78:0/442820221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72a4100330 0x7f72a41012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.648+0000 7f72a9718640 1 -- 172.21.15.78:0/442820221 >> 172.21.15.78:0/442820221 conn(0x7f72a4077270 msgr2=0x7f72a40fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.648+0000 7f72a9718640 1 -- 172.21.15.78:0/442820221 shutdown_connections 2024-09-18T13:05:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.648+0000 7f72a9718640 1 -- 172.21.15.78:0/442820221 wait complete. 2024-09-18T13:05:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:10 smithi148 ceph-mon[80030]: from='client.34722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:10 smithi148 ceph-mon[80030]: pgmap v480: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:10 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3648100804' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:05:10.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.728+0000 7fe6247d6640 1 -- 172.21.15.78:0/4056248729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe61c1067f0 msgr2=0x7fe61c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:10.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.728+0000 7fe6247d6640 1 --2- 172.21.15.78:0/4056248729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe61c1067f0 0x7fe61c106bd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe618009880 tx=0x7fe61802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.729+0000 7fe6247d6640 1 -- 172.21.15.78:0/4056248729 shutdown_connections 2024-09-18T13:05:10.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.729+0000 7fe6247d6640 1 --2- 172.21.15.78:0/4056248729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe61c1007f0 0x7fe61c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.729+0000 7fe6247d6640 1 --2- 172.21.15.78:0/4056248729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe61c1067f0 0x7fe61c106bd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.729+0000 7fe6247d6640 1 -- 172.21.15.78:0/4056248729 >> 172.21.15.78:0/4056248729 conn(0x7fe61c0fc550 msgr2=0x7fe61c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:10.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.729+0000 7fe6247d6640 1 -- 172.21.15.78:0/4056248729 shutdown_connections 2024-09-18T13:05:10.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.729+0000 7fe6247d6640 1 -- 172.21.15.78:0/4056248729 wait complete. 2024-09-18T13:05:10.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.729+0000 7fe6247d6640 1 Processor -- start 2024-09-18T13:05:10.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.729+0000 7fe6247d6640 1 -- start start 2024-09-18T13:05:10.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe6247d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe61c1007f0 0x7fe61c198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:10.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe6247d6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe61c1067f0 0x7fe61c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:10.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe6247d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe61c10dcc0 con 0x7fe61c1007f0 2024-09-18T13:05:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe6247d6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe61c10db40 con 0x7fe61c1067f0 2024-09-18T13:05:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe622572640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe61c1007f0 0x7fe61c198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe622572640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe61c1007f0 0x7fe61c198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34788/0 (socket says 172.21.15.78:34788) 2024-09-18T13:05:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe622572640 1 -- 172.21.15.78:0/3772737352 learned_addr learned my addr 172.21.15.78:0/3772737352 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:05:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe621d71640 1 --2- 172.21.15.78:0/3772737352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe61c1067f0 0x7fe61c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe622572640 1 -- 172.21.15.78:0/3772737352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe61c1067f0 msgr2=0x7fe61c198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe622572640 1 --2- 172.21.15.78:0/3772737352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe61c1067f0 0x7fe61c198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe622572640 1 -- 172.21.15.78:0/3772737352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61c199350 con 0x7fe61c1007f0 2024-09-18T13:05:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe622572640 1 --2- 172.21.15.78:0/3772737352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe61c1007f0 0x7fe61c198810 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe618031460 tx=0x7fe618004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe6137fe640 1 -- 172.21.15.78:0/3772737352 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe61803f070 con 0x7fe61c1007f0 2024-09-18T13:05:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe6137fe640 1 -- 172.21.15.78:0/3772737352 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6180035f0 con 0x7fe61c1007f0 2024-09-18T13:05:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe6137fe640 1 -- 172.21.15.78:0/3772737352 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe618035030 con 0x7fe61c1007f0 2024-09-18T13:05:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe6247d6640 1 -- 172.21.15.78:0/3772737352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe61c1995e0 con 0x7fe61c1007f0 2024-09-18T13:05:10.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.730+0000 7fe6247d6640 1 -- 172.21.15.78:0/3772737352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe61c1a1b90 con 0x7fe61c1007f0 2024-09-18T13:05:10.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.731+0000 7fe6247d6640 1 -- 172.21.15.78:0/3772737352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe61c101f30 con 0x7fe61c1007f0 2024-09-18T13:05:10.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.732+0000 7fe6137fe640 1 -- 172.21.15.78:0/3772737352 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe618042070 con 0x7fe61c1007f0 2024-09-18T13:05:10.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.733+0000 7fe6137fe640 1 --2- 172.21.15.78:0/3772737352 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe60807af80 0x7fe60807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:10.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.733+0000 7fe6137fe640 1 -- 172.21.15.78:0/3772737352 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fe6180be930 con 0x7fe61c1007f0 2024-09-18T13:05:10.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.733+0000 7fe621d71640 1 --2- 172.21.15.78:0/3772737352 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe60807af80 0x7fe60807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:10.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.733+0000 7fe621d71640 1 --2- 172.21.15.78:0/3772737352 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe60807af80 0x7fe60807d440 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe61c06a7f0 tx=0x7fe60c005f90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:10.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.738+0000 7fe6137fe640 1 -- 172.21.15.78:0/3772737352 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe618089eb0 con 0x7fe61c1007f0 2024-09-18T13:05:10.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.980+0000 7fe6247d6640 1 -- 172.21.15.78:0/3772737352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe61c108d60 con 0x7fe61c1007f0 2024-09-18T13:05:10.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.981+0000 7fe6137fe640 1 -- 172.21.15.78:0/3772737352 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fe61808ed60 con 0x7fe61c1007f0 2024-09-18T13:05:10.982 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:05:10.982 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:05:10.982 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:05:10.982 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:05:10.982 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:05:10.983 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:05:10.983 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:05:10.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.983+0000 7fe6247d6640 1 -- 172.21.15.78:0/3772737352 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe60807af80 msgr2=0x7fe60807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:10.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.983+0000 7fe6247d6640 1 --2- 172.21.15.78:0/3772737352 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe60807af80 0x7fe60807d440 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe61c06a7f0 tx=0x7fe60c005f90 comp rx=0 tx=0).stop 2024-09-18T13:05:10.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.983+0000 7fe6247d6640 1 -- 172.21.15.78:0/3772737352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe61c1007f0 msgr2=0x7fe61c198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:10.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.983+0000 7fe6247d6640 1 --2- 172.21.15.78:0/3772737352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe61c1007f0 0x7fe61c198810 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe618031460 tx=0x7fe618004530 comp rx=0 tx=0).stop 2024-09-18T13:05:10.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.983+0000 7fe6247d6640 1 -- 172.21.15.78:0/3772737352 shutdown_connections 2024-09-18T13:05:10.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.983+0000 7fe6247d6640 1 --2- 172.21.15.78:0/3772737352 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe60807af80 0x7fe60807d440 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.983+0000 7fe6247d6640 1 --2- 172.21.15.78:0/3772737352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe61c1067f0 0x7fe61c198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.983+0000 7fe6247d6640 1 --2- 172.21.15.78:0/3772737352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe61c1007f0 0x7fe61c198810 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:10.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.983+0000 7fe6247d6640 1 -- 172.21.15.78:0/3772737352 >> 172.21.15.78:0/3772737352 conn(0x7fe61c0fc550 msgr2=0x7fe61c0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:10.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.983+0000 7fe6247d6640 1 -- 172.21.15.78:0/3772737352 shutdown_connections 2024-09-18T13:05:10.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:10.983+0000 7fe6247d6640 1 -- 172.21.15.78:0/3772737352 wait complete. 2024-09-18T13:05:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:11 smithi148 ceph-mon[80030]: from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:11 smithi148 ceph-mon[80030]: from='client.34730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:11 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2686489027' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:05:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:11 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3772737352' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:05:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:11 smithi078 ceph-mon[108578]: from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:11 smithi078 ceph-mon[108578]: from='client.34730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:11 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2686489027' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:05:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:11 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3772737352' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:05:12.707 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:12 smithi078 ceph-mon[108578]: from='client.34742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:12.707 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:12 smithi078 ceph-mon[108578]: pgmap v481: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:12.742 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:12 smithi148 ceph-mon[80030]: from='client.34742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:12.742 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:12 smithi148 ceph-mon[80030]: pgmap v481: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:14.634 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:14 smithi148 ceph-mon[80030]: pgmap v482: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:14 smithi078 ceph-mon[108578]: pgmap v482: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:16.644 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:16 smithi078 ceph-mon[108578]: pgmap v483: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:16.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:16 smithi148 ceph-mon[80030]: pgmap v483: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:18.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:18 smithi078 ceph-mon[108578]: pgmap v484: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:18 smithi148 ceph-mon[80030]: pgmap v484: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:20 smithi148 ceph-mon[80030]: pgmap v485: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:20.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:20 smithi078 ceph-mon[108578]: pgmap v485: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:22 smithi148 ceph-mon[80030]: pgmap v486: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:22.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:22 smithi078 ceph-mon[108578]: pgmap v486: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:24.711 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:24 smithi078 ceph-mon[108578]: pgmap v487: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:24.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:24 smithi148 ceph-mon[80030]: pgmap v487: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:26 smithi148 ceph-mon[80030]: pgmap v488: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:26.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:26 smithi078 ceph-mon[108578]: pgmap v488: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:26.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:28 smithi148 ceph-mon[80030]: pgmap v489: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:28.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:28 smithi078 ceph-mon[108578]: pgmap v489: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:30.710 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:30 smithi078 ceph-mon[108578]: pgmap v490: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:30.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:30 smithi148 ceph-mon[80030]: pgmap v490: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:32 smithi148 ceph-mon[80030]: pgmap v491: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:32 smithi078 ceph-mon[108578]: pgmap v491: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:34 smithi148 ceph-mon[80030]: pgmap v492: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:34.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:34 smithi078 ceph-mon[108578]: pgmap v492: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:36.713 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:36 smithi078 ceph-mon[108578]: pgmap v493: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:36.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:36 smithi148 ceph-mon[80030]: pgmap v493: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:38.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:38 smithi148 ceph-mon[80030]: pgmap v494: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:38.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:38 smithi078 ceph-mon[108578]: pgmap v494: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:40 smithi148 ceph-mon[80030]: pgmap v495: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:40 smithi078 ceph-mon[108578]: pgmap v495: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:41.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.078+0000 7ff02e3ed640 1 -- 172.21.15.78:0/3704915952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff028107900 msgr2=0x7ff028107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:41.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.078+0000 7ff02e3ed640 1 --2- 172.21.15.78:0/3704915952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff028107900 0x7ff028107ce0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff018009880 tx=0x7ff01802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.078+0000 7ff02e3ed640 1 -- 172.21.15.78:0/3704915952 shutdown_connections 2024-09-18T13:05:41.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.079+0000 7ff02e3ed640 1 --2- 172.21.15.78:0/3704915952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff028101900 0x7ff028101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.079+0000 7ff02e3ed640 1 --2- 172.21.15.78:0/3704915952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff028107900 0x7ff028107ce0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.079+0000 7ff02e3ed640 1 -- 172.21.15.78:0/3704915952 >> 172.21.15.78:0/3704915952 conn(0x7ff0280fd600 msgr2=0x7ff0280ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:41.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.079+0000 7ff02e3ed640 1 -- 172.21.15.78:0/3704915952 shutdown_connections 2024-09-18T13:05:41.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.079+0000 7ff02e3ed640 1 -- 172.21.15.78:0/3704915952 wait complete. 2024-09-18T13:05:41.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.079+0000 7ff02e3ed640 1 Processor -- start 2024-09-18T13:05:41.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.079+0000 7ff02e3ed640 1 -- start start 2024-09-18T13:05:41.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.080+0000 7ff02e3ed640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff028101900 0x7ff0280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:41.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.080+0000 7ff02e3ed640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff028107900 0x7ff028074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:41.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.080+0000 7ff02e3ed640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff02810edb0 con 0x7ff028107900 2024-09-18T13:05:41.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.080+0000 7ff02e3ed640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff02810ec30 con 0x7ff028101900 2024-09-18T13:05:41.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.080+0000 7ff0277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff028107900 0x7ff028074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:41.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.080+0000 7ff0277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff028107900 0x7ff028074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34692/0 (socket says 172.21.15.78:34692) 2024-09-18T13:05:41.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.080+0000 7ff0277fe640 1 -- 172.21.15.78:0/2802079009 learned_addr learned my addr 172.21.15.78:0/2802079009 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:05:41.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.080+0000 7ff027fff640 1 --2- 172.21.15.78:0/2802079009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff028101900 0x7ff0280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.080+0000 7ff0277fe640 1 -- 172.21.15.78:0/2802079009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff028101900 msgr2=0x7ff0280744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.080+0000 7ff0277fe640 1 --2- 172.21.15.78:0/2802079009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff028101900 0x7ff0280744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.080+0000 7ff0277fe640 1 -- 172.21.15.78:0/2802079009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff028074f70 con 0x7ff028107900 2024-09-18T13:05:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.080+0000 7ff027fff640 1 --2- 172.21.15.78:0/2802079009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff028101900 0x7ff0280744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:05:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.080+0000 7ff0277fe640 1 --2- 172.21.15.78:0/2802079009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff028107900 0x7ff028074a30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00c810 tx=0x7ff01c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.081+0000 7ff0257fa640 1 -- 172.21.15.78:0/2802079009 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff01c004020 con 0x7ff028107900 2024-09-18T13:05:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.081+0000 7ff02e3ed640 1 -- 172.21.15.78:0/2802079009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff028075260 con 0x7ff028107900 2024-09-18T13:05:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.081+0000 7ff0257fa640 1 -- 172.21.15.78:0/2802079009 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff01c0041c0 con 0x7ff028107900 2024-09-18T13:05:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.081+0000 7ff0257fa640 1 -- 172.21.15.78:0/2802079009 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff01c0047a0 con 0x7ff028107900 2024-09-18T13:05:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.081+0000 7ff02e3ed640 1 -- 172.21.15.78:0/2802079009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0281a3e60 con 0x7ff028107900 2024-09-18T13:05:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.082+0000 7ff02e3ed640 1 -- 172.21.15.78:0/2802079009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff028103040 con 0x7ff028107900 2024-09-18T13:05:41.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.082+0000 7ff0257fa640 1 -- 172.21.15.78:0/2802079009 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff01c0079b0 con 0x7ff028107900 2024-09-18T13:05:41.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.083+0000 7ff0257fa640 1 --2- 172.21.15.78:0/2802079009 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff01007af30 0x7ff01007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:41.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.083+0000 7ff0257fa640 1 -- 172.21.15.78:0/2802079009 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7ff01c09dfc0 con 0x7ff028107900 2024-09-18T13:05:41.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.083+0000 7ff027fff640 1 --2- 172.21.15.78:0/2802079009 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff01007af30 0x7ff01007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:41.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.084+0000 7ff027fff640 1 --2- 172.21.15.78:0/2802079009 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff01007af30 0x7ff01007d3f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff018031460 tx=0x7ff018009560 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:41.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.088+0000 7ff0257fa640 1 -- 172.21.15.78:0/2802079009 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff01c014030 con 0x7ff028107900 2024-09-18T13:05:41.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.280+0000 7ff02e3ed640 1 -- 172.21.15.78:0/2802079009 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff028062630 con 0x7ff01007af30 2024-09-18T13:05:41.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.281+0000 7ff0257fa640 1 -- 172.21.15.78:0/2802079009 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff028062630 con 0x7ff01007af30 2024-09-18T13:05:41.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.283+0000 7ff02e3ed640 1 -- 172.21.15.78:0/2802079009 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff01007af30 msgr2=0x7ff01007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:41.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.283+0000 7ff02e3ed640 1 --2- 172.21.15.78:0/2802079009 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff01007af30 0x7ff01007d3f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff018031460 tx=0x7ff018009560 comp rx=0 tx=0).stop 2024-09-18T13:05:41.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.283+0000 7ff02e3ed640 1 -- 172.21.15.78:0/2802079009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff028107900 msgr2=0x7ff028074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:41.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.283+0000 7ff02e3ed640 1 --2- 172.21.15.78:0/2802079009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff028107900 0x7ff028074a30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00c810 tx=0x7ff01c00ccd0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.283+0000 7ff02e3ed640 1 -- 172.21.15.78:0/2802079009 shutdown_connections 2024-09-18T13:05:41.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.283+0000 7ff02e3ed640 1 --2- 172.21.15.78:0/2802079009 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff01007af30 0x7ff01007d3f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.283+0000 7ff02e3ed640 1 --2- 172.21.15.78:0/2802079009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff028107900 0x7ff028074a30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.283+0000 7ff02e3ed640 1 --2- 172.21.15.78:0/2802079009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff028101900 0x7ff0280744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.283+0000 7ff02e3ed640 1 -- 172.21.15.78:0/2802079009 >> 172.21.15.78:0/2802079009 conn(0x7ff0280fd600 msgr2=0x7ff0280fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:41.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.283+0000 7ff02e3ed640 1 -- 172.21.15.78:0/2802079009 shutdown_connections 2024-09-18T13:05:41.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.283+0000 7ff02e3ed640 1 -- 172.21.15.78:0/2802079009 wait complete. 2024-09-18T13:05:41.293 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:05:41.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.366+0000 7f92ba77d640 1 -- 172.21.15.78:0/1924416969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b4107910 msgr2=0x7f92b4107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:41.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.366+0000 7f92ba77d640 1 --2- 172.21.15.78:0/1924416969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b4107910 0x7f92b4107cf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f92a4009880 tx=0x7f92a402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.366+0000 7f92ba77d640 1 -- 172.21.15.78:0/1924416969 shutdown_connections 2024-09-18T13:05:41.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.366+0000 7f92ba77d640 1 --2- 172.21.15.78:0/1924416969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b4101910 0x7f92b4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.366+0000 7f92ba77d640 1 --2- 172.21.15.78:0/1924416969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b4107910 0x7f92b4107cf0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.366+0000 7f92ba77d640 1 -- 172.21.15.78:0/1924416969 >> 172.21.15.78:0/1924416969 conn(0x7f92b40fd610 msgr2=0x7f92b40ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:41.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.367+0000 7f92ba77d640 1 -- 172.21.15.78:0/1924416969 shutdown_connections 2024-09-18T13:05:41.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.367+0000 7f92ba77d640 1 -- 172.21.15.78:0/1924416969 wait complete. 2024-09-18T13:05:41.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.367+0000 7f92ba77d640 1 Processor -- start 2024-09-18T13:05:41.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.367+0000 7f92ba77d640 1 -- start start 2024-09-18T13:05:41.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.367+0000 7f92ba77d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b4101910 0x7f92b419f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:41.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.367+0000 7f92ba77d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b4107910 0x7f92b419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:41.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.367+0000 7f92ba77d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f92b410ede0 con 0x7f92b4107910 2024-09-18T13:05:41.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.367+0000 7f92ba77d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f92b410ec60 con 0x7f92b4101910 2024-09-18T13:05:41.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.368+0000 7f92abfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b4107910 0x7f92b419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:41.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.368+0000 7f92abfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b4107910 0x7f92b419fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54404/0 (socket says 172.21.15.78:54404) 2024-09-18T13:05:41.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.368+0000 7f92abfff640 1 -- 172.21.15.78:0/2310617420 learned_addr learned my addr 172.21.15.78:0/2310617420 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:05:41.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.368+0000 7f92b3fff640 1 --2- 172.21.15.78:0/2310617420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b4101910 0x7f92b419f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:41.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.368+0000 7f92abfff640 1 -- 172.21.15.78:0/2310617420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b4101910 msgr2=0x7f92b419f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:41.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.368+0000 7f92abfff640 1 --2- 172.21.15.78:0/2310617420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b4101910 0x7f92b419f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.368+0000 7f92abfff640 1 -- 172.21.15.78:0/2310617420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b4199a00 con 0x7f92b4107910 2024-09-18T13:05:41.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.368+0000 7f92b3fff640 1 --2- 172.21.15.78:0/2310617420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b4101910 0x7f92b419f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:05:41.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.368+0000 7f92abfff640 1 --2- 172.21.15.78:0/2310617420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b4107910 0x7f92b419fd80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f929c00d6f0 tx=0x7f929c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:41.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.368+0000 7f92b1ffb640 1 -- 172.21.15.78:0/2310617420 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f929c017070 con 0x7f92b4107910 2024-09-18T13:05:41.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.368+0000 7f92b1ffb640 1 -- 172.21.15.78:0/2310617420 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f929c00de00 con 0x7f92b4107910 2024-09-18T13:05:41.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.368+0000 7f92ba77d640 1 -- 172.21.15.78:0/2310617420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b4199cf0 con 0x7f92b4107910 2024-09-18T13:05:41.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.368+0000 7f92b1ffb640 1 -- 172.21.15.78:0/2310617420 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f929c004bb0 con 0x7f92b4107910 2024-09-18T13:05:41.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.368+0000 7f92ba77d640 1 -- 172.21.15.78:0/2310617420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b419a280 con 0x7f92b4107910 2024-09-18T13:05:41.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.369+0000 7f92ba77d640 1 -- 172.21.15.78:0/2310617420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92b4103050 con 0x7f92b4107910 2024-09-18T13:05:41.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.370+0000 7f92b1ffb640 1 -- 172.21.15.78:0/2310617420 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f929c004e60 con 0x7f92b4107910 2024-09-18T13:05:41.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.371+0000 7f92b1ffb640 1 --2- 172.21.15.78:0/2310617420 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f92a007af40 0x7f92a007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:41.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.371+0000 7f92b3fff640 1 --2- 172.21.15.78:0/2310617420 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f92a007af40 0x7f92a007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:41.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.371+0000 7f92b1ffb640 1 -- 172.21.15.78:0/2310617420 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f929c09dd50 con 0x7f92b4107910 2024-09-18T13:05:41.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.371+0000 7f92b3fff640 1 --2- 172.21.15.78:0/2310617420 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f92a007af40 0x7f92a007d400 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f92a4000c00 tx=0x7f92a4031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:41.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.375+0000 7f92b1ffb640 1 -- 172.21.15.78:0/2310617420 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f929c069250 con 0x7f92b4107910 2024-09-18T13:05:41.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.568+0000 7f92ba77d640 1 -- 172.21.15.78:0/2310617420 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f92b419a530 con 0x7f92a007af40 2024-09-18T13:05:41.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.570+0000 7f92b1ffb640 1 -- 172.21.15.78:0/2310617420 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f92b419a530 con 0x7f92a007af40 2024-09-18T13:05:41.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.572+0000 7f92ba77d640 1 -- 172.21.15.78:0/2310617420 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f92a007af40 msgr2=0x7f92a007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:41.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.572+0000 7f92ba77d640 1 --2- 172.21.15.78:0/2310617420 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f92a007af40 0x7f92a007d400 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f92a4000c00 tx=0x7f92a4031400 comp rx=0 tx=0).stop 2024-09-18T13:05:41.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.572+0000 7f92ba77d640 1 -- 172.21.15.78:0/2310617420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b4107910 msgr2=0x7f92b419fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:41.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.572+0000 7f92ba77d640 1 --2- 172.21.15.78:0/2310617420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b4107910 0x7f92b419fd80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f929c00d6f0 tx=0x7f929c00dbb0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.572+0000 7f92ba77d640 1 -- 172.21.15.78:0/2310617420 shutdown_connections 2024-09-18T13:05:41.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.572+0000 7f92ba77d640 1 --2- 172.21.15.78:0/2310617420 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f92a007af40 0x7f92a007d400 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.572+0000 7f92ba77d640 1 --2- 172.21.15.78:0/2310617420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b4107910 0x7f92b419fd80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.572+0000 7f92ba77d640 1 --2- 172.21.15.78:0/2310617420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b4101910 0x7f92b419f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.572+0000 7f92ba77d640 1 -- 172.21.15.78:0/2310617420 >> 172.21.15.78:0/2310617420 conn(0x7f92b40fd610 msgr2=0x7f92b4074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:41.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.572+0000 7f92ba77d640 1 -- 172.21.15.78:0/2310617420 shutdown_connections 2024-09-18T13:05:41.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.572+0000 7f92ba77d640 1 -- 172.21.15.78:0/2310617420 wait complete. 2024-09-18T13:05:41.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.655+0000 7fd054200640 1 -- 172.21.15.78:0/3995147393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c107900 msgr2=0x7fd04c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:41.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.655+0000 7fd054200640 1 --2- 172.21.15.78:0/3995147393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c107900 0x7fd04c107ce0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd048009880 tx=0x7fd04802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.655+0000 7fd054200640 1 -- 172.21.15.78:0/3995147393 shutdown_connections 2024-09-18T13:05:41.656 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:41.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.655+0000 7fd054200640 1 --2- 172.21.15.78:0/3995147393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd04c101900 0x7fd04c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.655+0000 7fd054200640 1 --2- 172.21.15.78:0/3995147393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c107900 0x7fd04c107ce0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.655+0000 7fd054200640 1 -- 172.21.15.78:0/3995147393 >> 172.21.15.78:0/3995147393 conn(0x7fd04c0fd620 msgr2=0x7fd04c0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:41.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.655+0000 7fd054200640 1 -- 172.21.15.78:0/3995147393 shutdown_connections 2024-09-18T13:05:41.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.655+0000 7fd054200640 1 -- 172.21.15.78:0/3995147393 wait complete. 2024-09-18T13:05:41.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.656+0000 7fd054200640 1 Processor -- start 2024-09-18T13:05:41.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.656+0000 7fd054200640 1 -- start start 2024-09-18T13:05:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.656+0000 7fd054200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c101900 0x7fd04c19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.656+0000 7fd054200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd04c107900 0x7fd04c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.656+0000 7fd054200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c10edd0 con 0x7fd04c101900 2024-09-18T13:05:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.656+0000 7fd054200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c10ec50 con 0x7fd04c107900 2024-09-18T13:05:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.656+0000 7fd051f9c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c101900 0x7fd04c19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.656+0000 7fd051f9c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c101900 0x7fd04c19d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54434/0 (socket says 172.21.15.78:54434) 2024-09-18T13:05:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.656+0000 7fd051f9c640 1 -- 172.21.15.78:0/775031212 learned_addr learned my addr 172.21.15.78:0/775031212 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:05:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.656+0000 7fd05179b640 1 --2- 172.21.15.78:0/775031212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd04c107900 0x7fd04c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.656+0000 7fd051f9c640 1 -- 172.21.15.78:0/775031212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd04c107900 msgr2=0x7fd04c19db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.656+0000 7fd051f9c640 1 --2- 172.21.15.78:0/775031212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd04c107900 0x7fd04c19db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.656+0000 7fd051f9c640 1 -- 172.21.15.78:0/775031212 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04c1977a0 con 0x7fd04c101900 2024-09-18T13:05:41.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.657+0000 7fd051f9c640 1 --2- 172.21.15.78:0/775031212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c101900 0x7fd04c19d620 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd048031460 tx=0x7fd0480048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:41.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.657+0000 7fd042ffd640 1 -- 172.21.15.78:0/775031212 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd04803f070 con 0x7fd04c101900 2024-09-18T13:05:41.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.657+0000 7fd042ffd640 1 -- 172.21.15.78:0/775031212 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd048004cf0 con 0x7fd04c101900 2024-09-18T13:05:41.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.657+0000 7fd054200640 1 -- 172.21.15.78:0/775031212 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd04c197a30 con 0x7fd04c101900 2024-09-18T13:05:41.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.657+0000 7fd054200640 1 -- 172.21.15.78:0/775031212 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd04c197f60 con 0x7fd04c101900 2024-09-18T13:05:41.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.657+0000 7fd042ffd640 1 -- 172.21.15.78:0/775031212 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd048035030 con 0x7fd04c101900 2024-09-18T13:05:41.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.658+0000 7fd054200640 1 -- 172.21.15.78:0/775031212 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04c103040 con 0x7fd04c101900 2024-09-18T13:05:41.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.658+0000 7fd042ffd640 1 -- 172.21.15.78:0/775031212 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd048042070 con 0x7fd04c101900 2024-09-18T13:05:41.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.659+0000 7fd042ffd640 1 --2- 172.21.15.78:0/775031212 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd03807af30 0x7fd03807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:41.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.659+0000 7fd042ffd640 1 -- 172.21.15.78:0/775031212 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fd0480beb20 con 0x7fd04c101900 2024-09-18T13:05:41.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.659+0000 7fd05179b640 1 --2- 172.21.15.78:0/775031212 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd03807af30 0x7fd03807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:41.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.659+0000 7fd05179b640 1 --2- 172.21.15.78:0/775031212 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd03807af30 0x7fd03807d3f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd03c005fd0 tx=0x7fd03c005e20 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:41.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.663+0000 7fd042ffd640 1 -- 172.21.15.78:0/775031212 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd04808a0c0 con 0x7fd04c101900 2024-09-18T13:05:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:41.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.847+0000 7fd054200640 1 -- 172.21.15.78:0/775031212 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd04c1982d0 con 0x7fd03807af30 2024-09-18T13:05:41.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.856+0000 7fd042ffd640 1 -- 172.21.15.78:0/775031212 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fd04c1982d0 con 0x7fd03807af30 2024-09-18T13:05:41.858 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:05:41.858 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (13m) 7m ago 24m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:05:41.858 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (16m) 7m ago 24m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:05:41.858 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (15m) 7m ago 23m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:05:41.858 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (11m) 7m ago 24m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:05:41.858 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (11m) 7m ago 23m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:05:41.858 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (13m) 7m ago 24m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:05:41.858 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (8m) 7m ago 19m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:05:41.858 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (7m) 7m ago 19m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:05:41.858 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (7m) 7m ago 19m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:05:41.858 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (7m) 7m ago 19m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:05:41.858 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (15m) 7m ago 25m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:05:41.858 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (14m) 7m ago 23m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:05:41.859 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (12m) 7m ago 26m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:05:41.859 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (11m) 7m ago 23m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:05:41.859 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (14m) 7m ago 24m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:05:41.859 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (14m) 7m ago 23m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:05:41.859 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (11m) 7m ago 22m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:05:41.859 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (10m) 7m ago 21m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:05:41.859 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (10m) 7m ago 21m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:05:41.859 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (9m) 7m ago 21m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:05:41.859 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (8m) 7m ago 20m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:05:41.859 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (8m) 7m ago 20m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:05:41.859 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (13m) 7m ago 24m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:05:41.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.859+0000 7fd054200640 1 -- 172.21.15.78:0/775031212 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd03807af30 msgr2=0x7fd03807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:41.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.859+0000 7fd054200640 1 --2- 172.21.15.78:0/775031212 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd03807af30 0x7fd03807d3f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd03c005fd0 tx=0x7fd03c005e20 comp rx=0 tx=0).stop 2024-09-18T13:05:41.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.859+0000 7fd054200640 1 -- 172.21.15.78:0/775031212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c101900 msgr2=0x7fd04c19d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:41.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.859+0000 7fd054200640 1 --2- 172.21.15.78:0/775031212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c101900 0x7fd04c19d620 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd048031460 tx=0x7fd0480048f0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.859+0000 7fd054200640 1 -- 172.21.15.78:0/775031212 shutdown_connections 2024-09-18T13:05:41.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.859+0000 7fd054200640 1 --2- 172.21.15.78:0/775031212 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd03807af30 0x7fd03807d3f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.859+0000 7fd054200640 1 --2- 172.21.15.78:0/775031212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd04c107900 0x7fd04c19db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.859+0000 7fd054200640 1 --2- 172.21.15.78:0/775031212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04c101900 0x7fd04c19d620 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.859+0000 7fd054200640 1 -- 172.21.15.78:0/775031212 >> 172.21.15.78:0/775031212 conn(0x7fd04c0fd620 msgr2=0x7fd04c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:41.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.859+0000 7fd054200640 1 -- 172.21.15.78:0/775031212 shutdown_connections 2024-09-18T13:05:41.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.859+0000 7fd054200640 1 -- 172.21.15.78:0/775031212 wait complete. 2024-09-18T13:05:41.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.939+0000 7f1b415d3640 1 -- 172.21.15.78:0/2035896529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b3c1033e0 msgr2=0x7f1b3c10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:41.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.939+0000 7f1b415d3640 1 --2- 172.21.15.78:0/2035896529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b3c1033e0 0x7f1b3c10b8d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009880 tx=0x7f1b2402a530 comp rx=0 tx=0).stop 2024-09-18T13:05:41.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.939+0000 7f1b415d3640 1 -- 172.21.15.78:0/2035896529 shutdown_connections 2024-09-18T13:05:41.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.939+0000 7f1b415d3640 1 --2- 172.21.15.78:0/2035896529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b3c1033e0 0x7f1b3c10b8d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.939+0000 7f1b415d3640 1 --2- 172.21.15.78:0/2035896529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b3c102ac0 0x7f1b3c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.939+0000 7f1b415d3640 1 -- 172.21.15.78:0/2035896529 >> 172.21.15.78:0/2035896529 conn(0x7f1b3c0fc520 msgr2=0x7f1b3c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:41.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.939+0000 7f1b415d3640 1 -- 172.21.15.78:0/2035896529 shutdown_connections 2024-09-18T13:05:41.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.939+0000 7f1b415d3640 1 -- 172.21.15.78:0/2035896529 wait complete. 2024-09-18T13:05:41.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.940+0000 7f1b415d3640 1 Processor -- start 2024-09-18T13:05:41.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.940+0000 7f1b415d3640 1 -- start start 2024-09-18T13:05:41.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.940+0000 7f1b415d3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b3c102ac0 0x7f1b3c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:41.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.940+0000 7f1b415d3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b3c1033e0 0x7f1b3c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:41.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.941+0000 7f1b415d3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c10edf0 con 0x7f1b3c1033e0 2024-09-18T13:05:41.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.941+0000 7f1b415d3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c10ec70 con 0x7f1b3c102ac0 2024-09-18T13:05:41.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.941+0000 7f1b327fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b3c1033e0 0x7f1b3c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:41.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.941+0000 7f1b327fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b3c1033e0 0x7f1b3c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54460/0 (socket says 172.21.15.78:54460) 2024-09-18T13:05:41.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.941+0000 7f1b327fc640 1 -- 172.21.15.78:0/2040854459 learned_addr learned my addr 172.21.15.78:0/2040854459 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:05:41.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.941+0000 7f1b3affd640 1 --2- 172.21.15.78:0/2040854459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b3c102ac0 0x7f1b3c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:41.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.941+0000 7f1b327fc640 1 -- 172.21.15.78:0/2040854459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b3c102ac0 msgr2=0x7f1b3c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:41.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.941+0000 7f1b327fc640 1 --2- 172.21.15.78:0/2040854459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b3c102ac0 0x7f1b3c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:41.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.941+0000 7f1b327fc640 1 -- 172.21.15.78:0/2040854459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3c197800 con 0x7f1b3c1033e0 2024-09-18T13:05:41.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.941+0000 7f1b327fc640 1 --2- 172.21.15.78:0/2040854459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b3c1033e0 0x7f1b3c19dbc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1b24031460 tx=0x7f1b240045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:41.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.941+0000 7f1b38ff9640 1 -- 172.21.15.78:0/2040854459 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b2403f070 con 0x7f1b3c1033e0 2024-09-18T13:05:41.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.941+0000 7f1b415d3640 1 -- 172.21.15.78:0/2040854459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b3c197a90 con 0x7f1b3c1033e0 2024-09-18T13:05:41.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.941+0000 7f1b38ff9640 1 -- 172.21.15.78:0/2040854459 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b240035f0 con 0x7f1b3c1033e0 2024-09-18T13:05:41.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.941+0000 7f1b38ff9640 1 -- 172.21.15.78:0/2040854459 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b24035030 con 0x7f1b3c1033e0 2024-09-18T13:05:41.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.942+0000 7f1b415d3640 1 -- 172.21.15.78:0/2040854459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b3c197fc0 con 0x7f1b3c1033e0 2024-09-18T13:05:41.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.943+0000 7f1b415d3640 1 -- 172.21.15.78:0/2040854459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b3c06aa90 con 0x7f1b3c1033e0 2024-09-18T13:05:41.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.943+0000 7f1b38ff9640 1 -- 172.21.15.78:0/2040854459 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1b24042070 con 0x7f1b3c1033e0 2024-09-18T13:05:41.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.944+0000 7f1b38ff9640 1 --2- 172.21.15.78:0/2040854459 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1b2807af30 0x7f1b2807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:41.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.944+0000 7f1b38ff9640 1 -- 172.21.15.78:0/2040854459 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f1b240be8a0 con 0x7f1b3c1033e0 2024-09-18T13:05:41.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.944+0000 7f1b3affd640 1 --2- 172.21.15.78:0/2040854459 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1b2807af30 0x7f1b2807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:41.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.944+0000 7f1b3affd640 1 --2- 172.21.15.78:0/2040854459 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1b2807af30 0x7f1b2807d3f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009bd0 tx=0x7f1b2c005f90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:41.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:41.948+0000 7f1b38ff9640 1 -- 172.21.15.78:0/2040854459 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1b24089e40 con 0x7f1b3c1033e0 2024-09-18T13:05:42.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.216+0000 7f1b415d3640 1 -- 172.21.15.78:0/2040854459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1b3c198d30 con 0x7f1b3c1033e0 2024-09-18T13:05:42.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.217+0000 7f1b38ff9640 1 -- 172.21.15.78:0/2040854459 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f1b2408ecf0 con 0x7f1b3c1033e0 2024-09-18T13:05:42.218 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:05:42.218 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:05:42.218 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:05:42.219 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:05:42.219 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:05:42.219 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:05:42.219 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:05:42.219 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:05:42.219 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:05:42.219 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:05:42.219 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:05:42.219 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:05:42.219 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:05:42.219 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:05:42.219 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:05:42.219 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:05:42.219 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:05:42.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.219+0000 7f1b415d3640 1 -- 172.21.15.78:0/2040854459 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1b2807af30 msgr2=0x7f1b2807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:42.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.219+0000 7f1b415d3640 1 --2- 172.21.15.78:0/2040854459 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1b2807af30 0x7f1b2807d3f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009bd0 tx=0x7f1b2c005f90 comp rx=0 tx=0).stop 2024-09-18T13:05:42.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.219+0000 7f1b415d3640 1 -- 172.21.15.78:0/2040854459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b3c1033e0 msgr2=0x7f1b3c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:42.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.219+0000 7f1b415d3640 1 --2- 172.21.15.78:0/2040854459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b3c1033e0 0x7f1b3c19dbc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1b24031460 tx=0x7f1b240045c0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.219+0000 7f1b415d3640 1 -- 172.21.15.78:0/2040854459 shutdown_connections 2024-09-18T13:05:42.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.219+0000 7f1b415d3640 1 --2- 172.21.15.78:0/2040854459 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f1b2807af30 0x7f1b2807d3f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.219+0000 7f1b415d3640 1 --2- 172.21.15.78:0/2040854459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b3c1033e0 0x7f1b3c19dbc0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.219+0000 7f1b415d3640 1 --2- 172.21.15.78:0/2040854459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b3c102ac0 0x7f1b3c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.219+0000 7f1b415d3640 1 -- 172.21.15.78:0/2040854459 >> 172.21.15.78:0/2040854459 conn(0x7f1b3c0fc520 msgr2=0x7f1b3c108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:42.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.219+0000 7f1b415d3640 1 -- 172.21.15.78:0/2040854459 shutdown_connections 2024-09-18T13:05:42.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.219+0000 7f1b415d3640 1 -- 172.21.15.78:0/2040854459 wait complete. 2024-09-18T13:05:42.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.300+0000 7f9d274da640 1 -- 172.21.15.78:0/4056871596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d20107900 msgr2=0x7f9d20107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:42.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.300+0000 7f9d274da640 1 --2- 172.21.15.78:0/4056871596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d20107900 0x7f9d20107ce0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9d10009880 tx=0x7f9d1002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.300+0000 7f9d274da640 1 -- 172.21.15.78:0/4056871596 shutdown_connections 2024-09-18T13:05:42.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.300+0000 7f9d274da640 1 --2- 172.21.15.78:0/4056871596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d20101900 0x7f9d20101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.300+0000 7f9d274da640 1 --2- 172.21.15.78:0/4056871596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d20107900 0x7f9d20107ce0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.300+0000 7f9d274da640 1 -- 172.21.15.78:0/4056871596 >> 172.21.15.78:0/4056871596 conn(0x7f9d200fd600 msgr2=0x7f9d200ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:42.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.300+0000 7f9d274da640 1 -- 172.21.15.78:0/4056871596 shutdown_connections 2024-09-18T13:05:42.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.300+0000 7f9d274da640 1 -- 172.21.15.78:0/4056871596 wait complete. 2024-09-18T13:05:42.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.301+0000 7f9d274da640 1 Processor -- start 2024-09-18T13:05:42.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.301+0000 7f9d274da640 1 -- start start 2024-09-18T13:05:42.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.301+0000 7f9d274da640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d20101900 0x7f9d200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:42.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.301+0000 7f9d274da640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d20107900 0x7f9d20074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:42.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.301+0000 7f9d274da640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2010edd0 con 0x7f9d20101900 2024-09-18T13:05:42.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.301+0000 7f9d274da640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2010ec50 con 0x7f9d20107900 2024-09-18T13:05:42.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.301+0000 7f9d25276640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d20101900 0x7f9d200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:42.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.301+0000 7f9d25276640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d20101900 0x7f9d200744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54488/0 (socket says 172.21.15.78:54488) 2024-09-18T13:05:42.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.301+0000 7f9d25276640 1 -- 172.21.15.78:0/2432331694 learned_addr learned my addr 172.21.15.78:0/2432331694 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:05:42.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.302+0000 7f9d25276640 1 -- 172.21.15.78:0/2432331694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d20107900 msgr2=0x7f9d20074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:42.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.302+0000 7f9d25276640 1 --2- 172.21.15.78:0/2432331694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d20107900 0x7f9d20074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.302+0000 7f9d25276640 1 -- 172.21.15.78:0/2432331694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d20074f70 con 0x7f9d20101900 2024-09-18T13:05:42.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.302+0000 7f9d25276640 1 --2- 172.21.15.78:0/2432331694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d20101900 0x7f9d200744f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9d10031460 tx=0x7f9d100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:42.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.302+0000 7f9d167fc640 1 -- 172.21.15.78:0/2432331694 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d1003f070 con 0x7f9d20101900 2024-09-18T13:05:42.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.302+0000 7f9d274da640 1 -- 172.21.15.78:0/2432331694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d20075200 con 0x7f9d20101900 2024-09-18T13:05:42.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.302+0000 7f9d167fc640 1 -- 172.21.15.78:0/2432331694 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d10004cf0 con 0x7f9d20101900 2024-09-18T13:05:42.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.302+0000 7f9d167fc640 1 -- 172.21.15.78:0/2432331694 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d10035030 con 0x7f9d20101900 2024-09-18T13:05:42.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.302+0000 7f9d274da640 1 -- 172.21.15.78:0/2432331694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d201a3d60 con 0x7f9d20101900 2024-09-18T13:05:42.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.303+0000 7f9d274da640 1 -- 172.21.15.78:0/2432331694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d20103040 con 0x7f9d20101900 2024-09-18T13:05:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.304+0000 7f9d167fc640 1 -- 172.21.15.78:0/2432331694 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9d10042070 con 0x7f9d20101900 2024-09-18T13:05:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.304+0000 7f9d167fc640 1 --2- 172.21.15.78:0/2432331694 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9d0c07af30 0x7f9d0c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.304+0000 7f9d167fc640 1 -- 172.21.15.78:0/2432331694 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f9d100bebc0 con 0x7f9d20101900 2024-09-18T13:05:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.304+0000 7f9d24a75640 1 --2- 172.21.15.78:0/2432331694 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9d0c07af30 0x7f9d0c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.305+0000 7f9d24a75640 1 --2- 172.21.15.78:0/2432331694 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9d0c07af30 0x7f9d0c07d3f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9d20075f80 tx=0x7f9d1c005bf0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:42.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.309+0000 7f9d167fc640 1 -- 172.21.15.78:0/2432331694 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9d1008a0c0 con 0x7f9d20101900 2024-09-18T13:05:42.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:42 smithi078 ceph-mon[108578]: pgmap v496: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:42.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:42 smithi078 ceph-mon[108578]: from='client.34750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:42.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:42 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2040854459' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:05:42.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.520+0000 7f9d274da640 1 -- 172.21.15.78:0/2432331694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9d20109e70 con 0x7f9d20101900 2024-09-18T13:05:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.520+0000 7f9d167fc640 1 -- 172.21.15.78:0/2432331694 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f9d1008ef70 con 0x7f9d20101900 2024-09-18T13:05:42.522 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:05:42.522 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:05:42.522 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:05:42.522 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:05:42.522 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:05:42.523 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:05:42.523 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:05:42.523 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:05:42.523 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:05:42.523 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:05:42.523 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:05:42.523 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:05:42.523 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:05:42.523 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:05:42.523 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:05:42.523 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:05:42.524 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:05:42.524 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:05:42.524 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:05:42.524 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:05:42.524 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:05:42.524 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:05:42.524 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:05:42.524 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:05:42.524 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:05:42.524 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:05:42.524 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:05:42.524 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:05:42.524 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:05:42.524 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:05:42.525 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:05:42.525 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:05:42.525 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:05:42.525 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:05:42.525 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:05:42.525 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:05:42.525 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:05:42.525 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:05:42.525 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:05:42.525 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:05:42.525 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:05:42.525 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:05:42.525 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:05:42.526 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:05:42.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.522+0000 7f9d274da640 1 -- 172.21.15.78:0/2432331694 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9d0c07af30 msgr2=0x7f9d0c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:42.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.522+0000 7f9d274da640 1 --2- 172.21.15.78:0/2432331694 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9d0c07af30 0x7f9d0c07d3f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9d20075f80 tx=0x7f9d1c005bf0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.522+0000 7f9d274da640 1 -- 172.21.15.78:0/2432331694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d20101900 msgr2=0x7f9d200744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:42.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.522+0000 7f9d274da640 1 --2- 172.21.15.78:0/2432331694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d20101900 0x7f9d200744f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9d10031460 tx=0x7f9d100048f0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.522+0000 7f9d274da640 1 -- 172.21.15.78:0/2432331694 shutdown_connections 2024-09-18T13:05:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.522+0000 7f9d274da640 1 --2- 172.21.15.78:0/2432331694 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9d0c07af30 0x7f9d0c07d3f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.522+0000 7f9d274da640 1 --2- 172.21.15.78:0/2432331694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d20107900 0x7f9d20074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.522+0000 7f9d274da640 1 --2- 172.21.15.78:0/2432331694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d20101900 0x7f9d200744f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.522+0000 7f9d274da640 1 -- 172.21.15.78:0/2432331694 >> 172.21.15.78:0/2432331694 conn(0x7f9d200fd600 msgr2=0x7f9d200fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.522+0000 7f9d274da640 1 -- 172.21.15.78:0/2432331694 shutdown_connections 2024-09-18T13:05:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.522+0000 7f9d274da640 1 -- 172.21.15.78:0/2432331694 wait complete. 2024-09-18T13:05:42.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.604+0000 7f81cd488640 1 -- 172.21.15.78:0/3898405156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81007f0 msgr2=0x7f81c8100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:42.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.604+0000 7f81cd488640 1 --2- 172.21.15.78:0/3898405156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81007f0 0x7f81c8100c50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f81bc009880 tx=0x7f81bc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.605+0000 7f81cd488640 1 -- 172.21.15.78:0/3898405156 shutdown_connections 2024-09-18T13:05:42.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.605+0000 7f81cd488640 1 --2- 172.21.15.78:0/3898405156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81007f0 0x7f81c8100c50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.605+0000 7f81cd488640 1 --2- 172.21.15.78:0/3898405156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81c81067f0 0x7f81c8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.605+0000 7f81cd488640 1 -- 172.21.15.78:0/3898405156 >> 172.21.15.78:0/3898405156 conn(0x7f81c80fc550 msgr2=0x7f81c80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:42.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.605+0000 7f81cd488640 1 -- 172.21.15.78:0/3898405156 shutdown_connections 2024-09-18T13:05:42.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.605+0000 7f81cd488640 1 -- 172.21.15.78:0/3898405156 wait complete. 2024-09-18T13:05:42.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.605+0000 7f81cd488640 1 Processor -- start 2024-09-18T13:05:42.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.605+0000 7f81cd488640 1 -- start start 2024-09-18T13:05:42.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.606+0000 7f81cd488640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81c81007f0 0x7f81c819c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:42.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.606+0000 7f81cd488640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81067f0 0x7f81c819cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:42.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.606+0000 7f81cd488640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f81c810dcc0 con 0x7f81c81067f0 2024-09-18T13:05:42.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.606+0000 7f81cd488640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f81c810db40 con 0x7f81c81007f0 2024-09-18T13:05:42.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.606+0000 7f81c67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81067f0 0x7f81c819cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:42.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.606+0000 7f81c67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81067f0 0x7f81c819cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54506/0 (socket says 172.21.15.78:54506) 2024-09-18T13:05:42.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.606+0000 7f81c67fc640 1 -- 172.21.15.78:0/1410728221 learned_addr learned my addr 172.21.15.78:0/1410728221 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:05:42.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.606+0000 7f81c6ffd640 1 --2- 172.21.15.78:0/1410728221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81c81007f0 0x7f81c819c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:42.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.606+0000 7f81c67fc640 1 -- 172.21.15.78:0/1410728221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81c81007f0 msgr2=0x7f81c819c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:42.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.606+0000 7f81c67fc640 1 --2- 172.21.15.78:0/1410728221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81c81007f0 0x7f81c819c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.606+0000 7f81c67fc640 1 -- 172.21.15.78:0/1410728221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c81966b0 con 0x7f81c81067f0 2024-09-18T13:05:42.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.606+0000 7f81c67fc640 1 --2- 172.21.15.78:0/1410728221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81067f0 0x7f81c819cb20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f81bc031460 tx=0x7f81bc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:42.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.606+0000 7f81affff640 1 -- 172.21.15.78:0/1410728221 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f81bc035070 con 0x7f81c81067f0 2024-09-18T13:05:42.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.606+0000 7f81affff640 1 -- 172.21.15.78:0/1410728221 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f81bc0035f0 con 0x7f81c81067f0 2024-09-18T13:05:42.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.606+0000 7f81cd488640 1 -- 172.21.15.78:0/1410728221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c8196940 con 0x7f81c81067f0 2024-09-18T13:05:42.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.607+0000 7f81affff640 1 -- 172.21.15.78:0/1410728221 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f81bc031890 con 0x7f81c81067f0 2024-09-18T13:05:42.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.607+0000 7f81cd488640 1 -- 172.21.15.78:0/1410728221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c8196e40 con 0x7f81c81067f0 2024-09-18T13:05:42.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.608+0000 7f81cd488640 1 -- 172.21.15.78:0/1410728221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c8101f30 con 0x7f81c81067f0 2024-09-18T13:05:42.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.608+0000 7f81affff640 1 -- 172.21.15.78:0/1410728221 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f81bc0049d0 con 0x7f81c81067f0 2024-09-18T13:05:42.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.609+0000 7f81affff640 1 --2- 172.21.15.78:0/1410728221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f81b007af80 0x7f81b007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:42.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.609+0000 7f81c6ffd640 1 --2- 172.21.15.78:0/1410728221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f81b007af80 0x7f81b007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:42.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.609+0000 7f81affff640 1 -- 172.21.15.78:0/1410728221 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f81bc03e070 con 0x7f81c81067f0 2024-09-18T13:05:42.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.609+0000 7f81c6ffd640 1 --2- 172.21.15.78:0/1410728221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f81b007af80 0x7f81b007d440 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f81b8005fd0 tx=0x7f81b800b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:42.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.613+0000 7f81affff640 1 -- 172.21.15.78:0/1410728221 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f81bc08b9b0 con 0x7f81c81067f0 2024-09-18T13:05:42.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:42 smithi148 ceph-mon[80030]: pgmap v496: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:42 smithi148 ceph-mon[80030]: from='client.34750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:42 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2040854459' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:05:42.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.809+0000 7f81cd488640 1 -- 172.21.15.78:0/1410728221 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f81c81970f0 con 0x7f81b007af80 2024-09-18T13:05:42.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.810+0000 7f81affff640 1 -- 172.21.15.78:0/1410728221 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f81c81970f0 con 0x7f81b007af80 2024-09-18T13:05:42.811 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:05:42.811 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:05:42.811 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:05:42.811 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:05:42.811 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:05:42.811 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:05:42.812 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:05:42.812 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:05:42.812 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:05:42.812 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:05:42.812 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:05:42.812 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:05:42.812 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:05:42.812 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:05:42.812 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:05:42.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.814+0000 7f81cd488640 1 -- 172.21.15.78:0/1410728221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f81b007af80 msgr2=0x7f81b007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:42.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.814+0000 7f81cd488640 1 --2- 172.21.15.78:0/1410728221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f81b007af80 0x7f81b007d440 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f81b8005fd0 tx=0x7f81b800b390 comp rx=0 tx=0).stop 2024-09-18T13:05:42.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.814+0000 7f81cd488640 1 -- 172.21.15.78:0/1410728221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81067f0 msgr2=0x7f81c819cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:42.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.814+0000 7f81cd488640 1 --2- 172.21.15.78:0/1410728221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81067f0 0x7f81c819cb20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f81bc031460 tx=0x7f81bc0045e0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.814+0000 7f81cd488640 1 -- 172.21.15.78:0/1410728221 shutdown_connections 2024-09-18T13:05:42.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.814+0000 7f81cd488640 1 --2- 172.21.15.78:0/1410728221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f81b007af80 0x7f81b007d440 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.814+0000 7f81cd488640 1 --2- 172.21.15.78:0/1410728221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81067f0 0x7f81c819cb20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.814+0000 7f81cd488640 1 --2- 172.21.15.78:0/1410728221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81c81007f0 0x7f81c819c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.814+0000 7f81cd488640 1 -- 172.21.15.78:0/1410728221 >> 172.21.15.78:0/1410728221 conn(0x7f81c80fc550 msgr2=0x7f81c80fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:42.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.814+0000 7f81cd488640 1 -- 172.21.15.78:0/1410728221 shutdown_connections 2024-09-18T13:05:42.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.814+0000 7f81cd488640 1 -- 172.21.15.78:0/1410728221 wait complete. 2024-09-18T13:05:42.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.896+0000 7f6cd83c8640 1 -- 172.21.15.78:0/859641098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd0106820 msgr2=0x7f6cd0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:42.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.896+0000 7f6cd83c8640 1 --2- 172.21.15.78:0/859641098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd0106820 0x7f6cd0106c00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009880 tx=0x7f6ccc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.896+0000 7f6cd83c8640 1 -- 172.21.15.78:0/859641098 shutdown_connections 2024-09-18T13:05:42.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.896+0000 7f6cd83c8640 1 --2- 172.21.15.78:0/859641098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cd0100820 0x7f6cd0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.896+0000 7f6cd83c8640 1 --2- 172.21.15.78:0/859641098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd0106820 0x7f6cd0106c00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.896+0000 7f6cd83c8640 1 -- 172.21.15.78:0/859641098 >> 172.21.15.78:0/859641098 conn(0x7f6cd00fc540 msgr2=0x7f6cd00fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:42.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.896+0000 7f6cd83c8640 1 -- 172.21.15.78:0/859641098 shutdown_connections 2024-09-18T13:05:42.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.896+0000 7f6cd83c8640 1 -- 172.21.15.78:0/859641098 wait complete. 2024-09-18T13:05:42.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.897+0000 7f6cd83c8640 1 Processor -- start 2024-09-18T13:05:42.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.897+0000 7f6cd83c8640 1 -- start start 2024-09-18T13:05:42.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.897+0000 7f6cd83c8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cd0100820 0x7f6cd019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:42.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.897+0000 7f6cd83c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd0106820 0x7f6cd019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:42.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.897+0000 7f6cd83c8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd010dcd0 con 0x7f6cd0106820 2024-09-18T13:05:42.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.897+0000 7f6cd83c8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd010db50 con 0x7f6cd0100820 2024-09-18T13:05:42.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.897+0000 7f6cd5963640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd0106820 0x7f6cd019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:42.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.897+0000 7f6cd5963640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd0106820 0x7f6cd019cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54536/0 (socket says 172.21.15.78:54536) 2024-09-18T13:05:42.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.897+0000 7f6cd5963640 1 -- 172.21.15.78:0/3300993500 learned_addr learned my addr 172.21.15.78:0/3300993500 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:05:42.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.897+0000 7f6cd6164640 1 --2- 172.21.15.78:0/3300993500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cd0100820 0x7f6cd019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:42.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.897+0000 7f6cd5963640 1 -- 172.21.15.78:0/3300993500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cd0100820 msgr2=0x7f6cd019c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:42.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.897+0000 7f6cd5963640 1 --2- 172.21.15.78:0/3300993500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cd0100820 0x7f6cd019c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:42.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.897+0000 7f6cd5963640 1 -- 172.21.15.78:0/3300993500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd0196760 con 0x7f6cd0106820 2024-09-18T13:05:42.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.898+0000 7f6cd5963640 1 --2- 172.21.15.78:0/3300993500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd0106820 0x7f6cd019cbd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000c8a0 tx=0x7f6cc000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:42.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.898+0000 7f6cc77fe640 1 -- 172.21.15.78:0/3300993500 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6cc00079b0 con 0x7f6cd0106820 2024-09-18T13:05:42.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.898+0000 7f6cc77fe640 1 -- 172.21.15.78:0/3300993500 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6cc0007b50 con 0x7f6cd0106820 2024-09-18T13:05:42.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.898+0000 7f6cd83c8640 1 -- 172.21.15.78:0/3300993500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd0196a50 con 0x7f6cd0106820 2024-09-18T13:05:42.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.898+0000 7f6cc77fe640 1 -- 172.21.15.78:0/3300993500 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6cc0018700 con 0x7f6cd0106820 2024-09-18T13:05:42.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.898+0000 7f6cd83c8640 1 -- 172.21.15.78:0/3300993500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd0196fe0 con 0x7f6cd0106820 2024-09-18T13:05:42.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.899+0000 7f6cd83c8640 1 -- 172.21.15.78:0/3300993500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd0101f60 con 0x7f6cd0106820 2024-09-18T13:05:42.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.899+0000 7f6cc77fe640 1 -- 172.21.15.78:0/3300993500 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6cc0007d00 con 0x7f6cd0106820 2024-09-18T13:05:42.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.900+0000 7f6cc77fe640 1 --2- 172.21.15.78:0/3300993500 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6cbc07af80 0x7f6cbc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:05:42.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.900+0000 7f6cc77fe640 1 -- 172.21.15.78:0/3300993500 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f6cc009e350 con 0x7f6cd0106820 2024-09-18T13:05:42.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.900+0000 7f6cd6164640 1 --2- 172.21.15.78:0/3300993500 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6cbc07af80 0x7f6cbc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:05:42.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.900+0000 7f6cd6164640 1 --2- 172.21.15.78:0/3300993500 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6cbc07af80 0x7f6cbc07d440 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc031460 tx=0x7f6ccc009560 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:05:42.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:42.904+0000 7f6cc77fe640 1 -- 172.21.15.78:0/3300993500 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6cc0014030 con 0x7f6cd0106820 2024-09-18T13:05:43.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:43.145+0000 7f6cd83c8640 1 -- 172.21.15.78:0/3300993500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6cd0197cc0 con 0x7f6cd0106820 2024-09-18T13:05:43.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:43.146+0000 7f6cc77fe640 1 -- 172.21.15.78:0/3300993500 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f6cd0197cc0 con 0x7f6cd0106820 2024-09-18T13:05:43.147 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:05:43.147 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:05:43.147 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:05:43.147 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:05:43.147 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:05:43.147 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:05:43.147 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:05:43.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:43.148+0000 7f6cd83c8640 1 -- 172.21.15.78:0/3300993500 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6cbc07af80 msgr2=0x7f6cbc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:43.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:43.148+0000 7f6cd83c8640 1 --2- 172.21.15.78:0/3300993500 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6cbc07af80 0x7f6cbc07d440 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc031460 tx=0x7f6ccc009560 comp rx=0 tx=0).stop 2024-09-18T13:05:43.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:43.148+0000 7f6cd83c8640 1 -- 172.21.15.78:0/3300993500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd0106820 msgr2=0x7f6cd019cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:05:43.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:43.148+0000 7f6cd83c8640 1 --2- 172.21.15.78:0/3300993500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd0106820 0x7f6cd019cbd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000c8a0 tx=0x7f6cc000cd60 comp rx=0 tx=0).stop 2024-09-18T13:05:43.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:43.148+0000 7f6cd83c8640 1 -- 172.21.15.78:0/3300993500 shutdown_connections 2024-09-18T13:05:43.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:43.148+0000 7f6cd83c8640 1 --2- 172.21.15.78:0/3300993500 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6cbc07af80 0x7f6cbc07d440 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:43.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:43.148+0000 7f6cd83c8640 1 --2- 172.21.15.78:0/3300993500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd0106820 0x7f6cd019cbd0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:43.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:43.148+0000 7f6cd83c8640 1 --2- 172.21.15.78:0/3300993500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cd0100820 0x7f6cd019c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:05:43.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:43.148+0000 7f6cd83c8640 1 -- 172.21.15.78:0/3300993500 >> 172.21.15.78:0/3300993500 conn(0x7f6cd00fc540 msgr2=0x7f6cd00fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:05:43.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:43.148+0000 7f6cd83c8640 1 -- 172.21.15.78:0/3300993500 shutdown_connections 2024-09-18T13:05:43.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:05:43.148+0000 7f6cd83c8640 1 -- 172.21.15.78:0/3300993500 wait complete. 2024-09-18T13:05:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:43 smithi148 ceph-mon[80030]: from='client.34754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:43 smithi148 ceph-mon[80030]: from='client.34758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:43 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2432331694' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:05:43.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:43 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3300993500' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:05:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:43 smithi078 ceph-mon[108578]: from='client.34754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:43 smithi078 ceph-mon[108578]: from='client.34758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:43 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2432331694' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:05:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:43 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3300993500' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:05:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:44 smithi148 ceph-mon[80030]: from='client.34770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:44 smithi148 ceph-mon[80030]: pgmap v497: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:44 smithi078 ceph-mon[108578]: from='client.34770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:05:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:44 smithi078 ceph-mon[108578]: pgmap v497: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:46 smithi148 ceph-mon[80030]: pgmap v498: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:46 smithi078 ceph-mon[108578]: pgmap v498: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:48.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:48 smithi078 ceph-mon[108578]: pgmap v499: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:48 smithi148 ceph-mon[80030]: pgmap v499: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:50 smithi148 ceph-mon[80030]: pgmap v500: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:50 smithi078 ceph-mon[108578]: pgmap v500: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:52.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:52 smithi078 ceph-mon[108578]: pgmap v501: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:52 smithi148 ceph-mon[80030]: pgmap v501: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:54.709 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:54 smithi078 ceph-mon[108578]: pgmap v502: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:54.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:54 smithi148 ceph-mon[80030]: pgmap v502: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:56 smithi148 ceph-mon[80030]: pgmap v503: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:56 smithi078 ceph-mon[108578]: pgmap v503: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:57.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:05:57 smithi078 ceph-mon[108578]: pgmap v504: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:05:57.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:05:57 smithi148 ceph-mon[80030]: pgmap v504: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:00.676 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:00 smithi148 ceph-mon[80030]: pgmap v505: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:00.707 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:00 smithi078 ceph-mon[108578]: pgmap v505: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:02.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:02 smithi148 ceph-mon[80030]: pgmap v506: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:02 smithi078 ceph-mon[108578]: pgmap v506: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:04.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:04 smithi148 ceph-mon[80030]: pgmap v507: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:04.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:04 smithi078 ceph-mon[108578]: pgmap v507: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:06.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:06 smithi078 ceph-mon[108578]: pgmap v508: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:06.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:06 smithi148 ceph-mon[80030]: pgmap v508: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:08.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:08 smithi148 ceph-mon[80030]: pgmap v509: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:08.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:08 smithi078 ceph-mon[108578]: pgmap v509: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:10 smithi148 ceph-mon[80030]: pgmap v510: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:10.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:10 smithi078 ceph-mon[108578]: pgmap v510: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:12.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:12 smithi078 ceph-mon[108578]: pgmap v511: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:12.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:12 smithi148 ceph-mon[80030]: pgmap v511: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:13.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.245+0000 7fc2dc951640 1 -- 172.21.15.78:0/576333724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d8101900 msgr2=0x7fc2d8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:13.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.245+0000 7fc2dc951640 1 --2- 172.21.15.78:0/576333724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d8101900 0x7fc2d8101d60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0009880 tx=0x7fc2c002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.245+0000 7fc2dc951640 1 -- 172.21.15.78:0/576333724 shutdown_connections 2024-09-18T13:06:13.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.245+0000 7fc2dc951640 1 --2- 172.21.15.78:0/576333724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d8101900 0x7fc2d8101d60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.245+0000 7fc2dc951640 1 --2- 172.21.15.78:0/576333724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d8107900 0x7fc2d8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.245+0000 7fc2dc951640 1 -- 172.21.15.78:0/576333724 >> 172.21.15.78:0/576333724 conn(0x7fc2d80fd600 msgr2=0x7fc2d80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:13.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.245+0000 7fc2dc951640 1 -- 172.21.15.78:0/576333724 shutdown_connections 2024-09-18T13:06:13.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.245+0000 7fc2dc951640 1 -- 172.21.15.78:0/576333724 wait complete. 2024-09-18T13:06:13.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.246+0000 7fc2dc951640 1 Processor -- start 2024-09-18T13:06:13.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.246+0000 7fc2dc951640 1 -- start start 2024-09-18T13:06:13.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.246+0000 7fc2dc951640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d8101900 0x7fc2d80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:13.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.246+0000 7fc2dc951640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d8107900 0x7fc2d8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:13.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.246+0000 7fc2dc951640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d810edb0 con 0x7fc2d8101900 2024-09-18T13:06:13.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.246+0000 7fc2dc951640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d810ec30 con 0x7fc2d8107900 2024-09-18T13:06:13.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.247+0000 7fc2d659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d8101900 0x7fc2d80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:13.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.247+0000 7fc2d659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d8101900 0x7fc2d80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55066/0 (socket says 172.21.15.78:55066) 2024-09-18T13:06:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.247+0000 7fc2d659c640 1 -- 172.21.15.78:0/1366677594 learned_addr learned my addr 172.21.15.78:0/1366677594 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:06:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.247+0000 7fc2d5d9b640 1 --2- 172.21.15.78:0/1366677594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d8107900 0x7fc2d8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.247+0000 7fc2d659c640 1 -- 172.21.15.78:0/1366677594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d8107900 msgr2=0x7fc2d8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.247+0000 7fc2d659c640 1 --2- 172.21.15.78:0/1366677594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d8107900 0x7fc2d8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.247+0000 7fc2d659c640 1 -- 172.21.15.78:0/1366677594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d8074f70 con 0x7fc2d8101900 2024-09-18T13:06:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.247+0000 7fc2d659c640 1 --2- 172.21.15.78:0/1366677594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d8101900 0x7fc2d80744f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800d8d0 tx=0x7fc2c800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.247+0000 7fc2cf7fe640 1 -- 172.21.15.78:0/1366677594 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc2c8017030 con 0x7fc2d8101900 2024-09-18T13:06:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.247+0000 7fc2cf7fe640 1 -- 172.21.15.78:0/1366677594 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc2c8004020 con 0x7fc2d8101900 2024-09-18T13:06:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.247+0000 7fc2dc951640 1 -- 172.21.15.78:0/1366677594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d8075260 con 0x7fc2d8101900 2024-09-18T13:06:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.247+0000 7fc2cf7fe640 1 -- 172.21.15.78:0/1366677594 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc2c80047a0 con 0x7fc2d8101900 2024-09-18T13:06:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.247+0000 7fc2dc951640 1 -- 172.21.15.78:0/1366677594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d81a3e50 con 0x7fc2d8101900 2024-09-18T13:06:13.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.249+0000 7fc2dc951640 1 -- 172.21.15.78:0/1366677594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d8103040 con 0x7fc2d8101900 2024-09-18T13:06:13.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.249+0000 7fc2cf7fe640 1 -- 172.21.15.78:0/1366677594 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc2c80041d0 con 0x7fc2d8101900 2024-09-18T13:06:13.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.250+0000 7fc2cf7fe640 1 --2- 172.21.15.78:0/1366677594 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc2c407af90 0x7fc2c407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:13.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.250+0000 7fc2cf7fe640 1 -- 172.21.15.78:0/1366677594 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fc2c8018070 con 0x7fc2d8101900 2024-09-18T13:06:13.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.250+0000 7fc2d5d9b640 1 --2- 172.21.15.78:0/1366677594 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc2c407af90 0x7fc2c407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:13.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.251+0000 7fc2d5d9b640 1 --2- 172.21.15.78:0/1366677594 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc2c407af90 0x7fc2c407d450 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8075f80 tx=0x7fc2c0031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:13.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.255+0000 7fc2cf7fe640 1 -- 172.21.15.78:0/1366677594 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc2c80692f0 con 0x7fc2d8101900 2024-09-18T13:06:13.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.449+0000 7fc2dc951640 1 -- 172.21.15.78:0/1366677594 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc2d8062630 con 0x7fc2c407af90 2024-09-18T13:06:13.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.450+0000 7fc2cf7fe640 1 -- 172.21.15.78:0/1366677594 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc2d8062630 con 0x7fc2c407af90 2024-09-18T13:06:13.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.452+0000 7fc2dc951640 1 -- 172.21.15.78:0/1366677594 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc2c407af90 msgr2=0x7fc2c407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:13.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.452+0000 7fc2dc951640 1 --2- 172.21.15.78:0/1366677594 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc2c407af90 0x7fc2c407d450 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8075f80 tx=0x7fc2c0031400 comp rx=0 tx=0).stop 2024-09-18T13:06:13.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.452+0000 7fc2dc951640 1 -- 172.21.15.78:0/1366677594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d8101900 msgr2=0x7fc2d80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:13.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.452+0000 7fc2dc951640 1 --2- 172.21.15.78:0/1366677594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d8101900 0x7fc2d80744f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800d8d0 tx=0x7fc2c800dd90 comp rx=0 tx=0).stop 2024-09-18T13:06:13.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.452+0000 7fc2dc951640 1 -- 172.21.15.78:0/1366677594 shutdown_connections 2024-09-18T13:06:13.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.452+0000 7fc2dc951640 1 --2- 172.21.15.78:0/1366677594 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc2c407af90 0x7fc2c407d450 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.452+0000 7fc2dc951640 1 --2- 172.21.15.78:0/1366677594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2d8107900 0x7fc2d8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.452+0000 7fc2dc951640 1 --2- 172.21.15.78:0/1366677594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2d8101900 0x7fc2d80744f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.452+0000 7fc2dc951640 1 -- 172.21.15.78:0/1366677594 >> 172.21.15.78:0/1366677594 conn(0x7fc2d80fd600 msgr2=0x7fc2d80fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:13.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.453+0000 7fc2dc951640 1 -- 172.21.15.78:0/1366677594 shutdown_connections 2024-09-18T13:06:13.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.453+0000 7fc2dc951640 1 -- 172.21.15.78:0/1366677594 wait complete. 2024-09-18T13:06:13.462 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:06:13.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.535+0000 7f3e8e5e1640 1 -- 172.21.15.78:0/1570863492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e88102b20 msgr2=0x7f3e88102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:13.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.535+0000 7f3e8e5e1640 1 --2- 172.21.15.78:0/1570863492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e88102b20 0x7f3e88102f00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3e780098b0 tx=0x7f3e7802a560 comp rx=0 tx=0).stop 2024-09-18T13:06:13.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.535+0000 7f3e8e5e1640 1 -- 172.21.15.78:0/1570863492 shutdown_connections 2024-09-18T13:06:13.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.535+0000 7f3e8e5e1640 1 --2- 172.21.15.78:0/1570863492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e88103440 0x7f3e8810b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.535+0000 7f3e8e5e1640 1 --2- 172.21.15.78:0/1570863492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e88102b20 0x7f3e88102f00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.535+0000 7f3e8e5e1640 1 -- 172.21.15.78:0/1570863492 >> 172.21.15.78:0/1570863492 conn(0x7f3e880fc520 msgr2=0x7f3e880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:13.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.535+0000 7f3e8e5e1640 1 -- 172.21.15.78:0/1570863492 shutdown_connections 2024-09-18T13:06:13.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.535+0000 7f3e8e5e1640 1 -- 172.21.15.78:0/1570863492 wait complete. 2024-09-18T13:06:13.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.535+0000 7f3e8e5e1640 1 Processor -- start 2024-09-18T13:06:13.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.536+0000 7f3e8e5e1640 1 -- start start 2024-09-18T13:06:13.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.536+0000 7f3e8e5e1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e88102b20 0x7f3e88100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:13.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.536+0000 7f3e8e5e1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e88103440 0x7f3e88100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:13.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.536+0000 7f3e8e5e1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8810edd0 con 0x7f3e88102b20 2024-09-18T13:06:13.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.536+0000 7f3e8e5e1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8810ec50 con 0x7f3e88103440 2024-09-18T13:06:13.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.536+0000 7f3e87fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e88102b20 0x7f3e88100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:13.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.536+0000 7f3e87fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e88102b20 0x7f3e88100780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55094/0 (socket says 172.21.15.78:55094) 2024-09-18T13:06:13.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.536+0000 7f3e87fff640 1 -- 172.21.15.78:0/947087067 learned_addr learned my addr 172.21.15.78:0/947087067 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:06:13.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.536+0000 7f3e877fe640 1 --2- 172.21.15.78:0/947087067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e88103440 0x7f3e88100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:13.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.536+0000 7f3e87fff640 1 -- 172.21.15.78:0/947087067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e88103440 msgr2=0x7f3e88100cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:13.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.536+0000 7f3e87fff640 1 --2- 172.21.15.78:0/947087067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e88103440 0x7f3e88100cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.536+0000 7f3e87fff640 1 -- 172.21.15.78:0/947087067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e88101200 con 0x7f3e88102b20 2024-09-18T13:06:13.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.537+0000 7f3e87fff640 1 --2- 172.21.15.78:0/947087067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e88102b20 0x7f3e88100780 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3e78031460 tx=0x7f3e780045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:13.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.537+0000 7f3e857fa640 1 -- 172.21.15.78:0/947087067 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e7803f070 con 0x7f3e88102b20 2024-09-18T13:06:13.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.537+0000 7f3e8e5e1640 1 -- 172.21.15.78:0/947087067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e88101490 con 0x7f3e88102b20 2024-09-18T13:06:13.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.537+0000 7f3e857fa640 1 -- 172.21.15.78:0/947087067 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e780035f0 con 0x7f3e88102b20 2024-09-18T13:06:13.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.537+0000 7f3e857fa640 1 -- 172.21.15.78:0/947087067 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e78035030 con 0x7f3e88102b20 2024-09-18T13:06:13.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.537+0000 7f3e8e5e1640 1 -- 172.21.15.78:0/947087067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e881a3dc0 con 0x7f3e88102b20 2024-09-18T13:06:13.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.538+0000 7f3e8e5e1640 1 -- 172.21.15.78:0/947087067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e8806aa30 con 0x7f3e88102b20 2024-09-18T13:06:13.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.539+0000 7f3e857fa640 1 -- 172.21.15.78:0/947087067 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3e78042070 con 0x7f3e88102b20 2024-09-18T13:06:13.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.539+0000 7f3e857fa640 1 --2- 172.21.15.78:0/947087067 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3e7407af30 0x7f3e7407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:13.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.539+0000 7f3e857fa640 1 -- 172.21.15.78:0/947087067 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f3e780bea10 con 0x7f3e88102b20 2024-09-18T13:06:13.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.539+0000 7f3e877fe640 1 --2- 172.21.15.78:0/947087067 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3e7407af30 0x7f3e7407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:13.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.540+0000 7f3e877fe640 1 --2- 172.21.15.78:0/947087067 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3e7407af30 0x7f3e7407d3f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3e70005fd0 tx=0x7f3e70005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:13.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.544+0000 7f3e857fa640 1 -- 172.21.15.78:0/947087067 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3e78089fb0 con 0x7f3e88102b20 2024-09-18T13:06:13.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.735+0000 7f3e8e5e1640 1 -- 172.21.15.78:0/947087067 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3e88062630 con 0x7f3e7407af30 2024-09-18T13:06:13.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.736+0000 7f3e857fa640 1 -- 172.21.15.78:0/947087067 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3e88062630 con 0x7f3e7407af30 2024-09-18T13:06:13.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.738+0000 7f3e8e5e1640 1 -- 172.21.15.78:0/947087067 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3e7407af30 msgr2=0x7f3e7407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:13.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.738+0000 7f3e8e5e1640 1 --2- 172.21.15.78:0/947087067 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3e7407af30 0x7f3e7407d3f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3e70005fd0 tx=0x7f3e70005850 comp rx=0 tx=0).stop 2024-09-18T13:06:13.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.738+0000 7f3e8e5e1640 1 -- 172.21.15.78:0/947087067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e88102b20 msgr2=0x7f3e88100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:13.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.738+0000 7f3e8e5e1640 1 --2- 172.21.15.78:0/947087067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e88102b20 0x7f3e88100780 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3e78031460 tx=0x7f3e780045c0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.738+0000 7f3e8e5e1640 1 -- 172.21.15.78:0/947087067 shutdown_connections 2024-09-18T13:06:13.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.738+0000 7f3e8e5e1640 1 --2- 172.21.15.78:0/947087067 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3e7407af30 0x7f3e7407d3f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.738+0000 7f3e8e5e1640 1 --2- 172.21.15.78:0/947087067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e88103440 0x7f3e88100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.738+0000 7f3e8e5e1640 1 --2- 172.21.15.78:0/947087067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e88102b20 0x7f3e88100780 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.738+0000 7f3e8e5e1640 1 -- 172.21.15.78:0/947087067 >> 172.21.15.78:0/947087067 conn(0x7f3e880fc520 msgr2=0x7f3e88103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:13.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.738+0000 7f3e8e5e1640 1 -- 172.21.15.78:0/947087067 shutdown_connections 2024-09-18T13:06:13.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.738+0000 7f3e8e5e1640 1 -- 172.21.15.78:0/947087067 wait complete. 2024-09-18T13:06:13.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.820+0000 7f4f32a65640 1 -- 172.21.15.78:0/3914763107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2c107900 msgr2=0x7f4f2c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:13.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.820+0000 7f4f32a65640 1 --2- 172.21.15.78:0/3914763107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2c107900 0x7f4f2c107ce0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009880 tx=0x7f4f2002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.820+0000 7f4f32a65640 1 -- 172.21.15.78:0/3914763107 shutdown_connections 2024-09-18T13:06:13.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.820+0000 7f4f32a65640 1 --2- 172.21.15.78:0/3914763107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f2c101900 0x7f4f2c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.820+0000 7f4f32a65640 1 --2- 172.21.15.78:0/3914763107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2c107900 0x7f4f2c107ce0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.820+0000 7f4f32a65640 1 -- 172.21.15.78:0/3914763107 >> 172.21.15.78:0/3914763107 conn(0x7f4f2c0fd600 msgr2=0x7f4f2c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:13.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.820+0000 7f4f32a65640 1 -- 172.21.15.78:0/3914763107 shutdown_connections 2024-09-18T13:06:13.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.820+0000 7f4f32a65640 1 -- 172.21.15.78:0/3914763107 wait complete. 2024-09-18T13:06:13.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.821+0000 7f4f32a65640 1 Processor -- start 2024-09-18T13:06:13.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.821+0000 7f4f32a65640 1 -- start start 2024-09-18T13:06:13.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.821+0000 7f4f32a65640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f2c101900 0x7f4f2c19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:13.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.821+0000 7f4f32a65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2c107900 0x7f4f2c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:13.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.821+0000 7f4f32a65640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c10edd0 con 0x7f4f2c107900 2024-09-18T13:06:13.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.821+0000 7f4f32a65640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c10ec50 con 0x7f4f2c101900 2024-09-18T13:06:13.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.821+0000 7f4f2bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2c107900 0x7f4f2c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:13.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.821+0000 7f4f2bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2c107900 0x7f4f2c19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55120/0 (socket says 172.21.15.78:55120) 2024-09-18T13:06:13.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.821+0000 7f4f2bfff640 1 -- 172.21.15.78:0/1631106289 learned_addr learned my addr 172.21.15.78:0/1631106289 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:06:13.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.821+0000 7f4f30801640 1 --2- 172.21.15.78:0/1631106289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f2c101900 0x7f4f2c19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:13.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.822+0000 7f4f2bfff640 1 -- 172.21.15.78:0/1631106289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f2c101900 msgr2=0x7f4f2c19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:13.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.822+0000 7f4f2bfff640 1 --2- 172.21.15.78:0/1631106289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f2c101900 0x7f4f2c19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:13.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.822+0000 7f4f2bfff640 1 -- 172.21.15.78:0/1631106289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2c1977a0 con 0x7f4f2c107900 2024-09-18T13:06:13.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.822+0000 7f4f2bfff640 1 --2- 172.21.15.78:0/1631106289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2c107900 0x7f4f2c19db60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800d6f0 tx=0x7f4f1800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:13.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.822+0000 7f4f29ffb640 1 -- 172.21.15.78:0/1631106289 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f18017070 con 0x7f4f2c107900 2024-09-18T13:06:13.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.822+0000 7f4f32a65640 1 -- 172.21.15.78:0/1631106289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2c197a90 con 0x7f4f2c107900 2024-09-18T13:06:13.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.822+0000 7f4f29ffb640 1 -- 172.21.15.78:0/1631106289 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f1800de00 con 0x7f4f2c107900 2024-09-18T13:06:13.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.822+0000 7f4f29ffb640 1 -- 172.21.15.78:0/1631106289 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f18004bb0 con 0x7f4f2c107900 2024-09-18T13:06:13.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.822+0000 7f4f32a65640 1 -- 172.21.15.78:0/1631106289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f2c198020 con 0x7f4f2c107900 2024-09-18T13:06:13.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.823+0000 7f4f32a65640 1 -- 172.21.15.78:0/1631106289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f2c103040 con 0x7f4f2c107900 2024-09-18T13:06:13.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.824+0000 7f4f29ffb640 1 -- 172.21.15.78:0/1631106289 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4f18004e60 con 0x7f4f2c107900 2024-09-18T13:06:13.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.824+0000 7f4f29ffb640 1 --2- 172.21.15.78:0/1631106289 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f1c07b130 0x7f4f1c07d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:13.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.824+0000 7f4f29ffb640 1 -- 172.21.15.78:0/1631106289 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f4f1809da00 con 0x7f4f2c107900 2024-09-18T13:06:13.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.824+0000 7f4f30801640 1 --2- 172.21.15.78:0/1631106289 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f1c07b130 0x7f4f1c07d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:13.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.825+0000 7f4f30801640 1 --2- 172.21.15.78:0/1631106289 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f1c07b130 0x7f4f1c07d5f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4f200096c0 tx=0x7f4f20031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:13.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:13.829+0000 7f4f29ffb640 1 -- 172.21.15.78:0/1631106289 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4f18068fa0 con 0x7f4f2c107900 2024-09-18T13:06:14.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.009+0000 7f4f32a65640 1 -- 172.21.15.78:0/1631106289 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4f2c1982d0 con 0x7f4f1c07b130 2024-09-18T13:06:14.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.018+0000 7f4f29ffb640 1 -- 172.21.15.78:0/1631106289 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f4f2c1982d0 con 0x7f4f1c07b130 2024-09-18T13:06:14.019 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:06:14.019 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (14m) 8m ago 24m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:06:14.019 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (16m) 8m ago 25m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:06:14.019 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (16m) 7m ago 24m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:06:14.019 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (12m) 8m ago 25m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:06:14.019 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (12m) 7m ago 24m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:06:14.019 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (13m) 8m ago 24m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:06:14.019 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (8m) 8m ago 19m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:06:14.020 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (8m) 8m ago 19m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:06:14.020 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (8m) 7m ago 19m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:06:14.020 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (7m) 7m ago 19m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:06:14.020 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (16m) 8m ago 26m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:06:14.020 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (15m) 7m ago 24m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:06:14.020 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (12m) 8m ago 26m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:06:14.020 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (12m) 7m ago 24m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:06:14.020 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (14m) 8m ago 25m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:06:14.020 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (14m) 7m ago 24m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:06:14.020 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (11m) 8m ago 23m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:06:14.020 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (11m) 8m ago 22m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:06:14.020 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (10m) 8m ago 22m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:06:14.020 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (10m) 7m ago 21m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:06:14.021 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (9m) 7m ago 21m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:06:14.021 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (8m) 7m ago 20m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:06:14.021 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (14m) 8m ago 24m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:06:14.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.020+0000 7f4f32a65640 1 -- 172.21.15.78:0/1631106289 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f1c07b130 msgr2=0x7f4f1c07d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:14.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.020+0000 7f4f32a65640 1 --2- 172.21.15.78:0/1631106289 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f1c07b130 0x7f4f1c07d5f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4f200096c0 tx=0x7f4f20031400 comp rx=0 tx=0).stop 2024-09-18T13:06:14.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.020+0000 7f4f32a65640 1 -- 172.21.15.78:0/1631106289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2c107900 msgr2=0x7f4f2c19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:14.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.020+0000 7f4f32a65640 1 --2- 172.21.15.78:0/1631106289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2c107900 0x7f4f2c19db60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800d6f0 tx=0x7f4f1800dbb0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.020+0000 7f4f32a65640 1 -- 172.21.15.78:0/1631106289 shutdown_connections 2024-09-18T13:06:14.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.020+0000 7f4f32a65640 1 --2- 172.21.15.78:0/1631106289 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f1c07b130 0x7f4f1c07d5f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.020+0000 7f4f32a65640 1 --2- 172.21.15.78:0/1631106289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2c107900 0x7f4f2c19db60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.020+0000 7f4f32a65640 1 --2- 172.21.15.78:0/1631106289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f2c101900 0x7f4f2c19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.020+0000 7f4f32a65640 1 -- 172.21.15.78:0/1631106289 >> 172.21.15.78:0/1631106289 conn(0x7f4f2c0fd600 msgr2=0x7f4f2c0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:14.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.021+0000 7f4f32a65640 1 -- 172.21.15.78:0/1631106289 shutdown_connections 2024-09-18T13:06:14.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.021+0000 7f4f32a65640 1 -- 172.21.15.78:0/1631106289 wait complete. 2024-09-18T13:06:14.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.101+0000 7f12807b9640 1 -- 172.21.15.78:0/3963854269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12781033e0 msgr2=0x7f127810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:14.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.101+0000 7f12807b9640 1 --2- 172.21.15.78:0/3963854269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12781033e0 0x7f127810b8d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1274009880 tx=0x7f127402a530 comp rx=0 tx=0).stop 2024-09-18T13:06:14.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.101+0000 7f12807b9640 1 -- 172.21.15.78:0/3963854269 shutdown_connections 2024-09-18T13:06:14.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.101+0000 7f12807b9640 1 --2- 172.21.15.78:0/3963854269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12781033e0 0x7f127810b8d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.101+0000 7f12807b9640 1 --2- 172.21.15.78:0/3963854269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1278102ac0 0x7f1278102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.101+0000 7f12807b9640 1 -- 172.21.15.78:0/3963854269 >> 172.21.15.78:0/3963854269 conn(0x7f12780fc520 msgr2=0x7f12780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:14.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.102+0000 7f12807b9640 1 -- 172.21.15.78:0/3963854269 shutdown_connections 2024-09-18T13:06:14.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.102+0000 7f12807b9640 1 -- 172.21.15.78:0/3963854269 wait complete. 2024-09-18T13:06:14.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.102+0000 7f12807b9640 1 Processor -- start 2024-09-18T13:06:14.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.102+0000 7f12807b9640 1 -- start start 2024-09-18T13:06:14.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.102+0000 7f12807b9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1278102ac0 0x7f1278100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:14.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.102+0000 7f12807b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12781033e0 0x7f1278100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:14.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.102+0000 7f12807b9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f127810edf0 con 0x7f12781033e0 2024-09-18T13:06:14.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.102+0000 7f12807b9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f127810ec70 con 0x7f1278102ac0 2024-09-18T13:06:14.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.102+0000 7f127dd54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12781033e0 0x7f1278100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:14.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.103+0000 7f127dd54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12781033e0 0x7f1278100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55152/0 (socket says 172.21.15.78:55152) 2024-09-18T13:06:14.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.103+0000 7f127dd54640 1 -- 172.21.15.78:0/1611137509 learned_addr learned my addr 172.21.15.78:0/1611137509 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:06:14.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.103+0000 7f127e555640 1 --2- 172.21.15.78:0/1611137509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1278102ac0 0x7f1278100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:14.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.103+0000 7f127dd54640 1 -- 172.21.15.78:0/1611137509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1278102ac0 msgr2=0x7f1278100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:14.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.103+0000 7f127dd54640 1 --2- 172.21.15.78:0/1611137509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1278102ac0 0x7f1278100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.103+0000 7f127dd54640 1 -- 172.21.15.78:0/1611137509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12781011a0 con 0x7f12781033e0 2024-09-18T13:06:14.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.103+0000 7f127e555640 1 --2- 172.21.15.78:0/1611137509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1278102ac0 0x7f1278100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:06:14.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.103+0000 7f127dd54640 1 --2- 172.21.15.78:0/1611137509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12781033e0 0x7f1278100c60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1274031460 tx=0x7f1274004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:14.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.103+0000 7f126f7fe640 1 -- 172.21.15.78:0/1611137509 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f127403f070 con 0x7f12781033e0 2024-09-18T13:06:14.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.103+0000 7f12807b9640 1 -- 172.21.15.78:0/1611137509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1278101430 con 0x7f12781033e0 2024-09-18T13:06:14.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.103+0000 7f126f7fe640 1 -- 172.21.15.78:0/1611137509 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f12740035f0 con 0x7f12781033e0 2024-09-18T13:06:14.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.103+0000 7f126f7fe640 1 -- 172.21.15.78:0/1611137509 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1274035030 con 0x7f12781033e0 2024-09-18T13:06:14.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.103+0000 7f12807b9640 1 -- 172.21.15.78:0/1611137509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12781a3dc0 con 0x7f12781033e0 2024-09-18T13:06:14.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.105+0000 7f12807b9640 1 -- 172.21.15.78:0/1611137509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f127806aa90 con 0x7f12781033e0 2024-09-18T13:06:14.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.105+0000 7f126f7fe640 1 -- 172.21.15.78:0/1611137509 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1274042070 con 0x7f12781033e0 2024-09-18T13:06:14.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.105+0000 7f126f7fe640 1 --2- 172.21.15.78:0/1611137509 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f126407af80 0x7f126407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:14.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.106+0000 7f126f7fe640 1 -- 172.21.15.78:0/1611137509 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f12740be940 con 0x7f12781033e0 2024-09-18T13:06:14.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.106+0000 7f127e555640 1 --2- 172.21.15.78:0/1611137509 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f126407af80 0x7f126407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:14.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.106+0000 7f127e555640 1 --2- 172.21.15.78:0/1611137509 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f126407af80 0x7f126407d440 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f12680058c0 tx=0x7f1268005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:14.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.110+0000 7f126f7fe640 1 -- 172.21.15.78:0/1611137509 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1274089f60 con 0x7f12781033e0 2024-09-18T13:06:14.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.358+0000 7f12807b9640 1 -- 172.21.15.78:0/1611137509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1278101c50 con 0x7f12781033e0 2024-09-18T13:06:14.359 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:14 smithi078 ceph-mon[108578]: pgmap v512: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:14.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.358+0000 7f126f7fe640 1 -- 172.21.15.78:0/1611137509 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f127408ee10 con 0x7f12781033e0 2024-09-18T13:06:14.360 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:06:14.360 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:06:14.360 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:06:14.360 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:06:14.360 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:06:14.360 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:06:14.361 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:06:14.361 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:06:14.361 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:06:14.361 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:06:14.361 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:06:14.361 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:06:14.361 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:06:14.361 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:06:14.361 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:06:14.361 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:06:14.361 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:06:14.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.360+0000 7f12807b9640 1 -- 172.21.15.78:0/1611137509 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f126407af80 msgr2=0x7f126407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:14.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.360+0000 7f12807b9640 1 --2- 172.21.15.78:0/1611137509 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f126407af80 0x7f126407d440 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f12680058c0 tx=0x7f1268005850 comp rx=0 tx=0).stop 2024-09-18T13:06:14.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.360+0000 7f12807b9640 1 -- 172.21.15.78:0/1611137509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12781033e0 msgr2=0x7f1278100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:14.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.360+0000 7f12807b9640 1 --2- 172.21.15.78:0/1611137509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12781033e0 0x7f1278100c60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1274031460 tx=0x7f1274004530 comp rx=0 tx=0).stop 2024-09-18T13:06:14.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.361+0000 7f12807b9640 1 -- 172.21.15.78:0/1611137509 shutdown_connections 2024-09-18T13:06:14.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.361+0000 7f12807b9640 1 --2- 172.21.15.78:0/1611137509 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f126407af80 0x7f126407d440 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.361+0000 7f12807b9640 1 --2- 172.21.15.78:0/1611137509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12781033e0 0x7f1278100c60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.361+0000 7f12807b9640 1 --2- 172.21.15.78:0/1611137509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1278102ac0 0x7f1278100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.361+0000 7f12807b9640 1 -- 172.21.15.78:0/1611137509 >> 172.21.15.78:0/1611137509 conn(0x7f12780fc520 msgr2=0x7f1278108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:14.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.361+0000 7f12807b9640 1 -- 172.21.15.78:0/1611137509 shutdown_connections 2024-09-18T13:06:14.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.361+0000 7f12807b9640 1 -- 172.21.15.78:0/1611137509 wait complete. 2024-09-18T13:06:14.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.442+0000 7f621343b640 1 -- 172.21.15.78:0/1819313328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f620c102b60 msgr2=0x7f620c102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:14.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.442+0000 7f621343b640 1 --2- 172.21.15.78:0/1819313328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f620c102b60 0x7f620c102f40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6208009880 tx=0x7f620802a530 comp rx=0 tx=0).stop 2024-09-18T13:06:14.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.442+0000 7f621343b640 1 -- 172.21.15.78:0/1819313328 shutdown_connections 2024-09-18T13:06:14.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.442+0000 7f621343b640 1 --2- 172.21.15.78:0/1819313328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f620c103480 0x7f620c10b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.443+0000 7f621343b640 1 --2- 172.21.15.78:0/1819313328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f620c102b60 0x7f620c102f40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.443+0000 7f621343b640 1 -- 172.21.15.78:0/1819313328 >> 172.21.15.78:0/1819313328 conn(0x7f620c0fc520 msgr2=0x7f620c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:14.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.443+0000 7f621343b640 1 -- 172.21.15.78:0/1819313328 shutdown_connections 2024-09-18T13:06:14.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.443+0000 7f621343b640 1 -- 172.21.15.78:0/1819313328 wait complete. 2024-09-18T13:06:14.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.443+0000 7f621343b640 1 Processor -- start 2024-09-18T13:06:14.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.443+0000 7f621343b640 1 -- start start 2024-09-18T13:06:14.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f621343b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f620c102b60 0x7f620c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:14.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f621343b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f620c103480 0x7f620c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:14.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f621343b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f620c10edd0 con 0x7f620c103480 2024-09-18T13:06:14.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f621343b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f620c10ec50 con 0x7f620c102b60 2024-09-18T13:06:14.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f62109d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f620c103480 0x7f620c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:14.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f62109d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f620c103480 0x7f620c19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55176/0 (socket says 172.21.15.78:55176) 2024-09-18T13:06:14.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f62109d6640 1 -- 172.21.15.78:0/1334774573 learned_addr learned my addr 172.21.15.78:0/1334774573 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:06:14.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f62111d7640 1 --2- 172.21.15.78:0/1334774573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f620c102b60 0x7f620c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:14.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f62109d6640 1 -- 172.21.15.78:0/1334774573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f620c102b60 msgr2=0x7f620c19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:14.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f62109d6640 1 --2- 172.21.15.78:0/1334774573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f620c102b60 0x7f620c19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f62109d6640 1 -- 172.21.15.78:0/1334774573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620c1977e0 con 0x7f620c103480 2024-09-18T13:06:14.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f62111d7640 1 --2- 172.21.15.78:0/1334774573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f620c102b60 0x7f620c19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:06:14.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f62109d6640 1 --2- 172.21.15.78:0/1334774573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f620c103480 0x7f620c19dba0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00c8a0 tx=0x7f61fc00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:14.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f62027fc640 1 -- 172.21.15.78:0/1334774573 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f61fc0079b0 con 0x7f620c103480 2024-09-18T13:06:14.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f62027fc640 1 -- 172.21.15.78:0/1334774573 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f61fc007b50 con 0x7f620c103480 2024-09-18T13:06:14.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f621343b640 1 -- 172.21.15.78:0/1334774573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f620c197ad0 con 0x7f620c103480 2024-09-18T13:06:14.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f62027fc640 1 -- 172.21.15.78:0/1334774573 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f61fc018700 con 0x7f620c103480 2024-09-18T13:06:14.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.444+0000 7f621343b640 1 -- 172.21.15.78:0/1334774573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f620c198060 con 0x7f620c103480 2024-09-18T13:06:14.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.445+0000 7f621343b640 1 -- 172.21.15.78:0/1334774573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f620c06a9f0 con 0x7f620c103480 2024-09-18T13:06:14.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.446+0000 7f62027fc640 1 -- 172.21.15.78:0/1334774573 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f61fc007d00 con 0x7f620c103480 2024-09-18T13:06:14.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.447+0000 7f62027fc640 1 --2- 172.21.15.78:0/1334774573 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f61f807af30 0x7f61f807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:14.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.447+0000 7f62111d7640 1 --2- 172.21.15.78:0/1334774573 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f61f807af30 0x7f61f807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:14.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.447+0000 7f62027fc640 1 -- 172.21.15.78:0/1334774573 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f61fc09e410 con 0x7f620c103480 2024-09-18T13:06:14.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.447+0000 7f62111d7640 1 --2- 172.21.15.78:0/1334774573 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f61f807af30 0x7f61f807d3f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6208006010 tx=0x7f62080095f0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:14.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.451+0000 7f62027fc640 1 -- 172.21.15.78:0/1334774573 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f61fc014030 con 0x7f620c103480 2024-09-18T13:06:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.659+0000 7f621343b640 1 -- 172.21.15.78:0/1334774573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f620c105fc0 con 0x7f620c103480 2024-09-18T13:06:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.659+0000 7f62027fc640 1 -- 172.21.15.78:0/1334774573 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f61fc069910 con 0x7f620c103480 2024-09-18T13:06:14.661 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:06:14.661 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:06:14.661 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:06:14.661 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:06:14.661 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:06:14.661 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:06:14.661 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:06:14.661 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:06:14.662 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:06:14.662 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:06:14.662 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:06:14.662 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:06:14.662 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:06:14.662 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:06:14.662 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:06:14.662 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:06:14.662 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:06:14.662 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:06:14.662 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:06:14.662 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:06:14.662 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:06:14.662 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:06:14.663 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:06:14.663 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:06:14.663 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:06:14.663 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:06:14.663 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:06:14.663 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:06:14.663 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:06:14.663 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:06:14.663 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:06:14.663 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:06:14.663 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:06:14.663 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:06:14.663 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:06:14.663 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:06:14.664 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:06:14.664 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:06:14.664 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:06:14.664 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:06:14.664 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:06:14.664 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:06:14.664 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:06:14.665 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:06:14.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.661+0000 7f621343b640 1 -- 172.21.15.78:0/1334774573 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f61f807af30 msgr2=0x7f61f807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:14.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.662+0000 7f621343b640 1 --2- 172.21.15.78:0/1334774573 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f61f807af30 0x7f61f807d3f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6208006010 tx=0x7f62080095f0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.662+0000 7f621343b640 1 -- 172.21.15.78:0/1334774573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f620c103480 msgr2=0x7f620c19dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:14.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.662+0000 7f621343b640 1 --2- 172.21.15.78:0/1334774573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f620c103480 0x7f620c19dba0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00c8a0 tx=0x7f61fc00cd60 comp rx=0 tx=0).stop 2024-09-18T13:06:14.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.662+0000 7f621343b640 1 -- 172.21.15.78:0/1334774573 shutdown_connections 2024-09-18T13:06:14.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.662+0000 7f621343b640 1 --2- 172.21.15.78:0/1334774573 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f61f807af30 0x7f61f807d3f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.662+0000 7f621343b640 1 --2- 172.21.15.78:0/1334774573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f620c103480 0x7f620c19dba0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.662+0000 7f621343b640 1 --2- 172.21.15.78:0/1334774573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f620c102b60 0x7f620c19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.662+0000 7f621343b640 1 -- 172.21.15.78:0/1334774573 >> 172.21.15.78:0/1334774573 conn(0x7f620c0fc520 msgr2=0x7f620c108f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:14.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.662+0000 7f621343b640 1 -- 172.21.15.78:0/1334774573 shutdown_connections 2024-09-18T13:06:14.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.662+0000 7f621343b640 1 -- 172.21.15.78:0/1334774573 wait complete. 2024-09-18T13:06:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:14 smithi148 ceph-mon[80030]: pgmap v512: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:14.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.745+0000 7f0f29ec1640 1 -- 172.21.15.78:0/723177332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f24100800 msgr2=0x7f0f24100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:14.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.745+0000 7f0f29ec1640 1 --2- 172.21.15.78:0/723177332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f24100800 0x7f0f24100c60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0f18009880 tx=0x7f0f1802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.745+0000 7f0f29ec1640 1 -- 172.21.15.78:0/723177332 shutdown_connections 2024-09-18T13:06:14.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.745+0000 7f0f29ec1640 1 --2- 172.21.15.78:0/723177332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f24100800 0x7f0f24100c60 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.745+0000 7f0f29ec1640 1 --2- 172.21.15.78:0/723177332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f24106800 0x7f0f24106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.745+0000 7f0f29ec1640 1 -- 172.21.15.78:0/723177332 >> 172.21.15.78:0/723177332 conn(0x7f0f240fc520 msgr2=0x7f0f240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:14.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.745+0000 7f0f29ec1640 1 -- 172.21.15.78:0/723177332 shutdown_connections 2024-09-18T13:06:14.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.745+0000 7f0f29ec1640 1 -- 172.21.15.78:0/723177332 wait complete. 2024-09-18T13:06:14.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.746+0000 7f0f29ec1640 1 Processor -- start 2024-09-18T13:06:14.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.746+0000 7f0f29ec1640 1 -- start start 2024-09-18T13:06:14.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.746+0000 7f0f29ec1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f24100800 0x7f0f240fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:14.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.746+0000 7f0f29ec1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f24106800 0x7f0f240fd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:14.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.746+0000 7f0f29ec1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2410dcd0 con 0x7f0f24100800 2024-09-18T13:06:14.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.746+0000 7f0f29ec1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2410db50 con 0x7f0f24106800 2024-09-18T13:06:14.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.746+0000 7f0f237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f24100800 0x7f0f240fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:14.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.746+0000 7f0f237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f24100800 0x7f0f240fcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55190/0 (socket says 172.21.15.78:55190) 2024-09-18T13:06:14.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.746+0000 7f0f237fe640 1 -- 172.21.15.78:0/3041636955 learned_addr learned my addr 172.21.15.78:0/3041636955 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:06:14.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.746+0000 7f0f22ffd640 1 --2- 172.21.15.78:0/3041636955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f24106800 0x7f0f240fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:14.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.747+0000 7f0f237fe640 1 -- 172.21.15.78:0/3041636955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f24106800 msgr2=0x7f0f240fd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:14.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.747+0000 7f0f237fe640 1 --2- 172.21.15.78:0/3041636955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f24106800 0x7f0f240fd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.747+0000 7f0f237fe640 1 -- 172.21.15.78:0/3041636955 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f240fd670 con 0x7f0f24100800 2024-09-18T13:06:14.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.747+0000 7f0f237fe640 1 --2- 172.21.15.78:0/3041636955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f24100800 0x7f0f240fcbf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400c8f0 tx=0x7f0f1400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:14.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.747+0000 7f0f20ff9640 1 -- 172.21.15.78:0/3041636955 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f140079b0 con 0x7f0f24100800 2024-09-18T13:06:14.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.747+0000 7f0f20ff9640 1 -- 172.21.15.78:0/3041636955 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f140054e0 con 0x7f0f24100800 2024-09-18T13:06:14.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.747+0000 7f0f20ff9640 1 -- 172.21.15.78:0/3041636955 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f14004dd0 con 0x7f0f24100800 2024-09-18T13:06:14.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.747+0000 7f0f29ec1640 1 -- 172.21.15.78:0/3041636955 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f240fd960 con 0x7f0f24100800 2024-09-18T13:06:14.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.747+0000 7f0f29ec1640 1 -- 172.21.15.78:0/3041636955 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f241a3e70 con 0x7f0f24100800 2024-09-18T13:06:14.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.748+0000 7f0f29ec1640 1 -- 172.21.15.78:0/3041636955 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f24101f40 con 0x7f0f24100800 2024-09-18T13:06:14.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.749+0000 7f0f20ff9640 1 -- 172.21.15.78:0/3041636955 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f0f14005020 con 0x7f0f24100800 2024-09-18T13:06:14.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.749+0000 7f0f20ff9640 1 --2- 172.21.15.78:0/3041636955 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0f0c07aed0 0x7f0f0c07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:14.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.749+0000 7f0f20ff9640 1 -- 172.21.15.78:0/3041636955 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f0f1409e020 con 0x7f0f24100800 2024-09-18T13:06:14.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.749+0000 7f0f22ffd640 1 --2- 172.21.15.78:0/3041636955 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0f0c07aed0 0x7f0f0c07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:14.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.750+0000 7f0f22ffd640 1 --2- 172.21.15.78:0/3041636955 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0f0c07aed0 0x7f0f0c07d390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0f240fe680 tx=0x7f0f18031420 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:14.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.754+0000 7f0f20ff9640 1 -- 172.21.15.78:0/3041636955 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f0f14014030 con 0x7f0f24100800 2024-09-18T13:06:14.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.943+0000 7f0f29ec1640 1 -- 172.21.15.78:0/3041636955 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0f24062630 con 0x7f0f0c07aed0 2024-09-18T13:06:14.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.945+0000 7f0f20ff9640 1 -- 172.21.15.78:0/3041636955 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f0f24062630 con 0x7f0f0c07aed0 2024-09-18T13:06:14.950 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:06:14.950 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:06:14.950 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:06:14.950 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:06:14.950 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:06:14.950 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:06:14.950 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:06:14.950 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:06:14.950 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:06:14.950 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:06:14.950 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:06:14.950 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:06:14.951 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:06:14.951 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:06:14.951 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:06:14.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.947+0000 7f0f29ec1640 1 -- 172.21.15.78:0/3041636955 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0f0c07aed0 msgr2=0x7f0f0c07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:14.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.947+0000 7f0f29ec1640 1 --2- 172.21.15.78:0/3041636955 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0f0c07aed0 0x7f0f0c07d390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0f240fe680 tx=0x7f0f18031420 comp rx=0 tx=0).stop 2024-09-18T13:06:14.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.947+0000 7f0f29ec1640 1 -- 172.21.15.78:0/3041636955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f24100800 msgr2=0x7f0f240fcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:14.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.947+0000 7f0f29ec1640 1 --2- 172.21.15.78:0/3041636955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f24100800 0x7f0f240fcbf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400c8f0 tx=0x7f0f1400cdb0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.947+0000 7f0f29ec1640 1 -- 172.21.15.78:0/3041636955 shutdown_connections 2024-09-18T13:06:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.947+0000 7f0f29ec1640 1 --2- 172.21.15.78:0/3041636955 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0f0c07aed0 0x7f0f0c07d390 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.947+0000 7f0f29ec1640 1 --2- 172.21.15.78:0/3041636955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f24106800 0x7f0f240fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.947+0000 7f0f29ec1640 1 --2- 172.21.15.78:0/3041636955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f24100800 0x7f0f240fcbf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.947+0000 7f0f29ec1640 1 -- 172.21.15.78:0/3041636955 >> 172.21.15.78:0/3041636955 conn(0x7f0f240fc520 msgr2=0x7f0f2406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.947+0000 7f0f29ec1640 1 -- 172.21.15.78:0/3041636955 shutdown_connections 2024-09-18T13:06:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:14.947+0000 7f0f29ec1640 1 -- 172.21.15.78:0/3041636955 wait complete. 2024-09-18T13:06:15.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.030+0000 7fe19d9b0640 1 -- 172.21.15.78:0/3718608203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe198101900 msgr2=0x7fe198101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:15.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.030+0000 7fe19d9b0640 1 --2- 172.21.15.78:0/3718608203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe198101900 0x7fe198101d60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe188009880 tx=0x7fe18802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:06:15.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.030+0000 7fe19d9b0640 1 -- 172.21.15.78:0/3718608203 shutdown_connections 2024-09-18T13:06:15.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.030+0000 7fe19d9b0640 1 --2- 172.21.15.78:0/3718608203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe198101900 0x7fe198101d60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:15.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.030+0000 7fe19d9b0640 1 --2- 172.21.15.78:0/3718608203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe198107900 0x7fe198107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:15.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.030+0000 7fe19d9b0640 1 -- 172.21.15.78:0/3718608203 >> 172.21.15.78:0/3718608203 conn(0x7fe1980fd5e0 msgr2=0x7fe1980ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.030+0000 7fe19d9b0640 1 -- 172.21.15.78:0/3718608203 shutdown_connections 2024-09-18T13:06:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.030+0000 7fe19d9b0640 1 -- 172.21.15.78:0/3718608203 wait complete. 2024-09-18T13:06:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.030+0000 7fe19d9b0640 1 Processor -- start 2024-09-18T13:06:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.030+0000 7fe19d9b0640 1 -- start start 2024-09-18T13:06:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe19d9b0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe198101900 0x7fe19819f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe19d9b0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe198107900 0x7fe19819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe19d9b0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe19810edb0 con 0x7fe198101900 2024-09-18T13:06:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe19d9b0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe19810ec30 con 0x7fe198107900 2024-09-18T13:06:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe196ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe198101900 0x7fe19819f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe196ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe198101900 0x7fe19819f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55202/0 (socket says 172.21.15.78:55202) 2024-09-18T13:06:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe196ffd640 1 -- 172.21.15.78:0/71403794 learned_addr learned my addr 172.21.15.78:0/71403794 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:06:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe196ffd640 1 -- 172.21.15.78:0/71403794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe198107900 msgr2=0x7fe19819fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe1967fc640 1 --2- 172.21.15.78:0/71403794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe198107900 0x7fe19819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe196ffd640 1 --2- 172.21.15.78:0/71403794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe198107900 0x7fe19819fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe196ffd640 1 -- 172.21.15.78:0/71403794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1981a03e0 con 0x7fe198101900 2024-09-18T13:06:15.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe196ffd640 1 --2- 172.21.15.78:0/71403794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe198101900 0x7fe19819f7f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00c8a0 tx=0x7fe18c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:15.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe19c9ae640 1 -- 172.21.15.78:0/71403794 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe18c0079b0 con 0x7fe198101900 2024-09-18T13:06:15.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe19c9ae640 1 -- 172.21.15.78:0/71403794 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe18c007b50 con 0x7fe198101900 2024-09-18T13:06:15.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe19c9ae640 1 -- 172.21.15.78:0/71403794 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe18c018700 con 0x7fe198101900 2024-09-18T13:06:15.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.031+0000 7fe19d9b0640 1 -- 172.21.15.78:0/71403794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe198199ad0 con 0x7fe198101900 2024-09-18T13:06:15.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.032+0000 7fe19d9b0640 1 -- 172.21.15.78:0/71403794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19819a030 con 0x7fe198101900 2024-09-18T13:06:15.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.033+0000 7fe19d9b0640 1 -- 172.21.15.78:0/71403794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe198103040 con 0x7fe198101900 2024-09-18T13:06:15.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.033+0000 7fe19c9ae640 1 -- 172.21.15.78:0/71403794 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe18c007d00 con 0x7fe198101900 2024-09-18T13:06:15.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.034+0000 7fe19c9ae640 1 --2- 172.21.15.78:0/71403794 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe18007af30 0x7fe18007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:15.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.034+0000 7fe1967fc640 1 --2- 172.21.15.78:0/71403794 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe18007af30 0x7fe18007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:15.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.034+0000 7fe19c9ae640 1 -- 172.21.15.78:0/71403794 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fe18c09e370 con 0x7fe198101900 2024-09-18T13:06:15.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.034+0000 7fe1967fc640 1 --2- 172.21.15.78:0/71403794 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe18007af30 0x7fe18007d3f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe188031460 tx=0x7fe188009560 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:15.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.038+0000 7fe19c9ae640 1 -- 172.21.15.78:0/71403794 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe18c014030 con 0x7fe198101900 2024-09-18T13:06:15.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.283+0000 7fe19d9b0640 1 -- 172.21.15.78:0/71403794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe19819a3e0 con 0x7fe198101900 2024-09-18T13:06:15.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.283+0000 7fe19c9ae640 1 -- 172.21.15.78:0/71403794 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fe18c069910 con 0x7fe198101900 2024-09-18T13:06:15.284 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:06:15.284 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:06:15.285 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:06:15.285 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:06:15.285 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:06:15.285 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:06:15.285 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:06:15.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.285+0000 7fe19d9b0640 1 -- 172.21.15.78:0/71403794 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe18007af30 msgr2=0x7fe18007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:15.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.285+0000 7fe19d9b0640 1 --2- 172.21.15.78:0/71403794 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe18007af30 0x7fe18007d3f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe188031460 tx=0x7fe188009560 comp rx=0 tx=0).stop 2024-09-18T13:06:15.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.285+0000 7fe19d9b0640 1 -- 172.21.15.78:0/71403794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe198101900 msgr2=0x7fe19819f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:15.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.285+0000 7fe19d9b0640 1 --2- 172.21.15.78:0/71403794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe198101900 0x7fe19819f7f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00c8a0 tx=0x7fe18c00cd60 comp rx=0 tx=0).stop 2024-09-18T13:06:15.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.285+0000 7fe19d9b0640 1 -- 172.21.15.78:0/71403794 shutdown_connections 2024-09-18T13:06:15.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.285+0000 7fe19d9b0640 1 --2- 172.21.15.78:0/71403794 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe18007af30 0x7fe18007d3f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:15.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.285+0000 7fe19d9b0640 1 --2- 172.21.15.78:0/71403794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe198107900 0x7fe19819fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:15.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.285+0000 7fe19d9b0640 1 --2- 172.21.15.78:0/71403794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe198101900 0x7fe19819f7f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:15.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.286+0000 7fe19d9b0640 1 -- 172.21.15.78:0/71403794 >> 172.21.15.78:0/71403794 conn(0x7fe1980fd5e0 msgr2=0x7fe198074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:15.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.286+0000 7fe19d9b0640 1 -- 172.21.15.78:0/71403794 shutdown_connections 2024-09-18T13:06:15.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:15.286+0000 7fe19d9b0640 1 -- 172.21.15.78:0/71403794 wait complete. 2024-09-18T13:06:15.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:15 smithi078 ceph-mon[108578]: from='client.34778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:15.704 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:15 smithi078 ceph-mon[108578]: from='client.34782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:15.704 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:15 smithi078 ceph-mon[108578]: from='client.34786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:15.704 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:15 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1611137509' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:06:15.704 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:15 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1334774573' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:06:15.704 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:15 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/71403794' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:06:15.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:15 smithi148 ceph-mon[80030]: from='client.34778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:15.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:15 smithi148 ceph-mon[80030]: from='client.34782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:15.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:15 smithi148 ceph-mon[80030]: from='client.34786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:15.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:15 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1611137509' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:06:15.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:15 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1334774573' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:06:15.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:15 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/71403794' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:06:16.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:16 smithi148 ceph-mon[80030]: from='client.34798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:16.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:16 smithi148 ceph-mon[80030]: pgmap v513: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:16 smithi078 ceph-mon[108578]: from='client.34798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:16 smithi078 ceph-mon[108578]: pgmap v513: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:18.711 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:18 smithi078 ceph-mon[108578]: pgmap v514: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:18 smithi148 ceph-mon[80030]: pgmap v514: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:20.618 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:20 smithi148 ceph-mon[80030]: pgmap v515: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:20.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:20 smithi078 ceph-mon[108578]: pgmap v515: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:22.645 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:22 smithi078 ceph-mon[108578]: pgmap v516: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:22 smithi148 ceph-mon[80030]: pgmap v516: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:24.704 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:24 smithi078 ceph-mon[108578]: pgmap v517: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:24 smithi148 ceph-mon[80030]: pgmap v517: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:26 smithi148 ceph-mon[80030]: pgmap v518: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:26 smithi078 ceph-mon[108578]: pgmap v518: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:28 smithi148 ceph-mon[80030]: pgmap v519: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:28.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:28 smithi078 ceph-mon[108578]: pgmap v519: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:30.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:30 smithi078 ceph-mon[108578]: pgmap v520: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:30 smithi148 ceph-mon[80030]: pgmap v520: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:32 smithi148 ceph-mon[80030]: pgmap v521: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:32.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:32 smithi078 ceph-mon[108578]: pgmap v521: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:34 smithi148 ceph-mon[80030]: pgmap v522: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:34.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:34 smithi078 ceph-mon[108578]: pgmap v522: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:36.707 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:36 smithi078 ceph-mon[108578]: pgmap v523: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:36 smithi148 ceph-mon[80030]: pgmap v523: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:38.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:38 smithi148 ceph-mon[80030]: pgmap v524: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:38.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:38 smithi078 ceph-mon[108578]: pgmap v524: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:40 smithi148 ceph-mon[80030]: pgmap v525: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:40 smithi078 ceph-mon[108578]: pgmap v525: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:42.701 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:42 smithi078 ceph-mon[108578]: pgmap v526: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:42 smithi148 ceph-mon[80030]: pgmap v526: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:44 smithi148 ceph-mon[80030]: pgmap v527: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:44 smithi078 ceph-mon[108578]: pgmap v527: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:45.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.380+0000 7f11487b1640 1 -- 172.21.15.78:0/2957882655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1140074eb0 msgr2=0x7f11401123d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:45.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.380+0000 7f11487b1640 1 --2- 172.21.15.78:0/2957882655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1140074eb0 0x7f11401123d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1130009880 tx=0x7f113002a530 comp rx=0 tx=0).stop 2024-09-18T13:06:45.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.381+0000 7f11487b1640 1 -- 172.21.15.78:0/2957882655 shutdown_connections 2024-09-18T13:06:45.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.381+0000 7f11487b1640 1 --2- 172.21.15.78:0/2957882655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1140074eb0 0x7f11401123d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.381+0000 7f11487b1640 1 --2- 172.21.15.78:0/2957882655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1140074590 0x7f1140074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.381+0000 7f11487b1640 1 -- 172.21.15.78:0/2957882655 >> 172.21.15.78:0/2957882655 conn(0x7f11400fd600 msgr2=0x7f11400ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:45.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.381+0000 7f11487b1640 1 -- 172.21.15.78:0/2957882655 shutdown_connections 2024-09-18T13:06:45.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.381+0000 7f11487b1640 1 -- 172.21.15.78:0/2957882655 wait complete. 2024-09-18T13:06:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.381+0000 7f11487b1640 1 Processor -- start 2024-09-18T13:06:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.381+0000 7f11487b1640 1 -- start start 2024-09-18T13:06:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.381+0000 7f11487b1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1140074590 0x7f114019dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.381+0000 7f11487b1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1140074eb0 0x7f114019e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.381+0000 7f11487b1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f11401153e0 con 0x7f1140074590 2024-09-18T13:06:45.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.381+0000 7f11487b1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1140115260 con 0x7f1140074eb0 2024-09-18T13:06:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.382+0000 7f114654d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1140074590 0x7f114019dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.382+0000 7f114654d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1140074590 0x7f114019dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43020/0 (socket says 172.21.15.78:43020) 2024-09-18T13:06:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.382+0000 7f114654d640 1 -- 172.21.15.78:0/2078551148 learned_addr learned my addr 172.21.15.78:0/2078551148 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:06:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.382+0000 7f1145d4c640 1 --2- 172.21.15.78:0/2078551148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1140074eb0 0x7f114019e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.382+0000 7f114654d640 1 -- 172.21.15.78:0/2078551148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1140074eb0 msgr2=0x7f114019e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.382+0000 7f114654d640 1 --2- 172.21.15.78:0/2078551148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1140074eb0 0x7f114019e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.382+0000 7f114654d640 1 -- 172.21.15.78:0/2078551148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11401a28b0 con 0x7f1140074590 2024-09-18T13:06:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.382+0000 7f114654d640 1 --2- 172.21.15.78:0/2078551148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1140074590 0x7f114019dfe0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f113c00d6f0 tx=0x7f113c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.382+0000 7f11377fe640 1 -- 172.21.15.78:0/2078551148 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f113c017070 con 0x7f1140074590 2024-09-18T13:06:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.382+0000 7f11377fe640 1 -- 172.21.15.78:0/2078551148 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f113c00de00 con 0x7f1140074590 2024-09-18T13:06:45.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.382+0000 7f11487b1640 1 -- 172.21.15.78:0/2078551148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11401a2ba0 con 0x7f1140074590 2024-09-18T13:06:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.382+0000 7f11377fe640 1 -- 172.21.15.78:0/2078551148 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f113c004bb0 con 0x7f1140074590 2024-09-18T13:06:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.382+0000 7f11487b1640 1 -- 172.21.15.78:0/2078551148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11401a3130 con 0x7f1140074590 2024-09-18T13:06:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.384+0000 7f11487b1640 1 -- 172.21.15.78:0/2078551148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1140075cd0 con 0x7f1140074590 2024-09-18T13:06:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.384+0000 7f11377fe640 1 -- 172.21.15.78:0/2078551148 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f113c004e60 con 0x7f1140074590 2024-09-18T13:06:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.385+0000 7f11377fe640 1 --2- 172.21.15.78:0/2078551148 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f112c07af30 0x7f112c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.385+0000 7f11377fe640 1 -- 172.21.15.78:0/2078551148 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f113c09dc00 con 0x7f1140074590 2024-09-18T13:06:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.385+0000 7f1145d4c640 1 --2- 172.21.15.78:0/2078551148 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f112c07af30 0x7f112c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.385+0000 7f1145d4c640 1 --2- 172.21.15.78:0/2078551148 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f112c07af30 0x7f112c07d3f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f11401047f0 tx=0x7f1130031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.389+0000 7f11377fe640 1 -- 172.21.15.78:0/2078551148 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f113c0a3020 con 0x7f1140074590 2024-09-18T13:06:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.582+0000 7f11487b1640 1 -- 172.21.15.78:0/2078551148 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f11401a33e0 con 0x7f112c07af30 2024-09-18T13:06:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.583+0000 7f11377fe640 1 -- 172.21.15.78:0/2078551148 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f11401a33e0 con 0x7f112c07af30 2024-09-18T13:06:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.586+0000 7f11487b1640 1 -- 172.21.15.78:0/2078551148 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f112c07af30 msgr2=0x7f112c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:45.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.586+0000 7f11487b1640 1 --2- 172.21.15.78:0/2078551148 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f112c07af30 0x7f112c07d3f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f11401047f0 tx=0x7f1130031400 comp rx=0 tx=0).stop 2024-09-18T13:06:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.586+0000 7f11487b1640 1 -- 172.21.15.78:0/2078551148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1140074590 msgr2=0x7f114019dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.586+0000 7f11487b1640 1 --2- 172.21.15.78:0/2078551148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1140074590 0x7f114019dfe0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f113c00d6f0 tx=0x7f113c00dbb0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.586+0000 7f11487b1640 1 -- 172.21.15.78:0/2078551148 shutdown_connections 2024-09-18T13:06:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.586+0000 7f11487b1640 1 --2- 172.21.15.78:0/2078551148 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f112c07af30 0x7f112c07d3f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.586+0000 7f11487b1640 1 --2- 172.21.15.78:0/2078551148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1140074eb0 0x7f114019e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.586+0000 7f11487b1640 1 --2- 172.21.15.78:0/2078551148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1140074590 0x7f114019dfe0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.586+0000 7f11487b1640 1 -- 172.21.15.78:0/2078551148 >> 172.21.15.78:0/2078551148 conn(0x7f11400fd600 msgr2=0x7f1140104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.586+0000 7f11487b1640 1 -- 172.21.15.78:0/2078551148 shutdown_connections 2024-09-18T13:06:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.586+0000 7f11487b1640 1 -- 172.21.15.78:0/2078551148 wait complete. 2024-09-18T13:06:45.689 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:06:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.670+0000 7f6d436c0640 1 -- 172.21.15.78:0/2557540735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c107900 msgr2=0x7f6d3c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.670+0000 7f6d436c0640 1 --2- 172.21.15.78:0/2557540735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c107900 0x7f6d3c107ce0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009880 tx=0x7f6d3802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.670+0000 7f6d436c0640 1 -- 172.21.15.78:0/2557540735 shutdown_connections 2024-09-18T13:06:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.670+0000 7f6d436c0640 1 --2- 172.21.15.78:0/2557540735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d3c101900 0x7f6d3c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.670+0000 7f6d436c0640 1 --2- 172.21.15.78:0/2557540735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c107900 0x7f6d3c107ce0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.670+0000 7f6d436c0640 1 -- 172.21.15.78:0/2557540735 >> 172.21.15.78:0/2557540735 conn(0x7f6d3c0fd600 msgr2=0x7f6d3c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.670+0000 7f6d436c0640 1 -- 172.21.15.78:0/2557540735 shutdown_connections 2024-09-18T13:06:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.670+0000 7f6d436c0640 1 -- 172.21.15.78:0/2557540735 wait complete. 2024-09-18T13:06:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.670+0000 7f6d436c0640 1 Processor -- start 2024-09-18T13:06:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.670+0000 7f6d436c0640 1 -- start start 2024-09-18T13:06:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.671+0000 7f6d436c0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d3c101900 0x7f6d3c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.671+0000 7f6d436c0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c107900 0x7f6d3c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.671+0000 7f6d436c0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c10edb0 con 0x7f6d3c107900 2024-09-18T13:06:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.671+0000 7f6d436c0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c10ec30 con 0x7f6d3c101900 2024-09-18T13:06:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.671+0000 7f6d40c5b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c107900 0x7f6d3c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.671+0000 7f6d40c5b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c107900 0x7f6d3c19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43038/0 (socket says 172.21.15.78:43038) 2024-09-18T13:06:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.671+0000 7f6d40c5b640 1 -- 172.21.15.78:0/1637493354 learned_addr learned my addr 172.21.15.78:0/1637493354 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:06:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.671+0000 7f6d4145c640 1 --2- 172.21.15.78:0/1637493354 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d3c101900 0x7f6d3c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.671+0000 7f6d40c5b640 1 -- 172.21.15.78:0/1637493354 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d3c101900 msgr2=0x7f6d3c19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.671+0000 7f6d40c5b640 1 --2- 172.21.15.78:0/1637493354 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d3c101900 0x7f6d3c19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.671+0000 7f6d40c5b640 1 -- 172.21.15.78:0/1637493354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3c1977e0 con 0x7f6d3c107900 2024-09-18T13:06:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.671+0000 7f6d40c5b640 1 --2- 172.21.15.78:0/1637493354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c107900 0x7f6d3c19dba0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00c8a0 tx=0x7f6d2c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.671+0000 7f6d327fc640 1 -- 172.21.15.78:0/1637493354 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d2c0079b0 con 0x7f6d3c107900 2024-09-18T13:06:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.672+0000 7f6d327fc640 1 -- 172.21.15.78:0/1637493354 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d2c007b50 con 0x7f6d3c107900 2024-09-18T13:06:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.672+0000 7f6d436c0640 1 -- 172.21.15.78:0/1637493354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d3c197ad0 con 0x7f6d3c107900 2024-09-18T13:06:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.672+0000 7f6d327fc640 1 -- 172.21.15.78:0/1637493354 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d2c018700 con 0x7f6d3c107900 2024-09-18T13:06:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.672+0000 7f6d436c0640 1 -- 172.21.15.78:0/1637493354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d3c198060 con 0x7f6d3c107900 2024-09-18T13:06:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.672+0000 7f6d436c0640 1 -- 172.21.15.78:0/1637493354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3c103040 con 0x7f6d3c107900 2024-09-18T13:06:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.673+0000 7f6d327fc640 1 -- 172.21.15.78:0/1637493354 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6d2c007d00 con 0x7f6d3c107900 2024-09-18T13:06:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.674+0000 7f6d327fc640 1 --2- 172.21.15.78:0/1637493354 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6d2807af30 0x7f6d2807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.674+0000 7f6d4145c640 1 --2- 172.21.15.78:0/1637493354 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6d2807af30 0x7f6d2807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.674+0000 7f6d327fc640 1 -- 172.21.15.78:0/1637493354 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f6d2c09e370 con 0x7f6d3c107900 2024-09-18T13:06:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.674+0000 7f6d4145c640 1 --2- 172.21.15.78:0/1637493354 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6d2807af30 0x7f6d2807d3f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6d38031460 tx=0x7f6d38005bd0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:45.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.678+0000 7f6d327fc640 1 -- 172.21.15.78:0/1637493354 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6d2c014030 con 0x7f6d3c107900 2024-09-18T13:06:45.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.875+0000 7f6d436c0640 1 -- 172.21.15.78:0/1637493354 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6d3c198370 con 0x7f6d2807af30 2024-09-18T13:06:45.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.876+0000 7f6d327fc640 1 -- 172.21.15.78:0/1637493354 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6d3c198370 con 0x7f6d2807af30 2024-09-18T13:06:45.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.878+0000 7f6d436c0640 1 -- 172.21.15.78:0/1637493354 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6d2807af30 msgr2=0x7f6d2807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:45.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.878+0000 7f6d436c0640 1 --2- 172.21.15.78:0/1637493354 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6d2807af30 0x7f6d2807d3f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6d38031460 tx=0x7f6d38005bd0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.878+0000 7f6d436c0640 1 -- 172.21.15.78:0/1637493354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c107900 msgr2=0x7f6d3c19dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:45.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.878+0000 7f6d436c0640 1 --2- 172.21.15.78:0/1637493354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c107900 0x7f6d3c19dba0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00c8a0 tx=0x7f6d2c00cd60 comp rx=0 tx=0).stop 2024-09-18T13:06:45.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.878+0000 7f6d436c0640 1 -- 172.21.15.78:0/1637493354 shutdown_connections 2024-09-18T13:06:45.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.878+0000 7f6d436c0640 1 --2- 172.21.15.78:0/1637493354 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6d2807af30 0x7f6d2807d3f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.878+0000 7f6d436c0640 1 --2- 172.21.15.78:0/1637493354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c107900 0x7f6d3c19dba0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.878+0000 7f6d436c0640 1 --2- 172.21.15.78:0/1637493354 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d3c101900 0x7f6d3c19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.878+0000 7f6d436c0640 1 -- 172.21.15.78:0/1637493354 >> 172.21.15.78:0/1637493354 conn(0x7f6d3c0fd600 msgr2=0x7f6d3c0fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:45.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.878+0000 7f6d436c0640 1 -- 172.21.15.78:0/1637493354 shutdown_connections 2024-09-18T13:06:45.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.879+0000 7f6d436c0640 1 -- 172.21.15.78:0/1637493354 wait complete. 2024-09-18T13:06:45.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.959+0000 7f741b3e5640 1 -- 172.21.15.78:0/1423699545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74141033d0 msgr2=0x7f741410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:45.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.959+0000 7f741b3e5640 1 --2- 172.21.15.78:0/1423699545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74141033d0 0x7f741410b8c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7408009880 tx=0x7f740802a530 comp rx=0 tx=0).stop 2024-09-18T13:06:45.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.959+0000 7f741b3e5640 1 -- 172.21.15.78:0/1423699545 shutdown_connections 2024-09-18T13:06:45.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.959+0000 7f741b3e5640 1 --2- 172.21.15.78:0/1423699545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74141033d0 0x7f741410b8c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.959+0000 7f741b3e5640 1 --2- 172.21.15.78:0/1423699545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7414102ab0 0x7f7414102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.959+0000 7f741b3e5640 1 -- 172.21.15.78:0/1423699545 >> 172.21.15.78:0/1423699545 conn(0x7f74140fc550 msgr2=0x7f74140fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:45.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.960+0000 7f741b3e5640 1 -- 172.21.15.78:0/1423699545 shutdown_connections 2024-09-18T13:06:45.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.960+0000 7f741b3e5640 1 -- 172.21.15.78:0/1423699545 wait complete. 2024-09-18T13:06:45.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.960+0000 7f741b3e5640 1 Processor -- start 2024-09-18T13:06:45.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.960+0000 7f741b3e5640 1 -- start start 2024-09-18T13:06:45.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.960+0000 7f741b3e5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7414102ab0 0x7f741419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:45.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.960+0000 7f741b3e5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74141033d0 0x7f741419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:45.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.961+0000 7f741b3e5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f741410ede0 con 0x7f7414102ab0 2024-09-18T13:06:45.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.961+0000 7f741b3e5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f741410ec60 con 0x7f74141033d0 2024-09-18T13:06:45.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.961+0000 7f7419181640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7414102ab0 0x7f741419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:45.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.961+0000 7f7419181640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7414102ab0 0x7f741419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43052/0 (socket says 172.21.15.78:43052) 2024-09-18T13:06:45.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.961+0000 7f7419181640 1 -- 172.21.15.78:0/208281577 learned_addr learned my addr 172.21.15.78:0/208281577 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:06:45.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.961+0000 7f7418980640 1 --2- 172.21.15.78:0/208281577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74141033d0 0x7f741419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:45.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.961+0000 7f7419181640 1 -- 172.21.15.78:0/208281577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74141033d0 msgr2=0x7f741419dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:45.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.961+0000 7f7419181640 1 --2- 172.21.15.78:0/208281577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74141033d0 0x7f741419dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:45.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.961+0000 7f7419181640 1 -- 172.21.15.78:0/208281577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7414197810 con 0x7f7414102ab0 2024-09-18T13:06:45.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.961+0000 7f7419181640 1 --2- 172.21.15.78:0/208281577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7414102ab0 0x7f741419d690 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f740400d6f0 tx=0x7f740400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:45.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.961+0000 7f74127fc640 1 -- 172.21.15.78:0/208281577 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7404017070 con 0x7f7414102ab0 2024-09-18T13:06:45.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.961+0000 7f741b3e5640 1 -- 172.21.15.78:0/208281577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7414197b00 con 0x7f7414102ab0 2024-09-18T13:06:45.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.961+0000 7f74127fc640 1 -- 172.21.15.78:0/208281577 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f740400de00 con 0x7f7414102ab0 2024-09-18T13:06:45.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.962+0000 7f74127fc640 1 -- 172.21.15.78:0/208281577 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7404004bb0 con 0x7f7414102ab0 2024-09-18T13:06:45.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.962+0000 7f741b3e5640 1 -- 172.21.15.78:0/208281577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7414198060 con 0x7f7414102ab0 2024-09-18T13:06:45.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.962+0000 7f741b3e5640 1 -- 172.21.15.78:0/208281577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f741406a580 con 0x7f7414102ab0 2024-09-18T13:06:45.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.964+0000 7f74127fc640 1 -- 172.21.15.78:0/208281577 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7404004e60 con 0x7f7414102ab0 2024-09-18T13:06:45.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.964+0000 7f74127fc640 1 --2- 172.21.15.78:0/208281577 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f73fc07af30 0x7f73fc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:45.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.964+0000 7f74127fc640 1 -- 172.21.15.78:0/208281577 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f740409dc00 con 0x7f7414102ab0 2024-09-18T13:06:45.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.964+0000 7f7418980640 1 --2- 172.21.15.78:0/208281577 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f73fc07af30 0x7f73fc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:45.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.965+0000 7f7418980640 1 --2- 172.21.15.78:0/208281577 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f73fc07af30 0x7f73fc07d3f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7414198b60 tx=0x7f7408031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:45.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:45.969+0000 7f74127fc640 1 -- 172.21.15.78:0/208281577 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f74040a3020 con 0x7f7414102ab0 2024-09-18T13:06:46.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.151+0000 7f741b3e5640 1 -- 172.21.15.78:0/208281577 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7414198310 con 0x7f73fc07af30 2024-09-18T13:06:46.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.160+0000 7f74127fc640 1 -- 172.21.15.78:0/208281577 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f7414198310 con 0x7f73fc07af30 2024-09-18T13:06:46.162 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:06:46.162 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (14m) 8m ago 25m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:06:46.162 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (17m) 8m ago 25m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:06:46.162 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (16m) 8m ago 24m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:06:46.162 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (12m) 8m ago 25m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:06:46.162 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (12m) 8m ago 24m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:06:46.162 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (14m) 8m ago 25m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:06:46.162 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (9m) 8m ago 20m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:06:46.162 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (8m) 8m ago 20m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:06:46.162 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (8m) 8m ago 20m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:06:46.163 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (8m) 8m ago 20m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:06:46.163 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (16m) 8m ago 26m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:06:46.163 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (15m) 8m ago 24m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:06:46.163 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (13m) 8m ago 27m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:06:46.163 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (13m) 8m ago 24m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:06:46.163 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (15m) 8m ago 25m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:06:46.163 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (15m) 8m ago 24m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:06:46.163 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (12m) 8m ago 23m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:06:46.163 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (11m) 8m ago 23m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:06:46.163 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (11m) 8m ago 22m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:06:46.163 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (10m) 8m ago 22m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:06:46.164 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (10m) 8m ago 21m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:06:46.164 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (9m) 8m ago 21m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:06:46.164 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (14m) 8m ago 25m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:06:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.162+0000 7f741b3e5640 1 -- 172.21.15.78:0/208281577 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f73fc07af30 msgr2=0x7f73fc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.162+0000 7f741b3e5640 1 --2- 172.21.15.78:0/208281577 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f73fc07af30 0x7f73fc07d3f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7414198b60 tx=0x7f7408031400 comp rx=0 tx=0).stop 2024-09-18T13:06:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.162+0000 7f741b3e5640 1 -- 172.21.15.78:0/208281577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7414102ab0 msgr2=0x7f741419d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.162+0000 7f741b3e5640 1 --2- 172.21.15.78:0/208281577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7414102ab0 0x7f741419d690 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f740400d6f0 tx=0x7f740400dbb0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.162+0000 7f741b3e5640 1 -- 172.21.15.78:0/208281577 shutdown_connections 2024-09-18T13:06:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.162+0000 7f741b3e5640 1 --2- 172.21.15.78:0/208281577 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f73fc07af30 0x7f73fc07d3f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.162+0000 7f741b3e5640 1 --2- 172.21.15.78:0/208281577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74141033d0 0x7f741419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.162+0000 7f741b3e5640 1 --2- 172.21.15.78:0/208281577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7414102ab0 0x7f741419d690 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.162+0000 7f741b3e5640 1 -- 172.21.15.78:0/208281577 >> 172.21.15.78:0/208281577 conn(0x7f74140fc550 msgr2=0x7f7414108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.163+0000 7f741b3e5640 1 -- 172.21.15.78:0/208281577 shutdown_connections 2024-09-18T13:06:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.163+0000 7f741b3e5640 1 -- 172.21.15.78:0/208281577 wait complete. 2024-09-18T13:06:46.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.242+0000 7f19fb99a640 1 -- 172.21.15.78:0/1348118812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f4101540 msgr2=0x7f19f4101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:46.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.242+0000 7f19fb99a640 1 --2- 172.21.15.78:0/1348118812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f4101540 0x7f19f4101920 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009880 tx=0x7f19f002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.242+0000 7f19fb99a640 1 -- 172.21.15.78:0/1348118812 shutdown_connections 2024-09-18T13:06:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.242+0000 7f19fb99a640 1 --2- 172.21.15.78:0/1348118812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19f4101ef0 0x7f19f41054a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.242+0000 7f19fb99a640 1 --2- 172.21.15.78:0/1348118812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f4101540 0x7f19f4101920 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.242+0000 7f19fb99a640 1 -- 172.21.15.78:0/1348118812 >> 172.21.15.78:0/1348118812 conn(0x7f19f40771e0 msgr2=0x7f19f40775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.242+0000 7f19fb99a640 1 -- 172.21.15.78:0/1348118812 shutdown_connections 2024-09-18T13:06:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.242+0000 7f19fb99a640 1 -- 172.21.15.78:0/1348118812 wait complete. 2024-09-18T13:06:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.243+0000 7f19fb99a640 1 Processor -- start 2024-09-18T13:06:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.243+0000 7f19fb99a640 1 -- start start 2024-09-18T13:06:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.243+0000 7f19fb99a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f4101540 0x7f19f4102540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.243+0000 7f19fb99a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19f4101ef0 0x7f19f4102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:46.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.243+0000 7f19fb99a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f19f410dcd0 con 0x7f19f4101540 2024-09-18T13:06:46.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.243+0000 7f19fb99a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f19f410db50 con 0x7f19f4101ef0 2024-09-18T13:06:46.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.243+0000 7f19f9736640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f4101540 0x7f19f4102540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:46.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.243+0000 7f19f9736640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f4101540 0x7f19f4102540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43066/0 (socket says 172.21.15.78:43066) 2024-09-18T13:06:46.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.243+0000 7f19f9736640 1 -- 172.21.15.78:0/1642424476 learned_addr learned my addr 172.21.15.78:0/1642424476 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:06:46.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.244+0000 7f19f8f35640 1 --2- 172.21.15.78:0/1642424476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19f4101ef0 0x7f19f4102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:46.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.244+0000 7f19f9736640 1 -- 172.21.15.78:0/1642424476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19f4101ef0 msgr2=0x7f19f4102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:46.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.244+0000 7f19f9736640 1 --2- 172.21.15.78:0/1642424476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19f4101ef0 0x7f19f4102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.244+0000 7f19f9736640 1 -- 172.21.15.78:0/1642424476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f4102fc0 con 0x7f19f4101540 2024-09-18T13:06:46.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.244+0000 7f19f9736640 1 --2- 172.21.15.78:0/1642424476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f4101540 0x7f19f4102540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f19f0031460 tx=0x7f19f00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:46.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.244+0000 7f19ea7fc640 1 -- 172.21.15.78:0/1642424476 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19f003f070 con 0x7f19f4101540 2024-09-18T13:06:46.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.244+0000 7f19ea7fc640 1 -- 172.21.15.78:0/1642424476 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f19f00035f0 con 0x7f19f4101540 2024-09-18T13:06:46.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.244+0000 7f19fb99a640 1 -- 172.21.15.78:0/1642424476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f4103250 con 0x7f19f4101540 2024-09-18T13:06:46.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.244+0000 7f19fb99a640 1 -- 172.21.15.78:0/1642424476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f41a3d40 con 0x7f19f4101540 2024-09-18T13:06:46.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.244+0000 7f19ea7fc640 1 -- 172.21.15.78:0/1642424476 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19f0035030 con 0x7f19f4101540 2024-09-18T13:06:46.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.245+0000 7f19fb99a640 1 -- 172.21.15.78:0/1642424476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f40698d0 con 0x7f19f4101540 2024-09-18T13:06:46.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.246+0000 7f19ea7fc640 1 -- 172.21.15.78:0/1642424476 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f19f0042070 con 0x7f19f4101540 2024-09-18T13:06:46.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.246+0000 7f19ea7fc640 1 --2- 172.21.15.78:0/1642424476 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f19e007af80 0x7f19e007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:46.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.247+0000 7f19f8f35640 1 --2- 172.21.15.78:0/1642424476 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f19e007af80 0x7f19e007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:46.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.247+0000 7f19ea7fc640 1 -- 172.21.15.78:0/1642424476 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f19f00be8c0 con 0x7f19f4101540 2024-09-18T13:06:46.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.247+0000 7f19f8f35640 1 --2- 172.21.15.78:0/1642424476 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f19e007af80 0x7f19e007d440 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f19f4103fd0 tx=0x7f19e400b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:46.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.251+0000 7f19ea7fc640 1 -- 172.21.15.78:0/1642424476 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f19f0089ee0 con 0x7f19f4101540 2024-09-18T13:06:46.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.493+0000 7f19fb99a640 1 -- 172.21.15.78:0/1642424476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f19f4109da0 con 0x7f19f4101540 2024-09-18T13:06:46.494 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:46 smithi078 ceph-mon[108578]: pgmap v528: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:46.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.493+0000 7f19ea7fc640 1 -- 172.21.15.78:0/1642424476 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f19f008ed90 con 0x7f19f4101540 2024-09-18T13:06:46.495 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:06:46.495 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:06:46.495 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:06:46.495 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:06:46.495 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:06:46.495 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:06:46.495 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:06:46.495 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:06:46.495 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:06:46.495 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:06:46.496 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:06:46.496 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:06:46.496 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:06:46.496 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:06:46.496 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:06:46.496 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:06:46.496 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:06:46.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.496+0000 7f19fb99a640 1 -- 172.21.15.78:0/1642424476 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f19e007af80 msgr2=0x7f19e007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:46.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.496+0000 7f19fb99a640 1 --2- 172.21.15.78:0/1642424476 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f19e007af80 0x7f19e007d440 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f19f4103fd0 tx=0x7f19e400b390 comp rx=0 tx=0).stop 2024-09-18T13:06:46.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.496+0000 7f19fb99a640 1 -- 172.21.15.78:0/1642424476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f4101540 msgr2=0x7f19f4102540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:46.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.496+0000 7f19fb99a640 1 --2- 172.21.15.78:0/1642424476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f4101540 0x7f19f4102540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f19f0031460 tx=0x7f19f00045e0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.496+0000 7f19fb99a640 1 -- 172.21.15.78:0/1642424476 shutdown_connections 2024-09-18T13:06:46.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.496+0000 7f19fb99a640 1 --2- 172.21.15.78:0/1642424476 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f19e007af80 0x7f19e007d440 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.496+0000 7f19fb99a640 1 --2- 172.21.15.78:0/1642424476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19f4101ef0 0x7f19f4102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.496+0000 7f19fb99a640 1 --2- 172.21.15.78:0/1642424476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f4101540 0x7f19f4102540 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.496+0000 7f19fb99a640 1 -- 172.21.15.78:0/1642424476 >> 172.21.15.78:0/1642424476 conn(0x7f19f40771e0 msgr2=0x7f19f4104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:46.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.496+0000 7f19fb99a640 1 -- 172.21.15.78:0/1642424476 shutdown_connections 2024-09-18T13:06:46.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.496+0000 7f19fb99a640 1 -- 172.21.15.78:0/1642424476 wait complete. 2024-09-18T13:06:46.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.577+0000 7fc19de0b640 1 -- 172.21.15.78:0/3652618459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc198102ac0 msgr2=0x7fc198102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:46.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.577+0000 7fc19de0b640 1 --2- 172.21.15.78:0/3652618459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc198102ac0 0x7fc198102ea0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc188009880 tx=0x7fc18802a530 comp rx=0 tx=0).stop 2024-09-18T13:06:46.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.577+0000 7fc19de0b640 1 -- 172.21.15.78:0/3652618459 shutdown_connections 2024-09-18T13:06:46.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.577+0000 7fc19de0b640 1 --2- 172.21.15.78:0/3652618459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1981033e0 0x7fc19810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.577+0000 7fc19de0b640 1 --2- 172.21.15.78:0/3652618459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc198102ac0 0x7fc198102ea0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.577+0000 7fc19de0b640 1 -- 172.21.15.78:0/3652618459 >> 172.21.15.78:0/3652618459 conn(0x7fc1980fc520 msgr2=0x7fc1980fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:46.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.577+0000 7fc19de0b640 1 -- 172.21.15.78:0/3652618459 shutdown_connections 2024-09-18T13:06:46.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.577+0000 7fc19de0b640 1 -- 172.21.15.78:0/3652618459 wait complete. 2024-09-18T13:06:46.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.578+0000 7fc19de0b640 1 Processor -- start 2024-09-18T13:06:46.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.578+0000 7fc19de0b640 1 -- start start 2024-09-18T13:06:46.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.578+0000 7fc19de0b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc198102ac0 0x7fc19819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:46.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.578+0000 7fc19de0b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1981033e0 0x7fc19819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.578+0000 7fc19de0b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc19810ee50 con 0x7fc1981033e0 2024-09-18T13:06:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.578+0000 7fc19de0b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc19810ecd0 con 0x7fc198102ac0 2024-09-18T13:06:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.578+0000 7fc196ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1981033e0 0x7fc19819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.578+0000 7fc196ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1981033e0 0x7fc19819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43082/0 (socket says 172.21.15.78:43082) 2024-09-18T13:06:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.578+0000 7fc196ffd640 1 -- 172.21.15.78:0/2413391470 learned_addr learned my addr 172.21.15.78:0/2413391470 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:06:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.578+0000 7fc1977fe640 1 --2- 172.21.15.78:0/2413391470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc198102ac0 0x7fc19819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.578+0000 7fc196ffd640 1 -- 172.21.15.78:0/2413391470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc198102ac0 msgr2=0x7fc19819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.578+0000 7fc196ffd640 1 --2- 172.21.15.78:0/2413391470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc198102ac0 0x7fc19819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.578+0000 7fc196ffd640 1 -- 172.21.15.78:0/2413391470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc198197860 con 0x7fc1981033e0 2024-09-18T13:06:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.578+0000 7fc1977fe640 1 --2- 172.21.15.78:0/2413391470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc198102ac0 0x7fc19819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:06:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.579+0000 7fc196ffd640 1 --2- 172.21.15.78:0/2413391470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1981033e0 0x7fc19819dbe0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00b370 tx=0x7fc18c00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.579+0000 7fc194ff9640 1 -- 172.21.15.78:0/2413391470 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc18c015020 con 0x7fc1981033e0 2024-09-18T13:06:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.579+0000 7fc194ff9640 1 -- 172.21.15.78:0/2413391470 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc18c011af0 con 0x7fc1981033e0 2024-09-18T13:06:46.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.579+0000 7fc19de0b640 1 -- 172.21.15.78:0/2413391470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc198197b50 con 0x7fc1981033e0 2024-09-18T13:06:46.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.579+0000 7fc194ff9640 1 -- 172.21.15.78:0/2413391470 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc18c010d60 con 0x7fc1981033e0 2024-09-18T13:06:46.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.579+0000 7fc19de0b640 1 -- 172.21.15.78:0/2413391470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1981980e0 con 0x7fc1981033e0 2024-09-18T13:06:46.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.580+0000 7fc19de0b640 1 -- 172.21.15.78:0/2413391470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc19806aa90 con 0x7fc1981033e0 2024-09-18T13:06:46.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.581+0000 7fc194ff9640 1 -- 172.21.15.78:0/2413391470 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc18c018020 con 0x7fc1981033e0 2024-09-18T13:06:46.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.581+0000 7fc194ff9640 1 --2- 172.21.15.78:0/2413391470 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc18007af30 0x7fc18007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:46.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.581+0000 7fc194ff9640 1 -- 172.21.15.78:0/2413391470 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fc18c09da00 con 0x7fc1981033e0 2024-09-18T13:06:46.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.581+0000 7fc1977fe640 1 --2- 172.21.15.78:0/2413391470 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc18007af30 0x7fc18007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:46.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.582+0000 7fc1977fe640 1 --2- 172.21.15.78:0/2413391470 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc18007af30 0x7fc18007d3f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc188006010 tx=0x7fc188004220 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:46.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.585+0000 7fc194ff9640 1 -- 172.21.15.78:0/2413391470 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc18c01f020 con 0x7fc1981033e0 2024-09-18T13:06:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:46 smithi148 ceph-mon[80030]: pgmap v528: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:46.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.797+0000 7fc19de0b640 1 -- 172.21.15.78:0/2413391470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc198105ff0 con 0x7fc1981033e0 2024-09-18T13:06:46.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.797+0000 7fc194ff9640 1 -- 172.21.15.78:0/2413391470 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7fc18c068fa0 con 0x7fc1981033e0 2024-09-18T13:06:46.799 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:06:46.799 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:06:46.799 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:06:46.799 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:06:46.799 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:06:46.799 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:06:46.799 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:06:46.799 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:06:46.799 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:06:46.799 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:06:46.800 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:06:46.800 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:06:46.800 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:06:46.800 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:06:46.800 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:06:46.800 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:06:46.800 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:06:46.800 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:06:46.800 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:06:46.800 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:06:46.800 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:06:46.800 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:06:46.800 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:06:46.801 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:06:46.801 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:06:46.801 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:06:46.801 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:06:46.801 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:06:46.801 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:06:46.801 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:06:46.801 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:06:46.801 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:06:46.801 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:06:46.801 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:06:46.801 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:06:46.801 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:06:46.801 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:06:46.802 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:06:46.802 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:06:46.802 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:06:46.802 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:06:46.802 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:06:46.802 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:06:46.802 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:06:46.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.800+0000 7fc19de0b640 1 -- 172.21.15.78:0/2413391470 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc18007af30 msgr2=0x7fc18007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:46.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.800+0000 7fc19de0b640 1 --2- 172.21.15.78:0/2413391470 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc18007af30 0x7fc18007d3f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc188006010 tx=0x7fc188004220 comp rx=0 tx=0).stop 2024-09-18T13:06:46.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.800+0000 7fc19de0b640 1 -- 172.21.15.78:0/2413391470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1981033e0 msgr2=0x7fc19819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:46.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.800+0000 7fc19de0b640 1 --2- 172.21.15.78:0/2413391470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1981033e0 0x7fc19819dbe0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00b370 tx=0x7fc18c00b830 comp rx=0 tx=0).stop 2024-09-18T13:06:46.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.800+0000 7fc19de0b640 1 -- 172.21.15.78:0/2413391470 shutdown_connections 2024-09-18T13:06:46.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.800+0000 7fc19de0b640 1 --2- 172.21.15.78:0/2413391470 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc18007af30 0x7fc18007d3f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.800+0000 7fc19de0b640 1 --2- 172.21.15.78:0/2413391470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1981033e0 0x7fc19819dbe0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.800+0000 7fc19de0b640 1 --2- 172.21.15.78:0/2413391470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc198102ac0 0x7fc19819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.800+0000 7fc19de0b640 1 -- 172.21.15.78:0/2413391470 >> 172.21.15.78:0/2413391470 conn(0x7fc1980fc520 msgr2=0x7fc198108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:46.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.801+0000 7fc19de0b640 1 -- 172.21.15.78:0/2413391470 shutdown_connections 2024-09-18T13:06:46.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.801+0000 7fc19de0b640 1 -- 172.21.15.78:0/2413391470 wait complete. 2024-09-18T13:06:46.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.884+0000 7f60914e8640 1 -- 172.21.15.78:0/3068782057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f608c100800 msgr2=0x7f608c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:46.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.884+0000 7f60914e8640 1 --2- 172.21.15.78:0/3068782057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f608c100800 0x7f608c100c60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6080009880 tx=0x7f608002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.884+0000 7f60914e8640 1 -- 172.21.15.78:0/3068782057 shutdown_connections 2024-09-18T13:06:46.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.884+0000 7f60914e8640 1 --2- 172.21.15.78:0/3068782057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f608c100800 0x7f608c100c60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.884+0000 7f60914e8640 1 --2- 172.21.15.78:0/3068782057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f608c106800 0x7f608c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.884+0000 7f60914e8640 1 -- 172.21.15.78:0/3068782057 >> 172.21.15.78:0/3068782057 conn(0x7f608c0fc520 msgr2=0x7f608c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.884+0000 7f60914e8640 1 -- 172.21.15.78:0/3068782057 shutdown_connections 2024-09-18T13:06:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.884+0000 7f60914e8640 1 -- 172.21.15.78:0/3068782057 wait complete. 2024-09-18T13:06:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.884+0000 7f60914e8640 1 Processor -- start 2024-09-18T13:06:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.885+0000 7f60914e8640 1 -- start start 2024-09-18T13:06:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.885+0000 7f60914e8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f608c100800 0x7f608c0fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.885+0000 7f60914e8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f608c106800 0x7f608c0fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.885+0000 7f60914e8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f608c10dcb0 con 0x7f608c100800 2024-09-18T13:06:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.885+0000 7f60914e8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f608c10db30 con 0x7f608c106800 2024-09-18T13:06:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.885+0000 7f608affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f608c100800 0x7f608c0fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.885+0000 7f608affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f608c100800 0x7f608c0fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43094/0 (socket says 172.21.15.78:43094) 2024-09-18T13:06:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.885+0000 7f608affd640 1 -- 172.21.15.78:0/3418239900 learned_addr learned my addr 172.21.15.78:0/3418239900 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:06:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.885+0000 7f608a7fc640 1 --2- 172.21.15.78:0/3418239900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f608c106800 0x7f608c0fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.885+0000 7f608affd640 1 -- 172.21.15.78:0/3418239900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f608c106800 msgr2=0x7f608c0fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.885+0000 7f608affd640 1 --2- 172.21.15.78:0/3418239900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f608c106800 0x7f608c0fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.885+0000 7f608affd640 1 -- 172.21.15.78:0/3418239900 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608c0fd650 con 0x7f608c100800 2024-09-18T13:06:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.885+0000 7f608a7fc640 1 --2- 172.21.15.78:0/3418239900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f608c106800 0x7f608c0fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:06:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.885+0000 7f608affd640 1 --2- 172.21.15.78:0/3418239900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f608c100800 0x7f608c0fcbd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f607c00c8a0 tx=0x7f607c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.886+0000 7f6073fff640 1 -- 172.21.15.78:0/3418239900 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f607c0079b0 con 0x7f608c100800 2024-09-18T13:06:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.886+0000 7f60914e8640 1 -- 172.21.15.78:0/3418239900 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608c0fd940 con 0x7f608c100800 2024-09-18T13:06:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.886+0000 7f6073fff640 1 -- 172.21.15.78:0/3418239900 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f607c007b50 con 0x7f608c100800 2024-09-18T13:06:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.886+0000 7f6073fff640 1 -- 172.21.15.78:0/3418239900 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f607c018700 con 0x7f608c100800 2024-09-18T13:06:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.886+0000 7f60914e8640 1 -- 172.21.15.78:0/3418239900 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f608c1a3dc0 con 0x7f608c100800 2024-09-18T13:06:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.887+0000 7f60914e8640 1 -- 172.21.15.78:0/3418239900 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f608c101f40 con 0x7f608c100800 2024-09-18T13:06:46.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.887+0000 7f6073fff640 1 -- 172.21.15.78:0/3418239900 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f607c007d00 con 0x7f608c100800 2024-09-18T13:06:46.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.888+0000 7f6073fff640 1 --2- 172.21.15.78:0/3418239900 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f607407af30 0x7f607407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:46.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.888+0000 7f6073fff640 1 -- 172.21.15.78:0/3418239900 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f607c09e410 con 0x7f608c100800 2024-09-18T13:06:46.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.888+0000 7f608a7fc640 1 --2- 172.21.15.78:0/3418239900 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f607407af30 0x7f607407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:46.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.888+0000 7f608a7fc640 1 --2- 172.21.15.78:0/3418239900 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f607407af30 0x7f607407d3f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6080006010 tx=0x7f60800095f0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:46.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:46.892+0000 7f6073fff640 1 -- 172.21.15.78:0/3418239900 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f607c014030 con 0x7f608c100800 2024-09-18T13:06:47.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.083+0000 7f60914e8640 1 -- 172.21.15.78:0/3418239900 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f608c062630 con 0x7f607407af30 2024-09-18T13:06:47.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.084+0000 7f6073fff640 1 -- 172.21.15.78:0/3418239900 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f608c062630 con 0x7f607407af30 2024-09-18T13:06:47.085 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:06:47.085 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:06:47.085 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:06:47.085 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:06:47.085 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:06:47.085 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:06:47.085 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:06:47.085 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:06:47.086 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:06:47.086 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:06:47.086 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:06:47.086 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:06:47.086 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:06:47.086 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:06:47.086 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:06:47.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.086+0000 7f60914e8640 1 -- 172.21.15.78:0/3418239900 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f607407af30 msgr2=0x7f607407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:47.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.086+0000 7f60914e8640 1 --2- 172.21.15.78:0/3418239900 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f607407af30 0x7f607407d3f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6080006010 tx=0x7f60800095f0 comp rx=0 tx=0).stop 2024-09-18T13:06:47.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.086+0000 7f60914e8640 1 -- 172.21.15.78:0/3418239900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f608c100800 msgr2=0x7f608c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:47.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.086+0000 7f60914e8640 1 --2- 172.21.15.78:0/3418239900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f608c100800 0x7f608c0fcbd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f607c00c8a0 tx=0x7f607c00cd60 comp rx=0 tx=0).stop 2024-09-18T13:06:47.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.086+0000 7f60914e8640 1 -- 172.21.15.78:0/3418239900 shutdown_connections 2024-09-18T13:06:47.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.086+0000 7f60914e8640 1 --2- 172.21.15.78:0/3418239900 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f607407af30 0x7f607407d3f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:47.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.086+0000 7f60914e8640 1 --2- 172.21.15.78:0/3418239900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f608c106800 0x7f608c0fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:47.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.086+0000 7f60914e8640 1 --2- 172.21.15.78:0/3418239900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f608c100800 0x7f608c0fcbd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:47.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.086+0000 7f60914e8640 1 -- 172.21.15.78:0/3418239900 >> 172.21.15.78:0/3418239900 conn(0x7f608c0fc520 msgr2=0x7f608c06a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:47.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.086+0000 7f60914e8640 1 -- 172.21.15.78:0/3418239900 shutdown_connections 2024-09-18T13:06:47.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.086+0000 7f60914e8640 1 -- 172.21.15.78:0/3418239900 wait complete. 2024-09-18T13:06:47.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.168+0000 7fe52268d640 1 -- 172.21.15.78:0/1503571818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe51c1007f0 msgr2=0x7fe51c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:47.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.168+0000 7fe52268d640 1 --2- 172.21.15.78:0/1503571818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe51c1007f0 0x7fe51c100c50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe510009880 tx=0x7fe51002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:06:47.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.169+0000 7fe52268d640 1 -- 172.21.15.78:0/1503571818 shutdown_connections 2024-09-18T13:06:47.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.169+0000 7fe52268d640 1 --2- 172.21.15.78:0/1503571818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe51c1007f0 0x7fe51c100c50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:47.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.169+0000 7fe52268d640 1 --2- 172.21.15.78:0/1503571818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe51c1067f0 0x7fe51c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:47.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.169+0000 7fe52268d640 1 -- 172.21.15.78:0/1503571818 >> 172.21.15.78:0/1503571818 conn(0x7fe51c0fc550 msgr2=0x7fe51c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.169+0000 7fe52268d640 1 -- 172.21.15.78:0/1503571818 shutdown_connections 2024-09-18T13:06:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.169+0000 7fe52268d640 1 -- 172.21.15.78:0/1503571818 wait complete. 2024-09-18T13:06:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.169+0000 7fe52268d640 1 Processor -- start 2024-09-18T13:06:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.169+0000 7fe52268d640 1 -- start start 2024-09-18T13:06:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe52268d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe51c1007f0 0x7fe51c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe52268d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe51c1067f0 0x7fe51c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe52268d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe51c10dcc0 con 0x7fe51c1007f0 2024-09-18T13:06:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe52268d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe51c10db40 con 0x7fe51c1067f0 2024-09-18T13:06:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe51bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe51c1007f0 0x7fe51c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe51bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe51c1007f0 0x7fe51c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43120/0 (socket says 172.21.15.78:43120) 2024-09-18T13:06:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe51bfff640 1 -- 172.21.15.78:0/3161205923 learned_addr learned my addr 172.21.15.78:0/3161205923 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:06:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe51b7fe640 1 --2- 172.21.15.78:0/3161205923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe51c1067f0 0x7fe51c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe51bfff640 1 -- 172.21.15.78:0/3161205923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe51c1067f0 msgr2=0x7fe51c19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:47.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe51bfff640 1 --2- 172.21.15.78:0/3161205923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe51c1067f0 0x7fe51c19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:47.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe51bfff640 1 -- 172.21.15.78:0/3161205923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe51c1977e0 con 0x7fe51c1007f0 2024-09-18T13:06:47.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe51bfff640 1 --2- 172.21.15.78:0/3161205923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe51c1007f0 0x7fe51c19d660 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00d6f0 tx=0x7fe50c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:47.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe5197fa640 1 -- 172.21.15.78:0/3161205923 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe50c017070 con 0x7fe51c1007f0 2024-09-18T13:06:47.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe5197fa640 1 -- 172.21.15.78:0/3161205923 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe50c00de00 con 0x7fe51c1007f0 2024-09-18T13:06:47.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe5197fa640 1 -- 172.21.15.78:0/3161205923 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe50c004bb0 con 0x7fe51c1007f0 2024-09-18T13:06:47.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.170+0000 7fe52268d640 1 -- 172.21.15.78:0/3161205923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe51c197ad0 con 0x7fe51c1007f0 2024-09-18T13:06:47.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.171+0000 7fe52268d640 1 -- 172.21.15.78:0/3161205923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe51c198030 con 0x7fe51c1007f0 2024-09-18T13:06:47.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.171+0000 7fe52268d640 1 -- 172.21.15.78:0/3161205923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe51c101f30 con 0x7fe51c1007f0 2024-09-18T13:06:47.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.172+0000 7fe5197fa640 1 -- 172.21.15.78:0/3161205923 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe50c004e60 con 0x7fe51c1007f0 2024-09-18T13:06:47.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.173+0000 7fe5197fa640 1 --2- 172.21.15.78:0/3161205923 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe50407af40 0x7fe50407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:06:47.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.173+0000 7fe51b7fe640 1 --2- 172.21.15.78:0/3161205923 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe50407af40 0x7fe50407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:06:47.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.173+0000 7fe5197fa640 1 -- 172.21.15.78:0/3161205923 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fe50c09dc00 con 0x7fe51c1007f0 2024-09-18T13:06:47.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.173+0000 7fe51b7fe640 1 --2- 172.21.15.78:0/3161205923 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe50407af40 0x7fe50407d400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe51c198b30 tx=0x7fe510031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:06:47.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.177+0000 7fe5197fa640 1 -- 172.21.15.78:0/3161205923 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe50c0a3020 con 0x7fe51c1007f0 2024-09-18T13:06:47.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.423+0000 7fe52268d640 1 -- 172.21.15.78:0/3161205923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe51c109d70 con 0x7fe51c1007f0 2024-09-18T13:06:47.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.423+0000 7fe5197fa640 1 -- 172.21.15.78:0/3161205923 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fe50c0691a0 con 0x7fe51c1007f0 2024-09-18T13:06:47.425 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:06:47.425 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:06:47.425 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:06:47.425 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:06:47.425 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:06:47.425 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:06:47.425 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:06:47.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.425+0000 7fe52268d640 1 -- 172.21.15.78:0/3161205923 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe50407af40 msgr2=0x7fe50407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:47.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.425+0000 7fe52268d640 1 --2- 172.21.15.78:0/3161205923 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe50407af40 0x7fe50407d400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe51c198b30 tx=0x7fe510031400 comp rx=0 tx=0).stop 2024-09-18T13:06:47.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.425+0000 7fe52268d640 1 -- 172.21.15.78:0/3161205923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe51c1007f0 msgr2=0x7fe51c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:06:47.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.425+0000 7fe52268d640 1 --2- 172.21.15.78:0/3161205923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe51c1007f0 0x7fe51c19d660 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00d6f0 tx=0x7fe50c00dbb0 comp rx=0 tx=0).stop 2024-09-18T13:06:47.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.425+0000 7fe52268d640 1 -- 172.21.15.78:0/3161205923 shutdown_connections 2024-09-18T13:06:47.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.425+0000 7fe52268d640 1 --2- 172.21.15.78:0/3161205923 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe50407af40 0x7fe50407d400 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:47.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.425+0000 7fe52268d640 1 --2- 172.21.15.78:0/3161205923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe51c1067f0 0x7fe51c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:47.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.425+0000 7fe52268d640 1 --2- 172.21.15.78:0/3161205923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe51c1007f0 0x7fe51c19d660 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:06:47.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.425+0000 7fe52268d640 1 -- 172.21.15.78:0/3161205923 >> 172.21.15.78:0/3161205923 conn(0x7fe51c0fc550 msgr2=0x7fe51c069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:06:47.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.425+0000 7fe52268d640 1 -- 172.21.15.78:0/3161205923 shutdown_connections 2024-09-18T13:06:47.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:06:47.425+0000 7fe52268d640 1 -- 172.21.15.78:0/3161205923 wait complete. 2024-09-18T13:06:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:47 smithi148 ceph-mon[80030]: from='client.34806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:47 smithi148 ceph-mon[80030]: from='client.34810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:47 smithi148 ceph-mon[80030]: from='client.34814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:47 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1642424476' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:06:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:47 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2413391470' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:06:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:47 smithi078 ceph-mon[108578]: from='client.34806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:47 smithi078 ceph-mon[108578]: from='client.34810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:47 smithi078 ceph-mon[108578]: from='client.34814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:47 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1642424476' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:06:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:47 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2413391470' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:06:48.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:48 smithi078 ceph-mon[108578]: from='client.34826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:48.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:48 smithi078 ceph-mon[108578]: pgmap v529: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:48.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:48 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3161205923' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:06:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:48 smithi148 ceph-mon[80030]: from='client.34826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:06:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:48 smithi148 ceph-mon[80030]: pgmap v529: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:48 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3161205923' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:06:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:50 smithi148 ceph-mon[80030]: pgmap v530: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:50.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:50 smithi078 ceph-mon[108578]: pgmap v530: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:52 smithi148 ceph-mon[80030]: pgmap v531: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:52.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:52 smithi078 ceph-mon[108578]: pgmap v531: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:54.701 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:54 smithi078 ceph-mon[108578]: pgmap v532: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:54.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:54 smithi148 ceph-mon[80030]: pgmap v532: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:56 smithi148 ceph-mon[80030]: pgmap v533: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:56 smithi078 ceph-mon[108578]: pgmap v533: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:58.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:06:58 smithi078 ceph-mon[108578]: pgmap v534: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:06:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:06:58 smithi148 ceph-mon[80030]: pgmap v534: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:00.710 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:00 smithi078 ceph-mon[108578]: pgmap v535: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:00 smithi148 ceph-mon[80030]: pgmap v535: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:02.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:02 smithi148 ceph-mon[80030]: pgmap v536: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:02 smithi078 ceph-mon[108578]: pgmap v536: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:04 smithi148 ceph-mon[80030]: pgmap v537: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:04 smithi078 ceph-mon[108578]: pgmap v537: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:06.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:06 smithi078 ceph-mon[108578]: pgmap v538: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:06.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:06 smithi148 ceph-mon[80030]: pgmap v538: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:08.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:08 smithi148 ceph-mon[80030]: pgmap v539: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:08.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:08 smithi078 ceph-mon[108578]: pgmap v539: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:10 smithi148 ceph-mon[80030]: pgmap v540: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:10.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:10 smithi078 ceph-mon[108578]: pgmap v540: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:12.707 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:12 smithi078 ceph-mon[108578]: pgmap v541: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:12.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:12 smithi148 ceph-mon[80030]: pgmap v541: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:14 smithi148 ceph-mon[80030]: pgmap v542: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:14 smithi078 ceph-mon[108578]: pgmap v542: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:16.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:16 smithi148 ceph-mon[80030]: pgmap v543: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:16 smithi078 ceph-mon[108578]: pgmap v543: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:17.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.518+0000 7fa591fe9640 1 -- 172.21.15.78:0/3184905971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa58c102ab0 msgr2=0x7fa58c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:17.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.518+0000 7fa591fe9640 1 --2- 172.21.15.78:0/3184905971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa58c102ab0 0x7fa58c102e90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009880 tx=0x7fa57c02a530 comp rx=0 tx=0).stop 2024-09-18T13:07:17.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.518+0000 7fa591fe9640 1 -- 172.21.15.78:0/3184905971 shutdown_connections 2024-09-18T13:07:17.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.518+0000 7fa591fe9640 1 --2- 172.21.15.78:0/3184905971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa58c1033d0 0x7fa58c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:17.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.518+0000 7fa591fe9640 1 --2- 172.21.15.78:0/3184905971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa58c102ab0 0x7fa58c102e90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:17.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.518+0000 7fa591fe9640 1 -- 172.21.15.78:0/3184905971 >> 172.21.15.78:0/3184905971 conn(0x7fa58c0fc4d0 msgr2=0x7fa58c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:17.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.518+0000 7fa591fe9640 1 -- 172.21.15.78:0/3184905971 shutdown_connections 2024-09-18T13:07:17.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.518+0000 7fa591fe9640 1 -- 172.21.15.78:0/3184905971 wait complete. 2024-09-18T13:07:17.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.519+0000 7fa591fe9640 1 Processor -- start 2024-09-18T13:07:17.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.519+0000 7fa591fe9640 1 -- start start 2024-09-18T13:07:17.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.519+0000 7fa591fe9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa58c102ab0 0x7fa58c19d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:17.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.519+0000 7fa591fe9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa58c1033d0 0x7fa58c19dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:17.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.519+0000 7fa591fe9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c10ede0 con 0x7fa58c102ab0 2024-09-18T13:07:17.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.519+0000 7fa591fe9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c10ec60 con 0x7fa58c1033d0 2024-09-18T13:07:17.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.519+0000 7fa58b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa58c102ab0 0x7fa58c19d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.519+0000 7fa58b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa58c102ab0 0x7fa58c19d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53018/0 (socket says 172.21.15.78:53018) 2024-09-18T13:07:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.519+0000 7fa58b7fe640 1 -- 172.21.15.78:0/2386980025 learned_addr learned my addr 172.21.15.78:0/2386980025 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:07:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.519+0000 7fa583fff640 1 --2- 172.21.15.78:0/2386980025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa58c1033d0 0x7fa58c19dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.519+0000 7fa58b7fe640 1 -- 172.21.15.78:0/2386980025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa58c1033d0 msgr2=0x7fa58c19dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.519+0000 7fa58b7fe640 1 --2- 172.21.15.78:0/2386980025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa58c1033d0 0x7fa58c19dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.519+0000 7fa58b7fe640 1 -- 172.21.15.78:0/2386980025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c1978f0 con 0x7fa58c102ab0 2024-09-18T13:07:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.520+0000 7fa58b7fe640 1 --2- 172.21.15.78:0/2386980025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa58c102ab0 0x7fa58c19d730 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa57c031460 tx=0x7fa57c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.520+0000 7fa5897fa640 1 -- 172.21.15.78:0/2386980025 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa57c03f070 con 0x7fa58c102ab0 2024-09-18T13:07:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.520+0000 7fa5897fa640 1 -- 172.21.15.78:0/2386980025 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa57c0035f0 con 0x7fa58c102ab0 2024-09-18T13:07:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.520+0000 7fa591fe9640 1 -- 172.21.15.78:0/2386980025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58c197b80 con 0x7fa58c102ab0 2024-09-18T13:07:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.520+0000 7fa5897fa640 1 -- 172.21.15.78:0/2386980025 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa57c035030 con 0x7fa58c102ab0 2024-09-18T13:07:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.520+0000 7fa591fe9640 1 -- 172.21.15.78:0/2386980025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa58c1980b0 con 0x7fa58c102ab0 2024-09-18T13:07:17.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.521+0000 7fa591fe9640 1 -- 172.21.15.78:0/2386980025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa58c06ada0 con 0x7fa58c102ab0 2024-09-18T13:07:17.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.522+0000 7fa5897fa640 1 -- 172.21.15.78:0/2386980025 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa57c042070 con 0x7fa58c102ab0 2024-09-18T13:07:17.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.522+0000 7fa5897fa640 1 --2- 172.21.15.78:0/2386980025 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa57807af80 0x7fa57807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:17.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.522+0000 7fa5897fa640 1 -- 172.21.15.78:0/2386980025 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fa57c0be970 con 0x7fa58c102ab0 2024-09-18T13:07:17.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.522+0000 7fa583fff640 1 --2- 172.21.15.78:0/2386980025 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa57807af80 0x7fa57807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:17.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.523+0000 7fa583fff640 1 --2- 172.21.15.78:0/2386980025 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa57807af80 0x7fa57807d440 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa5740058c0 tx=0x7fa574005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.527+0000 7fa5897fa640 1 -- 172.21.15.78:0/2386980025 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa57c0c0e20 con 0x7fa58c102ab0 2024-09-18T13:07:17.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.718+0000 7fa591fe9640 1 -- 172.21.15.78:0/2386980025 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa58c198e20 con 0x7fa57807af80 2024-09-18T13:07:17.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.719+0000 7fa5897fa640 1 -- 172.21.15.78:0/2386980025 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa58c198e20 con 0x7fa57807af80 2024-09-18T13:07:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.722+0000 7fa591fe9640 1 -- 172.21.15.78:0/2386980025 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa57807af80 msgr2=0x7fa57807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.722+0000 7fa591fe9640 1 --2- 172.21.15.78:0/2386980025 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa57807af80 0x7fa57807d440 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa5740058c0 tx=0x7fa574005850 comp rx=0 tx=0).stop 2024-09-18T13:07:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.722+0000 7fa591fe9640 1 -- 172.21.15.78:0/2386980025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa58c102ab0 msgr2=0x7fa58c19d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.722+0000 7fa591fe9640 1 --2- 172.21.15.78:0/2386980025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa58c102ab0 0x7fa58c19d730 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa57c031460 tx=0x7fa57c0045e0 comp rx=0 tx=0).stop 2024-09-18T13:07:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.722+0000 7fa591fe9640 1 -- 172.21.15.78:0/2386980025 shutdown_connections 2024-09-18T13:07:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.722+0000 7fa591fe9640 1 --2- 172.21.15.78:0/2386980025 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa57807af80 0x7fa57807d440 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.722+0000 7fa591fe9640 1 --2- 172.21.15.78:0/2386980025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa58c1033d0 0x7fa58c19dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.722+0000 7fa591fe9640 1 --2- 172.21.15.78:0/2386980025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa58c102ab0 0x7fa58c19d730 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.722+0000 7fa591fe9640 1 -- 172.21.15.78:0/2386980025 >> 172.21.15.78:0/2386980025 conn(0x7fa58c0fc4d0 msgr2=0x7fa58c108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.722+0000 7fa591fe9640 1 -- 172.21.15.78:0/2386980025 shutdown_connections 2024-09-18T13:07:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.722+0000 7fa591fe9640 1 -- 172.21.15.78:0/2386980025 wait complete. 2024-09-18T13:07:17.732 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:07:17.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.805+0000 7f8587b6a640 1 -- 172.21.15.78:0/3354291220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580107900 msgr2=0x7f8580107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:17.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.805+0000 7f8587b6a640 1 --2- 172.21.15.78:0/3354291220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580107900 0x7f8580107ce0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8570009880 tx=0x7f857002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:07:17.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.805+0000 7f8587b6a640 1 -- 172.21.15.78:0/3354291220 shutdown_connections 2024-09-18T13:07:17.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.805+0000 7f8587b6a640 1 --2- 172.21.15.78:0/3354291220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8580101900 0x7f8580101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:17.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.805+0000 7f8587b6a640 1 --2- 172.21.15.78:0/3354291220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580107900 0x7f8580107ce0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:17.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.805+0000 7f8587b6a640 1 -- 172.21.15.78:0/3354291220 >> 172.21.15.78:0/3354291220 conn(0x7f85800fd600 msgr2=0x7f85800ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:17.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.805+0000 7f8587b6a640 1 -- 172.21.15.78:0/3354291220 shutdown_connections 2024-09-18T13:07:17.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.805+0000 7f8587b6a640 1 -- 172.21.15.78:0/3354291220 wait complete. 2024-09-18T13:07:17.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.806+0000 7f8587b6a640 1 Processor -- start 2024-09-18T13:07:17.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.806+0000 7f8587b6a640 1 -- start start 2024-09-18T13:07:17.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.806+0000 7f8587b6a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8580101900 0x7f858019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.806+0000 7f8587b6a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580107900 0x7f858019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.806+0000 7f8587b6a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f858010edd0 con 0x7f8580107900 2024-09-18T13:07:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.806+0000 7f8587b6a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f858010ec50 con 0x7f8580101900 2024-09-18T13:07:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.806+0000 7f8585105640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580107900 0x7f858019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.806+0000 7f8585105640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580107900 0x7f858019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53042/0 (socket says 172.21.15.78:53042) 2024-09-18T13:07:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.806+0000 7f8585105640 1 -- 172.21.15.78:0/3104395008 learned_addr learned my addr 172.21.15.78:0/3104395008 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:07:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.806+0000 7f8585906640 1 --2- 172.21.15.78:0/3104395008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8580101900 0x7f858019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.806+0000 7f8585105640 1 -- 172.21.15.78:0/3104395008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8580101900 msgr2=0x7f858019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.806+0000 7f8585105640 1 --2- 172.21.15.78:0/3104395008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8580101900 0x7f858019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.806+0000 7f8585105640 1 -- 172.21.15.78:0/3104395008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85801977c0 con 0x7f8580107900 2024-09-18T13:07:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.807+0000 7f8585105640 1 --2- 172.21.15.78:0/3104395008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580107900 0x7f858019db80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c8f0 tx=0x7f857c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.807+0000 7f8576ffd640 1 -- 172.21.15.78:0/3104395008 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f857c0079b0 con 0x7f8580107900 2024-09-18T13:07:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.807+0000 7f8576ffd640 1 -- 172.21.15.78:0/3104395008 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f857c0054e0 con 0x7f8580107900 2024-09-18T13:07:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.807+0000 7f8587b6a640 1 -- 172.21.15.78:0/3104395008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8580197ab0 con 0x7f8580107900 2024-09-18T13:07:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.807+0000 7f8576ffd640 1 -- 172.21.15.78:0/3104395008 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f857c004dd0 con 0x7f8580107900 2024-09-18T13:07:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.807+0000 7f8587b6a640 1 -- 172.21.15.78:0/3104395008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8580198040 con 0x7f8580107900 2024-09-18T13:07:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.808+0000 7f8587b6a640 1 -- 172.21.15.78:0/3104395008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8580103040 con 0x7f8580107900 2024-09-18T13:07:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.809+0000 7f8576ffd640 1 -- 172.21.15.78:0/3104395008 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f857c005020 con 0x7f8580107900 2024-09-18T13:07:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.809+0000 7f8576ffd640 1 --2- 172.21.15.78:0/3104395008 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f856c07af30 0x7f856c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.809+0000 7f8576ffd640 1 -- 172.21.15.78:0/3104395008 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f857c09df90 con 0x7f8580107900 2024-09-18T13:07:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.809+0000 7f8585906640 1 --2- 172.21.15.78:0/3104395008 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f856c07af30 0x7f856c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.810+0000 7f8585906640 1 --2- 172.21.15.78:0/3104395008 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f856c07af30 0x7f856c07d3f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8570031460 tx=0x7f8570005bd0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:17.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:17.814+0000 7f8576ffd640 1 -- 172.21.15.78:0/3104395008 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f857c014030 con 0x7f8580107900 2024-09-18T13:07:18.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.011+0000 7f8587b6a640 1 -- 172.21.15.78:0/3104395008 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f85801983b0 con 0x7f856c07af30 2024-09-18T13:07:18.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.012+0000 7f8576ffd640 1 -- 172.21.15.78:0/3104395008 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f85801983b0 con 0x7f856c07af30 2024-09-18T13:07:18.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.014+0000 7f8587b6a640 1 -- 172.21.15.78:0/3104395008 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f856c07af30 msgr2=0x7f856c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:18.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.014+0000 7f8587b6a640 1 --2- 172.21.15.78:0/3104395008 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f856c07af30 0x7f856c07d3f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8570031460 tx=0x7f8570005bd0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.014+0000 7f8587b6a640 1 -- 172.21.15.78:0/3104395008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580107900 msgr2=0x7f858019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:18.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.014+0000 7f8587b6a640 1 --2- 172.21.15.78:0/3104395008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580107900 0x7f858019db80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c8f0 tx=0x7f857c00cdb0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.014+0000 7f8587b6a640 1 -- 172.21.15.78:0/3104395008 shutdown_connections 2024-09-18T13:07:18.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.014+0000 7f8587b6a640 1 --2- 172.21.15.78:0/3104395008 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f856c07af30 0x7f856c07d3f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.014+0000 7f8587b6a640 1 --2- 172.21.15.78:0/3104395008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580107900 0x7f858019db80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.014+0000 7f8587b6a640 1 --2- 172.21.15.78:0/3104395008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8580101900 0x7f858019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.014+0000 7f8587b6a640 1 -- 172.21.15.78:0/3104395008 >> 172.21.15.78:0/3104395008 conn(0x7f85800fd600 msgr2=0x7f85800fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:18.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.014+0000 7f8587b6a640 1 -- 172.21.15.78:0/3104395008 shutdown_connections 2024-09-18T13:07:18.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.014+0000 7f8587b6a640 1 -- 172.21.15.78:0/3104395008 wait complete. 2024-09-18T13:07:18.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.096+0000 7f7cfcdf0640 1 -- 172.21.15.78:0/816516990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf81007f0 msgr2=0x7f7cf8100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:18.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.096+0000 7f7cfcdf0640 1 --2- 172.21.15.78:0/816516990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf81007f0 0x7f7cf8100c50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009880 tx=0x7f7cec02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.096+0000 7f7cfcdf0640 1 -- 172.21.15.78:0/816516990 shutdown_connections 2024-09-18T13:07:18.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.096+0000 7f7cfcdf0640 1 --2- 172.21.15.78:0/816516990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf81007f0 0x7f7cf8100c50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.096+0000 7f7cfcdf0640 1 --2- 172.21.15.78:0/816516990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf81067f0 0x7f7cf8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.096+0000 7f7cfcdf0640 1 -- 172.21.15.78:0/816516990 >> 172.21.15.78:0/816516990 conn(0x7f7cf80fc550 msgr2=0x7f7cf80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:18.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.096+0000 7f7cfcdf0640 1 -- 172.21.15.78:0/816516990 shutdown_connections 2024-09-18T13:07:18.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.096+0000 7f7cfcdf0640 1 -- 172.21.15.78:0/816516990 wait complete. 2024-09-18T13:07:18.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.097+0000 7f7cfcdf0640 1 Processor -- start 2024-09-18T13:07:18.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.097+0000 7f7cfcdf0640 1 -- start start 2024-09-18T13:07:18.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.097+0000 7f7cfcdf0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf81007f0 0x7f7cf819d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:18.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.097+0000 7f7cfcdf0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf81067f0 0x7f7cf819dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:18.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.097+0000 7f7cfcdf0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf810dd20 con 0x7f7cf81067f0 2024-09-18T13:07:18.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.097+0000 7f7cfcdf0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf810dba0 con 0x7f7cf81007f0 2024-09-18T13:07:18.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.097+0000 7f7cf5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf81067f0 0x7f7cf819dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:18.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.097+0000 7f7cf5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf81067f0 0x7f7cf819dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53068/0 (socket says 172.21.15.78:53068) 2024-09-18T13:07:18.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.097+0000 7f7cf5d9b640 1 -- 172.21.15.78:0/4006767219 learned_addr learned my addr 172.21.15.78:0/4006767219 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:07:18.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.097+0000 7f7cf659c640 1 --2- 172.21.15.78:0/4006767219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf81007f0 0x7f7cf819d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:18.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.097+0000 7f7cf5d9b640 1 -- 172.21.15.78:0/4006767219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf81007f0 msgr2=0x7f7cf819d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:18.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.097+0000 7f7cf5d9b640 1 --2- 172.21.15.78:0/4006767219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf81007f0 0x7f7cf819d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.097+0000 7f7cf5d9b640 1 -- 172.21.15.78:0/4006767219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf8197900 con 0x7f7cf81067f0 2024-09-18T13:07:18.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.097+0000 7f7cf659c640 1 --2- 172.21.15.78:0/4006767219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf81007f0 0x7f7cf819d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:07:18.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.098+0000 7f7cf5d9b640 1 --2- 172.21.15.78:0/4006767219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf81067f0 0x7f7cf819dc80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7cec031460 tx=0x7f7cec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:18.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.098+0000 7f7ce77fe640 1 -- 172.21.15.78:0/4006767219 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cec03f070 con 0x7f7cf81067f0 2024-09-18T13:07:18.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.098+0000 7f7ce77fe640 1 -- 172.21.15.78:0/4006767219 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7cec004cf0 con 0x7f7cf81067f0 2024-09-18T13:07:18.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.098+0000 7f7cfcdf0640 1 -- 172.21.15.78:0/4006767219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf8197b30 con 0x7f7cf81067f0 2024-09-18T13:07:18.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.098+0000 7f7cfcdf0640 1 -- 172.21.15.78:0/4006767219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf8198060 con 0x7f7cf81067f0 2024-09-18T13:07:18.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.098+0000 7f7ce77fe640 1 -- 172.21.15.78:0/4006767219 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cec035030 con 0x7f7cf81067f0 2024-09-18T13:07:18.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.099+0000 7f7cfcdf0640 1 -- 172.21.15.78:0/4006767219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf8101f30 con 0x7f7cf81067f0 2024-09-18T13:07:18.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.100+0000 7f7ce77fe640 1 -- 172.21.15.78:0/4006767219 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7cec042070 con 0x7f7cf81067f0 2024-09-18T13:07:18.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.100+0000 7f7ce77fe640 1 --2- 172.21.15.78:0/4006767219 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ce007af30 0x7f7ce007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:18.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.100+0000 7f7ce77fe640 1 -- 172.21.15.78:0/4006767219 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f7cec0beb60 con 0x7f7cf81067f0 2024-09-18T13:07:18.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.100+0000 7f7cf659c640 1 --2- 172.21.15.78:0/4006767219 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ce007af30 0x7f7ce007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:18.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.101+0000 7f7cf659c640 1 --2- 172.21.15.78:0/4006767219 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ce007af30 0x7f7ce007d3f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8006fd0 tx=0x7f7ce8008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:18.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.105+0000 7f7ce77fe640 1 -- 172.21.15.78:0/4006767219 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7cec08a100 con 0x7f7cf81067f0 2024-09-18T13:07:18.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.285+0000 7f7cfcdf0640 1 -- 172.21.15.78:0/4006767219 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7cf8198ed0 con 0x7f7ce007af30 2024-09-18T13:07:18.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.294+0000 7f7ce77fe640 1 -- 172.21.15.78:0/4006767219 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f7cf8198ed0 con 0x7f7ce007af30 2024-09-18T13:07:18.297 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:07:18.297 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (15m) 9m ago 26m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:07:18.297 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (17m) 9m ago 26m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:07:18.297 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (17m) 8m ago 25m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:07:18.298 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (13m) 9m ago 26m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:07:18.298 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (13m) 8m ago 25m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:07:18.298 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (14m) 9m ago 25m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:07:18.298 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (9m) 9m ago 20m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:07:18.298 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (9m) 9m ago 20m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:07:18.298 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (9m) 8m ago 20m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:07:18.298 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (8m) 8m ago 20m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:07:18.298 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (17m) 9m ago 27m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:07:18.298 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (16m) 8m ago 25m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:07:18.298 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (13m) 9m ago 27m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:07:18.298 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (13m) 8m ago 25m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:07:18.298 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (15m) 9m ago 26m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:07:18.298 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (15m) 8m ago 25m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:07:18.299 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (12m) 9m ago 24m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:07:18.299 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (12m) 9m ago 23m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:07:18.299 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (11m) 9m ago 23m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:07:18.299 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (11m) 8m ago 22m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:07:18.299 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (10m) 8m ago 22m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:07:18.299 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (9m) 8m ago 21m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:07:18.299 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (15m) 9m ago 25m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:07:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.297+0000 7f7cfcdf0640 1 -- 172.21.15.78:0/4006767219 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ce007af30 msgr2=0x7f7ce007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.297+0000 7f7cfcdf0640 1 --2- 172.21.15.78:0/4006767219 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ce007af30 0x7f7ce007d3f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8006fd0 tx=0x7f7ce8008040 comp rx=0 tx=0).stop 2024-09-18T13:07:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.297+0000 7f7cfcdf0640 1 -- 172.21.15.78:0/4006767219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf81067f0 msgr2=0x7f7cf819dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.297+0000 7f7cfcdf0640 1 --2- 172.21.15.78:0/4006767219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf81067f0 0x7f7cf819dc80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7cec031460 tx=0x7f7cec0048f0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.297+0000 7f7cfcdf0640 1 -- 172.21.15.78:0/4006767219 shutdown_connections 2024-09-18T13:07:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.297+0000 7f7cfcdf0640 1 --2- 172.21.15.78:0/4006767219 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ce007af30 0x7f7ce007d3f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.297+0000 7f7cfcdf0640 1 --2- 172.21.15.78:0/4006767219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf81067f0 0x7f7cf819dc80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.297+0000 7f7cfcdf0640 1 --2- 172.21.15.78:0/4006767219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cf81007f0 0x7f7cf819d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.297+0000 7f7cfcdf0640 1 -- 172.21.15.78:0/4006767219 >> 172.21.15.78:0/4006767219 conn(0x7f7cf80fc550 msgr2=0x7f7cf8104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:18.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.297+0000 7f7cfcdf0640 1 -- 172.21.15.78:0/4006767219 shutdown_connections 2024-09-18T13:07:18.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.297+0000 7f7cfcdf0640 1 -- 172.21.15.78:0/4006767219 wait complete. 2024-09-18T13:07:18.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.377+0000 7f48d1671640 1 -- 172.21.15.78:0/3504946260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48cc1067f0 msgr2=0x7f48cc106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:18.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.377+0000 7f48d1671640 1 --2- 172.21.15.78:0/3504946260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48cc1067f0 0x7f48cc106bd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009c20 tx=0x7f48bc02a970 comp rx=0 tx=0).stop 2024-09-18T13:07:18.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.377+0000 7f48d1671640 1 -- 172.21.15.78:0/3504946260 shutdown_connections 2024-09-18T13:07:18.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.377+0000 7f48d1671640 1 --2- 172.21.15.78:0/3504946260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc1007f0 0x7f48cc100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.377+0000 7f48d1671640 1 --2- 172.21.15.78:0/3504946260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48cc1067f0 0x7f48cc106bd0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.377+0000 7f48d1671640 1 -- 172.21.15.78:0/3504946260 >> 172.21.15.78:0/3504946260 conn(0x7f48cc0fc550 msgr2=0x7f48cc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:18.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.377+0000 7f48d1671640 1 -- 172.21.15.78:0/3504946260 shutdown_connections 2024-09-18T13:07:18.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.378+0000 7f48d1671640 1 -- 172.21.15.78:0/3504946260 wait complete. 2024-09-18T13:07:18.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.378+0000 7f48d1671640 1 Processor -- start 2024-09-18T13:07:18.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.378+0000 7f48d1671640 1 -- start start 2024-09-18T13:07:18.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.378+0000 7f48d1671640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc1007f0 0x7f48cc0fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:18.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.378+0000 7f48d1671640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48cc1067f0 0x7f48cc0fd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:18.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.378+0000 7f48d1671640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc10dd20 con 0x7f48cc1067f0 2024-09-18T13:07:18.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.378+0000 7f48d1671640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc10dba0 con 0x7f48cc1007f0 2024-09-18T13:07:18.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.379+0000 7f48ca7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48cc1067f0 0x7f48cc0fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:18.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.379+0000 7f48ca7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48cc1067f0 0x7f48cc0fd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53088/0 (socket says 172.21.15.78:53088) 2024-09-18T13:07:18.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.379+0000 7f48ca7fc640 1 -- 172.21.15.78:0/1089898377 learned_addr learned my addr 172.21.15.78:0/1089898377 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:07:18.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.379+0000 7f48caffd640 1 --2- 172.21.15.78:0/1089898377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc1007f0 0x7f48cc0fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:18.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.379+0000 7f48ca7fc640 1 -- 172.21.15.78:0/1089898377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc1007f0 msgr2=0x7f48cc0fcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:18.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.379+0000 7f48ca7fc640 1 --2- 172.21.15.78:0/1089898377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc1007f0 0x7f48cc0fcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.379+0000 7f48ca7fc640 1 -- 172.21.15.78:0/1089898377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc0fd840 con 0x7f48cc1067f0 2024-09-18T13:07:18.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.379+0000 7f48ca7fc640 1 --2- 172.21.15.78:0/1089898377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48cc1067f0 0x7f48cc0fd300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f48b400b420 tx=0x7f48b400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:18.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.379+0000 7f48c3fff640 1 -- 172.21.15.78:0/1089898377 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f48b4011630 con 0x7f48cc1067f0 2024-09-18T13:07:18.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.379+0000 7f48c3fff640 1 -- 172.21.15.78:0/1089898377 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f48b4016070 con 0x7f48cc1067f0 2024-09-18T13:07:18.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.379+0000 7f48c3fff640 1 -- 172.21.15.78:0/1089898377 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f48b4010d40 con 0x7f48cc1067f0 2024-09-18T13:07:18.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.379+0000 7f48d1671640 1 -- 172.21.15.78:0/1089898377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48cc0fdb30 con 0x7f48cc1067f0 2024-09-18T13:07:18.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.379+0000 7f48d1671640 1 -- 172.21.15.78:0/1089898377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48cc1a3ef0 con 0x7f48cc1067f0 2024-09-18T13:07:18.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.380+0000 7f48d1671640 1 -- 172.21.15.78:0/1089898377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48cc101f30 con 0x7f48cc1067f0 2024-09-18T13:07:18.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.381+0000 7f48c3fff640 1 -- 172.21.15.78:0/1089898377 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f48b401b460 con 0x7f48cc1067f0 2024-09-18T13:07:18.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.382+0000 7f48c3fff640 1 --2- 172.21.15.78:0/1089898377 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f48b807af30 0x7f48b807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:18.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.382+0000 7f48c3fff640 1 -- 172.21.15.78:0/1089898377 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f48b409d810 con 0x7f48cc1067f0 2024-09-18T13:07:18.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.382+0000 7f48caffd640 1 --2- 172.21.15.78:0/1089898377 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f48b807af30 0x7f48b807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:18.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.382+0000 7f48caffd640 1 --2- 172.21.15.78:0/1089898377 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f48b807af30 0x7f48b807d3f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f48bc006010 tx=0x7f48bc009380 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:18.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.386+0000 7f48c3fff640 1 -- 172.21.15.78:0/1089898377 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f48b4021250 con 0x7f48cc1067f0 2024-09-18T13:07:18.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.635+0000 7f48d1671640 1 -- 172.21.15.78:0/1089898377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f48cc109d70 con 0x7f48cc1067f0 2024-09-18T13:07:18.638 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:18 smithi078 ceph-mon[108578]: pgmap v544: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:18.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.636+0000 7f48c3fff640 1 -- 172.21.15.78:0/1089898377 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f48b4068db0 con 0x7f48cc1067f0 2024-09-18T13:07:18.638 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:07:18.638 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:07:18.639 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:07:18.639 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:07:18.639 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:07:18.639 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:07:18.639 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:07:18.639 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:07:18.639 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:07:18.639 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:07:18.639 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:07:18.639 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:07:18.639 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:07:18.639 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:07:18.640 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:07:18.640 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:07:18.640 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:07:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.638+0000 7f48d1671640 1 -- 172.21.15.78:0/1089898377 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f48b807af30 msgr2=0x7f48b807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.638+0000 7f48d1671640 1 --2- 172.21.15.78:0/1089898377 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f48b807af30 0x7f48b807d3f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f48bc006010 tx=0x7f48bc009380 comp rx=0 tx=0).stop 2024-09-18T13:07:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.638+0000 7f48d1671640 1 -- 172.21.15.78:0/1089898377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48cc1067f0 msgr2=0x7f48cc0fd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.638+0000 7f48d1671640 1 --2- 172.21.15.78:0/1089898377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48cc1067f0 0x7f48cc0fd300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f48b400b420 tx=0x7f48b400b8e0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.638+0000 7f48d1671640 1 -- 172.21.15.78:0/1089898377 shutdown_connections 2024-09-18T13:07:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.638+0000 7f48d1671640 1 --2- 172.21.15.78:0/1089898377 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f48b807af30 0x7f48b807d3f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.638+0000 7f48d1671640 1 --2- 172.21.15.78:0/1089898377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48cc1067f0 0x7f48cc0fd300 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.638+0000 7f48d1671640 1 --2- 172.21.15.78:0/1089898377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48cc1007f0 0x7f48cc0fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.638+0000 7f48d1671640 1 -- 172.21.15.78:0/1089898377 >> 172.21.15.78:0/1089898377 conn(0x7f48cc0fc550 msgr2=0x7f48cc06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.638+0000 7f48d1671640 1 -- 172.21.15.78:0/1089898377 shutdown_connections 2024-09-18T13:07:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.638+0000 7f48d1671640 1 -- 172.21.15.78:0/1089898377 wait complete. 2024-09-18T13:07:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:18 smithi148 ceph-mon[80030]: pgmap v544: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:18.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.728+0000 7f19960ef640 1 -- 172.21.15.78:0/3569486012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990102ac0 msgr2=0x7f1990102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:18.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.728+0000 7f19960ef640 1 --2- 172.21.15.78:0/3569486012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990102ac0 0x7f1990102ea0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1980009880 tx=0x7f198002a530 comp rx=0 tx=0).stop 2024-09-18T13:07:18.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.728+0000 7f19960ef640 1 -- 172.21.15.78:0/3569486012 shutdown_connections 2024-09-18T13:07:18.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.728+0000 7f19960ef640 1 --2- 172.21.15.78:0/3569486012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19901033e0 0x7f199010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.728+0000 7f19960ef640 1 --2- 172.21.15.78:0/3569486012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990102ac0 0x7f1990102ea0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.728+0000 7f19960ef640 1 -- 172.21.15.78:0/3569486012 >> 172.21.15.78:0/3569486012 conn(0x7f19900fc520 msgr2=0x7f19900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:18.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.728+0000 7f19960ef640 1 -- 172.21.15.78:0/3569486012 shutdown_connections 2024-09-18T13:07:18.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.728+0000 7f19960ef640 1 -- 172.21.15.78:0/3569486012 wait complete. 2024-09-18T13:07:18.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.729+0000 7f19960ef640 1 Processor -- start 2024-09-18T13:07:18.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.729+0000 7f19960ef640 1 -- start start 2024-09-18T13:07:18.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.729+0000 7f19960ef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990102ac0 0x7f199019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:18.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.729+0000 7f19960ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19901033e0 0x7f199019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:18.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.729+0000 7f19960ef640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f199010edd0 con 0x7f1990102ac0 2024-09-18T13:07:18.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.729+0000 7f19960ef640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f199010ec50 con 0x7f19901033e0 2024-09-18T13:07:18.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.729+0000 7f198f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990102ac0 0x7f199019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:18.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.729+0000 7f198f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990102ac0 0x7f199019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53100/0 (socket says 172.21.15.78:53100) 2024-09-18T13:07:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.729+0000 7f198f7fe640 1 -- 172.21.15.78:0/4082598945 learned_addr learned my addr 172.21.15.78:0/4082598945 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:07:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.729+0000 7f198f7fe640 1 -- 172.21.15.78:0/4082598945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19901033e0 msgr2=0x7f199019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.729+0000 7f198f7fe640 1 --2- 172.21.15.78:0/4082598945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19901033e0 0x7f199019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.729+0000 7f198f7fe640 1 -- 172.21.15.78:0/4082598945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19901977c0 con 0x7f1990102ac0 2024-09-18T13:07:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.730+0000 7f198f7fe640 1 --2- 172.21.15.78:0/4082598945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990102ac0 0x7f199019d640 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1980031460 tx=0x7f19800045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.730+0000 7f198d7fa640 1 -- 172.21.15.78:0/4082598945 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f198003f070 con 0x7f1990102ac0 2024-09-18T13:07:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.730+0000 7f198d7fa640 1 -- 172.21.15.78:0/4082598945 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f19800035f0 con 0x7f1990102ac0 2024-09-18T13:07:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.730+0000 7f19960ef640 1 -- 172.21.15.78:0/4082598945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1990197a50 con 0x7f1990102ac0 2024-09-18T13:07:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.730+0000 7f198d7fa640 1 -- 172.21.15.78:0/4082598945 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1980035030 con 0x7f1990102ac0 2024-09-18T13:07:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.730+0000 7f19960ef640 1 -- 172.21.15.78:0/4082598945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1990197f80 con 0x7f1990102ac0 2024-09-18T13:07:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.731+0000 7f19960ef640 1 -- 172.21.15.78:0/4082598945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f199006aa90 con 0x7f1990102ac0 2024-09-18T13:07:18.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.732+0000 7f198d7fa640 1 -- 172.21.15.78:0/4082598945 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1980042070 con 0x7f1990102ac0 2024-09-18T13:07:18.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.732+0000 7f198d7fa640 1 --2- 172.21.15.78:0/4082598945 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f197c07af80 0x7f197c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:18.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.732+0000 7f198d7fa640 1 -- 172.21.15.78:0/4082598945 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f19800be970 con 0x7f1990102ac0 2024-09-18T13:07:18.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.732+0000 7f1987fff640 1 --2- 172.21.15.78:0/4082598945 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f197c07af80 0x7f197c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:18.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.732+0000 7f1987fff640 1 --2- 172.21.15.78:0/4082598945 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f197c07af80 0x7f197c07d440 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1978005fd0 tx=0x7f1978005ee0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:18.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.736+0000 7f198d7fa640 1 -- 172.21.15.78:0/4082598945 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f19800c0e20 con 0x7f1990102ac0 2024-09-18T13:07:18.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.947+0000 7f19960ef640 1 -- 172.21.15.78:0/4082598945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1990198cf0 con 0x7f1990102ac0 2024-09-18T13:07:18.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.948+0000 7f198d7fa640 1 -- 172.21.15.78:0/4082598945 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f1980089f90 con 0x7f1990102ac0 2024-09-18T13:07:18.950 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:07:18.950 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:07:18.950 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:07:18.950 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:07:18.951 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:07:18.951 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:07:18.951 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:07:18.951 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:07:18.951 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:07:18.951 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:07:18.951 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:07:18.951 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:07:18.951 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:07:18.951 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:07:18.951 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:07:18.951 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:07:18.952 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:07:18.952 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:07:18.952 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:07:18.952 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:07:18.952 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:07:18.952 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:07:18.952 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:07:18.952 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:07:18.952 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:07:18.952 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:07:18.952 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:07:18.953 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:07:18.953 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:07:18.953 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:07:18.953 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:07:18.953 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:07:18.953 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:07:18.953 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:07:18.953 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:07:18.953 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:07:18.953 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:07:18.953 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:07:18.953 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:07:18.953 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:07:18.954 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:07:18.954 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:07:18.954 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:07:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:07:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.951+0000 7f19960ef640 1 -- 172.21.15.78:0/4082598945 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f197c07af80 msgr2=0x7f197c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.951+0000 7f19960ef640 1 --2- 172.21.15.78:0/4082598945 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f197c07af80 0x7f197c07d440 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1978005fd0 tx=0x7f1978005ee0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.951+0000 7f19960ef640 1 -- 172.21.15.78:0/4082598945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990102ac0 msgr2=0x7f199019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.951+0000 7f19960ef640 1 --2- 172.21.15.78:0/4082598945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990102ac0 0x7f199019d640 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1980031460 tx=0x7f19800045e0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.951+0000 7f19960ef640 1 -- 172.21.15.78:0/4082598945 shutdown_connections 2024-09-18T13:07:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.951+0000 7f19960ef640 1 --2- 172.21.15.78:0/4082598945 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f197c07af80 0x7f197c07d440 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.951+0000 7f19960ef640 1 --2- 172.21.15.78:0/4082598945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19901033e0 0x7f199019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.951+0000 7f19960ef640 1 --2- 172.21.15.78:0/4082598945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990102ac0 0x7f199019d640 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:18.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.951+0000 7f19960ef640 1 -- 172.21.15.78:0/4082598945 >> 172.21.15.78:0/4082598945 conn(0x7f19900fc520 msgr2=0x7f1990108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:18.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.951+0000 7f19960ef640 1 -- 172.21.15.78:0/4082598945 shutdown_connections 2024-09-18T13:07:18.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:18.951+0000 7f19960ef640 1 -- 172.21.15.78:0/4082598945 wait complete. 2024-09-18T13:07:19.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.035+0000 7fe37c183640 1 -- 172.21.15.78:0/1731207913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3741069a0 msgr2=0x7fe374106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:19.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.035+0000 7fe37c183640 1 --2- 172.21.15.78:0/1731207913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3741069a0 0x7fe374106d80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe364009880 tx=0x7fe36402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:07:19.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.035+0000 7fe37c183640 1 -- 172.21.15.78:0/1731207913 shutdown_connections 2024-09-18T13:07:19.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.035+0000 7fe37c183640 1 --2- 172.21.15.78:0/1731207913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740ffdc0 0x7fe374100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:19.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.035+0000 7fe37c183640 1 --2- 172.21.15.78:0/1731207913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3741069a0 0x7fe374106d80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:19.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.035+0000 7fe37c183640 1 -- 172.21.15.78:0/1731207913 >> 172.21.15.78:0/1731207913 conn(0x7fe3740fbc90 msgr2=0x7fe3740fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:19.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.035+0000 7fe37c183640 1 -- 172.21.15.78:0/1731207913 shutdown_connections 2024-09-18T13:07:19.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.035+0000 7fe37c183640 1 -- 172.21.15.78:0/1731207913 wait complete. 2024-09-18T13:07:19.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.036+0000 7fe37c183640 1 Processor -- start 2024-09-18T13:07:19.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.036+0000 7fe37c183640 1 -- start start 2024-09-18T13:07:19.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.036+0000 7fe37c183640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740ffdc0 0x7fe374100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:19.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.036+0000 7fe37c183640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3741069a0 0x7fe3741014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:19.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.036+0000 7fe37c183640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe37410ef40 con 0x7fe3741069a0 2024-09-18T13:07:19.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.036+0000 7fe37c183640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe37410edc0 con 0x7fe3740ffdc0 2024-09-18T13:07:19.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.036+0000 7fe37971e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3741069a0 0x7fe3741014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:19.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.036+0000 7fe37971e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3741069a0 0x7fe3741014e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53118/0 (socket says 172.21.15.78:53118) 2024-09-18T13:07:19.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.036+0000 7fe37971e640 1 -- 172.21.15.78:0/2958685747 learned_addr learned my addr 172.21.15.78:0/2958685747 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:07:19.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.036+0000 7fe379f1f640 1 --2- 172.21.15.78:0/2958685747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740ffdc0 0x7fe374100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:19.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.036+0000 7fe37971e640 1 -- 172.21.15.78:0/2958685747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740ffdc0 msgr2=0x7fe374100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:19.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.036+0000 7fe37971e640 1 --2- 172.21.15.78:0/2958685747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740ffdc0 0x7fe374100fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:19.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.036+0000 7fe37971e640 1 -- 172.21.15.78:0/2958685747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe374101a20 con 0x7fe3741069a0 2024-09-18T13:07:19.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.037+0000 7fe37971e640 1 --2- 172.21.15.78:0/2958685747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3741069a0 0x7fe3741014e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe37000d6f0 tx=0x7fe37000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:19.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.037+0000 7fe36affd640 1 -- 172.21.15.78:0/2958685747 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe370017070 con 0x7fe3741069a0 2024-09-18T13:07:19.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.037+0000 7fe36affd640 1 -- 172.21.15.78:0/2958685747 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe37000de00 con 0x7fe3741069a0 2024-09-18T13:07:19.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.037+0000 7fe37c183640 1 -- 172.21.15.78:0/2958685747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe374101d10 con 0x7fe3741069a0 2024-09-18T13:07:19.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.037+0000 7fe36affd640 1 -- 172.21.15.78:0/2958685747 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe370004bb0 con 0x7fe3741069a0 2024-09-18T13:07:19.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.037+0000 7fe37c183640 1 -- 172.21.15.78:0/2958685747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3741a3f70 con 0x7fe3741069a0 2024-09-18T13:07:19.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.038+0000 7fe37c183640 1 -- 172.21.15.78:0/2958685747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3741030e0 con 0x7fe3741069a0 2024-09-18T13:07:19.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.038+0000 7fe36affd640 1 -- 172.21.15.78:0/2958685747 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe370004e60 con 0x7fe3741069a0 2024-09-18T13:07:19.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.039+0000 7fe36affd640 1 --2- 172.21.15.78:0/2958685747 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe36007af30 0x7fe36007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:19.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.039+0000 7fe36affd640 1 -- 172.21.15.78:0/2958685747 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fe37009dca0 con 0x7fe3741069a0 2024-09-18T13:07:19.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.039+0000 7fe379f1f640 1 --2- 172.21.15.78:0/2958685747 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe36007af30 0x7fe36007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:19.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.039+0000 7fe379f1f640 1 --2- 172.21.15.78:0/2958685747 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe36007af30 0x7fe36007d3f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe3640096c0 tx=0x7fe364031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:19.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.043+0000 7fe36affd640 1 -- 172.21.15.78:0/2958685747 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe3700a2070 con 0x7fe3741069a0 2024-09-18T13:07:19.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.234+0000 7fe37c183640 1 -- 172.21.15.78:0/2958685747 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe374062630 con 0x7fe36007af30 2024-09-18T13:07:19.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.236+0000 7fe36affd640 1 -- 172.21.15.78:0/2958685747 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe374062630 con 0x7fe36007af30 2024-09-18T13:07:19.238 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:07:19.238 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:07:19.238 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:07:19.238 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:07:19.238 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:07:19.238 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:07:19.238 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:07:19.238 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:07:19.238 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:07:19.238 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:07:19.238 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:07:19.239 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:07:19.239 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:07:19.239 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:07:19.239 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:07:19.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.238+0000 7fe37c183640 1 -- 172.21.15.78:0/2958685747 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe36007af30 msgr2=0x7fe36007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:19.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.238+0000 7fe37c183640 1 --2- 172.21.15.78:0/2958685747 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe36007af30 0x7fe36007d3f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe3640096c0 tx=0x7fe364031400 comp rx=0 tx=0).stop 2024-09-18T13:07:19.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.238+0000 7fe37c183640 1 -- 172.21.15.78:0/2958685747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3741069a0 msgr2=0x7fe3741014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:19.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.238+0000 7fe37c183640 1 --2- 172.21.15.78:0/2958685747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3741069a0 0x7fe3741014e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe37000d6f0 tx=0x7fe37000dbb0 comp rx=0 tx=0).stop 2024-09-18T13:07:19.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.238+0000 7fe37c183640 1 -- 172.21.15.78:0/2958685747 shutdown_connections 2024-09-18T13:07:19.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.238+0000 7fe37c183640 1 --2- 172.21.15.78:0/2958685747 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe36007af30 0x7fe36007d3f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:19.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.238+0000 7fe37c183640 1 --2- 172.21.15.78:0/2958685747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3741069a0 0x7fe3741014e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:19.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.238+0000 7fe37c183640 1 --2- 172.21.15.78:0/2958685747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3740ffdc0 0x7fe374100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:19.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.238+0000 7fe37c183640 1 -- 172.21.15.78:0/2958685747 >> 172.21.15.78:0/2958685747 conn(0x7fe3740fbc90 msgr2=0x7fe3740fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:19.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.238+0000 7fe37c183640 1 -- 172.21.15.78:0/2958685747 shutdown_connections 2024-09-18T13:07:19.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.238+0000 7fe37c183640 1 -- 172.21.15.78:0/2958685747 wait complete. 2024-09-18T13:07:19.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.320+0000 7f661be54640 1 -- 172.21.15.78:0/580849853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6614103470 msgr2=0x7f661410b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:19.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.320+0000 7f661be54640 1 --2- 172.21.15.78:0/580849853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6614103470 0x7f661410b960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6608009880 tx=0x7f660802a530 comp rx=0 tx=0).stop 2024-09-18T13:07:19.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.320+0000 7f661be54640 1 -- 172.21.15.78:0/580849853 shutdown_connections 2024-09-18T13:07:19.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.320+0000 7f661be54640 1 --2- 172.21.15.78:0/580849853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6614103470 0x7f661410b960 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:19.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.320+0000 7f661be54640 1 --2- 172.21.15.78:0/580849853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6614102b50 0x7f6614102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:19.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.320+0000 7f661be54640 1 -- 172.21.15.78:0/580849853 >> 172.21.15.78:0/580849853 conn(0x7f66140fc550 msgr2=0x7f66140fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:19.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.320+0000 7f661be54640 1 -- 172.21.15.78:0/580849853 shutdown_connections 2024-09-18T13:07:19.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.320+0000 7f661be54640 1 -- 172.21.15.78:0/580849853 wait complete. 2024-09-18T13:07:19.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.321+0000 7f661be54640 1 Processor -- start 2024-09-18T13:07:19.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.321+0000 7f661be54640 1 -- start start 2024-09-18T13:07:19.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.321+0000 7f661be54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6614102b50 0x7f661419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:19.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.321+0000 7f661be54640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6614103470 0x7f661419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:19.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.321+0000 7f661be54640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f661410ede0 con 0x7f6614102b50 2024-09-18T13:07:19.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.321+0000 7f661be54640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f661410ec60 con 0x7f6614103470 2024-09-18T13:07:19.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.321+0000 7f6619bf0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6614102b50 0x7f661419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:19.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.321+0000 7f6619bf0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6614102b50 0x7f661419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53142/0 (socket says 172.21.15.78:53142) 2024-09-18T13:07:19.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.321+0000 7f6619bf0640 1 -- 172.21.15.78:0/1598862086 learned_addr learned my addr 172.21.15.78:0/1598862086 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:07:19.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.321+0000 7f6619bf0640 1 -- 172.21.15.78:0/1598862086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6614103470 msgr2=0x7f661419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:19.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.321+0000 7f66193ef640 1 --2- 172.21.15.78:0/1598862086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6614103470 0x7f661419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:19.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.321+0000 7f6619bf0640 1 --2- 172.21.15.78:0/1598862086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6614103470 0x7f661419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:19.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.321+0000 7f6619bf0640 1 -- 172.21.15.78:0/1598862086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66141977b0 con 0x7f6614102b50 2024-09-18T13:07:19.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.321+0000 7f6619bf0640 1 --2- 172.21.15.78:0/1598862086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6614102b50 0x7f661419d630 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f660400cc60 tx=0x7f660400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:19.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.322+0000 7f6612ffd640 1 -- 172.21.15.78:0/1598862086 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f660400ad30 con 0x7f6614102b50 2024-09-18T13:07:19.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.322+0000 7f6612ffd640 1 -- 172.21.15.78:0/1598862086 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6604005020 con 0x7f6614102b50 2024-09-18T13:07:19.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.322+0000 7f661be54640 1 -- 172.21.15.78:0/1598862086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6614197aa0 con 0x7f6614102b50 2024-09-18T13:07:19.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.322+0000 7f6612ffd640 1 -- 172.21.15.78:0/1598862086 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f660400f640 con 0x7f6614102b50 2024-09-18T13:07:19.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.322+0000 7f661be54640 1 -- 172.21.15.78:0/1598862086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6614198030 con 0x7f6614102b50 2024-09-18T13:07:19.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.323+0000 7f661be54640 1 -- 172.21.15.78:0/1598862086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f661406a4e0 con 0x7f6614102b50 2024-09-18T13:07:19.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.323+0000 7f6612ffd640 1 -- 172.21.15.78:0/1598862086 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f66040051d0 con 0x7f6614102b50 2024-09-18T13:07:19.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.324+0000 7f6612ffd640 1 --2- 172.21.15.78:0/1598862086 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f65fc07af80 0x7f65fc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:19.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.324+0000 7f66193ef640 1 --2- 172.21.15.78:0/1598862086 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f65fc07af80 0x7f65fc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:19.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.324+0000 7f6612ffd640 1 -- 172.21.15.78:0/1598862086 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f660409e320 con 0x7f6614102b50 2024-09-18T13:07:19.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.324+0000 7f66193ef640 1 --2- 172.21.15.78:0/1598862086 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f65fc07af80 0x7f65fc07d440 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6608004f90 tx=0x7f6608009560 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:19.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.329+0000 7f6612ffd640 1 -- 172.21.15.78:0/1598862086 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6604014030 con 0x7f6614102b50 2024-09-18T13:07:19.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:19 smithi078 ceph-mon[108578]: from='client.34834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:19.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:19 smithi078 ceph-mon[108578]: from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:19.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:19 smithi078 ceph-mon[108578]: from='client.34842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:19.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:19 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1089898377' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:07:19.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:19 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/4082598945' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:07:19.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.577+0000 7f661be54640 1 -- 172.21.15.78:0/1598862086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6614105fe0 con 0x7f6614102b50 2024-09-18T13:07:19.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.578+0000 7f6612ffd640 1 -- 172.21.15.78:0/1598862086 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f66040698a0 con 0x7f6614102b50 2024-09-18T13:07:19.581 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:07:19.581 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:07:19.581 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:07:19.581 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:07:19.581 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:07:19.582 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:07:19.582 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:07:19.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.580+0000 7f661be54640 1 -- 172.21.15.78:0/1598862086 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f65fc07af80 msgr2=0x7f65fc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:19.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.580+0000 7f661be54640 1 --2- 172.21.15.78:0/1598862086 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f65fc07af80 0x7f65fc07d440 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6608004f90 tx=0x7f6608009560 comp rx=0 tx=0).stop 2024-09-18T13:07:19.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.580+0000 7f661be54640 1 -- 172.21.15.78:0/1598862086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6614102b50 msgr2=0x7f661419d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:19.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.580+0000 7f661be54640 1 --2- 172.21.15.78:0/1598862086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6614102b50 0x7f661419d630 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f660400cc60 tx=0x7f660400a620 comp rx=0 tx=0).stop 2024-09-18T13:07:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.580+0000 7f661be54640 1 -- 172.21.15.78:0/1598862086 shutdown_connections 2024-09-18T13:07:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.580+0000 7f661be54640 1 --2- 172.21.15.78:0/1598862086 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f65fc07af80 0x7f65fc07d440 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.580+0000 7f661be54640 1 --2- 172.21.15.78:0/1598862086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6614103470 0x7f661419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.580+0000 7f661be54640 1 --2- 172.21.15.78:0/1598862086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6614102b50 0x7f661419d630 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.580+0000 7f661be54640 1 -- 172.21.15.78:0/1598862086 >> 172.21.15.78:0/1598862086 conn(0x7f66140fc550 msgr2=0x7f6614103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.580+0000 7f661be54640 1 -- 172.21.15.78:0/1598862086 shutdown_connections 2024-09-18T13:07:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:19.580+0000 7f661be54640 1 -- 172.21.15.78:0/1598862086 wait complete. 2024-09-18T13:07:19.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:19 smithi148 ceph-mon[80030]: from='client.34834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:19.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:19 smithi148 ceph-mon[80030]: from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:19.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:19 smithi148 ceph-mon[80030]: from='client.34842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:19.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:19 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1089898377' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:07:19.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:19 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/4082598945' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:07:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:20 smithi148 ceph-mon[80030]: from='client.34854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:20 smithi148 ceph-mon[80030]: pgmap v545: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:20 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1598862086' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:07:20.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:20 smithi078 ceph-mon[108578]: from='client.34854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:20.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:20 smithi078 ceph-mon[108578]: pgmap v545: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:20.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:20 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1598862086' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:07:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:22 smithi148 ceph-mon[80030]: pgmap v546: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:22.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:22 smithi078 ceph-mon[108578]: pgmap v546: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:24.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:24 smithi078 ceph-mon[108578]: pgmap v547: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:24 smithi148 ceph-mon[80030]: pgmap v547: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:26 smithi148 ceph-mon[80030]: pgmap v548: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:26 smithi078 ceph-mon[108578]: pgmap v548: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:28 smithi148 ceph-mon[80030]: pgmap v549: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:28.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:28 smithi078 ceph-mon[108578]: pgmap v549: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:30.712 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:30 smithi078 ceph-mon[108578]: pgmap v550: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:30 smithi148 ceph-mon[80030]: pgmap v550: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:32 smithi148 ceph-mon[80030]: pgmap v551: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:32 smithi078 ceph-mon[108578]: pgmap v551: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:34 smithi148 ceph-mon[80030]: pgmap v552: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:34 smithi078 ceph-mon[108578]: pgmap v552: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:36.708 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:36 smithi078 ceph-mon[108578]: pgmap v553: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:36 smithi148 ceph-mon[80030]: pgmap v553: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:38.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:38 smithi148 ceph-mon[80030]: pgmap v554: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:38.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:38 smithi078 ceph-mon[108578]: pgmap v554: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:40 smithi148 ceph-mon[80030]: pgmap v555: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:40 smithi078 ceph-mon[108578]: pgmap v555: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:42.704 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:42 smithi078 ceph-mon[108578]: pgmap v556: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:42 smithi148 ceph-mon[80030]: pgmap v556: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:44 smithi148 ceph-mon[80030]: pgmap v557: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:44 smithi078 ceph-mon[108578]: pgmap v557: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:46.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:46 smithi148 ceph-mon[80030]: pgmap v558: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:46 smithi078 ceph-mon[108578]: pgmap v558: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:48.714 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:48 smithi078 ceph-mon[108578]: pgmap v559: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:48.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:48 smithi148 ceph-mon[80030]: pgmap v559: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:49.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.676+0000 7fe9a873a640 1 -- 172.21.15.78:0/937252174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0101900 msgr2=0x7fe9a0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:49.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.676+0000 7fe9a873a640 1 --2- 172.21.15.78:0/937252174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0101900 0x7fe9a0101d60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe994009880 tx=0x7fe99402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:07:49.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.676+0000 7fe9a873a640 1 -- 172.21.15.78:0/937252174 shutdown_connections 2024-09-18T13:07:49.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.676+0000 7fe9a873a640 1 --2- 172.21.15.78:0/937252174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0101900 0x7fe9a0101d60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:49.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.676+0000 7fe9a873a640 1 --2- 172.21.15.78:0/937252174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a0107900 0x7fe9a0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:49.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.676+0000 7fe9a873a640 1 -- 172.21.15.78:0/937252174 >> 172.21.15.78:0/937252174 conn(0x7fe9a00fd600 msgr2=0x7fe9a00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:49.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.676+0000 7fe9a873a640 1 -- 172.21.15.78:0/937252174 shutdown_connections 2024-09-18T13:07:49.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.676+0000 7fe9a873a640 1 -- 172.21.15.78:0/937252174 wait complete. 2024-09-18T13:07:49.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.676+0000 7fe9a873a640 1 Processor -- start 2024-09-18T13:07:49.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.676+0000 7fe9a873a640 1 -- start start 2024-09-18T13:07:49.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.677+0000 7fe9a873a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0101900 0x7fe9a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:49.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.677+0000 7fe9a873a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a0107900 0x7fe9a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:49.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.677+0000 7fe9a873a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a010edd0 con 0x7fe9a0101900 2024-09-18T13:07:49.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.677+0000 7fe9a873a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a010ec50 con 0x7fe9a0107900 2024-09-18T13:07:49.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.677+0000 7fe9a64d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0101900 0x7fe9a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:49.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.677+0000 7fe9a64d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0101900 0x7fe9a00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48194/0 (socket says 172.21.15.78:48194) 2024-09-18T13:07:49.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.677+0000 7fe9a64d6640 1 -- 172.21.15.78:0/863405899 learned_addr learned my addr 172.21.15.78:0/863405899 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:07:49.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.677+0000 7fe9a5cd5640 1 --2- 172.21.15.78:0/863405899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a0107900 0x7fe9a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:49.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.677+0000 7fe9a64d6640 1 -- 172.21.15.78:0/863405899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a0107900 msgr2=0x7fe9a0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:49.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.677+0000 7fe9a64d6640 1 --2- 172.21.15.78:0/863405899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a0107900 0x7fe9a0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:49.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.677+0000 7fe9a64d6640 1 -- 172.21.15.78:0/863405899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a0074f70 con 0x7fe9a0101900 2024-09-18T13:07:49.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.677+0000 7fe9a64d6640 1 --2- 172.21.15.78:0/863405899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0101900 0x7fe9a00744f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00d6f0 tx=0x7fe99c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:49.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.678+0000 7fe9937fe640 1 -- 172.21.15.78:0/863405899 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe99c017070 con 0x7fe9a0101900 2024-09-18T13:07:49.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.678+0000 7fe9937fe640 1 -- 172.21.15.78:0/863405899 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe99c00de00 con 0x7fe9a0101900 2024-09-18T13:07:49.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.678+0000 7fe9a873a640 1 -- 172.21.15.78:0/863405899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a0075260 con 0x7fe9a0101900 2024-09-18T13:07:49.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.678+0000 7fe9937fe640 1 -- 172.21.15.78:0/863405899 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe99c004bb0 con 0x7fe9a0101900 2024-09-18T13:07:49.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.678+0000 7fe9a873a640 1 -- 172.21.15.78:0/863405899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a01a3e20 con 0x7fe9a0101900 2024-09-18T13:07:49.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.679+0000 7fe9a873a640 1 -- 172.21.15.78:0/863405899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a0103040 con 0x7fe9a0101900 2024-09-18T13:07:49.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.679+0000 7fe9937fe640 1 -- 172.21.15.78:0/863405899 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe99c009a30 con 0x7fe9a0101900 2024-09-18T13:07:49.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.680+0000 7fe9937fe640 1 --2- 172.21.15.78:0/863405899 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe98c07af80 0x7fe98c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:49.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.680+0000 7fe9937fe640 1 -- 172.21.15.78:0/863405899 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fe99c09db20 con 0x7fe9a0101900 2024-09-18T13:07:49.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.680+0000 7fe9a5cd5640 1 --2- 172.21.15.78:0/863405899 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe98c07af80 0x7fe98c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:49.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.680+0000 7fe9a5cd5640 1 --2- 172.21.15.78:0/863405899 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe98c07af80 0x7fe98c07d440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0075f80 tx=0x7fe994031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:49.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.684+0000 7fe9937fe640 1 -- 172.21.15.78:0/863405899 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe99c069140 con 0x7fe9a0101900 2024-09-18T13:07:49.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.875+0000 7fe9a873a640 1 -- 172.21.15.78:0/863405899 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe9a0062630 con 0x7fe98c07af80 2024-09-18T13:07:49.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.877+0000 7fe9937fe640 1 -- 172.21.15.78:0/863405899 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe9a0062630 con 0x7fe98c07af80 2024-09-18T13:07:49.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.879+0000 7fe9a873a640 1 -- 172.21.15.78:0/863405899 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe98c07af80 msgr2=0x7fe98c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:49.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.879+0000 7fe9a873a640 1 --2- 172.21.15.78:0/863405899 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe98c07af80 0x7fe98c07d440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0075f80 tx=0x7fe994031400 comp rx=0 tx=0).stop 2024-09-18T13:07:49.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.879+0000 7fe9a873a640 1 -- 172.21.15.78:0/863405899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0101900 msgr2=0x7fe9a00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:49.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.879+0000 7fe9a873a640 1 --2- 172.21.15.78:0/863405899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0101900 0x7fe9a00744f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00d6f0 tx=0x7fe99c00dbb0 comp rx=0 tx=0).stop 2024-09-18T13:07:49.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.879+0000 7fe9a873a640 1 -- 172.21.15.78:0/863405899 shutdown_connections 2024-09-18T13:07:49.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.879+0000 7fe9a873a640 1 --2- 172.21.15.78:0/863405899 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe98c07af80 0x7fe98c07d440 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:49.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.879+0000 7fe9a873a640 1 --2- 172.21.15.78:0/863405899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a0107900 0x7fe9a0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:49.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.879+0000 7fe9a873a640 1 --2- 172.21.15.78:0/863405899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0101900 0x7fe9a00744f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:49.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.879+0000 7fe9a873a640 1 -- 172.21.15.78:0/863405899 >> 172.21.15.78:0/863405899 conn(0x7fe9a00fd600 msgr2=0x7fe9a00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:49.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.879+0000 7fe9a873a640 1 -- 172.21.15.78:0/863405899 shutdown_connections 2024-09-18T13:07:49.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.879+0000 7fe9a873a640 1 -- 172.21.15.78:0/863405899 wait complete. 2024-09-18T13:07:49.889 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:07:49.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.961+0000 7ff3a8961640 1 -- 172.21.15.78:0/4162427255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a41067f0 msgr2=0x7ff3a4106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:49.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.961+0000 7ff3a8961640 1 --2- 172.21.15.78:0/4162427255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a41067f0 0x7ff3a4106bd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff394009880 tx=0x7ff39402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:07:49.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.962+0000 7ff3a8961640 1 -- 172.21.15.78:0/4162427255 shutdown_connections 2024-09-18T13:07:49.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.962+0000 7ff3a8961640 1 --2- 172.21.15.78:0/4162427255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a41007f0 0x7ff3a4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:49.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.962+0000 7ff3a8961640 1 --2- 172.21.15.78:0/4162427255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a41067f0 0x7ff3a4106bd0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:49.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.962+0000 7ff3a8961640 1 -- 172.21.15.78:0/4162427255 >> 172.21.15.78:0/4162427255 conn(0x7ff3a40fc550 msgr2=0x7ff3a40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:49.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.962+0000 7ff3a8961640 1 -- 172.21.15.78:0/4162427255 shutdown_connections 2024-09-18T13:07:49.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.962+0000 7ff3a8961640 1 -- 172.21.15.78:0/4162427255 wait complete. 2024-09-18T13:07:49.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.962+0000 7ff3a8961640 1 Processor -- start 2024-09-18T13:07:49.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.962+0000 7ff3a8961640 1 -- start start 2024-09-18T13:07:49.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3a8961640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a41007f0 0x7ff3a419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:49.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3a8961640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a41067f0 0x7ff3a419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:49.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3a8961640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a410dcc0 con 0x7ff3a41007f0 2024-09-18T13:07:49.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3a8961640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a410db40 con 0x7ff3a41067f0 2024-09-18T13:07:49.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3a259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a41007f0 0x7ff3a419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:49.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3a259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a41007f0 0x7ff3a419c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48206/0 (socket says 172.21.15.78:48206) 2024-09-18T13:07:49.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3a259c640 1 -- 172.21.15.78:0/2229039879 learned_addr learned my addr 172.21.15.78:0/2229039879 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:07:49.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3a1d9b640 1 --2- 172.21.15.78:0/2229039879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a41067f0 0x7ff3a419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:49.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3a259c640 1 -- 172.21.15.78:0/2229039879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a41067f0 msgr2=0x7ff3a419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:49.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3a259c640 1 --2- 172.21.15.78:0/2229039879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a41067f0 0x7ff3a419cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:49.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3a259c640 1 -- 172.21.15.78:0/2229039879 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a41966d0 con 0x7ff3a41007f0 2024-09-18T13:07:49.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3a259c640 1 --2- 172.21.15.78:0/2229039879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a41007f0 0x7ff3a419c600 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff394031460 tx=0x7ff3940045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:49.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3937fe640 1 -- 172.21.15.78:0/2229039879 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff394035070 con 0x7ff3a41007f0 2024-09-18T13:07:49.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3937fe640 1 -- 172.21.15.78:0/2229039879 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff3940035f0 con 0x7ff3a41007f0 2024-09-18T13:07:49.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3a8961640 1 -- 172.21.15.78:0/2229039879 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a4196960 con 0x7ff3a41007f0 2024-09-18T13:07:49.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.963+0000 7ff3937fe640 1 -- 172.21.15.78:0/2229039879 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff394031890 con 0x7ff3a41007f0 2024-09-18T13:07:49.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.964+0000 7ff3a8961640 1 -- 172.21.15.78:0/2229039879 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a4196e60 con 0x7ff3a41007f0 2024-09-18T13:07:49.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.964+0000 7ff3a8961640 1 -- 172.21.15.78:0/2229039879 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a4101f30 con 0x7ff3a41007f0 2024-09-18T13:07:49.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.965+0000 7ff3937fe640 1 -- 172.21.15.78:0/2229039879 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff394031b90 con 0x7ff3a41007f0 2024-09-18T13:07:49.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.966+0000 7ff3937fe640 1 --2- 172.21.15.78:0/2229039879 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff38c07af30 0x7ff38c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:49.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.966+0000 7ff3937fe640 1 -- 172.21.15.78:0/2229039879 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7ff39403e070 con 0x7ff3a41007f0 2024-09-18T13:07:49.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.966+0000 7ff3a1d9b640 1 --2- 172.21.15.78:0/2229039879 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff38c07af30 0x7ff38c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:49.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.966+0000 7ff3a1d9b640 1 --2- 172.21.15.78:0/2229039879 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff38c07af30 0x7ff38c07d3f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff398005fd0 tx=0x7ff398005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:49.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:49.970+0000 7ff3937fe640 1 -- 172.21.15.78:0/2229039879 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff39408bae0 con 0x7ff3a41007f0 2024-09-18T13:07:50.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.161+0000 7ff3a8961640 1 -- 172.21.15.78:0/2229039879 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff3a4197110 con 0x7ff38c07af30 2024-09-18T13:07:50.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.162+0000 7ff3937fe640 1 -- 172.21.15.78:0/2229039879 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff3a4197110 con 0x7ff38c07af30 2024-09-18T13:07:50.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.164+0000 7ff3a8961640 1 -- 172.21.15.78:0/2229039879 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff38c07af30 msgr2=0x7ff38c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.164+0000 7ff3a8961640 1 --2- 172.21.15.78:0/2229039879 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff38c07af30 0x7ff38c07d3f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff398005fd0 tx=0x7ff398005850 comp rx=0 tx=0).stop 2024-09-18T13:07:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.164+0000 7ff3a8961640 1 -- 172.21.15.78:0/2229039879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a41007f0 msgr2=0x7ff3a419c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.164+0000 7ff3a8961640 1 --2- 172.21.15.78:0/2229039879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a41007f0 0x7ff3a419c600 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff394031460 tx=0x7ff3940045e0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.164+0000 7ff3a8961640 1 -- 172.21.15.78:0/2229039879 shutdown_connections 2024-09-18T13:07:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.164+0000 7ff3a8961640 1 --2- 172.21.15.78:0/2229039879 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff38c07af30 0x7ff38c07d3f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.164+0000 7ff3a8961640 1 --2- 172.21.15.78:0/2229039879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a41067f0 0x7ff3a419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.164+0000 7ff3a8961640 1 --2- 172.21.15.78:0/2229039879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a41007f0 0x7ff3a419c600 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.164+0000 7ff3a8961640 1 -- 172.21.15.78:0/2229039879 >> 172.21.15.78:0/2229039879 conn(0x7ff3a40fc550 msgr2=0x7ff3a40fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.165+0000 7ff3a8961640 1 -- 172.21.15.78:0/2229039879 shutdown_connections 2024-09-18T13:07:50.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.165+0000 7ff3a8961640 1 -- 172.21.15.78:0/2229039879 wait complete. 2024-09-18T13:07:50.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.246+0000 7ff5d59db640 1 -- 172.21.15.78:0/512703041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d01067f0 msgr2=0x7ff5d0106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:50.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.246+0000 7ff5d59db640 1 --2- 172.21.15.78:0/512703041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d01067f0 0x7ff5d0106bd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0009880 tx=0x7ff5c002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.246+0000 7ff5d59db640 1 -- 172.21.15.78:0/512703041 shutdown_connections 2024-09-18T13:07:50.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.246+0000 7ff5d59db640 1 --2- 172.21.15.78:0/512703041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5d01007f0 0x7ff5d0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.246+0000 7ff5d59db640 1 --2- 172.21.15.78:0/512703041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d01067f0 0x7ff5d0106bd0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.246+0000 7ff5d59db640 1 -- 172.21.15.78:0/512703041 >> 172.21.15.78:0/512703041 conn(0x7ff5d00fc550 msgr2=0x7ff5d00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:50.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.246+0000 7ff5d59db640 1 -- 172.21.15.78:0/512703041 shutdown_connections 2024-09-18T13:07:50.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.246+0000 7ff5d59db640 1 -- 172.21.15.78:0/512703041 wait complete. 2024-09-18T13:07:50.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.247+0000 7ff5d59db640 1 Processor -- start 2024-09-18T13:07:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.247+0000 7ff5d59db640 1 -- start start 2024-09-18T13:07:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.247+0000 7ff5d59db640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5d01007f0 0x7ff5d019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.247+0000 7ff5d59db640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d01067f0 0x7ff5d019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.247+0000 7ff5d59db640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d010dcc0 con 0x7ff5d01067f0 2024-09-18T13:07:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.247+0000 7ff5d59db640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d010db40 con 0x7ff5d01007f0 2024-09-18T13:07:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.247+0000 7ff5ce7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d01067f0 0x7ff5d019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.247+0000 7ff5ce7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d01067f0 0x7ff5d019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48224/0 (socket says 172.21.15.78:48224) 2024-09-18T13:07:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.247+0000 7ff5ce7fc640 1 -- 172.21.15.78:0/372630919 learned_addr learned my addr 172.21.15.78:0/372630919 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:07:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.247+0000 7ff5ceffd640 1 --2- 172.21.15.78:0/372630919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5d01007f0 0x7ff5d019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.248+0000 7ff5ce7fc640 1 -- 172.21.15.78:0/372630919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5d01007f0 msgr2=0x7ff5d019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.248+0000 7ff5ce7fc640 1 --2- 172.21.15.78:0/372630919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5d01007f0 0x7ff5d019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.248+0000 7ff5ce7fc640 1 -- 172.21.15.78:0/372630919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d01977c0 con 0x7ff5d01067f0 2024-09-18T13:07:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.248+0000 7ff5ce7fc640 1 --2- 172.21.15.78:0/372630919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d01067f0 0x7ff5d019db80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400d6f0 tx=0x7ff5c400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.248+0000 7ff5d49d9640 1 -- 172.21.15.78:0/372630919 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff5c4017070 con 0x7ff5d01067f0 2024-09-18T13:07:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.248+0000 7ff5d49d9640 1 -- 172.21.15.78:0/372630919 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff5c400de00 con 0x7ff5d01067f0 2024-09-18T13:07:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.248+0000 7ff5d59db640 1 -- 172.21.15.78:0/372630919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d0197ab0 con 0x7ff5d01067f0 2024-09-18T13:07:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.248+0000 7ff5d49d9640 1 -- 172.21.15.78:0/372630919 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff5c4004bb0 con 0x7ff5d01067f0 2024-09-18T13:07:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.248+0000 7ff5d59db640 1 -- 172.21.15.78:0/372630919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d0198040 con 0x7ff5d01067f0 2024-09-18T13:07:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.249+0000 7ff5d59db640 1 -- 172.21.15.78:0/372630919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d0101f30 con 0x7ff5d01067f0 2024-09-18T13:07:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.249+0000 7ff5d49d9640 1 -- 172.21.15.78:0/372630919 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff5c4004e60 con 0x7ff5d01067f0 2024-09-18T13:07:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.250+0000 7ff5d49d9640 1 --2- 172.21.15.78:0/372630919 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff5b807af30 0x7ff5b807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.250+0000 7ff5d49d9640 1 -- 172.21.15.78:0/372630919 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7ff5c409dd50 con 0x7ff5d01067f0 2024-09-18T13:07:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.250+0000 7ff5ceffd640 1 --2- 172.21.15.78:0/372630919 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff5b807af30 0x7ff5b807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.250+0000 7ff5ceffd640 1 --2- 172.21.15.78:0/372630919 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff5b807af30 0x7ff5b807d3f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff5c00096c0 tx=0x7ff5c0031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:50.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.254+0000 7ff5d49d9640 1 -- 172.21.15.78:0/372630919 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff5c4069250 con 0x7ff5d01067f0 2024-09-18T13:07:50.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.440+0000 7ff5d59db640 1 -- 172.21.15.78:0/372630919 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff5d01982f0 con 0x7ff5b807af30 2024-09-18T13:07:50.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.449+0000 7ff5d49d9640 1 -- 172.21.15.78:0/372630919 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ff5d01982f0 con 0x7ff5b807af30 2024-09-18T13:07:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:07:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (15m) 9m ago 26m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:07:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (18m) 9m ago 26m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:07:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (18m) 9m ago 25m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:07:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (13m) 9m ago 26m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:07:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (13m) 9m ago 25m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:07:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (15m) 9m ago 26m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:07:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (10m) 9m ago 21m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:07:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (9m) 9m ago 21m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:07:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (9m) 9m ago 21m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:07:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (9m) 9m ago 21m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:07:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (17m) 9m ago 27m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:07:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (16m) 9m ago 25m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:07:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (14m) 9m ago 28m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:07:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (14m) 9m ago 25m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:07:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (16m) 9m ago 26m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:07:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (16m) 9m ago 25m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:07:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (13m) 9m ago 24m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:07:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (12m) 9m ago 24m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:07:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (12m) 9m ago 23m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:07:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (11m) 9m ago 23m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:07:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (11m) 9m ago 22m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:07:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (10m) 9m ago 22m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:07:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (16m) 9m ago 26m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:07:50.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.452+0000 7ff5d59db640 1 -- 172.21.15.78:0/372630919 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff5b807af30 msgr2=0x7ff5b807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:50.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.452+0000 7ff5d59db640 1 --2- 172.21.15.78:0/372630919 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff5b807af30 0x7ff5b807d3f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff5c00096c0 tx=0x7ff5c0031400 comp rx=0 tx=0).stop 2024-09-18T13:07:50.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.452+0000 7ff5d59db640 1 -- 172.21.15.78:0/372630919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d01067f0 msgr2=0x7ff5d019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:50.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.452+0000 7ff5d59db640 1 --2- 172.21.15.78:0/372630919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d01067f0 0x7ff5d019db80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400d6f0 tx=0x7ff5c400dbb0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.452+0000 7ff5d59db640 1 -- 172.21.15.78:0/372630919 shutdown_connections 2024-09-18T13:07:50.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.452+0000 7ff5d59db640 1 --2- 172.21.15.78:0/372630919 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff5b807af30 0x7ff5b807d3f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.452+0000 7ff5d59db640 1 --2- 172.21.15.78:0/372630919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d01067f0 0x7ff5d019db80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.452+0000 7ff5d59db640 1 --2- 172.21.15.78:0/372630919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5d01007f0 0x7ff5d019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.452+0000 7ff5d59db640 1 -- 172.21.15.78:0/372630919 >> 172.21.15.78:0/372630919 conn(0x7ff5d00fc550 msgr2=0x7ff5d01045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:50.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.452+0000 7ff5d59db640 1 -- 172.21.15.78:0/372630919 shutdown_connections 2024-09-18T13:07:50.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.452+0000 7ff5d59db640 1 -- 172.21.15.78:0/372630919 wait complete. 2024-09-18T13:07:50.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.533+0000 7f525712d640 1 -- 172.21.15.78:0/801961943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5250102ac0 msgr2=0x7f5250102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:50.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.533+0000 7f525712d640 1 --2- 172.21.15.78:0/801961943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5250102ac0 0x7f5250102ea0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5238009880 tx=0x7f523802a530 comp rx=0 tx=0).stop 2024-09-18T13:07:50.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.533+0000 7f525712d640 1 -- 172.21.15.78:0/801961943 shutdown_connections 2024-09-18T13:07:50.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.533+0000 7f525712d640 1 --2- 172.21.15.78:0/801961943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52501033e0 0x7f525010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.533+0000 7f525712d640 1 --2- 172.21.15.78:0/801961943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5250102ac0 0x7f5250102ea0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.533+0000 7f525712d640 1 -- 172.21.15.78:0/801961943 >> 172.21.15.78:0/801961943 conn(0x7f52500fc520 msgr2=0x7f52500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:50.535 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:50 smithi078 ceph-mon[108578]: pgmap v560: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.533+0000 7f525712d640 1 -- 172.21.15.78:0/801961943 shutdown_connections 2024-09-18T13:07:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.533+0000 7f525712d640 1 -- 172.21.15.78:0/801961943 wait complete. 2024-09-18T13:07:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.534+0000 7f525712d640 1 Processor -- start 2024-09-18T13:07:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.534+0000 7f525712d640 1 -- start start 2024-09-18T13:07:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.534+0000 7f525712d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5250102ac0 0x7f525019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.534+0000 7f525712d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52501033e0 0x7f525019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.534+0000 7f525712d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f525010edf0 con 0x7f52501033e0 2024-09-18T13:07:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.534+0000 7f525712d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f525010ec70 con 0x7f5250102ac0 2024-09-18T13:07:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.534+0000 7f524ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52501033e0 0x7f525019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.534+0000 7f524ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52501033e0 0x7f525019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48238/0 (socket says 172.21.15.78:48238) 2024-09-18T13:07:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.534+0000 7f524ffff640 1 -- 172.21.15.78:0/3233682357 learned_addr learned my addr 172.21.15.78:0/3233682357 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:07:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.534+0000 7f5254ec9640 1 --2- 172.21.15.78:0/3233682357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5250102ac0 0x7f525019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.534+0000 7f524ffff640 1 -- 172.21.15.78:0/3233682357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5250102ac0 msgr2=0x7f525019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.534+0000 7f524ffff640 1 --2- 172.21.15.78:0/3233682357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5250102ac0 0x7f525019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.534+0000 7f524ffff640 1 -- 172.21.15.78:0/3233682357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5250197800 con 0x7f52501033e0 2024-09-18T13:07:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.534+0000 7f5254ec9640 1 --2- 172.21.15.78:0/3233682357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5250102ac0 0x7f525019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:07:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.535+0000 7f524ffff640 1 --2- 172.21.15.78:0/3233682357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52501033e0 0x7f525019dbc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f524000d6d0 tx=0x7f524000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.535+0000 7f524dffb640 1 -- 172.21.15.78:0/3233682357 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5240017070 con 0x7f52501033e0 2024-09-18T13:07:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.535+0000 7f524dffb640 1 -- 172.21.15.78:0/3233682357 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f52400054e0 con 0x7f52501033e0 2024-09-18T13:07:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.535+0000 7f525712d640 1 -- 172.21.15.78:0/3233682357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5250197af0 con 0x7f52501033e0 2024-09-18T13:07:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.535+0000 7f524dffb640 1 -- 172.21.15.78:0/3233682357 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5240004ae0 con 0x7f52501033e0 2024-09-18T13:07:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.535+0000 7f525712d640 1 -- 172.21.15.78:0/3233682357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5250198080 con 0x7f52501033e0 2024-09-18T13:07:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.536+0000 7f525712d640 1 -- 172.21.15.78:0/3233682357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525006aa90 con 0x7f52501033e0 2024-09-18T13:07:50.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.537+0000 7f524dffb640 1 -- 172.21.15.78:0/3233682357 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5240004de0 con 0x7f52501033e0 2024-09-18T13:07:50.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.537+0000 7f524dffb640 1 --2- 172.21.15.78:0/3233682357 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f523c07af30 0x7f523c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:50.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.538+0000 7f524dffb640 1 -- 172.21.15.78:0/3233682357 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f524009dc50 con 0x7f52501033e0 2024-09-18T13:07:50.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.538+0000 7f5254ec9640 1 --2- 172.21.15.78:0/3233682357 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f523c07af30 0x7f523c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:50.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.538+0000 7f5254ec9640 1 --2- 172.21.15.78:0/3233682357 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f523c07af30 0x7f523c07d3f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5238006010 tx=0x7f52380095f0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:50.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.542+0000 7f524dffb640 1 -- 172.21.15.78:0/3233682357 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f52400691f0 con 0x7f52501033e0 2024-09-18T13:07:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:50 smithi148 ceph-mon[80030]: pgmap v560: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:50.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.786+0000 7f525712d640 1 -- 172.21.15.78:0/3233682357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5250105f90 con 0x7f52501033e0 2024-09-18T13:07:50.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.786+0000 7f524dffb640 1 -- 172.21.15.78:0/3233682357 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f524006e0a0 con 0x7f52501033e0 2024-09-18T13:07:50.788 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:07:50.788 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:07:50.788 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:07:50.788 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:07:50.788 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:07:50.788 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:07:50.788 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:07:50.788 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:07:50.788 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:07:50.788 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:07:50.788 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:07:50.789 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:07:50.789 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:07:50.789 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:07:50.789 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:07:50.789 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:07:50.789 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:07:50.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.789+0000 7f525712d640 1 -- 172.21.15.78:0/3233682357 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f523c07af30 msgr2=0x7f523c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:50.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.789+0000 7f525712d640 1 --2- 172.21.15.78:0/3233682357 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f523c07af30 0x7f523c07d3f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5238006010 tx=0x7f52380095f0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.789+0000 7f525712d640 1 -- 172.21.15.78:0/3233682357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52501033e0 msgr2=0x7f525019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:50.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.789+0000 7f525712d640 1 --2- 172.21.15.78:0/3233682357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52501033e0 0x7f525019dbc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f524000d6d0 tx=0x7f524000db90 comp rx=0 tx=0).stop 2024-09-18T13:07:50.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.789+0000 7f525712d640 1 -- 172.21.15.78:0/3233682357 shutdown_connections 2024-09-18T13:07:50.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.789+0000 7f525712d640 1 --2- 172.21.15.78:0/3233682357 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f523c07af30 0x7f523c07d3f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.789+0000 7f525712d640 1 --2- 172.21.15.78:0/3233682357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52501033e0 0x7f525019dbc0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.789+0000 7f525712d640 1 --2- 172.21.15.78:0/3233682357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5250102ac0 0x7f525019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.789+0000 7f525712d640 1 -- 172.21.15.78:0/3233682357 >> 172.21.15.78:0/3233682357 conn(0x7f52500fc520 msgr2=0x7f5250108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:50.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.789+0000 7f525712d640 1 -- 172.21.15.78:0/3233682357 shutdown_connections 2024-09-18T13:07:50.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.789+0000 7f525712d640 1 -- 172.21.15.78:0/3233682357 wait complete. 2024-09-18T13:07:50.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.870+0000 7f5ad5bfe640 1 -- 172.21.15.78:0/4066062403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad0102b20 msgr2=0x7f5ad0102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.870+0000 7f5ad5bfe640 1 --2- 172.21.15.78:0/4066062403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad0102b20 0x7f5ad0102f00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00098b0 tx=0x7f5ac002a560 comp rx=0 tx=0).stop 2024-09-18T13:07:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.870+0000 7f5ad5bfe640 1 -- 172.21.15.78:0/4066062403 shutdown_connections 2024-09-18T13:07:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.870+0000 7f5ad5bfe640 1 --2- 172.21.15.78:0/4066062403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ad0103440 0x7f5ad010b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.870+0000 7f5ad5bfe640 1 --2- 172.21.15.78:0/4066062403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad0102b20 0x7f5ad0102f00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.870+0000 7f5ad5bfe640 1 -- 172.21.15.78:0/4066062403 >> 172.21.15.78:0/4066062403 conn(0x7f5ad00fc520 msgr2=0x7f5ad00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.870+0000 7f5ad5bfe640 1 -- 172.21.15.78:0/4066062403 shutdown_connections 2024-09-18T13:07:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.870+0000 7f5ad5bfe640 1 -- 172.21.15.78:0/4066062403 wait complete. 2024-09-18T13:07:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.871+0000 7f5ad5bfe640 1 Processor -- start 2024-09-18T13:07:50.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.871+0000 7f5ad5bfe640 1 -- start start 2024-09-18T13:07:50.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.871+0000 7f5ad5bfe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad0102b20 0x7f5ad0100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:50.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.871+0000 7f5ad5bfe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ad0103440 0x7f5ad0100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:50.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.871+0000 7f5ad5bfe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad010edd0 con 0x7f5ad0102b20 2024-09-18T13:07:50.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.871+0000 7f5ad5bfe640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad010ec50 con 0x7f5ad0103440 2024-09-18T13:07:50.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.871+0000 7f5acf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad0102b20 0x7f5ad0100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:50.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.871+0000 7f5acf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad0102b20 0x7f5ad0100780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48262/0 (socket says 172.21.15.78:48262) 2024-09-18T13:07:50.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.871+0000 7f5acf7fe640 1 -- 172.21.15.78:0/2279564097 learned_addr learned my addr 172.21.15.78:0/2279564097 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:07:50.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.871+0000 7f5aceffd640 1 --2- 172.21.15.78:0/2279564097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ad0103440 0x7f5ad0100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:50.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.871+0000 7f5acf7fe640 1 -- 172.21.15.78:0/2279564097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ad0103440 msgr2=0x7f5ad0100cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:50.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.871+0000 7f5acf7fe640 1 --2- 172.21.15.78:0/2279564097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ad0103440 0x7f5ad0100cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:50.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.871+0000 7f5acf7fe640 1 -- 172.21.15.78:0/2279564097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad0101200 con 0x7f5ad0102b20 2024-09-18T13:07:50.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.872+0000 7f5acf7fe640 1 --2- 172.21.15.78:0/2279564097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad0102b20 0x7f5ad0100780 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0031460 tx=0x7f5ac00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:50.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.872+0000 7f5accff9640 1 -- 172.21.15.78:0/2279564097 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ac003f070 con 0x7f5ad0102b20 2024-09-18T13:07:50.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.872+0000 7f5accff9640 1 -- 172.21.15.78:0/2279564097 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5ac00044d0 con 0x7f5ad0102b20 2024-09-18T13:07:50.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.872+0000 7f5ad5bfe640 1 -- 172.21.15.78:0/2279564097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad0101490 con 0x7f5ad0102b20 2024-09-18T13:07:50.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.872+0000 7f5accff9640 1 -- 172.21.15.78:0/2279564097 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ac0035030 con 0x7f5ad0102b20 2024-09-18T13:07:50.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.872+0000 7f5ad5bfe640 1 -- 172.21.15.78:0/2279564097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad01a3dc0 con 0x7f5ad0102b20 2024-09-18T13:07:50.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.873+0000 7f5ad5bfe640 1 -- 172.21.15.78:0/2279564097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad006aa30 con 0x7f5ad0102b20 2024-09-18T13:07:50.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.874+0000 7f5accff9640 1 -- 172.21.15.78:0/2279564097 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5ac0042070 con 0x7f5ad0102b20 2024-09-18T13:07:50.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.874+0000 7f5accff9640 1 --2- 172.21.15.78:0/2279564097 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5ab807af80 0x7f5ab807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:50.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.874+0000 7f5accff9640 1 -- 172.21.15.78:0/2279564097 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f5ac00bea10 con 0x7f5ad0102b20 2024-09-18T13:07:50.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.874+0000 7f5aceffd640 1 --2- 172.21.15.78:0/2279564097 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5ab807af80 0x7f5ab807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:50.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.874+0000 7f5aceffd640 1 --2- 172.21.15.78:0/2279564097 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5ab807af80 0x7f5ab807d440 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0102210 tx=0x7f5ac4005c60 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:50.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:50.878+0000 7f5accff9640 1 -- 172.21.15.78:0/2279564097 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5ac0004cf0 con 0x7f5ad0102b20 2024-09-18T13:07:51.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.087+0000 7f5ad5bfe640 1 -- 172.21.15.78:0/2279564097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5ad0101cb0 con 0x7f5ad0102b20 2024-09-18T13:07:51.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.087+0000 7f5accff9640 1 -- 172.21.15.78:0/2279564097 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f5ac008a030 con 0x7f5ad0102b20 2024-09-18T13:07:51.089 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:07:51.089 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:07:51.089 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:07:51.089 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:07:51.089 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:07:51.089 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:07:51.089 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:07:51.089 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:07:51.089 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:07:51.089 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:07:51.090 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:07:51.090 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:07:51.090 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:07:51.090 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:07:51.090 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:07:51.090 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:07:51.090 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:07:51.090 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:07:51.090 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:07:51.090 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:07:51.090 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:07:51.090 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:07:51.091 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:07:51.091 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:07:51.091 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:07:51.091 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:07:51.091 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:07:51.091 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:07:51.091 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:07:51.091 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:07:51.091 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:07:51.091 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:07:51.091 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:07:51.091 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:07:51.091 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:07:51.092 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:07:51.092 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:07:51.092 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:07:51.092 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:07:51.092 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:07:51.092 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:07:51.092 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:07:51.092 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:07:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:07:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.089+0000 7f5ad5bfe640 1 -- 172.21.15.78:0/2279564097 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5ab807af80 msgr2=0x7f5ab807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.089+0000 7f5ad5bfe640 1 --2- 172.21.15.78:0/2279564097 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5ab807af80 0x7f5ab807d440 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0102210 tx=0x7f5ac4005c60 comp rx=0 tx=0).stop 2024-09-18T13:07:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.089+0000 7f5ad5bfe640 1 -- 172.21.15.78:0/2279564097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad0102b20 msgr2=0x7f5ad0100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.089+0000 7f5ad5bfe640 1 --2- 172.21.15.78:0/2279564097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad0102b20 0x7f5ad0100780 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0031460 tx=0x7f5ac00048f0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.090+0000 7f5ad5bfe640 1 -- 172.21.15.78:0/2279564097 shutdown_connections 2024-09-18T13:07:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.090+0000 7f5ad5bfe640 1 --2- 172.21.15.78:0/2279564097 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5ab807af80 0x7f5ab807d440 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.090+0000 7f5ad5bfe640 1 --2- 172.21.15.78:0/2279564097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ad0103440 0x7f5ad0100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.090+0000 7f5ad5bfe640 1 --2- 172.21.15.78:0/2279564097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad0102b20 0x7f5ad0100780 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.090+0000 7f5ad5bfe640 1 -- 172.21.15.78:0/2279564097 >> 172.21.15.78:0/2279564097 conn(0x7f5ad00fc520 msgr2=0x7f5ad0103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.090+0000 7f5ad5bfe640 1 -- 172.21.15.78:0/2279564097 shutdown_connections 2024-09-18T13:07:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.090+0000 7f5ad5bfe640 1 -- 172.21.15.78:0/2279564097 wait complete. 2024-09-18T13:07:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.173+0000 7fa0f8c82640 1 -- 172.21.15.78:0/3600245477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f41007f0 msgr2=0x7fa0f4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.173+0000 7fa0f8c82640 1 --2- 172.21.15.78:0/3600245477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f41007f0 0x7fa0f4100c50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009880 tx=0x7fa0e802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.173+0000 7fa0f8c82640 1 -- 172.21.15.78:0/3600245477 shutdown_connections 2024-09-18T13:07:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.173+0000 7fa0f8c82640 1 --2- 172.21.15.78:0/3600245477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f41007f0 0x7fa0f4100c50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.173+0000 7fa0f8c82640 1 --2- 172.21.15.78:0/3600245477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0f41067f0 0x7fa0f4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.173+0000 7fa0f8c82640 1 -- 172.21.15.78:0/3600245477 >> 172.21.15.78:0/3600245477 conn(0x7fa0f40fc550 msgr2=0x7fa0f40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:51.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.173+0000 7fa0f8c82640 1 -- 172.21.15.78:0/3600245477 shutdown_connections 2024-09-18T13:07:51.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.173+0000 7fa0f8c82640 1 -- 172.21.15.78:0/3600245477 wait complete. 2024-09-18T13:07:51.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.174+0000 7fa0f8c82640 1 Processor -- start 2024-09-18T13:07:51.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.174+0000 7fa0f8c82640 1 -- start start 2024-09-18T13:07:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.174+0000 7fa0f8c82640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0f41007f0 0x7fa0f419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.174+0000 7fa0f8c82640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f41067f0 0x7fa0f419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.174+0000 7fa0f8c82640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f410dcc0 con 0x7fa0f41067f0 2024-09-18T13:07:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.174+0000 7fa0f8c82640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f410db40 con 0x7fa0f41007f0 2024-09-18T13:07:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.174+0000 7fa0f1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f41067f0 0x7fa0f419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.174+0000 7fa0f1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f41067f0 0x7fa0f419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48384/0 (socket says 172.21.15.78:48384) 2024-09-18T13:07:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.174+0000 7fa0f1d9b640 1 -- 172.21.15.78:0/1208028749 learned_addr learned my addr 172.21.15.78:0/1208028749 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:07:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.174+0000 7fa0f259c640 1 --2- 172.21.15.78:0/1208028749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0f41007f0 0x7fa0f419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.174+0000 7fa0f1d9b640 1 -- 172.21.15.78:0/1208028749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0f41007f0 msgr2=0x7fa0f419f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.174+0000 7fa0f1d9b640 1 --2- 172.21.15.78:0/1208028749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0f41007f0 0x7fa0f419f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.174+0000 7fa0f1d9b640 1 -- 172.21.15.78:0/1208028749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f41999b0 con 0x7fa0f41067f0 2024-09-18T13:07:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.175+0000 7fa0f1d9b640 1 --2- 172.21.15.78:0/1208028749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f41067f0 0x7fa0f419fd30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8031460 tx=0x7fa0e8004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:51.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.175+0000 7fa0e37fe640 1 -- 172.21.15.78:0/1208028749 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0e803f070 con 0x7fa0f41067f0 2024-09-18T13:07:51.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.175+0000 7fa0e37fe640 1 -- 172.21.15.78:0/1208028749 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa0e80035f0 con 0x7fa0f41067f0 2024-09-18T13:07:51.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.175+0000 7fa0f8c82640 1 -- 172.21.15.78:0/1208028749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f4199c40 con 0x7fa0f41067f0 2024-09-18T13:07:51.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.175+0000 7fa0e37fe640 1 -- 172.21.15.78:0/1208028749 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0e8035030 con 0x7fa0f41067f0 2024-09-18T13:07:51.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.175+0000 7fa0f8c82640 1 -- 172.21.15.78:0/1208028749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f419a170 con 0x7fa0f41067f0 2024-09-18T13:07:51.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.176+0000 7fa0f8c82640 1 -- 172.21.15.78:0/1208028749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0f4101f30 con 0x7fa0f41067f0 2024-09-18T13:07:51.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.176+0000 7fa0e37fe640 1 -- 172.21.15.78:0/1208028749 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa0e8042070 con 0x7fa0f41067f0 2024-09-18T13:07:51.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.177+0000 7fa0e37fe640 1 --2- 172.21.15.78:0/1208028749 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa0dc07af30 0x7fa0dc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:51.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.177+0000 7fa0e37fe640 1 -- 172.21.15.78:0/1208028749 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fa0e80be960 con 0x7fa0f41067f0 2024-09-18T13:07:51.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.177+0000 7fa0f259c640 1 --2- 172.21.15.78:0/1208028749 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa0dc07af30 0x7fa0dc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:51.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.177+0000 7fa0f259c640 1 --2- 172.21.15.78:0/1208028749 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa0dc07af30 0x7fa0dc07d3f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa0f419aaf0 tx=0x7fa0e4005f90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:51.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.181+0000 7fa0e37fe640 1 -- 172.21.15.78:0/1208028749 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa0e8089f00 con 0x7fa0f41067f0 2024-09-18T13:07:51.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.372+0000 7fa0f8c82640 1 -- 172.21.15.78:0/1208028749 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa0f419a420 con 0x7fa0dc07af30 2024-09-18T13:07:51.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.373+0000 7fa0e37fe640 1 -- 172.21.15.78:0/1208028749 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa0f419a420 con 0x7fa0dc07af30 2024-09-18T13:07:51.375 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:07:51.375 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:07:51.375 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:07:51.375 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:07:51.375 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:07:51.375 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:07:51.375 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:07:51.375 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:07:51.375 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:07:51.375 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:07:51.375 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:07:51.375 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:07:51.375 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:07:51.376 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:07:51.376 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:07:51.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.375+0000 7fa0f8c82640 1 -- 172.21.15.78:0/1208028749 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa0dc07af30 msgr2=0x7fa0dc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:51.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.375+0000 7fa0f8c82640 1 --2- 172.21.15.78:0/1208028749 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa0dc07af30 0x7fa0dc07d3f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa0f419aaf0 tx=0x7fa0e4005f90 comp rx=0 tx=0).stop 2024-09-18T13:07:51.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.375+0000 7fa0f8c82640 1 -- 172.21.15.78:0/1208028749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f41067f0 msgr2=0x7fa0f419fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:51.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.375+0000 7fa0f8c82640 1 --2- 172.21.15.78:0/1208028749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f41067f0 0x7fa0f419fd30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8031460 tx=0x7fa0e8004530 comp rx=0 tx=0).stop 2024-09-18T13:07:51.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.375+0000 7fa0f8c82640 1 -- 172.21.15.78:0/1208028749 shutdown_connections 2024-09-18T13:07:51.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.375+0000 7fa0f8c82640 1 --2- 172.21.15.78:0/1208028749 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa0dc07af30 0x7fa0dc07d3f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.375+0000 7fa0f8c82640 1 --2- 172.21.15.78:0/1208028749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f41067f0 0x7fa0f419fd30 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.375+0000 7fa0f8c82640 1 --2- 172.21.15.78:0/1208028749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0f41007f0 0x7fa0f419f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.375+0000 7fa0f8c82640 1 -- 172.21.15.78:0/1208028749 >> 172.21.15.78:0/1208028749 conn(0x7fa0f40fc550 msgr2=0x7fa0f4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:51.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.375+0000 7fa0f8c82640 1 -- 172.21.15.78:0/1208028749 shutdown_connections 2024-09-18T13:07:51.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.375+0000 7fa0f8c82640 1 -- 172.21.15.78:0/1208028749 wait complete. 2024-09-18T13:07:51.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.457+0000 7f74461a7640 1 -- 172.21.15.78:0/723996297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7440102b60 msgr2=0x7f7440102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:51.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.457+0000 7f74461a7640 1 --2- 172.21.15.78:0/723996297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7440102b60 0x7f7440102f40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f74300098b0 tx=0x7f743002a560 comp rx=0 tx=0).stop 2024-09-18T13:07:51.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.457+0000 7f74461a7640 1 -- 172.21.15.78:0/723996297 shutdown_connections 2024-09-18T13:07:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.457+0000 7f74461a7640 1 --2- 172.21.15.78:0/723996297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7440103480 0x7f744010b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.457+0000 7f74461a7640 1 --2- 172.21.15.78:0/723996297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7440102b60 0x7f7440102f40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.457+0000 7f74461a7640 1 -- 172.21.15.78:0/723996297 >> 172.21.15.78:0/723996297 conn(0x7f74400fc580 msgr2=0x7f74400fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.457+0000 7f74461a7640 1 -- 172.21.15.78:0/723996297 shutdown_connections 2024-09-18T13:07:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.457+0000 7f74461a7640 1 -- 172.21.15.78:0/723996297 wait complete. 2024-09-18T13:07:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.458+0000 7f74461a7640 1 Processor -- start 2024-09-18T13:07:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.458+0000 7f74461a7640 1 -- start start 2024-09-18T13:07:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.458+0000 7f74461a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7440102b60 0x7f74401007c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.458+0000 7f74461a7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7440103480 0x7f7440100d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.458+0000 7f74461a7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f744010eeb0 con 0x7f7440102b60 2024-09-18T13:07:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.458+0000 7f74461a7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f744010ed30 con 0x7f7440103480 2024-09-18T13:07:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.458+0000 7f743f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7440102b60 0x7f74401007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.458+0000 7f743f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7440102b60 0x7f74401007c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48402/0 (socket says 172.21.15.78:48402) 2024-09-18T13:07:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.458+0000 7f743f7fe640 1 -- 172.21.15.78:0/2090486681 learned_addr learned my addr 172.21.15.78:0/2090486681 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:07:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.458+0000 7f743effd640 1 --2- 172.21.15.78:0/2090486681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7440103480 0x7f7440100d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.459+0000 7f743f7fe640 1 -- 172.21.15.78:0/2090486681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7440103480 msgr2=0x7f7440100d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.459+0000 7f743f7fe640 1 --2- 172.21.15.78:0/2090486681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7440103480 0x7f7440100d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.459+0000 7f743f7fe640 1 -- 172.21.15.78:0/2090486681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7440101240 con 0x7f7440102b60 2024-09-18T13:07:51.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.459+0000 7f743effd640 1 --2- 172.21.15.78:0/2090486681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7440103480 0x7f7440100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:07:51.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.459+0000 7f743f7fe640 1 --2- 172.21.15.78:0/2090486681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7440102b60 0x7f74401007c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7430009230 tx=0x7f74300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:51.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.459+0000 7f743cff9640 1 -- 172.21.15.78:0/2090486681 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f743003f070 con 0x7f7440102b60 2024-09-18T13:07:51.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.459+0000 7f743cff9640 1 -- 172.21.15.78:0/2090486681 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7430004ac0 con 0x7f7440102b60 2024-09-18T13:07:51.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.459+0000 7f74461a7640 1 -- 172.21.15.78:0/2090486681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74401014d0 con 0x7f7440102b60 2024-09-18T13:07:51.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.459+0000 7f743cff9640 1 -- 172.21.15.78:0/2090486681 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7430035030 con 0x7f7440102b60 2024-09-18T13:07:51.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.459+0000 7f74461a7640 1 -- 172.21.15.78:0/2090486681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74401a3ec0 con 0x7f7440102b60 2024-09-18T13:07:51.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.460+0000 7f74461a7640 1 -- 172.21.15.78:0/2090486681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f744006ad60 con 0x7f7440102b60 2024-09-18T13:07:51.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.461+0000 7f743cff9640 1 -- 172.21.15.78:0/2090486681 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7430042070 con 0x7f7440102b60 2024-09-18T13:07:51.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.461+0000 7f743cff9640 1 --2- 172.21.15.78:0/2090486681 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f742807af40 0x7f742807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:07:51.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.461+0000 7f743cff9640 1 -- 172.21.15.78:0/2090486681 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f74300bec60 con 0x7f7440102b60 2024-09-18T13:07:51.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.461+0000 7f743effd640 1 --2- 172.21.15.78:0/2090486681 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f742807af40 0x7f742807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:07:51.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.462+0000 7f743effd640 1 --2- 172.21.15.78:0/2090486681 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f742807af40 0x7f742807d400 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7440102250 tx=0x7f7434008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:07:51.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.466+0000 7f743cff9640 1 -- 172.21.15.78:0/2090486681 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f743008a200 con 0x7f7440102b60 2024-09-18T13:07:51.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.705+0000 7f74461a7640 1 -- 172.21.15.78:0/2090486681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7440101cf0 con 0x7f7440102b60 2024-09-18T13:07:51.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:51 smithi078 ceph-mon[108578]: from='client.34862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:51.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:51 smithi078 ceph-mon[108578]: from='client.34866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:51.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:51 smithi078 ceph-mon[108578]: from='client.34870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:51.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:51 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3233682357' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:07:51.707 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:51 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2279564097' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:07:51.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.705+0000 7f743cff9640 1 -- 172.21.15.78:0/2090486681 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f743007fe20 con 0x7f7440102b60 2024-09-18T13:07:51.707 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:07:51.707 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:07:51.707 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:07:51.707 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:07:51.707 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:07:51.708 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:07:51.708 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:07:51.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.708+0000 7f74461a7640 1 -- 172.21.15.78:0/2090486681 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f742807af40 msgr2=0x7f742807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:51.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.708+0000 7f74461a7640 1 --2- 172.21.15.78:0/2090486681 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f742807af40 0x7f742807d400 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7440102250 tx=0x7f7434008040 comp rx=0 tx=0).stop 2024-09-18T13:07:51.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.708+0000 7f74461a7640 1 -- 172.21.15.78:0/2090486681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7440102b60 msgr2=0x7f74401007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:07:51.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.708+0000 7f74461a7640 1 --2- 172.21.15.78:0/2090486681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7440102b60 0x7f74401007c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7430009230 tx=0x7f74300046c0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.708+0000 7f74461a7640 1 -- 172.21.15.78:0/2090486681 shutdown_connections 2024-09-18T13:07:51.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.708+0000 7f74461a7640 1 --2- 172.21.15.78:0/2090486681 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f742807af40 0x7f742807d400 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.708+0000 7f74461a7640 1 --2- 172.21.15.78:0/2090486681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7440103480 0x7f7440100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.708+0000 7f74461a7640 1 --2- 172.21.15.78:0/2090486681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7440102b60 0x7f74401007c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:07:51.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.708+0000 7f74461a7640 1 -- 172.21.15.78:0/2090486681 >> 172.21.15.78:0/2090486681 conn(0x7f74400fc580 msgr2=0x7f7440108f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:07:51.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.708+0000 7f74461a7640 1 -- 172.21.15.78:0/2090486681 shutdown_connections 2024-09-18T13:07:51.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:07:51.708+0000 7f74461a7640 1 -- 172.21.15.78:0/2090486681 wait complete. 2024-09-18T13:07:51.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:51 smithi148 ceph-mon[80030]: from='client.34862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:51 smithi148 ceph-mon[80030]: from='client.34866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:51 smithi148 ceph-mon[80030]: from='client.34870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:51 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3233682357' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:07:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:51 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2279564097' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:07:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:52 smithi148 ceph-mon[80030]: pgmap v561: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:52 smithi148 ceph-mon[80030]: from='client.34882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:52 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2090486681' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:07:52.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:52 smithi078 ceph-mon[108578]: pgmap v561: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:52.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:52 smithi078 ceph-mon[108578]: from='client.34882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:07:52.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:52 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2090486681' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:07:54.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:54 smithi148 ceph-mon[80030]: pgmap v562: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:54.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:54 smithi078 ceph-mon[108578]: pgmap v562: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:56 smithi148 ceph-mon[80030]: pgmap v563: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:56 smithi078 ceph-mon[108578]: pgmap v563: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:58 smithi148 ceph-mon[80030]: pgmap v564: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:58.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:58 smithi078 ceph-mon[108578]: pgmap v564: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:07:59 smithi148 ceph-mon[80030]: pgmap v565: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:07:59.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:07:59 smithi078 ceph-mon[108578]: pgmap v565: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:02.426 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:02 smithi148 ceph-mon[80030]: pgmap v566: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:02 smithi078 ceph-mon[108578]: pgmap v566: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:04 smithi078 ceph-mon[108578]: pgmap v567: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:04 smithi148 ceph-mon[80030]: pgmap v567: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:06.701 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:06 smithi078 ceph-mon[108578]: pgmap v568: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:06.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:06 smithi148 ceph-mon[80030]: pgmap v568: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:08.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:08 smithi148 ceph-mon[80030]: pgmap v569: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:08.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:08 smithi078 ceph-mon[108578]: pgmap v569: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:10 smithi148 ceph-mon[80030]: pgmap v570: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:10.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:10 smithi078 ceph-mon[108578]: pgmap v570: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:12.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:12 smithi078 ceph-mon[108578]: pgmap v571: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:12.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:12 smithi148 ceph-mon[80030]: pgmap v571: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:14 smithi148 ceph-mon[80030]: pgmap v572: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:14.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:14 smithi078 ceph-mon[108578]: pgmap v572: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:16.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:16 smithi148 ceph-mon[80030]: pgmap v573: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:16 smithi078 ceph-mon[108578]: pgmap v573: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:18.701 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:18 smithi078 ceph-mon[108578]: pgmap v574: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:18 smithi148 ceph-mon[80030]: pgmap v574: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:20 smithi148 ceph-mon[80030]: pgmap v575: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:20.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:20 smithi078 ceph-mon[108578]: pgmap v575: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:21.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.802+0000 7f7442065640 1 -- 172.21.15.78:0/777432842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f743c107900 msgr2=0x7f743c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:21.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.802+0000 7f7442065640 1 --2- 172.21.15.78:0/777432842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f743c107900 0x7f743c107ce0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f742c009880 tx=0x7f742c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:08:21.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.802+0000 7f7442065640 1 -- 172.21.15.78:0/777432842 shutdown_connections 2024-09-18T13:08:21.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.802+0000 7f7442065640 1 --2- 172.21.15.78:0/777432842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f743c101900 0x7f743c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:21.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.802+0000 7f7442065640 1 --2- 172.21.15.78:0/777432842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f743c107900 0x7f743c107ce0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:21.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.802+0000 7f7442065640 1 -- 172.21.15.78:0/777432842 >> 172.21.15.78:0/777432842 conn(0x7f743c0fd600 msgr2=0x7f743c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:21.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.802+0000 7f7442065640 1 -- 172.21.15.78:0/777432842 shutdown_connections 2024-09-18T13:08:21.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.802+0000 7f7442065640 1 -- 172.21.15.78:0/777432842 wait complete. 2024-09-18T13:08:21.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.803+0000 7f7442065640 1 Processor -- start 2024-09-18T13:08:21.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.803+0000 7f7442065640 1 -- start start 2024-09-18T13:08:21.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.803+0000 7f7442065640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f743c101900 0x7f743c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:21.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.803+0000 7f7442065640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f743c107900 0x7f743c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:21.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.803+0000 7f7442065640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f743c10edd0 con 0x7f743c107900 2024-09-18T13:08:21.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.803+0000 7f7442065640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f743c10ec50 con 0x7f743c101900 2024-09-18T13:08:21.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.803+0000 7f743affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f743c107900 0x7f743c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:21.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.803+0000 7f743affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f743c107900 0x7f743c19db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46610/0 (socket says 172.21.15.78:46610) 2024-09-18T13:08:21.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.803+0000 7f743affd640 1 -- 172.21.15.78:0/2810637422 learned_addr learned my addr 172.21.15.78:0/2810637422 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:08:21.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.804+0000 7f743b7fe640 1 --2- 172.21.15.78:0/2810637422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f743c101900 0x7f743c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:21.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.804+0000 7f743affd640 1 -- 172.21.15.78:0/2810637422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f743c101900 msgr2=0x7f743c19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:21.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.804+0000 7f743affd640 1 --2- 172.21.15.78:0/2810637422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f743c101900 0x7f743c19d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.804+0000 7f743affd640 1 -- 172.21.15.78:0/2810637422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743c1977c0 con 0x7f743c107900 2024-09-18T13:08:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.804+0000 7f743b7fe640 1 --2- 172.21.15.78:0/2810637422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f743c101900 0x7f743c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:08:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.804+0000 7f743affd640 1 --2- 172.21.15.78:0/2810637422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f743c107900 0x7f743c19db80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f743000d6f0 tx=0x7f743000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.804+0000 7f7438ff9640 1 -- 172.21.15.78:0/2810637422 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7430017070 con 0x7f743c107900 2024-09-18T13:08:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.804+0000 7f7442065640 1 -- 172.21.15.78:0/2810637422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f743c197ab0 con 0x7f743c107900 2024-09-18T13:08:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.804+0000 7f7438ff9640 1 -- 172.21.15.78:0/2810637422 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f743000de00 con 0x7f743c107900 2024-09-18T13:08:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.804+0000 7f7438ff9640 1 -- 172.21.15.78:0/2810637422 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7430004bb0 con 0x7f743c107900 2024-09-18T13:08:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.804+0000 7f7442065640 1 -- 172.21.15.78:0/2810637422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f743c198040 con 0x7f743c107900 2024-09-18T13:08:21.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.805+0000 7f7442065640 1 -- 172.21.15.78:0/2810637422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f743c103040 con 0x7f743c107900 2024-09-18T13:08:21.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.806+0000 7f7438ff9640 1 -- 172.21.15.78:0/2810637422 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7430004e60 con 0x7f743c107900 2024-09-18T13:08:21.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.807+0000 7f7438ff9640 1 --2- 172.21.15.78:0/2810637422 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f742407af30 0x7f742407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:21.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.807+0000 7f7438ff9640 1 -- 172.21.15.78:0/2810637422 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f743009dcb0 con 0x7f743c107900 2024-09-18T13:08:21.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.807+0000 7f743b7fe640 1 --2- 172.21.15.78:0/2810637422 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f742407af30 0x7f742407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:21.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.807+0000 7f743b7fe640 1 --2- 172.21.15.78:0/2810637422 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f742407af30 0x7f742407d3f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f742c000c00 tx=0x7f742c031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:21.811+0000 7f7438ff9640 1 -- 172.21.15.78:0/2810637422 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7430069250 con 0x7f743c107900 2024-09-18T13:08:22.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.003+0000 7f7442065640 1 -- 172.21.15.78:0/2810637422 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f743c1983b0 con 0x7f742407af30 2024-09-18T13:08:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.005+0000 7f7438ff9640 1 -- 172.21.15.78:0/2810637422 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f743c1983b0 con 0x7f742407af30 2024-09-18T13:08:22.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.007+0000 7f7442065640 1 -- 172.21.15.78:0/2810637422 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f742407af30 msgr2=0x7f742407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:22.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.007+0000 7f7442065640 1 --2- 172.21.15.78:0/2810637422 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f742407af30 0x7f742407d3f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f742c000c00 tx=0x7f742c031400 comp rx=0 tx=0).stop 2024-09-18T13:08:22.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.007+0000 7f7442065640 1 -- 172.21.15.78:0/2810637422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f743c107900 msgr2=0x7f743c19db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:22.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.007+0000 7f7442065640 1 --2- 172.21.15.78:0/2810637422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f743c107900 0x7f743c19db80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f743000d6f0 tx=0x7f743000dbb0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.007+0000 7f7442065640 1 -- 172.21.15.78:0/2810637422 shutdown_connections 2024-09-18T13:08:22.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.007+0000 7f7442065640 1 --2- 172.21.15.78:0/2810637422 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f742407af30 0x7f742407d3f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.007+0000 7f7442065640 1 --2- 172.21.15.78:0/2810637422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f743c107900 0x7f743c19db80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.007+0000 7f7442065640 1 --2- 172.21.15.78:0/2810637422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f743c101900 0x7f743c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.007+0000 7f7442065640 1 -- 172.21.15.78:0/2810637422 >> 172.21.15.78:0/2810637422 conn(0x7f743c0fd600 msgr2=0x7f743c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:22.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.007+0000 7f7442065640 1 -- 172.21.15.78:0/2810637422 shutdown_connections 2024-09-18T13:08:22.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.007+0000 7f7442065640 1 -- 172.21.15.78:0/2810637422 wait complete. 2024-09-18T13:08:22.018 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:08:22.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.089+0000 7f32daf67640 1 -- 172.21.15.78:0/1810518161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d41007f0 msgr2=0x7f32d4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:22.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.089+0000 7f32daf67640 1 --2- 172.21.15.78:0/1810518161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d41007f0 0x7f32d4100c50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f32c4009c20 tx=0x7f32c402a970 comp rx=0 tx=0).stop 2024-09-18T13:08:22.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.089+0000 7f32daf67640 1 -- 172.21.15.78:0/1810518161 shutdown_connections 2024-09-18T13:08:22.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.089+0000 7f32daf67640 1 --2- 172.21.15.78:0/1810518161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d41007f0 0x7f32d4100c50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.089+0000 7f32daf67640 1 --2- 172.21.15.78:0/1810518161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32d41067f0 0x7f32d4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.089+0000 7f32daf67640 1 -- 172.21.15.78:0/1810518161 >> 172.21.15.78:0/1810518161 conn(0x7f32d40fc550 msgr2=0x7f32d40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:22.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.089+0000 7f32daf67640 1 -- 172.21.15.78:0/1810518161 shutdown_connections 2024-09-18T13:08:22.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.089+0000 7f32daf67640 1 -- 172.21.15.78:0/1810518161 wait complete. 2024-09-18T13:08:22.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.089+0000 7f32daf67640 1 Processor -- start 2024-09-18T13:08:22.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.090+0000 7f32daf67640 1 -- start start 2024-09-18T13:08:22.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.090+0000 7f32daf67640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d41007f0 0x7f32d419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:22.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.090+0000 7f32daf67640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32d41067f0 0x7f32d419db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:22.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.090+0000 7f32daf67640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32d410dcc0 con 0x7f32d41007f0 2024-09-18T13:08:22.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.090+0000 7f32daf67640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f32d410db40 con 0x7f32d41067f0 2024-09-18T13:08:22.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.090+0000 7f32d8d03640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d41007f0 0x7f32d419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:22.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.090+0000 7f32d8d03640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d41007f0 0x7f32d419d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46632/0 (socket says 172.21.15.78:46632) 2024-09-18T13:08:22.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.090+0000 7f32d8d03640 1 -- 172.21.15.78:0/4018271325 learned_addr learned my addr 172.21.15.78:0/4018271325 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:08:22.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.090+0000 7f32d3fff640 1 --2- 172.21.15.78:0/4018271325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32d41067f0 0x7f32d419db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:22.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.090+0000 7f32d8d03640 1 -- 172.21.15.78:0/4018271325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32d41067f0 msgr2=0x7f32d419db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:22.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.090+0000 7f32d8d03640 1 --2- 172.21.15.78:0/4018271325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32d41067f0 0x7f32d419db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.090+0000 7f32d8d03640 1 -- 172.21.15.78:0/4018271325 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d4197780 con 0x7f32d41007f0 2024-09-18T13:08:22.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.090+0000 7f32d8d03640 1 --2- 172.21.15.78:0/4018271325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d41007f0 0x7f32d419d600 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00d6f0 tx=0x7f32cc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:22.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.090+0000 7f32d1ffb640 1 -- 172.21.15.78:0/4018271325 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f32cc017070 con 0x7f32d41007f0 2024-09-18T13:08:22.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.090+0000 7f32d1ffb640 1 -- 172.21.15.78:0/4018271325 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f32cc00de00 con 0x7f32d41007f0 2024-09-18T13:08:22.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.091+0000 7f32daf67640 1 -- 172.21.15.78:0/4018271325 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d4197a70 con 0x7f32d41007f0 2024-09-18T13:08:22.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.091+0000 7f32d1ffb640 1 -- 172.21.15.78:0/4018271325 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f32cc004bb0 con 0x7f32d41007f0 2024-09-18T13:08:22.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.091+0000 7f32daf67640 1 -- 172.21.15.78:0/4018271325 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d4198000 con 0x7f32d41007f0 2024-09-18T13:08:22.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.092+0000 7f32daf67640 1 -- 172.21.15.78:0/4018271325 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32d4101f30 con 0x7f32d41007f0 2024-09-18T13:08:22.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.092+0000 7f32d1ffb640 1 -- 172.21.15.78:0/4018271325 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f32cc009a30 con 0x7f32d41007f0 2024-09-18T13:08:22.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.093+0000 7f32d1ffb640 1 --2- 172.21.15.78:0/4018271325 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f32c007af80 0x7f32c007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:22.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.093+0000 7f32d1ffb640 1 -- 172.21.15.78:0/4018271325 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f32cc09dbd0 con 0x7f32d41007f0 2024-09-18T13:08:22.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.093+0000 7f32d3fff640 1 --2- 172.21.15.78:0/4018271325 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f32c007af80 0x7f32c007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:22.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.093+0000 7f32d3fff640 1 --2- 172.21.15.78:0/4018271325 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f32c007af80 0x7f32c007d440 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f32d406ad60 tx=0x7f32c4005f30 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:22.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.097+0000 7f32d1ffb640 1 -- 172.21.15.78:0/4018271325 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f32cc0691f0 con 0x7f32d41007f0 2024-09-18T13:08:22.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.288+0000 7f32daf67640 1 -- 172.21.15.78:0/4018271325 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f32d41982b0 con 0x7f32c007af80 2024-09-18T13:08:22.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.289+0000 7f32d1ffb640 1 -- 172.21.15.78:0/4018271325 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f32d41982b0 con 0x7f32c007af80 2024-09-18T13:08:22.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.291+0000 7f32daf67640 1 -- 172.21.15.78:0/4018271325 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f32c007af80 msgr2=0x7f32c007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:22.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.291+0000 7f32daf67640 1 --2- 172.21.15.78:0/4018271325 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f32c007af80 0x7f32c007d440 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f32d406ad60 tx=0x7f32c4005f30 comp rx=0 tx=0).stop 2024-09-18T13:08:22.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.291+0000 7f32daf67640 1 -- 172.21.15.78:0/4018271325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d41007f0 msgr2=0x7f32d419d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:22.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.291+0000 7f32daf67640 1 --2- 172.21.15.78:0/4018271325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d41007f0 0x7f32d419d600 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00d6f0 tx=0x7f32cc00dbb0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.291+0000 7f32daf67640 1 -- 172.21.15.78:0/4018271325 shutdown_connections 2024-09-18T13:08:22.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.291+0000 7f32daf67640 1 --2- 172.21.15.78:0/4018271325 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f32c007af80 0x7f32c007d440 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.291+0000 7f32daf67640 1 --2- 172.21.15.78:0/4018271325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32d41067f0 0x7f32d419db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.291+0000 7f32daf67640 1 --2- 172.21.15.78:0/4018271325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d41007f0 0x7f32d419d600 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.291+0000 7f32daf67640 1 -- 172.21.15.78:0/4018271325 >> 172.21.15.78:0/4018271325 conn(0x7f32d40fc550 msgr2=0x7f32d4104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:22.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.291+0000 7f32daf67640 1 -- 172.21.15.78:0/4018271325 shutdown_connections 2024-09-18T13:08:22.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.291+0000 7f32daf67640 1 -- 172.21.15.78:0/4018271325 wait complete. 2024-09-18T13:08:22.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.374+0000 7f03ac23f640 1 -- 172.21.15.78:0/3512332855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03a4103b00 msgr2=0x7f03a4103f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:22.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.374+0000 7f03ac23f640 1 --2- 172.21.15.78:0/3512332855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03a4103b00 0x7f03a4103f60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0394009880 tx=0x7f039402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.374+0000 7f03ac23f640 1 -- 172.21.15.78:0/3512332855 shutdown_connections 2024-09-18T13:08:22.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.374+0000 7f03ac23f640 1 --2- 172.21.15.78:0/3512332855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03a4103b00 0x7f03a4103f60 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.374+0000 7f03ac23f640 1 --2- 172.21.15.78:0/3512332855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03a4109b90 0x7f03a4109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.374+0000 7f03ac23f640 1 -- 172.21.15.78:0/3512332855 >> 172.21.15.78:0/3512332855 conn(0x7f03a40ff800 msgr2=0x7f03a4101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:22.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.374+0000 7f03ac23f640 1 -- 172.21.15.78:0/3512332855 shutdown_connections 2024-09-18T13:08:22.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.374+0000 7f03ac23f640 1 -- 172.21.15.78:0/3512332855 wait complete. 2024-09-18T13:08:22.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.375+0000 7f03ac23f640 1 Processor -- start 2024-09-18T13:08:22.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.375+0000 7f03ac23f640 1 -- start start 2024-09-18T13:08:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.375+0000 7f03ac23f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03a4103b00 0x7f03a419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.375+0000 7f03ac23f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03a4109b90 0x7f03a419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.375+0000 7f03ac23f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f03a4110fb0 con 0x7f03a4103b00 2024-09-18T13:08:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.375+0000 7f03ac23f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f03a4110e30 con 0x7f03a4109b90 2024-09-18T13:08:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.375+0000 7f03a9fdb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03a4103b00 0x7f03a419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.375+0000 7f03a9fdb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03a4103b00 0x7f03a419f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46648/0 (socket says 172.21.15.78:46648) 2024-09-18T13:08:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.375+0000 7f03a9fdb640 1 -- 172.21.15.78:0/2677519935 learned_addr learned my addr 172.21.15.78:0/2677519935 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:08:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.375+0000 7f03a97da640 1 --2- 172.21.15.78:0/2677519935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03a4109b90 0x7f03a419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.375+0000 7f03a9fdb640 1 -- 172.21.15.78:0/2677519935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03a4109b90 msgr2=0x7f03a419fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.375+0000 7f03a9fdb640 1 --2- 172.21.15.78:0/2677519935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03a4109b90 0x7f03a419fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.375+0000 7f03a9fdb640 1 -- 172.21.15.78:0/2677519935 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a41999e0 con 0x7f03a4103b00 2024-09-18T13:08:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.375+0000 7f03a9fdb640 1 --2- 172.21.15.78:0/2677519935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03a4103b00 0x7f03a419f820 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f03a000d8d0 tx=0x7f03a000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.376+0000 7f039affd640 1 -- 172.21.15.78:0/2677519935 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03a0017070 con 0x7f03a4103b00 2024-09-18T13:08:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.376+0000 7f03ac23f640 1 -- 172.21.15.78:0/2677519935 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a4199cd0 con 0x7f03a4103b00 2024-09-18T13:08:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.376+0000 7f039affd640 1 -- 172.21.15.78:0/2677519935 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03a0010460 con 0x7f03a4103b00 2024-09-18T13:08:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.376+0000 7f039affd640 1 -- 172.21.15.78:0/2677519935 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03a000f5f0 con 0x7f03a4103b00 2024-09-18T13:08:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.376+0000 7f03ac23f640 1 -- 172.21.15.78:0/2677519935 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a419a230 con 0x7f03a4103b00 2024-09-18T13:08:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.377+0000 7f03ac23f640 1 -- 172.21.15.78:0/2677519935 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a4105200 con 0x7f03a4103b00 2024-09-18T13:08:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.377+0000 7f039affd640 1 -- 172.21.15.78:0/2677519935 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f03a0009a30 con 0x7f03a4103b00 2024-09-18T13:08:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.378+0000 7f039affd640 1 --2- 172.21.15.78:0/2677519935 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f039007af40 0x7f039007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.378+0000 7f03a97da640 1 --2- 172.21.15.78:0/2677519935 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f039007af40 0x7f039007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.378+0000 7f039affd640 1 -- 172.21.15.78:0/2677519935 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f03a009de80 con 0x7f03a4103b00 2024-09-18T13:08:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.378+0000 7f03a97da640 1 --2- 172.21.15.78:0/2677519935 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f039007af40 0x7f039007d400 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f03a419b1d0 tx=0x7f0394031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:22.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.382+0000 7f039affd640 1 -- 172.21.15.78:0/2677519935 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f03a0069420 con 0x7f03a4103b00 2024-09-18T13:08:22.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.567+0000 7f03ac23f640 1 -- 172.21.15.78:0/2677519935 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f03a410c100 con 0x7f039007af40 2024-09-18T13:08:22.569 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:22 smithi078 ceph-mon[108578]: pgmap v576: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.577+0000 7f039affd640 1 -- 172.21.15.78:0/2677519935 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f0394004260 con 0x7f039007af40 2024-09-18T13:08:22.579 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:08:22.579 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (16m) 10m ago 27m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:08:22.579 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (18m) 10m ago 27m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:08:22.579 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (18m) 9m ago 26m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:08:22.579 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (14m) 10m ago 27m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:08:22.579 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (14m) 9m ago 26m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:08:22.579 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (15m) 10m ago 26m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:08:22.579 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (10m) 10m ago 21m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:08:22.579 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (10m) 10m ago 21m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:08:22.579 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (10m) 9m ago 21m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:08:22.579 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (9m) 9m ago 21m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:08:22.579 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (18m) 10m ago 28m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:08:22.580 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (17m) 9m ago 26m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:08:22.580 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (14m) 10m ago 28m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:08:22.580 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (14m) 9m ago 26m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:08:22.580 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (17m) 10m ago 27m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:08:22.580 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (16m) 9m ago 26m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:08:22.580 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (14m) 10m ago 25m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:08:22.580 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (13m) 10m ago 24m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:08:22.580 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (12m) 10m ago 24m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:08:22.580 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (12m) 9m ago 23m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:08:22.580 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (11m) 9m ago 23m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:08:22.580 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (11m) 9m ago 22m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:08:22.580 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (16m) 10m ago 26m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:08:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.579+0000 7f03ac23f640 1 -- 172.21.15.78:0/2677519935 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f039007af40 msgr2=0x7f039007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.579+0000 7f03ac23f640 1 --2- 172.21.15.78:0/2677519935 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f039007af40 0x7f039007d400 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f03a419b1d0 tx=0x7f0394031400 comp rx=0 tx=0).stop 2024-09-18T13:08:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.579+0000 7f03ac23f640 1 -- 172.21.15.78:0/2677519935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03a4103b00 msgr2=0x7f03a419f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:22.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.579+0000 7f03ac23f640 1 --2- 172.21.15.78:0/2677519935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03a4103b00 0x7f03a419f820 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f03a000d8d0 tx=0x7f03a000dd90 comp rx=0 tx=0).stop 2024-09-18T13:08:22.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.579+0000 7f03ac23f640 1 -- 172.21.15.78:0/2677519935 shutdown_connections 2024-09-18T13:08:22.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.579+0000 7f03ac23f640 1 --2- 172.21.15.78:0/2677519935 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f039007af40 0x7f039007d400 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.579+0000 7f03ac23f640 1 --2- 172.21.15.78:0/2677519935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03a4109b90 0x7f03a419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.579+0000 7f03ac23f640 1 --2- 172.21.15.78:0/2677519935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03a4103b00 0x7f03a419f820 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.579+0000 7f03ac23f640 1 -- 172.21.15.78:0/2677519935 >> 172.21.15.78:0/2677519935 conn(0x7f03a40ff800 msgr2=0x7f03a41000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:22.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.579+0000 7f03ac23f640 1 -- 172.21.15.78:0/2677519935 shutdown_connections 2024-09-18T13:08:22.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.579+0000 7f03ac23f640 1 -- 172.21.15.78:0/2677519935 wait complete. 2024-09-18T13:08:22.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.659+0000 7f4fb0990640 1 -- 172.21.15.78:0/135265245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fac107900 msgr2=0x7f4fac107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:22.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.659+0000 7f4fb0990640 1 --2- 172.21.15.78:0/135265245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fac107900 0x7f4fac107ce0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009c20 tx=0x7f4fa402a970 comp rx=0 tx=0).stop 2024-09-18T13:08:22.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.659+0000 7f4fb0990640 1 -- 172.21.15.78:0/135265245 shutdown_connections 2024-09-18T13:08:22.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.659+0000 7f4fb0990640 1 --2- 172.21.15.78:0/135265245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fac101900 0x7f4fac101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.659+0000 7f4fb0990640 1 --2- 172.21.15.78:0/135265245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fac107900 0x7f4fac107ce0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.659+0000 7f4fb0990640 1 -- 172.21.15.78:0/135265245 >> 172.21.15.78:0/135265245 conn(0x7f4fac0fd600 msgr2=0x7f4fac0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:22.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.659+0000 7f4fb0990640 1 -- 172.21.15.78:0/135265245 shutdown_connections 2024-09-18T13:08:22.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.659+0000 7f4fb0990640 1 -- 172.21.15.78:0/135265245 wait complete. 2024-09-18T13:08:22.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.660+0000 7f4fb0990640 1 Processor -- start 2024-09-18T13:08:22.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.660+0000 7f4fb0990640 1 -- start start 2024-09-18T13:08:22.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.660+0000 7f4fb0990640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fac101900 0x7f4fac19f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:22.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.660+0000 7f4fb0990640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fac107900 0x7f4fac19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:22.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.660+0000 7f4fb0990640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac10ee30 con 0x7f4fac107900 2024-09-18T13:08:22.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.660+0000 7f4fb0990640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac10ecb0 con 0x7f4fac101900 2024-09-18T13:08:22.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.660+0000 7f4fa9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fac107900 0x7f4fac19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:22.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.660+0000 7f4fa9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fac107900 0x7f4fac19fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46674/0 (socket says 172.21.15.78:46674) 2024-09-18T13:08:22.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.660+0000 7f4fa9d9b640 1 -- 172.21.15.78:0/3117159702 learned_addr learned my addr 172.21.15.78:0/3117159702 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:08:22.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.660+0000 7f4faa59c640 1 --2- 172.21.15.78:0/3117159702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fac101900 0x7f4fac19f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:22.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.660+0000 7f4fa9d9b640 1 -- 172.21.15.78:0/3117159702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fac101900 msgr2=0x7f4fac19f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:22.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.660+0000 7f4fa9d9b640 1 --2- 172.21.15.78:0/3117159702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fac101900 0x7f4fac19f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.660+0000 7f4fa9d9b640 1 -- 172.21.15.78:0/3117159702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac199a80 con 0x7f4fac107900 2024-09-18T13:08:22.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.660+0000 7f4fa9d9b640 1 --2- 172.21.15.78:0/3117159702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fac107900 0x7f4fac19fe00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400b420 tx=0x7f4f9400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:22.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.661+0000 7f4fa37fe640 1 -- 172.21.15.78:0/3117159702 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f94011630 con 0x7f4fac107900 2024-09-18T13:08:22.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.661+0000 7f4fb0990640 1 -- 172.21.15.78:0/3117159702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fac199d70 con 0x7f4fac107900 2024-09-18T13:08:22.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.661+0000 7f4fa37fe640 1 -- 172.21.15.78:0/3117159702 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f94016070 con 0x7f4fac107900 2024-09-18T13:08:22.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.661+0000 7f4fa37fe640 1 -- 172.21.15.78:0/3117159702 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f94010d40 con 0x7f4fac107900 2024-09-18T13:08:22.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.661+0000 7f4fb0990640 1 -- 172.21.15.78:0/3117159702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fac19a300 con 0x7f4fac107900 2024-09-18T13:08:22.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.662+0000 7f4fb0990640 1 -- 172.21.15.78:0/3117159702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fac103040 con 0x7f4fac107900 2024-09-18T13:08:22.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.662+0000 7f4fa37fe640 1 -- 172.21.15.78:0/3117159702 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4f9401b460 con 0x7f4fac107900 2024-09-18T13:08:22.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.663+0000 7f4fa37fe640 1 --2- 172.21.15.78:0/3117159702 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f9807af30 0x7f4f9807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:22.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.663+0000 7f4fa37fe640 1 -- 172.21.15.78:0/3117159702 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f4f9409d800 con 0x7f4fac107900 2024-09-18T13:08:22.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.663+0000 7f4faa59c640 1 --2- 172.21.15.78:0/3117159702 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f9807af30 0x7f4f9807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:22.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.664+0000 7f4faa59c640 1 --2- 172.21.15.78:0/3117159702 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f9807af30 0x7f4f9807d3f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009430 tx=0x7f4fa40093c0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:22.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.667+0000 7f4fa37fe640 1 -- 172.21.15.78:0/3117159702 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4f94068d40 con 0x7f4fac107900 2024-09-18T13:08:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:22 smithi148 ceph-mon[80030]: pgmap v576: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:22.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.911+0000 7f4fb0990640 1 -- 172.21.15.78:0/3117159702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4fac19a610 con 0x7f4fac107900 2024-09-18T13:08:22.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.911+0000 7f4fa37fe640 1 -- 172.21.15.78:0/3117159702 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f4f9406dbf0 con 0x7f4fac107900 2024-09-18T13:08:22.916 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:08:22.916 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:08:22.916 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:08:22.916 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:08:22.917 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:08:22.917 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:08:22.917 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:08:22.917 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:08:22.917 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:08:22.917 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:08:22.917 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:08:22.917 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:08:22.917 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:08:22.917 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:08:22.917 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:08:22.918 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:08:22.918 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:08:22.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.914+0000 7f4fb0990640 1 -- 172.21.15.78:0/3117159702 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f9807af30 msgr2=0x7f4f9807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:22.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.914+0000 7f4fb0990640 1 --2- 172.21.15.78:0/3117159702 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f9807af30 0x7f4f9807d3f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009430 tx=0x7f4fa40093c0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.914+0000 7f4fb0990640 1 -- 172.21.15.78:0/3117159702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fac107900 msgr2=0x7f4fac19fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:22.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.914+0000 7f4fb0990640 1 --2- 172.21.15.78:0/3117159702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fac107900 0x7f4fac19fe00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400b420 tx=0x7f4f9400b8e0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.914+0000 7f4fb0990640 1 -- 172.21.15.78:0/3117159702 shutdown_connections 2024-09-18T13:08:22.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.914+0000 7f4fb0990640 1 --2- 172.21.15.78:0/3117159702 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f9807af30 0x7f4f9807d3f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.914+0000 7f4fb0990640 1 --2- 172.21.15.78:0/3117159702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fac107900 0x7f4fac19fe00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.914+0000 7f4fb0990640 1 --2- 172.21.15.78:0/3117159702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fac101900 0x7f4fac19f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:22.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.914+0000 7f4fb0990640 1 -- 172.21.15.78:0/3117159702 >> 172.21.15.78:0/3117159702 conn(0x7f4fac0fd600 msgr2=0x7f4fac0744c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:22.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.914+0000 7f4fb0990640 1 -- 172.21.15.78:0/3117159702 shutdown_connections 2024-09-18T13:08:22.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.914+0000 7f4fb0990640 1 -- 172.21.15.78:0/3117159702 wait complete. 2024-09-18T13:08:22.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.997+0000 7f445f50f640 1 -- 172.21.15.78:0/2907531470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4458102ab0 msgr2=0x7f4458102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:22.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.997+0000 7f445f50f640 1 --2- 172.21.15.78:0/2907531470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4458102ab0 0x7f4458102e90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4454009880 tx=0x7f445402a530 comp rx=0 tx=0).stop 2024-09-18T13:08:22.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.997+0000 7f445f50f640 1 -- 172.21.15.78:0/2907531470 shutdown_connections 2024-09-18T13:08:22.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.997+0000 7f445f50f640 1 --2- 172.21.15.78:0/2907531470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44581033d0 0x7f445810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.997+0000 7f445f50f640 1 --2- 172.21.15.78:0/2907531470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4458102ab0 0x7f4458102e90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.997+0000 7f445f50f640 1 -- 172.21.15.78:0/2907531470 >> 172.21.15.78:0/2907531470 conn(0x7f44580fc550 msgr2=0x7f44580fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:23.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.997+0000 7f445f50f640 1 -- 172.21.15.78:0/2907531470 shutdown_connections 2024-09-18T13:08:23.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.997+0000 7f445f50f640 1 -- 172.21.15.78:0/2907531470 wait complete. 2024-09-18T13:08:23.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.997+0000 7f445f50f640 1 Processor -- start 2024-09-18T13:08:23.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.997+0000 7f445f50f640 1 -- start start 2024-09-18T13:08:23.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f445f50f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4458102ab0 0x7f445819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:23.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f445f50f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44581033d0 0x7f445819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:23.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f445f50f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f445810edc0 con 0x7f44581033d0 2024-09-18T13:08:23.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f445f50f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f445810ec40 con 0x7f4458102ab0 2024-09-18T13:08:23.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f445caaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44581033d0 0x7f445819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:23.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f445caaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44581033d0 0x7f445819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46682/0 (socket says 172.21.15.78:46682) 2024-09-18T13:08:23.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f445caaa640 1 -- 172.21.15.78:0/3967408950 learned_addr learned my addr 172.21.15.78:0/3967408950 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:08:23.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f445d2ab640 1 --2- 172.21.15.78:0/3967408950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4458102ab0 0x7f445819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f445caaa640 1 -- 172.21.15.78:0/3967408950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4458102ab0 msgr2=0x7f445819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f445caaa640 1 --2- 172.21.15.78:0/3967408950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4458102ab0 0x7f445819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f445caaa640 1 -- 172.21.15.78:0/3967408950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44581977b0 con 0x7f44581033d0 2024-09-18T13:08:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f445caaa640 1 --2- 172.21.15.78:0/3967408950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44581033d0 0x7f445819db70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f444800e970 tx=0x7f444800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f444e7fc640 1 -- 172.21.15.78:0/3967408950 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4448009590 con 0x7f44581033d0 2024-09-18T13:08:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f444e7fc640 1 -- 172.21.15.78:0/3967408950 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4448010430 con 0x7f44581033d0 2024-09-18T13:08:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f444e7fc640 1 -- 172.21.15.78:0/3967408950 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4448018630 con 0x7f44581033d0 2024-09-18T13:08:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f445f50f640 1 -- 172.21.15.78:0/3967408950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4458197aa0 con 0x7f44581033d0 2024-09-18T13:08:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.998+0000 7f445f50f640 1 -- 172.21.15.78:0/3967408950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4458198030 con 0x7f44581033d0 2024-09-18T13:08:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:22.999+0000 7f445f50f640 1 -- 172.21.15.78:0/3967408950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445806a580 con 0x7f44581033d0 2024-09-18T13:08:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.000+0000 7f444e7fc640 1 -- 172.21.15.78:0/3967408950 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f44480105e0 con 0x7f44581033d0 2024-09-18T13:08:23.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.001+0000 7f444e7fc640 1 --2- 172.21.15.78:0/3967408950 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f444407af30 0x7f444407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:23.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.001+0000 7f445d2ab640 1 --2- 172.21.15.78:0/3967408950 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f444407af30 0x7f444407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:23.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.001+0000 7f444e7fc640 1 -- 172.21.15.78:0/3967408950 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f444809e770 con 0x7f44581033d0 2024-09-18T13:08:23.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.001+0000 7f445d2ab640 1 --2- 172.21.15.78:0/3967408950 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f444407af30 0x7f444407d3f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f44540096c0 tx=0x7f4454031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:23.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.005+0000 7f444e7fc640 1 -- 172.21.15.78:0/3967408950 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4448069c70 con 0x7f44581033d0 2024-09-18T13:08:23.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.220+0000 7f445f50f640 1 -- 172.21.15.78:0/3967408950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4458198ce0 con 0x7f44581033d0 2024-09-18T13:08:23.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.221+0000 7f444e7fc640 1 -- 172.21.15.78:0/3967408950 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f444806eb20 con 0x7f44581033d0 2024-09-18T13:08:23.223 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:08:23.223 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:08:23.224 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:08:23.224 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:08:23.224 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:08:23.224 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:08:23.224 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:08:23.224 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:08:23.224 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:08:23.224 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:08:23.224 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:08:23.224 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:08:23.224 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:08:23.224 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:08:23.224 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:08:23.225 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:08:23.225 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:08:23.225 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:08:23.225 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:08:23.225 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:08:23.225 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:08:23.225 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:08:23.225 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:08:23.225 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:08:23.225 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:08:23.225 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:08:23.225 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:08:23.225 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:08:23.225 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:08:23.226 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:08:23.226 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:08:23.226 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:08:23.226 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:08:23.226 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:08:23.226 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:08:23.226 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:08:23.226 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:08:23.226 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:08:23.226 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:08:23.226 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:08:23.226 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:08:23.226 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:08:23.227 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:08:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:08:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.223+0000 7f445f50f640 1 -- 172.21.15.78:0/3967408950 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f444407af30 msgr2=0x7f444407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.223+0000 7f445f50f640 1 --2- 172.21.15.78:0/3967408950 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f444407af30 0x7f444407d3f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f44540096c0 tx=0x7f4454031400 comp rx=0 tx=0).stop 2024-09-18T13:08:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.223+0000 7f445f50f640 1 -- 172.21.15.78:0/3967408950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44581033d0 msgr2=0x7f445819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.223+0000 7f445f50f640 1 --2- 172.21.15.78:0/3967408950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44581033d0 0x7f445819db70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f444800e970 tx=0x7f444800ee30 comp rx=0 tx=0).stop 2024-09-18T13:08:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.223+0000 7f445f50f640 1 -- 172.21.15.78:0/3967408950 shutdown_connections 2024-09-18T13:08:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.223+0000 7f445f50f640 1 --2- 172.21.15.78:0/3967408950 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f444407af30 0x7f444407d3f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.223+0000 7f445f50f640 1 --2- 172.21.15.78:0/3967408950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44581033d0 0x7f445819db70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.223+0000 7f445f50f640 1 --2- 172.21.15.78:0/3967408950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4458102ab0 0x7f445819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.223+0000 7f445f50f640 1 -- 172.21.15.78:0/3967408950 >> 172.21.15.78:0/3967408950 conn(0x7f44580fc550 msgr2=0x7f4458108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.223+0000 7f445f50f640 1 -- 172.21.15.78:0/3967408950 shutdown_connections 2024-09-18T13:08:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.224+0000 7f445f50f640 1 -- 172.21.15.78:0/3967408950 wait complete. 2024-09-18T13:08:23.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.305+0000 7fad2bd50640 1 -- 172.21.15.78:0/1756072443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad24101900 msgr2=0x7fad24101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:23.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.305+0000 7fad2bd50640 1 --2- 172.21.15.78:0/1756072443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad24101900 0x7fad24101d60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fad18009880 tx=0x7fad1802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.305+0000 7fad2bd50640 1 -- 172.21.15.78:0/1756072443 shutdown_connections 2024-09-18T13:08:23.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.305+0000 7fad2bd50640 1 --2- 172.21.15.78:0/1756072443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad24101900 0x7fad24101d60 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.305+0000 7fad2bd50640 1 --2- 172.21.15.78:0/1756072443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad24107900 0x7fad24107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.305+0000 7fad2bd50640 1 -- 172.21.15.78:0/1756072443 >> 172.21.15.78:0/1756072443 conn(0x7fad240fd600 msgr2=0x7fad240ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.306+0000 7fad2bd50640 1 -- 172.21.15.78:0/1756072443 shutdown_connections 2024-09-18T13:08:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.306+0000 7fad2bd50640 1 -- 172.21.15.78:0/1756072443 wait complete. 2024-09-18T13:08:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.306+0000 7fad2bd50640 1 Processor -- start 2024-09-18T13:08:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.306+0000 7fad2bd50640 1 -- start start 2024-09-18T13:08:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.306+0000 7fad2bd50640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad24101900 0x7fad2419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.306+0000 7fad2bd50640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad24107900 0x7fad2419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.306+0000 7fad2bd50640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fad2410edb0 con 0x7fad24107900 2024-09-18T13:08:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.306+0000 7fad2bd50640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fad2410ec30 con 0x7fad24101900 2024-09-18T13:08:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.306+0000 7fad292eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad24107900 0x7fad2419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.307+0000 7fad292eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad24107900 0x7fad2419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46688/0 (socket says 172.21.15.78:46688) 2024-09-18T13:08:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.307+0000 7fad292eb640 1 -- 172.21.15.78:0/3295916888 learned_addr learned my addr 172.21.15.78:0/3295916888 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:08:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.307+0000 7fad29aec640 1 --2- 172.21.15.78:0/3295916888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad24101900 0x7fad2419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:23.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.307+0000 7fad292eb640 1 -- 172.21.15.78:0/3295916888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad24101900 msgr2=0x7fad2419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:23.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.307+0000 7fad292eb640 1 --2- 172.21.15.78:0/3295916888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad24101900 0x7fad2419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.307+0000 7fad292eb640 1 -- 172.21.15.78:0/3295916888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad241977d0 con 0x7fad24107900 2024-09-18T13:08:23.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.307+0000 7fad292eb640 1 --2- 172.21.15.78:0/3295916888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad24107900 0x7fad2419db90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fad18031460 tx=0x7fad180045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:23.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.307+0000 7fad22ffd640 1 -- 172.21.15.78:0/3295916888 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad1803f070 con 0x7fad24107900 2024-09-18T13:08:23.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.307+0000 7fad2bd50640 1 -- 172.21.15.78:0/3295916888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad24197a60 con 0x7fad24107900 2024-09-18T13:08:23.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.307+0000 7fad22ffd640 1 -- 172.21.15.78:0/3295916888 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad180035f0 con 0x7fad24107900 2024-09-18T13:08:23.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.307+0000 7fad22ffd640 1 -- 172.21.15.78:0/3295916888 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad18035030 con 0x7fad24107900 2024-09-18T13:08:23.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.307+0000 7fad2bd50640 1 -- 172.21.15.78:0/3295916888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad24197f90 con 0x7fad24107900 2024-09-18T13:08:23.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.308+0000 7fad2bd50640 1 -- 172.21.15.78:0/3295916888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad24103040 con 0x7fad24107900 2024-09-18T13:08:23.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.309+0000 7fad22ffd640 1 -- 172.21.15.78:0/3295916888 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fad18042070 con 0x7fad24107900 2024-09-18T13:08:23.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.309+0000 7fad22ffd640 1 --2- 172.21.15.78:0/3295916888 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fad0c07af30 0x7fad0c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:23.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.309+0000 7fad22ffd640 1 -- 172.21.15.78:0/3295916888 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fad180be9d0 con 0x7fad24107900 2024-09-18T13:08:23.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.309+0000 7fad29aec640 1 --2- 172.21.15.78:0/3295916888 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fad0c07af30 0x7fad0c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:23.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.310+0000 7fad29aec640 1 --2- 172.21.15.78:0/3295916888 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fad0c07af30 0x7fad0c07d3f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fad1c005d00 tx=0x7fad1c00b410 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:23.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.314+0000 7fad22ffd640 1 -- 172.21.15.78:0/3295916888 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fad18089f70 con 0x7fad24107900 2024-09-18T13:08:23.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:23 smithi078 ceph-mon[108578]: from='client.34890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:23.517 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:23 smithi078 ceph-mon[108578]: from='client.34894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:23.517 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:23 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3117159702' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:08:23.517 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:23 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3967408950' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:08:23.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.507+0000 7fad2bd50640 1 -- 172.21.15.78:0/3295916888 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fad24198240 con 0x7fad0c07af30 2024-09-18T13:08:23.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.508+0000 7fad22ffd640 1 -- 172.21.15.78:0/3295916888 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fad24198240 con 0x7fad0c07af30 2024-09-18T13:08:23.518 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:08:23.518 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:08:23.518 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:08:23.518 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:08:23.518 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:08:23.518 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:08:23.518 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:08:23.518 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:08:23.519 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:08:23.519 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:08:23.519 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:08:23.519 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:08:23.519 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:08:23.519 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:08:23.519 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:08:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.510+0000 7fad2bd50640 1 -- 172.21.15.78:0/3295916888 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fad0c07af30 msgr2=0x7fad0c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.510+0000 7fad2bd50640 1 --2- 172.21.15.78:0/3295916888 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fad0c07af30 0x7fad0c07d3f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fad1c005d00 tx=0x7fad1c00b410 comp rx=0 tx=0).stop 2024-09-18T13:08:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.510+0000 7fad2bd50640 1 -- 172.21.15.78:0/3295916888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad24107900 msgr2=0x7fad2419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.510+0000 7fad2bd50640 1 --2- 172.21.15.78:0/3295916888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad24107900 0x7fad2419db90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fad18031460 tx=0x7fad180045e0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.510+0000 7fad2bd50640 1 -- 172.21.15.78:0/3295916888 shutdown_connections 2024-09-18T13:08:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.510+0000 7fad2bd50640 1 --2- 172.21.15.78:0/3295916888 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fad0c07af30 0x7fad0c07d3f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.510+0000 7fad2bd50640 1 --2- 172.21.15.78:0/3295916888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad24107900 0x7fad2419db90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.510+0000 7fad2bd50640 1 --2- 172.21.15.78:0/3295916888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad24101900 0x7fad2419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.510+0000 7fad2bd50640 1 -- 172.21.15.78:0/3295916888 >> 172.21.15.78:0/3295916888 conn(0x7fad240fd600 msgr2=0x7fad240fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.510+0000 7fad2bd50640 1 -- 172.21.15.78:0/3295916888 shutdown_connections 2024-09-18T13:08:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.510+0000 7fad2bd50640 1 -- 172.21.15.78:0/3295916888 wait complete. 2024-09-18T13:08:23.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.592+0000 7f4150257640 1 -- 172.21.15.78:0/1553328841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4148102b70 msgr2=0x7f4148102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:23.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.592+0000 7f4150257640 1 --2- 172.21.15.78:0/1553328841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4148102b70 0x7f4148102f50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4144009880 tx=0x7f414402a530 comp rx=0 tx=0).stop 2024-09-18T13:08:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.592+0000 7f4150257640 1 -- 172.21.15.78:0/1553328841 shutdown_connections 2024-09-18T13:08:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.592+0000 7f4150257640 1 --2- 172.21.15.78:0/1553328841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4148103490 0x7f414810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.592+0000 7f4150257640 1 --2- 172.21.15.78:0/1553328841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4148102b70 0x7f4148102f50 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.592+0000 7f4150257640 1 -- 172.21.15.78:0/1553328841 >> 172.21.15.78:0/1553328841 conn(0x7f41480fc4d0 msgr2=0x7f41480fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.592+0000 7f4150257640 1 -- 172.21.15.78:0/1553328841 shutdown_connections 2024-09-18T13:08:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.592+0000 7f4150257640 1 -- 172.21.15.78:0/1553328841 wait complete. 2024-09-18T13:08:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.592+0000 7f4150257640 1 Processor -- start 2024-09-18T13:08:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.592+0000 7f4150257640 1 -- start start 2024-09-18T13:08:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f4150257640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4148102b70 0x7f414819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f4150257640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4148103490 0x7f414819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f4150257640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f414810edc0 con 0x7f4148103490 2024-09-18T13:08:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f4150257640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f414810ec40 con 0x7f4148102b70 2024-09-18T13:08:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f414d7f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4148103490 0x7f414819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f414d7f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4148103490 0x7f414819dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46706/0 (socket says 172.21.15.78:46706) 2024-09-18T13:08:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f414d7f2640 1 -- 172.21.15.78:0/143847035 learned_addr learned my addr 172.21.15.78:0/143847035 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:08:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f414dff3640 1 --2- 172.21.15.78:0/143847035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4148102b70 0x7f414819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f414d7f2640 1 -- 172.21.15.78:0/143847035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4148102b70 msgr2=0x7f414819d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f414d7f2640 1 --2- 172.21.15.78:0/143847035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4148102b70 0x7f414819d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f414d7f2640 1 -- 172.21.15.78:0/143847035 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4148197850 con 0x7f4148103490 2024-09-18T13:08:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f414dff3640 1 --2- 172.21.15.78:0/143847035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4148102b70 0x7f414819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:08:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f414d7f2640 1 --2- 172.21.15.78:0/143847035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4148103490 0x7f414819dc10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f413800d8d0 tx=0x7f413800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:23.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f413effd640 1 -- 172.21.15.78:0/143847035 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4138017070 con 0x7f4148103490 2024-09-18T13:08:23.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f413effd640 1 -- 172.21.15.78:0/143847035 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4138010460 con 0x7f4148103490 2024-09-18T13:08:23.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f4150257640 1 -- 172.21.15.78:0/143847035 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4148197b40 con 0x7f4148103490 2024-09-18T13:08:23.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f413effd640 1 -- 172.21.15.78:0/143847035 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f413800f5f0 con 0x7f4148103490 2024-09-18T13:08:23.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.593+0000 7f4150257640 1 -- 172.21.15.78:0/143847035 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41481980d0 con 0x7f4148103490 2024-09-18T13:08:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.594+0000 7f4150257640 1 -- 172.21.15.78:0/143847035 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f414806ace0 con 0x7f4148103490 2024-09-18T13:08:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.595+0000 7f413effd640 1 -- 172.21.15.78:0/143847035 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4138009a30 con 0x7f4148103490 2024-09-18T13:08:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.595+0000 7f413effd640 1 --2- 172.21.15.78:0/143847035 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f413407af30 0x7f413407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.595+0000 7f413effd640 1 -- 172.21.15.78:0/143847035 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f413809df00 con 0x7f4148103490 2024-09-18T13:08:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.595+0000 7f414dff3640 1 --2- 172.21.15.78:0/143847035 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f413407af30 0x7f413407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.596+0000 7f414dff3640 1 --2- 172.21.15.78:0/143847035 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f413407af30 0x7f413407d3f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4144000c00 tx=0x7f4144004f30 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:23.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.600+0000 7f413effd640 1 -- 172.21.15.78:0/143847035 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f41380694a0 con 0x7f4148103490 2024-09-18T13:08:23.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:23 smithi148 ceph-mon[80030]: from='client.34890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:23.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:23 smithi148 ceph-mon[80030]: from='client.34894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:23.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:23 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3117159702' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:08:23.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:23 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3967408950' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:08:23.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.846+0000 7f4150257640 1 -- 172.21.15.78:0/143847035 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f4148104fc0 con 0x7f4148103490 2024-09-18T13:08:23.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.847+0000 7f413effd640 1 -- 172.21.15.78:0/143847035 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f413806e350 con 0x7f4148103490 2024-09-18T13:08:23.849 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:08:23.849 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:08:23.849 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:08:23.849 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:08:23.849 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:08:23.850 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:08:23.850 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:08:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.849+0000 7f4150257640 1 -- 172.21.15.78:0/143847035 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f413407af30 msgr2=0x7f413407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.849+0000 7f4150257640 1 --2- 172.21.15.78:0/143847035 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f413407af30 0x7f413407d3f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4144000c00 tx=0x7f4144004f30 comp rx=0 tx=0).stop 2024-09-18T13:08:23.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.849+0000 7f4150257640 1 -- 172.21.15.78:0/143847035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4148103490 msgr2=0x7f414819dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:23.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.849+0000 7f4150257640 1 --2- 172.21.15.78:0/143847035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4148103490 0x7f414819dc10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f413800d8d0 tx=0x7f413800dd90 comp rx=0 tx=0).stop 2024-09-18T13:08:23.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.849+0000 7f4150257640 1 -- 172.21.15.78:0/143847035 shutdown_connections 2024-09-18T13:08:23.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.849+0000 7f4150257640 1 --2- 172.21.15.78:0/143847035 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f413407af30 0x7f413407d3f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.849+0000 7f4150257640 1 --2- 172.21.15.78:0/143847035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4148103490 0x7f414819dc10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.849+0000 7f4150257640 1 --2- 172.21.15.78:0/143847035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4148102b70 0x7f414819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:23.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.849+0000 7f4150257640 1 -- 172.21.15.78:0/143847035 >> 172.21.15.78:0/143847035 conn(0x7f41480fc4d0 msgr2=0x7f4148107e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:23.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.850+0000 7f4150257640 1 -- 172.21.15.78:0/143847035 shutdown_connections 2024-09-18T13:08:23.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:23.850+0000 7f4150257640 1 -- 172.21.15.78:0/143847035 wait complete. 2024-09-18T13:08:24.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:24 smithi078 ceph-mon[108578]: from='client.34898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:24.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:24 smithi078 ceph-mon[108578]: pgmap v577: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:24.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:24 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/143847035' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:08:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:24 smithi148 ceph-mon[80030]: from='client.34898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:24 smithi148 ceph-mon[80030]: pgmap v577: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:24 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/143847035' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:08:25.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:25 smithi148 ceph-mon[80030]: from='client.34910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:25 smithi078 ceph-mon[108578]: from='client.34910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:26 smithi148 ceph-mon[80030]: pgmap v578: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:26 smithi078 ceph-mon[108578]: pgmap v578: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:28 smithi148 ceph-mon[80030]: pgmap v579: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:28.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:28 smithi078 ceph-mon[108578]: pgmap v579: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:30.704 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:30 smithi078 ceph-mon[108578]: pgmap v580: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:30.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:30 smithi148 ceph-mon[80030]: pgmap v580: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:32.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:32 smithi148 ceph-mon[80030]: pgmap v581: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:32.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:32 smithi078 ceph-mon[108578]: pgmap v581: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:34 smithi148 ceph-mon[80030]: pgmap v582: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:34 smithi078 ceph-mon[108578]: pgmap v582: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:36.701 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:36 smithi078 ceph-mon[108578]: pgmap v583: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:36 smithi148 ceph-mon[80030]: pgmap v583: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:38.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:38 smithi148 ceph-mon[80030]: pgmap v584: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:38.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:38 smithi078 ceph-mon[108578]: pgmap v584: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:40 smithi148 ceph-mon[80030]: pgmap v585: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:40 smithi078 ceph-mon[108578]: pgmap v585: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:41.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:42.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:42 smithi078 ceph-mon[108578]: pgmap v586: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:42 smithi148 ceph-mon[80030]: pgmap v586: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:44 smithi148 ceph-mon[80030]: pgmap v587: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:44 smithi078 ceph-mon[108578]: pgmap v587: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:46 smithi148 ceph-mon[80030]: pgmap v588: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:46 smithi078 ceph-mon[108578]: pgmap v588: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:48.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:48 smithi078 ceph-mon[108578]: pgmap v589: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:48.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:48 smithi148 ceph-mon[80030]: pgmap v589: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:50 smithi148 ceph-mon[80030]: pgmap v590: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:50.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:50 smithi078 ceph-mon[108578]: pgmap v590: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:52 smithi148 ceph-mon[80030]: pgmap v591: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:52.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:52 smithi078 ceph-mon[108578]: pgmap v591: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:53.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.946+0000 7fa9ac655640 1 -- 172.21.15.78:0/1105075468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9a41033e0 msgr2=0x7fa9a410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:53.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.946+0000 7fa9ac655640 1 --2- 172.21.15.78:0/1105075468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9a41033e0 0x7fa9a410b8d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa994009880 tx=0x7fa99402a530 comp rx=0 tx=0).stop 2024-09-18T13:08:53.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.946+0000 7fa9ac655640 1 -- 172.21.15.78:0/1105075468 shutdown_connections 2024-09-18T13:08:53.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.946+0000 7fa9ac655640 1 --2- 172.21.15.78:0/1105075468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9a41033e0 0x7fa9a410b8d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:53.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.946+0000 7fa9ac655640 1 --2- 172.21.15.78:0/1105075468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a4102ac0 0x7fa9a4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:53.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.946+0000 7fa9ac655640 1 -- 172.21.15.78:0/1105075468 >> 172.21.15.78:0/1105075468 conn(0x7fa9a40fc520 msgr2=0x7fa9a40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:53.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.946+0000 7fa9ac655640 1 -- 172.21.15.78:0/1105075468 shutdown_connections 2024-09-18T13:08:53.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.946+0000 7fa9ac655640 1 -- 172.21.15.78:0/1105075468 wait complete. 2024-09-18T13:08:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.946+0000 7fa9ac655640 1 Processor -- start 2024-09-18T13:08:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.946+0000 7fa9ac655640 1 -- start start 2024-09-18T13:08:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.947+0000 7fa9ac655640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9a4102ac0 0x7fa9a419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.947+0000 7fa9ac655640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a41033e0 0x7fa9a419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.947+0000 7fa9ac655640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a410edf0 con 0x7fa9a4102ac0 2024-09-18T13:08:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.947+0000 7fa9ac655640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a410ec70 con 0x7fa9a41033e0 2024-09-18T13:08:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.947+0000 7fa9aa3f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9a4102ac0 0x7fa9a419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.947+0000 7fa9aa3f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9a4102ac0 0x7fa9a419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57880/0 (socket says 172.21.15.78:57880) 2024-09-18T13:08:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.947+0000 7fa9aa3f1640 1 -- 172.21.15.78:0/3824993001 learned_addr learned my addr 172.21.15.78:0/3824993001 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:08:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.947+0000 7fa9a9bf0640 1 --2- 172.21.15.78:0/3824993001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a41033e0 0x7fa9a419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.947+0000 7fa9aa3f1640 1 -- 172.21.15.78:0/3824993001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a41033e0 msgr2=0x7fa9a419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:53.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.947+0000 7fa9aa3f1640 1 --2- 172.21.15.78:0/3824993001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a41033e0 0x7fa9a419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:53.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.947+0000 7fa9aa3f1640 1 -- 172.21.15.78:0/3824993001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a4197820 con 0x7fa9a4102ac0 2024-09-18T13:08:53.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.947+0000 7fa9a9bf0640 1 --2- 172.21.15.78:0/3824993001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a41033e0 0x7fa9a419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:08:53.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.947+0000 7fa9aa3f1640 1 --2- 172.21.15.78:0/3824993001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9a4102ac0 0x7fa9a419d6a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000d6f0 tx=0x7fa9a000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:53.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.948+0000 7fa99b7fe640 1 -- 172.21.15.78:0/3824993001 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa9a0017070 con 0x7fa9a4102ac0 2024-09-18T13:08:53.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.948+0000 7fa9ac655640 1 -- 172.21.15.78:0/3824993001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a4197b10 con 0x7fa9a4102ac0 2024-09-18T13:08:53.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.948+0000 7fa99b7fe640 1 -- 172.21.15.78:0/3824993001 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa9a000de00 con 0x7fa9a4102ac0 2024-09-18T13:08:53.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.948+0000 7fa99b7fe640 1 -- 172.21.15.78:0/3824993001 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa9a0004bb0 con 0x7fa9a4102ac0 2024-09-18T13:08:53.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.948+0000 7fa9ac655640 1 -- 172.21.15.78:0/3824993001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a41980a0 con 0x7fa9a4102ac0 2024-09-18T13:08:53.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.949+0000 7fa9ac655640 1 -- 172.21.15.78:0/3824993001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a406aa90 con 0x7fa9a4102ac0 2024-09-18T13:08:53.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.949+0000 7fa99b7fe640 1 -- 172.21.15.78:0/3824993001 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa9a0004e60 con 0x7fa9a4102ac0 2024-09-18T13:08:53.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.950+0000 7fa99b7fe640 1 --2- 172.21.15.78:0/3824993001 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa99007af30 0x7fa99007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:53.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.950+0000 7fa99b7fe640 1 -- 172.21.15.78:0/3824993001 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fa9a009dcb0 con 0x7fa9a4102ac0 2024-09-18T13:08:53.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.950+0000 7fa9a9bf0640 1 --2- 172.21.15.78:0/3824993001 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa99007af30 0x7fa99007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:53.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.950+0000 7fa9a9bf0640 1 --2- 172.21.15.78:0/3824993001 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa99007af30 0x7fa99007d3f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa994031460 tx=0x7fa9940095f0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:53.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:53.954+0000 7fa99b7fe640 1 -- 172.21.15.78:0/3824993001 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa9a0069250 con 0x7fa9a4102ac0 2024-09-18T13:08:54.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.146+0000 7fa9ac655640 1 -- 172.21.15.78:0/3824993001 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa9a4198350 con 0x7fa99007af30 2024-09-18T13:08:54.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.147+0000 7fa99b7fe640 1 -- 172.21.15.78:0/3824993001 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa9a4198350 con 0x7fa99007af30 2024-09-18T13:08:54.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.149+0000 7fa9ac655640 1 -- 172.21.15.78:0/3824993001 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa99007af30 msgr2=0x7fa99007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:54.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.149+0000 7fa9ac655640 1 --2- 172.21.15.78:0/3824993001 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa99007af30 0x7fa99007d3f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa994031460 tx=0x7fa9940095f0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.149+0000 7fa9ac655640 1 -- 172.21.15.78:0/3824993001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9a4102ac0 msgr2=0x7fa9a419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:54.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.149+0000 7fa9ac655640 1 --2- 172.21.15.78:0/3824993001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9a4102ac0 0x7fa9a419d6a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000d6f0 tx=0x7fa9a000dbb0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.149+0000 7fa9ac655640 1 -- 172.21.15.78:0/3824993001 shutdown_connections 2024-09-18T13:08:54.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.149+0000 7fa9ac655640 1 --2- 172.21.15.78:0/3824993001 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa99007af30 0x7fa99007d3f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.149+0000 7fa9ac655640 1 --2- 172.21.15.78:0/3824993001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a41033e0 0x7fa9a419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.149+0000 7fa9ac655640 1 --2- 172.21.15.78:0/3824993001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9a4102ac0 0x7fa9a419d6a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.149+0000 7fa9ac655640 1 -- 172.21.15.78:0/3824993001 >> 172.21.15.78:0/3824993001 conn(0x7fa9a40fc520 msgr2=0x7fa9a4108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:54.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.149+0000 7fa9ac655640 1 -- 172.21.15.78:0/3824993001 shutdown_connections 2024-09-18T13:08:54.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.149+0000 7fa9ac655640 1 -- 172.21.15.78:0/3824993001 wait complete. 2024-09-18T13:08:54.159 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:08:54.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.232+0000 7f349b343640 1 -- 172.21.15.78:0/2302290448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3494106800 msgr2=0x7f3494106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:54.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.232+0000 7f349b343640 1 --2- 172.21.15.78:0/2302290448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3494106800 0x7f3494106be0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f348c009880 tx=0x7f348c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.232+0000 7f349b343640 1 -- 172.21.15.78:0/2302290448 shutdown_connections 2024-09-18T13:08:54.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.232+0000 7f349b343640 1 --2- 172.21.15.78:0/2302290448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3494100800 0x7f3494100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.232+0000 7f349b343640 1 --2- 172.21.15.78:0/2302290448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3494106800 0x7f3494106be0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.232+0000 7f349b343640 1 -- 172.21.15.78:0/2302290448 >> 172.21.15.78:0/2302290448 conn(0x7f34940fc520 msgr2=0x7f34940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:54.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.232+0000 7f349b343640 1 -- 172.21.15.78:0/2302290448 shutdown_connections 2024-09-18T13:08:54.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.232+0000 7f349b343640 1 -- 172.21.15.78:0/2302290448 wait complete. 2024-09-18T13:08:54.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.233+0000 7f349b343640 1 Processor -- start 2024-09-18T13:08:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.233+0000 7f349b343640 1 -- start start 2024-09-18T13:08:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.233+0000 7f349b343640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3494100800 0x7f3494198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.233+0000 7f349b343640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3494106800 0x7f3494198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.233+0000 7f349b343640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f349410dd30 con 0x7f3494100800 2024-09-18T13:08:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.233+0000 7f349b343640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f349410dbb0 con 0x7f3494106800 2024-09-18T13:08:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.233+0000 7f34990df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3494100800 0x7f3494198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.233+0000 7f34990df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3494100800 0x7f3494198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57908/0 (socket says 172.21.15.78:57908) 2024-09-18T13:08:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.233+0000 7f34990df640 1 -- 172.21.15.78:0/3035484379 learned_addr learned my addr 172.21.15.78:0/3035484379 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:08:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.233+0000 7f34988de640 1 --2- 172.21.15.78:0/3035484379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3494106800 0x7f3494198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.233+0000 7f34990df640 1 -- 172.21.15.78:0/3035484379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3494106800 msgr2=0x7f3494198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.233+0000 7f34990df640 1 --2- 172.21.15.78:0/3035484379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3494106800 0x7f3494198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.233+0000 7f34990df640 1 -- 172.21.15.78:0/3035484379 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3494199380 con 0x7f3494100800 2024-09-18T13:08:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.234+0000 7f34990df640 1 --2- 172.21.15.78:0/3035484379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3494100800 0x7f3494198840 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f348c031460 tx=0x7f348c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.234+0000 7f348a7fc640 1 -- 172.21.15.78:0/3035484379 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f348c03f070 con 0x7f3494100800 2024-09-18T13:08:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.234+0000 7f349b343640 1 -- 172.21.15.78:0/3035484379 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3494199610 con 0x7f3494100800 2024-09-18T13:08:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.234+0000 7f348a7fc640 1 -- 172.21.15.78:0/3035484379 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f348c004cf0 con 0x7f3494100800 2024-09-18T13:08:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.234+0000 7f348a7fc640 1 -- 172.21.15.78:0/3035484379 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f348c035030 con 0x7f3494100800 2024-09-18T13:08:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.234+0000 7f349b343640 1 -- 172.21.15.78:0/3035484379 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34941a1bc0 con 0x7f3494100800 2024-09-18T13:08:54.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.235+0000 7f349b343640 1 -- 172.21.15.78:0/3035484379 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3494101f40 con 0x7f3494100800 2024-09-18T13:08:54.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.235+0000 7f348a7fc640 1 -- 172.21.15.78:0/3035484379 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f348c042070 con 0x7f3494100800 2024-09-18T13:08:54.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.236+0000 7f348a7fc640 1 --2- 172.21.15.78:0/3035484379 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f347c07af80 0x7f347c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:54.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.236+0000 7f348a7fc640 1 -- 172.21.15.78:0/3035484379 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f348c0bea40 con 0x7f3494100800 2024-09-18T13:08:54.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.236+0000 7f34988de640 1 --2- 172.21.15.78:0/3035484379 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f347c07af80 0x7f347c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:54.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.237+0000 7f34988de640 1 --2- 172.21.15.78:0/3035484379 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f347c07af80 0x7f347c07d440 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f349406ad00 tx=0x7f34900072f0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:54.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.241+0000 7f348a7fc640 1 -- 172.21.15.78:0/3035484379 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f348c08a060 con 0x7f3494100800 2024-09-18T13:08:54.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.430+0000 7f349b343640 1 -- 172.21.15.78:0/3035484379 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3494062630 con 0x7f347c07af80 2024-09-18T13:08:54.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.432+0000 7f348a7fc640 1 -- 172.21.15.78:0/3035484379 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3494062630 con 0x7f347c07af80 2024-09-18T13:08:54.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.434+0000 7f349b343640 1 -- 172.21.15.78:0/3035484379 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f347c07af80 msgr2=0x7f347c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:54.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.434+0000 7f349b343640 1 --2- 172.21.15.78:0/3035484379 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f347c07af80 0x7f347c07d440 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f349406ad00 tx=0x7f34900072f0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.434+0000 7f349b343640 1 -- 172.21.15.78:0/3035484379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3494100800 msgr2=0x7f3494198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:54.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.434+0000 7f349b343640 1 --2- 172.21.15.78:0/3035484379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3494100800 0x7f3494198840 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f348c031460 tx=0x7f348c0048f0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.434+0000 7f349b343640 1 -- 172.21.15.78:0/3035484379 shutdown_connections 2024-09-18T13:08:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.434+0000 7f349b343640 1 --2- 172.21.15.78:0/3035484379 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f347c07af80 0x7f347c07d440 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.434+0000 7f349b343640 1 --2- 172.21.15.78:0/3035484379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3494106800 0x7f3494198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.434+0000 7f349b343640 1 --2- 172.21.15.78:0/3035484379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3494100800 0x7f3494198840 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.434+0000 7f349b343640 1 -- 172.21.15.78:0/3035484379 >> 172.21.15.78:0/3035484379 conn(0x7f34940fc520 msgr2=0x7f34940fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.434+0000 7f349b343640 1 -- 172.21.15.78:0/3035484379 shutdown_connections 2024-09-18T13:08:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.434+0000 7f349b343640 1 -- 172.21.15.78:0/3035484379 wait complete. 2024-09-18T13:08:54.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:54 smithi078 ceph-mon[108578]: pgmap v592: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:54.731 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:54 smithi148 ceph-mon[80030]: pgmap v592: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:54.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.516+0000 7fa049b60640 1 -- 172.21.15.78:0/1418756341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa044100800 msgr2=0x7fa044100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:54.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.516+0000 7fa049b60640 1 --2- 172.21.15.78:0/1418756341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa044100800 0x7fa044100c60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa038009880 tx=0x7fa03802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.516+0000 7fa049b60640 1 -- 172.21.15.78:0/1418756341 shutdown_connections 2024-09-18T13:08:54.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.516+0000 7fa049b60640 1 --2- 172.21.15.78:0/1418756341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa044100800 0x7fa044100c60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.516+0000 7fa049b60640 1 --2- 172.21.15.78:0/1418756341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa044106800 0x7fa044106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.516+0000 7fa049b60640 1 -- 172.21.15.78:0/1418756341 >> 172.21.15.78:0/1418756341 conn(0x7fa0440fc520 msgr2=0x7fa0440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:54.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.516+0000 7fa049b60640 1 -- 172.21.15.78:0/1418756341 shutdown_connections 2024-09-18T13:08:54.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.516+0000 7fa049b60640 1 -- 172.21.15.78:0/1418756341 wait complete. 2024-09-18T13:08:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.517+0000 7fa049b60640 1 Processor -- start 2024-09-18T13:08:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.517+0000 7fa049b60640 1 -- start start 2024-09-18T13:08:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.517+0000 7fa049b60640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa044100800 0x7fa04419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.517+0000 7fa049b60640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa044106800 0x7fa04419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.517+0000 7fa049b60640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa04410dcd0 con 0x7fa044106800 2024-09-18T13:08:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.517+0000 7fa049b60640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa04410db50 con 0x7fa044100800 2024-09-18T13:08:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.517+0000 7fa042ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa044106800 0x7fa04419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.517+0000 7fa042ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa044106800 0x7fa04419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57934/0 (socket says 172.21.15.78:57934) 2024-09-18T13:08:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.517+0000 7fa042ffd640 1 -- 172.21.15.78:0/2866208293 learned_addr learned my addr 172.21.15.78:0/2866208293 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:08:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.518+0000 7fa0437fe640 1 --2- 172.21.15.78:0/2866208293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa044100800 0x7fa04419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.518+0000 7fa042ffd640 1 -- 172.21.15.78:0/2866208293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa044100800 msgr2=0x7fa04419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.518+0000 7fa042ffd640 1 --2- 172.21.15.78:0/2866208293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa044100800 0x7fa04419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.518+0000 7fa042ffd640 1 -- 172.21.15.78:0/2866208293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0441977d0 con 0x7fa044106800 2024-09-18T13:08:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.518+0000 7fa0437fe640 1 --2- 172.21.15.78:0/2866208293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa044100800 0x7fa04419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:08:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.518+0000 7fa042ffd640 1 --2- 172.21.15.78:0/2866208293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa044106800 0x7fa04419db90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa038031460 tx=0x7fa0380045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.518+0000 7fa040ff9640 1 -- 172.21.15.78:0/2866208293 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa03803f070 con 0x7fa044106800 2024-09-18T13:08:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.518+0000 7fa049b60640 1 -- 172.21.15.78:0/2866208293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa044197a60 con 0x7fa044106800 2024-09-18T13:08:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.518+0000 7fa040ff9640 1 -- 172.21.15.78:0/2866208293 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa0380035f0 con 0x7fa044106800 2024-09-18T13:08:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.518+0000 7fa040ff9640 1 -- 172.21.15.78:0/2866208293 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa038035030 con 0x7fa044106800 2024-09-18T13:08:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.518+0000 7fa049b60640 1 -- 172.21.15.78:0/2866208293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa044197f90 con 0x7fa044106800 2024-09-18T13:08:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.519+0000 7fa049b60640 1 -- 172.21.15.78:0/2866208293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa044101f40 con 0x7fa044106800 2024-09-18T13:08:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.520+0000 7fa040ff9640 1 -- 172.21.15.78:0/2866208293 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa038042070 con 0x7fa044106800 2024-09-18T13:08:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.520+0000 7fa040ff9640 1 --2- 172.21.15.78:0/2866208293 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa02c07af30 0x7fa02c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.521+0000 7fa040ff9640 1 -- 172.21.15.78:0/2866208293 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fa0380bea80 con 0x7fa044106800 2024-09-18T13:08:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.521+0000 7fa0437fe640 1 --2- 172.21.15.78:0/2866208293 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa02c07af30 0x7fa02c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.521+0000 7fa0437fe640 1 --2- 172.21.15.78:0/2866208293 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa02c07af30 0x7fa02c07d3f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa034009b40 tx=0x7fa034005e50 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.525+0000 7fa040ff9640 1 -- 172.21.15.78:0/2866208293 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa03808a020 con 0x7fa044106800 2024-09-18T13:08:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.707+0000 7fa049b60640 1 -- 172.21.15.78:0/2866208293 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa044198300 con 0x7fa02c07af30 2024-09-18T13:08:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.718+0000 7fa040ff9640 1 -- 172.21.15.78:0/2866208293 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fa044198300 con 0x7fa02c07af30 2024-09-18T13:08:54.737 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:08:54.737 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (16m) 10m ago 27m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:08:54.737 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (19m) 10m ago 27m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:08:54.737 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (19m) 10m ago 27m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:08:54.737 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (14m) 10m ago 27m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:08:54.737 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (14m) 10m ago 27m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:08:54.737 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (16m) 10m ago 27m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:08:54.737 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (11m) 10m ago 22m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:08:54.738 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (11m) 10m ago 22m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:08:54.738 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (10m) 10m ago 22m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:08:54.738 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (10m) 10m ago 22m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:08:54.738 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (18m) 10m ago 28m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:08:54.738 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (17m) 10m ago 26m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:08:54.738 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (15m) 10m ago 29m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:08:54.738 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (15m) 10m ago 26m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:08:54.738 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (17m) 10m ago 27m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:08:54.738 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (17m) 10m ago 26m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:08:54.738 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (14m) 10m ago 25m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:08:54.738 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (13m) 10m ago 25m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:08:54.738 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (13m) 10m ago 24m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:08:54.738 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (12m) 10m ago 24m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:08:54.738 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (12m) 10m ago 23m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:08:54.739 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (11m) 10m ago 23m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:08:54.739 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (17m) 10m ago 27m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:08:54.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.720+0000 7fa049b60640 1 -- 172.21.15.78:0/2866208293 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa02c07af30 msgr2=0x7fa02c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:54.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.720+0000 7fa049b60640 1 --2- 172.21.15.78:0/2866208293 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa02c07af30 0x7fa02c07d3f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa034009b40 tx=0x7fa034005e50 comp rx=0 tx=0).stop 2024-09-18T13:08:54.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.720+0000 7fa049b60640 1 -- 172.21.15.78:0/2866208293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa044106800 msgr2=0x7fa04419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:54.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.720+0000 7fa049b60640 1 --2- 172.21.15.78:0/2866208293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa044106800 0x7fa04419db90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa038031460 tx=0x7fa0380045e0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.720+0000 7fa049b60640 1 -- 172.21.15.78:0/2866208293 shutdown_connections 2024-09-18T13:08:54.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.720+0000 7fa049b60640 1 --2- 172.21.15.78:0/2866208293 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa02c07af30 0x7fa02c07d3f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.720+0000 7fa049b60640 1 --2- 172.21.15.78:0/2866208293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa044106800 0x7fa04419db90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.720+0000 7fa049b60640 1 --2- 172.21.15.78:0/2866208293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa044100800 0x7fa04419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.720+0000 7fa049b60640 1 -- 172.21.15.78:0/2866208293 >> 172.21.15.78:0/2866208293 conn(0x7fa0440fc520 msgr2=0x7fa0441045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:54.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.720+0000 7fa049b60640 1 -- 172.21.15.78:0/2866208293 shutdown_connections 2024-09-18T13:08:54.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.720+0000 7fa049b60640 1 -- 172.21.15.78:0/2866208293 wait complete. 2024-09-18T13:08:54.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.800+0000 7f4f3060b640 1 -- 172.21.15.78:0/1733467463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28103490 msgr2=0x7f4f2810b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.800+0000 7f4f3060b640 1 --2- 172.21.15.78:0/1733467463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28103490 0x7f4f2810b980 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009880 tx=0x7f4f1c02a530 comp rx=0 tx=0).stop 2024-09-18T13:08:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.801+0000 7f4f3060b640 1 -- 172.21.15.78:0/1733467463 shutdown_connections 2024-09-18T13:08:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.801+0000 7f4f3060b640 1 --2- 172.21.15.78:0/1733467463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28103490 0x7f4f2810b980 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.801+0000 7f4f3060b640 1 --2- 172.21.15.78:0/1733467463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f28102b70 0x7f4f28102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.801+0000 7f4f3060b640 1 -- 172.21.15.78:0/1733467463 >> 172.21.15.78:0/1733467463 conn(0x7f4f280fc550 msgr2=0x7f4f280fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.801+0000 7f4f3060b640 1 -- 172.21.15.78:0/1733467463 shutdown_connections 2024-09-18T13:08:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.801+0000 7f4f3060b640 1 -- 172.21.15.78:0/1733467463 wait complete. 2024-09-18T13:08:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.801+0000 7f4f3060b640 1 Processor -- start 2024-09-18T13:08:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.801+0000 7f4f3060b640 1 -- start start 2024-09-18T13:08:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.802+0000 7f4f3060b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28102b70 0x7f4f2819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.802+0000 7f4f3060b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f28103490 0x7f4f2819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.802+0000 7f4f3060b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2810ede0 con 0x7f4f28102b70 2024-09-18T13:08:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.802+0000 7f4f3060b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2810ec60 con 0x7f4f28103490 2024-09-18T13:08:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.802+0000 7f4f2e3a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28102b70 0x7f4f2819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.802+0000 7f4f2e3a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28102b70 0x7f4f2819d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57946/0 (socket says 172.21.15.78:57946) 2024-09-18T13:08:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.802+0000 7f4f2e3a7640 1 -- 172.21.15.78:0/1300268244 learned_addr learned my addr 172.21.15.78:0/1300268244 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:08:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.802+0000 7f4f2dba6640 1 --2- 172.21.15.78:0/1300268244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f28103490 0x7f4f2819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.802+0000 7f4f2e3a7640 1 -- 172.21.15.78:0/1300268244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f28103490 msgr2=0x7f4f2819db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.802+0000 7f4f2e3a7640 1 --2- 172.21.15.78:0/1300268244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f28103490 0x7f4f2819db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.802+0000 7f4f2e3a7640 1 -- 172.21.15.78:0/1300268244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f281977d0 con 0x7f4f28102b70 2024-09-18T13:08:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.802+0000 7f4f2e3a7640 1 --2- 172.21.15.78:0/1300268244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28102b70 0x7f4f2819d650 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800ea00 tx=0x7f4f1800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.802+0000 7f4f277fe640 1 -- 172.21.15.78:0/1300268244 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f1800cb80 con 0x7f4f28102b70 2024-09-18T13:08:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.803+0000 7f4f3060b640 1 -- 172.21.15.78:0/1300268244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f28197ac0 con 0x7f4f28102b70 2024-09-18T13:08:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.803+0000 7f4f277fe640 1 -- 172.21.15.78:0/1300268244 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f1800cd20 con 0x7f4f28102b70 2024-09-18T13:08:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.803+0000 7f4f277fe640 1 -- 172.21.15.78:0/1300268244 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f18011470 con 0x7f4f28102b70 2024-09-18T13:08:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.803+0000 7f4f3060b640 1 -- 172.21.15.78:0/1300268244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f28198020 con 0x7f4f28102b70 2024-09-18T13:08:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.804+0000 7f4f3060b640 1 -- 172.21.15.78:0/1300268244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f2806a4c0 con 0x7f4f28102b70 2024-09-18T13:08:54.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.804+0000 7f4f277fe640 1 -- 172.21.15.78:0/1300268244 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4f18005020 con 0x7f4f28102b70 2024-09-18T13:08:54.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.805+0000 7f4f277fe640 1 --2- 172.21.15.78:0/1300268244 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f1007af30 0x7f4f1007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:54.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.805+0000 7f4f277fe640 1 -- 172.21.15.78:0/1300268244 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f4f1809e4d0 con 0x7f4f28102b70 2024-09-18T13:08:54.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.805+0000 7f4f2dba6640 1 --2- 172.21.15.78:0/1300268244 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f1007af30 0x7f4f1007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:54.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.806+0000 7f4f2dba6640 1 --2- 172.21.15.78:0/1300268244 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f1007af30 0x7f4f1007d3f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4f28198b20 tx=0x7f4f1c004f30 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:54.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:54.809+0000 7f4f277fe640 1 -- 172.21.15.78:0/1300268244 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4f18016030 con 0x7f4f28102b70 2024-09-18T13:08:55.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.056+0000 7f4f3060b640 1 -- 172.21.15.78:0/1300268244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4f28106000 con 0x7f4f28102b70 2024-09-18T13:08:55.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.056+0000 7f4f277fe640 1 -- 172.21.15.78:0/1300268244 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f4f18069a10 con 0x7f4f28102b70 2024-09-18T13:08:55.057 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:08:55.058 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:08:55.058 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:08:55.058 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:08:55.058 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:08:55.058 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:08:55.058 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:08:55.058 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:08:55.058 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:08:55.058 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:08:55.058 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:08:55.058 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:08:55.058 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:08:55.059 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:08:55.059 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:08:55.059 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:08:55.059 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:08:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.058+0000 7f4f3060b640 1 -- 172.21.15.78:0/1300268244 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f1007af30 msgr2=0x7f4f1007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.058+0000 7f4f3060b640 1 --2- 172.21.15.78:0/1300268244 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f1007af30 0x7f4f1007d3f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4f28198b20 tx=0x7f4f1c004f30 comp rx=0 tx=0).stop 2024-09-18T13:08:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.058+0000 7f4f3060b640 1 -- 172.21.15.78:0/1300268244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28102b70 msgr2=0x7f4f2819d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.058+0000 7f4f3060b640 1 --2- 172.21.15.78:0/1300268244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28102b70 0x7f4f2819d650 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800ea00 tx=0x7f4f1800eec0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.058+0000 7f4f3060b640 1 -- 172.21.15.78:0/1300268244 shutdown_connections 2024-09-18T13:08:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.058+0000 7f4f3060b640 1 --2- 172.21.15.78:0/1300268244 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f4f1007af30 0x7f4f1007d3f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.058+0000 7f4f3060b640 1 --2- 172.21.15.78:0/1300268244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f28103490 0x7f4f2819db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.058+0000 7f4f3060b640 1 --2- 172.21.15.78:0/1300268244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f28102b70 0x7f4f2819d650 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.058+0000 7f4f3060b640 1 -- 172.21.15.78:0/1300268244 >> 172.21.15.78:0/1300268244 conn(0x7f4f280fc550 msgr2=0x7f4f28103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.059+0000 7f4f3060b640 1 -- 172.21.15.78:0/1300268244 shutdown_connections 2024-09-18T13:08:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.059+0000 7f4f3060b640 1 -- 172.21.15.78:0/1300268244 wait complete. 2024-09-18T13:08:55.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.140+0000 7f97b677c640 1 -- 172.21.15.78:0/3687872180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97b01033e0 msgr2=0x7f97b010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:55.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.140+0000 7f97b677c640 1 --2- 172.21.15.78:0/3687872180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97b01033e0 0x7f97b010b8d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009880 tx=0x7f97a402a530 comp rx=0 tx=0).stop 2024-09-18T13:08:55.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.140+0000 7f97b677c640 1 -- 172.21.15.78:0/3687872180 shutdown_connections 2024-09-18T13:08:55.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.140+0000 7f97b677c640 1 --2- 172.21.15.78:0/3687872180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97b01033e0 0x7f97b010b8d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.140+0000 7f97b677c640 1 --2- 172.21.15.78:0/3687872180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97b0102ac0 0x7f97b0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.140+0000 7f97b677c640 1 -- 172.21.15.78:0/3687872180 >> 172.21.15.78:0/3687872180 conn(0x7f97b00fc520 msgr2=0x7f97b00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:55.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.140+0000 7f97b677c640 1 -- 172.21.15.78:0/3687872180 shutdown_connections 2024-09-18T13:08:55.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.140+0000 7f97b677c640 1 -- 172.21.15.78:0/3687872180 wait complete. 2024-09-18T13:08:55.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.141+0000 7f97b677c640 1 Processor -- start 2024-09-18T13:08:55.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.141+0000 7f97b677c640 1 -- start start 2024-09-18T13:08:55.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.141+0000 7f97b677c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97b0102ac0 0x7f97b019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:55.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.141+0000 7f97b677c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97b01033e0 0x7f97b019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:55.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.141+0000 7f97b677c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f97b010edf0 con 0x7f97b0102ac0 2024-09-18T13:08:55.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.141+0000 7f97b677c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f97b010ec70 con 0x7f97b01033e0 2024-09-18T13:08:55.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.141+0000 7f97affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97b0102ac0 0x7f97b019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:55.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.141+0000 7f97affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97b0102ac0 0x7f97b019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57968/0 (socket says 172.21.15.78:57968) 2024-09-18T13:08:55.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.141+0000 7f97affff640 1 -- 172.21.15.78:0/12146523 learned_addr learned my addr 172.21.15.78:0/12146523 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:08:55.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.142+0000 7f97af7fe640 1 --2- 172.21.15.78:0/12146523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97b01033e0 0x7f97b019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:55.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.142+0000 7f97affff640 1 -- 172.21.15.78:0/12146523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97b01033e0 msgr2=0x7f97b019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:55.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.142+0000 7f97affff640 1 --2- 172.21.15.78:0/12146523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97b01033e0 0x7f97b019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.142+0000 7f97affff640 1 -- 172.21.15.78:0/12146523 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b0197800 con 0x7f97b0102ac0 2024-09-18T13:08:55.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.142+0000 7f97affff640 1 --2- 172.21.15.78:0/12146523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97b0102ac0 0x7f97b019d680 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f97a000d6f0 tx=0x7f97a000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:55.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.142+0000 7f97ad7fa640 1 -- 172.21.15.78:0/12146523 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f97a0017070 con 0x7f97b0102ac0 2024-09-18T13:08:55.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.142+0000 7f97ad7fa640 1 -- 172.21.15.78:0/12146523 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f97a000de00 con 0x7f97b0102ac0 2024-09-18T13:08:55.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.142+0000 7f97b677c640 1 -- 172.21.15.78:0/12146523 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b0197af0 con 0x7f97b0102ac0 2024-09-18T13:08:55.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.142+0000 7f97ad7fa640 1 -- 172.21.15.78:0/12146523 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f97a0004bb0 con 0x7f97b0102ac0 2024-09-18T13:08:55.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.142+0000 7f97b677c640 1 -- 172.21.15.78:0/12146523 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b0198050 con 0x7f97b0102ac0 2024-09-18T13:08:55.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.143+0000 7f97b677c640 1 -- 172.21.15.78:0/12146523 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b006aa90 con 0x7f97b0102ac0 2024-09-18T13:08:55.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.144+0000 7f97ad7fa640 1 -- 172.21.15.78:0/12146523 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f97a0004e60 con 0x7f97b0102ac0 2024-09-18T13:08:55.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.144+0000 7f97ad7fa640 1 --2- 172.21.15.78:0/12146523 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f979807af30 0x7f979807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:55.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.144+0000 7f97af7fe640 1 --2- 172.21.15.78:0/12146523 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f979807af30 0x7f979807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:55.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.144+0000 7f97ad7fa640 1 -- 172.21.15.78:0/12146523 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f97a009dcb0 con 0x7f97b0102ac0 2024-09-18T13:08:55.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.145+0000 7f97af7fe640 1 --2- 172.21.15.78:0/12146523 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f979807af30 0x7f979807d3f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f97b0198b50 tx=0x7f97a4031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:55.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.148+0000 7f97ad7fa640 1 -- 172.21.15.78:0/12146523 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f97a0069250 con 0x7f97b0102ac0 2024-09-18T13:08:55.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.360+0000 7f97b677c640 1 -- 172.21.15.78:0/12146523 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f97b0105f60 con 0x7f97b0102ac0 2024-09-18T13:08:55.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.361+0000 7f97ad7fa640 1 -- 172.21.15.78:0/12146523 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f97a006e100 con 0x7f97b0102ac0 2024-09-18T13:08:55.362 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:08:55.362 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:08:55.362 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:08:55.362 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:08:55.362 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:08:55.362 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:08:55.362 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:08:55.362 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:08:55.363 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:08:55.363 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:08:55.363 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:08:55.363 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:08:55.363 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:08:55.363 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:08:55.363 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:08:55.363 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:08:55.363 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:08:55.363 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:08:55.363 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:08:55.363 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:08:55.363 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:08:55.364 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:08:55.364 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:08:55.364 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:08:55.364 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:08:55.364 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:08:55.364 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:08:55.364 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:08:55.364 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:08:55.364 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:08:55.364 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:08:55.364 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:08:55.364 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:08:55.364 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:08:55.365 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:08:55.365 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:08:55.365 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:08:55.365 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:08:55.365 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:08:55.365 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:08:55.365 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:08:55.365 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:08:55.365 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:08:55.366 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:08:55.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.363+0000 7f97b677c640 1 -- 172.21.15.78:0/12146523 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f979807af30 msgr2=0x7f979807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:55.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.363+0000 7f97b677c640 1 --2- 172.21.15.78:0/12146523 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f979807af30 0x7f979807d3f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f97b0198b50 tx=0x7f97a4031400 comp rx=0 tx=0).stop 2024-09-18T13:08:55.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.363+0000 7f97b677c640 1 -- 172.21.15.78:0/12146523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97b0102ac0 msgr2=0x7f97b019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:55.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.363+0000 7f97b677c640 1 --2- 172.21.15.78:0/12146523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97b0102ac0 0x7f97b019d680 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f97a000d6f0 tx=0x7f97a000dbb0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.363+0000 7f97b677c640 1 -- 172.21.15.78:0/12146523 shutdown_connections 2024-09-18T13:08:55.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.363+0000 7f97b677c640 1 --2- 172.21.15.78:0/12146523 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f979807af30 0x7f979807d3f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.363+0000 7f97b677c640 1 --2- 172.21.15.78:0/12146523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97b01033e0 0x7f97b019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.363+0000 7f97b677c640 1 --2- 172.21.15.78:0/12146523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97b0102ac0 0x7f97b019d680 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.363+0000 7f97b677c640 1 -- 172.21.15.78:0/12146523 >> 172.21.15.78:0/12146523 conn(0x7f97b00fc520 msgr2=0x7f97b0108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:55.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.363+0000 7f97b677c640 1 -- 172.21.15.78:0/12146523 shutdown_connections 2024-09-18T13:08:55.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.363+0000 7f97b677c640 1 -- 172.21.15.78:0/12146523 wait complete. 2024-09-18T13:08:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.448+0000 7fa3b0a1d640 1 -- 172.21.15.78:0/1732024993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac1067f0 msgr2=0x7fa3ac106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.448+0000 7fa3b0a1d640 1 --2- 172.21.15.78:0/1732024993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac1067f0 0x7fa3ac106bd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009880 tx=0x7fa39c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.448+0000 7fa3b0a1d640 1 -- 172.21.15.78:0/1732024993 shutdown_connections 2024-09-18T13:08:55.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.448+0000 7fa3b0a1d640 1 --2- 172.21.15.78:0/1732024993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3ac1007f0 0x7fa3ac100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.448+0000 7fa3b0a1d640 1 --2- 172.21.15.78:0/1732024993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac1067f0 0x7fa3ac106bd0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.448+0000 7fa3b0a1d640 1 -- 172.21.15.78:0/1732024993 >> 172.21.15.78:0/1732024993 conn(0x7fa3ac0fc550 msgr2=0x7fa3ac0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:55.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.449+0000 7fa3b0a1d640 1 -- 172.21.15.78:0/1732024993 shutdown_connections 2024-09-18T13:08:55.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.449+0000 7fa3b0a1d640 1 -- 172.21.15.78:0/1732024993 wait complete. 2024-09-18T13:08:55.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.449+0000 7fa3b0a1d640 1 Processor -- start 2024-09-18T13:08:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.450+0000 7fa3b0a1d640 1 -- start start 2024-09-18T13:08:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.450+0000 7fa3b0a1d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3ac1007f0 0x7fa3ac1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.450+0000 7fa3b0a1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac1067f0 0x7fa3ac198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.450+0000 7fa3b0a1d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac10dca0 con 0x7fa3ac1067f0 2024-09-18T13:08:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.450+0000 7fa3b0a1d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac10db20 con 0x7fa3ac1007f0 2024-09-18T13:08:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.450+0000 7fa3a1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac1067f0 0x7fa3ac198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.450+0000 7fa3a1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac1067f0 0x7fa3ac198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57994/0 (socket says 172.21.15.78:57994) 2024-09-18T13:08:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.450+0000 7fa3a1d9b640 1 -- 172.21.15.78:0/3841852807 learned_addr learned my addr 172.21.15.78:0/3841852807 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:08:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.450+0000 7fa3aa59c640 1 --2- 172.21.15.78:0/3841852807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3ac1007f0 0x7fa3ac1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.450+0000 7fa3a1d9b640 1 -- 172.21.15.78:0/3841852807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3ac1007f0 msgr2=0x7fa3ac1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.450+0000 7fa3a1d9b640 1 --2- 172.21.15.78:0/3841852807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3ac1007f0 0x7fa3ac1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.450+0000 7fa3a1d9b640 1 -- 172.21.15.78:0/3841852807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ac199410 con 0x7fa3ac1067f0 2024-09-18T13:08:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.451+0000 7fa3a1d9b640 1 --2- 172.21.15.78:0/3841852807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac1067f0 0x7fa3ac198e10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa39400d8d0 tx=0x7fa39400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.451+0000 7fa3a3fff640 1 -- 172.21.15.78:0/3841852807 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa394017070 con 0x7fa3ac1067f0 2024-09-18T13:08:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.451+0000 7fa3a3fff640 1 -- 172.21.15.78:0/3841852807 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa394010460 con 0x7fa3ac1067f0 2024-09-18T13:08:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.451+0000 7fa3a3fff640 1 -- 172.21.15.78:0/3841852807 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa39400f5f0 con 0x7fa3ac1067f0 2024-09-18T13:08:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.451+0000 7fa3b0a1d640 1 -- 172.21.15.78:0/3841852807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3ac199700 con 0x7fa3ac1067f0 2024-09-18T13:08:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.451+0000 7fa3b0a1d640 1 -- 172.21.15.78:0/3841852807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3ac1a1d00 con 0x7fa3ac1067f0 2024-09-18T13:08:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.452+0000 7fa3b0a1d640 1 -- 172.21.15.78:0/3841852807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3ac101f30 con 0x7fa3ac1067f0 2024-09-18T13:08:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.452+0000 7fa3a3fff640 1 -- 172.21.15.78:0/3841852807 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa394009a30 con 0x7fa3ac1067f0 2024-09-18T13:08:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.453+0000 7fa3a3fff640 1 --2- 172.21.15.78:0/3841852807 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa39807af40 0x7fa39807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.453+0000 7fa3a3fff640 1 -- 172.21.15.78:0/3841852807 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fa39409de90 con 0x7fa3ac1067f0 2024-09-18T13:08:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.453+0000 7fa3aa59c640 1 --2- 172.21.15.78:0/3841852807 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa39807af40 0x7fa39807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.453+0000 7fa3aa59c640 1 --2- 172.21.15.78:0/3841852807 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa39807af40 0x7fa39807d400 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0096c0 tx=0x7fa39c031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.458+0000 7fa3a3fff640 1 -- 172.21.15.78:0/3841852807 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa3ac199700 con 0x7fa3ac1067f0 2024-09-18T13:08:55.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.660+0000 7fa3b0a1d640 1 -- 172.21.15.78:0/3841852807 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa3ac062630 con 0x7fa39807af40 2024-09-18T13:08:55.661 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:55 smithi078 ceph-mon[108578]: from='client.34918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:55.661 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:55 smithi078 ceph-mon[108578]: from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:55.661 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:55 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1300268244' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:08:55.661 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:55 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/12146523' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:08:55.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.661+0000 7fa3a3fff640 1 -- 172.21.15.78:0/3841852807 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa3ac062630 con 0x7fa39807af40 2024-09-18T13:08:55.662 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:08:55.662 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:08:55.662 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:08:55.662 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:08:55.663 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:08:55.663 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:08:55.663 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:08:55.663 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:08:55.663 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:08:55.663 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:08:55.663 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:08:55.663 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:08:55.663 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:08:55.663 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:08:55.663 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:08:55.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.664+0000 7fa3b0a1d640 1 -- 172.21.15.78:0/3841852807 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa39807af40 msgr2=0x7fa39807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:55.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.664+0000 7fa3b0a1d640 1 --2- 172.21.15.78:0/3841852807 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa39807af40 0x7fa39807d400 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0096c0 tx=0x7fa39c031400 comp rx=0 tx=0).stop 2024-09-18T13:08:55.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.664+0000 7fa3b0a1d640 1 -- 172.21.15.78:0/3841852807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac1067f0 msgr2=0x7fa3ac198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:55.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.664+0000 7fa3b0a1d640 1 --2- 172.21.15.78:0/3841852807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac1067f0 0x7fa3ac198e10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa39400d8d0 tx=0x7fa39400dd90 comp rx=0 tx=0).stop 2024-09-18T13:08:55.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.664+0000 7fa3b0a1d640 1 -- 172.21.15.78:0/3841852807 shutdown_connections 2024-09-18T13:08:55.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.664+0000 7fa3b0a1d640 1 --2- 172.21.15.78:0/3841852807 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa39807af40 0x7fa39807d400 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.664+0000 7fa3b0a1d640 1 --2- 172.21.15.78:0/3841852807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3ac1067f0 0x7fa3ac198e10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.664+0000 7fa3b0a1d640 1 --2- 172.21.15.78:0/3841852807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3ac1007f0 0x7fa3ac1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.664+0000 7fa3b0a1d640 1 -- 172.21.15.78:0/3841852807 >> 172.21.15.78:0/3841852807 conn(0x7fa3ac0fc550 msgr2=0x7fa3ac0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:55.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.664+0000 7fa3b0a1d640 1 -- 172.21.15.78:0/3841852807 shutdown_connections 2024-09-18T13:08:55.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.664+0000 7fa3b0a1d640 1 -- 172.21.15.78:0/3841852807 wait complete. 2024-09-18T13:08:55.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:55 smithi148 ceph-mon[80030]: from='client.34918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:55.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:55 smithi148 ceph-mon[80030]: from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:55.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:55 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1300268244' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:08:55.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:55 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/12146523' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:08:55.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.744+0000 7f2c2e9f1640 1 -- 172.21.15.78:0/2825056419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c28100800 msgr2=0x7f2c28100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:55.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.744+0000 7f2c2e9f1640 1 --2- 172.21.15.78:0/2825056419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c28100800 0x7f2c28100c60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009880 tx=0x7f2c1c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.744+0000 7f2c2e9f1640 1 -- 172.21.15.78:0/2825056419 shutdown_connections 2024-09-18T13:08:55.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.744+0000 7f2c2e9f1640 1 --2- 172.21.15.78:0/2825056419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c28100800 0x7f2c28100c60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.744+0000 7f2c2e9f1640 1 --2- 172.21.15.78:0/2825056419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c28106800 0x7f2c28106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.744+0000 7f2c2e9f1640 1 -- 172.21.15.78:0/2825056419 >> 172.21.15.78:0/2825056419 conn(0x7f2c280fc520 msgr2=0x7f2c280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:55.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.744+0000 7f2c2e9f1640 1 -- 172.21.15.78:0/2825056419 shutdown_connections 2024-09-18T13:08:55.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.744+0000 7f2c2e9f1640 1 -- 172.21.15.78:0/2825056419 wait complete. 2024-09-18T13:08:55.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.745+0000 7f2c2e9f1640 1 Processor -- start 2024-09-18T13:08:55.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.745+0000 7f2c2e9f1640 1 -- start start 2024-09-18T13:08:55.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.745+0000 7f2c2e9f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c28100800 0x7f2c2819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:55.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.745+0000 7f2c2e9f1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c28106800 0x7f2c2819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:55.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.745+0000 7f2c2e9f1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2810dd30 con 0x7f2c28100800 2024-09-18T13:08:55.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.745+0000 7f2c2e9f1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2810dbb0 con 0x7f2c28106800 2024-09-18T13:08:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.745+0000 7f2c27fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c28100800 0x7f2c2819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.745+0000 7f2c27fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c28100800 0x7f2c2819d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58022/0 (socket says 172.21.15.78:58022) 2024-09-18T13:08:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.745+0000 7f2c27fff640 1 -- 172.21.15.78:0/352208496 learned_addr learned my addr 172.21.15.78:0/352208496 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:08:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.745+0000 7f2c27fff640 1 -- 172.21.15.78:0/352208496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c28106800 msgr2=0x7f2c2819dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.745+0000 7f2c27fff640 1 --2- 172.21.15.78:0/352208496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c28106800 0x7f2c2819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.745+0000 7f2c27fff640 1 -- 172.21.15.78:0/352208496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c28197870 con 0x7f2c28100800 2024-09-18T13:08:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.746+0000 7f2c27fff640 1 --2- 172.21.15.78:0/352208496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c28100800 0x7f2c2819d6b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800b420 tx=0x7f2c1800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.746+0000 7f2c257fa640 1 -- 172.21.15.78:0/352208496 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c18011630 con 0x7f2c28100800 2024-09-18T13:08:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.746+0000 7f2c257fa640 1 -- 172.21.15.78:0/352208496 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2c18016070 con 0x7f2c28100800 2024-09-18T13:08:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.746+0000 7f2c257fa640 1 -- 172.21.15.78:0/352208496 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c18010d40 con 0x7f2c28100800 2024-09-18T13:08:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.746+0000 7f2c2e9f1640 1 -- 172.21.15.78:0/352208496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c28197b60 con 0x7f2c28100800 2024-09-18T13:08:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.746+0000 7f2c2e9f1640 1 -- 172.21.15.78:0/352208496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c281980f0 con 0x7f2c28100800 2024-09-18T13:08:55.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.747+0000 7f2c2e9f1640 1 -- 172.21.15.78:0/352208496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c28101f40 con 0x7f2c28100800 2024-09-18T13:08:55.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.747+0000 7f2c257fa640 1 -- 172.21.15.78:0/352208496 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2c1801b460 con 0x7f2c28100800 2024-09-18T13:08:55.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.748+0000 7f2c257fa640 1 --2- 172.21.15.78:0/352208496 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2c1007af30 0x7f2c1007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:08:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.748+0000 7f2c257fa640 1 -- 172.21.15.78:0/352208496 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f2c1809d7a0 con 0x7f2c28100800 2024-09-18T13:08:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.748+0000 7f2c277fe640 1 --2- 172.21.15.78:0/352208496 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2c1007af30 0x7f2c1007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:08:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.748+0000 7f2c277fe640 1 --2- 172.21.15.78:0/352208496 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2c1007af30 0x7f2c1007d3f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0096c0 tx=0x7f2c1c000bc0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:08:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.752+0000 7f2c257fa640 1 -- 172.21.15.78:0/352208496 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2c18021250 con 0x7f2c28100800 2024-09-18T13:08:55.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.996+0000 7f2c2e9f1640 1 -- 172.21.15.78:0/352208496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2c28198da0 con 0x7f2c28100800 2024-09-18T13:08:55.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.996+0000 7f2c257fa640 1 -- 172.21.15.78:0/352208496 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f2c18068d40 con 0x7f2c28100800 2024-09-18T13:08:55.998 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:08:55.998 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:08:55.998 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:08:55.998 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:08:55.998 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:08:55.998 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:08:55.998 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:08:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.998+0000 7f2c2e9f1640 1 -- 172.21.15.78:0/352208496 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2c1007af30 msgr2=0x7f2c1007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.998+0000 7f2c2e9f1640 1 --2- 172.21.15.78:0/352208496 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2c1007af30 0x7f2c1007d3f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0096c0 tx=0x7f2c1c000bc0 comp rx=0 tx=0).stop 2024-09-18T13:08:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.998+0000 7f2c2e9f1640 1 -- 172.21.15.78:0/352208496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c28100800 msgr2=0x7f2c2819d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:08:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.998+0000 7f2c2e9f1640 1 --2- 172.21.15.78:0/352208496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c28100800 0x7f2c2819d6b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800b420 tx=0x7f2c1800b8e0 comp rx=0 tx=0).stop 2024-09-18T13:08:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.999+0000 7f2c2e9f1640 1 -- 172.21.15.78:0/352208496 shutdown_connections 2024-09-18T13:08:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.999+0000 7f2c2e9f1640 1 --2- 172.21.15.78:0/352208496 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2c1007af30 0x7f2c1007d3f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.999+0000 7f2c2e9f1640 1 --2- 172.21.15.78:0/352208496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c28106800 0x7f2c2819dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.999+0000 7f2c2e9f1640 1 --2- 172.21.15.78:0/352208496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c28100800 0x7f2c2819d6b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:08:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.999+0000 7f2c2e9f1640 1 -- 172.21.15.78:0/352208496 >> 172.21.15.78:0/352208496 conn(0x7f2c280fc520 msgr2=0x7f2c2806a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:08:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.999+0000 7f2c2e9f1640 1 -- 172.21.15.78:0/352208496 shutdown_connections 2024-09-18T13:08:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:08:55.999+0000 7f2c2e9f1640 1 -- 172.21.15.78:0/352208496 wait complete. 2024-09-18T13:08:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:56 smithi148 ceph-mon[80030]: from='client.34926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:56 smithi148 ceph-mon[80030]: pgmap v593: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:56 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/352208496' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:08:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:56 smithi078 ceph-mon[108578]: from='client.34926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:56 smithi078 ceph-mon[108578]: pgmap v593: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:56 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/352208496' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:08:57.714 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:57 smithi078 ceph-mon[108578]: from='client.34938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:57.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:57 smithi148 ceph-mon[80030]: from='client.34938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:08:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:08:58 smithi148 ceph-mon[80030]: pgmap v594: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:08:58.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:08:58 smithi078 ceph-mon[108578]: pgmap v594: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:00.711 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:00 smithi078 ceph-mon[108578]: pgmap v595: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:00 smithi148 ceph-mon[80030]: pgmap v595: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:02.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:02 smithi148 ceph-mon[80030]: pgmap v596: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:02 smithi078 ceph-mon[108578]: pgmap v596: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:04 smithi148 ceph-mon[80030]: pgmap v597: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:04 smithi078 ceph-mon[108578]: pgmap v597: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:06.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:06 smithi148 ceph-mon[80030]: pgmap v598: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:06.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:06 smithi078 ceph-mon[108578]: pgmap v598: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:08.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:08 smithi148 ceph-mon[80030]: pgmap v599: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:08.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:08 smithi078 ceph-mon[108578]: pgmap v599: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:09.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:09 smithi078 ceph-mon[108578]: pgmap v600: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:09.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:09 smithi148 ceph-mon[80030]: pgmap v600: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:10.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:10 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:09:10.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:10 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:09:11.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:11 smithi148 ceph-mon[80030]: pgmap v601: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:11 smithi078 ceph-mon[108578]: pgmap v601: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:14 smithi148 ceph-mon[80030]: pgmap v602: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:14.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:14 smithi078 ceph-mon[108578]: pgmap v602: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:16.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:16 smithi148 ceph-mon[80030]: pgmap v603: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:16 smithi078 ceph-mon[108578]: pgmap v603: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:18.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:18 smithi078 ceph-mon[108578]: pgmap v604: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:18 smithi148 ceph-mon[80030]: pgmap v604: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:20 smithi148 ceph-mon[80030]: pgmap v605: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:20.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:20 smithi078 ceph-mon[108578]: pgmap v605: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:22 smithi148 ceph-mon[80030]: pgmap v606: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:22.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:22 smithi078 ceph-mon[108578]: pgmap v606: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:24.707 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:24 smithi078 ceph-mon[108578]: pgmap v607: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:24 smithi148 ceph-mon[80030]: pgmap v607: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:26.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.092+0000 7fec5f1c7640 1 -- 172.21.15.78:0/2449508747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec58106800 msgr2=0x7fec58106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:26.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.092+0000 7fec5f1c7640 1 --2- 172.21.15.78:0/2449508747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec58106800 0x7fec58106be0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fec54009880 tx=0x7fec5402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.092+0000 7fec5f1c7640 1 -- 172.21.15.78:0/2449508747 shutdown_connections 2024-09-18T13:09:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.092+0000 7fec5f1c7640 1 --2- 172.21.15.78:0/2449508747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec58100800 0x7fec58100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.092+0000 7fec5f1c7640 1 --2- 172.21.15.78:0/2449508747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec58106800 0x7fec58106be0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.092+0000 7fec5f1c7640 1 -- 172.21.15.78:0/2449508747 >> 172.21.15.78:0/2449508747 conn(0x7fec580fc520 msgr2=0x7fec580fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.092+0000 7fec5f1c7640 1 -- 172.21.15.78:0/2449508747 shutdown_connections 2024-09-18T13:09:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.092+0000 7fec5f1c7640 1 -- 172.21.15.78:0/2449508747 wait complete. 2024-09-18T13:09:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.093+0000 7fec5f1c7640 1 Processor -- start 2024-09-18T13:09:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.093+0000 7fec5f1c7640 1 -- start start 2024-09-18T13:09:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.093+0000 7fec5f1c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec58100800 0x7fec5819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.093+0000 7fec5f1c7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec58106800 0x7fec5819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.093+0000 7fec5f1c7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fec5810dcb0 con 0x7fec58100800 2024-09-18T13:09:26.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.093+0000 7fec5f1c7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fec5810db30 con 0x7fec58106800 2024-09-18T13:09:26.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.094+0000 7fec5cf63640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec58100800 0x7fec5819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:26.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.094+0000 7fec5cf63640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec58100800 0x7fec5819d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40594/0 (socket says 172.21.15.78:40594) 2024-09-18T13:09:26.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.094+0000 7fec5cf63640 1 -- 172.21.15.78:0/1470658203 learned_addr learned my addr 172.21.15.78:0/1470658203 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:09:26.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.094+0000 7fec4ffff640 1 --2- 172.21.15.78:0/1470658203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec58106800 0x7fec5819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:26.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.094+0000 7fec5cf63640 1 -- 172.21.15.78:0/1470658203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec58106800 msgr2=0x7fec5819dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:26.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.094+0000 7fec5cf63640 1 --2- 172.21.15.78:0/1470658203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec58106800 0x7fec5819dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.094+0000 7fec5cf63640 1 -- 172.21.15.78:0/1470658203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec58197850 con 0x7fec58100800 2024-09-18T13:09:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.094+0000 7fec5cf63640 1 --2- 172.21.15.78:0/1470658203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec58100800 0x7fec5819d6d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fec54031460 tx=0x7fec540048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.094+0000 7fec4dffb640 1 -- 172.21.15.78:0/1470658203 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec5403f070 con 0x7fec58100800 2024-09-18T13:09:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.094+0000 7fec5f1c7640 1 -- 172.21.15.78:0/1470658203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec58197ae0 con 0x7fec58100800 2024-09-18T13:09:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.094+0000 7fec4dffb640 1 -- 172.21.15.78:0/1470658203 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fec54004cf0 con 0x7fec58100800 2024-09-18T13:09:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.094+0000 7fec4dffb640 1 -- 172.21.15.78:0/1470658203 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec54035030 con 0x7fec58100800 2024-09-18T13:09:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.095+0000 7fec5f1c7640 1 -- 172.21.15.78:0/1470658203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec58198010 con 0x7fec58100800 2024-09-18T13:09:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.096+0000 7fec5f1c7640 1 -- 172.21.15.78:0/1470658203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec58101f40 con 0x7fec58100800 2024-09-18T13:09:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.096+0000 7fec4dffb640 1 -- 172.21.15.78:0/1470658203 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fec54042070 con 0x7fec58100800 2024-09-18T13:09:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.097+0000 7fec4dffb640 1 --2- 172.21.15.78:0/1470658203 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fec4007af30 0x7fec4007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.097+0000 7fec4dffb640 1 -- 172.21.15.78:0/1470658203 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fec540beb20 con 0x7fec58100800 2024-09-18T13:09:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.097+0000 7fec4ffff640 1 --2- 172.21.15.78:0/1470658203 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fec4007af30 0x7fec4007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.098+0000 7fec4ffff640 1 --2- 172.21.15.78:0/1470658203 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fec4007af30 0x7fec4007d3f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fec48005e10 tx=0x7fec48005da0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:26.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.101+0000 7fec4dffb640 1 -- 172.21.15.78:0/1470658203 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fec5408a0c0 con 0x7fec58100800 2024-09-18T13:09:26.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.293+0000 7fec5f1c7640 1 -- 172.21.15.78:0/1470658203 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fec58198d80 con 0x7fec4007af30 2024-09-18T13:09:26.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.294+0000 7fec4dffb640 1 -- 172.21.15.78:0/1470658203 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fec58198d80 con 0x7fec4007af30 2024-09-18T13:09:26.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.296+0000 7fec5f1c7640 1 -- 172.21.15.78:0/1470658203 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fec4007af30 msgr2=0x7fec4007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:26.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.296+0000 7fec5f1c7640 1 --2- 172.21.15.78:0/1470658203 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fec4007af30 0x7fec4007d3f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fec48005e10 tx=0x7fec48005da0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.296+0000 7fec5f1c7640 1 -- 172.21.15.78:0/1470658203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec58100800 msgr2=0x7fec5819d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:26.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.296+0000 7fec5f1c7640 1 --2- 172.21.15.78:0/1470658203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec58100800 0x7fec5819d6d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fec54031460 tx=0x7fec540048f0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.296+0000 7fec5f1c7640 1 -- 172.21.15.78:0/1470658203 shutdown_connections 2024-09-18T13:09:26.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.296+0000 7fec5f1c7640 1 --2- 172.21.15.78:0/1470658203 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fec4007af30 0x7fec4007d3f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.296+0000 7fec5f1c7640 1 --2- 172.21.15.78:0/1470658203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec58106800 0x7fec5819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.296+0000 7fec5f1c7640 1 --2- 172.21.15.78:0/1470658203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec58100800 0x7fec5819d6d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.297+0000 7fec5f1c7640 1 -- 172.21.15.78:0/1470658203 >> 172.21.15.78:0/1470658203 conn(0x7fec580fc520 msgr2=0x7fec5806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:26.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.297+0000 7fec5f1c7640 1 -- 172.21.15.78:0/1470658203 shutdown_connections 2024-09-18T13:09:26.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.297+0000 7fec5f1c7640 1 -- 172.21.15.78:0/1470658203 wait complete. 2024-09-18T13:09:26.307 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:09:26.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.381+0000 7fe565a77640 1 -- 172.21.15.78:0/829293237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe560100810 msgr2=0x7fe560100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:26.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.381+0000 7fe565a77640 1 --2- 172.21.15.78:0/829293237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe560100810 0x7fe560100c70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe548009880 tx=0x7fe54802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.381+0000 7fe565a77640 1 -- 172.21.15.78:0/829293237 shutdown_connections 2024-09-18T13:09:26.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.381+0000 7fe565a77640 1 --2- 172.21.15.78:0/829293237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe560100810 0x7fe560100c70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.381+0000 7fe565a77640 1 --2- 172.21.15.78:0/829293237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe560106810 0x7fe560106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.381+0000 7fe565a77640 1 -- 172.21.15.78:0/829293237 >> 172.21.15.78:0/829293237 conn(0x7fe5600fc510 msgr2=0x7fe5600fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:26.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.381+0000 7fe565a77640 1 -- 172.21.15.78:0/829293237 shutdown_connections 2024-09-18T13:09:26.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.381+0000 7fe565a77640 1 -- 172.21.15.78:0/829293237 wait complete. 2024-09-18T13:09:26.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.381+0000 7fe565a77640 1 Processor -- start 2024-09-18T13:09:26.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.382+0000 7fe565a77640 1 -- start start 2024-09-18T13:09:26.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.382+0000 7fe565a77640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe560100810 0x7fe56019c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:26.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.382+0000 7fe565a77640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe560106810 0x7fe56019cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:26.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.382+0000 7fe565a77640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe56010dce0 con 0x7fe560100810 2024-09-18T13:09:26.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.382+0000 7fe565a77640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe56010db60 con 0x7fe560106810 2024-09-18T13:09:26.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.382+0000 7fe55f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe560100810 0x7fe56019c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:26.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.382+0000 7fe55f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe560100810 0x7fe56019c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40612/0 (socket says 172.21.15.78:40612) 2024-09-18T13:09:26.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.382+0000 7fe55f7fe640 1 -- 172.21.15.78:0/2107741952 learned_addr learned my addr 172.21.15.78:0/2107741952 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:09:26.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.382+0000 7fe55effd640 1 --2- 172.21.15.78:0/2107741952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe560106810 0x7fe56019cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:26.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.382+0000 7fe55f7fe640 1 -- 172.21.15.78:0/2107741952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe560106810 msgr2=0x7fe56019cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:26.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.382+0000 7fe55f7fe640 1 --2- 172.21.15.78:0/2107741952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe560106810 0x7fe56019cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.382+0000 7fe55f7fe640 1 -- 172.21.15.78:0/2107741952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5601966d0 con 0x7fe560100810 2024-09-18T13:09:26.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.382+0000 7fe55f7fe640 1 --2- 172.21.15.78:0/2107741952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe560100810 0x7fe56019c600 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe55000d6f0 tx=0x7fe55000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:26.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.382+0000 7fe55cff9640 1 -- 172.21.15.78:0/2107741952 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe550017070 con 0x7fe560100810 2024-09-18T13:09:26.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.382+0000 7fe55cff9640 1 -- 172.21.15.78:0/2107741952 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe55000de00 con 0x7fe560100810 2024-09-18T13:09:26.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.383+0000 7fe565a77640 1 -- 172.21.15.78:0/2107741952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5601969c0 con 0x7fe560100810 2024-09-18T13:09:26.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.383+0000 7fe55cff9640 1 -- 172.21.15.78:0/2107741952 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe550004bb0 con 0x7fe560100810 2024-09-18T13:09:26.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.383+0000 7fe565a77640 1 -- 172.21.15.78:0/2107741952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe560196f20 con 0x7fe560100810 2024-09-18T13:09:26.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.384+0000 7fe565a77640 1 -- 172.21.15.78:0/2107741952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe560101f50 con 0x7fe560100810 2024-09-18T13:09:26.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.384+0000 7fe55cff9640 1 -- 172.21.15.78:0/2107741952 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe550009a30 con 0x7fe560100810 2024-09-18T13:09:26.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.385+0000 7fe55cff9640 1 --2- 172.21.15.78:0/2107741952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe54c07af80 0x7fe54c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:26.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.385+0000 7fe55effd640 1 --2- 172.21.15.78:0/2107741952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe54c07af80 0x7fe54c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:26.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.385+0000 7fe55cff9640 1 -- 172.21.15.78:0/2107741952 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fe55009dbd0 con 0x7fe560100810 2024-09-18T13:09:26.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.386+0000 7fe55effd640 1 --2- 172.21.15.78:0/2107741952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe54c07af80 0x7fe54c07d440 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe560197f20 tx=0x7fe548031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:26.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.389+0000 7fe55cff9640 1 -- 172.21.15.78:0/2107741952 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe5500691f0 con 0x7fe560100810 2024-09-18T13:09:26.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.579+0000 7fe565a77640 1 -- 172.21.15.78:0/2107741952 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe5601971d0 con 0x7fe54c07af80 2024-09-18T13:09:26.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.581+0000 7fe55cff9640 1 -- 172.21.15.78:0/2107741952 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe5601971d0 con 0x7fe54c07af80 2024-09-18T13:09:26.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.583+0000 7fe565a77640 1 -- 172.21.15.78:0/2107741952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe54c07af80 msgr2=0x7fe54c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:26.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.583+0000 7fe565a77640 1 --2- 172.21.15.78:0/2107741952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe54c07af80 0x7fe54c07d440 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe560197f20 tx=0x7fe548031400 comp rx=0 tx=0).stop 2024-09-18T13:09:26.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.583+0000 7fe565a77640 1 -- 172.21.15.78:0/2107741952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe560100810 msgr2=0x7fe56019c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:26.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.583+0000 7fe565a77640 1 --2- 172.21.15.78:0/2107741952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe560100810 0x7fe56019c600 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe55000d6f0 tx=0x7fe55000dbb0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.583+0000 7fe565a77640 1 -- 172.21.15.78:0/2107741952 shutdown_connections 2024-09-18T13:09:26.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.583+0000 7fe565a77640 1 --2- 172.21.15.78:0/2107741952 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe54c07af80 0x7fe54c07d440 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.583+0000 7fe565a77640 1 --2- 172.21.15.78:0/2107741952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe560106810 0x7fe56019cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.583+0000 7fe565a77640 1 --2- 172.21.15.78:0/2107741952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe560100810 0x7fe56019c600 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.583+0000 7fe565a77640 1 -- 172.21.15.78:0/2107741952 >> 172.21.15.78:0/2107741952 conn(0x7fe5600fc510 msgr2=0x7fe5600fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:26.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.583+0000 7fe565a77640 1 -- 172.21.15.78:0/2107741952 shutdown_connections 2024-09-18T13:09:26.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.583+0000 7fe565a77640 1 -- 172.21.15.78:0/2107741952 wait complete. 2024-09-18T13:09:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.664+0000 7ff011e5e640 1 -- 172.21.15.78:0/4224068215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c101910 msgr2=0x7ff00c101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.664+0000 7ff011e5e640 1 --2- 172.21.15.78:0/4224068215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c101910 0x7ff00c101d70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff000009880 tx=0x7ff00002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.665+0000 7ff011e5e640 1 -- 172.21.15.78:0/4224068215 shutdown_connections 2024-09-18T13:09:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.665+0000 7ff011e5e640 1 --2- 172.21.15.78:0/4224068215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c101910 0x7ff00c101d70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.665+0000 7ff011e5e640 1 --2- 172.21.15.78:0/4224068215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff00c107910 0x7ff00c107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.665+0000 7ff011e5e640 1 -- 172.21.15.78:0/4224068215 >> 172.21.15.78:0/4224068215 conn(0x7ff00c0fd630 msgr2=0x7ff00c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:26.668 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:26 smithi078 ceph-mon[108578]: pgmap v608: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:26.668 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:09:26.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.665+0000 7ff011e5e640 1 -- 172.21.15.78:0/4224068215 shutdown_connections 2024-09-18T13:09:26.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.665+0000 7ff011e5e640 1 -- 172.21.15.78:0/4224068215 wait complete. 2024-09-18T13:09:26.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.665+0000 7ff011e5e640 1 Processor -- start 2024-09-18T13:09:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.665+0000 7ff011e5e640 1 -- start start 2024-09-18T13:09:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.666+0000 7ff011e5e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c101910 0x7ff00c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.666+0000 7ff011e5e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff00c107910 0x7ff00c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.666+0000 7ff011e5e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c10ee40 con 0x7ff00c101910 2024-09-18T13:09:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.666+0000 7ff011e5e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c10ecc0 con 0x7ff00c107910 2024-09-18T13:09:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.666+0000 7ff00b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c101910 0x7ff00c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.666+0000 7ff00b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c101910 0x7ff00c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40624/0 (socket says 172.21.15.78:40624) 2024-09-18T13:09:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.666+0000 7ff00b7fe640 1 -- 172.21.15.78:0/1125348678 learned_addr learned my addr 172.21.15.78:0/1125348678 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:09:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.666+0000 7ff00affd640 1 --2- 172.21.15.78:0/1125348678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff00c107910 0x7ff00c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.666+0000 7ff00b7fe640 1 -- 172.21.15.78:0/1125348678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff00c107910 msgr2=0x7ff00c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.666+0000 7ff00b7fe640 1 --2- 172.21.15.78:0/1125348678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff00c107910 0x7ff00c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.666+0000 7ff00b7fe640 1 -- 172.21.15.78:0/1125348678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00c074f70 con 0x7ff00c101910 2024-09-18T13:09:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.666+0000 7ff00b7fe640 1 --2- 172.21.15.78:0/1125348678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c101910 0x7ff00c0744f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7feffc00b420 tx=0x7feffc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.666+0000 7ff008ff9640 1 -- 172.21.15.78:0/1125348678 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feffc011630 con 0x7ff00c101910 2024-09-18T13:09:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.667+0000 7ff008ff9640 1 -- 172.21.15.78:0/1125348678 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feffc016070 con 0x7ff00c101910 2024-09-18T13:09:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.667+0000 7ff011e5e640 1 -- 172.21.15.78:0/1125348678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00c075260 con 0x7ff00c101910 2024-09-18T13:09:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.667+0000 7ff008ff9640 1 -- 172.21.15.78:0/1125348678 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feffc010d40 con 0x7ff00c101910 2024-09-18T13:09:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.667+0000 7ff011e5e640 1 -- 172.21.15.78:0/1125348678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff00c1a3e70 con 0x7ff00c101910 2024-09-18T13:09:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.668+0000 7ff011e5e640 1 -- 172.21.15.78:0/1125348678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff00c103050 con 0x7ff00c101910 2024-09-18T13:09:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.668+0000 7ff008ff9640 1 -- 172.21.15.78:0/1125348678 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7feffc01b460 con 0x7ff00c101910 2024-09-18T13:09:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.669+0000 7ff008ff9640 1 --2- 172.21.15.78:0/1125348678 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feff407af30 0x7feff407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.669+0000 7ff008ff9640 1 -- 172.21.15.78:0/1125348678 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7feffc09d750 con 0x7ff00c101910 2024-09-18T13:09:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.669+0000 7ff00affd640 1 --2- 172.21.15.78:0/1125348678 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feff407af30 0x7feff407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.669+0000 7ff00affd640 1 --2- 172.21.15.78:0/1125348678 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feff407af30 0x7feff407d3f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff00c075f80 tx=0x7ff000031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:26.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.673+0000 7ff008ff9640 1 -- 172.21.15.78:0/1125348678 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7feffc068cf0 con 0x7ff00c101910 2024-09-18T13:09:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:26 smithi148 ceph-mon[80030]: pgmap v608: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:09:26.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.857+0000 7ff011e5e640 1 -- 172.21.15.78:0/1125348678 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff00c062630 con 0x7feff407af30 2024-09-18T13:09:26.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.866+0000 7ff008ff9640 1 -- 172.21.15.78:0/1125348678 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ff00c062630 con 0x7feff407af30 2024-09-18T13:09:26.869 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:09:26.869 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (17m) 11m ago 28m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:09:26.869 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (19m) 11m ago 28m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:09:26.869 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (19m) 11m ago 27m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:09:26.869 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (15m) 11m ago 28m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:09:26.869 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (15m) 11m ago 27m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:09:26.869 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (16m) 11m ago 28m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:09:26.869 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (11m) 11m ago 22m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:09:26.869 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (11m) 11m ago 22m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:09:26.869 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (11m) 11m ago 22m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:09:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (11m) 11m ago 22m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:09:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (19m) 11m ago 29m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:09:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (18m) 11m ago 27m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:09:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (16m) 11m ago 29m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:09:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (15m) 11m ago 27m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:09:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (18m) 11m ago 28m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:09:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (18m) 11m ago 27m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:09:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (15m) 11m ago 26m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:09:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (14m) 11m ago 25m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:09:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (13m) 11m ago 25m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:09:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (13m) 11m ago 24m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:09:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (12m) 11m ago 24m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:09:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (12m) 11m ago 23m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:09:26.871 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (17m) 11m ago 27m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:09:26.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.869+0000 7ff011e5e640 1 -- 172.21.15.78:0/1125348678 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feff407af30 msgr2=0x7feff407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:26.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.869+0000 7ff011e5e640 1 --2- 172.21.15.78:0/1125348678 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feff407af30 0x7feff407d3f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff00c075f80 tx=0x7ff000031400 comp rx=0 tx=0).stop 2024-09-18T13:09:26.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.869+0000 7ff011e5e640 1 -- 172.21.15.78:0/1125348678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c101910 msgr2=0x7ff00c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:26.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.869+0000 7ff011e5e640 1 --2- 172.21.15.78:0/1125348678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c101910 0x7ff00c0744f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7feffc00b420 tx=0x7feffc00b8e0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.869+0000 7ff011e5e640 1 -- 172.21.15.78:0/1125348678 shutdown_connections 2024-09-18T13:09:26.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.869+0000 7ff011e5e640 1 --2- 172.21.15.78:0/1125348678 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7feff407af30 0x7feff407d3f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.869+0000 7ff011e5e640 1 --2- 172.21.15.78:0/1125348678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff00c107910 0x7ff00c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.869+0000 7ff011e5e640 1 --2- 172.21.15.78:0/1125348678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff00c101910 0x7ff00c0744f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.869+0000 7ff011e5e640 1 -- 172.21.15.78:0/1125348678 >> 172.21.15.78:0/1125348678 conn(0x7ff00c0fd630 msgr2=0x7ff00c0fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:26.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.869+0000 7ff011e5e640 1 -- 172.21.15.78:0/1125348678 shutdown_connections 2024-09-18T13:09:26.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.869+0000 7ff011e5e640 1 -- 172.21.15.78:0/1125348678 wait complete. 2024-09-18T13:09:26.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.951+0000 7fd82ee5d640 1 -- 172.21.15.78:0/2411351860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd828101900 msgr2=0x7fd828101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:26.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.951+0000 7fd82ee5d640 1 --2- 172.21.15.78:0/2411351860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd828101900 0x7fd828101d60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd818009880 tx=0x7fd81802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.951+0000 7fd82ee5d640 1 -- 172.21.15.78:0/2411351860 shutdown_connections 2024-09-18T13:09:26.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.951+0000 7fd82ee5d640 1 --2- 172.21.15.78:0/2411351860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd828101900 0x7fd828101d60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.951+0000 7fd82ee5d640 1 --2- 172.21.15.78:0/2411351860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd828107900 0x7fd828107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.951+0000 7fd82ee5d640 1 -- 172.21.15.78:0/2411351860 >> 172.21.15.78:0/2411351860 conn(0x7fd8280fd5e0 msgr2=0x7fd8280ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:26.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.951+0000 7fd82ee5d640 1 -- 172.21.15.78:0/2411351860 shutdown_connections 2024-09-18T13:09:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.951+0000 7fd82ee5d640 1 -- 172.21.15.78:0/2411351860 wait complete. 2024-09-18T13:09:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.951+0000 7fd82ee5d640 1 Processor -- start 2024-09-18T13:09:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.952+0000 7fd82ee5d640 1 -- start start 2024-09-18T13:09:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.952+0000 7fd82ee5d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd828101900 0x7fd8280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.952+0000 7fd82ee5d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd828107900 0x7fd828074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.952+0000 7fd82ee5d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd82810ee30 con 0x7fd828101900 2024-09-18T13:09:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.952+0000 7fd82ee5d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd82810ecb0 con 0x7fd828107900 2024-09-18T13:09:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.952+0000 7fd82cbf9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd828101900 0x7fd8280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.952+0000 7fd82cbf9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd828101900 0x7fd8280744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40648/0 (socket says 172.21.15.78:40648) 2024-09-18T13:09:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.952+0000 7fd82cbf9640 1 -- 172.21.15.78:0/2171551572 learned_addr learned my addr 172.21.15.78:0/2171551572 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:09:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.952+0000 7fd81ffff640 1 --2- 172.21.15.78:0/2171551572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd828107900 0x7fd828074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.952+0000 7fd82cbf9640 1 -- 172.21.15.78:0/2171551572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd828107900 msgr2=0x7fd828074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.952+0000 7fd82cbf9640 1 --2- 172.21.15.78:0/2171551572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd828107900 0x7fd828074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.952+0000 7fd82cbf9640 1 -- 172.21.15.78:0/2171551572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd828074f70 con 0x7fd828101900 2024-09-18T13:09:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.952+0000 7fd81ffff640 1 --2- 172.21.15.78:0/2171551572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd828107900 0x7fd828074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:09:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.952+0000 7fd82cbf9640 1 --2- 172.21.15.78:0/2171551572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd828101900 0x7fd8280744f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd82400b420 tx=0x7fd82400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.953+0000 7fd81dffb640 1 -- 172.21.15.78:0/2171551572 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd824011630 con 0x7fd828101900 2024-09-18T13:09:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.953+0000 7fd82ee5d640 1 -- 172.21.15.78:0/2171551572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd828075260 con 0x7fd828101900 2024-09-18T13:09:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.953+0000 7fd81dffb640 1 -- 172.21.15.78:0/2171551572 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd824016070 con 0x7fd828101900 2024-09-18T13:09:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.953+0000 7fd81dffb640 1 -- 172.21.15.78:0/2171551572 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd824010d40 con 0x7fd828101900 2024-09-18T13:09:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.953+0000 7fd82ee5d640 1 -- 172.21.15.78:0/2171551572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8281a3ea0 con 0x7fd828101900 2024-09-18T13:09:26.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.954+0000 7fd82ee5d640 1 -- 172.21.15.78:0/2171551572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd828103040 con 0x7fd828101900 2024-09-18T13:09:26.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.954+0000 7fd81dffb640 1 -- 172.21.15.78:0/2171551572 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd82401b460 con 0x7fd828101900 2024-09-18T13:09:26.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.955+0000 7fd81dffb640 1 --2- 172.21.15.78:0/2171551572 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd81007af30 0x7fd81007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:26.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.955+0000 7fd81dffb640 1 -- 172.21.15.78:0/2171551572 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fd82409d810 con 0x7fd828101900 2024-09-18T13:09:26.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.955+0000 7fd81ffff640 1 --2- 172.21.15.78:0/2171551572 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd81007af30 0x7fd81007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:26.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.956+0000 7fd81ffff640 1 --2- 172.21.15.78:0/2171551572 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd81007af30 0x7fd81007d3f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd818006010 tx=0x7fd8180095f0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:26.959+0000 7fd81dffb640 1 -- 172.21.15.78:0/2171551572 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd824021250 con 0x7fd828101900 2024-09-18T13:09:27.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.209+0000 7fd82ee5d640 1 -- 172.21.15.78:0/2171551572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd828109e90 con 0x7fd828101900 2024-09-18T13:09:27.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.210+0000 7fd81dffb640 1 -- 172.21.15.78:0/2171551572 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fd824068db0 con 0x7fd828101900 2024-09-18T13:09:27.212 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:09:27.212 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:09:27.213 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:09:27.213 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:09:27.213 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:09:27.213 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:09:27.213 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:09:27.213 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:09:27.213 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:09:27.213 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:09:27.213 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:09:27.213 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:09:27.213 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:09:27.213 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:09:27.213 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:09:27.214 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:09:27.214 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:09:27.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.212+0000 7fd82ee5d640 1 -- 172.21.15.78:0/2171551572 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd81007af30 msgr2=0x7fd81007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:27.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.212+0000 7fd82ee5d640 1 --2- 172.21.15.78:0/2171551572 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd81007af30 0x7fd81007d3f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd818006010 tx=0x7fd8180095f0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.212+0000 7fd82ee5d640 1 -- 172.21.15.78:0/2171551572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd828101900 msgr2=0x7fd8280744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:27.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.212+0000 7fd82ee5d640 1 --2- 172.21.15.78:0/2171551572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd828101900 0x7fd8280744f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd82400b420 tx=0x7fd82400b8e0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.213+0000 7fd82ee5d640 1 -- 172.21.15.78:0/2171551572 shutdown_connections 2024-09-18T13:09:27.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.213+0000 7fd82ee5d640 1 --2- 172.21.15.78:0/2171551572 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd81007af30 0x7fd81007d3f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.213+0000 7fd82ee5d640 1 --2- 172.21.15.78:0/2171551572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd828107900 0x7fd828074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.213+0000 7fd82ee5d640 1 --2- 172.21.15.78:0/2171551572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd828101900 0x7fd8280744f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.213+0000 7fd82ee5d640 1 -- 172.21.15.78:0/2171551572 >> 172.21.15.78:0/2171551572 conn(0x7fd8280fd5e0 msgr2=0x7fd8280fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:27.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.213+0000 7fd82ee5d640 1 -- 172.21.15.78:0/2171551572 shutdown_connections 2024-09-18T13:09:27.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.213+0000 7fd82ee5d640 1 -- 172.21.15.78:0/2171551572 wait complete. 2024-09-18T13:09:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.294+0000 7fd068fb5640 1 -- 172.21.15.78:0/3414422989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0641069a0 msgr2=0x7fd064106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.294+0000 7fd068fb5640 1 --2- 172.21.15.78:0/3414422989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0641069a0 0x7fd064106d80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd058009880 tx=0x7fd05802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.294+0000 7fd068fb5640 1 -- 172.21.15.78:0/3414422989 shutdown_connections 2024-09-18T13:09:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.294+0000 7fd068fb5640 1 --2- 172.21.15.78:0/3414422989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0640ffdc0 0x7fd064100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.294+0000 7fd068fb5640 1 --2- 172.21.15.78:0/3414422989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0641069a0 0x7fd064106d80 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.294+0000 7fd068fb5640 1 -- 172.21.15.78:0/3414422989 >> 172.21.15.78:0/3414422989 conn(0x7fd0640fbc90 msgr2=0x7fd0640fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.294+0000 7fd068fb5640 1 -- 172.21.15.78:0/3414422989 shutdown_connections 2024-09-18T13:09:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.294+0000 7fd068fb5640 1 -- 172.21.15.78:0/3414422989 wait complete. 2024-09-18T13:09:27.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.294+0000 7fd068fb5640 1 Processor -- start 2024-09-18T13:09:27.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.294+0000 7fd068fb5640 1 -- start start 2024-09-18T13:09:27.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd068fb5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0640ffdc0 0x7fd06419d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:27.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd068fb5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0641069a0 0x7fd06419dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:27.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd068fb5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd06410efa0 con 0x7fd0641069a0 2024-09-18T13:09:27.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd068fb5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd06410ee20 con 0x7fd0640ffdc0 2024-09-18T13:09:27.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd061d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0641069a0 0x7fd06419dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd061d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0641069a0 0x7fd06419dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40652/0 (socket says 172.21.15.78:40652) 2024-09-18T13:09:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd061d9b640 1 -- 172.21.15.78:0/386206603 learned_addr learned my addr 172.21.15.78:0/386206603 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:09:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd06259c640 1 --2- 172.21.15.78:0/386206603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0640ffdc0 0x7fd06419d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd061d9b640 1 -- 172.21.15.78:0/386206603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0640ffdc0 msgr2=0x7fd06419d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd061d9b640 1 --2- 172.21.15.78:0/386206603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0640ffdc0 0x7fd06419d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd061d9b640 1 -- 172.21.15.78:0/386206603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd064197930 con 0x7fd0641069a0 2024-09-18T13:09:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd061d9b640 1 --2- 172.21.15.78:0/386206603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0641069a0 0x7fd06419dcb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd05400b420 tx=0x7fd05400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd0537fe640 1 -- 172.21.15.78:0/386206603 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd054011630 con 0x7fd0641069a0 2024-09-18T13:09:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd0537fe640 1 -- 172.21.15.78:0/386206603 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd054016070 con 0x7fd0641069a0 2024-09-18T13:09:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd068fb5640 1 -- 172.21.15.78:0/386206603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd064197c20 con 0x7fd0641069a0 2024-09-18T13:09:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd0537fe640 1 -- 172.21.15.78:0/386206603 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd054010d40 con 0x7fd0641069a0 2024-09-18T13:09:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.295+0000 7fd068fb5640 1 -- 172.21.15.78:0/386206603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0641981b0 con 0x7fd0641069a0 2024-09-18T13:09:27.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.296+0000 7fd068fb5640 1 -- 172.21.15.78:0/386206603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0641030e0 con 0x7fd0641069a0 2024-09-18T13:09:27.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.297+0000 7fd0537fe640 1 -- 172.21.15.78:0/386206603 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd05401b460 con 0x7fd0641069a0 2024-09-18T13:09:27.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.297+0000 7fd0537fe640 1 --2- 172.21.15.78:0/386206603 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd04c07af30 0x7fd04c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:27.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.298+0000 7fd0537fe640 1 -- 172.21.15.78:0/386206603 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fd05409d7a0 con 0x7fd0641069a0 2024-09-18T13:09:27.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.298+0000 7fd06259c640 1 --2- 172.21.15.78:0/386206603 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd04c07af30 0x7fd04c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:27.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.298+0000 7fd06259c640 1 --2- 172.21.15.78:0/386206603 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd04c07af30 0x7fd04c07d3f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd058000c00 tx=0x7fd058031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:27.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.302+0000 7fd0537fe640 1 -- 172.21.15.78:0/386206603 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd054021250 con 0x7fd0641069a0 2024-09-18T13:09:27.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:27 smithi078 ceph-mon[108578]: from='client.34946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:09:27.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:27 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2171551572' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:09:27.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.513+0000 7fd068fb5640 1 -- 172.21.15.78:0/386206603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd064198e60 con 0x7fd0641069a0 2024-09-18T13:09:27.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.514+0000 7fd0537fe640 1 -- 172.21.15.78:0/386206603 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7fd054068d40 con 0x7fd0641069a0 2024-09-18T13:09:27.516 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:09:27.516 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:09:27.516 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:09:27.516 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:09:27.516 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:09:27.516 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:09:27.516 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:09:27.516 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:09:27.517 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:09:27.517 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:09:27.517 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:09:27.517 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:09:27.517 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:09:27.517 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:09:27.517 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:09:27.517 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:09:27.517 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:09:27.517 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:09:27.517 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:09:27.517 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:09:27.517 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:09:27.517 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:09:27.518 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:09:27.518 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:09:27.518 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:09:27.518 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:09:27.518 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:09:27.518 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:09:27.518 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:09:27.518 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:09:27.518 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:09:27.518 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:09:27.518 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:09:27.518 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:09:27.518 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:09:27.518 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:09:27.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:09:27.519 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:09:27.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:09:27.519 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:09:27.519 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:09:27.519 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:09:27.519 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:09:27.520 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:09:27.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.516+0000 7fd068fb5640 1 -- 172.21.15.78:0/386206603 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd04c07af30 msgr2=0x7fd04c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:27.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.516+0000 7fd068fb5640 1 --2- 172.21.15.78:0/386206603 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd04c07af30 0x7fd04c07d3f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd058000c00 tx=0x7fd058031400 comp rx=0 tx=0).stop 2024-09-18T13:09:27.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.516+0000 7fd068fb5640 1 -- 172.21.15.78:0/386206603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0641069a0 msgr2=0x7fd06419dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:27.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.516+0000 7fd068fb5640 1 --2- 172.21.15.78:0/386206603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0641069a0 0x7fd06419dcb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd05400b420 tx=0x7fd05400b8e0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.516+0000 7fd068fb5640 1 -- 172.21.15.78:0/386206603 shutdown_connections 2024-09-18T13:09:27.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.516+0000 7fd068fb5640 1 --2- 172.21.15.78:0/386206603 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fd04c07af30 0x7fd04c07d3f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.516+0000 7fd068fb5640 1 --2- 172.21.15.78:0/386206603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0641069a0 0x7fd06419dcb0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.516+0000 7fd068fb5640 1 --2- 172.21.15.78:0/386206603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0640ffdc0 0x7fd06419d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.516+0000 7fd068fb5640 1 -- 172.21.15.78:0/386206603 >> 172.21.15.78:0/386206603 conn(0x7fd0640fbc90 msgr2=0x7fd0640fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:27.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.516+0000 7fd068fb5640 1 -- 172.21.15.78:0/386206603 shutdown_connections 2024-09-18T13:09:27.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.516+0000 7fd068fb5640 1 -- 172.21.15.78:0/386206603 wait complete. 2024-09-18T13:09:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.599+0000 7fa263324640 1 -- 172.21.15.78:0/13782205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa25c106800 msgr2=0x7fa25c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.599+0000 7fa263324640 1 --2- 172.21.15.78:0/13782205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa25c106800 0x7fa25c106be0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009880 tx=0x7fa24c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.599+0000 7fa263324640 1 -- 172.21.15.78:0/13782205 shutdown_connections 2024-09-18T13:09:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.599+0000 7fa263324640 1 --2- 172.21.15.78:0/13782205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa25c100800 0x7fa25c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.599+0000 7fa263324640 1 --2- 172.21.15.78:0/13782205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa25c106800 0x7fa25c106be0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.599+0000 7fa263324640 1 -- 172.21.15.78:0/13782205 >> 172.21.15.78:0/13782205 conn(0x7fa25c0fc520 msgr2=0x7fa25c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.599+0000 7fa263324640 1 -- 172.21.15.78:0/13782205 shutdown_connections 2024-09-18T13:09:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.599+0000 7fa263324640 1 -- 172.21.15.78:0/13782205 wait complete. 2024-09-18T13:09:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.600+0000 7fa263324640 1 Processor -- start 2024-09-18T13:09:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.600+0000 7fa263324640 1 -- start start 2024-09-18T13:09:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.600+0000 7fa263324640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa25c100800 0x7fa25c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.600+0000 7fa263324640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa25c106800 0x7fa25c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.600+0000 7fa263324640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c10dcd0 con 0x7fa25c106800 2024-09-18T13:09:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.600+0000 7fa263324640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c10db50 con 0x7fa25c100800 2024-09-18T13:09:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.600+0000 7fa2608bf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa25c106800 0x7fa25c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.600+0000 7fa2608bf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa25c106800 0x7fa25c198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40678/0 (socket says 172.21.15.78:40678) 2024-09-18T13:09:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.600+0000 7fa2608bf640 1 -- 172.21.15.78:0/4018174893 learned_addr learned my addr 172.21.15.78:0/4018174893 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:09:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.600+0000 7fa2610c0640 1 --2- 172.21.15.78:0/4018174893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa25c100800 0x7fa25c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.600+0000 7fa2608bf640 1 -- 172.21.15.78:0/4018174893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa25c100800 msgr2=0x7fa25c1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.600+0000 7fa2608bf640 1 --2- 172.21.15.78:0/4018174893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa25c100800 0x7fa25c1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.600+0000 7fa2608bf640 1 -- 172.21.15.78:0/4018174893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25c199320 con 0x7fa25c106800 2024-09-18T13:09:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.600+0000 7fa2608bf640 1 --2- 172.21.15.78:0/4018174893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa25c106800 0x7fa25c198d20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa25800d6f0 tx=0x7fa25800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:27.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.601+0000 7fa2527fc640 1 -- 172.21.15.78:0/4018174893 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa258017070 con 0x7fa25c106800 2024-09-18T13:09:27.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.601+0000 7fa263324640 1 -- 172.21.15.78:0/4018174893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25c199610 con 0x7fa25c106800 2024-09-18T13:09:27.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.601+0000 7fa2527fc640 1 -- 172.21.15.78:0/4018174893 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa25800de00 con 0x7fa25c106800 2024-09-18T13:09:27.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.601+0000 7fa2527fc640 1 -- 172.21.15.78:0/4018174893 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa258004bb0 con 0x7fa25c106800 2024-09-18T13:09:27.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.601+0000 7fa263324640 1 -- 172.21.15.78:0/4018174893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa25c1a1c10 con 0x7fa25c106800 2024-09-18T13:09:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.602+0000 7fa263324640 1 -- 172.21.15.78:0/4018174893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa25c101f40 con 0x7fa25c106800 2024-09-18T13:09:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.602+0000 7fa2527fc640 1 -- 172.21.15.78:0/4018174893 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa258004e60 con 0x7fa25c106800 2024-09-18T13:09:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.603+0000 7fa2527fc640 1 --2- 172.21.15.78:0/4018174893 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa24807af30 0x7fa24807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.603+0000 7fa2527fc640 1 -- 172.21.15.78:0/4018174893 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fa25809dcb0 con 0x7fa25c106800 2024-09-18T13:09:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.603+0000 7fa2610c0640 1 --2- 172.21.15.78:0/4018174893 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa24807af30 0x7fa24807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.603+0000 7fa2610c0640 1 --2- 172.21.15.78:0/4018174893 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa24807af30 0x7fa24807d3f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0096c0 tx=0x7fa24c031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:27.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.607+0000 7fa2527fc640 1 -- 172.21.15.78:0/4018174893 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa25c199610 con 0x7fa25c106800 2024-09-18T13:09:27.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:27 smithi148 ceph-mon[80030]: from='client.34946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:09:27.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:27 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2171551572' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:09:27.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.799+0000 7fa263324640 1 -- 172.21.15.78:0/4018174893 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa25c062630 con 0x7fa24807af30 2024-09-18T13:09:27.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.800+0000 7fa2527fc640 1 -- 172.21.15.78:0/4018174893 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa25c062630 con 0x7fa24807af30 2024-09-18T13:09:27.802 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:09:27.802 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:09:27.802 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:09:27.803 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:09:27.803 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:09:27.803 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:09:27.803 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:09:27.803 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:09:27.803 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:09:27.803 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:09:27.803 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:09:27.803 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:09:27.803 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:09:27.803 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:09:27.803 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:09:27.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.802+0000 7fa263324640 1 -- 172.21.15.78:0/4018174893 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa24807af30 msgr2=0x7fa24807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.802+0000 7fa263324640 1 --2- 172.21.15.78:0/4018174893 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa24807af30 0x7fa24807d3f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0096c0 tx=0x7fa24c031400 comp rx=0 tx=0).stop 2024-09-18T13:09:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.802+0000 7fa263324640 1 -- 172.21.15.78:0/4018174893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa25c106800 msgr2=0x7fa25c198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.802+0000 7fa263324640 1 --2- 172.21.15.78:0/4018174893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa25c106800 0x7fa25c198d20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa25800d6f0 tx=0x7fa25800dbb0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.802+0000 7fa263324640 1 -- 172.21.15.78:0/4018174893 shutdown_connections 2024-09-18T13:09:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.802+0000 7fa263324640 1 --2- 172.21.15.78:0/4018174893 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa24807af30 0x7fa24807d3f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.802+0000 7fa263324640 1 --2- 172.21.15.78:0/4018174893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa25c106800 0x7fa25c198d20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.802+0000 7fa263324640 1 --2- 172.21.15.78:0/4018174893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa25c100800 0x7fa25c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.802+0000 7fa263324640 1 -- 172.21.15.78:0/4018174893 >> 172.21.15.78:0/4018174893 conn(0x7fa25c0fc520 msgr2=0x7fa25c0fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.802+0000 7fa263324640 1 -- 172.21.15.78:0/4018174893 shutdown_connections 2024-09-18T13:09:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.802+0000 7fa263324640 1 -- 172.21.15.78:0/4018174893 wait complete. 2024-09-18T13:09:27.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.883+0000 7ff506db4640 1 -- 172.21.15.78:0/3095524966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5001007f0 msgr2=0x7ff500100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:27.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.883+0000 7ff506db4640 1 --2- 172.21.15.78:0/3095524966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5001007f0 0x7ff500100c50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009880 tx=0x7ff4ec02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.884+0000 7ff506db4640 1 -- 172.21.15.78:0/3095524966 shutdown_connections 2024-09-18T13:09:27.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.884+0000 7ff506db4640 1 --2- 172.21.15.78:0/3095524966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5001007f0 0x7ff500100c50 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.884+0000 7ff506db4640 1 --2- 172.21.15.78:0/3095524966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5001067f0 0x7ff500106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.884+0000 7ff506db4640 1 -- 172.21.15.78:0/3095524966 >> 172.21.15.78:0/3095524966 conn(0x7ff5000fc550 msgr2=0x7ff5000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:27.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.884+0000 7ff506db4640 1 -- 172.21.15.78:0/3095524966 shutdown_connections 2024-09-18T13:09:27.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.884+0000 7ff506db4640 1 -- 172.21.15.78:0/3095524966 wait complete. 2024-09-18T13:09:27.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.884+0000 7ff506db4640 1 Processor -- start 2024-09-18T13:09:27.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.884+0000 7ff506db4640 1 -- start start 2024-09-18T13:09:27.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.884+0000 7ff506db4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5001007f0 0x7ff50019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:27.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.884+0000 7ff506db4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5001067f0 0x7ff50019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:27.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.884+0000 7ff506db4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff50010dca0 con 0x7ff5001067f0 2024-09-18T13:09:27.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.884+0000 7ff506db4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff50010db20 con 0x7ff5001007f0 2024-09-18T13:09:27.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.885+0000 7ff4fffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5001067f0 0x7ff50019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:27.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.885+0000 7ff4fffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5001067f0 0x7ff50019db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40696/0 (socket says 172.21.15.78:40696) 2024-09-18T13:09:27.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.885+0000 7ff4fffff640 1 -- 172.21.15.78:0/2164581963 learned_addr learned my addr 172.21.15.78:0/2164581963 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:09:27.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.885+0000 7ff504b50640 1 --2- 172.21.15.78:0/2164581963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5001007f0 0x7ff50019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:27.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.885+0000 7ff4fffff640 1 -- 172.21.15.78:0/2164581963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5001007f0 msgr2=0x7ff50019d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:27.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.885+0000 7ff4fffff640 1 --2- 172.21.15.78:0/2164581963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5001007f0 0x7ff50019d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:27.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.885+0000 7ff4fffff640 1 -- 172.21.15.78:0/2164581963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff500197780 con 0x7ff5001067f0 2024-09-18T13:09:27.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.885+0000 7ff504b50640 1 --2- 172.21.15.78:0/2164581963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5001007f0 0x7ff50019d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:09:27.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.885+0000 7ff4fffff640 1 --2- 172.21.15.78:0/2164581963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5001067f0 0x7ff50019db40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec031460 tx=0x7ff4ec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:27.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.885+0000 7ff4fdffb640 1 -- 172.21.15.78:0/2164581963 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4ec03f070 con 0x7ff5001067f0 2024-09-18T13:09:27.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.885+0000 7ff4fdffb640 1 -- 172.21.15.78:0/2164581963 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4ec004cf0 con 0x7ff5001067f0 2024-09-18T13:09:27.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.885+0000 7ff4fdffb640 1 -- 172.21.15.78:0/2164581963 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4ec035030 con 0x7ff5001067f0 2024-09-18T13:09:27.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.885+0000 7ff506db4640 1 -- 172.21.15.78:0/2164581963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff500197a10 con 0x7ff5001067f0 2024-09-18T13:09:27.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.885+0000 7ff506db4640 1 -- 172.21.15.78:0/2164581963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff500197f40 con 0x7ff5001067f0 2024-09-18T13:09:27.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.886+0000 7ff506db4640 1 -- 172.21.15.78:0/2164581963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff500101f30 con 0x7ff5001067f0 2024-09-18T13:09:27.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.887+0000 7ff4fdffb640 1 -- 172.21.15.78:0/2164581963 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff4ec042070 con 0x7ff5001067f0 2024-09-18T13:09:27.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.887+0000 7ff4fdffb640 1 --2- 172.21.15.78:0/2164581963 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff4f007af80 0x7ff4f007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:27.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.888+0000 7ff4fdffb640 1 -- 172.21.15.78:0/2164581963 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7ff4ec0beae0 con 0x7ff5001067f0 2024-09-18T13:09:27.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.888+0000 7ff504b50640 1 --2- 172.21.15.78:0/2164581963 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff4f007af80 0x7ff4f007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:27.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.888+0000 7ff504b50640 1 --2- 172.21.15.78:0/2164581963 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff4f007af80 0x7ff4f007d440 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400baa0 tx=0x7ff4f4005d90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:27.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:27.892+0000 7ff4fdffb640 1 -- 172.21.15.78:0/2164581963 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff4ec08a060 con 0x7ff5001067f0 2024-09-18T13:09:28.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:28.133+0000 7ff506db4640 1 -- 172.21.15.78:0/2164581963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff500198cb0 con 0x7ff5001067f0 2024-09-18T13:09:28.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:28.134+0000 7ff4fdffb640 1 -- 172.21.15.78:0/2164581963 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7ff4ec08ef10 con 0x7ff5001067f0 2024-09-18T13:09:28.136 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:09:28.136 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:09:28.136 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:09:28.137 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:09:28.137 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:09:28.137 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:09:28.137 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:09:28.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:28.136+0000 7ff506db4640 1 -- 172.21.15.78:0/2164581963 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff4f007af80 msgr2=0x7ff4f007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:28.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:28.136+0000 7ff506db4640 1 --2- 172.21.15.78:0/2164581963 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff4f007af80 0x7ff4f007d440 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400baa0 tx=0x7ff4f4005d90 comp rx=0 tx=0).stop 2024-09-18T13:09:28.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:28.136+0000 7ff506db4640 1 -- 172.21.15.78:0/2164581963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5001067f0 msgr2=0x7ff50019db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:28.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:28.136+0000 7ff506db4640 1 --2- 172.21.15.78:0/2164581963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5001067f0 0x7ff50019db40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec031460 tx=0x7ff4ec0048f0 comp rx=0 tx=0).stop 2024-09-18T13:09:28.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:28.136+0000 7ff506db4640 1 -- 172.21.15.78:0/2164581963 shutdown_connections 2024-09-18T13:09:28.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:28.136+0000 7ff506db4640 1 --2- 172.21.15.78:0/2164581963 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff4f007af80 0x7ff4f007d440 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:28.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:28.136+0000 7ff506db4640 1 --2- 172.21.15.78:0/2164581963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5001067f0 0x7ff50019db40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:28.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:28.136+0000 7ff506db4640 1 --2- 172.21.15.78:0/2164581963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5001007f0 0x7ff50019d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:28.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:28.136+0000 7ff506db4640 1 -- 172.21.15.78:0/2164581963 >> 172.21.15.78:0/2164581963 conn(0x7ff5000fc550 msgr2=0x7ff500069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:28.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:28.136+0000 7ff506db4640 1 -- 172.21.15.78:0/2164581963 shutdown_connections 2024-09-18T13:09:28.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:28.136+0000 7ff506db4640 1 -- 172.21.15.78:0/2164581963 wait complete. 2024-09-18T13:09:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:28 smithi078 ceph-mon[108578]: from='client.34950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:09:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:28 smithi078 ceph-mon[108578]: from='client.34954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:09:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:28 smithi078 ceph-mon[108578]: pgmap v609: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:28 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/386206603' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:09:28.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:28 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2164581963' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:09:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:28 smithi148 ceph-mon[80030]: from='client.34950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:09:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:28 smithi148 ceph-mon[80030]: from='client.34954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:09:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:28 smithi148 ceph-mon[80030]: pgmap v609: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:28 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/386206603' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:09:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:28 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2164581963' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:09:29.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:29 smithi148 ceph-mon[80030]: from='client.34966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:09:29.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:29 smithi078 ceph-mon[108578]: from='client.34966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:09:30.709 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:30 smithi078 ceph-mon[108578]: pgmap v610: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:30 smithi148 ceph-mon[80030]: pgmap v610: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:32.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:32 smithi148 ceph-mon[80030]: pgmap v611: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:32 smithi078 ceph-mon[108578]: pgmap v611: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:34 smithi148 ceph-mon[80030]: pgmap v612: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:34 smithi078 ceph-mon[108578]: pgmap v612: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:36.709 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:36 smithi078 ceph-mon[108578]: pgmap v613: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:36 smithi148 ceph-mon[80030]: pgmap v613: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:38.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:38 smithi148 ceph-mon[80030]: pgmap v614: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:38.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:38 smithi078 ceph-mon[108578]: pgmap v614: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:40 smithi148 ceph-mon[80030]: pgmap v615: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:40 smithi078 ceph-mon[108578]: pgmap v615: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:09:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:09:42.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:42 smithi078 ceph-mon[108578]: pgmap v616: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:42.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:42 smithi148 ceph-mon[80030]: pgmap v616: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:44 smithi148 ceph-mon[80030]: pgmap v617: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:44.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:44 smithi078 ceph-mon[108578]: pgmap v617: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:46 smithi148 ceph-mon[80030]: pgmap v618: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:46.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:46 smithi078 ceph-mon[108578]: pgmap v618: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:48.713 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:48 smithi078 ceph-mon[108578]: pgmap v619: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:48.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:48 smithi148 ceph-mon[80030]: pgmap v619: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:50 smithi148 ceph-mon[80030]: pgmap v620: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:50 smithi078 ceph-mon[108578]: pgmap v620: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:52 smithi148 ceph-mon[80030]: pgmap v621: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:52.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:52 smithi078 ceph-mon[108578]: pgmap v621: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:54.704 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:54 smithi078 ceph-mon[108578]: pgmap v622: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:54.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:54 smithi148 ceph-mon[80030]: pgmap v622: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:56 smithi148 ceph-mon[80030]: pgmap v623: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:09:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:56 smithi078 ceph-mon[108578]: pgmap v623: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:09:58.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.231+0000 7f96835a0640 1 -- 172.21.15.78:0/576505528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f967c107900 msgr2=0x7f967c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:58.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.231+0000 7f96835a0640 1 --2- 172.21.15.78:0/576505528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f967c107900 0x7f967c107ce0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9678009880 tx=0x7f967802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.231+0000 7f96835a0640 1 -- 172.21.15.78:0/576505528 shutdown_connections 2024-09-18T13:09:58.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.231+0000 7f96835a0640 1 --2- 172.21.15.78:0/576505528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c101900 0x7f967c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.231+0000 7f96835a0640 1 --2- 172.21.15.78:0/576505528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f967c107900 0x7f967c107ce0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.231+0000 7f96835a0640 1 -- 172.21.15.78:0/576505528 >> 172.21.15.78:0/576505528 conn(0x7f967c0fd600 msgr2=0x7f967c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:58.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.231+0000 7f96835a0640 1 -- 172.21.15.78:0/576505528 shutdown_connections 2024-09-18T13:09:58.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.232+0000 7f96835a0640 1 -- 172.21.15.78:0/576505528 wait complete. 2024-09-18T13:09:58.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.232+0000 7f96835a0640 1 Processor -- start 2024-09-18T13:09:58.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.232+0000 7f96835a0640 1 -- start start 2024-09-18T13:09:58.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.232+0000 7f96835a0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f967c101900 0x7f967c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:58.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.232+0000 7f96835a0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c107900 0x7f967c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:58.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.232+0000 7f96835a0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f967c10edd0 con 0x7f967c101900 2024-09-18T13:09:58.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.232+0000 7f96835a0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f967c10ec50 con 0x7f967c107900 2024-09-18T13:09:58.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.233+0000 7f968133c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f967c101900 0x7f967c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:58.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.233+0000 7f968133c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f967c101900 0x7f967c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50708/0 (socket says 172.21.15.78:50708) 2024-09-18T13:09:58.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.233+0000 7f968133c640 1 -- 172.21.15.78:0/3598333329 learned_addr learned my addr 172.21.15.78:0/3598333329 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:09:58.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.233+0000 7f9680b3b640 1 --2- 172.21.15.78:0/3598333329 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c107900 0x7f967c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:58.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.233+0000 7f968133c640 1 -- 172.21.15.78:0/3598333329 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c107900 msgr2=0x7f967c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:58.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.233+0000 7f968133c640 1 --2- 172.21.15.78:0/3598333329 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c107900 0x7f967c19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.233+0000 7f968133c640 1 -- 172.21.15.78:0/3598333329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f967c1977c0 con 0x7f967c101900 2024-09-18T13:09:58.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.233+0000 7f9680b3b640 1 --2- 172.21.15.78:0/3598333329 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c107900 0x7f967c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:09:58.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.233+0000 7f968133c640 1 --2- 172.21.15.78:0/3598333329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f967c101900 0x7f967c19d640 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9678031460 tx=0x7f96780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:58.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.233+0000 7f96727fc640 1 -- 172.21.15.78:0/3598333329 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f967803f070 con 0x7f967c101900 2024-09-18T13:09:58.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.233+0000 7f96727fc640 1 -- 172.21.15.78:0/3598333329 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9678004b10 con 0x7f967c101900 2024-09-18T13:09:58.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.233+0000 7f96835a0640 1 -- 172.21.15.78:0/3598333329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f967c197a50 con 0x7f967c101900 2024-09-18T13:09:58.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.233+0000 7f96727fc640 1 -- 172.21.15.78:0/3598333329 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9678035030 con 0x7f967c101900 2024-09-18T13:09:58.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.233+0000 7f96835a0640 1 -- 172.21.15.78:0/3598333329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f967c197f80 con 0x7f967c101900 2024-09-18T13:09:58.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.235+0000 7f96835a0640 1 -- 172.21.15.78:0/3598333329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f967c103040 con 0x7f967c101900 2024-09-18T13:09:58.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.235+0000 7f96727fc640 1 -- 172.21.15.78:0/3598333329 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9678042070 con 0x7f967c101900 2024-09-18T13:09:58.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.236+0000 7f96727fc640 1 --2- 172.21.15.78:0/3598333329 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f966807af40 0x7f966807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:58.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.236+0000 7f9680b3b640 1 --2- 172.21.15.78:0/3598333329 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f966807af40 0x7f966807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:58.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.236+0000 7f96727fc640 1 -- 172.21.15.78:0/3598333329 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f96780bebc0 con 0x7f967c101900 2024-09-18T13:09:58.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.236+0000 7f9680b3b640 1 --2- 172.21.15.78:0/3598333329 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f966807af40 0x7f966807d400 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f966c0058c0 tx=0x7f966c005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:58.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.240+0000 7f96727fc640 1 -- 172.21.15.78:0/3598333329 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f967808a160 con 0x7f967c101900 2024-09-18T13:09:58.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.432+0000 7f96835a0640 1 -- 172.21.15.78:0/3598333329 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f967c198230 con 0x7f966807af40 2024-09-18T13:09:58.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.433+0000 7f96727fc640 1 -- 172.21.15.78:0/3598333329 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f967c198230 con 0x7f966807af40 2024-09-18T13:09:58.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.435+0000 7f96835a0640 1 -- 172.21.15.78:0/3598333329 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f966807af40 msgr2=0x7f966807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:58.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.435+0000 7f96835a0640 1 --2- 172.21.15.78:0/3598333329 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f966807af40 0x7f966807d400 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f966c0058c0 tx=0x7f966c005850 comp rx=0 tx=0).stop 2024-09-18T13:09:58.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.435+0000 7f96835a0640 1 -- 172.21.15.78:0/3598333329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f967c101900 msgr2=0x7f967c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:58.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.435+0000 7f96835a0640 1 --2- 172.21.15.78:0/3598333329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f967c101900 0x7f967c19d640 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9678031460 tx=0x7f96780045e0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.435+0000 7f96835a0640 1 -- 172.21.15.78:0/3598333329 shutdown_connections 2024-09-18T13:09:58.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.436+0000 7f96835a0640 1 --2- 172.21.15.78:0/3598333329 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f966807af40 0x7f966807d400 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.436+0000 7f96835a0640 1 --2- 172.21.15.78:0/3598333329 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c107900 0x7f967c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.436+0000 7f96835a0640 1 --2- 172.21.15.78:0/3598333329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f967c101900 0x7f967c19d640 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.436+0000 7f96835a0640 1 -- 172.21.15.78:0/3598333329 >> 172.21.15.78:0/3598333329 conn(0x7f967c0fd600 msgr2=0x7f967c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:58.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.436+0000 7f96835a0640 1 -- 172.21.15.78:0/3598333329 shutdown_connections 2024-09-18T13:09:58.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.436+0000 7f96835a0640 1 -- 172.21.15.78:0/3598333329 wait complete. 2024-09-18T13:09:58.446 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:09:58.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:58 smithi078 ceph-mon[108578]: pgmap v624: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:58.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.521+0000 7f1747d3e640 1 -- 172.21.15.78:0/1089329792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1740106800 msgr2=0x7f1740106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:58.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.521+0000 7f1747d3e640 1 --2- 172.21.15.78:0/1089329792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1740106800 0x7f1740106be0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1738009880 tx=0x7f173802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.521+0000 7f1747d3e640 1 -- 172.21.15.78:0/1089329792 shutdown_connections 2024-09-18T13:09:58.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.521+0000 7f1747d3e640 1 --2- 172.21.15.78:0/1089329792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1740100800 0x7f1740100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.521+0000 7f1747d3e640 1 --2- 172.21.15.78:0/1089329792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1740106800 0x7f1740106be0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.521+0000 7f1747d3e640 1 -- 172.21.15.78:0/1089329792 >> 172.21.15.78:0/1089329792 conn(0x7f17400fc520 msgr2=0x7f17400fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:58.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.521+0000 7f1747d3e640 1 -- 172.21.15.78:0/1089329792 shutdown_connections 2024-09-18T13:09:58.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.521+0000 7f1747d3e640 1 -- 172.21.15.78:0/1089329792 wait complete. 2024-09-18T13:09:58.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.521+0000 7f1747d3e640 1 Processor -- start 2024-09-18T13:09:58.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.521+0000 7f1747d3e640 1 -- start start 2024-09-18T13:09:58.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.522+0000 7f1747d3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1740100800 0x7f1740198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:58.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.522+0000 7f1747d3e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1740106800 0x7f1740198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:58.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.522+0000 7f1747d3e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f174010dd30 con 0x7f1740100800 2024-09-18T13:09:58.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.522+0000 7f1747d3e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f174010dbb0 con 0x7f1740106800 2024-09-18T13:09:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.522+0000 7f1745ada640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1740100800 0x7f1740198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.522+0000 7f1745ada640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1740100800 0x7f1740198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50736/0 (socket says 172.21.15.78:50736) 2024-09-18T13:09:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.522+0000 7f1745ada640 1 -- 172.21.15.78:0/4090430888 learned_addr learned my addr 172.21.15.78:0/4090430888 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:09:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.522+0000 7f17452d9640 1 --2- 172.21.15.78:0/4090430888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1740106800 0x7f1740198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.522+0000 7f1745ada640 1 -- 172.21.15.78:0/4090430888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1740106800 msgr2=0x7f1740198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.522+0000 7f1745ada640 1 --2- 172.21.15.78:0/4090430888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1740106800 0x7f1740198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.522+0000 7f1745ada640 1 -- 172.21.15.78:0/4090430888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17401993b0 con 0x7f1740100800 2024-09-18T13:09:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.522+0000 7f1745ada640 1 --2- 172.21.15.78:0/4090430888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1740100800 0x7f1740198870 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1738031460 tx=0x7f17380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.522+0000 7f173effd640 1 -- 172.21.15.78:0/4090430888 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f173803f070 con 0x7f1740100800 2024-09-18T13:09:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.523+0000 7f1747d3e640 1 -- 172.21.15.78:0/4090430888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1740199640 con 0x7f1740100800 2024-09-18T13:09:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.523+0000 7f173effd640 1 -- 172.21.15.78:0/4090430888 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1738004cf0 con 0x7f1740100800 2024-09-18T13:09:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.523+0000 7f173effd640 1 -- 172.21.15.78:0/4090430888 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1738035030 con 0x7f1740100800 2024-09-18T13:09:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.523+0000 7f1747d3e640 1 -- 172.21.15.78:0/4090430888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17401a1bf0 con 0x7f1740100800 2024-09-18T13:09:58.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.524+0000 7f1747d3e640 1 -- 172.21.15.78:0/4090430888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1740101f40 con 0x7f1740100800 2024-09-18T13:09:58.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.524+0000 7f173effd640 1 -- 172.21.15.78:0/4090430888 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1738042070 con 0x7f1740100800 2024-09-18T13:09:58.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.525+0000 7f173effd640 1 --2- 172.21.15.78:0/4090430888 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f172807af30 0x7f172807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:58.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.525+0000 7f173effd640 1 -- 172.21.15.78:0/4090430888 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f17380beb60 con 0x7f1740100800 2024-09-18T13:09:58.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.525+0000 7f17452d9640 1 --2- 172.21.15.78:0/4090430888 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f172807af30 0x7f172807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:58.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.525+0000 7f17452d9640 1 --2- 172.21.15.78:0/4090430888 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f172807af30 0x7f172807d3f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f174006ad00 tx=0x7f1734008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:58.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.529+0000 7f173effd640 1 -- 172.21.15.78:0/4090430888 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f173808a100 con 0x7f1740100800 2024-09-18T13:09:58.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.720+0000 7f1747d3e640 1 -- 172.21.15.78:0/4090430888 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1740062630 con 0x7f172807af30 2024-09-18T13:09:58.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.721+0000 7f173effd640 1 -- 172.21.15.78:0/4090430888 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f1740062630 con 0x7f172807af30 2024-09-18T13:09:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:58 smithi148 ceph-mon[80030]: pgmap v624: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:09:58.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.723+0000 7f1747d3e640 1 -- 172.21.15.78:0/4090430888 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f172807af30 msgr2=0x7f172807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:58.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.723+0000 7f1747d3e640 1 --2- 172.21.15.78:0/4090430888 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f172807af30 0x7f172807d3f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f174006ad00 tx=0x7f1734008040 comp rx=0 tx=0).stop 2024-09-18T13:09:58.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.723+0000 7f1747d3e640 1 -- 172.21.15.78:0/4090430888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1740100800 msgr2=0x7f1740198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:58.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.723+0000 7f1747d3e640 1 --2- 172.21.15.78:0/4090430888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1740100800 0x7f1740198870 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1738031460 tx=0x7f17380048f0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.724+0000 7f1747d3e640 1 -- 172.21.15.78:0/4090430888 shutdown_connections 2024-09-18T13:09:58.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.724+0000 7f1747d3e640 1 --2- 172.21.15.78:0/4090430888 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f172807af30 0x7f172807d3f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.724+0000 7f1747d3e640 1 --2- 172.21.15.78:0/4090430888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1740106800 0x7f1740198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.724+0000 7f1747d3e640 1 --2- 172.21.15.78:0/4090430888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1740100800 0x7f1740198870 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.724+0000 7f1747d3e640 1 -- 172.21.15.78:0/4090430888 >> 172.21.15.78:0/4090430888 conn(0x7f17400fc520 msgr2=0x7f17400fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:58.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.724+0000 7f1747d3e640 1 -- 172.21.15.78:0/4090430888 shutdown_connections 2024-09-18T13:09:58.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.724+0000 7f1747d3e640 1 -- 172.21.15.78:0/4090430888 wait complete. 2024-09-18T13:09:58.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.804+0000 7f33e1707640 1 -- 172.21.15.78:0/2794830671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33dc1067f0 msgr2=0x7f33dc106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:58.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.804+0000 7f33e1707640 1 --2- 172.21.15.78:0/2794830671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33dc1067f0 0x7f33dc106bd0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009880 tx=0x7f33cc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.805+0000 7f33e1707640 1 -- 172.21.15.78:0/2794830671 shutdown_connections 2024-09-18T13:09:58.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.805+0000 7f33e1707640 1 --2- 172.21.15.78:0/2794830671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33dc1007f0 0x7f33dc100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.805+0000 7f33e1707640 1 --2- 172.21.15.78:0/2794830671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33dc1067f0 0x7f33dc106bd0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.805+0000 7f33e1707640 1 -- 172.21.15.78:0/2794830671 >> 172.21.15.78:0/2794830671 conn(0x7f33dc0fc550 msgr2=0x7f33dc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.805+0000 7f33e1707640 1 -- 172.21.15.78:0/2794830671 shutdown_connections 2024-09-18T13:09:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.805+0000 7f33e1707640 1 -- 172.21.15.78:0/2794830671 wait complete. 2024-09-18T13:09:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.805+0000 7f33e1707640 1 Processor -- start 2024-09-18T13:09:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.806+0000 7f33e1707640 1 -- start start 2024-09-18T13:09:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.806+0000 7f33e1707640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33dc1007f0 0x7f33dc198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.806+0000 7f33e1707640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33dc1067f0 0x7f33dc198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.806+0000 7f33e1707640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc10dcc0 con 0x7f33dc1067f0 2024-09-18T13:09:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.806+0000 7f33e1707640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc10db40 con 0x7f33dc1007f0 2024-09-18T13:09:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.806+0000 7f33d27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33dc1067f0 0x7f33dc198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.806+0000 7f33d27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33dc1067f0 0x7f33dc198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50760/0 (socket says 172.21.15.78:50760) 2024-09-18T13:09:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.806+0000 7f33d27fc640 1 -- 172.21.15.78:0/804661997 learned_addr learned my addr 172.21.15.78:0/804661997 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:09:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.806+0000 7f33daffd640 1 --2- 172.21.15.78:0/804661997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33dc1007f0 0x7f33dc198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.806+0000 7f33d27fc640 1 -- 172.21.15.78:0/804661997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33dc1007f0 msgr2=0x7f33dc198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.806+0000 7f33d27fc640 1 --2- 172.21.15.78:0/804661997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33dc1007f0 0x7f33dc198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.806+0000 7f33d27fc640 1 -- 172.21.15.78:0/804661997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33dc199350 con 0x7f33dc1067f0 2024-09-18T13:09:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.806+0000 7f33daffd640 1 --2- 172.21.15.78:0/804661997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33dc1007f0 0x7f33dc198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:09:58.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.807+0000 7f33d27fc640 1 --2- 172.21.15.78:0/804661997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33dc1067f0 0x7f33dc198d50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f33c400d6f0 tx=0x7f33c400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:58.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.807+0000 7f33d8ff9640 1 -- 172.21.15.78:0/804661997 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f33c4017070 con 0x7f33dc1067f0 2024-09-18T13:09:58.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.807+0000 7f33e1707640 1 -- 172.21.15.78:0/804661997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33dc199640 con 0x7f33dc1067f0 2024-09-18T13:09:58.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.807+0000 7f33d8ff9640 1 -- 172.21.15.78:0/804661997 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f33c400de00 con 0x7f33dc1067f0 2024-09-18T13:09:58.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.807+0000 7f33d8ff9640 1 -- 172.21.15.78:0/804661997 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f33c4004bb0 con 0x7f33dc1067f0 2024-09-18T13:09:58.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.807+0000 7f33e1707640 1 -- 172.21.15.78:0/804661997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33dc1a1c40 con 0x7f33dc1067f0 2024-09-18T13:09:58.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.808+0000 7f33e1707640 1 -- 172.21.15.78:0/804661997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33bc005290 con 0x7f33dc1067f0 2024-09-18T13:09:58.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.809+0000 7f33d8ff9640 1 -- 172.21.15.78:0/804661997 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f33c4009a30 con 0x7f33dc1067f0 2024-09-18T13:09:58.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.809+0000 7f33d8ff9640 1 --2- 172.21.15.78:0/804661997 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f33c807af80 0x7f33c807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:58.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.809+0000 7f33d8ff9640 1 -- 172.21.15.78:0/804661997 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f33c409daf0 con 0x7f33dc1067f0 2024-09-18T13:09:58.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.809+0000 7f33daffd640 1 --2- 172.21.15.78:0/804661997 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f33c807af80 0x7f33c807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.810+0000 7f33daffd640 1 --2- 172.21.15.78:0/804661997 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f33c807af80 0x7f33c807d440 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f33cc000c00 tx=0x7f33cc031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:58.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.813+0000 7f33d8ff9640 1 -- 172.21.15.78:0/804661997 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f33dc199640 con 0x7f33dc1067f0 2024-09-18T13:09:59.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:58.997+0000 7f33e1707640 1 -- 172.21.15.78:0/804661997 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f33bc000bc0 con 0x7f33c807af80 2024-09-18T13:09:59.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.006+0000 7f33d8ff9640 1 -- 172.21.15.78:0/804661997 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f33bc000bc0 con 0x7f33c807af80 2024-09-18T13:09:59.008 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:09:59.008 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (17m) 12m ago 28m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:09:59.008 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (20m) 12m ago 28m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:09:59.008 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (20m) 11m ago 28m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:09:59.008 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (16m) 12m ago 28m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:09:59.008 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (15m) 11m ago 28m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:09:59.008 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (17m) 12m ago 28m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:09:59.008 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (12m) 12m ago 23m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:09:59.008 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (12m) 12m ago 23m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:09:59.008 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (11m) 11m ago 23m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:09:59.008 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (11m) 11m ago 23m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:09:59.009 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (20m) 12m ago 30m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:09:59.009 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (18m) 11m ago 27m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:09:59.009 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (16m) 12m ago 30m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:09:59.009 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (16m) 11m ago 27m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:09:59.009 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (18m) 12m ago 28m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:09:59.009 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (18m) 11m ago 28m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:09:59.009 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (15m) 12m ago 26m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:09:59.009 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (15m) 12m ago 26m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:09:59.009 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (14m) 12m ago 25m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:09:59.009 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (13m) 11m ago 25m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:09:59.009 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (13m) 11m ago 24m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:09:59.009 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (12m) 11m ago 24m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:09:59.009 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (18m) 12m ago 28m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:09:59.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.009+0000 7f33e1707640 1 -- 172.21.15.78:0/804661997 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f33c807af80 msgr2=0x7f33c807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:59.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.009+0000 7f33e1707640 1 --2- 172.21.15.78:0/804661997 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f33c807af80 0x7f33c807d440 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f33cc000c00 tx=0x7f33cc031400 comp rx=0 tx=0).stop 2024-09-18T13:09:59.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.009+0000 7f33e1707640 1 -- 172.21.15.78:0/804661997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33dc1067f0 msgr2=0x7f33dc198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:59.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.009+0000 7f33e1707640 1 --2- 172.21.15.78:0/804661997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33dc1067f0 0x7f33dc198d50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f33c400d6f0 tx=0x7f33c400dbb0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.009+0000 7f33e1707640 1 -- 172.21.15.78:0/804661997 shutdown_connections 2024-09-18T13:09:59.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.009+0000 7f33e1707640 1 --2- 172.21.15.78:0/804661997 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f33c807af80 0x7f33c807d440 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.009+0000 7f33e1707640 1 --2- 172.21.15.78:0/804661997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33dc1067f0 0x7f33dc198d50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.009+0000 7f33e1707640 1 --2- 172.21.15.78:0/804661997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33dc1007f0 0x7f33dc198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.009+0000 7f33e1707640 1 -- 172.21.15.78:0/804661997 >> 172.21.15.78:0/804661997 conn(0x7f33dc0fc550 msgr2=0x7f33dc0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:59.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.009+0000 7f33e1707640 1 -- 172.21.15.78:0/804661997 shutdown_connections 2024-09-18T13:09:59.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.009+0000 7f33e1707640 1 -- 172.21.15.78:0/804661997 wait complete. 2024-09-18T13:09:59.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.089+0000 7f7a15b67640 1 -- 172.21.15.78:0/4211351417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a10101900 msgr2=0x7f7a10101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:59.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.089+0000 7f7a15b67640 1 --2- 172.21.15.78:0/4211351417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a10101900 0x7f7a10101d60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009880 tx=0x7f79f802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.089+0000 7f7a15b67640 1 -- 172.21.15.78:0/4211351417 shutdown_connections 2024-09-18T13:09:59.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.089+0000 7f7a15b67640 1 --2- 172.21.15.78:0/4211351417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a10101900 0x7f7a10101d60 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.089+0000 7f7a15b67640 1 --2- 172.21.15.78:0/4211351417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a10107900 0x7f7a10107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.089+0000 7f7a15b67640 1 -- 172.21.15.78:0/4211351417 >> 172.21.15.78:0/4211351417 conn(0x7f7a100fd5e0 msgr2=0x7f7a100ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:59.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.089+0000 7f7a15b67640 1 -- 172.21.15.78:0/4211351417 shutdown_connections 2024-09-18T13:09:59.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.089+0000 7f7a15b67640 1 -- 172.21.15.78:0/4211351417 wait complete. 2024-09-18T13:09:59.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.090+0000 7f7a15b67640 1 Processor -- start 2024-09-18T13:09:59.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.090+0000 7f7a15b67640 1 -- start start 2024-09-18T13:09:59.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.090+0000 7f7a15b67640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a10101900 0x7f7a100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:59.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.090+0000 7f7a15b67640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a10107900 0x7f7a10074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:59.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.090+0000 7f7a15b67640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1010edd0 con 0x7f7a10107900 2024-09-18T13:09:59.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.090+0000 7f7a15b67640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1010ec50 con 0x7f7a10101900 2024-09-18T13:09:59.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.090+0000 7f7a07fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a10107900 0x7f7a10074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:59.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.090+0000 7f7a07fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a10107900 0x7f7a10074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50766/0 (socket says 172.21.15.78:50766) 2024-09-18T13:09:59.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.090+0000 7f7a07fff640 1 -- 172.21.15.78:0/2735791433 learned_addr learned my addr 172.21.15.78:0/2735791433 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:09:59.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.090+0000 7f7a0f7fe640 1 --2- 172.21.15.78:0/2735791433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a10101900 0x7f7a100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:59.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.090+0000 7f7a07fff640 1 -- 172.21.15.78:0/2735791433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a10101900 msgr2=0x7f7a100744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:59.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.090+0000 7f7a07fff640 1 --2- 172.21.15.78:0/2735791433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a10101900 0x7f7a100744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.090+0000 7f7a07fff640 1 -- 172.21.15.78:0/2735791433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a10074f70 con 0x7f7a10107900 2024-09-18T13:09:59.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.090+0000 7f7a07fff640 1 --2- 172.21.15.78:0/2735791433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a10107900 0x7f7a10074a30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f79f8031460 tx=0x7f79f80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:59.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.091+0000 7f7a0d7fa640 1 -- 172.21.15.78:0/2735791433 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79f803f070 con 0x7f7a10107900 2024-09-18T13:09:59.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.091+0000 7f7a15b67640 1 -- 172.21.15.78:0/2735791433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a10075200 con 0x7f7a10107900 2024-09-18T13:09:59.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.091+0000 7f7a0d7fa640 1 -- 172.21.15.78:0/2735791433 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79f80035f0 con 0x7f7a10107900 2024-09-18T13:09:59.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.091+0000 7f7a0d7fa640 1 -- 172.21.15.78:0/2735791433 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79f8035030 con 0x7f7a10107900 2024-09-18T13:09:59.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.091+0000 7f7a15b67640 1 -- 172.21.15.78:0/2735791433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a101a3de0 con 0x7f7a10107900 2024-09-18T13:09:59.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.092+0000 7f7a15b67640 1 -- 172.21.15.78:0/2735791433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a10103040 con 0x7f7a10107900 2024-09-18T13:09:59.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.092+0000 7f7a0d7fa640 1 -- 172.21.15.78:0/2735791433 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f79f8042070 con 0x7f7a10107900 2024-09-18T13:09:59.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.093+0000 7f7a0d7fa640 1 --2- 172.21.15.78:0/2735791433 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f79fc07af30 0x7f79fc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:59.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.093+0000 7f7a0d7fa640 1 -- 172.21.15.78:0/2735791433 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f79f80bea80 con 0x7f7a10107900 2024-09-18T13:09:59.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.093+0000 7f7a0f7fe640 1 --2- 172.21.15.78:0/2735791433 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f79fc07af30 0x7f79fc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:59.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.094+0000 7f7a0f7fe640 1 --2- 172.21.15.78:0/2735791433 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f79fc07af30 0x7f79fc07d3f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7a00005fd0 tx=0x7f7a00005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:59.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.097+0000 7f7a0d7fa640 1 -- 172.21.15.78:0/2735791433 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f79f808a020 con 0x7f7a10107900 2024-09-18T13:09:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.340+0000 7f7a15b67640 1 -- 172.21.15.78:0/2735791433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7a10075a20 con 0x7f7a10107900 2024-09-18T13:09:59.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.341+0000 7f7a0d7fa640 1 -- 172.21.15.78:0/2735791433 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f79f808c070 con 0x7f7a10107900 2024-09-18T13:09:59.342 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:09:59.342 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:09:59.342 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:09:59.343 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:09:59.343 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:09:59.343 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:09:59.343 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:09:59.343 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:09:59.343 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:09:59.343 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:09:59.343 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:09:59.343 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:09:59.343 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:09:59.343 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:09:59.343 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:09:59.343 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:09:59.343 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:09:59.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.343+0000 7f7a15b67640 1 -- 172.21.15.78:0/2735791433 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f79fc07af30 msgr2=0x7f79fc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:59.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.343+0000 7f7a15b67640 1 --2- 172.21.15.78:0/2735791433 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f79fc07af30 0x7f79fc07d3f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7a00005fd0 tx=0x7f7a00005850 comp rx=0 tx=0).stop 2024-09-18T13:09:59.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.343+0000 7f7a15b67640 1 -- 172.21.15.78:0/2735791433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a10107900 msgr2=0x7f7a10074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:59.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.343+0000 7f7a15b67640 1 --2- 172.21.15.78:0/2735791433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a10107900 0x7f7a10074a30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f79f8031460 tx=0x7f79f80045e0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.344+0000 7f7a15b67640 1 -- 172.21.15.78:0/2735791433 shutdown_connections 2024-09-18T13:09:59.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.344+0000 7f7a15b67640 1 --2- 172.21.15.78:0/2735791433 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f79fc07af30 0x7f79fc07d3f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.344+0000 7f7a15b67640 1 --2- 172.21.15.78:0/2735791433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a10107900 0x7f7a10074a30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.344+0000 7f7a15b67640 1 --2- 172.21.15.78:0/2735791433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a10101900 0x7f7a100744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.344+0000 7f7a15b67640 1 -- 172.21.15.78:0/2735791433 >> 172.21.15.78:0/2735791433 conn(0x7f7a100fd5e0 msgr2=0x7f7a100fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:59.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.344+0000 7f7a15b67640 1 -- 172.21.15.78:0/2735791433 shutdown_connections 2024-09-18T13:09:59.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.344+0000 7f7a15b67640 1 -- 172.21.15.78:0/2735791433 wait complete. 2024-09-18T13:09:59.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.425+0000 7f88efe87640 1 -- 172.21.15.78:0/3586534715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88e8101900 msgr2=0x7f88e8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:59.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.425+0000 7f88efe87640 1 --2- 172.21.15.78:0/3586534715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88e8101900 0x7f88e8101d60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009880 tx=0x7f88d802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.425+0000 7f88efe87640 1 -- 172.21.15.78:0/3586534715 shutdown_connections 2024-09-18T13:09:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.425+0000 7f88efe87640 1 --2- 172.21.15.78:0/3586534715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88e8101900 0x7f88e8101d60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.425+0000 7f88efe87640 1 --2- 172.21.15.78:0/3586534715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88e8107900 0x7f88e8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.425+0000 7f88efe87640 1 -- 172.21.15.78:0/3586534715 >> 172.21.15.78:0/3586534715 conn(0x7f88e80fd5e0 msgr2=0x7f88e80ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.425+0000 7f88efe87640 1 -- 172.21.15.78:0/3586534715 shutdown_connections 2024-09-18T13:09:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.425+0000 7f88efe87640 1 -- 172.21.15.78:0/3586534715 wait complete. 2024-09-18T13:09:59.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.426+0000 7f88efe87640 1 Processor -- start 2024-09-18T13:09:59.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.426+0000 7f88efe87640 1 -- start start 2024-09-18T13:09:59.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.426+0000 7f88efe87640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88e8101900 0x7f88e819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:59.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.426+0000 7f88efe87640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88e8107900 0x7f88e819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:59.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.426+0000 7f88efe87640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f88e810edd0 con 0x7f88e8101900 2024-09-18T13:09:59.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.426+0000 7f88efe87640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f88e810ec50 con 0x7f88e8107900 2024-09-18T13:09:59.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.426+0000 7f88edc23640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88e8101900 0x7f88e819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:59.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.426+0000 7f88edc23640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88e8101900 0x7f88e819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50780/0 (socket says 172.21.15.78:50780) 2024-09-18T13:09:59.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.426+0000 7f88edc23640 1 -- 172.21.15.78:0/3392139680 learned_addr learned my addr 172.21.15.78:0/3392139680 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:09:59.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.426+0000 7f88edc23640 1 -- 172.21.15.78:0/3392139680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88e8107900 msgr2=0x7f88e819dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:59.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.426+0000 7f88edc23640 1 --2- 172.21.15.78:0/3392139680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88e8107900 0x7f88e819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.426+0000 7f88edc23640 1 -- 172.21.15.78:0/3392139680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e8197820 con 0x7f88e8101900 2024-09-18T13:09:59.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.427+0000 7f88edc23640 1 --2- 172.21.15.78:0/3392139680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88e8101900 0x7f88e819d6a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f88e400d6f0 tx=0x7f88e400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:59.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.427+0000 7f88deffd640 1 -- 172.21.15.78:0/3392139680 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88e4017070 con 0x7f88e8101900 2024-09-18T13:09:59.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.427+0000 7f88deffd640 1 -- 172.21.15.78:0/3392139680 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f88e400de00 con 0x7f88e8101900 2024-09-18T13:09:59.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.427+0000 7f88efe87640 1 -- 172.21.15.78:0/3392139680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e8197b10 con 0x7f88e8101900 2024-09-18T13:09:59.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.427+0000 7f88deffd640 1 -- 172.21.15.78:0/3392139680 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88e4004bb0 con 0x7f88e8101900 2024-09-18T13:09:59.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.427+0000 7f88efe87640 1 -- 172.21.15.78:0/3392139680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e81980a0 con 0x7f88e8101900 2024-09-18T13:09:59.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.428+0000 7f88efe87640 1 -- 172.21.15.78:0/3392139680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88e8103040 con 0x7f88e8101900 2024-09-18T13:09:59.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.428+0000 7f88deffd640 1 -- 172.21.15.78:0/3392139680 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f88e4004e60 con 0x7f88e8101900 2024-09-18T13:09:59.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.429+0000 7f88deffd640 1 --2- 172.21.15.78:0/3392139680 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f88d407af30 0x7f88d407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:59.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.429+0000 7f88deffd640 1 -- 172.21.15.78:0/3392139680 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f88e409dcb0 con 0x7f88e8101900 2024-09-18T13:09:59.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.429+0000 7f88ed422640 1 --2- 172.21.15.78:0/3392139680 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f88d407af30 0x7f88d407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:59.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.429+0000 7f88ed422640 1 --2- 172.21.15.78:0/3392139680 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f88d407af30 0x7f88d407d3f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f88d80096c0 tx=0x7f88d8000bc0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:59.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.433+0000 7f88deffd640 1 -- 172.21.15.78:0/3392139680 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f88e4069250 con 0x7f88e8101900 2024-09-18T13:09:59.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.650+0000 7f88efe87640 1 -- 172.21.15.78:0/3392139680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f88e8109e70 con 0x7f88e8101900 2024-09-18T13:09:59.652 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:59 smithi078 ceph-mon[108578]: from='client.34974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:09:59.652 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:09:59 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2735791433' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:09:59.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.651+0000 7f88deffd640 1 -- 172.21.15.78:0/3392139680 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f88e406e100 con 0x7f88e8101900 2024-09-18T13:09:59.653 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:09:59.653 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:09:59.653 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:09:59.653 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:09:59.653 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:09:59.653 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:09:59.653 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:09:59.653 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:09:59.654 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:09:59.654 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:09:59.654 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:09:59.654 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:09:59.654 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:09:59.654 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:09:59.654 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:09:59.654 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:09:59.654 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:09:59.654 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:09:59.654 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:09:59.654 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:09:59.654 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:09:59.655 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:09:59.655 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:09:59.655 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:09:59.655 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:09:59.655 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:09:59.655 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:09:59.655 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:09:59.655 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:09:59.655 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:09:59.655 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:09:59.655 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:09:59.655 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:09:59.655 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:09:59.655 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:09:59.656 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:09:59.656 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:09:59.656 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:09:59.656 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:09:59.656 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:09:59.656 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:09:59.656 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:09:59.656 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:09:59.657 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:09:59.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.654+0000 7f88efe87640 1 -- 172.21.15.78:0/3392139680 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f88d407af30 msgr2=0x7f88d407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:59.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.654+0000 7f88efe87640 1 --2- 172.21.15.78:0/3392139680 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f88d407af30 0x7f88d407d3f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f88d80096c0 tx=0x7f88d8000bc0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.654+0000 7f88efe87640 1 -- 172.21.15.78:0/3392139680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88e8101900 msgr2=0x7f88e819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:59.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.654+0000 7f88efe87640 1 --2- 172.21.15.78:0/3392139680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88e8101900 0x7f88e819d6a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f88e400d6f0 tx=0x7f88e400dbb0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.654+0000 7f88efe87640 1 -- 172.21.15.78:0/3392139680 shutdown_connections 2024-09-18T13:09:59.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.654+0000 7f88efe87640 1 --2- 172.21.15.78:0/3392139680 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f88d407af30 0x7f88d407d3f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.654+0000 7f88efe87640 1 --2- 172.21.15.78:0/3392139680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88e8107900 0x7f88e819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.654+0000 7f88efe87640 1 --2- 172.21.15.78:0/3392139680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88e8101900 0x7f88e819d6a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.654+0000 7f88efe87640 1 -- 172.21.15.78:0/3392139680 >> 172.21.15.78:0/3392139680 conn(0x7f88e80fd5e0 msgr2=0x7f88e80fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:59.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.654+0000 7f88efe87640 1 -- 172.21.15.78:0/3392139680 shutdown_connections 2024-09-18T13:09:59.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.654+0000 7f88efe87640 1 -- 172.21.15.78:0/3392139680 wait complete. 2024-09-18T13:09:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:59 smithi148 ceph-mon[80030]: from='client.34974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:09:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:09:59 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2735791433' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:09:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.738+0000 7f80560ac640 1 -- 172.21.15.78:0/486059352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80501033e0 msgr2=0x7f805010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.738+0000 7f80560ac640 1 --2- 172.21.15.78:0/486059352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80501033e0 0x7f805010b8d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8044009880 tx=0x7f804402a530 comp rx=0 tx=0).stop 2024-09-18T13:09:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.738+0000 7f80560ac640 1 -- 172.21.15.78:0/486059352 shutdown_connections 2024-09-18T13:09:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.738+0000 7f80560ac640 1 --2- 172.21.15.78:0/486059352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80501033e0 0x7f805010b8d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.738+0000 7f80560ac640 1 --2- 172.21.15.78:0/486059352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8050102ac0 0x7f8050102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.738+0000 7f80560ac640 1 -- 172.21.15.78:0/486059352 >> 172.21.15.78:0/486059352 conn(0x7f80500fc520 msgr2=0x7f80500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.738+0000 7f80560ac640 1 -- 172.21.15.78:0/486059352 shutdown_connections 2024-09-18T13:09:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.738+0000 7f80560ac640 1 -- 172.21.15.78:0/486059352 wait complete. 2024-09-18T13:09:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.739+0000 7f80560ac640 1 Processor -- start 2024-09-18T13:09:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.739+0000 7f80560ac640 1 -- start start 2024-09-18T13:09:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.739+0000 7f80560ac640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8050102ac0 0x7f805019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.739+0000 7f80560ac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80501033e0 0x7f805019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.739+0000 7f80560ac640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f805010edd0 con 0x7f80501033e0 2024-09-18T13:09:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.739+0000 7f80560ac640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f805010ec50 con 0x7f8050102ac0 2024-09-18T13:09:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.740+0000 7f804effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80501033e0 0x7f805019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.740+0000 7f804effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80501033e0 0x7f805019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50808/0 (socket says 172.21.15.78:50808) 2024-09-18T13:09:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.740+0000 7f804effd640 1 -- 172.21.15.78:0/3260446573 learned_addr learned my addr 172.21.15.78:0/3260446573 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:09:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.740+0000 7f804f7fe640 1 --2- 172.21.15.78:0/3260446573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8050102ac0 0x7f805019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.740+0000 7f804effd640 1 -- 172.21.15.78:0/3260446573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8050102ac0 msgr2=0x7f805019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.740+0000 7f804effd640 1 --2- 172.21.15.78:0/3260446573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8050102ac0 0x7f805019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.740+0000 7f804effd640 1 -- 172.21.15.78:0/3260446573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80501977e0 con 0x7f80501033e0 2024-09-18T13:09:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.740+0000 7f804effd640 1 --2- 172.21.15.78:0/3260446573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80501033e0 0x7f805019dba0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8044031460 tx=0x7f80440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.740+0000 7f804cff9640 1 -- 172.21.15.78:0/3260446573 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f804403f070 con 0x7f80501033e0 2024-09-18T13:09:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.740+0000 7f804cff9640 1 -- 172.21.15.78:0/3260446573 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8044004ac0 con 0x7f80501033e0 2024-09-18T13:09:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.740+0000 7f80560ac640 1 -- 172.21.15.78:0/3260446573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8050197a70 con 0x7f80501033e0 2024-09-18T13:09:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.740+0000 7f804cff9640 1 -- 172.21.15.78:0/3260446573 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8044035030 con 0x7f80501033e0 2024-09-18T13:09:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.740+0000 7f80560ac640 1 -- 172.21.15.78:0/3260446573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8050197fa0 con 0x7f80501033e0 2024-09-18T13:09:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.741+0000 7f80560ac640 1 -- 172.21.15.78:0/3260446573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f805006aa90 con 0x7f80501033e0 2024-09-18T13:09:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.742+0000 7f804cff9640 1 -- 172.21.15.78:0/3260446573 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8044042070 con 0x7f80501033e0 2024-09-18T13:09:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.742+0000 7f804cff9640 1 --2- 172.21.15.78:0/3260446573 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f803807af80 0x7f803807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:09:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.743+0000 7f804f7fe640 1 --2- 172.21.15.78:0/3260446573 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f803807af80 0x7f803807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:09:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.743+0000 7f804cff9640 1 -- 172.21.15.78:0/3260446573 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f80440be910 con 0x7f80501033e0 2024-09-18T13:09:59.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.743+0000 7f804f7fe640 1 --2- 172.21.15.78:0/3260446573 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f803807af80 0x7f803807d440 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8040005c40 tx=0x7f804000a590 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:09:59.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.747+0000 7f804cff9640 1 -- 172.21.15.78:0/3260446573 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8044089f30 con 0x7f80501033e0 2024-09-18T13:09:59.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.937+0000 7f80560ac640 1 -- 172.21.15.78:0/3260446573 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8050198250 con 0x7f803807af80 2024-09-18T13:09:59.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.938+0000 7f804cff9640 1 -- 172.21.15.78:0/3260446573 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8050198250 con 0x7f803807af80 2024-09-18T13:09:59.939 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:09:59.939 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:09:59.939 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:09:59.940 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:09:59.940 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:09:59.940 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:09:59.940 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:09:59.940 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:09:59.940 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:09:59.940 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:09:59.940 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:09:59.940 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:09:59.940 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:09:59.940 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:09:59.940 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:09:59.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.940+0000 7f80560ac640 1 -- 172.21.15.78:0/3260446573 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f803807af80 msgr2=0x7f803807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:59.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.940+0000 7f80560ac640 1 --2- 172.21.15.78:0/3260446573 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f803807af80 0x7f803807d440 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8040005c40 tx=0x7f804000a590 comp rx=0 tx=0).stop 2024-09-18T13:09:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.940+0000 7f80560ac640 1 -- 172.21.15.78:0/3260446573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80501033e0 msgr2=0x7f805019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:09:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.940+0000 7f80560ac640 1 --2- 172.21.15.78:0/3260446573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80501033e0 0x7f805019dba0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8044031460 tx=0x7f80440046c0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.940+0000 7f80560ac640 1 -- 172.21.15.78:0/3260446573 shutdown_connections 2024-09-18T13:09:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.940+0000 7f80560ac640 1 --2- 172.21.15.78:0/3260446573 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f803807af80 0x7f803807d440 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.940+0000 7f80560ac640 1 --2- 172.21.15.78:0/3260446573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80501033e0 0x7f805019dba0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.940+0000 7f80560ac640 1 --2- 172.21.15.78:0/3260446573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8050102ac0 0x7f805019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:09:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.940+0000 7f80560ac640 1 -- 172.21.15.78:0/3260446573 >> 172.21.15.78:0/3260446573 conn(0x7f80500fc520 msgr2=0x7f8050108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:09:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.940+0000 7f80560ac640 1 -- 172.21.15.78:0/3260446573 shutdown_connections 2024-09-18T13:09:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:09:59.940+0000 7f80560ac640 1 -- 172.21.15.78:0/3260446573 wait complete. 2024-09-18T13:10:00.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.021+0000 7f19a4f9a640 1 -- 172.21.15.78:0/1706834200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a0101900 msgr2=0x7f19a0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:00.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.021+0000 7f19a4f9a640 1 --2- 172.21.15.78:0/1706834200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a0101900 0x7f19a0101d60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1988009880 tx=0x7f198802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:10:00.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.021+0000 7f19a4f9a640 1 -- 172.21.15.78:0/1706834200 shutdown_connections 2024-09-18T13:10:00.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.021+0000 7f19a4f9a640 1 --2- 172.21.15.78:0/1706834200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a0101900 0x7f19a0101d60 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:00.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.021+0000 7f19a4f9a640 1 --2- 172.21.15.78:0/1706834200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19a0107900 0x7f19a0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:00.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.021+0000 7f19a4f9a640 1 -- 172.21.15.78:0/1706834200 >> 172.21.15.78:0/1706834200 conn(0x7f19a00fd600 msgr2=0x7f19a00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:00.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.021+0000 7f19a4f9a640 1 -- 172.21.15.78:0/1706834200 shutdown_connections 2024-09-18T13:10:00.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.021+0000 7f19a4f9a640 1 -- 172.21.15.78:0/1706834200 wait complete. 2024-09-18T13:10:00.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.022+0000 7f19a4f9a640 1 Processor -- start 2024-09-18T13:10:00.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.022+0000 7f19a4f9a640 1 -- start start 2024-09-18T13:10:00.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.022+0000 7f19a4f9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a0101900 0x7f19a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:00.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.022+0000 7f19a4f9a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19a0107900 0x7f19a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:00.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.022+0000 7f19a4f9a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f19a010ee30 con 0x7f19a0101900 2024-09-18T13:10:00.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.022+0000 7f19a4f9a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f19a010ecb0 con 0x7f19a0107900 2024-09-18T13:10:00.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.022+0000 7f199e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a0101900 0x7f19a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.022+0000 7f199e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a0101900 0x7f19a00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50820/0 (socket says 172.21.15.78:50820) 2024-09-18T13:10:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.022+0000 7f199e59c640 1 -- 172.21.15.78:0/2294475813 learned_addr learned my addr 172.21.15.78:0/2294475813 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:10:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.023+0000 7f1997fff640 1 --2- 172.21.15.78:0/2294475813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19a0107900 0x7f19a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.023+0000 7f199e59c640 1 -- 172.21.15.78:0/2294475813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19a0107900 msgr2=0x7f19a0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.023+0000 7f199e59c640 1 --2- 172.21.15.78:0/2294475813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19a0107900 0x7f19a0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.023+0000 7f199e59c640 1 -- 172.21.15.78:0/2294475813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a0074f70 con 0x7f19a0101900 2024-09-18T13:10:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.023+0000 7f1997fff640 1 --2- 172.21.15.78:0/2294475813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19a0107900 0x7f19a0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:10:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.023+0000 7f199e59c640 1 --2- 172.21.15.78:0/2294475813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a0101900 0x7f19a00744f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f199000b420 tx=0x7f199000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.023+0000 7f19977fe640 1 -- 172.21.15.78:0/2294475813 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1990011630 con 0x7f19a0101900 2024-09-18T13:10:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.023+0000 7f19977fe640 1 -- 172.21.15.78:0/2294475813 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1990016070 con 0x7f19a0101900 2024-09-18T13:10:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.023+0000 7f19a4f9a640 1 -- 172.21.15.78:0/2294475813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a0075260 con 0x7f19a0101900 2024-09-18T13:10:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.023+0000 7f19977fe640 1 -- 172.21.15.78:0/2294475813 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1990010d40 con 0x7f19a0101900 2024-09-18T13:10:00.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.023+0000 7f19a4f9a640 1 -- 172.21.15.78:0/2294475813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a01a3ec0 con 0x7f19a0101900 2024-09-18T13:10:00.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.024+0000 7f19a4f9a640 1 -- 172.21.15.78:0/2294475813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a0103040 con 0x7f19a0101900 2024-09-18T13:10:00.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.025+0000 7f19977fe640 1 -- 172.21.15.78:0/2294475813 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f199001b460 con 0x7f19a0101900 2024-09-18T13:10:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.025+0000 7f19977fe640 1 --2- 172.21.15.78:0/2294475813 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f198c07af30 0x7f198c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.025+0000 7f19977fe640 1 -- 172.21.15.78:0/2294475813 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f199009d830 con 0x7f19a0101900 2024-09-18T13:10:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.025+0000 7f1997fff640 1 --2- 172.21.15.78:0/2294475813 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f198c07af30 0x7f198c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.026+0000 7f1997fff640 1 --2- 172.21.15.78:0/2294475813 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f198c07af30 0x7f198c07d3f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1988006010 tx=0x7f19880095f0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:00.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.030+0000 7f19977fe640 1 -- 172.21.15.78:0/2294475813 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1990021250 con 0x7f19a0101900 2024-09-18T13:10:00.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:00 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[108574]: 2024-09-18T13:09:59.999+0000 7f54f7b0e640 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:10:00.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.277+0000 7f19a4f9a640 1 -- 172.21.15.78:0/2294475813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f19a0101d60 con 0x7f19a0101900 2024-09-18T13:10:00.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.277+0000 7f19977fe640 1 -- 172.21.15.78:0/2294475813 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f1990068dd0 con 0x7f19a0101900 2024-09-18T13:10:00.278 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:10:00.278 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:10:00.278 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:10:00.278 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:10:00.279 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:10:00.279 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:10:00.279 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:10:00.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.279+0000 7f19a4f9a640 1 -- 172.21.15.78:0/2294475813 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f198c07af30 msgr2=0x7f198c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:00.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.279+0000 7f19a4f9a640 1 --2- 172.21.15.78:0/2294475813 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f198c07af30 0x7f198c07d3f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1988006010 tx=0x7f19880095f0 comp rx=0 tx=0).stop 2024-09-18T13:10:00.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.279+0000 7f19a4f9a640 1 -- 172.21.15.78:0/2294475813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a0101900 msgr2=0x7f19a00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:00.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.279+0000 7f19a4f9a640 1 --2- 172.21.15.78:0/2294475813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a0101900 0x7f19a00744f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f199000b420 tx=0x7f199000b8e0 comp rx=0 tx=0).stop 2024-09-18T13:10:00.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.279+0000 7f19a4f9a640 1 -- 172.21.15.78:0/2294475813 shutdown_connections 2024-09-18T13:10:00.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.279+0000 7f19a4f9a640 1 --2- 172.21.15.78:0/2294475813 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f198c07af30 0x7f198c07d3f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:00.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.279+0000 7f19a4f9a640 1 --2- 172.21.15.78:0/2294475813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19a0107900 0x7f19a0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:00.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.279+0000 7f19a4f9a640 1 --2- 172.21.15.78:0/2294475813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19a0101900 0x7f19a00744f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:00.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.279+0000 7f19a4f9a640 1 -- 172.21.15.78:0/2294475813 >> 172.21.15.78:0/2294475813 conn(0x7f19a00fd600 msgr2=0x7f19a00fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:00.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.279+0000 7f19a4f9a640 1 -- 172.21.15.78:0/2294475813 shutdown_connections 2024-09-18T13:10:00.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:00.279+0000 7f19a4f9a640 1 -- 172.21.15.78:0/2294475813 wait complete. 2024-09-18T13:10:00.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:00 smithi078 ceph-mon[108578]: from='client.34978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:10:00.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:00 smithi078 ceph-mon[108578]: from='client.34982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:10:00.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:00 smithi078 ceph-mon[108578]: pgmap v625: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:00.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:00 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3392139680' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:10:00.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:00 smithi078 ceph-mon[108578]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:10:00.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:00 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2294475813' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:10:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:00 smithi148 ceph-mon[80030]: from='client.34978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:10:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:00 smithi148 ceph-mon[80030]: from='client.34982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:10:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:00 smithi148 ceph-mon[80030]: pgmap v625: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:00 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3392139680' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:10:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:00 smithi148 ceph-mon[80030]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:10:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:00 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2294475813' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:10:01.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:01 smithi148 ceph-mon[80030]: from='client.34994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:10:01.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:01 smithi078 ceph-mon[108578]: from='client.34994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:10:02.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:02 smithi148 ceph-mon[80030]: pgmap v626: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:02 smithi078 ceph-mon[108578]: pgmap v626: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:04 smithi148 ceph-mon[80030]: pgmap v627: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:04 smithi078 ceph-mon[108578]: pgmap v627: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:06.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:06 smithi148 ceph-mon[80030]: pgmap v628: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:06.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:06 smithi078 ceph-mon[108578]: pgmap v628: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:08.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:08 smithi148 ceph-mon[80030]: pgmap v629: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:08.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:08 smithi078 ceph-mon[108578]: pgmap v629: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:10 smithi148 ceph-mon[80030]: pgmap v630: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:10.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:10 smithi078 ceph-mon[108578]: pgmap v630: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:10:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:10:12.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:12 smithi148 ceph-mon[80030]: pgmap v631: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:12.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:12 smithi078 ceph-mon[108578]: pgmap v631: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:14 smithi148 ceph-mon[80030]: pgmap v632: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:14 smithi078 ceph-mon[108578]: pgmap v632: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:16 smithi078 ceph-mon[108578]: pgmap v633: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:16.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:16 smithi148 ceph-mon[80030]: pgmap v633: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:18.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:18 smithi078 ceph-mon[108578]: pgmap v634: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:18.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:18 smithi148 ceph-mon[80030]: pgmap v634: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:20.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:20 smithi078 ceph-mon[108578]: pgmap v635: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:20.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:20 smithi148 ceph-mon[80030]: pgmap v635: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:22.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:22 smithi078 ceph-mon[108578]: pgmap v636: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:22.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:22 smithi148 ceph-mon[80030]: pgmap v636: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:23.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:23 smithi148 ceph-mon[80030]: pgmap v637: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:23.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:23 smithi078 ceph-mon[108578]: pgmap v637: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:26 smithi148 ceph-mon[80030]: pgmap v638: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:10:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:26 smithi078 ceph-mon[108578]: pgmap v638: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:10:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:28 smithi148 ceph-mon[80030]: pgmap v639: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:28.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:28 smithi078 ceph-mon[108578]: pgmap v639: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:30.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.377+0000 7fb4e0da2640 1 -- 172.21.15.78:0/229553046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4dc107900 msgr2=0x7fb4dc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:30.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.377+0000 7fb4e0da2640 1 --2- 172.21.15.78:0/229553046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4dc107900 0x7fb4dc107ce0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc009c20 tx=0x7fb4cc02a970 comp rx=0 tx=0).stop 2024-09-18T13:10:30.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.377+0000 7fb4e0da2640 1 -- 172.21.15.78:0/229553046 shutdown_connections 2024-09-18T13:10:30.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.377+0000 7fb4e0da2640 1 --2- 172.21.15.78:0/229553046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4dc101900 0x7fb4dc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.377+0000 7fb4e0da2640 1 --2- 172.21.15.78:0/229553046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4dc107900 0x7fb4dc107ce0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.377+0000 7fb4e0da2640 1 -- 172.21.15.78:0/229553046 >> 172.21.15.78:0/229553046 conn(0x7fb4dc0fd600 msgr2=0x7fb4dc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:30.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.377+0000 7fb4e0da2640 1 -- 172.21.15.78:0/229553046 shutdown_connections 2024-09-18T13:10:30.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.377+0000 7fb4e0da2640 1 -- 172.21.15.78:0/229553046 wait complete. 2024-09-18T13:10:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.378+0000 7fb4e0da2640 1 Processor -- start 2024-09-18T13:10:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.378+0000 7fb4e0da2640 1 -- start start 2024-09-18T13:10:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.379+0000 7fb4e0da2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4dc101900 0x7fb4dc19f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.379+0000 7fb4e0da2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4dc107900 0x7fb4dc19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.379+0000 7fb4e0da2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb4dc10edb0 con 0x7fb4dc101900 2024-09-18T13:10:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.379+0000 7fb4e0da2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb4dc10ec30 con 0x7fb4dc107900 2024-09-18T13:10:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.379+0000 7fb4da59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4dc101900 0x7fb4dc19f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.379+0000 7fb4da59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4dc101900 0x7fb4dc19f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36738/0 (socket says 172.21.15.78:36738) 2024-09-18T13:10:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.379+0000 7fb4da59c640 1 -- 172.21.15.78:0/1499431667 learned_addr learned my addr 172.21.15.78:0/1499431667 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:10:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.379+0000 7fb4d9d9b640 1 --2- 172.21.15.78:0/1499431667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4dc107900 0x7fb4dc19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.379+0000 7fb4da59c640 1 -- 172.21.15.78:0/1499431667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4dc107900 msgr2=0x7fb4dc19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.379+0000 7fb4da59c640 1 --2- 172.21.15.78:0/1499431667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4dc107900 0x7fb4dc19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.379+0000 7fb4da59c640 1 -- 172.21.15.78:0/1499431667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4dc199990 con 0x7fb4dc101900 2024-09-18T13:10:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.379+0000 7fb4da59c640 1 --2- 172.21.15.78:0/1499431667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4dc101900 0x7fb4dc19f7d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc02ae90 tx=0x7fb4cc02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:30.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.380+0000 7fb4cb7fe640 1 -- 172.21.15.78:0/1499431667 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4cc047070 con 0x7fb4dc101900 2024-09-18T13:10:30.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.380+0000 7fb4cb7fe640 1 -- 172.21.15.78:0/1499431667 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4cc02f7e0 con 0x7fb4dc101900 2024-09-18T13:10:30.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.380+0000 7fb4e0da2640 1 -- 172.21.15.78:0/1499431667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4dc199c20 con 0x7fb4dc101900 2024-09-18T13:10:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.380+0000 7fb4cb7fe640 1 -- 172.21.15.78:0/1499431667 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4cc034070 con 0x7fb4dc101900 2024-09-18T13:10:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.380+0000 7fb4e0da2640 1 -- 172.21.15.78:0/1499431667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4dc19a150 con 0x7fb4dc101900 2024-09-18T13:10:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.381+0000 7fb4e0da2640 1 -- 172.21.15.78:0/1499431667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4dc103040 con 0x7fb4dc101900 2024-09-18T13:10:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.382+0000 7fb4cb7fe640 1 -- 172.21.15.78:0/1499431667 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fb4cc04a070 con 0x7fb4dc101900 2024-09-18T13:10:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.383+0000 7fb4cb7fe640 1 --2- 172.21.15.78:0/1499431667 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb4c407af80 0x7fb4c407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.383+0000 7fb4cb7fe640 1 -- 172.21.15.78:0/1499431667 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fb4cc0bec60 con 0x7fb4dc101900 2024-09-18T13:10:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.383+0000 7fb4d9d9b640 1 --2- 172.21.15.78:0/1499431667 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb4c407af80 0x7fb4c407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.383+0000 7fb4d9d9b640 1 --2- 172.21.15.78:0/1499431667 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb4c407af80 0x7fb4c407d440 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc100060 tx=0x7fb4d000b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.387+0000 7fb4cb7fe640 1 -- 172.21.15.78:0/1499431667 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fb4cc03f070 con 0x7fb4dc101900 2024-09-18T13:10:30.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.582+0000 7fb4e0da2640 1 -- 172.21.15.78:0/1499431667 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb4dc19a400 con 0x7fb4c407af80 2024-09-18T13:10:30.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.583+0000 7fb4cb7fe640 1 -- 172.21.15.78:0/1499431667 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fb4dc19a400 con 0x7fb4c407af80 2024-09-18T13:10:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.585+0000 7fb4e0da2640 1 -- 172.21.15.78:0/1499431667 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb4c407af80 msgr2=0x7fb4c407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.585+0000 7fb4e0da2640 1 --2- 172.21.15.78:0/1499431667 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb4c407af80 0x7fb4c407d440 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc100060 tx=0x7fb4d000b390 comp rx=0 tx=0).stop 2024-09-18T13:10:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.585+0000 7fb4e0da2640 1 -- 172.21.15.78:0/1499431667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4dc101900 msgr2=0x7fb4dc19f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.585+0000 7fb4e0da2640 1 --2- 172.21.15.78:0/1499431667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4dc101900 0x7fb4dc19f7d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc02ae90 tx=0x7fb4cc02f5f0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.585+0000 7fb4e0da2640 1 -- 172.21.15.78:0/1499431667 shutdown_connections 2024-09-18T13:10:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.585+0000 7fb4e0da2640 1 --2- 172.21.15.78:0/1499431667 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb4c407af80 0x7fb4c407d440 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.585+0000 7fb4e0da2640 1 --2- 172.21.15.78:0/1499431667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4dc107900 0x7fb4dc19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.585+0000 7fb4e0da2640 1 --2- 172.21.15.78:0/1499431667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4dc101900 0x7fb4dc19f7d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.585+0000 7fb4e0da2640 1 -- 172.21.15.78:0/1499431667 >> 172.21.15.78:0/1499431667 conn(0x7fb4dc0fd600 msgr2=0x7fb4dc0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.586+0000 7fb4e0da2640 1 -- 172.21.15.78:0/1499431667 shutdown_connections 2024-09-18T13:10:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.586+0000 7fb4e0da2640 1 -- 172.21.15.78:0/1499431667 wait complete. 2024-09-18T13:10:30.597 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:10:30.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.668+0000 7feffcd01640 1 -- 172.21.15.78:0/952821856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff81033d0 msgr2=0x7feff810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:30.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.668+0000 7feffcd01640 1 --2- 172.21.15.78:0/952821856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff81033d0 0x7feff810b8c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fefec009880 tx=0x7fefec02a530 comp rx=0 tx=0).stop 2024-09-18T13:10:30.671 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:30 smithi078 ceph-mon[108578]: pgmap v640: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.669+0000 7feffcd01640 1 -- 172.21.15.78:0/952821856 shutdown_connections 2024-09-18T13:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.669+0000 7feffcd01640 1 --2- 172.21.15.78:0/952821856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff81033d0 0x7feff810b8c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.669+0000 7feffcd01640 1 --2- 172.21.15.78:0/952821856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff8102ab0 0x7feff8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.669+0000 7feffcd01640 1 -- 172.21.15.78:0/952821856 >> 172.21.15.78:0/952821856 conn(0x7feff80fc550 msgr2=0x7feff80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.669+0000 7feffcd01640 1 -- 172.21.15.78:0/952821856 shutdown_connections 2024-09-18T13:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.669+0000 7feffcd01640 1 -- 172.21.15.78:0/952821856 wait complete. 2024-09-18T13:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.669+0000 7feffcd01640 1 Processor -- start 2024-09-18T13:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.669+0000 7feffcd01640 1 -- start start 2024-09-18T13:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.670+0000 7feffcd01640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff8102ab0 0x7feff819f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.670+0000 7feffcd01640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff81033d0 0x7feff819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:30.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.670+0000 7feffcd01640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feff810ede0 con 0x7feff8102ab0 2024-09-18T13:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.670+0000 7feffcd01640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feff810ec60 con 0x7feff81033d0 2024-09-18T13:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.670+0000 7feff659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff8102ab0 0x7feff819f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.670+0000 7feff659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff8102ab0 0x7feff819f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36760/0 (socket says 172.21.15.78:36760) 2024-09-18T13:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.670+0000 7feff659c640 1 -- 172.21.15.78:0/4120752787 learned_addr learned my addr 172.21.15.78:0/4120752787 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.670+0000 7feff5d9b640 1 --2- 172.21.15.78:0/4120752787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff81033d0 0x7feff819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.670+0000 7feff659c640 1 -- 172.21.15.78:0/4120752787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff81033d0 msgr2=0x7feff819fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.670+0000 7feff659c640 1 --2- 172.21.15.78:0/4120752787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff81033d0 0x7feff819fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.670+0000 7feff659c640 1 -- 172.21.15.78:0/4120752787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff81999c0 con 0x7feff8102ab0 2024-09-18T13:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.670+0000 7feff659c640 1 --2- 172.21.15.78:0/4120752787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff8102ab0 0x7feff819f800 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fefe800ea00 tx=0x7fefe800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.670+0000 7fefe77fe640 1 -- 172.21.15.78:0/4120752787 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fefe800cb80 con 0x7feff8102ab0 2024-09-18T13:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.671+0000 7fefe77fe640 1 -- 172.21.15.78:0/4120752787 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fefe800cd20 con 0x7feff8102ab0 2024-09-18T13:10:30.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.671+0000 7fefe77fe640 1 -- 172.21.15.78:0/4120752787 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fefe8011470 con 0x7feff8102ab0 2024-09-18T13:10:30.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.671+0000 7feffcd01640 1 -- 172.21.15.78:0/4120752787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff8199cb0 con 0x7feff8102ab0 2024-09-18T13:10:30.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.671+0000 7feffcd01640 1 -- 172.21.15.78:0/4120752787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff819a210 con 0x7feff8102ab0 2024-09-18T13:10:30.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.672+0000 7fefe77fe640 1 -- 172.21.15.78:0/4120752787 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fefe80116e0 con 0x7feff8102ab0 2024-09-18T13:10:30.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.672+0000 7feffcd01640 1 -- 172.21.15.78:0/4120752787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff806a580 con 0x7feff8102ab0 2024-09-18T13:10:30.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.673+0000 7fefe77fe640 1 --2- 172.21.15.78:0/4120752787 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fefe007af80 0x7fefe007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:30.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.673+0000 7fefe77fe640 1 -- 172.21.15.78:0/4120752787 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fefe809e380 con 0x7feff8102ab0 2024-09-18T13:10:30.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.673+0000 7feff5d9b640 1 --2- 172.21.15.78:0/4120752787 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fefe007af80 0x7fefe007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:30.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.673+0000 7feff5d9b640 1 --2- 172.21.15.78:0/4120752787 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fefe007af80 0x7fefe007d440 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feff819b1b0 tx=0x7fefec031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:30.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.677+0000 7fefe77fe640 1 -- 172.21.15.78:0/4120752787 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fefe8016030 con 0x7feff8102ab0 2024-09-18T13:10:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:30 smithi148 ceph-mon[80030]: pgmap v640: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:30.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.874+0000 7feffcd01640 1 -- 172.21.15.78:0/4120752787 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7feff819aef0 con 0x7fefe007af80 2024-09-18T13:10:30.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.876+0000 7fefe77fe640 1 -- 172.21.15.78:0/4120752787 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7feff819aef0 con 0x7fefe007af80 2024-09-18T13:10:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.878+0000 7feffcd01640 1 -- 172.21.15.78:0/4120752787 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fefe007af80 msgr2=0x7fefe007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.878+0000 7feffcd01640 1 --2- 172.21.15.78:0/4120752787 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fefe007af80 0x7fefe007d440 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feff819b1b0 tx=0x7fefec031400 comp rx=0 tx=0).stop 2024-09-18T13:10:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.878+0000 7feffcd01640 1 -- 172.21.15.78:0/4120752787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff8102ab0 msgr2=0x7feff819f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.878+0000 7feffcd01640 1 --2- 172.21.15.78:0/4120752787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff8102ab0 0x7feff819f800 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fefe800ea00 tx=0x7fefe800eec0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.878+0000 7feffcd01640 1 -- 172.21.15.78:0/4120752787 shutdown_connections 2024-09-18T13:10:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.878+0000 7feffcd01640 1 --2- 172.21.15.78:0/4120752787 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fefe007af80 0x7fefe007d440 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.878+0000 7feffcd01640 1 --2- 172.21.15.78:0/4120752787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feff81033d0 0x7feff819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.878+0000 7feffcd01640 1 --2- 172.21.15.78:0/4120752787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff8102ab0 0x7feff819f800 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.878+0000 7feffcd01640 1 -- 172.21.15.78:0/4120752787 >> 172.21.15.78:0/4120752787 conn(0x7feff80fc550 msgr2=0x7feff8100b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:30.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.878+0000 7feffcd01640 1 -- 172.21.15.78:0/4120752787 shutdown_connections 2024-09-18T13:10:30.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.878+0000 7feffcd01640 1 -- 172.21.15.78:0/4120752787 wait complete. 2024-09-18T13:10:30.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.959+0000 7f782719f640 1 -- 172.21.15.78:0/980084838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7820101900 msgr2=0x7f7820101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:30.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.959+0000 7f782719f640 1 --2- 172.21.15.78:0/980084838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7820101900 0x7f7820101d60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f780c009880 tx=0x7f780c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.959+0000 7f782719f640 1 -- 172.21.15.78:0/980084838 shutdown_connections 2024-09-18T13:10:30.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.959+0000 7f782719f640 1 --2- 172.21.15.78:0/980084838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7820101900 0x7f7820101d60 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.959+0000 7f782719f640 1 --2- 172.21.15.78:0/980084838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7820107900 0x7f7820107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.959+0000 7f782719f640 1 -- 172.21.15.78:0/980084838 >> 172.21.15.78:0/980084838 conn(0x7f78200fd600 msgr2=0x7f78200ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:30.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.959+0000 7f782719f640 1 -- 172.21.15.78:0/980084838 shutdown_connections 2024-09-18T13:10:30.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.959+0000 7f782719f640 1 -- 172.21.15.78:0/980084838 wait complete. 2024-09-18T13:10:30.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.960+0000 7f782719f640 1 Processor -- start 2024-09-18T13:10:30.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.960+0000 7f782719f640 1 -- start start 2024-09-18T13:10:30.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.960+0000 7f782719f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7820101900 0x7f782019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:30.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.960+0000 7f782719f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7820107900 0x7f782019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:30.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.960+0000 7f782719f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f782010edd0 con 0x7f7820107900 2024-09-18T13:10:30.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.960+0000 7f782719f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f782010ec50 con 0x7f7820101900 2024-09-18T13:10:30.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.960+0000 7f781ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7820107900 0x7f782019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:30.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.960+0000 7f781ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7820107900 0x7f782019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36786/0 (socket says 172.21.15.78:36786) 2024-09-18T13:10:30.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.960+0000 7f781ffff640 1 -- 172.21.15.78:0/2184915019 learned_addr learned my addr 172.21.15.78:0/2184915019 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:10:30.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.960+0000 7f7824f3b640 1 --2- 172.21.15.78:0/2184915019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7820101900 0x7f782019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:30.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.960+0000 7f781ffff640 1 -- 172.21.15.78:0/2184915019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7820101900 msgr2=0x7f782019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:30.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.960+0000 7f781ffff640 1 --2- 172.21.15.78:0/2184915019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7820101900 0x7f782019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:30.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.960+0000 7f781ffff640 1 -- 172.21.15.78:0/2184915019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7820197800 con 0x7f7820107900 2024-09-18T13:10:30.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.960+0000 7f781ffff640 1 --2- 172.21.15.78:0/2184915019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7820107900 0x7f782019dbc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f780c031460 tx=0x7f780c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:30.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.961+0000 7f781dffb640 1 -- 172.21.15.78:0/2184915019 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f780c03f070 con 0x7f7820107900 2024-09-18T13:10:30.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.961+0000 7f781dffb640 1 -- 172.21.15.78:0/2184915019 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f780c0035f0 con 0x7f7820107900 2024-09-18T13:10:30.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.961+0000 7f782719f640 1 -- 172.21.15.78:0/2184915019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7820197a90 con 0x7f7820107900 2024-09-18T13:10:30.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.961+0000 7f781dffb640 1 -- 172.21.15.78:0/2184915019 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f780c035030 con 0x7f7820107900 2024-09-18T13:10:30.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.961+0000 7f782719f640 1 -- 172.21.15.78:0/2184915019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7820197fc0 con 0x7f7820107900 2024-09-18T13:10:30.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.962+0000 7f782719f640 1 -- 172.21.15.78:0/2184915019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7820103040 con 0x7f7820107900 2024-09-18T13:10:30.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.962+0000 7f781dffb640 1 -- 172.21.15.78:0/2184915019 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f780c042070 con 0x7f7820107900 2024-09-18T13:10:30.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.963+0000 7f781dffb640 1 --2- 172.21.15.78:0/2184915019 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f781007af30 0x7f781007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:30.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.963+0000 7f781dffb640 1 -- 172.21.15.78:0/2184915019 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f780c0beae0 con 0x7f7820107900 2024-09-18T13:10:30.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.963+0000 7f7824f3b640 1 --2- 172.21.15.78:0/2184915019 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f781007af30 0x7f781007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:30.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.964+0000 7f7824f3b640 1 --2- 172.21.15.78:0/2184915019 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f781007af30 0x7f781007d3f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7814005fd0 tx=0x7f7814005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:30.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:30.967+0000 7f781dffb640 1 -- 172.21.15.78:0/2184915019 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f780c08a020 con 0x7f7820107900 2024-09-18T13:10:31.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.153+0000 7f782719f640 1 -- 172.21.15.78:0/2184915019 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7820198330 con 0x7f781007af30 2024-09-18T13:10:31.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.162+0000 7f781dffb640 1 -- 172.21.15.78:0/2184915019 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f7820198330 con 0x7f781007af30 2024-09-18T13:10:31.164 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:10:31.164 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (18m) 12m ago 29m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:10:31.165 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (20m) 12m ago 29m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:10:31.165 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (20m) 12m ago 28m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:10:31.165 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (16m) 12m ago 29m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:10:31.165 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (16m) 12m ago 28m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:10:31.165 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (17m) 12m ago 29m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:10:31.165 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (12m) 12m ago 24m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:10:31.165 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (12m) 12m ago 23m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:10:31.165 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (12m) 12m ago 23m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:10:31.165 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (12m) 12m ago 23m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:10:31.165 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (20m) 12m ago 30m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:10:31.165 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (19m) 12m ago 28m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:10:31.165 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (17m) 12m ago 30m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:10:31.165 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (16m) 12m ago 28m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:10:31.166 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (19m) 12m ago 29m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:10:31.166 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (19m) 12m ago 28m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:10:31.166 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (16m) 12m ago 27m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:10:31.166 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (15m) 12m ago 26m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:10:31.166 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (14m) 12m ago 26m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:10:31.166 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (14m) 12m ago 25m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:10:31.166 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (13m) 12m ago 25m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:10:31.166 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (13m) 12m ago 25m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:10:31.166 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (18m) 12m ago 28m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:10:31.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.164+0000 7f782719f640 1 -- 172.21.15.78:0/2184915019 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f781007af30 msgr2=0x7f781007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:31.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.164+0000 7f782719f640 1 --2- 172.21.15.78:0/2184915019 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f781007af30 0x7f781007d3f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7814005fd0 tx=0x7f7814005850 comp rx=0 tx=0).stop 2024-09-18T13:10:31.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.164+0000 7f782719f640 1 -- 172.21.15.78:0/2184915019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7820107900 msgr2=0x7f782019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:31.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.164+0000 7f782719f640 1 --2- 172.21.15.78:0/2184915019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7820107900 0x7f782019dbc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f780c031460 tx=0x7f780c0045e0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.164+0000 7f782719f640 1 -- 172.21.15.78:0/2184915019 shutdown_connections 2024-09-18T13:10:31.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.164+0000 7f782719f640 1 --2- 172.21.15.78:0/2184915019 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f781007af30 0x7f781007d3f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.164+0000 7f782719f640 1 --2- 172.21.15.78:0/2184915019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7820107900 0x7f782019dbc0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.164+0000 7f782719f640 1 --2- 172.21.15.78:0/2184915019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7820101900 0x7f782019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.165+0000 7f782719f640 1 -- 172.21.15.78:0/2184915019 >> 172.21.15.78:0/2184915019 conn(0x7f78200fd600 msgr2=0x7f78200fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:31.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.165+0000 7f782719f640 1 -- 172.21.15.78:0/2184915019 shutdown_connections 2024-09-18T13:10:31.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.165+0000 7f782719f640 1 -- 172.21.15.78:0/2184915019 wait complete. 2024-09-18T13:10:31.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.246+0000 7f3fed835640 1 -- 172.21.15.78:0/3966087921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8106800 msgr2=0x7f3fe8106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:31.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.246+0000 7f3fed835640 1 --2- 172.21.15.78:0/3966087921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8106800 0x7f3fe8106be0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8009880 tx=0x7f3fd802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.246+0000 7f3fed835640 1 -- 172.21.15.78:0/3966087921 shutdown_connections 2024-09-18T13:10:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.246+0000 7f3fed835640 1 --2- 172.21.15.78:0/3966087921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe8100800 0x7f3fe8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.246+0000 7f3fed835640 1 --2- 172.21.15.78:0/3966087921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8106800 0x7f3fe8106be0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.246+0000 7f3fed835640 1 -- 172.21.15.78:0/3966087921 >> 172.21.15.78:0/3966087921 conn(0x7f3fe80fc520 msgr2=0x7f3fe80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.246+0000 7f3fed835640 1 -- 172.21.15.78:0/3966087921 shutdown_connections 2024-09-18T13:10:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.246+0000 7f3fed835640 1 -- 172.21.15.78:0/3966087921 wait complete. 2024-09-18T13:10:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.247+0000 7f3fed835640 1 Processor -- start 2024-09-18T13:10:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.247+0000 7f3fed835640 1 -- start start 2024-09-18T13:10:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.247+0000 7f3fed835640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe8100800 0x7f3fe819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.247+0000 7f3fed835640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8106800 0x7f3fe819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.247+0000 7f3fed835640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe810dcd0 con 0x7f3fe8106800 2024-09-18T13:10:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.247+0000 7f3fed835640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe810db50 con 0x7f3fe8100800 2024-09-18T13:10:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.247+0000 7f3fe67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8106800 0x7f3fe819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:31.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.247+0000 7f3fe67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8106800 0x7f3fe819cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35434/0 (socket says 172.21.15.78:35434) 2024-09-18T13:10:31.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.247+0000 7f3fe67fc640 1 -- 172.21.15.78:0/143784033 learned_addr learned my addr 172.21.15.78:0/143784033 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:10:31.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.248+0000 7f3fe6ffd640 1 --2- 172.21.15.78:0/143784033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe8100800 0x7f3fe819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:31.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.248+0000 7f3fe67fc640 1 -- 172.21.15.78:0/143784033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe8100800 msgr2=0x7f3fe819c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:31.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.248+0000 7f3fe67fc640 1 --2- 172.21.15.78:0/143784033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe8100800 0x7f3fe819c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.248+0000 7f3fe67fc640 1 -- 172.21.15.78:0/143784033 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe81966d0 con 0x7f3fe8106800 2024-09-18T13:10:31.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.248+0000 7f3fe6ffd640 1 --2- 172.21.15.78:0/143784033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe8100800 0x7f3fe819c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:10:31.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.248+0000 7f3fe67fc640 1 --2- 172.21.15.78:0/143784033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8106800 0x7f3fe819cb40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00c8f0 tx=0x7f3fdc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:31.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.248+0000 7f3fec833640 1 -- 172.21.15.78:0/143784033 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3fdc0079b0 con 0x7f3fe8106800 2024-09-18T13:10:31.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.248+0000 7f3fec833640 1 -- 172.21.15.78:0/143784033 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3fdc0054e0 con 0x7f3fe8106800 2024-09-18T13:10:31.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.248+0000 7f3fed835640 1 -- 172.21.15.78:0/143784033 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe81969c0 con 0x7f3fe8106800 2024-09-18T13:10:31.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.248+0000 7f3fed835640 1 -- 172.21.15.78:0/143784033 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe8196f20 con 0x7f3fe8106800 2024-09-18T13:10:31.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.248+0000 7f3fec833640 1 -- 172.21.15.78:0/143784033 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3fdc004dd0 con 0x7f3fe8106800 2024-09-18T13:10:31.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.249+0000 7f3fed835640 1 -- 172.21.15.78:0/143784033 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd4005290 con 0x7f3fe8106800 2024-09-18T13:10:31.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.250+0000 7f3fec833640 1 -- 172.21.15.78:0/143784033 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3fdc007b50 con 0x7f3fe8106800 2024-09-18T13:10:31.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.250+0000 7f3fec833640 1 --2- 172.21.15.78:0/143784033 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3fd007aed0 0x7f3fd007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:31.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.250+0000 7f3fec833640 1 -- 172.21.15.78:0/143784033 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f3fdc09dff0 con 0x7f3fe8106800 2024-09-18T13:10:31.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.250+0000 7f3fe6ffd640 1 --2- 172.21.15.78:0/143784033 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3fd007aed0 0x7f3fd007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:31.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.251+0000 7f3fe6ffd640 1 --2- 172.21.15.78:0/143784033 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3fd007aed0 0x7f3fd007d390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8031460 tx=0x7f3fd8009580 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:31.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.254+0000 7f3fec833640 1 -- 172.21.15.78:0/143784033 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3fdc014030 con 0x7f3fe8106800 2024-09-18T13:10:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.503+0000 7f3fed835640 1 -- 172.21.15.78:0/143784033 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3fd4005d90 con 0x7f3fe8106800 2024-09-18T13:10:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.503+0000 7f3fec833640 1 -- 172.21.15.78:0/143784033 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f3fdc069510 con 0x7f3fe8106800 2024-09-18T13:10:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:10:31.506 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:10:31.506 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:10:31.506 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:10:31.506 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:10:31.506 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:10:31.506 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:10:31.506 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:10:31.506 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:10:31.506 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:10:31.506 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:10:31.506 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:10:31.507 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:10:31.507 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:10:31.507 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:10:31.507 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:10:31.507 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:10:31.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.505+0000 7f3fed835640 1 -- 172.21.15.78:0/143784033 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3fd007aed0 msgr2=0x7f3fd007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:31.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.505+0000 7f3fed835640 1 --2- 172.21.15.78:0/143784033 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3fd007aed0 0x7f3fd007d390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8031460 tx=0x7f3fd8009580 comp rx=0 tx=0).stop 2024-09-18T13:10:31.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.505+0000 7f3fed835640 1 -- 172.21.15.78:0/143784033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8106800 msgr2=0x7f3fe819cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:31.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.505+0000 7f3fed835640 1 --2- 172.21.15.78:0/143784033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8106800 0x7f3fe819cb40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00c8f0 tx=0x7f3fdc00cdb0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.505+0000 7f3fed835640 1 -- 172.21.15.78:0/143784033 shutdown_connections 2024-09-18T13:10:31.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.505+0000 7f3fed835640 1 --2- 172.21.15.78:0/143784033 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3fd007aed0 0x7f3fd007d390 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.505+0000 7f3fed835640 1 --2- 172.21.15.78:0/143784033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8106800 0x7f3fe819cb40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.505+0000 7f3fed835640 1 --2- 172.21.15.78:0/143784033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3fe8100800 0x7f3fe819c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.505+0000 7f3fed835640 1 -- 172.21.15.78:0/143784033 >> 172.21.15.78:0/143784033 conn(0x7f3fe80fc520 msgr2=0x7f3fe80fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:31.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.506+0000 7f3fed835640 1 -- 172.21.15.78:0/143784033 shutdown_connections 2024-09-18T13:10:31.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.506+0000 7f3fed835640 1 -- 172.21.15.78:0/143784033 wait complete. 2024-09-18T13:10:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.586+0000 7f35e1044640 1 -- 172.21.15.78:0/2155445064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35dc1067f0 msgr2=0x7f35dc106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.586+0000 7f35e1044640 1 --2- 172.21.15.78:0/2155445064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35dc1067f0 0x7f35dc106bd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009880 tx=0x7f35cc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.586+0000 7f35e1044640 1 -- 172.21.15.78:0/2155445064 shutdown_connections 2024-09-18T13:10:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.586+0000 7f35e1044640 1 --2- 172.21.15.78:0/2155445064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35dc1007f0 0x7f35dc100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.586+0000 7f35e1044640 1 --2- 172.21.15.78:0/2155445064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35dc1067f0 0x7f35dc106bd0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.586+0000 7f35e1044640 1 -- 172.21.15.78:0/2155445064 >> 172.21.15.78:0/2155445064 conn(0x7f35dc0fc550 msgr2=0x7f35dc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.586+0000 7f35e1044640 1 -- 172.21.15.78:0/2155445064 shutdown_connections 2024-09-18T13:10:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.586+0000 7f35e1044640 1 -- 172.21.15.78:0/2155445064 wait complete. 2024-09-18T13:10:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.587+0000 7f35e1044640 1 Processor -- start 2024-09-18T13:10:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.587+0000 7f35e1044640 1 -- start start 2024-09-18T13:10:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.587+0000 7f35e1044640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35dc1007f0 0x7f35dc19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35e1044640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35dc1067f0 0x7f35dc19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35e1044640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc10dca0 con 0x7f35dc1067f0 2024-09-18T13:10:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35e1044640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc10db20 con 0x7f35dc1007f0 2024-09-18T13:10:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35da59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35dc1067f0 0x7f35dc19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35da59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35dc1067f0 0x7f35dc19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35452/0 (socket says 172.21.15.78:35452) 2024-09-18T13:10:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35da59c640 1 -- 172.21.15.78:0/218225674 learned_addr learned my addr 172.21.15.78:0/218225674 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:10:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35dad9d640 1 --2- 172.21.15.78:0/218225674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35dc1007f0 0x7f35dc19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35da59c640 1 -- 172.21.15.78:0/218225674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35dc1007f0 msgr2=0x7f35dc19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35da59c640 1 --2- 172.21.15.78:0/218225674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35dc1007f0 0x7f35dc19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35da59c640 1 -- 172.21.15.78:0/218225674 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc197750 con 0x7f35dc1067f0 2024-09-18T13:10:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35da59c640 1 --2- 172.21.15.78:0/218225674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35dc1067f0 0x7f35dc19dbc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c8a0 tx=0x7f35d000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35c3fff640 1 -- 172.21.15.78:0/218225674 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35d00079b0 con 0x7f35dc1067f0 2024-09-18T13:10:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35e1044640 1 -- 172.21.15.78:0/218225674 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35dc197a40 con 0x7f35dc1067f0 2024-09-18T13:10:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35c3fff640 1 -- 172.21.15.78:0/218225674 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f35d0007b50 con 0x7f35dc1067f0 2024-09-18T13:10:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35c3fff640 1 -- 172.21.15.78:0/218225674 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35d0018700 con 0x7f35dc1067f0 2024-09-18T13:10:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.588+0000 7f35e1044640 1 -- 172.21.15.78:0/218225674 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35dc197fd0 con 0x7f35dc1067f0 2024-09-18T13:10:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.590+0000 7f35e1044640 1 -- 172.21.15.78:0/218225674 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35dc101f30 con 0x7f35dc1067f0 2024-09-18T13:10:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.590+0000 7f35c3fff640 1 -- 172.21.15.78:0/218225674 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f35d00188c0 con 0x7f35dc1067f0 2024-09-18T13:10:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.590+0000 7f35c3fff640 1 --2- 172.21.15.78:0/218225674 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f35c407af30 0x7f35c407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.591+0000 7f35c3fff640 1 -- 172.21.15.78:0/218225674 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f35d009e290 con 0x7f35dc1067f0 2024-09-18T13:10:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.591+0000 7f35dad9d640 1 --2- 172.21.15.78:0/218225674 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f35c407af30 0x7f35c407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.591+0000 7f35dad9d640 1 --2- 172.21.15.78:0/218225674 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f35c407af30 0x7f35c407d3f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f35cc000c00 tx=0x7f35cc031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.595+0000 7f35c3fff640 1 -- 172.21.15.78:0/218225674 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f35d0014030 con 0x7f35dc1067f0 2024-09-18T13:10:31.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.803+0000 7f35e1044640 1 -- 172.21.15.78:0/218225674 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f35dc198c80 con 0x7f35dc1067f0 2024-09-18T13:10:31.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.803+0000 7f35c3fff640 1 -- 172.21.15.78:0/218225674 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f35d0069830 con 0x7f35dc1067f0 2024-09-18T13:10:31.806 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:10:31.806 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:10:31.806 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:10:31.806 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:10:31.806 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:10:31.807 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:10:31.807 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:10:31.807 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:10:31.807 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:10:31.807 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:10:31.807 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:10:31.807 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:10:31.807 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:10:31.808 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:10:31.808 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:10:31.808 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:10:31.808 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:10:31.808 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:10:31.808 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:10:31.808 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:10:31.808 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:10:31.809 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:10:31.809 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:10:31.809 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:10:31.809 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:10:31.809 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:10:31.809 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:10:31.809 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:10:31.809 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:10:31.810 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:10:31.810 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:10:31.810 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:10:31.810 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:10:31.810 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:10:31.810 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:10:31.810 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:10:31.810 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:10:31.811 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:10:31.811 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:10:31.811 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:10:31.811 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:10:31.811 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:10:31.811 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:10:31.812 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:10:31.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.805+0000 7f35e1044640 1 -- 172.21.15.78:0/218225674 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f35c407af30 msgr2=0x7f35c407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:31.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.805+0000 7f35e1044640 1 --2- 172.21.15.78:0/218225674 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f35c407af30 0x7f35c407d3f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f35cc000c00 tx=0x7f35cc031400 comp rx=0 tx=0).stop 2024-09-18T13:10:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.805+0000 7f35e1044640 1 -- 172.21.15.78:0/218225674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35dc1067f0 msgr2=0x7f35dc19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.805+0000 7f35e1044640 1 --2- 172.21.15.78:0/218225674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35dc1067f0 0x7f35dc19dbc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c8a0 tx=0x7f35d000cd60 comp rx=0 tx=0).stop 2024-09-18T13:10:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.805+0000 7f35e1044640 1 -- 172.21.15.78:0/218225674 shutdown_connections 2024-09-18T13:10:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.805+0000 7f35e1044640 1 --2- 172.21.15.78:0/218225674 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f35c407af30 0x7f35c407d3f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.805+0000 7f35e1044640 1 --2- 172.21.15.78:0/218225674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35dc1067f0 0x7f35dc19dbc0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.805+0000 7f35e1044640 1 --2- 172.21.15.78:0/218225674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35dc1007f0 0x7f35dc19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.805+0000 7f35e1044640 1 -- 172.21.15.78:0/218225674 >> 172.21.15.78:0/218225674 conn(0x7f35dc0fc550 msgr2=0x7f35dc069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.806+0000 7f35e1044640 1 -- 172.21.15.78:0/218225674 shutdown_connections 2024-09-18T13:10:31.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.806+0000 7f35e1044640 1 -- 172.21.15.78:0/218225674 wait complete. 2024-09-18T13:10:31.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.888+0000 7f397f610640 1 -- 172.21.15.78:0/2299124569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3978101900 msgr2=0x7f3978101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:31.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.888+0000 7f397f610640 1 --2- 172.21.15.78:0/2299124569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3978101900 0x7f3978101d60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3974009880 tx=0x7f397402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.888+0000 7f397f610640 1 -- 172.21.15.78:0/2299124569 shutdown_connections 2024-09-18T13:10:31.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.888+0000 7f397f610640 1 --2- 172.21.15.78:0/2299124569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3978101900 0x7f3978101d60 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.888+0000 7f397f610640 1 --2- 172.21.15.78:0/2299124569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3978107900 0x7f3978107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.888+0000 7f397f610640 1 -- 172.21.15.78:0/2299124569 >> 172.21.15.78:0/2299124569 conn(0x7f39780fd600 msgr2=0x7f39780ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:31.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.888+0000 7f397f610640 1 -- 172.21.15.78:0/2299124569 shutdown_connections 2024-09-18T13:10:31.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.888+0000 7f397f610640 1 -- 172.21.15.78:0/2299124569 wait complete. 2024-09-18T13:10:31.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.889+0000 7f397f610640 1 Processor -- start 2024-09-18T13:10:31.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.889+0000 7f397f610640 1 -- start start 2024-09-18T13:10:31.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.889+0000 7f397f610640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3978101900 0x7f397819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:31.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.889+0000 7f397f610640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3978107900 0x7f397819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:31.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.889+0000 7f397f610640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f397810edb0 con 0x7f3978107900 2024-09-18T13:10:31.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.889+0000 7f397f610640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f397810ec30 con 0x7f3978101900 2024-09-18T13:10:31.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.889+0000 7f397cbab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3978107900 0x7f397819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:31.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.889+0000 7f397cbab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3978107900 0x7f397819db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35464/0 (socket says 172.21.15.78:35464) 2024-09-18T13:10:31.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.889+0000 7f397cbab640 1 -- 172.21.15.78:0/2988614494 learned_addr learned my addr 172.21.15.78:0/2988614494 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:10:31.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.889+0000 7f397d3ac640 1 --2- 172.21.15.78:0/2988614494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3978101900 0x7f397819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:31.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.890+0000 7f397cbab640 1 -- 172.21.15.78:0/2988614494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3978101900 msgr2=0x7f397819d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:31.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.890+0000 7f397cbab640 1 --2- 172.21.15.78:0/2988614494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3978101900 0x7f397819d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:31.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.890+0000 7f397cbab640 1 -- 172.21.15.78:0/2988614494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39781977d0 con 0x7f3978107900 2024-09-18T13:10:31.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.890+0000 7f397d3ac640 1 --2- 172.21.15.78:0/2988614494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3978101900 0x7f397819d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:10:31.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.890+0000 7f397cbab640 1 --2- 172.21.15.78:0/2988614494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3978107900 0x7f397819db90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3974031460 tx=0x7f39740045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:31.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.890+0000 7f396e7fc640 1 -- 172.21.15.78:0/2988614494 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f397403f070 con 0x7f3978107900 2024-09-18T13:10:31.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.890+0000 7f396e7fc640 1 -- 172.21.15.78:0/2988614494 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39740035f0 con 0x7f3978107900 2024-09-18T13:10:31.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.890+0000 7f397f610640 1 -- 172.21.15.78:0/2988614494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3978197a60 con 0x7f3978107900 2024-09-18T13:10:31.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.890+0000 7f396e7fc640 1 -- 172.21.15.78:0/2988614494 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3974035030 con 0x7f3978107900 2024-09-18T13:10:31.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.890+0000 7f397f610640 1 -- 172.21.15.78:0/2988614494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3978197f90 con 0x7f3978107900 2024-09-18T13:10:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.891+0000 7f397f610640 1 -- 172.21.15.78:0/2988614494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3978103040 con 0x7f3978107900 2024-09-18T13:10:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.892+0000 7f396e7fc640 1 -- 172.21.15.78:0/2988614494 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3974042070 con 0x7f3978107900 2024-09-18T13:10:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.892+0000 7f396e7fc640 1 --2- 172.21.15.78:0/2988614494 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f396407af80 0x7f396407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.892+0000 7f396e7fc640 1 -- 172.21.15.78:0/2988614494 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f39740bea10 con 0x7f3978107900 2024-09-18T13:10:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.892+0000 7f397d3ac640 1 --2- 172.21.15.78:0/2988614494 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f396407af80 0x7f396407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.893+0000 7f397d3ac640 1 --2- 172.21.15.78:0/2988614494 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f396407af80 0x7f396407d440 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f39680058c0 tx=0x7f3968005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:31.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:31.897+0000 7f396e7fc640 1 -- 172.21.15.78:0/2988614494 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3974089f90 con 0x7f3978107900 2024-09-18T13:10:32.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.090+0000 7f397f610640 1 -- 172.21.15.78:0/2988614494 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3978198300 con 0x7f396407af80 2024-09-18T13:10:32.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.092+0000 7f396e7fc640 1 -- 172.21.15.78:0/2988614494 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3978198300 con 0x7f396407af80 2024-09-18T13:10:32.094 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:10:32.094 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:10:32.094 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:10:32.094 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:10:32.094 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:10:32.094 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:10:32.094 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:10:32.094 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:10:32.095 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:10:32.095 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:10:32.095 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:10:32.095 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:10:32.095 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:10:32.095 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:10:32.095 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:10:32.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.094+0000 7f397f610640 1 -- 172.21.15.78:0/2988614494 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f396407af80 msgr2=0x7f396407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:32.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.094+0000 7f397f610640 1 --2- 172.21.15.78:0/2988614494 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f396407af80 0x7f396407d440 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f39680058c0 tx=0x7f3968005850 comp rx=0 tx=0).stop 2024-09-18T13:10:32.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.094+0000 7f397f610640 1 -- 172.21.15.78:0/2988614494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3978107900 msgr2=0x7f397819db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:32.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.094+0000 7f397f610640 1 --2- 172.21.15.78:0/2988614494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3978107900 0x7f397819db90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3974031460 tx=0x7f39740045e0 comp rx=0 tx=0).stop 2024-09-18T13:10:32.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.094+0000 7f397f610640 1 -- 172.21.15.78:0/2988614494 shutdown_connections 2024-09-18T13:10:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.094+0000 7f397f610640 1 --2- 172.21.15.78:0/2988614494 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f396407af80 0x7f396407d440 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.094+0000 7f397f610640 1 --2- 172.21.15.78:0/2988614494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3978107900 0x7f397819db90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.094+0000 7f397f610640 1 --2- 172.21.15.78:0/2988614494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3978101900 0x7f397819d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.094+0000 7f397f610640 1 -- 172.21.15.78:0/2988614494 >> 172.21.15.78:0/2988614494 conn(0x7f39780fd600 msgr2=0x7f39780fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.094+0000 7f397f610640 1 -- 172.21.15.78:0/2988614494 shutdown_connections 2024-09-18T13:10:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.094+0000 7f397f610640 1 -- 172.21.15.78:0/2988614494 wait complete. 2024-09-18T13:10:32.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.176+0000 7fef3e7ac640 1 -- 172.21.15.78:0/1026734645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef38074510 msgr2=0x7fef380748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:32.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.176+0000 7fef3e7ac640 1 --2- 172.21.15.78:0/1026734645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef38074510 0x7fef380748f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fef28009880 tx=0x7fef2802a530 comp rx=0 tx=0).stop 2024-09-18T13:10:32.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.176+0000 7fef3e7ac640 1 -- 172.21.15.78:0/1026734645 shutdown_connections 2024-09-18T13:10:32.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.176+0000 7fef3e7ac640 1 --2- 172.21.15.78:0/1026734645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef38074e30 0x7fef3810dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:32.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.176+0000 7fef3e7ac640 1 --2- 172.21.15.78:0/1026734645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef38074510 0x7fef380748f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:32.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.176+0000 7fef3e7ac640 1 -- 172.21.15.78:0/1026734645 >> 172.21.15.78:0/1026734645 conn(0x7fef380fd620 msgr2=0x7fef380ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:32.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.177+0000 7fef3e7ac640 1 -- 172.21.15.78:0/1026734645 shutdown_connections 2024-09-18T13:10:32.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.177+0000 7fef3e7ac640 1 -- 172.21.15.78:0/1026734645 wait complete. 2024-09-18T13:10:32.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.177+0000 7fef3e7ac640 1 Processor -- start 2024-09-18T13:10:32.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.177+0000 7fef3e7ac640 1 -- start start 2024-09-18T13:10:32.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.177+0000 7fef3e7ac640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef38074510 0x7fef3819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:32.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.177+0000 7fef3e7ac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef38074e30 0x7fef3819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:32.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.177+0000 7fef3e7ac640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fef38111040 con 0x7fef38074e30 2024-09-18T13:10:32.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.177+0000 7fef3e7ac640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fef38110ec0 con 0x7fef38074510 2024-09-18T13:10:32.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.178+0000 7fef377fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef38074e30 0x7fef3819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:32.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.178+0000 7fef377fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef38074e30 0x7fef3819fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35480/0 (socket says 172.21.15.78:35480) 2024-09-18T13:10:32.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.178+0000 7fef377fe640 1 -- 172.21.15.78:0/4101582602 learned_addr learned my addr 172.21.15.78:0/4101582602 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:10:32.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.178+0000 7fef37fff640 1 --2- 172.21.15.78:0/4101582602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef38074510 0x7fef3819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:32.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.178+0000 7fef377fe640 1 -- 172.21.15.78:0/4101582602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef38074510 msgr2=0x7fef3819f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:32.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.178+0000 7fef377fe640 1 --2- 172.21.15.78:0/4101582602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef38074510 0x7fef3819f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:32.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.178+0000 7fef377fe640 1 -- 172.21.15.78:0/4101582602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef38199a50 con 0x7fef38074e30 2024-09-18T13:10:32.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.178+0000 7fef377fe640 1 --2- 172.21.15.78:0/4101582602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef38074e30 0x7fef3819fdd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00b420 tx=0x7fef2c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:32.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.178+0000 7fef357fa640 1 -- 172.21.15.78:0/4101582602 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef2c011630 con 0x7fef38074e30 2024-09-18T13:10:32.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.178+0000 7fef357fa640 1 -- 172.21.15.78:0/4101582602 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fef2c016070 con 0x7fef38074e30 2024-09-18T13:10:32.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.178+0000 7fef3e7ac640 1 -- 172.21.15.78:0/4101582602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef38199d40 con 0x7fef38074e30 2024-09-18T13:10:32.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.178+0000 7fef357fa640 1 -- 172.21.15.78:0/4101582602 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef2c010d40 con 0x7fef38074e30 2024-09-18T13:10:32.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.178+0000 7fef3e7ac640 1 -- 172.21.15.78:0/4101582602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3819a2d0 con 0x7fef38074e30 2024-09-18T13:10:32.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.180+0000 7fef3e7ac640 1 -- 172.21.15.78:0/4101582602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef38075c50 con 0x7fef38074e30 2024-09-18T13:10:32.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.180+0000 7fef357fa640 1 -- 172.21.15.78:0/4101582602 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fef2c01b460 con 0x7fef38074e30 2024-09-18T13:10:32.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.180+0000 7fef357fa640 1 --2- 172.21.15.78:0/4101582602 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fef2007af80 0x7fef2007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:10:32.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.181+0000 7fef357fa640 1 -- 172.21.15.78:0/4101582602 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fef2c09d670 con 0x7fef38074e30 2024-09-18T13:10:32.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.181+0000 7fef37fff640 1 --2- 172.21.15.78:0/4101582602 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fef2007af80 0x7fef2007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:10:32.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.181+0000 7fef37fff640 1 --2- 172.21.15.78:0/4101582602 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fef2007af80 0x7fef2007d440 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fef28000c00 tx=0x7fef28031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:10:32.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.185+0000 7fef357fa640 1 -- 172.21.15.78:0/4101582602 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fef2c068c90 con 0x7fef38074e30 2024-09-18T13:10:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.428+0000 7fef3e7ac640 1 -- 172.21.15.78:0/4101582602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fef3819af80 con 0x7fef38074e30 2024-09-18T13:10:32.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.428+0000 7fef357fa640 1 -- 172.21.15.78:0/4101582602 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fef2c069e20 con 0x7fef38074e30 2024-09-18T13:10:32.431 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:10:32.431 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:10:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:10:32.431 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:10:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:10:32.431 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:10:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:10:32.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.431+0000 7fef3e7ac640 1 -- 172.21.15.78:0/4101582602 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fef2007af80 msgr2=0x7fef2007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:32.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.431+0000 7fef3e7ac640 1 --2- 172.21.15.78:0/4101582602 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fef2007af80 0x7fef2007d440 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fef28000c00 tx=0x7fef28031400 comp rx=0 tx=0).stop 2024-09-18T13:10:32.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.431+0000 7fef3e7ac640 1 -- 172.21.15.78:0/4101582602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef38074e30 msgr2=0x7fef3819fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:10:32.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.431+0000 7fef3e7ac640 1 --2- 172.21.15.78:0/4101582602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef38074e30 0x7fef3819fdd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00b420 tx=0x7fef2c00b8e0 comp rx=0 tx=0).stop 2024-09-18T13:10:32.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.431+0000 7fef3e7ac640 1 -- 172.21.15.78:0/4101582602 shutdown_connections 2024-09-18T13:10:32.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.431+0000 7fef3e7ac640 1 --2- 172.21.15.78:0/4101582602 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fef2007af80 0x7fef2007d440 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:32.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.431+0000 7fef3e7ac640 1 --2- 172.21.15.78:0/4101582602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef38074e30 0x7fef3819fdd0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:32.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.431+0000 7fef3e7ac640 1 --2- 172.21.15.78:0/4101582602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef38074510 0x7fef3819f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:10:32.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.431+0000 7fef3e7ac640 1 -- 172.21.15.78:0/4101582602 >> 172.21.15.78:0/4101582602 conn(0x7fef380fd620 msgr2=0x7fef3810b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:10:32.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.431+0000 7fef3e7ac640 1 -- 172.21.15.78:0/4101582602 shutdown_connections 2024-09-18T13:10:32.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:10:32.431+0000 7fef3e7ac640 1 -- 172.21.15.78:0/4101582602 wait complete. 2024-09-18T13:10:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:32 smithi148 ceph-mon[80030]: from='client.35002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:10:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:32 smithi148 ceph-mon[80030]: from='client.35006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:10:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:32 smithi148 ceph-mon[80030]: from='client.35010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:10:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:32 smithi148 ceph-mon[80030]: pgmap v641: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:32 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/143784033' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:10:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:32 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/218225674' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:10:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:32 smithi078 ceph-mon[108578]: from='client.35002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:10:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:32 smithi078 ceph-mon[108578]: from='client.35006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:10:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:32 smithi078 ceph-mon[108578]: from='client.35010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:10:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:32 smithi078 ceph-mon[108578]: pgmap v641: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:32 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/143784033' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:10:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:32 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/218225674' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:10:33.644 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:33 smithi078 ceph-mon[108578]: from='client.35022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:10:33.645 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:33 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/4101582602' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:10:33.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:33 smithi148 ceph-mon[80030]: from='client.35022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:10:33.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:33 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/4101582602' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:10:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:34 smithi148 ceph-mon[80030]: pgmap v642: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:34 smithi078 ceph-mon[108578]: pgmap v642: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:36.708 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:36 smithi078 ceph-mon[108578]: pgmap v643: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:36.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:36 smithi148 ceph-mon[80030]: pgmap v643: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:38.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:38 smithi148 ceph-mon[80030]: pgmap v644: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:38.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:38 smithi078 ceph-mon[108578]: pgmap v644: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:40 smithi148 ceph-mon[80030]: pgmap v645: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:40 smithi078 ceph-mon[108578]: pgmap v645: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:10:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:10:42.709 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:42 smithi078 ceph-mon[108578]: pgmap v646: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:42.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:42 smithi148 ceph-mon[80030]: pgmap v646: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:44 smithi148 ceph-mon[80030]: pgmap v647: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:44 smithi078 ceph-mon[108578]: pgmap v647: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:46 smithi148 ceph-mon[80030]: pgmap v648: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:46.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:46 smithi078 ceph-mon[108578]: pgmap v648: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:48.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:48 smithi078 ceph-mon[108578]: pgmap v649: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:48.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:48 smithi148 ceph-mon[80030]: pgmap v649: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:50 smithi148 ceph-mon[80030]: pgmap v650: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:50 smithi078 ceph-mon[108578]: pgmap v650: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:52 smithi148 ceph-mon[80030]: pgmap v651: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:52.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:52 smithi078 ceph-mon[108578]: pgmap v651: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:54.704 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:54 smithi078 ceph-mon[108578]: pgmap v652: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:54.709 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:54 smithi148 ceph-mon[80030]: pgmap v652: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:56 smithi148 ceph-mon[80030]: pgmap v653: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:10:56.731 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:56 smithi078 ceph-mon[108578]: pgmap v653: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:56.732 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:10:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:10:58 smithi148 ceph-mon[80030]: pgmap v654: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:10:58.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:10:58 smithi078 ceph-mon[108578]: pgmap v654: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:00.712 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:00 smithi078 ceph-mon[108578]: pgmap v655: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:00.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:00 smithi148 ceph-mon[80030]: pgmap v655: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:02.525 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:02 smithi148 ceph-mon[80030]: pgmap v656: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:02.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.524+0000 7f5fc8f82640 1 -- 172.21.15.78:0/2295587739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc4102b60 msgr2=0x7f5fc4102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:02.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.524+0000 7f5fc8f82640 1 --2- 172.21.15.78:0/2295587739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc4102b60 0x7f5fc4102f40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4009880 tx=0x7f5fb402a530 comp rx=0 tx=0).stop 2024-09-18T13:11:02.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.524+0000 7f5fc8f82640 1 -- 172.21.15.78:0/2295587739 shutdown_connections 2024-09-18T13:11:02.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.524+0000 7f5fc8f82640 1 --2- 172.21.15.78:0/2295587739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc4103480 0x7f5fc410b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:02.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.524+0000 7f5fc8f82640 1 --2- 172.21.15.78:0/2295587739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc4102b60 0x7f5fc4102f40 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:02.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.524+0000 7f5fc8f82640 1 -- 172.21.15.78:0/2295587739 >> 172.21.15.78:0/2295587739 conn(0x7f5fc40fc520 msgr2=0x7f5fc40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:02.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.524+0000 7f5fc8f82640 1 -- 172.21.15.78:0/2295587739 shutdown_connections 2024-09-18T13:11:02.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.524+0000 7f5fc8f82640 1 -- 172.21.15.78:0/2295587739 wait complete. 2024-09-18T13:11:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.525+0000 7f5fc8f82640 1 Processor -- start 2024-09-18T13:11:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.525+0000 7f5fc8f82640 1 -- start start 2024-09-18T13:11:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.526+0000 7f5fc8f82640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc4102b60 0x7f5fc419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.526+0000 7f5fc8f82640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc4103480 0x7f5fc419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.526+0000 7f5fc8f82640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc410edf0 con 0x7f5fc4103480 2024-09-18T13:11:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.526+0000 7f5fc8f82640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc410ec70 con 0x7f5fc4102b60 2024-09-18T13:11:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.526+0000 7f5fb9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc4103480 0x7f5fc419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.526+0000 7f5fb9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc4103480 0x7f5fc419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35848/0 (socket says 172.21.15.78:35848) 2024-09-18T13:11:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.526+0000 7f5fb9d9b640 1 -- 172.21.15.78:0/4004682461 learned_addr learned my addr 172.21.15.78:0/4004682461 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:11:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.526+0000 7f5fc259c640 1 --2- 172.21.15.78:0/4004682461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc4102b60 0x7f5fc419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.526+0000 7f5fb9d9b640 1 -- 172.21.15.78:0/4004682461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc4102b60 msgr2=0x7f5fc419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.526+0000 7f5fb9d9b640 1 --2- 172.21.15.78:0/4004682461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc4102b60 0x7f5fc419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.526+0000 7f5fb9d9b640 1 -- 172.21.15.78:0/4004682461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc4197880 con 0x7f5fc4103480 2024-09-18T13:11:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.526+0000 7f5fb9d9b640 1 --2- 172.21.15.78:0/4004682461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc4103480 0x7f5fc419dc00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00d6f0 tx=0x7f5fac00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.527+0000 7f5fbbfff640 1 -- 172.21.15.78:0/4004682461 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fac017070 con 0x7f5fc4103480 2024-09-18T13:11:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.527+0000 7f5fc8f82640 1 -- 172.21.15.78:0/4004682461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc4197b70 con 0x7f5fc4103480 2024-09-18T13:11:02.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.527+0000 7f5fbbfff640 1 -- 172.21.15.78:0/4004682461 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5fac00de00 con 0x7f5fc4103480 2024-09-18T13:11:02.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.527+0000 7f5fbbfff640 1 -- 172.21.15.78:0/4004682461 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fac004bb0 con 0x7f5fc4103480 2024-09-18T13:11:02.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.527+0000 7f5fc8f82640 1 -- 172.21.15.78:0/4004682461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc4198100 con 0x7f5fc4103480 2024-09-18T13:11:02.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.528+0000 7f5fc8f82640 1 -- 172.21.15.78:0/4004682461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc406a9f0 con 0x7f5fc4103480 2024-09-18T13:11:02.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.529+0000 7f5fbbfff640 1 -- 172.21.15.78:0/4004682461 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5fac004e60 con 0x7f5fc4103480 2024-09-18T13:11:02.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.530+0000 7f5fbbfff640 1 --2- 172.21.15.78:0/4004682461 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5fb007af30 0x7f5fb007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:02.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.530+0000 7f5fc259c640 1 --2- 172.21.15.78:0/4004682461 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5fb007af30 0x7f5fb007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:02.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.530+0000 7f5fbbfff640 1 -- 172.21.15.78:0/4004682461 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f5fac09df90 con 0x7f5fc4103480 2024-09-18T13:11:02.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.531+0000 7f5fc259c640 1 --2- 172.21.15.78:0/4004682461 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5fb007af30 0x7f5fb007d3f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4000c00 tx=0x7f5fb4004f30 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:02.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.534+0000 7f5fbbfff640 1 -- 172.21.15.78:0/4004682461 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5fac069650 con 0x7f5fc4103480 2024-09-18T13:11:02.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.724+0000 7f5fc8f82640 1 -- 172.21.15.78:0/4004682461 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5fc4198db0 con 0x7f5fb007af30 2024-09-18T13:11:02.725 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:02 smithi078 ceph-mon[108578]: pgmap v656: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:02.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.725+0000 7f5fbbfff640 1 -- 172.21.15.78:0/4004682461 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5fc4198db0 con 0x7f5fb007af30 2024-09-18T13:11:02.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.727+0000 7f5fc8f82640 1 -- 172.21.15.78:0/4004682461 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5fb007af30 msgr2=0x7f5fb007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.727+0000 7f5fc8f82640 1 --2- 172.21.15.78:0/4004682461 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5fb007af30 0x7f5fb007d3f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4000c00 tx=0x7f5fb4004f30 comp rx=0 tx=0).stop 2024-09-18T13:11:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.727+0000 7f5fc8f82640 1 -- 172.21.15.78:0/4004682461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc4103480 msgr2=0x7f5fc419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.727+0000 7f5fc8f82640 1 --2- 172.21.15.78:0/4004682461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc4103480 0x7f5fc419dc00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00d6f0 tx=0x7f5fac00dbb0 comp rx=0 tx=0).stop 2024-09-18T13:11:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.727+0000 7f5fc8f82640 1 -- 172.21.15.78:0/4004682461 shutdown_connections 2024-09-18T13:11:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.727+0000 7f5fc8f82640 1 --2- 172.21.15.78:0/4004682461 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5fb007af30 0x7f5fb007d3f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.727+0000 7f5fc8f82640 1 --2- 172.21.15.78:0/4004682461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fc4103480 0x7f5fc419dc00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.727+0000 7f5fc8f82640 1 --2- 172.21.15.78:0/4004682461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fc4102b60 0x7f5fc419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.727+0000 7f5fc8f82640 1 -- 172.21.15.78:0/4004682461 >> 172.21.15.78:0/4004682461 conn(0x7f5fc40fc520 msgr2=0x7f5fc4107e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.727+0000 7f5fc8f82640 1 -- 172.21.15.78:0/4004682461 shutdown_connections 2024-09-18T13:11:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.727+0000 7f5fc8f82640 1 -- 172.21.15.78:0/4004682461 wait complete. 2024-09-18T13:11:02.737 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:11:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.810+0000 7f9d1ca65640 1 -- 172.21.15.78:0/3011793979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d18100800 msgr2=0x7f9d18100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.810+0000 7f9d1ca65640 1 --2- 172.21.15.78:0/3011793979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d18100800 0x7f9d18100c60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009880 tx=0x7f9d0002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:11:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.810+0000 7f9d1ca65640 1 -- 172.21.15.78:0/3011793979 shutdown_connections 2024-09-18T13:11:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.810+0000 7f9d1ca65640 1 --2- 172.21.15.78:0/3011793979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d18100800 0x7f9d18100c60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.810+0000 7f9d1ca65640 1 --2- 172.21.15.78:0/3011793979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d18106800 0x7f9d18106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.810+0000 7f9d1ca65640 1 -- 172.21.15.78:0/3011793979 >> 172.21.15.78:0/3011793979 conn(0x7f9d180fc520 msgr2=0x7f9d180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:02.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.810+0000 7f9d1ca65640 1 -- 172.21.15.78:0/3011793979 shutdown_connections 2024-09-18T13:11:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.810+0000 7f9d1ca65640 1 -- 172.21.15.78:0/3011793979 wait complete. 2024-09-18T13:11:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.811+0000 7f9d1ca65640 1 Processor -- start 2024-09-18T13:11:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.811+0000 7f9d1ca65640 1 -- start start 2024-09-18T13:11:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.811+0000 7f9d1ca65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d18100800 0x7f9d181987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.811+0000 7f9d1ca65640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d18106800 0x7f9d18198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.811+0000 7f9d1ca65640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1810dcd0 con 0x7f9d18100800 2024-09-18T13:11:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.811+0000 7f9d1ca65640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1810db50 con 0x7f9d18106800 2024-09-18T13:11:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.811+0000 7f9d1659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d18100800 0x7f9d181987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.811+0000 7f9d1659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d18100800 0x7f9d181987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35872/0 (socket says 172.21.15.78:35872) 2024-09-18T13:11:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.811+0000 7f9d1659c640 1 -- 172.21.15.78:0/1188151831 learned_addr learned my addr 172.21.15.78:0/1188151831 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:11:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.811+0000 7f9d15d9b640 1 --2- 172.21.15.78:0/1188151831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d18106800 0x7f9d18198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:02.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.811+0000 7f9d1659c640 1 -- 172.21.15.78:0/1188151831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d18106800 msgr2=0x7f9d18198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:02.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.811+0000 7f9d1659c640 1 --2- 172.21.15.78:0/1188151831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d18106800 0x7f9d18198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:02.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.811+0000 7f9d1659c640 1 -- 172.21.15.78:0/1188151831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d18199320 con 0x7f9d18100800 2024-09-18T13:11:02.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.812+0000 7f9d1659c640 1 --2- 172.21.15.78:0/1188151831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d18100800 0x7f9d181987e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000eb10 tx=0x7f9d1000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:02.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.812+0000 7f9d0f7fe640 1 -- 172.21.15.78:0/1188151831 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d1000cce0 con 0x7f9d18100800 2024-09-18T13:11:02.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.812+0000 7f9d1ca65640 1 -- 172.21.15.78:0/1188151831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d18199610 con 0x7f9d18100800 2024-09-18T13:11:02.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.812+0000 7f9d0f7fe640 1 -- 172.21.15.78:0/1188151831 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d10005020 con 0x7f9d18100800 2024-09-18T13:11:02.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.812+0000 7f9d0f7fe640 1 -- 172.21.15.78:0/1188151831 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d10010660 con 0x7f9d18100800 2024-09-18T13:11:02.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.812+0000 7f9d1ca65640 1 -- 172.21.15.78:0/1188151831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d181a1c10 con 0x7f9d18100800 2024-09-18T13:11:02.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.813+0000 7f9d1ca65640 1 -- 172.21.15.78:0/1188151831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d18101f40 con 0x7f9d18100800 2024-09-18T13:11:02.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.813+0000 7f9d0f7fe640 1 -- 172.21.15.78:0/1188151831 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9d100051d0 con 0x7f9d18100800 2024-09-18T13:11:02.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.814+0000 7f9d0f7fe640 1 --2- 172.21.15.78:0/1188151831 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9d0407af30 0x7f9d0407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:02.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.814+0000 7f9d15d9b640 1 --2- 172.21.15.78:0/1188151831 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9d0407af30 0x7f9d0407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:02.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.814+0000 7f9d0f7fe640 1 -- 172.21.15.78:0/1188151831 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f9d1009e8b0 con 0x7f9d18100800 2024-09-18T13:11:02.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.815+0000 7f9d15d9b640 1 --2- 172.21.15.78:0/1188151831 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9d0407af30 0x7f9d0407d3f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9d1806ad00 tx=0x7f9d00031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:02.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:02.819+0000 7f9d0f7fe640 1 -- 172.21.15.78:0/1188151831 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9d18199610 con 0x7f9d18100800 2024-09-18T13:11:03.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.009+0000 7f9d1ca65640 1 -- 172.21.15.78:0/1188151831 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9d18062630 con 0x7f9d0407af30 2024-09-18T13:11:03.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.011+0000 7f9d0f7fe640 1 -- 172.21.15.78:0/1188151831 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9d18062630 con 0x7f9d0407af30 2024-09-18T13:11:03.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.013+0000 7f9d1ca65640 1 -- 172.21.15.78:0/1188151831 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9d0407af30 msgr2=0x7f9d0407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:03.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.013+0000 7f9d1ca65640 1 --2- 172.21.15.78:0/1188151831 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9d0407af30 0x7f9d0407d3f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9d1806ad00 tx=0x7f9d00031400 comp rx=0 tx=0).stop 2024-09-18T13:11:03.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.013+0000 7f9d1ca65640 1 -- 172.21.15.78:0/1188151831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d18100800 msgr2=0x7f9d181987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:03.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.013+0000 7f9d1ca65640 1 --2- 172.21.15.78:0/1188151831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d18100800 0x7f9d181987e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000eb10 tx=0x7f9d1000c2d0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.013+0000 7f9d1ca65640 1 -- 172.21.15.78:0/1188151831 shutdown_connections 2024-09-18T13:11:03.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.013+0000 7f9d1ca65640 1 --2- 172.21.15.78:0/1188151831 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9d0407af30 0x7f9d0407d3f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.013+0000 7f9d1ca65640 1 --2- 172.21.15.78:0/1188151831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d18106800 0x7f9d18198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.013+0000 7f9d1ca65640 1 --2- 172.21.15.78:0/1188151831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d18100800 0x7f9d181987e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.013+0000 7f9d1ca65640 1 -- 172.21.15.78:0/1188151831 >> 172.21.15.78:0/1188151831 conn(0x7f9d180fc520 msgr2=0x7f9d180fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:03.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.013+0000 7f9d1ca65640 1 -- 172.21.15.78:0/1188151831 shutdown_connections 2024-09-18T13:11:03.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.013+0000 7f9d1ca65640 1 -- 172.21.15.78:0/1188151831 wait complete. 2024-09-18T13:11:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.095+0000 7f8137605640 1 -- 172.21.15.78:0/3842012913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8130100c00 msgr2=0x7f8130104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.095+0000 7f8137605640 1 --2- 172.21.15.78:0/3842012913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8130100c00 0x7f8130104c50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f812c00a990 tx=0x7f812c02b7d0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.095+0000 7f8137605640 1 -- 172.21.15.78:0/3842012913 shutdown_connections 2024-09-18T13:11:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.095+0000 7f8137605640 1 --2- 172.21.15.78:0/3842012913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8130100c00 0x7f8130104c50 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.095+0000 7f8137605640 1 --2- 172.21.15.78:0/3842012913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8130100250 0x7f8130100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.095+0000 7f8137605640 1 -- 172.21.15.78:0/3842012913 >> 172.21.15.78:0/3842012913 conn(0x7f81300fbc90 msgr2=0x7f81300fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.095+0000 7f8137605640 1 -- 172.21.15.78:0/3842012913 shutdown_connections 2024-09-18T13:11:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.095+0000 7f8137605640 1 -- 172.21.15.78:0/3842012913 wait complete. 2024-09-18T13:11:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.095+0000 7f8137605640 1 Processor -- start 2024-09-18T13:11:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.095+0000 7f8137605640 1 -- start start 2024-09-18T13:11:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f8137605640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8130100250 0x7f813019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f8137605640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8130100c00 0x7f813019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f8137605640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f813010cbd0 con 0x7f8130100c00 2024-09-18T13:11:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f8137605640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f813010ca50 con 0x7f8130100250 2024-09-18T13:11:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f8134ba0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8130100c00 0x7f813019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f8134ba0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8130100c00 0x7f813019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35886/0 (socket says 172.21.15.78:35886) 2024-09-18T13:11:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f8134ba0640 1 -- 172.21.15.78:0/3732384994 learned_addr learned my addr 172.21.15.78:0/3732384994 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:11:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f81353a1640 1 --2- 172.21.15.78:0/3732384994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8130100250 0x7f813019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f8134ba0640 1 -- 172.21.15.78:0/3732384994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8130100250 msgr2=0x7f813019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f8134ba0640 1 --2- 172.21.15.78:0/3732384994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8130100250 0x7f813019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f8134ba0640 1 -- 172.21.15.78:0/3732384994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8130197810 con 0x7f8130100c00 2024-09-18T13:11:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f8134ba0640 1 --2- 172.21.15.78:0/3732384994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8130100c00 0x7f813019db80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f812c006010 tx=0x7f812c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f81227fc640 1 -- 172.21.15.78:0/3732384994 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f812c008e90 con 0x7f8130100c00 2024-09-18T13:11:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f8137605640 1 -- 172.21.15.78:0/3732384994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8130197aa0 con 0x7f8130100c00 2024-09-18T13:11:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f81227fc640 1 -- 172.21.15.78:0/3732384994 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f812c045070 con 0x7f8130100c00 2024-09-18T13:11:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.096+0000 7f81227fc640 1 -- 172.21.15.78:0/3732384994 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f812c0035f0 con 0x7f8130100c00 2024-09-18T13:11:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.097+0000 7f8137605640 1 -- 172.21.15.78:0/3732384994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8130197fd0 con 0x7f8130100c00 2024-09-18T13:11:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.097+0000 7f8137605640 1 -- 172.21.15.78:0/3732384994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8130101730 con 0x7f8130100c00 2024-09-18T13:11:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.098+0000 7f81227fc640 1 -- 172.21.15.78:0/3732384994 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f812c032070 con 0x7f8130100c00 2024-09-18T13:11:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.099+0000 7f81227fc640 1 --2- 172.21.15.78:0/3732384994 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f811c07af30 0x7f811c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.099+0000 7f81227fc640 1 -- 172.21.15.78:0/3732384994 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f812c008030 con 0x7f8130100c00 2024-09-18T13:11:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.099+0000 7f81353a1640 1 --2- 172.21.15.78:0/3732384994 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f811c07af30 0x7f811c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.099+0000 7f81353a1640 1 --2- 172.21.15.78:0/3732384994 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f811c07af30 0x7f811c07d3f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8124005fd0 tx=0x7f812400b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.103+0000 7f81227fc640 1 -- 172.21.15.78:0/3732384994 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f812c08a6a0 con 0x7f8130100c00 2024-09-18T13:11:03.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.289+0000 7f8137605640 1 -- 172.21.15.78:0/3732384994 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8130198280 con 0x7f811c07af30 2024-09-18T13:11:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.298+0000 7f81227fc640 1 -- 172.21.15.78:0/3732384994 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f8130198280 con 0x7f811c07af30 2024-09-18T13:11:03.300 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:11:03.300 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (18m) 13m ago 29m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:11:03.300 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (21m) 13m ago 30m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:11:03.300 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (21m) 12m ago 29m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:11:03.300 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (17m) 13m ago 30m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:11:03.300 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (17m) 12m ago 29m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:11:03.300 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (18m) 13m ago 29m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:11:03.300 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (13m) 13m ago 24m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:11:03.301 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (13m) 13m ago 24m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:11:03.301 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (12m) 12m ago 24m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:11:03.301 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (12m) 12m ago 24m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:11:03.301 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (21m) 13m ago 31m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:11:03.301 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (19m) 12m ago 29m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:11:03.301 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (17m) 13m ago 31m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:11:03.301 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (17m) 12m ago 28m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:11:03.301 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (19m) 13m ago 29m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:11:03.301 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (19m) 12m ago 29m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:11:03.301 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (16m) 13m ago 27m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:11:03.301 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (16m) 13m ago 27m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:11:03.301 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (15m) 13m ago 26m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:11:03.302 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (14m) 12m ago 26m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:11:03.302 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (14m) 12m ago 25m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:11:03.302 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (13m) 12m ago 25m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:11:03.302 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (19m) 13m ago 29m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:11:03.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.300+0000 7f8137605640 1 -- 172.21.15.78:0/3732384994 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f811c07af30 msgr2=0x7f811c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:03.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.300+0000 7f8137605640 1 --2- 172.21.15.78:0/3732384994 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f811c07af30 0x7f811c07d3f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8124005fd0 tx=0x7f812400b390 comp rx=0 tx=0).stop 2024-09-18T13:11:03.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.300+0000 7f8137605640 1 -- 172.21.15.78:0/3732384994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8130100c00 msgr2=0x7f813019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:03.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.300+0000 7f8137605640 1 --2- 172.21.15.78:0/3732384994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8130100c00 0x7f813019db80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f812c006010 tx=0x7f812c004270 comp rx=0 tx=0).stop 2024-09-18T13:11:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.301+0000 7f8137605640 1 -- 172.21.15.78:0/3732384994 shutdown_connections 2024-09-18T13:11:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.301+0000 7f8137605640 1 --2- 172.21.15.78:0/3732384994 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f811c07af30 0x7f811c07d3f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.301+0000 7f8137605640 1 --2- 172.21.15.78:0/3732384994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8130100c00 0x7f813019db80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.301+0000 7f8137605640 1 --2- 172.21.15.78:0/3732384994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8130100250 0x7f813019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.301+0000 7f8137605640 1 -- 172.21.15.78:0/3732384994 >> 172.21.15.78:0/3732384994 conn(0x7f81300fbc90 msgr2=0x7f81300fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.301+0000 7f8137605640 1 -- 172.21.15.78:0/3732384994 shutdown_connections 2024-09-18T13:11:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.301+0000 7f8137605640 1 -- 172.21.15.78:0/3732384994 wait complete. 2024-09-18T13:11:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.380+0000 7fe8e22b0640 1 -- 172.21.15.78:0/7127859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8dc101900 msgr2=0x7fe8dc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.380+0000 7fe8e22b0640 1 --2- 172.21.15.78:0/7127859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8dc101900 0x7fe8dc101d60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009880 tx=0x7fe8c402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.380+0000 7fe8e22b0640 1 -- 172.21.15.78:0/7127859 shutdown_connections 2024-09-18T13:11:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.380+0000 7fe8e22b0640 1 --2- 172.21.15.78:0/7127859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8dc101900 0x7fe8dc101d60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.380+0000 7fe8e22b0640 1 --2- 172.21.15.78:0/7127859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8dc107900 0x7fe8dc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.380+0000 7fe8e22b0640 1 -- 172.21.15.78:0/7127859 >> 172.21.15.78:0/7127859 conn(0x7fe8dc0fd600 msgr2=0x7fe8dc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.380+0000 7fe8e22b0640 1 -- 172.21.15.78:0/7127859 shutdown_connections 2024-09-18T13:11:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.380+0000 7fe8e22b0640 1 -- 172.21.15.78:0/7127859 wait complete. 2024-09-18T13:11:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.380+0000 7fe8e22b0640 1 Processor -- start 2024-09-18T13:11:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.380+0000 7fe8e22b0640 1 -- start start 2024-09-18T13:11:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8e22b0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8dc101900 0x7fe8dc19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8e22b0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8dc107900 0x7fe8dc19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8e22b0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc10ee30 con 0x7fe8dc101900 2024-09-18T13:11:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8e22b0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc10ecb0 con 0x7fe8dc107900 2024-09-18T13:11:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8dbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8dc101900 0x7fe8dc19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:03.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8dbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8dc101900 0x7fe8dc19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35906/0 (socket says 172.21.15.78:35906) 2024-09-18T13:11:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8dbfff640 1 -- 172.21.15.78:0/1422973859 learned_addr learned my addr 172.21.15.78:0/1422973859 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:11:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8db7fe640 1 --2- 172.21.15.78:0/1422973859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8dc107900 0x7fe8dc19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8dbfff640 1 -- 172.21.15.78:0/1422973859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8dc107900 msgr2=0x7fe8dc19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8dbfff640 1 --2- 172.21.15.78:0/1422973859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8dc107900 0x7fe8dc19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8dbfff640 1 -- 172.21.15.78:0/1422973859 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc197840 con 0x7fe8dc101900 2024-09-18T13:11:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8db7fe640 1 --2- 172.21.15.78:0/1422973859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8dc107900 0x7fe8dc19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:11:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8dbfff640 1 --2- 172.21.15.78:0/1422973859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8dc101900 0x7fe8dc19d6c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00b420 tx=0x7fe8cc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8d97fa640 1 -- 172.21.15.78:0/1422973859 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe8cc011630 con 0x7fe8dc101900 2024-09-18T13:11:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8d97fa640 1 -- 172.21.15.78:0/1422973859 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe8cc016070 con 0x7fe8dc101900 2024-09-18T13:11:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8e22b0640 1 -- 172.21.15.78:0/1422973859 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8dc197b30 con 0x7fe8dc101900 2024-09-18T13:11:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.381+0000 7fe8d97fa640 1 -- 172.21.15.78:0/1422973859 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe8cc010d40 con 0x7fe8dc101900 2024-09-18T13:11:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.382+0000 7fe8e22b0640 1 -- 172.21.15.78:0/1422973859 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8dc198090 con 0x7fe8dc101900 2024-09-18T13:11:03.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.382+0000 7fe8e22b0640 1 -- 172.21.15.78:0/1422973859 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8dc103040 con 0x7fe8dc101900 2024-09-18T13:11:03.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.383+0000 7fe8d97fa640 1 -- 172.21.15.78:0/1422973859 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe8cc01b460 con 0x7fe8dc101900 2024-09-18T13:11:03.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.384+0000 7fe8d97fa640 1 --2- 172.21.15.78:0/1422973859 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe8c807af30 0x7fe8c807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:03.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.384+0000 7fe8d97fa640 1 -- 172.21.15.78:0/1422973859 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fe8cc09d800 con 0x7fe8dc101900 2024-09-18T13:11:03.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.384+0000 7fe8db7fe640 1 --2- 172.21.15.78:0/1422973859 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe8c807af30 0x7fe8c807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:03.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.384+0000 7fe8db7fe640 1 --2- 172.21.15.78:0/1422973859 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe8c807af30 0x7fe8c807d3f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc198b90 tx=0x7fe8c4031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.389+0000 7fe8d97fa640 1 -- 172.21.15.78:0/1422973859 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe8cc021250 con 0x7fe8dc101900 2024-09-18T13:11:03.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.632+0000 7fe8e22b0640 1 -- 172.21.15.78:0/1422973859 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe8dc109e90 con 0x7fe8dc101900 2024-09-18T13:11:03.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.632+0000 7fe8d97fa640 1 -- 172.21.15.78:0/1422973859 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fe8cc068d40 con 0x7fe8dc101900 2024-09-18T13:11:03.634 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:11:03.634 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:11:03.634 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:11:03.634 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:11:03.634 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:11:03.634 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:11:03.634 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:11:03.634 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:11:03.634 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:11:03.634 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:11:03.634 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:11:03.635 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:11:03.635 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:11:03.635 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:11:03.635 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:11:03.635 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:11:03.635 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:11:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.635+0000 7fe8e22b0640 1 -- 172.21.15.78:0/1422973859 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe8c807af30 msgr2=0x7fe8c807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.635+0000 7fe8e22b0640 1 --2- 172.21.15.78:0/1422973859 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe8c807af30 0x7fe8c807d3f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc198b90 tx=0x7fe8c4031400 comp rx=0 tx=0).stop 2024-09-18T13:11:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.635+0000 7fe8e22b0640 1 -- 172.21.15.78:0/1422973859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8dc101900 msgr2=0x7fe8dc19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.635+0000 7fe8e22b0640 1 --2- 172.21.15.78:0/1422973859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8dc101900 0x7fe8dc19d6c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00b420 tx=0x7fe8cc00b8e0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.635+0000 7fe8e22b0640 1 -- 172.21.15.78:0/1422973859 shutdown_connections 2024-09-18T13:11:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.635+0000 7fe8e22b0640 1 --2- 172.21.15.78:0/1422973859 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe8c807af30 0x7fe8c807d3f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.635+0000 7fe8e22b0640 1 --2- 172.21.15.78:0/1422973859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8dc107900 0x7fe8dc19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.635+0000 7fe8e22b0640 1 --2- 172.21.15.78:0/1422973859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8dc101900 0x7fe8dc19d6c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.635+0000 7fe8e22b0640 1 -- 172.21.15.78:0/1422973859 >> 172.21.15.78:0/1422973859 conn(0x7fe8dc0fd600 msgr2=0x7fe8dc0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.635+0000 7fe8e22b0640 1 -- 172.21.15.78:0/1422973859 shutdown_connections 2024-09-18T13:11:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.635+0000 7fe8e22b0640 1 -- 172.21.15.78:0/1422973859 wait complete. 2024-09-18T13:11:03.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.719+0000 7f257ee54640 1 -- 172.21.15.78:0/617568997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578101900 msgr2=0x7f2578101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:03.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.719+0000 7f257ee54640 1 --2- 172.21.15.78:0/617568997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578101900 0x7f2578101d60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2568009880 tx=0x7f256802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.719+0000 7f257ee54640 1 -- 172.21.15.78:0/617568997 shutdown_connections 2024-09-18T13:11:03.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.719+0000 7f257ee54640 1 --2- 172.21.15.78:0/617568997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578101900 0x7f2578101d60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.719+0000 7f257ee54640 1 --2- 172.21.15.78:0/617568997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2578107900 0x7f2578107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.719+0000 7f257ee54640 1 -- 172.21.15.78:0/617568997 >> 172.21.15.78:0/617568997 conn(0x7f25780fd600 msgr2=0x7f25780ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:03.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.719+0000 7f257ee54640 1 -- 172.21.15.78:0/617568997 shutdown_connections 2024-09-18T13:11:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.719+0000 7f257ee54640 1 -- 172.21.15.78:0/617568997 wait complete. 2024-09-18T13:11:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.720+0000 7f257ee54640 1 Processor -- start 2024-09-18T13:11:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.720+0000 7f257ee54640 1 -- start start 2024-09-18T13:11:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.720+0000 7f257ee54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578101900 0x7f257819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.720+0000 7f257ee54640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2578107900 0x7f257819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.720+0000 7f257ee54640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f257810edb0 con 0x7f2578101900 2024-09-18T13:11:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.720+0000 7f257ee54640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f257810ec30 con 0x7f2578107900 2024-09-18T13:11:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.720+0000 7f257cbf0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578101900 0x7f257819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.720+0000 7f257cbf0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578101900 0x7f257819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35914/0 (socket says 172.21.15.78:35914) 2024-09-18T13:11:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.720+0000 7f257cbf0640 1 -- 172.21.15.78:0/2103211077 learned_addr learned my addr 172.21.15.78:0/2103211077 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:11:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.720+0000 7f257cbf0640 1 -- 172.21.15.78:0/2103211077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2578107900 msgr2=0x7f257819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.720+0000 7f257cbf0640 1 --2- 172.21.15.78:0/2103211077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2578107900 0x7f257819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.720+0000 7f257cbf0640 1 -- 172.21.15.78:0/2103211077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2578197800 con 0x7f2578101900 2024-09-18T13:11:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.721+0000 7f257cbf0640 1 --2- 172.21.15.78:0/2103211077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578101900 0x7f257819d680 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f257000db80 tx=0x7f257000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.721+0000 7f2575ffb640 1 -- 172.21.15.78:0/2103211077 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2570017070 con 0x7f2578101900 2024-09-18T13:11:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.721+0000 7f2575ffb640 1 -- 172.21.15.78:0/2103211077 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2570003e30 con 0x7f2578101900 2024-09-18T13:11:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.721+0000 7f2575ffb640 1 -- 172.21.15.78:0/2103211077 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2570010460 con 0x7f2578101900 2024-09-18T13:11:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.721+0000 7f257ee54640 1 -- 172.21.15.78:0/2103211077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2578197af0 con 0x7f2578101900 2024-09-18T13:11:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.721+0000 7f257ee54640 1 -- 172.21.15.78:0/2103211077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2578198080 con 0x7f2578101900 2024-09-18T13:11:03.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.722+0000 7f257ee54640 1 -- 172.21.15.78:0/2103211077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2578103040 con 0x7f2578101900 2024-09-18T13:11:03.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.722+0000 7f2575ffb640 1 -- 172.21.15.78:0/2103211077 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f257000dc70 con 0x7f2578101900 2024-09-18T13:11:03.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.723+0000 7f2575ffb640 1 --2- 172.21.15.78:0/2103211077 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f256407af80 0x7f256407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:03.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.723+0000 7f2575ffb640 1 -- 172.21.15.78:0/2103211077 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f257009e4d0 con 0x7f2578101900 2024-09-18T13:11:03.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.723+0000 7f2577fff640 1 --2- 172.21.15.78:0/2103211077 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f256407af80 0x7f256407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:03.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.723+0000 7f2577fff640 1 --2- 172.21.15.78:0/2103211077 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f256407af80 0x7f256407d440 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f25680096c0 tx=0x7f2568000bc0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:03.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.727+0000 7f2575ffb640 1 -- 172.21.15.78:0/2103211077 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2570069a90 con 0x7f2578101900 2024-09-18T13:11:03.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.936+0000 7f257ee54640 1 -- 172.21.15.78:0/2103211077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2578109e90 con 0x7f2578101900 2024-09-18T13:11:03.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.937+0000 7f2575ffb640 1 -- 172.21.15.78:0/2103211077 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f257006e940 con 0x7f2578101900 2024-09-18T13:11:03.938 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:11:03.938 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:11:03.938 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:11:03.938 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:11:03.938 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:11:03.938 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:11:03.938 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:11:03.939 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:11:03.939 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:11:03.939 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:11:03.939 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:11:03.939 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:11:03.939 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:11:03.939 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:11:03.939 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:11:03.939 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:11:03.939 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:11:03.939 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:11:03.939 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:11:03.940 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:11:03.940 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:11:03.940 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:11:03.940 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:11:03.940 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:11:03.940 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:11:03.940 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:11:03.940 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:11:03.940 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:11:03.940 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:11:03.940 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:11:03.940 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:11:03.941 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:11:03.941 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:11:03.941 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:11:03.941 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:11:03.941 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:11:03.941 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:11:03.941 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:11:03.941 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:11:03.941 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:11:03.941 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:11:03.941 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:11:03.941 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:11:03.942 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:11:03.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.939+0000 7f257ee54640 1 -- 172.21.15.78:0/2103211077 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f256407af80 msgr2=0x7f256407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:03.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.939+0000 7f257ee54640 1 --2- 172.21.15.78:0/2103211077 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f256407af80 0x7f256407d440 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f25680096c0 tx=0x7f2568000bc0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.939+0000 7f257ee54640 1 -- 172.21.15.78:0/2103211077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578101900 msgr2=0x7f257819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:03.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.939+0000 7f257ee54640 1 --2- 172.21.15.78:0/2103211077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578101900 0x7f257819d680 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f257000db80 tx=0x7f257000b630 comp rx=0 tx=0).stop 2024-09-18T13:11:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.939+0000 7f257ee54640 1 -- 172.21.15.78:0/2103211077 shutdown_connections 2024-09-18T13:11:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.939+0000 7f257ee54640 1 --2- 172.21.15.78:0/2103211077 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f256407af80 0x7f256407d440 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.939+0000 7f257ee54640 1 --2- 172.21.15.78:0/2103211077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2578107900 0x7f257819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.939+0000 7f257ee54640 1 --2- 172.21.15.78:0/2103211077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2578101900 0x7f257819d680 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.939+0000 7f257ee54640 1 -- 172.21.15.78:0/2103211077 >> 172.21.15.78:0/2103211077 conn(0x7f25780fd600 msgr2=0x7f25780fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.939+0000 7f257ee54640 1 -- 172.21.15.78:0/2103211077 shutdown_connections 2024-09-18T13:11:03.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:03.939+0000 7f257ee54640 1 -- 172.21.15.78:0/2103211077 wait complete. 2024-09-18T13:11:04.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.022+0000 7f6f5fbc3640 1 -- 172.21.15.78:0/1941075417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f581033e0 msgr2=0x7f6f5810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:04.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.022+0000 7f6f5fbc3640 1 --2- 172.21.15.78:0/1941075417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f581033e0 0x7f6f5810b8d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009880 tx=0x7f6f4802a530 comp rx=0 tx=0).stop 2024-09-18T13:11:04.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.022+0000 7f6f5fbc3640 1 -- 172.21.15.78:0/1941075417 shutdown_connections 2024-09-18T13:11:04.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.022+0000 7f6f5fbc3640 1 --2- 172.21.15.78:0/1941075417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f581033e0 0x7f6f5810b8d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:04.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.022+0000 7f6f5fbc3640 1 --2- 172.21.15.78:0/1941075417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f58102ac0 0x7f6f58102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:04.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.022+0000 7f6f5fbc3640 1 -- 172.21.15.78:0/1941075417 >> 172.21.15.78:0/1941075417 conn(0x7f6f580fc520 msgr2=0x7f6f580fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:04.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.022+0000 7f6f5fbc3640 1 -- 172.21.15.78:0/1941075417 shutdown_connections 2024-09-18T13:11:04.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.022+0000 7f6f5fbc3640 1 -- 172.21.15.78:0/1941075417 wait complete. 2024-09-18T13:11:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.023+0000 7f6f5fbc3640 1 Processor -- start 2024-09-18T13:11:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.023+0000 7f6f5fbc3640 1 -- start start 2024-09-18T13:11:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.023+0000 7f6f5fbc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f58102ac0 0x7f6f5819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.023+0000 7f6f5fbc3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f581033e0 0x7f6f5819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.023+0000 7f6f5fbc3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5810edf0 con 0x7f6f58102ac0 2024-09-18T13:11:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.023+0000 7f6f5fbc3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5810ec70 con 0x7f6f581033e0 2024-09-18T13:11:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.023+0000 7f6f5d95f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f58102ac0 0x7f6f5819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.023+0000 7f6f5d95f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f58102ac0 0x7f6f5819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35942/0 (socket says 172.21.15.78:35942) 2024-09-18T13:11:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.023+0000 7f6f5d95f640 1 -- 172.21.15.78:0/1241044166 learned_addr learned my addr 172.21.15.78:0/1241044166 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:11:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.024+0000 7f6f5d95f640 1 -- 172.21.15.78:0/1241044166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f581033e0 msgr2=0x7f6f5819dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.024+0000 7f6f5d95f640 1 --2- 172.21.15.78:0/1241044166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f581033e0 0x7f6f5819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.024+0000 7f6f5d95f640 1 -- 172.21.15.78:0/1241044166 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f58197820 con 0x7f6f58102ac0 2024-09-18T13:11:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.024+0000 7f6f5d95f640 1 --2- 172.21.15.78:0/1241044166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f58102ac0 0x7f6f5819d6a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400d6f0 tx=0x7f6f5400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.024+0000 7f6f4effd640 1 -- 172.21.15.78:0/1241044166 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f54017070 con 0x7f6f58102ac0 2024-09-18T13:11:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.024+0000 7f6f4effd640 1 -- 172.21.15.78:0/1241044166 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f5400de00 con 0x7f6f58102ac0 2024-09-18T13:11:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.024+0000 7f6f4effd640 1 -- 172.21.15.78:0/1241044166 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f54004bb0 con 0x7f6f58102ac0 2024-09-18T13:11:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.024+0000 7f6f5fbc3640 1 -- 172.21.15.78:0/1241044166 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f58197b10 con 0x7f6f58102ac0 2024-09-18T13:11:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.024+0000 7f6f5fbc3640 1 -- 172.21.15.78:0/1241044166 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f581980a0 con 0x7f6f58102ac0 2024-09-18T13:11:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.025+0000 7f6f5fbc3640 1 -- 172.21.15.78:0/1241044166 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f5806aa90 con 0x7f6f58102ac0 2024-09-18T13:11:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.026+0000 7f6f4effd640 1 -- 172.21.15.78:0/1241044166 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6f54009a30 con 0x7f6f58102ac0 2024-09-18T13:11:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.026+0000 7f6f4effd640 1 --2- 172.21.15.78:0/1241044166 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f4407af80 0x7f6f4407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:04.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.026+0000 7f6f5d15e640 1 --2- 172.21.15.78:0/1241044166 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f4407af80 0x7f6f4407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:04.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.026+0000 7f6f4effd640 1 -- 172.21.15.78:0/1241044166 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f6f5409dbd0 con 0x7f6f58102ac0 2024-09-18T13:11:04.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.027+0000 7f6f5d15e640 1 --2- 172.21.15.78:0/1241044166 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f4407af80 0x7f6f4407d440 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6f480096c0 tx=0x7f6f48000bc0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:04.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.030+0000 7f6f4effd640 1 -- 172.21.15.78:0/1241044166 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6f540691f0 con 0x7f6f58102ac0 2024-09-18T13:11:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.223+0000 7f6f5fbc3640 1 -- 172.21.15.78:0/1241044166 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6f58198350 con 0x7f6f4407af80 2024-09-18T13:11:04.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.225+0000 7f6f4effd640 1 -- 172.21.15.78:0/1241044166 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6f58198350 con 0x7f6f4407af80 2024-09-18T13:11:04.226 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:11:04.226 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:11:04.226 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:11:04.226 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:11:04.226 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:11:04.226 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:11:04.227 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:11:04.227 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:11:04.227 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:11:04.227 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:11:04.227 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:11:04.227 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:11:04.227 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:11:04.227 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:11:04.227 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:11:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.227+0000 7f6f5fbc3640 1 -- 172.21.15.78:0/1241044166 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f4407af80 msgr2=0x7f6f4407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.227+0000 7f6f5fbc3640 1 --2- 172.21.15.78:0/1241044166 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f4407af80 0x7f6f4407d440 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6f480096c0 tx=0x7f6f48000bc0 comp rx=0 tx=0).stop 2024-09-18T13:11:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.227+0000 7f6f5fbc3640 1 -- 172.21.15.78:0/1241044166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f58102ac0 msgr2=0x7f6f5819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.227+0000 7f6f5fbc3640 1 --2- 172.21.15.78:0/1241044166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f58102ac0 0x7f6f5819d6a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400d6f0 tx=0x7f6f5400dbb0 comp rx=0 tx=0).stop 2024-09-18T13:11:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.227+0000 7f6f5fbc3640 1 -- 172.21.15.78:0/1241044166 shutdown_connections 2024-09-18T13:11:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.227+0000 7f6f5fbc3640 1 --2- 172.21.15.78:0/1241044166 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f4407af80 0x7f6f4407d440 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.227+0000 7f6f5fbc3640 1 --2- 172.21.15.78:0/1241044166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f581033e0 0x7f6f5819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.227+0000 7f6f5fbc3640 1 --2- 172.21.15.78:0/1241044166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f58102ac0 0x7f6f5819d6a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:04.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.227+0000 7f6f5fbc3640 1 -- 172.21.15.78:0/1241044166 >> 172.21.15.78:0/1241044166 conn(0x7f6f580fc520 msgr2=0x7f6f58108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:04.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.227+0000 7f6f5fbc3640 1 -- 172.21.15.78:0/1241044166 shutdown_connections 2024-09-18T13:11:04.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.227+0000 7f6f5fbc3640 1 -- 172.21.15.78:0/1241044166 wait complete. 2024-09-18T13:11:04.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.308+0000 7f3d5c7ad640 1 -- 172.21.15.78:0/3812486811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d541007f0 msgr2=0x7f3d54100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:04.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.308+0000 7f3d5c7ad640 1 --2- 172.21.15.78:0/3812486811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d541007f0 0x7f3d54100c50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009880 tx=0x7f3d4402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:11:04.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.309+0000 7f3d5c7ad640 1 -- 172.21.15.78:0/3812486811 shutdown_connections 2024-09-18T13:11:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.309+0000 7f3d5c7ad640 1 --2- 172.21.15.78:0/3812486811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d541007f0 0x7f3d54100c50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.309+0000 7f3d5c7ad640 1 --2- 172.21.15.78:0/3812486811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d541067f0 0x7f3d54106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.309+0000 7f3d5c7ad640 1 -- 172.21.15.78:0/3812486811 >> 172.21.15.78:0/3812486811 conn(0x7f3d540fc550 msgr2=0x7f3d540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.309+0000 7f3d5c7ad640 1 -- 172.21.15.78:0/3812486811 shutdown_connections 2024-09-18T13:11:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.309+0000 7f3d5c7ad640 1 -- 172.21.15.78:0/3812486811 wait complete. 2024-09-18T13:11:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.309+0000 7f3d5c7ad640 1 Processor -- start 2024-09-18T13:11:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.309+0000 7f3d5c7ad640 1 -- start start 2024-09-18T13:11:04.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d5c7ad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d541007f0 0x7f3d5419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:04.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d5c7ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d541067f0 0x7f3d5419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d5c7ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5410dca0 con 0x7f3d541067f0 2024-09-18T13:11:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d5c7ad640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5410db20 con 0x7f3d541007f0 2024-09-18T13:11:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d59d48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d541067f0 0x7f3d5419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d59d48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d541067f0 0x7f3d5419dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35962/0 (socket says 172.21.15.78:35962) 2024-09-18T13:11:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d59d48640 1 -- 172.21.15.78:0/359807578 learned_addr learned my addr 172.21.15.78:0/359807578 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:11:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d5a549640 1 --2- 172.21.15.78:0/359807578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d541007f0 0x7f3d5419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d59d48640 1 -- 172.21.15.78:0/359807578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d541007f0 msgr2=0x7f3d5419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d59d48640 1 --2- 172.21.15.78:0/359807578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d541007f0 0x7f3d5419d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d59d48640 1 -- 172.21.15.78:0/359807578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d54197770 con 0x7f3d541067f0 2024-09-18T13:11:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d59d48640 1 --2- 172.21.15.78:0/359807578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d541067f0 0x7f3d5419dbe0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3d44031460 tx=0x7f3d44004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d4b7fe640 1 -- 172.21.15.78:0/359807578 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d4403f070 con 0x7f3d541067f0 2024-09-18T13:11:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d4b7fe640 1 -- 172.21.15.78:0/359807578 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d440035f0 con 0x7f3d541067f0 2024-09-18T13:11:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d5c7ad640 1 -- 172.21.15.78:0/359807578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d54197a00 con 0x7f3d541067f0 2024-09-18T13:11:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d4b7fe640 1 -- 172.21.15.78:0/359807578 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d44035030 con 0x7f3d541067f0 2024-09-18T13:11:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.310+0000 7f3d5c7ad640 1 -- 172.21.15.78:0/359807578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d54197f00 con 0x7f3d541067f0 2024-09-18T13:11:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.311+0000 7f3d5c7ad640 1 -- 172.21.15.78:0/359807578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d54101f30 con 0x7f3d541067f0 2024-09-18T13:11:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.312+0000 7f3d4b7fe640 1 -- 172.21.15.78:0/359807578 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3d44042070 con 0x7f3d541067f0 2024-09-18T13:11:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.312+0000 7f3d4b7fe640 1 --2- 172.21.15.78:0/359807578 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3d4007af80 0x7f3d4007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.313+0000 7f3d4b7fe640 1 -- 172.21.15.78:0/359807578 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f3d440be940 con 0x7f3d541067f0 2024-09-18T13:11:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.313+0000 7f3d5a549640 1 --2- 172.21.15.78:0/359807578 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3d4007af80 0x7f3d4007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.313+0000 7f3d5a549640 1 --2- 172.21.15.78:0/359807578 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3d4007af80 0x7f3d4007d440 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3d50005fd0 tx=0x7f3d50009500 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.317+0000 7f3d4b7fe640 1 -- 172.21.15.78:0/359807578 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3d44089f60 con 0x7f3d541067f0 2024-09-18T13:11:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:04 smithi078 ceph-mon[108578]: from='client.35030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:04 smithi078 ceph-mon[108578]: from='client.35034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:04 smithi078 ceph-mon[108578]: from='client.35038 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:04 smithi078 ceph-mon[108578]: pgmap v657: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:04 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1422973859' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:11:04.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:04 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2103211077' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:11:04.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.561+0000 7f3d5c7ad640 1 -- 172.21.15.78:0/359807578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f3d541981b0 con 0x7f3d541067f0 2024-09-18T13:11:04.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.562+0000 7f3d4b7fe640 1 -- 172.21.15.78:0/359807578 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f3d4408ee10 con 0x7f3d541067f0 2024-09-18T13:11:04.563 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:11:04.563 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:11:04.563 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:11:04.563 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:11:04.563 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:11:04.563 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:11:04.563 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:11:04.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.564+0000 7f3d5c7ad640 1 -- 172.21.15.78:0/359807578 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3d4007af80 msgr2=0x7f3d4007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:04.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.564+0000 7f3d5c7ad640 1 --2- 172.21.15.78:0/359807578 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3d4007af80 0x7f3d4007d440 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3d50005fd0 tx=0x7f3d50009500 comp rx=0 tx=0).stop 2024-09-18T13:11:04.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.564+0000 7f3d5c7ad640 1 -- 172.21.15.78:0/359807578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d541067f0 msgr2=0x7f3d5419dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:04.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.564+0000 7f3d5c7ad640 1 --2- 172.21.15.78:0/359807578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d541067f0 0x7f3d5419dbe0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3d44031460 tx=0x7f3d44004530 comp rx=0 tx=0).stop 2024-09-18T13:11:04.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.564+0000 7f3d5c7ad640 1 -- 172.21.15.78:0/359807578 shutdown_connections 2024-09-18T13:11:04.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.564+0000 7f3d5c7ad640 1 --2- 172.21.15.78:0/359807578 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3d4007af80 0x7f3d4007d440 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:04.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.564+0000 7f3d5c7ad640 1 --2- 172.21.15.78:0/359807578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d541067f0 0x7f3d5419dbe0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:04.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.564+0000 7f3d5c7ad640 1 --2- 172.21.15.78:0/359807578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d541007f0 0x7f3d5419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:04.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.564+0000 7f3d5c7ad640 1 -- 172.21.15.78:0/359807578 >> 172.21.15.78:0/359807578 conn(0x7f3d540fc550 msgr2=0x7f3d54104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:04.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.564+0000 7f3d5c7ad640 1 -- 172.21.15.78:0/359807578 shutdown_connections 2024-09-18T13:11:04.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:04.564+0000 7f3d5c7ad640 1 -- 172.21.15.78:0/359807578 wait complete. 2024-09-18T13:11:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:04 smithi148 ceph-mon[80030]: from='client.35030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:04 smithi148 ceph-mon[80030]: from='client.35034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:04 smithi148 ceph-mon[80030]: from='client.35038 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:04 smithi148 ceph-mon[80030]: pgmap v657: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:04 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1422973859' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:11:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:04 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2103211077' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:11:05.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:05 smithi148 ceph-mon[80030]: from='client.35050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:05.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:05 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/359807578' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:11:05.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:05 smithi078 ceph-mon[108578]: from='client.35050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:05.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:05 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/359807578' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:11:06.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:06 smithi078 ceph-mon[108578]: pgmap v658: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:06.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:06 smithi148 ceph-mon[80030]: pgmap v658: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:08.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:08 smithi148 ceph-mon[80030]: pgmap v659: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:08.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:08 smithi078 ceph-mon[108578]: pgmap v659: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:10 smithi148 ceph-mon[80030]: pgmap v660: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:10.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:10 smithi078 ceph-mon[108578]: pgmap v660: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:11:11.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:11:12.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:12 smithi148 ceph-mon[80030]: pgmap v661: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:12.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:12 smithi078 ceph-mon[108578]: pgmap v661: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:14 smithi148 ceph-mon[80030]: pgmap v662: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:14 smithi078 ceph-mon[108578]: pgmap v662: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:16.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:16 smithi148 ceph-mon[80030]: pgmap v663: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:16.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:16 smithi078 ceph-mon[108578]: pgmap v663: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:18 smithi148 ceph-mon[80030]: pgmap v664: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:18.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:18 smithi078 ceph-mon[108578]: pgmap v664: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:20.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:20 smithi078 ceph-mon[108578]: pgmap v665: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:20.972 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:20 smithi148 ceph-mon[80030]: pgmap v665: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:22.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:22 smithi078 ceph-mon[108578]: pgmap v666: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:22.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:22 smithi148 ceph-mon[80030]: pgmap v666: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:24.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:24 smithi078 ceph-mon[108578]: pgmap v667: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:24.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:24 smithi148 ceph-mon[80030]: pgmap v667: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:26 smithi078 ceph-mon[108578]: pgmap v668: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:11:26.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:26 smithi148 ceph-mon[80030]: pgmap v668: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:26.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:11:28.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:28 smithi078 ceph-mon[108578]: pgmap v669: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:28.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:28 smithi148 ceph-mon[80030]: pgmap v669: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:30.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:30 smithi078 ceph-mon[108578]: pgmap v670: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:30.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:30 smithi148 ceph-mon[80030]: pgmap v670: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:32 smithi078 ceph-mon[108578]: pgmap v671: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:32.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:32 smithi148 ceph-mon[80030]: pgmap v671: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:34.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.656+0000 7f078365d640 1 -- 172.21.15.78:0/2503308669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f077c107910 msgr2=0x7f077c107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:34.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.656+0000 7f078365d640 1 --2- 172.21.15.78:0/2503308669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f077c107910 0x7f077c107cf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f076c009c20 tx=0x7f076c02a970 comp rx=0 tx=0).stop 2024-09-18T13:11:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.656+0000 7f078365d640 1 -- 172.21.15.78:0/2503308669 shutdown_connections 2024-09-18T13:11:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.656+0000 7f078365d640 1 --2- 172.21.15.78:0/2503308669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f077c101910 0x7f077c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.656+0000 7f078365d640 1 --2- 172.21.15.78:0/2503308669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f077c107910 0x7f077c107cf0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.656+0000 7f078365d640 1 -- 172.21.15.78:0/2503308669 >> 172.21.15.78:0/2503308669 conn(0x7f077c0fd630 msgr2=0x7f077c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.656+0000 7f078365d640 1 -- 172.21.15.78:0/2503308669 shutdown_connections 2024-09-18T13:11:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.656+0000 7f078365d640 1 -- 172.21.15.78:0/2503308669 wait complete. 2024-09-18T13:11:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.656+0000 7f078365d640 1 Processor -- start 2024-09-18T13:11:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.656+0000 7f078365d640 1 -- start start 2024-09-18T13:11:34.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.657+0000 7f078365d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f077c101910 0x7f077c19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.657+0000 7f078365d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f077c107910 0x7f077c19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.657+0000 7f078365d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f077c10ede0 con 0x7f077c101910 2024-09-18T13:11:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.657+0000 7f078365d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f077c10ec60 con 0x7f077c107910 2024-09-18T13:11:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.657+0000 7f07813f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f077c101910 0x7f077c19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.657+0000 7f07813f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f077c101910 0x7f077c19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34820/0 (socket says 172.21.15.78:34820) 2024-09-18T13:11:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.657+0000 7f07813f9640 1 -- 172.21.15.78:0/4041895252 learned_addr learned my addr 172.21.15.78:0/4041895252 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:11:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.657+0000 7f0780bf8640 1 --2- 172.21.15.78:0/4041895252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f077c107910 0x7f077c19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.657+0000 7f07813f9640 1 -- 172.21.15.78:0/4041895252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f077c107910 msgr2=0x7f077c19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.657+0000 7f07813f9640 1 --2- 172.21.15.78:0/4041895252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f077c107910 0x7f077c19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.657+0000 7f07813f9640 1 -- 172.21.15.78:0/4041895252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c1977b0 con 0x7f077c101910 2024-09-18T13:11:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.657+0000 7f07813f9640 1 --2- 172.21.15.78:0/4041895252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f077c101910 0x7f077c19d630 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f076c006010 tx=0x7f076c02fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.658+0000 7f077a7fc640 1 -- 172.21.15.78:0/4041895252 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f076c047070 con 0x7f077c101910 2024-09-18T13:11:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.658+0000 7f078365d640 1 -- 172.21.15.78:0/4041895252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f077c197a40 con 0x7f077c101910 2024-09-18T13:11:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.658+0000 7f077a7fc640 1 -- 172.21.15.78:0/4041895252 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f076c003e30 con 0x7f077c101910 2024-09-18T13:11:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.658+0000 7f077a7fc640 1 -- 172.21.15.78:0/4041895252 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f076c034070 con 0x7f077c101910 2024-09-18T13:11:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.658+0000 7f078365d640 1 -- 172.21.15.78:0/4041895252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f077c197f70 con 0x7f077c101910 2024-09-18T13:11:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.659+0000 7f078365d640 1 -- 172.21.15.78:0/4041895252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f077c103050 con 0x7f077c101910 2024-09-18T13:11:34.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.659+0000 7f077a7fc640 1 -- 172.21.15.78:0/4041895252 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f076c04a070 con 0x7f077c101910 2024-09-18T13:11:34.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.660+0000 7f077a7fc640 1 --2- 172.21.15.78:0/4041895252 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f076407af40 0x7f076407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:34.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.660+0000 7f077a7fc640 1 -- 172.21.15.78:0/4041895252 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f076c0beda0 con 0x7f077c101910 2024-09-18T13:11:34.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.660+0000 7f0780bf8640 1 --2- 172.21.15.78:0/4041895252 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f076407af40 0x7f076407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:34.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.660+0000 7f0780bf8640 1 --2- 172.21.15.78:0/4041895252 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f076407af40 0x7f076407d400 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f077c0ffc20 tx=0x7f077000b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.664+0000 7f077a7fc640 1 -- 172.21.15.78:0/4041895252 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f076c03f070 con 0x7f077c101910 2024-09-18T13:11:34.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.855+0000 7f078365d640 1 -- 172.21.15.78:0/4041895252 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f077c198220 con 0x7f076407af40 2024-09-18T13:11:34.857 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:34 smithi078 ceph-mon[108578]: pgmap v672: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:34.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.856+0000 7f077a7fc640 1 -- 172.21.15.78:0/4041895252 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f077c198220 con 0x7f076407af40 2024-09-18T13:11:34.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.858+0000 7f078365d640 1 -- 172.21.15.78:0/4041895252 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f076407af40 msgr2=0x7f076407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:34.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.858+0000 7f078365d640 1 --2- 172.21.15.78:0/4041895252 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f076407af40 0x7f076407d400 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f077c0ffc20 tx=0x7f077000b390 comp rx=0 tx=0).stop 2024-09-18T13:11:34.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.858+0000 7f078365d640 1 -- 172.21.15.78:0/4041895252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f077c101910 msgr2=0x7f077c19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:34.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.858+0000 7f078365d640 1 --2- 172.21.15.78:0/4041895252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f077c101910 0x7f077c19d630 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f076c006010 tx=0x7f076c02fdd0 comp rx=0 tx=0).stop 2024-09-18T13:11:34.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.858+0000 7f078365d640 1 -- 172.21.15.78:0/4041895252 shutdown_connections 2024-09-18T13:11:34.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.858+0000 7f078365d640 1 --2- 172.21.15.78:0/4041895252 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f076407af40 0x7f076407d400 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:34.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.858+0000 7f078365d640 1 --2- 172.21.15.78:0/4041895252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f077c107910 0x7f077c19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:34.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.858+0000 7f078365d640 1 --2- 172.21.15.78:0/4041895252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f077c101910 0x7f077c19d630 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:34.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.858+0000 7f078365d640 1 -- 172.21.15.78:0/4041895252 >> 172.21.15.78:0/4041895252 conn(0x7f077c0fd630 msgr2=0x7f077c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:34.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.859+0000 7f078365d640 1 -- 172.21.15.78:0/4041895252 shutdown_connections 2024-09-18T13:11:34.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.859+0000 7f078365d640 1 -- 172.21.15.78:0/4041895252 wait complete. 2024-09-18T13:11:34.869 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:11:34.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.941+0000 7f7ccbbd5640 1 -- 172.21.15.78:0/3295764566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc4102ac0 msgr2=0x7f7cc4102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:34.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.941+0000 7f7ccbbd5640 1 --2- 172.21.15.78:0/3295764566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc4102ac0 0x7f7cc4102ea0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009880 tx=0x7f7cc002a530 comp rx=0 tx=0).stop 2024-09-18T13:11:34.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.941+0000 7f7ccbbd5640 1 -- 172.21.15.78:0/3295764566 shutdown_connections 2024-09-18T13:11:34.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.941+0000 7f7ccbbd5640 1 --2- 172.21.15.78:0/3295764566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cc41033e0 0x7f7cc410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:34.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.941+0000 7f7ccbbd5640 1 --2- 172.21.15.78:0/3295764566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc4102ac0 0x7f7cc4102ea0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:34.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.941+0000 7f7ccbbd5640 1 -- 172.21.15.78:0/3295764566 >> 172.21.15.78:0/3295764566 conn(0x7f7cc40fc520 msgr2=0x7f7cc40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:34.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.941+0000 7f7ccbbd5640 1 -- 172.21.15.78:0/3295764566 shutdown_connections 2024-09-18T13:11:34.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.941+0000 7f7ccbbd5640 1 -- 172.21.15.78:0/3295764566 wait complete. 2024-09-18T13:11:34.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.942+0000 7f7ccbbd5640 1 Processor -- start 2024-09-18T13:11:34.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.942+0000 7f7ccbbd5640 1 -- start start 2024-09-18T13:11:34.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.942+0000 7f7ccbbd5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cc4102ac0 0x7f7cc419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:34.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.942+0000 7f7ccbbd5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc41033e0 0x7f7cc419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:34.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.942+0000 7f7ccbbd5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc410edf0 con 0x7f7cc41033e0 2024-09-18T13:11:34.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.942+0000 7f7ccbbd5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc410ec70 con 0x7f7cc4102ac0 2024-09-18T13:11:34.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.942+0000 7f7cc9170640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc41033e0 0x7f7cc419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:34.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.942+0000 7f7cc9170640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc41033e0 0x7f7cc419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34848/0 (socket says 172.21.15.78:34848) 2024-09-18T13:11:34.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.942+0000 7f7cc9170640 1 -- 172.21.15.78:0/3285640389 learned_addr learned my addr 172.21.15.78:0/3285640389 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:11:34.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.942+0000 7f7cc9971640 1 --2- 172.21.15.78:0/3285640389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cc4102ac0 0x7f7cc419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:34.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.942+0000 7f7cc9170640 1 -- 172.21.15.78:0/3285640389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cc4102ac0 msgr2=0x7f7cc419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:34.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.942+0000 7f7cc9170640 1 --2- 172.21.15.78:0/3285640389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cc4102ac0 0x7f7cc419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:34.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.942+0000 7f7cc9170640 1 -- 172.21.15.78:0/3285640389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc4197800 con 0x7f7cc41033e0 2024-09-18T13:11:34.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.943+0000 7f7cc9170640 1 --2- 172.21.15.78:0/3285640389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc41033e0 0x7f7cc419dbc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400c8f0 tx=0x7f7cb400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:34.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.943+0000 7f7cbaffd640 1 -- 172.21.15.78:0/3285640389 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cb400ae50 con 0x7f7cc41033e0 2024-09-18T13:11:34.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.943+0000 7f7cbaffd640 1 -- 172.21.15.78:0/3285640389 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7cb4005020 con 0x7f7cc41033e0 2024-09-18T13:11:34.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.943+0000 7f7ccbbd5640 1 -- 172.21.15.78:0/3285640389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc4197af0 con 0x7f7cc41033e0 2024-09-18T13:11:34.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.943+0000 7f7cbaffd640 1 -- 172.21.15.78:0/3285640389 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cb4004d70 con 0x7f7cc41033e0 2024-09-18T13:11:34.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.943+0000 7f7ccbbd5640 1 -- 172.21.15.78:0/3285640389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc4198080 con 0x7f7cc41033e0 2024-09-18T13:11:34.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.944+0000 7f7ccbbd5640 1 -- 172.21.15.78:0/3285640389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc406aa90 con 0x7f7cc41033e0 2024-09-18T13:11:34.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.944+0000 7f7cbaffd640 1 -- 172.21.15.78:0/3285640389 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7cb40051d0 con 0x7f7cc41033e0 2024-09-18T13:11:34.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.945+0000 7f7cbaffd640 1 --2- 172.21.15.78:0/3285640389 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7cb007b0e0 0x7f7cb007d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:34.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.945+0000 7f7cbaffd640 1 -- 172.21.15.78:0/3285640389 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f7cb409df00 con 0x7f7cc41033e0 2024-09-18T13:11:34.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.945+0000 7f7cc9971640 1 --2- 172.21.15.78:0/3285640389 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7cb007b0e0 0x7f7cb007d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:34.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.945+0000 7f7cc9971640 1 --2- 172.21.15.78:0/3285640389 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7cb007b0e0 0x7f7cb007d5a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0031460 tx=0x7f7cc0005bd0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:34.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:34.950+0000 7f7cbaffd640 1 -- 172.21.15.78:0/3285640389 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7cb4014030 con 0x7f7cc41033e0 2024-09-18T13:11:34.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:34 smithi148 ceph-mon[80030]: pgmap v672: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:35.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.140+0000 7f7ccbbd5640 1 -- 172.21.15.78:0/3285640389 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7cc41983f0 con 0x7f7cb007b0e0 2024-09-18T13:11:35.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.142+0000 7f7cbaffd640 1 -- 172.21.15.78:0/3285640389 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7cc41983f0 con 0x7f7cb007b0e0 2024-09-18T13:11:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.145+0000 7f7ccbbd5640 1 -- 172.21.15.78:0/3285640389 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7cb007b0e0 msgr2=0x7f7cb007d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.145+0000 7f7ccbbd5640 1 --2- 172.21.15.78:0/3285640389 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7cb007b0e0 0x7f7cb007d5a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0031460 tx=0x7f7cc0005bd0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.145+0000 7f7ccbbd5640 1 -- 172.21.15.78:0/3285640389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc41033e0 msgr2=0x7f7cc419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.145+0000 7f7ccbbd5640 1 --2- 172.21.15.78:0/3285640389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc41033e0 0x7f7cc419dbc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400c8f0 tx=0x7f7cb400cdb0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.145+0000 7f7ccbbd5640 1 -- 172.21.15.78:0/3285640389 shutdown_connections 2024-09-18T13:11:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.145+0000 7f7ccbbd5640 1 --2- 172.21.15.78:0/3285640389 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7cb007b0e0 0x7f7cb007d5a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.145+0000 7f7ccbbd5640 1 --2- 172.21.15.78:0/3285640389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc41033e0 0x7f7cc419dbc0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.145+0000 7f7ccbbd5640 1 --2- 172.21.15.78:0/3285640389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cc4102ac0 0x7f7cc419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.145+0000 7f7ccbbd5640 1 -- 172.21.15.78:0/3285640389 >> 172.21.15.78:0/3285640389 conn(0x7f7cc40fc520 msgr2=0x7f7cc4108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:35.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.145+0000 7f7ccbbd5640 1 -- 172.21.15.78:0/3285640389 shutdown_connections 2024-09-18T13:11:35.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.145+0000 7f7ccbbd5640 1 -- 172.21.15.78:0/3285640389 wait complete. 2024-09-18T13:11:35.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.226+0000 7f83d296b640 1 -- 172.21.15.78:0/1028492290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc100800 msgr2=0x7f83cc100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.226+0000 7f83d296b640 1 --2- 172.21.15.78:0/1028492290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc100800 0x7f83cc100c60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009880 tx=0x7f83c002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.226+0000 7f83d296b640 1 -- 172.21.15.78:0/1028492290 shutdown_connections 2024-09-18T13:11:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.226+0000 7f83d296b640 1 --2- 172.21.15.78:0/1028492290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc100800 0x7f83cc100c60 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.226+0000 7f83d296b640 1 --2- 172.21.15.78:0/1028492290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83cc106800 0x7f83cc106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.226+0000 7f83d296b640 1 -- 172.21.15.78:0/1028492290 >> 172.21.15.78:0/1028492290 conn(0x7f83cc0fc520 msgr2=0x7f83cc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.226+0000 7f83d296b640 1 -- 172.21.15.78:0/1028492290 shutdown_connections 2024-09-18T13:11:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.226+0000 7f83d296b640 1 -- 172.21.15.78:0/1028492290 wait complete. 2024-09-18T13:11:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.227+0000 7f83d296b640 1 Processor -- start 2024-09-18T13:11:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.227+0000 7f83d296b640 1 -- start start 2024-09-18T13:11:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.227+0000 7f83d296b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc100800 0x7f83cc198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.227+0000 7f83d296b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83cc106800 0x7f83cc198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.227+0000 7f83d296b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc10dd30 con 0x7f83cc100800 2024-09-18T13:11:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.227+0000 7f83d296b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc10dbb0 con 0x7f83cc106800 2024-09-18T13:11:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.227+0000 7f83cbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc100800 0x7f83cc198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.227+0000 7f83cbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc100800 0x7f83cc198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34862/0 (socket says 172.21.15.78:34862) 2024-09-18T13:11:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.227+0000 7f83cbfff640 1 -- 172.21.15.78:0/2099124728 learned_addr learned my addr 172.21.15.78:0/2099124728 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:11:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.228+0000 7f83cbfff640 1 -- 172.21.15.78:0/2099124728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83cc106800 msgr2=0x7f83cc198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.228+0000 7f83cbfff640 1 --2- 172.21.15.78:0/2099124728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83cc106800 0x7f83cc198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.228+0000 7f83cbfff640 1 -- 172.21.15.78:0/2099124728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc1993d0 con 0x7f83cc100800 2024-09-18T13:11:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.228+0000 7f83cbfff640 1 --2- 172.21.15.78:0/2099124728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc100800 0x7f83cc198890 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00b420 tx=0x7f83bc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:35.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.228+0000 7f83c97fa640 1 -- 172.21.15.78:0/2099124728 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83bc011630 con 0x7f83cc100800 2024-09-18T13:11:35.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.228+0000 7f83c97fa640 1 -- 172.21.15.78:0/2099124728 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83bc016070 con 0x7f83cc100800 2024-09-18T13:11:35.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.228+0000 7f83d296b640 1 -- 172.21.15.78:0/2099124728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83cc1996c0 con 0x7f83cc100800 2024-09-18T13:11:35.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.228+0000 7f83c97fa640 1 -- 172.21.15.78:0/2099124728 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83bc010d40 con 0x7f83cc100800 2024-09-18T13:11:35.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.228+0000 7f83d296b640 1 -- 172.21.15.78:0/2099124728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83cc1a1cc0 con 0x7f83cc100800 2024-09-18T13:11:35.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.229+0000 7f83d296b640 1 -- 172.21.15.78:0/2099124728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83cc101f40 con 0x7f83cc100800 2024-09-18T13:11:35.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.230+0000 7f83c97fa640 1 -- 172.21.15.78:0/2099124728 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f83bc01b460 con 0x7f83cc100800 2024-09-18T13:11:35.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.230+0000 7f83c97fa640 1 --2- 172.21.15.78:0/2099124728 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f83b407af80 0x7f83b407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:35.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.230+0000 7f83cb7fe640 1 --2- 172.21.15.78:0/2099124728 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f83b407af80 0x7f83b407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:35.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.230+0000 7f83c97fa640 1 -- 172.21.15.78:0/2099124728 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f83bc09d750 con 0x7f83cc100800 2024-09-18T13:11:35.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.231+0000 7f83cb7fe640 1 --2- 172.21.15.78:0/2099124728 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f83b407af80 0x7f83b407d440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f83c00096c0 tx=0x7f83c0000bc0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:35.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.235+0000 7f83c97fa640 1 -- 172.21.15.78:0/2099124728 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f83cc1996c0 con 0x7f83cc100800 2024-09-18T13:11:35.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.418+0000 7f83d296b640 1 -- 172.21.15.78:0/2099124728 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f83cc108de0 con 0x7f83b407af80 2024-09-18T13:11:35.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.427+0000 7f83c97fa640 1 -- 172.21.15.78:0/2099124728 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f83cc108de0 con 0x7f83b407af80 2024-09-18T13:11:35.430 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:11:35.430 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (19m) 13m ago 30m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:11:35.430 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (21m) 13m ago 30m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:11:35.430 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (21m) 13m ago 29m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:11:35.430 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (17m) 13m ago 30m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:11:35.430 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (17m) 13m ago 29m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:11:35.430 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (19m) 13m ago 30m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:11:35.430 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (13m) 13m ago 25m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:11:35.430 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (13m) 13m ago 24m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:11:35.430 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (13m) 13m ago 25m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:11:35.431 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (13m) 13m ago 24m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:11:35.431 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (21m) 13m ago 31m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:11:35.431 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (20m) 13m ago 29m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:11:35.431 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (18m) 13m ago 31m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:11:35.431 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (17m) 13m ago 29m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:11:35.431 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (20m) 13m ago 30m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:11:35.431 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (20m) 13m ago 29m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:11:35.431 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (17m) 13m ago 28m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:11:35.431 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (16m) 13m ago 27m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:11:35.431 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (16m) 13m ago 27m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:11:35.431 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (15m) 13m ago 26m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:11:35.432 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (14m) 13m ago 26m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:11:35.432 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (14m) 13m ago 26m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:11:35.432 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (19m) 13m ago 29m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:11:35.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.430+0000 7f83d296b640 1 -- 172.21.15.78:0/2099124728 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f83b407af80 msgr2=0x7f83b407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:35.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.430+0000 7f83d296b640 1 --2- 172.21.15.78:0/2099124728 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f83b407af80 0x7f83b407d440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f83c00096c0 tx=0x7f83c0000bc0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.430+0000 7f83d296b640 1 -- 172.21.15.78:0/2099124728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc100800 msgr2=0x7f83cc198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:35.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.430+0000 7f83d296b640 1 --2- 172.21.15.78:0/2099124728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc100800 0x7f83cc198890 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00b420 tx=0x7f83bc00b8e0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.430+0000 7f83d296b640 1 -- 172.21.15.78:0/2099124728 shutdown_connections 2024-09-18T13:11:35.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.430+0000 7f83d296b640 1 --2- 172.21.15.78:0/2099124728 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f83b407af80 0x7f83b407d440 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.430+0000 7f83d296b640 1 --2- 172.21.15.78:0/2099124728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83cc106800 0x7f83cc198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.430+0000 7f83d296b640 1 --2- 172.21.15.78:0/2099124728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc100800 0x7f83cc198890 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.430+0000 7f83d296b640 1 -- 172.21.15.78:0/2099124728 >> 172.21.15.78:0/2099124728 conn(0x7f83cc0fc520 msgr2=0x7f83cc0fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:35.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.430+0000 7f83d296b640 1 -- 172.21.15.78:0/2099124728 shutdown_connections 2024-09-18T13:11:35.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.430+0000 7f83d296b640 1 -- 172.21.15.78:0/2099124728 wait complete. 2024-09-18T13:11:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.510+0000 7f6a12e0c640 1 -- 172.21.15.78:0/4096519021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a0c107900 msgr2=0x7f6a0c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.510+0000 7f6a12e0c640 1 --2- 172.21.15.78:0/4096519021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a0c107900 0x7f6a0c107ce0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009880 tx=0x7f6a0002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.511+0000 7f6a12e0c640 1 -- 172.21.15.78:0/4096519021 shutdown_connections 2024-09-18T13:11:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.511+0000 7f6a12e0c640 1 --2- 172.21.15.78:0/4096519021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a0c101900 0x7f6a0c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.511+0000 7f6a12e0c640 1 --2- 172.21.15.78:0/4096519021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a0c107900 0x7f6a0c107ce0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.511+0000 7f6a12e0c640 1 -- 172.21.15.78:0/4096519021 >> 172.21.15.78:0/4096519021 conn(0x7f6a0c0fd600 msgr2=0x7f6a0c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.511+0000 7f6a12e0c640 1 -- 172.21.15.78:0/4096519021 shutdown_connections 2024-09-18T13:11:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.511+0000 7f6a12e0c640 1 -- 172.21.15.78:0/4096519021 wait complete. 2024-09-18T13:11:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.511+0000 7f6a12e0c640 1 Processor -- start 2024-09-18T13:11:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.511+0000 7f6a12e0c640 1 -- start start 2024-09-18T13:11:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.511+0000 7f6a12e0c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a0c101900 0x7f6a0c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.511+0000 7f6a12e0c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a0c107900 0x7f6a0c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.511+0000 7f6a12e0c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c10edb0 con 0x7f6a0c101900 2024-09-18T13:11:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.511+0000 7f6a12e0c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c10ec30 con 0x7f6a0c107900 2024-09-18T13:11:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.512+0000 7f6a10ba8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a0c101900 0x7f6a0c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.512+0000 7f6a10ba8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a0c101900 0x7f6a0c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34874/0 (socket says 172.21.15.78:34874) 2024-09-18T13:11:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.512+0000 7f6a10ba8640 1 -- 172.21.15.78:0/204447680 learned_addr learned my addr 172.21.15.78:0/204447680 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:11:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.512+0000 7f6a0bfff640 1 --2- 172.21.15.78:0/204447680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a0c107900 0x7f6a0c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.512+0000 7f6a10ba8640 1 -- 172.21.15.78:0/204447680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a0c107900 msgr2=0x7f6a0c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.512+0000 7f6a10ba8640 1 --2- 172.21.15.78:0/204447680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a0c107900 0x7f6a0c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.512+0000 7f6a10ba8640 1 -- 172.21.15.78:0/204447680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0c074f70 con 0x7f6a0c101900 2024-09-18T13:11:35.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.512+0000 7f6a10ba8640 1 --2- 172.21.15.78:0/204447680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a0c101900 0x7f6a0c0744f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6a00031460 tx=0x7f6a000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:35.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.512+0000 7f6a09ffb640 1 -- 172.21.15.78:0/204447680 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a0003f070 con 0x7f6a0c101900 2024-09-18T13:11:35.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.512+0000 7f6a09ffb640 1 -- 172.21.15.78:0/204447680 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a00004cf0 con 0x7f6a0c101900 2024-09-18T13:11:35.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.512+0000 7f6a09ffb640 1 -- 172.21.15.78:0/204447680 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a00035030 con 0x7f6a0c101900 2024-09-18T13:11:35.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.512+0000 7f6a12e0c640 1 -- 172.21.15.78:0/204447680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0c075200 con 0x7f6a0c101900 2024-09-18T13:11:35.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.513+0000 7f6a12e0c640 1 -- 172.21.15.78:0/204447680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0c1a3d10 con 0x7f6a0c101900 2024-09-18T13:11:35.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.513+0000 7f6a12e0c640 1 -- 172.21.15.78:0/204447680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a0c103040 con 0x7f6a0c101900 2024-09-18T13:11:35.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.514+0000 7f6a09ffb640 1 -- 172.21.15.78:0/204447680 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6a00042070 con 0x7f6a0c101900 2024-09-18T13:11:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.514+0000 7f6a09ffb640 1 --2- 172.21.15.78:0/204447680 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f69fc07af80 0x7f69fc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.515+0000 7f6a09ffb640 1 -- 172.21.15.78:0/204447680 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f6a000bea50 con 0x7f6a0c101900 2024-09-18T13:11:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.515+0000 7f6a0bfff640 1 --2- 172.21.15.78:0/204447680 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f69fc07af80 0x7f69fc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.515+0000 7f6a0bfff640 1 --2- 172.21.15.78:0/204447680 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f69fc07af80 0x7f69fc07d440 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f69f8005e10 tx=0x7f69f8005da0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.519+0000 7f6a09ffb640 1 -- 172.21.15.78:0/204447680 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6a0008a070 con 0x7f6a0c101900 2024-09-18T13:11:35.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:35 smithi148 ceph-mon[80030]: from='client.35058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:35.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:35 smithi148 ceph-mon[80030]: from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:35.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:35 smithi148 ceph-mon[80030]: pgmap v673: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:35.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:35 smithi148 ceph-mon[80030]: from='client.35066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:35.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:35 smithi078 ceph-mon[108578]: from='client.35058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:35.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:35 smithi078 ceph-mon[108578]: from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:35.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:35 smithi078 ceph-mon[108578]: pgmap v673: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:35.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:35 smithi078 ceph-mon[108578]: from='client.35066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:35.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.766+0000 7f6a12e0c640 1 -- 172.21.15.78:0/204447680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6a0c104b10 con 0x7f6a0c101900 2024-09-18T13:11:35.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.766+0000 7f6a09ffb640 1 -- 172.21.15.78:0/204447680 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f6a0008ef20 con 0x7f6a0c101900 2024-09-18T13:11:35.769 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:11:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:11:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:11:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:11:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:11:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:11:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:11:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:11:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:11:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:11:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:11:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:11:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:11:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:11:35.770 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:11:35.770 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:11:35.770 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:11:35.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.769+0000 7f6a12e0c640 1 -- 172.21.15.78:0/204447680 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f69fc07af80 msgr2=0x7f69fc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:35.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.769+0000 7f6a12e0c640 1 --2- 172.21.15.78:0/204447680 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f69fc07af80 0x7f69fc07d440 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f69f8005e10 tx=0x7f69f8005da0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.769+0000 7f6a12e0c640 1 -- 172.21.15.78:0/204447680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a0c101900 msgr2=0x7f6a0c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:35.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.769+0000 7f6a12e0c640 1 --2- 172.21.15.78:0/204447680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a0c101900 0x7f6a0c0744f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6a00031460 tx=0x7f6a000048f0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.769+0000 7f6a12e0c640 1 -- 172.21.15.78:0/204447680 shutdown_connections 2024-09-18T13:11:35.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.769+0000 7f6a12e0c640 1 --2- 172.21.15.78:0/204447680 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f69fc07af80 0x7f69fc07d440 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.769+0000 7f6a12e0c640 1 --2- 172.21.15.78:0/204447680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a0c107900 0x7f6a0c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.769+0000 7f6a12e0c640 1 --2- 172.21.15.78:0/204447680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a0c101900 0x7f6a0c0744f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.769+0000 7f6a12e0c640 1 -- 172.21.15.78:0/204447680 >> 172.21.15.78:0/204447680 conn(0x7f6a0c0fd600 msgr2=0x7f6a0c0feef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:35.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.769+0000 7f6a12e0c640 1 -- 172.21.15.78:0/204447680 shutdown_connections 2024-09-18T13:11:35.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.769+0000 7f6a12e0c640 1 -- 172.21.15.78:0/204447680 wait complete. 2024-09-18T13:11:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.849+0000 7f55fdde9640 1 -- 172.21.15.78:0/4064818396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f8102b50 msgr2=0x7f55f8102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.849+0000 7f55fdde9640 1 --2- 172.21.15.78:0/4064818396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f8102b50 0x7f55f8102f30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009c20 tx=0x7f55e802aa00 comp rx=0 tx=0).stop 2024-09-18T13:11:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.849+0000 7f55fdde9640 1 -- 172.21.15.78:0/4064818396 shutdown_connections 2024-09-18T13:11:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.849+0000 7f55fdde9640 1 --2- 172.21.15.78:0/4064818396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55f8103470 0x7f55f810b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.849+0000 7f55fdde9640 1 --2- 172.21.15.78:0/4064818396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f8102b50 0x7f55f8102f30 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.849+0000 7f55fdde9640 1 -- 172.21.15.78:0/4064818396 >> 172.21.15.78:0/4064818396 conn(0x7f55f80fc550 msgr2=0x7f55f80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.850+0000 7f55fdde9640 1 -- 172.21.15.78:0/4064818396 shutdown_connections 2024-09-18T13:11:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.850+0000 7f55fdde9640 1 -- 172.21.15.78:0/4064818396 wait complete. 2024-09-18T13:11:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.850+0000 7f55fdde9640 1 Processor -- start 2024-09-18T13:11:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.850+0000 7f55fdde9640 1 -- start start 2024-09-18T13:11:35.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.850+0000 7f55fdde9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f8102b50 0x7f55f819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:35.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.850+0000 7f55fdde9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55f8103470 0x7f55f819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:35.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.850+0000 7f55fdde9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f55f810edc0 con 0x7f55f8102b50 2024-09-18T13:11:35.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.850+0000 7f55fdde9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f55f810ec40 con 0x7f55f8103470 2024-09-18T13:11:35.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.851+0000 7f55f77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f8102b50 0x7f55f819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:35.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.851+0000 7f55f77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f8102b50 0x7f55f819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34892/0 (socket says 172.21.15.78:34892) 2024-09-18T13:11:35.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.851+0000 7f55f77fe640 1 -- 172.21.15.78:0/1469293294 learned_addr learned my addr 172.21.15.78:0/1469293294 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:11:35.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.851+0000 7f55f6ffd640 1 --2- 172.21.15.78:0/1469293294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55f8103470 0x7f55f819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:35.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.851+0000 7f55f77fe640 1 -- 172.21.15.78:0/1469293294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55f8103470 msgr2=0x7f55f819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:35.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.851+0000 7f55f77fe640 1 --2- 172.21.15.78:0/1469293294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55f8103470 0x7f55f819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:35.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.851+0000 7f55f77fe640 1 -- 172.21.15.78:0/1469293294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f81977b0 con 0x7f55f8102b50 2024-09-18T13:11:35.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.851+0000 7f55f77fe640 1 --2- 172.21.15.78:0/1469293294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f8102b50 0x7f55f819d630 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f55e8005cc0 tx=0x7f55e802ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:35.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.851+0000 7f55f4ff9640 1 -- 172.21.15.78:0/1469293294 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f55e8047070 con 0x7f55f8102b50 2024-09-18T13:11:35.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.851+0000 7f55f4ff9640 1 -- 172.21.15.78:0/1469293294 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55e8003e30 con 0x7f55f8102b50 2024-09-18T13:11:35.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.851+0000 7f55fdde9640 1 -- 172.21.15.78:0/1469293294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f8197a40 con 0x7f55f8102b50 2024-09-18T13:11:35.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.851+0000 7f55f4ff9640 1 -- 172.21.15.78:0/1469293294 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f55e8033050 con 0x7f55f8102b50 2024-09-18T13:11:35.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.851+0000 7f55fdde9640 1 -- 172.21.15.78:0/1469293294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f8197f70 con 0x7f55f8102b50 2024-09-18T13:11:35.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.852+0000 7f55fdde9640 1 -- 172.21.15.78:0/1469293294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f806a4e0 con 0x7f55f8102b50 2024-09-18T13:11:35.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.853+0000 7f55f4ff9640 1 -- 172.21.15.78:0/1469293294 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f55e804a070 con 0x7f55f8102b50 2024-09-18T13:11:35.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.854+0000 7f55f4ff9640 1 --2- 172.21.15.78:0/1469293294 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f55e007af80 0x7f55e007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:35.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.854+0000 7f55f4ff9640 1 -- 172.21.15.78:0/1469293294 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f55e803e030 con 0x7f55f8102b50 2024-09-18T13:11:35.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.854+0000 7f55f6ffd640 1 --2- 172.21.15.78:0/1469293294 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f55e007af80 0x7f55e007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:35.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.854+0000 7f55f6ffd640 1 --2- 172.21.15.78:0/1469293294 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f55e007af80 0x7f55e007d440 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f55ec005e10 tx=0x7f55ec005da0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:35.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:35.858+0000 7f55f4ff9640 1 -- 172.21.15.78:0/1469293294 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f55e808a800 con 0x7f55f8102b50 2024-09-18T13:11:36.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.068+0000 7f55fdde9640 1 -- 172.21.15.78:0/1469293294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f55f8198ce0 con 0x7f55f8102b50 2024-09-18T13:11:36.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.069+0000 7f55f4ff9640 1 -- 172.21.15.78:0/1469293294 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f55e808f6b0 con 0x7f55f8102b50 2024-09-18T13:11:36.071 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:11:36.071 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:11:36.071 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:11:36.071 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:11:36.072 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:11:36.072 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:11:36.072 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:11:36.072 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:11:36.072 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:11:36.072 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:11:36.072 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:11:36.072 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:11:36.072 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:11:36.072 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:11:36.072 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:11:36.072 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:11:36.072 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:11:36.073 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:11:36.073 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:11:36.073 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:11:36.073 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:11:36.073 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:11:36.073 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:11:36.073 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:11:36.073 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:11:36.073 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:11:36.073 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:11:36.073 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:11:36.073 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:11:36.073 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:11:36.074 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:11:36.074 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:11:36.074 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:11:36.074 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:11:36.074 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:11:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:11:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:11:36.074 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:11:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:11:36.074 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:11:36.074 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:11:36.074 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:11:36.074 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:11:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:11:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.072+0000 7f55fdde9640 1 -- 172.21.15.78:0/1469293294 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f55e007af80 msgr2=0x7f55e007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.072+0000 7f55fdde9640 1 --2- 172.21.15.78:0/1469293294 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f55e007af80 0x7f55e007d440 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f55ec005e10 tx=0x7f55ec005da0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.072+0000 7f55fdde9640 1 -- 172.21.15.78:0/1469293294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f8102b50 msgr2=0x7f55f819d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.072+0000 7f55fdde9640 1 --2- 172.21.15.78:0/1469293294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f8102b50 0x7f55f819d630 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f55e8005cc0 tx=0x7f55e802ee50 comp rx=0 tx=0).stop 2024-09-18T13:11:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.072+0000 7f55fdde9640 1 -- 172.21.15.78:0/1469293294 shutdown_connections 2024-09-18T13:11:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.072+0000 7f55fdde9640 1 --2- 172.21.15.78:0/1469293294 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f55e007af80 0x7f55e007d440 secure :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f55ec005e10 tx=0x7f55ec005da0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.072+0000 7f55fdde9640 1 --2- 172.21.15.78:0/1469293294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55f8103470 0x7f55f819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.072+0000 7f55fdde9640 1 --2- 172.21.15.78:0/1469293294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55f8102b50 0x7f55f819d630 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.072+0000 7f55fdde9640 1 -- 172.21.15.78:0/1469293294 >> 172.21.15.78:0/1469293294 conn(0x7f55f80fc550 msgr2=0x7f55f8108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.072+0000 7f55fdde9640 1 -- 172.21.15.78:0/1469293294 shutdown_connections 2024-09-18T13:11:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.072+0000 7f55fdde9640 1 -- 172.21.15.78:0/1469293294 wait complete. 2024-09-18T13:11:36.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.154+0000 7f0b57ff4640 1 -- 172.21.15.78:0/1657865357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b501067f0 msgr2=0x7f0b50106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:36.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.154+0000 7f0b57ff4640 1 --2- 172.21.15.78:0/1657865357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b501067f0 0x7f0b50106bd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009880 tx=0x7f0b4c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.155+0000 7f0b57ff4640 1 -- 172.21.15.78:0/1657865357 shutdown_connections 2024-09-18T13:11:36.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.155+0000 7f0b57ff4640 1 --2- 172.21.15.78:0/1657865357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b501007f0 0x7f0b50100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.155+0000 7f0b57ff4640 1 --2- 172.21.15.78:0/1657865357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b501067f0 0x7f0b50106bd0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.155+0000 7f0b57ff4640 1 -- 172.21.15.78:0/1657865357 >> 172.21.15.78:0/1657865357 conn(0x7f0b500fc550 msgr2=0x7f0b500fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:36.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.155+0000 7f0b57ff4640 1 -- 172.21.15.78:0/1657865357 shutdown_connections 2024-09-18T13:11:36.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.155+0000 7f0b57ff4640 1 -- 172.21.15.78:0/1657865357 wait complete. 2024-09-18T13:11:36.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.155+0000 7f0b57ff4640 1 Processor -- start 2024-09-18T13:11:36.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.155+0000 7f0b57ff4640 1 -- start start 2024-09-18T13:11:36.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.155+0000 7f0b57ff4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b501007f0 0x7f0b500fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:36.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.155+0000 7f0b57ff4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b501067f0 0x7f0b500fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:36.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.156+0000 7f0b57ff4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5010dd20 con 0x7f0b501067f0 2024-09-18T13:11:36.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.156+0000 7f0b57ff4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5010dba0 con 0x7f0b501007f0 2024-09-18T13:11:36.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.156+0000 7f0b5558f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b501067f0 0x7f0b500fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:36.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.156+0000 7f0b5558f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b501067f0 0x7f0b500fd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34906/0 (socket says 172.21.15.78:34906) 2024-09-18T13:11:36.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.156+0000 7f0b5558f640 1 -- 172.21.15.78:0/1699708309 learned_addr learned my addr 172.21.15.78:0/1699708309 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:11:36.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.156+0000 7f0b55d90640 1 --2- 172.21.15.78:0/1699708309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b501007f0 0x7f0b500fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:36.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.156+0000 7f0b5558f640 1 -- 172.21.15.78:0/1699708309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b501007f0 msgr2=0x7f0b500fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:36.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.156+0000 7f0b5558f640 1 --2- 172.21.15.78:0/1699708309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b501007f0 0x7f0b500fcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.156+0000 7f0b5558f640 1 -- 172.21.15.78:0/1699708309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b500fd7a0 con 0x7f0b501067f0 2024-09-18T13:11:36.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.156+0000 7f0b5558f640 1 --2- 172.21.15.78:0/1699708309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b501067f0 0x7f0b500fd260 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000b420 tx=0x7f0b4000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:36.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.156+0000 7f0b46ffd640 1 -- 172.21.15.78:0/1699708309 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b40011630 con 0x7f0b501067f0 2024-09-18T13:11:36.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.156+0000 7f0b57ff4640 1 -- 172.21.15.78:0/1699708309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b500fda90 con 0x7f0b501067f0 2024-09-18T13:11:36.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.156+0000 7f0b46ffd640 1 -- 172.21.15.78:0/1699708309 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b40016070 con 0x7f0b501067f0 2024-09-18T13:11:36.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.156+0000 7f0b46ffd640 1 -- 172.21.15.78:0/1699708309 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b40010d40 con 0x7f0b501067f0 2024-09-18T13:11:36.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.156+0000 7f0b57ff4640 1 -- 172.21.15.78:0/1699708309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b501a3e80 con 0x7f0b501067f0 2024-09-18T13:11:36.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.157+0000 7f0b57ff4640 1 -- 172.21.15.78:0/1699708309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b50101f30 con 0x7f0b501067f0 2024-09-18T13:11:36.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.158+0000 7f0b46ffd640 1 -- 172.21.15.78:0/1699708309 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f0b4001b460 con 0x7f0b501067f0 2024-09-18T13:11:36.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.158+0000 7f0b46ffd640 1 --2- 172.21.15.78:0/1699708309 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0b3c07af30 0x7f0b3c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:36.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.159+0000 7f0b55d90640 1 --2- 172.21.15.78:0/1699708309 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0b3c07af30 0x7f0b3c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:36.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.159+0000 7f0b46ffd640 1 -- 172.21.15.78:0/1699708309 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f0b4009d810 con 0x7f0b501067f0 2024-09-18T13:11:36.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.159+0000 7f0b55d90640 1 --2- 172.21.15.78:0/1699708309 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0b3c07af30 0x7f0b3c07d3f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0096c0 tx=0x7f0b4c031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:36.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.163+0000 7f0b46ffd640 1 -- 172.21.15.78:0/1699708309 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f0b40021250 con 0x7f0b501067f0 2024-09-18T13:11:36.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.354+0000 7f0b57ff4640 1 -- 172.21.15.78:0/1699708309 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0b50062630 con 0x7f0b3c07af30 2024-09-18T13:11:36.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.355+0000 7f0b46ffd640 1 -- 172.21.15.78:0/1699708309 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f0b50062630 con 0x7f0b3c07af30 2024-09-18T13:11:36.357 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:11:36.357 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:11:36.358 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:11:36.358 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:11:36.358 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:11:36.358 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:11:36.358 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:11:36.358 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:11:36.358 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:11:36.358 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:11:36.358 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:11:36.358 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:11:36.358 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:11:36.358 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:11:36.358 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:11:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.357+0000 7f0b57ff4640 1 -- 172.21.15.78:0/1699708309 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0b3c07af30 msgr2=0x7f0b3c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.357+0000 7f0b57ff4640 1 --2- 172.21.15.78:0/1699708309 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0b3c07af30 0x7f0b3c07d3f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0096c0 tx=0x7f0b4c031400 comp rx=0 tx=0).stop 2024-09-18T13:11:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.357+0000 7f0b57ff4640 1 -- 172.21.15.78:0/1699708309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b501067f0 msgr2=0x7f0b500fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.357+0000 7f0b57ff4640 1 --2- 172.21.15.78:0/1699708309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b501067f0 0x7f0b500fd260 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000b420 tx=0x7f0b4000b8e0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.357+0000 7f0b57ff4640 1 -- 172.21.15.78:0/1699708309 shutdown_connections 2024-09-18T13:11:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.357+0000 7f0b57ff4640 1 --2- 172.21.15.78:0/1699708309 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0b3c07af30 0x7f0b3c07d3f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.357+0000 7f0b57ff4640 1 --2- 172.21.15.78:0/1699708309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b501067f0 0x7f0b500fd260 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.357+0000 7f0b57ff4640 1 --2- 172.21.15.78:0/1699708309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b501007f0 0x7f0b500fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.357+0000 7f0b57ff4640 1 -- 172.21.15.78:0/1699708309 >> 172.21.15.78:0/1699708309 conn(0x7f0b500fc550 msgr2=0x7f0b50069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.358+0000 7f0b57ff4640 1 -- 172.21.15.78:0/1699708309 shutdown_connections 2024-09-18T13:11:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.358+0000 7f0b57ff4640 1 -- 172.21.15.78:0/1699708309 wait complete. 2024-09-18T13:11:36.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.439+0000 7f021d43e640 1 -- 172.21.15.78:0/2512131062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0218106800 msgr2=0x7f0218106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:36.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.439+0000 7f021d43e640 1 --2- 172.21.15.78:0/2512131062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0218106800 0x7f0218106be0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0208009880 tx=0x7f020802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.439+0000 7f021d43e640 1 -- 172.21.15.78:0/2512131062 shutdown_connections 2024-09-18T13:11:36.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.439+0000 7f021d43e640 1 --2- 172.21.15.78:0/2512131062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0218100800 0x7f0218100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.439+0000 7f021d43e640 1 --2- 172.21.15.78:0/2512131062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0218106800 0x7f0218106be0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.439+0000 7f021d43e640 1 -- 172.21.15.78:0/2512131062 >> 172.21.15.78:0/2512131062 conn(0x7f02180fc520 msgr2=0x7f02180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:36.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.439+0000 7f021d43e640 1 -- 172.21.15.78:0/2512131062 shutdown_connections 2024-09-18T13:11:36.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.439+0000 7f021d43e640 1 -- 172.21.15.78:0/2512131062 wait complete. 2024-09-18T13:11:36.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.440+0000 7f021d43e640 1 Processor -- start 2024-09-18T13:11:36.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.440+0000 7f021d43e640 1 -- start start 2024-09-18T13:11:36.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.440+0000 7f021d43e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0218100800 0x7f0218196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:36.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.440+0000 7f021d43e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0218106800 0x7f0218196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:36.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.440+0000 7f021d43e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f021810dcb0 con 0x7f0218100800 2024-09-18T13:11:36.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.440+0000 7f021d43e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f021810db30 con 0x7f0218106800 2024-09-18T13:11:36.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.440+0000 7f0216ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0218100800 0x7f0218196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:36.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.440+0000 7f0216ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0218100800 0x7f0218196600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34922/0 (socket says 172.21.15.78:34922) 2024-09-18T13:11:36.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.440+0000 7f0216ffd640 1 -- 172.21.15.78:0/4139339670 learned_addr learned my addr 172.21.15.78:0/4139339670 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:11:36.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.441+0000 7f0216ffd640 1 -- 172.21.15.78:0/4139339670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0218106800 msgr2=0x7f0218196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:36.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.441+0000 7f0216ffd640 1 --2- 172.21.15.78:0/4139339670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0218106800 0x7f0218196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.441+0000 7f0216ffd640 1 -- 172.21.15.78:0/4139339670 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0218197080 con 0x7f0218100800 2024-09-18T13:11:36.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.441+0000 7f0216ffd640 1 --2- 172.21.15.78:0/4139339670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0218100800 0x7f0218196600 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0208031460 tx=0x7f02080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:36.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.441+0000 7f0214ff9640 1 -- 172.21.15.78:0/4139339670 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f020803f070 con 0x7f0218100800 2024-09-18T13:11:36.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.441+0000 7f0214ff9640 1 -- 172.21.15.78:0/4139339670 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02080035f0 con 0x7f0218100800 2024-09-18T13:11:36.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.441+0000 7f0214ff9640 1 -- 172.21.15.78:0/4139339670 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0208035030 con 0x7f0218100800 2024-09-18T13:11:36.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.441+0000 7f021d43e640 1 -- 172.21.15.78:0/4139339670 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0218197310 con 0x7f0218100800 2024-09-18T13:11:36.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.441+0000 7f021d43e640 1 -- 172.21.15.78:0/4139339670 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02181a3e40 con 0x7f0218100800 2024-09-18T13:11:36.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.442+0000 7f021d43e640 1 -- 172.21.15.78:0/4139339670 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0218101f40 con 0x7f0218100800 2024-09-18T13:11:36.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.443+0000 7f0214ff9640 1 -- 172.21.15.78:0/4139339670 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f0208042070 con 0x7f0218100800 2024-09-18T13:11:36.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.443+0000 7f0214ff9640 1 --2- 172.21.15.78:0/4139339670 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f020407af80 0x7f020407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:11:36.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.443+0000 7f0214ff9640 1 -- 172.21.15.78:0/4139339670 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f02080be970 con 0x7f0218100800 2024-09-18T13:11:36.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.443+0000 7f020e7fc640 1 --2- 172.21.15.78:0/4139339670 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f020407af80 0x7f020407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:11:36.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.444+0000 7f020e7fc640 1 --2- 172.21.15.78:0/4139339670 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f020407af80 0x7f020407d440 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0200005fd0 tx=0x7f0200005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:11:36.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.447+0000 7f0214ff9640 1 -- 172.21.15.78:0/4139339670 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f02080c0e20 con 0x7f0218100800 2024-09-18T13:11:36.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.693+0000 7f021d43e640 1 -- 172.21.15.78:0/4139339670 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0218103480 con 0x7f0218100800 2024-09-18T13:11:36.695 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:36 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/204447680' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:11:36.695 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:36 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1469293294' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:11:36.696 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:36 smithi078 ceph-mon[108578]: from='client.35078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:36.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.693+0000 7f0214ff9640 1 -- 172.21.15.78:0/4139339670 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f0208089f90 con 0x7f0218100800 2024-09-18T13:11:36.696 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:11:36.696 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:11:36.696 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:11:36.696 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:11:36.696 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:11:36.697 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:11:36.697 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:11:36.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.696+0000 7f021d43e640 1 -- 172.21.15.78:0/4139339670 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f020407af80 msgr2=0x7f020407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:36.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.696+0000 7f021d43e640 1 --2- 172.21.15.78:0/4139339670 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f020407af80 0x7f020407d440 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0200005fd0 tx=0x7f0200005850 comp rx=0 tx=0).stop 2024-09-18T13:11:36.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.696+0000 7f021d43e640 1 -- 172.21.15.78:0/4139339670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0218100800 msgr2=0x7f0218196600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:11:36.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.696+0000 7f021d43e640 1 --2- 172.21.15.78:0/4139339670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0218100800 0x7f0218196600 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0208031460 tx=0x7f02080045e0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.696+0000 7f021d43e640 1 -- 172.21.15.78:0/4139339670 shutdown_connections 2024-09-18T13:11:36.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.696+0000 7f021d43e640 1 --2- 172.21.15.78:0/4139339670 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f020407af80 0x7f020407d440 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.696+0000 7f021d43e640 1 --2- 172.21.15.78:0/4139339670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0218106800 0x7f0218196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.696+0000 7f021d43e640 1 --2- 172.21.15.78:0/4139339670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0218100800 0x7f0218196600 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:11:36.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.696+0000 7f021d43e640 1 -- 172.21.15.78:0/4139339670 >> 172.21.15.78:0/4139339670 conn(0x7f02180fc520 msgr2=0x7f02180fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:11:36.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.696+0000 7f021d43e640 1 -- 172.21.15.78:0/4139339670 shutdown_connections 2024-09-18T13:11:36.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:11:36.696+0000 7f021d43e640 1 -- 172.21.15.78:0/4139339670 wait complete. 2024-09-18T13:11:36.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:36 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/204447680' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:11:36.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:36 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1469293294' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:11:36.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:36 smithi148 ceph-mon[80030]: from='client.35078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:11:37.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:37 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/4139339670' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:11:37.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:37 smithi078 ceph-mon[108578]: pgmap v674: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:37 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/4139339670' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:11:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:37 smithi148 ceph-mon[80030]: pgmap v674: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:40 smithi148 ceph-mon[80030]: pgmap v675: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:40.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:40 smithi078 ceph-mon[108578]: pgmap v675: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:11:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:11:42.712 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:42 smithi078 ceph-mon[108578]: pgmap v676: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:42.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:42 smithi148 ceph-mon[80030]: pgmap v676: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:44 smithi148 ceph-mon[80030]: pgmap v677: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:44 smithi078 ceph-mon[108578]: pgmap v677: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:46.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:46 smithi148 ceph-mon[80030]: pgmap v678: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:46.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:46 smithi078 ceph-mon[108578]: pgmap v678: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:48.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:48 smithi148 ceph-mon[80030]: pgmap v679: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:48.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:48 smithi078 ceph-mon[108578]: pgmap v679: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:50 smithi148 ceph-mon[80030]: pgmap v680: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:50 smithi078 ceph-mon[108578]: pgmap v680: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:52 smithi148 ceph-mon[80030]: pgmap v681: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:52.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:52 smithi078 ceph-mon[108578]: pgmap v681: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:54.708 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:54 smithi078 ceph-mon[108578]: pgmap v682: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:54.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:54 smithi148 ceph-mon[80030]: pgmap v682: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:56 smithi148 ceph-mon[80030]: pgmap v683: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:11:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:56 smithi078 ceph-mon[108578]: pgmap v683: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:11:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:11:58 smithi148 ceph-mon[80030]: pgmap v684: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:11:58.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:11:58 smithi078 ceph-mon[108578]: pgmap v684: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:00.687 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:00 smithi148 ceph-mon[80030]: pgmap v685: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:00.700 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:00 smithi078 ceph-mon[108578]: pgmap v685: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:02.715 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:02 smithi078 ceph-mon[108578]: pgmap v686: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:02.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:02 smithi148 ceph-mon[80030]: pgmap v686: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:04 smithi148 ceph-mon[80030]: pgmap v687: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:04 smithi078 ceph-mon[108578]: pgmap v687: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:06.700 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:06 smithi078 ceph-mon[108578]: pgmap v688: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:06.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:06 smithi148 ceph-mon[80030]: pgmap v688: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:06.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.790+0000 7f8ae2843640 1 -- 172.21.15.78:0/1092343162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8adc107900 msgr2=0x7f8adc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:06.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.790+0000 7f8ae2843640 1 --2- 172.21.15.78:0/1092343162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8adc107900 0x7f8adc107ce0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009880 tx=0x7f8acc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:12:06.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.790+0000 7f8ae2843640 1 -- 172.21.15.78:0/1092343162 shutdown_connections 2024-09-18T13:12:06.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.790+0000 7f8ae2843640 1 --2- 172.21.15.78:0/1092343162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8adc101900 0x7f8adc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:06.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.790+0000 7f8ae2843640 1 --2- 172.21.15.78:0/1092343162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8adc107900 0x7f8adc107ce0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:06.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.790+0000 7f8ae2843640 1 -- 172.21.15.78:0/1092343162 >> 172.21.15.78:0/1092343162 conn(0x7f8adc0fd600 msgr2=0x7f8adc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:06.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.790+0000 7f8ae2843640 1 -- 172.21.15.78:0/1092343162 shutdown_connections 2024-09-18T13:12:06.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.790+0000 7f8ae2843640 1 -- 172.21.15.78:0/1092343162 wait complete. 2024-09-18T13:12:06.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.790+0000 7f8ae2843640 1 Processor -- start 2024-09-18T13:12:06.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.790+0000 7f8ae2843640 1 -- start start 2024-09-18T13:12:06.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.791+0000 7f8ae2843640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8adc101900 0x7f8adc19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:06.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.791+0000 7f8ae2843640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8adc107900 0x7f8adc19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:06.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.791+0000 7f8ae2843640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc10edd0 con 0x7f8adc107900 2024-09-18T13:12:06.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.791+0000 7f8ae2843640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc10ec50 con 0x7f8adc101900 2024-09-18T13:12:06.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.791+0000 7f8adb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8adc107900 0x7f8adc19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:06.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.791+0000 7f8adb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8adc107900 0x7f8adc19db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56052/0 (socket says 172.21.15.78:56052) 2024-09-18T13:12:06.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.791+0000 7f8adb7fe640 1 -- 172.21.15.78:0/627230302 learned_addr learned my addr 172.21.15.78:0/627230302 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:12:06.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.791+0000 7f8adbfff640 1 --2- 172.21.15.78:0/627230302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8adc101900 0x7f8adc19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:06.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.791+0000 7f8adb7fe640 1 -- 172.21.15.78:0/627230302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8adc101900 msgr2=0x7f8adc19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:06.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.791+0000 7f8adb7fe640 1 --2- 172.21.15.78:0/627230302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8adc101900 0x7f8adc19d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:06.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.791+0000 7f8adb7fe640 1 -- 172.21.15.78:0/627230302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8adc1977c0 con 0x7f8adc107900 2024-09-18T13:12:06.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.791+0000 7f8adb7fe640 1 --2- 172.21.15.78:0/627230302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8adc107900 0x7f8adc19db80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000d6f0 tx=0x7f8ad000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:06.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.792+0000 7f8ad97fa640 1 -- 172.21.15.78:0/627230302 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ad0017070 con 0x7f8adc107900 2024-09-18T13:12:06.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.792+0000 7f8ad97fa640 1 -- 172.21.15.78:0/627230302 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ad000de00 con 0x7f8adc107900 2024-09-18T13:12:06.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.792+0000 7f8ae2843640 1 -- 172.21.15.78:0/627230302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8adc197ab0 con 0x7f8adc107900 2024-09-18T13:12:06.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.792+0000 7f8ad97fa640 1 -- 172.21.15.78:0/627230302 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ad0004bb0 con 0x7f8adc107900 2024-09-18T13:12:06.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.792+0000 7f8ae2843640 1 -- 172.21.15.78:0/627230302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8adc198040 con 0x7f8adc107900 2024-09-18T13:12:06.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.793+0000 7f8ae2843640 1 -- 172.21.15.78:0/627230302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8adc103040 con 0x7f8adc107900 2024-09-18T13:12:06.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.793+0000 7f8ad97fa640 1 -- 172.21.15.78:0/627230302 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8ad0009a30 con 0x7f8adc107900 2024-09-18T13:12:06.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.794+0000 7f8ad97fa640 1 --2- 172.21.15.78:0/627230302 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8ac407af80 0x7f8ac407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:06.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.794+0000 7f8adbfff640 1 --2- 172.21.15.78:0/627230302 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8ac407af80 0x7f8ac407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:06.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.794+0000 7f8ad97fa640 1 -- 172.21.15.78:0/627230302 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f8ad009db20 con 0x7f8adc107900 2024-09-18T13:12:06.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.795+0000 7f8adbfff640 1 --2- 172.21.15.78:0/627230302 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8ac407af80 0x7f8ac407d440 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0096c0 tx=0x7f8acc031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:06.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.798+0000 7f8ad97fa640 1 -- 172.21.15.78:0/627230302 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8ad0069140 con 0x7f8adc107900 2024-09-18T13:12:06.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.988+0000 7f8ae2843640 1 -- 172.21.15.78:0/627230302 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8adc1982f0 con 0x7f8ac407af80 2024-09-18T13:12:06.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.989+0000 7f8ad97fa640 1 -- 172.21.15.78:0/627230302 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8adc1982f0 con 0x7f8ac407af80 2024-09-18T13:12:06.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.992+0000 7f8ae2843640 1 -- 172.21.15.78:0/627230302 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8ac407af80 msgr2=0x7f8ac407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:06.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.992+0000 7f8ae2843640 1 --2- 172.21.15.78:0/627230302 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8ac407af80 0x7f8ac407d440 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0096c0 tx=0x7f8acc031400 comp rx=0 tx=0).stop 2024-09-18T13:12:06.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.992+0000 7f8ae2843640 1 -- 172.21.15.78:0/627230302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8adc107900 msgr2=0x7f8adc19db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:06.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.992+0000 7f8ae2843640 1 --2- 172.21.15.78:0/627230302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8adc107900 0x7f8adc19db80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000d6f0 tx=0x7f8ad000dbb0 comp rx=0 tx=0).stop 2024-09-18T13:12:06.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.992+0000 7f8ae2843640 1 -- 172.21.15.78:0/627230302 shutdown_connections 2024-09-18T13:12:06.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.992+0000 7f8ae2843640 1 --2- 172.21.15.78:0/627230302 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f8ac407af80 0x7f8ac407d440 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:06.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.992+0000 7f8ae2843640 1 --2- 172.21.15.78:0/627230302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8adc107900 0x7f8adc19db80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:06.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.992+0000 7f8ae2843640 1 --2- 172.21.15.78:0/627230302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8adc101900 0x7f8adc19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:06.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.992+0000 7f8ae2843640 1 -- 172.21.15.78:0/627230302 >> 172.21.15.78:0/627230302 conn(0x7f8adc0fd600 msgr2=0x7f8adc0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:06.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.992+0000 7f8ae2843640 1 -- 172.21.15.78:0/627230302 shutdown_connections 2024-09-18T13:12:06.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:06.992+0000 7f8ae2843640 1 -- 172.21.15.78:0/627230302 wait complete. 2024-09-18T13:12:07.002 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:12:07.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.075+0000 7fe7c08ec640 1 -- 172.21.15.78:0/1635650872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc106800 msgr2=0x7fe7bc106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:07.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.075+0000 7fe7c08ec640 1 --2- 172.21.15.78:0/1635650872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc106800 0x7fe7bc106be0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009880 tx=0x7fe7ac02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.075+0000 7fe7c08ec640 1 -- 172.21.15.78:0/1635650872 shutdown_connections 2024-09-18T13:12:07.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.075+0000 7fe7c08ec640 1 --2- 172.21.15.78:0/1635650872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7bc100800 0x7fe7bc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.075+0000 7fe7c08ec640 1 --2- 172.21.15.78:0/1635650872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc106800 0x7fe7bc106be0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.075+0000 7fe7c08ec640 1 -- 172.21.15.78:0/1635650872 >> 172.21.15.78:0/1635650872 conn(0x7fe7bc0fc520 msgr2=0x7fe7bc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:07.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.075+0000 7fe7c08ec640 1 -- 172.21.15.78:0/1635650872 shutdown_connections 2024-09-18T13:12:07.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.075+0000 7fe7c08ec640 1 -- 172.21.15.78:0/1635650872 wait complete. 2024-09-18T13:12:07.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.076+0000 7fe7c08ec640 1 Processor -- start 2024-09-18T13:12:07.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.076+0000 7fe7c08ec640 1 -- start start 2024-09-18T13:12:07.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.076+0000 7fe7c08ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc100800 0x7fe7bc19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:07.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.076+0000 7fe7c08ec640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7bc106800 0x7fe7bc19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:07.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.076+0000 7fe7c08ec640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe7bc10edf0 con 0x7fe7bc100800 2024-09-18T13:12:07.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.076+0000 7fe7c08ec640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe7bc10ec70 con 0x7fe7bc106800 2024-09-18T13:12:07.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.076+0000 7fe7ba59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc100800 0x7fe7bc19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:07.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.076+0000 7fe7ba59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc100800 0x7fe7bc19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56064/0 (socket says 172.21.15.78:56064) 2024-09-18T13:12:07.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.076+0000 7fe7ba59c640 1 -- 172.21.15.78:0/2916541453 learned_addr learned my addr 172.21.15.78:0/2916541453 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:12:07.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.076+0000 7fe7b9d9b640 1 --2- 172.21.15.78:0/2916541453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7bc106800 0x7fe7bc19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:07.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.077+0000 7fe7ba59c640 1 -- 172.21.15.78:0/2916541453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7bc106800 msgr2=0x7fe7bc19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:07.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.077+0000 7fe7ba59c640 1 --2- 172.21.15.78:0/2916541453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7bc106800 0x7fe7bc19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.077+0000 7fe7ba59c640 1 -- 172.21.15.78:0/2916541453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7bc1977c0 con 0x7fe7bc100800 2024-09-18T13:12:07.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.077+0000 7fe7b9d9b640 1 --2- 172.21.15.78:0/2916541453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7bc106800 0x7fe7bc19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:12:07.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.077+0000 7fe7ba59c640 1 --2- 172.21.15.78:0/2916541453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc100800 0x7fe7bc19d640 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac031460 tx=0x7fe7ac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:07.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.077+0000 7fe7ab7fe640 1 -- 172.21.15.78:0/2916541453 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe7ac03f070 con 0x7fe7bc100800 2024-09-18T13:12:07.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.077+0000 7fe7c08ec640 1 -- 172.21.15.78:0/2916541453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7bc197a50 con 0x7fe7bc100800 2024-09-18T13:12:07.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.077+0000 7fe7ab7fe640 1 -- 172.21.15.78:0/2916541453 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe7ac004cf0 con 0x7fe7bc100800 2024-09-18T13:12:07.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.077+0000 7fe7ab7fe640 1 -- 172.21.15.78:0/2916541453 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe7ac035030 con 0x7fe7bc100800 2024-09-18T13:12:07.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.077+0000 7fe7c08ec640 1 -- 172.21.15.78:0/2916541453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7bc197f80 con 0x7fe7bc100800 2024-09-18T13:12:07.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.078+0000 7fe7c08ec640 1 -- 172.21.15.78:0/2916541453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7bc101f40 con 0x7fe7bc100800 2024-09-18T13:12:07.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.079+0000 7fe7ab7fe640 1 -- 172.21.15.78:0/2916541453 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe7ac042070 con 0x7fe7bc100800 2024-09-18T13:12:07.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.079+0000 7fe7ab7fe640 1 --2- 172.21.15.78:0/2916541453 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe7a407af30 0x7fe7a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:07.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.079+0000 7fe7b9d9b640 1 --2- 172.21.15.78:0/2916541453 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe7a407af30 0x7fe7a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:07.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.079+0000 7fe7ab7fe640 1 -- 172.21.15.78:0/2916541453 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fe7ac0beb20 con 0x7fe7bc100800 2024-09-18T13:12:07.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.080+0000 7fe7b9d9b640 1 --2- 172.21.15.78:0/2916541453 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe7a407af30 0x7fe7a407d3f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0feb80 tx=0x7fe7b0005d30 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:07.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.084+0000 7fe7ab7fe640 1 -- 172.21.15.78:0/2916541453 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe7ac08a0c0 con 0x7fe7bc100800 2024-09-18T13:12:07.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.278+0000 7fe7c08ec640 1 -- 172.21.15.78:0/2916541453 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe7bc198230 con 0x7fe7a407af30 2024-09-18T13:12:07.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.279+0000 7fe7ab7fe640 1 -- 172.21.15.78:0/2916541453 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe7bc198230 con 0x7fe7a407af30 2024-09-18T13:12:07.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.281+0000 7fe7c08ec640 1 -- 172.21.15.78:0/2916541453 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe7a407af30 msgr2=0x7fe7a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:07.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.281+0000 7fe7c08ec640 1 --2- 172.21.15.78:0/2916541453 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe7a407af30 0x7fe7a407d3f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0feb80 tx=0x7fe7b0005d30 comp rx=0 tx=0).stop 2024-09-18T13:12:07.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.282+0000 7fe7c08ec640 1 -- 172.21.15.78:0/2916541453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc100800 msgr2=0x7fe7bc19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:07.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.282+0000 7fe7c08ec640 1 --2- 172.21.15.78:0/2916541453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc100800 0x7fe7bc19d640 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac031460 tx=0x7fe7ac0048f0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.282+0000 7fe7c08ec640 1 -- 172.21.15.78:0/2916541453 shutdown_connections 2024-09-18T13:12:07.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.282+0000 7fe7c08ec640 1 --2- 172.21.15.78:0/2916541453 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe7a407af30 0x7fe7a407d3f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.282+0000 7fe7c08ec640 1 --2- 172.21.15.78:0/2916541453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7bc106800 0x7fe7bc19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.282+0000 7fe7c08ec640 1 --2- 172.21.15.78:0/2916541453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc100800 0x7fe7bc19d640 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.282+0000 7fe7c08ec640 1 -- 172.21.15.78:0/2916541453 >> 172.21.15.78:0/2916541453 conn(0x7fe7bc0fc520 msgr2=0x7fe7bc0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:07.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.282+0000 7fe7c08ec640 1 -- 172.21.15.78:0/2916541453 shutdown_connections 2024-09-18T13:12:07.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.282+0000 7fe7c08ec640 1 -- 172.21.15.78:0/2916541453 wait complete. 2024-09-18T13:12:07.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.363+0000 7fbec96f4640 1 -- 172.21.15.78:0/2494389676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec41007f0 msgr2=0x7fbec4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:07.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.363+0000 7fbec96f4640 1 --2- 172.21.15.78:0/2494389676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec41007f0 0x7fbec4100c50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009880 tx=0x7fbeac02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.363+0000 7fbec96f4640 1 -- 172.21.15.78:0/2494389676 shutdown_connections 2024-09-18T13:12:07.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.363+0000 7fbec96f4640 1 --2- 172.21.15.78:0/2494389676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec41007f0 0x7fbec4100c50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.363+0000 7fbec96f4640 1 --2- 172.21.15.78:0/2494389676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbec41067f0 0x7fbec4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.363+0000 7fbec96f4640 1 -- 172.21.15.78:0/2494389676 >> 172.21.15.78:0/2494389676 conn(0x7fbec40fc550 msgr2=0x7fbec40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:07.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.363+0000 7fbec96f4640 1 -- 172.21.15.78:0/2494389676 shutdown_connections 2024-09-18T13:12:07.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.363+0000 7fbec96f4640 1 -- 172.21.15.78:0/2494389676 wait complete. 2024-09-18T13:12:07.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.364+0000 7fbec96f4640 1 Processor -- start 2024-09-18T13:12:07.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.364+0000 7fbec96f4640 1 -- start start 2024-09-18T13:12:07.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.364+0000 7fbec96f4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbec41007f0 0x7fbec419f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:07.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.364+0000 7fbec96f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec41067f0 0x7fbec419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:07.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.364+0000 7fbec96f4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbec410dd20 con 0x7fbec41067f0 2024-09-18T13:12:07.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.364+0000 7fbec96f4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbec410dba0 con 0x7fbec41007f0 2024-09-18T13:12:07.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.364+0000 7fbeba7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec41067f0 0x7fbec419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:07.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.364+0000 7fbeba7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec41067f0 0x7fbec419fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56094/0 (socket says 172.21.15.78:56094) 2024-09-18T13:12:07.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.364+0000 7fbeba7fc640 1 -- 172.21.15.78:0/1174949675 learned_addr learned my addr 172.21.15.78:0/1174949675 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:12:07.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.364+0000 7fbec2ffd640 1 --2- 172.21.15.78:0/1174949675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbec41007f0 0x7fbec419f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:07.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.365+0000 7fbeba7fc640 1 -- 172.21.15.78:0/1174949675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbec41007f0 msgr2=0x7fbec419f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:07.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.365+0000 7fbeba7fc640 1 --2- 172.21.15.78:0/1174949675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbec41007f0 0x7fbec419f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.365+0000 7fbeba7fc640 1 -- 172.21.15.78:0/1174949675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec4199a50 con 0x7fbec41067f0 2024-09-18T13:12:07.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.365+0000 7fbec2ffd640 1 --2- 172.21.15.78:0/1174949675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbec41007f0 0x7fbec419f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:12:07.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.365+0000 7fbeba7fc640 1 --2- 172.21.15.78:0/1174949675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec41067f0 0x7fbec419fdd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbeac031460 tx=0x7fbeac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:07.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.365+0000 7fbec0ff9640 1 -- 172.21.15.78:0/1174949675 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbeac03f070 con 0x7fbec41067f0 2024-09-18T13:12:07.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.365+0000 7fbec96f4640 1 -- 172.21.15.78:0/1174949675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec4199ce0 con 0x7fbec41067f0 2024-09-18T13:12:07.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.365+0000 7fbec0ff9640 1 -- 172.21.15.78:0/1174949675 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbeac0044d0 con 0x7fbec41067f0 2024-09-18T13:12:07.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.365+0000 7fbec0ff9640 1 -- 172.21.15.78:0/1174949675 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbeac035030 con 0x7fbec41067f0 2024-09-18T13:12:07.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.365+0000 7fbec96f4640 1 -- 172.21.15.78:0/1174949675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec419a210 con 0x7fbec41067f0 2024-09-18T13:12:07.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.366+0000 7fbec96f4640 1 -- 172.21.15.78:0/1174949675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec4101f30 con 0x7fbec41067f0 2024-09-18T13:12:07.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.367+0000 7fbec0ff9640 1 -- 172.21.15.78:0/1174949675 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbeac042070 con 0x7fbec41067f0 2024-09-18T13:12:07.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.367+0000 7fbec0ff9640 1 --2- 172.21.15.78:0/1174949675 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbeb007af40 0x7fbeb007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:07.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.367+0000 7fbec0ff9640 1 -- 172.21.15.78:0/1174949675 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fbeac0bec60 con 0x7fbec41067f0 2024-09-18T13:12:07.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.367+0000 7fbec2ffd640 1 --2- 172.21.15.78:0/1174949675 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbeb007af40 0x7fbeb007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:07.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.368+0000 7fbec2ffd640 1 --2- 172.21.15.78:0/1174949675 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbeb007af40 0x7fbeb007d400 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbec419ab90 tx=0x7fbeb4008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:07.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.372+0000 7fbec0ff9640 1 -- 172.21.15.78:0/1174949675 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbeac004cf0 con 0x7fbec41067f0 2024-09-18T13:12:07.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.557+0000 7fbec96f4640 1 -- 172.21.15.78:0/1174949675 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbec419aff0 con 0x7fbeb007af40 2024-09-18T13:12:07.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.566+0000 7fbec0ff9640 1 -- 172.21.15.78:0/1174949675 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fbec419aff0 con 0x7fbeb007af40 2024-09-18T13:12:07.568 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:12:07.568 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (19m) 14m ago 30m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:12:07.568 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (22m) 14m ago 31m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:12:07.568 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (22m) 13m ago 30m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:12:07.568 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (18m) 14m ago 31m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:12:07.568 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (18m) 13m ago 30m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:12:07.568 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (19m) 14m ago 30m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:12:07.568 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (14m) 14m ago 25m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:12:07.568 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (14m) 14m ago 25m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:12:07.568 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (13m) 13m ago 25m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:12:07.568 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (13m) 13m ago 25m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:12:07.568 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (22m) 14m ago 32m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:12:07.569 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (21m) 13m ago 30m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:12:07.569 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (18m) 14m ago 32m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:12:07.569 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (18m) 13m ago 30m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:12:07.569 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (20m) 14m ago 31m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:12:07.569 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (20m) 13m ago 30m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:12:07.569 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (17m) 14m ago 28m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:12:07.569 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (17m) 14m ago 28m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:12:07.569 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (16m) 14m ago 27m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:12:07.569 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (15m) 13m ago 27m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:12:07.569 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (15m) 13m ago 27m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:12:07.569 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (14m) 13m ago 26m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:12:07.569 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (20m) 14m ago 30m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:12:07.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.568+0000 7fbec96f4640 1 -- 172.21.15.78:0/1174949675 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbeb007af40 msgr2=0x7fbeb007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:07.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.568+0000 7fbec96f4640 1 --2- 172.21.15.78:0/1174949675 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbeb007af40 0x7fbeb007d400 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbec419ab90 tx=0x7fbeb4008040 comp rx=0 tx=0).stop 2024-09-18T13:12:07.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.568+0000 7fbec96f4640 1 -- 172.21.15.78:0/1174949675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec41067f0 msgr2=0x7fbec419fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:07.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.568+0000 7fbec96f4640 1 --2- 172.21.15.78:0/1174949675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec41067f0 0x7fbec419fdd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbeac031460 tx=0x7fbeac0048f0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.569+0000 7fbec96f4640 1 -- 172.21.15.78:0/1174949675 shutdown_connections 2024-09-18T13:12:07.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.569+0000 7fbec96f4640 1 --2- 172.21.15.78:0/1174949675 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbeb007af40 0x7fbeb007d400 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.569+0000 7fbec96f4640 1 --2- 172.21.15.78:0/1174949675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec41067f0 0x7fbec419fdd0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.569+0000 7fbec96f4640 1 --2- 172.21.15.78:0/1174949675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbec41007f0 0x7fbec419f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.569+0000 7fbec96f4640 1 -- 172.21.15.78:0/1174949675 >> 172.21.15.78:0/1174949675 conn(0x7fbec40fc550 msgr2=0x7fbec4069dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:07.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.569+0000 7fbec96f4640 1 -- 172.21.15.78:0/1174949675 shutdown_connections 2024-09-18T13:12:07.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.569+0000 7fbec96f4640 1 -- 172.21.15.78:0/1174949675 wait complete. 2024-09-18T13:12:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.649+0000 7ff701474640 1 -- 172.21.15.78:0/1766304978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc1067f0 msgr2=0x7ff6fc106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.649+0000 7ff701474640 1 --2- 172.21.15.78:0/1766304978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc1067f0 0x7ff6fc106bd0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec009c20 tx=0x7ff6ec02a970 comp rx=0 tx=0).stop 2024-09-18T13:12:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.650+0000 7ff701474640 1 -- 172.21.15.78:0/1766304978 shutdown_connections 2024-09-18T13:12:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.650+0000 7ff701474640 1 --2- 172.21.15.78:0/1766304978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6fc1007f0 0x7ff6fc100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.650+0000 7ff701474640 1 --2- 172.21.15.78:0/1766304978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc1067f0 0x7ff6fc106bd0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.650+0000 7ff701474640 1 -- 172.21.15.78:0/1766304978 >> 172.21.15.78:0/1766304978 conn(0x7ff6fc0fc550 msgr2=0x7ff6fc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.650+0000 7ff701474640 1 -- 172.21.15.78:0/1766304978 shutdown_connections 2024-09-18T13:12:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.650+0000 7ff701474640 1 -- 172.21.15.78:0/1766304978 wait complete. 2024-09-18T13:12:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.650+0000 7ff701474640 1 Processor -- start 2024-09-18T13:12:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.650+0000 7ff701474640 1 -- start start 2024-09-18T13:12:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff701474640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc1007f0 0x7ff6fc196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff701474640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6fc1067f0 0x7ff6fc196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff701474640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc10dcc0 con 0x7ff6fc1007f0 2024-09-18T13:12:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff701474640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc10db40 con 0x7ff6fc1067f0 2024-09-18T13:12:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff6faffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc1007f0 0x7ff6fc196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff6faffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc1007f0 0x7ff6fc196600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56112/0 (socket says 172.21.15.78:56112) 2024-09-18T13:12:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff6faffd640 1 -- 172.21.15.78:0/3189379221 learned_addr learned my addr 172.21.15.78:0/3189379221 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:12:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff6fa7fc640 1 --2- 172.21.15.78:0/3189379221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6fc1067f0 0x7ff6fc196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff6faffd640 1 -- 172.21.15.78:0/3189379221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6fc1067f0 msgr2=0x7ff6fc196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff6faffd640 1 --2- 172.21.15.78:0/3189379221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6fc1067f0 0x7ff6fc196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff6faffd640 1 -- 172.21.15.78:0/3189379221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6fc197080 con 0x7ff6fc1007f0 2024-09-18T13:12:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff6faffd640 1 --2- 172.21.15.78:0/3189379221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc1007f0 0x7ff6fc196600 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec02ae90 tx=0x7ff6ec02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:07.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff6f3fff640 1 -- 172.21.15.78:0/3189379221 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff6ec047070 con 0x7ff6fc1007f0 2024-09-18T13:12:07.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff6f3fff640 1 -- 172.21.15.78:0/3189379221 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6ec02f7e0 con 0x7ff6fc1007f0 2024-09-18T13:12:07.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff701474640 1 -- 172.21.15.78:0/3189379221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6fc197310 con 0x7ff6fc1007f0 2024-09-18T13:12:07.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff6f3fff640 1 -- 172.21.15.78:0/3189379221 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff6ec034070 con 0x7ff6fc1007f0 2024-09-18T13:12:07.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.651+0000 7ff701474640 1 -- 172.21.15.78:0/3189379221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6fc1a3e40 con 0x7ff6fc1007f0 2024-09-18T13:12:07.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.652+0000 7ff701474640 1 -- 172.21.15.78:0/3189379221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6fc101f30 con 0x7ff6fc1007f0 2024-09-18T13:12:07.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.653+0000 7ff6f3fff640 1 -- 172.21.15.78:0/3189379221 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff6ec04a070 con 0x7ff6fc1007f0 2024-09-18T13:12:07.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.653+0000 7ff6f3fff640 1 --2- 172.21.15.78:0/3189379221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff6e807af80 0x7ff6e807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:07.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.654+0000 7ff6f3fff640 1 -- 172.21.15.78:0/3189379221 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7ff6ec0bec60 con 0x7ff6fc1007f0 2024-09-18T13:12:07.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.654+0000 7ff6fa7fc640 1 --2- 172.21.15.78:0/3189379221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff6e807af80 0x7ff6e807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:07.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.654+0000 7ff6fa7fc640 1 --2- 172.21.15.78:0/3189379221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff6e807af80 0x7ff6e807d440 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc198760 tx=0x7ff6e400b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:07.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.658+0000 7ff6f3fff640 1 -- 172.21.15.78:0/3189379221 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff6ec03f070 con 0x7ff6fc1007f0 2024-09-18T13:12:07.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.908+0000 7ff701474640 1 -- 172.21.15.78:0/3189379221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff6fc108db0 con 0x7ff6fc1007f0 2024-09-18T13:12:07.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.908+0000 7ff6f3fff640 1 -- 172.21.15.78:0/3189379221 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7ff6fc108db0 con 0x7ff6fc1007f0 2024-09-18T13:12:07.910 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:12:07.910 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:12:07.910 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:12:07.910 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:12:07.910 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:12:07.910 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:12:07.910 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:12:07.910 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:12:07.910 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:12:07.910 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:12:07.910 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:12:07.911 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:12:07.911 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:12:07.911 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:12:07.911 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:12:07.911 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:12:07.911 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:12:07.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.911+0000 7ff701474640 1 -- 172.21.15.78:0/3189379221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff6e807af80 msgr2=0x7ff6e807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:07.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.911+0000 7ff701474640 1 --2- 172.21.15.78:0/3189379221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff6e807af80 0x7ff6e807d440 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc198760 tx=0x7ff6e400b390 comp rx=0 tx=0).stop 2024-09-18T13:12:07.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.911+0000 7ff701474640 1 -- 172.21.15.78:0/3189379221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc1007f0 msgr2=0x7ff6fc196600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:07.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.911+0000 7ff701474640 1 --2- 172.21.15.78:0/3189379221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc1007f0 0x7ff6fc196600 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec02ae90 tx=0x7ff6ec02f5f0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.911+0000 7ff701474640 1 -- 172.21.15.78:0/3189379221 shutdown_connections 2024-09-18T13:12:07.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.911+0000 7ff701474640 1 --2- 172.21.15.78:0/3189379221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff6e807af80 0x7ff6e807d440 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.911+0000 7ff701474640 1 --2- 172.21.15.78:0/3189379221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6fc1067f0 0x7ff6fc196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.911+0000 7ff701474640 1 --2- 172.21.15.78:0/3189379221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6fc1007f0 0x7ff6fc196600 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.911+0000 7ff701474640 1 -- 172.21.15.78:0/3189379221 >> 172.21.15.78:0/3189379221 conn(0x7ff6fc0fc550 msgr2=0x7ff6fc0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:07.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.911+0000 7ff701474640 1 -- 172.21.15.78:0/3189379221 shutdown_connections 2024-09-18T13:12:07.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.911+0000 7ff701474640 1 -- 172.21.15.78:0/3189379221 wait complete. 2024-09-18T13:12:07.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.992+0000 7f3c77ece640 1 -- 172.21.15.78:0/2679863326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c701033e0 msgr2=0x7f3c7010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.992+0000 7f3c77ece640 1 --2- 172.21.15.78:0/2679863326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c701033e0 0x7f3c7010b8d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009880 tx=0x7f3c6002a530 comp rx=0 tx=0).stop 2024-09-18T13:12:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.992+0000 7f3c77ece640 1 -- 172.21.15.78:0/2679863326 shutdown_connections 2024-09-18T13:12:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.992+0000 7f3c77ece640 1 --2- 172.21.15.78:0/2679863326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c701033e0 0x7f3c7010b8d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.992+0000 7f3c77ece640 1 --2- 172.21.15.78:0/2679863326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c70102ac0 0x7f3c70102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.992+0000 7f3c77ece640 1 -- 172.21.15.78:0/2679863326 >> 172.21.15.78:0/2679863326 conn(0x7f3c700fc520 msgr2=0x7f3c700fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.992+0000 7f3c77ece640 1 -- 172.21.15.78:0/2679863326 shutdown_connections 2024-09-18T13:12:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.992+0000 7f3c77ece640 1 -- 172.21.15.78:0/2679863326 wait complete. 2024-09-18T13:12:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.993+0000 7f3c77ece640 1 Processor -- start 2024-09-18T13:12:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.993+0000 7f3c77ece640 1 -- start start 2024-09-18T13:12:07.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.993+0000 7f3c77ece640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c70102ac0 0x7f3c7019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:07.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.993+0000 7f3c77ece640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c701033e0 0x7f3c7019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:07.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.993+0000 7f3c77ece640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7010ee50 con 0x7f3c70102ac0 2024-09-18T13:12:07.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.993+0000 7f3c77ece640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7010ecd0 con 0x7f3c701033e0 2024-09-18T13:12:07.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.993+0000 7f3c75c6a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c70102ac0 0x7f3c7019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:07.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.993+0000 7f3c75c6a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c70102ac0 0x7f3c7019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56126/0 (socket says 172.21.15.78:56126) 2024-09-18T13:12:07.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.993+0000 7f3c75c6a640 1 -- 172.21.15.78:0/227282753 learned_addr learned my addr 172.21.15.78:0/227282753 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:12:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.993+0000 7f3c75469640 1 --2- 172.21.15.78:0/227282753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c701033e0 0x7f3c7019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.993+0000 7f3c75c6a640 1 -- 172.21.15.78:0/227282753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c701033e0 msgr2=0x7f3c7019dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.993+0000 7f3c75c6a640 1 --2- 172.21.15.78:0/227282753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c701033e0 0x7f3c7019dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.993+0000 7f3c75c6a640 1 -- 172.21.15.78:0/227282753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c70197860 con 0x7f3c70102ac0 2024-09-18T13:12:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.993+0000 7f3c75469640 1 --2- 172.21.15.78:0/227282753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c701033e0 0x7f3c7019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:12:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.994+0000 7f3c75c6a640 1 --2- 172.21.15.78:0/227282753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c70102ac0 0x7f3c7019d6a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00b420 tx=0x7f3c6c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.994+0000 7f3c66ffd640 1 -- 172.21.15.78:0/227282753 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c6c011630 con 0x7f3c70102ac0 2024-09-18T13:12:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.994+0000 7f3c66ffd640 1 -- 172.21.15.78:0/227282753 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c6c016070 con 0x7f3c70102ac0 2024-09-18T13:12:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.994+0000 7f3c77ece640 1 -- 172.21.15.78:0/227282753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c70197b50 con 0x7f3c70102ac0 2024-09-18T13:12:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.994+0000 7f3c66ffd640 1 -- 172.21.15.78:0/227282753 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c6c010d40 con 0x7f3c70102ac0 2024-09-18T13:12:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.994+0000 7f3c77ece640 1 -- 172.21.15.78:0/227282753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c701980b0 con 0x7f3c70102ac0 2024-09-18T13:12:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.995+0000 7f3c77ece640 1 -- 172.21.15.78:0/227282753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c7006aa90 con 0x7f3c70102ac0 2024-09-18T13:12:07.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.995+0000 7f3c66ffd640 1 -- 172.21.15.78:0/227282753 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3c6c01b460 con 0x7f3c70102ac0 2024-09-18T13:12:07.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.996+0000 7f3c66ffd640 1 --2- 172.21.15.78:0/227282753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3c5c07af80 0x7f3c5c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:07.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.996+0000 7f3c66ffd640 1 -- 172.21.15.78:0/227282753 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f3c6c09d750 con 0x7f3c70102ac0 2024-09-18T13:12:07.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.996+0000 7f3c75469640 1 --2- 172.21.15.78:0/227282753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3c5c07af80 0x7f3c5c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:07.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:07.996+0000 7f3c75469640 1 --2- 172.21.15.78:0/227282753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3c5c07af80 0x7f3c5c07d440 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3c70199050 tx=0x7f3c60031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:08.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.000+0000 7f3c66ffd640 1 -- 172.21.15.78:0/227282753 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3c6c021250 con 0x7f3c70102ac0 2024-09-18T13:12:08.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.211+0000 7f3c77ece640 1 -- 172.21.15.78:0/227282753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3c70198d90 con 0x7f3c70102ac0 2024-09-18T13:12:08.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.211+0000 7f3c66ffd640 1 -- 172.21.15.78:0/227282753 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f3c6c068d70 con 0x7f3c70102ac0 2024-09-18T13:12:08.213 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:12:08.213 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:12:08.213 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:12:08.213 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:12:08.213 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:12:08.213 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:12:08.213 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:12:08.213 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:12:08.213 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:12:08.213 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:12:08.214 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:12:08.214 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:12:08.214 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:12:08.214 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:12:08.214 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:12:08.214 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:12:08.214 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:12:08.214 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:12:08.214 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:12:08.214 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:12:08.214 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:12:08.214 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:12:08.214 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:12:08.215 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:12:08.215 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:12:08.215 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:12:08.215 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:12:08.215 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:12:08.215 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:12:08.215 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:12:08.215 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:12:08.215 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:12:08.215 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:12:08.215 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:12:08.215 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:12:08.215 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:12:08.215 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:12:08.215 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:12:08.216 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:12:08.216 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:12:08.216 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:12:08.216 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:12:08.216 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:12:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:12:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.213+0000 7f3c77ece640 1 -- 172.21.15.78:0/227282753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3c5c07af80 msgr2=0x7f3c5c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.213+0000 7f3c77ece640 1 --2- 172.21.15.78:0/227282753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3c5c07af80 0x7f3c5c07d440 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3c70199050 tx=0x7f3c60031400 comp rx=0 tx=0).stop 2024-09-18T13:12:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.213+0000 7f3c77ece640 1 -- 172.21.15.78:0/227282753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c70102ac0 msgr2=0x7f3c7019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.213+0000 7f3c77ece640 1 --2- 172.21.15.78:0/227282753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c70102ac0 0x7f3c7019d6a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00b420 tx=0x7f3c6c00b8e0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.213+0000 7f3c77ece640 1 -- 172.21.15.78:0/227282753 shutdown_connections 2024-09-18T13:12:08.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.213+0000 7f3c77ece640 1 --2- 172.21.15.78:0/227282753 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3c5c07af80 0x7f3c5c07d440 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.213+0000 7f3c77ece640 1 --2- 172.21.15.78:0/227282753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c701033e0 0x7f3c7019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.214+0000 7f3c77ece640 1 --2- 172.21.15.78:0/227282753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c70102ac0 0x7f3c7019d6a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.214+0000 7f3c77ece640 1 -- 172.21.15.78:0/227282753 >> 172.21.15.78:0/227282753 conn(0x7f3c700fc520 msgr2=0x7f3c70108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:08.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.214+0000 7f3c77ece640 1 -- 172.21.15.78:0/227282753 shutdown_connections 2024-09-18T13:12:08.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.214+0000 7f3c77ece640 1 -- 172.21.15.78:0/227282753 wait complete. 2024-09-18T13:12:08.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.297+0000 7fc9802f7640 1 -- 172.21.15.78:0/2387388654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc978106800 msgr2=0x7fc978106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:08.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.297+0000 7fc9802f7640 1 --2- 172.21.15.78:0/2387388654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc978106800 0x7fc978106be0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc968009880 tx=0x7fc96802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.297+0000 7fc9802f7640 1 -- 172.21.15.78:0/2387388654 shutdown_connections 2024-09-18T13:12:08.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.297+0000 7fc9802f7640 1 --2- 172.21.15.78:0/2387388654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc978100800 0x7fc978100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.297+0000 7fc9802f7640 1 --2- 172.21.15.78:0/2387388654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc978106800 0x7fc978106be0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.297+0000 7fc9802f7640 1 -- 172.21.15.78:0/2387388654 >> 172.21.15.78:0/2387388654 conn(0x7fc9780fc520 msgr2=0x7fc9780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:08.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.297+0000 7fc9802f7640 1 -- 172.21.15.78:0/2387388654 shutdown_connections 2024-09-18T13:12:08.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.297+0000 7fc9802f7640 1 -- 172.21.15.78:0/2387388654 wait complete. 2024-09-18T13:12:08.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.298+0000 7fc9802f7640 1 Processor -- start 2024-09-18T13:12:08.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.298+0000 7fc9802f7640 1 -- start start 2024-09-18T13:12:08.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.298+0000 7fc9802f7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc978100800 0x7fc97819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:08.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.298+0000 7fc9802f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc978106800 0x7fc97819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:08.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.298+0000 7fc9802f7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc97810dcb0 con 0x7fc978106800 2024-09-18T13:12:08.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.298+0000 7fc9802f7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc97810db30 con 0x7fc978100800 2024-09-18T13:12:08.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.298+0000 7fc97d892640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc978106800 0x7fc97819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:08.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.298+0000 7fc97d892640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc978106800 0x7fc97819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56140/0 (socket says 172.21.15.78:56140) 2024-09-18T13:12:08.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.298+0000 7fc97d892640 1 -- 172.21.15.78:0/3814697335 learned_addr learned my addr 172.21.15.78:0/3814697335 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:12:08.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.298+0000 7fc97e093640 1 --2- 172.21.15.78:0/3814697335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc978100800 0x7fc97819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:08.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.298+0000 7fc97d892640 1 -- 172.21.15.78:0/3814697335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc978100800 msgr2=0x7fc97819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:08.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.298+0000 7fc97d892640 1 --2- 172.21.15.78:0/3814697335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc978100800 0x7fc97819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.298+0000 7fc97d892640 1 -- 172.21.15.78:0/3814697335 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc978197740 con 0x7fc978106800 2024-09-18T13:12:08.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.299+0000 7fc97d892640 1 --2- 172.21.15.78:0/3814697335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc978106800 0x7fc97819dbb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc97400c8a0 tx=0x7fc97400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:08.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.299+0000 7fc96f7fe640 1 -- 172.21.15.78:0/3814697335 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9740079b0 con 0x7fc978106800 2024-09-18T13:12:08.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.299+0000 7fc96f7fe640 1 -- 172.21.15.78:0/3814697335 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc974007b50 con 0x7fc978106800 2024-09-18T13:12:08.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.299+0000 7fc9802f7640 1 -- 172.21.15.78:0/3814697335 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc978197a30 con 0x7fc978106800 2024-09-18T13:12:08.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.299+0000 7fc96f7fe640 1 -- 172.21.15.78:0/3814697335 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc974018700 con 0x7fc978106800 2024-09-18T13:12:08.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.299+0000 7fc9802f7640 1 -- 172.21.15.78:0/3814697335 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc978197fc0 con 0x7fc978106800 2024-09-18T13:12:08.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.300+0000 7fc9802f7640 1 -- 172.21.15.78:0/3814697335 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc978101f40 con 0x7fc978106800 2024-09-18T13:12:08.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.301+0000 7fc96f7fe640 1 -- 172.21.15.78:0/3814697335 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc974007d00 con 0x7fc978106800 2024-09-18T13:12:08.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.301+0000 7fc96f7fe640 1 --2- 172.21.15.78:0/3814697335 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc96407af80 0x7fc96407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:08.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.301+0000 7fc97e093640 1 --2- 172.21.15.78:0/3814697335 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc96407af80 0x7fc96407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:08.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.301+0000 7fc96f7fe640 1 -- 172.21.15.78:0/3814697335 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fc97409e1e0 con 0x7fc978106800 2024-09-18T13:12:08.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.302+0000 7fc97e093640 1 --2- 172.21.15.78:0/3814697335 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc96407af80 0x7fc96407d440 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc968000c00 tx=0x7fc968031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:08.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.306+0000 7fc96f7fe640 1 -- 172.21.15.78:0/3814697335 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc974014030 con 0x7fc978106800 2024-09-18T13:12:08.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:08 smithi078 ceph-mon[108578]: from='client.35086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:08.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:08 smithi078 ceph-mon[108578]: from='client.35090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:08.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:08 smithi078 ceph-mon[108578]: pgmap v689: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:08.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:08 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3189379221' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:12:08.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:08 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/227282753' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:12:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.497+0000 7fc9802f7640 1 -- 172.21.15.78:0/3814697335 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc9781982d0 con 0x7fc96407af80 2024-09-18T13:12:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.499+0000 7fc96f7fe640 1 -- 172.21.15.78:0/3814697335 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc9781982d0 con 0x7fc96407af80 2024-09-18T13:12:08.500 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:12:08.500 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:12:08.500 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:12:08.500 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:12:08.500 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:12:08.500 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:12:08.500 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:12:08.500 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:12:08.500 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:12:08.500 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:12:08.501 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:12:08.501 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:12:08.501 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:12:08.501 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:12:08.501 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:12:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.501+0000 7fc9802f7640 1 -- 172.21.15.78:0/3814697335 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc96407af80 msgr2=0x7fc96407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.501+0000 7fc9802f7640 1 --2- 172.21.15.78:0/3814697335 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc96407af80 0x7fc96407d440 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc968000c00 tx=0x7fc968031400 comp rx=0 tx=0).stop 2024-09-18T13:12:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.501+0000 7fc9802f7640 1 -- 172.21.15.78:0/3814697335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc978106800 msgr2=0x7fc97819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.501+0000 7fc9802f7640 1 --2- 172.21.15.78:0/3814697335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc978106800 0x7fc97819dbb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc97400c8a0 tx=0x7fc97400cd60 comp rx=0 tx=0).stop 2024-09-18T13:12:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.501+0000 7fc9802f7640 1 -- 172.21.15.78:0/3814697335 shutdown_connections 2024-09-18T13:12:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.501+0000 7fc9802f7640 1 --2- 172.21.15.78:0/3814697335 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc96407af80 0x7fc96407d440 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.501+0000 7fc9802f7640 1 --2- 172.21.15.78:0/3814697335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc978106800 0x7fc97819dbb0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.501+0000 7fc9802f7640 1 --2- 172.21.15.78:0/3814697335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc978100800 0x7fc97819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.501+0000 7fc9802f7640 1 -- 172.21.15.78:0/3814697335 >> 172.21.15.78:0/3814697335 conn(0x7fc9780fc520 msgr2=0x7fc97806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.501+0000 7fc9802f7640 1 -- 172.21.15.78:0/3814697335 shutdown_connections 2024-09-18T13:12:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.501+0000 7fc9802f7640 1 -- 172.21.15.78:0/3814697335 wait complete. 2024-09-18T13:12:08.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.582+0000 7f6ea16f5640 1 -- 172.21.15.78:0/2179032541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e9c101900 msgr2=0x7f6e9c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:08.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.582+0000 7f6ea16f5640 1 --2- 172.21.15.78:0/2179032541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e9c101900 0x7f6e9c101d60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009880 tx=0x7f6e9002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.582+0000 7f6ea16f5640 1 -- 172.21.15.78:0/2179032541 shutdown_connections 2024-09-18T13:12:08.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.582+0000 7f6ea16f5640 1 --2- 172.21.15.78:0/2179032541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e9c101900 0x7f6e9c101d60 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.582+0000 7f6ea16f5640 1 --2- 172.21.15.78:0/2179032541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e9c107900 0x7f6e9c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.582+0000 7f6ea16f5640 1 -- 172.21.15.78:0/2179032541 >> 172.21.15.78:0/2179032541 conn(0x7f6e9c0fd600 msgr2=0x7f6e9c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:08.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.582+0000 7f6ea16f5640 1 -- 172.21.15.78:0/2179032541 shutdown_connections 2024-09-18T13:12:08.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.582+0000 7f6ea16f5640 1 -- 172.21.15.78:0/2179032541 wait complete. 2024-09-18T13:12:08.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.583+0000 7f6ea16f5640 1 Processor -- start 2024-09-18T13:12:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.583+0000 7f6ea16f5640 1 -- start start 2024-09-18T13:12:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.583+0000 7f6ea16f5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e9c101900 0x7f6e9c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.583+0000 7f6ea16f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e9c107900 0x7f6e9c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.583+0000 7f6ea16f5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c10edd0 con 0x7f6e9c101900 2024-09-18T13:12:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.583+0000 7f6ea16f5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c10ec50 con 0x7f6e9c107900 2024-09-18T13:12:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.583+0000 7f6e9affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e9c101900 0x7f6e9c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.584+0000 7f6e9affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e9c101900 0x7f6e9c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56158/0 (socket says 172.21.15.78:56158) 2024-09-18T13:12:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.584+0000 7f6e9affd640 1 -- 172.21.15.78:0/1941558025 learned_addr learned my addr 172.21.15.78:0/1941558025 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:12:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.584+0000 7f6e9a7fc640 1 --2- 172.21.15.78:0/1941558025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e9c107900 0x7f6e9c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.584+0000 7f6e9affd640 1 -- 172.21.15.78:0/1941558025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e9c107900 msgr2=0x7f6e9c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.584+0000 7f6e9affd640 1 --2- 172.21.15.78:0/1941558025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e9c107900 0x7f6e9c19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.584+0000 7f6e9affd640 1 -- 172.21.15.78:0/1941558025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9c1977c0 con 0x7f6e9c101900 2024-09-18T13:12:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.584+0000 7f6e9affd640 1 --2- 172.21.15.78:0/1941558025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e9c101900 0x7f6e9c19d640 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00ea00 tx=0x7f6e8c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.584+0000 7f6e83fff640 1 -- 172.21.15.78:0/1941558025 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e8c00cb80 con 0x7f6e9c101900 2024-09-18T13:12:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.584+0000 7f6e83fff640 1 -- 172.21.15.78:0/1941558025 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e8c00cd20 con 0x7f6e9c101900 2024-09-18T13:12:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.584+0000 7f6ea16f5640 1 -- 172.21.15.78:0/1941558025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e9c197ab0 con 0x7f6e9c101900 2024-09-18T13:12:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.584+0000 7f6e83fff640 1 -- 172.21.15.78:0/1941558025 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e8c011470 con 0x7f6e9c101900 2024-09-18T13:12:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.584+0000 7f6ea16f5640 1 -- 172.21.15.78:0/1941558025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e9c198010 con 0x7f6e9c101900 2024-09-18T13:12:08.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.585+0000 7f6ea16f5640 1 -- 172.21.15.78:0/1941558025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e9c103040 con 0x7f6e9c101900 2024-09-18T13:12:08.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.586+0000 7f6e83fff640 1 -- 172.21.15.78:0/1941558025 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6e8c005020 con 0x7f6e9c101900 2024-09-18T13:12:08.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.586+0000 7f6e83fff640 1 --2- 172.21.15.78:0/1941558025 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6e8407af80 0x7f6e8407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:08.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.587+0000 7f6e83fff640 1 -- 172.21.15.78:0/1941558025 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f6e8c09e440 con 0x7f6e9c101900 2024-09-18T13:12:08.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.587+0000 7f6e9a7fc640 1 --2- 172.21.15.78:0/1941558025 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6e8407af80 0x7f6e8407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:08.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.587+0000 7f6e9a7fc640 1 --2- 172.21.15.78:0/1941558025 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6e8407af80 0x7f6e8407d440 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c198b10 tx=0x7f6e90031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:08.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.591+0000 7f6e83fff640 1 -- 172.21.15.78:0/1941558025 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6e8c016030 con 0x7f6e9c101900 2024-09-18T13:12:08.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:08 smithi148 ceph-mon[80030]: from='client.35086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:08.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:08 smithi148 ceph-mon[80030]: from='client.35090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:08.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:08 smithi148 ceph-mon[80030]: pgmap v689: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:08.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:08 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3189379221' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:12:08.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:08 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/227282753' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:12:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.837+0000 7f6ea16f5640 1 -- 172.21.15.78:0/1941558025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6e9c109e70 con 0x7f6e9c101900 2024-09-18T13:12:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.838+0000 7f6e83fff640 1 -- 172.21.15.78:0/1941558025 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f6e8c069a60 con 0x7f6e9c101900 2024-09-18T13:12:08.839 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:12:08.839 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:12:08.839 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:12:08.839 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:12:08.839 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:12:08.840 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:12:08.840 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:12:08.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.840+0000 7f6ea16f5640 1 -- 172.21.15.78:0/1941558025 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6e8407af80 msgr2=0x7f6e8407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:08.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.840+0000 7f6ea16f5640 1 --2- 172.21.15.78:0/1941558025 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6e8407af80 0x7f6e8407d440 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c198b10 tx=0x7f6e90031400 comp rx=0 tx=0).stop 2024-09-18T13:12:08.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.840+0000 7f6ea16f5640 1 -- 172.21.15.78:0/1941558025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e9c101900 msgr2=0x7f6e9c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:08.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.840+0000 7f6ea16f5640 1 --2- 172.21.15.78:0/1941558025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e9c101900 0x7f6e9c19d640 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00ea00 tx=0x7f6e8c00eec0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.840+0000 7f6ea16f5640 1 -- 172.21.15.78:0/1941558025 shutdown_connections 2024-09-18T13:12:08.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.840+0000 7f6ea16f5640 1 --2- 172.21.15.78:0/1941558025 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6e8407af80 0x7f6e8407d440 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.840+0000 7f6ea16f5640 1 --2- 172.21.15.78:0/1941558025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e9c107900 0x7f6e9c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.840+0000 7f6ea16f5640 1 --2- 172.21.15.78:0/1941558025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e9c101900 0x7f6e9c19d640 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:08.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.840+0000 7f6ea16f5640 1 -- 172.21.15.78:0/1941558025 >> 172.21.15.78:0/1941558025 conn(0x7f6e9c0fd600 msgr2=0x7f6e9c0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:08.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.840+0000 7f6ea16f5640 1 -- 172.21.15.78:0/1941558025 shutdown_connections 2024-09-18T13:12:08.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:08.840+0000 7f6ea16f5640 1 -- 172.21.15.78:0/1941558025 wait complete. 2024-09-18T13:12:09.714 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:09 smithi078 ceph-mon[108578]: from='client.35094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:09.714 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:09 smithi078 ceph-mon[108578]: from='client.35106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:09.714 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:09 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1941558025' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:12:09.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:09 smithi148 ceph-mon[80030]: from='client.35094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:09.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:09 smithi148 ceph-mon[80030]: from='client.35106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:09.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:09 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1941558025' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:12:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:10 smithi148 ceph-mon[80030]: pgmap v690: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:10.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:10 smithi078 ceph-mon[108578]: pgmap v690: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:12:11.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:12:12.711 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:12 smithi078 ceph-mon[108578]: pgmap v691: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:12.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:12 smithi148 ceph-mon[80030]: pgmap v691: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:14 smithi148 ceph-mon[80030]: pgmap v692: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:14 smithi078 ceph-mon[108578]: pgmap v692: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:16.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:16 smithi148 ceph-mon[80030]: pgmap v693: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:16 smithi078 ceph-mon[108578]: pgmap v693: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:18.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:18 smithi078 ceph-mon[108578]: pgmap v694: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:18.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:18 smithi148 ceph-mon[80030]: pgmap v694: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:20 smithi148 ceph-mon[80030]: pgmap v695: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:20.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:20 smithi078 ceph-mon[108578]: pgmap v695: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:22 smithi148 ceph-mon[80030]: pgmap v696: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:22.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:22 smithi078 ceph-mon[108578]: pgmap v696: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:24.708 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:24 smithi078 ceph-mon[108578]: pgmap v697: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:24.750 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:24 smithi148 ceph-mon[80030]: pgmap v697: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:26 smithi148 ceph-mon[80030]: pgmap v698: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:12:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:26 smithi078 ceph-mon[108578]: pgmap v698: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:12:28.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:28 smithi148 ceph-mon[80030]: pgmap v699: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:28.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:28 smithi078 ceph-mon[108578]: pgmap v699: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:30 smithi148 ceph-mon[80030]: pgmap v700: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:30.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:30 smithi078 ceph-mon[108578]: pgmap v700: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:32.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:32 smithi148 ceph-mon[80030]: pgmap v701: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:32 smithi078 ceph-mon[108578]: pgmap v701: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:34.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:34 smithi148 ceph-mon[80030]: pgmap v702: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:34 smithi078 ceph-mon[108578]: pgmap v702: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:36.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:36 smithi078 ceph-mon[108578]: pgmap v703: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:36.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:36 smithi148 ceph-mon[80030]: pgmap v703: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:38.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:38 smithi078 ceph-mon[108578]: pgmap v704: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:38.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.932+0000 7f5c9ae48640 1 -- 172.21.15.78:0/52209318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c94107900 msgr2=0x7f5c94107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:38.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.932+0000 7f5c9ae48640 1 --2- 172.21.15.78:0/52209318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c94107900 0x7f5c94107ce0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009880 tx=0x7f5c9002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:12:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.933+0000 7f5c9ae48640 1 -- 172.21.15.78:0/52209318 shutdown_connections 2024-09-18T13:12:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.933+0000 7f5c9ae48640 1 --2- 172.21.15.78:0/52209318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c94101900 0x7f5c94101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.933+0000 7f5c9ae48640 1 --2- 172.21.15.78:0/52209318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c94107900 0x7f5c94107ce0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.933+0000 7f5c9ae48640 1 -- 172.21.15.78:0/52209318 >> 172.21.15.78:0/52209318 conn(0x7f5c940fd600 msgr2=0x7f5c940ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.933+0000 7f5c9ae48640 1 -- 172.21.15.78:0/52209318 shutdown_connections 2024-09-18T13:12:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.933+0000 7f5c9ae48640 1 -- 172.21.15.78:0/52209318 wait complete. 2024-09-18T13:12:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.933+0000 7f5c9ae48640 1 Processor -- start 2024-09-18T13:12:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.933+0000 7f5c9ae48640 1 -- start start 2024-09-18T13:12:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.933+0000 7f5c9ae48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c94101900 0x7f5c9419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.934+0000 7f5c9ae48640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c94107900 0x7f5c9419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.934+0000 7f5c9ae48640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9410edd0 con 0x7f5c94101900 2024-09-18T13:12:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.934+0000 7f5c9ae48640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9410ec50 con 0x7f5c94107900 2024-09-18T13:12:38.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.934+0000 7f5c98be4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c94101900 0x7f5c9419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:38.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.934+0000 7f5c98be4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c94101900 0x7f5c9419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43016/0 (socket says 172.21.15.78:43016) 2024-09-18T13:12:38.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.934+0000 7f5c98be4640 1 -- 172.21.15.78:0/1703744016 learned_addr learned my addr 172.21.15.78:0/1703744016 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:12:38.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.934+0000 7f5c8bfff640 1 --2- 172.21.15.78:0/1703744016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c94107900 0x7f5c9419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:38.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.934+0000 7f5c98be4640 1 -- 172.21.15.78:0/1703744016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c94107900 msgr2=0x7f5c9419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:38.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.934+0000 7f5c98be4640 1 --2- 172.21.15.78:0/1703744016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c94107900 0x7f5c9419db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:38.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.934+0000 7f5c98be4640 1 -- 172.21.15.78:0/1703744016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c941977c0 con 0x7f5c94101900 2024-09-18T13:12:38.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.934+0000 7f5c98be4640 1 --2- 172.21.15.78:0/1703744016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c94101900 0x7f5c9419d640 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5c90031460 tx=0x7f5c900045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:38.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.934+0000 7f5c89ffb640 1 -- 172.21.15.78:0/1703744016 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c9003f070 con 0x7f5c94101900 2024-09-18T13:12:38.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.934+0000 7f5c9ae48640 1 -- 172.21.15.78:0/1703744016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c94197a50 con 0x7f5c94101900 2024-09-18T13:12:38.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.934+0000 7f5c89ffb640 1 -- 172.21.15.78:0/1703744016 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c900035f0 con 0x7f5c94101900 2024-09-18T13:12:38.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.934+0000 7f5c89ffb640 1 -- 172.21.15.78:0/1703744016 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c90035030 con 0x7f5c94101900 2024-09-18T13:12:38.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.935+0000 7f5c9ae48640 1 -- 172.21.15.78:0/1703744016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c94197f80 con 0x7f5c94101900 2024-09-18T13:12:38.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.936+0000 7f5c9ae48640 1 -- 172.21.15.78:0/1703744016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c94103040 con 0x7f5c94101900 2024-09-18T13:12:38.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.936+0000 7f5c89ffb640 1 -- 172.21.15.78:0/1703744016 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5c90042070 con 0x7f5c94101900 2024-09-18T13:12:38.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.937+0000 7f5c89ffb640 1 --2- 172.21.15.78:0/1703744016 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5c7c07af80 0x7f5c7c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:38.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.937+0000 7f5c89ffb640 1 -- 172.21.15.78:0/1703744016 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f5c900be8c0 con 0x7f5c94101900 2024-09-18T13:12:38.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.937+0000 7f5c8bfff640 1 --2- 172.21.15.78:0/1703744016 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5c7c07af80 0x7f5c7c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:38.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.937+0000 7f5c8bfff640 1 --2- 172.21.15.78:0/1703744016 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5c7c07af80 0x7f5c7c07d440 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5c940ffbf0 tx=0x7f5c8400b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:38.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:38.942+0000 7f5c89ffb640 1 -- 172.21.15.78:0/1703744016 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5c90089ee0 con 0x7f5c94101900 2024-09-18T13:12:38.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:38 smithi148 ceph-mon[80030]: pgmap v704: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:39.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.132+0000 7f5c9ae48640 1 -- 172.21.15.78:0/1703744016 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5c941982f0 con 0x7f5c7c07af80 2024-09-18T13:12:39.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.133+0000 7f5c89ffb640 1 -- 172.21.15.78:0/1703744016 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5c941982f0 con 0x7f5c7c07af80 2024-09-18T13:12:39.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.135+0000 7f5c9ae48640 1 -- 172.21.15.78:0/1703744016 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5c7c07af80 msgr2=0x7f5c7c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:39.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.135+0000 7f5c9ae48640 1 --2- 172.21.15.78:0/1703744016 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5c7c07af80 0x7f5c7c07d440 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5c940ffbf0 tx=0x7f5c8400b390 comp rx=0 tx=0).stop 2024-09-18T13:12:39.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.135+0000 7f5c9ae48640 1 -- 172.21.15.78:0/1703744016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c94101900 msgr2=0x7f5c9419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:39.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.135+0000 7f5c9ae48640 1 --2- 172.21.15.78:0/1703744016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c94101900 0x7f5c9419d640 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5c90031460 tx=0x7f5c900045e0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.135+0000 7f5c9ae48640 1 -- 172.21.15.78:0/1703744016 shutdown_connections 2024-09-18T13:12:39.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.135+0000 7f5c9ae48640 1 --2- 172.21.15.78:0/1703744016 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f5c7c07af80 0x7f5c7c07d440 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.135+0000 7f5c9ae48640 1 --2- 172.21.15.78:0/1703744016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c94107900 0x7f5c9419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.135+0000 7f5c9ae48640 1 --2- 172.21.15.78:0/1703744016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c94101900 0x7f5c9419d640 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.135+0000 7f5c9ae48640 1 -- 172.21.15.78:0/1703744016 >> 172.21.15.78:0/1703744016 conn(0x7f5c940fd600 msgr2=0x7f5c940fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:39.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.135+0000 7f5c9ae48640 1 -- 172.21.15.78:0/1703744016 shutdown_connections 2024-09-18T13:12:39.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.135+0000 7f5c9ae48640 1 -- 172.21.15.78:0/1703744016 wait complete. 2024-09-18T13:12:39.146 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:12:39.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.218+0000 7f9be7d4d640 1 -- 172.21.15.78:0/2429907278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be0101910 msgr2=0x7f9be0101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:39.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.218+0000 7f9be7d4d640 1 --2- 172.21.15.78:0/2429907278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be0101910 0x7f9be0101d70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009880 tx=0x7f9bd002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.218+0000 7f9be7d4d640 1 -- 172.21.15.78:0/2429907278 shutdown_connections 2024-09-18T13:12:39.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.218+0000 7f9be7d4d640 1 --2- 172.21.15.78:0/2429907278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be0101910 0x7f9be0101d70 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.218+0000 7f9be7d4d640 1 --2- 172.21.15.78:0/2429907278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9be0107910 0x7f9be0107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.218+0000 7f9be7d4d640 1 -- 172.21.15.78:0/2429907278 >> 172.21.15.78:0/2429907278 conn(0x7f9be00fd630 msgr2=0x7f9be00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:39.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.219+0000 7f9be7d4d640 1 -- 172.21.15.78:0/2429907278 shutdown_connections 2024-09-18T13:12:39.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.219+0000 7f9be7d4d640 1 -- 172.21.15.78:0/2429907278 wait complete. 2024-09-18T13:12:39.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.219+0000 7f9be7d4d640 1 Processor -- start 2024-09-18T13:12:39.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.219+0000 7f9be7d4d640 1 -- start start 2024-09-18T13:12:39.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.220+0000 7f9be7d4d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be0101910 0x7f9be019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:39.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.220+0000 7f9be7d4d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9be0107910 0x7f9be019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:39.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.220+0000 7f9be7d4d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9be010edc0 con 0x7f9be0101910 2024-09-18T13:12:39.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.220+0000 7f9be7d4d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9be010ec40 con 0x7f9be0107910 2024-09-18T13:12:39.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.220+0000 7f9be5ae9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be0101910 0x7f9be019f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:39.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.220+0000 7f9be5ae9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be0101910 0x7f9be019f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43036/0 (socket says 172.21.15.78:43036) 2024-09-18T13:12:39.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.220+0000 7f9be5ae9640 1 -- 172.21.15.78:0/399508273 learned_addr learned my addr 172.21.15.78:0/399508273 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:12:39.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.220+0000 7f9be52e8640 1 --2- 172.21.15.78:0/399508273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9be0107910 0x7f9be019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:39.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.220+0000 7f9be5ae9640 1 -- 172.21.15.78:0/399508273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9be0107910 msgr2=0x7f9be019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:39.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.220+0000 7f9be5ae9640 1 --2- 172.21.15.78:0/399508273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9be0107910 0x7f9be019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.220+0000 7f9be5ae9640 1 -- 172.21.15.78:0/399508273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be01a03d0 con 0x7f9be0101910 2024-09-18T13:12:39.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.220+0000 7f9be5ae9640 1 --2- 172.21.15.78:0/399508273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be0101910 0x7f9be019f7e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00c8a0 tx=0x7f9bdc00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:39.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.220+0000 7f9bd6ffd640 1 -- 172.21.15.78:0/399508273 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9bdc0079b0 con 0x7f9be0101910 2024-09-18T13:12:39.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.221+0000 7f9bd6ffd640 1 -- 172.21.15.78:0/399508273 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9bdc007b50 con 0x7f9be0101910 2024-09-18T13:12:39.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.221+0000 7f9be7d4d640 1 -- 172.21.15.78:0/399508273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be0199ac0 con 0x7f9be0101910 2024-09-18T13:12:39.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.221+0000 7f9bd6ffd640 1 -- 172.21.15.78:0/399508273 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9bdc018700 con 0x7f9be0101910 2024-09-18T13:12:39.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.221+0000 7f9be7d4d640 1 -- 172.21.15.78:0/399508273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be019a020 con 0x7f9be0101910 2024-09-18T13:12:39.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.222+0000 7f9be7d4d640 1 -- 172.21.15.78:0/399508273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9be0103050 con 0x7f9be0101910 2024-09-18T13:12:39.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.223+0000 7f9bd6ffd640 1 -- 172.21.15.78:0/399508273 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9bdc007d00 con 0x7f9be0101910 2024-09-18T13:12:39.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.223+0000 7f9bd6ffd640 1 --2- 172.21.15.78:0/399508273 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9bcc07af80 0x7f9bcc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:39.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.223+0000 7f9be52e8640 1 --2- 172.21.15.78:0/399508273 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9bcc07af80 0x7f9bcc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:39.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.223+0000 7f9bd6ffd640 1 -- 172.21.15.78:0/399508273 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f9bdc09e2b0 con 0x7f9be0101910 2024-09-18T13:12:39.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.224+0000 7f9be52e8640 1 --2- 172.21.15.78:0/399508273 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9bcc07af80 0x7f9bcc07d440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9be019b190 tx=0x7f9bd0031420 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:39.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.229+0000 7f9bd6ffd640 1 -- 172.21.15.78:0/399508273 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9bdc014030 con 0x7f9be0101910 2024-09-18T13:12:39.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.420+0000 7f9be7d4d640 1 -- 172.21.15.78:0/399508273 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9be019a370 con 0x7f9bcc07af80 2024-09-18T13:12:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.421+0000 7f9bd6ffd640 1 -- 172.21.15.78:0/399508273 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9be019a370 con 0x7f9bcc07af80 2024-09-18T13:12:39.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.424+0000 7f9be7d4d640 1 -- 172.21.15.78:0/399508273 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9bcc07af80 msgr2=0x7f9bcc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:39.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.424+0000 7f9be7d4d640 1 --2- 172.21.15.78:0/399508273 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9bcc07af80 0x7f9bcc07d440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9be019b190 tx=0x7f9bd0031420 comp rx=0 tx=0).stop 2024-09-18T13:12:39.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.424+0000 7f9be7d4d640 1 -- 172.21.15.78:0/399508273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be0101910 msgr2=0x7f9be019f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:39.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.424+0000 7f9be7d4d640 1 --2- 172.21.15.78:0/399508273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be0101910 0x7f9be019f7e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00c8a0 tx=0x7f9bdc00cd60 comp rx=0 tx=0).stop 2024-09-18T13:12:39.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.424+0000 7f9be7d4d640 1 -- 172.21.15.78:0/399508273 shutdown_connections 2024-09-18T13:12:39.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.424+0000 7f9be7d4d640 1 --2- 172.21.15.78:0/399508273 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9bcc07af80 0x7f9bcc07d440 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.424+0000 7f9be7d4d640 1 --2- 172.21.15.78:0/399508273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9be0107910 0x7f9be019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.424+0000 7f9be7d4d640 1 --2- 172.21.15.78:0/399508273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be0101910 0x7f9be019f7e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.424+0000 7f9be7d4d640 1 -- 172.21.15.78:0/399508273 >> 172.21.15.78:0/399508273 conn(0x7f9be00fd630 msgr2=0x7f9be0074440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:39.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.424+0000 7f9be7d4d640 1 -- 172.21.15.78:0/399508273 shutdown_connections 2024-09-18T13:12:39.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.424+0000 7f9be7d4d640 1 -- 172.21.15.78:0/399508273 wait complete. 2024-09-18T13:12:39.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.506+0000 7f6f47dcd640 1 -- 172.21.15.78:0/3330392395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f40100ff0 msgr2=0x7f6f4010dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.506+0000 7f6f47dcd640 1 --2- 172.21.15.78:0/3330392395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f40100ff0 0x7f6f4010dcb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009880 tx=0x7f6f3002a490 comp rx=0 tx=0).stop 2024-09-18T13:12:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.506+0000 7f6f47dcd640 1 -- 172.21.15.78:0/3330392395 shutdown_connections 2024-09-18T13:12:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.506+0000 7f6f47dcd640 1 --2- 172.21.15.78:0/3330392395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f40100ff0 0x7f6f4010dcb0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.506+0000 7f6f47dcd640 1 --2- 172.21.15.78:0/3330392395 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f40100640 0x7f6f40100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.506+0000 7f6f47dcd640 1 -- 172.21.15.78:0/3330392395 >> 172.21.15.78:0/3330392395 conn(0x7f6f400fc550 msgr2=0x7f6f400fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.506+0000 7f6f47dcd640 1 -- 172.21.15.78:0/3330392395 shutdown_connections 2024-09-18T13:12:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.506+0000 7f6f47dcd640 1 -- 172.21.15.78:0/3330392395 wait complete. 2024-09-18T13:12:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.507+0000 7f6f47dcd640 1 Processor -- start 2024-09-18T13:12:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.507+0000 7f6f47dcd640 1 -- start start 2024-09-18T13:12:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.507+0000 7f6f47dcd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f40100640 0x7f6f4019f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.507+0000 7f6f47dcd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f40100ff0 0x7f6f4019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.507+0000 7f6f47dcd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6f40110ff0 con 0x7f6f40100ff0 2024-09-18T13:12:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.507+0000 7f6f47dcd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6f40110e70 con 0x7f6f40100640 2024-09-18T13:12:39.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.507+0000 7f6f45368640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f40100ff0 0x7f6f4019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:39.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.507+0000 7f6f45368640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f40100ff0 0x7f6f4019fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43062/0 (socket says 172.21.15.78:43062) 2024-09-18T13:12:39.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.507+0000 7f6f45368640 1 -- 172.21.15.78:0/3420081387 learned_addr learned my addr 172.21.15.78:0/3420081387 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:12:39.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.508+0000 7f6f45368640 1 -- 172.21.15.78:0/3420081387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f40100640 msgr2=0x7f6f4019f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:39.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.508+0000 7f6f45368640 1 --2- 172.21.15.78:0/3420081387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f40100640 0x7f6f4019f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.508+0000 7f6f45368640 1 -- 172.21.15.78:0/3420081387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f40199a60 con 0x7f6f40100ff0 2024-09-18T13:12:39.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.508+0000 7f6f45368640 1 --2- 172.21.15.78:0/3420081387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f40100ff0 0x7f6f4019fde0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6f30031460 tx=0x7f6f300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:39.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.508+0000 7f6f36ffd640 1 -- 172.21.15.78:0/3420081387 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f3003f070 con 0x7f6f40100ff0 2024-09-18T13:12:39.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.508+0000 7f6f36ffd640 1 -- 172.21.15.78:0/3420081387 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f30004cf0 con 0x7f6f40100ff0 2024-09-18T13:12:39.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.508+0000 7f6f36ffd640 1 -- 172.21.15.78:0/3420081387 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f30035030 con 0x7f6f40100ff0 2024-09-18T13:12:39.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.508+0000 7f6f47dcd640 1 -- 172.21.15.78:0/3420081387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f40199cf0 con 0x7f6f40100ff0 2024-09-18T13:12:39.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.508+0000 7f6f47dcd640 1 -- 172.21.15.78:0/3420081387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f4019a280 con 0x7f6f40100ff0 2024-09-18T13:12:39.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.509+0000 7f6f47dcd640 1 -- 172.21.15.78:0/3420081387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f4006a580 con 0x7f6f40100ff0 2024-09-18T13:12:39.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.510+0000 7f6f36ffd640 1 -- 172.21.15.78:0/3420081387 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6f30042070 con 0x7f6f40100ff0 2024-09-18T13:12:39.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.510+0000 7f6f36ffd640 1 --2- 172.21.15.78:0/3420081387 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f2c07af80 0x7f6f2c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:39.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.510+0000 7f6f45b69640 1 --2- 172.21.15.78:0/3420081387 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f2c07af80 0x7f6f2c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:39.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.510+0000 7f6f36ffd640 1 -- 172.21.15.78:0/3420081387 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f6f300bea40 con 0x7f6f40100ff0 2024-09-18T13:12:39.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.511+0000 7f6f45b69640 1 --2- 172.21.15.78:0/3420081387 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f2c07af80 0x7f6f2c07d440 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6f4019aba0 tx=0x7f6f3c006c90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:39.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.515+0000 7f6f36ffd640 1 -- 172.21.15.78:0/3420081387 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6f3008a060 con 0x7f6f40100ff0 2024-09-18T13:12:39.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.696+0000 7f6f47dcd640 1 -- 172.21.15.78:0/3420081387 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6f4019af90 con 0x7f6f2c07af80 2024-09-18T13:12:39.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.706+0000 7f6f36ffd640 1 -- 172.21.15.78:0/3420081387 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f6f4019af90 con 0x7f6f2c07af80 2024-09-18T13:12:39.708 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:12:39.709 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (20m) 14m ago 31m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:12:39.709 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (23m) 14m ago 31m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:12:39.709 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (22m) 14m ago 30m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:12:39.709 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (18m) 14m ago 31m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:12:39.709 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (18m) 14m ago 30m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:12:39.709 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (20m) 14m ago 31m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:12:39.709 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (15m) 14m ago 26m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:12:39.709 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (14m) 14m ago 26m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:12:39.709 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (14m) 14m ago 26m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:12:39.709 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (14m) 14m ago 26m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:12:39.709 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (22m) 14m ago 32m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:12:39.709 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (21m) 14m ago 30m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:12:39.710 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (19m) 14m ago 32m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:12:39.710 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (18m) 14m ago 30m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:12:39.710 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (21m) 14m ago 31m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:12:39.710 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (21m) 14m ago 30m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:12:39.710 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (18m) 14m ago 29m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:12:39.710 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (17m) 14m ago 28m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:12:39.710 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (17m) 14m ago 28m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:12:39.710 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (16m) 14m ago 28m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:12:39.710 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (15m) 14m ago 27m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:12:39.710 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (15m) 14m ago 27m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:12:39.710 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (20m) 14m ago 31m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:12:39.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.708+0000 7f6f47dcd640 1 -- 172.21.15.78:0/3420081387 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f2c07af80 msgr2=0x7f6f2c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:39.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.708+0000 7f6f47dcd640 1 --2- 172.21.15.78:0/3420081387 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f2c07af80 0x7f6f2c07d440 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6f4019aba0 tx=0x7f6f3c006c90 comp rx=0 tx=0).stop 2024-09-18T13:12:39.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.708+0000 7f6f47dcd640 1 -- 172.21.15.78:0/3420081387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f40100ff0 msgr2=0x7f6f4019fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:39.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.708+0000 7f6f47dcd640 1 --2- 172.21.15.78:0/3420081387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f40100ff0 0x7f6f4019fde0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6f30031460 tx=0x7f6f300048f0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.708+0000 7f6f47dcd640 1 -- 172.21.15.78:0/3420081387 shutdown_connections 2024-09-18T13:12:39.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.708+0000 7f6f47dcd640 1 --2- 172.21.15.78:0/3420081387 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f2c07af80 0x7f6f2c07d440 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.708+0000 7f6f47dcd640 1 --2- 172.21.15.78:0/3420081387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f40100ff0 0x7f6f4019fde0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.708+0000 7f6f47dcd640 1 --2- 172.21.15.78:0/3420081387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f40100640 0x7f6f4019f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.708+0000 7f6f47dcd640 1 -- 172.21.15.78:0/3420081387 >> 172.21.15.78:0/3420081387 conn(0x7f6f400fc550 msgr2=0x7f6f400fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:39.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.709+0000 7f6f47dcd640 1 -- 172.21.15.78:0/3420081387 shutdown_connections 2024-09-18T13:12:39.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.709+0000 7f6f47dcd640 1 -- 172.21.15.78:0/3420081387 wait complete. 2024-09-18T13:12:39.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.788+0000 7fadd7da4640 1 -- 172.21.15.78:0/1440400617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0101900 msgr2=0x7fadd0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:39.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.788+0000 7fadd7da4640 1 --2- 172.21.15.78:0/1440400617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0101900 0x7fadd0101d60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009880 tx=0x7fadcc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.788+0000 7fadd7da4640 1 -- 172.21.15.78:0/1440400617 shutdown_connections 2024-09-18T13:12:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.788+0000 7fadd7da4640 1 --2- 172.21.15.78:0/1440400617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0101900 0x7fadd0101d60 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.788+0000 7fadd7da4640 1 --2- 172.21.15.78:0/1440400617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd0107900 0x7fadd0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.788+0000 7fadd7da4640 1 -- 172.21.15.78:0/1440400617 >> 172.21.15.78:0/1440400617 conn(0x7fadd00fd600 msgr2=0x7fadd00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.788+0000 7fadd7da4640 1 -- 172.21.15.78:0/1440400617 shutdown_connections 2024-09-18T13:12:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.788+0000 7fadd7da4640 1 -- 172.21.15.78:0/1440400617 wait complete. 2024-09-18T13:12:39.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.789+0000 7fadd7da4640 1 Processor -- start 2024-09-18T13:12:39.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.789+0000 7fadd7da4640 1 -- start start 2024-09-18T13:12:39.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.789+0000 7fadd7da4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0101900 0x7fadd00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:39.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.789+0000 7fadd7da4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd0107900 0x7fadd0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:39.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.789+0000 7fadd7da4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fadd010edd0 con 0x7fadd0101900 2024-09-18T13:12:39.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.789+0000 7fadd7da4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fadd010ec50 con 0x7fadd0107900 2024-09-18T13:12:39.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.789+0000 7fadd5b40640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0101900 0x7fadd00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:39.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.789+0000 7fadd5b40640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0101900 0x7fadd00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43092/0 (socket says 172.21.15.78:43092) 2024-09-18T13:12:39.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.789+0000 7fadd5b40640 1 -- 172.21.15.78:0/621203901 learned_addr learned my addr 172.21.15.78:0/621203901 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:12:39.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.789+0000 7fadd533f640 1 --2- 172.21.15.78:0/621203901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd0107900 0x7fadd0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:39.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.790+0000 7fadd5b40640 1 -- 172.21.15.78:0/621203901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd0107900 msgr2=0x7fadd0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:39.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.790+0000 7fadd5b40640 1 --2- 172.21.15.78:0/621203901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd0107900 0x7fadd0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:39.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.790+0000 7fadd5b40640 1 -- 172.21.15.78:0/621203901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd0074f70 con 0x7fadd0101900 2024-09-18T13:12:39.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.790+0000 7fadd5b40640 1 --2- 172.21.15.78:0/621203901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0101900 0x7fadd00744f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c8f0 tx=0x7fadc000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:39.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.790+0000 7fadc6ffd640 1 -- 172.21.15.78:0/621203901 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fadc00079b0 con 0x7fadd0101900 2024-09-18T13:12:39.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.790+0000 7fadc6ffd640 1 -- 172.21.15.78:0/621203901 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fadc00054e0 con 0x7fadd0101900 2024-09-18T13:12:39.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.790+0000 7fadd7da4640 1 -- 172.21.15.78:0/621203901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd0075260 con 0x7fadd0101900 2024-09-18T13:12:39.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.790+0000 7fadc6ffd640 1 -- 172.21.15.78:0/621203901 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fadc0004dd0 con 0x7fadd0101900 2024-09-18T13:12:39.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.790+0000 7fadd7da4640 1 -- 172.21.15.78:0/621203901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd01a3e80 con 0x7fadd0101900 2024-09-18T13:12:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.791+0000 7fadd7da4640 1 -- 172.21.15.78:0/621203901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd0103040 con 0x7fadd0101900 2024-09-18T13:12:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.792+0000 7fadc6ffd640 1 -- 172.21.15.78:0/621203901 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fadc0005020 con 0x7fadd0101900 2024-09-18T13:12:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.792+0000 7fadc6ffd640 1 --2- 172.21.15.78:0/621203901 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fadbc07af30 0x7fadbc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.792+0000 7fadc6ffd640 1 -- 172.21.15.78:0/621203901 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fadc009df50 con 0x7fadd0101900 2024-09-18T13:12:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.792+0000 7fadd533f640 1 --2- 172.21.15.78:0/621203901 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fadbc07af30 0x7fadbc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.793+0000 7fadd533f640 1 --2- 172.21.15.78:0/621203901 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fadbc07af30 0x7fadbc07d3f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fadd0075f80 tx=0x7fadcc031420 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:39.797+0000 7fadc6ffd640 1 -- 172.21.15.78:0/621203901 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fadc0014030 con 0x7fadd0101900 2024-09-18T13:12:40.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.040+0000 7fadd7da4640 1 -- 172.21.15.78:0/621203901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fadd0109e70 con 0x7fadd0101900 2024-09-18T13:12:40.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.041+0000 7fadc6ffd640 1 -- 172.21.15.78:0/621203901 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fadc0069570 con 0x7fadd0101900 2024-09-18T13:12:40.045 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:12:40.045 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:12:40.045 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:12:40.046 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:12:40.046 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:12:40.046 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:12:40.046 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:12:40.046 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:12:40.046 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:12:40.046 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:12:40.046 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:12:40.046 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:12:40.046 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:12:40.046 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:12:40.046 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:12:40.046 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:12:40.047 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:12:40.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.043+0000 7fadd7da4640 1 -- 172.21.15.78:0/621203901 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fadbc07af30 msgr2=0x7fadbc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:40.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.043+0000 7fadd7da4640 1 --2- 172.21.15.78:0/621203901 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fadbc07af30 0x7fadbc07d3f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fadd0075f80 tx=0x7fadcc031420 comp rx=0 tx=0).stop 2024-09-18T13:12:40.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.043+0000 7fadd7da4640 1 -- 172.21.15.78:0/621203901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0101900 msgr2=0x7fadd00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:40.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.043+0000 7fadd7da4640 1 --2- 172.21.15.78:0/621203901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0101900 0x7fadd00744f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c8f0 tx=0x7fadc000cdb0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.043+0000 7fadd7da4640 1 -- 172.21.15.78:0/621203901 shutdown_connections 2024-09-18T13:12:40.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.043+0000 7fadd7da4640 1 --2- 172.21.15.78:0/621203901 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fadbc07af30 0x7fadbc07d3f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.043+0000 7fadd7da4640 1 --2- 172.21.15.78:0/621203901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadd0107900 0x7fadd0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.043+0000 7fadd7da4640 1 --2- 172.21.15.78:0/621203901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0101900 0x7fadd00744f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.043+0000 7fadd7da4640 1 -- 172.21.15.78:0/621203901 >> 172.21.15.78:0/621203901 conn(0x7fadd00fd600 msgr2=0x7fadd00fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:40.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.043+0000 7fadd7da4640 1 -- 172.21.15.78:0/621203901 shutdown_connections 2024-09-18T13:12:40.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.043+0000 7fadd7da4640 1 -- 172.21.15.78:0/621203901 wait complete. 2024-09-18T13:12:40.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.125+0000 7ff9d036b640 1 -- 172.21.15.78:0/2501393202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9c8106800 msgr2=0x7ff9c8106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:40.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.125+0000 7ff9d036b640 1 --2- 172.21.15.78:0/2501393202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9c8106800 0x7ff9c8106be0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009880 tx=0x7ff9bc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.125+0000 7ff9d036b640 1 -- 172.21.15.78:0/2501393202 shutdown_connections 2024-09-18T13:12:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.125+0000 7ff9d036b640 1 --2- 172.21.15.78:0/2501393202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9c8100800 0x7ff9c8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.125+0000 7ff9d036b640 1 --2- 172.21.15.78:0/2501393202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9c8106800 0x7ff9c8106be0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.125+0000 7ff9d036b640 1 -- 172.21.15.78:0/2501393202 >> 172.21.15.78:0/2501393202 conn(0x7ff9c80fc520 msgr2=0x7ff9c80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.125+0000 7ff9d036b640 1 -- 172.21.15.78:0/2501393202 shutdown_connections 2024-09-18T13:12:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.125+0000 7ff9d036b640 1 -- 172.21.15.78:0/2501393202 wait complete. 2024-09-18T13:12:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.126+0000 7ff9d036b640 1 Processor -- start 2024-09-18T13:12:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.126+0000 7ff9d036b640 1 -- start start 2024-09-18T13:12:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.126+0000 7ff9d036b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9c8100800 0x7ff9c819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.126+0000 7ff9d036b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9c8106800 0x7ff9c819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.126+0000 7ff9d036b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c810dcd0 con 0x7ff9c8106800 2024-09-18T13:12:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.126+0000 7ff9d036b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c810db50 con 0x7ff9c8100800 2024-09-18T13:12:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.126+0000 7ff9cd906640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9c8106800 0x7ff9c819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.126+0000 7ff9cd906640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9c8106800 0x7ff9c819cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43110/0 (socket says 172.21.15.78:43110) 2024-09-18T13:12:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.126+0000 7ff9cd906640 1 -- 172.21.15.78:0/1675147221 learned_addr learned my addr 172.21.15.78:0/1675147221 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:12:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.126+0000 7ff9ce107640 1 --2- 172.21.15.78:0/1675147221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9c8100800 0x7ff9c819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.126+0000 7ff9cd906640 1 -- 172.21.15.78:0/1675147221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9c8100800 msgr2=0x7ff9c819c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.126+0000 7ff9cd906640 1 --2- 172.21.15.78:0/1675147221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9c8100800 0x7ff9c819c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.126+0000 7ff9cd906640 1 -- 172.21.15.78:0/1675147221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c81966d0 con 0x7ff9c8106800 2024-09-18T13:12:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.127+0000 7ff9cd906640 1 --2- 172.21.15.78:0/1675147221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9c8106800 0x7ff9c819cb40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400d6f0 tx=0x7ff9c400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.127+0000 7ff9bb7fe640 1 -- 172.21.15.78:0/1675147221 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9c4017070 con 0x7ff9c8106800 2024-09-18T13:12:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.127+0000 7ff9bb7fe640 1 -- 172.21.15.78:0/1675147221 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9c400de00 con 0x7ff9c8106800 2024-09-18T13:12:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.127+0000 7ff9d036b640 1 -- 172.21.15.78:0/1675147221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c81969c0 con 0x7ff9c8106800 2024-09-18T13:12:40.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.127+0000 7ff9bb7fe640 1 -- 172.21.15.78:0/1675147221 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9c4004bb0 con 0x7ff9c8106800 2024-09-18T13:12:40.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.127+0000 7ff9d036b640 1 -- 172.21.15.78:0/1675147221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c8196f20 con 0x7ff9c8106800 2024-09-18T13:12:40.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.128+0000 7ff9d036b640 1 -- 172.21.15.78:0/1675147221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c8101f40 con 0x7ff9c8106800 2024-09-18T13:12:40.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.128+0000 7ff9bb7fe640 1 -- 172.21.15.78:0/1675147221 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff9c4009a30 con 0x7ff9c8106800 2024-09-18T13:12:40.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.129+0000 7ff9bb7fe640 1 --2- 172.21.15.78:0/1675147221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff9b407af80 0x7ff9b407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:40.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.129+0000 7ff9bb7fe640 1 -- 172.21.15.78:0/1675147221 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7ff9c409db80 con 0x7ff9c8106800 2024-09-18T13:12:40.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.129+0000 7ff9ce107640 1 --2- 172.21.15.78:0/1675147221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff9b407af80 0x7ff9b407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:40.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.129+0000 7ff9ce107640 1 --2- 172.21.15.78:0/1675147221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff9b407af80 0x7ff9b407d440 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0096c0 tx=0x7ff9bc031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:40.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.133+0000 7ff9bb7fe640 1 -- 172.21.15.78:0/1675147221 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff9c4069140 con 0x7ff9c8106800 2024-09-18T13:12:40.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.344+0000 7ff9d036b640 1 -- 172.21.15.78:0/1675147221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff9c8197c00 con 0x7ff9c8106800 2024-09-18T13:12:40.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.345+0000 7ff9bb7fe640 1 -- 172.21.15.78:0/1675147221 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7ff9c406dff0 con 0x7ff9c8106800 2024-09-18T13:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:12:40.347 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:12:40.347 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:12:40.347 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:12:40.347 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:12:40.347 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:12:40.347 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:12:40.347 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:12:40.347 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:12:40.347 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:12:40.347 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:12:40.347 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:12:40.347 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:12:40.347 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:12:40.347 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:12:40.348 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:12:40.348 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:12:40.348 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:12:40.348 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:12:40.348 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:12:40.348 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:12:40.348 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:12:40.348 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:12:40.348 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:12:40.348 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:12:40.348 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:12:40.348 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:12:40.348 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:12:40.348 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:12:40.349 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:12:40.349 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:12:40.349 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:12:40.349 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:12:40.349 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:12:40.349 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:12:40.349 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:12:40.349 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:12:40.349 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:12:40.349 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:12:40.349 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:12:40.349 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:12:40.350 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:12:40.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.348+0000 7ff9d036b640 1 -- 172.21.15.78:0/1675147221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff9b407af80 msgr2=0x7ff9b407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:40.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.348+0000 7ff9d036b640 1 --2- 172.21.15.78:0/1675147221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff9b407af80 0x7ff9b407d440 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0096c0 tx=0x7ff9bc031400 comp rx=0 tx=0).stop 2024-09-18T13:12:40.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.348+0000 7ff9d036b640 1 -- 172.21.15.78:0/1675147221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9c8106800 msgr2=0x7ff9c819cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:40.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.348+0000 7ff9d036b640 1 --2- 172.21.15.78:0/1675147221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9c8106800 0x7ff9c819cb40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400d6f0 tx=0x7ff9c400dbb0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.348+0000 7ff9d036b640 1 -- 172.21.15.78:0/1675147221 shutdown_connections 2024-09-18T13:12:40.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.348+0000 7ff9d036b640 1 --2- 172.21.15.78:0/1675147221 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7ff9b407af80 0x7ff9b407d440 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.348+0000 7ff9d036b640 1 --2- 172.21.15.78:0/1675147221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9c8106800 0x7ff9c819cb40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.348+0000 7ff9d036b640 1 --2- 172.21.15.78:0/1675147221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9c8100800 0x7ff9c819c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.348+0000 7ff9d036b640 1 -- 172.21.15.78:0/1675147221 >> 172.21.15.78:0/1675147221 conn(0x7ff9c80fc520 msgr2=0x7ff9c80fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:40.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.349+0000 7ff9d036b640 1 -- 172.21.15.78:0/1675147221 shutdown_connections 2024-09-18T13:12:40.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.349+0000 7ff9d036b640 1 -- 172.21.15.78:0/1675147221 wait complete. 2024-09-18T13:12:40.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.432+0000 7fe5c5058640 1 -- 172.21.15.78:0/2076916141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c0107900 msgr2=0x7fe5c0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:40.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.432+0000 7fe5c5058640 1 --2- 172.21.15.78:0/2076916141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c0107900 0x7fe5c0107ce0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009880 tx=0x7fe5b002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.432+0000 7fe5c5058640 1 -- 172.21.15.78:0/2076916141 shutdown_connections 2024-09-18T13:12:40.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.432+0000 7fe5c5058640 1 --2- 172.21.15.78:0/2076916141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c0101900 0x7fe5c0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.432+0000 7fe5c5058640 1 --2- 172.21.15.78:0/2076916141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c0107900 0x7fe5c0107ce0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.432+0000 7fe5c5058640 1 -- 172.21.15.78:0/2076916141 >> 172.21.15.78:0/2076916141 conn(0x7fe5c00fd600 msgr2=0x7fe5c00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:40.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.432+0000 7fe5c5058640 1 -- 172.21.15.78:0/2076916141 shutdown_connections 2024-09-18T13:12:40.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.432+0000 7fe5c5058640 1 -- 172.21.15.78:0/2076916141 wait complete. 2024-09-18T13:12:40.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.433+0000 7fe5c5058640 1 Processor -- start 2024-09-18T13:12:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.433+0000 7fe5c5058640 1 -- start start 2024-09-18T13:12:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.433+0000 7fe5c5058640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c0101900 0x7fe5c019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.433+0000 7fe5c5058640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c0107900 0x7fe5c019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.433+0000 7fe5c5058640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c010edd0 con 0x7fe5c0107900 2024-09-18T13:12:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.433+0000 7fe5c5058640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c010ec50 con 0x7fe5c0101900 2024-09-18T13:12:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.433+0000 7fe5be59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c0107900 0x7fe5c019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.433+0000 7fe5be59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c0107900 0x7fe5c019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43132/0 (socket says 172.21.15.78:43132) 2024-09-18T13:12:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.433+0000 7fe5be59c640 1 -- 172.21.15.78:0/1343367196 learned_addr learned my addr 172.21.15.78:0/1343367196 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:12:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.433+0000 7fe5bed9d640 1 --2- 172.21.15.78:0/1343367196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c0101900 0x7fe5c019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.434+0000 7fe5be59c640 1 -- 172.21.15.78:0/1343367196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c0101900 msgr2=0x7fe5c019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.434+0000 7fe5be59c640 1 --2- 172.21.15.78:0/1343367196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c0101900 0x7fe5c019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.434+0000 7fe5be59c640 1 -- 172.21.15.78:0/1343367196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c01977c0 con 0x7fe5c0107900 2024-09-18T13:12:40.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.434+0000 7fe5bed9d640 1 --2- 172.21.15.78:0/1343367196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c0101900 0x7fe5c019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:12:40.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.434+0000 7fe5be59c640 1 --2- 172.21.15.78:0/1343367196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c0107900 0x7fe5c019db80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400e970 tx=0x7fe5b400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:40.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.434+0000 7fe5a7fff640 1 -- 172.21.15.78:0/1343367196 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe5b400cac0 con 0x7fe5c0107900 2024-09-18T13:12:40.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.434+0000 7fe5c5058640 1 -- 172.21.15.78:0/1343367196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c0197ab0 con 0x7fe5c0107900 2024-09-18T13:12:40.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.434+0000 7fe5a7fff640 1 -- 172.21.15.78:0/1343367196 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe5b40054e0 con 0x7fe5c0107900 2024-09-18T13:12:40.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.434+0000 7fe5a7fff640 1 -- 172.21.15.78:0/1343367196 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe5b4010430 con 0x7fe5c0107900 2024-09-18T13:12:40.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.434+0000 7fe5c5058640 1 -- 172.21.15.78:0/1343367196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c0198040 con 0x7fe5c0107900 2024-09-18T13:12:40.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.435+0000 7fe5c5058640 1 -- 172.21.15.78:0/1343367196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c0103040 con 0x7fe5c0107900 2024-09-18T13:12:40.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.436+0000 7fe5a7fff640 1 -- 172.21.15.78:0/1343367196 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe5b4004ec0 con 0x7fe5c0107900 2024-09-18T13:12:40.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.436+0000 7fe5a7fff640 1 --2- 172.21.15.78:0/1343367196 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe5a807af30 0x7fe5a807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:40.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.437+0000 7fe5bed9d640 1 --2- 172.21.15.78:0/1343367196 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe5a807af30 0x7fe5a807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:40.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.437+0000 7fe5a7fff640 1 -- 172.21.15.78:0/1343367196 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fe5b409e7b0 con 0x7fe5c0107900 2024-09-18T13:12:40.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.437+0000 7fe5bed9d640 1 --2- 172.21.15.78:0/1343367196 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe5a807af30 0x7fe5a807d3f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0000c00 tx=0x7fe5b0031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:40.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.441+0000 7fe5a7fff640 1 -- 172.21.15.78:0/1343367196 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe5b4069d50 con 0x7fe5c0107900 2024-09-18T13:12:40.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.634+0000 7fe5c5058640 1 -- 172.21.15.78:0/1343367196 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe5c0198350 con 0x7fe5a807af30 2024-09-18T13:12:40.635 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:40 smithi078 ceph-mon[108578]: from='client.35114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:40.635 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:40 smithi078 ceph-mon[108578]: pgmap v705: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:40.635 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:40 smithi078 ceph-mon[108578]: from='client.35118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:40.636 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:40 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/621203901' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:12:40.636 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:40 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1675147221' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:12:40.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.635+0000 7fe5a7fff640 1 -- 172.21.15.78:0/1343367196 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe5c0198350 con 0x7fe5a807af30 2024-09-18T13:12:40.636 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:12:40.636 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:12:40.637 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:12:40.637 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:12:40.637 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:12:40.637 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:12:40.637 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:12:40.637 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:12:40.637 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:12:40.637 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:12:40.637 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:12:40.637 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:12:40.637 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:12:40.637 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:12:40.638 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:12:40.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.637+0000 7fe5c5058640 1 -- 172.21.15.78:0/1343367196 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe5a807af30 msgr2=0x7fe5a807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:40.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.637+0000 7fe5c5058640 1 --2- 172.21.15.78:0/1343367196 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe5a807af30 0x7fe5a807d3f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0000c00 tx=0x7fe5b0031400 comp rx=0 tx=0).stop 2024-09-18T13:12:40.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.637+0000 7fe5c5058640 1 -- 172.21.15.78:0/1343367196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c0107900 msgr2=0x7fe5c019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:40.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.637+0000 7fe5c5058640 1 --2- 172.21.15.78:0/1343367196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c0107900 0x7fe5c019db80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400e970 tx=0x7fe5b400ed70 comp rx=0 tx=0).stop 2024-09-18T13:12:40.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.637+0000 7fe5c5058640 1 -- 172.21.15.78:0/1343367196 shutdown_connections 2024-09-18T13:12:40.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.637+0000 7fe5c5058640 1 --2- 172.21.15.78:0/1343367196 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe5a807af30 0x7fe5a807d3f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.637+0000 7fe5c5058640 1 --2- 172.21.15.78:0/1343367196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c0107900 0x7fe5c019db80 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.637+0000 7fe5c5058640 1 --2- 172.21.15.78:0/1343367196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c0101900 0x7fe5c019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.637+0000 7fe5c5058640 1 -- 172.21.15.78:0/1343367196 >> 172.21.15.78:0/1343367196 conn(0x7fe5c00fd600 msgr2=0x7fe5c00fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:40.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.637+0000 7fe5c5058640 1 -- 172.21.15.78:0/1343367196 shutdown_connections 2024-09-18T13:12:40.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.638+0000 7fe5c5058640 1 -- 172.21.15.78:0/1343367196 wait complete. 2024-09-18T13:12:40.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.719+0000 7f642775a640 1 -- 172.21.15.78:0/547780978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6420107900 msgr2=0x7f6420107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:40.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.719+0000 7f642775a640 1 --2- 172.21.15.78:0/547780978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6420107900 0x7f6420107ce0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f641c009880 tx=0x7f641c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.719+0000 7f642775a640 1 -- 172.21.15.78:0/547780978 shutdown_connections 2024-09-18T13:12:40.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.719+0000 7f642775a640 1 --2- 172.21.15.78:0/547780978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6420101900 0x7f6420101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.719+0000 7f642775a640 1 --2- 172.21.15.78:0/547780978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6420107900 0x7f6420107ce0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.719+0000 7f642775a640 1 -- 172.21.15.78:0/547780978 >> 172.21.15.78:0/547780978 conn(0x7f64200fd600 msgr2=0x7f64200ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:40.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.719+0000 7f642775a640 1 -- 172.21.15.78:0/547780978 shutdown_connections 2024-09-18T13:12:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.719+0000 7f642775a640 1 -- 172.21.15.78:0/547780978 wait complete. 2024-09-18T13:12:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.720+0000 7f642775a640 1 Processor -- start 2024-09-18T13:12:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.720+0000 7f642775a640 1 -- start start 2024-09-18T13:12:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.720+0000 7f642775a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6420101900 0x7f64200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.720+0000 7f642775a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6420107900 0x7f6420074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.720+0000 7f642775a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f642010ee30 con 0x7f6420101900 2024-09-18T13:12:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.720+0000 7f642775a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f642010ecb0 con 0x7f6420107900 2024-09-18T13:12:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.720+0000 7f64254f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6420101900 0x7f64200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.720+0000 7f64254f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6420101900 0x7f64200744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43146/0 (socket says 172.21.15.78:43146) 2024-09-18T13:12:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.720+0000 7f64254f6640 1 -- 172.21.15.78:0/3633886068 learned_addr learned my addr 172.21.15.78:0/3633886068 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:12:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.720+0000 7f6424cf5640 1 --2- 172.21.15.78:0/3633886068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6420107900 0x7f6420074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.720+0000 7f64254f6640 1 -- 172.21.15.78:0/3633886068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6420107900 msgr2=0x7f6420074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.720+0000 7f64254f6640 1 --2- 172.21.15.78:0/3633886068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6420107900 0x7f6420074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.721+0000 7f64254f6640 1 -- 172.21.15.78:0/3633886068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6420074f70 con 0x7f6420101900 2024-09-18T13:12:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.721+0000 7f64254f6640 1 --2- 172.21.15.78:0/3633886068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6420101900 0x7f64200744f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f641c031460 tx=0x7f641c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.721+0000 7f64167fc640 1 -- 172.21.15.78:0/3633886068 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f641c03f070 con 0x7f6420101900 2024-09-18T13:12:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.721+0000 7f64167fc640 1 -- 172.21.15.78:0/3633886068 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f641c004cf0 con 0x7f6420101900 2024-09-18T13:12:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.721+0000 7f642775a640 1 -- 172.21.15.78:0/3633886068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6420075200 con 0x7f6420101900 2024-09-18T13:12:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.721+0000 7f64167fc640 1 -- 172.21.15.78:0/3633886068 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f641c035030 con 0x7f6420101900 2024-09-18T13:12:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.721+0000 7f642775a640 1 -- 172.21.15.78:0/3633886068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64201a3e20 con 0x7f6420101900 2024-09-18T13:12:40.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.722+0000 7f642775a640 1 -- 172.21.15.78:0/3633886068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6420103040 con 0x7f6420101900 2024-09-18T13:12:40.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.723+0000 7f64167fc640 1 -- 172.21.15.78:0/3633886068 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f641c042070 con 0x7f6420101900 2024-09-18T13:12:40.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.723+0000 7f64167fc640 1 --2- 172.21.15.78:0/3633886068 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f640c07af30 0x7f640c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:12:40.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.723+0000 7f6424cf5640 1 --2- 172.21.15.78:0/3633886068 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f640c07af30 0x7f640c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:12:40.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.723+0000 7f64167fc640 1 -- 172.21.15.78:0/3633886068 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f641c0beb60 con 0x7f6420101900 2024-09-18T13:12:40.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.724+0000 7f6424cf5640 1 --2- 172.21.15.78:0/3633886068 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f640c07af30 0x7f640c07d3f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6420075f80 tx=0x7f6410008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:12:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.728+0000 7f64167fc640 1 -- 172.21.15.78:0/3633886068 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f641c08a100 con 0x7f6420101900 2024-09-18T13:12:40.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.970+0000 7f642775a640 1 -- 172.21.15.78:0/3633886068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6420109e70 con 0x7f6420101900 2024-09-18T13:12:40.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.971+0000 7f64167fc640 1 -- 172.21.15.78:0/3633886068 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f641c08efb0 con 0x7f6420101900 2024-09-18T13:12:40.972 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:12:40.972 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:12:40.972 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:12:40.972 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:12:40.972 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:12:40.973 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:12:40.973 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:12:40.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:40 smithi148 ceph-mon[80030]: from='client.35114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:40.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:40 smithi148 ceph-mon[80030]: pgmap v705: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:40.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:40 smithi148 ceph-mon[80030]: from='client.35118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:40.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:40 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/621203901' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:12:40.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:40 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1675147221' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:12:40.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.973+0000 7f642775a640 1 -- 172.21.15.78:0/3633886068 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f640c07af30 msgr2=0x7f640c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:40.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.973+0000 7f642775a640 1 --2- 172.21.15.78:0/3633886068 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f640c07af30 0x7f640c07d3f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6420075f80 tx=0x7f6410008040 comp rx=0 tx=0).stop 2024-09-18T13:12:40.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.973+0000 7f642775a640 1 -- 172.21.15.78:0/3633886068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6420101900 msgr2=0x7f64200744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:12:40.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.973+0000 7f642775a640 1 --2- 172.21.15.78:0/3633886068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6420101900 0x7f64200744f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f641c031460 tx=0x7f641c0048f0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.973+0000 7f642775a640 1 -- 172.21.15.78:0/3633886068 shutdown_connections 2024-09-18T13:12:40.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.973+0000 7f642775a640 1 --2- 172.21.15.78:0/3633886068 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f640c07af30 0x7f640c07d3f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.973+0000 7f642775a640 1 --2- 172.21.15.78:0/3633886068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6420107900 0x7f6420074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.973+0000 7f642775a640 1 --2- 172.21.15.78:0/3633886068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6420101900 0x7f64200744f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:12:40.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.973+0000 7f642775a640 1 -- 172.21.15.78:0/3633886068 >> 172.21.15.78:0/3633886068 conn(0x7f64200fd600 msgr2=0x7f64200fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:12:40.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.973+0000 7f642775a640 1 -- 172.21.15.78:0/3633886068 shutdown_connections 2024-09-18T13:12:40.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:12:40.973+0000 7f642775a640 1 -- 172.21.15.78:0/3633886068 wait complete. 2024-09-18T13:12:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:41 smithi148 ceph-mon[80030]: from='client.35122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:12:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:41 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3633886068' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:12:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:41 smithi078 ceph-mon[108578]: from='client.35122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:12:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:41 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3633886068' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:12:42.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:42 smithi078 ceph-mon[108578]: from='client.35134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:42.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:42 smithi078 ceph-mon[108578]: pgmap v706: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:42.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:42 smithi148 ceph-mon[80030]: from='client.35134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:12:42.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:42 smithi148 ceph-mon[80030]: pgmap v706: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:44.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:44 smithi078 ceph-mon[108578]: pgmap v707: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:44.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:44 smithi148 ceph-mon[80030]: pgmap v707: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:46.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:46 smithi148 ceph-mon[80030]: pgmap v708: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:46.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:46 smithi078 ceph-mon[108578]: pgmap v708: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:48.711 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:48 smithi078 ceph-mon[108578]: pgmap v709: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:48.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:48 smithi148 ceph-mon[80030]: pgmap v709: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:50.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:50 smithi148 ceph-mon[80030]: pgmap v710: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:50.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:50 smithi078 ceph-mon[108578]: pgmap v710: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:52 smithi148 ceph-mon[80030]: pgmap v711: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:52.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:52 smithi078 ceph-mon[108578]: pgmap v711: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:54.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:54 smithi148 ceph-mon[80030]: pgmap v712: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:54 smithi078 ceph-mon[108578]: pgmap v712: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:56.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:56 smithi148 ceph-mon[80030]: pgmap v713: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:56.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:12:56.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:56 smithi078 ceph-mon[108578]: pgmap v713: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:56.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:12:57.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:12:57 smithi148 ceph-mon[80030]: pgmap v714: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:12:57.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:12:57 smithi078 ceph-mon[108578]: pgmap v714: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:00.713 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:00 smithi078 ceph-mon[108578]: pgmap v715: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:00.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:00 smithi148 ceph-mon[80030]: pgmap v715: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:02.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:02 smithi148 ceph-mon[80030]: pgmap v716: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:02 smithi078 ceph-mon[108578]: pgmap v716: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:04.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:04 smithi148 ceph-mon[80030]: pgmap v717: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:04.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:04 smithi078 ceph-mon[108578]: pgmap v717: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:06.710 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:06 smithi078 ceph-mon[108578]: pgmap v718: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:06.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:06 smithi148 ceph-mon[80030]: pgmap v718: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:08.700 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:08 smithi078 ceph-mon[108578]: pgmap v719: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:08.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:08 smithi148 ceph-mon[80030]: pgmap v719: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:10.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:10 smithi148 ceph-mon[80030]: pgmap v720: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:10.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:10 smithi078 ceph-mon[108578]: pgmap v720: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:11.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.065+0000 7f416be2d640 1 -- 172.21.15.78:0/1564992377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164107900 msgr2=0x7f4164107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:11.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.065+0000 7f416be2d640 1 --2- 172.21.15.78:0/1564992377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164107900 0x7f4164107ce0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4160009880 tx=0x7f416002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.065+0000 7f416be2d640 1 -- 172.21.15.78:0/1564992377 shutdown_connections 2024-09-18T13:13:11.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.065+0000 7f416be2d640 1 --2- 172.21.15.78:0/1564992377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4164101900 0x7f4164101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.065+0000 7f416be2d640 1 --2- 172.21.15.78:0/1564992377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164107900 0x7f4164107ce0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.065+0000 7f416be2d640 1 -- 172.21.15.78:0/1564992377 >> 172.21.15.78:0/1564992377 conn(0x7f41640fd600 msgr2=0x7f41640ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:11.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.065+0000 7f416be2d640 1 -- 172.21.15.78:0/1564992377 shutdown_connections 2024-09-18T13:13:11.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.065+0000 7f416be2d640 1 -- 172.21.15.78:0/1564992377 wait complete. 2024-09-18T13:13:11.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.066+0000 7f416be2d640 1 Processor -- start 2024-09-18T13:13:11.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.066+0000 7f416be2d640 1 -- start start 2024-09-18T13:13:11.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.066+0000 7f416be2d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4164101900 0x7f41640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:11.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.066+0000 7f416be2d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164107900 0x7f4164074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:11.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.066+0000 7f416be2d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f416410edd0 con 0x7f4164107900 2024-09-18T13:13:11.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.066+0000 7f416be2d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f416410ec50 con 0x7f4164101900 2024-09-18T13:13:11.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.066+0000 7f41693c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164107900 0x7f4164074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:11.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.066+0000 7f41693c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164107900 0x7f4164074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59322/0 (socket says 172.21.15.78:59322) 2024-09-18T13:13:11.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.066+0000 7f41693c8640 1 -- 172.21.15.78:0/4175132060 learned_addr learned my addr 172.21.15.78:0/4175132060 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:13:11.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.067+0000 7f4169bc9640 1 --2- 172.21.15.78:0/4175132060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4164101900 0x7f41640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:11.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.067+0000 7f41693c8640 1 -- 172.21.15.78:0/4175132060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4164101900 msgr2=0x7f41640744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:11.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.067+0000 7f41693c8640 1 --2- 172.21.15.78:0/4175132060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4164101900 0x7f41640744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.067+0000 7f41693c8640 1 -- 172.21.15.78:0/4175132060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4164074f70 con 0x7f4164107900 2024-09-18T13:13:11.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.067+0000 7f41693c8640 1 --2- 172.21.15.78:0/4175132060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164107900 0x7f4164074a30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f415400d6f0 tx=0x7f415400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:11.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.067+0000 7f415affd640 1 -- 172.21.15.78:0/4175132060 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4154017070 con 0x7f4164107900 2024-09-18T13:13:11.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.067+0000 7f415affd640 1 -- 172.21.15.78:0/4175132060 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f415400de00 con 0x7f4164107900 2024-09-18T13:13:11.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.067+0000 7f416be2d640 1 -- 172.21.15.78:0/4175132060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4164075260 con 0x7f4164107900 2024-09-18T13:13:11.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.067+0000 7f415affd640 1 -- 172.21.15.78:0/4175132060 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4154004bb0 con 0x7f4164107900 2024-09-18T13:13:11.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.067+0000 7f416be2d640 1 -- 172.21.15.78:0/4175132060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41641a3e40 con 0x7f4164107900 2024-09-18T13:13:11.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.068+0000 7f416be2d640 1 -- 172.21.15.78:0/4175132060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4164103040 con 0x7f4164107900 2024-09-18T13:13:11.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.069+0000 7f415affd640 1 -- 172.21.15.78:0/4175132060 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4154004e60 con 0x7f4164107900 2024-09-18T13:13:11.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.069+0000 7f415affd640 1 --2- 172.21.15.78:0/4175132060 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f415007af30 0x7f415007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:11.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.069+0000 7f415affd640 1 -- 172.21.15.78:0/4175132060 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f415409dc90 con 0x7f4164107900 2024-09-18T13:13:11.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.069+0000 7f4169bc9640 1 --2- 172.21.15.78:0/4175132060 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f415007af30 0x7f415007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:11.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.070+0000 7f4169bc9640 1 --2- 172.21.15.78:0/4175132060 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f415007af30 0x7f415007d3f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f41600096c0 tx=0x7f4160031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:11.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.074+0000 7f415affd640 1 -- 172.21.15.78:0/4175132060 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4154069230 con 0x7f4164107900 2024-09-18T13:13:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.266+0000 7f416be2d640 1 -- 172.21.15.78:0/4175132060 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4164062630 con 0x7f415007af30 2024-09-18T13:13:11.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.268+0000 7f415affd640 1 -- 172.21.15.78:0/4175132060 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f4164062630 con 0x7f415007af30 2024-09-18T13:13:11.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.270+0000 7f416be2d640 1 -- 172.21.15.78:0/4175132060 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f415007af30 msgr2=0x7f415007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:11.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.270+0000 7f416be2d640 1 --2- 172.21.15.78:0/4175132060 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f415007af30 0x7f415007d3f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f41600096c0 tx=0x7f4160031400 comp rx=0 tx=0).stop 2024-09-18T13:13:11.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.270+0000 7f416be2d640 1 -- 172.21.15.78:0/4175132060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164107900 msgr2=0x7f4164074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:11.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.270+0000 7f416be2d640 1 --2- 172.21.15.78:0/4175132060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164107900 0x7f4164074a30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f415400d6f0 tx=0x7f415400dbb0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.270+0000 7f416be2d640 1 -- 172.21.15.78:0/4175132060 shutdown_connections 2024-09-18T13:13:11.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.270+0000 7f416be2d640 1 --2- 172.21.15.78:0/4175132060 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f415007af30 0x7f415007d3f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.270+0000 7f416be2d640 1 --2- 172.21.15.78:0/4175132060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4164107900 0x7f4164074a30 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.270+0000 7f416be2d640 1 --2- 172.21.15.78:0/4175132060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4164101900 0x7f41640744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.270+0000 7f416be2d640 1 -- 172.21.15.78:0/4175132060 >> 172.21.15.78:0/4175132060 conn(0x7f41640fd600 msgr2=0x7f41640fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:11.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.270+0000 7f416be2d640 1 -- 172.21.15.78:0/4175132060 shutdown_connections 2024-09-18T13:13:11.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.270+0000 7f416be2d640 1 -- 172.21.15.78:0/4175132060 wait complete. 2024-09-18T13:13:11.280 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:13:11.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.352+0000 7f12f57f6640 1 -- 172.21.15.78:0/775683785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f0101900 msgr2=0x7f12f0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:11.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.352+0000 7f12f57f6640 1 --2- 172.21.15.78:0/775683785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f0101900 0x7f12f0101d60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f12e0009880 tx=0x7f12e002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.352+0000 7f12f57f6640 1 -- 172.21.15.78:0/775683785 shutdown_connections 2024-09-18T13:13:11.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.352+0000 7f12f57f6640 1 --2- 172.21.15.78:0/775683785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f0101900 0x7f12f0101d60 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.352+0000 7f12f57f6640 1 --2- 172.21.15.78:0/775683785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f0107900 0x7f12f0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.352+0000 7f12f57f6640 1 -- 172.21.15.78:0/775683785 >> 172.21.15.78:0/775683785 conn(0x7f12f00fd600 msgr2=0x7f12f00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:11.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.352+0000 7f12f57f6640 1 -- 172.21.15.78:0/775683785 shutdown_connections 2024-09-18T13:13:11.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.352+0000 7f12f57f6640 1 -- 172.21.15.78:0/775683785 wait complete. 2024-09-18T13:13:11.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.353+0000 7f12f57f6640 1 Processor -- start 2024-09-18T13:13:11.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.353+0000 7f12f57f6640 1 -- start start 2024-09-18T13:13:11.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.353+0000 7f12f57f6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f0101900 0x7f12f019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:11.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.353+0000 7f12f57f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f0107900 0x7f12f019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:11.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.353+0000 7f12f57f6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f12f010edd0 con 0x7f12f0107900 2024-09-18T13:13:11.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.353+0000 7f12f57f6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f12f010ec50 con 0x7f12f0101900 2024-09-18T13:13:11.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.354+0000 7f12ee7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f0107900 0x7f12f019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:11.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.354+0000 7f12ee7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f0107900 0x7f12f019db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38194/0 (socket says 172.21.15.78:38194) 2024-09-18T13:13:11.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.354+0000 7f12ee7fc640 1 -- 172.21.15.78:0/1139846881 learned_addr learned my addr 172.21.15.78:0/1139846881 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:13:11.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.354+0000 7f12eeffd640 1 --2- 172.21.15.78:0/1139846881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f0101900 0x7f12f019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:11.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.354+0000 7f12ee7fc640 1 -- 172.21.15.78:0/1139846881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f0101900 msgr2=0x7f12f019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:11.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.354+0000 7f12ee7fc640 1 --2- 172.21.15.78:0/1139846881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f0101900 0x7f12f019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.354+0000 7f12ee7fc640 1 -- 172.21.15.78:0/1139846881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f01977a0 con 0x7f12f0107900 2024-09-18T13:13:11.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.354+0000 7f12ee7fc640 1 --2- 172.21.15.78:0/1139846881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f0107900 0x7f12f019db60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f12e0031460 tx=0x7f12e00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:11.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.354+0000 7f12e7fff640 1 -- 172.21.15.78:0/1139846881 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f12e003f070 con 0x7f12f0107900 2024-09-18T13:13:11.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.354+0000 7f12e7fff640 1 -- 172.21.15.78:0/1139846881 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f12e0004cf0 con 0x7f12f0107900 2024-09-18T13:13:11.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.354+0000 7f12e7fff640 1 -- 172.21.15.78:0/1139846881 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f12e0035030 con 0x7f12f0107900 2024-09-18T13:13:11.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.354+0000 7f12f57f6640 1 -- 172.21.15.78:0/1139846881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f0197a30 con 0x7f12f0107900 2024-09-18T13:13:11.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.354+0000 7f12f57f6640 1 -- 172.21.15.78:0/1139846881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f0197f60 con 0x7f12f0107900 2024-09-18T13:13:11.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.355+0000 7f12f57f6640 1 -- 172.21.15.78:0/1139846881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f0103040 con 0x7f12f0107900 2024-09-18T13:13:11.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.356+0000 7f12e7fff640 1 -- 172.21.15.78:0/1139846881 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f12e0042070 con 0x7f12f0107900 2024-09-18T13:13:11.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.357+0000 7f12e7fff640 1 --2- 172.21.15.78:0/1139846881 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f12dc07af80 0x7f12dc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:11.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.357+0000 7f12eeffd640 1 --2- 172.21.15.78:0/1139846881 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f12dc07af80 0x7f12dc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:11.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.357+0000 7f12e7fff640 1 -- 172.21.15.78:0/1139846881 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f12e00be9e0 con 0x7f12f0107900 2024-09-18T13:13:11.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.357+0000 7f12eeffd640 1 --2- 172.21.15.78:0/1139846881 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f12dc07af80 0x7f12dc07d440 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f12d80058c0 tx=0x7f12d800a250 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:11.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.361+0000 7f12e7fff640 1 -- 172.21.15.78:0/1139846881 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f12e008a000 con 0x7f12f0107900 2024-09-18T13:13:11.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.556+0000 7f12f57f6640 1 -- 172.21.15.78:0/1139846881 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f12f0198210 con 0x7f12dc07af80 2024-09-18T13:13:11.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.558+0000 7f12e7fff640 1 -- 172.21.15.78:0/1139846881 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f12f0198210 con 0x7f12dc07af80 2024-09-18T13:13:11.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.560+0000 7f12f57f6640 1 -- 172.21.15.78:0/1139846881 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f12dc07af80 msgr2=0x7f12dc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:11.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.560+0000 7f12f57f6640 1 --2- 172.21.15.78:0/1139846881 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f12dc07af80 0x7f12dc07d440 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f12d80058c0 tx=0x7f12d800a250 comp rx=0 tx=0).stop 2024-09-18T13:13:11.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.560+0000 7f12f57f6640 1 -- 172.21.15.78:0/1139846881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f0107900 msgr2=0x7f12f019db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.560+0000 7f12f57f6640 1 --2- 172.21.15.78:0/1139846881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f0107900 0x7f12f019db60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f12e0031460 tx=0x7f12e00048f0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.560+0000 7f12f57f6640 1 -- 172.21.15.78:0/1139846881 shutdown_connections 2024-09-18T13:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.560+0000 7f12f57f6640 1 --2- 172.21.15.78:0/1139846881 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f12dc07af80 0x7f12dc07d440 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.560+0000 7f12f57f6640 1 --2- 172.21.15.78:0/1139846881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f0107900 0x7f12f019db60 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.560+0000 7f12f57f6640 1 --2- 172.21.15.78:0/1139846881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f0101900 0x7f12f019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.560+0000 7f12f57f6640 1 -- 172.21.15.78:0/1139846881 >> 172.21.15.78:0/1139846881 conn(0x7f12f00fd600 msgr2=0x7f12f00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.560+0000 7f12f57f6640 1 -- 172.21.15.78:0/1139846881 shutdown_connections 2024-09-18T13:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.560+0000 7f12f57f6640 1 -- 172.21.15.78:0/1139846881 wait complete. 2024-09-18T13:13:11.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.642+0000 7f545b5ff640 1 -- 172.21.15.78:0/632050529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54541067f0 msgr2=0x7f5454106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:11.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.642+0000 7f545b5ff640 1 --2- 172.21.15.78:0/632050529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54541067f0 0x7f5454106bd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5444009880 tx=0x7f544402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.642+0000 7f545b5ff640 1 -- 172.21.15.78:0/632050529 shutdown_connections 2024-09-18T13:13:11.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.642+0000 7f545b5ff640 1 --2- 172.21.15.78:0/632050529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54541007f0 0x7f5454100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.642+0000 7f545b5ff640 1 --2- 172.21.15.78:0/632050529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54541067f0 0x7f5454106bd0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.642+0000 7f545b5ff640 1 -- 172.21.15.78:0/632050529 >> 172.21.15.78:0/632050529 conn(0x7f54540fc550 msgr2=0x7f54540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:11.643 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:13:11.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.642+0000 7f545b5ff640 1 -- 172.21.15.78:0/632050529 shutdown_connections 2024-09-18T13:13:11.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.642+0000 7f545b5ff640 1 -- 172.21.15.78:0/632050529 wait complete. 2024-09-18T13:13:11.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.642+0000 7f545b5ff640 1 Processor -- start 2024-09-18T13:13:11.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.642+0000 7f545b5ff640 1 -- start start 2024-09-18T13:13:11.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f545b5ff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54541007f0 0x7f54541987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:11.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f545b5ff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54541067f0 0x7f5454198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:11.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f545b5ff640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f545410dcc0 con 0x7f54541067f0 2024-09-18T13:13:11.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f545b5ff640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f545410db40 con 0x7f54541007f0 2024-09-18T13:13:11.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f5458b9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54541067f0 0x7f5454198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:11.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f5458b9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54541067f0 0x7f5454198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38218/0 (socket says 172.21.15.78:38218) 2024-09-18T13:13:11.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f5458b9a640 1 -- 172.21.15.78:0/112813708 learned_addr learned my addr 172.21.15.78:0/112813708 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:13:11.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f545939b640 1 --2- 172.21.15.78:0/112813708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54541007f0 0x7f54541987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:11.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f5458b9a640 1 -- 172.21.15.78:0/112813708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54541007f0 msgr2=0x7f54541987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:11.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f5458b9a640 1 --2- 172.21.15.78:0/112813708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54541007f0 0x7f54541987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f5458b9a640 1 -- 172.21.15.78:0/112813708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5454199360 con 0x7f54541067f0 2024-09-18T13:13:11.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f5458b9a640 1 --2- 172.21.15.78:0/112813708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54541067f0 0x7f5454198d10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f545000d6f0 tx=0x7f545000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:11.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f544a7fc640 1 -- 172.21.15.78:0/112813708 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5450017070 con 0x7f54541067f0 2024-09-18T13:13:11.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f544a7fc640 1 -- 172.21.15.78:0/112813708 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f545000de00 con 0x7f54541067f0 2024-09-18T13:13:11.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f545b5ff640 1 -- 172.21.15.78:0/112813708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54541a1840 con 0x7f54541067f0 2024-09-18T13:13:11.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f544a7fc640 1 -- 172.21.15.78:0/112813708 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5450004bb0 con 0x7f54541067f0 2024-09-18T13:13:11.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.643+0000 7f545b5ff640 1 -- 172.21.15.78:0/112813708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54541a1c40 con 0x7f54541067f0 2024-09-18T13:13:11.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.644+0000 7f545b5ff640 1 -- 172.21.15.78:0/112813708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5454101f30 con 0x7f54541067f0 2024-09-18T13:13:11.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.645+0000 7f544a7fc640 1 -- 172.21.15.78:0/112813708 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5450004e60 con 0x7f54541067f0 2024-09-18T13:13:11.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.646+0000 7f544a7fc640 1 --2- 172.21.15.78:0/112813708 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f544007af30 0x7f544007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:11.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.646+0000 7f544a7fc640 1 -- 172.21.15.78:0/112813708 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f545009dc00 con 0x7f54541067f0 2024-09-18T13:13:11.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.646+0000 7f545939b640 1 --2- 172.21.15.78:0/112813708 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f544007af30 0x7f544007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:11.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.646+0000 7f545939b640 1 --2- 172.21.15.78:0/112813708 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f544007af30 0x7f544007d3f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f54440096c0 tx=0x7f5444031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:11.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.650+0000 7f544a7fc640 1 -- 172.21.15.78:0/112813708 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f54500a3020 con 0x7f54541067f0 2024-09-18T13:13:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:13:11.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.831+0000 7f545b5ff640 1 -- 172.21.15.78:0/112813708 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5454062630 con 0x7f544007af30 2024-09-18T13:13:11.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.840+0000 7f544a7fc640 1 -- 172.21.15.78:0/112813708 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5454062630 con 0x7f544007af30 2024-09-18T13:13:11.841 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:13:11.842 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (21m) 15m ago 31m 20.2M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:13:11.842 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (23m) 15m ago 32m 9210k - 19.1.1-330-gc2ddf972 ebb0615149de 110e76a0c154 2024-09-18T13:13:11.842 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (23m) 14m ago 31m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 7b8d9f14151c 2024-09-18T13:13:11.842 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (19m) 15m ago 32m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:13:11.842 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (19m) 14m ago 31m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:13:11.842 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (20m) 15m ago 31m 76.2M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:13:11.842 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (15m) 15m ago 26m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:13:11.842 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (15m) 15m ago 26m 10.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:13:11.842 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (15m) 14m ago 26m 13.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:13:11.842 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (14m) 14m ago 26m 14.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:13:11.842 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (23m) 15m ago 33m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:13:11.842 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (22m) 14m ago 31m 456M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:13:11.842 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (19m) 15m ago 33m 49.5M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:13:11.842 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (19m) 14m ago 31m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:13:11.843 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (21m) 15m ago 32m 11.6M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:13:11.843 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (21m) 14m ago 31m 11.7M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:13:11.843 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (18m) 15m ago 29m 89.5M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:13:11.843 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (18m) 15m ago 29m 89.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:13:11.843 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (17m) 15m ago 29m 77.7M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:13:11.843 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (16m) 14m ago 28m 93.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:13:11.843 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (16m) 14m ago 28m 84.9M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:13:11.843 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (15m) 14m ago 27m 80.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:13:11.843 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (21m) 15m ago 31m 58.5M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:13:11.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.842+0000 7f545b5ff640 1 -- 172.21.15.78:0/112813708 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f544007af30 msgr2=0x7f544007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:11.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.842+0000 7f545b5ff640 1 --2- 172.21.15.78:0/112813708 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f544007af30 0x7f544007d3f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f54440096c0 tx=0x7f5444031400 comp rx=0 tx=0).stop 2024-09-18T13:13:11.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.842+0000 7f545b5ff640 1 -- 172.21.15.78:0/112813708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54541067f0 msgr2=0x7f5454198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:11.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.842+0000 7f545b5ff640 1 --2- 172.21.15.78:0/112813708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54541067f0 0x7f5454198d10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f545000d6f0 tx=0x7f545000dbb0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.842+0000 7f545b5ff640 1 -- 172.21.15.78:0/112813708 shutdown_connections 2024-09-18T13:13:11.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.842+0000 7f545b5ff640 1 --2- 172.21.15.78:0/112813708 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f544007af30 0x7f544007d3f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.842+0000 7f545b5ff640 1 --2- 172.21.15.78:0/112813708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54541067f0 0x7f5454198d10 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.842+0000 7f545b5ff640 1 --2- 172.21.15.78:0/112813708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54541007f0 0x7f54541987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.842+0000 7f545b5ff640 1 -- 172.21.15.78:0/112813708 >> 172.21.15.78:0/112813708 conn(0x7f54540fc550 msgr2=0x7f54540fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:11.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.843+0000 7f545b5ff640 1 -- 172.21.15.78:0/112813708 shutdown_connections 2024-09-18T13:13:11.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.843+0000 7f545b5ff640 1 -- 172.21.15.78:0/112813708 wait complete. 2024-09-18T13:13:11.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.923+0000 7f0405adc640 1 -- 172.21.15.78:0/1536896003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0400107900 msgr2=0x7f0400107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:11.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.923+0000 7f0405adc640 1 --2- 172.21.15.78:0/1536896003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0400107900 0x7f0400107ce0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009880 tx=0x7f03f002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.923+0000 7f0405adc640 1 -- 172.21.15.78:0/1536896003 shutdown_connections 2024-09-18T13:13:11.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.923+0000 7f0405adc640 1 --2- 172.21.15.78:0/1536896003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0400101900 0x7f0400101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.923+0000 7f0405adc640 1 --2- 172.21.15.78:0/1536896003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0400107900 0x7f0400107ce0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.923+0000 7f0405adc640 1 -- 172.21.15.78:0/1536896003 >> 172.21.15.78:0/1536896003 conn(0x7f04000fd600 msgr2=0x7f04000ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:11.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.923+0000 7f0405adc640 1 -- 172.21.15.78:0/1536896003 shutdown_connections 2024-09-18T13:13:11.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.923+0000 7f0405adc640 1 -- 172.21.15.78:0/1536896003 wait complete. 2024-09-18T13:13:11.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.924+0000 7f0405adc640 1 Processor -- start 2024-09-18T13:13:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.924+0000 7f0405adc640 1 -- start start 2024-09-18T13:13:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.924+0000 7f0405adc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0400101900 0x7f040019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.924+0000 7f0405adc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0400107900 0x7f040019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.924+0000 7f0405adc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f040010edd0 con 0x7f0400107900 2024-09-18T13:13:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.924+0000 7f0405adc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f040010ec50 con 0x7f0400101900 2024-09-18T13:13:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.925+0000 7f03feffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0400107900 0x7f040019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.925+0000 7f03feffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0400107900 0x7f040019db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38236/0 (socket says 172.21.15.78:38236) 2024-09-18T13:13:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.925+0000 7f03feffd640 1 -- 172.21.15.78:0/2133400077 learned_addr learned my addr 172.21.15.78:0/2133400077 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:13:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.925+0000 7f03ff7fe640 1 --2- 172.21.15.78:0/2133400077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0400101900 0x7f040019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.925+0000 7f03feffd640 1 -- 172.21.15.78:0/2133400077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0400101900 msgr2=0x7f040019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.925+0000 7f03feffd640 1 --2- 172.21.15.78:0/2133400077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0400101900 0x7f040019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.925+0000 7f03feffd640 1 -- 172.21.15.78:0/2133400077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04001977a0 con 0x7f0400107900 2024-09-18T13:13:11.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.925+0000 7f03feffd640 1 --2- 172.21.15.78:0/2133400077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0400107900 0x7f040019db60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f03f400d6f0 tx=0x7f03f400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:11.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.925+0000 7f03fcff9640 1 -- 172.21.15.78:0/2133400077 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03f4017070 con 0x7f0400107900 2024-09-18T13:13:11.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.925+0000 7f0405adc640 1 -- 172.21.15.78:0/2133400077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0400197a90 con 0x7f0400107900 2024-09-18T13:13:11.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.925+0000 7f03fcff9640 1 -- 172.21.15.78:0/2133400077 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03f400de00 con 0x7f0400107900 2024-09-18T13:13:11.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.925+0000 7f03fcff9640 1 -- 172.21.15.78:0/2133400077 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03f4004bb0 con 0x7f0400107900 2024-09-18T13:13:11.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.926+0000 7f0405adc640 1 -- 172.21.15.78:0/2133400077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0400198020 con 0x7f0400107900 2024-09-18T13:13:11.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.927+0000 7f0405adc640 1 -- 172.21.15.78:0/2133400077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0400103040 con 0x7f0400107900 2024-09-18T13:13:11.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.927+0000 7f03fcff9640 1 -- 172.21.15.78:0/2133400077 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f03f4009a30 con 0x7f0400107900 2024-09-18T13:13:11.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.928+0000 7f03fcff9640 1 --2- 172.21.15.78:0/2133400077 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f03e807f390 0x7f03e8081850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:11.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.928+0000 7f03fcff9640 1 -- 172.21.15.78:0/2133400077 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f03f409db00 con 0x7f0400107900 2024-09-18T13:13:11.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.928+0000 7f03ff7fe640 1 --2- 172.21.15.78:0/2133400077 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f03e807f390 0x7f03e8081850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:11.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.928+0000 7f03ff7fe640 1 --2- 172.21.15.78:0/2133400077 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f03e807f390 0x7f03e8081850 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f03f00096c0 tx=0x7f03f0031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:11.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:11.933+0000 7f03fcff9640 1 -- 172.21.15.78:0/2133400077 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f03f4069120 con 0x7f0400107900 2024-09-18T13:13:12.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.178+0000 7f0405adc640 1 -- 172.21.15.78:0/2133400077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0400109e70 con 0x7f0400107900 2024-09-18T13:13:12.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.178+0000 7f03fcff9640 1 -- 172.21.15.78:0/2133400077 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f03f406dfd0 con 0x7f0400107900 2024-09-18T13:13:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:13:12.180 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:13:12.180 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:13:12.180 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:13:12.180 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:13:12.180 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:13:12.180 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:13:12.180 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:13:12.180 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:13:12.180 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:13:12.180 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:13:12.180 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:13:12.180 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:13:12.181 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:13:12.181 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:13:12.181 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:13:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:13:12.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.180+0000 7f0405adc640 1 -- 172.21.15.78:0/2133400077 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f03e807f390 msgr2=0x7f03e8081850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:12.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.180+0000 7f0405adc640 1 --2- 172.21.15.78:0/2133400077 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f03e807f390 0x7f03e8081850 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f03f00096c0 tx=0x7f03f0031400 comp rx=0 tx=0).stop 2024-09-18T13:13:12.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.180+0000 7f0405adc640 1 -- 172.21.15.78:0/2133400077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0400107900 msgr2=0x7f040019db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:12.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.180+0000 7f0405adc640 1 --2- 172.21.15.78:0/2133400077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0400107900 0x7f040019db60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f03f400d6f0 tx=0x7f03f400dbb0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.180+0000 7f0405adc640 1 -- 172.21.15.78:0/2133400077 shutdown_connections 2024-09-18T13:13:12.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.180+0000 7f0405adc640 1 --2- 172.21.15.78:0/2133400077 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f03e807f390 0x7f03e8081850 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.180+0000 7f0405adc640 1 --2- 172.21.15.78:0/2133400077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0400107900 0x7f040019db60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.180+0000 7f0405adc640 1 --2- 172.21.15.78:0/2133400077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0400101900 0x7f040019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.180+0000 7f0405adc640 1 -- 172.21.15.78:0/2133400077 >> 172.21.15.78:0/2133400077 conn(0x7f04000fd600 msgr2=0x7f04000fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:12.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.181+0000 7f0405adc640 1 -- 172.21.15.78:0/2133400077 shutdown_connections 2024-09-18T13:13:12.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.181+0000 7f0405adc640 1 -- 172.21.15.78:0/2133400077 wait complete. 2024-09-18T13:13:12.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.262+0000 7fa021874640 1 -- 172.21.15.78:0/2281760050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c107900 msgr2=0x7fa01c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:12.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.262+0000 7fa021874640 1 --2- 172.21.15.78:0/2281760050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c107900 0x7fa01c107ce0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa004009880 tx=0x7fa00402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.262+0000 7fa021874640 1 -- 172.21.15.78:0/2281760050 shutdown_connections 2024-09-18T13:13:12.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.262+0000 7fa021874640 1 --2- 172.21.15.78:0/2281760050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa01c101900 0x7fa01c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.262+0000 7fa021874640 1 --2- 172.21.15.78:0/2281760050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c107900 0x7fa01c107ce0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.262+0000 7fa021874640 1 -- 172.21.15.78:0/2281760050 >> 172.21.15.78:0/2281760050 conn(0x7fa01c0fd600 msgr2=0x7fa01c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:12.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.262+0000 7fa021874640 1 -- 172.21.15.78:0/2281760050 shutdown_connections 2024-09-18T13:13:12.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.262+0000 7fa021874640 1 -- 172.21.15.78:0/2281760050 wait complete. 2024-09-18T13:13:12.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.262+0000 7fa021874640 1 Processor -- start 2024-09-18T13:13:12.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.263+0000 7fa021874640 1 -- start start 2024-09-18T13:13:12.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.263+0000 7fa021874640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa01c101900 0x7fa01c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:12.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.263+0000 7fa021874640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c107900 0x7fa01c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.263+0000 7fa021874640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa01c10edd0 con 0x7fa01c107900 2024-09-18T13:13:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.263+0000 7fa021874640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa01c10ec50 con 0x7fa01c101900 2024-09-18T13:13:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.263+0000 7fa01a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c107900 0x7fa01c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.263+0000 7fa01a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c107900 0x7fa01c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38244/0 (socket says 172.21.15.78:38244) 2024-09-18T13:13:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.263+0000 7fa01a7fc640 1 -- 172.21.15.78:0/3093120737 learned_addr learned my addr 172.21.15.78:0/3093120737 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:13:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.263+0000 7fa01affd640 1 --2- 172.21.15.78:0/3093120737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa01c101900 0x7fa01c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.263+0000 7fa01a7fc640 1 -- 172.21.15.78:0/3093120737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa01c101900 msgr2=0x7fa01c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.263+0000 7fa01a7fc640 1 --2- 172.21.15.78:0/3093120737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa01c101900 0x7fa01c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.263+0000 7fa01a7fc640 1 -- 172.21.15.78:0/3093120737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01c074f70 con 0x7fa01c107900 2024-09-18T13:13:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.263+0000 7fa01affd640 1 --2- 172.21.15.78:0/3093120737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa01c101900 0x7fa01c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:13:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.263+0000 7fa01a7fc640 1 --2- 172.21.15.78:0/3093120737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c107900 0x7fa01c074a30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00c8f0 tx=0x7fa00c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.264+0000 7fa020872640 1 -- 172.21.15.78:0/3093120737 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa00c0079b0 con 0x7fa01c107900 2024-09-18T13:13:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.264+0000 7fa021874640 1 -- 172.21.15.78:0/3093120737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa01c075260 con 0x7fa01c107900 2024-09-18T13:13:12.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.264+0000 7fa020872640 1 -- 172.21.15.78:0/3093120737 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa00c0054e0 con 0x7fa01c107900 2024-09-18T13:13:12.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.264+0000 7fa020872640 1 -- 172.21.15.78:0/3093120737 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa00c004dd0 con 0x7fa01c107900 2024-09-18T13:13:12.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.264+0000 7fa021874640 1 -- 172.21.15.78:0/3093120737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa01c1a3e20 con 0x7fa01c107900 2024-09-18T13:13:12.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.265+0000 7fa021874640 1 -- 172.21.15.78:0/3093120737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa01c103040 con 0x7fa01c107900 2024-09-18T13:13:12.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.265+0000 7fa020872640 1 -- 172.21.15.78:0/3093120737 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa00c005020 con 0x7fa01c107900 2024-09-18T13:13:12.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.266+0000 7fa020872640 1 --2- 172.21.15.78:0/3093120737 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa00807aed0 0x7fa00807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:12.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.266+0000 7fa01affd640 1 --2- 172.21.15.78:0/3093120737 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa00807aed0 0x7fa00807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:12.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.266+0000 7fa020872640 1 -- 172.21.15.78:0/3093120737 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fa00c09e060 con 0x7fa01c107900 2024-09-18T13:13:12.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.267+0000 7fa01affd640 1 --2- 172.21.15.78:0/3093120737 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa00807aed0 0x7fa00807d390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa004031460 tx=0x7fa004009580 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:12.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.270+0000 7fa020872640 1 -- 172.21.15.78:0/3093120737 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa00c014030 con 0x7fa01c107900 2024-09-18T13:13:12.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.482+0000 7fa021874640 1 -- 172.21.15.78:0/3093120737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa01c109e70 con 0x7fa01c107900 2024-09-18T13:13:12.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.482+0000 7fa020872640 1 -- 172.21.15.78:0/3093120737 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7fa00c069600 con 0x7fa01c107900 2024-09-18T13:13:12.483 INFO:teuthology.orchestra.run.smithi078.stdout:e28 2024-09-18T13:13:12.483 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T12:58:24:186744+0000 2024-09-18T13:13:12.484 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:13:12.484 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:13:12.484 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:13:12.484 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:13:12.484 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:13:12.484 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:13:12.484 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 19 2024-09-18T13:13:12.484 INFO:teuthology.orchestra.run.smithi078.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-18T13:13:12.484 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:13:12.484 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T12:57:27.052903+0000 2024-09-18T13:13:12.484 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:13:12.484 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:13:12.484 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:13:12.485 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:13:12.485 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:13:12.485 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:13:12.485 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:13:12.485 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:13:12.485 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:13:12.485 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:13:12.485 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:13:12.485 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:13:12.485 INFO:teuthology.orchestra.run.smithi078.stdout:up {} 2024-09-18T13:13:12.485 INFO:teuthology.orchestra.run.smithi078.stdout:failed 0,1 2024-09-18T13:13:12.485 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:13:12.485 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:13:12.485 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:13:12.486 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:13:12.486 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:13:12.486 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:13:12.486 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:13:12.486 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:13:12.486 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 0 members: 2024-09-18T13:13:12.486 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:13:12.486 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:13:12.486 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:13:12.486 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:13:12.486 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:13:12.486 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:13:12.486 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:13:12.487 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:13:12.487 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:13:12.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.484+0000 7fa021874640 1 -- 172.21.15.78:0/3093120737 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa00807aed0 msgr2=0x7fa00807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:12.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.484+0000 7fa021874640 1 --2- 172.21.15.78:0/3093120737 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa00807aed0 0x7fa00807d390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa004031460 tx=0x7fa004009580 comp rx=0 tx=0).stop 2024-09-18T13:13:12.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.484+0000 7fa021874640 1 -- 172.21.15.78:0/3093120737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c107900 msgr2=0x7fa01c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:12.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.484+0000 7fa021874640 1 --2- 172.21.15.78:0/3093120737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c107900 0x7fa01c074a30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00c8f0 tx=0x7fa00c00cdb0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.484+0000 7fa021874640 1 -- 172.21.15.78:0/3093120737 shutdown_connections 2024-09-18T13:13:12.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.484+0000 7fa021874640 1 --2- 172.21.15.78:0/3093120737 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fa00807aed0 0x7fa00807d390 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.484+0000 7fa021874640 1 --2- 172.21.15.78:0/3093120737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c107900 0x7fa01c074a30 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.484+0000 7fa021874640 1 --2- 172.21.15.78:0/3093120737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa01c101900 0x7fa01c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.484+0000 7fa021874640 1 -- 172.21.15.78:0/3093120737 >> 172.21.15.78:0/3093120737 conn(0x7fa01c0fd600 msgr2=0x7fa01c0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:12.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.485+0000 7fa021874640 1 -- 172.21.15.78:0/3093120737 shutdown_connections 2024-09-18T13:13:12.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.485+0000 7fa021874640 1 -- 172.21.15.78:0/3093120737 wait complete. 2024-09-18T13:13:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.567+0000 7fc442d2b640 1 -- 172.21.15.78:0/1518329329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc43c102ad0 msgr2=0x7fc43c102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.567+0000 7fc442d2b640 1 --2- 172.21.15.78:0/1518329329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc43c102ad0 0x7fc43c102eb0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009880 tx=0x7fc42c02a530 comp rx=0 tx=0).stop 2024-09-18T13:13:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.567+0000 7fc442d2b640 1 -- 172.21.15.78:0/1518329329 shutdown_connections 2024-09-18T13:13:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.567+0000 7fc442d2b640 1 --2- 172.21.15.78:0/1518329329 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc43c1033f0 0x7fc43c10b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.567+0000 7fc442d2b640 1 --2- 172.21.15.78:0/1518329329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc43c102ad0 0x7fc43c102eb0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.567+0000 7fc442d2b640 1 -- 172.21.15.78:0/1518329329 >> 172.21.15.78:0/1518329329 conn(0x7fc43c0fc510 msgr2=0x7fc43c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.568+0000 7fc442d2b640 1 -- 172.21.15.78:0/1518329329 shutdown_connections 2024-09-18T13:13:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.568+0000 7fc442d2b640 1 -- 172.21.15.78:0/1518329329 wait complete. 2024-09-18T13:13:12.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.568+0000 7fc442d2b640 1 Processor -- start 2024-09-18T13:13:12.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.568+0000 7fc442d2b640 1 -- start start 2024-09-18T13:13:12.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.568+0000 7fc442d2b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc43c102ad0 0x7fc43c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:12.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.568+0000 7fc442d2b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc43c1033f0 0x7fc43c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:12.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.568+0000 7fc442d2b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c10ee00 con 0x7fc43c1033f0 2024-09-18T13:13:12.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.568+0000 7fc442d2b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c10ec80 con 0x7fc43c102ad0 2024-09-18T13:13:12.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.568+0000 7fc43bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc43c1033f0 0x7fc43c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:12.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.569+0000 7fc43bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc43c1033f0 0x7fc43c19dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38264/0 (socket says 172.21.15.78:38264) 2024-09-18T13:13:12.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.569+0000 7fc43bfff640 1 -- 172.21.15.78:0/3276104558 learned_addr learned my addr 172.21.15.78:0/3276104558 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:13:12.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.569+0000 7fc440ac7640 1 --2- 172.21.15.78:0/3276104558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc43c102ad0 0x7fc43c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:12.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.569+0000 7fc43bfff640 1 -- 172.21.15.78:0/3276104558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc43c102ad0 msgr2=0x7fc43c19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:12.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.569+0000 7fc43bfff640 1 --2- 172.21.15.78:0/3276104558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc43c102ad0 0x7fc43c19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.569+0000 7fc43bfff640 1 -- 172.21.15.78:0/3276104558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43c197810 con 0x7fc43c1033f0 2024-09-18T13:13:12.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.569+0000 7fc43bfff640 1 --2- 172.21.15.78:0/3276104558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc43c1033f0 0x7fc43c19dbd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc43000d6d0 tx=0x7fc43000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:12.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.569+0000 7fc439ffb640 1 -- 172.21.15.78:0/3276104558 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc430017070 con 0x7fc43c1033f0 2024-09-18T13:13:12.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.569+0000 7fc442d2b640 1 -- 172.21.15.78:0/3276104558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43c197b00 con 0x7fc43c1033f0 2024-09-18T13:13:12.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.569+0000 7fc439ffb640 1 -- 172.21.15.78:0/3276104558 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc4300054e0 con 0x7fc43c1033f0 2024-09-18T13:13:12.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.569+0000 7fc439ffb640 1 -- 172.21.15.78:0/3276104558 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc430004ae0 con 0x7fc43c1033f0 2024-09-18T13:13:12.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.569+0000 7fc442d2b640 1 -- 172.21.15.78:0/3276104558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc43c198090 con 0x7fc43c1033f0 2024-09-18T13:13:12.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.570+0000 7fc442d2b640 1 -- 172.21.15.78:0/3276104558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc43c06ada0 con 0x7fc43c1033f0 2024-09-18T13:13:12.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.571+0000 7fc439ffb640 1 -- 172.21.15.78:0/3276104558 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc430004de0 con 0x7fc43c1033f0 2024-09-18T13:13:12.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.571+0000 7fc439ffb640 1 --2- 172.21.15.78:0/3276104558 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc42407af30 0x7fc42407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:12.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.571+0000 7fc439ffb640 1 -- 172.21.15.78:0/3276104558 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fc43009dc50 con 0x7fc43c1033f0 2024-09-18T13:13:12.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.572+0000 7fc440ac7640 1 --2- 172.21.15.78:0/3276104558 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc42407af30 0x7fc42407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:12.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.572+0000 7fc440ac7640 1 --2- 172.21.15.78:0/3276104558 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc42407af30 0x7fc42407d3f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0096c0 tx=0x7fc42c031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:12.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.576+0000 7fc439ffb640 1 -- 172.21.15.78:0/3276104558 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc4300691f0 con 0x7fc43c1033f0 2024-09-18T13:13:12.710 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:12 smithi078 ceph-mon[108578]: from='client.35142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:12.710 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:12 smithi078 ceph-mon[108578]: pgmap v721: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:12.710 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:12 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2133400077' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:12.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:12 smithi148 ceph-mon[80030]: from='client.35142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:12.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:12 smithi148 ceph-mon[80030]: pgmap v721: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:12.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:12 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2133400077' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:12.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.768+0000 7fc442d2b640 1 -- 172.21.15.78:0/3276104558 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc43c198340 con 0x7fc42407af30 2024-09-18T13:13:12.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.769+0000 7fc439ffb640 1 -- 172.21.15.78:0/3276104558 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc43c198340 con 0x7fc42407af30 2024-09-18T13:13:12.770 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:13:12.770 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:13:12.772 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:13:12.772 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:13:12.772 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:13:12.772 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:13:12.772 INFO:teuthology.orchestra.run.smithi078.stdout: "mon", 2024-09-18T13:13:12.772 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:13:12.772 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:13:12.772 INFO:teuthology.orchestra.run.smithi078.stdout: "mds" 2024-09-18T13:13:12.773 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:13:12.773 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:13:12.773 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:13:12.773 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:13:12.773 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:13:12.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.771+0000 7fc442d2b640 1 -- 172.21.15.78:0/3276104558 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc42407af30 msgr2=0x7fc42407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:12.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.771+0000 7fc442d2b640 1 --2- 172.21.15.78:0/3276104558 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc42407af30 0x7fc42407d3f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0096c0 tx=0x7fc42c031400 comp rx=0 tx=0).stop 2024-09-18T13:13:12.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.771+0000 7fc442d2b640 1 -- 172.21.15.78:0/3276104558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc43c1033f0 msgr2=0x7fc43c19dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:12.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.771+0000 7fc442d2b640 1 --2- 172.21.15.78:0/3276104558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc43c1033f0 0x7fc43c19dbd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc43000d6d0 tx=0x7fc43000db90 comp rx=0 tx=0).stop 2024-09-18T13:13:12.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.771+0000 7fc442d2b640 1 -- 172.21.15.78:0/3276104558 shutdown_connections 2024-09-18T13:13:12.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.771+0000 7fc442d2b640 1 --2- 172.21.15.78:0/3276104558 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc42407af30 0x7fc42407d3f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.771+0000 7fc442d2b640 1 --2- 172.21.15.78:0/3276104558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc43c1033f0 0x7fc43c19dbd0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.771+0000 7fc442d2b640 1 --2- 172.21.15.78:0/3276104558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc43c102ad0 0x7fc43c19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.771+0000 7fc442d2b640 1 -- 172.21.15.78:0/3276104558 >> 172.21.15.78:0/3276104558 conn(0x7fc43c0fc510 msgr2=0x7fc43c108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:12.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.771+0000 7fc442d2b640 1 -- 172.21.15.78:0/3276104558 shutdown_connections 2024-09-18T13:13:12.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.771+0000 7fc442d2b640 1 -- 172.21.15.78:0/3276104558 wait complete. 2024-09-18T13:13:12.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.852+0000 7f50c3a01640 1 -- 172.21.15.78:0/2904988839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50bc1033d0 msgr2=0x7f50bc10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:12.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.852+0000 7f50c3a01640 1 --2- 172.21.15.78:0/2904988839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50bc1033d0 0x7f50bc10b8c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009880 tx=0x7f50b002a530 comp rx=0 tx=0).stop 2024-09-18T13:13:12.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.853+0000 7f50c3a01640 1 -- 172.21.15.78:0/2904988839 shutdown_connections 2024-09-18T13:13:12.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.853+0000 7f50c3a01640 1 --2- 172.21.15.78:0/2904988839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50bc1033d0 0x7f50bc10b8c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.853+0000 7f50c3a01640 1 --2- 172.21.15.78:0/2904988839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50bc102ab0 0x7f50bc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.853+0000 7f50c3a01640 1 -- 172.21.15.78:0/2904988839 >> 172.21.15.78:0/2904988839 conn(0x7f50bc0fc550 msgr2=0x7f50bc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:12.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.853+0000 7f50c3a01640 1 -- 172.21.15.78:0/2904988839 shutdown_connections 2024-09-18T13:13:12.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.853+0000 7f50c3a01640 1 -- 172.21.15.78:0/2904988839 wait complete. 2024-09-18T13:13:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.853+0000 7f50c3a01640 1 Processor -- start 2024-09-18T13:13:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.853+0000 7f50c3a01640 1 -- start start 2024-09-18T13:13:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50c3a01640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50bc102ab0 0x7f50bc100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50c3a01640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50bc1033d0 0x7f50bc100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50c3a01640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc10ee40 con 0x7f50bc1033d0 2024-09-18T13:13:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50c3a01640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc10ecc0 con 0x7f50bc102ab0 2024-09-18T13:13:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50c0f9c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50bc1033d0 0x7f50bc100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50c0f9c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50bc1033d0 0x7f50bc100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38284/0 (socket says 172.21.15.78:38284) 2024-09-18T13:13:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50c0f9c640 1 -- 172.21.15.78:0/3432337387 learned_addr learned my addr 172.21.15.78:0/3432337387 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:13:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50c179d640 1 --2- 172.21.15.78:0/3432337387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50bc102ab0 0x7f50bc100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:12.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50c0f9c640 1 -- 172.21.15.78:0/3432337387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50bc102ab0 msgr2=0x7f50bc100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:12.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50c0f9c640 1 --2- 172.21.15.78:0/3432337387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50bc102ab0 0x7f50bc100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:12.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50c0f9c640 1 -- 172.21.15.78:0/3432337387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50bc101190 con 0x7f50bc1033d0 2024-09-18T13:13:12.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50c0f9c640 1 --2- 172.21.15.78:0/3432337387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50bc1033d0 0x7f50bc100c50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f50b0031460 tx=0x7f50b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:12.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50ba7fc640 1 -- 172.21.15.78:0/3432337387 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f50b003f070 con 0x7f50bc1033d0 2024-09-18T13:13:12.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50ba7fc640 1 -- 172.21.15.78:0/3432337387 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f50b0004ac0 con 0x7f50bc1033d0 2024-09-18T13:13:12.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50c3a01640 1 -- 172.21.15.78:0/3432337387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50bc101420 con 0x7f50bc1033d0 2024-09-18T13:13:12.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50ba7fc640 1 -- 172.21.15.78:0/3432337387 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f50b0035030 con 0x7f50bc1033d0 2024-09-18T13:13:12.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.854+0000 7f50c3a01640 1 -- 172.21.15.78:0/3432337387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50bc1a3df0 con 0x7f50bc1033d0 2024-09-18T13:13:12.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.855+0000 7f50c3a01640 1 -- 172.21.15.78:0/3432337387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50bc06a580 con 0x7f50bc1033d0 2024-09-18T13:13:12.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.856+0000 7f50ba7fc640 1 -- 172.21.15.78:0/3432337387 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f50b0042070 con 0x7f50bc1033d0 2024-09-18T13:13:12.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.856+0000 7f50ba7fc640 1 --2- 172.21.15.78:0/3432337387 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f50a407af30 0x7f50a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.857+0000 7f50ba7fc640 1 -- 172.21.15.78:0/3432337387 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f50b00bea60 con 0x7f50bc1033d0 2024-09-18T13:13:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.857+0000 7f50c179d640 1 --2- 172.21.15.78:0/3432337387 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f50a407af30 0x7f50a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.857+0000 7f50c179d640 1 --2- 172.21.15.78:0/3432337387 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f50a407af30 0x7f50a407d3f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00a400 tx=0x7f50ac00d040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:12.861+0000 7f50ba7fc640 1 -- 172.21.15.78:0/3432337387 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f50b008a000 con 0x7f50bc1033d0 2024-09-18T13:13:13.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:13.106+0000 7f50c3a01640 1 -- 172.21.15.78:0/3432337387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f50bc02d7c0 con 0x7f50bc1033d0 2024-09-18T13:13:13.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:13.107+0000 7f50ba7fc640 1 -- 172.21.15.78:0/3432337387 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f50b008eeb0 con 0x7f50bc1033d0 2024-09-18T13:13:13.108 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-18T13:13:13.108 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T13:13:13.108 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is degraded 2024-09-18T13:13:13.109 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:13:13.109 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:13:13.109 INFO:teuthology.orchestra.run.smithi078.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-18T13:13:13.109 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-18T13:13:13.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:13.109+0000 7f50c3a01640 1 -- 172.21.15.78:0/3432337387 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f50a407af30 msgr2=0x7f50a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:13.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:13.109+0000 7f50c3a01640 1 --2- 172.21.15.78:0/3432337387 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f50a407af30 0x7f50a407d3f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00a400 tx=0x7f50ac00d040 comp rx=0 tx=0).stop 2024-09-18T13:13:13.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:13.109+0000 7f50c3a01640 1 -- 172.21.15.78:0/3432337387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50bc1033d0 msgr2=0x7f50bc100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:13.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:13.109+0000 7f50c3a01640 1 --2- 172.21.15.78:0/3432337387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50bc1033d0 0x7f50bc100c50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f50b0031460 tx=0x7f50b00046c0 comp rx=0 tx=0).stop 2024-09-18T13:13:13.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:13.109+0000 7f50c3a01640 1 -- 172.21.15.78:0/3432337387 shutdown_connections 2024-09-18T13:13:13.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:13.109+0000 7f50c3a01640 1 --2- 172.21.15.78:0/3432337387 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f50a407af30 0x7f50a407d3f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:13.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:13.109+0000 7f50c3a01640 1 --2- 172.21.15.78:0/3432337387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50bc1033d0 0x7f50bc100c50 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:13.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:13.109+0000 7f50c3a01640 1 --2- 172.21.15.78:0/3432337387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50bc102ab0 0x7f50bc100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:13.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:13.109+0000 7f50c3a01640 1 -- 172.21.15.78:0/3432337387 >> 172.21.15.78:0/3432337387 conn(0x7f50bc0fc550 msgr2=0x7f50bc108e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:13.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:13.109+0000 7f50c3a01640 1 -- 172.21.15.78:0/3432337387 shutdown_connections 2024-09-18T13:13:13.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:13.109+0000 7f50c3a01640 1 -- 172.21.15.78:0/3432337387 wait complete. 2024-09-18T13:13:13.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:13 smithi148 ceph-mon[80030]: from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:13.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:13 smithi148 ceph-mon[80030]: from='client.35150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:13.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:13 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3093120737' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:13:13.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:13 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3432337387' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:13:13.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:13 smithi078 ceph-mon[108578]: from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:13.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:13 smithi078 ceph-mon[108578]: from='client.35150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:13.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:13 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3093120737' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:13:13.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:13 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3432337387' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:13:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:14 smithi148 ceph-mon[80030]: from='client.35162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:14.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:14 smithi148 ceph-mon[80030]: pgmap v722: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:14 smithi078 ceph-mon[108578]: from='client.35162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:14.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:14 smithi078 ceph-mon[108578]: pgmap v722: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:16.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:16 smithi148 ceph-mon[80030]: pgmap v723: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:16.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:16 smithi078 ceph-mon[108578]: pgmap v723: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:18.701 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:18 smithi078 ceph-mon[108578]: pgmap v724: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:18.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:18 smithi148 ceph-mon[80030]: pgmap v724: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:20.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:20 smithi148 ceph-mon[80030]: pgmap v725: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:20.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:20 smithi078 ceph-mon[108578]: pgmap v725: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:22.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:22 smithi148 ceph-mon[80030]: pgmap v726: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:22.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:22 smithi078 ceph-mon[108578]: pgmap v726: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: pgmap v727: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:13:24.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:13:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: pgmap v728: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:13:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi078.eakgoe"} : dispatch 2024-09-18T13:13:24.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi078.eakgoe"}]': finished 2024-09-18T13:13:24.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi078.furyab"} : dispatch 2024-09-18T13:13:24.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi078.furyab"}]': finished 2024-09-18T13:13:24.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.fqecmm"} : dispatch 2024-09-18T13:13:24.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.fqecmm"}]': finished 2024-09-18T13:13:24.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.tvvouo"} : dispatch 2024-09-18T13:13:24.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.tvvouo"}]': finished 2024-09-18T13:13:24.725 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:24 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-18T13:13:24.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: pgmap v727: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:24.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:13:24.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:13:24.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: pgmap v728: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:24.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:24.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:13:24.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:24.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:24.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:24.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:24.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:24.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:24.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi078.eakgoe"} : dispatch 2024-09-18T13:13:24.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi078.eakgoe"}]': finished 2024-09-18T13:13:24.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi078.furyab"} : dispatch 2024-09-18T13:13:24.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi078.furyab"}]': finished 2024-09-18T13:13:24.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.fqecmm"} : dispatch 2024-09-18T13:13:24.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.fqecmm"}]': finished 2024-09-18T13:13:24.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.tvvouo"} : dispatch 2024-09-18T13:13:24.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.tvvouo"}]': finished 2024-09-18T13:13:24.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:24 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-18T13:13:25.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:25 smithi148 ceph-mon[80030]: Upgrade: Setting container_image for all mds 2024-09-18T13:13:25.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:25 smithi148 ceph-mon[80030]: Upgrade: Setting filesystem cephfs Joinable 2024-09-18T13:13:25.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:25 smithi148 ceph-mon[80030]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-18T13:13:25.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:25 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-18T13:13:25.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:25 smithi148 ceph-mon[80030]: Standby daemon mds.cephfs.smithi078.eakgoe assigned to filesystem cephfs as rank 0 2024-09-18T13:13:25.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:25 smithi148 ceph-mon[80030]: Standby daemon mds.cephfs.smithi078.furyab assigned to filesystem cephfs as rank 1 2024-09-18T13:13:25.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:25 smithi148 ceph-mon[80030]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T13:13:25.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:25 smithi148 ceph-mon[80030]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-18T13:13:25.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:25 smithi148 ceph-mon[80030]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:replay,1=cephfs.smithi078.furyab=up:replay} 2 up:standby 2024-09-18T13:13:25.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:25 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:25.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:25 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:25.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:25 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:25.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:25 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:25.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:25 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:25 smithi078 ceph-mon[108578]: Upgrade: Setting container_image for all mds 2024-09-18T13:13:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:25 smithi078 ceph-mon[108578]: Upgrade: Setting filesystem cephfs Joinable 2024-09-18T13:13:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:25 smithi078 ceph-mon[108578]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-18T13:13:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:25 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-18T13:13:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:25 smithi078 ceph-mon[108578]: Standby daemon mds.cephfs.smithi078.eakgoe assigned to filesystem cephfs as rank 0 2024-09-18T13:13:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:25 smithi078 ceph-mon[108578]: Standby daemon mds.cephfs.smithi078.furyab assigned to filesystem cephfs as rank 1 2024-09-18T13:13:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:25 smithi078 ceph-mon[108578]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T13:13:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:25 smithi078 ceph-mon[108578]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-18T13:13:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:25 smithi078 ceph-mon[108578]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:replay,1=cephfs.smithi078.furyab=up:replay} 2 up:standby 2024-09-18T13:13:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:25 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:25 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:25.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:25 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:25.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:25 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:25.743 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:25 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:26.721 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:26 smithi078 ceph-mon[108578]: Upgrade: Setting container_image for all rgw 2024-09-18T13:13:26.721 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:26 smithi078 ceph-mon[108578]: Upgrade: Setting container_image for all rbd-mirror 2024-09-18T13:13:26.722 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:26 smithi078 ceph-mon[108578]: pgmap v729: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:26.722 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:26.722 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:13:26.722 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:26 smithi078 ceph-mon[108578]: mds.? [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] up:resolve 2024-09-18T13:13:26.722 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:26 smithi078 ceph-mon[108578]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:replay,1=cephfs.smithi078.furyab=up:resolve} 2 up:standby 2024-09-18T13:13:26.722 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:26.722 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi078", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T13:13:26.722 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:13:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:26 smithi148 ceph-mon[80030]: Upgrade: Setting container_image for all rgw 2024-09-18T13:13:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:26 smithi148 ceph-mon[80030]: Upgrade: Setting container_image for all rbd-mirror 2024-09-18T13:13:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:26 smithi148 ceph-mon[80030]: pgmap v729: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:13:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:26 smithi148 ceph-mon[80030]: mds.? [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] up:resolve 2024-09-18T13:13:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:26 smithi148 ceph-mon[80030]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:replay,1=cephfs.smithi078.furyab=up:resolve} 2 up:standby 2024-09-18T13:13:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi078", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T13:13:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:13:27.654 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:27 smithi078 ceph-mon[108578]: Upgrade: Updating ceph-exporter.smithi078 (1/2) 2024-09-18T13:13:27.654 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:27 smithi078 ceph-mon[108578]: Deploying daemon ceph-exporter.smithi078 on smithi078 2024-09-18T13:13:27.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:27 smithi148 ceph-mon[80030]: Upgrade: Updating ceph-exporter.smithi078 (1/2) 2024-09-18T13:13:27.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:27 smithi148 ceph-mon[80030]: Deploying daemon ceph-exporter.smithi078 on smithi078 2024-09-18T13:13:28.612 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:28 smithi078 ceph-mon[108578]: pgmap v730: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.2 MiB/s rd, 3 op/s 2024-09-18T13:13:28.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:28 smithi148 ceph-mon[80030]: pgmap v730: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.2 MiB/s rd, 3 op/s 2024-09-18T13:13:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:30 smithi148 ceph-mon[80030]: pgmap v731: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 5 op/s 2024-09-18T13:13:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:30 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:30.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:30 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:30.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:30 smithi078 ceph-mon[108578]: pgmap v731: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 5 op/s 2024-09-18T13:13:30.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:30 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:30.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:30 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:32.628 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:32 smithi148 ceph-mon[80030]: Upgrade: Updating ceph-exporter.smithi148 (2/2) 2024-09-18T13:13:32.629 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:32 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:32.629 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:32 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi148", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T13:13:32.629 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:32 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:13:32.629 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:32 smithi148 ceph-mon[80030]: Deploying daemon ceph-exporter.smithi148 on smithi148 2024-09-18T13:13:32.629 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:32 smithi148 ceph-mon[80030]: pgmap v732: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 7 op/s 2024-09-18T13:13:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:32 smithi078 ceph-mon[108578]: Upgrade: Updating ceph-exporter.smithi148 (2/2) 2024-09-18T13:13:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:32 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:32 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi148", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T13:13:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:32 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:13:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:32 smithi078 ceph-mon[108578]: Deploying daemon ceph-exporter.smithi148 on smithi148 2024-09-18T13:13:32.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:32 smithi078 ceph-mon[108578]: pgmap v732: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 7 op/s 2024-09-18T13:13:34.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:34 smithi148 ceph-mon[80030]: mds.? [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] up:resolve 2024-09-18T13:13:34.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:34 smithi148 ceph-mon[80030]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:resolve,1=cephfs.smithi078.furyab=up:resolve} 2 up:standby 2024-09-18T13:13:34.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:34 smithi148 ceph-mon[80030]: pgmap v733: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 9 op/s 2024-09-18T13:13:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:34 smithi078 ceph-mon[108578]: mds.? [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] up:resolve 2024-09-18T13:13:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:34 smithi078 ceph-mon[108578]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:resolve,1=cephfs.smithi078.furyab=up:resolve} 2 up:standby 2024-09-18T13:13:34.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:34 smithi078 ceph-mon[108578]: pgmap v733: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 9 op/s 2024-09-18T13:13:35.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:35 smithi078 ceph-mon[108578]: reconnect by client.14610 192.168.0.1:0/870258011 after 0.000999984 2024-09-18T13:13:35.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:35 smithi078 ceph-mon[108578]: reconnect by client.14610 192.168.0.1:0/870258011 after 0.000999984 2024-09-18T13:13:35.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:35 smithi078 ceph-mon[108578]: reconnect by client.24303 192.168.0.1:0/2979256136 after 0.000999984 2024-09-18T13:13:35.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:35 smithi078 ceph-mon[108578]: reconnect by client.24303 192.168.0.1:0/2979256136 after 0.000999984 2024-09-18T13:13:35.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:35 smithi078 ceph-mon[108578]: mds.? [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] up:reconnect 2024-09-18T13:13:35.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:35 smithi078 ceph-mon[108578]: mds.? [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] up:reconnect 2024-09-18T13:13:35.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:35 smithi078 ceph-mon[108578]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:reconnect,1=cephfs.smithi078.furyab=up:reconnect} 2 up:standby 2024-09-18T13:13:35.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:35 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:35.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:35 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:35.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:35 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:13:35.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:35 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:35.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:35 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:35.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:35 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:35.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:35 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:35.706 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:35 smithi148 ceph-mon[80030]: reconnect by client.14610 192.168.0.1:0/870258011 after 0.000999984 2024-09-18T13:13:35.707 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:35 smithi148 ceph-mon[80030]: reconnect by client.14610 192.168.0.1:0/870258011 after 0.000999984 2024-09-18T13:13:35.707 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:35 smithi148 ceph-mon[80030]: reconnect by client.24303 192.168.0.1:0/2979256136 after 0.000999984 2024-09-18T13:13:35.707 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:35 smithi148 ceph-mon[80030]: reconnect by client.24303 192.168.0.1:0/2979256136 after 0.000999984 2024-09-18T13:13:35.707 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:35 smithi148 ceph-mon[80030]: mds.? [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] up:reconnect 2024-09-18T13:13:35.707 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:35 smithi148 ceph-mon[80030]: mds.? [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] up:reconnect 2024-09-18T13:13:35.707 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:35 smithi148 ceph-mon[80030]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:reconnect,1=cephfs.smithi078.furyab=up:reconnect} 2 up:standby 2024-09-18T13:13:35.707 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:35 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:35.707 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:35 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:35.707 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:35 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:13:35.707 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:35 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:35.707 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:35 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:35.708 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:35 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:35.708 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:35 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:36.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:36 smithi078 ceph-mon[108578]: mds.? [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] up:rejoin 2024-09-18T13:13:36.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:36 smithi078 ceph-mon[108578]: mds.? [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] up:rejoin 2024-09-18T13:13:36.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:36 smithi078 ceph-mon[108578]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:rejoin,1=cephfs.smithi078.furyab=up:rejoin} 2 up:standby 2024-09-18T13:13:36.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:36 smithi078 ceph-mon[108578]: daemon mds.cephfs.smithi078.furyab is now active in filesystem cephfs as rank 1 2024-09-18T13:13:36.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:36 smithi078 ceph-mon[108578]: pgmap v734: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-18T13:13:36.702 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:36 smithi078 ceph-mon[108578]: daemon mds.cephfs.smithi078.eakgoe is now active in filesystem cephfs as rank 0 2024-09-18T13:13:36.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:36 smithi148 ceph-mon[80030]: mds.? [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] up:rejoin 2024-09-18T13:13:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:36 smithi148 ceph-mon[80030]: mds.? [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] up:rejoin 2024-09-18T13:13:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:36 smithi148 ceph-mon[80030]: fsmap cephfs:2/2 {0=cephfs.smithi078.eakgoe=up:rejoin,1=cephfs.smithi078.furyab=up:rejoin} 2 up:standby 2024-09-18T13:13:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:36 smithi148 ceph-mon[80030]: daemon mds.cephfs.smithi078.furyab is now active in filesystem cephfs as rank 1 2024-09-18T13:13:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:36 smithi148 ceph-mon[80030]: pgmap v734: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-18T13:13:36.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:36 smithi148 ceph-mon[80030]: daemon mds.cephfs.smithi078.eakgoe is now active in filesystem cephfs as rank 0 2024-09-18T13:13:37.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:37 smithi148 ceph-mon[80030]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T13:13:37.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:37 smithi148 ceph-mon[80030]: mds.? [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] up:active 2024-09-18T13:13:37.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:37 smithi148 ceph-mon[80030]: mds.? [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] up:active 2024-09-18T13:13:37.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:37 smithi148 ceph-mon[80030]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:active} 2 up:standby 2024-09-18T13:13:37.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:37 smithi078 ceph-mon[108578]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T13:13:37.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:37 smithi078 ceph-mon[108578]: mds.? [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] up:active 2024-09-18T13:13:37.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:37 smithi078 ceph-mon[108578]: mds.? [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] up:active 2024-09-18T13:13:37.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:37 smithi078 ceph-mon[108578]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:active} 2 up:standby 2024-09-18T13:13:38.658 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:38 smithi148 ceph-mon[80030]: pgmap v735: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-18T13:13:38.658 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:38 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:38.658 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:38 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:38.658 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:38 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:38.658 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:38 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:38.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:38 smithi078 ceph-mon[108578]: pgmap v735: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-18T13:13:38.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:38 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:38.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:38 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:38.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:38 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:38.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:38 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:39.818 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:39 smithi148 ceph-mon[80030]: pgmap v736: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 341 B/s wr, 10 op/s 2024-09-18T13:13:39.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:39 smithi078 ceph-mon[108578]: pgmap v736: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 341 B/s wr, 10 op/s 2024-09-18T13:13:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:13:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:41 smithi078 ceph-mon[108578]: pgmap v737: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 341 B/s wr, 11 op/s 2024-09-18T13:13:41.800 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:41.800 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:13:41.800 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:41.800 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:41.800 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:41 smithi148 ceph-mon[80030]: pgmap v737: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 341 B/s wr, 11 op/s 2024-09-18T13:13:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.195+0000 7f28e61a9640 1 -- 172.21.15.78:0/3315298339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28e0106800 msgr2=0x7f28e0106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.195+0000 7f28e61a9640 1 --2- 172.21.15.78:0/3315298339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28e0106800 0x7f28e0106be0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009c20 tx=0x7f28d002a970 comp rx=0 tx=0).stop 2024-09-18T13:13:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.195+0000 7f28e61a9640 1 -- 172.21.15.78:0/3315298339 shutdown_connections 2024-09-18T13:13:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.195+0000 7f28e61a9640 1 --2- 172.21.15.78:0/3315298339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e0100800 0x7f28e0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.195+0000 7f28e61a9640 1 --2- 172.21.15.78:0/3315298339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28e0106800 0x7f28e0106be0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.195+0000 7f28e61a9640 1 -- 172.21.15.78:0/3315298339 >> 172.21.15.78:0/3315298339 conn(0x7f28e00fc520 msgr2=0x7f28e00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.195+0000 7f28e61a9640 1 -- 172.21.15.78:0/3315298339 shutdown_connections 2024-09-18T13:13:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.195+0000 7f28e61a9640 1 -- 172.21.15.78:0/3315298339 wait complete. 2024-09-18T13:13:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.195+0000 7f28e61a9640 1 Processor -- start 2024-09-18T13:13:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.196+0000 7f28e61a9640 1 -- start start 2024-09-18T13:13:43.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.196+0000 7f28e61a9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e0100800 0x7f28e01987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:43.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.196+0000 7f28e61a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28e0106800 0x7f28e0198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:43.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.196+0000 7f28e61a9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f28e010dcd0 con 0x7f28e0106800 2024-09-18T13:13:43.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.196+0000 7f28e61a9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f28e010db50 con 0x7f28e0100800 2024-09-18T13:13:43.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.196+0000 7f28deffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28e0106800 0x7f28e0198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:43.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.196+0000 7f28deffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28e0106800 0x7f28e0198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38788/0 (socket says 172.21.15.78:38788) 2024-09-18T13:13:43.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.196+0000 7f28deffd640 1 -- 172.21.15.78:0/2842229478 learned_addr learned my addr 172.21.15.78:0/2842229478 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:13:43.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.196+0000 7f28df7fe640 1 --2- 172.21.15.78:0/2842229478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e0100800 0x7f28e01987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:43.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.196+0000 7f28deffd640 1 -- 172.21.15.78:0/2842229478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e0100800 msgr2=0x7f28e01987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:43.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.196+0000 7f28deffd640 1 --2- 172.21.15.78:0/2842229478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e0100800 0x7f28e01987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.196+0000 7f28deffd640 1 -- 172.21.15.78:0/2842229478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e0199320 con 0x7f28e0106800 2024-09-18T13:13:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.196+0000 7f28deffd640 1 --2- 172.21.15.78:0/2842229478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28e0106800 0x7f28e0198d20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f28d400d6f0 tx=0x7f28d400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.197+0000 7f28dcff9640 1 -- 172.21.15.78:0/2842229478 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f28d4017070 con 0x7f28e0106800 2024-09-18T13:13:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.197+0000 7f28dcff9640 1 -- 172.21.15.78:0/2842229478 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f28d400de00 con 0x7f28e0106800 2024-09-18T13:13:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.197+0000 7f28dcff9640 1 -- 172.21.15.78:0/2842229478 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f28d4004bb0 con 0x7f28e0106800 2024-09-18T13:13:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.197+0000 7f28e61a9640 1 -- 172.21.15.78:0/2842229478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e0199610 con 0x7f28e0106800 2024-09-18T13:13:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.197+0000 7f28e61a9640 1 -- 172.21.15.78:0/2842229478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e01a1c10 con 0x7f28e0106800 2024-09-18T13:13:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.198+0000 7f28e61a9640 1 -- 172.21.15.78:0/2842229478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e0101f40 con 0x7f28e0106800 2024-09-18T13:13:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.198+0000 7f28dcff9640 1 -- 172.21.15.78:0/2842229478 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f28d4009a30 con 0x7f28e0106800 2024-09-18T13:13:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.199+0000 7f28dcff9640 1 --2- 172.21.15.78:0/2842229478 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28c807af80 0x7f28c807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.199+0000 7f28dcff9640 1 -- 172.21.15.78:0/2842229478 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f28d409dbc0 con 0x7f28e0106800 2024-09-18T13:13:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.199+0000 7f28df7fe640 1 --2- 172.21.15.78:0/2842229478 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28c807af80 0x7f28c807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.199+0000 7f28df7fe640 1 --2- 172.21.15.78:0/2842229478 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28c807af80 0x7f28c807d440 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009430 tx=0x7f28d003c040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:43.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.203+0000 7f28dcff9640 1 -- 172.21.15.78:0/2842229478 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f28e0199610 con 0x7f28e0106800 2024-09-18T13:13:43.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.411+0000 7f28e61a9640 1 -- 172.21.15.78:0/2842229478 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f28e0062630 con 0x7f28c807af80 2024-09-18T13:13:43.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.413+0000 7f28dcff9640 1 -- 172.21.15.78:0/2842229478 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7f28e0062630 con 0x7f28c807af80 2024-09-18T13:13:43.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.415+0000 7f28e61a9640 1 -- 172.21.15.78:0/2842229478 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28c807af80 msgr2=0x7f28c807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:43.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.415+0000 7f28e61a9640 1 --2- 172.21.15.78:0/2842229478 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28c807af80 0x7f28c807d440 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009430 tx=0x7f28d003c040 comp rx=0 tx=0).stop 2024-09-18T13:13:43.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.415+0000 7f28e61a9640 1 -- 172.21.15.78:0/2842229478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28e0106800 msgr2=0x7f28e0198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:43.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.415+0000 7f28e61a9640 1 --2- 172.21.15.78:0/2842229478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28e0106800 0x7f28e0198d20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f28d400d6f0 tx=0x7f28d400dbb0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.415+0000 7f28e61a9640 1 -- 172.21.15.78:0/2842229478 shutdown_connections 2024-09-18T13:13:43.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.415+0000 7f28e61a9640 1 --2- 172.21.15.78:0/2842229478 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f28c807af80 0x7f28c807d440 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.415+0000 7f28e61a9640 1 --2- 172.21.15.78:0/2842229478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28e0106800 0x7f28e0198d20 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.415+0000 7f28e61a9640 1 --2- 172.21.15.78:0/2842229478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e0100800 0x7f28e01987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.415+0000 7f28e61a9640 1 -- 172.21.15.78:0/2842229478 >> 172.21.15.78:0/2842229478 conn(0x7f28e00fc520 msgr2=0x7f28e00fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:43.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.415+0000 7f28e61a9640 1 -- 172.21.15.78:0/2842229478 shutdown_connections 2024-09-18T13:13:43.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.415+0000 7f28e61a9640 1 -- 172.21.15.78:0/2842229478 wait complete. 2024-09-18T13:13:43.425 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:13:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.500+0000 7f14c3456640 1 -- 172.21.15.78:0/3471047464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14bc102ac0 msgr2=0x7f14bc102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.500+0000 7f14c3456640 1 --2- 172.21.15.78:0/3471047464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14bc102ac0 0x7f14bc102ea0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f14b8009880 tx=0x7f14b802a530 comp rx=0 tx=0).stop 2024-09-18T13:13:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.500+0000 7f14c3456640 1 -- 172.21.15.78:0/3471047464 shutdown_connections 2024-09-18T13:13:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.501+0000 7f14c3456640 1 --2- 172.21.15.78:0/3471047464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14bc1033e0 0x7f14bc10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.501+0000 7f14c3456640 1 --2- 172.21.15.78:0/3471047464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14bc102ac0 0x7f14bc102ea0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.501+0000 7f14c3456640 1 -- 172.21.15.78:0/3471047464 >> 172.21.15.78:0/3471047464 conn(0x7f14bc0fc520 msgr2=0x7f14bc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.501+0000 7f14c3456640 1 -- 172.21.15.78:0/3471047464 shutdown_connections 2024-09-18T13:13:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.501+0000 7f14c3456640 1 -- 172.21.15.78:0/3471047464 wait complete. 2024-09-18T13:13:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.501+0000 7f14c3456640 1 Processor -- start 2024-09-18T13:13:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.501+0000 7f14c3456640 1 -- start start 2024-09-18T13:13:43.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.501+0000 7f14c3456640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14bc102ac0 0x7f14bc19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:43.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.501+0000 7f14c3456640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14bc1033e0 0x7f14bc19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:43.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.501+0000 7f14c3456640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc10edf0 con 0x7f14bc1033e0 2024-09-18T13:13:43.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.501+0000 7f14c3456640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc10ec70 con 0x7f14bc102ac0 2024-09-18T13:13:43.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.502+0000 7f14c09f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14bc1033e0 0x7f14bc19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:43.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.502+0000 7f14c09f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14bc1033e0 0x7f14bc19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38796/0 (socket says 172.21.15.78:38796) 2024-09-18T13:13:43.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.502+0000 7f14c09f1640 1 -- 172.21.15.78:0/2363812006 learned_addr learned my addr 172.21.15.78:0/2363812006 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:13:43.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.502+0000 7f14c11f2640 1 --2- 172.21.15.78:0/2363812006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14bc102ac0 0x7f14bc19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:43.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.502+0000 7f14c09f1640 1 -- 172.21.15.78:0/2363812006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14bc102ac0 msgr2=0x7f14bc19f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:43.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.502+0000 7f14c09f1640 1 --2- 172.21.15.78:0/2363812006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14bc102ac0 0x7f14bc19f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.502+0000 7f14c09f1640 1 -- 172.21.15.78:0/2363812006 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14bc199a10 con 0x7f14bc1033e0 2024-09-18T13:13:43.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.502+0000 7f14c09f1640 1 --2- 172.21.15.78:0/2363812006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14bc1033e0 0x7f14bc19fd40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00d6d0 tx=0x7f14ac00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:43.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.502+0000 7f14b27fc640 1 -- 172.21.15.78:0/2363812006 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f14ac017070 con 0x7f14bc1033e0 2024-09-18T13:13:43.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.502+0000 7f14b27fc640 1 -- 172.21.15.78:0/2363812006 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f14ac0054e0 con 0x7f14bc1033e0 2024-09-18T13:13:43.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.502+0000 7f14c3456640 1 -- 172.21.15.78:0/2363812006 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14bc199d00 con 0x7f14bc1033e0 2024-09-18T13:13:43.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.502+0000 7f14b27fc640 1 -- 172.21.15.78:0/2363812006 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f14ac004ae0 con 0x7f14bc1033e0 2024-09-18T13:13:43.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.502+0000 7f14c3456640 1 -- 172.21.15.78:0/2363812006 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14bc19a290 con 0x7f14bc1033e0 2024-09-18T13:13:43.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.503+0000 7f14c3456640 1 -- 172.21.15.78:0/2363812006 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14bc06aa90 con 0x7f14bc1033e0 2024-09-18T13:13:43.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.504+0000 7f14b27fc640 1 -- 172.21.15.78:0/2363812006 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f14ac004de0 con 0x7f14bc1033e0 2024-09-18T13:13:43.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.504+0000 7f14b27fc640 1 --2- 172.21.15.78:0/2363812006 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f14a807af30 0x7f14a807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:43.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.505+0000 7f14b27fc640 1 -- 172.21.15.78:0/2363812006 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f14ac09dba0 con 0x7f14bc1033e0 2024-09-18T13:13:43.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.505+0000 7f14c11f2640 1 --2- 172.21.15.78:0/2363812006 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f14a807af30 0x7f14a807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:43.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.505+0000 7f14c11f2640 1 --2- 172.21.15.78:0/2363812006 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f14a807af30 0x7f14a807d3f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f14b8000c00 tx=0x7f14b8031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:43.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.509+0000 7f14b27fc640 1 -- 172.21.15.78:0/2363812006 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f14ac069140 con 0x7f14bc1033e0 2024-09-18T13:13:43.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.710+0000 7f14c3456640 1 -- 172.21.15.78:0/2363812006 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f14bc10b410 con 0x7f14a807af30 2024-09-18T13:13:43.712 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:43 smithi078 ceph-mon[108578]: from='client.35172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:43.712 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:43 smithi078 ceph-mon[108578]: pgmap v738: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.0 MiB/s rd, 4.3 KiB/s wr, 12 op/s 2024-09-18T13:13:43.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.712+0000 7f14b27fc640 1 -- 172.21.15.78:0/2363812006 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7f14b8004260 con 0x7f14a807af30 2024-09-18T13:13:43.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.714+0000 7f14c3456640 1 -- 172.21.15.78:0/2363812006 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f14a807af30 msgr2=0x7f14a807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:43.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.714+0000 7f14c3456640 1 --2- 172.21.15.78:0/2363812006 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f14a807af30 0x7f14a807d3f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f14b8000c00 tx=0x7f14b8031400 comp rx=0 tx=0).stop 2024-09-18T13:13:43.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.714+0000 7f14c3456640 1 -- 172.21.15.78:0/2363812006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14bc1033e0 msgr2=0x7f14bc19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:43.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.714+0000 7f14c3456640 1 --2- 172.21.15.78:0/2363812006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14bc1033e0 0x7f14bc19fd40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00d6d0 tx=0x7f14ac00db90 comp rx=0 tx=0).stop 2024-09-18T13:13:43.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.714+0000 7f14c3456640 1 -- 172.21.15.78:0/2363812006 shutdown_connections 2024-09-18T13:13:43.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.714+0000 7f14c3456640 1 --2- 172.21.15.78:0/2363812006 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f14a807af30 0x7f14a807d3f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.714+0000 7f14c3456640 1 --2- 172.21.15.78:0/2363812006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14bc1033e0 0x7f14bc19fd40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.714+0000 7f14c3456640 1 --2- 172.21.15.78:0/2363812006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14bc102ac0 0x7f14bc19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.714+0000 7f14c3456640 1 -- 172.21.15.78:0/2363812006 >> 172.21.15.78:0/2363812006 conn(0x7f14bc0fc520 msgr2=0x7f14bc100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:43.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.714+0000 7f14c3456640 1 -- 172.21.15.78:0/2363812006 shutdown_connections 2024-09-18T13:13:43.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.714+0000 7f14c3456640 1 -- 172.21.15.78:0/2363812006 wait complete. 2024-09-18T13:13:43.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.799+0000 7f6fb05b1640 1 -- 172.21.15.78:0/2208822902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fa81001d0 msgr2=0x7f6fa8100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:43.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.799+0000 7f6fb05b1640 1 --2- 172.21.15.78:0/2208822902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fa81001d0 0x7f6fa8100630 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009880 tx=0x7f6f9802a530 comp rx=0 tx=0).stop 2024-09-18T13:13:43.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.799+0000 7f6fb05b1640 1 -- 172.21.15.78:0/2208822902 shutdown_connections 2024-09-18T13:13:43.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.799+0000 7f6fb05b1640 1 --2- 172.21.15.78:0/2208822902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fa81001d0 0x7f6fa8100630 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.799+0000 7f6fb05b1640 1 --2- 172.21.15.78:0/2208822902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fa8107b00 0x7f6fa8107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.799+0000 7f6fb05b1640 1 -- 172.21.15.78:0/2208822902 >> 172.21.15.78:0/2208822902 conn(0x7f6fa80771e0 msgr2=0x7f6fa80775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.799+0000 7f6fb05b1640 1 -- 172.21.15.78:0/2208822902 shutdown_connections 2024-09-18T13:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.799+0000 7f6fb05b1640 1 -- 172.21.15.78:0/2208822902 wait complete. 2024-09-18T13:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.800+0000 7f6fb05b1640 1 Processor -- start 2024-09-18T13:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.800+0000 7f6fb05b1640 1 -- start start 2024-09-18T13:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.800+0000 7f6fb05b1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fa81001d0 0x7f6fa819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.800+0000 7f6fb05b1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fa8107b00 0x7f6fa819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.800+0000 7f6fb05b1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa810ee40 con 0x7f6fa8107b00 2024-09-18T13:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.800+0000 7f6fb05b1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa810ecc0 con 0x7f6fa81001d0 2024-09-18T13:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.800+0000 7f6fadb4c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fa8107b00 0x7f6fa819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.800+0000 7f6fadb4c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fa8107b00 0x7f6fa819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38804/0 (socket says 172.21.15.78:38804) 2024-09-18T13:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.800+0000 7f6fadb4c640 1 -- 172.21.15.78:0/4255077974 learned_addr learned my addr 172.21.15.78:0/4255077974 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.800+0000 7f6fae34d640 1 --2- 172.21.15.78:0/4255077974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fa81001d0 0x7f6fa819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.800+0000 7f6fadb4c640 1 -- 172.21.15.78:0/4255077974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fa81001d0 msgr2=0x7f6fa819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.800+0000 7f6fadb4c640 1 --2- 172.21.15.78:0/4255077974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fa81001d0 0x7f6fa819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.800+0000 7f6fadb4c640 1 -- 172.21.15.78:0/4255077974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa81977b0 con 0x7f6fa8107b00 2024-09-18T13:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.801+0000 7f6fadb4c640 1 --2- 172.21.15.78:0/4255077974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fa8107b00 0x7f6fa819db70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6f98031460 tx=0x7f6f98004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.801+0000 7f6f9f7fe640 1 -- 172.21.15.78:0/4255077974 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f9803f070 con 0x7f6fa8107b00 2024-09-18T13:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.801+0000 7f6f9f7fe640 1 -- 172.21.15.78:0/4255077974 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f980035f0 con 0x7f6fa8107b00 2024-09-18T13:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.801+0000 7f6fb05b1640 1 -- 172.21.15.78:0/4255077974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa8197a40 con 0x7f6fa8107b00 2024-09-18T13:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.801+0000 7f6f9f7fe640 1 -- 172.21.15.78:0/4255077974 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f98035030 con 0x7f6fa8107b00 2024-09-18T13:13:43.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.801+0000 7f6fb05b1640 1 -- 172.21.15.78:0/4255077974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa8197f70 con 0x7f6fa8107b00 2024-09-18T13:13:43.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.802+0000 7f6fb05b1640 1 -- 172.21.15.78:0/4255077974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa80697e0 con 0x7f6fa8107b00 2024-09-18T13:13:43.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.802+0000 7f6f9f7fe640 1 -- 172.21.15.78:0/4255077974 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6f98042070 con 0x7f6fa8107b00 2024-09-18T13:13:43.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.803+0000 7f6f9f7fe640 1 --2- 172.21.15.78:0/4255077974 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f9407af30 0x7f6f9407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:43.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.803+0000 7f6f9f7fe640 1 -- 172.21.15.78:0/4255077974 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f6f980bea90 con 0x7f6fa8107b00 2024-09-18T13:13:43.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.803+0000 7f6fae34d640 1 --2- 172.21.15.78:0/4255077974 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f9407af30 0x7f6f9407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:43.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.803+0000 7f6fae34d640 1 --2- 172.21.15.78:0/4255077974 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f9407af30 0x7f6f9407d3f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4009aa0 tx=0x7f6fa4005f90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:43.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:43.810+0000 7f6f9f7fe640 1 -- 172.21.15.78:0/4255077974 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6f9808a030 con 0x7f6fa8107b00 2024-09-18T13:13:43.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:43 smithi148 ceph-mon[80030]: from='client.35172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:43.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:43 smithi148 ceph-mon[80030]: pgmap v738: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.0 MiB/s rd, 4.3 KiB/s wr, 12 op/s 2024-09-18T13:13:44.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.044+0000 7f6fb05b1640 1 -- 172.21.15.78:0/4255077974 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6fa8198ce0 con 0x7f6f9407af30 2024-09-18T13:13:44.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.055+0000 7f6f9f7fe640 1 -- 172.21.15.78:0/4255077974 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f6fa8198ce0 con 0x7f6f9407af30 2024-09-18T13:13:44.056 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:13:44.056 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (21m) 0s ago 32m 20.3M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:13:44.056 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (14s) 0s ago 32m 7856k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 27bed60b114c 2024-09-18T13:13:44.056 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (9s) 6s ago 31m 7239k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2ad07367d594 2024-09-18T13:13:44.056 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (19m) 0s ago 32m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:13:44.056 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (19m) 6s ago 31m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:13:44.056 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (21m) 0s ago 32m 76.3M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:13:44.056 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (16m) 0s ago 27m 86.2M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:13:44.056 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (15m) 0s ago 27m 21.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:13:44.057 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (15m) 6s ago 27m 20.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:13:44.057 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (15m) 6s ago 27m 23.0M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:13:44.057 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (23m) 0s ago 33m 531M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:13:44.057 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (22m) 6s ago 31m 462M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:13:44.057 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (20m) 0s ago 34m 69.2M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:13:44.057 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (20m) 6s ago 31m 52.0M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:13:44.057 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (22m) 0s ago 32m 11.5M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:13:44.057 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (22m) 6s ago 31m 12.3M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:13:44.057 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (19m) 0s ago 30m 98.1M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:13:44.057 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (18m) 0s ago 30m 103M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:13:44.057 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (18m) 0s ago 29m 90.0M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:13:44.057 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (17m) 6s ago 29m 105M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:13:44.058 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (16m) 6s ago 28m 94.0M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:13:44.058 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (16m) 6s ago 28m 91.4M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:13:44.058 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (21m) 0s ago 32m 69.6M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:13:44.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.058+0000 7f6fb05b1640 1 -- 172.21.15.78:0/4255077974 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f9407af30 msgr2=0x7f6f9407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:44.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.058+0000 7f6fb05b1640 1 --2- 172.21.15.78:0/4255077974 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f9407af30 0x7f6f9407d3f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4009aa0 tx=0x7f6fa4005f90 comp rx=0 tx=0).stop 2024-09-18T13:13:44.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.058+0000 7f6fb05b1640 1 -- 172.21.15.78:0/4255077974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fa8107b00 msgr2=0x7f6fa819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:44.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.058+0000 7f6fb05b1640 1 --2- 172.21.15.78:0/4255077974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fa8107b00 0x7f6fa819db70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6f98031460 tx=0x7f6f98004530 comp rx=0 tx=0).stop 2024-09-18T13:13:44.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.058+0000 7f6fb05b1640 1 -- 172.21.15.78:0/4255077974 shutdown_connections 2024-09-18T13:13:44.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.058+0000 7f6fb05b1640 1 --2- 172.21.15.78:0/4255077974 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f6f9407af30 0x7f6f9407d3f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.058+0000 7f6fb05b1640 1 --2- 172.21.15.78:0/4255077974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fa8107b00 0x7f6fa819db70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.058+0000 7f6fb05b1640 1 --2- 172.21.15.78:0/4255077974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fa81001d0 0x7f6fa819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.058+0000 7f6fb05b1640 1 -- 172.21.15.78:0/4255077974 >> 172.21.15.78:0/4255077974 conn(0x7f6fa80771e0 msgr2=0x7f6fa80fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:44.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.058+0000 7f6fb05b1640 1 -- 172.21.15.78:0/4255077974 shutdown_connections 2024-09-18T13:13:44.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.058+0000 7f6fb05b1640 1 -- 172.21.15.78:0/4255077974 wait complete. 2024-09-18T13:13:44.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.142+0000 7f1730d47640 1 -- 172.21.15.78:0/2320138210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f172c101900 msgr2=0x7f172c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:44.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.142+0000 7f1730d47640 1 --2- 172.21.15.78:0/2320138210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f172c101900 0x7f172c101d60 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1720009880 tx=0x7f172002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.142+0000 7f1730d47640 1 -- 172.21.15.78:0/2320138210 shutdown_connections 2024-09-18T13:13:44.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.142+0000 7f1730d47640 1 --2- 172.21.15.78:0/2320138210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f172c101900 0x7f172c101d60 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.142+0000 7f1730d47640 1 --2- 172.21.15.78:0/2320138210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f172c107900 0x7f172c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.142+0000 7f1730d47640 1 -- 172.21.15.78:0/2320138210 >> 172.21.15.78:0/2320138210 conn(0x7f172c0fd5e0 msgr2=0x7f172c0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:44.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.142+0000 7f1730d47640 1 -- 172.21.15.78:0/2320138210 shutdown_connections 2024-09-18T13:13:44.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.142+0000 7f1730d47640 1 -- 172.21.15.78:0/2320138210 wait complete. 2024-09-18T13:13:44.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.143+0000 7f1730d47640 1 Processor -- start 2024-09-18T13:13:44.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.143+0000 7f1730d47640 1 -- start start 2024-09-18T13:13:44.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.143+0000 7f1730d47640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f172c101900 0x7f172c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:44.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.143+0000 7f1730d47640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f172c107900 0x7f172c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:44.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.143+0000 7f1730d47640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f172c10edb0 con 0x7f172c107900 2024-09-18T13:13:44.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.143+0000 7f1730d47640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f172c10ec30 con 0x7f172c101900 2024-09-18T13:13:44.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.143+0000 7f1729d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f172c107900 0x7f172c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:44.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.143+0000 7f1729d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f172c107900 0x7f172c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38830/0 (socket says 172.21.15.78:38830) 2024-09-18T13:13:44.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.143+0000 7f1729d9b640 1 -- 172.21.15.78:0/269687770 learned_addr learned my addr 172.21.15.78:0/269687770 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:13:44.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.143+0000 7f172a59c640 1 --2- 172.21.15.78:0/269687770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f172c101900 0x7f172c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.143+0000 7f1729d9b640 1 -- 172.21.15.78:0/269687770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f172c101900 msgr2=0x7f172c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.143+0000 7f1729d9b640 1 --2- 172.21.15.78:0/269687770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f172c101900 0x7f172c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.143+0000 7f1729d9b640 1 -- 172.21.15.78:0/269687770 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172c197800 con 0x7f172c107900 2024-09-18T13:13:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.144+0000 7f1729d9b640 1 --2- 172.21.15.78:0/269687770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f172c107900 0x7f172c19dbc0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1720031460 tx=0x7f17200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.144+0000 7f171b7fe640 1 -- 172.21.15.78:0/269687770 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f172003f070 con 0x7f172c107900 2024-09-18T13:13:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.144+0000 7f1730d47640 1 -- 172.21.15.78:0/269687770 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f172c197a90 con 0x7f172c107900 2024-09-18T13:13:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.144+0000 7f171b7fe640 1 -- 172.21.15.78:0/269687770 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1720004cf0 con 0x7f172c107900 2024-09-18T13:13:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.144+0000 7f171b7fe640 1 -- 172.21.15.78:0/269687770 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1720035030 con 0x7f172c107900 2024-09-18T13:13:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.144+0000 7f1730d47640 1 -- 172.21.15.78:0/269687770 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f172c197fc0 con 0x7f172c107900 2024-09-18T13:13:44.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.145+0000 7f1730d47640 1 -- 172.21.15.78:0/269687770 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f172c103040 con 0x7f172c107900 2024-09-18T13:13:44.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.146+0000 7f171b7fe640 1 -- 172.21.15.78:0/269687770 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1720042070 con 0x7f172c107900 2024-09-18T13:13:44.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.146+0000 7f171b7fe640 1 --2- 172.21.15.78:0/269687770 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f171407af30 0x7f171407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:44.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.146+0000 7f171b7fe640 1 -- 172.21.15.78:0/269687770 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f17200beb20 con 0x7f172c107900 2024-09-18T13:13:44.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.146+0000 7f172a59c640 1 --2- 172.21.15.78:0/269687770 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f171407af30 0x7f171407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:44.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.147+0000 7f172a59c640 1 --2- 172.21.15.78:0/269687770 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f171407af30 0x7f171407d3f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f171c0058c0 tx=0x7f171c00a4c0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:44.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.153+0000 7f171b7fe640 1 -- 172.21.15.78:0/269687770 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f172008a0c0 con 0x7f172c107900 2024-09-18T13:13:44.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.420+0000 7f1730d47640 1 -- 172.21.15.78:0/269687770 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f172c198d30 con 0x7f172c107900 2024-09-18T13:13:44.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.420+0000 7f171b7fe640 1 -- 172.21.15.78:0/269687770 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f172008ef70 con 0x7f172c107900 2024-09-18T13:13:44.422 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:13:44.422 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:13:44.422 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:13:44.422 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:13:44.423 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:13:44.423 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:13:44.423 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:13:44.423 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:13:44.423 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:13:44.423 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:13:44.423 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:13:44.423 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:13:44.423 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:13:44.423 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:13:44.423 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:13:44.423 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:13:44.424 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:13:44.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.423+0000 7f1730d47640 1 -- 172.21.15.78:0/269687770 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f171407af30 msgr2=0x7f171407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:44.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.423+0000 7f1730d47640 1 --2- 172.21.15.78:0/269687770 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f171407af30 0x7f171407d3f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f171c0058c0 tx=0x7f171c00a4c0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.423+0000 7f1730d47640 1 -- 172.21.15.78:0/269687770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f172c107900 msgr2=0x7f172c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:44.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.423+0000 7f1730d47640 1 --2- 172.21.15.78:0/269687770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f172c107900 0x7f172c19dbc0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1720031460 tx=0x7f17200048f0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.423+0000 7f1730d47640 1 -- 172.21.15.78:0/269687770 shutdown_connections 2024-09-18T13:13:44.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.423+0000 7f1730d47640 1 --2- 172.21.15.78:0/269687770 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f171407af30 0x7f171407d3f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.423+0000 7f1730d47640 1 --2- 172.21.15.78:0/269687770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f172c107900 0x7f172c19dbc0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.423+0000 7f1730d47640 1 --2- 172.21.15.78:0/269687770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f172c101900 0x7f172c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.423+0000 7f1730d47640 1 -- 172.21.15.78:0/269687770 >> 172.21.15.78:0/269687770 conn(0x7f172c0fd5e0 msgr2=0x7f172c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:44.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.423+0000 7f1730d47640 1 -- 172.21.15.78:0/269687770 shutdown_connections 2024-09-18T13:13:44.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.423+0000 7f1730d47640 1 -- 172.21.15.78:0/269687770 wait complete. 2024-09-18T13:13:44.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.508+0000 7f471a05c640 1 -- 172.21.15.78:0/2104350234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4714107900 msgr2=0x7f4714107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:44.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.508+0000 7f471a05c640 1 --2- 172.21.15.78:0/2104350234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4714107900 0x7f4714107ce0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f470c009c20 tx=0x7f470c02a970 comp rx=0 tx=0).stop 2024-09-18T13:13:44.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.508+0000 7f471a05c640 1 -- 172.21.15.78:0/2104350234 shutdown_connections 2024-09-18T13:13:44.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.508+0000 7f471a05c640 1 --2- 172.21.15.78:0/2104350234 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4714101900 0x7f4714101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.508+0000 7f471a05c640 1 --2- 172.21.15.78:0/2104350234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4714107900 0x7f4714107ce0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.508+0000 7f471a05c640 1 -- 172.21.15.78:0/2104350234 >> 172.21.15.78:0/2104350234 conn(0x7f47140fd5e0 msgr2=0x7f47140ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:44.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.508+0000 7f471a05c640 1 -- 172.21.15.78:0/2104350234 shutdown_connections 2024-09-18T13:13:44.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.508+0000 7f471a05c640 1 -- 172.21.15.78:0/2104350234 wait complete. 2024-09-18T13:13:44.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.509+0000 7f471a05c640 1 Processor -- start 2024-09-18T13:13:44.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.509+0000 7f471a05c640 1 -- start start 2024-09-18T13:13:44.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.509+0000 7f471a05c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4714101900 0x7f47140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:44.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.509+0000 7f471a05c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4714107900 0x7f4714074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:44.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.509+0000 7f471a05c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f471410edb0 con 0x7f4714107900 2024-09-18T13:13:44.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.509+0000 7f471a05c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f471410ec30 con 0x7f4714101900 2024-09-18T13:13:44.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.509+0000 7f4712ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4714107900 0x7f4714074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:44.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.510+0000 7f4712ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4714107900 0x7f4714074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38854/0 (socket says 172.21.15.78:38854) 2024-09-18T13:13:44.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.510+0000 7f4712ffd640 1 -- 172.21.15.78:0/512569417 learned_addr learned my addr 172.21.15.78:0/512569417 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:13:44.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.510+0000 7f47137fe640 1 --2- 172.21.15.78:0/512569417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4714101900 0x7f47140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:44.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.510+0000 7f4712ffd640 1 -- 172.21.15.78:0/512569417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4714101900 msgr2=0x7f47140744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:44.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.510+0000 7f4712ffd640 1 --2- 172.21.15.78:0/512569417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4714101900 0x7f47140744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.510+0000 7f4712ffd640 1 -- 172.21.15.78:0/512569417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4714074f70 con 0x7f4714107900 2024-09-18T13:13:44.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.510+0000 7f4712ffd640 1 --2- 172.21.15.78:0/512569417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4714107900 0x7f4714074a30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c810 tx=0x7f46fc00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:44.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.510+0000 7f4710ff9640 1 -- 172.21.15.78:0/512569417 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46fc004020 con 0x7f4714107900 2024-09-18T13:13:44.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.510+0000 7f471a05c640 1 -- 172.21.15.78:0/512569417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4714075260 con 0x7f4714107900 2024-09-18T13:13:44.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.510+0000 7f4710ff9640 1 -- 172.21.15.78:0/512569417 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f46fc0041c0 con 0x7f4714107900 2024-09-18T13:13:44.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.510+0000 7f4710ff9640 1 -- 172.21.15.78:0/512569417 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46fc0047a0 con 0x7f4714107900 2024-09-18T13:13:44.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.510+0000 7f471a05c640 1 -- 172.21.15.78:0/512569417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47141a3e20 con 0x7f4714107900 2024-09-18T13:13:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.511+0000 7f471a05c640 1 -- 172.21.15.78:0/512569417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4714103040 con 0x7f4714107900 2024-09-18T13:13:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.512+0000 7f4710ff9640 1 -- 172.21.15.78:0/512569417 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f46fc0079b0 con 0x7f4714107900 2024-09-18T13:13:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.512+0000 7f4710ff9640 1 --2- 172.21.15.78:0/512569417 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f470007af30 0x7f470007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.513+0000 7f4710ff9640 1 -- 172.21.15.78:0/512569417 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f46fc09dfe0 con 0x7f4714107900 2024-09-18T13:13:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.513+0000 7f47137fe640 1 --2- 172.21.15.78:0/512569417 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f470007af30 0x7f470007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:44.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.513+0000 7f47137fe640 1 --2- 172.21.15.78:0/512569417 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f470007af30 0x7f470007d3f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f470c009430 tx=0x7f470c0093a0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:44.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.517+0000 7f4710ff9640 1 -- 172.21.15.78:0/512569417 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f46fc014030 con 0x7f4714107900 2024-09-18T13:13:44.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.739+0000 7f471a05c640 1 -- 172.21.15.78:0/512569417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4714104b10 con 0x7f4714107900 2024-09-18T13:13:44.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.739+0000 7f4710ff9640 1 -- 172.21.15.78:0/512569417 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) ==== 76+0+2038 (secure 0 0 0) 0x7f46fc069580 con 0x7f4714107900 2024-09-18T13:13:44.741 INFO:teuthology.orchestra.run.smithi078.stdout:e35 2024-09-18T13:13:44.741 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T13:13:36:391405+0000 2024-09-18T13:13:44.741 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:13:44.741 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:13:44.741 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:13:44.741 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:13:44.741 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:13:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:13:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 35 2024-09-18T13:13:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T13:13:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:13:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T13:13:36.391399+0000 2024-09-18T13:13:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:13:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:13:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:13:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:13:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:13:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:13:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:13:44.743 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:13:44.743 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:13:44.743 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:13:44.743 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:13:44.743 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:13:44.743 INFO:teuthology.orchestra.run.smithi078.stdout:up {0=34320,1=34352} 2024-09-18T13:13:44.743 INFO:teuthology.orchestra.run.smithi078.stdout:failed 2024-09-18T13:13:44.743 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:13:44.743 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:13:44.743 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:13:44.743 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:13:44.743 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:13:44.743 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:13:44.744 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:13:44.744 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:13:44.744 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 34320 members: 34320,34352 2024-09-18T13:13:44.744 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{0:34320} state up:active seq 244 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:13:44.744 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{1:34352} state up:active seq 239 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:13:44.744 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:13:44.744 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:13:44.744 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:13:44.744 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:13:44.744 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:13:44.744 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:13:44.745 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 35 2024-09-18T13:13:44.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.741+0000 7f471a05c640 1 -- 172.21.15.78:0/512569417 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f470007af30 msgr2=0x7f470007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:44.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.741+0000 7f471a05c640 1 --2- 172.21.15.78:0/512569417 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f470007af30 0x7f470007d3f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f470c009430 tx=0x7f470c0093a0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.741+0000 7f471a05c640 1 -- 172.21.15.78:0/512569417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4714107900 msgr2=0x7f4714074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:44.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.741+0000 7f471a05c640 1 --2- 172.21.15.78:0/512569417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4714107900 0x7f4714074a30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c810 tx=0x7f46fc00ccd0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.742+0000 7f471a05c640 1 -- 172.21.15.78:0/512569417 shutdown_connections 2024-09-18T13:13:44.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.742+0000 7f471a05c640 1 --2- 172.21.15.78:0/512569417 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f470007af30 0x7f470007d3f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.742+0000 7f471a05c640 1 --2- 172.21.15.78:0/512569417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4714107900 0x7f4714074a30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.742+0000 7f471a05c640 1 --2- 172.21.15.78:0/512569417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4714101900 0x7f47140744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.742+0000 7f471a05c640 1 -- 172.21.15.78:0/512569417 >> 172.21.15.78:0/512569417 conn(0x7f47140fd5e0 msgr2=0x7f47140fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:44.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.742+0000 7f471a05c640 1 -- 172.21.15.78:0/512569417 shutdown_connections 2024-09-18T13:13:44.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.742+0000 7f471a05c640 1 -- 172.21.15.78:0/512569417 wait complete. 2024-09-18T13:13:44.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.826+0000 7f3eb9877640 1 -- 172.21.15.78:0/4020263058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eb4102ab0 msgr2=0x7f3eb4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:44.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.826+0000 7f3eb9877640 1 --2- 172.21.15.78:0/4020263058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eb4102ab0 0x7f3eb4102e90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009880 tx=0x7f3ea402a530 comp rx=0 tx=0).stop 2024-09-18T13:13:44.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.826+0000 7f3eb9877640 1 -- 172.21.15.78:0/4020263058 shutdown_connections 2024-09-18T13:13:44.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.826+0000 7f3eb9877640 1 --2- 172.21.15.78:0/4020263058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3eb41033d0 0x7f3eb410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.826+0000 7f3eb9877640 1 --2- 172.21.15.78:0/4020263058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eb4102ab0 0x7f3eb4102e90 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.826+0000 7f3eb9877640 1 -- 172.21.15.78:0/4020263058 >> 172.21.15.78:0/4020263058 conn(0x7f3eb40fc550 msgr2=0x7f3eb40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:44.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.826+0000 7f3eb9877640 1 -- 172.21.15.78:0/4020263058 shutdown_connections 2024-09-18T13:13:44.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.826+0000 7f3eb9877640 1 -- 172.21.15.78:0/4020263058 wait complete. 2024-09-18T13:13:44.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.827+0000 7f3eb9877640 1 Processor -- start 2024-09-18T13:13:44.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.827+0000 7f3eb9877640 1 -- start start 2024-09-18T13:13:44.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.827+0000 7f3eb9877640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3eb4102ab0 0x7f3eb419f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:44.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.827+0000 7f3eb9877640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eb41033d0 0x7f3eb419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:44.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.827+0000 7f3eb9877640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb410ede0 con 0x7f3eb41033d0 2024-09-18T13:13:44.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.827+0000 7f3eb9877640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb410ec60 con 0x7f3eb4102ab0 2024-09-18T13:13:44.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.828+0000 7f3eb27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eb41033d0 0x7f3eb419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:44.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.828+0000 7f3eb27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eb41033d0 0x7f3eb419fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38872/0 (socket says 172.21.15.78:38872) 2024-09-18T13:13:44.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.828+0000 7f3eb27fc640 1 -- 172.21.15.78:0/4208299799 learned_addr learned my addr 172.21.15.78:0/4208299799 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:13:44.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.828+0000 7f3eb2ffd640 1 --2- 172.21.15.78:0/4208299799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3eb4102ab0 0x7f3eb419f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:44.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.828+0000 7f3eb27fc640 1 -- 172.21.15.78:0/4208299799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3eb4102ab0 msgr2=0x7f3eb419f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:44.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.828+0000 7f3eb27fc640 1 --2- 172.21.15.78:0/4208299799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3eb4102ab0 0x7f3eb419f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:44.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.828+0000 7f3eb27fc640 1 -- 172.21.15.78:0/4208299799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb41999f0 con 0x7f3eb41033d0 2024-09-18T13:13:44.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.828+0000 7f3eb27fc640 1 --2- 172.21.15.78:0/4208299799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eb41033d0 0x7f3eb419fd70 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00d6d0 tx=0x7f3e9c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:44.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.828+0000 7f3eb8875640 1 -- 172.21.15.78:0/4208299799 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e9c017070 con 0x7f3eb41033d0 2024-09-18T13:13:44.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.828+0000 7f3eb8875640 1 -- 172.21.15.78:0/4208299799 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e9c0054e0 con 0x7f3eb41033d0 2024-09-18T13:13:44.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.828+0000 7f3eb9877640 1 -- 172.21.15.78:0/4208299799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb4199ce0 con 0x7f3eb41033d0 2024-09-18T13:13:44.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.828+0000 7f3eb8875640 1 -- 172.21.15.78:0/4208299799 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e9c004ae0 con 0x7f3eb41033d0 2024-09-18T13:13:44.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.828+0000 7f3eb9877640 1 -- 172.21.15.78:0/4208299799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb419a270 con 0x7f3eb41033d0 2024-09-18T13:13:44.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.830+0000 7f3eb9877640 1 -- 172.21.15.78:0/4208299799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eb406a580 con 0x7f3eb41033d0 2024-09-18T13:13:44.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.831+0000 7f3eb8875640 1 -- 172.21.15.78:0/4208299799 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3e9c004de0 con 0x7f3eb41033d0 2024-09-18T13:13:44.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.831+0000 7f3eb8875640 1 --2- 172.21.15.78:0/4208299799 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ea007af30 0x7f3ea007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:44.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.831+0000 7f3eb8875640 1 -- 172.21.15.78:0/4208299799 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f3e9c09dbc0 con 0x7f3eb41033d0 2024-09-18T13:13:44.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.831+0000 7f3eb2ffd640 1 --2- 172.21.15.78:0/4208299799 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ea007af30 0x7f3ea007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:44.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.832+0000 7f3eb2ffd640 1 --2- 172.21.15.78:0/4208299799 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ea007af30 0x7f3ea007d3f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4000c00 tx=0x7f3ea4031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:44.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:44.836+0000 7f3eb8875640 1 -- 172.21.15.78:0/4208299799 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3e9c069160 con 0x7f3eb41033d0 2024-09-18T13:13:45.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.047+0000 7f3eb9877640 1 -- 172.21.15.78:0/4208299799 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3eb419af20 con 0x7f3ea007af30 2024-09-18T13:13:45.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.048+0000 7f3eb8875640 1 -- 172.21.15.78:0/4208299799 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+466 (secure 0 0 0) 0x7f3eb419af20 con 0x7f3ea007af30 2024-09-18T13:13:45.049 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:13:45.049 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:13:45.049 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": true, 2024-09-18T13:13:45.049 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:13:45.049 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [ 2024-09-18T13:13:45.049 INFO:teuthology.orchestra.run.smithi078.stdout: "mds", 2024-09-18T13:13:45.049 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph-exporter", 2024-09-18T13:13:45.050 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr", 2024-09-18T13:13:45.050 INFO:teuthology.orchestra.run.smithi078.stdout: "osd", 2024-09-18T13:13:45.050 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-18T13:13:45.050 INFO:teuthology.orchestra.run.smithi078.stdout: "mon" 2024-09-18T13:13:45.050 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-18T13:13:45.050 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": "18/23 daemons upgraded", 2024-09-18T13:13:45.050 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-18T13:13:45.050 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:13:45.050 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:13:45.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.050+0000 7f3eb9877640 1 -- 172.21.15.78:0/4208299799 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ea007af30 msgr2=0x7f3ea007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:45.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.050+0000 7f3eb9877640 1 --2- 172.21.15.78:0/4208299799 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ea007af30 0x7f3ea007d3f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4000c00 tx=0x7f3ea4031400 comp rx=0 tx=0).stop 2024-09-18T13:13:45.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.050+0000 7f3eb9877640 1 -- 172.21.15.78:0/4208299799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eb41033d0 msgr2=0x7f3eb419fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:45.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.050+0000 7f3eb9877640 1 --2- 172.21.15.78:0/4208299799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eb41033d0 0x7f3eb419fd70 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00d6d0 tx=0x7f3e9c00db90 comp rx=0 tx=0).stop 2024-09-18T13:13:45.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.050+0000 7f3eb9877640 1 -- 172.21.15.78:0/4208299799 shutdown_connections 2024-09-18T13:13:45.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.050+0000 7f3eb9877640 1 --2- 172.21.15.78:0/4208299799 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3ea007af30 0x7f3ea007d3f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:45.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.050+0000 7f3eb9877640 1 --2- 172.21.15.78:0/4208299799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eb41033d0 0x7f3eb419fd70 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:45.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.050+0000 7f3eb9877640 1 --2- 172.21.15.78:0/4208299799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3eb4102ab0 0x7f3eb419f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:45.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.050+0000 7f3eb9877640 1 -- 172.21.15.78:0/4208299799 >> 172.21.15.78:0/4208299799 conn(0x7f3eb40fc550 msgr2=0x7f3eb41009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:45.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.050+0000 7f3eb9877640 1 -- 172.21.15.78:0/4208299799 shutdown_connections 2024-09-18T13:13:45.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.050+0000 7f3eb9877640 1 -- 172.21.15.78:0/4208299799 wait complete. 2024-09-18T13:13:45.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.133+0000 7fb29cee1640 1 -- 172.21.15.78:0/107528120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb298100800 msgr2=0x7fb298100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:45.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.133+0000 7fb29cee1640 1 --2- 172.21.15.78:0/107528120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb298100800 0x7fb298100c60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009880 tx=0x7fb28c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:13:45.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.133+0000 7fb29cee1640 1 -- 172.21.15.78:0/107528120 shutdown_connections 2024-09-18T13:13:45.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.133+0000 7fb29cee1640 1 --2- 172.21.15.78:0/107528120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb298100800 0x7fb298100c60 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:45.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.133+0000 7fb29cee1640 1 --2- 172.21.15.78:0/107528120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb298106800 0x7fb298106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:45.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.133+0000 7fb29cee1640 1 -- 172.21.15.78:0/107528120 >> 172.21.15.78:0/107528120 conn(0x7fb2980fc520 msgr2=0x7fb2980fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:45.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.133+0000 7fb29cee1640 1 -- 172.21.15.78:0/107528120 shutdown_connections 2024-09-18T13:13:45.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.133+0000 7fb29cee1640 1 -- 172.21.15.78:0/107528120 wait complete. 2024-09-18T13:13:45.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.134+0000 7fb29cee1640 1 Processor -- start 2024-09-18T13:13:45.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.134+0000 7fb29cee1640 1 -- start start 2024-09-18T13:13:45.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.134+0000 7fb29cee1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb298100800 0x7fb29819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:45.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.134+0000 7fb29cee1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb298106800 0x7fb29819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:45.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.134+0000 7fb29cee1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb29810dd30 con 0x7fb298100800 2024-09-18T13:13:45.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.134+0000 7fb29cee1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb29810dbb0 con 0x7fb298106800 2024-09-18T13:13:45.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.134+0000 7fb29659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb298100800 0x7fb29819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:45.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.134+0000 7fb29659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb298100800 0x7fb29819d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38894/0 (socket says 172.21.15.78:38894) 2024-09-18T13:13:45.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.134+0000 7fb29659c640 1 -- 172.21.15.78:0/2103674093 learned_addr learned my addr 172.21.15.78:0/2103674093 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:13:45.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.135+0000 7fb295d9b640 1 --2- 172.21.15.78:0/2103674093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb298106800 0x7fb29819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:45.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.135+0000 7fb29659c640 1 -- 172.21.15.78:0/2103674093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb298106800 msgr2=0x7fb29819dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:45.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.135+0000 7fb29659c640 1 --2- 172.21.15.78:0/2103674093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb298106800 0x7fb29819dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:45.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.135+0000 7fb29659c640 1 -- 172.21.15.78:0/2103674093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb298197830 con 0x7fb298100800 2024-09-18T13:13:45.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.135+0000 7fb295d9b640 1 --2- 172.21.15.78:0/2103674093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb298106800 0x7fb29819dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:13:45.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.135+0000 7fb29659c640 1 --2- 172.21.15.78:0/2103674093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb298100800 0x7fb29819d6b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb28800b420 tx=0x7fb28800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:45.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.135+0000 7fb2877fe640 1 -- 172.21.15.78:0/2103674093 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb288011630 con 0x7fb298100800 2024-09-18T13:13:45.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.135+0000 7fb2877fe640 1 -- 172.21.15.78:0/2103674093 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb288016070 con 0x7fb298100800 2024-09-18T13:13:45.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.135+0000 7fb29cee1640 1 -- 172.21.15.78:0/2103674093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb298197b20 con 0x7fb298100800 2024-09-18T13:13:45.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.135+0000 7fb2877fe640 1 -- 172.21.15.78:0/2103674093 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb288010d40 con 0x7fb298100800 2024-09-18T13:13:45.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.135+0000 7fb29cee1640 1 -- 172.21.15.78:0/2103674093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2981980b0 con 0x7fb298100800 2024-09-18T13:13:45.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.136+0000 7fb29cee1640 1 -- 172.21.15.78:0/2103674093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb298101f40 con 0x7fb298100800 2024-09-18T13:13:45.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.137+0000 7fb2877fe640 1 -- 172.21.15.78:0/2103674093 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fb28801b460 con 0x7fb298100800 2024-09-18T13:13:45.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.137+0000 7fb2877fe640 1 --2- 172.21.15.78:0/2103674093 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb28007af30 0x7fb28007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:13:45.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.137+0000 7fb295d9b640 1 --2- 172.21.15.78:0/2103674093 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb28007af30 0x7fb28007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:13:45.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.137+0000 7fb2877fe640 1 -- 172.21.15.78:0/2103674093 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fb28809d7a0 con 0x7fb298100800 2024-09-18T13:13:45.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.138+0000 7fb295d9b640 1 --2- 172.21.15.78:0/2103674093 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb28007af30 0x7fb28007d3f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb28c031460 tx=0x7fb28c0095f0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:13:45.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.142+0000 7fb2877fe640 1 -- 172.21.15.78:0/2103674093 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fb288068d40 con 0x7fb298100800 2024-09-18T13:13:45.144 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:45 smithi078 ceph-mon[108578]: from='client.35176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:45.145 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:45 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:45.145 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:45 smithi078 ceph-mon[108578]: from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:45.145 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:45 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:45.145 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:45 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/269687770' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:45.145 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:45 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:45.145 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:45 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:45.145 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:45 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/512569417' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:13:45.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:45 smithi148 ceph-mon[80030]: from='client.35176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:45.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:45 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:45.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:45 smithi148 ceph-mon[80030]: from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:45.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:45 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:45.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:45 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/269687770' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:45.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:45 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:45.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:45 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:45.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:45 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/512569417' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:13:45.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.399+0000 7fb29cee1640 1 -- 172.21.15.78:0/2103674093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb298109da0 con 0x7fb298100800 2024-09-18T13:13:45.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.399+0000 7fb2877fe640 1 -- 172.21.15.78:0/2103674093 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3573 (secure 0 0 0) 0x7fb28806dbf0 con 0x7fb298100800 2024-09-18T13:13:45.401 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_WARN failed to probe daemons or devices; 1 filesystem with deprecated feature inline_data 2024-09-18T13:13:45.401 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-18T13:13:45.401 INFO:teuthology.orchestra.run.smithi078.stdout: host smithi148 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi148/config 2024-09-18T13:13:45.401 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-18T13:13:45.401 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 -e NODE_NAME=smithi148 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968:/var/run/ceph:z -v /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqlxzmntq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 inventory --format=json-pretty --filter-for-batch 2024-09-18T13:13:45.401 INFO:teuthology.orchestra.run.smithi078.stdout:Traceback (most recent call last): 2024-09-18T13:13:45.402 INFO:teuthology.orchestra.run.smithi078.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-18T13:13:45.402 INFO:teuthology.orchestra.run.smithi078.stdout: return _run_code(code, main_globals, None, 2024-09-18T13:13:45.402 INFO:teuthology.orchestra.run.smithi078.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-18T13:13:45.402 INFO:teuthology.orchestra.run.smithi078.stdout: exec(code, run_globals) 2024-09-18T13:13:45.402 INFO:teuthology.orchestra.run.smithi078.stdout: File "/tmp/tmpustg9p7w.cephadm.build/app/__main__.py", line 5628, in 2024-09-18T13:13:45.402 INFO:teuthology.orchestra.run.smithi078.stdout: File "/tmp/tmpustg9p7w.cephadm.build/app/__main__.py", line 5616, in main 2024-09-18T13:13:45.402 INFO:teuthology.orchestra.run.smithi078.stdout: File "/tmp/tmpustg9p7w.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-18T13:13:45.402 INFO:teuthology.orchestra.run.smithi078.stdout: File "/tmp/tmpustg9p7w.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-18T13:13:45.402 INFO:teuthology.orchestra.run.smithi078.stdout: File "/tmp/tmpustg9p7w.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-18T13:13:45.402 INFO:teuthology.orchestra.run.smithi078.stdout: File "/tmp/tmpustg9p7w.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-18T13:13:45.402 INFO:teuthology.orchestra.run.smithi078.stdout: File "/tmp/tmpustg9p7w.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-18T13:13:45.402 INFO:teuthology.orchestra.run.smithi078.stdout: File "/tmp/tmpustg9p7w.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-18T13:13:45.402 INFO:teuthology.orchestra.run.smithi078.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 -e NODE_NAME=smithi148 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968:/var/run/ceph:z -v /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqlxzmntq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 inventory --format=json-pretty --filter-for-batch 2024-09-18T13:13:45.403 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:13:45.403 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:13:45.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.402+0000 7fb29cee1640 1 -- 172.21.15.78:0/2103674093 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb28007af30 msgr2=0x7fb28007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:45.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.402+0000 7fb29cee1640 1 --2- 172.21.15.78:0/2103674093 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb28007af30 0x7fb28007d3f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb28c031460 tx=0x7fb28c0095f0 comp rx=0 tx=0).stop 2024-09-18T13:13:45.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.402+0000 7fb29cee1640 1 -- 172.21.15.78:0/2103674093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb298100800 msgr2=0x7fb29819d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:13:45.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.402+0000 7fb29cee1640 1 --2- 172.21.15.78:0/2103674093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb298100800 0x7fb29819d6b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb28800b420 tx=0x7fb28800b8e0 comp rx=0 tx=0).stop 2024-09-18T13:13:45.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.402+0000 7fb29cee1640 1 -- 172.21.15.78:0/2103674093 shutdown_connections 2024-09-18T13:13:45.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.402+0000 7fb29cee1640 1 --2- 172.21.15.78:0/2103674093 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fb28007af30 0x7fb28007d3f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:45.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.402+0000 7fb29cee1640 1 --2- 172.21.15.78:0/2103674093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb298106800 0x7fb29819dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:45.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.402+0000 7fb29cee1640 1 --2- 172.21.15.78:0/2103674093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb298100800 0x7fb29819d6b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:13:45.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.402+0000 7fb29cee1640 1 -- 172.21.15.78:0/2103674093 >> 172.21.15.78:0/2103674093 conn(0x7fb2980fc520 msgr2=0x7fb29806a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:13:45.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.402+0000 7fb29cee1640 1 -- 172.21.15.78:0/2103674093 shutdown_connections 2024-09-18T13:13:45.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:13:45.402+0000 7fb29cee1640 1 -- 172.21.15.78:0/2103674093 wait complete. 2024-09-18T13:13:46.326 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:46 smithi078 ceph-mon[108578]: from='client.35192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:46.326 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:46 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2103674093' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:13:46.326 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:46 smithi078 ceph-mon[108578]: pgmap v739: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 350 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-09-18T13:13:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:46 smithi148 ceph-mon[80030]: from='client.35192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:13:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:46 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2103674093' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:13:46.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:46 smithi148 ceph-mon[80030]: pgmap v739: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 350 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-09-18T13:13:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:47 smithi078 ceph-mon[108578]: pgmap v740: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8.9 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-09-18T13:13:47.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:47 smithi148 ceph-mon[80030]: pgmap v740: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8.9 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-09-18T13:13:48.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:48 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:48.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:48 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:48.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:48 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:13:48.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:48 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:13:48.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:48 smithi078 ceph-mon[108578]: pgmap v741: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 9.5 KiB/s rd, 4.8 KiB/s wr, 11 op/s 2024-09-18T13:13:48.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:48 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:48.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:48 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:13:48.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:48 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:48.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:48 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:48.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:48 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:48.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:48 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:48.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:48 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:48.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:48 smithi078 ceph-mon[108578]: Upgrade: Setting filesystem cephfs Joinable 2024-09-18T13:13:48.994 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:48 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-18T13:13:49.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:48 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:49.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:48 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:49.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:48 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:13:49.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:48 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:13:49.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:48 smithi148 ceph-mon[80030]: pgmap v741: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 9.5 KiB/s rd, 4.8 KiB/s wr, 11 op/s 2024-09-18T13:13:49.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:48 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:49.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:48 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:13:49.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:48 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:49.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:48 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:49.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:48 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:49.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:48 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:49.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:48 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:49.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:48 smithi148 ceph-mon[80030]: Upgrade: Setting filesystem cephfs Joinable 2024-09-18T13:13:49.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:48 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-18T13:13:50.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-18T13:13:50.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-18T13:13:50.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:active} 2 up:standby 2024-09-18T13:13:50.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: Upgrade: Setting container_image for all ceph-exporter 2024-09-18T13:13:50.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:50.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi078"} : dispatch 2024-09-18T13:13:50.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi078"}]': finished 2024-09-18T13:13:50.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi148"} : dispatch 2024-09-18T13:13:50.225 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi148"}]': finished 2024-09-18T13:13:50.225 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.225 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: Upgrade: Setting container_image for all iscsi 2024-09-18T13:13:50.225 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:50.225 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.225 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: Upgrade: Setting container_image for all nfs 2024-09-18T13:13:50.225 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:50.225 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.225 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: Upgrade: Setting container_image for all nvmeof 2024-09-18T13:13:50.225 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:50.225 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.226 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.226 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.226 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.226 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.226 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.226 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: Upgrade: Finalizing container_image settings 2024-09-18T13:13:50.226 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-18T13:13:50.226 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-18T13:13:50.226 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.226 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-18T13:13:50.226 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-18T13:13:50.226 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-18T13:13:50.226 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-18T13:13:50.226 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-18T13:13:50.227 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-18T13:13:50.227 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-18T13:13:50.227 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-18T13:13:50.227 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-18T13:13:50.227 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-18T13:13:50.227 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-18T13:13:50.227 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.227 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-18T13:13:50.227 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-18T13:13:50.227 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-18T13:13:50.227 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-18T13:13:50.227 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-18T13:13:50.228 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-18T13:13:50.228 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-18T13:13:50.228 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-18T13:13:50.228 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.228 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.228 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.228 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.228 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.228 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.228 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: Upgrade: Complete! 2024-09-18T13:13:50.228 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-18T13:13:50.229 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-18T13:13:50.229 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:13:50.229 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:13:50.229 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:13:50.229 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:50.229 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:13:50.229 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:13:50.229 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:13:50.229 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:50.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-18T13:13:50.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-18T13:13:50.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: fsmap cephfs:2 {0=cephfs.smithi078.eakgoe=up:active,1=cephfs.smithi078.furyab=up:active} 2 up:standby 2024-09-18T13:13:50.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: Upgrade: Setting container_image for all ceph-exporter 2024-09-18T13:13:50.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:50.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi078"} : dispatch 2024-09-18T13:13:50.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi078"}]': finished 2024-09-18T13:13:50.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi148"} : dispatch 2024-09-18T13:13:50.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi148"}]': finished 2024-09-18T13:13:50.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.243 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: Upgrade: Setting container_image for all iscsi 2024-09-18T13:13:50.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:50.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: Upgrade: Setting container_image for all nfs 2024-09-18T13:13:50.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:50.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: Upgrade: Setting container_image for all nvmeof 2024-09-18T13:13:50.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:50.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.244 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:13:50.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: Upgrade: Finalizing container_image settings 2024-09-18T13:13:50.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-18T13:13:50.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-18T13:13:50.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-18T13:13:50.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-18T13:13:50.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-18T13:13:50.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-18T13:13:50.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-18T13:13:50.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-18T13:13:50.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-18T13:13:50.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-18T13:13:50.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-18T13:13:50.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-18T13:13:50.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-18T13:13:50.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-18T13:13:50.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-18T13:13:50.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-18T13:13:50.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-18T13:13:50.246 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-18T13:13:50.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-18T13:13:50.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-18T13:13:50.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-18T13:13:50.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:13:50.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: Upgrade: Complete! 2024-09-18T13:13:50.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-18T13:13:50.247 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-18T13:13:50.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:13:50.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:13:50.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:13:50.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:50.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:13:50.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:13:50.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:13:50.248 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:51.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:50 smithi148 ceph-mon[80030]: pgmap v742: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-09-18T13:13:51.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:50 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:51.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:50 smithi078 ceph-mon[108578]: pgmap v742: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-09-18T13:13:51.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:50 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:53.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:52 smithi148 ceph-mon[80030]: pgmap v743: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s wr, 2 op/s 2024-09-18T13:13:53.241 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:52 smithi078 ceph-mon[108578]: pgmap v743: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s wr, 2 op/s 2024-09-18T13:13:54.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:54 smithi078 ceph-mon[108578]: pgmap v744: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:55.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:54 smithi148 ceph-mon[80030]: pgmap v744: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:56.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:56.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:13:56.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:56 smithi148 ceph-mon[80030]: pgmap v745: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:56.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:13:56.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:13:56.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:56 smithi078 ceph-mon[108578]: pgmap v745: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:59.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:13:58 smithi148 ceph-mon[80030]: pgmap v746: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:13:59.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:13:58 smithi078 ceph-mon[108578]: pgmap v746: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:00.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:00 smithi078 ceph-mon[108578]: pgmap v747: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:01.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:00 smithi148 ceph-mon[80030]: pgmap v747: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:03.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:02 smithi148 ceph-mon[80030]: pgmap v748: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:03.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:02 smithi078 ceph-mon[108578]: pgmap v748: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:05.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:04 smithi148 ceph-mon[80030]: pgmap v749: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:05.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:04 smithi078 ceph-mon[108578]: pgmap v749: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:06.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:06 smithi078 ceph-mon[108578]: pgmap v750: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:07.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:06 smithi148 ceph-mon[80030]: pgmap v750: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:09.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:08 smithi148 ceph-mon[80030]: pgmap v751: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:09.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:08 smithi078 ceph-mon[108578]: pgmap v751: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:11.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:10 smithi148 ceph-mon[80030]: pgmap v752: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:11.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:10 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:14:11.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:10 smithi078 ceph-mon[108578]: pgmap v752: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:11.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:10 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:14:12.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:12 smithi078 ceph-mon[108578]: pgmap v753: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:13.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:12 smithi148 ceph-mon[80030]: pgmap v753: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:15.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:14 smithi148 ceph-mon[80030]: pgmap v754: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:15.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:14 smithi078 ceph-mon[108578]: pgmap v754: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:15.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.497+0000 7fc95cd7e640 1 -- 172.21.15.78:0/377474310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc958105860 msgr2=0x7fc958105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:15.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.497+0000 7fc95cd7e640 1 --2- 172.21.15.78:0/377474310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc958105860 0x7fc958105c40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009c20 tx=0x7fc94c02a970 comp rx=0 tx=0).stop 2024-09-18T13:14:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.497+0000 7fc95cd7e640 1 -- 172.21.15.78:0/377474310 shutdown_connections 2024-09-18T13:14:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.497+0000 7fc95cd7e640 1 --2- 172.21.15.78:0/377474310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc958101010 0x7fc958101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.497+0000 7fc95cd7e640 1 --2- 172.21.15.78:0/377474310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc958105860 0x7fc958105c40 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.497+0000 7fc95cd7e640 1 -- 172.21.15.78:0/377474310 >> 172.21.15.78:0/377474310 conn(0x7fc9580fbc90 msgr2=0x7fc9580fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.497+0000 7fc95cd7e640 1 -- 172.21.15.78:0/377474310 shutdown_connections 2024-09-18T13:14:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.497+0000 7fc95cd7e640 1 -- 172.21.15.78:0/377474310 wait complete. 2024-09-18T13:14:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.498+0000 7fc95cd7e640 1 Processor -- start 2024-09-18T13:14:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.498+0000 7fc95cd7e640 1 -- start start 2024-09-18T13:14:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.498+0000 7fc95cd7e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc958101010 0x7fc95819c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.498+0000 7fc95cd7e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc958105860 0x7fc95819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.498+0000 7fc95cd7e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc95810de40 con 0x7fc958105860 2024-09-18T13:14:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.498+0000 7fc95cd7e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc95810dcc0 con 0x7fc958101010 2024-09-18T13:14:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.498+0000 7fc955d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc958105860 0x7fc95819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.498+0000 7fc955d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc958105860 0x7fc95819cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35978/0 (socket says 172.21.15.78:35978) 2024-09-18T13:14:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.498+0000 7fc955d9b640 1 -- 172.21.15.78:0/106135832 learned_addr learned my addr 172.21.15.78:0/106135832 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:14:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.499+0000 7fc95659c640 1 --2- 172.21.15.78:0/106135832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc958101010 0x7fc95819c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.499+0000 7fc955d9b640 1 -- 172.21.15.78:0/106135832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc958101010 msgr2=0x7fc95819c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.499+0000 7fc955d9b640 1 --2- 172.21.15.78:0/106135832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc958101010 0x7fc95819c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.499+0000 7fc955d9b640 1 -- 172.21.15.78:0/106135832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc958196810 con 0x7fc958105860 2024-09-18T13:14:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.499+0000 7fc95659c640 1 --2- 172.21.15.78:0/106135832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc958101010 0x7fc95819c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:14:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.499+0000 7fc955d9b640 1 --2- 172.21.15.78:0/106135832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc958105860 0x7fc95819cbd0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc94800d6f0 tx=0x7fc94800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.499+0000 7fc9477fe640 1 -- 172.21.15.78:0/106135832 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc948017070 con 0x7fc958105860 2024-09-18T13:14:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.499+0000 7fc9477fe640 1 -- 172.21.15.78:0/106135832 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc94800de00 con 0x7fc958105860 2024-09-18T13:14:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.499+0000 7fc9477fe640 1 -- 172.21.15.78:0/106135832 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc948004bb0 con 0x7fc958105860 2024-09-18T13:14:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.499+0000 7fc95cd7e640 1 -- 172.21.15.78:0/106135832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc958196b00 con 0x7fc958105860 2024-09-18T13:14:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.499+0000 7fc95cd7e640 1 -- 172.21.15.78:0/106135832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc958197090 con 0x7fc958105860 2024-09-18T13:14:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.500+0000 7fc95cd7e640 1 -- 172.21.15.78:0/106135832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc958102020 con 0x7fc958105860 2024-09-18T13:14:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.501+0000 7fc9477fe640 1 -- 172.21.15.78:0/106135832 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc948009a30 con 0x7fc958105860 2024-09-18T13:14:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.501+0000 7fc9477fe640 1 --2- 172.21.15.78:0/106135832 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc94007af90 0x7fc94007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.502+0000 7fc9477fe640 1 -- 172.21.15.78:0/106135832 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fc94809dbd0 con 0x7fc958105860 2024-09-18T13:14:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.502+0000 7fc95659c640 1 --2- 172.21.15.78:0/106135832 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc94007af90 0x7fc94007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.502+0000 7fc95659c640 1 --2- 172.21.15.78:0/106135832 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc94007af90 0x7fc94007d450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009430 tx=0x7fc94c009380 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:15.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.506+0000 7fc9477fe640 1 -- 172.21.15.78:0/106135832 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc9480691f0 con 0x7fc958105860 2024-09-18T13:14:15.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.696+0000 7fc95cd7e640 1 -- 172.21.15.78:0/106135832 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc958197d40 con 0x7fc94007af90 2024-09-18T13:14:15.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.697+0000 7fc9477fe640 1 -- 172.21.15.78:0/106135832 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7fc958197d40 con 0x7fc94007af90 2024-09-18T13:14:15.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.699+0000 7fc95cd7e640 1 -- 172.21.15.78:0/106135832 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc94007af90 msgr2=0x7fc94007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:15.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.699+0000 7fc95cd7e640 1 --2- 172.21.15.78:0/106135832 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc94007af90 0x7fc94007d450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009430 tx=0x7fc94c009380 comp rx=0 tx=0).stop 2024-09-18T13:14:15.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.699+0000 7fc95cd7e640 1 -- 172.21.15.78:0/106135832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc958105860 msgr2=0x7fc95819cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:15.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.699+0000 7fc95cd7e640 1 --2- 172.21.15.78:0/106135832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc958105860 0x7fc95819cbd0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc94800d6f0 tx=0x7fc94800dbb0 comp rx=0 tx=0).stop 2024-09-18T13:14:15.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.699+0000 7fc95cd7e640 1 -- 172.21.15.78:0/106135832 shutdown_connections 2024-09-18T13:14:15.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.699+0000 7fc95cd7e640 1 --2- 172.21.15.78:0/106135832 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc94007af90 0x7fc94007d450 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:15.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.699+0000 7fc95cd7e640 1 --2- 172.21.15.78:0/106135832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc958105860 0x7fc95819cbd0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:15.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.699+0000 7fc95cd7e640 1 --2- 172.21.15.78:0/106135832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc958101010 0x7fc95819c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:15.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.699+0000 7fc95cd7e640 1 -- 172.21.15.78:0/106135832 >> 172.21.15.78:0/106135832 conn(0x7fc9580fbc90 msgr2=0x7fc9580fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:15.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.700+0000 7fc95cd7e640 1 -- 172.21.15.78:0/106135832 shutdown_connections 2024-09-18T13:14:15.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:15.700+0000 7fc95cd7e640 1 -- 172.21.15.78:0/106135832 wait complete. 2024-09-18T13:14:16.366 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch ps' 2024-09-18T13:14:16.658 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:14:17.043 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:16 smithi078 ceph-mon[108578]: from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:14:17.043 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:16 smithi078 ceph-mon[108578]: pgmap v755: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.123+0000 7f0d5e68d640 1 -- 172.21.15.78:0/4017925489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d581033e0 msgr2=0x7f0d5810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.123+0000 7f0d5e68d640 1 --2- 172.21.15.78:0/4017925489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d581033e0 0x7f0d5810b8d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009880 tx=0x7f0d4c02a530 comp rx=0 tx=0).stop 2024-09-18T13:14:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.123+0000 7f0d5e68d640 1 -- 172.21.15.78:0/4017925489 shutdown_connections 2024-09-18T13:14:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.123+0000 7f0d5e68d640 1 --2- 172.21.15.78:0/4017925489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d581033e0 0x7f0d5810b8d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.123+0000 7f0d5e68d640 1 --2- 172.21.15.78:0/4017925489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d58102ac0 0x7f0d58102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.123+0000 7f0d5e68d640 1 -- 172.21.15.78:0/4017925489 >> 172.21.15.78:0/4017925489 conn(0x7f0d580fc520 msgr2=0x7f0d580fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.123+0000 7f0d5e68d640 1 -- 172.21.15.78:0/4017925489 shutdown_connections 2024-09-18T13:14:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.123+0000 7f0d5e68d640 1 -- 172.21.15.78:0/4017925489 wait complete. 2024-09-18T13:14:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.123+0000 7f0d5e68d640 1 Processor -- start 2024-09-18T13:14:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.123+0000 7f0d5e68d640 1 -- start start 2024-09-18T13:14:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d5e68d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d58102ac0 0x7f0d5819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d5e68d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d581033e0 0x7f0d5819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d5e68d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5810ee50 con 0x7f0d581033e0 2024-09-18T13:14:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d5e68d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5810ecd0 con 0x7f0d58102ac0 2024-09-18T13:14:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d577fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d581033e0 0x7f0d5819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d577fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d581033e0 0x7f0d5819fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35984/0 (socket says 172.21.15.78:35984) 2024-09-18T13:14:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d577fe640 1 -- 172.21.15.78:0/869012485 learned_addr learned my addr 172.21.15.78:0/869012485 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:14:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d57fff640 1 --2- 172.21.15.78:0/869012485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d58102ac0 0x7f0d5819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d577fe640 1 -- 172.21.15.78:0/869012485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d58102ac0 msgr2=0x7f0d5819f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d577fe640 1 --2- 172.21.15.78:0/869012485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d58102ac0 0x7f0d5819f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d577fe640 1 -- 172.21.15.78:0/869012485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d58199a50 con 0x7f0d581033e0 2024-09-18T13:14:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d577fe640 1 --2- 172.21.15.78:0/869012485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d581033e0 0x7f0d5819fdd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c031460 tx=0x7f0d4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d557fa640 1 -- 172.21.15.78:0/869012485 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d4c03f070 con 0x7f0d581033e0 2024-09-18T13:14:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d557fa640 1 -- 172.21.15.78:0/869012485 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d4c004ac0 con 0x7f0d581033e0 2024-09-18T13:14:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d557fa640 1 -- 172.21.15.78:0/869012485 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d4c035030 con 0x7f0d581033e0 2024-09-18T13:14:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d5e68d640 1 -- 172.21.15.78:0/869012485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d58199ce0 con 0x7f0d581033e0 2024-09-18T13:14:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.124+0000 7f0d5e68d640 1 -- 172.21.15.78:0/869012485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5819a210 con 0x7f0d581033e0 2024-09-18T13:14:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.125+0000 7f0d5e68d640 1 -- 172.21.15.78:0/869012485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5806aa90 con 0x7f0d581033e0 2024-09-18T13:14:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.126+0000 7f0d557fa640 1 -- 172.21.15.78:0/869012485 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f0d4c042070 con 0x7f0d581033e0 2024-09-18T13:14:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.127+0000 7f0d557fa640 1 --2- 172.21.15.78:0/869012485 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0d4007af90 0x7f0d4007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.127+0000 7f0d57fff640 1 --2- 172.21.15.78:0/869012485 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0d4007af90 0x7f0d4007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.127+0000 7f0d557fa640 1 -- 172.21.15.78:0/869012485 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f0d4c0bea00 con 0x7f0d581033e0 2024-09-18T13:14:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.127+0000 7f0d57fff640 1 --2- 172.21.15.78:0/869012485 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0d4007af90 0x7f0d4007d450 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0d5819ab90 tx=0x7f0d48009110 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.131+0000 7f0d557fa640 1 -- 172.21.15.78:0/869012485 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f0d4c08a020 con 0x7f0d581033e0 2024-09-18T13:14:17.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:16 smithi148 ceph-mon[80030]: from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:14:17.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:16 smithi148 ceph-mon[80030]: pgmap v755: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:17.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.314+0000 7f0d5e68d640 1 -- 172.21.15.78:0/869012485 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0d5819af80 con 0x7f0d4007af90 2024-09-18T13:14:17.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.324+0000 7f0d557fa640 1 -- 172.21.15.78:0/869012485 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f0d5819af80 con 0x7f0d4007af90 2024-09-18T13:14:17.325 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:14:17.325 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (22m) 33s ago 33m 20.3M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:14:17.325 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (47s) 33s ago 33m 7856k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 27bed60b114c 2024-09-18T13:14:17.325 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (43s) 39s ago 32m 7239k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2ad07367d594 2024-09-18T13:14:17.325 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (20m) 33s ago 33m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:14:17.325 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (20m) 39s ago 32m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:14:17.326 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (21m) 33s ago 32m 76.3M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:14:17.326 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (16m) 33s ago 27m 86.2M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:14:17.326 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (16m) 33s ago 27m 21.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:14:17.326 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (16m) 39s ago 27m 20.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:14:17.326 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (15m) 39s ago 27m 23.0M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:14:17.326 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (24m) 33s ago 34m 531M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:14:17.326 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (23m) 39s ago 32m 462M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:14:17.326 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (20m) 33s ago 34m 69.2M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:14:17.326 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (20m) 39s ago 32m 52.0M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:14:17.326 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (22m) 33s ago 33m 11.5M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:14:17.326 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (22m) 39s ago 32m 12.3M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:14:17.326 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (19m) 33s ago 31m 98.1M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:14:17.326 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (19m) 33s ago 30m 103M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:14:17.326 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (18m) 33s ago 30m 90.0M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:14:17.327 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (18m) 39s ago 29m 105M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:14:17.327 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (17m) 39s ago 29m 94.0M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:14:17.327 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (16m) 39s ago 28m 91.4M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:14:17.327 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (22m) 33s ago 32m 69.6M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:14:17.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.326+0000 7f0d5e68d640 1 -- 172.21.15.78:0/869012485 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0d4007af90 msgr2=0x7f0d4007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:17.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.326+0000 7f0d5e68d640 1 --2- 172.21.15.78:0/869012485 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0d4007af90 0x7f0d4007d450 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0d5819ab90 tx=0x7f0d48009110 comp rx=0 tx=0).stop 2024-09-18T13:14:17.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.326+0000 7f0d5e68d640 1 -- 172.21.15.78:0/869012485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d581033e0 msgr2=0x7f0d5819fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:17.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.326+0000 7f0d5e68d640 1 --2- 172.21.15.78:0/869012485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d581033e0 0x7f0d5819fdd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c031460 tx=0x7f0d4c0046c0 comp rx=0 tx=0).stop 2024-09-18T13:14:17.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.326+0000 7f0d5e68d640 1 -- 172.21.15.78:0/869012485 shutdown_connections 2024-09-18T13:14:17.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.326+0000 7f0d5e68d640 1 --2- 172.21.15.78:0/869012485 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f0d4007af90 0x7f0d4007d450 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:17.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.326+0000 7f0d5e68d640 1 --2- 172.21.15.78:0/869012485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d581033e0 0x7f0d5819fdd0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:17.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.326+0000 7f0d5e68d640 1 --2- 172.21.15.78:0/869012485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d58102ac0 0x7f0d5819f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:17.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.326+0000 7f0d5e68d640 1 -- 172.21.15.78:0/869012485 >> 172.21.15.78:0/869012485 conn(0x7f0d580fc520 msgr2=0x7f0d58100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:17.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.326+0000 7f0d5e68d640 1 -- 172.21.15.78:0/869012485 shutdown_connections 2024-09-18T13:14:17.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:17.326+0000 7f0d5e68d640 1 -- 172.21.15.78:0/869012485 wait complete. 2024-09-18T13:14:18.034 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch upgrade status' 2024-09-18T13:14:18.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:17 smithi148 ceph-mon[80030]: from='client.35204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:14:18.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:17 smithi078 ceph-mon[108578]: from='client.35204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:14:18.296 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:14:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.748+0000 7f2d67eea640 1 -- 172.21.15.78:0/4063332688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d60106800 msgr2=0x7f2d60106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.748+0000 7f2d67eea640 1 --2- 172.21.15.78:0/4063332688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d60106800 0x7f2d60106be0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009c20 tx=0x7f2d5002a970 comp rx=0 tx=0).stop 2024-09-18T13:14:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.748+0000 7f2d67eea640 1 -- 172.21.15.78:0/4063332688 shutdown_connections 2024-09-18T13:14:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.748+0000 7f2d67eea640 1 --2- 172.21.15.78:0/4063332688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d60100800 0x7f2d60100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.748+0000 7f2d67eea640 1 --2- 172.21.15.78:0/4063332688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d60106800 0x7f2d60106be0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.748+0000 7f2d67eea640 1 -- 172.21.15.78:0/4063332688 >> 172.21.15.78:0/4063332688 conn(0x7f2d600fc520 msgr2=0x7f2d600fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.748+0000 7f2d67eea640 1 -- 172.21.15.78:0/4063332688 shutdown_connections 2024-09-18T13:14:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.748+0000 7f2d67eea640 1 -- 172.21.15.78:0/4063332688 wait complete. 2024-09-18T13:14:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.749+0000 7f2d67eea640 1 Processor -- start 2024-09-18T13:14:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.749+0000 7f2d67eea640 1 -- start start 2024-09-18T13:14:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.749+0000 7f2d67eea640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d60100800 0x7f2d601988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.749+0000 7f2d67eea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d60106800 0x7f2d60198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.749+0000 7f2d67eea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6010dd30 con 0x7f2d60106800 2024-09-18T13:14:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.749+0000 7f2d67eea640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6010dbb0 con 0x7f2d60100800 2024-09-18T13:14:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.749+0000 7f2d65485640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d60106800 0x7f2d60198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.749+0000 7f2d65485640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d60106800 0x7f2d60198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35996/0 (socket says 172.21.15.78:35996) 2024-09-18T13:14:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.749+0000 7f2d65485640 1 -- 172.21.15.78:0/588457800 learned_addr learned my addr 172.21.15.78:0/588457800 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:14:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.750+0000 7f2d65c86640 1 --2- 172.21.15.78:0/588457800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d60100800 0x7f2d601988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.750+0000 7f2d65485640 1 -- 172.21.15.78:0/588457800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d60100800 msgr2=0x7f2d601988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.750+0000 7f2d65485640 1 --2- 172.21.15.78:0/588457800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d60100800 0x7f2d601988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.750+0000 7f2d65485640 1 -- 172.21.15.78:0/588457800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d60199410 con 0x7f2d60106800 2024-09-18T13:14:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.750+0000 7f2d65485640 1 --2- 172.21.15.78:0/588457800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d60106800 0x7f2d60198e10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400b420 tx=0x7f2d5400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.750+0000 7f2d5effd640 1 -- 172.21.15.78:0/588457800 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d54011630 con 0x7f2d60106800 2024-09-18T13:14:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.750+0000 7f2d5effd640 1 -- 172.21.15.78:0/588457800 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2d54016070 con 0x7f2d60106800 2024-09-18T13:14:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.750+0000 7f2d67eea640 1 -- 172.21.15.78:0/588457800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d60199700 con 0x7f2d60106800 2024-09-18T13:14:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.750+0000 7f2d5effd640 1 -- 172.21.15.78:0/588457800 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d54010d40 con 0x7f2d60106800 2024-09-18T13:14:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.750+0000 7f2d67eea640 1 -- 172.21.15.78:0/588457800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d601a1d00 con 0x7f2d60106800 2024-09-18T13:14:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.751+0000 7f2d67eea640 1 -- 172.21.15.78:0/588457800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d60101f40 con 0x7f2d60106800 2024-09-18T13:14:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.752+0000 7f2d5effd640 1 -- 172.21.15.78:0/588457800 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2d5401b460 con 0x7f2d60106800 2024-09-18T13:14:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.752+0000 7f2d5effd640 1 --2- 172.21.15.78:0/588457800 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2d4807af30 0x7f2d4807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.752+0000 7f2d5effd640 1 -- 172.21.15.78:0/588457800 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f2d5409d7a0 con 0x7f2d60106800 2024-09-18T13:14:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.752+0000 7f2d65c86640 1 --2- 172.21.15.78:0/588457800 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2d4807af30 0x7f2d4807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.753+0000 7f2d65c86640 1 --2- 172.21.15.78:0/588457800 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2d4807af30 0x7f2d4807d3f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2d50006010 tx=0x7f2d50009380 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.757+0000 7f2d5effd640 1 -- 172.21.15.78:0/588457800 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2d60199700 con 0x7f2d60106800 2024-09-18T13:14:18.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.950+0000 7f2d67eea640 1 -- 172.21.15.78:0/588457800 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2d60062630 con 0x7f2d4807af30 2024-09-18T13:14:18.951 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:18 smithi078 ceph-mon[108578]: pgmap v756: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:18.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.951+0000 7f2d5effd640 1 -- 172.21.15.78:0/588457800 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f2d60062630 con 0x7f2d4807af30 2024-09-18T13:14:18.952 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:14:18.952 INFO:teuthology.orchestra.run.smithi078.stdout: "target_image": null, 2024-09-18T13:14:18.952 INFO:teuthology.orchestra.run.smithi078.stdout: "in_progress": false, 2024-09-18T13:14:18.952 INFO:teuthology.orchestra.run.smithi078.stdout: "which": "", 2024-09-18T13:14:18.952 INFO:teuthology.orchestra.run.smithi078.stdout: "services_complete": [], 2024-09-18T13:14:18.953 INFO:teuthology.orchestra.run.smithi078.stdout: "progress": null, 2024-09-18T13:14:18.953 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-18T13:14:18.953 INFO:teuthology.orchestra.run.smithi078.stdout: "is_paused": false 2024-09-18T13:14:18.953 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:14:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.953+0000 7f2d67eea640 1 -- 172.21.15.78:0/588457800 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2d4807af30 msgr2=0x7f2d4807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.953+0000 7f2d67eea640 1 --2- 172.21.15.78:0/588457800 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2d4807af30 0x7f2d4807d3f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2d50006010 tx=0x7f2d50009380 comp rx=0 tx=0).stop 2024-09-18T13:14:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.953+0000 7f2d67eea640 1 -- 172.21.15.78:0/588457800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d60106800 msgr2=0x7f2d60198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.953+0000 7f2d67eea640 1 --2- 172.21.15.78:0/588457800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d60106800 0x7f2d60198e10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400b420 tx=0x7f2d5400b8e0 comp rx=0 tx=0).stop 2024-09-18T13:14:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.953+0000 7f2d67eea640 1 -- 172.21.15.78:0/588457800 shutdown_connections 2024-09-18T13:14:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.953+0000 7f2d67eea640 1 --2- 172.21.15.78:0/588457800 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2d4807af30 0x7f2d4807d3f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.953+0000 7f2d67eea640 1 --2- 172.21.15.78:0/588457800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d60106800 0x7f2d60198e10 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.953+0000 7f2d67eea640 1 --2- 172.21.15.78:0/588457800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d60100800 0x7f2d601988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.953+0000 7f2d67eea640 1 -- 172.21.15.78:0/588457800 >> 172.21.15.78:0/588457800 conn(0x7f2d600fc520 msgr2=0x7f2d600fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:18.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.954+0000 7f2d67eea640 1 -- 172.21.15.78:0/588457800 shutdown_connections 2024-09-18T13:14:18.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:18.954+0000 7f2d67eea640 1 -- 172.21.15.78:0/588457800 wait complete. 2024-09-18T13:14:19.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:18 smithi148 ceph-mon[80030]: pgmap v756: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:19.540 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph health detail' 2024-09-18T13:14:19.788 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:14:20.173 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:19 smithi078 ceph-mon[108578]: from='client.35208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:14:20.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:19 smithi148 ceph-mon[80030]: from='client.35208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:14:20.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.252+0000 7f071e639640 1 -- 172.21.15.78:0/1861752031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07181067f0 msgr2=0x7f0718106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:20.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.252+0000 7f071e639640 1 --2- 172.21.15.78:0/1861752031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07181067f0 0x7f0718106bd0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0708009880 tx=0x7f070802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:14:20.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.253+0000 7f071e639640 1 -- 172.21.15.78:0/1861752031 shutdown_connections 2024-09-18T13:14:20.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.253+0000 7f071e639640 1 --2- 172.21.15.78:0/1861752031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07181007f0 0x7f0718100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:20.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.253+0000 7f071e639640 1 --2- 172.21.15.78:0/1861752031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07181067f0 0x7f0718106bd0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:20.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.253+0000 7f071e639640 1 -- 172.21.15.78:0/1861752031 >> 172.21.15.78:0/1861752031 conn(0x7f07180fc550 msgr2=0x7f07180fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:20.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.253+0000 7f071e639640 1 -- 172.21.15.78:0/1861752031 shutdown_connections 2024-09-18T13:14:20.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.253+0000 7f071e639640 1 -- 172.21.15.78:0/1861752031 wait complete. 2024-09-18T13:14:20.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.253+0000 7f071e639640 1 Processor -- start 2024-09-18T13:14:20.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.253+0000 7f071e639640 1 -- start start 2024-09-18T13:14:20.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f071e639640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07181007f0 0x7f07180fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:20.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f071e639640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07181067f0 0x7f07180fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:20.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f071e639640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f071810dd20 con 0x7f07181067f0 2024-09-18T13:14:20.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f071e639640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f071810dba0 con 0x7f07181007f0 2024-09-18T13:14:20.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f07177fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07181067f0 0x7f07180fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:20.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f07177fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07181067f0 0x7f07180fd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36028/0 (socket says 172.21.15.78:36028) 2024-09-18T13:14:20.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f07177fe640 1 -- 172.21.15.78:0/4121781216 learned_addr learned my addr 172.21.15.78:0/4121781216 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:14:20.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f0717fff640 1 --2- 172.21.15.78:0/4121781216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07181007f0 0x7f07180fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:20.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f07177fe640 1 -- 172.21.15.78:0/4121781216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07181007f0 msgr2=0x7f07180fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:20.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f07177fe640 1 --2- 172.21.15.78:0/4121781216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07181007f0 0x7f07180fcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:20.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f07177fe640 1 -- 172.21.15.78:0/4121781216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07180fd7a0 con 0x7f07181067f0 2024-09-18T13:14:20.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f07177fe640 1 --2- 172.21.15.78:0/4121781216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07181067f0 0x7f07180fd260 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f070c00b420 tx=0x7f070c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:20.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f07157fa640 1 -- 172.21.15.78:0/4121781216 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f070c011630 con 0x7f07181067f0 2024-09-18T13:14:20.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f07157fa640 1 -- 172.21.15.78:0/4121781216 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f070c016070 con 0x7f07181067f0 2024-09-18T13:14:20.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f071e639640 1 -- 172.21.15.78:0/4121781216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07180fda90 con 0x7f07181067f0 2024-09-18T13:14:20.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f07157fa640 1 -- 172.21.15.78:0/4121781216 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f070c010d40 con 0x7f07181067f0 2024-09-18T13:14:20.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.254+0000 7f071e639640 1 -- 172.21.15.78:0/4121781216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07181a3e80 con 0x7f07181067f0 2024-09-18T13:14:20.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.255+0000 7f071e639640 1 -- 172.21.15.78:0/4121781216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0718101f30 con 0x7f07181067f0 2024-09-18T13:14:20.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.256+0000 7f07157fa640 1 -- 172.21.15.78:0/4121781216 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f070c01b460 con 0x7f07181067f0 2024-09-18T13:14:20.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.257+0000 7f07157fa640 1 --2- 172.21.15.78:0/4121781216 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f070007af30 0x7f070007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:20.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.257+0000 7f07157fa640 1 -- 172.21.15.78:0/4121781216 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f070c09d8b0 con 0x7f07181067f0 2024-09-18T13:14:20.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.257+0000 7f0717fff640 1 --2- 172.21.15.78:0/4121781216 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f070007af30 0x7f070007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:20.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.257+0000 7f0717fff640 1 --2- 172.21.15.78:0/4121781216 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f070007af30 0x7f070007d3f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f07080096c0 tx=0x7f0708031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:20.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.261+0000 7f07157fa640 1 -- 172.21.15.78:0/4121781216 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f070c021250 con 0x7f07181067f0 2024-09-18T13:14:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.503+0000 7f071e639640 1 -- 172.21.15.78:0/4121781216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0718109d70 con 0x7f07181067f0 2024-09-18T13:14:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.504+0000 7f07157fa640 1 -- 172.21.15.78:0/4121781216 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f070c068db0 con 0x7f07181067f0 2024-09-18T13:14:20.505 INFO:teuthology.orchestra.run.smithi078.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T13:14:20.505 INFO:teuthology.orchestra.run.smithi078.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:14:20.505 INFO:teuthology.orchestra.run.smithi078.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:14:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.506+0000 7f071e639640 1 -- 172.21.15.78:0/4121781216 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f070007af30 msgr2=0x7f070007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.506+0000 7f071e639640 1 --2- 172.21.15.78:0/4121781216 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f070007af30 0x7f070007d3f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f07080096c0 tx=0x7f0708031400 comp rx=0 tx=0).stop 2024-09-18T13:14:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.506+0000 7f071e639640 1 -- 172.21.15.78:0/4121781216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07181067f0 msgr2=0x7f07180fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.506+0000 7f071e639640 1 --2- 172.21.15.78:0/4121781216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07181067f0 0x7f07180fd260 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f070c00b420 tx=0x7f070c00b8e0 comp rx=0 tx=0).stop 2024-09-18T13:14:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.506+0000 7f071e639640 1 -- 172.21.15.78:0/4121781216 shutdown_connections 2024-09-18T13:14:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.506+0000 7f071e639640 1 --2- 172.21.15.78:0/4121781216 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f070007af30 0x7f070007d3f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.506+0000 7f071e639640 1 --2- 172.21.15.78:0/4121781216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07181067f0 0x7f07180fd260 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.506+0000 7f071e639640 1 --2- 172.21.15.78:0/4121781216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07181007f0 0x7f07180fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.506+0000 7f071e639640 1 -- 172.21.15.78:0/4121781216 >> 172.21.15.78:0/4121781216 conn(0x7f07180fc550 msgr2=0x7f0718069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.506+0000 7f071e639640 1 -- 172.21.15.78:0/4121781216 shutdown_connections 2024-09-18T13:14:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:20.506+0000 7f071e639640 1 -- 172.21.15.78:0/4121781216 wait complete. 2024-09-18T13:14:21.219 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:20 smithi078 ceph-mon[108578]: pgmap v757: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:21.219 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:20 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/4121781216' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:14:21.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:20 smithi148 ceph-mon[80030]: pgmap v757: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:21.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:20 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/4121781216' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:14:21.246 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions' 2024-09-18T13:14:21.494 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:14:21.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.925+0000 7f3ac8605640 1 -- 172.21.15.78:0/1854549194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac01067f0 msgr2=0x7f3ac0106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:21.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.925+0000 7f3ac8605640 1 --2- 172.21.15.78:0/1854549194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac01067f0 0x7f3ac0106bd0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009880 tx=0x7f3ab402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:14:21.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.925+0000 7f3ac8605640 1 -- 172.21.15.78:0/1854549194 shutdown_connections 2024-09-18T13:14:21.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.925+0000 7f3ac8605640 1 --2- 172.21.15.78:0/1854549194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ac01007f0 0x7f3ac0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:21.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.925+0000 7f3ac8605640 1 --2- 172.21.15.78:0/1854549194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac01067f0 0x7f3ac0106bd0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:21.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.925+0000 7f3ac8605640 1 -- 172.21.15.78:0/1854549194 >> 172.21.15.78:0/1854549194 conn(0x7f3ac00fc550 msgr2=0x7f3ac00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:21.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.925+0000 7f3ac8605640 1 -- 172.21.15.78:0/1854549194 shutdown_connections 2024-09-18T13:14:21.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.925+0000 7f3ac8605640 1 -- 172.21.15.78:0/1854549194 wait complete. 2024-09-18T13:14:21.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.926+0000 7f3ac8605640 1 Processor -- start 2024-09-18T13:14:21.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.926+0000 7f3ac8605640 1 -- start start 2024-09-18T13:14:21.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.926+0000 7f3ac8605640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ac01007f0 0x7f3ac019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:21.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.926+0000 7f3ac8605640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac01067f0 0x7f3ac019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:21.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.926+0000 7f3ac8605640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac010dca0 con 0x7f3ac01067f0 2024-09-18T13:14:21.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.926+0000 7f3ac8605640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac010db20 con 0x7f3ac01007f0 2024-09-18T13:14:21.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.926+0000 7f3ac5ba0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac01067f0 0x7f3ac019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:21.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.926+0000 7f3ac5ba0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac01067f0 0x7f3ac019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34512/0 (socket says 172.21.15.78:34512) 2024-09-18T13:14:21.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.926+0000 7f3ac5ba0640 1 -- 172.21.15.78:0/1032687465 learned_addr learned my addr 172.21.15.78:0/1032687465 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:14:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.927+0000 7f3ac63a1640 1 --2- 172.21.15.78:0/1032687465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ac01007f0 0x7f3ac019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.927+0000 7f3ac5ba0640 1 -- 172.21.15.78:0/1032687465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ac01007f0 msgr2=0x7f3ac019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.927+0000 7f3ac5ba0640 1 --2- 172.21.15.78:0/1032687465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ac01007f0 0x7f3ac019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.927+0000 7f3ac5ba0640 1 -- 172.21.15.78:0/1032687465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac0197750 con 0x7f3ac01067f0 2024-09-18T13:14:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.927+0000 7f3ac5ba0640 1 --2- 172.21.15.78:0/1032687465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac01067f0 0x7f3ac019dbc0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00c8a0 tx=0x7f3abc00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.927+0000 7f3ab37fe640 1 -- 172.21.15.78:0/1032687465 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3abc0079b0 con 0x7f3ac01067f0 2024-09-18T13:14:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.927+0000 7f3ab37fe640 1 -- 172.21.15.78:0/1032687465 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3abc007b50 con 0x7f3ac01067f0 2024-09-18T13:14:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.927+0000 7f3ac8605640 1 -- 172.21.15.78:0/1032687465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac0197a40 con 0x7f3ac01067f0 2024-09-18T13:14:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.927+0000 7f3ab37fe640 1 -- 172.21.15.78:0/1032687465 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3abc018700 con 0x7f3ac01067f0 2024-09-18T13:14:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.927+0000 7f3ac8605640 1 -- 172.21.15.78:0/1032687465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac0197fd0 con 0x7f3ac01067f0 2024-09-18T13:14:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.928+0000 7f3ac8605640 1 -- 172.21.15.78:0/1032687465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac0101f30 con 0x7f3ac01067f0 2024-09-18T13:14:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.929+0000 7f3ab37fe640 1 -- 172.21.15.78:0/1032687465 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3abc007d00 con 0x7f3ac01067f0 2024-09-18T13:14:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.929+0000 7f3ab37fe640 1 --2- 172.21.15.78:0/1032687465 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3aac07af30 0x7f3aac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:14:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.930+0000 7f3ac63a1640 1 --2- 172.21.15.78:0/1032687465 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3aac07af30 0x7f3aac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:14:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.930+0000 7f3ab37fe640 1 -- 172.21.15.78:0/1032687465 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f3abc09e370 con 0x7f3ac01067f0 2024-09-18T13:14:21.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.930+0000 7f3ac63a1640 1 --2- 172.21.15.78:0/1032687465 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3aac07af30 0x7f3aac07d3f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4031460 tx=0x7f3ab4009560 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:14:21.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:21.934+0000 7f3ab37fe640 1 -- 172.21.15.78:0/1032687465 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3abc014030 con 0x7f3ac01067f0 2024-09-18T13:14:22.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:22.177+0000 7f3ac8605640 1 -- 172.21.15.78:0/1032687465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3ac01982e0 con 0x7f3ac01067f0 2024-09-18T13:14:22.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:22.177+0000 7f3ab37fe640 1 -- 172.21.15.78:0/1032687465 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f3abc069910 con 0x7f3ac01067f0 2024-09-18T13:14:22.178 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:14:22.179 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:14:22.179 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:14:22.179 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:14:22.179 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:14:22.179 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:14:22.179 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:14:22.179 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:14:22.179 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:14:22.179 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:14:22.179 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:14:22.179 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:14:22.179 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:14:22.179 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:14:22.179 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:14:22.179 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:14:22.180 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:14:22.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:22.180+0000 7f3ac8605640 1 -- 172.21.15.78:0/1032687465 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3aac07af30 msgr2=0x7f3aac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:22.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:22.180+0000 7f3ac8605640 1 --2- 172.21.15.78:0/1032687465 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3aac07af30 0x7f3aac07d3f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4031460 tx=0x7f3ab4009560 comp rx=0 tx=0).stop 2024-09-18T13:14:22.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:22.180+0000 7f3ac8605640 1 -- 172.21.15.78:0/1032687465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac01067f0 msgr2=0x7f3ac019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:14:22.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:22.180+0000 7f3ac8605640 1 --2- 172.21.15.78:0/1032687465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac01067f0 0x7f3ac019dbc0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00c8a0 tx=0x7f3abc00cd60 comp rx=0 tx=0).stop 2024-09-18T13:14:22.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:22.180+0000 7f3ac8605640 1 -- 172.21.15.78:0/1032687465 shutdown_connections 2024-09-18T13:14:22.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:22.180+0000 7f3ac8605640 1 --2- 172.21.15.78:0/1032687465 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f3aac07af30 0x7f3aac07d3f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:22.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:22.180+0000 7f3ac8605640 1 --2- 172.21.15.78:0/1032687465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac01067f0 0x7f3ac019dbc0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:22.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:22.180+0000 7f3ac8605640 1 --2- 172.21.15.78:0/1032687465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ac01007f0 0x7f3ac019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:14:22.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:22.180+0000 7f3ac8605640 1 -- 172.21.15.78:0/1032687465 >> 172.21.15.78:0/1032687465 conn(0x7f3ac00fc550 msgr2=0x7f3ac0069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:14:22.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:22.180+0000 7f3ac8605640 1 -- 172.21.15.78:0/1032687465 shutdown_connections 2024-09-18T13:14:22.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:14:22.180+0000 7f3ac8605640 1 -- 172.21.15.78:0/1032687465 wait complete. 2024-09-18T13:14:22.837 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-18T13:14:22.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:22 smithi078 ceph-mon[108578]: pgmap v758: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:22.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:22 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1032687465' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:14:23.087 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:14:23.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:22 smithi148 ceph-mon[80030]: pgmap v758: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:23.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:22 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1032687465' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:14:23.554 INFO:teuthology.orchestra.run.smithi078.stdout:wait for servicemap items w/ changing names to refresh 2024-09-18T13:14:24.238 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'sleep 60' 2024-09-18T13:14:24.484 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:14:25.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:24 smithi148 ceph-mon[80030]: pgmap v759: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:25.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:24 smithi078 ceph-mon[108578]: pgmap v759: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:26.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:25 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:14:26.241 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:25 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:14:27.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:26 smithi148 ceph-mon[80030]: pgmap v760: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:27.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:26 smithi078 ceph-mon[108578]: pgmap v760: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:28.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:28 smithi078 ceph-mon[108578]: pgmap v761: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:29.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:28 smithi148 ceph-mon[80030]: pgmap v761: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:30.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:30 smithi078 ceph-mon[108578]: pgmap v762: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:31.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:30 smithi148 ceph-mon[80030]: pgmap v762: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:33.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:32 smithi148 ceph-mon[80030]: pgmap v763: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:33.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:32 smithi078 ceph-mon[108578]: pgmap v763: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:35.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:34 smithi148 ceph-mon[80030]: pgmap v764: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:35.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:34 smithi078 ceph-mon[108578]: pgmap v764: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:36.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:36 smithi078 ceph-mon[108578]: pgmap v765: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:37.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:36 smithi148 ceph-mon[80030]: pgmap v765: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:39.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:38 smithi148 ceph-mon[80030]: pgmap v766: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:39.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:38 smithi078 ceph-mon[108578]: pgmap v766: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:40.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:40 smithi148 ceph-mon[80030]: pgmap v767: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:40.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:40 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:14:41.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:40 smithi078 ceph-mon[108578]: pgmap v767: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:41.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:40 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:14:42.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:42 smithi078 ceph-mon[108578]: pgmap v768: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:43.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:42 smithi148 ceph-mon[80030]: pgmap v768: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:45.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:44 smithi148 ceph-mon[80030]: pgmap v769: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:45.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:44 smithi078 ceph-mon[108578]: pgmap v769: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:47.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:46 smithi148 ceph-mon[80030]: pgmap v770: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:47.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:46 smithi078 ceph-mon[108578]: pgmap v770: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:48.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:48 smithi078 ceph-mon[108578]: pgmap v771: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:49.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:48 smithi148 ceph-mon[80030]: pgmap v771: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:50.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:14:50.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:14:50.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:14:50.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:49 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:14:50.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:14:50.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:14:50.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:14:50.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:49 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:14:51.709 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:51 smithi078 ceph-mon[108578]: pgmap v772: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:51.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:51 smithi148 ceph-mon[80030]: pgmap v772: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:53.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:53 smithi148 ceph-mon[80030]: pgmap v773: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:53.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:53 smithi078 ceph-mon[108578]: pgmap v773: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:55.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:55 smithi148 ceph-mon[80030]: pgmap v774: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:55 smithi078 ceph-mon[108578]: pgmap v774: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:56.714 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:14:56.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:14:57.712 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:57 smithi078 ceph-mon[108578]: pgmap v775: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:57 smithi148 ceph-mon[80030]: pgmap v775: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:14:59 smithi148 ceph-mon[80030]: pgmap v776: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:14:59.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:14:59 smithi078 ceph-mon[108578]: pgmap v776: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:01.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:01 smithi148 ceph-mon[80030]: pgmap v777: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:01.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:01 smithi078 ceph-mon[108578]: pgmap v777: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:03.708 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:03 smithi078 ceph-mon[108578]: pgmap v778: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:03.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:03 smithi148 ceph-mon[80030]: pgmap v778: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:05.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:05 smithi148 ceph-mon[80030]: pgmap v779: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:05.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:05 smithi078 ceph-mon[108578]: pgmap v779: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:07.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:07 smithi148 ceph-mon[80030]: pgmap v780: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:07.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:07 smithi078 ceph-mon[108578]: pgmap v780: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:09.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:09 smithi148 ceph-mon[80030]: pgmap v781: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:09.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:09 smithi078 ceph-mon[108578]: pgmap v781: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:11 smithi148 ceph-mon[80030]: pgmap v782: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:15:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:11 smithi078 ceph-mon[108578]: pgmap v782: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:15:13.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:13 smithi148 ceph-mon[80030]: pgmap v783: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:13.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:13 smithi078 ceph-mon[108578]: pgmap v783: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:15.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:15 smithi078 ceph-mon[108578]: pgmap v784: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:15 smithi148 ceph-mon[80030]: pgmap v784: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:17.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:17 smithi078 ceph-mon[108578]: pgmap v785: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:17.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:17 smithi148 ceph-mon[80030]: pgmap v785: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:19.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:19 smithi078 ceph-mon[108578]: pgmap v786: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:19.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:19 smithi148 ceph-mon[80030]: pgmap v786: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:21.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:21 smithi148 ceph-mon[80030]: pgmap v787: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:21.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:21 smithi078 ceph-mon[108578]: pgmap v787: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:23.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:23 smithi078 ceph-mon[108578]: pgmap v788: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:23.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:23 smithi148 ceph-mon[80030]: pgmap v788: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:25.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch ps' 2024-09-18T13:15:25.736 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:25.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:25 smithi078 ceph-mon[108578]: pgmap v789: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:25.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:25 smithi148 ceph-mon[80030]: pgmap v789: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:26.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.189+0000 7f2952592640 1 -- 172.21.15.78:0/526003250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f294c100d70 msgr2=0x7f294c1065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.189+0000 7f2952592640 1 --2- 172.21.15.78:0/526003250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f294c100d70 0x7f294c1065c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2940009880 tx=0x7f294002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.190+0000 7f2952592640 1 -- 172.21.15.78:0/526003250 shutdown_connections 2024-09-18T13:15:26.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.190+0000 7f2952592640 1 --2- 172.21.15.78:0/526003250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f294c100d70 0x7f294c1065c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.190+0000 7f2952592640 1 --2- 172.21.15.78:0/526003250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f294c1003c0 0x7f294c1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.190+0000 7f2952592640 1 -- 172.21.15.78:0/526003250 >> 172.21.15.78:0/526003250 conn(0x7f294c077150 msgr2=0x7f294c077560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:26.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.190+0000 7f2952592640 1 -- 172.21.15.78:0/526003250 shutdown_connections 2024-09-18T13:15:26.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.190+0000 7f2952592640 1 -- 172.21.15.78:0/526003250 wait complete. 2024-09-18T13:15:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.190+0000 7f2952592640 1 Processor -- start 2024-09-18T13:15:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.190+0000 7f2952592640 1 -- start start 2024-09-18T13:15:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f2952592640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f294c1003c0 0x7f294c101340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f2952592640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f294c100d70 0x7f294c101880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f2952592640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f294c10eda0 con 0x7f294c1003c0 2024-09-18T13:15:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f2952592640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f294c10ec20 con 0x7f294c100d70 2024-09-18T13:15:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f294bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f294c1003c0 0x7f294c101340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f294bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f294c1003c0 0x7f294c101340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39154/0 (socket says 172.21.15.78:39154) 2024-09-18T13:15:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f294bfff640 1 -- 172.21.15.78:0/1317288175 learned_addr learned my addr 172.21.15.78:0/1317288175 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f294b7fe640 1 --2- 172.21.15.78:0/1317288175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f294c100d70 0x7f294c101880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f294bfff640 1 -- 172.21.15.78:0/1317288175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f294c100d70 msgr2=0x7f294c101880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f294bfff640 1 --2- 172.21.15.78:0/1317288175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f294c100d70 0x7f294c101880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f294bfff640 1 -- 172.21.15.78:0/1317288175 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294c101dc0 con 0x7f294c1003c0 2024-09-18T13:15:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f294bfff640 1 --2- 172.21.15.78:0/1317288175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f294c1003c0 0x7f294c101340 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f293c00c810 tx=0x7f293c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f29497fa640 1 -- 172.21.15.78:0/1317288175 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f293c004020 con 0x7f294c1003c0 2024-09-18T13:15:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f29497fa640 1 -- 172.21.15.78:0/1317288175 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f293c0041c0 con 0x7f294c1003c0 2024-09-18T13:15:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f29497fa640 1 -- 172.21.15.78:0/1317288175 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f293c0047a0 con 0x7f294c1003c0 2024-09-18T13:15:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f2952592640 1 -- 172.21.15.78:0/1317288175 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f294c1020b0 con 0x7f294c1003c0 2024-09-18T13:15:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.191+0000 7f2952592640 1 -- 172.21.15.78:0/1317288175 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f294c1a3df0 con 0x7f294c1003c0 2024-09-18T13:15:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.192+0000 7f2952592640 1 -- 172.21.15.78:0/1317288175 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f294c069d90 con 0x7f294c1003c0 2024-09-18T13:15:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.193+0000 7f29497fa640 1 -- 172.21.15.78:0/1317288175 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f293c0079b0 con 0x7f294c1003c0 2024-09-18T13:15:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.193+0000 7f29497fa640 1 --2- 172.21.15.78:0/1317288175 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f293407af30 0x7f293407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.194+0000 7f29497fa640 1 -- 172.21.15.78:0/1317288175 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f293c09dff0 con 0x7f294c1003c0 2024-09-18T13:15:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.194+0000 7f294b7fe640 1 --2- 172.21.15.78:0/1317288175 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f293407af30 0x7f293407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.194+0000 7f294b7fe640 1 --2- 172.21.15.78:0/1317288175 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f293407af30 0x7f293407d3f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2940000c00 tx=0x7f2940031420 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:26.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.198+0000 7f29497fa640 1 -- 172.21.15.78:0/1317288175 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f293c014030 con 0x7f294c1003c0 2024-09-18T13:15:26.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.381+0000 7f2952592640 1 -- 172.21.15.78:0/1317288175 --> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f294c109f30 con 0x7f293407af30 2024-09-18T13:15:26.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.391+0000 7f29497fa640 1 -- 172.21.15.78:0/1317288175 <== mgr.14770 v2:172.21.15.78:6800/2800506880 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f29400042c0 con 0x7f293407af30 2024-09-18T13:15:26.392 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:15:26.393 INFO:teuthology.orchestra.run.smithi078.stdout:alertmanager.smithi078 smithi078 *:9093,9094 running (23m) 102s ago 34m 20.3M - 0.27.0 11f11916f8cd 61fff5bc08f2 2024-09-18T13:15:26.393 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi078 smithi078 running (116s) 102s ago 34m 7856k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 27bed60b114c 2024-09-18T13:15:26.393 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-exporter.smithi148 smithi148 running (112s) 108s ago 33m 7239k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2ad07367d594 2024-09-18T13:15:26.393 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi078 smithi078 running (21m) 102s ago 34m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 70a38f213b4d 2024-09-18T13:15:26.393 INFO:teuthology.orchestra.run.smithi078.stdout:crash.smithi148 smithi148 running (21m) 108s ago 33m 6895k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1aaa87ba8400 2024-09-18T13:15:26.393 INFO:teuthology.orchestra.run.smithi078.stdout:grafana.smithi078 smithi078 *:3000 running (22m) 102s ago 34m 76.3M - 10.4.0 c8b91775d855 d8b81262366f 2024-09-18T13:15:26.393 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.eakgoe smithi078 running (17m) 102s ago 28m 86.2M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4c5c457e70c5 2024-09-18T13:15:26.393 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi078.furyab smithi078 running (17m) 102s ago 28m 21.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9fcc282099ad 2024-09-18T13:15:26.393 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.fqecmm smithi148 running (17m) 108s ago 28m 20.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 2b273faf4f2b 2024-09-18T13:15:26.393 INFO:teuthology.orchestra.run.smithi078.stdout:mds.cephfs.smithi148.tvvouo smithi148 running (17m) 108s ago 28m 23.0M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 95b05d14c009 2024-09-18T13:15:26.393 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi078.ohifux smithi078 *:8443,9283,8765 running (25m) 102s ago 35m 531M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 bfab2c4239d6 2024-09-18T13:15:26.393 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.smithi148.bfgshs smithi148 *:8443,9283,8765 running (24m) 108s ago 33m 462M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 68f661c8a866 2024-09-18T13:15:26.394 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi078 smithi078 running (21m) 102s ago 35m 69.2M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f62f02a2a5d3 2024-09-18T13:15:26.394 INFO:teuthology.orchestra.run.smithi078.stdout:mon.smithi148 smithi148 running (21m) 108s ago 33m 52.0M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 88906a6c2abc 2024-09-18T13:15:26.394 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi078 smithi078 *:9100 running (24m) 102s ago 34m 11.5M - 1.7.0 72c9c2088986 04524e831f27 2024-09-18T13:15:26.394 INFO:teuthology.orchestra.run.smithi078.stdout:node-exporter.smithi148 smithi148 *:9100 running (23m) 108s ago 33m 12.3M - 1.7.0 72c9c2088986 b249dedc2bea 2024-09-18T13:15:26.394 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (21m) 102s ago 32m 98.1M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4aad8c6ec439 2024-09-18T13:15:26.394 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi078 running (20m) 102s ago 31m 103M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 407cc1be36c1 2024-09-18T13:15:26.394 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi078 running (19m) 102s ago 31m 90.0M 1216M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c74b9bc9ce72 2024-09-18T13:15:26.394 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi148 running (19m) 108s ago 30m 105M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 084fd12e1890 2024-09-18T13:15:26.394 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi148 running (18m) 108s ago 30m 94.0M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 da0a51763e0c 2024-09-18T13:15:26.394 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi148 running (18m) 108s ago 29m 91.4M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 aed13dbdc252 2024-09-18T13:15:26.394 INFO:teuthology.orchestra.run.smithi078.stdout:prometheus.smithi078 smithi078 *:9095 running (23m) 102s ago 33m 69.6M - 2.51.0 1d3b7f56885b 9bf0f11667d8 2024-09-18T13:15:26.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.393+0000 7f2952592640 1 -- 172.21.15.78:0/1317288175 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f293407af30 msgr2=0x7f293407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.393+0000 7f2952592640 1 --2- 172.21.15.78:0/1317288175 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f293407af30 0x7f293407d3f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2940000c00 tx=0x7f2940031420 comp rx=0 tx=0).stop 2024-09-18T13:15:26.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.393+0000 7f2952592640 1 -- 172.21.15.78:0/1317288175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f294c1003c0 msgr2=0x7f294c101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:26.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.393+0000 7f2952592640 1 --2- 172.21.15.78:0/1317288175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f294c1003c0 0x7f294c101340 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f293c00c810 tx=0x7f293c00ccd0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.394+0000 7f2952592640 1 -- 172.21.15.78:0/1317288175 shutdown_connections 2024-09-18T13:15:26.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.394+0000 7f2952592640 1 --2- 172.21.15.78:0/1317288175 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f293407af30 0x7f293407d3f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.394+0000 7f2952592640 1 --2- 172.21.15.78:0/1317288175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f294c100d70 0x7f294c101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.394+0000 7f2952592640 1 --2- 172.21.15.78:0/1317288175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f294c1003c0 0x7f294c101340 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:26.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.394+0000 7f2952592640 1 -- 172.21.15.78:0/1317288175 >> 172.21.15.78:0/1317288175 conn(0x7f294c077150 msgr2=0x7f294c0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:26.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.394+0000 7f2952592640 1 -- 172.21.15.78:0/1317288175 shutdown_connections 2024-09-18T13:15:26.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:26.394+0000 7f2952592640 1 -- 172.21.15.78:0/1317288175 wait complete. 2024-09-18T13:15:26.672 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:15:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:15:27.067 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions' 2024-09-18T13:15:27.327 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:27.591 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:27 smithi078 ceph-mon[108578]: pgmap v790: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:27.591 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:27 smithi078 ceph-mon[108578]: from='client.35220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:15:27.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.804+0000 7f370ac1c640 1 -- 172.21.15.78:0/2307431819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3704106800 msgr2=0x7f3704106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.804+0000 7f370ac1c640 1 --2- 172.21.15.78:0/2307431819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3704106800 0x7f3704106be0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009880 tx=0x7f36f802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.804+0000 7f370ac1c640 1 -- 172.21.15.78:0/2307431819 shutdown_connections 2024-09-18T13:15:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.804+0000 7f370ac1c640 1 --2- 172.21.15.78:0/2307431819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3704100800 0x7f3704100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.804+0000 7f370ac1c640 1 --2- 172.21.15.78:0/2307431819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3704106800 0x7f3704106be0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.804+0000 7f370ac1c640 1 -- 172.21.15.78:0/2307431819 >> 172.21.15.78:0/2307431819 conn(0x7f37040fc520 msgr2=0x7f37040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.804+0000 7f370ac1c640 1 -- 172.21.15.78:0/2307431819 shutdown_connections 2024-09-18T13:15:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.804+0000 7f370ac1c640 1 -- 172.21.15.78:0/2307431819 wait complete. 2024-09-18T13:15:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.805+0000 7f370ac1c640 1 Processor -- start 2024-09-18T13:15:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.805+0000 7f370ac1c640 1 -- start start 2024-09-18T13:15:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.805+0000 7f370ac1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3704100800 0x7f3704107730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.805+0000 7f370ac1c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3704106800 0x7f3704107c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.805+0000 7f370ac1c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f370410dcb0 con 0x7f3704100800 2024-09-18T13:15:27.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.805+0000 7f370ac1c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f370410db30 con 0x7f3704106800 2024-09-18T13:15:27.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.805+0000 7f37089b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3704100800 0x7f3704107730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:27.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.805+0000 7f37089b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3704100800 0x7f3704107730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39172/0 (socket says 172.21.15.78:39172) 2024-09-18T13:15:27.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.805+0000 7f37089b8640 1 -- 172.21.15.78:0/3135523875 learned_addr learned my addr 172.21.15.78:0/3135523875 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:27.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.806+0000 7f37089b8640 1 -- 172.21.15.78:0/3135523875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3704106800 msgr2=0x7f3704107c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:27.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.806+0000 7f37089b8640 1 --2- 172.21.15.78:0/3135523875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3704106800 0x7f3704107c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:27.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.806+0000 7f37089b8640 1 -- 172.21.15.78:0/3135523875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37041081b0 con 0x7f3704100800 2024-09-18T13:15:27.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.806+0000 7f37089b8640 1 --2- 172.21.15.78:0/3135523875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3704100800 0x7f3704107730 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f36f8031460 tx=0x7f36f80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.806+0000 7f3701ffb640 1 -- 172.21.15.78:0/3135523875 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36f803f070 con 0x7f3704100800 2024-09-18T13:15:27.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.806+0000 7f3701ffb640 1 -- 172.21.15.78:0/3135523875 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36f8004cf0 con 0x7f3704100800 2024-09-18T13:15:27.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.806+0000 7f370ac1c640 1 -- 172.21.15.78:0/3135523875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3704108440 con 0x7f3704100800 2024-09-18T13:15:27.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.806+0000 7f3701ffb640 1 -- 172.21.15.78:0/3135523875 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36f8035030 con 0x7f3704100800 2024-09-18T13:15:27.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.806+0000 7f370ac1c640 1 -- 172.21.15.78:0/3135523875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37041a3d30 con 0x7f3704100800 2024-09-18T13:15:27.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.807+0000 7f370ac1c640 1 -- 172.21.15.78:0/3135523875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3704101f40 con 0x7f3704100800 2024-09-18T13:15:27.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.808+0000 7f3701ffb640 1 -- 172.21.15.78:0/3135523875 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f36f8042070 con 0x7f3704100800 2024-09-18T13:15:27.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.808+0000 7f3701ffb640 1 --2- 172.21.15.78:0/3135523875 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f36f407af30 0x7f36f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:27.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.808+0000 7f3701ffb640 1 -- 172.21.15.78:0/3135523875 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f36f80beaf0 con 0x7f3704100800 2024-09-18T13:15:27.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.809+0000 7f3703fff640 1 --2- 172.21.15.78:0/3135523875 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f36f407af30 0x7f36f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.809+0000 7f3703fff640 1 --2- 172.21.15.78:0/3135523875 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f36f407af30 0x7f36f407d3f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f37041091c0 tx=0x7f36f0005c70 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:27.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:27.813+0000 7f3701ffb640 1 -- 172.21.15.78:0/3135523875 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f36f808a090 con 0x7f3704100800 2024-09-18T13:15:27.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:27 smithi148 ceph-mon[80030]: pgmap v790: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:27.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:27 smithi148 ceph-mon[80030]: from='client.35220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:15:28.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:28.057+0000 7f370ac1c640 1 -- 172.21.15.78:0/3135523875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f37041a3f90 con 0x7f3704100800 2024-09-18T13:15:28.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:28.057+0000 7f3701ffb640 1 -- 172.21.15.78:0/3135523875 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f36f808ef40 con 0x7f3704100800 2024-09-18T13:15:28.059 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-18T13:15:28.059 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": { 2024-09-18T13:15:28.059 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:15:28.059 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:15:28.059 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": { 2024-09-18T13:15:28.059 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:15:28.059 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:15:28.059 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": { 2024-09-18T13:15:28.059 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:15:28.059 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:15:28.059 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": { 2024-09-18T13:15:28.060 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:15:28.060 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-18T13:15:28.060 INFO:teuthology.orchestra.run.smithi078.stdout: "overall": { 2024-09-18T13:15:28.060 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:15:28.060 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-18T13:15:28.060 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-18T13:15:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:28.060+0000 7f370ac1c640 1 -- 172.21.15.78:0/3135523875 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f36f407af30 msgr2=0x7f36f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:28.060+0000 7f370ac1c640 1 --2- 172.21.15.78:0/3135523875 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f36f407af30 0x7f36f407d3f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f37041091c0 tx=0x7f36f0005c70 comp rx=0 tx=0).stop 2024-09-18T13:15:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:28.060+0000 7f370ac1c640 1 -- 172.21.15.78:0/3135523875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3704100800 msgr2=0x7f3704107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:28.060+0000 7f370ac1c640 1 --2- 172.21.15.78:0/3135523875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3704100800 0x7f3704107730 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f36f8031460 tx=0x7f36f80048f0 comp rx=0 tx=0).stop 2024-09-18T13:15:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:28.060+0000 7f370ac1c640 1 -- 172.21.15.78:0/3135523875 shutdown_connections 2024-09-18T13:15:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:28.060+0000 7f370ac1c640 1 --2- 172.21.15.78:0/3135523875 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f36f407af30 0x7f36f407d3f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:28.060+0000 7f370ac1c640 1 --2- 172.21.15.78:0/3135523875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3704106800 0x7f3704107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:28.060+0000 7f370ac1c640 1 --2- 172.21.15.78:0/3135523875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3704100800 0x7f3704107730 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:28.060+0000 7f370ac1c640 1 -- 172.21.15.78:0/3135523875 >> 172.21.15.78:0/3135523875 conn(0x7f37040fc520 msgr2=0x7f370406a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:28.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:28.060+0000 7f370ac1c640 1 -- 172.21.15.78:0/3135523875 shutdown_connections 2024-09-18T13:15:28.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:28.060+0000 7f370ac1c640 1 -- 172.21.15.78:0/3135523875 wait complete. 2024-09-18T13:15:28.738 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:28 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3135523875' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:15:28.740 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-18T13:15:28.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:28 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3135523875' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:15:28.989 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:29.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.393+0000 7f2e3ae1f640 1 -- 172.21.15.78:0/792600900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e34106800 msgr2=0x7f2e34106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:29.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.393+0000 7f2e3ae1f640 1 --2- 172.21.15.78:0/792600900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e34106800 0x7f2e34106be0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009880 tx=0x7f2e2802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:29.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.393+0000 7f2e3ae1f640 1 -- 172.21.15.78:0/792600900 shutdown_connections 2024-09-18T13:15:29.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.393+0000 7f2e3ae1f640 1 --2- 172.21.15.78:0/792600900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e34100800 0x7f2e34100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:29.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.393+0000 7f2e3ae1f640 1 --2- 172.21.15.78:0/792600900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e34106800 0x7f2e34106be0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:29.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.393+0000 7f2e3ae1f640 1 -- 172.21.15.78:0/792600900 >> 172.21.15.78:0/792600900 conn(0x7f2e340fc520 msgr2=0x7f2e340fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:29.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.393+0000 7f2e3ae1f640 1 -- 172.21.15.78:0/792600900 shutdown_connections 2024-09-18T13:15:29.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.393+0000 7f2e3ae1f640 1 -- 172.21.15.78:0/792600900 wait complete. 2024-09-18T13:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.394+0000 7f2e3ae1f640 1 Processor -- start 2024-09-18T13:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.394+0000 7f2e3ae1f640 1 -- start start 2024-09-18T13:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.394+0000 7f2e3ae1f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e34100800 0x7f2e3419b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.394+0000 7f2e3ae1f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e34106800 0x7f2e3419b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.394+0000 7f2e3ae1f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3410cbe0 con 0x7f2e34100800 2024-09-18T13:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.394+0000 7f2e3ae1f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3410ca60 con 0x7f2e34106800 2024-09-18T13:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.394+0000 7f2e38bbb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e34100800 0x7f2e3419b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.394+0000 7f2e38bbb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e34100800 0x7f2e3419b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39182/0 (socket says 172.21.15.78:39182) 2024-09-18T13:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.394+0000 7f2e38bbb640 1 -- 172.21.15.78:0/2411010786 learned_addr learned my addr 172.21.15.78:0/2411010786 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.394+0000 7f2e33fff640 1 --2- 172.21.15.78:0/2411010786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e34106800 0x7f2e3419b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.395+0000 7f2e38bbb640 1 -- 172.21.15.78:0/2411010786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e34106800 msgr2=0x7f2e3419b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.395+0000 7f2e38bbb640 1 --2- 172.21.15.78:0/2411010786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e34106800 0x7f2e3419b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.395+0000 7f2e38bbb640 1 -- 172.21.15.78:0/2411010786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e341955e0 con 0x7f2e34100800 2024-09-18T13:15:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.395+0000 7f2e38bbb640 1 --2- 172.21.15.78:0/2411010786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e34100800 0x7f2e3419b420 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2e28031460 tx=0x7f2e280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.395+0000 7f2e31ffb640 1 -- 172.21.15.78:0/2411010786 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e2803f070 con 0x7f2e34100800 2024-09-18T13:15:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.395+0000 7f2e31ffb640 1 -- 172.21.15.78:0/2411010786 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e28004cf0 con 0x7f2e34100800 2024-09-18T13:15:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.395+0000 7f2e3ae1f640 1 -- 172.21.15.78:0/2411010786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e34195870 con 0x7f2e34100800 2024-09-18T13:15:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.395+0000 7f2e31ffb640 1 -- 172.21.15.78:0/2411010786 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e28035030 con 0x7f2e34100800 2024-09-18T13:15:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.395+0000 7f2e3ae1f640 1 -- 172.21.15.78:0/2411010786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e34195da0 con 0x7f2e34100800 2024-09-18T13:15:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.396+0000 7f2e3ae1f640 1 -- 172.21.15.78:0/2411010786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e34101f40 con 0x7f2e34100800 2024-09-18T13:15:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.397+0000 7f2e31ffb640 1 -- 172.21.15.78:0/2411010786 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2e28042070 con 0x7f2e34100800 2024-09-18T13:15:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.397+0000 7f2e31ffb640 1 --2- 172.21.15.78:0/2411010786 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2e2407d150 0x7f2e2407f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.397+0000 7f2e31ffb640 1 -- 172.21.15.78:0/2411010786 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f2e280beb20 con 0x7f2e34100800 2024-09-18T13:15:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.397+0000 7f2e33fff640 1 --2- 172.21.15.78:0/2411010786 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2e2407d150 0x7f2e2407f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:29.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.398+0000 7f2e33fff640 1 --2- 172.21.15.78:0/2411010786 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2e2407d150 0x7f2e2407f610 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2e20005fd0 tx=0x7f2e20005e20 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:29.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.402+0000 7f2e31ffb640 1 -- 172.21.15.78:0/2411010786 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2e2808a0c0 con 0x7f2e34100800 2024-09-18T13:15:29.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.646+0000 7f2e3ae1f640 1 -- 172.21.15.78:0/2411010786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2e34196b10 con 0x7f2e34100800 2024-09-18T13:15:29.648 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:29 smithi078 ceph-mon[108578]: pgmap v791: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:29.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.647+0000 7f2e31ffb640 1 -- 172.21.15.78:0/2411010786 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f2e2808ef70 con 0x7f2e34100800 2024-09-18T13:15:29.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.649+0000 7f2e3ae1f640 1 -- 172.21.15.78:0/2411010786 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2e2407d150 msgr2=0x7f2e2407f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:29.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.649+0000 7f2e3ae1f640 1 --2- 172.21.15.78:0/2411010786 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2e2407d150 0x7f2e2407f610 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2e20005fd0 tx=0x7f2e20005e20 comp rx=0 tx=0).stop 2024-09-18T13:15:29.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.649+0000 7f2e3ae1f640 1 -- 172.21.15.78:0/2411010786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e34100800 msgr2=0x7f2e3419b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:29.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.649+0000 7f2e3ae1f640 1 --2- 172.21.15.78:0/2411010786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e34100800 0x7f2e3419b420 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2e28031460 tx=0x7f2e280048f0 comp rx=0 tx=0).stop 2024-09-18T13:15:29.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.649+0000 7f2e3ae1f640 1 -- 172.21.15.78:0/2411010786 shutdown_connections 2024-09-18T13:15:29.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.649+0000 7f2e3ae1f640 1 --2- 172.21.15.78:0/2411010786 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f2e2407d150 0x7f2e2407f610 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:29.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.649+0000 7f2e3ae1f640 1 --2- 172.21.15.78:0/2411010786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e34106800 0x7f2e3419b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:29.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.649+0000 7f2e3ae1f640 1 --2- 172.21.15.78:0/2411010786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e34100800 0x7f2e3419b420 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:29.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.649+0000 7f2e3ae1f640 1 -- 172.21.15.78:0/2411010786 >> 172.21.15.78:0/2411010786 conn(0x7f2e340fc520 msgr2=0x7f2e340fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:29.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.649+0000 7f2e3ae1f640 1 -- 172.21.15.78:0/2411010786 shutdown_connections 2024-09-18T13:15:29.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:29.649+0000 7f2e3ae1f640 1 -- 172.21.15.78:0/2411010786 wait complete. 2024-09-18T13:15:29.659 INFO:teuthology.orchestra.run.smithi078.stdout:true 2024-09-18T13:15:29.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:29 smithi148 ceph-mon[80030]: pgmap v791: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:30.239 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-18T13:15:30.488 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:30.763 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:30 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2411010786' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:15:30.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:30 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2411010786' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:15:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.975+0000 7f39b146d640 1 -- 172.21.15.78:0/3222541395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39ac100800 msgr2=0x7f39ac100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.975+0000 7f39b146d640 1 --2- 172.21.15.78:0/3222541395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39ac100800 0x7f39ac100c60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3994009880 tx=0x7f399402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.975+0000 7f39b146d640 1 -- 172.21.15.78:0/3222541395 shutdown_connections 2024-09-18T13:15:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.975+0000 7f39b146d640 1 --2- 172.21.15.78:0/3222541395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39ac100800 0x7f39ac100c60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.975+0000 7f39b146d640 1 --2- 172.21.15.78:0/3222541395 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39ac106800 0x7f39ac106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.975+0000 7f39b146d640 1 -- 172.21.15.78:0/3222541395 >> 172.21.15.78:0/3222541395 conn(0x7f39ac0fc520 msgr2=0x7f39ac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.975+0000 7f39b146d640 1 -- 172.21.15.78:0/3222541395 shutdown_connections 2024-09-18T13:15:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.975+0000 7f39b146d640 1 -- 172.21.15.78:0/3222541395 wait complete. 2024-09-18T13:15:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.976+0000 7f39b146d640 1 Processor -- start 2024-09-18T13:15:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.976+0000 7f39b146d640 1 -- start start 2024-09-18T13:15:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.976+0000 7f39b146d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39ac100800 0x7f39ac19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.976+0000 7f39b146d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39ac106800 0x7f39ac19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.976+0000 7f39b146d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac10dd30 con 0x7f39ac100800 2024-09-18T13:15:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.976+0000 7f39b146d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac10dbb0 con 0x7f39ac106800 2024-09-18T13:15:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.976+0000 7f39aaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39ac100800 0x7f39ac19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.976+0000 7f39aaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39ac100800 0x7f39ac19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39198/0 (socket says 172.21.15.78:39198) 2024-09-18T13:15:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.976+0000 7f39aaffd640 1 -- 172.21.15.78:0/3793679294 learned_addr learned my addr 172.21.15.78:0/3793679294 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.976+0000 7f39a27fc640 1 --2- 172.21.15.78:0/3793679294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39ac106800 0x7f39ac19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.976+0000 7f39aaffd640 1 -- 172.21.15.78:0/3793679294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39ac106800 msgr2=0x7f39ac19dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.976+0000 7f39aaffd640 1 --2- 172.21.15.78:0/3793679294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39ac106800 0x7f39ac19dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.976+0000 7f39aaffd640 1 -- 172.21.15.78:0/3793679294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ac197870 con 0x7f39ac100800 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.977+0000 7f39aaffd640 1 --2- 172.21.15.78:0/3793679294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39ac100800 0x7f39ac19d6b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f399c00b420 tx=0x7f399c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.977+0000 7f39a8ff9640 1 -- 172.21.15.78:0/3793679294 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f399c011630 con 0x7f39ac100800 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.977+0000 7f39a8ff9640 1 -- 172.21.15.78:0/3793679294 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f399c016070 con 0x7f39ac100800 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.977+0000 7f39b146d640 1 -- 172.21.15.78:0/3793679294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39ac197b60 con 0x7f39ac100800 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.977+0000 7f39a8ff9640 1 -- 172.21.15.78:0/3793679294 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f399c010d40 con 0x7f39ac100800 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.977+0000 7f39b146d640 1 -- 172.21.15.78:0/3793679294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39ac1980c0 con 0x7f39ac100800 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.978+0000 7f39b146d640 1 -- 172.21.15.78:0/3793679294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39ac101f40 con 0x7f39ac100800 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.979+0000 7f39a8ff9640 1 -- 172.21.15.78:0/3793679294 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f399c01b460 con 0x7f39ac100800 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.979+0000 7f39a8ff9640 1 --2- 172.21.15.78:0/3793679294 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f399807af30 0x7f399807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.979+0000 7f39a8ff9640 1 -- 172.21.15.78:0/3793679294 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f399c09d7a0 con 0x7f39ac100800 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.979+0000 7f39a27fc640 1 --2- 172.21.15.78:0/3793679294 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f399807af30 0x7f399807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.980+0000 7f39a27fc640 1 --2- 172.21.15.78:0/3793679294 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f399807af30 0x7f399807d3f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f39ac199060 tx=0x7f3994031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:30.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:30.984+0000 7f39a8ff9640 1 -- 172.21.15.78:0/3793679294 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f399c021250 con 0x7f39ac100800 2024-09-18T13:15:31.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:31.228+0000 7f39b146d640 1 -- 172.21.15.78:0/3793679294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f39ac198da0 con 0x7f39ac100800 2024-09-18T13:15:31.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:31.228+0000 7f39a8ff9640 1 -- 172.21.15.78:0/3793679294 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f399c068d40 con 0x7f39ac100800 2024-09-18T13:15:31.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:31.231+0000 7f39b146d640 1 -- 172.21.15.78:0/3793679294 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f399807af30 msgr2=0x7f399807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:31.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:31.231+0000 7f39b146d640 1 --2- 172.21.15.78:0/3793679294 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f399807af30 0x7f399807d3f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f39ac199060 tx=0x7f3994031400 comp rx=0 tx=0).stop 2024-09-18T13:15:31.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:31.231+0000 7f39b146d640 1 -- 172.21.15.78:0/3793679294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39ac100800 msgr2=0x7f39ac19d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:31.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:31.231+0000 7f39b146d640 1 --2- 172.21.15.78:0/3793679294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39ac100800 0x7f39ac19d6b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f399c00b420 tx=0x7f399c00b8e0 comp rx=0 tx=0).stop 2024-09-18T13:15:31.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:31.231+0000 7f39b146d640 1 -- 172.21.15.78:0/3793679294 shutdown_connections 2024-09-18T13:15:31.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:31.231+0000 7f39b146d640 1 --2- 172.21.15.78:0/3793679294 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f399807af30 0x7f399807d3f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:31.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:31.231+0000 7f39b146d640 1 --2- 172.21.15.78:0/3793679294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39ac106800 0x7f39ac19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:31.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:31.231+0000 7f39b146d640 1 --2- 172.21.15.78:0/3793679294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39ac100800 0x7f39ac19d6b0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:31.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:31.231+0000 7f39b146d640 1 -- 172.21.15.78:0/3793679294 >> 172.21.15.78:0/3793679294 conn(0x7f39ac0fc520 msgr2=0x7f39ac06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:31.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:31.231+0000 7f39b146d640 1 -- 172.21.15.78:0/3793679294 shutdown_connections 2024-09-18T13:15:31.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:31.231+0000 7f39b146d640 1 -- 172.21.15.78:0/3793679294 wait complete. 2024-09-18T13:15:31.241 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)" 2024-09-18T13:15:31.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:31 smithi148 ceph-mon[80030]: pgmap v792: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:31.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:31 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3793679294' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:15:31.876 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:31 smithi078 ceph-mon[108578]: pgmap v792: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:31.876 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:31 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3793679294' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:15:31.907 DEBUG:teuthology.parallel:result is None 2024-09-18T13:15:31.907 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T13:15:31.922 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-18T13:15:31.922 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-18T13:15:32.172 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:32.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.676+0000 7f541c039640 1 -- 172.21.15.78:0/700188139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5414101900 msgr2=0x7f5414101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:32.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.676+0000 7f541c039640 1 --2- 172.21.15.78:0/700188139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5414101900 0x7f5414101d60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5408009880 tx=0x7f540802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:32.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.676+0000 7f541c039640 1 -- 172.21.15.78:0/700188139 shutdown_connections 2024-09-18T13:15:32.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.676+0000 7f541c039640 1 --2- 172.21.15.78:0/700188139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5414101900 0x7f5414101d60 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:32.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.676+0000 7f541c039640 1 --2- 172.21.15.78:0/700188139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5414107900 0x7f5414107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:32.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.676+0000 7f541c039640 1 -- 172.21.15.78:0/700188139 >> 172.21.15.78:0/700188139 conn(0x7f54140fd5e0 msgr2=0x7f54140ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:32.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.676+0000 7f541c039640 1 -- 172.21.15.78:0/700188139 shutdown_connections 2024-09-18T13:15:32.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.676+0000 7f541c039640 1 -- 172.21.15.78:0/700188139 wait complete. 2024-09-18T13:15:32.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.676+0000 7f541c039640 1 Processor -- start 2024-09-18T13:15:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.676+0000 7f541c039640 1 -- start start 2024-09-18T13:15:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.676+0000 7f541c039640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5414101900 0x7f541419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f541c039640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5414107900 0x7f541419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f541c039640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f541410edb0 con 0x7f5414101900 2024-09-18T13:15:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f541c039640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f541410ec30 con 0x7f5414107900 2024-09-18T13:15:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f5419dd5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5414101900 0x7f541419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f5419dd5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5414101900 0x7f541419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44770/0 (socket says 172.21.15.78:44770) 2024-09-18T13:15:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f5419dd5640 1 -- 172.21.15.78:0/3887337306 learned_addr learned my addr 172.21.15.78:0/3887337306 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f54195d4640 1 --2- 172.21.15.78:0/3887337306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5414107900 0x7f541419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f5419dd5640 1 -- 172.21.15.78:0/3887337306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5414107900 msgr2=0x7f541419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f5419dd5640 1 --2- 172.21.15.78:0/3887337306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5414107900 0x7f541419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:32.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f5419dd5640 1 -- 172.21.15.78:0/3887337306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5414197800 con 0x7f5414101900 2024-09-18T13:15:32.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f5419dd5640 1 --2- 172.21.15.78:0/3887337306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5414101900 0x7f541419d680 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f540c00c8a0 tx=0x7f540c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:32.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f5412ffd640 1 -- 172.21.15.78:0/3887337306 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f540c0079b0 con 0x7f5414101900 2024-09-18T13:15:32.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f541c039640 1 -- 172.21.15.78:0/3887337306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5414197af0 con 0x7f5414101900 2024-09-18T13:15:32.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f5412ffd640 1 -- 172.21.15.78:0/3887337306 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f540c007b50 con 0x7f5414101900 2024-09-18T13:15:32.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f5412ffd640 1 -- 172.21.15.78:0/3887337306 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f540c018700 con 0x7f5414101900 2024-09-18T13:15:32.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.677+0000 7f541c039640 1 -- 172.21.15.78:0/3887337306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5414198050 con 0x7f5414101900 2024-09-18T13:15:32.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.678+0000 7f541c039640 1 -- 172.21.15.78:0/3887337306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5414103040 con 0x7f5414101900 2024-09-18T13:15:32.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.679+0000 7f5412ffd640 1 -- 172.21.15.78:0/3887337306 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f540c007d00 con 0x7f5414101900 2024-09-18T13:15:32.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.679+0000 7f5412ffd640 1 --2- 172.21.15.78:0/3887337306 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f53fc07af30 0x7f53fc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:32.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.679+0000 7f54195d4640 1 --2- 172.21.15.78:0/3887337306 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f53fc07af30 0x7f53fc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:32.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.679+0000 7f5412ffd640 1 -- 172.21.15.78:0/3887337306 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f540c09e370 con 0x7f5414101900 2024-09-18T13:15:32.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.680+0000 7f54195d4640 1 --2- 172.21.15.78:0/3887337306 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f53fc07af30 0x7f53fc07d3f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5414198b50 tx=0x7f5408031420 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:32.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.684+0000 7f5412ffd640 1 -- 172.21.15.78:0/3887337306 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f540c014030 con 0x7f5414101900 2024-09-18T13:15:32.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.897+0000 7f541c039640 1 -- 172.21.15.78:0/3887337306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5414198d60 con 0x7f5414101900 2024-09-18T13:15:32.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.898+0000 7f5412ffd640 1 -- 172.21.15.78:0/3887337306 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) ==== 76+0+2038 (secure 0 0 0) 0x7f5414198d60 con 0x7f5414101900 2024-09-18T13:15:32.899 INFO:teuthology.orchestra.run.smithi078.stdout:e36 2024-09-18T13:15:32.899 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-18T13:13:48:786340+0000 2024-09-18T13:15:32.899 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:15:32.899 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:15:32.899 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-18T13:15:32.899 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:32.899 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:15:32.899 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-18T13:15:32.900 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 36 2024-09-18T13:15:32.900 INFO:teuthology.orchestra.run.smithi078.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T13:15:32.900 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-18T12:46:26.747207+0000 2024-09-18T13:15:32.900 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-18T13:13:47.876518+0000 2024-09-18T13:15:32.900 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-18T13:15:32.900 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-18T13:15:32.900 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 60 2024-09-18T13:15:32.900 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-18T13:15:32.900 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-18T13:15:32.900 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-18T13:15:32.900 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-18T13:15:32.900 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-18T13:15:32.900 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 75 2024-09-18T13:15:32.900 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:15:32.901 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 2 2024-09-18T13:15:32.901 INFO:teuthology.orchestra.run.smithi078.stdout:in 0,1 2024-09-18T13:15:32.901 INFO:teuthology.orchestra.run.smithi078.stdout:up {0=34320,1=34352} 2024-09-18T13:15:32.901 INFO:teuthology.orchestra.run.smithi078.stdout:failed 2024-09-18T13:15:32.901 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-18T13:15:32.901 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-18T13:15:32.901 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-18T13:15:32.901 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-18T13:15:32.901 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data enabled 2024-09-18T13:15:32.901 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-18T13:15:32.901 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-18T13:15:32.901 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 1 2024-09-18T13:15:32.902 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 34320 members: 34352,34320 2024-09-18T13:15:32.902 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.eakgoe{0:34320} state up:active seq 244 join_fscid=1 addr [v2:172.21.15.78:6828/2241162518,v1:172.21.15.78:6829/2241162518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:15:32.902 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi078.furyab{1:34352} state up:active seq 239 join_fscid=1 addr [v2:172.21.15.78:6826/2453525200,v1:172.21.15.78:6827/2453525200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:15:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:32.902 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-18T13:15:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:32.902 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.fqecmm{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6824/2385856084,v1:172.21.15.148:6825/2385856084] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:15:32.902 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.cephfs.smithi148.tvvouo{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/3319905864,v1:172.21.15.148:6827/3319905864] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:15:32.903 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 36 2024-09-18T13:15:32.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.900+0000 7f541c039640 1 -- 172.21.15.78:0/3887337306 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f53fc07af30 msgr2=0x7f53fc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:32.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.900+0000 7f541c039640 1 --2- 172.21.15.78:0/3887337306 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f53fc07af30 0x7f53fc07d3f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5414198b50 tx=0x7f5408031420 comp rx=0 tx=0).stop 2024-09-18T13:15:32.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.900+0000 7f541c039640 1 -- 172.21.15.78:0/3887337306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5414101900 msgr2=0x7f541419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:32.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.900+0000 7f541c039640 1 --2- 172.21.15.78:0/3887337306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5414101900 0x7f541419d680 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f540c00c8a0 tx=0x7f540c00cd60 comp rx=0 tx=0).stop 2024-09-18T13:15:32.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.900+0000 7f541c039640 1 -- 172.21.15.78:0/3887337306 shutdown_connections 2024-09-18T13:15:32.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.900+0000 7f541c039640 1 --2- 172.21.15.78:0/3887337306 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f53fc07af30 0x7f53fc07d3f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:32.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.900+0000 7f541c039640 1 --2- 172.21.15.78:0/3887337306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5414107900 0x7f541419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:32.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.900+0000 7f541c039640 1 --2- 172.21.15.78:0/3887337306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5414101900 0x7f541419d680 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:32.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.900+0000 7f541c039640 1 -- 172.21.15.78:0/3887337306 >> 172.21.15.78:0/3887337306 conn(0x7f54140fd5e0 msgr2=0x7f54140fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:32.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.900+0000 7f541c039640 1 -- 172.21.15.78:0/3887337306 shutdown_connections 2024-09-18T13:15:32.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:32.900+0000 7f541c039640 1 -- 172.21.15.78:0/3887337306 wait complete. 2024-09-18T13:15:33.586 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-18T13:15:33.598 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-18T13:15:33.848 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:33.968 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:33 smithi078 ceph-mon[108578]: pgmap v793: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:33.969 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:33 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3887337306' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:15:33.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:33 smithi148 ceph-mon[80030]: pgmap v793: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:33.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:33 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3887337306' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:15:34.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.309+0000 7f370482f640 1 -- 172.21.15.78:0/2908521247 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37001007f0 msgr2=0x7f3700100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:34.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.309+0000 7f370482f640 1 --2- 172.21.15.78:0/2908521247 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37001007f0 0x7f3700100c50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009880 tx=0x7f36f402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:34.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.309+0000 7f370482f640 1 -- 172.21.15.78:0/2908521247 shutdown_connections 2024-09-18T13:15:34.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.309+0000 7f370482f640 1 --2- 172.21.15.78:0/2908521247 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37001007f0 0x7f3700100c50 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:34.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.309+0000 7f370482f640 1 --2- 172.21.15.78:0/2908521247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37001067f0 0x7f3700106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:34.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.309+0000 7f370482f640 1 -- 172.21.15.78:0/2908521247 >> 172.21.15.78:0/2908521247 conn(0x7f37000fc550 msgr2=0x7f37000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:34.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.309+0000 7f370482f640 1 -- 172.21.15.78:0/2908521247 shutdown_connections 2024-09-18T13:15:34.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.309+0000 7f370482f640 1 -- 172.21.15.78:0/2908521247 wait complete. 2024-09-18T13:15:34.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.310+0000 7f370482f640 1 Processor -- start 2024-09-18T13:15:34.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.310+0000 7f370482f640 1 -- start start 2024-09-18T13:15:34.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.310+0000 7f370482f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37001007f0 0x7f370019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:34.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.310+0000 7f370482f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37001067f0 0x7f370019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:34.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.310+0000 7f370482f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f370010dca0 con 0x7f37001067f0 2024-09-18T13:15:34.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.310+0000 7f370482f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f370010db20 con 0x7f37001007f0 2024-09-18T13:15:34.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.310+0000 7f36fdd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37001067f0 0x7f370019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:34.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.310+0000 7f36fdd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37001067f0 0x7f370019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44800/0 (socket says 172.21.15.78:44800) 2024-09-18T13:15:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.310+0000 7f36fdd9b640 1 -- 172.21.15.78:0/1420125715 learned_addr learned my addr 172.21.15.78:0/1420125715 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.310+0000 7f36fe59c640 1 --2- 172.21.15.78:0/1420125715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37001007f0 0x7f370019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.310+0000 7f36fdd9b640 1 -- 172.21.15.78:0/1420125715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37001007f0 msgr2=0x7f370019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.310+0000 7f36fdd9b640 1 --2- 172.21.15.78:0/1420125715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37001007f0 0x7f370019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.310+0000 7f36fdd9b640 1 -- 172.21.15.78:0/1420125715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3700197770 con 0x7f37001067f0 2024-09-18T13:15:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.310+0000 7f36fe59c640 1 --2- 172.21.15.78:0/1420125715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37001007f0 0x7f370019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:15:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.311+0000 7f36fdd9b640 1 --2- 172.21.15.78:0/1420125715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37001067f0 0x7f370019dbe0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f36f4031460 tx=0x7f36f40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.311+0000 7f36ef7fe640 1 -- 172.21.15.78:0/1420125715 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36f403f070 con 0x7f37001067f0 2024-09-18T13:15:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.311+0000 7f370482f640 1 -- 172.21.15.78:0/1420125715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3700197a00 con 0x7f37001067f0 2024-09-18T13:15:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.311+0000 7f36ef7fe640 1 -- 172.21.15.78:0/1420125715 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36f4004cf0 con 0x7f37001067f0 2024-09-18T13:15:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.311+0000 7f36ef7fe640 1 -- 172.21.15.78:0/1420125715 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36f4035030 con 0x7f37001067f0 2024-09-18T13:15:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.311+0000 7f370482f640 1 -- 172.21.15.78:0/1420125715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3700197f30 con 0x7f37001067f0 2024-09-18T13:15:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.312+0000 7f370482f640 1 -- 172.21.15.78:0/1420125715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3700101f30 con 0x7f37001067f0 2024-09-18T13:15:34.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.313+0000 7f36ef7fe640 1 -- 172.21.15.78:0/1420125715 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f36f4042070 con 0x7f37001067f0 2024-09-18T13:15:34.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.313+0000 7f36ef7fe640 1 --2- 172.21.15.78:0/1420125715 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f36e807af30 0x7f36e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:34.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.313+0000 7f36ef7fe640 1 -- 172.21.15.78:0/1420125715 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f36f40beb20 con 0x7f37001067f0 2024-09-18T13:15:34.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.313+0000 7f36fe59c640 1 --2- 172.21.15.78:0/1420125715 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f36e807af30 0x7f36e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:34.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.314+0000 7f36fe59c640 1 --2- 172.21.15.78:0/1420125715 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f36e807af30 0x7f36e807d3f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f36f0008e00 tx=0x7f36f0008350 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:34.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.317+0000 7f36ef7fe640 1 -- 172.21.15.78:0/1420125715 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f36f408a0c0 con 0x7f37001067f0 2024-09-18T13:15:34.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.528+0000 7f370482f640 1 -- 172.21.15.78:0/1420125715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37001981e0 con 0x7f37001067f0 2024-09-18T13:15:34.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.529+0000 7f36ef7fe640 1 -- 172.21.15.78:0/1420125715 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5348 (secure 0 0 0) 0x7f36f408ef70 con 0x7f37001067f0 2024-09-18T13:15:34.530 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:34.530 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":36,"btime":"2024-09-18T13:13:48:786340+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44293,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/2385856084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2385856084},{"type":"v1","addr":"172.21.15.148:6825","nonce":2385856084}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/3319905864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3319905864},{"type":"v1","addr":"172.21.15.148:6827","nonce":3319905864}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T13:13:47.876518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34320,"mds_1":34352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi078.eakgoe","rank":0,"incarnation":30,"state":"up:active","state_seq":244,"addr":"172.21.15.78:6829/2241162518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2241162518},{"type":"v1","addr":"172.21.15.78:6829","nonce":2241162518}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34352":{"gid":34352,"name":"cephfs.smithi078.furyab","rank":1,"incarnation":30,"state":"up:active","state_seq":239,"addr":"172.21.15.78:6827/2453525200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2453525200},{"type":"v1","addr":"172.21.15.78:6827","nonce":2453525200}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34320,"qdb_cluster":[34352,34320]},"id":1}]} 2024-09-18T13:15:34.531 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 36 2024-09-18T13:15:34.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.531+0000 7f370482f640 1 -- 172.21.15.78:0/1420125715 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f36e807af30 msgr2=0x7f36e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:34.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.531+0000 7f370482f640 1 --2- 172.21.15.78:0/1420125715 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f36e807af30 0x7f36e807d3f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f36f0008e00 tx=0x7f36f0008350 comp rx=0 tx=0).stop 2024-09-18T13:15:34.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.531+0000 7f370482f640 1 -- 172.21.15.78:0/1420125715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37001067f0 msgr2=0x7f370019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:34.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.531+0000 7f370482f640 1 --2- 172.21.15.78:0/1420125715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37001067f0 0x7f370019dbe0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f36f4031460 tx=0x7f36f40048f0 comp rx=0 tx=0).stop 2024-09-18T13:15:34.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.531+0000 7f370482f640 1 -- 172.21.15.78:0/1420125715 shutdown_connections 2024-09-18T13:15:34.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.531+0000 7f370482f640 1 --2- 172.21.15.78:0/1420125715 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f36e807af30 0x7f36e807d3f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:34.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.531+0000 7f370482f640 1 --2- 172.21.15.78:0/1420125715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37001067f0 0x7f370019dbe0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:34.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.531+0000 7f370482f640 1 --2- 172.21.15.78:0/1420125715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37001007f0 0x7f370019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:34.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.531+0000 7f370482f640 1 -- 172.21.15.78:0/1420125715 >> 172.21.15.78:0/1420125715 conn(0x7f37000fc550 msgr2=0x7f3700104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:34.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.531+0000 7f370482f640 1 -- 172.21.15.78:0/1420125715 shutdown_connections 2024-09-18T13:15:34.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:34.531+0000 7f370482f640 1 -- 172.21.15.78:0/1420125715 wait complete. 2024-09-18T13:15:35.161 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 18} 2024-09-18T13:15:35.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-18T13:15:35.408 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:35.778 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:35 smithi078 ceph-mon[108578]: pgmap v794: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:35.779 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:35 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1420125715' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-18T13:15:35.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.856+0000 7f56ab839640 1 -- 172.21.15.78:0/1511126135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a4103440 msgr2=0x7f56a410b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:35.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.856+0000 7f56ab839640 1 --2- 172.21.15.78:0/1511126135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a4103440 0x7f56a410b930 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f56940098b0 tx=0x7f569402a560 comp rx=0 tx=0).stop 2024-09-18T13:15:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.856+0000 7f56ab839640 1 -- 172.21.15.78:0/1511126135 shutdown_connections 2024-09-18T13:15:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.856+0000 7f56ab839640 1 --2- 172.21.15.78:0/1511126135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a4103440 0x7f56a410b930 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.856+0000 7f56ab839640 1 --2- 172.21.15.78:0/1511126135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a4102b20 0x7f56a4102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.856+0000 7f56ab839640 1 -- 172.21.15.78:0/1511126135 >> 172.21.15.78:0/1511126135 conn(0x7f56a40fc520 msgr2=0x7f56a40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.856+0000 7f56ab839640 1 -- 172.21.15.78:0/1511126135 shutdown_connections 2024-09-18T13:15:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.856+0000 7f56ab839640 1 -- 172.21.15.78:0/1511126135 wait complete. 2024-09-18T13:15:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.857+0000 7f56ab839640 1 Processor -- start 2024-09-18T13:15:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.857+0000 7f56ab839640 1 -- start start 2024-09-18T13:15:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.857+0000 7f56ab839640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a4102b20 0x7f56a419d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.857+0000 7f56ab839640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a4103440 0x7f56a419dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.857+0000 7f56ab839640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f56a410ee50 con 0x7f56a4103440 2024-09-18T13:15:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.857+0000 7f56ab839640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f56a410ecd0 con 0x7f56a4102b20 2024-09-18T13:15:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.857+0000 7f56a8dd4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a4103440 0x7f56a419dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.857+0000 7f56a8dd4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a4103440 0x7f56a419dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44826/0 (socket says 172.21.15.78:44826) 2024-09-18T13:15:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.857+0000 7f56a8dd4640 1 -- 172.21.15.78:0/1294502355 learned_addr learned my addr 172.21.15.78:0/1294502355 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.858+0000 7f56a8dd4640 1 -- 172.21.15.78:0/1294502355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a4102b20 msgr2=0x7f56a419d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.858+0000 7f56a95d5640 1 --2- 172.21.15.78:0/1294502355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a4102b20 0x7f56a419d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.858+0000 7f56a8dd4640 1 --2- 172.21.15.78:0/1294502355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a4102b20 0x7f56a419d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.858+0000 7f56a8dd4640 1 -- 172.21.15.78:0/1294502355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a4197900 con 0x7f56a4103440 2024-09-18T13:15:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.858+0000 7f56a8dd4640 1 --2- 172.21.15.78:0/1294502355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a4103440 0x7f56a419dc80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5694031460 tx=0x7f56940048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.858+0000 7f569a7fc640 1 -- 172.21.15.78:0/1294502355 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f569403f070 con 0x7f56a4103440 2024-09-18T13:15:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.858+0000 7f569a7fc640 1 -- 172.21.15.78:0/1294502355 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f56940044d0 con 0x7f56a4103440 2024-09-18T13:15:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.858+0000 7f569a7fc640 1 -- 172.21.15.78:0/1294502355 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5694035030 con 0x7f56a4103440 2024-09-18T13:15:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.858+0000 7f56ab839640 1 -- 172.21.15.78:0/1294502355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a4197b90 con 0x7f56a4103440 2024-09-18T13:15:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.858+0000 7f56ab839640 1 -- 172.21.15.78:0/1294502355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a41980c0 con 0x7f56a4103440 2024-09-18T13:15:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.859+0000 7f56ab839640 1 -- 172.21.15.78:0/1294502355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56a406aa30 con 0x7f56a4103440 2024-09-18T13:15:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.860+0000 7f569a7fc640 1 -- 172.21.15.78:0/1294502355 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5694042070 con 0x7f56a4103440 2024-09-18T13:15:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.860+0000 7f569a7fc640 1 --2- 172.21.15.78:0/1294502355 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f569007af30 0x7f569007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.860+0000 7f569a7fc640 1 -- 172.21.15.78:0/1294502355 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f56940beb80 con 0x7f56a4103440 2024-09-18T13:15:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.860+0000 7f56a95d5640 1 --2- 172.21.15.78:0/1294502355 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f569007af30 0x7f569007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.861+0000 7f56a95d5640 1 --2- 172.21.15.78:0/1294502355 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f569007af30 0x7f569007d3f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f56a4198a40 tx=0x7f56a0008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:35.864+0000 7f569a7fc640 1 -- 172.21.15.78:0/1294502355 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5694004cf0 con 0x7f56a4103440 2024-09-18T13:15:35.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:35 smithi148 ceph-mon[80030]: pgmap v794: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:35.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:35 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1420125715' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-18T13:15:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:36.074+0000 7f56ab839640 1 -- 172.21.15.78:0/1294502355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) -- 0x7f56a4105fb0 con 0x7f56a4103440 2024-09-18T13:15:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:36.074+0000 7f569a7fc640 1 -- 172.21.15.78:0/1294502355 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v36) ==== 107+0+3610 (secure 0 0 0) 0x7f569408a120 con 0x7f56a4103440 2024-09-18T13:15:36.076 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:36.076 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"btime":"2024-09-18T12:57:27:052907+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.148:6827/1048760842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1048760842},{"type":"v1","addr":"172.21.15.148:6827","nonce":1048760842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":24287,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/258027429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":258027429},{"type":"v1","addr":"172.21.15.148:6825","nonce":258027429}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T12:57:27.052903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 19 2024-09-18T13:15:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:36.076+0000 7f56ab839640 1 -- 172.21.15.78:0/1294502355 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f569007af30 msgr2=0x7f569007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:36.076+0000 7f56ab839640 1 --2- 172.21.15.78:0/1294502355 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f569007af30 0x7f569007d3f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f56a4198a40 tx=0x7f56a0008040 comp rx=0 tx=0).stop 2024-09-18T13:15:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:36.076+0000 7f56ab839640 1 -- 172.21.15.78:0/1294502355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a4103440 msgr2=0x7f56a419dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:36.076+0000 7f56ab839640 1 --2- 172.21.15.78:0/1294502355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a4103440 0x7f56a419dc80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5694031460 tx=0x7f56940048f0 comp rx=0 tx=0).stop 2024-09-18T13:15:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:36.077+0000 7f56ab839640 1 -- 172.21.15.78:0/1294502355 shutdown_connections 2024-09-18T13:15:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:36.077+0000 7f56ab839640 1 --2- 172.21.15.78:0/1294502355 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f569007af30 0x7f569007d3f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:36.077+0000 7f56ab839640 1 --2- 172.21.15.78:0/1294502355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56a4103440 0x7f56a419dc80 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:36.077+0000 7f56ab839640 1 --2- 172.21.15.78:0/1294502355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a4102b20 0x7f56a419d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:36.077+0000 7f56ab839640 1 -- 172.21.15.78:0/1294502355 >> 172.21.15.78:0/1294502355 conn(0x7f56a40fc520 msgr2=0x7f56a4103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:36.077+0000 7f56ab839640 1 -- 172.21.15.78:0/1294502355 shutdown_connections 2024-09-18T13:15:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:36.077+0000 7f56ab839640 1 -- 172.21.15.78:0/1294502355 wait complete. 2024-09-18T13:15:36.669 DEBUG:tasks.fs:max_mds not reduced in epoch 19 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-18T13:15:36.670 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-18T13:15:36.922 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:36.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:36 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1294502355' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-18T13:15:36.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:36 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1294502355' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-18T13:15:37.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.389+0000 7fc64cd20640 1 -- 172.21.15.78:0/711357494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc648100800 msgr2=0x7fc648100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:37.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.389+0000 7fc64cd20640 1 --2- 172.21.15.78:0/711357494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc648100800 0x7fc648100c60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009880 tx=0x7fc63c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:37.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.389+0000 7fc64cd20640 1 -- 172.21.15.78:0/711357494 shutdown_connections 2024-09-18T13:15:37.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.389+0000 7fc64cd20640 1 --2- 172.21.15.78:0/711357494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc648100800 0x7fc648100c60 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:37.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.389+0000 7fc64cd20640 1 --2- 172.21.15.78:0/711357494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc648106800 0x7fc648106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:37.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.389+0000 7fc64cd20640 1 -- 172.21.15.78:0/711357494 >> 172.21.15.78:0/711357494 conn(0x7fc6480fc520 msgr2=0x7fc6480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:37.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.389+0000 7fc64cd20640 1 -- 172.21.15.78:0/711357494 shutdown_connections 2024-09-18T13:15:37.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.389+0000 7fc64cd20640 1 -- 172.21.15.78:0/711357494 wait complete. 2024-09-18T13:15:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.390+0000 7fc64cd20640 1 Processor -- start 2024-09-18T13:15:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.390+0000 7fc64cd20640 1 -- start start 2024-09-18T13:15:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.390+0000 7fc64cd20640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc648100800 0x7fc648198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.390+0000 7fc64cd20640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc648106800 0x7fc648198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.390+0000 7fc64cd20640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc64810dd30 con 0x7fc648106800 2024-09-18T13:15:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.390+0000 7fc64cd20640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc64810dbb0 con 0x7fc648100800 2024-09-18T13:15:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.390+0000 7fc645d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc648106800 0x7fc648198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.390+0000 7fc645d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc648106800 0x7fc648198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44842/0 (socket says 172.21.15.78:44842) 2024-09-18T13:15:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.390+0000 7fc645d9b640 1 -- 172.21.15.78:0/3493638565 learned_addr learned my addr 172.21.15.78:0/3493638565 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.391+0000 7fc645d9b640 1 -- 172.21.15.78:0/3493638565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc648100800 msgr2=0x7fc648198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.391+0000 7fc645d9b640 1 --2- 172.21.15.78:0/3493638565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc648100800 0x7fc648198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.391+0000 7fc645d9b640 1 -- 172.21.15.78:0/3493638565 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6481993a0 con 0x7fc648106800 2024-09-18T13:15:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.391+0000 7fc645d9b640 1 --2- 172.21.15.78:0/3493638565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc648106800 0x7fc648198da0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc63c031460 tx=0x7fc63c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.391+0000 7fc6377fe640 1 -- 172.21.15.78:0/3493638565 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc63c03f070 con 0x7fc648106800 2024-09-18T13:15:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.391+0000 7fc64cd20640 1 -- 172.21.15.78:0/3493638565 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc648199630 con 0x7fc648106800 2024-09-18T13:15:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.391+0000 7fc6377fe640 1 -- 172.21.15.78:0/3493638565 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc63c004cf0 con 0x7fc648106800 2024-09-18T13:15:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.391+0000 7fc6377fe640 1 -- 172.21.15.78:0/3493638565 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc63c035030 con 0x7fc648106800 2024-09-18T13:15:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.391+0000 7fc64cd20640 1 -- 172.21.15.78:0/3493638565 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6481a1be0 con 0x7fc648106800 2024-09-18T13:15:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.392+0000 7fc64cd20640 1 -- 172.21.15.78:0/3493638565 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc648101f40 con 0x7fc648106800 2024-09-18T13:15:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.393+0000 7fc6377fe640 1 -- 172.21.15.78:0/3493638565 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc63c042070 con 0x7fc648106800 2024-09-18T13:15:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.394+0000 7fc6377fe640 1 --2- 172.21.15.78:0/3493638565 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc63007af30 0x7fc63007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.394+0000 7fc6377fe640 1 -- 172.21.15.78:0/3493638565 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fc63c0beb60 con 0x7fc648106800 2024-09-18T13:15:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.394+0000 7fc64659c640 1 --2- 172.21.15.78:0/3493638565 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc63007af30 0x7fc63007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.394+0000 7fc64659c640 1 --2- 172.21.15.78:0/3493638565 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc63007af30 0x7fc63007d3f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc638009710 tx=0x7fc638006c90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:37.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.398+0000 7fc6377fe640 1 -- 172.21.15.78:0/3493638565 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc63c08a100 con 0x7fc648106800 2024-09-18T13:15:37.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.615+0000 7fc64cd20640 1 -- 172.21.15.78:0/3493638565 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) -- 0x7fc648108d90 con 0x7fc648106800 2024-09-18T13:15:37.617 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:37 smithi078 ceph-mon[108578]: pgmap v795: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:37.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.616+0000 7fc6377fe640 1 -- 172.21.15.78:0/3493638565 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v36) ==== 107+0+5304 (secure 0 0 0) 0x7fc63c08efb0 con 0x7fc648106800 2024-09-18T13:15:37.617 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:37.617 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-18T12:57:28:054193+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.148:6827/1048760842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1048760842},{"type":"v1","addr":"172.21.15.148:6827","nonce":1048760842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":24287,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/258027429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":258027429},{"type":"v1","addr":"172.21.15.148:6825","nonce":258027429}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":34310,"name":"cephfs.smithi078.furyab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6827/2971989157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2971989157},{"type":"v1","addr":"172.21.15.78:6827","nonce":2971989157}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34314,"name":"cephfs.smithi078.eakgoe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6829/1628237937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":1628237937},{"type":"v1","addr":"172.21.15.78:6829","nonce":1628237937}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T12:57:27.052903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:37.618 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-18T13:15:37.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.618+0000 7fc64cd20640 1 -- 172.21.15.78:0/3493638565 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc63007af30 msgr2=0x7fc63007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:37.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.618+0000 7fc64cd20640 1 --2- 172.21.15.78:0/3493638565 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc63007af30 0x7fc63007d3f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc638009710 tx=0x7fc638006c90 comp rx=0 tx=0).stop 2024-09-18T13:15:37.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.618+0000 7fc64cd20640 1 -- 172.21.15.78:0/3493638565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc648106800 msgr2=0x7fc648198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:37.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.618+0000 7fc64cd20640 1 --2- 172.21.15.78:0/3493638565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc648106800 0x7fc648198da0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc63c031460 tx=0x7fc63c0048f0 comp rx=0 tx=0).stop 2024-09-18T13:15:37.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.618+0000 7fc64cd20640 1 -- 172.21.15.78:0/3493638565 shutdown_connections 2024-09-18T13:15:37.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.618+0000 7fc64cd20640 1 --2- 172.21.15.78:0/3493638565 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fc63007af30 0x7fc63007d3f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:37.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.618+0000 7fc64cd20640 1 --2- 172.21.15.78:0/3493638565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc648106800 0x7fc648198da0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:37.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.618+0000 7fc64cd20640 1 --2- 172.21.15.78:0/3493638565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc648100800 0x7fc648198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:37.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.618+0000 7fc64cd20640 1 -- 172.21.15.78:0/3493638565 >> 172.21.15.78:0/3493638565 conn(0x7fc6480fc520 msgr2=0x7fc6480fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:37.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.618+0000 7fc64cd20640 1 -- 172.21.15.78:0/3493638565 shutdown_connections 2024-09-18T13:15:37.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:37.618+0000 7fc64cd20640 1 -- 172.21.15.78:0/3493638565 wait complete. 2024-09-18T13:15:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:37 smithi148 ceph-mon[80030]: pgmap v795: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:38.267 DEBUG:tasks.fs:max_mds not reduced in epoch 20 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-18T13:15:38.267 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-18T13:15:38.516 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:38.793 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:38 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3493638565' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-18T13:15:38.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.963+0000 7fdfeaa96640 1 -- 172.21.15.78:0/1453650773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe4101e80 msgr2=0x7fdfe41054a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:38.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.963+0000 7fdfeaa96640 1 --2- 172.21.15.78:0/1453650773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe4101e80 0x7fdfe41054a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009880 tx=0x7fdfd002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:38.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.963+0000 7fdfeaa96640 1 -- 172.21.15.78:0/1453650773 shutdown_connections 2024-09-18T13:15:38.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.963+0000 7fdfeaa96640 1 --2- 172.21.15.78:0/1453650773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe4101e80 0x7fdfe41054a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:38.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.963+0000 7fdfeaa96640 1 --2- 172.21.15.78:0/1453650773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfe41014d0 0x7fdfe41018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:38.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.963+0000 7fdfeaa96640 1 -- 172.21.15.78:0/1453650773 >> 172.21.15.78:0/1453650773 conn(0x7fdfe4077150 msgr2=0x7fdfe4077560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:38.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.963+0000 7fdfeaa96640 1 -- 172.21.15.78:0/1453650773 shutdown_connections 2024-09-18T13:15:38.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.963+0000 7fdfeaa96640 1 -- 172.21.15.78:0/1453650773 wait complete. 2024-09-18T13:15:38.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.964+0000 7fdfeaa96640 1 Processor -- start 2024-09-18T13:15:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.964+0000 7fdfeaa96640 1 -- start start 2024-09-18T13:15:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.964+0000 7fdfeaa96640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfe41014d0 0x7fdfe419c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.964+0000 7fdfeaa96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe4101e80 0x7fdfe419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.964+0000 7fdfeaa96640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe410dd40 con 0x7fdfe4101e80 2024-09-18T13:15:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.964+0000 7fdfeaa96640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe410dbc0 con 0x7fdfe41014d0 2024-09-18T13:15:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.965+0000 7fdfe3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe4101e80 0x7fdfe419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.965+0000 7fdfe3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe4101e80 0x7fdfe419cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44870/0 (socket says 172.21.15.78:44870) 2024-09-18T13:15:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.965+0000 7fdfe3fff640 1 -- 172.21.15.78:0/2390685318 learned_addr learned my addr 172.21.15.78:0/2390685318 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.965+0000 7fdfe8832640 1 --2- 172.21.15.78:0/2390685318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfe41014d0 0x7fdfe419c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.965+0000 7fdfe3fff640 1 -- 172.21.15.78:0/2390685318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfe41014d0 msgr2=0x7fdfe419c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.965+0000 7fdfe3fff640 1 --2- 172.21.15.78:0/2390685318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfe41014d0 0x7fdfe419c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.965+0000 7fdfe3fff640 1 -- 172.21.15.78:0/2390685318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe4196750 con 0x7fdfe4101e80 2024-09-18T13:15:38.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.965+0000 7fdfe8832640 1 --2- 172.21.15.78:0/2390685318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfe41014d0 0x7fdfe419c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:15:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.965+0000 7fdfe3fff640 1 --2- 172.21.15.78:0/2390685318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe4101e80 0x7fdfe419cbc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0031460 tx=0x7fdfd00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.965+0000 7fdfe1ffb640 1 -- 172.21.15.78:0/2390685318 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdfd003f070 con 0x7fdfe4101e80 2024-09-18T13:15:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.965+0000 7fdfe1ffb640 1 -- 172.21.15.78:0/2390685318 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdfd0004cf0 con 0x7fdfe4101e80 2024-09-18T13:15:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.965+0000 7fdfeaa96640 1 -- 172.21.15.78:0/2390685318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe41969e0 con 0x7fdfe4101e80 2024-09-18T13:15:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.965+0000 7fdfe1ffb640 1 -- 172.21.15.78:0/2390685318 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdfd0035030 con 0x7fdfe4101e80 2024-09-18T13:15:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.966+0000 7fdfeaa96640 1 -- 172.21.15.78:0/2390685318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe4196ee0 con 0x7fdfe4101e80 2024-09-18T13:15:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.967+0000 7fdfeaa96640 1 -- 172.21.15.78:0/2390685318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfe4069e70 con 0x7fdfe4101e80 2024-09-18T13:15:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.967+0000 7fdfe1ffb640 1 -- 172.21.15.78:0/2390685318 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fdfd0042070 con 0x7fdfe4101e80 2024-09-18T13:15:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.968+0000 7fdfe1ffb640 1 --2- 172.21.15.78:0/2390685318 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdfd407af30 0x7fdfd407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.968+0000 7fdfe1ffb640 1 -- 172.21.15.78:0/2390685318 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fdfd00beb60 con 0x7fdfe4101e80 2024-09-18T13:15:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.968+0000 7fdfe8832640 1 --2- 172.21.15.78:0/2390685318 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdfd407af30 0x7fdfd407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.968+0000 7fdfe8832640 1 --2- 172.21.15.78:0/2390685318 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdfd407af30 0x7fdfd407d3f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009930 tx=0x7fdfd8008040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:38.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:38 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3493638565' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-18T13:15:38.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:38.972+0000 7fdfe1ffb640 1 -- 172.21.15.78:0/2390685318 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fdfd008a100 con 0x7fdfe4101e80 2024-09-18T13:15:39.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:39.183+0000 7fdfeaa96640 1 -- 172.21.15.78:0/2390685318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) -- 0x7fdfe4108d40 con 0x7fdfe4101e80 2024-09-18T13:15:39.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:39.184+0000 7fdfe1ffb640 1 -- 172.21.15.78:0/2390685318 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v36) ==== 107+0+4457 (secure 0 0 0) 0x7fdfd008efb0 con 0x7fdfe4101e80 2024-09-18T13:15:39.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:39.186 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":21,"btime":"2024-09-18T12:57:31:075518+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.148:6827/1048760842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1048760842},{"type":"v1","addr":"172.21.15.148:6827","nonce":1048760842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":24287,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/258027429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":258027429},{"type":"v1","addr":"172.21.15.148:6825","nonce":258027429}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":34310,"name":"cephfs.smithi078.furyab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6827/2971989157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2971989157},{"type":"v1","addr":"172.21.15.78:6827","nonce":2971989157}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T12:57:27.052903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:39.186 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 21 2024-09-18T13:15:39.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:39.186+0000 7fdfeaa96640 1 -- 172.21.15.78:0/2390685318 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdfd407af30 msgr2=0x7fdfd407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:39.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:39.186+0000 7fdfeaa96640 1 --2- 172.21.15.78:0/2390685318 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdfd407af30 0x7fdfd407d3f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009930 tx=0x7fdfd8008040 comp rx=0 tx=0).stop 2024-09-18T13:15:39.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:39.186+0000 7fdfeaa96640 1 -- 172.21.15.78:0/2390685318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe4101e80 msgr2=0x7fdfe419cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:39.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:39.186+0000 7fdfeaa96640 1 --2- 172.21.15.78:0/2390685318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe4101e80 0x7fdfe419cbc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0031460 tx=0x7fdfd00048f0 comp rx=0 tx=0).stop 2024-09-18T13:15:39.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:39.186+0000 7fdfeaa96640 1 -- 172.21.15.78:0/2390685318 shutdown_connections 2024-09-18T13:15:39.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:39.186+0000 7fdfeaa96640 1 --2- 172.21.15.78:0/2390685318 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdfd407af30 0x7fdfd407d3f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:39.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:39.186+0000 7fdfeaa96640 1 --2- 172.21.15.78:0/2390685318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe4101e80 0x7fdfe419cbc0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:39.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:39.186+0000 7fdfeaa96640 1 --2- 172.21.15.78:0/2390685318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfe41014d0 0x7fdfe419c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:39.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:39.186+0000 7fdfeaa96640 1 -- 172.21.15.78:0/2390685318 >> 172.21.15.78:0/2390685318 conn(0x7fdfe4077150 msgr2=0x7fdfe40fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:39.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:39.187+0000 7fdfeaa96640 1 -- 172.21.15.78:0/2390685318 shutdown_connections 2024-09-18T13:15:39.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:39.187+0000 7fdfeaa96640 1 -- 172.21.15.78:0/2390685318 wait complete. 2024-09-18T13:15:39.797 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:39 smithi078 ceph-mon[108578]: pgmap v796: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:39.797 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:39 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2390685318' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-18T13:15:39.825 DEBUG:tasks.fs:max_mds not reduced in epoch 21 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-18T13:15:39.826 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-18T13:15:39.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:39 smithi148 ceph-mon[80030]: pgmap v796: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:39.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:39 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2390685318' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-18T13:15:40.074 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.487+0000 7f91a9029640 1 -- 172.21.15.78:0/916680983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a4107900 msgr2=0x7f91a4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.487+0000 7f91a9029640 1 --2- 172.21.15.78:0/916680983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a4107900 0x7f91a4107ce0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f919c009880 tx=0x7f919c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.487+0000 7f91a9029640 1 -- 172.21.15.78:0/916680983 shutdown_connections 2024-09-18T13:15:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.487+0000 7f91a9029640 1 --2- 172.21.15.78:0/916680983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91a4101900 0x7f91a4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.487+0000 7f91a9029640 1 --2- 172.21.15.78:0/916680983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a4107900 0x7f91a4107ce0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.487+0000 7f91a9029640 1 -- 172.21.15.78:0/916680983 >> 172.21.15.78:0/916680983 conn(0x7f91a40fd600 msgr2=0x7f91a40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.487+0000 7f91a9029640 1 -- 172.21.15.78:0/916680983 shutdown_connections 2024-09-18T13:15:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.487+0000 7f91a9029640 1 -- 172.21.15.78:0/916680983 wait complete. 2024-09-18T13:15:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.487+0000 7f91a9029640 1 Processor -- start 2024-09-18T13:15:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.488+0000 7f91a9029640 1 -- start start 2024-09-18T13:15:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.488+0000 7f91a9029640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91a4101900 0x7f91a419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.488+0000 7f91a9029640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a4107900 0x7f91a419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.488+0000 7f91a9029640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f91a410edb0 con 0x7f91a4107900 2024-09-18T13:15:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.488+0000 7f91a9029640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f91a410ec30 con 0x7f91a4101900 2024-09-18T13:15:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.488+0000 7f91a259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a4107900 0x7f91a419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.488+0000 7f91a259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a4107900 0x7f91a419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44884/0 (socket says 172.21.15.78:44884) 2024-09-18T13:15:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.488+0000 7f91a259c640 1 -- 172.21.15.78:0/3718900874 learned_addr learned my addr 172.21.15.78:0/3718900874 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.488+0000 7f91a2d9d640 1 --2- 172.21.15.78:0/3718900874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91a4101900 0x7f91a419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.488+0000 7f91a259c640 1 -- 172.21.15.78:0/3718900874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91a4101900 msgr2=0x7f91a419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.488+0000 7f91a259c640 1 --2- 172.21.15.78:0/3718900874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91a4101900 0x7f91a419d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.488+0000 7f91a259c640 1 -- 172.21.15.78:0/3718900874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a41977e0 con 0x7f91a4107900 2024-09-18T13:15:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.489+0000 7f91a259c640 1 --2- 172.21.15.78:0/3718900874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a4107900 0x7f91a419dba0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f918c00c810 tx=0x7f918c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.489+0000 7f919bfff640 1 -- 172.21.15.78:0/3718900874 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f918c004020 con 0x7f91a4107900 2024-09-18T13:15:40.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.489+0000 7f91a9029640 1 -- 172.21.15.78:0/3718900874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a4197ad0 con 0x7f91a4107900 2024-09-18T13:15:40.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.489+0000 7f919bfff640 1 -- 172.21.15.78:0/3718900874 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f918c0041c0 con 0x7f91a4107900 2024-09-18T13:15:40.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.489+0000 7f919bfff640 1 -- 172.21.15.78:0/3718900874 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f918c0047a0 con 0x7f91a4107900 2024-09-18T13:15:40.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.489+0000 7f91a9029640 1 -- 172.21.15.78:0/3718900874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a4198060 con 0x7f91a4107900 2024-09-18T13:15:40.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.490+0000 7f91a9029640 1 -- 172.21.15.78:0/3718900874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a4103040 con 0x7f91a4107900 2024-09-18T13:15:40.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.490+0000 7f919bfff640 1 -- 172.21.15.78:0/3718900874 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f918c0079b0 con 0x7f91a4107900 2024-09-18T13:15:40.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.491+0000 7f919bfff640 1 --2- 172.21.15.78:0/3718900874 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f919007af30 0x7f919007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:40.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.491+0000 7f91a2d9d640 1 --2- 172.21.15.78:0/3718900874 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f919007af30 0x7f919007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:40.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.491+0000 7f919bfff640 1 -- 172.21.15.78:0/3718900874 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f918c09def0 con 0x7f91a4107900 2024-09-18T13:15:40.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.492+0000 7f91a2d9d640 1 --2- 172.21.15.78:0/3718900874 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f919007af30 0x7f919007d3f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f919c000c00 tx=0x7f919c031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:40.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.495+0000 7f919bfff640 1 -- 172.21.15.78:0/3718900874 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f918c014030 con 0x7f91a4107900 2024-09-18T13:15:40.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.706+0000 7f91a9029640 1 -- 172.21.15.78:0/3718900874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) -- 0x7f91a4104b10 con 0x7f91a4107900 2024-09-18T13:15:40.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.706+0000 7f919bfff640 1 -- 172.21.15.78:0/3718900874 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v36) ==== 107+0+5304 (secure 0 0 0) 0x7f918c069490 con 0x7f91a4107900 2024-09-18T13:15:40.708 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:40.708 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"btime":"2024-09-18T12:57:37:091220+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.148:6827/1048760842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1048760842},{"type":"v1","addr":"172.21.15.148:6827","nonce":1048760842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":24287,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/258027429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":258027429},{"type":"v1","addr":"172.21.15.148:6825","nonce":258027429}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":34310,"name":"cephfs.smithi078.furyab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6827/2971989157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2971989157},{"type":"v1","addr":"172.21.15.78:6827","nonce":2971989157}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34320,"name":"cephfs.smithi078.eakgoe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6829/2241162518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2241162518},{"type":"v1","addr":"172.21.15.78:6829","nonce":2241162518}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T12:57:27.052903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:40.708 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 22 2024-09-18T13:15:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.708+0000 7f91a9029640 1 -- 172.21.15.78:0/3718900874 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f919007af30 msgr2=0x7f919007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.708+0000 7f91a9029640 1 --2- 172.21.15.78:0/3718900874 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f919007af30 0x7f919007d3f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f919c000c00 tx=0x7f919c031400 comp rx=0 tx=0).stop 2024-09-18T13:15:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.709+0000 7f91a9029640 1 -- 172.21.15.78:0/3718900874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a4107900 msgr2=0x7f91a419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.709+0000 7f91a9029640 1 --2- 172.21.15.78:0/3718900874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a4107900 0x7f91a419dba0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f918c00c810 tx=0x7f918c00ccd0 comp rx=0 tx=0).stop 2024-09-18T13:15:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.709+0000 7f91a9029640 1 -- 172.21.15.78:0/3718900874 shutdown_connections 2024-09-18T13:15:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.709+0000 7f91a9029640 1 --2- 172.21.15.78:0/3718900874 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f919007af30 0x7f919007d3f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.709+0000 7f91a9029640 1 --2- 172.21.15.78:0/3718900874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91a4107900 0x7f91a419dba0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.709+0000 7f91a9029640 1 --2- 172.21.15.78:0/3718900874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91a4101900 0x7f91a419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.709+0000 7f91a9029640 1 -- 172.21.15.78:0/3718900874 >> 172.21.15.78:0/3718900874 conn(0x7f91a40fd600 msgr2=0x7f91a40fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:40.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.709+0000 7f91a9029640 1 -- 172.21.15.78:0/3718900874 shutdown_connections 2024-09-18T13:15:40.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:40.709+0000 7f91a9029640 1 -- 172.21.15.78:0/3718900874 wait complete. 2024-09-18T13:15:41.495 DEBUG:tasks.fs:max_mds not reduced in epoch 22 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-18T13:15:41.495 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-18T13:15:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:41 smithi078 ceph-mon[108578]: pgmap v797: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:15:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:41 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3718900874' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-18T13:15:41.746 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:41 smithi148 ceph-mon[80030]: pgmap v797: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:15:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:41 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3718900874' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-18T13:15:42.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.144+0000 7f96b37fb640 1 -- 172.21.15.78:0/2128622419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac107900 msgr2=0x7f96ac107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:42.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.144+0000 7f96b37fb640 1 --2- 172.21.15.78:0/2128622419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac107900 0x7f96ac107ce0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f96a4009880 tx=0x7f96a402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.144+0000 7f96b37fb640 1 -- 172.21.15.78:0/2128622419 shutdown_connections 2024-09-18T13:15:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.144+0000 7f96b37fb640 1 --2- 172.21.15.78:0/2128622419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96ac101900 0x7f96ac101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.144+0000 7f96b37fb640 1 --2- 172.21.15.78:0/2128622419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac107900 0x7f96ac107ce0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.144+0000 7f96b37fb640 1 -- 172.21.15.78:0/2128622419 >> 172.21.15.78:0/2128622419 conn(0x7f96ac0fd600 msgr2=0x7f96ac0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.144+0000 7f96b37fb640 1 -- 172.21.15.78:0/2128622419 shutdown_connections 2024-09-18T13:15:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.144+0000 7f96b37fb640 1 -- 172.21.15.78:0/2128622419 wait complete. 2024-09-18T13:15:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.145+0000 7f96b37fb640 1 Processor -- start 2024-09-18T13:15:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.145+0000 7f96b37fb640 1 -- start start 2024-09-18T13:15:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.145+0000 7f96b37fb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96ac101900 0x7f96ac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.145+0000 7f96b37fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac107900 0x7f96ac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.145+0000 7f96b37fb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac10ee30 con 0x7f96ac107900 2024-09-18T13:15:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.145+0000 7f96b37fb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac10ecb0 con 0x7f96ac101900 2024-09-18T13:15:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.145+0000 7f96b0d96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac107900 0x7f96ac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.145+0000 7f96b0d96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac107900 0x7f96ac074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39970/0 (socket says 172.21.15.78:39970) 2024-09-18T13:15:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.145+0000 7f96b0d96640 1 -- 172.21.15.78:0/871848694 learned_addr learned my addr 172.21.15.78:0/871848694 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.145+0000 7f96b1597640 1 --2- 172.21.15.78:0/871848694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96ac101900 0x7f96ac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.145+0000 7f96b0d96640 1 -- 172.21.15.78:0/871848694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96ac101900 msgr2=0x7f96ac0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.145+0000 7f96b0d96640 1 --2- 172.21.15.78:0/871848694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96ac101900 0x7f96ac0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.145+0000 7f96b0d96640 1 -- 172.21.15.78:0/871848694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ac074f70 con 0x7f96ac107900 2024-09-18T13:15:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.145+0000 7f96b0d96640 1 --2- 172.21.15.78:0/871848694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac107900 0x7f96ac074a30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f96a000b420 tx=0x7f96a000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.146+0000 7f96aa7fc640 1 -- 172.21.15.78:0/871848694 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f96a0011630 con 0x7f96ac107900 2024-09-18T13:15:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.146+0000 7f96b37fb640 1 -- 172.21.15.78:0/871848694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ac075260 con 0x7f96ac107900 2024-09-18T13:15:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.146+0000 7f96aa7fc640 1 -- 172.21.15.78:0/871848694 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f96a0016070 con 0x7f96ac107900 2024-09-18T13:15:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.146+0000 7f96aa7fc640 1 -- 172.21.15.78:0/871848694 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f96a0010d40 con 0x7f96ac107900 2024-09-18T13:15:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.146+0000 7f96b37fb640 1 -- 172.21.15.78:0/871848694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ac1a3e90 con 0x7f96ac107900 2024-09-18T13:15:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.147+0000 7f96b37fb640 1 -- 172.21.15.78:0/871848694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96ac103040 con 0x7f96ac107900 2024-09-18T13:15:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.147+0000 7f96aa7fc640 1 -- 172.21.15.78:0/871848694 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f96a001b460 con 0x7f96ac107900 2024-09-18T13:15:42.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.148+0000 7f96aa7fc640 1 --2- 172.21.15.78:0/871848694 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f969407af30 0x7f969407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:42.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.148+0000 7f96b1597640 1 --2- 172.21.15.78:0/871848694 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f969407af30 0x7f969407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:42.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.148+0000 7f96aa7fc640 1 -- 172.21.15.78:0/871848694 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f96a009d8d0 con 0x7f96ac107900 2024-09-18T13:15:42.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.148+0000 7f96b1597640 1 --2- 172.21.15.78:0/871848694 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f969407af30 0x7f969407d3f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f96a40096c0 tx=0x7f96a4031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:42.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.152+0000 7f96aa7fc640 1 -- 172.21.15.78:0/871848694 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f96a0021250 con 0x7f96ac107900 2024-09-18T13:15:42.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.365+0000 7f96b37fb640 1 -- 172.21.15.78:0/871848694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) -- 0x7f96ac109e70 con 0x7f96ac107900 2024-09-18T13:15:42.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.366+0000 7f96aa7fc640 1 -- 172.21.15.78:0/871848694 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v36) ==== 107+0+4457 (secure 0 0 0) 0x7f96a0068dd0 con 0x7f96ac107900 2024-09-18T13:15:42.368 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:42.369 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"btime":"2024-09-18T12:57:48:450947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.148:6827/1048760842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1048760842},{"type":"v1","addr":"172.21.15.148:6827","nonce":1048760842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":24287,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/258027429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":258027429},{"type":"v1","addr":"172.21.15.148:6825","nonce":258027429}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":34320,"name":"cephfs.smithi078.eakgoe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6829/2241162518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2241162518},{"type":"v1","addr":"172.21.15.78:6829","nonce":2241162518}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T12:57:27.052903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 23 2024-09-18T13:15:42.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.368+0000 7f96b37fb640 1 -- 172.21.15.78:0/871848694 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f969407af30 msgr2=0x7f969407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:42.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.368+0000 7f96b37fb640 1 --2- 172.21.15.78:0/871848694 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f969407af30 0x7f969407d3f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f96a40096c0 tx=0x7f96a4031400 comp rx=0 tx=0).stop 2024-09-18T13:15:42.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.368+0000 7f96b37fb640 1 -- 172.21.15.78:0/871848694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac107900 msgr2=0x7f96ac074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:42.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.368+0000 7f96b37fb640 1 --2- 172.21.15.78:0/871848694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac107900 0x7f96ac074a30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f96a000b420 tx=0x7f96a000b8e0 comp rx=0 tx=0).stop 2024-09-18T13:15:42.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.368+0000 7f96b37fb640 1 -- 172.21.15.78:0/871848694 shutdown_connections 2024-09-18T13:15:42.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.368+0000 7f96b37fb640 1 --2- 172.21.15.78:0/871848694 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f969407af30 0x7f969407d3f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:42.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.368+0000 7f96b37fb640 1 --2- 172.21.15.78:0/871848694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac107900 0x7f96ac074a30 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:42.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.368+0000 7f96b37fb640 1 --2- 172.21.15.78:0/871848694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96ac101900 0x7f96ac0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:42.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.368+0000 7f96b37fb640 1 -- 172.21.15.78:0/871848694 >> 172.21.15.78:0/871848694 conn(0x7f96ac0fd600 msgr2=0x7f96ac0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:42.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.369+0000 7f96b37fb640 1 -- 172.21.15.78:0/871848694 shutdown_connections 2024-09-18T13:15:42.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:42.369+0000 7f96b37fb640 1 -- 172.21.15.78:0/871848694 wait complete. 2024-09-18T13:15:43.030 DEBUG:tasks.fs:max_mds not reduced in epoch 23 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-18T13:15:43.030 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-18T13:15:43.279 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:43.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:43 smithi078 ceph-mon[108578]: pgmap v798: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:43.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:43 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/871848694' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-18T13:15:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:43 smithi148 ceph-mon[80030]: pgmap v798: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:43 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/871848694' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-18T13:15:43.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.716+0000 7fdae85b3640 1 -- 172.21.15.78:0/3340383942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae0107900 msgr2=0x7fdae0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:43.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.716+0000 7fdae85b3640 1 --2- 172.21.15.78:0/3340383942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae0107900 0x7fdae0107ce0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009880 tx=0x7fdadc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:43.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.716+0000 7fdae85b3640 1 -- 172.21.15.78:0/3340383942 shutdown_connections 2024-09-18T13:15:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.716+0000 7fdae85b3640 1 --2- 172.21.15.78:0/3340383942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae0101900 0x7fdae0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.716+0000 7fdae85b3640 1 --2- 172.21.15.78:0/3340383942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae0107900 0x7fdae0107ce0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.716+0000 7fdae85b3640 1 -- 172.21.15.78:0/3340383942 >> 172.21.15.78:0/3340383942 conn(0x7fdae00fd600 msgr2=0x7fdae00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.717+0000 7fdae85b3640 1 -- 172.21.15.78:0/3340383942 shutdown_connections 2024-09-18T13:15:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.717+0000 7fdae85b3640 1 -- 172.21.15.78:0/3340383942 wait complete. 2024-09-18T13:15:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.717+0000 7fdae85b3640 1 Processor -- start 2024-09-18T13:15:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.717+0000 7fdae85b3640 1 -- start start 2024-09-18T13:15:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.717+0000 7fdae85b3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae0101900 0x7fdae019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.717+0000 7fdae85b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae0107900 0x7fdae019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.717+0000 7fdae85b3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdae010edb0 con 0x7fdae0107900 2024-09-18T13:15:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.717+0000 7fdae85b3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdae010ec30 con 0x7fdae0101900 2024-09-18T13:15:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.717+0000 7fdae5b4e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae0107900 0x7fdae019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.718+0000 7fdae5b4e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae0107900 0x7fdae019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39986/0 (socket says 172.21.15.78:39986) 2024-09-18T13:15:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.718+0000 7fdae5b4e640 1 -- 172.21.15.78:0/941385192 learned_addr learned my addr 172.21.15.78:0/941385192 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.718+0000 7fdae634f640 1 --2- 172.21.15.78:0/941385192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae0101900 0x7fdae019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.718+0000 7fdae5b4e640 1 -- 172.21.15.78:0/941385192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae0101900 msgr2=0x7fdae019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.718+0000 7fdae5b4e640 1 --2- 172.21.15.78:0/941385192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae0101900 0x7fdae019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.718+0000 7fdae5b4e640 1 -- 172.21.15.78:0/941385192 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae01977e0 con 0x7fdae0107900 2024-09-18T13:15:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.718+0000 7fdae5b4e640 1 --2- 172.21.15.78:0/941385192 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae0107900 0x7fdae019dba0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdad000d8d0 tx=0x7fdad000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.718+0000 7fdad77fe640 1 -- 172.21.15.78:0/941385192 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdad0017070 con 0x7fdae0107900 2024-09-18T13:15:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.718+0000 7fdad77fe640 1 -- 172.21.15.78:0/941385192 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdad0010460 con 0x7fdae0107900 2024-09-18T13:15:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.718+0000 7fdae85b3640 1 -- 172.21.15.78:0/941385192 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdae0197ad0 con 0x7fdae0107900 2024-09-18T13:15:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.718+0000 7fdad77fe640 1 -- 172.21.15.78:0/941385192 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdad000f5f0 con 0x7fdae0107900 2024-09-18T13:15:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.718+0000 7fdae85b3640 1 -- 172.21.15.78:0/941385192 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdae0198060 con 0x7fdae0107900 2024-09-18T13:15:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.719+0000 7fdae85b3640 1 -- 172.21.15.78:0/941385192 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdae0103040 con 0x7fdae0107900 2024-09-18T13:15:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.720+0000 7fdad77fe640 1 -- 172.21.15.78:0/941385192 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fdad0009a30 con 0x7fdae0107900 2024-09-18T13:15:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.720+0000 7fdad77fe640 1 --2- 172.21.15.78:0/941385192 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdacc07af30 0x7fdacc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.720+0000 7fdad77fe640 1 -- 172.21.15.78:0/941385192 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fdad009df40 con 0x7fdae0107900 2024-09-18T13:15:43.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.720+0000 7fdae634f640 1 --2- 172.21.15.78:0/941385192 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdacc07af30 0x7fdacc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:43.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.721+0000 7fdae634f640 1 --2- 172.21.15.78:0/941385192 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdacc07af30 0x7fdacc07d3f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdadc0096c0 tx=0x7fdadc031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:43.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.725+0000 7fdad77fe640 1 -- 172.21.15.78:0/941385192 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fdad00694e0 con 0x7fdae0107900 2024-09-18T13:15:43.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.934+0000 7fdae85b3640 1 -- 172.21.15.78:0/941385192 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) -- 0x7fdae0104b10 con 0x7fdae0107900 2024-09-18T13:15:43.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.935+0000 7fdad77fe640 1 -- 172.21.15.78:0/941385192 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v36) ==== 107+0+5304 (secure 0 0 0) 0x7fdad006e390 con 0x7fdae0107900 2024-09-18T13:15:43.937 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:43.938 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"btime":"2024-09-18T12:57:53:180863+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.148:6827/1048760842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1048760842},{"type":"v1","addr":"172.21.15.148:6827","nonce":1048760842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":24287,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/258027429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":258027429},{"type":"v1","addr":"172.21.15.148:6825","nonce":258027429}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":34320,"name":"cephfs.smithi078.eakgoe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6829/2241162518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2241162518},{"type":"v1","addr":"172.21.15.78:6829","nonce":2241162518}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":34352,"name":"cephfs.smithi078.furyab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6827/2453525200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2453525200},{"type":"v1","addr":"172.21.15.78:6827","nonce":2453525200}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T12:57:27.052903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:43.938 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 24 2024-09-18T13:15:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.937+0000 7fdae85b3640 1 -- 172.21.15.78:0/941385192 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdacc07af30 msgr2=0x7fdacc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.937+0000 7fdae85b3640 1 --2- 172.21.15.78:0/941385192 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdacc07af30 0x7fdacc07d3f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdadc0096c0 tx=0x7fdadc031400 comp rx=0 tx=0).stop 2024-09-18T13:15:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.937+0000 7fdae85b3640 1 -- 172.21.15.78:0/941385192 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae0107900 msgr2=0x7fdae019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.937+0000 7fdae85b3640 1 --2- 172.21.15.78:0/941385192 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae0107900 0x7fdae019dba0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdad000d8d0 tx=0x7fdad000dd90 comp rx=0 tx=0).stop 2024-09-18T13:15:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.937+0000 7fdae85b3640 1 -- 172.21.15.78:0/941385192 shutdown_connections 2024-09-18T13:15:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.937+0000 7fdae85b3640 1 --2- 172.21.15.78:0/941385192 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fdacc07af30 0x7fdacc07d3f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.937+0000 7fdae85b3640 1 --2- 172.21.15.78:0/941385192 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdae0107900 0x7fdae019dba0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.937+0000 7fdae85b3640 1 --2- 172.21.15.78:0/941385192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdae0101900 0x7fdae019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:43.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.937+0000 7fdae85b3640 1 -- 172.21.15.78:0/941385192 >> 172.21.15.78:0/941385192 conn(0x7fdae00fd600 msgr2=0x7fdae00fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:43.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.937+0000 7fdae85b3640 1 -- 172.21.15.78:0/941385192 shutdown_connections 2024-09-18T13:15:43.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:43.937+0000 7fdae85b3640 1 -- 172.21.15.78:0/941385192 wait complete. 2024-09-18T13:15:44.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:44 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/941385192' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-18T13:15:44.596 DEBUG:tasks.fs:max_mds not reduced in epoch 24 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-18T13:15:44.596 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-18T13:15:44.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:44 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/941385192' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-18T13:15:44.844 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:45.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.249+0000 7f061afba640 1 -- 172.21.15.78:0/1223542006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0614106800 msgr2=0x7f0614106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:45.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.249+0000 7f061afba640 1 --2- 172.21.15.78:0/1223542006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0614106800 0x7f0614106be0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f060c009c20 tx=0x7f060c02a970 comp rx=0 tx=0).stop 2024-09-18T13:15:45.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.249+0000 7f061afba640 1 -- 172.21.15.78:0/1223542006 shutdown_connections 2024-09-18T13:15:45.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.249+0000 7f061afba640 1 --2- 172.21.15.78:0/1223542006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0614100800 0x7f0614100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:45.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.249+0000 7f061afba640 1 --2- 172.21.15.78:0/1223542006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0614106800 0x7f0614106be0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:45.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.249+0000 7f061afba640 1 -- 172.21.15.78:0/1223542006 >> 172.21.15.78:0/1223542006 conn(0x7f06140fc520 msgr2=0x7f06140fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:45.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.249+0000 7f061afba640 1 -- 172.21.15.78:0/1223542006 shutdown_connections 2024-09-18T13:15:45.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.249+0000 7f061afba640 1 -- 172.21.15.78:0/1223542006 wait complete. 2024-09-18T13:15:45.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.250+0000 7f061afba640 1 Processor -- start 2024-09-18T13:15:45.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.250+0000 7f061afba640 1 -- start start 2024-09-18T13:15:45.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.250+0000 7f061afba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0614100800 0x7f0614198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:45.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.250+0000 7f061afba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0614106800 0x7f0614198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:45.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.250+0000 7f061afba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f061410dcd0 con 0x7f0614106800 2024-09-18T13:15:45.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.250+0000 7f061afba640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f061410db50 con 0x7f0614100800 2024-09-18T13:15:45.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.250+0000 7f0613fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0614106800 0x7f0614198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:45.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.250+0000 7f0613fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0614106800 0x7f0614198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40006/0 (socket says 172.21.15.78:40006) 2024-09-18T13:15:45.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.250+0000 7f0613fff640 1 -- 172.21.15.78:0/2328543943 learned_addr learned my addr 172.21.15.78:0/2328543943 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:45.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.251+0000 7f0618d56640 1 --2- 172.21.15.78:0/2328543943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0614100800 0x7f0614198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:45.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.251+0000 7f0613fff640 1 -- 172.21.15.78:0/2328543943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0614100800 msgr2=0x7f0614198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:45.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.251+0000 7f0613fff640 1 --2- 172.21.15.78:0/2328543943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0614100800 0x7f0614198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:45.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.251+0000 7f0613fff640 1 -- 172.21.15.78:0/2328543943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0614199360 con 0x7f0614106800 2024-09-18T13:15:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.251+0000 7f0613fff640 1 --2- 172.21.15.78:0/2328543943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0614106800 0x7f0614198d60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f060800d6f0 tx=0x7f060800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.251+0000 7f0611ffb640 1 -- 172.21.15.78:0/2328543943 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0608017070 con 0x7f0614106800 2024-09-18T13:15:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.251+0000 7f0611ffb640 1 -- 172.21.15.78:0/2328543943 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f060800de00 con 0x7f0614106800 2024-09-18T13:15:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.251+0000 7f0611ffb640 1 -- 172.21.15.78:0/2328543943 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0608004bb0 con 0x7f0614106800 2024-09-18T13:15:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.251+0000 7f061afba640 1 -- 172.21.15.78:0/2328543943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0614199650 con 0x7f0614106800 2024-09-18T13:15:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.251+0000 7f061afba640 1 -- 172.21.15.78:0/2328543943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06141a1c50 con 0x7f0614106800 2024-09-18T13:15:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.252+0000 7f061afba640 1 -- 172.21.15.78:0/2328543943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0614101f40 con 0x7f0614106800 2024-09-18T13:15:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.253+0000 7f0611ffb640 1 -- 172.21.15.78:0/2328543943 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f0608004e60 con 0x7f0614106800 2024-09-18T13:15:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.253+0000 7f0611ffb640 1 --2- 172.21.15.78:0/2328543943 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f05fc07af30 0x7f05fc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.254+0000 7f0611ffb640 1 -- 172.21.15.78:0/2328543943 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f060809dca0 con 0x7f0614106800 2024-09-18T13:15:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.254+0000 7f0618d56640 1 --2- 172.21.15.78:0/2328543943 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f05fc07af30 0x7f05fc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.254+0000 7f0618d56640 1 --2- 172.21.15.78:0/2328543943 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f05fc07af30 0x7f05fc07d3f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f060c009430 tx=0x7f060c03c040 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:45.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.258+0000 7f0611ffb640 1 -- 172.21.15.78:0/2328543943 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f0614199650 con 0x7f0614106800 2024-09-18T13:15:45.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.468+0000 7f061afba640 1 -- 172.21.15.78:0/2328543943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) -- 0x7f0614108d70 con 0x7f0614106800 2024-09-18T13:15:45.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.469+0000 7f0611ffb640 1 -- 172.21.15.78:0/2328543943 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v36) ==== 107+0+4457 (secure 0 0 0) 0x7f06080691a0 con 0x7f0614106800 2024-09-18T13:15:45.471 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:45.471 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"btime":"2024-09-18T12:58:04:906467+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.148:6827/1048760842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1048760842},{"type":"v1","addr":"172.21.15.148:6827","nonce":1048760842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34320,"name":"cephfs.smithi078.eakgoe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6829/2241162518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2241162518},{"type":"v1","addr":"172.21.15.78:6829","nonce":2241162518}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":34352,"name":"cephfs.smithi078.furyab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6827/2453525200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2453525200},{"type":"v1","addr":"172.21.15.78:6827","nonce":2453525200}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T12:57:27.052903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:45.471 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 25 2024-09-18T13:15:45.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.471+0000 7f061afba640 1 -- 172.21.15.78:0/2328543943 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f05fc07af30 msgr2=0x7f05fc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:45.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.471+0000 7f061afba640 1 --2- 172.21.15.78:0/2328543943 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f05fc07af30 0x7f05fc07d3f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f060c009430 tx=0x7f060c03c040 comp rx=0 tx=0).stop 2024-09-18T13:15:45.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.471+0000 7f061afba640 1 -- 172.21.15.78:0/2328543943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0614106800 msgr2=0x7f0614198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:45.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.471+0000 7f061afba640 1 --2- 172.21.15.78:0/2328543943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0614106800 0x7f0614198d60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f060800d6f0 tx=0x7f060800dbb0 comp rx=0 tx=0).stop 2024-09-18T13:15:45.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.471+0000 7f061afba640 1 -- 172.21.15.78:0/2328543943 shutdown_connections 2024-09-18T13:15:45.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.471+0000 7f061afba640 1 --2- 172.21.15.78:0/2328543943 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f05fc07af30 0x7f05fc07d3f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:45.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.471+0000 7f061afba640 1 --2- 172.21.15.78:0/2328543943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0614106800 0x7f0614198d60 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:45.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.471+0000 7f061afba640 1 --2- 172.21.15.78:0/2328543943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0614100800 0x7f0614198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:45.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.471+0000 7f061afba640 1 -- 172.21.15.78:0/2328543943 >> 172.21.15.78:0/2328543943 conn(0x7f06140fc520 msgr2=0x7f06140fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:45.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.471+0000 7f061afba640 1 -- 172.21.15.78:0/2328543943 shutdown_connections 2024-09-18T13:15:45.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:45.471+0000 7f061afba640 1 -- 172.21.15.78:0/2328543943 wait complete. 2024-09-18T13:15:45.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:45 smithi078 ceph-mon[108578]: pgmap v799: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:45 smithi148 ceph-mon[80030]: pgmap v799: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:46.122 DEBUG:tasks.fs:max_mds not reduced in epoch 25 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-18T13:15:46.123 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-18T13:15:46.372 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:46.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:46 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2328543943' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-18T13:15:46.701 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:46 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2328543943' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-18T13:15:46.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.842+0000 7f9a3a1e7640 1 -- 172.21.15.78:0/848775260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a34106800 msgr2=0x7f9a34106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:46.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.842+0000 7f9a3a1e7640 1 --2- 172.21.15.78:0/848775260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a34106800 0x7f9a34106be0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009c20 tx=0x7f9a2402a970 comp rx=0 tx=0).stop 2024-09-18T13:15:46.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.842+0000 7f9a3a1e7640 1 -- 172.21.15.78:0/848775260 shutdown_connections 2024-09-18T13:15:46.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.842+0000 7f9a3a1e7640 1 --2- 172.21.15.78:0/848775260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a34100800 0x7f9a34100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:46.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.842+0000 7f9a3a1e7640 1 --2- 172.21.15.78:0/848775260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a34106800 0x7f9a34106be0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:46.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.842+0000 7f9a3a1e7640 1 -- 172.21.15.78:0/848775260 >> 172.21.15.78:0/848775260 conn(0x7f9a340fc520 msgr2=0x7f9a340fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:46.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.842+0000 7f9a3a1e7640 1 -- 172.21.15.78:0/848775260 shutdown_connections 2024-09-18T13:15:46.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.842+0000 7f9a3a1e7640 1 -- 172.21.15.78:0/848775260 wait complete. 2024-09-18T13:15:46.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.842+0000 7f9a3a1e7640 1 Processor -- start 2024-09-18T13:15:46.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.843+0000 7f9a3a1e7640 1 -- start start 2024-09-18T13:15:46.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.843+0000 7f9a3a1e7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a34100800 0x7f9a340fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:46.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.843+0000 7f9a3a1e7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a34106800 0x7f9a340fd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:46.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.843+0000 7f9a3a1e7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3410dcd0 con 0x7f9a34106800 2024-09-18T13:15:46.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.843+0000 7f9a3a1e7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3410db50 con 0x7f9a34100800 2024-09-18T13:15:46.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.843+0000 7f9a32ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a34106800 0x7f9a340fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:46.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.843+0000 7f9a32ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a34106800 0x7f9a340fd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40026/0 (socket says 172.21.15.78:40026) 2024-09-18T13:15:46.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.843+0000 7f9a32ffd640 1 -- 172.21.15.78:0/271277187 learned_addr learned my addr 172.21.15.78:0/271277187 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:46.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.843+0000 7f9a337fe640 1 --2- 172.21.15.78:0/271277187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a34100800 0x7f9a340fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:46.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.843+0000 7f9a32ffd640 1 -- 172.21.15.78:0/271277187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a34100800 msgr2=0x7f9a340fcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:46.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.843+0000 7f9a32ffd640 1 --2- 172.21.15.78:0/271277187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a34100800 0x7f9a340fcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:46.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.843+0000 7f9a32ffd640 1 -- 172.21.15.78:0/271277187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a340fd6d0 con 0x7f9a34106800 2024-09-18T13:15:46.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.843+0000 7f9a337fe640 1 --2- 172.21.15.78:0/271277187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a34100800 0x7f9a340fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:15:46.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.843+0000 7f9a32ffd640 1 --2- 172.21.15.78:0/271277187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a34106800 0x7f9a340fd190 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800d6f0 tx=0x7f9a2800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:46.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.843+0000 7f9a30ff9640 1 -- 172.21.15.78:0/271277187 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a28017070 con 0x7f9a34106800 2024-09-18T13:15:46.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.844+0000 7f9a30ff9640 1 -- 172.21.15.78:0/271277187 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a2800de00 con 0x7f9a34106800 2024-09-18T13:15:46.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.844+0000 7f9a3a1e7640 1 -- 172.21.15.78:0/271277187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a340fd9c0 con 0x7f9a34106800 2024-09-18T13:15:46.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.844+0000 7f9a30ff9640 1 -- 172.21.15.78:0/271277187 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a28004bb0 con 0x7f9a34106800 2024-09-18T13:15:46.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.844+0000 7f9a3a1e7640 1 -- 172.21.15.78:0/271277187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a341a3ea0 con 0x7f9a34106800 2024-09-18T13:15:46.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.845+0000 7f9a3a1e7640 1 -- 172.21.15.78:0/271277187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a34101f40 con 0x7f9a34106800 2024-09-18T13:15:46.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.845+0000 7f9a30ff9640 1 -- 172.21.15.78:0/271277187 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9a28004e60 con 0x7f9a34106800 2024-09-18T13:15:46.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.846+0000 7f9a30ff9640 1 --2- 172.21.15.78:0/271277187 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9a1c07af30 0x7f9a1c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:46.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.846+0000 7f9a30ff9640 1 -- 172.21.15.78:0/271277187 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f9a2809dcf0 con 0x7f9a34106800 2024-09-18T13:15:46.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.846+0000 7f9a337fe640 1 --2- 172.21.15.78:0/271277187 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9a1c07af30 0x7f9a1c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:46.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.846+0000 7f9a337fe640 1 --2- 172.21.15.78:0/271277187 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9a1c07af30 0x7f9a1c07d3f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9a24006010 tx=0x7f9a2402f9d0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:46.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:46.850+0000 7f9a30ff9640 1 -- 172.21.15.78:0/271277187 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9a28069230 con 0x7f9a34106800 2024-09-18T13:15:47.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:47.063+0000 7f9a3a1e7640 1 -- 172.21.15.78:0/271277187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) -- 0x7f9a34100c60 con 0x7f9a34106800 2024-09-18T13:15:47.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:47.063+0000 7f9a30ff9640 1 -- 172.21.15.78:0/271277187 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v36) ==== 107+0+5307 (secure 0 0 0) 0x7f9a2806e0e0 con 0x7f9a34106800 2024-09-18T13:15:47.066 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:47.066 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"btime":"2024-09-18T12:58:10:183617+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.148:6827/1048760842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1048760842},{"type":"v1","addr":"172.21.15.148:6827","nonce":1048760842}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34320,"name":"cephfs.smithi078.eakgoe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6829/2241162518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2241162518},{"type":"v1","addr":"172.21.15.78:6829","nonce":2241162518}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":34352,"name":"cephfs.smithi078.furyab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6827/2453525200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2453525200},{"type":"v1","addr":"172.21.15.78:6827","nonce":2453525200}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44293,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/2385856084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2385856084},{"type":"v1","addr":"172.21.15.148:6825","nonce":2385856084}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T12:57:27.052903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:47.066 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 26 2024-09-18T13:15:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:47.065+0000 7f9a3a1e7640 1 -- 172.21.15.78:0/271277187 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9a1c07af30 msgr2=0x7f9a1c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:47.065+0000 7f9a3a1e7640 1 --2- 172.21.15.78:0/271277187 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9a1c07af30 0x7f9a1c07d3f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9a24006010 tx=0x7f9a2402f9d0 comp rx=0 tx=0).stop 2024-09-18T13:15:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:47.065+0000 7f9a3a1e7640 1 -- 172.21.15.78:0/271277187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a34106800 msgr2=0x7f9a340fd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:47.065+0000 7f9a3a1e7640 1 --2- 172.21.15.78:0/271277187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a34106800 0x7f9a340fd190 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800d6f0 tx=0x7f9a2800dbb0 comp rx=0 tx=0).stop 2024-09-18T13:15:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:47.065+0000 7f9a3a1e7640 1 -- 172.21.15.78:0/271277187 shutdown_connections 2024-09-18T13:15:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:47.065+0000 7f9a3a1e7640 1 --2- 172.21.15.78:0/271277187 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f9a1c07af30 0x7f9a1c07d3f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:47.065+0000 7f9a3a1e7640 1 --2- 172.21.15.78:0/271277187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a34106800 0x7f9a340fd190 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:47.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:47.065+0000 7f9a3a1e7640 1 --2- 172.21.15.78:0/271277187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a34100800 0x7f9a340fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:47.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:47.065+0000 7f9a3a1e7640 1 -- 172.21.15.78:0/271277187 >> 172.21.15.78:0/271277187 conn(0x7f9a340fc520 msgr2=0x7f9a3406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:47.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:47.066+0000 7f9a3a1e7640 1 -- 172.21.15.78:0/271277187 shutdown_connections 2024-09-18T13:15:47.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:47.066+0000 7f9a3a1e7640 1 -- 172.21.15.78:0/271277187 wait complete. 2024-09-18T13:15:47.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:47 smithi078 ceph-mon[108578]: pgmap v800: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:47.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:47 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/271277187' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-18T13:15:47.654 DEBUG:tasks.fs:max_mds not reduced in epoch 26 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-18T13:15:47.654 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-18T13:15:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:47 smithi148 ceph-mon[80030]: pgmap v800: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:47.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:47 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/271277187' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-18T13:15:47.908 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:48.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.366+0000 7fbfcc863640 1 -- 172.21.15.78:0/647762314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc8101960 msgr2=0x7fbfc8101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:48.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.366+0000 7fbfcc863640 1 --2- 172.21.15.78:0/647762314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc8101960 0x7fbfc8101dc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009880 tx=0x7fbfbc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:48.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.366+0000 7fbfcc863640 1 -- 172.21.15.78:0/647762314 shutdown_connections 2024-09-18T13:15:48.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.366+0000 7fbfcc863640 1 --2- 172.21.15.78:0/647762314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc8101960 0x7fbfc8101dc0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:48.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.366+0000 7fbfcc863640 1 --2- 172.21.15.78:0/647762314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc8107960 0x7fbfc8107d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:48.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.366+0000 7fbfcc863640 1 -- 172.21.15.78:0/647762314 >> 172.21.15.78:0/647762314 conn(0x7fbfc80fd680 msgr2=0x7fbfc80ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:48.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.366+0000 7fbfcc863640 1 -- 172.21.15.78:0/647762314 shutdown_connections 2024-09-18T13:15:48.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.366+0000 7fbfcc863640 1 -- 172.21.15.78:0/647762314 wait complete. 2024-09-18T13:15:48.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.367+0000 7fbfcc863640 1 Processor -- start 2024-09-18T13:15:48.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.367+0000 7fbfcc863640 1 -- start start 2024-09-18T13:15:48.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.367+0000 7fbfcc863640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc8101960 0x7fbfc819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.367+0000 7fbfcc863640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc8107960 0x7fbfc819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.367+0000 7fbfcc863640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc810ee10 con 0x7fbfc8101960 2024-09-18T13:15:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.367+0000 7fbfcc863640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc810ec90 con 0x7fbfc8107960 2024-09-18T13:15:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.367+0000 7fbfc659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc8101960 0x7fbfc819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.368+0000 7fbfc659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc8101960 0x7fbfc819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40044/0 (socket says 172.21.15.78:40044) 2024-09-18T13:15:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.368+0000 7fbfc659c640 1 -- 172.21.15.78:0/949484885 learned_addr learned my addr 172.21.15.78:0/949484885 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.368+0000 7fbfc5d9b640 1 --2- 172.21.15.78:0/949484885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc8107960 0x7fbfc819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.368+0000 7fbfc659c640 1 -- 172.21.15.78:0/949484885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc8107960 msgr2=0x7fbfc819dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.368+0000 7fbfc659c640 1 --2- 172.21.15.78:0/949484885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc8107960 0x7fbfc819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.368+0000 7fbfc659c640 1 -- 172.21.15.78:0/949484885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc8197820 con 0x7fbfc8101960 2024-09-18T13:15:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.368+0000 7fbfc659c640 1 --2- 172.21.15.78:0/949484885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc8101960 0x7fbfc819d6a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800c8a0 tx=0x7fbfb800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.368+0000 7fbfb77fe640 1 -- 172.21.15.78:0/949484885 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbfb80079b0 con 0x7fbfc8101960 2024-09-18T13:15:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.368+0000 7fbfcc863640 1 -- 172.21.15.78:0/949484885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc8197b10 con 0x7fbfc8101960 2024-09-18T13:15:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.368+0000 7fbfb77fe640 1 -- 172.21.15.78:0/949484885 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbfb8007b50 con 0x7fbfc8101960 2024-09-18T13:15:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.368+0000 7fbfb77fe640 1 -- 172.21.15.78:0/949484885 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbfb8018700 con 0x7fbfc8101960 2024-09-18T13:15:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.368+0000 7fbfcc863640 1 -- 172.21.15.78:0/949484885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc81980a0 con 0x7fbfc8101960 2024-09-18T13:15:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.369+0000 7fbfcc863640 1 -- 172.21.15.78:0/949484885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc81030a0 con 0x7fbfc8101960 2024-09-18T13:15:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.370+0000 7fbfb77fe640 1 -- 172.21.15.78:0/949484885 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbfb80188c0 con 0x7fbfc8101960 2024-09-18T13:15:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.370+0000 7fbfb77fe640 1 --2- 172.21.15.78:0/949484885 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbfb007af30 0x7fbfb007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.370+0000 7fbfc5d9b640 1 --2- 172.21.15.78:0/949484885 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbfb007af30 0x7fbfb007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.370+0000 7fbfb77fe640 1 -- 172.21.15.78:0/949484885 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fbfb809e350 con 0x7fbfc8101960 2024-09-18T13:15:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.371+0000 7fbfc5d9b640 1 --2- 172.21.15.78:0/949484885 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbfb007af30 0x7fbfb007d3f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc031460 tx=0x7fbfbc009560 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.375+0000 7fbfb77fe640 1 -- 172.21.15.78:0/949484885 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbfb8014030 con 0x7fbfc8101960 2024-09-18T13:15:48.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.585+0000 7fbfcc863640 1 -- 172.21.15.78:0/949484885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) -- 0x7fbfc8198d50 con 0x7fbfc8101960 2024-09-18T13:15:48.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.586+0000 7fbfb77fe640 1 -- 172.21.15.78:0/949484885 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v36) ==== 107+0+4457 (secure 0 0 0) 0x7fbfb80698f0 con 0x7fbfc8101960 2024-09-18T13:15:48.587 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:48.587 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":27,"btime":"2024-09-18T12:58:19:993531+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34320,"name":"cephfs.smithi078.eakgoe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6829/2241162518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2241162518},{"type":"v1","addr":"172.21.15.78:6829","nonce":2241162518}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":34352,"name":"cephfs.smithi078.furyab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6827/2453525200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2453525200},{"type":"v1","addr":"172.21.15.78:6827","nonce":2453525200}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44293,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/2385856084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2385856084},{"type":"v1","addr":"172.21.15.148:6825","nonce":2385856084}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T12:57:27.052903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:48.587 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 27 2024-09-18T13:15:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.588+0000 7fbfcc863640 1 -- 172.21.15.78:0/949484885 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbfb007af30 msgr2=0x7fbfb007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.588+0000 7fbfcc863640 1 --2- 172.21.15.78:0/949484885 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbfb007af30 0x7fbfb007d3f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc031460 tx=0x7fbfbc009560 comp rx=0 tx=0).stop 2024-09-18T13:15:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.588+0000 7fbfcc863640 1 -- 172.21.15.78:0/949484885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc8101960 msgr2=0x7fbfc819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.588+0000 7fbfcc863640 1 --2- 172.21.15.78:0/949484885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc8101960 0x7fbfc819d6a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800c8a0 tx=0x7fbfb800cd60 comp rx=0 tx=0).stop 2024-09-18T13:15:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.588+0000 7fbfcc863640 1 -- 172.21.15.78:0/949484885 shutdown_connections 2024-09-18T13:15:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.588+0000 7fbfcc863640 1 --2- 172.21.15.78:0/949484885 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbfb007af30 0x7fbfb007d3f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:48.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.588+0000 7fbfcc863640 1 --2- 172.21.15.78:0/949484885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc8107960 0x7fbfc819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:48.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.588+0000 7fbfcc863640 1 --2- 172.21.15.78:0/949484885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc8101960 0x7fbfc819d6a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:48.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.588+0000 7fbfcc863640 1 -- 172.21.15.78:0/949484885 >> 172.21.15.78:0/949484885 conn(0x7fbfc80fd680 msgr2=0x7fbfc80fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:48.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.588+0000 7fbfcc863640 1 -- 172.21.15.78:0/949484885 shutdown_connections 2024-09-18T13:15:48.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:48.588+0000 7fbfcc863640 1 -- 172.21.15.78:0/949484885 wait complete. 2024-09-18T13:15:49.178 DEBUG:tasks.fs:max_mds not reduced in epoch 27 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-18T13:15:49.179 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-18T13:15:49.430 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:49.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:49 smithi078 ceph-mon[108578]: pgmap v801: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:49.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:49 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/949484885' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-18T13:15:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:49 smithi148 ceph-mon[80030]: pgmap v801: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:49.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:49 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/949484885' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-18T13:15:49.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.852+0000 7fbae1b4f640 1 -- 172.21.15.78:0/1474774829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbadc1067f0 msgr2=0x7fbadc106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:49.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.852+0000 7fbae1b4f640 1 --2- 172.21.15.78:0/1474774829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbadc1067f0 0x7fbadc106bd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbacc009880 tx=0x7fbacc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:49.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.852+0000 7fbae1b4f640 1 -- 172.21.15.78:0/1474774829 shutdown_connections 2024-09-18T13:15:49.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.852+0000 7fbae1b4f640 1 --2- 172.21.15.78:0/1474774829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbadc1007f0 0x7fbadc100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:49.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.852+0000 7fbae1b4f640 1 --2- 172.21.15.78:0/1474774829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbadc1067f0 0x7fbadc106bd0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:49.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.852+0000 7fbae1b4f640 1 -- 172.21.15.78:0/1474774829 >> 172.21.15.78:0/1474774829 conn(0x7fbadc0fc550 msgr2=0x7fbadc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:49.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.852+0000 7fbae1b4f640 1 -- 172.21.15.78:0/1474774829 shutdown_connections 2024-09-18T13:15:49.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.852+0000 7fbae1b4f640 1 -- 172.21.15.78:0/1474774829 wait complete. 2024-09-18T13:15:49.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.853+0000 7fbae1b4f640 1 Processor -- start 2024-09-18T13:15:49.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.853+0000 7fbae1b4f640 1 -- start start 2024-09-18T13:15:49.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.853+0000 7fbae1b4f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbadc1007f0 0x7fbadc19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:49.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.853+0000 7fbae1b4f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbadc1067f0 0x7fbadc19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:49.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.853+0000 7fbae1b4f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc10dcc0 con 0x7fbadc1067f0 2024-09-18T13:15:49.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.853+0000 7fbae1b4f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc10db40 con 0x7fbadc1007f0 2024-09-18T13:15:49.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.853+0000 7fbadaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbadc1067f0 0x7fbadc19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:49.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.853+0000 7fbadaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbadc1067f0 0x7fbadc19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40060/0 (socket says 172.21.15.78:40060) 2024-09-18T13:15:49.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.853+0000 7fbadaffd640 1 -- 172.21.15.78:0/3360498527 learned_addr learned my addr 172.21.15.78:0/3360498527 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:49.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.853+0000 7fbadb7fe640 1 --2- 172.21.15.78:0/3360498527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbadc1007f0 0x7fbadc19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:49.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.854+0000 7fbadaffd640 1 -- 172.21.15.78:0/3360498527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbadc1007f0 msgr2=0x7fbadc19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:49.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.854+0000 7fbadaffd640 1 --2- 172.21.15.78:0/3360498527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbadc1007f0 0x7fbadc19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:49.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.854+0000 7fbadaffd640 1 -- 172.21.15.78:0/3360498527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbadc1977e0 con 0x7fbadc1067f0 2024-09-18T13:15:49.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.854+0000 7fbadaffd640 1 --2- 172.21.15.78:0/3360498527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbadc1067f0 0x7fbadc19dba0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbad000d6f0 tx=0x7fbad000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:49.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.854+0000 7fbad8ff9640 1 -- 172.21.15.78:0/3360498527 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbad0017070 con 0x7fbadc1067f0 2024-09-18T13:15:49.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.854+0000 7fbad8ff9640 1 -- 172.21.15.78:0/3360498527 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbad000de00 con 0x7fbadc1067f0 2024-09-18T13:15:49.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.854+0000 7fbad8ff9640 1 -- 172.21.15.78:0/3360498527 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbad0004bb0 con 0x7fbadc1067f0 2024-09-18T13:15:49.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.854+0000 7fbae1b4f640 1 -- 172.21.15.78:0/3360498527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbadc197ad0 con 0x7fbadc1067f0 2024-09-18T13:15:49.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.854+0000 7fbae1b4f640 1 -- 172.21.15.78:0/3360498527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbadc198060 con 0x7fbadc1067f0 2024-09-18T13:15:49.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.855+0000 7fbae1b4f640 1 -- 172.21.15.78:0/3360498527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbadc101f30 con 0x7fbadc1067f0 2024-09-18T13:15:49.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.856+0000 7fbad8ff9640 1 -- 172.21.15.78:0/3360498527 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbad0010460 con 0x7fbadc1067f0 2024-09-18T13:15:49.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.856+0000 7fbad8ff9640 1 --2- 172.21.15.78:0/3360498527 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbac407af80 0x7fbac407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:49.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.856+0000 7fbad8ff9640 1 -- 172.21.15.78:0/3360498527 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fbad009db20 con 0x7fbadc1067f0 2024-09-18T13:15:49.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.856+0000 7fbadb7fe640 1 --2- 172.21.15.78:0/3360498527 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbac407af80 0x7fbac407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:49.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.857+0000 7fbadb7fe640 1 --2- 172.21.15.78:0/3360498527 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbac407af80 0x7fbac407d440 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0096c0 tx=0x7fbacc031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:49.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:49.861+0000 7fbad8ff9640 1 -- 172.21.15.78:0/3360498527 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbad0069140 con 0x7fbadc1067f0 2024-09-18T13:15:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:50.091+0000 7fbae1b4f640 1 -- 172.21.15.78:0/3360498527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) -- 0x7fbadc109d70 con 0x7fbadc1067f0 2024-09-18T13:15:50.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:50.091+0000 7fbad8ff9640 1 -- 172.21.15.78:0/3360498527 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v36) ==== 107+0+5307 (secure 0 0 0) 0x7fbad006dff0 con 0x7fbadc1067f0 2024-09-18T13:15:50.093 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:50.093 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":28,"btime":"2024-09-18T12:58:24:186744+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34320,"name":"cephfs.smithi078.eakgoe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6829/2241162518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2241162518},{"type":"v1","addr":"172.21.15.78:6829","nonce":2241162518}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":34352,"name":"cephfs.smithi078.furyab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6827/2453525200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2453525200},{"type":"v1","addr":"172.21.15.78:6827","nonce":2453525200}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44293,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/2385856084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2385856084},{"type":"v1","addr":"172.21.15.148:6825","nonce":2385856084}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/3319905864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3319905864},{"type":"v1","addr":"172.21.15.148:6827","nonce":3319905864}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T12:57:27.052903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:50.093 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 28 2024-09-18T13:15:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:50.094+0000 7fbae1b4f640 1 -- 172.21.15.78:0/3360498527 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbac407af80 msgr2=0x7fbac407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:50.094+0000 7fbae1b4f640 1 --2- 172.21.15.78:0/3360498527 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbac407af80 0x7fbac407d440 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0096c0 tx=0x7fbacc031400 comp rx=0 tx=0).stop 2024-09-18T13:15:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:50.094+0000 7fbae1b4f640 1 -- 172.21.15.78:0/3360498527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbadc1067f0 msgr2=0x7fbadc19dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:50.094+0000 7fbae1b4f640 1 --2- 172.21.15.78:0/3360498527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbadc1067f0 0x7fbadc19dba0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbad000d6f0 tx=0x7fbad000dbb0 comp rx=0 tx=0).stop 2024-09-18T13:15:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:50.094+0000 7fbae1b4f640 1 -- 172.21.15.78:0/3360498527 shutdown_connections 2024-09-18T13:15:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:50.094+0000 7fbae1b4f640 1 --2- 172.21.15.78:0/3360498527 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fbac407af80 0x7fbac407d440 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:50.094+0000 7fbae1b4f640 1 --2- 172.21.15.78:0/3360498527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbadc1067f0 0x7fbadc19dba0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:50.094+0000 7fbae1b4f640 1 --2- 172.21.15.78:0/3360498527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbadc1007f0 0x7fbadc19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:50.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:50.094+0000 7fbae1b4f640 1 -- 172.21.15.78:0/3360498527 >> 172.21.15.78:0/3360498527 conn(0x7fbadc0fc550 msgr2=0x7fbadc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:50.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:50.094+0000 7fbae1b4f640 1 -- 172.21.15.78:0/3360498527 shutdown_connections 2024-09-18T13:15:50.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:50.094+0000 7fbae1b4f640 1 -- 172.21.15.78:0/3360498527 wait complete. 2024-09-18T13:15:50.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:50 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:15:50.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:50 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:15:50.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:50 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:15:50.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:50 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:15:50.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:50 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3360498527' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-18T13:15:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:50 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:15:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:50 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:15:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:50 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:15:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:50 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:15:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:50 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3360498527' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-18T13:15:50.780 DEBUG:tasks.fs:max_mds not reduced in epoch 28 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-18T13:15:50.780 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-18T13:15:51.031 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:51.460 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:51 smithi078 ceph-mon[108578]: pgmap v802: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:51.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.459+0000 7efc673d5640 1 -- 172.21.15.78:0/900313055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc601011d0 msgr2=0x7efc601056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:51.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.459+0000 7efc673d5640 1 --2- 172.21.15.78:0/900313055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc601011d0 0x7efc601056a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7efc50009880 tx=0x7efc5002a530 comp rx=0 tx=0).stop 2024-09-18T13:15:51.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.459+0000 7efc673d5640 1 -- 172.21.15.78:0/900313055 shutdown_connections 2024-09-18T13:15:51.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.459+0000 7efc673d5640 1 --2- 172.21.15.78:0/900313055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc601011d0 0x7efc601056a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:51.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.459+0000 7efc673d5640 1 --2- 172.21.15.78:0/900313055 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc601008b0 0x7efc60100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:51.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.459+0000 7efc673d5640 1 -- 172.21.15.78:0/900313055 >> 172.21.15.78:0/900313055 conn(0x7efc600fc520 msgr2=0x7efc600fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:51.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.459+0000 7efc673d5640 1 -- 172.21.15.78:0/900313055 shutdown_connections 2024-09-18T13:15:51.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.459+0000 7efc673d5640 1 -- 172.21.15.78:0/900313055 wait complete. 2024-09-18T13:15:51.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.459+0000 7efc673d5640 1 Processor -- start 2024-09-18T13:15:51.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.459+0000 7efc673d5640 1 -- start start 2024-09-18T13:15:51.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc673d5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc601008b0 0x7efc6019dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:51.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc673d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc601011d0 0x7efc6019e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:51.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc673d5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efc601153f0 con 0x7efc601011d0 2024-09-18T13:15:51.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc673d5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efc60115270 con 0x7efc601008b0 2024-09-18T13:15:51.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc64970640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc601011d0 0x7efc6019e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:51.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc64970640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc601011d0 0x7efc6019e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40476/0 (socket says 172.21.15.78:40476) 2024-09-18T13:15:51.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc64970640 1 -- 172.21.15.78:0/1048957782 learned_addr learned my addr 172.21.15.78:0/1048957782 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:51.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc65171640 1 --2- 172.21.15.78:0/1048957782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc601008b0 0x7efc6019dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:51.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc64970640 1 -- 172.21.15.78:0/1048957782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc601008b0 msgr2=0x7efc6019dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:51.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc64970640 1 --2- 172.21.15.78:0/1048957782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc601008b0 0x7efc6019dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:51.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc64970640 1 -- 172.21.15.78:0/1048957782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc601a28a0 con 0x7efc601011d0 2024-09-18T13:15:51.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc64970640 1 --2- 172.21.15.78:0/1048957782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc601011d0 0x7efc6019e510 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efc50031460 tx=0x7efc50004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:51.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc567fc640 1 -- 172.21.15.78:0/1048957782 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc5003f070 con 0x7efc601011d0 2024-09-18T13:15:51.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc567fc640 1 -- 172.21.15.78:0/1048957782 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efc500035f0 con 0x7efc601011d0 2024-09-18T13:15:51.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc567fc640 1 -- 172.21.15.78:0/1048957782 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc50035030 con 0x7efc601011d0 2024-09-18T13:15:51.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc673d5640 1 -- 172.21.15.78:0/1048957782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc601a2b30 con 0x7efc601011d0 2024-09-18T13:15:51.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.460+0000 7efc673d5640 1 -- 172.21.15.78:0/1048957782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc601a3060 con 0x7efc601011d0 2024-09-18T13:15:51.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.462+0000 7efc673d5640 1 -- 172.21.15.78:0/1048957782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc6006aa90 con 0x7efc601011d0 2024-09-18T13:15:51.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.462+0000 7efc567fc640 1 -- 172.21.15.78:0/1048957782 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7efc50042070 con 0x7efc601011d0 2024-09-18T13:15:51.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.463+0000 7efc567fc640 1 --2- 172.21.15.78:0/1048957782 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7efc4c07af80 0x7efc4c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:51.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.463+0000 7efc567fc640 1 -- 172.21.15.78:0/1048957782 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7efc500be940 con 0x7efc601011d0 2024-09-18T13:15:51.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.463+0000 7efc65171640 1 --2- 172.21.15.78:0/1048957782 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7efc4c07af80 0x7efc4c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:51.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.463+0000 7efc65171640 1 --2- 172.21.15.78:0/1048957782 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7efc4c07af80 0x7efc4c07d440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efc5c005fd0 tx=0x7efc5c005850 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:51.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.467+0000 7efc567fc640 1 -- 172.21.15.78:0/1048957782 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7efc50089f60 con 0x7efc601011d0 2024-09-18T13:15:51.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.676+0000 7efc673d5640 1 -- 172.21.15.78:0/1048957782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) -- 0x7efc60102d20 con 0x7efc601011d0 2024-09-18T13:15:51.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.677+0000 7efc567fc640 1 -- 172.21.15.78:0/1048957782 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v36) ==== 107+0+5306 (secure 0 0 0) 0x7efc5008ee10 con 0x7efc601011d0 2024-09-18T13:15:51.678 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:51.678 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":29,"btime":"2024-09-18T13:13:24:579681+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34320,"name":"cephfs.smithi078.eakgoe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6829/2241162518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2241162518},{"type":"v1","addr":"172.21.15.78:6829","nonce":2241162518}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":34352,"name":"cephfs.smithi078.furyab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6827/2453525200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2453525200},{"type":"v1","addr":"172.21.15.78:6827","nonce":2453525200}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44293,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/2385856084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2385856084},{"type":"v1","addr":"172.21.15.148:6825","nonce":2385856084}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/3319905864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3319905864},{"type":"v1","addr":"172.21.15.148:6827","nonce":3319905864}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T13:13:23.582679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:51.679 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 29 2024-09-18T13:15:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.679+0000 7efc673d5640 1 -- 172.21.15.78:0/1048957782 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7efc4c07af80 msgr2=0x7efc4c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.679+0000 7efc673d5640 1 --2- 172.21.15.78:0/1048957782 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7efc4c07af80 0x7efc4c07d440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efc5c005fd0 tx=0x7efc5c005850 comp rx=0 tx=0).stop 2024-09-18T13:15:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.679+0000 7efc673d5640 1 -- 172.21.15.78:0/1048957782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc601011d0 msgr2=0x7efc6019e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.679+0000 7efc673d5640 1 --2- 172.21.15.78:0/1048957782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc601011d0 0x7efc6019e510 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efc50031460 tx=0x7efc50004530 comp rx=0 tx=0).stop 2024-09-18T13:15:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.679+0000 7efc673d5640 1 -- 172.21.15.78:0/1048957782 shutdown_connections 2024-09-18T13:15:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.679+0000 7efc673d5640 1 --2- 172.21.15.78:0/1048957782 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7efc4c07af80 0x7efc4c07d440 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.679+0000 7efc673d5640 1 --2- 172.21.15.78:0/1048957782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc601011d0 0x7efc6019e510 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.679+0000 7efc673d5640 1 --2- 172.21.15.78:0/1048957782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc601008b0 0x7efc6019dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:51.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.679+0000 7efc673d5640 1 -- 172.21.15.78:0/1048957782 >> 172.21.15.78:0/1048957782 conn(0x7efc600fc520 msgr2=0x7efc60112c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:51.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.679+0000 7efc673d5640 1 -- 172.21.15.78:0/1048957782 shutdown_connections 2024-09-18T13:15:51.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:51.679+0000 7efc673d5640 1 -- 172.21.15.78:0/1048957782 wait complete. 2024-09-18T13:15:51.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:51 smithi148 ceph-mon[80030]: pgmap v802: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:52.487 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:52 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1048957782' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-18T13:15:52.516 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-18T13:15:52.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:52 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1048957782' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-18T13:15:52.766 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:53.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.206+0000 7f7b07ca0640 1 -- 172.21.15.78:0/2180654221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b00103430 msgr2=0x7f7b0010b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:53.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.206+0000 7f7b07ca0640 1 --2- 172.21.15.78:0/2180654221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b00103430 0x7f7b0010b920 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7af40098b0 tx=0x7f7af402a560 comp rx=0 tx=0).stop 2024-09-18T13:15:53.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.206+0000 7f7b07ca0640 1 -- 172.21.15.78:0/2180654221 shutdown_connections 2024-09-18T13:15:53.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.207+0000 7f7b07ca0640 1 --2- 172.21.15.78:0/2180654221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b00103430 0x7f7b0010b920 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:53.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.207+0000 7f7b07ca0640 1 --2- 172.21.15.78:0/2180654221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b00102b10 0x7f7b00102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:53.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.207+0000 7f7b07ca0640 1 -- 172.21.15.78:0/2180654221 >> 172.21.15.78:0/2180654221 conn(0x7f7b000fc550 msgr2=0x7f7b000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:53.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.207+0000 7f7b07ca0640 1 -- 172.21.15.78:0/2180654221 shutdown_connections 2024-09-18T13:15:53.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.207+0000 7f7b07ca0640 1 -- 172.21.15.78:0/2180654221 wait complete. 2024-09-18T13:15:53.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.207+0000 7f7b07ca0640 1 Processor -- start 2024-09-18T13:15:53.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.207+0000 7f7b07ca0640 1 -- start start 2024-09-18T13:15:53.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7b07ca0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b00102b10 0x7f7b0019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:53.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7b07ca0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b00103430 0x7f7b0019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:53.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7b07ca0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0010ee40 con 0x7f7b00102b10 2024-09-18T13:15:53.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7b07ca0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0010ecc0 con 0x7f7b00103430 2024-09-18T13:15:53.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7b05a3c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b00102b10 0x7f7b0019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:53.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7b05a3c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b00102b10 0x7f7b0019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40496/0 (socket says 172.21.15.78:40496) 2024-09-18T13:15:53.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7b05a3c640 1 -- 172.21.15.78:0/4220722214 learned_addr learned my addr 172.21.15.78:0/4220722214 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:53.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7b0523b640 1 --2- 172.21.15.78:0/4220722214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b00103430 0x7f7b0019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:53.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7b05a3c640 1 -- 172.21.15.78:0/4220722214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b00103430 msgr2=0x7f7b0019dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:53.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7b05a3c640 1 --2- 172.21.15.78:0/4220722214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b00103430 0x7f7b0019dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:53.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7b05a3c640 1 -- 172.21.15.78:0/4220722214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b00197870 con 0x7f7b00102b10 2024-09-18T13:15:53.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7b05a3c640 1 --2- 172.21.15.78:0/4220722214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b00102b10 0x7f7b0019d6b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7af000ba50 tx=0x7f7af000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:53.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7afeffd640 1 -- 172.21.15.78:0/4220722214 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7af0019070 con 0x7f7b00102b10 2024-09-18T13:15:53.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7afeffd640 1 -- 172.21.15.78:0/4220722214 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7af000ce20 con 0x7f7b00102b10 2024-09-18T13:15:53.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7b07ca0640 1 -- 172.21.15.78:0/4220722214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b00197b60 con 0x7f7b00102b10 2024-09-18T13:15:53.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7afeffd640 1 -- 172.21.15.78:0/4220722214 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7af00075a0 con 0x7f7b00102b10 2024-09-18T13:15:53.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.208+0000 7f7b07ca0640 1 -- 172.21.15.78:0/4220722214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b001980c0 con 0x7f7b00102b10 2024-09-18T13:15:53.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.209+0000 7f7b07ca0640 1 -- 172.21.15.78:0/4220722214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b0006a520 con 0x7f7b00102b10 2024-09-18T13:15:53.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.210+0000 7f7afeffd640 1 -- 172.21.15.78:0/4220722214 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7af001c070 con 0x7f7b00102b10 2024-09-18T13:15:53.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.210+0000 7f7afeffd640 1 --2- 172.21.15.78:0/4220722214 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ae807af30 0x7f7ae807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:53.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.211+0000 7f7b0523b640 1 --2- 172.21.15.78:0/4220722214 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ae807af30 0x7f7ae807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:53.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.211+0000 7f7afeffd640 1 -- 172.21.15.78:0/4220722214 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f7af009d950 con 0x7f7b00102b10 2024-09-18T13:15:53.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.211+0000 7f7b0523b640 1 --2- 172.21.15.78:0/4220722214 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ae807af30 0x7f7ae807d3f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7af4000c00 tx=0x7f7af4031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:53.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.215+0000 7f7afeffd640 1 -- 172.21.15.78:0/4220722214 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7af0068ef0 con 0x7f7b00102b10 2024-09-18T13:15:53.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.426+0000 7f7b07ca0640 1 -- 172.21.15.78:0/4220722214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) -- 0x7f7b00198da0 con 0x7f7b00102b10 2024-09-18T13:15:53.428 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:53 smithi078 ceph-mon[108578]: pgmap v803: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:53.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.427+0000 7f7afeffd640 1 -- 172.21.15.78:0/4220722214 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v36) ==== 107+0+5329 (secure 0 0 0) 0x7f7af006dda0 con 0x7f7b00102b10 2024-09-18T13:15:53.429 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:53.429 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":30,"btime":"2024-09-18T13:13:24:583745+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44293,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/2385856084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2385856084},{"type":"v1","addr":"172.21.15.148:6825","nonce":2385856084}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/3319905864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3319905864},{"type":"v1","addr":"172.21.15.148:6827","nonce":3319905864}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T13:13:24.583732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34320,"mds_1":34352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi078.eakgoe","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.78:6829/2241162518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2241162518},{"type":"v1","addr":"172.21.15.78:6829","nonce":2241162518}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34352":{"gid":34352,"name":"cephfs.smithi078.furyab","rank":1,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.78:6827/2453525200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2453525200},{"type":"v1","addr":"172.21.15.78:6827","nonce":2453525200}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:53.429 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 30 2024-09-18T13:15:53.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.429+0000 7f7b07ca0640 1 -- 172.21.15.78:0/4220722214 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ae807af30 msgr2=0x7f7ae807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:53.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.429+0000 7f7b07ca0640 1 --2- 172.21.15.78:0/4220722214 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ae807af30 0x7f7ae807d3f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7af4000c00 tx=0x7f7af4031400 comp rx=0 tx=0).stop 2024-09-18T13:15:53.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.429+0000 7f7b07ca0640 1 -- 172.21.15.78:0/4220722214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b00102b10 msgr2=0x7f7b0019d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:53.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.429+0000 7f7b07ca0640 1 --2- 172.21.15.78:0/4220722214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b00102b10 0x7f7b0019d6b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7af000ba50 tx=0x7f7af000bf10 comp rx=0 tx=0).stop 2024-09-18T13:15:53.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.429+0000 7f7b07ca0640 1 -- 172.21.15.78:0/4220722214 shutdown_connections 2024-09-18T13:15:53.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.429+0000 7f7b07ca0640 1 --2- 172.21.15.78:0/4220722214 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f7ae807af30 0x7f7ae807d3f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:53.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.429+0000 7f7b07ca0640 1 --2- 172.21.15.78:0/4220722214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b00103430 0x7f7b0019dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:53.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.429+0000 7f7b07ca0640 1 --2- 172.21.15.78:0/4220722214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b00102b10 0x7f7b0019d6b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:53.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.429+0000 7f7b07ca0640 1 -- 172.21.15.78:0/4220722214 >> 172.21.15.78:0/4220722214 conn(0x7f7b000fc550 msgr2=0x7f7b00103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:53.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.429+0000 7f7b07ca0640 1 -- 172.21.15.78:0/4220722214 shutdown_connections 2024-09-18T13:15:53.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:53.429+0000 7f7b07ca0640 1 -- 172.21.15.78:0/4220722214 wait complete. 2024-09-18T13:15:53.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:53 smithi148 ceph-mon[80030]: pgmap v803: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:54.018 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-18T13:15:54.269 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:54.519 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:54 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/4220722214' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-18T13:15:54.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:54 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/4220722214' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-18T13:15:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.726+0000 7f3675564640 1 -- 172.21.15.78:0/3143396056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3670107900 msgr2=0x7f3670107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.726+0000 7f3675564640 1 --2- 172.21.15.78:0/3143396056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3670107900 0x7f3670107ce0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3660009880 tx=0x7f366002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.726+0000 7f3675564640 1 -- 172.21.15.78:0/3143396056 shutdown_connections 2024-09-18T13:15:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.726+0000 7f3675564640 1 --2- 172.21.15.78:0/3143396056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3670101900 0x7f3670101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:54.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.726+0000 7f3675564640 1 --2- 172.21.15.78:0/3143396056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3670107900 0x7f3670107ce0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.726+0000 7f3675564640 1 -- 172.21.15.78:0/3143396056 >> 172.21.15.78:0/3143396056 conn(0x7f36700fd5e0 msgr2=0x7f36700ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.727+0000 7f3675564640 1 -- 172.21.15.78:0/3143396056 shutdown_connections 2024-09-18T13:15:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.727+0000 7f3675564640 1 -- 172.21.15.78:0/3143396056 wait complete. 2024-09-18T13:15:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.727+0000 7f3675564640 1 Processor -- start 2024-09-18T13:15:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.727+0000 7f3675564640 1 -- start start 2024-09-18T13:15:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.727+0000 7f3675564640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3670101900 0x7f367019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.727+0000 7f3675564640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3670107900 0x7f367019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.727+0000 7f3675564640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f367010edd0 con 0x7f3670101900 2024-09-18T13:15:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.727+0000 7f3675564640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f367010ec50 con 0x7f3670107900 2024-09-18T13:15:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.728+0000 7f366effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3670101900 0x7f367019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.728+0000 7f366effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3670101900 0x7f367019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40512/0 (socket says 172.21.15.78:40512) 2024-09-18T13:15:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.728+0000 7f366effd640 1 -- 172.21.15.78:0/3035813334 learned_addr learned my addr 172.21.15.78:0/3035813334 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.728+0000 7f366e7fc640 1 --2- 172.21.15.78:0/3035813334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3670107900 0x7f367019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:54.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.728+0000 7f366effd640 1 -- 172.21.15.78:0/3035813334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3670107900 msgr2=0x7f367019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.728+0000 7f366effd640 1 --2- 172.21.15.78:0/3035813334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3670107900 0x7f367019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.728+0000 7f366effd640 1 -- 172.21.15.78:0/3035813334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36701977c0 con 0x7f3670101900 2024-09-18T13:15:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.728+0000 7f366effd640 1 --2- 172.21.15.78:0/3035813334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3670101900 0x7f367019d640 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3660031460 tx=0x7f3660004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.728+0000 7f3657fff640 1 -- 172.21.15.78:0/3035813334 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f366003f070 con 0x7f3670101900 2024-09-18T13:15:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.728+0000 7f3657fff640 1 -- 172.21.15.78:0/3035813334 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36600035f0 con 0x7f3670101900 2024-09-18T13:15:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.728+0000 7f3675564640 1 -- 172.21.15.78:0/3035813334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3670197a50 con 0x7f3670101900 2024-09-18T13:15:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.728+0000 7f3657fff640 1 -- 172.21.15.78:0/3035813334 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3660035030 con 0x7f3670101900 2024-09-18T13:15:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.728+0000 7f3675564640 1 -- 172.21.15.78:0/3035813334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3670197f80 con 0x7f3670101900 2024-09-18T13:15:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.729+0000 7f3675564640 1 -- 172.21.15.78:0/3035813334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3670103040 con 0x7f3670101900 2024-09-18T13:15:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.730+0000 7f3657fff640 1 -- 172.21.15.78:0/3035813334 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3660042070 con 0x7f3670101900 2024-09-18T13:15:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.730+0000 7f3657fff640 1 --2- 172.21.15.78:0/3035813334 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f365807af30 0x7f365807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.731+0000 7f366e7fc640 1 --2- 172.21.15.78:0/3035813334 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f365807af30 0x7f365807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.731+0000 7f3657fff640 1 -- 172.21.15.78:0/3035813334 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f36600be960 con 0x7f3670101900 2024-09-18T13:15:54.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.731+0000 7f366e7fc640 1 --2- 172.21.15.78:0/3035813334 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f365807af30 0x7f365807d3f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f36700ffc60 tx=0x7f3664005f90 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:54.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.735+0000 7f3657fff640 1 -- 172.21.15.78:0/3035813334 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3660089f00 con 0x7f3670101900 2024-09-18T13:15:54.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.944+0000 7f3675564640 1 -- 172.21.15.78:0/3035813334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) -- 0x7f3670109e70 con 0x7f3670101900 2024-09-18T13:15:54.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.944+0000 7f3657fff640 1 -- 172.21.15.78:0/3035813334 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v36) ==== 107+0+5332 (secure 0 0 0) 0x7f366008edb0 con 0x7f3670101900 2024-09-18T13:15:54.946 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:54.946 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":31,"btime":"2024-09-18T13:13:25:592866+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44293,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/2385856084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2385856084},{"type":"v1","addr":"172.21.15.148:6825","nonce":2385856084}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/3319905864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3319905864},{"type":"v1","addr":"172.21.15.148:6827","nonce":3319905864}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T13:13:24.598456+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34320,"mds_1":34352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi078.eakgoe","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.78:6829/2241162518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2241162518},{"type":"v1","addr":"172.21.15.78:6829","nonce":2241162518}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34352":{"gid":34352,"name":"cephfs.smithi078.furyab","rank":1,"incarnation":30,"state":"up:resolve","state_seq":234,"addr":"172.21.15.78:6827/2453525200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2453525200},{"type":"v1","addr":"172.21.15.78:6827","nonce":2453525200}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:54.946 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 31 2024-09-18T13:15:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.947+0000 7f3675564640 1 -- 172.21.15.78:0/3035813334 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f365807af30 msgr2=0x7f365807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.947+0000 7f3675564640 1 --2- 172.21.15.78:0/3035813334 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f365807af30 0x7f365807d3f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f36700ffc60 tx=0x7f3664005f90 comp rx=0 tx=0).stop 2024-09-18T13:15:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.947+0000 7f3675564640 1 -- 172.21.15.78:0/3035813334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3670101900 msgr2=0x7f367019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.947+0000 7f3675564640 1 --2- 172.21.15.78:0/3035813334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3670101900 0x7f367019d640 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3660031460 tx=0x7f3660004530 comp rx=0 tx=0).stop 2024-09-18T13:15:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.947+0000 7f3675564640 1 -- 172.21.15.78:0/3035813334 shutdown_connections 2024-09-18T13:15:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.947+0000 7f3675564640 1 --2- 172.21.15.78:0/3035813334 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f365807af30 0x7f365807d3f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.947+0000 7f3675564640 1 --2- 172.21.15.78:0/3035813334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3670107900 0x7f367019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.947+0000 7f3675564640 1 --2- 172.21.15.78:0/3035813334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3670101900 0x7f367019d640 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.947+0000 7f3675564640 1 -- 172.21.15.78:0/3035813334 >> 172.21.15.78:0/3035813334 conn(0x7f36700fd5e0 msgr2=0x7f36700fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:54.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.947+0000 7f3675564640 1 -- 172.21.15.78:0/3035813334 shutdown_connections 2024-09-18T13:15:54.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:54.947+0000 7f3675564640 1 -- 172.21.15.78:0/3035813334 wait complete. 2024-09-18T13:15:55.530 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:55 smithi078 ceph-mon[108578]: pgmap v804: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:55.531 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:55 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3035813334' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-18T13:15:55.562 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-18T13:15:55.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:55 smithi148 ceph-mon[80030]: pgmap v804: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:55.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:55 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3035813334' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-18T13:15:55.812 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:56.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.255+0000 7fba4b7df640 1 -- 172.21.15.78:0/4178636390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba44107900 msgr2=0x7fba44107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:56.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.255+0000 7fba4b7df640 1 --2- 172.21.15.78:0/4178636390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba44107900 0x7fba44107ce0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fba40009880 tx=0x7fba4002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:56.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.255+0000 7fba4b7df640 1 -- 172.21.15.78:0/4178636390 shutdown_connections 2024-09-18T13:15:56.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.255+0000 7fba4b7df640 1 --2- 172.21.15.78:0/4178636390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba44101900 0x7fba44101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:56.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.255+0000 7fba4b7df640 1 --2- 172.21.15.78:0/4178636390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba44107900 0x7fba44107ce0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:56.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.255+0000 7fba4b7df640 1 -- 172.21.15.78:0/4178636390 >> 172.21.15.78:0/4178636390 conn(0x7fba440fd600 msgr2=0x7fba440ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:56.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.255+0000 7fba4b7df640 1 -- 172.21.15.78:0/4178636390 shutdown_connections 2024-09-18T13:15:56.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.255+0000 7fba4b7df640 1 -- 172.21.15.78:0/4178636390 wait complete. 2024-09-18T13:15:56.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.255+0000 7fba4b7df640 1 Processor -- start 2024-09-18T13:15:56.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.255+0000 7fba4b7df640 1 -- start start 2024-09-18T13:15:56.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.255+0000 7fba4b7df640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba44101900 0x7fba4419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:56.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.255+0000 7fba4b7df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba44107900 0x7fba4419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:56.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.255+0000 7fba4b7df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fba4410edb0 con 0x7fba44107900 2024-09-18T13:15:56.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.255+0000 7fba4b7df640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fba4410ec30 con 0x7fba44101900 2024-09-18T13:15:56.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.256+0000 7fba48d7a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba44107900 0x7fba4419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:56.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.256+0000 7fba48d7a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba44107900 0x7fba4419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40524/0 (socket says 172.21.15.78:40524) 2024-09-18T13:15:56.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.256+0000 7fba48d7a640 1 -- 172.21.15.78:0/3296440134 learned_addr learned my addr 172.21.15.78:0/3296440134 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:56.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.256+0000 7fba4957b640 1 --2- 172.21.15.78:0/3296440134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba44101900 0x7fba4419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:56.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.256+0000 7fba48d7a640 1 -- 172.21.15.78:0/3296440134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba44101900 msgr2=0x7fba4419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:56.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.256+0000 7fba48d7a640 1 --2- 172.21.15.78:0/3296440134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba44101900 0x7fba4419d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:56.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.256+0000 7fba48d7a640 1 -- 172.21.15.78:0/3296440134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba441977e0 con 0x7fba44107900 2024-09-18T13:15:56.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.256+0000 7fba48d7a640 1 --2- 172.21.15.78:0/3296440134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba44107900 0x7fba4419dba0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fba3400d8d0 tx=0x7fba3400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:56.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.256+0000 7fba3a7fc640 1 -- 172.21.15.78:0/3296440134 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba34017070 con 0x7fba44107900 2024-09-18T13:15:56.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.256+0000 7fba3a7fc640 1 -- 172.21.15.78:0/3296440134 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba34010460 con 0x7fba44107900 2024-09-18T13:15:56.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.256+0000 7fba4b7df640 1 -- 172.21.15.78:0/3296440134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba44197ad0 con 0x7fba44107900 2024-09-18T13:15:56.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.256+0000 7fba3a7fc640 1 -- 172.21.15.78:0/3296440134 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba3400f5f0 con 0x7fba44107900 2024-09-18T13:15:56.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.256+0000 7fba4b7df640 1 -- 172.21.15.78:0/3296440134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba44198060 con 0x7fba44107900 2024-09-18T13:15:56.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.257+0000 7fba4b7df640 1 -- 172.21.15.78:0/3296440134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba44103040 con 0x7fba44107900 2024-09-18T13:15:56.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.258+0000 7fba3a7fc640 1 -- 172.21.15.78:0/3296440134 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fba34009a30 con 0x7fba44107900 2024-09-18T13:15:56.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.259+0000 7fba3a7fc640 1 --2- 172.21.15.78:0/3296440134 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fba3007af80 0x7fba3007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:56.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.259+0000 7fba4957b640 1 --2- 172.21.15.78:0/3296440134 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fba3007af80 0x7fba3007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:56.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.259+0000 7fba3a7fc640 1 -- 172.21.15.78:0/3296440134 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fba3409dda0 con 0x7fba44107900 2024-09-18T13:15:56.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.259+0000 7fba4957b640 1 --2- 172.21.15.78:0/3296440134 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fba3007af80 0x7fba3007d440 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fba400096c0 tx=0x7fba40031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:56.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.263+0000 7fba3a7fc640 1 -- 172.21.15.78:0/3296440134 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fba340693c0 con 0x7fba44107900 2024-09-18T13:15:56.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.478+0000 7fba4b7df640 1 -- 172.21.15.78:0/3296440134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) -- 0x7fba44104b10 con 0x7fba44107900 2024-09-18T13:15:56.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.479+0000 7fba3a7fc640 1 -- 172.21.15.78:0/3296440134 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v36) ==== 107+0+5335 (secure 0 0 0) 0x7fba3406e270 con 0x7fba44107900 2024-09-18T13:15:56.480 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:56.480 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":32,"btime":"2024-09-18T13:13:33:376427+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44293,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/2385856084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2385856084},{"type":"v1","addr":"172.21.15.148:6825","nonce":2385856084}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/3319905864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3319905864},{"type":"v1","addr":"172.21.15.148:6827","nonce":3319905864}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T13:13:33.171243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34320,"mds_1":34352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi078.eakgoe","rank":0,"incarnation":30,"state":"up:resolve","state_seq":241,"addr":"172.21.15.78:6829/2241162518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2241162518},{"type":"v1","addr":"172.21.15.78:6829","nonce":2241162518}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34352":{"gid":34352,"name":"cephfs.smithi078.furyab","rank":1,"incarnation":30,"state":"up:resolve","state_seq":234,"addr":"172.21.15.78:6827/2453525200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2453525200},{"type":"v1","addr":"172.21.15.78:6827","nonce":2453525200}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:56.481 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 32 2024-09-18T13:15:56.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.481+0000 7fba4b7df640 1 -- 172.21.15.78:0/3296440134 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fba3007af80 msgr2=0x7fba3007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:56.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.481+0000 7fba4b7df640 1 --2- 172.21.15.78:0/3296440134 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fba3007af80 0x7fba3007d440 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fba400096c0 tx=0x7fba40031400 comp rx=0 tx=0).stop 2024-09-18T13:15:56.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.481+0000 7fba4b7df640 1 -- 172.21.15.78:0/3296440134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba44107900 msgr2=0x7fba4419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:56.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.481+0000 7fba4b7df640 1 --2- 172.21.15.78:0/3296440134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba44107900 0x7fba4419dba0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fba3400d8d0 tx=0x7fba3400dd90 comp rx=0 tx=0).stop 2024-09-18T13:15:56.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.481+0000 7fba4b7df640 1 -- 172.21.15.78:0/3296440134 shutdown_connections 2024-09-18T13:15:56.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.481+0000 7fba4b7df640 1 --2- 172.21.15.78:0/3296440134 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fba3007af80 0x7fba3007d440 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:56.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.481+0000 7fba4b7df640 1 --2- 172.21.15.78:0/3296440134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba44107900 0x7fba4419dba0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:56.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.481+0000 7fba4b7df640 1 --2- 172.21.15.78:0/3296440134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba44101900 0x7fba4419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:56.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.481+0000 7fba4b7df640 1 -- 172.21.15.78:0/3296440134 >> 172.21.15.78:0/3296440134 conn(0x7fba440fd600 msgr2=0x7fba440fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:56.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.481+0000 7fba4b7df640 1 -- 172.21.15.78:0/3296440134 shutdown_connections 2024-09-18T13:15:56.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:56.481+0000 7fba4b7df640 1 -- 172.21.15.78:0/3296440134 wait complete. 2024-09-18T13:15:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:15:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:15:57.144 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-18T13:15:57.404 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:57.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:57 smithi078 ceph-mon[108578]: pgmap v805: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:57.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:57 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3296440134' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-18T13:15:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:57 smithi148 ceph-mon[80030]: pgmap v805: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:57 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3296440134' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-18T13:15:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.025+0000 7fe0f37e0640 1 -- 172.21.15.78:0/234934489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0ec1033e0 msgr2=0x7fe0ec10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.025+0000 7fe0f37e0640 1 --2- 172.21.15.78:0/234934489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0ec1033e0 0x7fe0ec10b8d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009880 tx=0x7fe0e002a530 comp rx=0 tx=0).stop 2024-09-18T13:15:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.025+0000 7fe0f37e0640 1 -- 172.21.15.78:0/234934489 shutdown_connections 2024-09-18T13:15:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.025+0000 7fe0f37e0640 1 --2- 172.21.15.78:0/234934489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0ec1033e0 0x7fe0ec10b8d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.025+0000 7fe0f37e0640 1 --2- 172.21.15.78:0/234934489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0ec102ac0 0x7fe0ec102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.025+0000 7fe0f37e0640 1 -- 172.21.15.78:0/234934489 >> 172.21.15.78:0/234934489 conn(0x7fe0ec0fc520 msgr2=0x7fe0ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.025+0000 7fe0f37e0640 1 -- 172.21.15.78:0/234934489 shutdown_connections 2024-09-18T13:15:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.025+0000 7fe0f37e0640 1 -- 172.21.15.78:0/234934489 wait complete. 2024-09-18T13:15:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.026+0000 7fe0f37e0640 1 Processor -- start 2024-09-18T13:15:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.026+0000 7fe0f37e0640 1 -- start start 2024-09-18T13:15:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.026+0000 7fe0f37e0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0ec102ac0 0x7fe0ec19f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.026+0000 7fe0f37e0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0ec1033e0 0x7fe0ec19fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.026+0000 7fe0f37e0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec10edf0 con 0x7fe0ec1033e0 2024-09-18T13:15:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.026+0000 7fe0f37e0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec10ec70 con 0x7fe0ec102ac0 2024-09-18T13:15:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.026+0000 7fe0f0d7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0ec1033e0 0x7fe0ec19fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.026+0000 7fe0f0d7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0ec1033e0 0x7fe0ec19fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40536/0 (socket says 172.21.15.78:40536) 2024-09-18T13:15:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.026+0000 7fe0f0d7b640 1 -- 172.21.15.78:0/1454052544 learned_addr learned my addr 172.21.15.78:0/1454052544 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.026+0000 7fe0f157c640 1 --2- 172.21.15.78:0/1454052544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0ec102ac0 0x7fe0ec19f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.026+0000 7fe0f0d7b640 1 -- 172.21.15.78:0/1454052544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0ec102ac0 msgr2=0x7fe0ec19f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.026+0000 7fe0f0d7b640 1 --2- 172.21.15.78:0/1454052544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0ec102ac0 0x7fe0ec19f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.026+0000 7fe0f0d7b640 1 -- 172.21.15.78:0/1454052544 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec199ab0 con 0x7fe0ec1033e0 2024-09-18T13:15:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.027+0000 7fe0f0d7b640 1 --2- 172.21.15.78:0/1454052544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0ec1033e0 0x7fe0ec19fe30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0031460 tx=0x7fe0e0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.027+0000 7fe0ea7fc640 1 -- 172.21.15.78:0/1454052544 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe0e003f070 con 0x7fe0ec1033e0 2024-09-18T13:15:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.027+0000 7fe0ea7fc640 1 -- 172.21.15.78:0/1454052544 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe0e00035f0 con 0x7fe0ec1033e0 2024-09-18T13:15:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.027+0000 7fe0f37e0640 1 -- 172.21.15.78:0/1454052544 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ec199d40 con 0x7fe0ec1033e0 2024-09-18T13:15:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.027+0000 7fe0ea7fc640 1 -- 172.21.15.78:0/1454052544 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe0e0035030 con 0x7fe0ec1033e0 2024-09-18T13:15:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.027+0000 7fe0f37e0640 1 -- 172.21.15.78:0/1454052544 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ec19a270 con 0x7fe0ec1033e0 2024-09-18T13:15:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.028+0000 7fe0f37e0640 1 -- 172.21.15.78:0/1454052544 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0ec06aa90 con 0x7fe0ec1033e0 2024-09-18T13:15:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.028+0000 7fe0ea7fc640 1 -- 172.21.15.78:0/1454052544 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe0e0042070 con 0x7fe0ec1033e0 2024-09-18T13:15:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.029+0000 7fe0ea7fc640 1 --2- 172.21.15.78:0/1454052544 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe0d407af30 0x7fe0d407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:58.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.029+0000 7fe0ea7fc640 1 -- 172.21.15.78:0/1454052544 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7fe0e00be9c0 con 0x7fe0ec1033e0 2024-09-18T13:15:58.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.029+0000 7fe0f157c640 1 --2- 172.21.15.78:0/1454052544 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe0d407af30 0x7fe0d407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:58.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.029+0000 7fe0f157c640 1 --2- 172.21.15.78:0/1454052544 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe0d407af30 0x7fe0d407d3f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec19abf0 tx=0x7fe0e400b390 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:58.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.033+0000 7fe0ea7fc640 1 -- 172.21.15.78:0/1454052544 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe0e0089f00 con 0x7fe0ec1033e0 2024-09-18T13:15:58.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.243+0000 7fe0f37e0640 1 -- 172.21.15.78:0/1454052544 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) -- 0x7fe0ec10b3a0 con 0x7fe0ec1033e0 2024-09-18T13:15:58.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.244+0000 7fe0ea7fc640 1 -- 172.21.15.78:0/1454052544 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v36) ==== 107+0+5339 (secure 0 0 0) 0x7fe0e008edb0 con 0x7fe0ec1033e0 2024-09-18T13:15:58.245 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:58.245 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":33,"btime":"2024-09-18T13:13:34:378304+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44293,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/2385856084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2385856084},{"type":"v1","addr":"172.21.15.148:6825","nonce":2385856084}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/3319905864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3319905864},{"type":"v1","addr":"172.21.15.148:6827","nonce":3319905864}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T13:13:33.424462+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34320,"mds_1":34352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi078.eakgoe","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":242,"addr":"172.21.15.78:6829/2241162518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2241162518},{"type":"v1","addr":"172.21.15.78:6829","nonce":2241162518}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34352":{"gid":34352,"name":"cephfs.smithi078.furyab","rank":1,"incarnation":30,"state":"up:reconnect","state_seq":237,"addr":"172.21.15.78:6827/2453525200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2453525200},{"type":"v1","addr":"172.21.15.78:6827","nonce":2453525200}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:58.245 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 33 2024-09-18T13:15:58.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.246+0000 7fe0f37e0640 1 -- 172.21.15.78:0/1454052544 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe0d407af30 msgr2=0x7fe0d407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.246+0000 7fe0f37e0640 1 --2- 172.21.15.78:0/1454052544 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe0d407af30 0x7fe0d407d3f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec19abf0 tx=0x7fe0e400b390 comp rx=0 tx=0).stop 2024-09-18T13:15:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.246+0000 7fe0f37e0640 1 -- 172.21.15.78:0/1454052544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0ec1033e0 msgr2=0x7fe0ec19fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.246+0000 7fe0f37e0640 1 --2- 172.21.15.78:0/1454052544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0ec1033e0 0x7fe0ec19fe30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0031460 tx=0x7fe0e0004530 comp rx=0 tx=0).stop 2024-09-18T13:15:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.246+0000 7fe0f37e0640 1 -- 172.21.15.78:0/1454052544 shutdown_connections 2024-09-18T13:15:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.246+0000 7fe0f37e0640 1 --2- 172.21.15.78:0/1454052544 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7fe0d407af30 0x7fe0d407d3f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.246+0000 7fe0f37e0640 1 --2- 172.21.15.78:0/1454052544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0ec1033e0 0x7fe0ec19fe30 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.246+0000 7fe0f37e0640 1 --2- 172.21.15.78:0/1454052544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0ec102ac0 0x7fe0ec19f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.246+0000 7fe0f37e0640 1 -- 172.21.15.78:0/1454052544 >> 172.21.15.78:0/1454052544 conn(0x7fe0ec0fc520 msgr2=0x7fe0ec100a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.246+0000 7fe0f37e0640 1 -- 172.21.15.78:0/1454052544 shutdown_connections 2024-09-18T13:15:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:58.246+0000 7fe0f37e0640 1 -- 172.21.15.78:0/1454052544 wait complete. 2024-09-18T13:15:58.539 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:58 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/1454052544' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-18T13:15:58.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:58 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/1454052544' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-18T13:15:58.859 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-18T13:15:59.110 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:15:59.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:15:59 smithi078 ceph-mon[108578]: pgmap v806: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:59.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.604+0000 7f0a12614640 1 -- 172.21.15.78:0/2494027318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a0c107900 msgr2=0x7f0a0c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:59.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.604+0000 7f0a12614640 1 --2- 172.21.15.78:0/2494027318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a0c107900 0x7f0a0c107ce0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009880 tx=0x7f09fc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:15:59.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.605+0000 7f0a12614640 1 -- 172.21.15.78:0/2494027318 shutdown_connections 2024-09-18T13:15:59.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.605+0000 7f0a12614640 1 --2- 172.21.15.78:0/2494027318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a0c101900 0x7f0a0c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:59.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.605+0000 7f0a12614640 1 --2- 172.21.15.78:0/2494027318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a0c107900 0x7f0a0c107ce0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:59.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.605+0000 7f0a12614640 1 -- 172.21.15.78:0/2494027318 >> 172.21.15.78:0/2494027318 conn(0x7f0a0c0fd600 msgr2=0x7f0a0c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:59.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.605+0000 7f0a12614640 1 -- 172.21.15.78:0/2494027318 shutdown_connections 2024-09-18T13:15:59.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.605+0000 7f0a12614640 1 -- 172.21.15.78:0/2494027318 wait complete. 2024-09-18T13:15:59.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.605+0000 7f0a12614640 1 Processor -- start 2024-09-18T13:15:59.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.605+0000 7f0a12614640 1 -- start start 2024-09-18T13:15:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.605+0000 7f0a12614640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a0c101900 0x7f0a0c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.605+0000 7f0a12614640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a0c107900 0x7f0a0c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.605+0000 7f0a12614640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0c10edd0 con 0x7f0a0c107900 2024-09-18T13:15:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.605+0000 7f0a12614640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0c10ec50 con 0x7f0a0c101900 2024-09-18T13:15:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.606+0000 7f0a03fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a0c107900 0x7f0a0c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.606+0000 7f0a03fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a0c107900 0x7f0a0c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40554/0 (socket says 172.21.15.78:40554) 2024-09-18T13:15:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.606+0000 7f0a03fff640 1 -- 172.21.15.78:0/291546713 learned_addr learned my addr 172.21.15.78:0/291546713 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:15:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.606+0000 7f0a0bfff640 1 --2- 172.21.15.78:0/291546713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a0c101900 0x7f0a0c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.606+0000 7f0a03fff640 1 -- 172.21.15.78:0/291546713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a0c101900 msgr2=0x7f0a0c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.606+0000 7f0a03fff640 1 --2- 172.21.15.78:0/291546713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a0c101900 0x7f0a0c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.606+0000 7f0a03fff640 1 -- 172.21.15.78:0/291546713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a0c074f70 con 0x7f0a0c107900 2024-09-18T13:15:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.606+0000 7f0a03fff640 1 --2- 172.21.15.78:0/291546713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a0c107900 0x7f0a0c074a30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f09f400c8f0 tx=0x7f09f400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.606+0000 7f0a09ffb640 1 -- 172.21.15.78:0/291546713 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f09f40079b0 con 0x7f0a0c107900 2024-09-18T13:15:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.606+0000 7f0a12614640 1 -- 172.21.15.78:0/291546713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a0c075260 con 0x7f0a0c107900 2024-09-18T13:15:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.606+0000 7f0a09ffb640 1 -- 172.21.15.78:0/291546713 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f09f40054e0 con 0x7f0a0c107900 2024-09-18T13:15:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.606+0000 7f0a09ffb640 1 -- 172.21.15.78:0/291546713 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f09f4004dd0 con 0x7f0a0c107900 2024-09-18T13:15:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.606+0000 7f0a12614640 1 -- 172.21.15.78:0/291546713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a0c1a3e40 con 0x7f0a0c107900 2024-09-18T13:15:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.607+0000 7f0a12614640 1 -- 172.21.15.78:0/291546713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a0c103040 con 0x7f0a0c107900 2024-09-18T13:15:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.608+0000 7f0a09ffb640 1 -- 172.21.15.78:0/291546713 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f09f4005020 con 0x7f0a0c107900 2024-09-18T13:15:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.608+0000 7f0a09ffb640 1 --2- 172.21.15.78:0/291546713 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f09f807aed0 0x7f09f807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:15:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.608+0000 7f0a09ffb640 1 -- 172.21.15.78:0/291546713 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f09f409df90 con 0x7f0a0c107900 2024-09-18T13:15:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.609+0000 7f0a0bfff640 1 --2- 172.21.15.78:0/291546713 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f09f807aed0 0x7f09f807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:15:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.609+0000 7f0a0bfff640 1 --2- 172.21.15.78:0/291546713 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f09f807aed0 0x7f09f807d390 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f09fc000c00 tx=0x7f09fc031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:15:59.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.613+0000 7f0a09ffb640 1 -- 172.21.15.78:0/291546713 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f09f4014030 con 0x7f0a0c107900 2024-09-18T13:15:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:15:59 smithi148 ceph-mon[80030]: pgmap v806: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:15:59.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.821+0000 7f0a12614640 1 -- 172.21.15.78:0/291546713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) -- 0x7f0a0c109e70 con 0x7f0a0c107900 2024-09-18T13:15:59.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.822+0000 7f0a09ffb640 1 -- 172.21.15.78:0/291546713 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v36) ==== 107+0+5333 (secure 0 0 0) 0x7f09f4069530 con 0x7f0a0c107900 2024-09-18T13:15:59.823 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:15:59.823 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":34,"btime":"2024-09-18T13:13:35:382997+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44293,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/2385856084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2385856084},{"type":"v1","addr":"172.21.15.148:6825","nonce":2385856084}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/3319905864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3319905864},{"type":"v1","addr":"172.21.15.148:6827","nonce":3319905864}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T13:13:34.386118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34320,"mds_1":34352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi078.eakgoe","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":243,"addr":"172.21.15.78:6829/2241162518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2241162518},{"type":"v1","addr":"172.21.15.78:6829","nonce":2241162518}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34352":{"gid":34352,"name":"cephfs.smithi078.furyab","rank":1,"incarnation":30,"state":"up:rejoin","state_seq":238,"addr":"172.21.15.78:6827/2453525200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2453525200},{"type":"v1","addr":"172.21.15.78:6827","nonce":2453525200}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:15:59.824 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 34 2024-09-18T13:15:59.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.824+0000 7f0a12614640 1 -- 172.21.15.78:0/291546713 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f09f807aed0 msgr2=0x7f09f807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:59.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.824+0000 7f0a12614640 1 --2- 172.21.15.78:0/291546713 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f09f807aed0 0x7f09f807d390 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f09fc000c00 tx=0x7f09fc031400 comp rx=0 tx=0).stop 2024-09-18T13:15:59.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.824+0000 7f0a12614640 1 -- 172.21.15.78:0/291546713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a0c107900 msgr2=0x7f0a0c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:15:59.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.824+0000 7f0a12614640 1 --2- 172.21.15.78:0/291546713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a0c107900 0x7f0a0c074a30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f09f400c8f0 tx=0x7f09f400cdb0 comp rx=0 tx=0).stop 2024-09-18T13:15:59.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.824+0000 7f0a12614640 1 -- 172.21.15.78:0/291546713 shutdown_connections 2024-09-18T13:15:59.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.824+0000 7f0a12614640 1 --2- 172.21.15.78:0/291546713 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f09f807aed0 0x7f09f807d390 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:59.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.824+0000 7f0a12614640 1 --2- 172.21.15.78:0/291546713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a0c107900 0x7f0a0c074a30 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:59.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.824+0000 7f0a12614640 1 --2- 172.21.15.78:0/291546713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a0c101900 0x7f0a0c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:15:59.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.824+0000 7f0a12614640 1 -- 172.21.15.78:0/291546713 >> 172.21.15.78:0/291546713 conn(0x7f0a0c0fd600 msgr2=0x7f0a0c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:15:59.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.824+0000 7f0a12614640 1 -- 172.21.15.78:0/291546713 shutdown_connections 2024-09-18T13:15:59.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:15:59.824+0000 7f0a12614640 1 -- 172.21.15.78:0/291546713 wait complete. 2024-09-18T13:16:00.404 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:00 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/291546713' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-18T13:16:00.433 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-18T13:16:00.680 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:16:00.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:00 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/291546713' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-18T13:16:01.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.161+0000 7f645f14a640 1 -- 172.21.15.78:0/1941780517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6458100800 msgr2=0x7f6458100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:01.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.161+0000 7f645f14a640 1 --2- 172.21.15.78:0/1941780517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6458100800 0x7f6458100c60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f644c009880 tx=0x7f644c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:16:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.161+0000 7f645f14a640 1 -- 172.21.15.78:0/1941780517 shutdown_connections 2024-09-18T13:16:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.161+0000 7f645f14a640 1 --2- 172.21.15.78:0/1941780517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6458100800 0x7f6458100c60 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.161+0000 7f645f14a640 1 --2- 172.21.15.78:0/1941780517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6458106800 0x7f6458106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.161+0000 7f645f14a640 1 -- 172.21.15.78:0/1941780517 >> 172.21.15.78:0/1941780517 conn(0x7f64580fc520 msgr2=0x7f64580fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.162+0000 7f645f14a640 1 -- 172.21.15.78:0/1941780517 shutdown_connections 2024-09-18T13:16:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.162+0000 7f645f14a640 1 -- 172.21.15.78:0/1941780517 wait complete. 2024-09-18T13:16:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.162+0000 7f645f14a640 1 Processor -- start 2024-09-18T13:16:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.162+0000 7f645f14a640 1 -- start start 2024-09-18T13:16:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.162+0000 7f645f14a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6458100800 0x7f6458198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.162+0000 7f645f14a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6458106800 0x7f6458198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.162+0000 7f645f14a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f645810dcb0 con 0x7f6458106800 2024-09-18T13:16:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.162+0000 7f645f14a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f645810db30 con 0x7f6458100800 2024-09-18T13:16:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.162+0000 7f6457fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6458106800 0x7f6458198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.162+0000 7f6457fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6458106800 0x7f6458198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40580/0 (socket says 172.21.15.78:40580) 2024-09-18T13:16:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.162+0000 7f6457fff640 1 -- 172.21.15.78:0/3516137723 learned_addr learned my addr 172.21.15.78:0/3516137723 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:16:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.163+0000 7f645cee6640 1 --2- 172.21.15.78:0/3516137723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6458100800 0x7f6458198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.163+0000 7f6457fff640 1 -- 172.21.15.78:0/3516137723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6458100800 msgr2=0x7f6458198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.163+0000 7f6457fff640 1 --2- 172.21.15.78:0/3516137723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6458100800 0x7f6458198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.163+0000 7f6457fff640 1 -- 172.21.15.78:0/3516137723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64581992b0 con 0x7f6458106800 2024-09-18T13:16:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.163+0000 7f6457fff640 1 --2- 172.21.15.78:0/3516137723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6458106800 0x7f6458198d40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f644c031460 tx=0x7f644c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.163+0000 7f6455ffb640 1 -- 172.21.15.78:0/3516137723 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f644c03f070 con 0x7f6458106800 2024-09-18T13:16:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.163+0000 7f645f14a640 1 -- 172.21.15.78:0/3516137723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6458199540 con 0x7f6458106800 2024-09-18T13:16:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.163+0000 7f6455ffb640 1 -- 172.21.15.78:0/3516137723 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f644c004cf0 con 0x7f6458106800 2024-09-18T13:16:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.163+0000 7f6455ffb640 1 -- 172.21.15.78:0/3516137723 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f644c035030 con 0x7f6458106800 2024-09-18T13:16:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.163+0000 7f645f14a640 1 -- 172.21.15.78:0/3516137723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64581a1af0 con 0x7f6458106800 2024-09-18T13:16:01.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.165+0000 7f645f14a640 1 -- 172.21.15.78:0/3516137723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6458101f40 con 0x7f6458106800 2024-09-18T13:16:01.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.165+0000 7f6455ffb640 1 -- 172.21.15.78:0/3516137723 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f644c042070 con 0x7f6458106800 2024-09-18T13:16:01.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.166+0000 7f6455ffb640 1 --2- 172.21.15.78:0/3516137723 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f644007af30 0x7f644007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:01.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.166+0000 7f6455ffb640 1 -- 172.21.15.78:0/3516137723 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f644c0beb20 con 0x7f6458106800 2024-09-18T13:16:01.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.166+0000 7f645cee6640 1 --2- 172.21.15.78:0/3516137723 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f644007af30 0x7f644007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:01.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.166+0000 7f645cee6640 1 --2- 172.21.15.78:0/3516137723 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f644007af30 0x7f644007d3f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6448005e10 tx=0x7f6448005da0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:01.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.170+0000 7f6455ffb640 1 -- 172.21.15.78:0/3516137723 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f644c08a0c0 con 0x7f6458106800 2024-09-18T13:16:01.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.384+0000 7f645f14a640 1 -- 172.21.15.78:0/3516137723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) -- 0x7f6458108d90 con 0x7f6458106800 2024-09-18T13:16:01.386 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:01 smithi078 ceph-mon[108578]: pgmap v807: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:01.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.385+0000 7f6455ffb640 1 -- 172.21.15.78:0/3516137723 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v36) ==== 107+0+5348 (secure 0 0 0) 0x7f644c08ef70 con 0x7f6458106800 2024-09-18T13:16:01.387 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-18T13:16:01.387 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":35,"btime":"2024-09-18T13:13:36:391405+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44293,"name":"cephfs.smithi148.fqecmm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6825/2385856084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2385856084},{"type":"v1","addr":"172.21.15.148:6825","nonce":2385856084}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi148.tvvouo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/3319905864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3319905864},{"type":"v1","addr":"172.21.15.148:6827","nonce":3319905864}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T12:46:26.747207+0000","modified":"2024-09-18T13:13:36.391399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34320,"mds_1":34352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34320":{"gid":34320,"name":"cephfs.smithi078.eakgoe","rank":0,"incarnation":30,"state":"up:active","state_seq":244,"addr":"172.21.15.78:6829/2241162518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2241162518},{"type":"v1","addr":"172.21.15.78:6829","nonce":2241162518}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34352":{"gid":34352,"name":"cephfs.smithi078.furyab","rank":1,"incarnation":30,"state":"up:active","state_seq":239,"addr":"172.21.15.78:6827/2453525200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2453525200},{"type":"v1","addr":"172.21.15.78:6827","nonce":2453525200}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34320,"qdb_cluster":[34320,34352]},"id":1}]} 2024-09-18T13:16:01.387 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 35 2024-09-18T13:16:01.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.387+0000 7f645f14a640 1 -- 172.21.15.78:0/3516137723 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f644007af30 msgr2=0x7f644007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:01.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.387+0000 7f645f14a640 1 --2- 172.21.15.78:0/3516137723 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f644007af30 0x7f644007d3f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6448005e10 tx=0x7f6448005da0 comp rx=0 tx=0).stop 2024-09-18T13:16:01.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.387+0000 7f645f14a640 1 -- 172.21.15.78:0/3516137723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6458106800 msgr2=0x7f6458198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:01.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.387+0000 7f645f14a640 1 --2- 172.21.15.78:0/3516137723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6458106800 0x7f6458198d40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f644c031460 tx=0x7f644c0048f0 comp rx=0 tx=0).stop 2024-09-18T13:16:01.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.387+0000 7f645f14a640 1 -- 172.21.15.78:0/3516137723 shutdown_connections 2024-09-18T13:16:01.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.387+0000 7f645f14a640 1 --2- 172.21.15.78:0/3516137723 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f644007af30 0x7f644007d3f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:01.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.387+0000 7f645f14a640 1 --2- 172.21.15.78:0/3516137723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6458106800 0x7f6458198d40 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:01.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.387+0000 7f645f14a640 1 --2- 172.21.15.78:0/3516137723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6458100800 0x7f6458198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:01.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.387+0000 7f645f14a640 1 -- 172.21.15.78:0/3516137723 >> 172.21.15.78:0/3516137723 conn(0x7f64580fc520 msgr2=0x7f64580fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:01.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.387+0000 7f645f14a640 1 -- 172.21.15.78:0/3516137723 shutdown_connections 2024-09-18T13:16:01.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:01.388+0000 7f645f14a640 1 -- 172.21.15.78:0/3516137723 wait complete. 2024-09-18T13:16:01.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:01 smithi148 ceph-mon[80030]: pgmap v807: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:02.068 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-18T13:16:02.079 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-18T13:16:02.079 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T13:16:02.079 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-18T13:16:02.098 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T13:16:02.099 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-18T13:16:02.157 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-18T13:16:02.450 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:16:02.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:02 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/3516137723' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-18T13:16:02.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:02 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/3516137723' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-18T13:16:02.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.926+0000 7f83c5e73640 1 -- 172.21.15.78:0/2348985950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c0101900 msgr2=0x7f83c0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:02.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.926+0000 7f83c5e73640 1 --2- 172.21.15.78:0/2348985950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c0101900 0x7f83c0101d60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009880 tx=0x7f83b402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:16:02.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.926+0000 7f83c5e73640 1 -- 172.21.15.78:0/2348985950 shutdown_connections 2024-09-18T13:16:02.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.926+0000 7f83c5e73640 1 --2- 172.21.15.78:0/2348985950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c0101900 0x7f83c0101d60 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:02.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.926+0000 7f83c5e73640 1 --2- 172.21.15.78:0/2348985950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83c0107900 0x7f83c0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:02.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.926+0000 7f83c5e73640 1 -- 172.21.15.78:0/2348985950 >> 172.21.15.78:0/2348985950 conn(0x7f83c00fd600 msgr2=0x7f83c00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.926+0000 7f83c5e73640 1 -- 172.21.15.78:0/2348985950 shutdown_connections 2024-09-18T13:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.927+0000 7f83c5e73640 1 -- 172.21.15.78:0/2348985950 wait complete. 2024-09-18T13:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.927+0000 7f83c5e73640 1 Processor -- start 2024-09-18T13:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.928+0000 7f83c5e73640 1 -- start start 2024-09-18T13:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.928+0000 7f83c5e73640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c0101900 0x7f83c019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.928+0000 7f83c5e73640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83c0107900 0x7f83c019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.928+0000 7f83c5e73640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f83c010ee30 con 0x7f83c0101900 2024-09-18T13:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.928+0000 7f83c5e73640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f83c010ecb0 con 0x7f83c0107900 2024-09-18T13:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.928+0000 7f83bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c0101900 0x7f83c019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.928+0000 7f83bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c0101900 0x7f83c019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52160/0 (socket says 172.21.15.78:52160) 2024-09-18T13:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.928+0000 7f83bf7fe640 1 -- 172.21.15.78:0/2201821412 learned_addr learned my addr 172.21.15.78:0/2201821412 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.928+0000 7f83beffd640 1 --2- 172.21.15.78:0/2201821412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83c0107900 0x7f83c019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:02.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.928+0000 7f83bf7fe640 1 -- 172.21.15.78:0/2201821412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83c0107900 msgr2=0x7f83c019dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.928+0000 7f83bf7fe640 1 --2- 172.21.15.78:0/2201821412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83c0107900 0x7f83c019dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.928+0000 7f83bf7fe640 1 -- 172.21.15.78:0/2201821412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c0197840 con 0x7f83c0101900 2024-09-18T13:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.929+0000 7f83bf7fe640 1 --2- 172.21.15.78:0/2201821412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c0101900 0x7f83c019d6c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f83b000b420 tx=0x7f83b000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.929+0000 7f83bcff9640 1 -- 172.21.15.78:0/2201821412 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83b0011630 con 0x7f83c0101900 2024-09-18T13:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.929+0000 7f83bcff9640 1 -- 172.21.15.78:0/2201821412 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83b0016070 con 0x7f83c0101900 2024-09-18T13:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.929+0000 7f83c5e73640 1 -- 172.21.15.78:0/2201821412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c0197b30 con 0x7f83c0101900 2024-09-18T13:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.929+0000 7f83bcff9640 1 -- 172.21.15.78:0/2201821412 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83b0010d40 con 0x7f83c0101900 2024-09-18T13:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.929+0000 7f83c5e73640 1 -- 172.21.15.78:0/2201821412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c0198090 con 0x7f83c0101900 2024-09-18T13:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.930+0000 7f83c5e73640 1 -- 172.21.15.78:0/2201821412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83c0103040 con 0x7f83c0101900 2024-09-18T13:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.930+0000 7f83bcff9640 1 -- 172.21.15.78:0/2201821412 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f83b001b460 con 0x7f83c0101900 2024-09-18T13:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.931+0000 7f83bcff9640 1 --2- 172.21.15.78:0/2201821412 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f83a807af30 0x7f83a807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:02.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.931+0000 7f83bcff9640 1 -- 172.21.15.78:0/2201821412 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f83b009d720 con 0x7f83c0101900 2024-09-18T13:16:02.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.931+0000 7f83beffd640 1 --2- 172.21.15.78:0/2201821412 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f83a807af30 0x7f83a807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:02.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.931+0000 7f83beffd640 1 --2- 172.21.15.78:0/2201821412 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f83a807af30 0x7f83a807d3f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f83c0198b90 tx=0x7f83b4031400 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:02.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:02.935+0000 7f83bcff9640 1 -- 172.21.15.78:0/2201821412 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f83b0068cc0 con 0x7f83c0101900 2024-09-18T13:16:03.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:03.125+0000 7f83c5e73640 1 -- 172.21.15.78:0/2201821412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f83c0109e90 con 0x7f83c0101900 2024-09-18T13:16:03.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:03.126+0000 7f83bcff9640 1 -- 172.21.15.78:0/2201821412 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 33 entries v82) ==== 81+0+1966 (secure 0 0 0) 0x7f83b006db70 con 0x7f83c0101900 2024-09-18T13:16:03.127 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6827/2954199576 2024-09-19T12:57:27.052703+0000 2024-09-18T13:16:03.127 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/2192057687 2024-09-19T12:41:41.346021+0000 2024-09-18T13:16:03.128 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:0/1737946673 2024-09-19T12:50:25.008053+0000 2024-09-18T13:16:03.128 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6801/2989194374 2024-09-19T12:40:12.294094+0000 2024-09-18T13:16:03.128 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6801/2933657307 2024-09-19T12:41:41.346021+0000 2024-09-18T13:16:03.128 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/1473581153 2024-09-19T12:40:43.381299+0000 2024-09-18T13:16:03.128 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/3469069650 2024-09-19T12:48:50.216405+0000 2024-09-18T13:16:03.128 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/2912158439 2024-09-19T12:48:50.216405+0000 2024-09-18T13:16:03.128 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6800/934367305 2024-09-19T12:48:50.216405+0000 2024-09-18T13:16:03.128 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6826/2954199576 2024-09-19T12:57:27.052703+0000 2024-09-18T13:16:03.128 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/478020441 2024-09-19T12:48:50.216405+0000 2024-09-18T13:16:03.128 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6801/934367305 2024-09-19T12:48:50.216405+0000 2024-09-18T13:16:03.128 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/1064721970 2024-09-19T12:48:50.216405+0000 2024-09-18T13:16:03.128 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/1268671960 2024-09-19T12:40:12.294094+0000 2024-09-18T13:16:03.128 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/3952976544 2024-09-19T12:41:41.346021+0000 2024-09-18T13:16:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/538305077 2024-09-19T12:40:12.294094+0000 2024-09-18T13:16:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:6829/2591325460 2024-09-19T12:50:25.008053+0000 2024-09-18T13:16:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:6824/1193522785 2024-09-19T12:46:40.245898+0000 2024-09-18T13:16:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:6828/2591325460 2024-09-19T12:50:25.008053+0000 2024-09-18T13:16:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/1238593923 2024-09-19T12:41:41.346021+0000 2024-09-18T13:16:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/2388875547 2024-09-19T12:40:43.381299+0000 2024-09-18T13:16:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6800/2989194374 2024-09-19T12:40:12.294094+0000 2024-09-18T13:16:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6801/2511056793 2024-09-19T12:40:43.381299+0000 2024-09-18T13:16:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:6825/1193522785 2024-09-19T12:46:40.245898+0000 2024-09-18T13:16:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:0/1050716361 2024-09-19T12:50:25.008053+0000 2024-09-18T13:16:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6800/2511056793 2024-09-19T12:40:43.381299+0000 2024-09-18T13:16:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:0/1796077546 2024-09-19T12:50:25.008053+0000 2024-09-18T13:16:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:0/4184321721 2024-09-19T12:50:25.008053+0000 2024-09-18T13:16:03.130 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6800/2933657307 2024-09-19T12:41:41.346021+0000 2024-09-18T13:16:03.130 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/1909696487 2024-09-19T12:40:12.294094+0000 2024-09-18T13:16:03.130 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6829/2120994206 2024-09-19T12:57:27.052715+0000 2024-09-18T13:16:03.130 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6828/2120994206 2024-09-19T12:57:27.052715+0000 2024-09-18T13:16:03.130 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/3952955113 2024-09-19T12:40:43.381299+0000 2024-09-18T13:16:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:listed 33 entries 2024-09-18T13:16:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:03.129+0000 7f83c5e73640 1 -- 172.21.15.78:0/2201821412 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f83a807af30 msgr2=0x7f83a807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:03.129+0000 7f83c5e73640 1 --2- 172.21.15.78:0/2201821412 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f83a807af30 0x7f83a807d3f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f83c0198b90 tx=0x7f83b4031400 comp rx=0 tx=0).stop 2024-09-18T13:16:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:03.129+0000 7f83c5e73640 1 -- 172.21.15.78:0/2201821412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c0101900 msgr2=0x7f83c019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:03.129+0000 7f83c5e73640 1 --2- 172.21.15.78:0/2201821412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c0101900 0x7f83c019d6c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f83b000b420 tx=0x7f83b000b8e0 comp rx=0 tx=0).stop 2024-09-18T13:16:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:03.129+0000 7f83c5e73640 1 -- 172.21.15.78:0/2201821412 shutdown_connections 2024-09-18T13:16:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:03.129+0000 7f83c5e73640 1 --2- 172.21.15.78:0/2201821412 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f83a807af30 0x7f83a807d3f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:03.129+0000 7f83c5e73640 1 --2- 172.21.15.78:0/2201821412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83c0107900 0x7f83c019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:03.129+0000 7f83c5e73640 1 --2- 172.21.15.78:0/2201821412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c0101900 0x7f83c019d6c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:03.129+0000 7f83c5e73640 1 -- 172.21.15.78:0/2201821412 >> 172.21.15.78:0/2201821412 conn(0x7f83c00fd600 msgr2=0x7f83c00fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:03.129+0000 7f83c5e73640 1 -- 172.21.15.78:0/2201821412 shutdown_connections 2024-09-18T13:16:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:03.129+0000 7f83c5e73640 1 -- 172.21.15.78:0/2201821412 wait complete. 2024-09-18T13:16:03.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:03 smithi078 ceph-mon[108578]: pgmap v808: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:03.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:03 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2201821412' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-18T13:16:03.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:03 smithi148 ceph-mon[80030]: pgmap v808: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:03.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:03 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2201821412' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-18T13:16:04.017 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-18T13:16:04.018 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-18T13:16:04.037 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-18T13:16:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/mon.smithi078/config 2024-09-18T13:16:04.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.842+0000 7f32aa8df640 1 -- 172.21.15.78:0/3471374676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32a4100800 msgr2=0x7f32a4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:04.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.842+0000 7f32aa8df640 1 --2- 172.21.15.78:0/3471374676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32a4100800 0x7f32a4100c60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3298009880 tx=0x7f329802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:16:04.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.842+0000 7f32aa8df640 1 -- 172.21.15.78:0/3471374676 shutdown_connections 2024-09-18T13:16:04.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.842+0000 7f32aa8df640 1 --2- 172.21.15.78:0/3471374676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32a4100800 0x7f32a4100c60 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.842+0000 7f32aa8df640 1 --2- 172.21.15.78:0/3471374676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32a4106800 0x7f32a4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.842+0000 7f32aa8df640 1 -- 172.21.15.78:0/3471374676 >> 172.21.15.78:0/3471374676 conn(0x7f32a40fc520 msgr2=0x7f32a40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.842+0000 7f32aa8df640 1 -- 172.21.15.78:0/3471374676 shutdown_connections 2024-09-18T13:16:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.842+0000 7f32aa8df640 1 -- 172.21.15.78:0/3471374676 wait complete. 2024-09-18T13:16:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.842+0000 7f32aa8df640 1 Processor -- start 2024-09-18T13:16:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.843+0000 7f32aa8df640 1 -- start start 2024-09-18T13:16:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.843+0000 7f32aa8df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32a4100800 0x7f32a419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.843+0000 7f32aa8df640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32a4106800 0x7f32a419caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.843+0000 7f32aa8df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32a410dcb0 con 0x7f32a4100800 2024-09-18T13:16:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.843+0000 7f32aa8df640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f32a410db30 con 0x7f32a4106800 2024-09-18T13:16:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.843+0000 7f32a3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32a4100800 0x7f32a419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.843+0000 7f32a3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32a4100800 0x7f32a419c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52176/0 (socket says 172.21.15.78:52176) 2024-09-18T13:16:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.843+0000 7f32a3fff640 1 -- 172.21.15.78:0/2067180344 learned_addr learned my addr 172.21.15.78:0/2067180344 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-18T13:16:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.843+0000 7f32a3fff640 1 -- 172.21.15.78:0/2067180344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32a4106800 msgr2=0x7f32a419caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.843+0000 7f32a3fff640 1 --2- 172.21.15.78:0/2067180344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32a4106800 0x7f32a419caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.843+0000 7f32a3fff640 1 -- 172.21.15.78:0/2067180344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a4196680 con 0x7f32a4100800 2024-09-18T13:16:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.843+0000 7f32a3fff640 1 --2- 172.21.15.78:0/2067180344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32a4100800 0x7f32a419c5b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f329400d8d0 tx=0x7f329400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.844+0000 7f32a17fa640 1 -- 172.21.15.78:0/2067180344 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3294017070 con 0x7f32a4100800 2024-09-18T13:16:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.844+0000 7f32a17fa640 1 -- 172.21.15.78:0/2067180344 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3294010460 con 0x7f32a4100800 2024-09-18T13:16:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.844+0000 7f32aa8df640 1 -- 172.21.15.78:0/2067180344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a4196970 con 0x7f32a4100800 2024-09-18T13:16:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.844+0000 7f32a17fa640 1 -- 172.21.15.78:0/2067180344 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f329400f5f0 con 0x7f32a4100800 2024-09-18T13:16:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.844+0000 7f32aa8df640 1 -- 172.21.15.78:0/2067180344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a4196f00 con 0x7f32a4100800 2024-09-18T13:16:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.845+0000 7f32aa8df640 1 -- 172.21.15.78:0/2067180344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a4101f40 con 0x7f32a4100800 2024-09-18T13:16:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.845+0000 7f32a17fa640 1 -- 172.21.15.78:0/2067180344 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3294009a30 con 0x7f32a4100800 2024-09-18T13:16:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.846+0000 7f32a17fa640 1 --2- 172.21.15.78:0/2067180344 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f328c07af30 0x7f328c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:16:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.846+0000 7f32a17fa640 1 -- 172.21.15.78:0/2067180344 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6242+0+0 (secure 0 0 0) 0x7f329409df40 con 0x7f32a4100800 2024-09-18T13:16:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.846+0000 7f32a37fe640 1 --2- 172.21.15.78:0/2067180344 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f328c07af30 0x7f328c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:16:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.846+0000 7f32a37fe640 1 --2- 172.21.15.78:0/2067180344 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f328c07af30 0x7f328c07d3f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f32980096c0 tx=0x7f3298000bc0 comp rx=0 tx=0).ready entity=mgr.14770 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:16:04.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:04.850+0000 7f32a17fa640 1 -- 172.21.15.78:0/2067180344 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f32940694e0 con 0x7f32a4100800 2024-09-18T13:16:05.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:05.036+0000 7f32aa8df640 1 -- 172.21.15.78:0/2067180344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f32a41971b0 con 0x7f32a4100800 2024-09-18T13:16:05.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:05.036+0000 7f32a17fa640 1 -- 172.21.15.78:0/2067180344 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 33 entries v82) ==== 81+0+1966 (secure 0 0 0) 0x7f329406e390 con 0x7f32a4100800 2024-09-18T13:16:05.037 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6827/2954199576 2024-09-19T12:57:27.052703+0000 2024-09-18T13:16:05.038 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/2192057687 2024-09-19T12:41:41.346021+0000 2024-09-18T13:16:05.038 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:0/1737946673 2024-09-19T12:50:25.008053+0000 2024-09-18T13:16:05.038 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6801/2989194374 2024-09-19T12:40:12.294094+0000 2024-09-18T13:16:05.038 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6801/2933657307 2024-09-19T12:41:41.346021+0000 2024-09-18T13:16:05.038 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/1473581153 2024-09-19T12:40:43.381299+0000 2024-09-18T13:16:05.038 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/3469069650 2024-09-19T12:48:50.216405+0000 2024-09-18T13:16:05.038 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/2912158439 2024-09-19T12:48:50.216405+0000 2024-09-18T13:16:05.038 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6800/934367305 2024-09-19T12:48:50.216405+0000 2024-09-18T13:16:05.038 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6826/2954199576 2024-09-19T12:57:27.052703+0000 2024-09-18T13:16:05.038 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/478020441 2024-09-19T12:48:50.216405+0000 2024-09-18T13:16:05.038 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6801/934367305 2024-09-19T12:48:50.216405+0000 2024-09-18T13:16:05.038 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/1064721970 2024-09-19T12:48:50.216405+0000 2024-09-18T13:16:05.039 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/1268671960 2024-09-19T12:40:12.294094+0000 2024-09-18T13:16:05.039 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/3952976544 2024-09-19T12:41:41.346021+0000 2024-09-18T13:16:05.039 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/538305077 2024-09-19T12:40:12.294094+0000 2024-09-18T13:16:05.039 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:6829/2591325460 2024-09-19T12:50:25.008053+0000 2024-09-18T13:16:05.039 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:6824/1193522785 2024-09-19T12:46:40.245898+0000 2024-09-18T13:16:05.039 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:6828/2591325460 2024-09-19T12:50:25.008053+0000 2024-09-18T13:16:05.039 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/1238593923 2024-09-19T12:41:41.346021+0000 2024-09-18T13:16:05.039 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/2388875547 2024-09-19T12:40:43.381299+0000 2024-09-18T13:16:05.039 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6800/2989194374 2024-09-19T12:40:12.294094+0000 2024-09-18T13:16:05.039 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6801/2511056793 2024-09-19T12:40:43.381299+0000 2024-09-18T13:16:05.039 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:6825/1193522785 2024-09-19T12:46:40.245898+0000 2024-09-18T13:16:05.039 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:0/1050716361 2024-09-19T12:50:25.008053+0000 2024-09-18T13:16:05.039 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6800/2511056793 2024-09-19T12:40:43.381299+0000 2024-09-18T13:16:05.039 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:0/1796077546 2024-09-19T12:50:25.008053+0000 2024-09-18T13:16:05.040 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.148:0/4184321721 2024-09-19T12:50:25.008053+0000 2024-09-18T13:16:05.040 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6800/2933657307 2024-09-19T12:41:41.346021+0000 2024-09-18T13:16:05.040 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/1909696487 2024-09-19T12:40:12.294094+0000 2024-09-18T13:16:05.040 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6829/2120994206 2024-09-19T12:57:27.052715+0000 2024-09-18T13:16:05.040 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6828/2120994206 2024-09-19T12:57:27.052715+0000 2024-09-18T13:16:05.040 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/3952955113 2024-09-19T12:40:43.381299+0000 2024-09-18T13:16:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:listed 33 entries 2024-09-18T13:16:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:05.038+0000 7f32aa8df640 1 -- 172.21.15.78:0/2067180344 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f328c07af30 msgr2=0x7f328c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:05.038+0000 7f32aa8df640 1 --2- 172.21.15.78:0/2067180344 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f328c07af30 0x7f328c07d3f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f32980096c0 tx=0x7f3298000bc0 comp rx=0 tx=0).stop 2024-09-18T13:16:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:05.038+0000 7f32aa8df640 1 -- 172.21.15.78:0/2067180344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32a4100800 msgr2=0x7f32a419c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:16:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:05.038+0000 7f32aa8df640 1 --2- 172.21.15.78:0/2067180344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32a4100800 0x7f32a419c5b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f329400d8d0 tx=0x7f329400dd90 comp rx=0 tx=0).stop 2024-09-18T13:16:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:05.039+0000 7f32aa8df640 1 -- 172.21.15.78:0/2067180344 shutdown_connections 2024-09-18T13:16:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:05.039+0000 7f32aa8df640 1 --2- 172.21.15.78:0/2067180344 >> [v2:172.21.15.78:6800/2800506880,v1:172.21.15.78:6801/2800506880] conn(0x7f328c07af30 0x7f328c07d3f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:05.039+0000 7f32aa8df640 1 --2- 172.21.15.78:0/2067180344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32a4106800 0x7f32a419caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:05.039+0000 7f32aa8df640 1 --2- 172.21.15.78:0/2067180344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32a4100800 0x7f32a419c5b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:16:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:05.039+0000 7f32aa8df640 1 -- 172.21.15.78:0/2067180344 >> 172.21.15.78:0/2067180344 conn(0x7f32a40fc520 msgr2=0x7f32a40fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:16:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:05.039+0000 7f32aa8df640 1 -- 172.21.15.78:0/2067180344 shutdown_connections 2024-09-18T13:16:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-18T13:16:05.039+0000 7f32aa8df640 1 -- 172.21.15.78:0/2067180344 wait complete. 2024-09-18T13:16:05.635 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:05 smithi078 ceph-mon[108578]: pgmap v809: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:05.635 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:05 smithi078 ceph-mon[108578]: from='client.? 172.21.15.78:0/2067180344' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-18T13:16:05.664 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi078.front.sepia.ceph.com... 2024-09-18T13:16:05.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T13:16:05.665 DEBUG:teuthology.orchestra.run.smithi078:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-18T13:16:05.691 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T13:16:05.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:05 smithi148 ceph-mon[80030]: pgmap v809: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:05.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:05 smithi148 ceph-mon[80030]: from='client.? 172.21.15.78:0/2067180344' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-18T13:16:07.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:07 smithi148 ceph-mon[80030]: pgmap v810: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:07.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:07 smithi078 ceph-mon[108578]: pgmap v810: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:09.710 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:09 smithi078 ceph-mon[108578]: pgmap v811: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:09.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:09 smithi148 ceph-mon[80030]: pgmap v811: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:11 smithi148 ceph-mon[80030]: pgmap v812: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:16:11.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:11 smithi078 ceph-mon[108578]: pgmap v812: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:11.745 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:16:13.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:13 smithi078 ceph-mon[108578]: pgmap v813: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:13.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:13 smithi148 ceph-mon[80030]: pgmap v813: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:15.703 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:15 smithi078 ceph-mon[108578]: pgmap v814: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:15.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:15 smithi148 ceph-mon[80030]: pgmap v814: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:17.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:17 smithi148 ceph-mon[80030]: pgmap v815: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:17.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:17 smithi078 ceph-mon[108578]: pgmap v815: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:19.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:19 smithi148 ceph-mon[80030]: pgmap v816: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:19.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:19 smithi078 ceph-mon[108578]: pgmap v816: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:21.712 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:21 smithi078 ceph-mon[108578]: pgmap v817: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:21.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:21 smithi148 ceph-mon[80030]: pgmap v817: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:23.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:23 smithi148 ceph-mon[80030]: pgmap v818: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:23.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:23 smithi078 ceph-mon[108578]: pgmap v818: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:25.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:25 smithi148 ceph-mon[80030]: pgmap v819: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:25 smithi078 ceph-mon[108578]: pgmap v819: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:16:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:16:27.710 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:27 smithi078 ceph-mon[108578]: pgmap v820: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:27.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:27 smithi148 ceph-mon[80030]: pgmap v820: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:29.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:29 smithi148 ceph-mon[80030]: pgmap v821: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:29.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:29 smithi078 ceph-mon[108578]: pgmap v821: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:31.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:31 smithi148 ceph-mon[80030]: pgmap v822: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:31.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:31 smithi078 ceph-mon[108578]: pgmap v822: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:33.544 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:33 smithi078 ceph-mon[108578]: pgmap v823: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:33.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:33 smithi148 ceph-mon[80030]: pgmap v823: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:35.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:35 smithi148 ceph-mon[80030]: pgmap v824: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:35.741 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:35 smithi078 ceph-mon[108578]: pgmap v824: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:37.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:37 smithi148 ceph-mon[80030]: pgmap v825: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:37.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:37 smithi078 ceph-mon[108578]: pgmap v825: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:39.706 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:39 smithi078 ceph-mon[108578]: pgmap v826: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:39.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:39 smithi148 ceph-mon[80030]: pgmap v826: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:41 smithi148 ceph-mon[80030]: pgmap v827: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:16:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:41 smithi078 ceph-mon[108578]: pgmap v827: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:16:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:43 smithi148 ceph-mon[80030]: pgmap v828: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:43 smithi078 ceph-mon[108578]: pgmap v828: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:45.705 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:45 smithi078 ceph-mon[108578]: pgmap v829: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:45.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:45 smithi148 ceph-mon[80030]: pgmap v829: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:47.654 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:47 smithi148 ceph-mon[80030]: pgmap v830: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:47 smithi078 ceph-mon[108578]: pgmap v830: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:49.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:49 smithi148 ceph-mon[80030]: pgmap v831: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:49.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:49 smithi078 ceph-mon[108578]: pgmap v831: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:50.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:50 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:16:50.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:50 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:16:51.710 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:51 smithi078 ceph-mon[108578]: pgmap v832: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:51.711 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:16:51.711 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:16:51.711 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:16:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:51 smithi148 ceph-mon[80030]: pgmap v832: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:16:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:16:51.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:16:53.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:53 smithi148 ceph-mon[80030]: pgmap v833: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:53.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:53 smithi078 ceph-mon[108578]: pgmap v833: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:55.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:55 smithi148 ceph-mon[80030]: pgmap v834: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:55 smithi078 ceph-mon[108578]: pgmap v834: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:16:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:16:57.708 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:57 smithi078 ceph-mon[108578]: pgmap v835: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:57.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:57 smithi148 ceph-mon[80030]: pgmap v835: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:16:59 smithi148 ceph-mon[80030]: pgmap v836: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:16:59.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:16:59 smithi078 ceph-mon[108578]: pgmap v836: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:01.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:01 smithi148 ceph-mon[80030]: pgmap v837: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:01.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:01 smithi078 ceph-mon[108578]: pgmap v837: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:03.544 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:03 smithi078 ceph-mon[108578]: pgmap v838: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:03.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:03 smithi148 ceph-mon[80030]: pgmap v838: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:05.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:05 smithi148 ceph-mon[80030]: pgmap v839: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:05.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:05 smithi078 ceph-mon[108578]: pgmap v839: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:07.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:07 smithi148 ceph-mon[80030]: pgmap v840: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:07.744 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:07 smithi078 ceph-mon[108578]: pgmap v840: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:09.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:09 smithi078 ceph-mon[108578]: pgmap v841: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:09.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:09 smithi148 ceph-mon[80030]: pgmap v841: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:11 smithi148 ceph-mon[80030]: pgmap v842: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:11.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:17:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:11 smithi078 ceph-mon[108578]: pgmap v842: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:17:13.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:13 smithi148 ceph-mon[80030]: pgmap v843: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:13.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:13 smithi078 ceph-mon[108578]: pgmap v843: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:15.708 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:15 smithi078 ceph-mon[108578]: pgmap v844: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:15.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:15 smithi148 ceph-mon[80030]: pgmap v844: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:17.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:17 smithi148 ceph-mon[80030]: pgmap v845: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:17.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:17 smithi078 ceph-mon[108578]: pgmap v845: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:19.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:19 smithi148 ceph-mon[80030]: pgmap v846: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:19.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:19 smithi078 ceph-mon[108578]: pgmap v846: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:21.711 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:21 smithi078 ceph-mon[108578]: pgmap v847: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:21.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:21 smithi148 ceph-mon[80030]: pgmap v847: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:23.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:23 smithi148 ceph-mon[80030]: pgmap v848: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:23.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:23 smithi078 ceph-mon[108578]: pgmap v848: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:25.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:25 smithi148 ceph-mon[80030]: pgmap v849: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:25.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:25 smithi078 ceph-mon[108578]: pgmap v849: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:26.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:17:26.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:17:27.707 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:27 smithi078 ceph-mon[108578]: pgmap v850: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:27.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:27 smithi148 ceph-mon[80030]: pgmap v850: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:29.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:29 smithi148 ceph-mon[80030]: pgmap v851: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:29.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:29 smithi078 ceph-mon[108578]: pgmap v851: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:31.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:31 smithi148 ceph-mon[80030]: pgmap v852: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:31.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:31 smithi078 ceph-mon[108578]: pgmap v852: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:33.544 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:33 smithi078 ceph-mon[108578]: pgmap v853: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:33.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:33 smithi148 ceph-mon[80030]: pgmap v853: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:35.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:35 smithi148 ceph-mon[80030]: pgmap v854: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:35.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:35 smithi078 ceph-mon[108578]: pgmap v854: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:37.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:37 smithi148 ceph-mon[80030]: pgmap v855: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:37.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:37 smithi078 ceph-mon[108578]: pgmap v855: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:39.712 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:39 smithi078 ceph-mon[108578]: pgmap v856: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:39.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:39 smithi148 ceph-mon[80030]: pgmap v856: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:41 smithi148 ceph-mon[80030]: pgmap v857: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:41.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:41 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:17:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:41 smithi078 ceph-mon[108578]: pgmap v857: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:41.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:41 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:17:43.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:43 smithi148 ceph-mon[80030]: pgmap v858: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:43.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:43 smithi078 ceph-mon[108578]: pgmap v858: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:45 smithi148 ceph-mon[80030]: pgmap v859: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:45.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:45 smithi078 ceph-mon[108578]: pgmap v859: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:47.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:47 smithi078 ceph-mon[108578]: pgmap v860: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:47.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:47 smithi148 ceph-mon[80030]: pgmap v860: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:49.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:49 smithi078 ceph-mon[108578]: pgmap v861: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:49.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:49 smithi148 ceph-mon[80030]: pgmap v861: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:51.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:51 smithi078 ceph-mon[108578]: pgmap v862: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:51.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:17:51.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:17:51.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:17:51.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:17:51.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:51 smithi148 ceph-mon[80030]: pgmap v862: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:51.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:17:51.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:17:51.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:17:51.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:17:53.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:53 smithi078 ceph-mon[108578]: pgmap v863: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:53.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:53 smithi148 ceph-mon[80030]: pgmap v863: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:55 smithi078 ceph-mon[108578]: pgmap v864: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:55.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:55 smithi148 ceph-mon[80030]: pgmap v864: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:56.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:17:56.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:17:57.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:57 smithi078 ceph-mon[108578]: pgmap v865: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:57.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:57 smithi148 ceph-mon[80030]: pgmap v865: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:59.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:17:59 smithi148 ceph-mon[80030]: pgmap v866: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:17:59.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:17:59 smithi078 ceph-mon[108578]: pgmap v866: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:01.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:01 smithi148 ceph-mon[80030]: pgmap v867: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:01.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:01 smithi078 ceph-mon[108578]: pgmap v867: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:03.714 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:03 smithi078 ceph-mon[108578]: pgmap v868: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:03.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:03 smithi148 ceph-mon[80030]: pgmap v868: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:05.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:05 smithi078 ceph-mon[108578]: pgmap v869: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:05.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:05 smithi148 ceph-mon[80030]: pgmap v869: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:07.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:07 smithi148 ceph-mon[80030]: pgmap v870: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:07.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:07 smithi078 ceph-mon[108578]: pgmap v870: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:09.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:09 smithi148 ceph-mon[80030]: pgmap v871: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:09.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:09 smithi078 ceph-mon[108578]: pgmap v871: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:11.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:11 smithi148 ceph-mon[80030]: pgmap v872: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:11.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:18:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:11 smithi078 ceph-mon[108578]: pgmap v872: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:11.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:18:13.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:13 smithi148 ceph-mon[80030]: pgmap v873: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:13.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:13 smithi078 ceph-mon[108578]: pgmap v873: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:15.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:15 smithi078 ceph-mon[108578]: pgmap v874: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:15 smithi148 ceph-mon[80030]: pgmap v874: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:17.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:17 smithi148 ceph-mon[80030]: pgmap v875: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:17.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:17 smithi078 ceph-mon[108578]: pgmap v875: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:19.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:19 smithi148 ceph-mon[80030]: pgmap v876: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:19.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:19 smithi078 ceph-mon[108578]: pgmap v876: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:21.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:21 smithi148 ceph-mon[80030]: pgmap v877: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:21.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:21 smithi078 ceph-mon[108578]: pgmap v877: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:23.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:23 smithi148 ceph-mon[80030]: pgmap v878: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:23.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:23 smithi078 ceph-mon[108578]: pgmap v878: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:25.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:25 smithi148 ceph-mon[80030]: pgmap v879: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:25.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:25 smithi078 ceph-mon[108578]: pgmap v879: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:26.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:18:26.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:18:27.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:27 smithi148 ceph-mon[80030]: pgmap v880: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:27.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:27 smithi078 ceph-mon[108578]: pgmap v880: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:29.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:29 smithi148 ceph-mon[80030]: pgmap v881: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:29.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:29 smithi078 ceph-mon[108578]: pgmap v881: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:31.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:31 smithi148 ceph-mon[80030]: pgmap v882: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:31.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:31 smithi078 ceph-mon[108578]: pgmap v882: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:33.815 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:33 smithi078 ceph-mon[108578]: pgmap v883: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:33.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:33 smithi148 ceph-mon[80030]: pgmap v883: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:35.855 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:35 smithi078 ceph-mon[108578]: pgmap v884: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:35.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:35 smithi148 ceph-mon[80030]: pgmap v884: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:37 smithi148 ceph-mon[80030]: pgmap v885: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:37.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:37 smithi078 ceph-mon[108578]: pgmap v885: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:39.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:39 smithi148 ceph-mon[80030]: pgmap v886: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:39.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:39 smithi078 ceph-mon[108578]: pgmap v886: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:40.953 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:40 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:18:40.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:40 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:18:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:41 smithi148 ceph-mon[80030]: pgmap v887: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:41.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:41 smithi078 ceph-mon[108578]: pgmap v887: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:42.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:42 smithi148 ceph-mon[80030]: pgmap v888: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:42.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:42 smithi078 ceph-mon[108578]: pgmap v888: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:45.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:44 smithi148 ceph-mon[80030]: pgmap v889: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:45.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:44 smithi078 ceph-mon[108578]: pgmap v889: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:47.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:46 smithi148 ceph-mon[80030]: pgmap v890: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:47.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:46 smithi078 ceph-mon[108578]: pgmap v890: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:48.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:48 smithi078 ceph-mon[108578]: pgmap v891: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:49.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:48 smithi148 ceph-mon[80030]: pgmap v891: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:51.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:50 smithi148 ceph-mon[80030]: pgmap v892: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:51.241 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:50 smithi078 ceph-mon[108578]: pgmap v892: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:51.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:18:51.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:18:51.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:18:51.993 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:18:52.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:18:52.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:18:52.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:18:52.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:18:53.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:53 smithi148 ceph-mon[80030]: pgmap v893: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:53.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:53 smithi078 ceph-mon[108578]: pgmap v893: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:55.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:55 smithi148 ceph-mon[80030]: pgmap v894: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:55.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:55 smithi078 ceph-mon[108578]: pgmap v894: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:18:56.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:18:57.710 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:57 smithi078 ceph-mon[108578]: pgmap v895: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:57.724 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:57 smithi148 ceph-mon[80030]: pgmap v895: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:59.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:18:59 smithi148 ceph-mon[80030]: pgmap v896: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:18:59.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:18:59 smithi078 ceph-mon[108578]: pgmap v896: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:01.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:01 smithi148 ceph-mon[80030]: pgmap v897: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:01.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:01 smithi078 ceph-mon[108578]: pgmap v897: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:03.544 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:03 smithi078 ceph-mon[108578]: pgmap v898: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:03.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:03 smithi148 ceph-mon[80030]: pgmap v898: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:05.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:05 smithi078 ceph-mon[108578]: pgmap v899: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:05.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:05 smithi148 ceph-mon[80030]: pgmap v899: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:07.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:07 smithi078 ceph-mon[108578]: pgmap v900: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:07.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:07 smithi148 ceph-mon[80030]: pgmap v900: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:09.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:09 smithi078 ceph-mon[108578]: pgmap v901: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:09.901 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:09 smithi148 ceph-mon[80030]: pgmap v901: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:11 smithi078 ceph-mon[108578]: pgmap v902: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:11.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:11 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:19:11.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:11 smithi148 ceph-mon[80030]: pgmap v902: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:11.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:11 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:19:13.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:13 smithi078 ceph-mon[108578]: pgmap v903: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:13.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:13 smithi148 ceph-mon[80030]: pgmap v903: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:15.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:15 smithi078 ceph-mon[108578]: pgmap v904: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:15.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:15 smithi148 ceph-mon[80030]: pgmap v904: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:17.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:17 smithi148 ceph-mon[80030]: pgmap v905: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:17.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:17 smithi078 ceph-mon[108578]: pgmap v905: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:19.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:19 smithi148 ceph-mon[80030]: pgmap v906: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:20.382 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:19 smithi078 ceph-mon[108578]: pgmap v906: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:21.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:21 smithi148 ceph-mon[80030]: pgmap v907: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:21.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:21 smithi078 ceph-mon[108578]: pgmap v907: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:23.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:23 smithi078 ceph-mon[108578]: pgmap v908: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:23.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:23 smithi148 ceph-mon[80030]: pgmap v908: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:25.975 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:25 smithi148 ceph-mon[80030]: pgmap v909: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:25.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:25 smithi078 ceph-mon[108578]: pgmap v909: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:26.804 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:26 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:19:26.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:26 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:19:27.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:27 smithi148 ceph-mon[80030]: pgmap v910: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:27.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:27 smithi078 ceph-mon[108578]: pgmap v910: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:29.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:29 smithi148 ceph-mon[80030]: pgmap v911: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:29.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:29 smithi078 ceph-mon[108578]: pgmap v911: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:31.898 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:31 smithi078 ceph-mon[108578]: pgmap v912: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:31.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:31 smithi148 ceph-mon[80030]: pgmap v912: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:33.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:33 smithi148 ceph-mon[80030]: pgmap v913: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:33.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:33 smithi078 ceph-mon[108578]: pgmap v913: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:35.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:35 smithi148 ceph-mon[80030]: pgmap v914: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:35.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:35 smithi078 ceph-mon[108578]: pgmap v914: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:37.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:37 smithi148 ceph-mon[80030]: pgmap v915: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:37.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:37 smithi078 ceph-mon[108578]: pgmap v915: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:39.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:39 smithi148 ceph-mon[80030]: pgmap v916: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:39.991 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:39 smithi078 ceph-mon[108578]: pgmap v916: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:40.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:40 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:19:40.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:40 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:19:41.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:41 smithi148 ceph-mon[80030]: pgmap v917: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:41.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:41 smithi078 ceph-mon[108578]: pgmap v917: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:43.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:43 smithi148 ceph-mon[80030]: pgmap v918: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:43.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:43 smithi078 ceph-mon[108578]: pgmap v918: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:45.723 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:45 smithi148 ceph-mon[80030]: pgmap v919: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:45.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:45 smithi078 ceph-mon[108578]: pgmap v919: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:47.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:47 smithi148 ceph-mon[80030]: pgmap v920: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:47.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:47 smithi078 ceph-mon[108578]: pgmap v920: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:49.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:49 smithi148 ceph-mon[80030]: pgmap v921: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:49.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:49 smithi078 ceph-mon[108578]: pgmap v921: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:51.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:51 smithi148 ceph-mon[80030]: pgmap v922: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:51.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:51 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:19:51.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:51 smithi078 ceph-mon[108578]: pgmap v922: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:51.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:51 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:19:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:52 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:19:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:52 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:19:52.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:52 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:19:52.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:52 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:19:52.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:52 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:19:52.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:52 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:19:53.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:53 smithi148 ceph-mon[80030]: pgmap v923: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:53.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:53 smithi078 ceph-mon[108578]: pgmap v923: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:55.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:55 smithi148 ceph-mon[80030]: pgmap v924: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:55.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:55 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:19:55.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:55 smithi078 ceph-mon[108578]: pgmap v924: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:55.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:55 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:19:57.700 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:57 smithi078 ceph-mon[108578]: pgmap v925: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:57.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:57 smithi148 ceph-mon[80030]: pgmap v925: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:59.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:19:59 smithi148 ceph-mon[80030]: pgmap v926: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:19:59.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:19:59 smithi078 ceph-mon[108578]: pgmap v926: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:00.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:00 smithi148 ceph-mon[80030]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T13:20:00.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:00 smithi148 ceph-mon[80030]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:20:00.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:00 smithi148 ceph-mon[80030]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:20:00.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:00 smithi078 ceph-mon[108578]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T13:20:00.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:00 smithi078 ceph-mon[108578]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:20:00.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:00 smithi078 ceph-mon[108578]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:20:01.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:01 smithi148 ceph-mon[80030]: pgmap v927: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:01.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:01 smithi078 ceph-mon[108578]: pgmap v927: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:02.742 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:02 smithi078 ceph-mon[108578]: pgmap v928: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:02.973 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:02 smithi148 ceph-mon[80030]: pgmap v928: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:05.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:04 smithi148 ceph-mon[80030]: pgmap v929: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:05.241 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:04 smithi078 ceph-mon[108578]: pgmap v929: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:06.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:06 smithi078 ceph-mon[108578]: pgmap v930: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:07.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:06 smithi148 ceph-mon[80030]: pgmap v930: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:09.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:08 smithi148 ceph-mon[80030]: pgmap v931: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:09.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:08 smithi078 ceph-mon[108578]: pgmap v931: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:11.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:10 smithi148 ceph-mon[80030]: pgmap v932: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:11.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:10 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:20:11.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:10 smithi078 ceph-mon[108578]: pgmap v932: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:11.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:10 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:20:13.224 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:12 smithi148 ceph-mon[80030]: pgmap v933: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:13.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:12 smithi078 ceph-mon[108578]: pgmap v933: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:15.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:14 smithi148 ceph-mon[80030]: pgmap v934: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:15.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:14 smithi078 ceph-mon[108578]: pgmap v934: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:17.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:16 smithi148 ceph-mon[80030]: pgmap v935: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:17.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:16 smithi078 ceph-mon[108578]: pgmap v935: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:18.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:18 smithi078 ceph-mon[108578]: pgmap v936: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:19.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:18 smithi148 ceph-mon[80030]: pgmap v936: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:21.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:20 smithi148 ceph-mon[80030]: pgmap v937: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:21.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:20 smithi078 ceph-mon[108578]: pgmap v937: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:23.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:22 smithi148 ceph-mon[80030]: pgmap v938: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:23.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:22 smithi078 ceph-mon[108578]: pgmap v938: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:25.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:24 smithi148 ceph-mon[80030]: pgmap v939: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:25.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:24 smithi078 ceph-mon[108578]: pgmap v939: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:26.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:25 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:20:26.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:25 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:20:27.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:26 smithi078 ceph-mon[108578]: pgmap v940: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:27.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:26 smithi148 ceph-mon[80030]: pgmap v940: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:29.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:28 smithi078 ceph-mon[108578]: pgmap v941: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:29.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:28 smithi148 ceph-mon[80030]: pgmap v941: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:31.245 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:30 smithi078 ceph-mon[108578]: pgmap v942: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:31.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:30 smithi148 ceph-mon[80030]: pgmap v942: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:33.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:32 smithi078 ceph-mon[108578]: pgmap v943: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:33.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:32 smithi148 ceph-mon[80030]: pgmap v943: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:35.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:34 smithi078 ceph-mon[108578]: pgmap v944: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:35.275 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:34 smithi148 ceph-mon[80030]: pgmap v944: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:37.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:36 smithi078 ceph-mon[108578]: pgmap v945: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:37.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:36 smithi148 ceph-mon[80030]: pgmap v945: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:39.242 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:38 smithi078 ceph-mon[108578]: pgmap v946: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:39.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:38 smithi148 ceph-mon[80030]: pgmap v946: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:41.350 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:40 smithi148 ceph-mon[80030]: pgmap v947: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:41.351 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:40 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:20:41.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:40 smithi078 ceph-mon[108578]: pgmap v947: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:41.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:40 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:20:43.264 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:42 smithi078 ceph-mon[108578]: pgmap v948: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:43.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:42 smithi148 ceph-mon[80030]: pgmap v948: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:45.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:45 smithi148 ceph-mon[80030]: pgmap v949: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:45.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:45 smithi078 ceph-mon[108578]: pgmap v949: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:47.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:47 smithi148 ceph-mon[80030]: pgmap v950: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:47.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:47 smithi078 ceph-mon[108578]: pgmap v950: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:49.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:49 smithi148 ceph-mon[80030]: pgmap v951: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:49.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:49 smithi078 ceph-mon[108578]: pgmap v951: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:51.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:51 smithi148 ceph-mon[80030]: pgmap v952: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:51.493 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:51 smithi078 ceph-mon[108578]: pgmap v952: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:52.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:52 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:20:52.491 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:52 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:20:53.411 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:53 smithi078 ceph-mon[108578]: pgmap v953: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:53.411 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:53 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:20:53.411 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:53 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:20:53.412 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:53 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:20:53.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:53 smithi148 ceph-mon[80030]: pgmap v953: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:53.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:53 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:20:53.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:53 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:20:53.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:53 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' 2024-09-18T13:20:55.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:55 smithi148 ceph-mon[80030]: pgmap v954: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:55.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:55 smithi078 ceph-mon[108578]: pgmap v954: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:56.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:56 smithi148 ceph-mon[80030]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:20:56.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:56 smithi078 ceph-mon[108578]: from='mgr.14770 172.21.15.78:0/3701783159' entity='mgr.smithi078.ohifux' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:20:57.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:57 smithi148 ceph-mon[80030]: pgmap v955: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:57.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:57 smithi078 ceph-mon[108578]: pgmap v955: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:59.478 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:20:59 smithi148 ceph-mon[80030]: pgmap v956: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:20:59.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:20:59 smithi078 ceph-mon[108578]: pgmap v956: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:21:01.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:21:01 smithi148 ceph-mon[80030]: pgmap v957: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:21:01.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:21:01 smithi078 ceph-mon[108578]: pgmap v957: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:21:03.294 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:21:03 smithi078 ceph-mon[108578]: pgmap v958: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:21:03.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:21:03 smithi148 ceph-mon[80030]: pgmap v958: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:21:04.769 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-18T13:21:04.769 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-18T13:21:04.771 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-18T13:21:04.784 INFO:tasks.cephadm:Teardown begin 2024-09-18T13:21:04.784 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/cephadm.py", line 2374, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-18T13:21:04.786 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T13:21:04.820 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T13:21:04.854 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-18T13:21:04.854 DEBUG:teuthology.orchestra.run.smithi078:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-18T13:21:04.878 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-18T13:21:04.912 INFO:tasks.cephadm:Stopping all daemons... 2024-09-18T13:21:04.913 INFO:tasks.cephadm.mon.smithi078:Stopping mon.smithi078... 2024-09-18T13:21:04.913 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mon.smithi078 2024-09-18T13:21:05.223 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:21:05 smithi148 ceph-mon[80030]: pgmap v959: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:21:05.225 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:21:04 smithi078 systemd[1]: Stopping Ceph mon.smithi078 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T13:21:05.225 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:21:05 smithi078 ceph-mon[108578]: pgmap v959: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T13:21:05.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:21:05 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[108574]: 2024-09-18T13:21:05.222+0000 7f54fab14640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi078 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:21:05.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:21:05 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078[108574]: 2024-09-18T13:21:05.222+0000 7f54fab14640 -1 mon.smithi078@0(leader) e2 *** Got Signal Terminated *** 2024-09-18T13:21:05.492 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:21:05 smithi078 podman[155240]: 2024-09-18 13:21:05.256026007 +0000 UTC m=+0.141203659 container died f62f02a2a5d3c196acce83f9282a397e2877ffe16887f6ac6a24dbae5985f366 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-18T13:21:05.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:21:05 smithi078 podman[155240]: 2024-09-18 13:21:05.766065759 +0000 UTC m=+0.651243410 container cleanup f62f02a2a5d3c196acce83f9282a397e2877ffe16887f6ac6a24dbae5985f366 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-18T13:21:05.992 INFO:journalctl@ceph.mon.smithi078.smithi078.stdout:Sep 18 13:21:05 smithi078 bash[155240]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi078 2024-09-18T13:21:06.148 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mon.smithi078.service' 2024-09-18T13:21:06.192 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:21:06.192 INFO:tasks.cephadm.mon.smithi078:Stopped mon.smithi078 2024-09-18T13:21:06.192 INFO:tasks.cephadm.mon.smithi148:Stopping mon.smithi148... 2024-09-18T13:21:06.192 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mon.smithi148 2024-09-18T13:21:06.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:21:06 smithi148 systemd[1]: Stopping Ceph mon.smithi148 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T13:21:06.738 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:21:06 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi148[80026]: 2024-09-18T13:21:06.523+0000 7fbd58f93640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi148 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:21:06.738 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:21:06 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi148[80026]: 2024-09-18T13:21:06.523+0000 7fbd58f93640 -1 mon.smithi148@1(peon) e2 *** Got Signal Terminated *** 2024-09-18T13:21:07.042 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:21:06 smithi148 podman[113454]: 2024-09-18 13:21:06.738162766 +0000 UTC m=+0.336515074 container died 88906a6c2abc72160af2567f5487e06ee198df4a46fcdfa37b11a1dd8396e2fa (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi148, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T13:21:07.459 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:21:07 smithi148 podman[113454]: 2024-09-18 13:21:07.232325634 +0000 UTC m=+0.830677941 container cleanup 88906a6c2abc72160af2567f5487e06ee198df4a46fcdfa37b11a1dd8396e2fa (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi148, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-18T13:21:07.459 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Sep 18 13:21:07 smithi148 bash[113454]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-mon-smithi148 2024-09-18T13:21:07.592 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@mon.smithi148.service' 2024-09-18T13:21:07.635 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:21:07.635 INFO:tasks.cephadm.mon.smithi148:Stopped mon.smithi148 2024-09-18T13:21:07.635 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-18T13:21:07.635 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.0 2024-09-18T13:21:07.980 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 13:21:07 smithi078 systemd[1]: Stopping Ceph osd.0 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T13:21:08.242 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 13:21:07 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0[117328]: 2024-09-18T13:21:07.979+0000 7fd9a5c28640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:21:08.242 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 13:21:07 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0[117328]: 2024-09-18T13:21:07.979+0000 7fd9a5c28640 -1 osd.0 82 *** Got signal Terminated *** 2024-09-18T13:21:08.242 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 13:21:07 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0[117328]: 2024-09-18T13:21:07.979+0000 7fd9a5c28640 -1 osd.0 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:21:13.742 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 13:21:13 smithi078 podman[155371]: 2024-09-18 13:21:13.478677855 +0000 UTC m=+5.650925016 container died 4aad8c6ec439e9dff988514c4949f5eaae02e8938b296476e76be49c5646a372 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-18T13:21:14.132 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 13:21:13 smithi078 podman[155371]: 2024-09-18 13:21:13.838196671 +0000 UTC m=+6.010443820 container cleanup 4aad8c6ec439e9dff988514c4949f5eaae02e8938b296476e76be49c5646a372 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-18T13:21:14.132 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 13:21:13 smithi078 bash[155371]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0 2024-09-18T13:21:14.492 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 13:21:14 smithi078 podman[155389]: 2024-09-18 13:21:14.131538696 +0000 UTC m=+0.650501211 container remove 4aad8c6ec439e9dff988514c4949f5eaae02e8938b296476e76be49c5646a372 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-18T13:21:14.844 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 13:21:14 smithi078 podman[155479]: 2024-09-18 13:21:14.411962853 +0000 UTC m=+0.016222164 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:21:14.844 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 13:21:14 smithi078 podman[155479]: 2024-09-18 13:21:14.524249127 +0000 UTC m=+0.128508428 container create 4bfacb5de86125a789dbc97ac4bed3345ff70b043246e6ba6091be71a30782a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-18T13:21:14.844 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 13:21:14 smithi078 podman[155479]: 2024-09-18 13:21:14.751718307 +0000 UTC m=+0.355977619 container init 4bfacb5de86125a789dbc97ac4bed3345ff70b043246e6ba6091be71a30782a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-18T13:21:14.844 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 13:21:14 smithi078 podman[155479]: 2024-09-18 13:21:14.755705859 +0000 UTC m=+0.359965167 container start 4bfacb5de86125a789dbc97ac4bed3345ff70b043246e6ba6091be71a30782a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-18T13:21:14.844 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 13:21:14 smithi078 podman[155479]: 2024-09-18 13:21:14.843391833 +0000 UTC m=+0.447651143 container attach 4bfacb5de86125a789dbc97ac4bed3345ff70b043246e6ba6091be71a30782a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-09-18T13:21:15.242 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 18 13:21:14 smithi078 podman[155479]: 2024-09-18 13:21:14.949135688 +0000 UTC m=+0.553395020 container died 4bfacb5de86125a789dbc97ac4bed3345ff70b043246e6ba6091be71a30782a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-18T13:21:15.567 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.0.service' 2024-09-18T13:21:15.607 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:21:15.607 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-18T13:21:15.607 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-18T13:21:15.607 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.1 2024-09-18T13:21:15.827 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 13:21:15 smithi078 systemd[1]: Stopping Ceph osd.1 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T13:21:16.242 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 13:21:15 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1[123018]: 2024-09-18T13:21:15.933+0000 7f8c7c4d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:21:16.242 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 13:21:15 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1[123018]: 2024-09-18T13:21:15.933+0000 7f8c7c4d3640 -1 osd.1 82 *** Got signal Terminated *** 2024-09-18T13:21:16.242 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 13:21:15 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1[123018]: 2024-09-18T13:21:15.933+0000 7f8c7c4d3640 -1 osd.1 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:21:21.518 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 13:21:21 smithi078 podman[155582]: 2024-09-18 13:21:21.257807806 +0000 UTC m=+5.424941821 container died 407cc1be36c1dbd321ea0ccbf35dd14dfb1c2e0dc42752b85567eddd278cbb4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-09-18T13:21:21.919 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 13:21:21 smithi078 podman[155582]: 2024-09-18 13:21:21.60869169 +0000 UTC m=+5.775825705 container cleanup 407cc1be36c1dbd321ea0ccbf35dd14dfb1c2e0dc42752b85567eddd278cbb4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-18T13:21:21.919 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 13:21:21 smithi078 bash[155582]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1 2024-09-18T13:21:22.242 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 13:21:21 smithi078 podman[155609]: 2024-09-18 13:21:21.918557318 +0000 UTC m=+0.654467621 container remove 407cc1be36c1dbd321ea0ccbf35dd14dfb1c2e0dc42752b85567eddd278cbb4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True) 2024-09-18T13:21:22.522 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 13:21:22 smithi078 podman[155696]: 2024-09-18 13:21:22.14537701 +0000 UTC m=+0.016429085 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:21:22.523 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 13:21:22 smithi078 podman[155696]: 2024-09-18 13:21:22.286634195 +0000 UTC m=+0.157686300 container create f1202a1df94ae617000e97929a732a09ed0f7fb0647b750f0611a31ba2553b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True) 2024-09-18T13:21:22.523 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 13:21:22 smithi078 podman[155696]: 2024-09-18 13:21:22.522364341 +0000 UTC m=+0.393416411 container init f1202a1df94ae617000e97929a732a09ed0f7fb0647b750f0611a31ba2553b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-18T13:21:22.992 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 13:21:22 smithi078 podman[155696]: 2024-09-18 13:21:22.525726506 +0000 UTC m=+0.396778574 container start f1202a1df94ae617000e97929a732a09ed0f7fb0647b750f0611a31ba2553b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-18T13:21:22.992 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 13:21:22 smithi078 podman[155696]: 2024-09-18 13:21:22.605645462 +0000 UTC m=+0.476697534 container attach f1202a1df94ae617000e97929a732a09ed0f7fb0647b750f0611a31ba2553b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-18T13:21:22.992 INFO:journalctl@ceph.osd.1.smithi078.stdout:Sep 18 13:21:22 smithi078 podman[155696]: 2024-09-18 13:21:22.722622653 +0000 UTC m=+0.593674729 container died f1202a1df94ae617000e97929a732a09ed0f7fb0647b750f0611a31ba2553b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T13:21:23.345 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.1.service' 2024-09-18T13:21:23.386 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:21:23.386 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-18T13:21:23.386 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-18T13:21:23.386 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.2 2024-09-18T13:21:23.738 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 13:21:23 smithi078 systemd[1]: Stopping Ceph osd.2 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T13:21:23.992 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 13:21:23 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2[128738]: 2024-09-18T13:21:23.737+0000 7f38412bb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:21:23.992 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 13:21:23 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2[128738]: 2024-09-18T13:21:23.737+0000 7f38412bb640 -1 osd.2 82 *** Got signal Terminated *** 2024-09-18T13:21:23.992 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 13:21:23 smithi078 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2[128738]: 2024-09-18T13:21:23.737+0000 7f38412bb640 -1 osd.2 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:21:29.242 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 13:21:29 smithi078 podman[155800]: 2024-09-18 13:21:29.145058982 +0000 UTC m=+5.528773927 container died c74b9bc9ce72d8d3352eb246a986b7539184416dd994b6b8c6d0f0bc3265dbd3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-18T13:21:29.742 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 13:21:29 smithi078 podman[155800]: 2024-09-18 13:21:29.520516605 +0000 UTC m=+5.904231540 container cleanup c74b9bc9ce72d8d3352eb246a986b7539184416dd994b6b8c6d0f0bc3265dbd3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-18T13:21:29.742 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 13:21:29 smithi078 bash[155800]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2 2024-09-18T13:21:30.141 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 13:21:29 smithi078 podman[155816]: 2024-09-18 13:21:29.783062913 +0000 UTC m=+0.630814815 container remove c74b9bc9ce72d8d3352eb246a986b7539184416dd994b6b8c6d0f0bc3265dbd3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2) 2024-09-18T13:21:30.459 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 13:21:30 smithi078 podman[155904]: 2024-09-18 13:21:30.044012745 +0000 UTC m=+0.016254470 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:21:30.459 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 13:21:30 smithi078 podman[155904]: 2024-09-18 13:21:30.173100374 +0000 UTC m=+0.145342127 container create 3bf983e887080ef87ec83706f54ae6bd9a65fbce5e2d2db798a4269905549847 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-18T13:21:30.459 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 13:21:30 smithi078 podman[155904]: 2024-09-18 13:21:30.383935476 +0000 UTC m=+0.356177196 container init 3bf983e887080ef87ec83706f54ae6bd9a65fbce5e2d2db798a4269905549847 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-09-18T13:21:30.459 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 13:21:30 smithi078 podman[155904]: 2024-09-18 13:21:30.387204277 +0000 UTC m=+0.359445985 container start 3bf983e887080ef87ec83706f54ae6bd9a65fbce5e2d2db798a4269905549847 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-18T13:21:30.459 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 13:21:30 smithi078 podman[155904]: 2024-09-18 13:21:30.458723258 +0000 UTC m=+0.430964985 container attach 3bf983e887080ef87ec83706f54ae6bd9a65fbce5e2d2db798a4269905549847 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-18T13:21:30.742 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 18 13:21:30 smithi078 podman[155904]: 2024-09-18 13:21:30.570788036 +0000 UTC m=+0.543029746 container died 3bf983e887080ef87ec83706f54ae6bd9a65fbce5e2d2db798a4269905549847 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-18T13:21:31.141 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.2.service' 2024-09-18T13:21:31.181 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:21:31.181 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-18T13:21:31.181 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-18T13:21:31.182 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.3 2024-09-18T13:21:31.473 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:31 smithi148 systemd[1]: Stopping Ceph osd.3 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T13:21:31.973 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:31 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3[88354]: 2024-09-18T13:21:31.501+0000 7f86312d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:21:31.973 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:31 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3[88354]: 2024-09-18T13:21:31.501+0000 7f86312d6640 -1 osd.3 82 *** Got signal Terminated *** 2024-09-18T13:21:31.973 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:31 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3[88354]: 2024-09-18T13:21:31.501+0000 7f86312d6640 -1 osd.3 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:21:34.723 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:34 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3[88354]: 2024-09-18T13:21:34.301+0000 7f86298e3640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.291100+0000 front 2024-09-18T13:21:09.291080+0000 (oldest deadline 2024-09-18T13:21:33.991071+0000) 2024-09-18T13:21:35.625 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:35 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3[88354]: 2024-09-18T13:21:35.257+0000 7f86298e3640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.291100+0000 front 2024-09-18T13:21:09.291080+0000 (oldest deadline 2024-09-18T13:21:33.991071+0000) 2024-09-18T13:21:35.625 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:35 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:35.344+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:36.635 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:36 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3[88354]: 2024-09-18T13:21:36.226+0000 7f86298e3640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.291100+0000 front 2024-09-18T13:21:09.291080+0000 (oldest deadline 2024-09-18T13:21:33.991071+0000) 2024-09-18T13:21:36.635 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:36 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:36.296+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:37.169 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:37 smithi148 podman[113578]: 2024-09-18 13:21:37.038488566 +0000 UTC m=+5.662001294 container died 084fd12e18904e2d3ee6d52b5f10e36af7bd6590ce70ca43a5ef7c2d82db6866 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-18T13:21:37.435 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:37 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:37.253+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:37.698 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:37 smithi148 podman[113578]: 2024-09-18 13:21:37.434969726 +0000 UTC m=+6.058482453 container cleanup 084fd12e18904e2d3ee6d52b5f10e36af7bd6590ce70ca43a5ef7c2d82db6866 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T13:21:37.698 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:37 smithi148 bash[113578]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3 2024-09-18T13:21:37.973 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:37 smithi148 podman[113597]: 2024-09-18 13:21:37.697360226 +0000 UTC m=+0.651229718 container remove 084fd12e18904e2d3ee6d52b5f10e36af7bd6590ce70ca43a5ef7c2d82db6866 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T13:21:38.357 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:38 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T13:21:38.250+0000 7f385bc39640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:12.785279+0000 front 2024-09-18T13:21:12.785400+0000 (oldest deadline 2024-09-18T13:21:37.485247+0000) 2024-09-18T13:21:38.357 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:38 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:38.228+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:38.357 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:38 smithi148 podman[113695]: 2024-09-18 13:21:37.93653253 +0000 UTC m=+0.022697257 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:21:38.357 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:38 smithi148 podman[113695]: 2024-09-18 13:21:38.054213237 +0000 UTC m=+0.140377962 container create ac4c46ce854c83d989f2657d53a38dccc377907a51f999089c89f4ee15fd9773 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-18T13:21:38.358 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:38 smithi148 podman[113695]: 2024-09-18 13:21:38.273440212 +0000 UTC m=+0.359604944 container init ac4c46ce854c83d989f2657d53a38dccc377907a51f999089c89f4ee15fd9773 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-18T13:21:38.358 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:38 smithi148 podman[113695]: 2024-09-18 13:21:38.276713063 +0000 UTC m=+0.362877802 container start ac4c46ce854c83d989f2657d53a38dccc377907a51f999089c89f4ee15fd9773 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-18T13:21:38.358 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:38 smithi148 podman[113695]: 2024-09-18 13:21:38.356747597 +0000 UTC m=+0.442912333 container attach ac4c46ce854c83d989f2657d53a38dccc377907a51f999089c89f4ee15fd9773 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-18T13:21:38.723 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 18 13:21:38 smithi148 podman[113695]: 2024-09-18 13:21:38.469657937 +0000 UTC m=+0.555822664 container died ac4c46ce854c83d989f2657d53a38dccc377907a51f999089c89f4ee15fd9773 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T13:21:39.045 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.3.service' 2024-09-18T13:21:39.090 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:21:39.090 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-18T13:21:39.090 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-18T13:21:39.091 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.4 2024-09-18T13:21:39.423 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:39 smithi148 systemd[1]: Stopping Ceph osd.4 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T13:21:39.423 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:39 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T13:21:39.233+0000 7f385bc39640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:12.785279+0000 front 2024-09-18T13:21:12.785400+0000 (oldest deadline 2024-09-18T13:21:37.485247+0000) 2024-09-18T13:21:39.423 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:39 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:39.184+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:39.723 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:39 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T13:21:39.421+0000 7f385f624640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:21:39.723 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:39 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T13:21:39.421+0000 7f385f624640 -1 osd.4 82 *** Got signal Terminated *** 2024-09-18T13:21:39.723 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:39 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T13:21:39.421+0000 7f385f624640 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:21:40.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:40 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T13:21:40.278+0000 7f385bc39640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:12.785279+0000 front 2024-09-18T13:21:12.785400+0000 (oldest deadline 2024-09-18T13:21:37.485247+0000) 2024-09-18T13:21:40.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:40 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:40.164+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:41.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:41 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T13:21:41.233+0000 7f385bc39640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:12.785279+0000 front 2024-09-18T13:21:12.785400+0000 (oldest deadline 2024-09-18T13:21:37.485247+0000) 2024-09-18T13:21:41.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:41 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:41.116+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:42.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:42 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:42.105+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:42.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:42 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T13:21:42.252+0000 7f385bc39640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:12.785279+0000 front 2024-09-18T13:21:12.785400+0000 (oldest deadline 2024-09-18T13:21:37.485247+0000) 2024-09-18T13:21:42.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:42 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T13:21:42.252+0000 7f385bc39640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-18T13:21:20.386076+0000 front 2024-09-18T13:21:20.386095+0000 (oldest deadline 2024-09-18T13:21:42.085937+0000) 2024-09-18T13:21:43.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:43 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:43.124+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:43.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:43 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T13:21:43.256+0000 7f385bc39640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:12.785279+0000 front 2024-09-18T13:21:12.785400+0000 (oldest deadline 2024-09-18T13:21:37.485247+0000) 2024-09-18T13:21:43.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:43 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T13:21:43.256+0000 7f385bc39640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-18T13:21:20.386076+0000 front 2024-09-18T13:21:20.386095+0000 (oldest deadline 2024-09-18T13:21:42.085937+0000) 2024-09-18T13:21:44.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:44 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:44.105+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:44.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:44 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T13:21:44.256+0000 7f385bc39640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:12.785279+0000 front 2024-09-18T13:21:12.785400+0000 (oldest deadline 2024-09-18T13:21:37.485247+0000) 2024-09-18T13:21:44.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:44 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4[93031]: 2024-09-18T13:21:44.256+0000 7f385bc39640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-18T13:21:20.386076+0000 front 2024-09-18T13:21:20.386095+0000 (oldest deadline 2024-09-18T13:21:42.085937+0000) 2024-09-18T13:21:45.115 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:44 smithi148 podman[113796]: 2024-09-18 13:21:44.843384529 +0000 UTC m=+5.530209260 container died da0a51763e0cbba96601942491e3199f70c37df9c1782c10b29ab80b41108fc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T13:21:45.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:45 smithi148 podman[113796]: 2024-09-18 13:21:45.204902341 +0000 UTC m=+5.891727111 container cleanup da0a51763e0cbba96601942491e3199f70c37df9c1782c10b29ab80b41108fc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T13:21:45.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:45 smithi148 bash[113796]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4 2024-09-18T13:21:45.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:45 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:45.121+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:45.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:45 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:45.121+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-18T13:21:19.043067+0000 front 2024-09-18T13:21:19.042942+0000 (oldest deadline 2024-09-18T13:21:44.342799+0000) 2024-09-18T13:21:45.820 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:45 smithi148 podman[113813]: 2024-09-18 13:21:45.47291276 +0000 UTC m=+0.626948220 container remove da0a51763e0cbba96601942491e3199f70c37df9c1782c10b29ab80b41108fc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-18T13:21:46.093 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:45 smithi148 podman[113903]: 2024-09-18 13:21:45.722478781 +0000 UTC m=+0.015883996 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:21:46.093 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:45 smithi148 podman[113903]: 2024-09-18 13:21:45.843914223 +0000 UTC m=+0.137319433 container create 4d285a545294a9f34343bacfc191e5a3c3a08f91f35cabb23e0af2202dd1a626 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-18T13:21:46.093 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:46 smithi148 podman[113903]: 2024-09-18 13:21:46.092946511 +0000 UTC m=+0.386351734 container init 4d285a545294a9f34343bacfc191e5a3c3a08f91f35cabb23e0af2202dd1a626 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-18T13:21:46.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:46 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:46.131+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:46.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:46 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:46.131+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-18T13:21:19.043067+0000 front 2024-09-18T13:21:19.042942+0000 (oldest deadline 2024-09-18T13:21:44.342799+0000) 2024-09-18T13:21:46.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:46 smithi148 podman[113903]: 2024-09-18 13:21:46.096220881 +0000 UTC m=+0.389626087 container start 4d285a545294a9f34343bacfc191e5a3c3a08f91f35cabb23e0af2202dd1a626 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T13:21:46.473 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:46 smithi148 podman[113903]: 2024-09-18 13:21:46.167933874 +0000 UTC m=+0.461339099 container attach 4d285a545294a9f34343bacfc191e5a3c3a08f91f35cabb23e0af2202dd1a626 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=) 2024-09-18T13:21:46.474 INFO:journalctl@ceph.osd.4.smithi148.stdout:Sep 18 13:21:46 smithi148 podman[113903]: 2024-09-18 13:21:46.282899963 +0000 UTC m=+0.576305188 container died 4d285a545294a9f34343bacfc191e5a3c3a08f91f35cabb23e0af2202dd1a626 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-18T13:21:46.888 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.4.service' 2024-09-18T13:21:46.929 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:21:46.929 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-18T13:21:46.929 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-18T13:21:46.929 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.5 2024-09-18T13:21:47.223 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:47 smithi148 systemd[1]: Stopping Ceph osd.5 for ecc0857e-75ba-11ef-bceb-c7b262605968... 2024-09-18T13:21:47.223 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:47 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:47.100+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:47.223 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:47 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:47.100+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-18T13:21:19.043067+0000 front 2024-09-18T13:21:19.042942+0000 (oldest deadline 2024-09-18T13:21:44.342799+0000) 2024-09-18T13:21:47.723 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:47 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:47.265+0000 7fefcfde8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:21:47.723 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:47 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:47.265+0000 7fefcfde8640 -1 osd.5 82 *** Got signal Terminated *** 2024-09-18T13:21:47.723 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:47 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:47.265+0000 7fefcfde8640 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:21:48.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:48 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:48.055+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:48.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:48 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:48.055+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-18T13:21:19.043067+0000 front 2024-09-18T13:21:19.042942+0000 (oldest deadline 2024-09-18T13:21:44.342799+0000) 2024-09-18T13:21:49.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:49 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:49.071+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:49.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:49 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:49.071+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-18T13:21:19.043067+0000 front 2024-09-18T13:21:19.042942+0000 (oldest deadline 2024-09-18T13:21:44.342799+0000) 2024-09-18T13:21:50.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:50 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:50.052+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:50.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:50 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:50.052+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-18T13:21:19.043067+0000 front 2024-09-18T13:21:19.042942+0000 (oldest deadline 2024-09-18T13:21:44.342799+0000) 2024-09-18T13:21:51.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:51 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:51.034+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:51.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:51 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:51.034+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-18T13:21:19.043067+0000 front 2024-09-18T13:21:19.042942+0000 (oldest deadline 2024-09-18T13:21:44.342799+0000) 2024-09-18T13:21:51.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:51 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:51.034+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-18T13:21:24.343371+0000 front 2024-09-18T13:21:24.343324+0000 (oldest deadline 2024-09-18T13:21:50.243172+0000) 2024-09-18T13:21:52.295 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:52 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:52.027+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-18T13:21:09.642256+0000 front 2024-09-18T13:21:09.642372+0000 (oldest deadline 2024-09-18T13:21:34.942135+0000) 2024-09-18T13:21:52.295 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:52 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:52.027+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6814 osd.1 since back 2024-09-18T13:21:19.043067+0000 front 2024-09-18T13:21:19.042942+0000 (oldest deadline 2024-09-18T13:21:44.342799+0000) 2024-09-18T13:21:52.295 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:52 smithi148 ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5[97722]: 2024-09-18T13:21:52.027+0000 7fefcc3fd640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.78:6822 osd.2 since back 2024-09-18T13:21:24.343371+0000 front 2024-09-18T13:21:24.343324+0000 (oldest deadline 2024-09-18T13:21:50.243172+0000) 2024-09-18T13:21:52.859 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:52 smithi148 podman[114008]: 2024-09-18 13:21:52.595982888 +0000 UTC m=+5.441726840 container died aed13dbdc2528fb2d0ff7bbc27bac4d1b39542802e0546b650e5366453eaa52a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-18T13:21:53.217 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:52 smithi148 podman[114008]: 2024-09-18 13:21:52.948807745 +0000 UTC m=+5.794551679 container cleanup aed13dbdc2528fb2d0ff7bbc27bac4d1b39542802e0546b650e5366453eaa52a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T13:21:53.217 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:52 smithi148 bash[114008]: ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5 2024-09-18T13:21:53.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:53 smithi148 podman[114026]: 2024-09-18 13:21:53.216770515 +0000 UTC m=+0.617972593 container remove aed13dbdc2528fb2d0ff7bbc27bac4d1b39542802e0546b650e5366453eaa52a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-18T13:21:53.837 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:53 smithi148 podman[114111]: 2024-09-18 13:21:53.559160136 +0000 UTC m=+0.113097385 container create 6aaa584b3f7a34cc80785176f6a47a212c4d3ec229af4e96d2ed3885257dc27a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD) 2024-09-18T13:21:53.837 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:53 smithi148 podman[114111]: 2024-09-18 13:21:53.4618259 +0000 UTC m=+0.015763159 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:21:53.837 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:53 smithi148 podman[114111]: 2024-09-18 13:21:53.754767173 +0000 UTC m=+0.308704427 container init 6aaa584b3f7a34cc80785176f6a47a212c4d3ec229af4e96d2ed3885257dc27a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux ) 2024-09-18T13:21:53.838 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:53 smithi148 podman[114111]: 2024-09-18 13:21:53.757989231 +0000 UTC m=+0.311926482 container start 6aaa584b3f7a34cc80785176f6a47a212c4d3ec229af4e96d2ed3885257dc27a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD) 2024-09-18T13:21:53.838 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:53 smithi148 podman[114111]: 2024-09-18 13:21:53.8370759 +0000 UTC m=+0.391013149 container attach 6aaa584b3f7a34cc80785176f6a47a212c4d3ec229af4e96d2ed3885257dc27a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-09-18T13:21:54.223 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 18 13:21:53 smithi148 podman[114111]: 2024-09-18 13:21:53.949279286 +0000 UTC m=+0.503216538 container died 6aaa584b3f7a34cc80785176f6a47a212c4d3ec229af4e96d2ed3885257dc27a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-ecc0857e-75ba-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-18T13:21:54.565 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ecc0857e-75ba-11ef-bceb-c7b262605968@osd.5.service' 2024-09-18T13:21:54.606 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:21:54.606 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-18T13:21:54.606 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-18T13:21:54.812 INFO:teuthology.orchestra.run.smithi078.stdout:Deleting cluster with fsid: ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T13:21:59.132 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[76875]: fuse finished with error 0 and tester_r 0 2024-09-18T13:22:18.076 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-18T13:22:18.293 INFO:teuthology.orchestra.run.smithi148.stdout:Deleting cluster with fsid: ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T13:22:32.730 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T13:22:32.764 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T13:22:32.796 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-18T13:22:32.798 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911383/remote/smithi078/crash 2024-09-18T13:22:32.799 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/crash -- . 2024-09-18T13:22:32.833 INFO:teuthology.orchestra.run.smithi078.stderr:tar: /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-18T13:22:32.834 INFO:teuthology.orchestra.run.smithi078.stderr:tar: Error is not recoverable: exiting now 2024-09-18T13:22:32.836 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911383/remote/smithi148/crash 2024-09-18T13:22:32.837 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/crash -- . 2024-09-18T13:22:32.861 INFO:teuthology.orchestra.run.smithi148.stderr:tar: /var/lib/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-18T13:22:32.861 INFO:teuthology.orchestra.run.smithi148.stderr:tar: Error is not recoverable: exiting now 2024-09-18T13:22:32.863 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-18T13:22:32.863 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-18T13:22:32.919 INFO:teuthology.orchestra.run.smithi078.stdout:2024-09-18T12:43:14.567215+0000 mon.smithi078 (mon.0) 398 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-18T13:22:32.920 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-18T13:22:32.920 INFO:tasks.cephadm:Compressing logs... 2024-09-18T13:22:32.920 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T13:22:32.923 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T13:22:32.946 INFO:teuthology.orchestra.run.smithi078.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-18T13:22:32.946 INFO:teuthology.orchestra.run.smithi078.stderr:: No such file or directory 2024-09-18T13:22:32.946 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-18T13:22:32.947 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-18T13:22:32.948 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mon.smithi078.log 2024-09-18T13:22:32.948 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mgr.smithi078.ohifux.log 2024-09-18T13:22:32.948 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi078.eakgoe.log 2024-09-18T13:22:32.951 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mon.smithi078.log: /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mgr.smithi078.ohifux.log: gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-18T13:22:32.951 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi078.eakgoe.log: gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi078.furyab.log 2024-09-18T13:22:32.951 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-18T13:22:32.952 INFO:teuthology.orchestra.run.smithi148.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi148.tvvouo.log 2024-09-18T13:22:32.953 INFO:teuthology.orchestra.run.smithi148.stderr:: No such file or directory 2024-09-18T13:22:32.953 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-18T13:22:32.953 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi148.tvvouo.log: gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-18T13:22:32.953 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-18T13:22:32.953 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mon.smithi148.log 2024-09-18T13:22:32.953 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-18T13:22:32.953 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mon.smithi148.log: gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi148.fqecmm.log 2024-09-18T13:22:32.953 INFO:teuthology.orchestra.run.smithi148.stderr:gzip/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.cephadm.log: -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi148.log 2024-09-18T13:22:32.953 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi148.fqecmm.log: gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-18T13:22:32.953 INFO:teuthology.orchestra.run.smithi148.stderr: 85.0% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-18T13:22:32.955 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi148.log: 91.6% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-18T13:22:32.955 INFO:teuthology.orchestra.run.smithi148.stderr: 94.4% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi148.log.gz 2024-09-18T13:22:32.955 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.log 2024-09-18T13:22:32.956 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mgr.smithi148.bfgshs.log 2024-09-18T13:22:32.956 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-18T13:22:32.956 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi078.furyab.log: 91.4% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-18T13:22:32.958 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-18T13:22:32.959 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mgr.smithi148.bfgshs.log: 89.3% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-18T13:22:32.959 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.cephadm.log: 86.5% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-18T13:22:32.960 INFO:teuthology.orchestra.run.smithi148.stderr: 94.7% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi148.tvvouo.log.gz 2024-09-18T13:22:32.962 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-18T13:22:32.962 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-18T13:22:32.967 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.log 2024-09-18T13:22:32.970 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.log: 93.2% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi148.fqecmm.log.gz 2024-09-18T13:22:32.971 INFO:teuthology.orchestra.run.smithi148.stderr: 91.1% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-18T13:22:32.973 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.2.log: 91.2% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-18T13:22:32.974 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi078.log 2024-09-18T13:22:32.975 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-18T13:22:32.979 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.log: 89.3% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-18T13:22:32.980 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-18T13:22:32.983 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi078.log: 94.3% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi078.log.gz 2024-09-18T13:22:32.983 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-18T13:22:33.013 INFO:teuthology.orchestra.run.smithi148.stderr: 89.7% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mgr.smithi148.bfgshs.log.gz 2024-09-18T13:22:33.039 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 93.5% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi078.furyab.log.gz 2024-09-18T13:22:33.061 INFO:teuthology.orchestra.run.smithi078.stderr: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-18T13:22:33.341 INFO:teuthology.orchestra.run.smithi148.stderr: 92.6% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mon.smithi148.log.gz 2024-09-18T13:22:33.456 INFO:teuthology.orchestra.run.smithi078.stderr: 89.8% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mgr.smithi078.ohifux.log.gz 2024-09-18T13:22:34.508 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mon.smithi078.log.gz 2024-09-18T13:22:36.653 INFO:teuthology.orchestra.run.smithi148.stderr: 93.8% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-18T13:22:37.479 INFO:teuthology.orchestra.run.smithi078.stderr: 93.8% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-18T13:22:37.928 INFO:teuthology.orchestra.run.smithi148.stderr: 93.8% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-18T13:22:38.389 INFO:teuthology.orchestra.run.smithi078.stderr: 93.7% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-18T13:22:38.507 INFO:teuthology.orchestra.run.smithi148.stderr: 93.8% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-18T13:22:39.431 INFO:teuthology.orchestra.run.smithi078.stderr: 93.8% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-18T13:22:47.074 INFO:teuthology.orchestra.run.smithi148.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-18T13:22:47.074 INFO:teuthology.orchestra.run.smithi148.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-18T13:22:47.075 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-18T13:22:47.075 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m14.138s 2024-09-18T13:22:47.076 INFO:teuthology.orchestra.run.smithi148.stderr:user 0m27.943s 2024-09-18T13:22:47.076 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m0.888s 2024-09-18T13:22:47.482 INFO:teuthology.orchestra.run.smithi078.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-18T13:24:16.098 INFO:teuthology.orchestra.run.smithi078.stderr: 93.0% -- replaced with /var/log/ceph/ecc0857e-75ba-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi078.eakgoe.log.gz 2024-09-18T13:24:16.100 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-18T13:24:16.100 INFO:teuthology.orchestra.run.smithi078.stderr:real 1m43.163s 2024-09-18T13:24:16.100 INFO:teuthology.orchestra.run.smithi078.stderr:user 2m11.632s 2024-09-18T13:24:16.100 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m4.382s 2024-09-18T13:24:16.100 INFO:tasks.cephadm:Archiving logs... 2024-09-18T13:24:16.101 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911383/remote/smithi078/log 2024-09-18T13:24:16.102 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T13:24:36.537 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911383/remote/smithi148/log 2024-09-18T13:24:36.539 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T13:24:40.749 INFO:tasks.cephadm:Removing cluster... 2024-09-18T13:24:40.749 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 --force 2024-09-18T13:24:40.948 INFO:teuthology.orchestra.run.smithi078.stdout:Deleting cluster with fsid: ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T13:24:41.394 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ecc0857e-75ba-11ef-bceb-c7b262605968 --force 2024-09-18T13:24:41.596 INFO:teuthology.orchestra.run.smithi148.stdout:Deleting cluster with fsid: ecc0857e-75ba-11ef-bceb-c7b262605968 2024-09-18T13:24:41.873 INFO:tasks.cephadm:Removing cephadm ... 2024-09-18T13:24:41.874 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-18T13:24:41.891 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-18T13:24:41.907 INFO:tasks.cephadm:Teardown complete 2024-09-18T13:24:41.907 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-18T13:24:41.918 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-18T13:24:41.919 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-18T13:24:41.919 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T13:24:41.933 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T13:24:42.018 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-18T13:24:42.029 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-18T13:24:42.029 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T13:24:42.032 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T13:24:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2024-09-18T13:24:42.046 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-18T13:24:42.050 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T13:24:42.050 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-09-18T13:24:42.050 INFO:teuthology.orchestra.run.smithi078.stdout:^* hv01.front.sepia.ceph.com 3 6 377 57 +569us[ +573us] +/- 43ms 2024-09-18T13:24:42.050 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 -2207us[-2207us] +/- 64ms 2024-09-18T13:24:42.050 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 +1723us[+1723us] +/- 81ms 2024-09-18T13:24:42.050 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T13:24:42.051 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T13:24:42.051 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-18T13:24:42.051 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv01.front.sepia.ceph.com 3 6 377 52 +581us[ +579us] +/- 43ms 2024-09-18T13:24:42.051 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 53 -2204us[-2206us] +/- 64ms 2024-09-18T13:24:42.051 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 +1717us[+1715us] +/- 81ms 2024-09-18T13:24:42.051 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T13:24:42.051 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-18T13:24:42.063 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-18T13:24:42.063 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-18T13:24:42.075 DEBUG:teuthology.orchestra.run.smithi078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T13:24:42.170 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T13:24:42.242 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-18T13:24:42.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:24:42.270 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-18T13:24:42.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:24:42.298 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-18T13:24:42.309 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-18T13:24:42.325 INFO:teuthology.task.internal:Duration was 3129.654085 seconds 2024-09-18T13:24:42.326 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-18T13:24:42.341 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-18T13:24:42.341 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T13:24:42.344 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T13:24:42.381 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T13:24:42.383 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T13:24:42.797 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-18T13:24:42.797 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2024-09-18T13:24:42.797 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T13:24:42.858 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2024-09-18T13:24:42.859 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T13:24:42.889 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-18T13:24:42.889 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T13:24:42.901 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T13:24:42.956 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-18T13:24:42.957 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T13:24:42.967 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T13:24:43.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-18T13:24:43.890 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-18T13:24:43.890 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T13:24:43.915 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T13:24:43.942 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-18T13:24:43.953 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:24:43.958 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:24:43.978 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2024-09-18T13:24:44.007 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2024-09-18T13:24:44.036 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:24:44.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:24:44.059 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:24:44.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:24:44.090 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-18T13:24:44.106 INFO:teuthology.task.internal:Transferring archived files... 2024-09-18T13:24:44.107 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911383/remote/smithi078 2024-09-18T13:24:44.107 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T13:24:44.162 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911383/remote/smithi148 2024-09-18T13:24:44.162 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T13:24:44.200 INFO:teuthology.task.internal:Removing archive directory... 2024-09-18T13:24:44.200 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T13:24:44.202 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T13:24:44.249 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-18T13:24:44.261 INFO:teuthology.task.internal:Not uploading archives. 2024-09-18T13:24:44.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-18T13:24:44.276 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-18T13:24:44.276 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T13:24:44.279 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T13:24:44.291 INFO:teuthology.orchestra.run.smithi078.stdout: 265854 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 18 13:24 /home/ubuntu/cephtest 2024-09-18T13:24:44.292 INFO:teuthology.orchestra.run.smithi078.stdout: 531236 4 d--------- 2 ubuntu ubuntu 4096 Sep 18 12:46 /home/ubuntu/cephtest/mnt.0 2024-09-18T13:24:44.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:24:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-18T13:24:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-18T13:24:44.293 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi078 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-18T13:24:44.293 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-18T13:24:44.305 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-18T13:24:44.327 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-18T13:24:44.330 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 3129.6540851593018 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_gabrioux@teuthology status: fail success: false 2024-09-18T13:24:44.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T13:24:44.405 INFO:teuthology.run:FAIL